2026-02-23T06:13:07.624 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-23T06:13:07.670 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T06:13:07.770 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial/64975 branch: wip-vshankar-testing-20260222.101816 description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_entire_dirfrags/no prefetch_oft_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} email: vshankar@redhat.com first_in_suite: false flavor: default job_id: '64975' kernel: client: branch: testing flavor: default kdb: 1 sha1: 8dec4b357aab872d3b63ec979924962a64be83dd sha1: 8dec4b357aab872d3b63ec979924962a64be83dd ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20260222.101816 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 1 session_timeout: 300 cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: false osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client_shutdown_timeout: 120 global: ms die on skipped message: false mds: mds oft prefetch dirfrags: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 filestore flush min: 0 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - Degraded data redundancy - is down - osds down - pg .*? is .*?degraded.*?, acting - pg .*? is stuck - pg degraded - PG_BACKFILL_FULL - Low space hindering backfill .*? backfill_toofull - OSD_ROOT_DOWN - pgs degraded - pgs undersized - is active.*backfill_toofull.* - overall HEALTH_ - \(MON_DOWN\) - SLOW_OPS - slow request sha1: b60f86513d744c550fab39595f0905abce2bdd7d ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: b60f86513d744c550fab39595f0905abce2bdd7d kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20260222.101816 sha1: b60f86513d744c550fab39595f0905abce2bdd7d owner: scheduled_vshankar@soko04.front.sepia.ceph.com priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 9225 sha1: b60f86513d744c550fab39595f0905abce2bdd7d sleep_before_teardown: 0 subset: 213/1024 suite: fs suite_branch: wip-vshankar-testing-20260222.101816 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_b60f86513d744c550fab39595f0905abce2bdd7d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: b60f86513d744c550fab39595f0905abce2bdd7d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial058.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLr0ybXQP1GbjOLYxQS/M8nym9RfhbagIZnf7M46JEV5x541rxUhmydmSZl+FSYW0XcKmnaUTTkI9xpoCth6l3E= trial093.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDHO3ZKUzuTjY7g426pFtA+oE5/QOsXRPNEWlOWXyKoPwhUCNMl6geIpXkfkqPwZJD+GPq9wfyfxWqYuu1K2YSI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - mon_thrash: check_mds_failover: true revive_delay: 20 thrash_delay: 10 - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-23_04:04:18 tube: trial user: vshankar verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3318653 2026-02-23T06:13:07.770 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_b60f86513d744c550fab39595f0905abce2bdd7d/qa; will attempt to use it 2026-02-23T06:13:07.770 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_b60f86513d744c550fab39595f0905abce2bdd7d/qa/tasks 2026-02-23T06:13:07.770 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-23T06:13:07.774 INFO:teuthology.task.internal:Checking packages... 2026-02-23T06:13:07.774 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b60f86513d744c550fab39595f0905abce2bdd7d' 2026-02-23T06:13:07.774 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-23T06:13:07.774 INFO:teuthology.packaging:ref: None 2026-02-23T06:13:07.774 INFO:teuthology.packaging:tag: None 2026-02-23T06:13:07.774 INFO:teuthology.packaging:branch: wip-vshankar-testing-20260222.101816 2026-02-23T06:13:07.774 INFO:teuthology.packaging:sha1: b60f86513d744c550fab39595f0905abce2bdd7d 2026-02-23T06:13:07.774 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20260222.101816 2026-02-23T06:13:07.894 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5449.gb60f8651 2026-02-23T06:13:07.896 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-23T06:13:07.907 INFO:teuthology.task.internal:no buildpackages task found 2026-02-23T06:13:07.907 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-23T06:13:07.922 INFO:teuthology.task.internal:Saving configuration 2026-02-23T06:13:07.940 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-23T06:13:07.951 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-23T06:13:08.026 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial058.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial/64975', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-23 06:09:43.524986', 'locked_by': 'scheduled_vshankar@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLr0ybXQP1GbjOLYxQS/M8nym9RfhbagIZnf7M46JEV5x541rxUhmydmSZl+FSYW0XcKmnaUTTkI9xpoCth6l3E='} 2026-02-23T06:13:08.082 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial093.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial/64975', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-23 06:09:43.524371', 'locked_by': 'scheduled_vshankar@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDHO3ZKUzuTjY7g426pFtA+oE5/QOsXRPNEWlOWXyKoPwhUCNMl6geIpXkfkqPwZJD+GPq9wfyfxWqYuu1K2YSI='} 2026-02-23T06:13:08.082 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-23T06:13:08.094 INFO:teuthology.task.internal:roles: ubuntu@trial058.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2026-02-23T06:13:08.094 INFO:teuthology.task.internal:roles: ubuntu@trial093.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2026-02-23T06:13:08.094 INFO:teuthology.run_tasks:Running task console_log... 2026-02-23T06:13:08.231 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ed5dcfdaa20>, signals=[15]) 2026-02-23T06:13:08.231 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-23T06:13:08.247 INFO:teuthology.task.internal:Opening connections... 2026-02-23T06:13:08.247 DEBUG:teuthology.task.internal:connecting to ubuntu@trial058.front.sepia.ceph.com 2026-02-23T06:13:08.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial058.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T06:13:08.311 DEBUG:teuthology.task.internal:connecting to ubuntu@trial093.front.sepia.ceph.com 2026-02-23T06:13:08.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T06:13:08.373 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-23T06:13:08.384 DEBUG:teuthology.orchestra.run.trial058:> uname -m 2026-02-23T06:13:08.400 INFO:teuthology.orchestra.run.trial058.stdout:x86_64 2026-02-23T06:13:08.400 DEBUG:teuthology.orchestra.run.trial058:> cat /etc/os-release 2026-02-23T06:13:08.456 INFO:teuthology.orchestra.run.trial058.stdout:NAME="CentOS Stream" 2026-02-23T06:13:08.456 INFO:teuthology.orchestra.run.trial058.stdout:VERSION="9" 2026-02-23T06:13:08.456 INFO:teuthology.orchestra.run.trial058.stdout:ID="centos" 2026-02-23T06:13:08.456 INFO:teuthology.orchestra.run.trial058.stdout:ID_LIKE="rhel fedora" 2026-02-23T06:13:08.456 INFO:teuthology.orchestra.run.trial058.stdout:VERSION_ID="9" 2026-02-23T06:13:08.456 INFO:teuthology.orchestra.run.trial058.stdout:PLATFORM_ID="platform:el9" 2026-02-23T06:13:08.456 INFO:teuthology.orchestra.run.trial058.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-23T06:13:08.456 INFO:teuthology.orchestra.run.trial058.stdout:ANSI_COLOR="0;31" 2026-02-23T06:13:08.456 INFO:teuthology.orchestra.run.trial058.stdout:LOGO="fedora-logo-icon" 2026-02-23T06:13:08.456 INFO:teuthology.orchestra.run.trial058.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-23T06:13:08.456 INFO:teuthology.orchestra.run.trial058.stdout:HOME_URL="https://centos.org/" 2026-02-23T06:13:08.456 INFO:teuthology.orchestra.run.trial058.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-23T06:13:08.456 INFO:teuthology.orchestra.run.trial058.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-23T06:13:08.456 INFO:teuthology.orchestra.run.trial058.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-23T06:13:08.457 INFO:teuthology.lock.ops:Updating trial058.front.sepia.ceph.com on lock server 2026-02-23T06:13:08.527 DEBUG:teuthology.orchestra.run.trial093:> uname -m 2026-02-23T06:13:08.543 INFO:teuthology.orchestra.run.trial093.stdout:x86_64 2026-02-23T06:13:08.543 DEBUG:teuthology.orchestra.run.trial093:> cat /etc/os-release 2026-02-23T06:13:08.599 INFO:teuthology.orchestra.run.trial093.stdout:NAME="CentOS Stream" 2026-02-23T06:13:08.599 INFO:teuthology.orchestra.run.trial093.stdout:VERSION="9" 2026-02-23T06:13:08.599 INFO:teuthology.orchestra.run.trial093.stdout:ID="centos" 2026-02-23T06:13:08.599 INFO:teuthology.orchestra.run.trial093.stdout:ID_LIKE="rhel fedora" 2026-02-23T06:13:08.599 INFO:teuthology.orchestra.run.trial093.stdout:VERSION_ID="9" 2026-02-23T06:13:08.599 INFO:teuthology.orchestra.run.trial093.stdout:PLATFORM_ID="platform:el9" 2026-02-23T06:13:08.599 INFO:teuthology.orchestra.run.trial093.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-23T06:13:08.599 INFO:teuthology.orchestra.run.trial093.stdout:ANSI_COLOR="0;31" 2026-02-23T06:13:08.599 INFO:teuthology.orchestra.run.trial093.stdout:LOGO="fedora-logo-icon" 2026-02-23T06:13:08.599 INFO:teuthology.orchestra.run.trial093.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-23T06:13:08.599 INFO:teuthology.orchestra.run.trial093.stdout:HOME_URL="https://centos.org/" 2026-02-23T06:13:08.599 INFO:teuthology.orchestra.run.trial093.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-23T06:13:08.600 INFO:teuthology.orchestra.run.trial093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-23T06:13:08.600 INFO:teuthology.orchestra.run.trial093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-23T06:13:08.600 INFO:teuthology.lock.ops:Updating trial093.front.sepia.ceph.com on lock server 2026-02-23T06:13:08.678 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-23T06:13:08.691 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-23T06:13:08.702 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-23T06:13:08.702 DEBUG:teuthology.orchestra.run.trial058:> test '!' -e /home/ubuntu/cephtest 2026-02-23T06:13:08.704 DEBUG:teuthology.orchestra.run.trial093:> test '!' -e /home/ubuntu/cephtest 2026-02-23T06:13:08.719 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-23T06:13:08.730 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-23T06:13:08.730 DEBUG:teuthology.orchestra.run.trial058:> test -z $(ls -A /var/lib/ceph) 2026-02-23T06:13:08.761 DEBUG:teuthology.orchestra.run.trial093:> test -z $(ls -A /var/lib/ceph) 2026-02-23T06:13:08.777 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-23T06:13:08.933 INFO:teuthology.run_tasks:Running task kernel... 2026-02-23T06:13:08.952 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing', 'flavor': 'default', 'kdb': 1, 'sha1': '8dec4b357aab872d3b63ec979924962a64be83dd'}, 'sha1': '8dec4b357aab872d3b63ec979924962a64be83dd'} 2026-02-23T06:13:08.952 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing', 'flavor': 'default', 'kdb': 1, 'sha1': '8dec4b357aab872d3b63ec979924962a64be83dd'}} 2026-02-23T06:13:08.952 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing', 'flavor': 'default', 'kdb': 1, 'sha1': '8dec4b357aab872d3b63ec979924962a64be83dd'}}, timeout 300 2026-02-23T06:13:08.953 DEBUG:teuthology.orchestra.run.trial058:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-23T06:13:08.967 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T06:13:08.968 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-23T06:13:08.968 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8dec4b357aab872d3b63ec979924962a64be83dd"... 2026-02-23T06:13:08.968 DEBUG:teuthology.orchestra.run.trial058:> uname -r 2026-02-23T06:13:09.023 INFO:teuthology.orchestra.run.trial058.stdout:5.14.0-681.el9.x86_64 2026-02-23T06:13:09.023 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-23T06:13:09.023 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2026-02-23T06:13:09.024 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-23T06:13:09.024 INFO:teuthology.packaging:ref: None 2026-02-23T06:13:09.024 INFO:teuthology.packaging:tag: None 2026-02-23T06:13:09.024 INFO:teuthology.packaging:branch: testing 2026-02-23T06:13:09.024 INFO:teuthology.packaging:sha1: 8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-23T06:13:09.024 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2026-02-23T06:13:09.173 DEBUG:teuthology.orchestra.run.trial058:> sudo yum upgrade -y linux-firmware 2026-02-23T06:13:10.286 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.9 MB 00:00 2026-02-23T06:13:13.539 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - AppStream 9.8 MB/s | 27 MB 00:02 2026-02-23T06:13:16.849 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - CRB 8.4 MB/s | 7.8 MB 00:00 2026-02-23T06:13:18.900 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 20 kB 00:01 2026-02-23T06:13:21.384 INFO:teuthology.orchestra.run.trial058.stdout:Extra Packages for Enterprise Linux 8.4 MB/s | 20 MB 00:02 2026-02-23T06:13:24.614 INFO:teuthology.orchestra.run.trial058.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-23T06:13:25.653 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-23T06:13:25.654 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-23T06:13:25.654 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-23T06:13:25.676 INFO:teuthology.task.kernel:Downloading kernel 8dec4b357aab872d3b63ec979924962a64be83dd on client.0... 2026-02-23T06:13:25.676 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-23T06:13:25.852 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/ 2026-02-23T06:13:25.853 DEBUG:teuthology.orchestra.run.trial058:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.19.0_g8dec4b357aab-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/ --input-file=- 2026-02-23T06:13:25.854 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@trial058.front.sepia.ceph.com to complete... 2026-02-23T06:13:37.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23 06:13:37 URL:https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/kernel-6.19.0_g8dec4b357aab-1.x86_64.rpm [387870085/387870085] -> "/tmp/kernel.x86_64.rpm" [1] 2026-02-23T06:13:37.815 INFO:teuthology.orchestra.run.trial058.stderr:FINISHED --2026-02-23 06:13:37-- 2026-02-23T06:13:37.815 INFO:teuthology.orchestra.run.trial058.stderr:Total wall clock time: 12s 2026-02-23T06:13:37.815 INFO:teuthology.orchestra.run.trial058.stderr:Downloaded: 1 files, 370M in 12s (31.7 MB/s) 2026-02-23T06:13:37.819 INFO:teuthology.task.kernel:Installing kernel 8dec4b357aab872d3b63ec979924962a64be83dd on client.0... 2026-02-23T06:13:37.820 DEBUG:teuthology.orchestra.run.trial058:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2026-02-23T06:13:38.950 INFO:teuthology.orchestra.run.trial058.stdout:Verifying... ######################################## 2026-02-23T06:13:39.001 INFO:teuthology.orchestra.run.trial058.stdout:Preparing... ######################################## 2026-02-23T06:13:39.018 INFO:teuthology.orchestra.run.trial058.stdout:Updating / installing... 2026-02-23T06:13:42.223 INFO:teuthology.orchestra.run.trial058.stdout:kernel-6.19.0_g8dec4b357aab-1 ######################################## 2026-02-23T06:13:59.264 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial058.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2026-02-23T06:13:59.264 DEBUG:teuthology.orchestra.run.trial058:> rpm -qlp /tmp/kernel.x86_64.rpm 2026-02-23T06:13:59.298 INFO:teuthology.orchestra.run.trial058.stdout:/boot/System.map-6.19.0-g8dec4b357aab 2026-02-23T06:13:59.298 INFO:teuthology.orchestra.run.trial058.stdout:/boot/config-6.19.0-g8dec4b357aab 2026-02-23T06:13:59.298 INFO:teuthology.orchestra.run.trial058.stdout:/boot/vmlinuz-6.19.0-g8dec4b357aab 2026-02-23T06:13:59.298 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab 2026-02-23T06:13:59.298 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/System.map 2026-02-23T06:13:59.298 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/config 2026-02-23T06:13:59.298 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel 2026-02-23T06:13:59.298 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch 2026-02-23T06:13:59.298 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86 2026-02-23T06:13:59.298 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto 2026-02-23T06:13:59.298 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/blowfish-x86_64.ko 2026-02-23T06:13:59.298 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2026-02-23T06:13:59.298 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2026-02-23T06:13:59.298 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-x86_64.ko 2026-02-23T06:13:59.298 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2026-02-23T06:13:59.298 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2026-02-23T06:13:59.298 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2026-02-23T06:13:59.299 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2026-02-23T06:13:59.299 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2026-02-23T06:13:59.299 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-avx2.ko 2026-02-23T06:13:59.299 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2026-02-23T06:13:59.299 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2026-02-23T06:13:59.299 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2026-02-23T06:13:59.299 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-x86_64.ko 2026-02-23T06:13:59.299 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel 2026-02-23T06:13:59.299 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu 2026-02-23T06:13:59.299 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu/mce 2026-02-23T06:13:59.299 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2026-02-23T06:13:59.299 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm 2026-02-23T06:13:59.299 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm-amd.ko 2026-02-23T06:13:59.299 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm-intel.ko 2026-02-23T06:13:59.299 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm.ko 2026-02-23T06:13:59.299 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto 2026-02-23T06:13:59.299 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/anubis.ko 2026-02-23T06:13:59.299 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/arc4.ko 2026-02-23T06:13:59.299 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx 2026-02-23T06:13:59.299 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_memcpy.ko 2026-02-23T06:13:59.299 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_pq.ko 2026-02-23T06:13:59.299 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_raid6_recov.ko 2026-02-23T06:13:59.299 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_tx.ko 2026-02-23T06:13:59.299 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_xor.ko 2026-02-23T06:13:59.299 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/raid6test.ko 2026-02-23T06:13:59.300 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/authenc.ko 2026-02-23T06:13:59.300 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/authencesn.ko 2026-02-23T06:13:59.300 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blake2b.ko 2026-02-23T06:13:59.300 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blowfish_common.ko 2026-02-23T06:13:59.300 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blowfish_generic.ko 2026-02-23T06:13:59.300 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/camellia_generic.ko 2026-02-23T06:13:59.300 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast5_generic.ko 2026-02-23T06:13:59.300 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast6_generic.ko 2026-02-23T06:13:59.300 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast_common.ko 2026-02-23T06:13:59.300 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/ccm.ko 2026-02-23T06:13:59.300 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cmac.ko 2026-02-23T06:13:59.300 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crc32-cryptoapi.ko 2026-02-23T06:13:59.300 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crypto_engine.ko 2026-02-23T06:13:59.300 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crypto_user.ko 2026-02-23T06:13:59.300 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/des_generic.ko 2026-02-23T06:13:59.300 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/dh_generic.ko 2026-02-23T06:13:59.300 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/echainiv.ko 2026-02-23T06:13:59.300 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/essiv.ko 2026-02-23T06:13:59.300 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/fcrypt.ko 2026-02-23T06:13:59.300 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/khazad.ko 2026-02-23T06:13:59.300 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5 2026-02-23T06:13:59.300 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5/krb5.ko 2026-02-23T06:13:59.300 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5enc.ko 2026-02-23T06:13:59.300 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/lz4.ko 2026-02-23T06:13:59.300 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/lz4hc.ko 2026-02-23T06:13:59.300 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/md4.ko 2026-02-23T06:13:59.301 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/michael_mic.ko 2026-02-23T06:13:59.301 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/pcbc.ko 2026-02-23T06:13:59.301 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/pcrypt.ko 2026-02-23T06:13:59.301 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/rmd160.ko 2026-02-23T06:13:59.301 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/seed.ko 2026-02-23T06:13:59.301 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/serpent_generic.ko 2026-02-23T06:13:59.301 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/tea.ko 2026-02-23T06:13:59.301 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/twofish_common.ko 2026-02-23T06:13:59.301 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/twofish_generic.ko 2026-02-23T06:13:59.301 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/wp512.ko 2026-02-23T06:13:59.301 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xcbc.ko 2026-02-23T06:13:59.301 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xor.ko 2026-02-23T06:13:59.301 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xxhash_generic.ko 2026-02-23T06:13:59.301 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers 2026-02-23T06:13:59.301 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi 2026-02-23T06:13:59.301 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/acpi_ipmi.ko 2026-02-23T06:13:59.301 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/acpi_pad.ko 2026-02-23T06:13:59.301 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/ec_sys.ko 2026-02-23T06:13:59.301 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/platform_profile.ko 2026-02-23T06:13:59.301 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/sbs.ko 2026-02-23T06:13:59.301 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/sbshc.ko 2026-02-23T06:13:59.301 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/video.ko 2026-02-23T06:13:59.301 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata 2026-02-23T06:13:59.301 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/acard-ahci.ko 2026-02-23T06:13:59.301 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/ahci_platform.ko 2026-02-23T06:13:59.302 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/ata_generic.ko 2026-02-23T06:13:59.302 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/libahci_platform.ko 2026-02-23T06:13:59.302 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_acpi.ko 2026-02-23T06:13:59.302 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ali.ko 2026-02-23T06:13:59.302 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_amd.ko 2026-02-23T06:13:59.302 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_artop.ko 2026-02-23T06:13:59.302 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_atiixp.ko 2026-02-23T06:13:59.302 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_atp867x.ko 2026-02-23T06:13:59.302 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cmd640.ko 2026-02-23T06:13:59.302 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cmd64x.ko 2026-02-23T06:13:59.302 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cypress.ko 2026-02-23T06:13:59.302 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_efar.ko 2026-02-23T06:13:59.302 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt366.ko 2026-02-23T06:13:59.302 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt37x.ko 2026-02-23T06:13:59.302 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt3x2n.ko 2026-02-23T06:13:59.302 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt3x3.ko 2026-02-23T06:13:59.302 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_it8213.ko 2026-02-23T06:13:59.302 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_it821x.ko 2026-02-23T06:13:59.302 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_jmicron.ko 2026-02-23T06:13:59.302 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_marvell.ko 2026-02-23T06:13:59.302 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_mpiix.ko 2026-02-23T06:13:59.302 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_netcell.ko 2026-02-23T06:13:59.302 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ninja32.ko 2026-02-23T06:13:59.302 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ns87410.ko 2026-02-23T06:13:59.302 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ns87415.ko 2026-02-23T06:13:59.302 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_oldpiix.ko 2026-02-23T06:13:59.303 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_opti.ko 2026-02-23T06:13:59.303 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_optidma.ko 2026-02-23T06:13:59.303 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pcmcia.ko 2026-02-23T06:13:59.303 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pdc2027x.ko 2026-02-23T06:13:59.303 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pdc202xx_old.ko 2026-02-23T06:13:59.303 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_piccolo.ko 2026-02-23T06:13:59.303 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_rdc.ko 2026-02-23T06:13:59.303 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sch.ko 2026-02-23T06:13:59.303 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_serverworks.ko 2026-02-23T06:13:59.303 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sil680.ko 2026-02-23T06:13:59.303 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sis.ko 2026-02-23T06:13:59.303 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sl82c105.ko 2026-02-23T06:13:59.303 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_triflex.ko 2026-02-23T06:13:59.303 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_via.ko 2026-02-23T06:13:59.303 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pdc_adma.ko 2026-02-23T06:13:59.303 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_inic162x.ko 2026-02-23T06:13:59.303 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_mv.ko 2026-02-23T06:13:59.303 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_nv.ko 2026-02-23T06:13:59.303 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_promise.ko 2026-02-23T06:13:59.303 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_qstor.ko 2026-02-23T06:13:59.303 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sil.ko 2026-02-23T06:13:59.303 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sil24.ko 2026-02-23T06:13:59.303 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sis.ko 2026-02-23T06:13:59.303 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_svw.ko 2026-02-23T06:13:59.303 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sx4.ko 2026-02-23T06:13:59.304 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_uli.ko 2026-02-23T06:13:59.304 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_via.ko 2026-02-23T06:13:59.304 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_vsc.ko 2026-02-23T06:13:59.304 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/auxdisplay 2026-02-23T06:13:59.304 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/auxdisplay/ks0108.ko 2026-02-23T06:13:59.304 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base 2026-02-23T06:13:59.304 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap 2026-02-23T06:13:59.304 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap/regmap-i2c.ko 2026-02-23T06:13:59.304 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap/regmap-mmio.ko 2026-02-23T06:13:59.304 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/bcma 2026-02-23T06:13:59.304 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/bcma/bcma.ko 2026-02-23T06:13:59.304 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block 2026-02-23T06:13:59.304 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/aoe 2026-02-23T06:13:59.304 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/aoe/aoe.ko 2026-02-23T06:13:59.304 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/brd.ko 2026-02-23T06:13:59.304 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/drbd 2026-02-23T06:13:59.304 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/drbd/drbd.ko 2026-02-23T06:13:59.304 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/floppy.ko 2026-02-23T06:13:59.304 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/loop.ko 2026-02-23T06:13:59.304 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/mtip32xx 2026-02-23T06:13:59.304 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/mtip32xx/mtip32xx.ko 2026-02-23T06:13:59.304 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/nbd.ko 2026-02-23T06:13:59.304 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/null_blk 2026-02-23T06:13:59.304 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/null_blk/null_blk.ko 2026-02-23T06:13:59.304 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/rbd.ko 2026-02-23T06:13:59.304 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/virtio_blk.ko 2026-02-23T06:13:59.304 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkback 2026-02-23T06:13:59.304 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkback/xen-blkback.ko 2026-02-23T06:13:59.305 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkfront.ko 2026-02-23T06:13:59.305 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/zram 2026-02-23T06:13:59.305 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/zram/zram.ko 2026-02-23T06:13:59.305 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char 2026-02-23T06:13:59.305 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hangcheck-timer.ko 2026-02-23T06:13:59.305 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random 2026-02-23T06:13:59.305 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/amd-rng.ko 2026-02-23T06:13:59.305 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/intel-rng.ko 2026-02-23T06:13:59.305 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/timeriomem-rng.ko 2026-02-23T06:13:59.305 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/via-rng.ko 2026-02-23T06:13:59.305 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/virtio-rng.ko 2026-02-23T06:13:59.305 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi 2026-02-23T06:13:59.305 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_devintf.ko 2026-02-23T06:13:59.305 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2026-02-23T06:13:59.305 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2026-02-23T06:13:59.305 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_si.ko 2026-02-23T06:13:59.305 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_ssif.ko 2026-02-23T06:13:59.305 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2026-02-23T06:13:59.305 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/lp.ko 2026-02-23T06:13:59.305 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/mwave 2026-02-23T06:13:59.305 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/mwave/mwave.ko 2026-02-23T06:13:59.305 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ppdev.ko 2026-02-23T06:13:59.305 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tlclk.ko 2026-02-23T06:13:59.305 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm 2026-02-23T06:13:59.305 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm.ko 2026-02-23T06:13:59.305 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_atmel.ko 2026-02-23T06:13:59.305 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_infineon.ko 2026-02-23T06:13:59.305 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_nsc.ko 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_tis.ko 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_tis_core.ko 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/uv_mmtimer.ko 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/virtio_console.ko 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/acpi-cpufreq.ko 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/p4-clockmod.ko 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/pcc-cpufreq.ko 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/powernow-k8.ko 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/speedstep-lib.ko 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp/ccp-crypto.ko 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp/ccp.ko 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_common 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/padlock-aes.ko 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/padlock-sha.ko 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/virtio 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/virtio/virtio_crypto.ko 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dca 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dca/dca.ko 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/devfreq 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/devfreq/governor_simpleondemand.ko 2026-02-23T06:13:59.306 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma 2026-02-23T06:13:59.307 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/dw 2026-02-23T06:13:59.307 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/dw/dw_dmac.ko 2026-02-23T06:13:59.307 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/ioat 2026-02-23T06:13:59.307 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/ioat/ioatdma.ko 2026-02-23T06:13:59.307 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac 2026-02-23T06:13:59.307 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/amd64_edac.ko 2026-02-23T06:13:59.307 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/e752x_edac.ko 2026-02-23T06:13:59.307 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/edac_mce_amd.ko 2026-02-23T06:13:59.307 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i3000_edac.ko 2026-02-23T06:13:59.307 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i3200_edac.ko 2026-02-23T06:13:59.307 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i5100_edac.ko 2026-02-23T06:13:59.307 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i5400_edac.ko 2026-02-23T06:13:59.307 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i7300_edac.ko 2026-02-23T06:13:59.307 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i7core_edac.ko 2026-02-23T06:13:59.307 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i82975x_edac.ko 2026-02-23T06:13:59.307 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/ie31200_edac.ko 2026-02-23T06:13:59.307 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/sb_edac.ko 2026-02-23T06:13:59.307 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/x38_edac.ko 2026-02-23T06:13:59.307 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware 2026-02-23T06:13:59.307 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware/edd.ko 2026-02-23T06:13:59.307 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware/iscsi_ibft.ko 2026-02-23T06:13:59.307 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio 2026-02-23T06:13:59.307 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio/gpio-ich.ko 2026-02-23T06:13:59.307 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio/gpio-viperboard.ko 2026-02-23T06:13:59.307 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid 2026-02-23T06:13:59.307 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-appleir.ko 2026-02-23T06:13:59.307 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-aureal.ko 2026-02-23T06:13:59.307 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-axff.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-dr.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-elecom.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-elo.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-emsff.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gaff.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gt683r.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gyration.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtek-kbd.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtek-mouse.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtekff.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-icade.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-keytouch.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-kye.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-lcpower.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-led.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-lenovo.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-multitouch.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-ortek.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-penmount.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-petalynx.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-picolcd.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-pl.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-plantronics.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-primax.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-rmi.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-arvo.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-common.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-isku.ko 2026-02-23T06:13:59.308 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-kone.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-koneplus.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-konepure.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-kovaplus.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-lua.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-pyra.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-ryos.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-savu.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-saitek.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-samsung.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sensor-hub.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sjoy.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sony.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-speedlink.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-steelseries.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sunplus.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-thrustmaster.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-tivo.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-tmff.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-topseed.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-twinhan.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-uclogic.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-waltop.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-wiimote.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-xinmo.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-zpff.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-zydacron.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/uhid.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/wacom.ko 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon 2026-02-23T06:13:59.309 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/abituguru.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/abituguru3.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/acpi_power_meter.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ad7414.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ad7418.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adc128d818.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1025.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1026.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1029.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1031.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm9240.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ads7828.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7410.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7411.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7462.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7470.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7475.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7x10.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/amc6821.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/applesmc.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asb100.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asc7621.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asus_atk0110.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/atxp1.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/coretemp.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/dell-smm-hwmon.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/dme1737.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ds1621.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ds620.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/emc1403.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/emc6w201.ko 2026-02-23T06:13:59.310 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f71805f.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f71882fg.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f75375s.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/fam15h_power.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/fschmd.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/g760a.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/g762.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/gl518sm.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/gl520sm.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/hwmon-vid.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/i5500_temp.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/i5k_amb.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ibmaem.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ibmpex.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ina209.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ina2xx.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/it87.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/k10temp.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/k8temp.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lineage-pem.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm63.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm73.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm75.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm77.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm78.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm80.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm83.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm85.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm87.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm90.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm92.ko 2026-02-23T06:13:59.311 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm93.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95234.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95241.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95245.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc2945.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4151.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4215.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4222.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4245.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4260.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4261.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max16065.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max1619.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max1668.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max197.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6639.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6650.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6697.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/mcp3021.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6683.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6775-core.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6775.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct7802.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pc87360.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pc87427.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pcf8591.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/adm1275.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/lm25066.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ltc2978.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max16064.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max34440.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max8688.ko 2026-02-23T06:13:59.312 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/pmbus.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/tps40422.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ucd9000.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ucd9200.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/zl6100.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/powr1220.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch5627.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch5636.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch56xx-common.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sht15.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sht21.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/shtc1.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sis5595.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47b397.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47m1.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47m192.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/thmc50.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp102.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp103.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp401.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp421.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/via-cputemp.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/via686a.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/vt1211.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/vt8231.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83627ehf.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83627hf.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83781d.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83791d.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83792d.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83793.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83795.ko 2026-02-23T06:13:59.313 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83l785ts.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83l786ng.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-amd756.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-amd8111.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-core.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-i801.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-isch.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-ismt.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-nforce2.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-parport.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-piix4.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-scmi.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-simtec.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-sis96x.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-via.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-viapro.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-viperboard.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-dev.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-mux.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-slave-eeprom.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-smbus.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-stub.ko 2026-02-23T06:13:59.314 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_cm.ko 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_core.ko 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_umad.ko 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_uverbs.ko 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/iw_cm.ko 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/rdma_cm.ko 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/rdma_ucm.ko 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/cxgb4 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx4 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx5 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mthca 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/ipoib 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/iser 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/isert 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srp 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srpt 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/emu10k1-gp.ko 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/fm801-gp.ko 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/gameport.ko 2026-02-23T06:13:59.315 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/joydev.ko 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/keyboard 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/keyboard/gpio_keys.ko 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/appletouch.ko 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/bcm5974.ko 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/cyapatp.ko 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/elan_i2c.ko 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/sermouse.ko 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/synaptics_i2c.ko 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/synaptics_usb.ko 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/vsxxxaa.ko 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/rmi4 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/rmi4/rmi_core.ko 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/altera_ps2.ko 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/arc_ps2.ko 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/serio_raw.ko 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/sparse-keymap.ko 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-blinkm.ko 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-lm3530.ko 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-lp3944.ko 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-ss4200.ko 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-camera.ko 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-timer.ko 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-transient.ko 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/bcache 2026-02-23T06:13:59.316 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/bcache/bcache.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-bio-prison.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-cache-smq.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-cache.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-crypt.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-delay.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-flakey.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-log-userspace.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-multipath.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-queue-length.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-raid.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-round-robin.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-service-time.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-switch.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-thin-pool.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-verity.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/linear.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/persistent-data 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid0.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid1.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid10.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid456.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptbase.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptctl.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptfc.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptlan.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptsas.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptscsih.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptspi.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/lpc_ich.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/lpc_sch.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/mfd-core.ko 2026-02-23T06:13:59.317 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/sm501.ko 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/viperboard.ko 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/vx855.ko 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/altera-stapl 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/apds9802als.ko 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/apds990x.ko 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/bh1770glc.ko 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/cb710 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/cb710/cb710.ko 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom/at24.ko 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom/max6875.ko 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/enclosure.ko 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/hpilo.ko 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/isl29003.ko 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/isl29020.ko 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei-me.ko 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei-txe.ko 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei.ko 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-gru 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-gru/gru.ko 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xp.ko 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xpc.ko 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xpnet.ko 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tifm_7xx1.ko 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tifm_core.ko 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tsl2550.ko 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_balloon.ko 2026-02-23T06:13:59.318 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_vmci 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/bonding 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/bonding/bonding.ko 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/b53 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/b53/b53_common.ko 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/bcm-sf2.ko 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6060.ko 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6xxx 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dummy.ko 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/eql.ko 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c59x.ko 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/typhoon.ko 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/8390.ko 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/adaptec 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/adaptec/starfire.ko 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/agere 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/agere/et131x.ko 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/alteon 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/alteon/acenic.ko 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/altera 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/altera/altera_tse.ko 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/amd8111e.ko 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/pcnet32.ko 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros 2026-02-23T06:13:59.319 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/alx 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1c 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1e 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/b44.ko 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2x 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/cnic.ko 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/genet 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/tg3.ko 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade/bna 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb3 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/libcxgb 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco/enic 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip 2026-02-23T06:13:59.320 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink/dl2k.ko 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink/sundance.ko 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dnet.ko 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex/benet 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ethoc.ko 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/fealnx.ko 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e100.ko 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000e 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/fm10k 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/i40e 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/iavf 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ice 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ice/ice.ko 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igb 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igb/igb.ko 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igbvf 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbe 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbevf 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth 2026-02-23T06:13:59.321 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth/libeth_xdp.ko 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie.ko 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie_adminq.ko 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie_fwlog.ko 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/jme.ko 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/skge.ko 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/sky2.ko 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5/core 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/micrel 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom/myri10ge 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/neterion 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/neterion/s2io.ko 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/nvidia 2026-02-23T06:13:59.322 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2026-02-23T06:13:59.323 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines 2026-02-23T06:13:59.323 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2026-02-23T06:13:59.323 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2026-02-23T06:13:59.323 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic 2026-02-23T06:13:59.323 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/netxen 2026-02-23T06:13:59.323 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2026-02-23T06:13:59.323 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2026-02-23T06:13:59.323 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qlcnic 2026-02-23T06:13:59.323 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2026-02-23T06:13:59.323 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rdc 2026-02-23T06:13:59.323 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rdc/r6040.ko 2026-02-23T06:13:59.323 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek 2026-02-23T06:13:59.323 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/8139cp.ko 2026-02-23T06:13:59.323 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/8139too.ko 2026-02-23T06:13:59.323 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/atp.ko 2026-02-23T06:13:59.323 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/r8169.ko 2026-02-23T06:13:59.323 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rocker 2026-02-23T06:13:59.323 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rocker/rocker.ko 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sfc 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sfc/sfc.ko 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/silan 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/silan/sc92031.ko 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis/sis190.ko 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis/sis900.ko 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/epic100.ko 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/cassini.ko 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/niu.ko 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/sungem.ko 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/sunhme.ko 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/tehuti 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ti 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ti/tlan.ko 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via/via-rhine.ko 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via/via-velocity.ko 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet/w5100.ko 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet/w5300.ko 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/xircom 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/geneve.ko 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ieee802154 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ieee802154/fakelb.ko 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ifb.ko 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ipvlan 2026-02-23T06:13:59.324 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ipvlan/ipvlan.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/macvlan.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/macvtap.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-bitbang.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-regmap.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mii.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/net_failover.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/netconsole.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/nlmon.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs/pcs-lynx.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs/pcs_xpcs.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/amd.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm-phy-lib.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm-phy-ptp.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm7xxx.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm87xx.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/broadcom.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/cicada.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/davicom.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/dp83640.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/et1011c.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/icplus.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/lxt.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/marvell.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/micrel.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/national.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/phy_package.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/phylink.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/qsemi.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/realtek 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/realtek/realtek.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/smsc.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/ste10Xp.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/vitesse.ko 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp 2026-02-23T06:13:59.325 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/bsd_comp.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_async.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_deflate.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_generic.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_mppe.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_synctty.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pppoe.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pppox.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pptp.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip/slhc.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip/slip.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/sungem_phy.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/tap.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_activebackup.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_broadcast.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_loadbalance.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_random.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_roundrobin.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/tun.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/veth.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/virtio_net.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vmxnet3 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vmxnet3/vmxnet3.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vxlan 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vxlan/vxlan.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netback 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netback/xen-netback.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netfront.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ntb 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ntb/ntb.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host/nvme-core.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host/nvme.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_cs.ko 2026-02-23T06:13:59.326 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_pc.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_serial.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/hotplug 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/pcie 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/pcie/aer_inject.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/xen-pcifront.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/i82092.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/pd6729.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/yenta_socket.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl/intel 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/wmi 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/wmi/wmi.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/acer-wmi.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/acerhdf.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/apple-gmux.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-laptop.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-nb-wmi.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-wmi.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/classmate-laptop.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/eeepc-laptop.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/eeepc-wmi.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/fujitsu-laptop.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/fujitsu-tablet.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/hdaps.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel/intel-rst.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel_ips.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/msi-wmi.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/mxm-wmi.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/panasonic-laptop.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/samsung-laptop.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/samsung-q10.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/topstar-laptop.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/toshiba_haps.ko 2026-02-23T06:13:59.327 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/wmi-bmof.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap/intel_rapl_common.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap/intel_rapl_msr.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps-gpio.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps-ldisc.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps_parport.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/pps_core.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp_kvm.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp_vmclock.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/atl 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/atl/amd_atl.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/fmpm.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-bq32k.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1286.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1307.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1374.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1511.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1553.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1672.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1742.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds2404.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds3232.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-em3027.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-fm3130.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-isl12022.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-isl1208.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m41t80.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m48t35.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m48t59.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-max6900.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-msm6242.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf2127.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf85063.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8523.ko 2026-02-23T06:13:59.328 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8563.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8583.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rp5c01.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rs5c372.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rv3029c2.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rx8025.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rx8581.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-stk17ta8.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-x1205.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-9xxx.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-sas.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-xxxx.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/BusLogic.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/a100u2w.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aacraid 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aacraid/aacraid.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/advansys.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/am53c974.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/arcmsr 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/arcmsr/arcmsr.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/atp870u.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/be2iscsi 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bfa 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bfa/bfa.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2fc 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2i 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2i/bnx2i.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ch.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/csiostor 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/csiostor/csiostor.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb3i 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb4i 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/dc395x.ko 2026-02-23T06:13:59.329 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/dmx3191d.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esas2r 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esas2r/esas2r.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esp_scsi.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe/fcoe.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe/libfcoe.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fnic 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fnic/fnic.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/hpsa.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/hptiop.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/initio.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ipr.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ips.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/isci 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/isci/isci.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/iscsi_tcp.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libfc 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libfc/libfc.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libiscsi.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libiscsi_tcp.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libsas 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libsas/libsas.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/lpfc 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/lpfc/lpfc.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mpt3sas 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvsas 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvsas/mvsas.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvumi.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pm8001 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pm8001/pm80xx.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pmcraid.ko 2026-02-23T06:13:59.330 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla1280.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla4xxx 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/raid_class.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_debug.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_fc.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_iscsi.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_sas.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_spi.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_srp.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ses.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/st.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/stex.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/sym53c8xx_2 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/virtio_scsi.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/vmw_pvscsi.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/wd719x.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ssb 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ssb/ssb.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/iscsi 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/loopback 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/loopback/tcm_loop.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_file.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_iblock.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_mod.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_pscsi.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_user.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/tcm_fc 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/tcm_fc/tcm_fc.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2026-02-23T06:13:59.331 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/platform_temperature_control.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_soc_slider.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/ipwireless 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/ipwireless/ipwireless.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/n_gsm.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/n_hdlc.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/nozomi.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/8250 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/8250/serial_cs.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/arc_uart.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/jsm 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/jsm/jsm.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/core 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/core/ufshcd-core.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/host 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/host/ufshcd-pci.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_aec.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_cif.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_pci_generic.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_sercos3.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/cdc-acm.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/cdc-wdm.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/usblp.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/usbtmc.ko 2026-02-23T06:13:59.332 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/host 2026-02-23T06:13:59.333 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/host/sl811-hcd.ko 2026-02-23T06:13:59.333 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image 2026-02-23T06:13:59.333 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image/mdc800.ko 2026-02-23T06:13:59.333 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image/microtek.ko 2026-02-23T06:13:59.333 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc 2026-02-23T06:13:59.333 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/adutux.ko 2026-02-23T06:13:59.333 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/appledisplay.ko 2026-02-23T06:13:59.333 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/emi26.ko 2026-02-23T06:13:59.333 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/emi62.ko 2026-02-23T06:13:59.333 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/ezusb.ko 2026-02-23T06:13:59.333 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/idmouse.ko 2026-02-23T06:13:59.333 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/iowarrior.ko 2026-02-23T06:13:59.333 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/isight_firmware.ko 2026-02-23T06:13:59.333 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/ldusb.ko 2026-02-23T06:13:59.333 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/legousbtower.ko 2026-02-23T06:13:59.333 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/sisusbvga 2026-02-23T06:13:59.333 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2026-02-23T06:13:59.333 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/trancevibrator.ko 2026-02-23T06:13:59.333 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usb3503.ko 2026-02-23T06:13:59.333 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usblcd.ko 2026-02-23T06:13:59.333 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usbsevseg.ko 2026-02-23T06:13:59.333 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/uss720.ko 2026-02-23T06:13:59.333 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/yurex.ko 2026-02-23T06:13:59.333 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/phy 2026-02-23T06:13:59.333 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/phy/phy-generic.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/aircable.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ark3116.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/belkin_sa.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ch341.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cp210x.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cyberjack.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cypress_m8.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/digi_acceleport.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/empeg.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ftdi_sio.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/garmin_gps.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/io_edgeport.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/io_ti.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ipaq.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ipw.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ir-usb.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/iuu_phoenix.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/keyspan.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/keyspan_pda.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/kl5kusb105.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/kobil_sct.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mct_u232.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mos7720.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mos7840.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/navman.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/omninet.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/opticon.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/option.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/oti6858.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/pl2303.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/qcaux.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/qcserial.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/quatech2.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/safe_serial.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/sierra.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/spcp8x5.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ssu100.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/symbolserial.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb-serial-simple.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb_debug.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb_wwan.ko 2026-02-23T06:13:59.334 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/visor.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/whiteheat.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/xsens_mt.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/uas.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-alauda.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-cypress.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-datafab.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-eneub6250.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-freecom.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-isd200.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-jumpshot.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-karma.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-onetouch.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-realtek.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-sddr09.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-sddr55.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-usbat.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/usb-storage.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/usbip-core.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/usbip-host.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/vhci-hcd.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci/vfio-pci-core.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci/vfio-pci.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/vfio.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/vfio_iommu_type1.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_iotlb.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_net.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_scsi.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/apple_bl.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/lcd.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/platform_lcd.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_balloon.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_mmio.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2026-02-23T06:13:59.335 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_ring.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters/ds2482.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters/ds2490.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2406.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2408.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2413.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2423.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2431.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2433.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2780.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2781.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds28e04.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_smem.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_therm.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/wire.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/alim1535_wdt.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/alim7101_wdt.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/f71808e_wdt.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/hpwdt.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/i6300esb.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/iTCO_vendor_support.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/iTCO_wdt.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ib700wdt.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ibmasr.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ie6xx_wdt.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/it8712f_wdt.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/it87_wdt.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/machzwd.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/nv_tco.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/pcwd_pci.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/pcwd_usb.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sch311x_wdt.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/softdog.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sp5100_tco.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/via_wdt.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83627hf_wdt.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83877f_wdt.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83977f_wdt.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/wdt_pci.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/xen_wdt.ko 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen 2026-02-23T06:13:59.336 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-acpi-processor.ko 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-evtchn.ko 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-gntalloc.ko 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-gntdev.ko 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-pciback 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-privcmd.ko 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xenfs 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xenfs/xenfs.ko 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/9p 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/9p/9p.ko 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/affs 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/affs/affs.ko 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/befs 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/befs/befs.ko 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/binfmt_misc.ko 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/btrfs 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/btrfs/btrfs.ko 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cachefiles 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cachefiles/cachefiles.ko 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ceph 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ceph/ceph.ko 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/coda 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/coda/coda.ko 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cramfs 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cramfs/cramfs.ko 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/dlm 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/dlm/dlm.ko 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ecryptfs 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ecryptfs/ecryptfs.ko 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/f2fs 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/f2fs/f2fs.ko 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/fat.ko 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/msdos.ko 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/vfat.ko 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse/cuse.ko 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse/fuse.ko 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/gfs2 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/gfs2/gfs2.ko 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfs 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfs/hfs.ko 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfsplus 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfsplus/hfsplus.ko 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/isofs 2026-02-23T06:13:59.337 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/isofs/isofs.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/jfs 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/jfs/jfs.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/lockd 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/lockd/lockd.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/minix 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/minix/minix.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/netfs 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/netfs/netfs.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/blocklayout 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/filelayout 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/flexfilelayout 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfs.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfsv3.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfsv4.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common/grace.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common/nfs_acl.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfsd 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfsd/nfsd.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nilfs2 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nilfs2/nilfs2.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-celtic.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-centeuro.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-croatian.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-cyrillic.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-gaelic.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-greek.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-iceland.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-inuit.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-roman.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-romanian.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-turkish.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1250.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1251.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1255.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp737.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp775.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp850.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp852.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp855.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp857.ko 2026-02-23T06:13:59.338 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp860.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp861.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp862.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp863.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp864.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp865.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp866.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp869.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp874.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp932.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp936.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp949.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp950.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_euc-jp.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-1.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-13.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-14.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-15.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-2.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-3.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-4.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-5.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-6.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-7.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-9.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-r.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-ru.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-u.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_ucs2_utils.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_utf8.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/cluster 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlm 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlmfs 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stack_user.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stackglue.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/overlayfs 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/overlayfs/overlay.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/pstore 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/pstore/ramoops.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/romfs 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/romfs/romfs.ko 2026-02-23T06:13:59.339 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/client 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/client/cifs.ko 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/common 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/common/cifs_md4.ko 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/squashfs 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/squashfs/squashfs.ko 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/udf 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/udf/udf.ko 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ufs 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ufs/ufs.ko 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/xfs 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/xfs/xfs.ko 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/rcu 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/rcu/rcutorture.ko 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/torture.ko 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/trace 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/trace/ring_buffer_benchmark.ko 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/asn1_encoder.ko 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc/crc-itu-t.ko 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc/crc8.ko 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libarc4.ko 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libblake2b.ko 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libdes.ko 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lru_cache.ko 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4/lz4_compress.ko 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4/lz4hc_compress.ko 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/math 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/math/cordic.ko 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/raid6 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/raid6/raid6_pq.ko 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/reed_solomon 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/reed_solomon/reed_solomon.ko 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_bm.ko 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_fsm.ko 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_kmp.ko 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/zstd 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/zstd/zstd_compress.ko 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/mm 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/mm/hwpoison-inject.ko 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan 2026-02-23T06:13:59.340 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/6lowpan.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_dest.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_fragment.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_hop.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_ipv6.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_mobility.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_routing.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_udp.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/garp.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/mrp.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/psnap.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/stp.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/8021q 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/8021q/8021q.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_fd.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_rdma.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_virtio.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/batman-adv 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/batman-adv/batman-adv.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/br_netfilter.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/bridge.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_802_3.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_among.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_arp.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_arpreply.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_dnat.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_ip.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_ip6.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_limit.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_log.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_mark.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_mark_m.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_nflog.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_pkttype.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_redirect.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_snat.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_stp.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_vlan.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ceph 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ceph/libceph.ko 2026-02-23T06:13:59.341 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core/failover.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core/pktgen.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dns_resolver 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dns_resolver/dns_resolver.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/dsa_core.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_brcm.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_dsa.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_none.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_trailer.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/6lowpan 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/ieee802154.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/ieee802154_socket.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ah4.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/esp4.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/fou.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/gre.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/inet_diag.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_gre.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_tunnel.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_vti.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ipcomp.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ipip.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/arpt_mangle.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_ECN.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_ah.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_bic.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_dctcp.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_diag.ko 2026-02-23T06:13:59.342 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_highspeed.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_htcp.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_hybla.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_illinois.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_lp.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_scalable.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_vegas.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_veno.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_westwood.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_yeah.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tunnel4.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/udp_diag.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/udp_tunnel.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/xfrm4_tunnel.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ah6.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/esp6.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/fou6.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_tunnel.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_udp_tunnel.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_vti.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ipcomp6.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_ah.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_frag.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_mh.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_rt.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/sit.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/tunnel6.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/xfrm6_tunnel.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/key 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/key/af_key.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_core.ko 2026-02-23T06:13:59.343 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_debugfs.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_eth.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ip.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ip6.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_netlink.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ppp.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/llc 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/llc/llc.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mac802154 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mac802154/mac802154.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mpls 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mpls/mpls_gso.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_list_set.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conncount.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack.ko 2026-02-23T06:13:59.344 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_amanda.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_broadcast.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_ftp.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_h323.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_irc.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_netlink.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_pptp.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_sane.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_sip.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_snmp.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_tftp.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_dup_netdev.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_flow_table.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_flow_table_inet.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_log_syslog.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_amanda.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_ftp.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_irc.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_sip.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_tftp.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_synproxy_core.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_tables.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_acct.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_log.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_osf.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_queue.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_chain_nat.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_compat.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_ct.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_dup_netdev.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_fib.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_fwd_netdev.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_hash.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_limit.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_log.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_masq.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_nat.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_numgen.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_queue.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_quota.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_redir.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_reject.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_reject_inet.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_socket.ko 2026-02-23T06:13:59.345 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_tunnel.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_AUDIT.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CHECKSUM.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CLASSIFY.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CONNSECMARK.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CT.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_DSCP.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_HL.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_HMARK.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_IDLETIMER.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_LED.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_LOG.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_MASQUERADE.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NETMAP.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NFLOG.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NFQUEUE.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_RATEEST.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_REDIRECT.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_SECMARK.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TCPMSS.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TEE.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TPROXY.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_addrtype.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_bpf.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cgroup.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cluster.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_comment.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connbytes.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connlabel.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connlimit.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connmark.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_conntrack.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cpu.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_dccp.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_devgroup.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_dscp.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ecn.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_esp.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_hashlimit.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_helper.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_hl.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ipcomp.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_iprange.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ipvs.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_l2tp.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_length.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_limit.ko 2026-02-23T06:13:59.346 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_mac.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_mark.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_multiport.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_nat.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_nfacct.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_osf.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_owner.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_physdev.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_pkttype.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_policy.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_quota.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_rateest.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_realm.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_recent.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_sctp.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_set.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_socket.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_state.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_statistic.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_string.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_tcpmss.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_time.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_u32.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netlink 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netlink/netlink_diag.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/nsh 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/nsh/nsh.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/openvswitch.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-geneve.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-gre.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-vxlan.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/packet 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/packet/af_packet_diag.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds_rdma.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds_tcp.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_csum.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_gact.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_mirred.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_nat.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_pedit.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_police.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_simple.ko 2026-02-23T06:13:59.347 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_skbedit.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_vlan.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_basic.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_bpf.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_flow.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_fw.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_route.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_u32.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_cmp.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_ipset.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_meta.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_nbyte.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_text.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_u32.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_choke.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_codel.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_drr.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_fq.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_gred.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_hfsc.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_hhf.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_htb.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_ingress.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_mqprio.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_mqprio_lib.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_multiq.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_netem.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_pie.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_plug.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_prio.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_qfq.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_red.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_sfb.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_sfq.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_tbf.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_teql.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp/sctp.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp/sctp_diag.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/sunrpc.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/xprtrdma 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc 2026-02-23T06:13:59.348 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc/tipc.ko 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc/tipc_diag.ko 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/unix 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/unix/unix_diag.ko 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock.ko 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock_diag.ko 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock_loopback.ko 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/xfrm 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/xfrm/xfrm_ipcomp.ko 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/encrypted-keys 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/trusted-keys 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/trusted-keys/trusted.ko 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt/lib 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt/lib/irqbypass.ko 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.alias 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.alias.bin 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.alias.bin 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.bin 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.modinfo 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.dep 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.dep.bin 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.devname 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.order 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.softdep 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.symbols 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.symbols.bin 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.weakdep 2026-02-23T06:13:59.349 INFO:teuthology.orchestra.run.trial058.stdout:/lib/modules/6.19.0-g8dec4b357aab/vmlinuz 2026-02-23T06:13:59.351 DEBUG:teuthology.task.kernel:get_image_version: 6.19.0-g8dec4b357aab 2026-02-23T06:13:59.351 DEBUG:teuthology.orchestra.run.trial058:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2026-02-23T06:13:59.372 INFO:teuthology.orchestra.run.trial058.stdout:postinstall scriptlet (using /bin/sh): 2026-02-23T06:13:59.372 INFO:teuthology.orchestra.run.trial058.stdout:if [ -x /usr/bin/kernel-install ]; then 2026-02-23T06:13:59.372 INFO:teuthology.orchestra.run.trial058.stdout: /usr/bin/kernel-install add 6.19.0-g8dec4b357aab /lib/modules/6.19.0-g8dec4b357aab/vmlinuz 2026-02-23T06:13:59.372 INFO:teuthology.orchestra.run.trial058.stdout:fi 2026-02-23T06:13:59.372 INFO:teuthology.orchestra.run.trial058.stdout:for file in vmlinuz System.map config; do 2026-02-23T06:13:59.372 INFO:teuthology.orchestra.run.trial058.stdout: if ! cmp --silent "/lib/modules/6.19.0-g8dec4b357aab/${file}" "/boot/${file}-6.19.0-g8dec4b357aab"; then 2026-02-23T06:13:59.372 INFO:teuthology.orchestra.run.trial058.stdout: cp "/lib/modules/6.19.0-g8dec4b357aab/${file}" "/boot/${file}-6.19.0-g8dec4b357aab" 2026-02-23T06:13:59.372 INFO:teuthology.orchestra.run.trial058.stdout: fi 2026-02-23T06:13:59.372 INFO:teuthology.orchestra.run.trial058.stdout:done 2026-02-23T06:13:59.372 INFO:teuthology.orchestra.run.trial058.stdout:if [ -d "/lib/modules/6.19.0-g8dec4b357aab/dtb" ] && \ 2026-02-23T06:13:59.372 INFO:teuthology.orchestra.run.trial058.stdout: ! diff -rq "/lib/modules/6.19.0-g8dec4b357aab/dtb" "/boot/dtb-6.19.0-g8dec4b357aab" >/dev/null 2>&1; then 2026-02-23T06:13:59.372 INFO:teuthology.orchestra.run.trial058.stdout: rm -rf "/boot/dtb-6.19.0-g8dec4b357aab" 2026-02-23T06:13:59.372 INFO:teuthology.orchestra.run.trial058.stdout: cp -r "/lib/modules/6.19.0-g8dec4b357aab/dtb" "/boot/dtb-6.19.0-g8dec4b357aab" 2026-02-23T06:13:59.372 INFO:teuthology.orchestra.run.trial058.stdout:fi 2026-02-23T06:13:59.372 INFO:teuthology.orchestra.run.trial058.stdout:if [ ! -e "/lib/modules/6.19.0-g8dec4b357aab/modules.dep" ]; then 2026-02-23T06:13:59.372 INFO:teuthology.orchestra.run.trial058.stdout: /usr/sbin/depmod 6.19.0-g8dec4b357aab 2026-02-23T06:13:59.372 INFO:teuthology.orchestra.run.trial058.stdout:fi 2026-02-23T06:13:59.372 INFO:teuthology.orchestra.run.trial058.stdout:preuninstall scriptlet (using /bin/sh): 2026-02-23T06:13:59.372 INFO:teuthology.orchestra.run.trial058.stdout:if [ -x /usr/bin/kernel-install ]; then 2026-02-23T06:13:59.372 INFO:teuthology.orchestra.run.trial058.stdout:kernel-install remove 6.19.0-g8dec4b357aab 2026-02-23T06:13:59.372 INFO:teuthology.orchestra.run.trial058.stdout:fi 2026-02-23T06:13:59.373 DEBUG:teuthology.orchestra.run.trial058:> sudo rpm -qi grub2-tools 2026-02-23T06:13:59.442 INFO:teuthology.orchestra.run.trial058.stdout:Name : grub2-tools 2026-02-23T06:13:59.442 INFO:teuthology.orchestra.run.trial058.stdout:Epoch : 1 2026-02-23T06:13:59.442 INFO:teuthology.orchestra.run.trial058.stdout:Version : 2.06 2026-02-23T06:13:59.442 INFO:teuthology.orchestra.run.trial058.stdout:Release : 120.el9 2026-02-23T06:13:59.442 INFO:teuthology.orchestra.run.trial058.stdout:Architecture: x86_64 2026-02-23T06:13:59.442 INFO:teuthology.orchestra.run.trial058.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-23T06:13:59.442 INFO:teuthology.orchestra.run.trial058.stdout:Group : Unspecified 2026-02-23T06:13:59.442 INFO:teuthology.orchestra.run.trial058.stdout:Size : 9108611 2026-02-23T06:13:59.442 INFO:teuthology.orchestra.run.trial058.stdout:License : GPLv3+ 2026-02-23T06:13:59.442 INFO:teuthology.orchestra.run.trial058.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-23T06:13:59.442 INFO:teuthology.orchestra.run.trial058.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-23T06:13:59.442 INFO:teuthology.orchestra.run.trial058.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-23T06:13:59.443 INFO:teuthology.orchestra.run.trial058.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-23T06:13:59.443 INFO:teuthology.orchestra.run.trial058.stdout:Packager : builder@centos.org 2026-02-23T06:13:59.443 INFO:teuthology.orchestra.run.trial058.stdout:Vendor : CentOS 2026-02-23T06:13:59.443 INFO:teuthology.orchestra.run.trial058.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-23T06:13:59.443 INFO:teuthology.orchestra.run.trial058.stdout:Summary : Support tools for GRUB. 2026-02-23T06:13:59.443 INFO:teuthology.orchestra.run.trial058.stdout:Description : 2026-02-23T06:13:59.443 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:13:59.443 INFO:teuthology.orchestra.run.trial058.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-23T06:13:59.443 INFO:teuthology.orchestra.run.trial058.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-23T06:13:59.443 INFO:teuthology.orchestra.run.trial058.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-23T06:13:59.443 INFO:teuthology.orchestra.run.trial058.stdout:hardware devices. 2026-02-23T06:13:59.443 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:13:59.443 INFO:teuthology.orchestra.run.trial058.stdout:This subpackage provides tools for support of all platforms. 2026-02-23T06:13:59.444 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-23T06:13:59.444 INFO:teuthology.task.kernel:Updating grub on trial058 to boot 6.19.0-g8dec4b357aab 2026-02-23T06:13:59.444 DEBUG:teuthology.orchestra.run.trial058:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-23T06:13:59.508 INFO:teuthology.orchestra.run.trial058.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-23T06:13:59.510 DEBUG:teuthology.orchestra.run.trial058:> sudo command -v grubby && echo yes || echo no 2026-02-23T06:13:59.574 INFO:teuthology.orchestra.run.trial058.stdout:/sbin/grubby 2026-02-23T06:13:59.575 INFO:teuthology.orchestra.run.trial058.stdout:yes 2026-02-23T06:13:59.576 DEBUG:teuthology.orchestra.run.trial058:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.19.0-g8dec4b357aab" | head -n 1 2026-02-23T06:13:59.639 INFO:teuthology.orchestra.run.trial058.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-6.19.0-g8dec4b357aab.conf 2026-02-23T06:13:59.640 DEBUG:teuthology.orchestra.run.trial058:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-6.19.0-g8dec4b357aab 2026-02-23T06:13:59.714 DEBUG:teuthology.orchestra.run.trial058:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-23T06:13:59.924 INFO:teuthology.orchestra.run.trial058.stderr:Generating grub configuration file ... 2026-02-23T06:13:59.992 INFO:teuthology.orchestra.run.trial058.stderr:Found linux image: /boot/vmlinuz-6.19.0-g8dec4b357aab 2026-02-23T06:13:59.999 INFO:teuthology.orchestra.run.trial058.stderr:Found initrd image: /boot/initramfs-6.19.0-g8dec4b357aab.img 2026-02-23T06:14:00.251 INFO:teuthology.orchestra.run.trial058.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-23T06:14:00.258 INFO:teuthology.orchestra.run.trial058.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-23T06:14:00.293 INFO:teuthology.orchestra.run.trial058.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-23T06:14:00.299 INFO:teuthology.orchestra.run.trial058.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-23T06:14:00.330 INFO:teuthology.orchestra.run.trial058.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-23T06:14:00.337 INFO:teuthology.orchestra.run.trial058.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-23T06:14:00.360 INFO:teuthology.orchestra.run.trial058.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-23T06:14:00.367 INFO:teuthology.orchestra.run.trial058.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-23T06:14:00.453 INFO:teuthology.orchestra.run.trial058.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-23T06:14:00.461 INFO:teuthology.orchestra.run.trial058.stderr:done 2026-02-23T06:14:00.464 DEBUG:teuthology.orchestra.run.trial058:> test -d /sys/firmware/efi 2026-02-23T06:14:00.480 DEBUG:teuthology.orchestra.run.trial058:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-23T06:14:00.544 INFO:teuthology.orchestra.run.trial058.stdout:/boot/efi/EFI/BOOT 2026-02-23T06:14:00.545 INFO:teuthology.orchestra.run.trial058.stdout:/boot/efi/EFI/centos 2026-02-23T06:14:00.546 DEBUG:teuthology.orchestra.run.trial058:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-23T06:14:00.612 INFO:teuthology.orchestra.run.trial058.stdout:no 2026-02-23T06:14:00.612 DEBUG:teuthology.orchestra.run.trial058:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-23T06:14:00.678 INFO:teuthology.orchestra.run.trial058.stdout:yes 2026-02-23T06:14:00.678 DEBUG:teuthology.orchestra.run.trial058:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-23T06:14:00.741 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial058 2026-02-23T06:14:00.742 DEBUG:teuthology.orchestra.run.trial058:> sudo bash -c ' 2026-02-23T06:14:00.742 DEBUG:teuthology.orchestra.run.trial058:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-23T06:14:00.742 DEBUG:teuthology.orchestra.run.trial058:> ' 2026-02-23T06:14:30.784 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-23T06:14:30.785 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial058.front.sepia.ceph.com' 2026-02-23T06:14:30.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial058.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T06:15:30.788 DEBUG:teuthology.orchestra.remote:timed out 2026-02-23T06:15:39.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial058.front.sepia.ceph.com' 2026-02-23T06:15:39.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial058.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T06:15:39.937 DEBUG:teuthology.orchestra.run.trial058:> true 2026-02-23T06:15:40.179 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial058.front.sepia.ceph.com' 2026-02-23T06:15:40.180 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.19.0-g8dec4b357aab"... 2026-02-23T06:15:40.180 DEBUG:teuthology.orchestra.run.trial058:> uname -r 2026-02-23T06:15:40.256 INFO:teuthology.orchestra.run.trial058.stdout:6.19.0-g8dec4b357aab 2026-02-23T06:15:40.256 DEBUG:teuthology.task.kernel:current kernel version is 6.19.0-g8dec4b357aab vs 6.19.0-g8dec4b357aab 2026-02-23T06:15:40.257 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-23T06:15:40.257 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-23T06:15:41.258 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2026-02-23T06:15:41.258 DEBUG:teuthology.orchestra.run.trial058:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-23T06:15:41.319 INFO:teuthology.orchestra.run.trial058.stdout:ttyS1 2026-02-23T06:15:41.350 DEBUG:teuthology.parallel:result is None 2026-02-23T06:15:41.350 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-23T06:15:41.359 INFO:teuthology.task.internal:Creating test directory... 2026-02-23T06:15:41.360 DEBUG:teuthology.orchestra.run.trial058:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-23T06:15:41.364 DEBUG:teuthology.orchestra.run.trial093:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-23T06:15:41.397 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-23T06:15:41.408 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-23T06:15:41.422 INFO:teuthology.task.internal:Creating archive directory... 2026-02-23T06:15:41.422 DEBUG:teuthology.orchestra.run.trial058:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-23T06:15:41.440 DEBUG:teuthology.orchestra.run.trial093:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-23T06:15:41.485 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-23T06:15:41.497 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-23T06:15:41.497 DEBUG:teuthology.orchestra.run.trial093:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-23T06:15:41.514 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T06:15:41.515 DEBUG:teuthology.orchestra.run.trial058:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-23T06:15:41.520 DEBUG:teuthology.orchestra.run.trial093:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-23T06:15:41.574 INFO:teuthology.orchestra.run.trial058.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T06:15:41.583 INFO:teuthology.orchestra.run.trial093.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T06:15:41.591 INFO:teuthology.orchestra.run.trial093.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T06:15:41.593 INFO:teuthology.orchestra.run.trial058.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T06:15:41.596 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-23T06:15:41.609 INFO:teuthology.task.internal:Configuring sudo... 2026-02-23T06:15:41.610 DEBUG:teuthology.orchestra.run.trial058:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-23T06:15:41.613 DEBUG:teuthology.orchestra.run.trial093:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-23T06:15:41.666 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-23T06:15:41.683 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-23T06:15:41.684 DEBUG:teuthology.orchestra.run.trial058:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-23T06:15:41.688 DEBUG:teuthology.orchestra.run.trial093:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-23T06:15:41.722 DEBUG:teuthology.orchestra.run.trial058:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-23T06:15:41.907 DEBUG:teuthology.orchestra.run.trial058:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-23T06:15:41.963 DEBUG:teuthology.orchestra.run.trial058:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-23T06:15:42.104 DEBUG:teuthology.orchestra.run.trial058:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-23T06:15:42.160 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:15:42.160 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-23T06:15:42.215 DEBUG:teuthology.orchestra.run.trial093:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-23T06:15:42.303 DEBUG:teuthology.orchestra.run.trial093:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-23T06:15:42.326 DEBUG:teuthology.orchestra.run.trial093:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-23T06:15:42.467 DEBUG:teuthology.orchestra.run.trial093:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-23T06:15:42.492 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-23T06:15:42.492 DEBUG:teuthology.orchestra.run.trial093:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-23T06:15:42.555 DEBUG:teuthology.orchestra.run.trial058:> sudo service rsyslog restart 2026-02-23T06:15:42.559 DEBUG:teuthology.orchestra.run.trial093:> sudo service rsyslog restart 2026-02-23T06:15:42.619 INFO:teuthology.orchestra.run.trial058.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-23T06:15:42.624 INFO:teuthology.orchestra.run.trial093.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-23T06:15:43.142 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-23T06:15:43.154 INFO:teuthology.task.internal:Starting timer... 2026-02-23T06:15:43.154 INFO:teuthology.run_tasks:Running task pcp... 2026-02-23T06:15:43.176 INFO:teuthology.run_tasks:Running task selinux... 2026-02-23T06:15:43.193 DEBUG:teuthology.orchestra.run.trial058:> sudo service auditd rotate 2026-02-23T06:15:43.259 INFO:teuthology.orchestra.run.trial058.stdout:Rotating logs: 2026-02-23T06:15:43.261 DEBUG:teuthology.orchestra.run.trial093:> sudo service auditd rotate 2026-02-23T06:15:43.292 INFO:teuthology.orchestra.run.trial093.stdout:Rotating logs: 2026-02-23T06:15:43.295 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-23T06:15:43.295 DEBUG:teuthology.orchestra.run.trial058:> /usr/sbin/getenforce 2026-02-23T06:15:43.333 INFO:teuthology.orchestra.run.trial058.stdout:Permissive 2026-02-23T06:15:43.333 DEBUG:teuthology.orchestra.run.trial093:> /usr/sbin/getenforce 2026-02-23T06:15:43.351 INFO:teuthology.orchestra.run.trial093.stdout:Permissive 2026-02-23T06:15:43.351 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial058.front.sepia.ceph.com': 'permissive', 'ubuntu@trial093.front.sepia.ceph.com': 'permissive'} 2026-02-23T06:15:43.351 DEBUG:teuthology.orchestra.run.trial058:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-23T06:15:43.430 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T06:15:43.431 DEBUG:teuthology.orchestra.run.trial093:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-23T06:15:43.458 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T06:15:43.459 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-23T06:15:43.459 DEBUG:teuthology.orchestra.run.trial058:> sudo /usr/sbin/setenforce permissive 2026-02-23T06:15:43.514 DEBUG:teuthology.orchestra.run.trial093:> sudo /usr/sbin/setenforce permissive 2026-02-23T06:15:43.539 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-23T06:15:43.555 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-23T06:15:43.568 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-23T06:15:43.569 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial058.front.sepia.ceph.com,trial093.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-23T06:19:29.039 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial058.front.sepia.ceph.com'), Remote(name='ubuntu@trial093.front.sepia.ceph.com')] 2026-02-23T06:19:29.048 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial058.front.sepia.ceph.com' 2026-02-23T06:19:29.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial058.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T06:19:29.163 DEBUG:teuthology.orchestra.run.trial058:> true 2026-02-23T06:19:29.265 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial058.front.sepia.ceph.com' 2026-02-23T06:19:29.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial093.front.sepia.ceph.com' 2026-02-23T06:19:29.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T06:19:29.369 DEBUG:teuthology.orchestra.run.trial093:> true 2026-02-23T06:19:29.445 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial093.front.sepia.ceph.com' 2026-02-23T06:19:29.445 INFO:teuthology.run_tasks:Running task clock... 2026-02-23T06:19:29.462 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-23T06:19:29.462 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-23T06:19:29.463 DEBUG:teuthology.orchestra.run.trial058:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-23T06:19:29.467 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-23T06:19:29.467 DEBUG:teuthology.orchestra.run.trial093:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-23T06:19:29.513 INFO:teuthology.orchestra.run.trial093.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-23T06:19:29.523 INFO:teuthology.orchestra.run.trial058.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-23T06:19:29.524 INFO:teuthology.orchestra.run.trial093.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-23T06:19:29.544 INFO:teuthology.orchestra.run.trial093.stderr:sudo: ntpd: command not found 2026-02-23T06:19:29.548 INFO:teuthology.orchestra.run.trial058.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-23T06:19:29.554 INFO:teuthology.orchestra.run.trial093.stdout:506 Cannot talk to daemon 2026-02-23T06:19:29.566 INFO:teuthology.orchestra.run.trial093.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-23T06:19:29.577 INFO:teuthology.orchestra.run.trial093.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-23T06:19:29.592 INFO:teuthology.orchestra.run.trial058.stderr:sudo: ntpd: command not found 2026-02-23T06:19:29.613 INFO:teuthology.orchestra.run.trial058.stdout:506 Cannot talk to daemon 2026-02-23T06:19:29.625 INFO:teuthology.orchestra.run.trial093.stderr:bash: line 1: ntpq: command not found 2026-02-23T06:19:29.630 INFO:teuthology.orchestra.run.trial093.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-23T06:19:29.630 INFO:teuthology.orchestra.run.trial093.stdout:=============================================================================== 2026-02-23T06:19:29.630 INFO:teuthology.orchestra.run.trial093.stdout:^? 144.202.62.209.vultruser> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-23T06:19:29.639 INFO:teuthology.orchestra.run.trial058.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-23T06:19:29.664 INFO:teuthology.orchestra.run.trial058.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-23T06:19:29.737 INFO:teuthology.orchestra.run.trial058.stderr:bash: line 1: ntpq: command not found 2026-02-23T06:19:29.755 INFO:teuthology.orchestra.run.trial058.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-23T06:19:29.755 INFO:teuthology.orchestra.run.trial058.stdout:=============================================================================== 2026-02-23T06:19:29.755 INFO:teuthology.orchestra.run.trial058.stdout:^? 144.202.62.209.vultruser> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-23T06:19:29.755 INFO:teuthology.orchestra.run.trial058.stdout:^? t1.time.bf1.yahoo.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-23T06:19:29.755 INFO:teuthology.orchestra.run.trial058.stdout:^? ntp6.kernfusion.at 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-23T06:19:29.755 INFO:teuthology.orchestra.run.trial058.stdout:^? perturb.org 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-23T06:19:29.757 INFO:teuthology.run_tasks:Running task install... 2026-02-23T06:19:29.771 DEBUG:teuthology.task.install:project ceph 2026-02-23T06:19:29.771 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b60f86513d744c550fab39595f0905abce2bdd7d'}} 2026-02-23T06:19:29.771 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b60f86513d744c550fab39595f0905abce2bdd7d'} 2026-02-23T06:19:29.771 INFO:teuthology.task.install:Using flavor: default 2026-02-23T06:19:29.781 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-23T06:19:29.781 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2026-02-23T06:19:29.782 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b60f86513d744c550fab39595f0905abce2bdd7d', 'tag': None, 'wait_for_package': False} 2026-02-23T06:19:29.783 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b60f86513d744c550fab39595f0905abce2bdd7d 2026-02-23T06:19:29.788 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b60f86513d744c550fab39595f0905abce2bdd7d', 'tag': None, 'wait_for_package': False} 2026-02-23T06:19:29.789 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b60f86513d744c550fab39595f0905abce2bdd7d 2026-02-23T06:19:29.979 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260222.101816/b60f86513d744c550fab39595f0905abce2bdd7d/centos/9/flavors/default/ 2026-02-23T06:19:29.979 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5449.gb60f8651 2026-02-23T06:19:29.989 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260222.101816/b60f86513d744c550fab39595f0905abce2bdd7d/centos/9/flavors/default/ 2026-02-23T06:19:29.989 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5449.gb60f8651 2026-02-23T06:19:30.147 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260222.101816/b60f86513d744c550fab39595f0905abce2bdd7d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260222.101816/b60f86513d744c550fab39595f0905abce2bdd7d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260222.101816/b60f86513d744c550fab39595f0905abce2bdd7d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-23T06:19:30.147 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:19:30.148 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-23T06:19:30.180 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260222.101816/b60f86513d744c550fab39595f0905abce2bdd7d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260222.101816/b60f86513d744c550fab39595f0905abce2bdd7d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260222.101816/b60f86513d744c550fab39595f0905abce2bdd7d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-23T06:19:30.180 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-23T06:19:30.180 DEBUG:teuthology.orchestra.run.trial093:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-23T06:19:30.203 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-23T06:19:30.204 DEBUG:teuthology.orchestra.run.trial058:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b60f86513d744c550fab39595f0905abce2bdd7d/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-23T06:19:30.207 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-23T06:19:30.207 DEBUG:teuthology.orchestra.run.trial093:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b60f86513d744c550fab39595f0905abce2bdd7d/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-23T06:19:30.274 DEBUG:teuthology.orchestra.run.trial093:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-23T06:19:30.301 DEBUG:teuthology.orchestra.run.trial058:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-23T06:19:30.346 DEBUG:teuthology.orchestra.run.trial093:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-23T06:19:30.378 DEBUG:teuthology.orchestra.run.trial058:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-23T06:19:30.411 INFO:teuthology.orchestra.run.trial093.stdout:check_obsoletes = 1 2026-02-23T06:19:30.413 DEBUG:teuthology.orchestra.run.trial093:> sudo yum clean all 2026-02-23T06:19:30.433 INFO:teuthology.orchestra.run.trial058.stdout:check_obsoletes = 1 2026-02-23T06:19:30.435 DEBUG:teuthology.orchestra.run.trial058:> sudo yum clean all 2026-02-23T06:19:30.569 INFO:teuthology.orchestra.run.trial093.stdout:41 files removed 2026-02-23T06:19:30.584 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-23T06:19:30.604 INFO:teuthology.orchestra.run.trial058.stdout:41 files removed 2026-02-23T06:19:30.622 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-23T06:19:30.852 INFO:teuthology.orchestra.run.trial093.stdout:ceph packages for x86_64 750 kB/s | 94 kB 00:00 2026-02-23T06:19:30.988 INFO:teuthology.orchestra.run.trial058.stdout:ceph packages for x86_64 744 kB/s | 94 kB 00:00 2026-02-23T06:19:30.994 INFO:teuthology.orchestra.run.trial093.stdout:ceph noarch packages 210 kB/s | 25 kB 00:00 2026-02-23T06:19:31.122 INFO:teuthology.orchestra.run.trial093.stdout:ceph source packages 19 kB/s | 2.1 kB 00:00 2026-02-23T06:19:31.132 INFO:teuthology.orchestra.run.trial058.stdout:ceph noarch packages 211 kB/s | 25 kB 00:00 2026-02-23T06:19:31.259 INFO:teuthology.orchestra.run.trial058.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-23T06:19:32.033 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.9 MB 00:00 2026-02-23T06:19:35.255 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-23T06:19:38.886 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 7.8 MB 00:01 2026-02-23T06:19:39.827 INFO:teuthology.orchestra.run.trial093.stdout:CentOS Stream 9 - BaseOS 1.0 MB/s | 8.9 MB 00:08 2026-02-23T06:19:39.879 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - Extras packages 108 kB/s | 20 kB 00:00 2026-02-23T06:19:40.276 INFO:teuthology.orchestra.run.trial058.stdout:Extra Packages for Enterprise Linux 61 MB/s | 20 MB 00:00 2026-02-23T06:19:43.043 INFO:teuthology.orchestra.run.trial093.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-23T06:19:44.437 INFO:teuthology.orchestra.run.trial058.stdout:lab-extras 1.5 MB/s | 50 kB 00:00 2026-02-23T06:19:45.709 INFO:teuthology.orchestra.run.trial058.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-23T06:19:45.709 INFO:teuthology.orchestra.run.trial058.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-23T06:19:45.715 INFO:teuthology.orchestra.run.trial058.stdout:Package NetworkManager-1:1.54.3-2.el9.x86_64 is already installed. 2026-02-23T06:19:45.715 INFO:teuthology.orchestra.run.trial058.stdout:Package iproute-6.17.0-2.el9.x86_64 is already installed. 2026-02-23T06:19:45.716 INFO:teuthology.orchestra.run.trial058.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-23T06:19:45.716 INFO:teuthology.orchestra.run.trial058.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-23T06:19:45.717 INFO:teuthology.orchestra.run.trial058.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-23T06:19:45.718 INFO:teuthology.orchestra.run.trial058.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-23T06:19:45.719 INFO:teuthology.orchestra.run.trial058.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-23T06:19:45.748 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-23T06:19:45.753 INFO:teuthology.orchestra.run.trial058.stdout:======================================================================================= 2026-02-23T06:19:45.753 INFO:teuthology.orchestra.run.trial058.stdout: Package Arch Version Repository Size 2026-02-23T06:19:45.753 INFO:teuthology.orchestra.run.trial058.stdout:======================================================================================= 2026-02-23T06:19:45.753 INFO:teuthology.orchestra.run.trial058.stdout:Installing: 2026-02-23T06:19:45.754 INFO:teuthology.orchestra.run.trial058.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-23T06:19:45.754 INFO:teuthology.orchestra.run.trial058.stdout: ceph x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 6.5 k 2026-02-23T06:19:45.754 INFO:teuthology.orchestra.run.trial058.stdout: ceph-base x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 5.2 M 2026-02-23T06:19:45.754 INFO:teuthology.orchestra.run.trial058.stdout: ceph-fuse x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 988 k 2026-02-23T06:19:45.754 INFO:teuthology.orchestra.run.trial058.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 147 k 2026-02-23T06:19:45.754 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 937 k 2026-02-23T06:19:45.754 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5449.gb60f8651.el9 ceph-noarch 184 k 2026-02-23T06:19:45.754 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5449.gb60f8651.el9 ceph-noarch 51 M 2026-02-23T06:19:45.754 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5449.gb60f8651.el9 ceph-noarch 7.4 M 2026-02-23T06:19:45.755 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-rook noarch 2:20.3.0-5449.gb60f8651.el9 ceph-noarch 50 k 2026-02-23T06:19:45.755 INFO:teuthology.orchestra.run.trial058.stdout: ceph-osd x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 166 k 2026-02-23T06:19:45.755 INFO:teuthology.orchestra.run.trial058.stdout: ceph-osd-classic x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 16 M 2026-02-23T06:19:45.755 INFO:teuthology.orchestra.run.trial058.stdout: ceph-radosgw x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 13 M 2026-02-23T06:19:45.755 INFO:teuthology.orchestra.run.trial058.stdout: ceph-test x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 78 M 2026-02-23T06:19:45.755 INFO:teuthology.orchestra.run.trial058.stdout: ceph-volume noarch 2:20.3.0-5449.gb60f8651.el9 ceph-noarch 301 k 2026-02-23T06:19:45.755 INFO:teuthology.orchestra.run.trial058.stdout: cephadm noarch 2:20.3.0-5449.gb60f8651.el9 ceph-noarch 1.0 M 2026-02-23T06:19:45.755 INFO:teuthology.orchestra.run.trial058.stdout: cephfs-mirror x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 243 k 2026-02-23T06:19:45.755 INFO:teuthology.orchestra.run.trial058.stdout: cephfs-shell x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 27 k 2026-02-23T06:19:45.755 INFO:teuthology.orchestra.run.trial058.stdout: cephfs-top noarch 2:20.3.0-5449.gb60f8651.el9 ceph-noarch 18 k 2026-02-23T06:19:45.755 INFO:teuthology.orchestra.run.trial058.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-23T06:19:45.755 INFO:teuthology.orchestra.run.trial058.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-23T06:19:45.756 INFO:teuthology.orchestra.run.trial058.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-23T06:19:45.756 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs-devel x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 37 k 2026-02-23T06:19:45.756 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs2 x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 908 k 2026-02-23T06:19:45.756 INFO:teuthology.orchestra.run.trial058.stdout: librados-devel x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 123 k 2026-02-23T06:19:45.756 INFO:teuthology.orchestra.run.trial058.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-23T06:19:45.756 INFO:teuthology.orchestra.run.trial058.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-23T06:19:45.756 INFO:teuthology.orchestra.run.trial058.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-23T06:19:45.756 INFO:teuthology.orchestra.run.trial058.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-23T06:19:45.756 INFO:teuthology.orchestra.run.trial058.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-23T06:19:45.756 INFO:teuthology.orchestra.run.trial058.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-23T06:19:45.756 INFO:teuthology.orchestra.run.trial058.stdout: python3-cephfs x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 204 k 2026-02-23T06:19:45.756 INFO:teuthology.orchestra.run.trial058.stdout: python3-rados x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 324 k 2026-02-23T06:19:45.757 INFO:teuthology.orchestra.run.trial058.stdout: python3-rbd x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 305 k 2026-02-23T06:19:45.757 INFO:teuthology.orchestra.run.trial058.stdout: python3-rgw x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 100 k 2026-02-23T06:19:45.757 INFO:teuthology.orchestra.run.trial058.stdout: rbd-fuse x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 84 k 2026-02-23T06:19:45.757 INFO:teuthology.orchestra.run.trial058.stdout: rbd-mirror x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 2.9 M 2026-02-23T06:19:45.757 INFO:teuthology.orchestra.run.trial058.stdout: rbd-nbd x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 172 k 2026-02-23T06:19:45.757 INFO:teuthology.orchestra.run.trial058.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-23T06:19:45.757 INFO:teuthology.orchestra.run.trial058.stdout:Upgrading: 2026-02-23T06:19:45.757 INFO:teuthology.orchestra.run.trial058.stdout: librados2 x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 3.5 M 2026-02-23T06:19:45.757 INFO:teuthology.orchestra.run.trial058.stdout: librbd1 x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 2.8 M 2026-02-23T06:19:45.757 INFO:teuthology.orchestra.run.trial058.stdout:Installing dependencies: 2026-02-23T06:19:45.757 INFO:teuthology.orchestra.run.trial058.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-23T06:19:45.757 INFO:teuthology.orchestra.run.trial058.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-23T06:19:45.757 INFO:teuthology.orchestra.run.trial058.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-23T06:19:45.758 INFO:teuthology.orchestra.run.trial058.stdout: ceph-common x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 24 M 2026-02-23T06:19:45.758 INFO:teuthology.orchestra.run.trial058.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5449.gb60f8651.el9 ceph-noarch 57 k 2026-02-23T06:19:45.758 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mds x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 2.4 M 2026-02-23T06:19:45.758 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5449.gb60f8651.el9 ceph-noarch 298 k 2026-02-23T06:19:45.758 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mon x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 5.0 M 2026-02-23T06:19:45.758 INFO:teuthology.orchestra.run.trial058.stdout: ceph-osd-crimson x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 19 M 2026-02-23T06:19:45.758 INFO:teuthology.orchestra.run.trial058.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5449.gb60f8651.el9 ceph-noarch 17 k 2026-02-23T06:19:45.758 INFO:teuthology.orchestra.run.trial058.stdout: ceph-selinux x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 25 k 2026-02-23T06:19:45.758 INFO:teuthology.orchestra.run.trial058.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-23T06:19:45.758 INFO:teuthology.orchestra.run.trial058.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-23T06:19:45.758 INFO:teuthology.orchestra.run.trial058.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-23T06:19:45.758 INFO:teuthology.orchestra.run.trial058.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-23T06:19:45.759 INFO:teuthology.orchestra.run.trial058.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-23T06:19:45.759 INFO:teuthology.orchestra.run.trial058.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-23T06:19:45.759 INFO:teuthology.orchestra.run.trial058.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-23T06:19:45.759 INFO:teuthology.orchestra.run.trial058.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-23T06:19:45.759 INFO:teuthology.orchestra.run.trial058.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-23T06:19:45.759 INFO:teuthology.orchestra.run.trial058.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-23T06:19:45.759 INFO:teuthology.orchestra.run.trial058.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-23T06:19:45.759 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 26 k 2026-02-23T06:19:45.759 INFO:teuthology.orchestra.run.trial058.stdout: libcephsqlite x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 159 k 2026-02-23T06:19:45.759 INFO:teuthology.orchestra.run.trial058.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-23T06:19:45.759 INFO:teuthology.orchestra.run.trial058.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-23T06:19:45.759 INFO:teuthology.orchestra.run.trial058.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-23T06:19:45.759 INFO:teuthology.orchestra.run.trial058.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-23T06:19:45.760 INFO:teuthology.orchestra.run.trial058.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-23T06:19:45.760 INFO:teuthology.orchestra.run.trial058.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-23T06:19:45.760 INFO:teuthology.orchestra.run.trial058.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-23T06:19:45.760 INFO:teuthology.orchestra.run.trial058.stdout: libradosstriper1 x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 248 k 2026-02-23T06:19:45.760 INFO:teuthology.orchestra.run.trial058.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-23T06:19:45.760 INFO:teuthology.orchestra.run.trial058.stdout: librgw2 x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 6.5 M 2026-02-23T06:19:45.760 INFO:teuthology.orchestra.run.trial058.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-23T06:19:45.760 INFO:teuthology.orchestra.run.trial058.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-23T06:19:45.760 INFO:teuthology.orchestra.run.trial058.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-23T06:19:45.760 INFO:teuthology.orchestra.run.trial058.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-23T06:19:45.760 INFO:teuthology.orchestra.run.trial058.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-23T06:19:45.760 INFO:teuthology.orchestra.run.trial058.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-23T06:19:45.760 INFO:teuthology.orchestra.run.trial058.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-23T06:19:45.761 INFO:teuthology.orchestra.run.trial058.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-23T06:19:45.761 INFO:teuthology.orchestra.run.trial058.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-23T06:19:45.761 INFO:teuthology.orchestra.run.trial058.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-23T06:19:45.761 INFO:teuthology.orchestra.run.trial058.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-23T06:19:45.761 INFO:teuthology.orchestra.run.trial058.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-23T06:19:45.761 INFO:teuthology.orchestra.run.trial058.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-23T06:19:45.761 INFO:teuthology.orchestra.run.trial058.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-23T06:19:45.761 INFO:teuthology.orchestra.run.trial058.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-23T06:19:45.761 INFO:teuthology.orchestra.run.trial058.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-23T06:19:45.762 INFO:teuthology.orchestra.run.trial058.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-23T06:19:45.762 INFO:teuthology.orchestra.run.trial058.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-23T06:19:45.762 INFO:teuthology.orchestra.run.trial058.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-23T06:19:45.762 INFO:teuthology.orchestra.run.trial058.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-23T06:19:45.762 INFO:teuthology.orchestra.run.trial058.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-23T06:19:45.762 INFO:teuthology.orchestra.run.trial058.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-23T06:19:45.762 INFO:teuthology.orchestra.run.trial058.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-23T06:19:45.762 INFO:teuthology.orchestra.run.trial058.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-23T06:19:45.762 INFO:teuthology.orchestra.run.trial058.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-23T06:19:45.762 INFO:teuthology.orchestra.run.trial058.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-23T06:19:45.763 INFO:teuthology.orchestra.run.trial058.stdout: python3-ceph-argparse x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 45 k 2026-02-23T06:19:45.763 INFO:teuthology.orchestra.run.trial058.stdout: python3-ceph-common x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 186 k 2026-02-23T06:19:45.763 INFO:teuthology.orchestra.run.trial058.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-23T06:19:45.763 INFO:teuthology.orchestra.run.trial058.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-23T06:19:45.763 INFO:teuthology.orchestra.run.trial058.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-23T06:19:45.763 INFO:teuthology.orchestra.run.trial058.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-23T06:19:45.763 INFO:teuthology.orchestra.run.trial058.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-23T06:19:45.763 INFO:teuthology.orchestra.run.trial058.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-23T06:19:45.763 INFO:teuthology.orchestra.run.trial058.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-23T06:19:45.763 INFO:teuthology.orchestra.run.trial058.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-23T06:19:45.763 INFO:teuthology.orchestra.run.trial058.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-23T06:19:45.763 INFO:teuthology.orchestra.run.trial058.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-23T06:19:45.764 INFO:teuthology.orchestra.run.trial058.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-23T06:19:45.764 INFO:teuthology.orchestra.run.trial058.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-23T06:19:45.764 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-23T06:19:45.764 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-23T06:19:45.764 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-23T06:19:45.764 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-23T06:19:45.764 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-23T06:19:45.764 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-23T06:19:45.764 INFO:teuthology.orchestra.run.trial058.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-23T06:19:45.764 INFO:teuthology.orchestra.run.trial058.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-23T06:19:45.764 INFO:teuthology.orchestra.run.trial058.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-23T06:19:45.764 INFO:teuthology.orchestra.run.trial058.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-23T06:19:45.765 INFO:teuthology.orchestra.run.trial058.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-23T06:19:45.765 INFO:teuthology.orchestra.run.trial058.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-23T06:19:45.765 INFO:teuthology.orchestra.run.trial058.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-23T06:19:45.765 INFO:teuthology.orchestra.run.trial058.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-23T06:19:45.765 INFO:teuthology.orchestra.run.trial058.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-23T06:19:45.765 INFO:teuthology.orchestra.run.trial058.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-23T06:19:45.765 INFO:teuthology.orchestra.run.trial058.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-23T06:19:45.765 INFO:teuthology.orchestra.run.trial058.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-23T06:19:45.765 INFO:teuthology.orchestra.run.trial058.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-23T06:19:45.766 INFO:teuthology.orchestra.run.trial058.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-23T06:19:45.766 INFO:teuthology.orchestra.run.trial058.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-23T06:19:45.766 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-23T06:19:45.766 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-23T06:19:45.766 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-23T06:19:45.766 INFO:teuthology.orchestra.run.trial058.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-23T06:19:45.766 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-23T06:19:45.766 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-23T06:19:45.766 INFO:teuthology.orchestra.run.trial058.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-23T06:19:45.766 INFO:teuthology.orchestra.run.trial058.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-23T06:19:45.766 INFO:teuthology.orchestra.run.trial058.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-23T06:19:45.766 INFO:teuthology.orchestra.run.trial058.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-23T06:19:45.766 INFO:teuthology.orchestra.run.trial058.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-23T06:19:45.767 INFO:teuthology.orchestra.run.trial058.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-23T06:19:45.767 INFO:teuthology.orchestra.run.trial058.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-23T06:19:45.767 INFO:teuthology.orchestra.run.trial058.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-23T06:19:45.767 INFO:teuthology.orchestra.run.trial058.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-23T06:19:45.767 INFO:teuthology.orchestra.run.trial058.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-23T06:19:45.767 INFO:teuthology.orchestra.run.trial058.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-23T06:19:45.767 INFO:teuthology.orchestra.run.trial058.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-23T06:19:45.767 INFO:teuthology.orchestra.run.trial058.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-23T06:19:45.767 INFO:teuthology.orchestra.run.trial058.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-23T06:19:45.767 INFO:teuthology.orchestra.run.trial058.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-23T06:19:45.767 INFO:teuthology.orchestra.run.trial058.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-23T06:19:45.767 INFO:teuthology.orchestra.run.trial058.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-23T06:19:45.767 INFO:teuthology.orchestra.run.trial058.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-23T06:19:45.768 INFO:teuthology.orchestra.run.trial058.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-23T06:19:45.768 INFO:teuthology.orchestra.run.trial058.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-23T06:19:45.768 INFO:teuthology.orchestra.run.trial058.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-23T06:19:45.768 INFO:teuthology.orchestra.run.trial058.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-23T06:19:45.768 INFO:teuthology.orchestra.run.trial058.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-23T06:19:45.768 INFO:teuthology.orchestra.run.trial058.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-23T06:19:45.768 INFO:teuthology.orchestra.run.trial058.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-23T06:19:45.768 INFO:teuthology.orchestra.run.trial058.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-23T06:19:45.768 INFO:teuthology.orchestra.run.trial058.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-23T06:19:45.768 INFO:teuthology.orchestra.run.trial058.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-23T06:19:45.768 INFO:teuthology.orchestra.run.trial058.stdout:Installing weak dependencies: 2026-02-23T06:19:45.768 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5449.gb60f8651.el9 ceph-noarch 22 k 2026-02-23T06:19:45.768 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs-daemon x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 39 k 2026-02-23T06:19:45.769 INFO:teuthology.orchestra.run.trial058.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-23T06:19:45.769 INFO:teuthology.orchestra.run.trial058.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-23T06:19:45.769 INFO:teuthology.orchestra.run.trial058.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-23T06:19:45.769 INFO:teuthology.orchestra.run.trial058.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-23T06:19:45.769 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:19:45.769 INFO:teuthology.orchestra.run.trial058.stdout:Transaction Summary 2026-02-23T06:19:45.769 INFO:teuthology.orchestra.run.trial058.stdout:======================================================================================= 2026-02-23T06:19:45.769 INFO:teuthology.orchestra.run.trial058.stdout:Install 174 Packages 2026-02-23T06:19:45.769 INFO:teuthology.orchestra.run.trial058.stdout:Upgrade 2 Packages 2026-02-23T06:19:45.769 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:19:45.770 INFO:teuthology.orchestra.run.trial058.stdout:Total download size: 330 M 2026-02-23T06:19:45.770 INFO:teuthology.orchestra.run.trial058.stdout:Downloading Packages: 2026-02-23T06:19:46.096 INFO:teuthology.orchestra.run.trial058.stdout:(1/176): ceph-20.3.0-5449.gb60f8651.el9.x86_64. 110 kB/s | 6.5 kB 00:00 2026-02-23T06:19:46.185 INFO:teuthology.orchestra.run.trial058.stdout:(2/176): ceph-fuse-20.3.0-5449.gb60f8651.el9.x8 11 MB/s | 988 kB 00:00 2026-02-23T06:19:46.221 INFO:teuthology.orchestra.run.trial058.stdout:(3/176): ceph-immutable-object-cache-20.3.0-544 4.0 MB/s | 147 kB 00:00 2026-02-23T06:19:46.381 INFO:teuthology.orchestra.run.trial058.stdout:(4/176): ceph-mds-20.3.0-5449.gb60f8651.el9.x86 15 MB/s | 2.4 MB 00:00 2026-02-23T06:19:46.397 INFO:teuthology.orchestra.run.trial058.stdout:(5/176): ceph-base-20.3.0-5449.gb60f8651.el9.x8 14 MB/s | 5.2 MB 00:00 2026-02-23T06:19:46.457 INFO:teuthology.orchestra.run.trial093.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 7.8 MB 00:01 2026-02-23T06:19:46.467 INFO:teuthology.orchestra.run.trial058.stdout:(6/176): ceph-mgr-20.3.0-5449.gb60f8651.el9.x86 11 MB/s | 937 kB 00:00 2026-02-23T06:19:46.518 INFO:teuthology.orchestra.run.trial058.stdout:(7/176): ceph-osd-20.3.0-5449.gb60f8651.el9.x86 3.2 MB/s | 166 kB 00:00 2026-02-23T06:19:46.634 INFO:teuthology.orchestra.run.trial058.stdout:(8/176): ceph-mon-20.3.0-5449.gb60f8651.el9.x86 21 MB/s | 5.0 MB 00:00 2026-02-23T06:19:47.116 INFO:teuthology.orchestra.run.trial058.stdout:(9/176): ceph-common-20.3.0-5449.gb60f8651.el9. 22 MB/s | 24 MB 00:01 2026-02-23T06:19:47.562 INFO:teuthology.orchestra.run.trial093.stdout:CentOS Stream 9 - Extras packages 52 kB/s | 20 kB 00:00 2026-02-23T06:19:47.612 INFO:teuthology.orchestra.run.trial058.stdout:(10/176): ceph-osd-crimson-20.3.0-5449.gb60f865 20 MB/s | 19 MB 00:00 2026-02-23T06:19:47.646 INFO:teuthology.orchestra.run.trial058.stdout:(11/176): ceph-osd-classic-20.3.0-5449.gb60f865 14 MB/s | 16 MB 00:01 2026-02-23T06:19:47.646 INFO:teuthology.orchestra.run.trial058.stdout:(12/176): ceph-selinux-20.3.0-5449.gb60f8651.el 743 kB/s | 25 kB 00:00 2026-02-23T06:19:47.681 INFO:teuthology.orchestra.run.trial058.stdout:(13/176): ceph-radosgw-20.3.0-5449.gb60f8651.el 24 MB/s | 13 MB 00:00 2026-02-23T06:19:47.683 INFO:teuthology.orchestra.run.trial058.stdout:(14/176): cephfs-mirror-20.3.0-5449.gb60f8651.e 6.5 MB/s | 243 kB 00:00 2026-02-23T06:19:47.693 INFO:teuthology.orchestra.run.trial058.stdout:(15/176): cephfs-shell-20.3.0-5449.gb60f8651.el 2.1 MB/s | 27 kB 00:00 2026-02-23T06:19:47.698 INFO:teuthology.orchestra.run.trial058.stdout:(16/176): libcephfs-daemon-20.3.0-5449.gb60f865 2.6 MB/s | 39 kB 00:00 2026-02-23T06:19:47.709 INFO:teuthology.orchestra.run.trial058.stdout:(17/176): libcephfs-devel-20.3.0-5449.gb60f8651 2.4 MB/s | 37 kB 00:00 2026-02-23T06:19:47.713 INFO:teuthology.orchestra.run.trial058.stdout:(18/176): libcephfs-proxy2-20.3.0-5449.gb60f865 1.7 MB/s | 26 kB 00:00 2026-02-23T06:19:47.742 INFO:teuthology.orchestra.run.trial058.stdout:(19/176): libcephfs2-20.3.0-5449.gb60f8651.el9. 27 MB/s | 908 kB 00:00 2026-02-23T06:19:47.746 INFO:teuthology.orchestra.run.trial058.stdout:(20/176): libcephsqlite-20.3.0-5449.gb60f8651.e 4.7 MB/s | 159 kB 00:00 2026-02-23T06:19:47.761 INFO:teuthology.orchestra.run.trial058.stdout:(21/176): librados-devel-20.3.0-5449.gb60f8651. 6.4 MB/s | 123 kB 00:00 2026-02-23T06:19:47.768 INFO:teuthology.orchestra.run.trial058.stdout:(22/176): libradosstriper1-20.3.0-5449.gb60f865 11 MB/s | 248 kB 00:00 2026-02-23T06:19:47.806 INFO:teuthology.orchestra.run.trial058.stdout:(23/176): python3-ceph-argparse-20.3.0-5449.gb6 1.2 MB/s | 45 kB 00:00 2026-02-23T06:19:47.849 INFO:teuthology.orchestra.run.trial058.stdout:(24/176): python3-ceph-common-20.3.0-5449.gb60f 4.3 MB/s | 186 kB 00:00 2026-02-23T06:19:47.892 INFO:teuthology.orchestra.run.trial058.stdout:(25/176): python3-cephfs-20.3.0-5449.gb60f8651. 4.6 MB/s | 204 kB 00:00 2026-02-23T06:19:47.937 INFO:teuthology.orchestra.run.trial058.stdout:(26/176): python3-rados-20.3.0-5449.gb60f8651.e 7.0 MB/s | 324 kB 00:00 2026-02-23T06:19:47.974 INFO:teuthology.orchestra.run.trial058.stdout:(27/176): librgw2-20.3.0-5449.gb60f8651.el9.x86 30 MB/s | 6.5 MB 00:00 2026-02-23T06:19:47.977 INFO:teuthology.orchestra.run.trial058.stdout:(28/176): python3-rbd-20.3.0-5449.gb60f8651.el9 7.5 MB/s | 305 kB 00:00 2026-02-23T06:19:47.991 INFO:teuthology.orchestra.run.trial058.stdout:(29/176): python3-rgw-20.3.0-5449.gb60f8651.el9 6.0 MB/s | 100 kB 00:00 2026-02-23T06:19:47.996 INFO:teuthology.orchestra.run.trial058.stdout:(30/176): rbd-fuse-20.3.0-5449.gb60f8651.el9.x8 4.4 MB/s | 84 kB 00:00 2026-02-23T06:19:48.038 INFO:teuthology.orchestra.run.trial058.stdout:(31/176): rbd-nbd-20.3.0-5449.gb60f8651.el9.x86 4.0 MB/s | 172 kB 00:00 2026-02-23T06:19:48.078 INFO:teuthology.orchestra.run.trial058.stdout:(32/176): ceph-grafana-dashboards-20.3.0-5449.g 1.4 MB/s | 57 kB 00:00 2026-02-23T06:19:48.094 INFO:teuthology.orchestra.run.trial058.stdout:(33/176): rbd-mirror-20.3.0-5449.gb60f8651.el9. 28 MB/s | 2.9 MB 00:00 2026-02-23T06:19:48.099 INFO:teuthology.orchestra.run.trial058.stdout:(34/176): ceph-mgr-cephadm-20.3.0-5449.gb60f865 8.8 MB/s | 184 kB 00:00 2026-02-23T06:19:48.517 INFO:teuthology.orchestra.run.trial058.stdout:(35/176): ceph-mgr-diskprediction-local-20.3.0- 18 MB/s | 7.4 MB 00:00 2026-02-23T06:19:48.553 INFO:teuthology.orchestra.run.trial058.stdout:(36/176): ceph-mgr-k8sevents-20.3.0-5449.gb60f8 626 kB/s | 22 kB 00:00 2026-02-23T06:19:48.601 INFO:teuthology.orchestra.run.trial058.stdout:(37/176): ceph-mgr-modules-core-20.3.0-5449.gb6 6.1 MB/s | 298 kB 00:00 2026-02-23T06:19:48.643 INFO:teuthology.orchestra.run.trial058.stdout:(38/176): ceph-mgr-rook-20.3.0-5449.gb60f8651.e 1.2 MB/s | 50 kB 00:00 2026-02-23T06:19:48.684 INFO:teuthology.orchestra.run.trial058.stdout:(39/176): ceph-prometheus-alerts-20.3.0-5449.gb 421 kB/s | 17 kB 00:00 2026-02-23T06:19:48.731 INFO:teuthology.orchestra.run.trial058.stdout:(40/176): ceph-volume-20.3.0-5449.gb60f8651.el9 6.2 MB/s | 301 kB 00:00 2026-02-23T06:19:48.794 INFO:teuthology.orchestra.run.trial058.stdout:(41/176): cephadm-20.3.0-5449.gb60f8651.el9.noa 16 MB/s | 1.0 MB 00:00 2026-02-23T06:19:48.836 INFO:teuthology.orchestra.run.trial058.stdout:(42/176): cephfs-top-20.3.0-5449.gb60f8651.el9. 436 kB/s | 18 kB 00:00 2026-02-23T06:19:49.379 INFO:teuthology.orchestra.run.trial058.stdout:(43/176): cryptsetup-2.8.1-3.el9.x86_64.rpm 648 kB/s | 351 kB 00:00 2026-02-23T06:19:49.752 INFO:teuthology.orchestra.run.trial058.stdout:(44/176): ceph-mgr-dashboard-20.3.0-5449.gb60f8 31 MB/s | 51 MB 00:01 2026-02-23T06:19:49.760 INFO:teuthology.orchestra.run.trial058.stdout:(45/176): hwloc-libs-2.4.1-6.el9.x86_64.rpm 5.5 MB/s | 2.1 MB 00:00 2026-02-23T06:19:49.839 INFO:teuthology.orchestra.run.trial058.stdout:(46/176): libatomic-11.5.0-14.el9.x86_64.rpm 291 kB/s | 23 kB 00:00 2026-02-23T06:19:49.918 INFO:teuthology.orchestra.run.trial058.stdout:(47/176): libconfig-1.7.2-9.el9.x86_64.rpm 913 kB/s | 72 kB 00:00 2026-02-23T06:19:50.016 INFO:teuthology.orchestra.run.trial058.stdout:(48/176): libgfortran-11.5.0-14.el9.x86_64.rpm 7.9 MB/s | 794 kB 00:00 2026-02-23T06:19:50.030 INFO:teuthology.orchestra.run.trial058.stdout:(49/176): ledmon-libs-1.1.0-3.el9.x86_64.rpm 146 kB/s | 40 kB 00:00 2026-02-23T06:19:50.098 INFO:teuthology.orchestra.run.trial058.stdout:(50/176): libquadmath-11.5.0-14.el9.x86_64.rpm 2.2 MB/s | 184 kB 00:00 2026-02-23T06:19:50.177 INFO:teuthology.orchestra.run.trial058.stdout:(51/176): mailcap-2.1.49-5.el9.noarch.rpm 423 kB/s | 33 kB 00:00 2026-02-23T06:19:50.248 INFO:teuthology.orchestra.run.trial058.stdout:(52/176): lksctp-tools-1.0.19-2.el9.x86_64.rpm 431 kB/s | 94 kB 00:00 2026-02-23T06:19:50.286 INFO:teuthology.orchestra.run.trial058.stdout:(53/176): nvme-cli-2.16-1.el9.x86_64.rpm 11 MB/s | 1.2 MB 00:00 2026-02-23T06:19:50.458 INFO:teuthology.orchestra.run.trial058.stdout:(54/176): ceph-test-20.3.0-5449.gb60f8651.el9.x 28 MB/s | 78 MB 00:02 2026-02-23T06:19:50.459 INFO:teuthology.orchestra.run.trial058.stdout:(55/176): pciutils-3.7.0-7.el9.x86_64.rpm 442 kB/s | 93 kB 00:00 2026-02-23T06:19:50.460 INFO:teuthology.orchestra.run.trial058.stdout:(56/176): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.4 MB/s | 253 kB 00:00 2026-02-23T06:19:50.542 INFO:teuthology.orchestra.run.trial058.stdout:(57/176): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2026-02-23T06:19:50.591 INFO:teuthology.orchestra.run.trial058.stdout:(58/176): python3-ply-3.11-14.el9.noarch.rpm 810 kB/s | 106 kB 00:00 2026-02-23T06:19:50.623 INFO:teuthology.orchestra.run.trial058.stdout:(59/176): python3-pyparsing-2.4.7-9.el9.noarch. 1.8 MB/s | 150 kB 00:00 2026-02-23T06:19:50.707 INFO:teuthology.orchestra.run.trial058.stdout:(60/176): python3-urllib3-1.26.5-7.el9.noarch.r 2.5 MB/s | 218 kB 00:00 2026-02-23T06:19:50.722 INFO:teuthology.orchestra.run.trial058.stdout:(61/176): python3-requests-2.25.1-10.el9.noarch 964 kB/s | 126 kB 00:00 2026-02-23T06:19:50.788 INFO:teuthology.orchestra.run.trial058.stdout:(62/176): unzip-6.0-59.el9.x86_64.rpm 2.2 MB/s | 182 kB 00:00 2026-02-23T06:19:50.894 INFO:teuthology.orchestra.run.trial058.stdout:(63/176): zip-3.0-35.el9.x86_64.rpm 1.5 MB/s | 266 kB 00:00 2026-02-23T06:19:51.059 INFO:teuthology.orchestra.run.trial058.stdout:(64/176): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 689 kB 00:00 2026-02-23T06:19:51.083 INFO:teuthology.orchestra.run.trial058.stdout:(65/176): bison-3.7.4-5.el9.x86_64.rpm 4.9 MB/s | 943 kB 00:00 2026-02-23T06:19:51.137 INFO:teuthology.orchestra.run.trial058.stdout:(66/176): python3-cryptography-36.0.1-5.el9.x86 1.8 MB/s | 1.2 MB 00:00 2026-02-23T06:19:51.176 INFO:teuthology.orchestra.run.trial058.stdout:(67/176): boost-program-options-1.75.0-13.el9.x 887 kB/s | 104 kB 00:00 2026-02-23T06:19:51.176 INFO:teuthology.orchestra.run.trial058.stdout:(68/176): elfutils-libelf-devel-0.194-1.el9.x86 844 kB/s | 79 kB 00:00 2026-02-23T06:19:51.248 INFO:teuthology.orchestra.run.trial058.stdout:(69/176): flexiblas-3.0.4-9.el9.x86_64.rpm 412 kB/s | 30 kB 00:00 2026-02-23T06:19:51.275 INFO:teuthology.orchestra.run.trial058.stdout:(70/176): flex-2.6.4-9.el9.x86_64.rpm 2.2 MB/s | 313 kB 00:00 2026-02-23T06:19:51.318 INFO:teuthology.orchestra.run.trial058.stdout:(71/176): flexiblas-openblas-openmp-3.0.4-9.el9 213 kB/s | 15 kB 00:00 2026-02-23T06:19:51.323 INFO:teuthology.orchestra.run.trial058.stdout:(72/176): libaio-devel-0.3.111-13.el9.x86_64.rp 232 kB/s | 11 kB 00:00 2026-02-23T06:19:51.413 INFO:teuthology.orchestra.run.trial058.stdout:(73/176): flexiblas-netlib-3.0.4-9.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2026-02-23T06:19:51.435 INFO:teuthology.orchestra.run.trial058.stdout:(74/176): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2026-02-23T06:19:51.436 INFO:teuthology.orchestra.run.trial058.stdout:(75/176): libnbd-1.20.3-4.el9.x86_64.rpm 1.4 MB/s | 164 kB 00:00 2026-02-23T06:19:51.504 INFO:teuthology.orchestra.run.trial058.stdout:(76/176): librabbitmq-0.11.0-7.el9.x86_64.rpm 496 kB/s | 45 kB 00:00 2026-02-23T06:19:51.572 INFO:teuthology.orchestra.run.trial058.stdout:(77/176): libstoragemgmt-1.10.1-1.el9.x86_64.rp 1.8 MB/s | 246 kB 00:00 2026-02-23T06:19:51.601 INFO:teuthology.orchestra.run.trial058.stdout:(78/176): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2026-02-23T06:19:51.647 INFO:teuthology.orchestra.run.trial058.stdout:(79/176): libuuid-devel-2.37.4-21.el9.x86_64.rp 329 kB/s | 25 kB 00:00 2026-02-23T06:19:51.664 INFO:teuthology.orchestra.run.trial058.stdout:(80/176): libtool-2.4.6-46.el9.x86_64.rpm 3.5 MB/s | 581 kB 00:00 2026-02-23T06:19:51.737 INFO:teuthology.orchestra.run.trial058.stdout:(81/176): libxslt-1.1.34-12.el9.x86_64.rpm 1.7 MB/s | 233 kB 00:00 2026-02-23T06:19:51.740 INFO:teuthology.orchestra.run.trial058.stdout:(82/176): libzstd-devel-1.5.5-1.el9.x86_64.rpm 551 kB/s | 51 kB 00:00 2026-02-23T06:19:51.794 INFO:teuthology.orchestra.run.trial058.stdout:(83/176): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.2 MB/s | 292 kB 00:00 2026-02-23T06:19:51.826 INFO:teuthology.orchestra.run.trial058.stdout:(84/176): openblas-0.3.29-1.el9.x86_64.rpm 489 kB/s | 42 kB 00:00 2026-02-23T06:19:51.852 INFO:teuthology.orchestra.run.trial058.stdout:(85/176): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2026-02-23T06:19:51.922 INFO:teuthology.orchestra.run.trial058.stdout:(86/176): perl-Thread-Queue-3.14-460.el9.noarch 315 kB/s | 22 kB 00:00 2026-02-23T06:19:52.012 INFO:teuthology.orchestra.run.trial058.stdout:(87/176): perl-threads-2.25-460.el9.x86_64.rpm 654 kB/s | 58 kB 00:00 2026-02-23T06:19:52.081 INFO:teuthology.orchestra.run.trial058.stdout:(88/176): openblas-openmp-0.3.29-1.el9.x86_64.r 18 MB/s | 5.3 MB 00:00 2026-02-23T06:19:52.114 INFO:teuthology.orchestra.run.trial058.stdout:(89/176): openssl-devel-3.5.5-1.el9.x86_64.rpm 17 MB/s | 4.8 MB 00:00 2026-02-23T06:19:52.114 INFO:teuthology.orchestra.run.trial058.stdout:(90/176): perl-threads-shared-1.61-460.el9.x86_ 435 kB/s | 45 kB 00:00 2026-02-23T06:19:52.228 INFO:teuthology.orchestra.run.trial058.stdout:(91/176): postgresql-private-libs-13.23-1.el9.x 1.2 MB/s | 138 kB 00:00 2026-02-23T06:19:52.263 INFO:teuthology.orchestra.run.trial058.stdout:(92/176): postgresql-13.23-1.el9.x86_64.rpm 8.9 MB/s | 1.6 MB 00:00 2026-02-23T06:19:52.298 INFO:teuthology.orchestra.run.trial058.stdout:(93/176): postgresql-contrib-13.23-1.el9.x86_64 4.8 MB/s | 903 kB 00:00 2026-02-23T06:19:52.448 INFO:teuthology.orchestra.run.trial058.stdout:(94/176): protobuf-3.14.0-17.el9.x86_64.rpm 5.4 MB/s | 1.0 MB 00:00 2026-02-23T06:19:52.521 INFO:teuthology.orchestra.run.trial058.stdout:(95/176): postgresql-server-13.23-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2026-02-23T06:19:52.539 INFO:teuthology.orchestra.run.trial058.stdout:(96/176): python3-colorama-0.4.6-3.el9.noarch.r 672 kB/s | 61 kB 00:00 2026-02-23T06:19:52.604 INFO:teuthology.orchestra.run.trial058.stdout:(97/176): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2026-02-23T06:19:52.660 INFO:teuthology.orchestra.run.trial058.stdout:(98/176): python3-devel-3.9.25-3.el9.x86_64.rpm 1.7 MB/s | 244 kB 00:00 2026-02-23T06:19:52.678 INFO:teuthology.orchestra.run.trial058.stdout:(99/176): python3-jinja2-2.11.3-8.el9.noarch.rp 1.7 MB/s | 249 kB 00:00 2026-02-23T06:19:52.692 INFO:teuthology.orchestra.run.trial058.stdout:(100/176): python3-jmespath-1.0.1-1.el9.noarch. 545 kB/s | 48 kB 00:00 2026-02-23T06:19:52.761 INFO:teuthology.orchestra.run.trial058.stdout:(101/176): python3-markupsafe-1.1.1-12.el9.x86_ 500 kB/s | 35 kB 00:00 2026-02-23T06:19:52.776 INFO:teuthology.orchestra.run.trial058.stdout:(102/176): python3-libstoragemgmt-1.10.1-1.el9. 1.5 MB/s | 177 kB 00:00 2026-02-23T06:19:52.871 INFO:teuthology.orchestra.run.trial058.stdout:(103/176): python3-lxml-4.6.5-3.el9.x86_64.rpm 6.4 MB/s | 1.2 MB 00:00 2026-02-23T06:19:52.936 INFO:teuthology.orchestra.run.trial058.stdout:(104/176): python3-numpy-f2py-1.23.5-2.el9.x86_ 2.7 MB/s | 442 kB 00:00 2026-02-23T06:19:52.965 INFO:teuthology.orchestra.run.trial058.stdout:(105/176): python3-packaging-20.9-5.el9.noarch. 822 kB/s | 77 kB 00:00 2026-02-23T06:19:53.071 INFO:teuthology.orchestra.run.trial058.stdout:(106/176): python3-numpy-1.23.5-2.el9.x86_64.rp 20 MB/s | 6.1 MB 00:00 2026-02-23T06:19:53.075 INFO:teuthology.orchestra.run.trial058.stdout:(107/176): python3-protobuf-3.14.0-17.el9.noarc 1.9 MB/s | 267 kB 00:00 2026-02-23T06:19:53.079 INFO:teuthology.orchestra.run.trial058.stdout:(108/176): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.4 MB/s | 159 kB 00:00 2026-02-23T06:19:53.167 INFO:teuthology.orchestra.run.trial058.stdout:(109/176): python3-requests-oauthlib-1.3.0-12.e 583 kB/s | 54 kB 00:00 2026-02-23T06:19:53.208 INFO:teuthology.orchestra.run.trial058.stdout:(110/176): python3-pyasn1-modules-0.4.8-6.el9.n 2.0 MB/s | 279 kB 00:00 2026-02-23T06:19:53.259 INFO:teuthology.orchestra.run.trial058.stdout:(111/176): python3-toml-0.10.2-6.el9.noarch.rpm 456 kB/s | 42 kB 00:00 2026-02-23T06:19:53.301 INFO:teuthology.orchestra.run.trial058.stdout:(112/176): python3-wcwidth-0.2.5-8.el9.noarch.r 478 kB/s | 44 kB 00:00 2026-02-23T06:19:53.371 INFO:teuthology.orchestra.run.trial058.stdout:(113/176): qatlib-service-25.08.0-2.el9.x86_64. 530 kB/s | 37 kB 00:00 2026-02-23T06:19:53.399 INFO:teuthology.orchestra.run.trial058.stdout:(114/176): qatlib-25.08.0-2.el9.x86_64.rpm 1.7 MB/s | 240 kB 00:00 2026-02-23T06:19:53.459 INFO:teuthology.orchestra.run.trial058.stdout:(115/176): qatzip-libs-1.3.1-1.el9.x86_64.rpm 756 kB/s | 66 kB 00:00 2026-02-23T06:19:53.538 INFO:teuthology.orchestra.run.trial058.stdout:(116/176): socat-1.7.4.1-8.el9.x86_64.rpm 2.1 MB/s | 303 kB 00:00 2026-02-23T06:19:53.550 INFO:teuthology.orchestra.run.trial058.stdout:(117/176): uuid-1.6.2-55.el9.x86_64.rpm 635 kB/s | 58 kB 00:00 2026-02-23T06:19:53.614 INFO:teuthology.orchestra.run.trial058.stdout:(118/176): python3-scipy-1.9.3-2.el9.x86_64.rpm 36 MB/s | 19 MB 00:00 2026-02-23T06:19:53.652 INFO:teuthology.orchestra.run.trial058.stdout:(119/176): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 843 kB/s | 96 kB 00:00 2026-02-23T06:19:53.659 INFO:teuthology.orchestra.run.trial058.stdout:(120/176): xmlsec1-1.2.29-13.el9.x86_64.rpm 1.7 MB/s | 189 kB 00:00 2026-02-23T06:19:53.707 INFO:teuthology.orchestra.run.trial058.stdout:(121/176): xmlsec1-openssl-1.2.29-13.el9.x86_64 978 kB/s | 90 kB 00:00 2026-02-23T06:19:53.745 INFO:teuthology.orchestra.run.trial058.stdout:(122/176): xmlstarlet-1.6.1-20.el9.x86_64.rpm 688 kB/s | 64 kB 00:00 2026-02-23T06:19:53.752 INFO:teuthology.orchestra.run.trial058.stdout:(123/176): zlib-devel-1.2.11-41.el9.x86_64.rpm 482 kB/s | 45 kB 00:00 2026-02-23T06:19:53.758 INFO:teuthology.orchestra.run.trial058.stdout:(124/176): lua-devel-5.4.4-4.el9.x86_64.rpm 438 kB/s | 22 kB 00:00 2026-02-23T06:19:53.793 INFO:teuthology.orchestra.run.trial058.stdout:(125/176): protobuf-compiler-3.14.0-17.el9.x86_ 18 MB/s | 862 kB 00:00 2026-02-23T06:19:58.040 INFO:teuthology.orchestra.run.trial093.stdout:Extra Packages for Enterprise Linux 1.9 MB/s | 20 MB 00:10 2026-02-23T06:19:58.775 INFO:teuthology.orchestra.run.trial058.stdout:(126/176): grpc-data-1.46.7-10.el9.noarch.rpm 3.9 kB/s | 19 kB 00:04 2026-02-23T06:19:58.789 INFO:teuthology.orchestra.run.trial058.stdout:(127/176): gperftools-libs-2.9.1-3.el9.x86_64.r 61 kB/s | 308 kB 00:05 2026-02-23T06:19:58.795 INFO:teuthology.orchestra.run.trial058.stdout:(128/176): abseil-cpp-20211102.0-4.el9.x86_64.r 109 kB/s | 551 kB 00:05 2026-02-23T06:19:58.795 INFO:teuthology.orchestra.run.trial058.stdout:(129/176): libarrow-doc-9.0.0-15.el9.noarch.rpm 4.1 MB/s | 25 kB 00:00 2026-02-23T06:19:58.800 INFO:teuthology.orchestra.run.trial058.stdout:(130/176): liboath-2.6.12-1.el9.x86_64.rpm 8.8 MB/s | 49 kB 00:00 2026-02-23T06:19:58.801 INFO:teuthology.orchestra.run.trial058.stdout:(131/176): libunwind-1.6.2-1.el9.x86_64.rpm 12 MB/s | 67 kB 00:00 2026-02-23T06:19:58.807 INFO:teuthology.orchestra.run.trial058.stdout:(132/176): luarocks-3.9.2-5.el9.noarch.rpm 22 MB/s | 151 kB 00:00 2026-02-23T06:19:58.823 INFO:teuthology.orchestra.run.trial058.stdout:(133/176): libarrow-9.0.0-15.el9.x86_64.rpm 92 MB/s | 4.4 MB 00:00 2026-02-23T06:19:58.825 INFO:teuthology.orchestra.run.trial058.stdout:(134/176): parquet-libs-9.0.0-15.el9.x86_64.rpm 34 MB/s | 838 kB 00:00 2026-02-23T06:19:58.828 INFO:teuthology.orchestra.run.trial058.stdout:(135/176): python3-asyncssh-2.13.2-5.el9.noarch 26 MB/s | 548 kB 00:00 2026-02-23T06:19:58.829 INFO:teuthology.orchestra.run.trial058.stdout:(136/176): python3-autocommand-2.2.2-8.el9.noar 4.9 MB/s | 29 kB 00:00 2026-02-23T06:19:58.832 INFO:teuthology.orchestra.run.trial058.stdout:(137/176): python3-backports-tarfile-1.2.0-1.el 9.0 MB/s | 60 kB 00:00 2026-02-23T06:19:58.834 INFO:teuthology.orchestra.run.trial058.stdout:(138/176): python3-bcrypt-3.2.2-1.el9.x86_64.rp 7.5 MB/s | 43 kB 00:00 2026-02-23T06:19:58.835 INFO:teuthology.orchestra.run.trial058.stdout:(139/176): python3-cachetools-4.2.4-1.el9.noarc 5.6 MB/s | 32 kB 00:00 2026-02-23T06:19:58.837 INFO:teuthology.orchestra.run.trial058.stdout:(140/176): python3-certifi-2023.05.07-4.el9.noa 2.8 MB/s | 14 kB 00:00 2026-02-23T06:19:58.843 INFO:teuthology.orchestra.run.trial058.stdout:(141/176): python3-cheroot-10.0.1-4.el9.noarch. 20 MB/s | 173 kB 00:00 2026-02-23T06:19:58.845 INFO:teuthology.orchestra.run.trial058.stdout:(142/176): python3-cherrypy-18.6.1-2.el9.noarch 36 MB/s | 358 kB 00:00 2026-02-23T06:19:58.846 INFO:teuthology.orchestra.run.trial058.stdout:(143/176): python3-cmd2-2.4.2-2.el9.noarch.rpm 32 MB/s | 303 kB 00:00 2026-02-23T06:19:58.851 INFO:teuthology.orchestra.run.trial058.stdout:(144/176): python3-google-auth-2.45.0-1.el9.noa 30 MB/s | 254 kB 00:00 2026-02-23T06:19:58.854 INFO:teuthology.orchestra.run.trial058.stdout:(145/176): python3-grpcio-tools-1.46.7-10.el9.x 20 MB/s | 144 kB 00:00 2026-02-23T06:19:58.859 INFO:teuthology.orchestra.run.trial058.stdout:(146/176): python3-influxdb-5.3.1-1.el9.noarch. 18 MB/s | 139 kB 00:00 2026-02-23T06:19:58.860 INFO:teuthology.orchestra.run.trial058.stdout:(147/176): python3-isodate-0.6.1-3.el9.noarch.r 8.9 MB/s | 56 kB 00:00 2026-02-23T06:19:58.866 INFO:teuthology.orchestra.run.trial058.stdout:(148/176): python3-grpcio-1.46.7-10.el9.x86_64. 98 MB/s | 2.0 MB 00:00 2026-02-23T06:19:58.866 INFO:teuthology.orchestra.run.trial058.stdout:(149/176): python3-jaraco-8.2.1-3.el9.noarch.rp 1.5 MB/s | 11 kB 00:00 2026-02-23T06:19:58.867 INFO:teuthology.orchestra.run.trial058.stdout:(150/176): python3-jaraco-classes-3.2.1-5.el9.n 2.6 MB/s | 18 kB 00:00 2026-02-23T06:19:58.871 INFO:teuthology.orchestra.run.trial058.stdout:(151/176): python3-jaraco-collections-3.0.0-8.e 4.1 MB/s | 23 kB 00:00 2026-02-23T06:19:58.872 INFO:teuthology.orchestra.run.trial058.stdout:(152/176): python3-jaraco-context-6.0.1-3.el9.n 3.4 MB/s | 20 kB 00:00 2026-02-23T06:19:58.872 INFO:teuthology.orchestra.run.trial058.stdout:(153/176): python3-jaraco-functools-3.5.0-2.el9 3.4 MB/s | 19 kB 00:00 2026-02-23T06:19:58.877 INFO:teuthology.orchestra.run.trial058.stdout:(154/176): python3-jaraco-text-4.0.0-2.el9.noar 4.6 MB/s | 26 kB 00:00 2026-02-23T06:19:58.878 INFO:teuthology.orchestra.run.trial058.stdout:(155/176): python3-more-itertools-8.12.0-2.el9. 14 MB/s | 79 kB 00:00 2026-02-23T06:19:58.884 INFO:teuthology.orchestra.run.trial058.stdout:(156/176): python3-msgpack-1.0.3-2.el9.x86_64.r 13 MB/s | 86 kB 00:00 2026-02-23T06:19:58.886 INFO:teuthology.orchestra.run.trial058.stdout:(157/176): python3-natsort-7.1.1-5.el9.noarch.r 8.1 MB/s | 58 kB 00:00 2026-02-23T06:19:58.889 INFO:teuthology.orchestra.run.trial058.stdout:(158/176): python3-portend-3.1.0-2.el9.noarch.r 3.0 MB/s | 16 kB 00:00 2026-02-23T06:19:58.892 INFO:teuthology.orchestra.run.trial058.stdout:(159/176): python3-pyOpenSSL-21.0.0-1.el9.noarc 14 MB/s | 90 kB 00:00 2026-02-23T06:19:58.895 INFO:teuthology.orchestra.run.trial058.stdout:(160/176): python3-pyperclip-1.8.2-2.el9.noarch 5.0 MB/s | 28 kB 00:00 2026-02-23T06:19:58.899 INFO:teuthology.orchestra.run.trial058.stdout:(161/176): python3-kubernetes-26.1.0-3.el9.noar 38 MB/s | 1.0 MB 00:00 2026-02-23T06:19:58.900 INFO:teuthology.orchestra.run.trial058.stdout:(162/176): python3-repoze-lru-0.7-16.el9.noarch 3.8 MB/s | 31 kB 00:00 2026-02-23T06:19:58.903 INFO:teuthology.orchestra.run.trial058.stdout:(163/176): python3-routes-2.5.1-5.el9.noarch.rp 24 MB/s | 188 kB 00:00 2026-02-23T06:19:58.906 INFO:teuthology.orchestra.run.trial058.stdout:(164/176): python3-rsa-4.9-2.el9.noarch.rpm 9.7 MB/s | 59 kB 00:00 2026-02-23T06:19:58.907 INFO:teuthology.orchestra.run.trial058.stdout:(165/176): python3-saml-1.16.0-1.el9.noarch.rpm 19 MB/s | 125 kB 00:00 2026-02-23T06:19:58.909 INFO:teuthology.orchestra.run.trial058.stdout:(166/176): python3-tempora-5.0.0-2.el9.noarch.r 6.3 MB/s | 36 kB 00:00 2026-02-23T06:19:58.912 INFO:teuthology.orchestra.run.trial058.stdout:(167/176): python3-typing-extensions-4.15.0-1.e 13 MB/s | 86 kB 00:00 2026-02-23T06:19:58.913 INFO:teuthology.orchestra.run.trial058.stdout:(168/176): python3-websocket-client-1.2.3-2.el9 14 MB/s | 90 kB 00:00 2026-02-23T06:19:58.915 INFO:teuthology.orchestra.run.trial058.stdout:(169/176): python3-xmlsec-1.3.13-1.el9.x86_64.r 8.3 MB/s | 48 kB 00:00 2026-02-23T06:19:58.918 INFO:teuthology.orchestra.run.trial058.stdout:(170/176): python3-xmltodict-0.12.0-15.el9.noar 4.1 MB/s | 22 kB 00:00 2026-02-23T06:19:58.918 INFO:teuthology.orchestra.run.trial058.stdout:(171/176): python3-zc-lockfile-2.0-10.el9.noarc 3.9 MB/s | 20 kB 00:00 2026-02-23T06:19:58.922 INFO:teuthology.orchestra.run.trial058.stdout:(172/176): re2-20211101-20.el9.x86_64.rpm 27 MB/s | 191 kB 00:00 2026-02-23T06:19:58.924 INFO:teuthology.orchestra.run.trial058.stdout:(173/176): yaml-cpp-0.6.3-5.el9.x86_64.rpm 23 MB/s | 122 kB 00:00 2026-02-23T06:19:58.933 INFO:teuthology.orchestra.run.trial058.stdout:(174/176): thrift-0.15.0-4.el9.x86_64.rpm 108 MB/s | 1.6 MB 00:00 2026-02-23T06:19:59.063 INFO:teuthology.orchestra.run.trial058.stdout:(175/176): librbd1-20.3.0-5449.gb60f8651.el9.x8 20 MB/s | 2.8 MB 00:00 2026-02-23T06:19:59.080 INFO:teuthology.orchestra.run.trial058.stdout:(176/176): librados2-20.3.0-5449.gb60f8651.el9. 22 MB/s | 3.5 MB 00:00 2026-02-23T06:19:59.082 INFO:teuthology.orchestra.run.trial058.stdout:-------------------------------------------------------------------------------- 2026-02-23T06:19:59.082 INFO:teuthology.orchestra.run.trial058.stdout:Total 25 MB/s | 330 MB 00:13 2026-02-23T06:20:00.527 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction check 2026-02-23T06:20:00.609 INFO:teuthology.orchestra.run.trial058.stdout:Transaction check succeeded. 2026-02-23T06:20:00.609 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction test 2026-02-23T06:20:01.198 INFO:teuthology.orchestra.run.trial093.stdout:lab-extras 2.1 MB/s | 50 kB 00:00 2026-02-23T06:20:01.993 INFO:teuthology.orchestra.run.trial058.stdout:Transaction test succeeded. 2026-02-23T06:20:01.993 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction 2026-02-23T06:20:02.398 INFO:teuthology.orchestra.run.trial093.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-23T06:20:02.399 INFO:teuthology.orchestra.run.trial093.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-23T06:20:02.405 INFO:teuthology.orchestra.run.trial093.stdout:Package NetworkManager-1:1.54.3-2.el9.x86_64 is already installed. 2026-02-23T06:20:02.405 INFO:teuthology.orchestra.run.trial093.stdout:Package iproute-6.17.0-2.el9.x86_64 is already installed. 2026-02-23T06:20:02.406 INFO:teuthology.orchestra.run.trial093.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-23T06:20:02.406 INFO:teuthology.orchestra.run.trial093.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-23T06:20:02.407 INFO:teuthology.orchestra.run.trial093.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-23T06:20:02.408 INFO:teuthology.orchestra.run.trial093.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-23T06:20:02.409 INFO:teuthology.orchestra.run.trial093.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-23T06:20:02.435 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-23T06:20:02.440 INFO:teuthology.orchestra.run.trial093.stdout:======================================================================================= 2026-02-23T06:20:02.440 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repository Size 2026-02-23T06:20:02.440 INFO:teuthology.orchestra.run.trial093.stdout:======================================================================================= 2026-02-23T06:20:02.440 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-23T06:20:02.441 INFO:teuthology.orchestra.run.trial093.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-23T06:20:02.441 INFO:teuthology.orchestra.run.trial093.stdout: ceph x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 6.5 k 2026-02-23T06:20:02.441 INFO:teuthology.orchestra.run.trial093.stdout: ceph-base x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 5.2 M 2026-02-23T06:20:02.441 INFO:teuthology.orchestra.run.trial093.stdout: ceph-fuse x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 988 k 2026-02-23T06:20:02.441 INFO:teuthology.orchestra.run.trial093.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 147 k 2026-02-23T06:20:02.441 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 937 k 2026-02-23T06:20:02.441 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5449.gb60f8651.el9 ceph-noarch 184 k 2026-02-23T06:20:02.441 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5449.gb60f8651.el9 ceph-noarch 51 M 2026-02-23T06:20:02.441 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5449.gb60f8651.el9 ceph-noarch 7.4 M 2026-02-23T06:20:02.441 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-rook noarch 2:20.3.0-5449.gb60f8651.el9 ceph-noarch 50 k 2026-02-23T06:20:02.441 INFO:teuthology.orchestra.run.trial093.stdout: ceph-osd x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 166 k 2026-02-23T06:20:02.441 INFO:teuthology.orchestra.run.trial093.stdout: ceph-osd-classic x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 16 M 2026-02-23T06:20:02.442 INFO:teuthology.orchestra.run.trial093.stdout: ceph-radosgw x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 13 M 2026-02-23T06:20:02.442 INFO:teuthology.orchestra.run.trial093.stdout: ceph-test x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 78 M 2026-02-23T06:20:02.442 INFO:teuthology.orchestra.run.trial093.stdout: ceph-volume noarch 2:20.3.0-5449.gb60f8651.el9 ceph-noarch 301 k 2026-02-23T06:20:02.442 INFO:teuthology.orchestra.run.trial093.stdout: cephadm noarch 2:20.3.0-5449.gb60f8651.el9 ceph-noarch 1.0 M 2026-02-23T06:20:02.442 INFO:teuthology.orchestra.run.trial093.stdout: cephfs-mirror x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 243 k 2026-02-23T06:20:02.442 INFO:teuthology.orchestra.run.trial093.stdout: cephfs-shell x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 27 k 2026-02-23T06:20:02.442 INFO:teuthology.orchestra.run.trial093.stdout: cephfs-top noarch 2:20.3.0-5449.gb60f8651.el9 ceph-noarch 18 k 2026-02-23T06:20:02.442 INFO:teuthology.orchestra.run.trial093.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-23T06:20:02.442 INFO:teuthology.orchestra.run.trial093.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-23T06:20:02.442 INFO:teuthology.orchestra.run.trial093.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-23T06:20:02.442 INFO:teuthology.orchestra.run.trial093.stdout: libcephfs-devel x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 37 k 2026-02-23T06:20:02.442 INFO:teuthology.orchestra.run.trial093.stdout: libcephfs2 x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 908 k 2026-02-23T06:20:02.443 INFO:teuthology.orchestra.run.trial093.stdout: librados-devel x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 123 k 2026-02-23T06:20:02.443 INFO:teuthology.orchestra.run.trial093.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-23T06:20:02.443 INFO:teuthology.orchestra.run.trial093.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-23T06:20:02.443 INFO:teuthology.orchestra.run.trial093.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-23T06:20:02.443 INFO:teuthology.orchestra.run.trial093.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-23T06:20:02.443 INFO:teuthology.orchestra.run.trial093.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-23T06:20:02.443 INFO:teuthology.orchestra.run.trial093.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-23T06:20:02.443 INFO:teuthology.orchestra.run.trial093.stdout: python3-cephfs x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 204 k 2026-02-23T06:20:02.443 INFO:teuthology.orchestra.run.trial093.stdout: python3-rados x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 324 k 2026-02-23T06:20:02.443 INFO:teuthology.orchestra.run.trial093.stdout: python3-rbd x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 305 k 2026-02-23T06:20:02.443 INFO:teuthology.orchestra.run.trial093.stdout: python3-rgw x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 100 k 2026-02-23T06:20:02.443 INFO:teuthology.orchestra.run.trial093.stdout: rbd-fuse x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 84 k 2026-02-23T06:20:02.443 INFO:teuthology.orchestra.run.trial093.stdout: rbd-mirror x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 2.9 M 2026-02-23T06:20:02.444 INFO:teuthology.orchestra.run.trial093.stdout: rbd-nbd x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 172 k 2026-02-23T06:20:02.444 INFO:teuthology.orchestra.run.trial093.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-23T06:20:02.444 INFO:teuthology.orchestra.run.trial093.stdout:Upgrading: 2026-02-23T06:20:02.444 INFO:teuthology.orchestra.run.trial093.stdout: librados2 x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 3.5 M 2026-02-23T06:20:02.444 INFO:teuthology.orchestra.run.trial093.stdout: librbd1 x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 2.8 M 2026-02-23T06:20:02.444 INFO:teuthology.orchestra.run.trial093.stdout:Installing dependencies: 2026-02-23T06:20:02.444 INFO:teuthology.orchestra.run.trial093.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-23T06:20:02.444 INFO:teuthology.orchestra.run.trial093.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-23T06:20:02.444 INFO:teuthology.orchestra.run.trial093.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-23T06:20:02.444 INFO:teuthology.orchestra.run.trial093.stdout: ceph-common x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 24 M 2026-02-23T06:20:02.444 INFO:teuthology.orchestra.run.trial093.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5449.gb60f8651.el9 ceph-noarch 57 k 2026-02-23T06:20:02.444 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mds x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 2.4 M 2026-02-23T06:20:02.444 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5449.gb60f8651.el9 ceph-noarch 298 k 2026-02-23T06:20:02.445 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mon x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 5.0 M 2026-02-23T06:20:02.445 INFO:teuthology.orchestra.run.trial093.stdout: ceph-osd-crimson x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 19 M 2026-02-23T06:20:02.445 INFO:teuthology.orchestra.run.trial093.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5449.gb60f8651.el9 ceph-noarch 17 k 2026-02-23T06:20:02.445 INFO:teuthology.orchestra.run.trial093.stdout: ceph-selinux x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 25 k 2026-02-23T06:20:02.445 INFO:teuthology.orchestra.run.trial093.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-23T06:20:02.445 INFO:teuthology.orchestra.run.trial093.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-23T06:20:02.445 INFO:teuthology.orchestra.run.trial093.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-23T06:20:02.445 INFO:teuthology.orchestra.run.trial093.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-23T06:20:02.445 INFO:teuthology.orchestra.run.trial093.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-23T06:20:02.445 INFO:teuthology.orchestra.run.trial093.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-23T06:20:02.445 INFO:teuthology.orchestra.run.trial093.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-23T06:20:02.445 INFO:teuthology.orchestra.run.trial093.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-23T06:20:02.446 INFO:teuthology.orchestra.run.trial093.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-23T06:20:02.446 INFO:teuthology.orchestra.run.trial093.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-23T06:20:02.446 INFO:teuthology.orchestra.run.trial093.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-23T06:20:02.446 INFO:teuthology.orchestra.run.trial093.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 26 k 2026-02-23T06:20:02.446 INFO:teuthology.orchestra.run.trial093.stdout: libcephsqlite x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 159 k 2026-02-23T06:20:02.446 INFO:teuthology.orchestra.run.trial093.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-23T06:20:02.446 INFO:teuthology.orchestra.run.trial093.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-23T06:20:02.446 INFO:teuthology.orchestra.run.trial093.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-23T06:20:02.446 INFO:teuthology.orchestra.run.trial093.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-23T06:20:02.446 INFO:teuthology.orchestra.run.trial093.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-23T06:20:02.446 INFO:teuthology.orchestra.run.trial093.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-23T06:20:02.446 INFO:teuthology.orchestra.run.trial093.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-23T06:20:02.446 INFO:teuthology.orchestra.run.trial093.stdout: libradosstriper1 x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 248 k 2026-02-23T06:20:02.447 INFO:teuthology.orchestra.run.trial093.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-23T06:20:02.447 INFO:teuthology.orchestra.run.trial093.stdout: librgw2 x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 6.5 M 2026-02-23T06:20:02.447 INFO:teuthology.orchestra.run.trial093.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-23T06:20:02.447 INFO:teuthology.orchestra.run.trial093.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-23T06:20:02.447 INFO:teuthology.orchestra.run.trial093.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-23T06:20:02.447 INFO:teuthology.orchestra.run.trial093.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-23T06:20:02.447 INFO:teuthology.orchestra.run.trial093.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-23T06:20:02.447 INFO:teuthology.orchestra.run.trial093.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-23T06:20:02.447 INFO:teuthology.orchestra.run.trial093.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-23T06:20:02.447 INFO:teuthology.orchestra.run.trial093.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-23T06:20:02.447 INFO:teuthology.orchestra.run.trial093.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-23T06:20:02.447 INFO:teuthology.orchestra.run.trial093.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-23T06:20:02.447 INFO:teuthology.orchestra.run.trial093.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-23T06:20:02.448 INFO:teuthology.orchestra.run.trial093.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-23T06:20:02.448 INFO:teuthology.orchestra.run.trial093.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-23T06:20:02.448 INFO:teuthology.orchestra.run.trial093.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-23T06:20:02.448 INFO:teuthology.orchestra.run.trial093.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-23T06:20:02.448 INFO:teuthology.orchestra.run.trial093.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-23T06:20:02.448 INFO:teuthology.orchestra.run.trial093.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-23T06:20:02.448 INFO:teuthology.orchestra.run.trial093.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-23T06:20:02.448 INFO:teuthology.orchestra.run.trial093.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-23T06:20:02.448 INFO:teuthology.orchestra.run.trial093.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-23T06:20:02.448 INFO:teuthology.orchestra.run.trial093.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-23T06:20:02.448 INFO:teuthology.orchestra.run.trial093.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-23T06:20:02.448 INFO:teuthology.orchestra.run.trial093.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-23T06:20:02.449 INFO:teuthology.orchestra.run.trial093.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-23T06:20:02.449 INFO:teuthology.orchestra.run.trial093.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-23T06:20:02.449 INFO:teuthology.orchestra.run.trial093.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-23T06:20:02.449 INFO:teuthology.orchestra.run.trial093.stdout: python3-ceph-argparse x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 45 k 2026-02-23T06:20:02.449 INFO:teuthology.orchestra.run.trial093.stdout: python3-ceph-common x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 186 k 2026-02-23T06:20:02.449 INFO:teuthology.orchestra.run.trial093.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-23T06:20:02.449 INFO:teuthology.orchestra.run.trial093.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-23T06:20:02.449 INFO:teuthology.orchestra.run.trial093.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-23T06:20:02.449 INFO:teuthology.orchestra.run.trial093.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-23T06:20:02.449 INFO:teuthology.orchestra.run.trial093.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-23T06:20:02.449 INFO:teuthology.orchestra.run.trial093.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-23T06:20:02.449 INFO:teuthology.orchestra.run.trial093.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-23T06:20:02.449 INFO:teuthology.orchestra.run.trial093.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-23T06:20:02.450 INFO:teuthology.orchestra.run.trial093.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-23T06:20:02.450 INFO:teuthology.orchestra.run.trial093.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-23T06:20:02.450 INFO:teuthology.orchestra.run.trial093.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-23T06:20:02.450 INFO:teuthology.orchestra.run.trial093.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-23T06:20:02.450 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-23T06:20:02.450 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-23T06:20:02.450 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-23T06:20:02.450 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-23T06:20:02.450 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-23T06:20:02.450 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-23T06:20:02.450 INFO:teuthology.orchestra.run.trial093.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-23T06:20:02.450 INFO:teuthology.orchestra.run.trial093.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-23T06:20:02.450 INFO:teuthology.orchestra.run.trial093.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-23T06:20:02.451 INFO:teuthology.orchestra.run.trial093.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-23T06:20:02.451 INFO:teuthology.orchestra.run.trial093.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-23T06:20:02.451 INFO:teuthology.orchestra.run.trial093.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-23T06:20:02.451 INFO:teuthology.orchestra.run.trial093.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-23T06:20:02.451 INFO:teuthology.orchestra.run.trial093.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-23T06:20:02.451 INFO:teuthology.orchestra.run.trial093.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-23T06:20:02.451 INFO:teuthology.orchestra.run.trial093.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-23T06:20:02.451 INFO:teuthology.orchestra.run.trial093.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-23T06:20:02.451 INFO:teuthology.orchestra.run.trial093.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-23T06:20:02.451 INFO:teuthology.orchestra.run.trial093.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-23T06:20:02.451 INFO:teuthology.orchestra.run.trial093.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-23T06:20:02.451 INFO:teuthology.orchestra.run.trial093.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-23T06:20:02.452 INFO:teuthology.orchestra.run.trial093.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-23T06:20:02.452 INFO:teuthology.orchestra.run.trial093.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-23T06:20:02.452 INFO:teuthology.orchestra.run.trial093.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-23T06:20:02.452 INFO:teuthology.orchestra.run.trial093.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-23T06:20:02.452 INFO:teuthology.orchestra.run.trial093.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-23T06:20:02.452 INFO:teuthology.orchestra.run.trial093.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-23T06:20:02.452 INFO:teuthology.orchestra.run.trial093.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-23T06:20:02.452 INFO:teuthology.orchestra.run.trial093.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-23T06:20:02.452 INFO:teuthology.orchestra.run.trial093.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-23T06:20:02.452 INFO:teuthology.orchestra.run.trial093.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-23T06:20:02.452 INFO:teuthology.orchestra.run.trial093.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-23T06:20:02.452 INFO:teuthology.orchestra.run.trial093.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-23T06:20:02.452 INFO:teuthology.orchestra.run.trial093.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-23T06:20:02.453 INFO:teuthology.orchestra.run.trial093.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-23T06:20:02.453 INFO:teuthology.orchestra.run.trial093.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-23T06:20:02.453 INFO:teuthology.orchestra.run.trial093.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-23T06:20:02.453 INFO:teuthology.orchestra.run.trial093.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-23T06:20:02.453 INFO:teuthology.orchestra.run.trial093.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-23T06:20:02.453 INFO:teuthology.orchestra.run.trial093.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-23T06:20:02.453 INFO:teuthology.orchestra.run.trial093.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-23T06:20:02.453 INFO:teuthology.orchestra.run.trial093.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-23T06:20:02.453 INFO:teuthology.orchestra.run.trial093.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-23T06:20:02.453 INFO:teuthology.orchestra.run.trial093.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-23T06:20:02.453 INFO:teuthology.orchestra.run.trial093.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-23T06:20:02.453 INFO:teuthology.orchestra.run.trial093.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-23T06:20:02.453 INFO:teuthology.orchestra.run.trial093.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-23T06:20:02.454 INFO:teuthology.orchestra.run.trial093.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-23T06:20:02.454 INFO:teuthology.orchestra.run.trial093.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-23T06:20:02.454 INFO:teuthology.orchestra.run.trial093.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-23T06:20:02.454 INFO:teuthology.orchestra.run.trial093.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-23T06:20:02.454 INFO:teuthology.orchestra.run.trial093.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-23T06:20:02.454 INFO:teuthology.orchestra.run.trial093.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-23T06:20:02.454 INFO:teuthology.orchestra.run.trial093.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-23T06:20:02.454 INFO:teuthology.orchestra.run.trial093.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-23T06:20:02.454 INFO:teuthology.orchestra.run.trial093.stdout:Installing weak dependencies: 2026-02-23T06:20:02.454 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5449.gb60f8651.el9 ceph-noarch 22 k 2026-02-23T06:20:02.454 INFO:teuthology.orchestra.run.trial093.stdout: libcephfs-daemon x86_64 2:20.3.0-5449.gb60f8651.el9 ceph 39 k 2026-02-23T06:20:02.454 INFO:teuthology.orchestra.run.trial093.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-23T06:20:02.454 INFO:teuthology.orchestra.run.trial093.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-23T06:20:02.455 INFO:teuthology.orchestra.run.trial093.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-23T06:20:02.455 INFO:teuthology.orchestra.run.trial093.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-23T06:20:02.455 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:02.455 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-23T06:20:02.455 INFO:teuthology.orchestra.run.trial093.stdout:======================================================================================= 2026-02-23T06:20:02.455 INFO:teuthology.orchestra.run.trial093.stdout:Install 174 Packages 2026-02-23T06:20:02.455 INFO:teuthology.orchestra.run.trial093.stdout:Upgrade 2 Packages 2026-02-23T06:20:02.455 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:02.456 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 330 M 2026-02-23T06:20:02.456 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-23T06:20:02.975 INFO:teuthology.orchestra.run.trial093.stdout:(1/176): ceph-20.3.0-5449.gb60f8651.el9.x86_64. 112 kB/s | 6.5 kB 00:00 2026-02-23T06:20:03.079 INFO:teuthology.orchestra.run.trial093.stdout:(2/176): ceph-fuse-20.3.0-5449.gb60f8651.el9.x8 9.3 MB/s | 988 kB 00:00 2026-02-23T06:20:03.120 INFO:teuthology.orchestra.run.trial093.stdout:(3/176): ceph-immutable-object-cache-20.3.0-544 3.5 MB/s | 147 kB 00:00 2026-02-23T06:20:03.222 INFO:teuthology.orchestra.run.trial093.stdout:(4/176): ceph-base-20.3.0-5449.gb60f8651.el9.x8 17 MB/s | 5.2 MB 00:00 2026-02-23T06:20:03.270 INFO:teuthology.orchestra.run.trial093.stdout:(5/176): ceph-mds-20.3.0-5449.gb60f8651.el9.x86 16 MB/s | 2.4 MB 00:00 2026-02-23T06:20:03.279 INFO:teuthology.orchestra.run.trial093.stdout:(6/176): ceph-mgr-20.3.0-5449.gb60f8651.el9.x86 16 MB/s | 937 kB 00:00 2026-02-23T06:20:03.324 INFO:teuthology.orchestra.run.trial093.stdout:(7/176): ceph-osd-20.3.0-5449.gb60f8651.el9.x86 3.6 MB/s | 166 kB 00:00 2026-02-23T06:20:03.432 INFO:teuthology.orchestra.run.trial058.stdout: Preparing : 1/1 2026-02-23T06:20:03.443 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/178 2026-02-23T06:20:03.450 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/178 2026-02-23T06:20:03.462 INFO:teuthology.orchestra.run.trial058.stdout: Installing : liboath-2.6.12-1.el9.x86_64 3/178 2026-02-23T06:20:03.481 INFO:teuthology.orchestra.run.trial058.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 4/178 2026-02-23T06:20:03.603 INFO:teuthology.orchestra.run.trial093.stdout:(8/176): ceph-mon-20.3.0-5449.gb60f8651.el9.x86 15 MB/s | 5.0 MB 00:00 2026-02-23T06:20:03.656 INFO:teuthology.orchestra.run.trial058.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 5/178 2026-02-23T06:20:03.660 INFO:teuthology.orchestra.run.trial058.stdout: Upgrading : librados2-2:20.3.0-5449.gb60f8651.el9.x86_64 6/178 2026-02-23T06:20:03.726 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: librados2-2:20.3.0-5449.gb60f8651.el9.x86_64 6/178 2026-02-23T06:20:03.729 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libcephfs2-2:20.3.0-5449.gb60f8651.el9.x86_64 7/178 2026-02-23T06:20:03.753 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: libcephfs2-2:20.3.0-5449.gb60f8651.el9.x86_64 7/178 2026-02-23T06:20:03.756 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libcephfs-daemon-2:20.3.0-5449.gb60f8651.el9.x86 8/178 2026-02-23T06:20:03.758 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libcephfs-proxy2-2:20.3.0-5449.gb60f8651.el9.x86 9/178 2026-02-23T06:20:03.798 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5449.gb60f8651.el9.x86 9/178 2026-02-23T06:20:03.811 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-rados-2:20.3.0-5449.gb60f8651.el9.x86_64 10/178 2026-02-23T06:20:03.817 INFO:teuthology.orchestra.run.trial058.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 11/178 2026-02-23T06:20:03.822 INFO:teuthology.orchestra.run.trial058.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 12/178 2026-02-23T06:20:03.826 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 13/178 2026-02-23T06:20:03.829 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 14/178 2026-02-23T06:20:03.838 INFO:teuthology.orchestra.run.trial058.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 15/178 2026-02-23T06:20:03.972 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 16/178 2026-02-23T06:20:03.975 INFO:teuthology.orchestra.run.trial058.stdout: Upgrading : librbd1-2:20.3.0-5449.gb60f8651.el9.x86_64 17/178 2026-02-23T06:20:04.081 INFO:teuthology.orchestra.run.trial093.stdout:(9/176): ceph-common-20.3.0-5449.gb60f8651.el9. 21 MB/s | 24 MB 00:01 2026-02-23T06:20:04.089 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: librbd1-2:20.3.0-5449.gb60f8651.el9.x86_64 17/178 2026-02-23T06:20:04.105 INFO:teuthology.orchestra.run.trial058.stdout: Installing : postgresql-13.23-1.el9.x86_64 18/178 2026-02-23T06:20:04.107 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libcephsqlite-2:20.3.0-5449.gb60f8651.el9.x86_64 19/178 2026-02-23T06:20:04.111 INFO:teuthology.orchestra.run.trial093.stdout:(10/176): ceph-osd-classic-20.3.0-5449.gb60f865 20 MB/s | 16 MB 00:00 2026-02-23T06:20:04.141 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5449.gb60f8651.el9.x86_64 19/178 2026-02-23T06:20:04.143 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libradosstriper1-2:20.3.0-5449.gb60f8651.el9.x86 20/178 2026-02-23T06:20:04.150 INFO:teuthology.orchestra.run.trial093.stdout:(11/176): ceph-selinux-20.3.0-5449.gb60f8651.el 643 kB/s | 25 kB 00:00 2026-02-23T06:20:04.215 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5449.gb60f8651.el9.x86 20/178 2026-02-23T06:20:04.226 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 21/178 2026-02-23T06:20:04.232 INFO:teuthology.orchestra.run.trial058.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 22/178 2026-02-23T06:20:04.238 INFO:teuthology.orchestra.run.trial058.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 23/178 2026-02-23T06:20:04.277 INFO:teuthology.orchestra.run.trial058.stdout: Installing : re2-1:20211101-20.el9.x86_64 24/178 2026-02-23T06:20:04.312 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 25/178 2026-02-23T06:20:04.320 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/178 2026-02-23T06:20:04.329 INFO:teuthology.orchestra.run.trial058.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 27/178 2026-02-23T06:20:04.334 INFO:teuthology.orchestra.run.trial058.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/178 2026-02-23T06:20:04.341 INFO:teuthology.orchestra.run.trial058.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 29/178 2026-02-23T06:20:04.378 INFO:teuthology.orchestra.run.trial058.stdout: Installing : unzip-6.0-59.el9.x86_64 30/178 2026-02-23T06:20:04.399 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 31/178 2026-02-23T06:20:04.409 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 32/178 2026-02-23T06:20:04.415 INFO:teuthology.orchestra.run.trial058.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 33/178 2026-02-23T06:20:04.423 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 34/178 2026-02-23T06:20:04.426 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 35/178 2026-02-23T06:20:04.429 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 36/178 2026-02-23T06:20:04.444 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 37/178 2026-02-23T06:20:04.494 INFO:teuthology.orchestra.run.trial058.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 38/178 2026-02-23T06:20:04.501 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-ceph-common-2:20.3.0-5449.gb60f8651.el9. 39/178 2026-02-23T06:20:04.515 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-ceph-argparse-2:20.3.0-5449.gb60f8651.el 40/178 2026-02-23T06:20:04.531 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-cephfs-2:20.3.0-5449.gb60f8651.el9.x86_6 41/178 2026-02-23T06:20:04.542 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 42/178 2026-02-23T06:20:04.581 INFO:teuthology.orchestra.run.trial058.stdout: Installing : zip-3.0-35.el9.x86_64 43/178 2026-02-23T06:20:04.587 INFO:teuthology.orchestra.run.trial058.stdout: Installing : luarocks-3.9.2-5.el9.noarch 44/178 2026-02-23T06:20:04.593 INFO:teuthology.orchestra.run.trial058.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 45/178 2026-02-23T06:20:04.598 INFO:teuthology.orchestra.run.trial058.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 46/178 2026-02-23T06:20:04.638 INFO:teuthology.orchestra.run.trial058.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 47/178 2026-02-23T06:20:04.658 INFO:teuthology.orchestra.run.trial093.stdout:(12/176): ceph-osd-crimson-20.3.0-5449.gb60f865 18 MB/s | 19 MB 00:01 2026-02-23T06:20:04.681 INFO:teuthology.orchestra.run.trial093.stdout:(13/176): ceph-radosgw-20.3.0-5449.gb60f8651.el 22 MB/s | 13 MB 00:00 2026-02-23T06:20:04.685 INFO:teuthology.orchestra.run.trial093.stdout:(14/176): cephfs-mirror-20.3.0-5449.gb60f8651.e 8.7 MB/s | 243 kB 00:00 2026-02-23T06:20:04.694 INFO:teuthology.orchestra.run.trial093.stdout:(15/176): cephfs-shell-20.3.0-5449.gb60f8651.el 2.1 MB/s | 27 kB 00:00 2026-02-23T06:20:04.706 INFO:teuthology.orchestra.run.trial093.stdout:(16/176): libcephfs-daemon-20.3.0-5449.gb60f865 1.8 MB/s | 39 kB 00:00 2026-02-23T06:20:04.714 INFO:teuthology.orchestra.run.trial058.stdout: Installing : automake-1.16.2-8.el9.noarch 48/178 2026-02-23T06:20:04.716 INFO:teuthology.orchestra.run.trial093.stdout:(17/176): libcephfs-devel-20.3.0-5449.gb60f8651 1.7 MB/s | 37 kB 00:00 2026-02-23T06:20:04.728 INFO:teuthology.orchestra.run.trial093.stdout:(18/176): libcephfs-proxy2-20.3.0-5449.gb60f865 1.2 MB/s | 26 kB 00:00 2026-02-23T06:20:04.734 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 49/178 2026-02-23T06:20:04.738 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-rsa-4.9-2.el9.noarch 50/178 2026-02-23T06:20:04.746 INFO:teuthology.orchestra.run.trial058.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 51/178 2026-02-23T06:20:04.753 INFO:teuthology.orchestra.run.trial093.stdout:(19/176): libcephfs2-20.3.0-5449.gb60f8651.el9. 24 MB/s | 908 kB 00:00 2026-02-23T06:20:04.765 INFO:teuthology.orchestra.run.trial093.stdout:(20/176): libcephsqlite-20.3.0-5449.gb60f8651.e 4.1 MB/s | 159 kB 00:00 2026-02-23T06:20:04.766 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 52/178 2026-02-23T06:20:04.774 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-rbd-2:20.3.0-5449.gb60f8651.el9.x86_64 53/178 2026-02-23T06:20:04.777 INFO:teuthology.orchestra.run.trial093.stdout:(21/176): librados-devel-20.3.0-5449.gb60f8651. 5.0 MB/s | 123 kB 00:00 2026-02-23T06:20:04.784 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/178 2026-02-23T06:20:04.792 INFO:teuthology.orchestra.run.trial093.stdout:(22/176): libradosstriper1-20.3.0-5449.gb60f865 9.0 MB/s | 248 kB 00:00 2026-02-23T06:20:04.795 INFO:teuthology.orchestra.run.trial058.stdout: Installing : librados-devel-2:20.3.0-5449.gb60f8651.el9.x86_6 55/178 2026-02-23T06:20:04.802 INFO:teuthology.orchestra.run.trial058.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 56/178 2026-02-23T06:20:04.817 INFO:teuthology.orchestra.run.trial058.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 57/178 2026-02-23T06:20:04.827 INFO:teuthology.orchestra.run.trial058.stdout: Installing : thrift-0.15.0-4.el9.x86_64 58/178 2026-02-23T06:20:04.833 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 59/178 2026-02-23T06:20:04.835 INFO:teuthology.orchestra.run.trial093.stdout:(23/176): python3-ceph-argparse-20.3.0-5449.gb6 1.0 MB/s | 45 kB 00:00 2026-02-23T06:20:04.856 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 60/178 2026-02-23T06:20:04.864 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 61/178 2026-02-23T06:20:04.872 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 62/178 2026-02-23T06:20:04.880 INFO:teuthology.orchestra.run.trial093.stdout:(24/176): python3-ceph-common-20.3.0-5449.gb60f 4.1 MB/s | 186 kB 00:00 2026-02-23T06:20:04.890 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 63/178 2026-02-23T06:20:04.899 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 64/178 2026-02-23T06:20:04.913 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 65/178 2026-02-23T06:20:04.924 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 66/178 2026-02-23T06:20:04.925 INFO:teuthology.orchestra.run.trial093.stdout:(25/176): python3-cephfs-20.3.0-5449.gb60f8651. 4.4 MB/s | 204 kB 00:00 2026-02-23T06:20:04.955 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 67/178 2026-02-23T06:20:04.973 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 68/178 2026-02-23T06:20:04.973 INFO:teuthology.orchestra.run.trial093.stdout:(26/176): python3-rados-20.3.0-5449.gb60f8651.e 6.6 MB/s | 324 kB 00:00 2026-02-23T06:20:04.997 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 69/178 2026-02-23T06:20:05.005 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 70/178 2026-02-23T06:20:05.018 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 71/178 2026-02-23T06:20:05.021 INFO:teuthology.orchestra.run.trial093.stdout:(27/176): python3-rbd-20.3.0-5449.gb60f8651.el9 6.2 MB/s | 305 kB 00:00 2026-02-23T06:20:05.038 INFO:teuthology.orchestra.run.trial093.stdout:(28/176): librgw2-20.3.0-5449.gb60f8651.el9.x86 25 MB/s | 6.5 MB 00:00 2026-02-23T06:20:05.048 INFO:teuthology.orchestra.run.trial093.stdout:(29/176): python3-rgw-20.3.0-5449.gb60f8651.el9 3.7 MB/s | 100 kB 00:00 2026-02-23T06:20:05.062 INFO:teuthology.orchestra.run.trial093.stdout:(30/176): rbd-fuse-20.3.0-5449.gb60f8651.el9.x8 3.4 MB/s | 84 kB 00:00 2026-02-23T06:20:05.078 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 72/178 2026-02-23T06:20:05.103 INFO:teuthology.orchestra.run.trial093.stdout:(31/176): rbd-nbd-20.3.0-5449.gb60f8651.el9.x86 4.1 MB/s | 172 kB 00:00 2026-02-23T06:20:05.142 INFO:teuthology.orchestra.run.trial093.stdout:(32/176): ceph-grafana-dashboards-20.3.0-5449.g 1.4 MB/s | 57 kB 00:00 2026-02-23T06:20:05.167 INFO:teuthology.orchestra.run.trial093.stdout:(33/176): rbd-mirror-20.3.0-5449.gb60f8651.el9. 24 MB/s | 2.9 MB 00:00 2026-02-23T06:20:05.180 INFO:teuthology.orchestra.run.trial093.stdout:(34/176): ceph-mgr-cephadm-20.3.0-5449.gb60f865 4.7 MB/s | 184 kB 00:00 2026-02-23T06:20:05.541 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 73/178 2026-02-23T06:20:05.549 INFO:teuthology.orchestra.run.trial093.stdout:(35/176): ceph-mgr-diskprediction-local-20.3.0- 20 MB/s | 7.4 MB 00:00 2026-02-23T06:20:05.559 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 74/178 2026-02-23T06:20:05.567 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 75/178 2026-02-23T06:20:05.577 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 76/178 2026-02-23T06:20:05.583 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 77/178 2026-02-23T06:20:05.588 INFO:teuthology.orchestra.run.trial093.stdout:(36/176): ceph-mgr-k8sevents-20.3.0-5449.gb60f8 577 kB/s | 22 kB 00:00 2026-02-23T06:20:05.592 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 78/178 2026-02-23T06:20:05.597 INFO:teuthology.orchestra.run.trial058.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 79/178 2026-02-23T06:20:05.599 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 80/178 2026-02-23T06:20:05.629 INFO:teuthology.orchestra.run.trial093.stdout:(37/176): ceph-mgr-modules-core-20.3.0-5449.gb6 7.1 MB/s | 298 kB 00:00 2026-02-23T06:20:05.647 INFO:teuthology.orchestra.run.trial058.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 81/178 2026-02-23T06:20:05.670 INFO:teuthology.orchestra.run.trial093.stdout:(38/176): ceph-mgr-rook-20.3.0-5449.gb60f8651.e 1.2 MB/s | 50 kB 00:00 2026-02-23T06:20:05.709 INFO:teuthology.orchestra.run.trial093.stdout:(39/176): ceph-prometheus-alerts-20.3.0-5449.gb 447 kB/s | 17 kB 00:00 2026-02-23T06:20:05.715 INFO:teuthology.orchestra.run.trial058.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 82/178 2026-02-23T06:20:05.723 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 83/178 2026-02-23T06:20:05.729 INFO:teuthology.orchestra.run.trial058.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 84/178 2026-02-23T06:20:05.742 INFO:teuthology.orchestra.run.trial058.stdout: Installing : uuid-1.6.2-55.el9.x86_64 85/178 2026-02-23T06:20:05.753 INFO:teuthology.orchestra.run.trial058.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 86/178 2026-02-23T06:20:05.754 INFO:teuthology.orchestra.run.trial093.stdout:(40/176): ceph-volume-20.3.0-5449.gb60f8651.el9 6.5 MB/s | 301 kB 00:00 2026-02-23T06:20:05.795 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 87/178 2026-02-23T06:20:05.806 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/178 2026-02-23T06:20:05.813 INFO:teuthology.orchestra.run.trial093.stdout:(41/176): cephadm-20.3.0-5449.gb60f8651.el9.noa 18 MB/s | 1.0 MB 00:00 2026-02-23T06:20:05.813 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 89/178 2026-02-23T06:20:05.823 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 90/178 2026-02-23T06:20:05.830 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 91/178 2026-02-23T06:20:05.841 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 92/178 2026-02-23T06:20:05.847 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 93/178 2026-02-23T06:20:05.853 INFO:teuthology.orchestra.run.trial093.stdout:(42/176): cephfs-top-20.3.0-5449.gb60f8651.el9. 457 kB/s | 18 kB 00:00 2026-02-23T06:20:05.889 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 94/178 2026-02-23T06:20:05.905 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 95/178 2026-02-23T06:20:05.916 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 96/178 2026-02-23T06:20:05.928 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 97/178 2026-02-23T06:20:05.936 INFO:teuthology.orchestra.run.trial093.stdout:(43/176): cryptsetup-2.8.1-3.el9.x86_64.rpm 4.1 MB/s | 351 kB 00:00 2026-02-23T06:20:05.975 INFO:teuthology.orchestra.run.trial093.stdout:(44/176): hwloc-libs-2.4.1-6.el9.x86_64.rpm 54 MB/s | 2.1 MB 00:00 2026-02-23T06:20:05.979 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 98/178 2026-02-23T06:20:05.984 INFO:teuthology.orchestra.run.trial093.stdout:(45/176): ledmon-libs-1.1.0-3.el9.x86_64.rpm 4.3 MB/s | 40 kB 00:00 2026-02-23T06:20:05.993 INFO:teuthology.orchestra.run.trial093.stdout:(46/176): libatomic-11.5.0-14.el9.x86_64.rpm 2.6 MB/s | 23 kB 00:00 2026-02-23T06:20:05.998 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 99/178 2026-02-23T06:20:06.003 INFO:teuthology.orchestra.run.trial093.stdout:(47/176): libconfig-1.7.2-9.el9.x86_64.rpm 7.4 MB/s | 72 kB 00:00 2026-02-23T06:20:06.015 INFO:teuthology.orchestra.run.trial093.stdout:(48/176): libgfortran-11.5.0-14.el9.x86_64.rpm 62 MB/s | 794 kB 00:00 2026-02-23T06:20:06.026 INFO:teuthology.orchestra.run.trial093.stdout:(49/176): libquadmath-11.5.0-14.el9.x86_64.rpm 17 MB/s | 184 kB 00:00 2026-02-23T06:20:06.036 INFO:teuthology.orchestra.run.trial093.stdout:(50/176): lksctp-tools-1.0.19-2.el9.x86_64.rpm 9.3 MB/s | 94 kB 00:00 2026-02-23T06:20:06.045 INFO:teuthology.orchestra.run.trial093.stdout:(51/176): mailcap-2.1.49-5.el9.noarch.rpm 3.7 MB/s | 33 kB 00:00 2026-02-23T06:20:06.058 INFO:teuthology.orchestra.run.trial093.stdout:(52/176): nvme-cli-2.16-1.el9.x86_64.rpm 90 MB/s | 1.2 MB 00:00 2026-02-23T06:20:06.068 INFO:teuthology.orchestra.run.trial093.stdout:(53/176): pciutils-3.7.0-7.el9.x86_64.rpm 9.2 MB/s | 93 kB 00:00 2026-02-23T06:20:06.079 INFO:teuthology.orchestra.run.trial093.stdout:(54/176): python3-cffi-1.14.5-5.el9.x86_64.rpm 24 MB/s | 253 kB 00:00 2026-02-23T06:20:06.093 INFO:teuthology.orchestra.run.trial093.stdout:(55/176): python3-cryptography-36.0.1-5.el9.x86 86 MB/s | 1.2 MB 00:00 2026-02-23T06:20:06.104 INFO:teuthology.orchestra.run.trial093.stdout:(56/176): python3-ply-3.11-14.el9.noarch.rpm 9.7 MB/s | 106 kB 00:00 2026-02-23T06:20:06.115 INFO:teuthology.orchestra.run.trial093.stdout:(57/176): python3-pycparser-2.20-6.el9.noarch.r 12 MB/s | 135 kB 00:00 2026-02-23T06:20:06.126 INFO:teuthology.orchestra.run.trial093.stdout:(58/176): python3-pyparsing-2.4.7-9.el9.noarch. 13 MB/s | 150 kB 00:00 2026-02-23T06:20:06.138 INFO:teuthology.orchestra.run.trial093.stdout:(59/176): python3-requests-2.25.1-10.el9.noarch 11 MB/s | 126 kB 00:00 2026-02-23T06:20:06.149 INFO:teuthology.orchestra.run.trial093.stdout:(60/176): python3-urllib3-1.26.5-7.el9.noarch.r 19 MB/s | 218 kB 00:00 2026-02-23T06:20:06.161 INFO:teuthology.orchestra.run.trial093.stdout:(61/176): unzip-6.0-59.el9.x86_64.rpm 15 MB/s | 182 kB 00:00 2026-02-23T06:20:06.172 INFO:teuthology.orchestra.run.trial093.stdout:(62/176): zip-3.0-35.el9.x86_64.rpm 24 MB/s | 266 kB 00:00 2026-02-23T06:20:06.301 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 100/178 2026-02-23T06:20:06.341 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 101/178 2026-02-23T06:20:06.348 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 102/178 2026-02-23T06:20:06.422 INFO:teuthology.orchestra.run.trial058.stdout: Installing : openblas-0.3.29-1.el9.x86_64 103/178 2026-02-23T06:20:06.426 INFO:teuthology.orchestra.run.trial058.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 104/178 2026-02-23T06:20:06.453 INFO:teuthology.orchestra.run.trial058.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 105/178 2026-02-23T06:20:06.920 INFO:teuthology.orchestra.run.trial058.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 106/178 2026-02-23T06:20:07.035 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 107/178 2026-02-23T06:20:07.101 INFO:teuthology.orchestra.run.trial093.stdout:(63/176): ceph-test-20.3.0-5449.gb60f8651.el9.x 27 MB/s | 78 MB 00:02 2026-02-23T06:20:07.205 INFO:teuthology.orchestra.run.trial093.stdout:(64/176): ceph-mgr-dashboard-20.3.0-5449.gb60f8 25 MB/s | 51 MB 00:02 2026-02-23T06:20:07.363 INFO:teuthology.orchestra.run.trial093.stdout:(65/176): automake-1.16.2-8.el9.noarch.rpm 579 kB/s | 689 kB 00:01 2026-02-23T06:20:07.524 INFO:teuthology.orchestra.run.trial093.stdout:(66/176): elfutils-libelf-devel-0.194-1.el9.x86 492 kB/s | 79 kB 00:00 2026-02-23T06:20:07.687 INFO:teuthology.orchestra.run.trial093.stdout:(67/176): flex-2.6.4-9.el9.x86_64.rpm 1.9 MB/s | 313 kB 00:00 2026-02-23T06:20:07.770 INFO:teuthology.orchestra.run.trial093.stdout:(68/176): flexiblas-3.0.4-9.el9.x86_64.rpm 357 kB/s | 30 kB 00:00 2026-02-23T06:20:07.919 INFO:teuthology.orchestra.run.trial093.stdout:(69/176): boost-program-options-1.75.0-13.el9.x 146 kB/s | 104 kB 00:00 2026-02-23T06:20:07.999 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 108/178 2026-02-23T06:20:08.001 INFO:teuthology.orchestra.run.trial093.stdout:(70/176): flexiblas-openblas-openmp-3.0.4-9.el9 181 kB/s | 15 kB 00:00 2026-02-23T06:20:08.031 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 109/178 2026-02-23T06:20:08.037 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 110/178 2026-02-23T06:20:08.040 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 111/178 2026-02-23T06:20:08.049 INFO:teuthology.orchestra.run.trial058.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 112/178 2026-02-23T06:20:08.055 INFO:teuthology.orchestra.run.trial093.stdout:(71/176): flexiblas-netlib-3.0.4-9.el9.x86_64.r 10 MB/s | 3.0 MB 00:00 2026-02-23T06:20:08.084 INFO:teuthology.orchestra.run.trial093.stdout:(72/176): libaio-devel-0.3.111-13.el9.x86_64.rp 135 kB/s | 11 kB 00:00 2026-02-23T06:20:08.139 INFO:teuthology.orchestra.run.trial093.stdout:(73/176): libnbd-1.20.3-4.el9.x86_64.rpm 1.9 MB/s | 164 kB 00:00 2026-02-23T06:20:08.222 INFO:teuthology.orchestra.run.trial093.stdout:(74/176): librabbitmq-0.11.0-7.el9.x86_64.rpm 547 kB/s | 45 kB 00:00 2026-02-23T06:20:08.307 INFO:teuthology.orchestra.run.trial093.stdout:(75/176): librdkafka-1.6.1-102.el9.x86_64.rpm 7.5 MB/s | 662 kB 00:00 2026-02-23T06:20:08.352 INFO:teuthology.orchestra.run.trial058.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 113/178 2026-02-23T06:20:08.355 INFO:teuthology.orchestra.run.trial058.stdout: Installing : librgw2-2:20.3.0-5449.gb60f8651.el9.x86_64 114/178 2026-02-23T06:20:08.391 INFO:teuthology.orchestra.run.trial093.stdout:(76/176): libstoragemgmt-1.10.1-1.el9.x86_64.rp 2.9 MB/s | 246 kB 00:00 2026-02-23T06:20:08.392 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: librgw2-2:20.3.0-5449.gb60f8651.el9.x86_64 114/178 2026-02-23T06:20:08.394 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-rgw-2:20.3.0-5449.gb60f8651.el9.x86_64 115/178 2026-02-23T06:20:08.477 INFO:teuthology.orchestra.run.trial093.stdout:(77/176): libtool-2.4.6-46.el9.x86_64.rpm 6.6 MB/s | 581 kB 00:00 2026-02-23T06:20:08.560 INFO:teuthology.orchestra.run.trial093.stdout:(78/176): libuuid-devel-2.37.4-21.el9.x86_64.rp 295 kB/s | 25 kB 00:00 2026-02-23T06:20:08.645 INFO:teuthology.orchestra.run.trial093.stdout:(79/176): libxslt-1.1.34-12.el9.x86_64.rpm 2.7 MB/s | 233 kB 00:00 2026-02-23T06:20:08.673 INFO:teuthology.orchestra.run.trial093.stdout:(80/176): libpmemobj-1.12.1-1.el9.x86_64.rpm 272 kB/s | 160 kB 00:00 2026-02-23T06:20:08.728 INFO:teuthology.orchestra.run.trial093.stdout:(81/176): libzstd-devel-1.5.5-1.el9.x86_64.rpm 614 kB/s | 51 kB 00:00 2026-02-23T06:20:08.811 INFO:teuthology.orchestra.run.trial093.stdout:(82/176): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2026-02-23T06:20:08.895 INFO:teuthology.orchestra.run.trial093.stdout:(83/176): openblas-0.3.29-1.el9.x86_64.rpm 506 kB/s | 42 kB 00:00 2026-02-23T06:20:09.069 INFO:teuthology.orchestra.run.trial093.stdout:(84/176): openblas-openmp-0.3.29-1.el9.x86_64.r 30 MB/s | 5.3 MB 00:00 2026-02-23T06:20:09.239 INFO:teuthology.orchestra.run.trial093.stdout:(85/176): openssl-devel-3.5.5-1.el9.x86_64.rpm 28 MB/s | 4.8 MB 00:00 2026-02-23T06:20:09.322 INFO:teuthology.orchestra.run.trial093.stdout:(86/176): perl-Thread-Queue-3.14-460.el9.noarch 268 kB/s | 22 kB 00:00 2026-02-23T06:20:09.377 INFO:teuthology.orchestra.run.trial093.stdout:(87/176): lttng-ust-2.12.0-6.el9.x86_64.rpm 415 kB/s | 292 kB 00:00 2026-02-23T06:20:09.405 INFO:teuthology.orchestra.run.trial093.stdout:(88/176): perl-threads-2.25-460.el9.x86_64.rpm 703 kB/s | 58 kB 00:00 2026-02-23T06:20:09.496 INFO:teuthology.orchestra.run.trial093.stdout:(89/176): postgresql-13.23-1.el9.x86_64.rpm 18 MB/s | 1.6 MB 00:00 2026-02-23T06:20:09.537 INFO:teuthology.orchestra.run.trial093.stdout:(90/176): perl-threads-shared-1.61-460.el9.x86_ 279 kB/s | 45 kB 00:00 2026-02-23T06:20:09.582 INFO:teuthology.orchestra.run.trial093.stdout:(91/176): postgresql-contrib-13.23-1.el9.x86_64 10 MB/s | 903 kB 00:00 2026-02-23T06:20:09.590 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-common-2:20.3.0-5449.gb60f8651.el9.x86_64 116/178 2026-02-23T06:20:09.597 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-common-2:20.3.0-5449.gb60f8651.el9.x86_64 116/178 2026-02-23T06:20:09.635 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-common-2:20.3.0-5449.gb60f8651.el9.x86_64 116/178 2026-02-23T06:20:09.647 INFO:teuthology.orchestra.run.trial093.stdout:(92/176): bison-3.7.4-5.el9.x86_64.rpm 370 kB/s | 943 kB 00:02 2026-02-23T06:20:09.650 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 117/178 2026-02-23T06:20:09.662 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-packaging-20.9-5.el9.noarch 118/178 2026-02-23T06:20:09.683 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-ply-3.11-14.el9.noarch 119/178 2026-02-23T06:20:09.707 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 120/178 2026-02-23T06:20:09.757 INFO:teuthology.orchestra.run.trial093.stdout:(93/176): postgresql-server-13.23-1.el9.x86_64. 33 MB/s | 5.8 MB 00:00 2026-02-23T06:20:09.775 INFO:teuthology.orchestra.run.trial093.stdout:(94/176): postgresql-private-libs-13.23-1.el9.x 581 kB/s | 138 kB 00:00 2026-02-23T06:20:09.824 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 121/178 2026-02-23T06:20:09.841 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 122/178 2026-02-23T06:20:09.877 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 123/178 2026-02-23T06:20:09.924 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 124/178 2026-02-23T06:20:09.933 INFO:teuthology.orchestra.run.trial093.stdout:(95/176): python3-babel-2.9.1-2.el9.noarch.rpm 34 MB/s | 6.0 MB 00:00 2026-02-23T06:20:09.937 INFO:teuthology.orchestra.run.trial093.stdout:(96/176): python3-colorama-0.4.6-3.el9.noarch.r 378 kB/s | 61 kB 00:00 2026-02-23T06:20:09.998 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 125/178 2026-02-23T06:20:10.009 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 126/178 2026-02-23T06:20:10.016 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 127/178 2026-02-23T06:20:10.017 INFO:teuthology.orchestra.run.trial093.stdout:(97/176): python3-devel-3.9.25-3.el9.x86_64.rpm 2.8 MB/s | 244 kB 00:00 2026-02-23T06:20:10.023 INFO:teuthology.orchestra.run.trial058.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 128/178 2026-02-23T06:20:10.027 INFO:teuthology.orchestra.run.trial058.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 129/178 2026-02-23T06:20:10.029 INFO:teuthology.orchestra.run.trial058.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 130/178 2026-02-23T06:20:10.066 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 130/178 2026-02-23T06:20:10.101 INFO:teuthology.orchestra.run.trial093.stdout:(98/176): python3-jmespath-1.0.1-1.el9.noarch.r 571 kB/s | 48 kB 00:00 2026-02-23T06:20:10.185 INFO:teuthology.orchestra.run.trial093.stdout:(99/176): python3-libstoragemgmt-1.10.1-1.el9.x 2.1 MB/s | 177 kB 00:00 2026-02-23T06:20:10.233 INFO:teuthology.orchestra.run.trial058.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 131/178 2026-02-23T06:20:10.237 INFO:teuthology.orchestra.run.trial058.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 132/178 2026-02-23T06:20:10.257 INFO:teuthology.orchestra.run.trial093.stdout:(100/176): python3-jinja2-2.11.3-8.el9.noarch.r 775 kB/s | 249 kB 00:00 2026-02-23T06:20:10.274 INFO:teuthology.orchestra.run.trial093.stdout:(101/176): python3-lxml-4.6.5-3.el9.x86_64.rpm 14 MB/s | 1.2 MB 00:00 2026-02-23T06:20:10.340 INFO:teuthology.orchestra.run.trial093.stdout:(102/176): python3-markupsafe-1.1.1-12.el9.x86_ 420 kB/s | 35 kB 00:00 2026-02-23T06:20:10.451 INFO:teuthology.orchestra.run.trial093.stdout:(103/176): python3-numpy-1.23.5-2.el9.x86_64.rp 35 MB/s | 6.1 MB 00:00 2026-02-23T06:20:10.535 INFO:teuthology.orchestra.run.trial093.stdout:(104/176): python3-packaging-20.9-5.el9.noarch. 923 kB/s | 77 kB 00:00 2026-02-23T06:20:10.620 INFO:teuthology.orchestra.run.trial093.stdout:(105/176): python3-protobuf-3.14.0-17.el9.noarc 3.1 MB/s | 267 kB 00:00 2026-02-23T06:20:10.704 INFO:teuthology.orchestra.run.trial093.stdout:(106/176): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.8 MB/s | 159 kB 00:00 2026-02-23T06:20:10.754 INFO:teuthology.orchestra.run.trial093.stdout:(107/176): protobuf-3.14.0-17.el9.x86_64.rpm 930 kB/s | 1.0 MB 00:01 2026-02-23T06:20:10.789 INFO:teuthology.orchestra.run.trial093.stdout:(108/176): python3-pyasn1-modules-0.4.8-6.el9.n 3.2 MB/s | 279 kB 00:00 2026-02-23T06:20:10.795 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 132/178 2026-02-23T06:20:10.795 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-23T06:20:10.795 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:10.812 INFO:teuthology.orchestra.run.trial093.stdout:(109/176): python3-numpy-f2py-1.23.5-2.el9.x86_ 937 kB/s | 442 kB 00:00 2026-02-23T06:20:10.837 INFO:teuthology.orchestra.run.trial093.stdout:(110/176): python3-requests-oauthlib-1.3.0-12.e 640 kB/s | 54 kB 00:00 2026-02-23T06:20:10.897 INFO:teuthology.orchestra.run.trial093.stdout:(111/176): python3-toml-0.10.2-6.el9.noarch.rpm 492 kB/s | 42 kB 00:00 2026-02-23T06:20:10.921 INFO:teuthology.orchestra.run.trial093.stdout:(112/176): python3-wcwidth-0.2.5-8.el9.noarch.r 529 kB/s | 44 kB 00:00 2026-02-23T06:20:11.004 INFO:teuthology.orchestra.run.trial093.stdout:(113/176): qatlib-service-25.08.0-2.el9.x86_64. 447 kB/s | 37 kB 00:00 2026-02-23T06:20:11.087 INFO:teuthology.orchestra.run.trial093.stdout:(114/176): qatzip-libs-1.3.1-1.el9.x86_64.rpm 798 kB/s | 66 kB 00:00 2026-02-23T06:20:11.094 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-base-2:20.3.0-5449.gb60f8651.el9.x86_64 133/178 2026-02-23T06:20:11.136 INFO:teuthology.orchestra.run.trial093.stdout:(115/176): qatlib-25.08.0-2.el9.x86_64.rpm 1.0 MB/s | 240 kB 00:00 2026-02-23T06:20:11.164 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-base-2:20.3.0-5449.gb60f8651.el9.x86_64 133/178 2026-02-23T06:20:11.165 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-23T06:20:11.165 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-23T06:20:11.165 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:11.170 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-selinux-2:20.3.0-5449.gb60f8651.el9.x86_64 134/178 2026-02-23T06:20:11.218 INFO:teuthology.orchestra.run.trial093.stdout:(116/176): uuid-1.6.2-55.el9.x86_64.rpm 702 kB/s | 58 kB 00:00 2026-02-23T06:20:11.293 INFO:teuthology.orchestra.run.trial093.stdout:(117/176): python3-scipy-1.9.3-2.el9.x86_64.rpm 38 MB/s | 19 MB 00:00 2026-02-23T06:20:11.328 INFO:teuthology.orchestra.run.trial093.stdout:(118/176): socat-1.7.4.1-8.el9.x86_64.rpm 1.2 MB/s | 303 kB 00:00 2026-02-23T06:20:11.377 INFO:teuthology.orchestra.run.trial093.stdout:(119/176): xmlsec1-1.2.29-13.el9.x86_64.rpm 2.2 MB/s | 189 kB 00:00 2026-02-23T06:20:11.378 INFO:teuthology.orchestra.run.trial093.stdout:(120/176): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 600 kB/s | 96 kB 00:00 2026-02-23T06:20:11.412 INFO:teuthology.orchestra.run.trial093.stdout:(121/176): xmlsec1-openssl-1.2.29-13.el9.x86_64 1.1 MB/s | 90 kB 00:00 2026-02-23T06:20:11.461 INFO:teuthology.orchestra.run.trial093.stdout:(122/176): xmlstarlet-1.6.1-20.el9.x86_64.rpm 765 kB/s | 64 kB 00:00 2026-02-23T06:20:11.461 INFO:teuthology.orchestra.run.trial093.stdout:(123/176): zlib-devel-1.2.11-41.el9.x86_64.rpm 539 kB/s | 45 kB 00:00 2026-02-23T06:20:11.599 INFO:teuthology.orchestra.run.trial093.stdout:(124/176): abseil-cpp-20211102.0-4.el9.x86_64.r 3.9 MB/s | 551 kB 00:00 2026-02-23T06:20:11.622 INFO:teuthology.orchestra.run.trial093.stdout:(125/176): gperftools-libs-2.9.1-3.el9.x86_64.r 13 MB/s | 308 kB 00:00 2026-02-23T06:20:11.642 INFO:teuthology.orchestra.run.trial093.stdout:(126/176): grpc-data-1.46.7-10.el9.noarch.rpm 958 kB/s | 19 kB 00:00 2026-02-23T06:20:11.727 INFO:teuthology.orchestra.run.trial093.stdout:(127/176): libarrow-9.0.0-15.el9.x86_64.rpm 52 MB/s | 4.4 MB 00:00 2026-02-23T06:20:11.748 INFO:teuthology.orchestra.run.trial093.stdout:(128/176): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.2 MB/s | 25 kB 00:00 2026-02-23T06:20:11.768 INFO:teuthology.orchestra.run.trial093.stdout:(129/176): liboath-2.6.12-1.el9.x86_64.rpm 2.3 MB/s | 49 kB 00:00 2026-02-23T06:20:11.789 INFO:teuthology.orchestra.run.trial093.stdout:(130/176): libunwind-1.6.2-1.el9.x86_64.rpm 3.1 MB/s | 67 kB 00:00 2026-02-23T06:20:11.811 INFO:teuthology.orchestra.run.trial093.stdout:(131/176): luarocks-3.9.2-5.el9.noarch.rpm 6.7 MB/s | 151 kB 00:00 2026-02-23T06:20:11.848 INFO:teuthology.orchestra.run.trial093.stdout:(132/176): parquet-libs-9.0.0-15.el9.x86_64.rpm 23 MB/s | 838 kB 00:00 2026-02-23T06:20:11.872 INFO:teuthology.orchestra.run.trial093.stdout:(133/176): python3-asyncssh-2.13.2-5.el9.noarch 22 MB/s | 548 kB 00:00 2026-02-23T06:20:11.893 INFO:teuthology.orchestra.run.trial093.stdout:(134/176): python3-autocommand-2.2.2-8.el9.noar 1.4 MB/s | 29 kB 00:00 2026-02-23T06:20:11.914 INFO:teuthology.orchestra.run.trial093.stdout:(135/176): python3-backports-tarfile-1.2.0-1.el 2.8 MB/s | 60 kB 00:00 2026-02-23T06:20:11.935 INFO:teuthology.orchestra.run.trial093.stdout:(136/176): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.0 MB/s | 43 kB 00:00 2026-02-23T06:20:11.956 INFO:teuthology.orchestra.run.trial093.stdout:(137/176): python3-cachetools-4.2.4-1.el9.noarc 1.5 MB/s | 32 kB 00:00 2026-02-23T06:20:11.961 INFO:teuthology.orchestra.run.trial093.stdout:(138/176): lua-devel-5.4.4-4.el9.x86_64.rpm 41 kB/s | 22 kB 00:00 2026-02-23T06:20:11.977 INFO:teuthology.orchestra.run.trial093.stdout:(139/176): python3-certifi-2023.05.07-4.el9.noa 686 kB/s | 14 kB 00:00 2026-02-23T06:20:12.000 INFO:teuthology.orchestra.run.trial093.stdout:(140/176): python3-cherrypy-18.6.1-2.el9.noarch 15 MB/s | 358 kB 00:00 2026-02-23T06:20:12.026 INFO:teuthology.orchestra.run.trial093.stdout:(141/176): python3-cmd2-2.4.2-2.el9.noarch.rpm 11 MB/s | 303 kB 00:00 2026-02-23T06:20:12.050 INFO:teuthology.orchestra.run.trial093.stdout:(142/176): python3-google-auth-2.45.0-1.el9.noa 11 MB/s | 254 kB 00:00 2026-02-23T06:20:12.061 INFO:teuthology.orchestra.run.trial093.stdout:(143/176): python3-cheroot-10.0.1-4.el9.noarch. 1.7 MB/s | 173 kB 00:00 2026-02-23T06:20:12.085 INFO:teuthology.orchestra.run.trial093.stdout:(144/176): python3-grpcio-tools-1.46.7-10.el9.x 6.0 MB/s | 144 kB 00:00 2026-02-23T06:20:12.108 INFO:teuthology.orchestra.run.trial093.stdout:(145/176): python3-influxdb-5.3.1-1.el9.noarch. 5.9 MB/s | 139 kB 00:00 2026-02-23T06:20:12.111 INFO:teuthology.orchestra.run.trial093.stdout:(146/176): python3-grpcio-1.46.7-10.el9.x86_64. 33 MB/s | 2.0 MB 00:00 2026-02-23T06:20:12.130 INFO:teuthology.orchestra.run.trial093.stdout:(147/176): python3-isodate-0.6.1-3.el9.noarch.r 2.5 MB/s | 56 kB 00:00 2026-02-23T06:20:12.132 INFO:teuthology.orchestra.run.trial093.stdout:(148/176): python3-jaraco-8.2.1-3.el9.noarch.rp 513 kB/s | 11 kB 00:00 2026-02-23T06:20:12.151 INFO:teuthology.orchestra.run.trial093.stdout:(149/176): python3-jaraco-classes-3.2.1-5.el9.n 846 kB/s | 18 kB 00:00 2026-02-23T06:20:12.153 INFO:teuthology.orchestra.run.trial093.stdout:(150/176): python3-jaraco-collections-3.0.0-8.e 1.1 MB/s | 23 kB 00:00 2026-02-23T06:20:12.172 INFO:teuthology.orchestra.run.trial093.stdout:(151/176): python3-jaraco-context-6.0.1-3.el9.n 929 kB/s | 20 kB 00:00 2026-02-23T06:20:12.174 INFO:teuthology.orchestra.run.trial093.stdout:(152/176): python3-jaraco-functools-3.5.0-2.el9 936 kB/s | 19 kB 00:00 2026-02-23T06:20:12.193 INFO:teuthology.orchestra.run.trial093.stdout:(153/176): python3-jaraco-text-4.0.0-2.el9.noar 1.2 MB/s | 26 kB 00:00 2026-02-23T06:20:12.199 INFO:teuthology.orchestra.run.trial093.stdout:(154/176): python3-kubernetes-26.1.0-3.el9.noar 41 MB/s | 1.0 MB 00:00 2026-02-23T06:20:12.215 INFO:teuthology.orchestra.run.trial093.stdout:(155/176): python3-more-itertools-8.12.0-2.el9. 3.5 MB/s | 79 kB 00:00 2026-02-23T06:20:12.221 INFO:teuthology.orchestra.run.trial093.stdout:(156/176): python3-msgpack-1.0.3-2.el9.x86_64.r 3.8 MB/s | 86 kB 00:00 2026-02-23T06:20:12.237 INFO:teuthology.orchestra.run.trial093.stdout:(157/176): python3-natsort-7.1.1-5.el9.noarch.r 2.6 MB/s | 58 kB 00:00 2026-02-23T06:20:12.242 INFO:teuthology.orchestra.run.trial093.stdout:(158/176): python3-portend-3.1.0-2.el9.noarch.r 791 kB/s | 16 kB 00:00 2026-02-23T06:20:12.259 INFO:teuthology.orchestra.run.trial093.stdout:(159/176): python3-pyOpenSSL-21.0.0-1.el9.noarc 4.0 MB/s | 90 kB 00:00 2026-02-23T06:20:12.263 INFO:teuthology.orchestra.run.trial093.stdout:(160/176): python3-pyperclip-1.8.2-2.el9.noarch 1.3 MB/s | 28 kB 00:00 2026-02-23T06:20:12.280 INFO:teuthology.orchestra.run.trial093.stdout:(161/176): python3-repoze-lru-0.7-16.el9.noarch 1.4 MB/s | 31 kB 00:00 2026-02-23T06:20:12.284 INFO:teuthology.orchestra.run.trial093.stdout:(162/176): python3-routes-2.5.1-5.el9.noarch.rp 8.8 MB/s | 188 kB 00:00 2026-02-23T06:20:12.302 INFO:teuthology.orchestra.run.trial093.stdout:(163/176): python3-rsa-4.9-2.el9.noarch.rpm 2.7 MB/s | 59 kB 00:00 2026-02-23T06:20:12.306 INFO:teuthology.orchestra.run.trial093.stdout:(164/176): python3-saml-1.16.0-1.el9.noarch.rpm 5.4 MB/s | 125 kB 00:00 2026-02-23T06:20:12.323 INFO:teuthology.orchestra.run.trial093.stdout:(165/176): python3-tempora-5.0.0-2.el9.noarch.r 1.6 MB/s | 36 kB 00:00 2026-02-23T06:20:12.328 INFO:teuthology.orchestra.run.trial093.stdout:(166/176): python3-typing-extensions-4.15.0-1.e 4.0 MB/s | 86 kB 00:00 2026-02-23T06:20:12.346 INFO:teuthology.orchestra.run.trial093.stdout:(167/176): python3-websocket-client-1.2.3-2.el9 3.9 MB/s | 90 kB 00:00 2026-02-23T06:20:12.349 INFO:teuthology.orchestra.run.trial093.stdout:(168/176): python3-xmlsec-1.3.13-1.el9.x86_64.r 2.2 MB/s | 48 kB 00:00 2026-02-23T06:20:12.361 INFO:teuthology.orchestra.run.trial093.stdout:(169/176): protobuf-compiler-3.14.0-17.el9.x86_ 958 kB/s | 862 kB 00:00 2026-02-23T06:20:12.367 INFO:teuthology.orchestra.run.trial093.stdout:(170/176): python3-xmltodict-0.12.0-15.el9.noar 1.0 MB/s | 22 kB 00:00 2026-02-23T06:20:12.370 INFO:teuthology.orchestra.run.trial093.stdout:(171/176): python3-zc-lockfile-2.0-10.el9.noarc 959 kB/s | 20 kB 00:00 2026-02-23T06:20:12.391 INFO:teuthology.orchestra.run.trial093.stdout:(172/176): yaml-cpp-0.6.3-5.el9.x86_64.rpm 5.6 MB/s | 122 kB 00:00 2026-02-23T06:20:12.431 INFO:teuthology.orchestra.run.trial093.stdout:(173/176): thrift-0.15.0-4.el9.x86_64.rpm 25 MB/s | 1.6 MB 00:00 2026-02-23T06:20:12.459 INFO:teuthology.orchestra.run.trial093.stdout:(174/176): re2-20211101-20.el9.x86_64.rpm 1.9 MB/s | 191 kB 00:00 2026-02-23T06:20:13.802 INFO:teuthology.orchestra.run.trial093.stdout:(175/176): librados2-20.3.0-5449.gb60f8651.el9. 2.5 MB/s | 3.5 MB 00:01 2026-02-23T06:20:14.125 INFO:teuthology.orchestra.run.trial093.stdout:(176/176): librbd1-20.3.0-5449.gb60f8651.el9.x8 1.7 MB/s | 2.8 MB 00:01 2026-02-23T06:20:14.129 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-23T06:20:14.130 INFO:teuthology.orchestra.run.trial093.stdout:Total 28 MB/s | 330 MB 00:11 2026-02-23T06:20:14.863 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-23T06:20:14.923 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-23T06:20:14.923 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-23T06:20:16.115 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-23T06:20:16.116 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-23T06:20:17.326 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5449.gb60f8651.el9.x86_64 134/178 2026-02-23T06:20:17.326 INFO:teuthology.orchestra.run.trial058.stdout:skipping the directory /sys 2026-02-23T06:20:17.326 INFO:teuthology.orchestra.run.trial058.stdout:skipping the directory /proc 2026-02-23T06:20:17.326 INFO:teuthology.orchestra.run.trial058.stdout:skipping the directory /mnt 2026-02-23T06:20:17.326 INFO:teuthology.orchestra.run.trial058.stdout:skipping the directory /var/tmp 2026-02-23T06:20:17.326 INFO:teuthology.orchestra.run.trial058.stdout:skipping the directory /home 2026-02-23T06:20:17.326 INFO:teuthology.orchestra.run.trial058.stdout:skipping the directory /root 2026-02-23T06:20:17.326 INFO:teuthology.orchestra.run.trial058.stdout:skipping the directory /tmp 2026-02-23T06:20:17.326 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:17.376 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-23T06:20:17.384 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/178 2026-02-23T06:20:17.387 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/178 2026-02-23T06:20:17.396 INFO:teuthology.orchestra.run.trial093.stdout: Installing : liboath-2.6.12-1.el9.x86_64 3/178 2026-02-23T06:20:17.435 INFO:teuthology.orchestra.run.trial093.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 4/178 2026-02-23T06:20:17.441 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mds-2:20.3.0-5449.gb60f8651.el9.x86_64 135/178 2026-02-23T06:20:17.489 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mds-2:20.3.0-5449.gb60f8651.el9.x86_64 135/178 2026-02-23T06:20:17.489 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T06:20:17.489 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-23T06:20:17.489 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-23T06:20:17.489 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-23T06:20:17.489 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:17.586 INFO:teuthology.orchestra.run.trial093.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 5/178 2026-02-23T06:20:17.591 INFO:teuthology.orchestra.run.trial093.stdout: Upgrading : librados2-2:20.3.0-5449.gb60f8651.el9.x86_64 6/178 2026-02-23T06:20:17.643 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: librados2-2:20.3.0-5449.gb60f8651.el9.x86_64 6/178 2026-02-23T06:20:17.644 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libcephfs2-2:20.3.0-5449.gb60f8651.el9.x86_64 7/178 2026-02-23T06:20:17.657 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: libcephfs2-2:20.3.0-5449.gb60f8651.el9.x86_64 7/178 2026-02-23T06:20:17.660 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libcephfs-daemon-2:20.3.0-5449.gb60f8651.el9.x86 8/178 2026-02-23T06:20:17.660 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libcephfs-proxy2-2:20.3.0-5449.gb60f8651.el9.x86 9/178 2026-02-23T06:20:17.689 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5449.gb60f8651.el9.x86 9/178 2026-02-23T06:20:17.699 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-rados-2:20.3.0-5449.gb60f8651.el9.x86_64 10/178 2026-02-23T06:20:17.702 INFO:teuthology.orchestra.run.trial093.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 11/178 2026-02-23T06:20:17.705 INFO:teuthology.orchestra.run.trial093.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 12/178 2026-02-23T06:20:17.707 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 13/178 2026-02-23T06:20:17.710 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 14/178 2026-02-23T06:20:17.715 INFO:teuthology.orchestra.run.trial093.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 15/178 2026-02-23T06:20:17.719 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mon-2:20.3.0-5449.gb60f8651.el9.x86_64 136/178 2026-02-23T06:20:17.767 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mon-2:20.3.0-5449.gb60f8651.el9.x86_64 136/178 2026-02-23T06:20:17.767 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T06:20:17.767 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-23T06:20:17.767 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-23T06:20:17.768 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-23T06:20:17.768 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:17.778 INFO:teuthology.orchestra.run.trial058.stdout: Installing : mailcap-2.1.49-5.el9.noarch 137/178 2026-02-23T06:20:17.781 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 138/178 2026-02-23T06:20:17.819 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 139/178 2026-02-23T06:20:17.819 INFO:teuthology.orchestra.run.trial058.stdout:Creating group 'qat' with GID 992. 2026-02-23T06:20:17.819 INFO:teuthology.orchestra.run.trial058.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-23T06:20:17.819 INFO:teuthology.orchestra.run.trial058.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-23T06:20:17.819 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:17.833 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 139/178 2026-02-23T06:20:17.836 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 16/178 2026-02-23T06:20:17.837 INFO:teuthology.orchestra.run.trial093.stdout: Upgrading : librbd1-2:20.3.0-5449.gb60f8651.el9.x86_64 17/178 2026-02-23T06:20:17.886 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 139/178 2026-02-23T06:20:17.886 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-23T06:20:17.886 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:17.911 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: librbd1-2:20.3.0-5449.gb60f8651.el9.x86_64 17/178 2026-02-23T06:20:17.921 INFO:teuthology.orchestra.run.trial093.stdout: Installing : postgresql-13.23-1.el9.x86_64 18/178 2026-02-23T06:20:17.922 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libcephsqlite-2:20.3.0-5449.gb60f8651.el9.x86_64 19/178 2026-02-23T06:20:17.937 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 140/178 2026-02-23T06:20:17.943 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5449.gb60f8651.el9.x86_64 19/178 2026-02-23T06:20:17.944 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libradosstriper1-2:20.3.0-5449.gb60f8651.el9.x86 20/178 2026-02-23T06:20:17.993 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5449.gb60f8651.el9.x86 20/178 2026-02-23T06:20:17.999 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 21/178 2026-02-23T06:20:18.002 INFO:teuthology.orchestra.run.trial093.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 22/178 2026-02-23T06:20:18.005 INFO:teuthology.orchestra.run.trial093.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 23/178 2026-02-23T06:20:18.038 INFO:teuthology.orchestra.run.trial093.stdout: Installing : re2-1:20211101-20.el9.x86_64 24/178 2026-02-23T06:20:18.060 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 25/178 2026-02-23T06:20:18.064 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/178 2026-02-23T06:20:18.069 INFO:teuthology.orchestra.run.trial093.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 27/178 2026-02-23T06:20:18.071 INFO:teuthology.orchestra.run.trial093.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/178 2026-02-23T06:20:18.076 INFO:teuthology.orchestra.run.trial093.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 29/178 2026-02-23T06:20:18.099 INFO:teuthology.orchestra.run.trial093.stdout: Installing : unzip-6.0-59.el9.x86_64 30/178 2026-02-23T06:20:18.113 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 31/178 2026-02-23T06:20:18.119 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 32/178 2026-02-23T06:20:18.122 INFO:teuthology.orchestra.run.trial093.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 33/178 2026-02-23T06:20:18.128 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 34/178 2026-02-23T06:20:18.130 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 35/178 2026-02-23T06:20:18.131 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 36/178 2026-02-23T06:20:18.141 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 37/178 2026-02-23T06:20:18.175 INFO:teuthology.orchestra.run.trial093.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 38/178 2026-02-23T06:20:18.180 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-ceph-common-2:20.3.0-5449.gb60f8651.el9. 39/178 2026-02-23T06:20:18.191 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-ceph-argparse-2:20.3.0-5449.gb60f8651.el 40/178 2026-02-23T06:20:18.202 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-cephfs-2:20.3.0-5449.gb60f8651.el9.x86_6 41/178 2026-02-23T06:20:18.208 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 42/178 2026-02-23T06:20:18.233 INFO:teuthology.orchestra.run.trial093.stdout: Installing : zip-3.0-35.el9.x86_64 43/178 2026-02-23T06:20:18.236 INFO:teuthology.orchestra.run.trial093.stdout: Installing : luarocks-3.9.2-5.el9.noarch 44/178 2026-02-23T06:20:18.239 INFO:teuthology.orchestra.run.trial093.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 45/178 2026-02-23T06:20:18.242 INFO:teuthology.orchestra.run.trial093.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 46/178 2026-02-23T06:20:18.270 INFO:teuthology.orchestra.run.trial093.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 47/178 2026-02-23T06:20:18.322 INFO:teuthology.orchestra.run.trial093.stdout: Installing : automake-1.16.2-8.el9.noarch 48/178 2026-02-23T06:20:18.335 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 49/178 2026-02-23T06:20:18.337 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-rsa-4.9-2.el9.noarch 50/178 2026-02-23T06:20:18.342 INFO:teuthology.orchestra.run.trial093.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 51/178 2026-02-23T06:20:18.358 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 52/178 2026-02-23T06:20:18.363 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-rbd-2:20.3.0-5449.gb60f8651.el9.x86_64 53/178 2026-02-23T06:20:18.371 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/178 2026-02-23T06:20:18.378 INFO:teuthology.orchestra.run.trial093.stdout: Installing : librados-devel-2:20.3.0-5449.gb60f8651.el9.x86_6 55/178 2026-02-23T06:20:18.382 INFO:teuthology.orchestra.run.trial093.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 56/178 2026-02-23T06:20:18.394 INFO:teuthology.orchestra.run.trial093.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 57/178 2026-02-23T06:20:18.398 INFO:teuthology.orchestra.run.trial093.stdout: Installing : thrift-0.15.0-4.el9.x86_64 58/178 2026-02-23T06:20:18.402 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 59/178 2026-02-23T06:20:18.416 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 60/178 2026-02-23T06:20:18.421 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 61/178 2026-02-23T06:20:18.426 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 62/178 2026-02-23T06:20:18.437 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 63/178 2026-02-23T06:20:18.442 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 64/178 2026-02-23T06:20:18.451 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 65/178 2026-02-23T06:20:18.457 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 66/178 2026-02-23T06:20:18.476 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 67/178 2026-02-23T06:20:18.488 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 68/178 2026-02-23T06:20:18.503 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 69/178 2026-02-23T06:20:18.508 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 70/178 2026-02-23T06:20:18.515 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 71/178 2026-02-23T06:20:18.556 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 72/178 2026-02-23T06:20:18.586 INFO:teuthology.orchestra.run.trial058.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 141/178 2026-02-23T06:20:18.883 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 73/178 2026-02-23T06:20:18.893 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 74/178 2026-02-23T06:20:18.896 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 75/178 2026-02-23T06:20:18.902 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 76/178 2026-02-23T06:20:18.905 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 77/178 2026-02-23T06:20:18.913 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 78/178 2026-02-23T06:20:18.915 INFO:teuthology.orchestra.run.trial093.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 79/178 2026-02-23T06:20:18.916 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 80/178 2026-02-23T06:20:18.946 INFO:teuthology.orchestra.run.trial093.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 81/178 2026-02-23T06:20:18.990 INFO:teuthology.orchestra.run.trial093.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 82/178 2026-02-23T06:20:18.993 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 83/178 2026-02-23T06:20:18.997 INFO:teuthology.orchestra.run.trial093.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 84/178 2026-02-23T06:20:19.006 INFO:teuthology.orchestra.run.trial093.stdout: Installing : uuid-1.6.2-55.el9.x86_64 85/178 2026-02-23T06:20:19.012 INFO:teuthology.orchestra.run.trial093.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 86/178 2026-02-23T06:20:19.040 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 87/178 2026-02-23T06:20:19.047 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/178 2026-02-23T06:20:19.050 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 89/178 2026-02-23T06:20:19.056 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 90/178 2026-02-23T06:20:19.059 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 91/178 2026-02-23T06:20:19.067 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 92/178 2026-02-23T06:20:19.070 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 93/178 2026-02-23T06:20:19.098 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 94/178 2026-02-23T06:20:19.108 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 95/178 2026-02-23T06:20:19.114 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 96/178 2026-02-23T06:20:19.121 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 97/178 2026-02-23T06:20:19.156 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 98/178 2026-02-23T06:20:19.166 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 99/178 2026-02-23T06:20:19.371 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-osd-classic-2:20.3.0-5449.gb60f8651.el9.x86 142/178 2026-02-23T06:20:19.391 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 100/178 2026-02-23T06:20:19.415 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 101/178 2026-02-23T06:20:19.419 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 102/178 2026-02-23T06:20:19.461 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-osd-crimson-2:20.3.0-5449.gb60f8651.el9.x86 143/178 2026-02-23T06:20:19.466 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-volume-2:20.3.0-5449.gb60f8651.el9.noarch 144/178 2026-02-23T06:20:19.477 INFO:teuthology.orchestra.run.trial093.stdout: Installing : openblas-0.3.29-1.el9.x86_64 103/178 2026-02-23T06:20:19.479 INFO:teuthology.orchestra.run.trial093.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 104/178 2026-02-23T06:20:19.499 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-volume-2:20.3.0-5449.gb60f8651.el9.noarch 144/178 2026-02-23T06:20:19.500 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T06:20:19.500 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-23T06:20:19.500 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:19.501 INFO:teuthology.orchestra.run.trial093.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 105/178 2026-02-23T06:20:19.514 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-osd-2:20.3.0-5449.gb60f8651.el9.x86_64 145/178 2026-02-23T06:20:19.568 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-osd-2:20.3.0-5449.gb60f8651.el9.x86_64 145/178 2026-02-23T06:20:19.568 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T06:20:19.568 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-23T06:20:19.568 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-23T06:20:19.568 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-23T06:20:19.568 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:19.683 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: cephadm-2:20.3.0-5449.gb60f8651.el9.noarch 146/178 2026-02-23T06:20:19.686 INFO:teuthology.orchestra.run.trial058.stdout: Installing : cephadm-2:20.3.0-5449.gb60f8651.el9.noarch 146/178 2026-02-23T06:20:19.699 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5449.gb60f8651.e 147/178 2026-02-23T06:20:19.732 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5449.gb60f8651. 148/178 2026-02-23T06:20:19.735 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5449.gb60f8651.el9.noa 149/178 2026-02-23T06:20:19.830 INFO:teuthology.orchestra.run.trial093.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 106/178 2026-02-23T06:20:19.904 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 107/178 2026-02-23T06:20:20.581 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 108/178 2026-02-23T06:20:20.595 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 109/178 2026-02-23T06:20:20.598 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 110/178 2026-02-23T06:20:20.600 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 111/178 2026-02-23T06:20:20.606 INFO:teuthology.orchestra.run.trial093.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 112/178 2026-02-23T06:20:20.887 INFO:teuthology.orchestra.run.trial093.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 113/178 2026-02-23T06:20:20.888 INFO:teuthology.orchestra.run.trial093.stdout: Installing : librgw2-2:20.3.0-5449.gb60f8651.el9.x86_64 114/178 2026-02-23T06:20:20.907 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: librgw2-2:20.3.0-5449.gb60f8651.el9.x86_64 114/178 2026-02-23T06:20:20.908 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-rgw-2:20.3.0-5449.gb60f8651.el9.x86_64 115/178 2026-02-23T06:20:21.997 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-common-2:20.3.0-5449.gb60f8651.el9.x86_64 116/178 2026-02-23T06:20:22.000 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-common-2:20.3.0-5449.gb60f8651.el9.x86_64 116/178 2026-02-23T06:20:22.018 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-common-2:20.3.0-5449.gb60f8651.el9.x86_64 116/178 2026-02-23T06:20:22.028 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 117/178 2026-02-23T06:20:22.035 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-packaging-20.9-5.el9.noarch 118/178 2026-02-23T06:20:22.049 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-ply-3.11-14.el9.noarch 119/178 2026-02-23T06:20:22.065 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 120/178 2026-02-23T06:20:22.140 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 121/178 2026-02-23T06:20:22.149 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 122/178 2026-02-23T06:20:22.173 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 123/178 2026-02-23T06:20:22.203 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 124/178 2026-02-23T06:20:22.253 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 125/178 2026-02-23T06:20:22.259 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 126/178 2026-02-23T06:20:22.263 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 127/178 2026-02-23T06:20:22.267 INFO:teuthology.orchestra.run.trial093.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 128/178 2026-02-23T06:20:22.269 INFO:teuthology.orchestra.run.trial093.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 129/178 2026-02-23T06:20:22.270 INFO:teuthology.orchestra.run.trial093.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 130/178 2026-02-23T06:20:22.287 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 130/178 2026-02-23T06:20:22.404 INFO:teuthology.orchestra.run.trial093.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 131/178 2026-02-23T06:20:22.406 INFO:teuthology.orchestra.run.trial093.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 132/178 2026-02-23T06:20:22.690 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 132/178 2026-02-23T06:20:22.690 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-23T06:20:22.690 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:22.949 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-base-2:20.3.0-5449.gb60f8651.el9.x86_64 133/178 2026-02-23T06:20:22.967 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5449.gb60f8651.el9.noa 149/178 2026-02-23T06:20:22.982 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5449.gb60f8651.el9.n 150/178 2026-02-23T06:20:22.988 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-base-2:20.3.0-5449.gb60f8651.el9.x86_64 133/178 2026-02-23T06:20:22.988 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-23T06:20:22.988 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-23T06:20:22.989 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:22.991 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-selinux-2:20.3.0-5449.gb60f8651.el9.x86_64 134/178 2026-02-23T06:20:23.488 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5449.gb60f8651.el9.n 150/178 2026-02-23T06:20:23.490 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5449.gb60 151/178 2026-02-23T06:20:23.517 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5449.gb60 151/178 2026-02-23T06:20:23.519 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5449.gb60f8651.el9.n 152/178 2026-02-23T06:20:23.612 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5449.gb60f8651.el9.n 152/178 2026-02-23T06:20:23.659 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5449.gb60f8651.el 153/178 2026-02-23T06:20:23.662 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mgr-2:20.3.0-5449.gb60f8651.el9.x86_64 154/178 2026-02-23T06:20:23.709 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5449.gb60f8651.el9.x86_64 154/178 2026-02-23T06:20:23.709 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T06:20:23.709 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-23T06:20:23.709 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-23T06:20:23.709 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-23T06:20:23.709 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:23.727 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mgr-rook-2:20.3.0-5449.gb60f8651.el9.noarch 155/178 2026-02-23T06:20:23.748 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5449.gb60f8651.el9.noarch 155/178 2026-02-23T06:20:24.350 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-2:20.3.0-5449.gb60f8651.el9.x86_64 156/178 2026-02-23T06:20:24.354 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-radosgw-2:20.3.0-5449.gb60f8651.el9.x86_64 157/178 2026-02-23T06:20:24.403 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5449.gb60f8651.el9.x86_64 157/178 2026-02-23T06:20:24.403 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T06:20:24.403 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-23T06:20:24.404 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-23T06:20:24.404 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-23T06:20:24.404 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:24.416 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5449.gb60f8 158/178 2026-02-23T06:20:24.461 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5449.gb60f8 158/178 2026-02-23T06:20:24.462 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T06:20:24.462 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-23T06:20:24.462 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:24.478 INFO:teuthology.orchestra.run.trial058.stdout: Installing : cephfs-mirror-2:20.3.0-5449.gb60f8651.el9.x86_64 159/178 2026-02-23T06:20:24.525 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5449.gb60f8651.el9.x86_64 159/178 2026-02-23T06:20:24.525 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T06:20:24.525 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-23T06:20:24.525 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-23T06:20:24.526 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-23T06:20:24.526 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:24.660 INFO:teuthology.orchestra.run.trial058.stdout: Installing : rbd-mirror-2:20.3.0-5449.gb60f8651.el9.x86_64 160/178 2026-02-23T06:20:24.707 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5449.gb60f8651.el9.x86_64 160/178 2026-02-23T06:20:24.707 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T06:20:24.708 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-23T06:20:24.708 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-23T06:20:24.708 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-23T06:20:24.708 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:27.790 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5449.gb60f8651.el9.x86_64 134/178 2026-02-23T06:20:27.790 INFO:teuthology.orchestra.run.trial093.stdout:skipping the directory /sys 2026-02-23T06:20:27.791 INFO:teuthology.orchestra.run.trial093.stdout:skipping the directory /proc 2026-02-23T06:20:27.791 INFO:teuthology.orchestra.run.trial093.stdout:skipping the directory /mnt 2026-02-23T06:20:27.791 INFO:teuthology.orchestra.run.trial093.stdout:skipping the directory /var/tmp 2026-02-23T06:20:27.791 INFO:teuthology.orchestra.run.trial093.stdout:skipping the directory /home 2026-02-23T06:20:27.791 INFO:teuthology.orchestra.run.trial093.stdout:skipping the directory /root 2026-02-23T06:20:27.791 INFO:teuthology.orchestra.run.trial093.stdout:skipping the directory /tmp 2026-02-23T06:20:27.791 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:27.893 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mds-2:20.3.0-5449.gb60f8651.el9.x86_64 135/178 2026-02-23T06:20:27.916 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-mds-2:20.3.0-5449.gb60f8651.el9.x86_64 135/178 2026-02-23T06:20:27.917 INFO:teuthology.orchestra.run.trial093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T06:20:27.917 INFO:teuthology.orchestra.run.trial093.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-23T06:20:27.917 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-23T06:20:27.917 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-23T06:20:27.917 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:28.136 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mon-2:20.3.0-5449.gb60f8651.el9.x86_64 136/178 2026-02-23T06:20:28.157 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-mon-2:20.3.0-5449.gb60f8651.el9.x86_64 136/178 2026-02-23T06:20:28.158 INFO:teuthology.orchestra.run.trial093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T06:20:28.158 INFO:teuthology.orchestra.run.trial093.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-23T06:20:28.158 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-23T06:20:28.158 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-23T06:20:28.158 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:28.165 INFO:teuthology.orchestra.run.trial093.stdout: Installing : mailcap-2.1.49-5.el9.noarch 137/178 2026-02-23T06:20:28.166 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 138/178 2026-02-23T06:20:28.185 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 139/178 2026-02-23T06:20:28.185 INFO:teuthology.orchestra.run.trial093.stdout:Creating group 'qat' with GID 992. 2026-02-23T06:20:28.185 INFO:teuthology.orchestra.run.trial093.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-23T06:20:28.185 INFO:teuthology.orchestra.run.trial093.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-23T06:20:28.185 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:28.194 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 139/178 2026-02-23T06:20:28.218 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 139/178 2026-02-23T06:20:28.218 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-23T06:20:28.218 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:28.255 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 140/178 2026-02-23T06:20:28.311 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-test-2:20.3.0-5449.gb60f8651.el9.x86_64 161/178 2026-02-23T06:20:28.332 INFO:teuthology.orchestra.run.trial058.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 162/178 2026-02-23T06:20:28.338 INFO:teuthology.orchestra.run.trial058.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 163/178 2026-02-23T06:20:28.450 INFO:teuthology.orchestra.run.trial058.stdout: Installing : cephfs-shell-2:20.3.0-5449.gb60f8651.el9.x86_64 164/178 2026-02-23T06:20:28.464 INFO:teuthology.orchestra.run.trial058.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 165/178 2026-02-23T06:20:28.479 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libcephfs-devel-2:20.3.0-5449.gb60f8651.el9.x86_ 166/178 2026-02-23T06:20:28.482 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libtool-2.4.6-46.el9.x86_64 167/178 2026-02-23T06:20:28.693 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 168/178 2026-02-23T06:20:28.703 INFO:teuthology.orchestra.run.trial058.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 168/178 2026-02-23T06:20:28.742 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 168/178 2026-02-23T06:20:28.754 INFO:teuthology.orchestra.run.trial058.stdout: Installing : rbd-fuse-2:20.3.0-5449.gb60f8651.el9.x86_64 169/178 2026-02-23T06:20:28.760 INFO:teuthology.orchestra.run.trial058.stdout: Installing : rbd-nbd-2:20.3.0-5449.gb60f8651.el9.x86_64 170/178 2026-02-23T06:20:28.806 INFO:teuthology.orchestra.run.trial058.stdout: Installing : cephfs-top-2:20.3.0-5449.gb60f8651.el9.noarch 171/178 2026-02-23T06:20:28.876 INFO:teuthology.orchestra.run.trial093.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 141/178 2026-02-23T06:20:29.631 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-osd-classic-2:20.3.0-5449.gb60f8651.el9.x86 142/178 2026-02-23T06:20:29.677 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-fuse-2:20.3.0-5449.gb60f8651.el9.x86_64 172/178 2026-02-23T06:20:29.694 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-osd-crimson-2:20.3.0-5449.gb60f8651.el9.x86 143/178 2026-02-23T06:20:29.696 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-volume-2:20.3.0-5449.gb60f8651.el9.noarch 144/178 2026-02-23T06:20:29.710 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-volume-2:20.3.0-5449.gb60f8651.el9.noarch 144/178 2026-02-23T06:20:29.710 INFO:teuthology.orchestra.run.trial093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T06:20:29.710 INFO:teuthology.orchestra.run.trial093.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-23T06:20:29.710 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:29.711 INFO:teuthology.orchestra.run.trial058.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 173/178 2026-02-23T06:20:29.720 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-osd-2:20.3.0-5449.gb60f8651.el9.x86_64 145/178 2026-02-23T06:20:29.727 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 174/178 2026-02-23T06:20:29.744 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-osd-2:20.3.0-5449.gb60f8651.el9.x86_64 145/178 2026-02-23T06:20:29.744 INFO:teuthology.orchestra.run.trial093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T06:20:29.745 INFO:teuthology.orchestra.run.trial093.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-23T06:20:29.745 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-23T06:20:29.745 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-23T06:20:29.745 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:29.770 INFO:teuthology.orchestra.run.trial058.stdout: Installing : flex-2.6.4-9.el9.x86_64 175/178 2026-02-23T06:20:29.778 INFO:teuthology.orchestra.run.trial058.stdout: Installing : bison-3.7.4-5.el9.x86_64 176/178 2026-02-23T06:20:29.778 INFO:teuthology.orchestra.run.trial058.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 177/178 2026-02-23T06:20:29.801 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: cephadm-2:20.3.0-5449.gb60f8651.el9.noarch 146/178 2026-02-23T06:20:29.803 INFO:teuthology.orchestra.run.trial093.stdout: Installing : cephadm-2:20.3.0-5449.gb60f8651.el9.noarch 146/178 2026-02-23T06:20:29.808 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 177/178 2026-02-23T06:20:29.808 INFO:teuthology.orchestra.run.trial058.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 178/178 2026-02-23T06:20:29.812 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5449.gb60f8651.e 147/178 2026-02-23T06:20:29.835 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 178/178 2026-02-23T06:20:29.835 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5449.gb60f8651. 148/178 2026-02-23T06:20:29.837 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5449.gb60f8651.el9.noa 149/178 2026-02-23T06:20:29.850 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5449.gb60f8651.el9.x86 178/178 2026-02-23T06:20:29.885 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5449.gb60f8651.el9.x86 178/178 2026-02-23T06:20:30.046 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 178/178 2026-02-23T06:20:30.046 INFO:teuthology.orchestra.run.trial058.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2026-02-23T06:20:30.046 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:31.191 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-2:20.3.0-5449.gb60f8651.el9.x86_64 1/178 2026-02-23T06:20:31.191 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-base-2:20.3.0-5449.gb60f8651.el9.x86_64 2/178 2026-02-23T06:20:31.191 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-common-2:20.3.0-5449.gb60f8651.el9.x86_64 3/178 2026-02-23T06:20:31.191 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-fuse-2:20.3.0-5449.gb60f8651.el9.x86_64 4/178 2026-02-23T06:20:31.191 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5449.gb60f8 5/178 2026-02-23T06:20:31.191 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mds-2:20.3.0-5449.gb60f8651.el9.x86_64 6/178 2026-02-23T06:20:31.191 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mgr-2:20.3.0-5449.gb60f8651.el9.x86_64 7/178 2026-02-23T06:20:31.191 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mon-2:20.3.0-5449.gb60f8651.el9.x86_64 8/178 2026-02-23T06:20:31.191 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-osd-2:20.3.0-5449.gb60f8651.el9.x86_64 9/178 2026-02-23T06:20:31.191 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-osd-classic-2:20.3.0-5449.gb60f8651.el9.x86 10/178 2026-02-23T06:20:31.191 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5449.gb60f8651.el9.x86 11/178 2026-02-23T06:20:31.191 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-radosgw-2:20.3.0-5449.gb60f8651.el9.x86_64 12/178 2026-02-23T06:20:31.191 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-selinux-2:20.3.0-5449.gb60f8651.el9.x86_64 13/178 2026-02-23T06:20:31.191 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-test-2:20.3.0-5449.gb60f8651.el9.x86_64 14/178 2026-02-23T06:20:31.191 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : cephfs-mirror-2:20.3.0-5449.gb60f8651.el9.x86_64 15/178 2026-02-23T06:20:31.191 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : cephfs-shell-2:20.3.0-5449.gb60f8651.el9.x86_64 16/178 2026-02-23T06:20:31.191 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libcephfs-daemon-2:20.3.0-5449.gb60f8651.el9.x86 17/178 2026-02-23T06:20:31.191 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libcephfs-devel-2:20.3.0-5449.gb60f8651.el9.x86_ 18/178 2026-02-23T06:20:31.191 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5449.gb60f8651.el9.x86 19/178 2026-02-23T06:20:31.191 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libcephfs2-2:20.3.0-5449.gb60f8651.el9.x86_64 20/178 2026-02-23T06:20:31.191 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libcephsqlite-2:20.3.0-5449.gb60f8651.el9.x86_64 21/178 2026-02-23T06:20:31.191 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librados-devel-2:20.3.0-5449.gb60f8651.el9.x86_6 22/178 2026-02-23T06:20:31.191 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libradosstriper1-2:20.3.0-5449.gb60f8651.el9.x86 23/178 2026-02-23T06:20:31.191 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librgw2-2:20.3.0-5449.gb60f8651.el9.x86_64 24/178 2026-02-23T06:20:31.191 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5449.gb60f8651.el 25/178 2026-02-23T06:20:31.191 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-ceph-common-2:20.3.0-5449.gb60f8651.el9. 26/178 2026-02-23T06:20:31.191 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-cephfs-2:20.3.0-5449.gb60f8651.el9.x86_6 27/178 2026-02-23T06:20:31.191 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-rados-2:20.3.0-5449.gb60f8651.el9.x86_64 28/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-rbd-2:20.3.0-5449.gb60f8651.el9.x86_64 29/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-rgw-2:20.3.0-5449.gb60f8651.el9.x86_64 30/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : rbd-fuse-2:20.3.0-5449.gb60f8651.el9.x86_64 31/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : rbd-mirror-2:20.3.0-5449.gb60f8651.el9.x86_64 32/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : rbd-nbd-2:20.3.0-5449.gb60f8651.el9.x86_64 33/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5449.gb60f8651. 34/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5449.gb60f8651.el9.noa 35/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5449.gb60f8651.el9.n 36/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5449.gb60 37/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5449.gb60f8651.el9.n 38/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5449.gb60f8651.el 39/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5449.gb60f8651.el9.noarch 40/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5449.gb60f8651.e 41/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-volume-2:20.3.0-5449.gb60f8651.el9.noarch 42/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : cephadm-2:20.3.0-5449.gb60f8651.el9.noarch 43/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : cephfs-top-2:20.3.0-5449.gb60f8651.el9.noarch 44/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 45/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 46/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 47/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 48/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 49/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 50/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 51/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 52/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 53/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 54/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 55/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 56/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 57/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-ply-3.11-14.el9.noarch 58/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 59/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 60/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 61/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 62/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : unzip-6.0-59.el9.x86_64 63/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : zip-3.0-35.el9.x86_64 64/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : automake-1.16.2-8.el9.noarch 65/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : bison-3.7.4-5.el9.x86_64 66/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 67/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 68/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : flex-2.6.4-9.el9.x86_64 69/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 70/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 71/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 72/178 2026-02-23T06:20:31.192 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 73/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 74/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 75/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 76/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 77/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 78/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 79/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 80/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 81/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 82/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 83/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : lua-5.4.4-4.el9.x86_64 84/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 85/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 86/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 87/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 88/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 89/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 90/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : postgresql-13.23-1.el9.x86_64 91/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 92/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 93/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 94/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 95/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 96/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 97/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 98/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 99/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 100/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 101/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 102/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 103/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 104/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 105/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 106/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 107/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 108/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 109/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 110/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 111/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 112/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 113/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 114/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 115/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 116/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 117/178 2026-02-23T06:20:31.193 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 118/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 119/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 120/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 121/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 122/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 123/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 124/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 125/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 126/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 127/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 128/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 129/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 130/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 131/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 132/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 133/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 134/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 135/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 136/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 137/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 138/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 139/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 140/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 141/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 142/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 143/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 144/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 145/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 146/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 147/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 148/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 149/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 150/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 151/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 152/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 153/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 154/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 155/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 156/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 157/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 158/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 159/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 160/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 161/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 162/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 163/178 2026-02-23T06:20:31.194 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 164/178 2026-02-23T06:20:31.195 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 165/178 2026-02-23T06:20:31.195 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 166/178 2026-02-23T06:20:31.195 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 167/178 2026-02-23T06:20:31.195 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 168/178 2026-02-23T06:20:31.195 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 169/178 2026-02-23T06:20:31.195 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 170/178 2026-02-23T06:20:31.195 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 171/178 2026-02-23T06:20:31.195 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : re2-1:20211101-20.el9.x86_64 172/178 2026-02-23T06:20:31.195 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 173/178 2026-02-23T06:20:31.195 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 174/178 2026-02-23T06:20:31.195 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librados2-2:20.3.0-5449.gb60f8651.el9.x86_64 175/178 2026-02-23T06:20:31.195 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 176/178 2026-02-23T06:20:31.195 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librbd1-2:20.3.0-5449.gb60f8651.el9.x86_64 177/178 2026-02-23T06:20:31.302 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 178/178 2026-02-23T06:20:31.302 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:31.302 INFO:teuthology.orchestra.run.trial058.stdout:Upgraded: 2026-02-23T06:20:31.302 INFO:teuthology.orchestra.run.trial058.stdout: librados2-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.302 INFO:teuthology.orchestra.run.trial058.stdout: librbd1-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.302 INFO:teuthology.orchestra.run.trial058.stdout:Installed: 2026-02-23T06:20:31.302 INFO:teuthology.orchestra.run.trial058.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-23T06:20:31.303 INFO:teuthology.orchestra.run.trial058.stdout: automake-1.16.2-8.el9.noarch 2026-02-23T06:20:31.303 INFO:teuthology.orchestra.run.trial058.stdout: bison-3.7.4-5.el9.x86_64 2026-02-23T06:20:31.303 INFO:teuthology.orchestra.run.trial058.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-23T06:20:31.303 INFO:teuthology.orchestra.run.trial058.stdout: ceph-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.303 INFO:teuthology.orchestra.run.trial058.stdout: ceph-base-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.303 INFO:teuthology.orchestra.run.trial058.stdout: ceph-common-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.303 INFO:teuthology.orchestra.run.trial058.stdout: ceph-fuse-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.303 INFO:teuthology.orchestra.run.trial058.stdout: ceph-grafana-dashboards-2:20.3.0-5449.gb60f8651.el9.noarch 2026-02-23T06:20:31.303 INFO:teuthology.orchestra.run.trial058.stdout: ceph-immutable-object-cache-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.303 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mds-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.303 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.303 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-cephadm-2:20.3.0-5449.gb60f8651.el9.noarch 2026-02-23T06:20:31.304 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-dashboard-2:20.3.0-5449.gb60f8651.el9.noarch 2026-02-23T06:20:31.304 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5449.gb60f8651.el9.noarch 2026-02-23T06:20:31.304 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-k8sevents-2:20.3.0-5449.gb60f8651.el9.noarch 2026-02-23T06:20:31.304 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-modules-core-2:20.3.0-5449.gb60f8651.el9.noarch 2026-02-23T06:20:31.304 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-rook-2:20.3.0-5449.gb60f8651.el9.noarch 2026-02-23T06:20:31.304 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mon-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.304 INFO:teuthology.orchestra.run.trial058.stdout: ceph-osd-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.304 INFO:teuthology.orchestra.run.trial058.stdout: ceph-osd-classic-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.304 INFO:teuthology.orchestra.run.trial058.stdout: ceph-osd-crimson-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.304 INFO:teuthology.orchestra.run.trial058.stdout: ceph-prometheus-alerts-2:20.3.0-5449.gb60f8651.el9.noarch 2026-02-23T06:20:31.304 INFO:teuthology.orchestra.run.trial058.stdout: ceph-radosgw-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.304 INFO:teuthology.orchestra.run.trial058.stdout: ceph-selinux-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.305 INFO:teuthology.orchestra.run.trial058.stdout: ceph-test-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.305 INFO:teuthology.orchestra.run.trial058.stdout: ceph-volume-2:20.3.0-5449.gb60f8651.el9.noarch 2026-02-23T06:20:31.305 INFO:teuthology.orchestra.run.trial058.stdout: cephadm-2:20.3.0-5449.gb60f8651.el9.noarch 2026-02-23T06:20:31.305 INFO:teuthology.orchestra.run.trial058.stdout: cephfs-mirror-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.305 INFO:teuthology.orchestra.run.trial058.stdout: cephfs-shell-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.305 INFO:teuthology.orchestra.run.trial058.stdout: cephfs-top-2:20.3.0-5449.gb60f8651.el9.noarch 2026-02-23T06:20:31.305 INFO:teuthology.orchestra.run.trial058.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-23T06:20:31.305 INFO:teuthology.orchestra.run.trial058.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-23T06:20:31.305 INFO:teuthology.orchestra.run.trial058.stdout: flex-2.6.4-9.el9.x86_64 2026-02-23T06:20:31.305 INFO:teuthology.orchestra.run.trial058.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-23T06:20:31.305 INFO:teuthology.orchestra.run.trial058.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-23T06:20:31.305 INFO:teuthology.orchestra.run.trial058.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-23T06:20:31.306 INFO:teuthology.orchestra.run.trial058.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-23T06:20:31.306 INFO:teuthology.orchestra.run.trial058.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-23T06:20:31.306 INFO:teuthology.orchestra.run.trial058.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-23T06:20:31.306 INFO:teuthology.orchestra.run.trial058.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-23T06:20:31.306 INFO:teuthology.orchestra.run.trial058.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-23T06:20:31.306 INFO:teuthology.orchestra.run.trial058.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-23T06:20:31.306 INFO:teuthology.orchestra.run.trial058.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-23T06:20:31.306 INFO:teuthology.orchestra.run.trial058.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-23T06:20:31.306 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs-daemon-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.306 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs-devel-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.306 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs-proxy2-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.306 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs2-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.306 INFO:teuthology.orchestra.run.trial058.stdout: libcephsqlite-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.307 INFO:teuthology.orchestra.run.trial058.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-23T06:20:31.307 INFO:teuthology.orchestra.run.trial058.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-23T06:20:31.307 INFO:teuthology.orchestra.run.trial058.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-23T06:20:31.307 INFO:teuthology.orchestra.run.trial058.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-23T06:20:31.307 INFO:teuthology.orchestra.run.trial058.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-23T06:20:31.307 INFO:teuthology.orchestra.run.trial058.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-23T06:20:31.307 INFO:teuthology.orchestra.run.trial058.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-23T06:20:31.307 INFO:teuthology.orchestra.run.trial058.stdout: librados-devel-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.307 INFO:teuthology.orchestra.run.trial058.stdout: libradosstriper1-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.307 INFO:teuthology.orchestra.run.trial058.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-23T06:20:31.307 INFO:teuthology.orchestra.run.trial058.stdout: librgw2-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.307 INFO:teuthology.orchestra.run.trial058.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-23T06:20:31.308 INFO:teuthology.orchestra.run.trial058.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-23T06:20:31.308 INFO:teuthology.orchestra.run.trial058.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-23T06:20:31.308 INFO:teuthology.orchestra.run.trial058.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-23T06:20:31.308 INFO:teuthology.orchestra.run.trial058.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-23T06:20:31.308 INFO:teuthology.orchestra.run.trial058.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-23T06:20:31.308 INFO:teuthology.orchestra.run.trial058.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-23T06:20:31.308 INFO:teuthology.orchestra.run.trial058.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-23T06:20:31.308 INFO:teuthology.orchestra.run.trial058.stdout: lua-5.4.4-4.el9.x86_64 2026-02-23T06:20:31.308 INFO:teuthology.orchestra.run.trial058.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-23T06:20:31.308 INFO:teuthology.orchestra.run.trial058.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-23T06:20:31.308 INFO:teuthology.orchestra.run.trial058.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-23T06:20:31.308 INFO:teuthology.orchestra.run.trial058.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-23T06:20:31.308 INFO:teuthology.orchestra.run.trial058.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-23T06:20:31.309 INFO:teuthology.orchestra.run.trial058.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-23T06:20:31.309 INFO:teuthology.orchestra.run.trial058.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-23T06:20:31.309 INFO:teuthology.orchestra.run.trial058.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-23T06:20:31.309 INFO:teuthology.orchestra.run.trial058.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-23T06:20:31.309 INFO:teuthology.orchestra.run.trial058.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-23T06:20:31.309 INFO:teuthology.orchestra.run.trial058.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-23T06:20:31.309 INFO:teuthology.orchestra.run.trial058.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-23T06:20:31.309 INFO:teuthology.orchestra.run.trial058.stdout: postgresql-13.23-1.el9.x86_64 2026-02-23T06:20:31.309 INFO:teuthology.orchestra.run.trial058.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-23T06:20:31.309 INFO:teuthology.orchestra.run.trial058.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-23T06:20:31.309 INFO:teuthology.orchestra.run.trial058.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-23T06:20:31.309 INFO:teuthology.orchestra.run.trial058.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-23T06:20:31.310 INFO:teuthology.orchestra.run.trial058.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-23T06:20:31.310 INFO:teuthology.orchestra.run.trial058.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-23T06:20:31.310 INFO:teuthology.orchestra.run.trial058.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-23T06:20:31.310 INFO:teuthology.orchestra.run.trial058.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-23T06:20:31.310 INFO:teuthology.orchestra.run.trial058.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-23T06:20:31.310 INFO:teuthology.orchestra.run.trial058.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-23T06:20:31.310 INFO:teuthology.orchestra.run.trial058.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-23T06:20:31.310 INFO:teuthology.orchestra.run.trial058.stdout: python3-ceph-argparse-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.310 INFO:teuthology.orchestra.run.trial058.stdout: python3-ceph-common-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.310 INFO:teuthology.orchestra.run.trial058.stdout: python3-cephfs-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.310 INFO:teuthology.orchestra.run.trial058.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-23T06:20:31.310 INFO:teuthology.orchestra.run.trial058.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-23T06:20:31.311 INFO:teuthology.orchestra.run.trial058.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-23T06:20:31.311 INFO:teuthology.orchestra.run.trial058.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-23T06:20:31.311 INFO:teuthology.orchestra.run.trial058.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-23T06:20:31.311 INFO:teuthology.orchestra.run.trial058.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-23T06:20:31.311 INFO:teuthology.orchestra.run.trial058.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-23T06:20:31.311 INFO:teuthology.orchestra.run.trial058.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-23T06:20:31.311 INFO:teuthology.orchestra.run.trial058.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-23T06:20:31.311 INFO:teuthology.orchestra.run.trial058.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-23T06:20:31.311 INFO:teuthology.orchestra.run.trial058.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-23T06:20:31.311 INFO:teuthology.orchestra.run.trial058.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-23T06:20:31.311 INFO:teuthology.orchestra.run.trial058.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-23T06:20:31.311 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-23T06:20:31.311 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-23T06:20:31.312 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-23T06:20:31.312 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-23T06:20:31.312 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-23T06:20:31.312 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-23T06:20:31.312 INFO:teuthology.orchestra.run.trial058.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-23T06:20:31.312 INFO:teuthology.orchestra.run.trial058.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-23T06:20:31.312 INFO:teuthology.orchestra.run.trial058.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-23T06:20:31.312 INFO:teuthology.orchestra.run.trial058.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-23T06:20:31.312 INFO:teuthology.orchestra.run.trial058.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-23T06:20:31.312 INFO:teuthology.orchestra.run.trial058.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-23T06:20:31.312 INFO:teuthology.orchestra.run.trial058.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-23T06:20:31.312 INFO:teuthology.orchestra.run.trial058.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-23T06:20:31.312 INFO:teuthology.orchestra.run.trial058.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-23T06:20:31.313 INFO:teuthology.orchestra.run.trial058.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-23T06:20:31.313 INFO:teuthology.orchestra.run.trial058.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-23T06:20:31.313 INFO:teuthology.orchestra.run.trial058.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-23T06:20:31.313 INFO:teuthology.orchestra.run.trial058.stdout: python3-ply-3.11-14.el9.noarch 2026-02-23T06:20:31.313 INFO:teuthology.orchestra.run.trial058.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-23T06:20:31.313 INFO:teuthology.orchestra.run.trial058.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-23T06:20:31.313 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-23T06:20:31.313 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-23T06:20:31.313 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-23T06:20:31.313 INFO:teuthology.orchestra.run.trial058.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-23T06:20:31.313 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-23T06:20:31.313 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-23T06:20:31.313 INFO:teuthology.orchestra.run.trial058.stdout: python3-rados-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.314 INFO:teuthology.orchestra.run.trial058.stdout: python3-rbd-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.314 INFO:teuthology.orchestra.run.trial058.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-23T06:20:31.314 INFO:teuthology.orchestra.run.trial058.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-23T06:20:31.314 INFO:teuthology.orchestra.run.trial058.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-23T06:20:31.314 INFO:teuthology.orchestra.run.trial058.stdout: python3-rgw-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.314 INFO:teuthology.orchestra.run.trial058.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-23T06:20:31.314 INFO:teuthology.orchestra.run.trial058.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-23T06:20:31.314 INFO:teuthology.orchestra.run.trial058.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-23T06:20:31.314 INFO:teuthology.orchestra.run.trial058.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-23T06:20:31.314 INFO:teuthology.orchestra.run.trial058.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-23T06:20:31.314 INFO:teuthology.orchestra.run.trial058.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-23T06:20:31.314 INFO:teuthology.orchestra.run.trial058.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-23T06:20:31.315 INFO:teuthology.orchestra.run.trial058.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-23T06:20:31.315 INFO:teuthology.orchestra.run.trial058.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-23T06:20:31.315 INFO:teuthology.orchestra.run.trial058.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-23T06:20:31.315 INFO:teuthology.orchestra.run.trial058.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-23T06:20:31.315 INFO:teuthology.orchestra.run.trial058.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-23T06:20:31.315 INFO:teuthology.orchestra.run.trial058.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-23T06:20:31.315 INFO:teuthology.orchestra.run.trial058.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-23T06:20:31.315 INFO:teuthology.orchestra.run.trial058.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-23T06:20:31.315 INFO:teuthology.orchestra.run.trial058.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-23T06:20:31.315 INFO:teuthology.orchestra.run.trial058.stdout: rbd-fuse-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.315 INFO:teuthology.orchestra.run.trial058.stdout: rbd-mirror-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.315 INFO:teuthology.orchestra.run.trial058.stdout: rbd-nbd-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:31.315 INFO:teuthology.orchestra.run.trial058.stdout: re2-1:20211101-20.el9.x86_64 2026-02-23T06:20:31.316 INFO:teuthology.orchestra.run.trial058.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-23T06:20:31.316 INFO:teuthology.orchestra.run.trial058.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-23T06:20:31.316 INFO:teuthology.orchestra.run.trial058.stdout: unzip-6.0-59.el9.x86_64 2026-02-23T06:20:31.316 INFO:teuthology.orchestra.run.trial058.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-23T06:20:31.316 INFO:teuthology.orchestra.run.trial058.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-23T06:20:31.316 INFO:teuthology.orchestra.run.trial058.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-23T06:20:31.316 INFO:teuthology.orchestra.run.trial058.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-23T06:20:31.316 INFO:teuthology.orchestra.run.trial058.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-23T06:20:31.316 INFO:teuthology.orchestra.run.trial058.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-23T06:20:31.316 INFO:teuthology.orchestra.run.trial058.stdout: zip-3.0-35.el9.x86_64 2026-02-23T06:20:31.316 INFO:teuthology.orchestra.run.trial058.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-23T06:20:31.316 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:31.317 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-23T06:20:31.567 DEBUG:teuthology.parallel:result is None 2026-02-23T06:20:32.723 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5449.gb60f8651.el9.noa 149/178 2026-02-23T06:20:32.730 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5449.gb60f8651.el9.n 150/178 2026-02-23T06:20:33.181 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5449.gb60f8651.el9.n 150/178 2026-02-23T06:20:33.182 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5449.gb60 151/178 2026-02-23T06:20:33.194 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5449.gb60 151/178 2026-02-23T06:20:33.195 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5449.gb60f8651.el9.n 152/178 2026-02-23T06:20:33.255 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5449.gb60f8651.el9.n 152/178 2026-02-23T06:20:33.297 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5449.gb60f8651.el 153/178 2026-02-23T06:20:33.298 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mgr-2:20.3.0-5449.gb60f8651.el9.x86_64 154/178 2026-02-23T06:20:33.319 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5449.gb60f8651.el9.x86_64 154/178 2026-02-23T06:20:33.319 INFO:teuthology.orchestra.run.trial093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T06:20:33.319 INFO:teuthology.orchestra.run.trial093.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-23T06:20:33.319 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-23T06:20:33.319 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-23T06:20:33.320 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:33.332 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mgr-rook-2:20.3.0-5449.gb60f8651.el9.noarch 155/178 2026-02-23T06:20:33.342 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5449.gb60f8651.el9.noarch 155/178 2026-02-23T06:20:33.909 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-2:20.3.0-5449.gb60f8651.el9.x86_64 156/178 2026-02-23T06:20:33.911 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-radosgw-2:20.3.0-5449.gb60f8651.el9.x86_64 157/178 2026-02-23T06:20:33.932 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5449.gb60f8651.el9.x86_64 157/178 2026-02-23T06:20:33.932 INFO:teuthology.orchestra.run.trial093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T06:20:33.932 INFO:teuthology.orchestra.run.trial093.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-23T06:20:33.933 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-23T06:20:33.933 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-23T06:20:33.933 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:33.942 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5449.gb60f8 158/178 2026-02-23T06:20:33.963 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5449.gb60f8 158/178 2026-02-23T06:20:33.963 INFO:teuthology.orchestra.run.trial093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T06:20:33.963 INFO:teuthology.orchestra.run.trial093.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-23T06:20:33.963 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:33.976 INFO:teuthology.orchestra.run.trial093.stdout: Installing : cephfs-mirror-2:20.3.0-5449.gb60f8651.el9.x86_64 159/178 2026-02-23T06:20:33.996 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5449.gb60f8651.el9.x86_64 159/178 2026-02-23T06:20:33.996 INFO:teuthology.orchestra.run.trial093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T06:20:33.996 INFO:teuthology.orchestra.run.trial093.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-23T06:20:33.996 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-23T06:20:33.996 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-23T06:20:33.997 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:34.119 INFO:teuthology.orchestra.run.trial093.stdout: Installing : rbd-mirror-2:20.3.0-5449.gb60f8651.el9.x86_64 160/178 2026-02-23T06:20:34.140 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5449.gb60f8651.el9.x86_64 160/178 2026-02-23T06:20:34.140 INFO:teuthology.orchestra.run.trial093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-23T06:20:34.140 INFO:teuthology.orchestra.run.trial093.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-23T06:20:34.140 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-23T06:20:34.140 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-23T06:20:34.140 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:37.572 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-test-2:20.3.0-5449.gb60f8651.el9.x86_64 161/178 2026-02-23T06:20:37.586 INFO:teuthology.orchestra.run.trial093.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 162/178 2026-02-23T06:20:37.590 INFO:teuthology.orchestra.run.trial093.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 163/178 2026-02-23T06:20:37.665 INFO:teuthology.orchestra.run.trial093.stdout: Installing : cephfs-shell-2:20.3.0-5449.gb60f8651.el9.x86_64 164/178 2026-02-23T06:20:37.672 INFO:teuthology.orchestra.run.trial093.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 165/178 2026-02-23T06:20:37.682 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libcephfs-devel-2:20.3.0-5449.gb60f8651.el9.x86_ 166/178 2026-02-23T06:20:37.684 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libtool-2.4.6-46.el9.x86_64 167/178 2026-02-23T06:20:37.807 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 168/178 2026-02-23T06:20:37.811 INFO:teuthology.orchestra.run.trial093.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 168/178 2026-02-23T06:20:37.830 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 168/178 2026-02-23T06:20:37.840 INFO:teuthology.orchestra.run.trial093.stdout: Installing : rbd-fuse-2:20.3.0-5449.gb60f8651.el9.x86_64 169/178 2026-02-23T06:20:37.844 INFO:teuthology.orchestra.run.trial093.stdout: Installing : rbd-nbd-2:20.3.0-5449.gb60f8651.el9.x86_64 170/178 2026-02-23T06:20:37.887 INFO:teuthology.orchestra.run.trial093.stdout: Installing : cephfs-top-2:20.3.0-5449.gb60f8651.el9.noarch 171/178 2026-02-23T06:20:38.341 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-fuse-2:20.3.0-5449.gb60f8651.el9.x86_64 172/178 2026-02-23T06:20:38.357 INFO:teuthology.orchestra.run.trial093.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 173/178 2026-02-23T06:20:38.367 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 174/178 2026-02-23T06:20:38.395 INFO:teuthology.orchestra.run.trial093.stdout: Installing : flex-2.6.4-9.el9.x86_64 175/178 2026-02-23T06:20:38.399 INFO:teuthology.orchestra.run.trial093.stdout: Installing : bison-3.7.4-5.el9.x86_64 176/178 2026-02-23T06:20:38.399 INFO:teuthology.orchestra.run.trial093.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 177/178 2026-02-23T06:20:38.414 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 177/178 2026-02-23T06:20:38.414 INFO:teuthology.orchestra.run.trial093.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 178/178 2026-02-23T06:20:38.426 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 178/178 2026-02-23T06:20:38.433 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5449.gb60f8651.el9.x86 178/178 2026-02-23T06:20:38.459 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5449.gb60f8651.el9.x86 178/178 2026-02-23T06:20:39.548 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 178/178 2026-02-23T06:20:39.548 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-2:20.3.0-5449.gb60f8651.el9.x86_64 1/178 2026-02-23T06:20:39.548 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-base-2:20.3.0-5449.gb60f8651.el9.x86_64 2/178 2026-02-23T06:20:39.548 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-common-2:20.3.0-5449.gb60f8651.el9.x86_64 3/178 2026-02-23T06:20:39.548 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-fuse-2:20.3.0-5449.gb60f8651.el9.x86_64 4/178 2026-02-23T06:20:39.548 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5449.gb60f8 5/178 2026-02-23T06:20:39.548 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mds-2:20.3.0-5449.gb60f8651.el9.x86_64 6/178 2026-02-23T06:20:39.548 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mgr-2:20.3.0-5449.gb60f8651.el9.x86_64 7/178 2026-02-23T06:20:39.548 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mon-2:20.3.0-5449.gb60f8651.el9.x86_64 8/178 2026-02-23T06:20:39.548 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-osd-2:20.3.0-5449.gb60f8651.el9.x86_64 9/178 2026-02-23T06:20:39.548 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-osd-classic-2:20.3.0-5449.gb60f8651.el9.x86 10/178 2026-02-23T06:20:39.548 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5449.gb60f8651.el9.x86 11/178 2026-02-23T06:20:39.548 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-radosgw-2:20.3.0-5449.gb60f8651.el9.x86_64 12/178 2026-02-23T06:20:39.548 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-selinux-2:20.3.0-5449.gb60f8651.el9.x86_64 13/178 2026-02-23T06:20:39.548 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-test-2:20.3.0-5449.gb60f8651.el9.x86_64 14/178 2026-02-23T06:20:39.548 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : cephfs-mirror-2:20.3.0-5449.gb60f8651.el9.x86_64 15/178 2026-02-23T06:20:39.548 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : cephfs-shell-2:20.3.0-5449.gb60f8651.el9.x86_64 16/178 2026-02-23T06:20:39.548 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libcephfs-daemon-2:20.3.0-5449.gb60f8651.el9.x86 17/178 2026-02-23T06:20:39.548 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libcephfs-devel-2:20.3.0-5449.gb60f8651.el9.x86_ 18/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5449.gb60f8651.el9.x86 19/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libcephfs2-2:20.3.0-5449.gb60f8651.el9.x86_64 20/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libcephsqlite-2:20.3.0-5449.gb60f8651.el9.x86_64 21/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : librados-devel-2:20.3.0-5449.gb60f8651.el9.x86_6 22/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libradosstriper1-2:20.3.0-5449.gb60f8651.el9.x86 23/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : librgw2-2:20.3.0-5449.gb60f8651.el9.x86_64 24/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5449.gb60f8651.el 25/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-ceph-common-2:20.3.0-5449.gb60f8651.el9. 26/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-cephfs-2:20.3.0-5449.gb60f8651.el9.x86_6 27/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-rados-2:20.3.0-5449.gb60f8651.el9.x86_64 28/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-rbd-2:20.3.0-5449.gb60f8651.el9.x86_64 29/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-rgw-2:20.3.0-5449.gb60f8651.el9.x86_64 30/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : rbd-fuse-2:20.3.0-5449.gb60f8651.el9.x86_64 31/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : rbd-mirror-2:20.3.0-5449.gb60f8651.el9.x86_64 32/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : rbd-nbd-2:20.3.0-5449.gb60f8651.el9.x86_64 33/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5449.gb60f8651. 34/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5449.gb60f8651.el9.noa 35/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5449.gb60f8651.el9.n 36/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5449.gb60 37/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5449.gb60f8651.el9.n 38/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5449.gb60f8651.el 39/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5449.gb60f8651.el9.noarch 40/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5449.gb60f8651.e 41/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-volume-2:20.3.0-5449.gb60f8651.el9.noarch 42/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : cephadm-2:20.3.0-5449.gb60f8651.el9.noarch 43/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : cephfs-top-2:20.3.0-5449.gb60f8651.el9.noarch 44/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 45/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 46/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 47/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 48/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 49/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 50/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 51/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 52/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 53/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 54/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 55/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 56/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 57/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-ply-3.11-14.el9.noarch 58/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 59/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 60/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 61/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 62/178 2026-02-23T06:20:39.549 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : unzip-6.0-59.el9.x86_64 63/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : zip-3.0-35.el9.x86_64 64/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : automake-1.16.2-8.el9.noarch 65/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : bison-3.7.4-5.el9.x86_64 66/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 67/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 68/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : flex-2.6.4-9.el9.x86_64 69/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 70/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 71/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 72/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 73/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 74/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 75/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 76/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 77/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 78/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 79/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 80/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 81/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 82/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 83/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : lua-5.4.4-4.el9.x86_64 84/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 85/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 86/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 87/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 88/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 89/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 90/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : postgresql-13.23-1.el9.x86_64 91/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 92/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 93/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 94/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 95/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 96/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 97/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 98/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 99/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 100/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 101/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 102/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 103/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 104/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 105/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 106/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 107/178 2026-02-23T06:20:39.550 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 108/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 109/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 110/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 111/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 112/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 113/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 114/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 115/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 116/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 117/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 118/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 119/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 120/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 121/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 122/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 123/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 124/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 125/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 126/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 127/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 128/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 129/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 130/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 131/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 132/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 133/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 134/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 135/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 136/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 137/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 138/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 139/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 140/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 141/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 142/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 143/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 144/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 145/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 146/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 147/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 148/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 149/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 150/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 151/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 152/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 153/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 154/178 2026-02-23T06:20:39.551 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 155/178 2026-02-23T06:20:39.552 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 156/178 2026-02-23T06:20:39.552 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 157/178 2026-02-23T06:20:39.552 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 158/178 2026-02-23T06:20:39.552 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 159/178 2026-02-23T06:20:39.552 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 160/178 2026-02-23T06:20:39.552 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 161/178 2026-02-23T06:20:39.552 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 162/178 2026-02-23T06:20:39.552 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 163/178 2026-02-23T06:20:39.552 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 164/178 2026-02-23T06:20:39.552 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 165/178 2026-02-23T06:20:39.552 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 166/178 2026-02-23T06:20:39.552 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 167/178 2026-02-23T06:20:39.552 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 168/178 2026-02-23T06:20:39.552 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 169/178 2026-02-23T06:20:39.552 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 170/178 2026-02-23T06:20:39.552 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 171/178 2026-02-23T06:20:39.552 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : re2-1:20211101-20.el9.x86_64 172/178 2026-02-23T06:20:39.552 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 173/178 2026-02-23T06:20:39.552 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 174/178 2026-02-23T06:20:39.552 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : librados2-2:20.3.0-5449.gb60f8651.el9.x86_64 175/178 2026-02-23T06:20:39.552 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 176/178 2026-02-23T06:20:39.552 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : librbd1-2:20.3.0-5449.gb60f8651.el9.x86_64 177/178 2026-02-23T06:20:39.626 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 178/178 2026-02-23T06:20:39.626 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:39.626 INFO:teuthology.orchestra.run.trial093.stdout:Upgraded: 2026-02-23T06:20:39.626 INFO:teuthology.orchestra.run.trial093.stdout: librados2-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.626 INFO:teuthology.orchestra.run.trial093.stdout: librbd1-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.626 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-23T06:20:39.627 INFO:teuthology.orchestra.run.trial093.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-23T06:20:39.627 INFO:teuthology.orchestra.run.trial093.stdout: automake-1.16.2-8.el9.noarch 2026-02-23T06:20:39.627 INFO:teuthology.orchestra.run.trial093.stdout: bison-3.7.4-5.el9.x86_64 2026-02-23T06:20:39.627 INFO:teuthology.orchestra.run.trial093.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-23T06:20:39.627 INFO:teuthology.orchestra.run.trial093.stdout: ceph-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.627 INFO:teuthology.orchestra.run.trial093.stdout: ceph-base-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.627 INFO:teuthology.orchestra.run.trial093.stdout: ceph-common-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.627 INFO:teuthology.orchestra.run.trial093.stdout: ceph-fuse-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.627 INFO:teuthology.orchestra.run.trial093.stdout: ceph-grafana-dashboards-2:20.3.0-5449.gb60f8651.el9.noarch 2026-02-23T06:20:39.627 INFO:teuthology.orchestra.run.trial093.stdout: ceph-immutable-object-cache-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.628 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mds-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.628 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.628 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-cephadm-2:20.3.0-5449.gb60f8651.el9.noarch 2026-02-23T06:20:39.628 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-dashboard-2:20.3.0-5449.gb60f8651.el9.noarch 2026-02-23T06:20:39.628 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5449.gb60f8651.el9.noarch 2026-02-23T06:20:39.628 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-k8sevents-2:20.3.0-5449.gb60f8651.el9.noarch 2026-02-23T06:20:39.628 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-modules-core-2:20.3.0-5449.gb60f8651.el9.noarch 2026-02-23T06:20:39.628 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-rook-2:20.3.0-5449.gb60f8651.el9.noarch 2026-02-23T06:20:39.628 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mon-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.628 INFO:teuthology.orchestra.run.trial093.stdout: ceph-osd-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.628 INFO:teuthology.orchestra.run.trial093.stdout: ceph-osd-classic-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.629 INFO:teuthology.orchestra.run.trial093.stdout: ceph-osd-crimson-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.629 INFO:teuthology.orchestra.run.trial093.stdout: ceph-prometheus-alerts-2:20.3.0-5449.gb60f8651.el9.noarch 2026-02-23T06:20:39.629 INFO:teuthology.orchestra.run.trial093.stdout: ceph-radosgw-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.629 INFO:teuthology.orchestra.run.trial093.stdout: ceph-selinux-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.629 INFO:teuthology.orchestra.run.trial093.stdout: ceph-test-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.629 INFO:teuthology.orchestra.run.trial093.stdout: ceph-volume-2:20.3.0-5449.gb60f8651.el9.noarch 2026-02-23T06:20:39.629 INFO:teuthology.orchestra.run.trial093.stdout: cephadm-2:20.3.0-5449.gb60f8651.el9.noarch 2026-02-23T06:20:39.629 INFO:teuthology.orchestra.run.trial093.stdout: cephfs-mirror-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.629 INFO:teuthology.orchestra.run.trial093.stdout: cephfs-shell-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.630 INFO:teuthology.orchestra.run.trial093.stdout: cephfs-top-2:20.3.0-5449.gb60f8651.el9.noarch 2026-02-23T06:20:39.630 INFO:teuthology.orchestra.run.trial093.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-23T06:20:39.630 INFO:teuthology.orchestra.run.trial093.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-23T06:20:39.630 INFO:teuthology.orchestra.run.trial093.stdout: flex-2.6.4-9.el9.x86_64 2026-02-23T06:20:39.630 INFO:teuthology.orchestra.run.trial093.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-23T06:20:39.630 INFO:teuthology.orchestra.run.trial093.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-23T06:20:39.630 INFO:teuthology.orchestra.run.trial093.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-23T06:20:39.630 INFO:teuthology.orchestra.run.trial093.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-23T06:20:39.630 INFO:teuthology.orchestra.run.trial093.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-23T06:20:39.630 INFO:teuthology.orchestra.run.trial093.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-23T06:20:39.631 INFO:teuthology.orchestra.run.trial093.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-23T06:20:39.631 INFO:teuthology.orchestra.run.trial093.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-23T06:20:39.631 INFO:teuthology.orchestra.run.trial093.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-23T06:20:39.631 INFO:teuthology.orchestra.run.trial093.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-23T06:20:39.631 INFO:teuthology.orchestra.run.trial093.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-23T06:20:39.631 INFO:teuthology.orchestra.run.trial093.stdout: libcephfs-daemon-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.631 INFO:teuthology.orchestra.run.trial093.stdout: libcephfs-devel-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.631 INFO:teuthology.orchestra.run.trial093.stdout: libcephfs-proxy2-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.631 INFO:teuthology.orchestra.run.trial093.stdout: libcephfs2-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.631 INFO:teuthology.orchestra.run.trial093.stdout: libcephsqlite-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.631 INFO:teuthology.orchestra.run.trial093.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-23T06:20:39.631 INFO:teuthology.orchestra.run.trial093.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-23T06:20:39.632 INFO:teuthology.orchestra.run.trial093.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-23T06:20:39.632 INFO:teuthology.orchestra.run.trial093.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-23T06:20:39.632 INFO:teuthology.orchestra.run.trial093.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-23T06:20:39.632 INFO:teuthology.orchestra.run.trial093.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-23T06:20:39.632 INFO:teuthology.orchestra.run.trial093.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-23T06:20:39.632 INFO:teuthology.orchestra.run.trial093.stdout: librados-devel-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.632 INFO:teuthology.orchestra.run.trial093.stdout: libradosstriper1-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.632 INFO:teuthology.orchestra.run.trial093.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-23T06:20:39.632 INFO:teuthology.orchestra.run.trial093.stdout: librgw2-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.632 INFO:teuthology.orchestra.run.trial093.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-23T06:20:39.632 INFO:teuthology.orchestra.run.trial093.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-23T06:20:39.632 INFO:teuthology.orchestra.run.trial093.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-23T06:20:39.633 INFO:teuthology.orchestra.run.trial093.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-23T06:20:39.633 INFO:teuthology.orchestra.run.trial093.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-23T06:20:39.633 INFO:teuthology.orchestra.run.trial093.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-23T06:20:39.633 INFO:teuthology.orchestra.run.trial093.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-23T06:20:39.633 INFO:teuthology.orchestra.run.trial093.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-23T06:20:39.633 INFO:teuthology.orchestra.run.trial093.stdout: lua-5.4.4-4.el9.x86_64 2026-02-23T06:20:39.633 INFO:teuthology.orchestra.run.trial093.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-23T06:20:39.633 INFO:teuthology.orchestra.run.trial093.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-23T06:20:39.633 INFO:teuthology.orchestra.run.trial093.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-23T06:20:39.633 INFO:teuthology.orchestra.run.trial093.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-23T06:20:39.633 INFO:teuthology.orchestra.run.trial093.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-23T06:20:39.633 INFO:teuthology.orchestra.run.trial093.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-23T06:20:39.633 INFO:teuthology.orchestra.run.trial093.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-23T06:20:39.634 INFO:teuthology.orchestra.run.trial093.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-23T06:20:39.634 INFO:teuthology.orchestra.run.trial093.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-23T06:20:39.634 INFO:teuthology.orchestra.run.trial093.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-23T06:20:39.634 INFO:teuthology.orchestra.run.trial093.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-23T06:20:39.634 INFO:teuthology.orchestra.run.trial093.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-23T06:20:39.634 INFO:teuthology.orchestra.run.trial093.stdout: postgresql-13.23-1.el9.x86_64 2026-02-23T06:20:39.634 INFO:teuthology.orchestra.run.trial093.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-23T06:20:39.634 INFO:teuthology.orchestra.run.trial093.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-23T06:20:39.634 INFO:teuthology.orchestra.run.trial093.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-23T06:20:39.634 INFO:teuthology.orchestra.run.trial093.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-23T06:20:39.634 INFO:teuthology.orchestra.run.trial093.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-23T06:20:39.634 INFO:teuthology.orchestra.run.trial093.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-23T06:20:39.634 INFO:teuthology.orchestra.run.trial093.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-23T06:20:39.635 INFO:teuthology.orchestra.run.trial093.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-23T06:20:39.635 INFO:teuthology.orchestra.run.trial093.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-23T06:20:39.635 INFO:teuthology.orchestra.run.trial093.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-23T06:20:39.635 INFO:teuthology.orchestra.run.trial093.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-23T06:20:39.635 INFO:teuthology.orchestra.run.trial093.stdout: python3-ceph-argparse-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.635 INFO:teuthology.orchestra.run.trial093.stdout: python3-ceph-common-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.635 INFO:teuthology.orchestra.run.trial093.stdout: python3-cephfs-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.635 INFO:teuthology.orchestra.run.trial093.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-23T06:20:39.635 INFO:teuthology.orchestra.run.trial093.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-23T06:20:39.635 INFO:teuthology.orchestra.run.trial093.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-23T06:20:39.635 INFO:teuthology.orchestra.run.trial093.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-23T06:20:39.636 INFO:teuthology.orchestra.run.trial093.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-23T06:20:39.636 INFO:teuthology.orchestra.run.trial093.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-23T06:20:39.636 INFO:teuthology.orchestra.run.trial093.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-23T06:20:39.636 INFO:teuthology.orchestra.run.trial093.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-23T06:20:39.636 INFO:teuthology.orchestra.run.trial093.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-23T06:20:39.636 INFO:teuthology.orchestra.run.trial093.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-23T06:20:39.636 INFO:teuthology.orchestra.run.trial093.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-23T06:20:39.636 INFO:teuthology.orchestra.run.trial093.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-23T06:20:39.636 INFO:teuthology.orchestra.run.trial093.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-23T06:20:39.636 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-23T06:20:39.636 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-23T06:20:39.636 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-23T06:20:39.636 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-23T06:20:39.637 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-23T06:20:39.637 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-23T06:20:39.637 INFO:teuthology.orchestra.run.trial093.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-23T06:20:39.637 INFO:teuthology.orchestra.run.trial093.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-23T06:20:39.637 INFO:teuthology.orchestra.run.trial093.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-23T06:20:39.637 INFO:teuthology.orchestra.run.trial093.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-23T06:20:39.637 INFO:teuthology.orchestra.run.trial093.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-23T06:20:39.637 INFO:teuthology.orchestra.run.trial093.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-23T06:20:39.637 INFO:teuthology.orchestra.run.trial093.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-23T06:20:39.637 INFO:teuthology.orchestra.run.trial093.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-23T06:20:39.637 INFO:teuthology.orchestra.run.trial093.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-23T06:20:39.637 INFO:teuthology.orchestra.run.trial093.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-23T06:20:39.638 INFO:teuthology.orchestra.run.trial093.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-23T06:20:39.638 INFO:teuthology.orchestra.run.trial093.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-23T06:20:39.638 INFO:teuthology.orchestra.run.trial093.stdout: python3-ply-3.11-14.el9.noarch 2026-02-23T06:20:39.638 INFO:teuthology.orchestra.run.trial093.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-23T06:20:39.638 INFO:teuthology.orchestra.run.trial093.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-23T06:20:39.638 INFO:teuthology.orchestra.run.trial093.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-23T06:20:39.638 INFO:teuthology.orchestra.run.trial093.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-23T06:20:39.638 INFO:teuthology.orchestra.run.trial093.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-23T06:20:39.638 INFO:teuthology.orchestra.run.trial093.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-23T06:20:39.638 INFO:teuthology.orchestra.run.trial093.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-23T06:20:39.638 INFO:teuthology.orchestra.run.trial093.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-23T06:20:39.638 INFO:teuthology.orchestra.run.trial093.stdout: python3-rados-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.639 INFO:teuthology.orchestra.run.trial093.stdout: python3-rbd-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.639 INFO:teuthology.orchestra.run.trial093.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-23T06:20:39.639 INFO:teuthology.orchestra.run.trial093.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-23T06:20:39.639 INFO:teuthology.orchestra.run.trial093.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-23T06:20:39.639 INFO:teuthology.orchestra.run.trial093.stdout: python3-rgw-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.639 INFO:teuthology.orchestra.run.trial093.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-23T06:20:39.639 INFO:teuthology.orchestra.run.trial093.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-23T06:20:39.639 INFO:teuthology.orchestra.run.trial093.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-23T06:20:39.639 INFO:teuthology.orchestra.run.trial093.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-23T06:20:39.639 INFO:teuthology.orchestra.run.trial093.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-23T06:20:39.639 INFO:teuthology.orchestra.run.trial093.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-23T06:20:39.639 INFO:teuthology.orchestra.run.trial093.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-23T06:20:39.640 INFO:teuthology.orchestra.run.trial093.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-23T06:20:39.640 INFO:teuthology.orchestra.run.trial093.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-23T06:20:39.640 INFO:teuthology.orchestra.run.trial093.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-23T06:20:39.640 INFO:teuthology.orchestra.run.trial093.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-23T06:20:39.640 INFO:teuthology.orchestra.run.trial093.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-23T06:20:39.640 INFO:teuthology.orchestra.run.trial093.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-23T06:20:39.640 INFO:teuthology.orchestra.run.trial093.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-23T06:20:39.640 INFO:teuthology.orchestra.run.trial093.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-23T06:20:39.640 INFO:teuthology.orchestra.run.trial093.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-23T06:20:39.640 INFO:teuthology.orchestra.run.trial093.stdout: rbd-fuse-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.640 INFO:teuthology.orchestra.run.trial093.stdout: rbd-mirror-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.640 INFO:teuthology.orchestra.run.trial093.stdout: rbd-nbd-2:20.3.0-5449.gb60f8651.el9.x86_64 2026-02-23T06:20:39.640 INFO:teuthology.orchestra.run.trial093.stdout: re2-1:20211101-20.el9.x86_64 2026-02-23T06:20:39.641 INFO:teuthology.orchestra.run.trial093.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-23T06:20:39.641 INFO:teuthology.orchestra.run.trial093.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-23T06:20:39.641 INFO:teuthology.orchestra.run.trial093.stdout: unzip-6.0-59.el9.x86_64 2026-02-23T06:20:39.641 INFO:teuthology.orchestra.run.trial093.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-23T06:20:39.641 INFO:teuthology.orchestra.run.trial093.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-23T06:20:39.641 INFO:teuthology.orchestra.run.trial093.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-23T06:20:39.641 INFO:teuthology.orchestra.run.trial093.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-23T06:20:39.641 INFO:teuthology.orchestra.run.trial093.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-23T06:20:39.641 INFO:teuthology.orchestra.run.trial093.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-23T06:20:39.641 INFO:teuthology.orchestra.run.trial093.stdout: zip-3.0-35.el9.x86_64 2026-02-23T06:20:39.641 INFO:teuthology.orchestra.run.trial093.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-23T06:20:39.641 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:39.642 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-23T06:20:39.731 DEBUG:teuthology.parallel:result is None 2026-02-23T06:20:39.732 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b60f86513d744c550fab39595f0905abce2bdd7d 2026-02-23T06:20:39.856 DEBUG:teuthology.orchestra.run.trial058:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-23T06:20:39.902 INFO:teuthology.orchestra.run.trial058.stdout:20.3.0-5449.gb60f8651.el9 2026-02-23T06:20:39.903 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5449.gb60f8651.el9 2026-02-23T06:20:39.903 INFO:teuthology.task.install:The correct ceph version 20.3.0-5449.gb60f8651 is installed. 2026-02-23T06:20:39.906 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b60f86513d744c550fab39595f0905abce2bdd7d 2026-02-23T06:20:40.054 DEBUG:teuthology.orchestra.run.trial093:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-23T06:20:40.073 INFO:teuthology.orchestra.run.trial093.stdout:20.3.0-5449.gb60f8651.el9 2026-02-23T06:20:40.074 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5449.gb60f8651.el9 2026-02-23T06:20:40.074 INFO:teuthology.task.install:The correct ceph version 20.3.0-5449.gb60f8651 is installed. 2026-02-23T06:20:40.075 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-23T06:20:40.075 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:20:40.075 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-23T06:20:40.133 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-23T06:20:40.134 DEBUG:teuthology.orchestra.run.trial093:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-23T06:20:40.161 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-23T06:20:40.161 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:20:40.161 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/usr/bin/daemon-helper 2026-02-23T06:20:40.231 DEBUG:teuthology.orchestra.run.trial058:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-23T06:20:40.327 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-23T06:20:40.327 DEBUG:teuthology.orchestra.run.trial093:> sudo dd of=/usr/bin/daemon-helper 2026-02-23T06:20:40.351 DEBUG:teuthology.orchestra.run.trial093:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-23T06:20:40.416 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-23T06:20:40.416 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:20:40.416 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-23T06:20:40.472 DEBUG:teuthology.orchestra.run.trial058:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-23T06:20:40.567 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-23T06:20:40.567 DEBUG:teuthology.orchestra.run.trial093:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-23T06:20:40.592 DEBUG:teuthology.orchestra.run.trial093:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-23T06:20:40.657 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-23T06:20:40.658 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:20:40.658 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/usr/bin/stdin-killer 2026-02-23T06:20:40.714 DEBUG:teuthology.orchestra.run.trial058:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-23T06:20:40.808 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-23T06:20:40.809 DEBUG:teuthology.orchestra.run.trial093:> sudo dd of=/usr/bin/stdin-killer 2026-02-23T06:20:40.834 DEBUG:teuthology.orchestra.run.trial093:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-23T06:20:40.899 INFO:teuthology.run_tasks:Running task ceph... 2026-02-23T06:20:41.012 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-23T06:20:41.012 DEBUG:teuthology.orchestra.run.trial058:> sudo chmod 777 /var/log/ceph 2026-02-23T06:20:41.015 DEBUG:teuthology.orchestra.run.trial093:> sudo chmod 777 /var/log/ceph 2026-02-23T06:20:41.067 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-23T06:20:41.067 DEBUG:teuthology.orchestra.run.trial058:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-23T06:20:41.070 DEBUG:teuthology.orchestra.run.trial093:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-23T06:20:41.121 INFO:tasks.ceph:Creating extra log directories... 2026-02-23T06:20:41.121 DEBUG:teuthology.orchestra.run.trial058:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-23T06:20:41.124 DEBUG:teuthology.orchestra.run.trial093:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-23T06:20:41.187 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2026-02-23T06:20:41.188 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2026-02-23T06:20:41.188 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2026-02-23T06:20:41.188 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:20:41.188 DEBUG:teuthology.orchestra.run.trial058:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2026-02-23T06:20:41.226 DEBUG:teuthology.orchestra.run.trial058:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2026-02-23T06:20:41.473 DEBUG:teuthology.orchestra.run.trial058:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2026-02-23T06:20:41.531 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-23T06:20:41.531 DEBUG:teuthology.orchestra.run.trial093:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2026-02-23T06:20:41.546 DEBUG:teuthology.orchestra.run.trial093:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2026-02-23T06:20:41.732 DEBUG:teuthology.orchestra.run.trial093:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2026-02-23T06:20:41.759 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-23T06:20:41.759 INFO:tasks.ceph:config {'conf': {'client': {'client_shutdown_timeout': 120}, 'global': {'ms die on skipped message': False}, 'mds': {'mds oft prefetch dirfrags': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'BLUESTORE_SLOW_OP_ALERT', 'slow operation indications in BlueStore', 'experiencing slow operations in BlueStore', 'MGR_MODULE_ERROR', 'OSD_DOWN', 'osd.* is down', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'osds down', 'osd.* is down', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-23T06:20:41.759 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial/64975', 'branch': 'wip-vshankar-testing-20260222.101816', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_entire_dirfrags/no prefetch_oft_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/ffsb}}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '64975', 'kernel': {'client': {'branch': 'testing', 'flavor': 'default', 'kdb': 1, 'sha1': '8dec4b357aab872d3b63ec979924962a64be83dd'}, 'sha1': '8dec4b357aab872d3b63ec979924962a64be83dd'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'trial', 'name': 'vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20260222.101816'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': False, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client_shutdown_timeout': 120}, 'global': {'ms die on skipped message': False}, 'mds': {'mds oft prefetch dirfrags': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'BLUESTORE_SLOW_OP_ALERT', 'slow operation indications in BlueStore', 'experiencing slow operations in BlueStore', 'MGR_MODULE_ERROR', 'OSD_DOWN', 'osd.* is down', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'osds down', 'osd.* is down', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'sha1': 'b60f86513d744c550fab39595f0905abce2bdd7d'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b60f86513d744c550fab39595f0905abce2bdd7d'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20260222.101816', 'sha1': 'b60f86513d744c550fab39595f0905abce2bdd7d'}}, 'owner': 'scheduled_vshankar@soko04.front.sepia.ceph.com', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 9225, 'sha1': 'b60f86513d744c550fab39595f0905abce2bdd7d', 'sleep_before_teardown': 0, 'subset': '213/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20260222.101816', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_b60f86513d744c550fab39595f0905abce2bdd7d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'b60f86513d744c550fab39595f0905abce2bdd7d', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'trial058.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLr0ybXQP1GbjOLYxQS/M8nym9RfhbagIZnf7M46JEV5x541rxUhmydmSZl+FSYW0XcKmnaUTTkI9xpoCth6l3E=', 'trial093.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDHO3ZKUzuTjY7g426pFtA+oE5/QOsXRPNEWlOWXyKoPwhUCNMl6geIpXkfkqPwZJD+GPq9wfyfxWqYuu1K2YSI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing', 'flavor': 'default', 'kdb': 1, 'sha1': '8dec4b357aab872d3b63ec979924962a64be83dd'}, 'sha1': '8dec4b357aab872d3b63ec979924962a64be83dd'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b60f86513d744c550fab39595f0905abce2bdd7d'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': False, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client_shutdown_timeout': 120}, 'global': {'ms die on skipped message': False}, 'mds': {'mds oft prefetch dirfrags': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'BLUESTORE_SLOW_OP_ALERT', 'slow operation indications in BlueStore', 'experiencing slow operations in BlueStore', 'MGR_MODULE_ERROR', 'OSD_DOWN', 'osd.* is down', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'osds down', 'osd.* is down', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'sha1': 'b60f86513d744c550fab39595f0905abce2bdd7d', 'cluster': 'ceph'}}, {'kclient': None}, {'mon_thrash': {'check_mds_failover': True, 'revive_delay': 20, 'thrash_delay': 10}}, {'workunit': {'clients': {'all': ['suites/ffsb.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local kernel = py_attrgetter(yaml).get(\'kernel\')\nif kernel ~= nil then\n local branch = py_attrgetter(kernel).get(\'branch\')\n if branch and not kernel.branch:find "-all$" then\n log.debug("removing default kernel specification: %s", kernel)\n py_attrgetter(kernel).pop(\'branch\', nil)\n py_attrgetter(kernel).pop(\'deb\', nil)\n py_attrgetter(kernel).pop(\'flavor\', nil)\n py_attrgetter(kernel).pop(\'kdb\', nil)\n py_attrgetter(kernel).pop(\'koji\', nil)\n py_attrgetter(kernel).pop(\'koji_task\', nil)\n py_attrgetter(kernel).pop(\'rpm\', nil)\n py_attrgetter(kernel).pop(\'sha1\', nil)\n py_attrgetter(kernel).pop(\'tag\', nil)\n end\nend\n', "local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-23_04:04:18', 'tube': 'trial', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3318653'} 2026-02-23T06:20:41.759 DEBUG:teuthology.orchestra.run.trial058:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-23T06:20:41.763 DEBUG:teuthology.orchestra.run.trial093:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-23T06:20:41.811 DEBUG:teuthology.orchestra.run.trial058:> sudo install -d -m0777 -- /var/run/ceph 2026-02-23T06:20:41.842 DEBUG:teuthology.orchestra.run.trial093:> sudo install -d -m0777 -- /var/run/ceph 2026-02-23T06:20:41.893 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:20:41.894 DEBUG:teuthology.orchestra.run.trial058:> dd if=/scratch_devs of=/dev/stdout 2026-02-23T06:20:41.933 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-23T06:20:41.933 DEBUG:teuthology.orchestra.run.trial058:> stat /dev/vg_nvme/lv_1 2026-02-23T06:20:42.010 INFO:teuthology.orchestra.run.trial058.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-23T06:20:42.011 INFO:teuthology.orchestra.run.trial058.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-23T06:20:42.011 INFO:teuthology.orchestra.run.trial058.stdout:Device: 6h/6d Inode: 1089 Links: 1 2026-02-23T06:20:42.011 INFO:teuthology.orchestra.run.trial058.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-23T06:20:42.011 INFO:teuthology.orchestra.run.trial058.stdout:Context: system_u:object_r:device_t:s0 2026-02-23T06:20:42.011 INFO:teuthology.orchestra.run.trial058.stdout:Access: 2026-02-23 06:20:30.242470862 +0000 2026-02-23T06:20:42.011 INFO:teuthology.orchestra.run.trial058.stdout:Modify: 2026-02-23 06:20:10.900481534 +0000 2026-02-23T06:20:42.011 INFO:teuthology.orchestra.run.trial058.stdout:Change: 2026-02-23 06:20:10.900481534 +0000 2026-02-23T06:20:42.011 INFO:teuthology.orchestra.run.trial058.stdout: Birth: 2026-02-23 06:20:10.900481534 +0000 2026-02-23T06:20:42.012 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-23T06:20:42.104 INFO:teuthology.orchestra.run.trial058.stderr:1+0 records in 2026-02-23T06:20:42.104 INFO:teuthology.orchestra.run.trial058.stderr:1+0 records out 2026-02-23T06:20:42.104 INFO:teuthology.orchestra.run.trial058.stderr:512 bytes copied, 0.00020815 s, 2.5 MB/s 2026-02-23T06:20:42.106 DEBUG:teuthology.orchestra.run.trial058:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-23T06:20:42.146 DEBUG:teuthology.orchestra.run.trial058:> stat /dev/vg_nvme/lv_2 2026-02-23T06:20:42.225 INFO:teuthology.orchestra.run.trial058.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-23T06:20:42.225 INFO:teuthology.orchestra.run.trial058.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-23T06:20:42.225 INFO:teuthology.orchestra.run.trial058.stdout:Device: 6h/6d Inode: 1094 Links: 1 2026-02-23T06:20:42.226 INFO:teuthology.orchestra.run.trial058.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-23T06:20:42.226 INFO:teuthology.orchestra.run.trial058.stdout:Context: system_u:object_r:device_t:s0 2026-02-23T06:20:42.226 INFO:teuthology.orchestra.run.trial058.stdout:Access: 2026-02-23 06:20:30.243470861 +0000 2026-02-23T06:20:42.226 INFO:teuthology.orchestra.run.trial058.stdout:Modify: 2026-02-23 06:20:10.901644446 +0000 2026-02-23T06:20:42.226 INFO:teuthology.orchestra.run.trial058.stdout:Change: 2026-02-23 06:20:10.901644446 +0000 2026-02-23T06:20:42.226 INFO:teuthology.orchestra.run.trial058.stdout: Birth: 2026-02-23 06:20:10.901644446 +0000 2026-02-23T06:20:42.226 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-23T06:20:42.319 INFO:teuthology.orchestra.run.trial058.stderr:1+0 records in 2026-02-23T06:20:42.319 INFO:teuthology.orchestra.run.trial058.stderr:1+0 records out 2026-02-23T06:20:42.319 INFO:teuthology.orchestra.run.trial058.stderr:512 bytes copied, 0.00023497 s, 2.2 MB/s 2026-02-23T06:20:42.322 DEBUG:teuthology.orchestra.run.trial058:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-23T06:20:42.362 DEBUG:teuthology.orchestra.run.trial058:> stat /dev/vg_nvme/lv_3 2026-02-23T06:20:42.440 INFO:teuthology.orchestra.run.trial058.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-23T06:20:42.440 INFO:teuthology.orchestra.run.trial058.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-23T06:20:42.440 INFO:teuthology.orchestra.run.trial058.stdout:Device: 6h/6d Inode: 1100 Links: 1 2026-02-23T06:20:42.440 INFO:teuthology.orchestra.run.trial058.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-23T06:20:42.440 INFO:teuthology.orchestra.run.trial058.stdout:Context: system_u:object_r:device_t:s0 2026-02-23T06:20:42.440 INFO:teuthology.orchestra.run.trial058.stdout:Access: 2026-02-23 06:20:30.244470861 +0000 2026-02-23T06:20:42.440 INFO:teuthology.orchestra.run.trial058.stdout:Modify: 2026-02-23 06:20:10.901644446 +0000 2026-02-23T06:20:42.440 INFO:teuthology.orchestra.run.trial058.stdout:Change: 2026-02-23 06:20:10.901644446 +0000 2026-02-23T06:20:42.441 INFO:teuthology.orchestra.run.trial058.stdout: Birth: 2026-02-23 06:20:10.901644446 +0000 2026-02-23T06:20:42.441 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-23T06:20:42.532 INFO:teuthology.orchestra.run.trial058.stderr:1+0 records in 2026-02-23T06:20:42.533 INFO:teuthology.orchestra.run.trial058.stderr:1+0 records out 2026-02-23T06:20:42.533 INFO:teuthology.orchestra.run.trial058.stderr:512 bytes copied, 0.000229019 s, 2.2 MB/s 2026-02-23T06:20:42.535 DEBUG:teuthology.orchestra.run.trial058:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-23T06:20:42.575 DEBUG:teuthology.orchestra.run.trial058:> stat /dev/vg_nvme/lv_4 2026-02-23T06:20:42.654 INFO:teuthology.orchestra.run.trial058.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-23T06:20:42.654 INFO:teuthology.orchestra.run.trial058.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-23T06:20:42.654 INFO:teuthology.orchestra.run.trial058.stdout:Device: 6h/6d Inode: 1096 Links: 1 2026-02-23T06:20:42.654 INFO:teuthology.orchestra.run.trial058.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-23T06:20:42.654 INFO:teuthology.orchestra.run.trial058.stdout:Context: system_u:object_r:device_t:s0 2026-02-23T06:20:42.654 INFO:teuthology.orchestra.run.trial058.stdout:Access: 2026-02-23 06:20:30.245470860 +0000 2026-02-23T06:20:42.655 INFO:teuthology.orchestra.run.trial058.stdout:Modify: 2026-02-23 06:20:10.901644446 +0000 2026-02-23T06:20:42.655 INFO:teuthology.orchestra.run.trial058.stdout:Change: 2026-02-23 06:20:10.901644446 +0000 2026-02-23T06:20:42.655 INFO:teuthology.orchestra.run.trial058.stdout: Birth: 2026-02-23 06:20:10.901644446 +0000 2026-02-23T06:20:42.655 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-23T06:20:42.747 INFO:teuthology.orchestra.run.trial058.stderr:1+0 records in 2026-02-23T06:20:42.748 INFO:teuthology.orchestra.run.trial058.stderr:1+0 records out 2026-02-23T06:20:42.748 INFO:teuthology.orchestra.run.trial058.stderr:512 bytes copied, 0.000226224 s, 2.3 MB/s 2026-02-23T06:20:42.750 DEBUG:teuthology.orchestra.run.trial058:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-23T06:20:42.790 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-23T06:20:42.791 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-23T06:20:42.791 DEBUG:teuthology.orchestra.run.trial093:> dd if=/scratch_devs of=/dev/stdout 2026-02-23T06:20:42.810 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-23T06:20:42.810 DEBUG:teuthology.orchestra.run.trial093:> stat /dev/vg_nvme/lv_1 2026-02-23T06:20:42.868 INFO:teuthology.orchestra.run.trial093.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-23T06:20:42.868 INFO:teuthology.orchestra.run.trial093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-23T06:20:42.869 INFO:teuthology.orchestra.run.trial093.stdout:Device: 6h/6d Inode: 1301 Links: 1 2026-02-23T06:20:42.869 INFO:teuthology.orchestra.run.trial093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-23T06:20:42.869 INFO:teuthology.orchestra.run.trial093.stdout:Context: system_u:object_r:device_t:s0 2026-02-23T06:20:42.869 INFO:teuthology.orchestra.run.trial093.stdout:Access: 2026-02-23 06:20:38.671442495 +0000 2026-02-23T06:20:42.869 INFO:teuthology.orchestra.run.trial093.stdout:Modify: 2026-02-23 06:20:22.724807544 +0000 2026-02-23T06:20:42.869 INFO:teuthology.orchestra.run.trial093.stdout:Change: 2026-02-23 06:20:22.724807544 +0000 2026-02-23T06:20:42.869 INFO:teuthology.orchestra.run.trial093.stdout: Birth: 2026-02-23 06:20:22.724807544 +0000 2026-02-23T06:20:42.870 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-23T06:20:42.932 INFO:teuthology.orchestra.run.trial093.stderr:1+0 records in 2026-02-23T06:20:42.932 INFO:teuthology.orchestra.run.trial093.stderr:1+0 records out 2026-02-23T06:20:42.932 INFO:teuthology.orchestra.run.trial093.stderr:512 bytes copied, 0.00015045 s, 3.4 MB/s 2026-02-23T06:20:42.934 DEBUG:teuthology.orchestra.run.trial093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-23T06:20:42.991 DEBUG:teuthology.orchestra.run.trial093:> stat /dev/vg_nvme/lv_2 2026-02-23T06:20:43.048 INFO:teuthology.orchestra.run.trial093.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-23T06:20:43.048 INFO:teuthology.orchestra.run.trial093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-23T06:20:43.049 INFO:teuthology.orchestra.run.trial093.stdout:Device: 6h/6d Inode: 1297 Links: 1 2026-02-23T06:20:43.049 INFO:teuthology.orchestra.run.trial093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-23T06:20:43.049 INFO:teuthology.orchestra.run.trial093.stdout:Context: system_u:object_r:device_t:s0 2026-02-23T06:20:43.049 INFO:teuthology.orchestra.run.trial093.stdout:Access: 2026-02-23 06:20:38.672442473 +0000 2026-02-23T06:20:43.049 INFO:teuthology.orchestra.run.trial093.stdout:Modify: 2026-02-23 06:20:22.724807544 +0000 2026-02-23T06:20:43.049 INFO:teuthology.orchestra.run.trial093.stdout:Change: 2026-02-23 06:20:22.724807544 +0000 2026-02-23T06:20:43.049 INFO:teuthology.orchestra.run.trial093.stdout: Birth: 2026-02-23 06:20:22.724807544 +0000 2026-02-23T06:20:43.049 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-23T06:20:43.112 INFO:teuthology.orchestra.run.trial093.stderr:1+0 records in 2026-02-23T06:20:43.112 INFO:teuthology.orchestra.run.trial093.stderr:1+0 records out 2026-02-23T06:20:43.112 INFO:teuthology.orchestra.run.trial093.stderr:512 bytes copied, 0.000158193 s, 3.2 MB/s 2026-02-23T06:20:43.113 DEBUG:teuthology.orchestra.run.trial093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-23T06:20:43.171 DEBUG:teuthology.orchestra.run.trial093:> stat /dev/vg_nvme/lv_3 2026-02-23T06:20:43.228 INFO:teuthology.orchestra.run.trial093.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-23T06:20:43.228 INFO:teuthology.orchestra.run.trial093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-23T06:20:43.229 INFO:teuthology.orchestra.run.trial093.stdout:Device: 6h/6d Inode: 1287 Links: 1 2026-02-23T06:20:43.229 INFO:teuthology.orchestra.run.trial093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-23T06:20:43.229 INFO:teuthology.orchestra.run.trial093.stdout:Context: system_u:object_r:device_t:s0 2026-02-23T06:20:43.229 INFO:teuthology.orchestra.run.trial093.stdout:Access: 2026-02-23 06:20:38.672442473 +0000 2026-02-23T06:20:43.229 INFO:teuthology.orchestra.run.trial093.stdout:Modify: 2026-02-23 06:20:22.723807567 +0000 2026-02-23T06:20:43.229 INFO:teuthology.orchestra.run.trial093.stdout:Change: 2026-02-23 06:20:22.723807567 +0000 2026-02-23T06:20:43.229 INFO:teuthology.orchestra.run.trial093.stdout: Birth: 2026-02-23 06:20:22.723807567 +0000 2026-02-23T06:20:43.230 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-23T06:20:43.291 INFO:teuthology.orchestra.run.trial093.stderr:1+0 records in 2026-02-23T06:20:43.292 INFO:teuthology.orchestra.run.trial093.stderr:1+0 records out 2026-02-23T06:20:43.292 INFO:teuthology.orchestra.run.trial093.stderr:512 bytes copied, 0.000223445 s, 2.3 MB/s 2026-02-23T06:20:43.293 DEBUG:teuthology.orchestra.run.trial093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-23T06:20:43.352 DEBUG:teuthology.orchestra.run.trial093:> stat /dev/vg_nvme/lv_4 2026-02-23T06:20:43.408 INFO:teuthology.orchestra.run.trial093.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-23T06:20:43.409 INFO:teuthology.orchestra.run.trial093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-23T06:20:43.409 INFO:teuthology.orchestra.run.trial093.stdout:Device: 6h/6d Inode: 1303 Links: 1 2026-02-23T06:20:43.409 INFO:teuthology.orchestra.run.trial093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-23T06:20:43.409 INFO:teuthology.orchestra.run.trial093.stdout:Context: system_u:object_r:device_t:s0 2026-02-23T06:20:43.409 INFO:teuthology.orchestra.run.trial093.stdout:Access: 2026-02-23 06:20:38.672442473 +0000 2026-02-23T06:20:43.409 INFO:teuthology.orchestra.run.trial093.stdout:Modify: 2026-02-23 06:20:22.724807544 +0000 2026-02-23T06:20:43.409 INFO:teuthology.orchestra.run.trial093.stdout:Change: 2026-02-23 06:20:22.724807544 +0000 2026-02-23T06:20:43.409 INFO:teuthology.orchestra.run.trial093.stdout: Birth: 2026-02-23 06:20:22.724807544 +0000 2026-02-23T06:20:43.410 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-23T06:20:43.471 INFO:teuthology.orchestra.run.trial093.stderr:1+0 records in 2026-02-23T06:20:43.471 INFO:teuthology.orchestra.run.trial093.stderr:1+0 records out 2026-02-23T06:20:43.471 INFO:teuthology.orchestra.run.trial093.stderr:512 bytes copied, 0.000208818 s, 2.5 MB/s 2026-02-23T06:20:43.473 DEBUG:teuthology.orchestra.run.trial093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-23T06:20:43.531 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2026-02-23T06:20:43.531 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial058.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial093.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2026-02-23T06:20:43.531 INFO:tasks.ceph:Generating config... 2026-02-23T06:20:43.532 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2026-02-23T06:20:43.532 INFO:tasks.ceph:[global] ms die on skipped message = False 2026-02-23T06:20:43.532 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2026-02-23T06:20:43.532 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2026-02-23T06:20:43.532 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2026-02-23T06:20:43.533 INFO:tasks.ceph:[mds] ms inject delay max = 1 2026-02-23T06:20:43.533 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2026-02-23T06:20:43.533 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2026-02-23T06:20:43.533 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2026-02-23T06:20:43.533 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-23T06:20:43.533 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-23T06:20:43.533 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-23T06:20:43.533 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-23T06:20:43.533 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-23T06:20:43.533 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2026-02-23T06:20:43.533 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-23T06:20:43.533 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2026-02-23T06:20:43.533 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-23T06:20:43.533 INFO:tasks.ceph:[osd] debug bluefs = 20 2026-02-23T06:20:43.533 INFO:tasks.ceph:[osd] debug bluestore = 20 2026-02-23T06:20:43.533 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-23T06:20:43.533 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-23T06:20:43.533 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-23T06:20:43.533 INFO:tasks.ceph:[osd] filestore flush min = 0 2026-02-23T06:20:43.533 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2026-02-23T06:20:43.533 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-23T06:20:43.533 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-23T06:20:43.533 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-23T06:20:43.533 INFO:tasks.ceph:[osd] ms inject delay max = 1 2026-02-23T06:20:43.533 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2026-02-23T06:20:43.533 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2026-02-23T06:20:43.533 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2026-02-23T06:20:43.533 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2026-02-23T06:20:43.533 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-23T06:20:43.533 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2026-02-23T06:20:43.533 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-23T06:20:43.533 INFO:tasks.ceph:Setting up mon.a... 2026-02-23T06:20:43.534 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-23T06:20:43.604 INFO:teuthology.orchestra.run.trial058.stdout:creating /etc/ceph/ceph.keyring 2026-02-23T06:20:43.608 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-23T06:20:43.683 DEBUG:teuthology.orchestra.run.trial058:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-23T06:20:43.738 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.58'), ('mon.b', '10.20.193.93'), ('mon.c', '[v2:10.20.193.93:3301,v1:10.20.193.93:6790]')] 2026-02-23T06:20:43.739 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.58,10.20.193.93,[v2:10.20.193.93:3301,v1:10.20.193.93:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client_shutdown_timeout': 120}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'mds oft prefetch dirfrags': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500}} 2026-02-23T06:20:43.740 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:20:43.740 DEBUG:teuthology.orchestra.run.trial058:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-23T06:20:43.777 DEBUG:teuthology.orchestra.run.trial058:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.58 --add b 10.20.193.93 --addv c '[v2:10.20.193.93:3301,v1:10.20.193.93:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2026-02-23T06:20:43.880 INFO:teuthology.orchestra.run.trial058.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-23T06:20:43.880 INFO:teuthology.orchestra.run.trial058.stdout:monmaptool: generated fsid 2624bd29-dc40-41ea-9c77-09981694f232 2026-02-23T06:20:43.881 INFO:teuthology.orchestra.run.trial058.stdout:setting min_mon_release = tentacle 2026-02-23T06:20:43.881 INFO:teuthology.orchestra.run.trial058.stdout:epoch 0 2026-02-23T06:20:43.881 INFO:teuthology.orchestra.run.trial058.stdout:fsid 2624bd29-dc40-41ea-9c77-09981694f232 2026-02-23T06:20:43.881 INFO:teuthology.orchestra.run.trial058.stdout:last_changed 2026-02-23T06:20:43.887319+0000 2026-02-23T06:20:43.881 INFO:teuthology.orchestra.run.trial058.stdout:created 2026-02-23T06:20:43.887319+0000 2026-02-23T06:20:43.881 INFO:teuthology.orchestra.run.trial058.stdout:min_mon_release 20 (tentacle) 2026-02-23T06:20:43.881 INFO:teuthology.orchestra.run.trial058.stdout:election_strategy: 1 2026-02-23T06:20:43.881 INFO:teuthology.orchestra.run.trial058.stdout:0: [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] mon.a 2026-02-23T06:20:43.881 INFO:teuthology.orchestra.run.trial058.stdout:1: [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] mon.b 2026-02-23T06:20:43.881 INFO:teuthology.orchestra.run.trial058.stdout:2: [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] mon.c 2026-02-23T06:20:43.882 INFO:teuthology.orchestra.run.trial058.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-23T06:20:43.883 DEBUG:teuthology.orchestra.run.trial058:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-23T06:20:43.920 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2624bd29-dc40-41ea-9c77-09981694f232... 2026-02-23T06:20:43.921 DEBUG:teuthology.orchestra.run.trial058:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-23T06:20:43.963 DEBUG:teuthology.orchestra.run.trial093:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-23T06:20:44.005 INFO:teuthology.orchestra.run.trial093.stdout:[global] 2026-02-23T06:20:44.006 INFO:teuthology.orchestra.run.trial093.stdout: chdir = "" 2026-02-23T06:20:44.006 INFO:teuthology.orchestra.run.trial093.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-23T06:20:44.006 INFO:teuthology.orchestra.run.trial093.stdout: auth supported = cephx 2026-02-23T06:20:44.006 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.006 INFO:teuthology.orchestra.run.trial093.stdout: filestore xattr use omap = true 2026-02-23T06:20:44.006 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.006 INFO:teuthology.orchestra.run.trial093.stdout: mon clock drift allowed = 1.000 2026-02-23T06:20:44.006 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.006 INFO:teuthology.orchestra.run.trial093.stdout: osd crush chooseleaf type = 0 2026-02-23T06:20:44.006 INFO:teuthology.orchestra.run.trial093.stdout: auth debug = true 2026-02-23T06:20:44.007 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.007 INFO:teuthology.orchestra.run.trial093.stdout: ms die on old message = true 2026-02-23T06:20:44.007 INFO:teuthology.orchestra.run.trial093.stdout: ms die on bug = true 2026-02-23T06:20:44.007 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.007 INFO:teuthology.orchestra.run.trial093.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-23T06:20:44.007 INFO:teuthology.orchestra.run.trial093.stdout: mon pg warn max object skew = 0 2026-02-23T06:20:44.007 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.007 INFO:teuthology.orchestra.run.trial093.stdout: # disable pg_autoscaler by default for new pools 2026-02-23T06:20:44.007 INFO:teuthology.orchestra.run.trial093.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-23T06:20:44.007 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.007 INFO:teuthology.orchestra.run.trial093.stdout: osd pool default size = 2 2026-02-23T06:20:44.007 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.008 INFO:teuthology.orchestra.run.trial093.stdout: mon osd allow primary affinity = true 2026-02-23T06:20:44.008 INFO:teuthology.orchestra.run.trial093.stdout: mon osd allow pg remap = true 2026-02-23T06:20:44.008 INFO:teuthology.orchestra.run.trial093.stdout: mon warn on legacy crush tunables = false 2026-02-23T06:20:44.008 INFO:teuthology.orchestra.run.trial093.stdout: mon warn on crush straw calc version zero = false 2026-02-23T06:20:44.008 INFO:teuthology.orchestra.run.trial093.stdout: mon warn on no sortbitwise = false 2026-02-23T06:20:44.008 INFO:teuthology.orchestra.run.trial093.stdout: mon warn on osd down out interval zero = false 2026-02-23T06:20:44.008 INFO:teuthology.orchestra.run.trial093.stdout: mon warn on too few osds = false 2026-02-23T06:20:44.008 INFO:teuthology.orchestra.run.trial093.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-23T06:20:44.008 INFO:teuthology.orchestra.run.trial093.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-23T06:20:44.008 INFO:teuthology.orchestra.run.trial093.stdout: mon_allow_pool_size_one = true 2026-02-23T06:20:44.008 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.008 INFO:teuthology.orchestra.run.trial093.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-23T06:20:44.008 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.008 INFO:teuthology.orchestra.run.trial093.stdout: osd default data pool replay window = 5 2026-02-23T06:20:44.009 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.009 INFO:teuthology.orchestra.run.trial093.stdout: mon allow pool delete = true 2026-02-23T06:20:44.009 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.009 INFO:teuthology.orchestra.run.trial093.stdout: mon cluster log file level = debug 2026-02-23T06:20:44.009 INFO:teuthology.orchestra.run.trial093.stdout: debug asserts on shutdown = true 2026-02-23T06:20:44.009 INFO:teuthology.orchestra.run.trial093.stdout: mon health detail to clog = false 2026-02-23T06:20:44.009 INFO:teuthology.orchestra.run.trial093.stdout: mon host = "10.20.193.58,10.20.193.93,[v2:10.20.193.93:3301,v1:10.20.193.93:6790]" 2026-02-23T06:20:44.009 INFO:teuthology.orchestra.run.trial093.stdout: ms die on skipped message = False 2026-02-23T06:20:44.009 INFO:teuthology.orchestra.run.trial093.stdout: fsid = 2624bd29-dc40-41ea-9c77-09981694f232 2026-02-23T06:20:44.009 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.009 INFO:teuthology.orchestra.run.trial093.stdout:[osd] 2026-02-23T06:20:44.009 INFO:teuthology.orchestra.run.trial093.stdout: osd journal size = 100 2026-02-23T06:20:44.009 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.010 INFO:teuthology.orchestra.run.trial093.stdout: osd scrub load threshold = 5.0 2026-02-23T06:20:44.010 INFO:teuthology.orchestra.run.trial093.stdout: osd scrub max interval = 600 2026-02-23T06:20:44.010 INFO:teuthology.orchestra.run.trial093.stdout: osd mclock profile = high_recovery_ops 2026-02-23T06:20:44.010 INFO:teuthology.orchestra.run.trial093.stdout: osd mclock skip benchmark = true 2026-02-23T06:20:44.010 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.010 INFO:teuthology.orchestra.run.trial093.stdout: osd recover clone overlap = true 2026-02-23T06:20:44.010 INFO:teuthology.orchestra.run.trial093.stdout: osd recovery max chunk = 1048576 2026-02-23T06:20:44.010 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.010 INFO:teuthology.orchestra.run.trial093.stdout: osd debug shutdown = true 2026-02-23T06:20:44.010 INFO:teuthology.orchestra.run.trial093.stdout: osd debug op order = true 2026-02-23T06:20:44.010 INFO:teuthology.orchestra.run.trial093.stdout: osd debug verify stray on activate = true 2026-02-23T06:20:44.010 INFO:teuthology.orchestra.run.trial093.stdout: osd debug trim objects = true 2026-02-23T06:20:44.010 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.010 INFO:teuthology.orchestra.run.trial093.stdout: osd open classes on start = true 2026-02-23T06:20:44.011 INFO:teuthology.orchestra.run.trial093.stdout: osd debug pg log writeout = true 2026-02-23T06:20:44.011 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.011 INFO:teuthology.orchestra.run.trial093.stdout: osd deep scrub update digest min age = 30 2026-02-23T06:20:44.011 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.011 INFO:teuthology.orchestra.run.trial093.stdout: osd map max advance = 10 2026-02-23T06:20:44.011 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.011 INFO:teuthology.orchestra.run.trial093.stdout: journal zero on create = true 2026-02-23T06:20:44.011 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.011 INFO:teuthology.orchestra.run.trial093.stdout: filestore ondisk finisher threads = 3 2026-02-23T06:20:44.011 INFO:teuthology.orchestra.run.trial093.stdout: filestore apply finisher threads = 3 2026-02-23T06:20:44.011 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.011 INFO:teuthology.orchestra.run.trial093.stdout: bdev debug aio = true 2026-02-23T06:20:44.011 INFO:teuthology.orchestra.run.trial093.stdout: osd debug misdirected ops = true 2026-02-23T06:20:44.011 INFO:teuthology.orchestra.run.trial093.stdout: bluestore block size = 96636764160 2026-02-23T06:20:44.012 INFO:teuthology.orchestra.run.trial093.stdout: bluestore compression mode = aggressive 2026-02-23T06:20:44.012 INFO:teuthology.orchestra.run.trial093.stdout: bluestore fsck on mount = True 2026-02-23T06:20:44.012 INFO:teuthology.orchestra.run.trial093.stdout: debug bluefs = 20 2026-02-23T06:20:44.012 INFO:teuthology.orchestra.run.trial093.stdout: debug bluestore = 20 2026-02-23T06:20:44.012 INFO:teuthology.orchestra.run.trial093.stdout: debug ms = 1 2026-02-23T06:20:44.012 INFO:teuthology.orchestra.run.trial093.stdout: debug osd = 20 2026-02-23T06:20:44.012 INFO:teuthology.orchestra.run.trial093.stdout: debug rocksdb = 10 2026-02-23T06:20:44.012 INFO:teuthology.orchestra.run.trial093.stdout: filestore flush min = 0 2026-02-23T06:20:44.012 INFO:teuthology.orchestra.run.trial093.stdout: mon client directed command retry = 5 2026-02-23T06:20:44.012 INFO:teuthology.orchestra.run.trial093.stdout: mon osd backfillfull_ratio = 0.85 2026-02-23T06:20:44.012 INFO:teuthology.orchestra.run.trial093.stdout: mon osd full ratio = 0.9 2026-02-23T06:20:44.012 INFO:teuthology.orchestra.run.trial093.stdout: mon osd nearfull ratio = 0.8 2026-02-23T06:20:44.012 INFO:teuthology.orchestra.run.trial093.stdout: ms inject delay max = 1 2026-02-23T06:20:44.012 INFO:teuthology.orchestra.run.trial093.stdout: ms inject delay probability = 0.005 2026-02-23T06:20:44.012 INFO:teuthology.orchestra.run.trial093.stdout: ms inject delay type = client mds 2026-02-23T06:20:44.013 INFO:teuthology.orchestra.run.trial093.stdout: ms inject socket failures = 2500 2026-02-23T06:20:44.013 INFO:teuthology.orchestra.run.trial093.stdout: osd blocked scrub grace period = 3600 2026-02-23T06:20:44.013 INFO:teuthology.orchestra.run.trial093.stdout: osd failsafe full ratio = 0.95 2026-02-23T06:20:44.013 INFO:teuthology.orchestra.run.trial093.stdout: osd max markdown count = 1000 2026-02-23T06:20:44.013 INFO:teuthology.orchestra.run.trial093.stdout: osd objectstore = bluestore 2026-02-23T06:20:44.013 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.013 INFO:teuthology.orchestra.run.trial093.stdout:[mgr] 2026-02-23T06:20:44.013 INFO:teuthology.orchestra.run.trial093.stdout: debug ms = 1 2026-02-23T06:20:44.013 INFO:teuthology.orchestra.run.trial093.stdout: debug mgr = 20 2026-02-23T06:20:44.013 INFO:teuthology.orchestra.run.trial093.stdout: debug mon = 20 2026-02-23T06:20:44.013 INFO:teuthology.orchestra.run.trial093.stdout: debug auth = 20 2026-02-23T06:20:44.013 INFO:teuthology.orchestra.run.trial093.stdout: mon reweight min pgs per osd = 4 2026-02-23T06:20:44.013 INFO:teuthology.orchestra.run.trial093.stdout: mon reweight min bytes per osd = 10 2026-02-23T06:20:44.013 INFO:teuthology.orchestra.run.trial093.stdout: mgr/telemetry/nag = false 2026-02-23T06:20:44.014 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.014 INFO:teuthology.orchestra.run.trial093.stdout:[mon] 2026-02-23T06:20:44.014 INFO:teuthology.orchestra.run.trial093.stdout: debug ms = 1 2026-02-23T06:20:44.014 INFO:teuthology.orchestra.run.trial093.stdout: debug mon = 20 2026-02-23T06:20:44.014 INFO:teuthology.orchestra.run.trial093.stdout: debug paxos = 20 2026-02-23T06:20:44.014 INFO:teuthology.orchestra.run.trial093.stdout: debug auth = 20 2026-02-23T06:20:44.014 INFO:teuthology.orchestra.run.trial093.stdout: mon data avail warn = 5 2026-02-23T06:20:44.014 INFO:teuthology.orchestra.run.trial093.stdout: mon mgr mkfs grace = 240 2026-02-23T06:20:44.014 INFO:teuthology.orchestra.run.trial093.stdout: mon reweight min pgs per osd = 4 2026-02-23T06:20:44.014 INFO:teuthology.orchestra.run.trial093.stdout: mon osd reporter subtree level = osd 2026-02-23T06:20:44.014 INFO:teuthology.orchestra.run.trial093.stdout: mon osd prime pg temp = true 2026-02-23T06:20:44.014 INFO:teuthology.orchestra.run.trial093.stdout: mon reweight min bytes per osd = 10 2026-02-23T06:20:44.014 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.015 INFO:teuthology.orchestra.run.trial093.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-23T06:20:44.015 INFO:teuthology.orchestra.run.trial093.stdout: auth mon ticket ttl = 660 # 11m 2026-02-23T06:20:44.015 INFO:teuthology.orchestra.run.trial093.stdout: auth service ticket ttl = 240 # 4m 2026-02-23T06:20:44.015 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.015 INFO:teuthology.orchestra.run.trial093.stdout: # don't complain about insecure global_id in the test suite 2026-02-23T06:20:44.015 INFO:teuthology.orchestra.run.trial093.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-23T06:20:44.015 INFO:teuthology.orchestra.run.trial093.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-23T06:20:44.015 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.015 INFO:teuthology.orchestra.run.trial093.stdout: # 1m isn't quite enough 2026-02-23T06:20:44.015 INFO:teuthology.orchestra.run.trial093.stdout: mon_down_mkfs_grace = 2m 2026-02-23T06:20:44.015 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.015 INFO:teuthology.orchestra.run.trial093.stdout: mon_warn_on_filestore_osds = false 2026-02-23T06:20:44.015 INFO:teuthology.orchestra.run.trial093.stdout: mon down mkfs grace = 300 2026-02-23T06:20:44.015 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-23T06:20:44.016 INFO:teuthology.orchestra.run.trial093.stdout:[client] 2026-02-23T06:20:44.016 INFO:teuthology.orchestra.run.trial093.stdout: rgw cache enabled = true 2026-02-23T06:20:44.016 INFO:teuthology.orchestra.run.trial093.stdout: rgw enable ops log = true 2026-02-23T06:20:44.016 INFO:teuthology.orchestra.run.trial093.stdout: rgw enable usage log = true 2026-02-23T06:20:44.016 INFO:teuthology.orchestra.run.trial093.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-23T06:20:44.016 INFO:teuthology.orchestra.run.trial093.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-23T06:20:44.016 INFO:teuthology.orchestra.run.trial093.stdout: client_shutdown_timeout = 120 2026-02-23T06:20:44.016 INFO:teuthology.orchestra.run.trial093.stdout:[mon.a] 2026-02-23T06:20:44.016 INFO:teuthology.orchestra.run.trial093.stdout:[mon.b] 2026-02-23T06:20:44.016 INFO:teuthology.orchestra.run.trial093.stdout:[mon.c] 2026-02-23T06:20:44.016 INFO:teuthology.orchestra.run.trial093.stdout:[mds.a] 2026-02-23T06:20:44.016 INFO:teuthology.orchestra.run.trial093.stdout:[mds.c] 2026-02-23T06:20:44.016 INFO:teuthology.orchestra.run.trial093.stdout:[mds.e] 2026-02-23T06:20:44.017 INFO:teuthology.orchestra.run.trial093.stdout:[mds.b] 2026-02-23T06:20:44.017 INFO:teuthology.orchestra.run.trial093.stdout:[mds.d] 2026-02-23T06:20:44.017 INFO:teuthology.orchestra.run.trial093.stdout:[mds.f] 2026-02-23T06:20:44.017 INFO:teuthology.orchestra.run.trial093.stdout:[mds] 2026-02-23T06:20:44.017 INFO:teuthology.orchestra.run.trial093.stdout: mds oft prefetch dirfrags = True 2026-02-23T06:20:44.017 INFO:teuthology.orchestra.run.trial093.stdout: mds_sleep_rank_change = 5000000.0 2026-02-23T06:20:44.017 INFO:teuthology.orchestra.run.trial093.stdout: mon client directed command retry = 5 2026-02-23T06:20:44.017 INFO:teuthology.orchestra.run.trial093.stdout: ms inject delay max = 1 2026-02-23T06:20:44.017 INFO:teuthology.orchestra.run.trial093.stdout: ms inject delay probability = 0.005 2026-02-23T06:20:44.017 INFO:teuthology.orchestra.run.trial093.stdout: ms inject delay type = client mds osd 2026-02-23T06:20:44.017 INFO:teuthology.orchestra.run.trial093.stdout: ms inject socket failures = 2500 2026-02-23T06:20:44.051 INFO:teuthology.orchestra.run.trial058.stdout:[global] 2026-02-23T06:20:44.052 INFO:teuthology.orchestra.run.trial058.stdout: chdir = "" 2026-02-23T06:20:44.052 INFO:teuthology.orchestra.run.trial058.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-23T06:20:44.052 INFO:teuthology.orchestra.run.trial058.stdout: auth supported = cephx 2026-02-23T06:20:44.052 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.052 INFO:teuthology.orchestra.run.trial058.stdout: filestore xattr use omap = true 2026-02-23T06:20:44.052 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.052 INFO:teuthology.orchestra.run.trial058.stdout: mon clock drift allowed = 1.000 2026-02-23T06:20:44.052 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.052 INFO:teuthology.orchestra.run.trial058.stdout: osd crush chooseleaf type = 0 2026-02-23T06:20:44.052 INFO:teuthology.orchestra.run.trial058.stdout: auth debug = true 2026-02-23T06:20:44.052 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.053 INFO:teuthology.orchestra.run.trial058.stdout: ms die on old message = true 2026-02-23T06:20:44.053 INFO:teuthology.orchestra.run.trial058.stdout: ms die on bug = true 2026-02-23T06:20:44.053 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.053 INFO:teuthology.orchestra.run.trial058.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-23T06:20:44.053 INFO:teuthology.orchestra.run.trial058.stdout: mon pg warn max object skew = 0 2026-02-23T06:20:44.053 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.053 INFO:teuthology.orchestra.run.trial058.stdout: # disable pg_autoscaler by default for new pools 2026-02-23T06:20:44.053 INFO:teuthology.orchestra.run.trial058.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-23T06:20:44.053 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.053 INFO:teuthology.orchestra.run.trial058.stdout: osd pool default size = 2 2026-02-23T06:20:44.053 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.054 INFO:teuthology.orchestra.run.trial058.stdout: mon osd allow primary affinity = true 2026-02-23T06:20:44.054 INFO:teuthology.orchestra.run.trial058.stdout: mon osd allow pg remap = true 2026-02-23T06:20:44.054 INFO:teuthology.orchestra.run.trial058.stdout: mon warn on legacy crush tunables = false 2026-02-23T06:20:44.054 INFO:teuthology.orchestra.run.trial058.stdout: mon warn on crush straw calc version zero = false 2026-02-23T06:20:44.054 INFO:teuthology.orchestra.run.trial058.stdout: mon warn on no sortbitwise = false 2026-02-23T06:20:44.054 INFO:teuthology.orchestra.run.trial058.stdout: mon warn on osd down out interval zero = false 2026-02-23T06:20:44.054 INFO:teuthology.orchestra.run.trial058.stdout: mon warn on too few osds = false 2026-02-23T06:20:44.054 INFO:teuthology.orchestra.run.trial058.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-23T06:20:44.054 INFO:teuthology.orchestra.run.trial058.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-23T06:20:44.054 INFO:teuthology.orchestra.run.trial058.stdout: mon_allow_pool_size_one = true 2026-02-23T06:20:44.054 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.054 INFO:teuthology.orchestra.run.trial058.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-23T06:20:44.055 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.055 INFO:teuthology.orchestra.run.trial058.stdout: osd default data pool replay window = 5 2026-02-23T06:20:44.055 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.055 INFO:teuthology.orchestra.run.trial058.stdout: mon allow pool delete = true 2026-02-23T06:20:44.055 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.055 INFO:teuthology.orchestra.run.trial058.stdout: mon cluster log file level = debug 2026-02-23T06:20:44.055 INFO:teuthology.orchestra.run.trial058.stdout: debug asserts on shutdown = true 2026-02-23T06:20:44.055 INFO:teuthology.orchestra.run.trial058.stdout: mon health detail to clog = false 2026-02-23T06:20:44.055 INFO:teuthology.orchestra.run.trial058.stdout: mon host = "10.20.193.58,10.20.193.93,[v2:10.20.193.93:3301,v1:10.20.193.93:6790]" 2026-02-23T06:20:44.055 INFO:teuthology.orchestra.run.trial058.stdout: ms die on skipped message = False 2026-02-23T06:20:44.055 INFO:teuthology.orchestra.run.trial058.stdout: fsid = 2624bd29-dc40-41ea-9c77-09981694f232 2026-02-23T06:20:44.056 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.056 INFO:teuthology.orchestra.run.trial058.stdout:[osd] 2026-02-23T06:20:44.056 INFO:teuthology.orchestra.run.trial058.stdout: osd journal size = 100 2026-02-23T06:20:44.056 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.056 INFO:teuthology.orchestra.run.trial058.stdout: osd scrub load threshold = 5.0 2026-02-23T06:20:44.056 INFO:teuthology.orchestra.run.trial058.stdout: osd scrub max interval = 600 2026-02-23T06:20:44.056 INFO:teuthology.orchestra.run.trial058.stdout: osd mclock profile = high_recovery_ops 2026-02-23T06:20:44.056 INFO:teuthology.orchestra.run.trial058.stdout: osd mclock skip benchmark = true 2026-02-23T06:20:44.056 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.056 INFO:teuthology.orchestra.run.trial058.stdout: osd recover clone overlap = true 2026-02-23T06:20:44.056 INFO:teuthology.orchestra.run.trial058.stdout: osd recovery max chunk = 1048576 2026-02-23T06:20:44.056 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.056 INFO:teuthology.orchestra.run.trial058.stdout: osd debug shutdown = true 2026-02-23T06:20:44.057 INFO:teuthology.orchestra.run.trial058.stdout: osd debug op order = true 2026-02-23T06:20:44.057 INFO:teuthology.orchestra.run.trial058.stdout: osd debug verify stray on activate = true 2026-02-23T06:20:44.057 INFO:teuthology.orchestra.run.trial058.stdout: osd debug trim objects = true 2026-02-23T06:20:44.057 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.057 INFO:teuthology.orchestra.run.trial058.stdout: osd open classes on start = true 2026-02-23T06:20:44.057 INFO:teuthology.orchestra.run.trial058.stdout: osd debug pg log writeout = true 2026-02-23T06:20:44.057 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.057 INFO:teuthology.orchestra.run.trial058.stdout: osd deep scrub update digest min age = 30 2026-02-23T06:20:44.057 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.057 INFO:teuthology.orchestra.run.trial058.stdout: osd map max advance = 10 2026-02-23T06:20:44.057 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.057 INFO:teuthology.orchestra.run.trial058.stdout: journal zero on create = true 2026-02-23T06:20:44.057 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.057 INFO:teuthology.orchestra.run.trial058.stdout: filestore ondisk finisher threads = 3 2026-02-23T06:20:44.058 INFO:teuthology.orchestra.run.trial058.stdout: filestore apply finisher threads = 3 2026-02-23T06:20:44.058 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.058 INFO:teuthology.orchestra.run.trial058.stdout: bdev debug aio = true 2026-02-23T06:20:44.058 INFO:teuthology.orchestra.run.trial058.stdout: osd debug misdirected ops = true 2026-02-23T06:20:44.058 INFO:teuthology.orchestra.run.trial058.stdout: bluestore block size = 96636764160 2026-02-23T06:20:44.058 INFO:teuthology.orchestra.run.trial058.stdout: bluestore compression mode = aggressive 2026-02-23T06:20:44.058 INFO:teuthology.orchestra.run.trial058.stdout: bluestore fsck on mount = True 2026-02-23T06:20:44.058 INFO:teuthology.orchestra.run.trial058.stdout: debug bluefs = 20 2026-02-23T06:20:44.058 INFO:teuthology.orchestra.run.trial058.stdout: debug bluestore = 20 2026-02-23T06:20:44.058 INFO:teuthology.orchestra.run.trial058.stdout: debug ms = 1 2026-02-23T06:20:44.058 INFO:teuthology.orchestra.run.trial058.stdout: debug osd = 20 2026-02-23T06:20:44.058 INFO:teuthology.orchestra.run.trial058.stdout: debug rocksdb = 10 2026-02-23T06:20:44.059 INFO:teuthology.orchestra.run.trial058.stdout: filestore flush min = 0 2026-02-23T06:20:44.059 INFO:teuthology.orchestra.run.trial058.stdout: mon client directed command retry = 5 2026-02-23T06:20:44.059 INFO:teuthology.orchestra.run.trial058.stdout: mon osd backfillfull_ratio = 0.85 2026-02-23T06:20:44.059 INFO:teuthology.orchestra.run.trial058.stdout: mon osd full ratio = 0.9 2026-02-23T06:20:44.059 INFO:teuthology.orchestra.run.trial058.stdout: mon osd nearfull ratio = 0.8 2026-02-23T06:20:44.059 INFO:teuthology.orchestra.run.trial058.stdout: ms inject delay max = 1 2026-02-23T06:20:44.059 INFO:teuthology.orchestra.run.trial058.stdout: ms inject delay probability = 0.005 2026-02-23T06:20:44.059 INFO:teuthology.orchestra.run.trial058.stdout: ms inject delay type = client mds 2026-02-23T06:20:44.059 INFO:teuthology.orchestra.run.trial058.stdout: ms inject socket failures = 2500 2026-02-23T06:20:44.059 INFO:teuthology.orchestra.run.trial058.stdout: osd blocked scrub grace period = 3600 2026-02-23T06:20:44.059 INFO:teuthology.orchestra.run.trial058.stdout: osd failsafe full ratio = 0.95 2026-02-23T06:20:44.059 INFO:teuthology.orchestra.run.trial058.stdout: osd max markdown count = 1000 2026-02-23T06:20:44.059 INFO:teuthology.orchestra.run.trial058.stdout: osd objectstore = bluestore 2026-02-23T06:20:44.059 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.060 INFO:teuthology.orchestra.run.trial058.stdout:[mgr] 2026-02-23T06:20:44.060 INFO:teuthology.orchestra.run.trial058.stdout: debug ms = 1 2026-02-23T06:20:44.060 INFO:teuthology.orchestra.run.trial058.stdout: debug mgr = 20 2026-02-23T06:20:44.060 INFO:teuthology.orchestra.run.trial058.stdout: debug mon = 20 2026-02-23T06:20:44.060 INFO:teuthology.orchestra.run.trial058.stdout: debug auth = 20 2026-02-23T06:20:44.060 INFO:teuthology.orchestra.run.trial058.stdout: mon reweight min pgs per osd = 4 2026-02-23T06:20:44.060 INFO:teuthology.orchestra.run.trial058.stdout: mon reweight min bytes per osd = 10 2026-02-23T06:20:44.060 INFO:teuthology.orchestra.run.trial058.stdout: mgr/telemetry/nag = false 2026-02-23T06:20:44.060 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.060 INFO:teuthology.orchestra.run.trial058.stdout:[mon] 2026-02-23T06:20:44.060 INFO:teuthology.orchestra.run.trial058.stdout: debug ms = 1 2026-02-23T06:20:44.060 INFO:teuthology.orchestra.run.trial058.stdout: debug mon = 20 2026-02-23T06:20:44.060 INFO:teuthology.orchestra.run.trial058.stdout: debug paxos = 20 2026-02-23T06:20:44.060 INFO:teuthology.orchestra.run.trial058.stdout: debug auth = 20 2026-02-23T06:20:44.061 INFO:teuthology.orchestra.run.trial058.stdout: mon data avail warn = 5 2026-02-23T06:20:44.061 INFO:teuthology.orchestra.run.trial058.stdout: mon mgr mkfs grace = 240 2026-02-23T06:20:44.061 INFO:teuthology.orchestra.run.trial058.stdout: mon reweight min pgs per osd = 4 2026-02-23T06:20:44.061 INFO:teuthology.orchestra.run.trial058.stdout: mon osd reporter subtree level = osd 2026-02-23T06:20:44.061 INFO:teuthology.orchestra.run.trial058.stdout: mon osd prime pg temp = true 2026-02-23T06:20:44.061 INFO:teuthology.orchestra.run.trial058.stdout: mon reweight min bytes per osd = 10 2026-02-23T06:20:44.061 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.061 INFO:teuthology.orchestra.run.trial058.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-23T06:20:44.061 INFO:teuthology.orchestra.run.trial058.stdout: auth mon ticket ttl = 660 # 11m 2026-02-23T06:20:44.061 INFO:teuthology.orchestra.run.trial058.stdout: auth service ticket ttl = 240 # 4m 2026-02-23T06:20:44.061 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.061 INFO:teuthology.orchestra.run.trial058.stdout: # don't complain about insecure global_id in the test suite 2026-02-23T06:20:44.061 INFO:teuthology.orchestra.run.trial058.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-23T06:20:44.061 INFO:teuthology.orchestra.run.trial058.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-23T06:20:44.062 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.062 INFO:teuthology.orchestra.run.trial058.stdout: # 1m isn't quite enough 2026-02-23T06:20:44.062 INFO:teuthology.orchestra.run.trial058.stdout: mon_down_mkfs_grace = 2m 2026-02-23T06:20:44.062 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.062 INFO:teuthology.orchestra.run.trial058.stdout: mon_warn_on_filestore_osds = false 2026-02-23T06:20:44.062 INFO:teuthology.orchestra.run.trial058.stdout: mon down mkfs grace = 300 2026-02-23T06:20:44.062 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:20:44.062 INFO:teuthology.orchestra.run.trial058.stdout:[client] 2026-02-23T06:20:44.062 INFO:teuthology.orchestra.run.trial058.stdout: rgw cache enabled = true 2026-02-23T06:20:44.062 INFO:teuthology.orchestra.run.trial058.stdout: rgw enable ops log = true 2026-02-23T06:20:44.062 INFO:teuthology.orchestra.run.trial058.stdout: rgw enable usage log = true 2026-02-23T06:20:44.062 INFO:teuthology.orchestra.run.trial058.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-23T06:20:44.062 INFO:teuthology.orchestra.run.trial058.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-23T06:20:44.062 INFO:teuthology.orchestra.run.trial058.stdout: client_shutdown_timeout = 120 2026-02-23T06:20:44.063 INFO:teuthology.orchestra.run.trial058.stdout:[mon.a] 2026-02-23T06:20:44.063 INFO:teuthology.orchestra.run.trial058.stdout:[mon.b] 2026-02-23T06:20:44.063 INFO:teuthology.orchestra.run.trial058.stdout:[mon.c] 2026-02-23T06:20:44.063 INFO:teuthology.orchestra.run.trial058.stdout:[mds.a] 2026-02-23T06:20:44.063 INFO:teuthology.orchestra.run.trial058.stdout:[mds.c] 2026-02-23T06:20:44.063 INFO:teuthology.orchestra.run.trial058.stdout:[mds.e] 2026-02-23T06:20:44.063 INFO:teuthology.orchestra.run.trial058.stdout:[mds.b] 2026-02-23T06:20:44.063 INFO:teuthology.orchestra.run.trial058.stdout:[mds.d] 2026-02-23T06:20:44.063 INFO:teuthology.orchestra.run.trial058.stdout:[mds.f] 2026-02-23T06:20:44.063 INFO:teuthology.orchestra.run.trial058.stdout:[mds] 2026-02-23T06:20:44.063 INFO:teuthology.orchestra.run.trial058.stdout: mds oft prefetch dirfrags = True 2026-02-23T06:20:44.063 INFO:teuthology.orchestra.run.trial058.stdout: mds_sleep_rank_change = 5000000.0 2026-02-23T06:20:44.063 INFO:teuthology.orchestra.run.trial058.stdout: mon client directed command retry = 5 2026-02-23T06:20:44.064 INFO:teuthology.orchestra.run.trial058.stdout: ms inject delay max = 1 2026-02-23T06:20:44.064 INFO:teuthology.orchestra.run.trial058.stdout: ms inject delay probability = 0.005 2026-02-23T06:20:44.064 INFO:teuthology.orchestra.run.trial058.stdout: ms inject delay type = client mds osd 2026-02-23T06:20:44.064 INFO:teuthology.orchestra.run.trial058.stdout: ms inject socket failures = 2500 2026-02-23T06:20:44.075 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-23T06:20:44.075 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-23T06:20:44.156 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-23T06:20:44.157 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:20:44.157 DEBUG:teuthology.orchestra.run.trial058:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-23T06:20:44.197 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:20:44.197 DEBUG:teuthology.orchestra.run.trial058:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-23T06:20:44.273 INFO:tasks.ceph:Sending monmap to node ubuntu@trial058.front.sepia.ceph.com 2026-02-23T06:20:44.273 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:20:44.274 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-23T06:20:44.274 DEBUG:teuthology.orchestra.run.trial058:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-23T06:20:44.389 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:20:44.389 DEBUG:teuthology.orchestra.run.trial058:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-23T06:20:44.467 INFO:tasks.ceph:Sending monmap to node ubuntu@trial093.front.sepia.ceph.com 2026-02-23T06:20:44.467 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-23T06:20:44.467 DEBUG:teuthology.orchestra.run.trial093:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-23T06:20:44.467 DEBUG:teuthology.orchestra.run.trial093:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-23T06:20:44.502 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-23T06:20:44.502 DEBUG:teuthology.orchestra.run.trial093:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-23T06:20:44.559 INFO:tasks.ceph:Setting up mon nodes... 2026-02-23T06:20:44.559 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-23T06:20:44.560 DEBUG:teuthology.orchestra.run.trial058:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2026-02-23T06:20:44.652 INFO:teuthology.orchestra.run.trial058.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2026-02-23T06:20:44.656 DEBUG:teuthology.orchestra.run.trial093:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-23T06:20:44.700 INFO:teuthology.orchestra.run.trial093.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-23T06:20:44.702 INFO:tasks.ceph:Setting up mds nodes... 2026-02-23T06:20:44.702 DEBUG:teuthology.orchestra.run.trial058:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2026-02-23T06:20:44.793 INFO:teuthology.orchestra.run.trial058.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2026-02-23T06:20:44.797 DEBUG:teuthology.orchestra.run.trial058:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2026-02-23T06:20:44.852 DEBUG:teuthology.orchestra.run.trial058:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2026-02-23T06:20:44.944 INFO:teuthology.orchestra.run.trial058.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2026-02-23T06:20:44.947 DEBUG:teuthology.orchestra.run.trial058:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2026-02-23T06:20:45.002 DEBUG:teuthology.orchestra.run.trial058:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2026-02-23T06:20:45.094 INFO:teuthology.orchestra.run.trial058.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2026-02-23T06:20:45.098 DEBUG:teuthology.orchestra.run.trial058:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2026-02-23T06:20:45.155 DEBUG:teuthology.orchestra.run.trial093:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2026-02-23T06:20:45.199 INFO:teuthology.orchestra.run.trial093.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2026-02-23T06:20:45.201 DEBUG:teuthology.orchestra.run.trial093:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2026-02-23T06:20:45.266 DEBUG:teuthology.orchestra.run.trial093:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2026-02-23T06:20:45.346 INFO:teuthology.orchestra.run.trial093.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2026-02-23T06:20:45.349 DEBUG:teuthology.orchestra.run.trial093:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2026-02-23T06:20:45.414 DEBUG:teuthology.orchestra.run.trial093:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2026-02-23T06:20:45.495 INFO:teuthology.orchestra.run.trial093.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2026-02-23T06:20:45.497 DEBUG:teuthology.orchestra.run.trial093:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2026-02-23T06:20:45.563 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-23T06:20:45.563 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-23T06:20:45.635 INFO:teuthology.orchestra.run.trial058.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-23T06:20:45.659 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-23T06:20:45.659 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial058.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial093.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2026-02-23T06:20:45.659 DEBUG:teuthology.orchestra.run.trial058:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-23T06:20:45.716 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-23T06:20:45.716 INFO:tasks.ceph:role: osd.0 2026-02-23T06:20:45.716 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial058.front.sepia.ceph.com 2026-02-23T06:20:45.716 DEBUG:teuthology.orchestra.run.trial058:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-23T06:20:45.774 INFO:teuthology.orchestra.run.trial058.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-23T06:20:45.774 INFO:teuthology.orchestra.run.trial058.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-23T06:20:45.774 INFO:teuthology.orchestra.run.trial058.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-23T06:20:45.774 INFO:teuthology.orchestra.run.trial058.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-23T06:20:45.774 INFO:teuthology.orchestra.run.trial058.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-23T06:20:45.774 INFO:teuthology.orchestra.run.trial058.stdout: = sunit=0 swidth=0 blks 2026-02-23T06:20:45.774 INFO:teuthology.orchestra.run.trial058.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-23T06:20:45.775 INFO:teuthology.orchestra.run.trial058.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-23T06:20:45.775 INFO:teuthology.orchestra.run.trial058.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-23T06:20:45.775 INFO:teuthology.orchestra.run.trial058.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-23T06:20:46.354 INFO:teuthology.orchestra.run.trial058.stdout:Discarding blocks...Done. 2026-02-23T06:20:46.357 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial058.front.sepia.ceph.com -o noatime 2026-02-23T06:20:46.357 DEBUG:teuthology.orchestra.run.trial058:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-23T06:20:46.441 DEBUG:teuthology.orchestra.run.trial058:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-23T06:20:46.503 DEBUG:teuthology.orchestra.run.trial058:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-23T06:20:46.561 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-23T06:20:46.561 INFO:tasks.ceph:role: osd.1 2026-02-23T06:20:46.561 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial058.front.sepia.ceph.com 2026-02-23T06:20:46.561 DEBUG:teuthology.orchestra.run.trial058:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-23T06:20:46.618 INFO:teuthology.orchestra.run.trial058.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-23T06:20:46.618 INFO:teuthology.orchestra.run.trial058.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-23T06:20:46.618 INFO:teuthology.orchestra.run.trial058.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-23T06:20:46.618 INFO:teuthology.orchestra.run.trial058.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-23T06:20:46.618 INFO:teuthology.orchestra.run.trial058.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-23T06:20:46.618 INFO:teuthology.orchestra.run.trial058.stdout: = sunit=0 swidth=0 blks 2026-02-23T06:20:46.619 INFO:teuthology.orchestra.run.trial058.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-23T06:20:46.619 INFO:teuthology.orchestra.run.trial058.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-23T06:20:46.619 INFO:teuthology.orchestra.run.trial058.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-23T06:20:46.619 INFO:teuthology.orchestra.run.trial058.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-23T06:20:47.197 INFO:teuthology.orchestra.run.trial058.stdout:Discarding blocks...Done. 2026-02-23T06:20:47.200 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial058.front.sepia.ceph.com -o noatime 2026-02-23T06:20:47.200 DEBUG:teuthology.orchestra.run.trial058:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-23T06:20:47.282 DEBUG:teuthology.orchestra.run.trial058:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-23T06:20:47.343 DEBUG:teuthology.orchestra.run.trial058:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-23T06:20:47.400 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-23T06:20:47.401 INFO:tasks.ceph:role: osd.2 2026-02-23T06:20:47.401 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial058.front.sepia.ceph.com 2026-02-23T06:20:47.401 DEBUG:teuthology.orchestra.run.trial058:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-23T06:20:47.458 INFO:teuthology.orchestra.run.trial058.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-23T06:20:47.458 INFO:teuthology.orchestra.run.trial058.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-23T06:20:47.458 INFO:teuthology.orchestra.run.trial058.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-23T06:20:47.458 INFO:teuthology.orchestra.run.trial058.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-23T06:20:47.458 INFO:teuthology.orchestra.run.trial058.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-23T06:20:47.458 INFO:teuthology.orchestra.run.trial058.stdout: = sunit=0 swidth=0 blks 2026-02-23T06:20:47.458 INFO:teuthology.orchestra.run.trial058.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-23T06:20:47.458 INFO:teuthology.orchestra.run.trial058.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-23T06:20:47.459 INFO:teuthology.orchestra.run.trial058.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-23T06:20:47.459 INFO:teuthology.orchestra.run.trial058.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-23T06:20:48.029 INFO:teuthology.orchestra.run.trial058.stdout:Discarding blocks...Done. 2026-02-23T06:20:48.032 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial058.front.sepia.ceph.com -o noatime 2026-02-23T06:20:48.032 DEBUG:teuthology.orchestra.run.trial058:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-23T06:20:48.115 DEBUG:teuthology.orchestra.run.trial058:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-23T06:20:48.177 DEBUG:teuthology.orchestra.run.trial058:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-23T06:20:48.234 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-23T06:20:48.234 INFO:tasks.ceph:role: osd.3 2026-02-23T06:20:48.235 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial058.front.sepia.ceph.com 2026-02-23T06:20:48.235 DEBUG:teuthology.orchestra.run.trial058:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-23T06:20:48.291 INFO:teuthology.orchestra.run.trial058.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-23T06:20:48.291 INFO:teuthology.orchestra.run.trial058.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-23T06:20:48.291 INFO:teuthology.orchestra.run.trial058.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-23T06:20:48.291 INFO:teuthology.orchestra.run.trial058.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-23T06:20:48.291 INFO:teuthology.orchestra.run.trial058.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-23T06:20:48.292 INFO:teuthology.orchestra.run.trial058.stdout: = sunit=0 swidth=0 blks 2026-02-23T06:20:48.292 INFO:teuthology.orchestra.run.trial058.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-23T06:20:48.292 INFO:teuthology.orchestra.run.trial058.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-23T06:20:48.292 INFO:teuthology.orchestra.run.trial058.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-23T06:20:48.292 INFO:teuthology.orchestra.run.trial058.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-23T06:20:48.860 INFO:teuthology.orchestra.run.trial058.stdout:Discarding blocks...Done. 2026-02-23T06:20:48.863 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial058.front.sepia.ceph.com -o noatime 2026-02-23T06:20:48.863 DEBUG:teuthology.orchestra.run.trial058:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2026-02-23T06:20:48.946 DEBUG:teuthology.orchestra.run.trial058:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-23T06:20:49.007 DEBUG:teuthology.orchestra.run.trial058:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-23T06:20:49.088 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:20:49.094+0000 7ff9c5c2f780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-23T06:20:49.089 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:20:49.094+0000 7ff9c5c2f780 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-23T06:20:49.089 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:20:49.094+0000 7ff9c5c2f780 -1 bdev(0x106c5400 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-23T06:20:49.089 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:20:49.094+0000 7ff9c5c2f780 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-23T06:20:49.878 DEBUG:teuthology.orchestra.run.trial058:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-23T06:20:49.935 DEBUG:teuthology.orchestra.run.trial058:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-23T06:20:50.016 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:20:50.021+0000 7f3796428780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-23T06:20:50.016 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:20:50.021+0000 7f3796428780 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-23T06:20:50.016 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:20:50.021+0000 7f3796428780 -1 bdev(0x39c3b400 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-23T06:20:50.016 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:20:50.021+0000 7f3796428780 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-23T06:20:50.838 DEBUG:teuthology.orchestra.run.trial058:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-23T06:20:50.898 DEBUG:teuthology.orchestra.run.trial058:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-23T06:20:50.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:20:50.982+0000 7faceb439780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-23T06:20:50.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:20:50.983+0000 7faceb439780 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-23T06:20:50.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:20:50.983+0000 7faceb439780 -1 bdev(0x27e2d400 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-23T06:20:50.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:20:50.983+0000 7faceb439780 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-23T06:20:51.792 DEBUG:teuthology.orchestra.run.trial058:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-23T06:20:51.849 DEBUG:teuthology.orchestra.run.trial058:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-23T06:20:51.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:20:51.933+0000 7f7725e2c780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-23T06:20:51.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:20:51.934+0000 7f7725e2c780 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-23T06:20:51.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:20:51.934+0000 7f7725e2c780 -1 bdev(0x2cc5f400 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-23T06:20:51.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:20:51.934+0000 7f7725e2c780 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-23T06:20:52.756 DEBUG:teuthology.orchestra.run.trial058:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-23T06:20:52.814 DEBUG:teuthology.orchestra.run.trial093:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-23T06:20:52.839 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2026-02-23T06:20:52.840 INFO:tasks.ceph:role: osd.4 2026-02-23T06:20:52.840 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial093.front.sepia.ceph.com 2026-02-23T06:20:52.840 DEBUG:teuthology.orchestra.run.trial093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-23T06:20:52.906 INFO:teuthology.orchestra.run.trial093.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-23T06:20:52.906 INFO:teuthology.orchestra.run.trial093.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-23T06:20:52.906 INFO:teuthology.orchestra.run.trial093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-23T06:20:52.906 INFO:teuthology.orchestra.run.trial093.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-23T06:20:52.906 INFO:teuthology.orchestra.run.trial093.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-23T06:20:52.906 INFO:teuthology.orchestra.run.trial093.stdout: = sunit=0 swidth=0 blks 2026-02-23T06:20:52.906 INFO:teuthology.orchestra.run.trial093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-23T06:20:52.906 INFO:teuthology.orchestra.run.trial093.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-23T06:20:52.906 INFO:teuthology.orchestra.run.trial093.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-23T06:20:52.907 INFO:teuthology.orchestra.run.trial093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-23T06:20:53.475 INFO:teuthology.orchestra.run.trial093.stdout:Discarding blocks...Done. 2026-02-23T06:20:53.477 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial093.front.sepia.ceph.com -o noatime 2026-02-23T06:20:53.477 DEBUG:teuthology.orchestra.run.trial093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2026-02-23T06:20:53.545 DEBUG:teuthology.orchestra.run.trial093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2026-02-23T06:20:53.613 DEBUG:teuthology.orchestra.run.trial093:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-23T06:20:53.678 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2026-02-23T06:20:53.679 INFO:tasks.ceph:role: osd.5 2026-02-23T06:20:53.679 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial093.front.sepia.ceph.com 2026-02-23T06:20:53.679 DEBUG:teuthology.orchestra.run.trial093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-23T06:20:53.745 INFO:teuthology.orchestra.run.trial093.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-23T06:20:53.746 INFO:teuthology.orchestra.run.trial093.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-23T06:20:53.746 INFO:teuthology.orchestra.run.trial093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-23T06:20:53.746 INFO:teuthology.orchestra.run.trial093.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-23T06:20:53.746 INFO:teuthology.orchestra.run.trial093.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-23T06:20:53.746 INFO:teuthology.orchestra.run.trial093.stdout: = sunit=0 swidth=0 blks 2026-02-23T06:20:53.746 INFO:teuthology.orchestra.run.trial093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-23T06:20:53.746 INFO:teuthology.orchestra.run.trial093.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-23T06:20:53.746 INFO:teuthology.orchestra.run.trial093.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-23T06:20:53.747 INFO:teuthology.orchestra.run.trial093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-23T06:20:54.312 INFO:teuthology.orchestra.run.trial093.stdout:Discarding blocks...Done. 2026-02-23T06:20:54.314 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial093.front.sepia.ceph.com -o noatime 2026-02-23T06:20:54.314 DEBUG:teuthology.orchestra.run.trial093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2026-02-23T06:20:54.382 DEBUG:teuthology.orchestra.run.trial093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2026-02-23T06:20:54.451 DEBUG:teuthology.orchestra.run.trial093:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2026-02-23T06:20:54.517 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2026-02-23T06:20:54.518 INFO:tasks.ceph:role: osd.6 2026-02-23T06:20:54.518 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial093.front.sepia.ceph.com 2026-02-23T06:20:54.518 DEBUG:teuthology.orchestra.run.trial093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-23T06:20:54.584 INFO:teuthology.orchestra.run.trial093.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-23T06:20:54.584 INFO:teuthology.orchestra.run.trial093.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-23T06:20:54.584 INFO:teuthology.orchestra.run.trial093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-23T06:20:54.584 INFO:teuthology.orchestra.run.trial093.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-23T06:20:54.584 INFO:teuthology.orchestra.run.trial093.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-23T06:20:54.584 INFO:teuthology.orchestra.run.trial093.stdout: = sunit=0 swidth=0 blks 2026-02-23T06:20:54.584 INFO:teuthology.orchestra.run.trial093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-23T06:20:54.585 INFO:teuthology.orchestra.run.trial093.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-23T06:20:54.585 INFO:teuthology.orchestra.run.trial093.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-23T06:20:54.585 INFO:teuthology.orchestra.run.trial093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-23T06:20:55.140 INFO:teuthology.orchestra.run.trial093.stdout:Discarding blocks...Done. 2026-02-23T06:20:55.142 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial093.front.sepia.ceph.com -o noatime 2026-02-23T06:20:55.142 DEBUG:teuthology.orchestra.run.trial093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2026-02-23T06:20:55.211 DEBUG:teuthology.orchestra.run.trial093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2026-02-23T06:20:55.280 DEBUG:teuthology.orchestra.run.trial093:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2026-02-23T06:20:55.344 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2026-02-23T06:20:55.344 INFO:tasks.ceph:role: osd.7 2026-02-23T06:20:55.344 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial093.front.sepia.ceph.com 2026-02-23T06:20:55.344 DEBUG:teuthology.orchestra.run.trial093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-23T06:20:55.409 INFO:teuthology.orchestra.run.trial093.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-23T06:20:55.409 INFO:teuthology.orchestra.run.trial093.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-23T06:20:55.409 INFO:teuthology.orchestra.run.trial093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-23T06:20:55.410 INFO:teuthology.orchestra.run.trial093.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-23T06:20:55.410 INFO:teuthology.orchestra.run.trial093.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-23T06:20:55.410 INFO:teuthology.orchestra.run.trial093.stdout: = sunit=0 swidth=0 blks 2026-02-23T06:20:55.410 INFO:teuthology.orchestra.run.trial093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-23T06:20:55.410 INFO:teuthology.orchestra.run.trial093.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-23T06:20:55.410 INFO:teuthology.orchestra.run.trial093.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-23T06:20:55.410 INFO:teuthology.orchestra.run.trial093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-23T06:20:55.966 INFO:teuthology.orchestra.run.trial093.stdout:Discarding blocks...Done. 2026-02-23T06:20:55.968 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial093.front.sepia.ceph.com -o noatime 2026-02-23T06:20:55.968 DEBUG:teuthology.orchestra.run.trial093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2026-02-23T06:20:56.036 DEBUG:teuthology.orchestra.run.trial093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2026-02-23T06:20:56.104 DEBUG:teuthology.orchestra.run.trial093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-23T06:20:56.196 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:20:56.201+0000 7f9f609e3780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-23T06:20:56.196 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:20:56.202+0000 7f9f609e3780 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-23T06:20:56.197 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:20:56.202+0000 7f9f609e3780 -1 bdev(0x2d53400 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-23T06:20:56.197 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:20:56.202+0000 7f9f609e3780 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-23T06:20:56.665 DEBUG:teuthology.orchestra.run.trial093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-23T06:20:56.731 DEBUG:teuthology.orchestra.run.trial093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-23T06:20:56.807 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:20:56.813+0000 7fb891e2f780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-23T06:20:56.808 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:20:56.813+0000 7fb891e2f780 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-23T06:20:56.808 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:20:56.813+0000 7fb891e2f780 -1 bdev(0x405f400 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-23T06:20:56.808 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:20:56.813+0000 7fb891e2f780 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-23T06:20:57.272 DEBUG:teuthology.orchestra.run.trial093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-23T06:20:57.337 DEBUG:teuthology.orchestra.run.trial093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-23T06:20:57.414 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:20:57.420+0000 7fd6b4a35780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2026-02-23T06:20:57.415 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:20:57.420+0000 7fd6b4a35780 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2026-02-23T06:20:57.415 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:20:57.420+0000 7fd6b4a35780 -1 bdev(0x42f1400 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2026-02-23T06:20:57.415 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:20:57.420+0000 7fd6b4a35780 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2026-02-23T06:20:57.884 DEBUG:teuthology.orchestra.run.trial093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2026-02-23T06:20:57.949 DEBUG:teuthology.orchestra.run.trial093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-23T06:20:58.026 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:20:58.031+0000 7fe0b8bdd780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2026-02-23T06:20:58.027 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:20:58.031+0000 7fe0b8bdd780 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2026-02-23T06:20:58.027 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:20:58.031+0000 7fe0b8bdd780 -1 bdev(0x3a71400 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2026-02-23T06:20:58.027 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:20:58.031+0000 7fe0b8bdd780 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2026-02-23T06:20:58.481 DEBUG:teuthology.orchestra.run.trial093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2026-02-23T06:20:58.546 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-23T06:20:58.547 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:20:58.547 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2026-02-23T06:20:58.605 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:20:58.605 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2026-02-23T06:20:58.701 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:20:58.702 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2026-02-23T06:20:58.797 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:20:58.797 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2026-02-23T06:20:58.891 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:20:58.892 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-23T06:20:58.986 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:20:58.986 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-23T06:20:59.082 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:20:59.082 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-23T06:20:59.179 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:20:59.179 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-23T06:20:59.273 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-23T06:20:59.273 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-23T06:20:59.300 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-23T06:20:59.300 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2026-02-23T06:20:59.365 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-23T06:20:59.365 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2026-02-23T06:20:59.429 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-23T06:20:59.430 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2026-02-23T06:20:59.493 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-23T06:20:59.493 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-23T06:20:59.557 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-23T06:20:59.558 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-23T06:20:59.621 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-23T06:20:59.622 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2026-02-23T06:20:59.685 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-23T06:20:59.685 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2026-02-23T06:20:59.749 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:20:59.749 DEBUG:teuthology.orchestra.run.trial058:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-23T06:20:59.787 INFO:tasks.ceph:Adding keys to all mons... 2026-02-23T06:20:59.788 DEBUG:teuthology.orchestra.run.trial058:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-23T06:20:59.832 DEBUG:teuthology.orchestra.run.trial093:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-23T06:20:59.855 INFO:teuthology.orchestra.run.trial093.stdout:[mgr.y] 2026-02-23T06:20:59.855 INFO:teuthology.orchestra.run.trial093.stdout: key = AQC88ZtpkyJOJxAAaMnx5y8oDUQ81bikjwM/rA== 2026-02-23T06:20:59.855 INFO:teuthology.orchestra.run.trial093.stdout:[mds.a] 2026-02-23T06:20:59.855 INFO:teuthology.orchestra.run.trial093.stdout: key = AQC88ZtpAei3LxAAomSOCuhIcy+s68vQATkWFA== 2026-02-23T06:20:59.855 INFO:teuthology.orchestra.run.trial093.stdout:[mds.c] 2026-02-23T06:20:59.855 INFO:teuthology.orchestra.run.trial093.stdout: key = AQC88ZtprW2vOBAAdIs2YZ3QUYrGZsI5QijGOw== 2026-02-23T06:20:59.856 INFO:teuthology.orchestra.run.trial093.stdout:[mds.e] 2026-02-23T06:20:59.856 INFO:teuthology.orchestra.run.trial093.stdout: key = AQC98ZtpGyQMBhAAf1XfNyA8Gc/JdD+jatxeuA== 2026-02-23T06:20:59.856 INFO:teuthology.orchestra.run.trial093.stdout:[osd.0] 2026-02-23T06:20:59.856 INFO:teuthology.orchestra.run.trial093.stdout: key = AQDB8ZtpbWmvBRAA/M9lR9NymB+hZfw85jEPQg== 2026-02-23T06:20:59.856 INFO:teuthology.orchestra.run.trial093.stdout:[osd.1] 2026-02-23T06:20:59.856 INFO:teuthology.orchestra.run.trial093.stdout: key = AQDC8ZtpS09YARAA8OdbRPmzuNRxD1udfzduvw== 2026-02-23T06:20:59.856 INFO:teuthology.orchestra.run.trial093.stdout:[osd.2] 2026-02-23T06:20:59.856 INFO:teuthology.orchestra.run.trial093.stdout: key = AQDC8ZtpsFGkOhAA7+fuYPXxD02Y4MVE9yCn4g== 2026-02-23T06:20:59.856 INFO:teuthology.orchestra.run.trial093.stdout:[osd.3] 2026-02-23T06:20:59.856 INFO:teuthology.orchestra.run.trial093.stdout: key = AQDD8Ztp2ha8NxAAaRb+/oVjamrSE5HZIcsAtQ== 2026-02-23T06:20:59.857 INFO:teuthology.orchestra.run.trial093.stdout:[mgr.x] 2026-02-23T06:20:59.857 INFO:teuthology.orchestra.run.trial093.stdout: key = AQC88Ztp2NUaKhAAn+bSFAIN6/lP6GDUMIf2pA== 2026-02-23T06:20:59.857 INFO:teuthology.orchestra.run.trial093.stdout:[mds.b] 2026-02-23T06:20:59.857 INFO:teuthology.orchestra.run.trial093.stdout: key = AQC98Ztpni0+DBAAcLbzNxFS6poy7DQWGMSU8Q== 2026-02-23T06:20:59.857 INFO:teuthology.orchestra.run.trial093.stdout:[mds.d] 2026-02-23T06:20:59.857 INFO:teuthology.orchestra.run.trial093.stdout: key = AQC98ZtpapgEFRAAqXhXfcTNRDxbXR1Ojtg4ag== 2026-02-23T06:20:59.857 INFO:teuthology.orchestra.run.trial093.stdout:[mds.f] 2026-02-23T06:20:59.857 INFO:teuthology.orchestra.run.trial093.stdout: key = AQC98ZtpY6jfHRAAFt6p2JVM+BzHTMrcRxTUJA== 2026-02-23T06:20:59.857 INFO:teuthology.orchestra.run.trial093.stdout:[osd.4] 2026-02-23T06:20:59.857 INFO:teuthology.orchestra.run.trial093.stdout: key = AQDI8ZtpNwcJDBAA9W9A4zDkkUBZCuHyf8oPxQ== 2026-02-23T06:20:59.858 INFO:teuthology.orchestra.run.trial093.stdout:[osd.5] 2026-02-23T06:20:59.858 INFO:teuthology.orchestra.run.trial093.stdout: key = AQDI8Ztp81p6MBAAH5fzo/yls7PI4XyK997BPQ== 2026-02-23T06:20:59.858 INFO:teuthology.orchestra.run.trial093.stdout:[osd.6] 2026-02-23T06:20:59.858 INFO:teuthology.orchestra.run.trial093.stdout: key = AQDJ8Ztps1kOGRAA542/S9TkMAo1QLmwHKTpNA== 2026-02-23T06:20:59.858 INFO:teuthology.orchestra.run.trial093.stdout:[osd.7] 2026-02-23T06:20:59.858 INFO:teuthology.orchestra.run.trial093.stdout: key = AQDK8ZtpZMHvARAA2vN2yqVuu6a1FADthnS23A== 2026-02-23T06:20:59.858 INFO:teuthology.orchestra.run.trial093.stdout:[client.0] 2026-02-23T06:20:59.858 INFO:teuthology.orchestra.run.trial093.stdout: key = AQC98ZtpuFtGJhAAEQ/9fpf0QQIP9uTxpmE1Fw== 2026-02-23T06:20:59.880 INFO:teuthology.orchestra.run.trial058.stdout:[mgr.y] 2026-02-23T06:20:59.880 INFO:teuthology.orchestra.run.trial058.stdout: key = AQC88ZtpkyJOJxAAaMnx5y8oDUQ81bikjwM/rA== 2026-02-23T06:20:59.880 INFO:teuthology.orchestra.run.trial058.stdout:[mds.a] 2026-02-23T06:20:59.881 INFO:teuthology.orchestra.run.trial058.stdout: key = AQC88ZtpAei3LxAAomSOCuhIcy+s68vQATkWFA== 2026-02-23T06:20:59.881 INFO:teuthology.orchestra.run.trial058.stdout:[mds.c] 2026-02-23T06:20:59.881 INFO:teuthology.orchestra.run.trial058.stdout: key = AQC88ZtprW2vOBAAdIs2YZ3QUYrGZsI5QijGOw== 2026-02-23T06:20:59.881 INFO:teuthology.orchestra.run.trial058.stdout:[mds.e] 2026-02-23T06:20:59.881 INFO:teuthology.orchestra.run.trial058.stdout: key = AQC98ZtpGyQMBhAAf1XfNyA8Gc/JdD+jatxeuA== 2026-02-23T06:20:59.881 INFO:teuthology.orchestra.run.trial058.stdout:[osd.0] 2026-02-23T06:20:59.881 INFO:teuthology.orchestra.run.trial058.stdout: key = AQDB8ZtpbWmvBRAA/M9lR9NymB+hZfw85jEPQg== 2026-02-23T06:20:59.881 INFO:teuthology.orchestra.run.trial058.stdout:[osd.1] 2026-02-23T06:20:59.881 INFO:teuthology.orchestra.run.trial058.stdout: key = AQDC8ZtpS09YARAA8OdbRPmzuNRxD1udfzduvw== 2026-02-23T06:20:59.881 INFO:teuthology.orchestra.run.trial058.stdout:[osd.2] 2026-02-23T06:20:59.882 INFO:teuthology.orchestra.run.trial058.stdout: key = AQDC8ZtpsFGkOhAA7+fuYPXxD02Y4MVE9yCn4g== 2026-02-23T06:20:59.882 INFO:teuthology.orchestra.run.trial058.stdout:[osd.3] 2026-02-23T06:20:59.882 INFO:teuthology.orchestra.run.trial058.stdout: key = AQDD8Ztp2ha8NxAAaRb+/oVjamrSE5HZIcsAtQ== 2026-02-23T06:20:59.882 INFO:teuthology.orchestra.run.trial058.stdout:[mgr.x] 2026-02-23T06:20:59.882 INFO:teuthology.orchestra.run.trial058.stdout: key = AQC88Ztp2NUaKhAAn+bSFAIN6/lP6GDUMIf2pA== 2026-02-23T06:20:59.882 INFO:teuthology.orchestra.run.trial058.stdout:[mds.b] 2026-02-23T06:20:59.882 INFO:teuthology.orchestra.run.trial058.stdout: key = AQC98Ztpni0+DBAAcLbzNxFS6poy7DQWGMSU8Q== 2026-02-23T06:20:59.882 INFO:teuthology.orchestra.run.trial058.stdout:[mds.d] 2026-02-23T06:20:59.882 INFO:teuthology.orchestra.run.trial058.stdout: key = AQC98ZtpapgEFRAAqXhXfcTNRDxbXR1Ojtg4ag== 2026-02-23T06:20:59.882 INFO:teuthology.orchestra.run.trial058.stdout:[mds.f] 2026-02-23T06:20:59.883 INFO:teuthology.orchestra.run.trial058.stdout: key = AQC98ZtpY6jfHRAAFt6p2JVM+BzHTMrcRxTUJA== 2026-02-23T06:20:59.883 INFO:teuthology.orchestra.run.trial058.stdout:[osd.4] 2026-02-23T06:20:59.883 INFO:teuthology.orchestra.run.trial058.stdout: key = AQDI8ZtpNwcJDBAA9W9A4zDkkUBZCuHyf8oPxQ== 2026-02-23T06:20:59.883 INFO:teuthology.orchestra.run.trial058.stdout:[osd.5] 2026-02-23T06:20:59.883 INFO:teuthology.orchestra.run.trial058.stdout: key = AQDI8Ztp81p6MBAAH5fzo/yls7PI4XyK997BPQ== 2026-02-23T06:20:59.883 INFO:teuthology.orchestra.run.trial058.stdout:[osd.6] 2026-02-23T06:20:59.883 INFO:teuthology.orchestra.run.trial058.stdout: key = AQDJ8Ztps1kOGRAA542/S9TkMAo1QLmwHKTpNA== 2026-02-23T06:20:59.883 INFO:teuthology.orchestra.run.trial058.stdout:[osd.7] 2026-02-23T06:20:59.883 INFO:teuthology.orchestra.run.trial058.stdout: key = AQDK8ZtpZMHvARAA2vN2yqVuu6a1FADthnS23A== 2026-02-23T06:20:59.883 INFO:teuthology.orchestra.run.trial058.stdout:[client.0] 2026-02-23T06:20:59.883 INFO:teuthology.orchestra.run.trial058.stdout: key = AQC98ZtpuFtGJhAAEQ/9fpf0QQIP9uTxpmE1Fw== 2026-02-23T06:20:59.885 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-23T06:20:59.929 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-23T06:21:00.003 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2026-02-23T06:21:00.007 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2026-02-23T06:21:00.083 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2026-02-23T06:21:00.086 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2026-02-23T06:21:00.161 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2026-02-23T06:21:00.164 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2026-02-23T06:21:00.241 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-23T06:21:00.244 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-23T06:21:00.318 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-23T06:21:00.321 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-23T06:21:00.397 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-23T06:21:00.408 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-23T06:21:00.485 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-23T06:21:00.489 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-23T06:21:00.563 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-23T06:21:00.566 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-23T06:21:00.641 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2026-02-23T06:21:00.643 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2026-02-23T06:21:00.721 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2026-02-23T06:21:00.724 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2026-02-23T06:21:00.800 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2026-02-23T06:21:00.803 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2026-02-23T06:21:00.879 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-23T06:21:00.883 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-23T06:21:00.957 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-23T06:21:00.961 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-23T06:21:01.035 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-23T06:21:01.038 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-23T06:21:01.113 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-23T06:21:01.117 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-23T06:21:01.192 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-23T06:21:01.196 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-23T06:21:01.273 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-23T06:21:01.273 DEBUG:teuthology.orchestra.run.trial058:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-23T06:21:01.330 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-23T06:21:01.424 DEBUG:teuthology.orchestra.run.trial058:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-23T06:21:01.481 DEBUG:teuthology.orchestra.run.trial093:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-23T06:21:01.507 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-23T06:21:01.593 DEBUG:teuthology.orchestra.run.trial093:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-23T06:21:01.617 DEBUG:teuthology.orchestra.run.trial093:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-23T06:21:01.682 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-23T06:21:01.770 DEBUG:teuthology.orchestra.run.trial093:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-23T06:21:01.794 DEBUG:teuthology.orchestra.run.trial058:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-23T06:21:01.799 DEBUG:teuthology.orchestra.run.trial093:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-23T06:21:01.850 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-23T06:21:01.851 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-23T06:21:01.851 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-23T06:21:01.877 INFO:tasks.ceph.mon.a:Started 2026-02-23T06:21:01.877 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-23T06:21:01.877 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-23T06:21:01.892 INFO:tasks.ceph.mon.b:Started 2026-02-23T06:21:01.892 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-23T06:21:01.893 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-23T06:21:01.895 INFO:tasks.ceph.mon.c:Started 2026-02-23T06:21:01.895 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-23T06:21:01.895 INFO:tasks.ceph.mgr.y:Restarting daemon 2026-02-23T06:21:01.896 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2026-02-23T06:21:01.899 INFO:tasks.ceph.mgr.y:Started 2026-02-23T06:21:01.900 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-23T06:21:01.900 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-23T06:21:01.902 INFO:tasks.ceph.mgr.x:Started 2026-02-23T06:21:01.902 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2026-02-23T06:21:01.902 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2026-02-23T06:21:01.906 INFO:tasks.ceph:setting config [client] debug_client = 20 2026-02-23T06:21:01.906 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set client debug_client 20 2026-02-23T06:21:01.951 INFO:tasks.ceph:setting config [client] debug_ms = 1 2026-02-23T06:21:01.951 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set client debug_ms 1 2026-02-23T06:21:01.997 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2026-02-23T06:21:01.997 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2026-02-23T06:21:02.042 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2026-02-23T06:21:02.043 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2026-02-23T06:21:02.076 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2026-02-23T06:21:02.076 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set mds debug_mds 20 2026-02-23T06:21:02.121 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2026-02-23T06:21:02.121 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2026-02-23T06:21:02.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.160+0000 7ffa5530b640 1 -- 10.20.193.58:0/3196222002 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ffa500b2080 msgr2=0x7ffa501625a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.160+0000 7ffa5530b640 1 --2- 10.20.193.58:0/3196222002 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ffa500b2080 0x7ffa501625a0 secure :-1 s=READY pgs=12 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa3c00c510 tx=0x7ffa3c00c9e0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.160+0000 7ffa5530b640 1 -- 10.20.193.58:0/3196222002 shutdown_connections 2026-02-23T06:21:02.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.160+0000 7ffa5530b640 1 --2- 10.20.193.58:0/3196222002 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ffa500ba270 0x7ffa50160130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.157 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2026-02-23T06:21:02.158 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set mds debug_ms 2 2026-02-23T06:21:02.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.160+0000 7ffa5530b640 1 --2- 10.20.193.58:0/3196222002 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ffa500b9ea0 0x7ffa5015fbf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.160+0000 7ffa5530b640 1 --2- 10.20.193.58:0/3196222002 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ffa500b2080 0x7ffa501625a0 unknown :-1 s=CLOSED pgs=12 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.160+0000 7ffa5530b640 1 -- 10.20.193.58:0/3196222002 >> 10.20.193.58:0/3196222002 conn(0x7ffa500b65c0 msgr2=0x7ffa500b3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.160+0000 7ffa5530b640 1 -- 10.20.193.58:0/3196222002 shutdown_connections 2026-02-23T06:21:02.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.160+0000 7ffa5530b640 1 -- 10.20.193.58:0/3196222002 wait complete. 2026-02-23T06:21:02.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.165+0000 7f7ef485b640 1 -- 10.20.193.58:0/1274073502 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7eec15f850 msgr2=0x7f7eec0574d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.165+0000 7f7ef485b640 1 --2- 10.20.193.58:0/1274073502 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7eec15f850 0x7f7eec0574d0 secure :-1 s=READY pgs=10 gs=1 cs=0 l=1 c_cookie=11608581247893982515 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7eec060ef0 tx=0x7f7ed802f260 comp rx=0 tx=0).stop 2026-02-23T06:21:02.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.165+0000 7f7ef485b640 1 -- 10.20.193.58:0/1274073502 shutdown_connections 2026-02-23T06:21:02.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.165+0000 7f7ef485b640 1 --2- 10.20.193.58:0/1274073502 >> v2:10.20.193.93:3300/0 conn(0x7f7eec05dab0 0x7f7eec05df50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.165+0000 7f7ef485b640 1 --2- 10.20.193.58:0/1274073502 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7eec15f850 0x7f7eec0574d0 unknown :-1 s=CLOSED pgs=10 gs=1 cs=0 l=1 c_cookie=11608581247893982515 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.165+0000 7f7ef485b640 1 --2- 10.20.193.58:0/1274073502 >> v2:10.20.193.58:3300/0 conn(0x7f7eec15f480 0x7f7eec056f90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.165+0000 7f7ef485b640 1 -- 10.20.193.58:0/1274073502 >> 10.20.193.58:0/1274073502 conn(0x7f7eec0b8840 msgr2=0x7f7eec0b8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.165+0000 7f7ef485b640 1 -- 10.20.193.58:0/1274073502 shutdown_connections 2026-02-23T06:21:02.162 INFO:tasks.ceph:setting config [mds] mds_bal_fragment_size_max = 10000 2026-02-23T06:21:02.162 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set mds mds_bal_fragment_size_max 10000 2026-02-23T06:21:02.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.165+0000 7f7ef485b640 1 -- 10.20.193.58:0/1274073502 wait complete. 2026-02-23T06:21:02.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.167+0000 7f7ef485b640 1 Processor -- start 2026-02-23T06:21:02.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.167+0000 7f7ef485b640 1 -- start start 2026-02-23T06:21:02.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.168+0000 7f7ef485b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7eec05dab0 0x7f7eec13bcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.168+0000 7f7ef485b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7eec15f480 0x7f7eec1386e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.168+0000 7f7ef485b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7eec15f850 0x7f7eec1491f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.168+0000 7f7ef485b640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f7eec13c210 con 0x7f7eec15f850 2026-02-23T06:21:02.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.168+0000 7f7ef485b640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f7eec13d460 con 0x7f7eec15f480 2026-02-23T06:21:02.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.168+0000 7f7ef485b640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f7eec13c8e0 con 0x7f7eec05dab0 2026-02-23T06:21:02.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.168+0000 7f7ef25d0640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7eec05dab0 0x7f7eec13bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.168+0000 7f7ef25d0640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7eec05dab0 0x7f7eec13bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:54400/0 (socket says 10.20.193.58:54400) 2026-02-23T06:21:02.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.168+0000 7f7ef25d0640 1 -- 10.20.193.58:0/3139291533 learned_addr learned my addr 10.20.193.58:0/3139291533 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:02.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.169+0000 7f7ef1dcf640 1 --2- 10.20.193.58:0/3139291533 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7eec15f480 0x7f7eec1386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.169+0000 7f7ef2dd1640 1 --2- 10.20.193.58:0/3139291533 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7eec15f850 0x7f7eec1491f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.169+0000 7f7ef25d0640 1 -- 10.20.193.58:0/3139291533 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7eec15f480 msgr2=0x7f7eec1386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.169+0000 7f7ef25d0640 1 --2- 10.20.193.58:0/3139291533 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7eec15f480 0x7f7eec1386e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.169+0000 7f7ef25d0640 1 -- 10.20.193.58:0/3139291533 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7eec15f850 msgr2=0x7f7eec1491f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.169+0000 7f7ef25d0640 1 --2- 10.20.193.58:0/3139291533 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7eec15f850 0x7f7eec1491f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.170+0000 7f7ef25d0640 1 -- 10.20.193.58:0/3139291533 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed8009570 con 0x7f7eec05dab0 2026-02-23T06:21:02.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.170+0000 7f7ef2dd1640 1 --2- 10.20.193.58:0/3139291533 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7eec15f850 0x7f7eec1491f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:21:02.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.170+0000 7f7ef25d0640 1 --2- 10.20.193.58:0/3139291533 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7eec05dab0 0x7f7eec13bcd0 secure :-1 s=READY pgs=11 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ee400c9b0 tx=0x7f7ee400ce80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:02.171 INFO:tasks.ceph:setting config [mds] mds_bal_merge_size = 5 2026-02-23T06:21:02.172 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set mds mds_bal_merge_size 5 2026-02-23T06:21:02.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.171+0000 7f7ed6ffd640 1 -- 10.20.193.58:0/3139291533 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7ee40044a0 con 0x7f7eec05dab0 2026-02-23T06:21:02.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.171+0000 7f7ed6ffd640 1 -- 10.20.193.58:0/3139291533 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f7ee40078c0 con 0x7f7eec05dab0 2026-02-23T06:21:02.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.172+0000 7f7ed6ffd640 1 -- 10.20.193.58:0/3139291533 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7ee4007c50 con 0x7f7eec05dab0 2026-02-23T06:21:02.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.172+0000 7f7ef485b640 1 -- 10.20.193.58:0/3139291533 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eec13cbc0 con 0x7f7eec05dab0 2026-02-23T06:21:02.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.172+0000 7f7ef485b640 1 -- 10.20.193.58:0/3139291533 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eec13d180 con 0x7f7eec05dab0 2026-02-23T06:21:02.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.172+0000 7f7ed6ffd640 1 -- 10.20.193.58:0/3139291533 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f7ee4002ab0 con 0x7f7eec05dab0 2026-02-23T06:21:02.175 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.173+0000 7f7ed6ffd640 1 -- 10.20.193.58:0/3139291533 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f7ee40185d0 con 0x7f7eec05dab0 2026-02-23T06:21:02.175 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.173+0000 7f7ef485b640 1 -- 10.20.193.58:0/3139291533 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7eb80050f0 con 0x7f7eec05dab0 2026-02-23T06:21:02.175 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.175+0000 7f7ed6ffd640 1 -- 10.20.193.58:0/3139291533 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f7ee401d060 con 0x7f7eec05dab0 2026-02-23T06:21:02.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.201+0000 7f2f8b1d2640 1 -- 10.20.193.58:0/1641124895 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f840576d0 msgr2=0x7f2f84058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.201 INFO:tasks.ceph:setting config [mds] mds_bal_split_bits = 3 2026-02-23T06:21:02.201 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set mds mds_bal_split_bits 3 2026-02-23T06:21:02.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.201+0000 7f2f8b1d2640 1 --2- 10.20.193.58:0/1641124895 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f840576d0 0x7f2f84058200 secure :-1 s=READY pgs=12 gs=3 cs=0 l=1 c_cookie=13337990097033950130 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f8000aa30 tx=0x7f2f800303b0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.203+0000 7f2f8b1d2640 1 -- 10.20.193.58:0/1641124895 shutdown_connections 2026-02-23T06:21:02.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.203+0000 7f2f8b1d2640 1 --2- 10.20.193.58:0/1641124895 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f840576d0 0x7f2f84058200 unknown :-1 s=CLOSED pgs=12 gs=3 cs=0 l=1 c_cookie=13337990097033950130 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.203+0000 7f2f8b1d2640 1 -- 10.20.193.58:0/1641124895 >> 10.20.193.58:0/1641124895 conn(0x7f2f840b3c20 msgr2=0x7f2f840b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.203+0000 7f2f8b1d2640 1 -- 10.20.193.58:0/1641124895 shutdown_connections 2026-02-23T06:21:02.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.203+0000 7f2f8b1d2640 1 -- 10.20.193.58:0/1641124895 wait complete. 2026-02-23T06:21:02.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.205+0000 7f2f8b1d2640 1 Processor -- start 2026-02-23T06:21:02.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.205+0000 7f2f8b1d2640 1 -- start start 2026-02-23T06:21:02.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.206+0000 7f2f8b1d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2f84056960 0x7f2f8413f210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.205 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.206+0000 7f2f8b1d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2f840576d0 0x7f2f8413db60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.205 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.206+0000 7f2f8a1d0640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2f84056960 0x7f2f8413f210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.205 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.206+0000 7f2f8a1d0640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2f84056960 0x7f2f8413f210 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:55576/0 (socket says 10.20.193.58:55576) 2026-02-23T06:21:02.205 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.207+0000 7f2f899cf640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2f840576d0 0x7f2f8413db60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.205 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.207+0000 7f2f899cf640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2f840576d0 0x7f2f8413db60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:48388/0 (socket says 10.20.193.58:48388) 2026-02-23T06:21:02.205 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.207+0000 7f2f8b1d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f8415c4b0 0x7f2f84141640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.205 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.207+0000 7f2f8b1d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f2f8415b2b0 con 0x7f2f840576d0 2026-02-23T06:21:02.205 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.207+0000 7f2f8b1d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f2f8415b570 con 0x7f2f84056960 2026-02-23T06:21:02.205 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.207+0000 7f2f8b1d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f2f8413d0b0 con 0x7f2f8415c4b0 2026-02-23T06:21:02.205 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.207+0000 7f2f8a1d0640 1 -- 10.20.193.58:0/2200567402 learned_addr learned my addr 10.20.193.58:0/2200567402 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:02.205 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.207+0000 7f2f8a9d1640 1 --2- 10.20.193.58:0/2200567402 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f8415c4b0 0x7f2f84141640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.205 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.207+0000 7f2f8a1d0640 1 -- 10.20.193.58:0/2200567402 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f8415c4b0 msgr2=0x7f2f84141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.205 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.208+0000 7f2f8a1d0640 1 --2- 10.20.193.58:0/2200567402 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f8415c4b0 0x7f2f84141640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.206 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.208+0000 7f2f8a1d0640 1 -- 10.20.193.58:0/2200567402 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2f840576d0 msgr2=0x7f2f8413db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.206 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.208+0000 7f2f8a1d0640 1 --2- 10.20.193.58:0/2200567402 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2f840576d0 0x7f2f8413db60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.206 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.208+0000 7f2f8a1d0640 1 -- 10.20.193.58:0/2200567402 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f8000a650 con 0x7f2f84056960 2026-02-23T06:21:02.206 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.208+0000 7f2f8a9d1640 1 --2- 10.20.193.58:0/2200567402 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f8415c4b0 0x7f2f84141640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:21:02.206 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.208+0000 7f2f899cf640 1 --2- 10.20.193.58:0/2200567402 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2f840576d0 0x7f2f8413db60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:02.206 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.208+0000 7f2f8a1d0640 1 --2- 10.20.193.58:0/2200567402 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2f84056960 0x7f2f8413f210 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f7400c4d0 tx=0x7f2f7400c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:02.206 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.208+0000 7f2f72ffd640 1 -- 10.20.193.58:0/2200567402 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f74004250 con 0x7f2f84056960 2026-02-23T06:21:02.206 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.208+0000 7f2f72ffd640 1 -- 10.20.193.58:0/2200567402 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f2f740043b0 con 0x7f2f84056960 2026-02-23T06:21:02.208 INFO:tasks.ceph:setting config [mds] mds_bal_split_size = 100 2026-02-23T06:21:02.209 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set mds mds_bal_split_size 100 2026-02-23T06:21:02.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.209+0000 7f2f72ffd640 1 -- 10.20.193.58:0/2200567402 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f74006ad0 con 0x7f2f84056960 2026-02-23T06:21:02.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.209+0000 7f2f8b1d2640 1 -- 10.20.193.58:0/2200567402 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f8413e870 con 0x7f2f84056960 2026-02-23T06:21:02.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.209+0000 7f2f8b1d2640 1 -- 10.20.193.58:0/2200567402 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f8413f750 con 0x7f2f84056960 2026-02-23T06:21:02.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.211+0000 7f2f72ffd640 1 -- 10.20.193.58:0/2200567402 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f2f74003a80 con 0x7f2f84056960 2026-02-23T06:21:02.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.212+0000 7f2f70ff9640 1 -- 10.20.193.58:0/2200567402 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f480050f0 con 0x7f2f84056960 2026-02-23T06:21:02.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.212+0000 7f2f72ffd640 1 -- 10.20.193.58:0/2200567402 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f2f7401b710 con 0x7f2f84056960 2026-02-23T06:21:02.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.214+0000 7f2f72ffd640 1 -- 10.20.193.58:0/2200567402 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f2f74016070 con 0x7f2f84056960 2026-02-23T06:21:02.212 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.216+0000 7f7ef485b640 1 -- 10.20.193.58:0/3139291533 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f7eb8005920 con 0x7f7eec05dab0 2026-02-23T06:21:02.216 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2026-02-23T06:21:02.216 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2026-02-23T06:21:02.223 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.227+0000 7f7ed6ffd640 1 -- 10.20.193.58:0/3139291533 <== mon.2 v2:10.20.193.93:3301/0 7 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f7ee4007db0 con 0x7f7eec05dab0 2026-02-23T06:21:02.223 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.228+0000 7f7ed6ffd640 1 -- 10.20.193.58:0/3139291533 <== mon.2 v2:10.20.193.93:3301/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v5)=0 v5) ==== 123+0+0 (secure 0 0 0) 0x7f7ee401d060 con 0x7f7eec05dab0 2026-02-23T06:21:02.226 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2026-02-23T06:21:02.227 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2026-02-23T06:21:02.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.229+0000 7f7ef485b640 1 -- 10.20.193.58:0/3139291533 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7eec05dab0 msgr2=0x7f7eec13bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.229+0000 7f7ef485b640 1 --2- 10.20.193.58:0/3139291533 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7eec05dab0 0x7f7eec13bcd0 secure :-1 s=READY pgs=11 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ee400c9b0 tx=0x7f7ee400ce80 comp rx=0 tx=0).stop 2026-02-23T06:21:02.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.229+0000 7f7ef485b640 1 -- 10.20.193.58:0/3139291533 shutdown_connections 2026-02-23T06:21:02.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.229+0000 7f7ef485b640 1 --2- 10.20.193.58:0/3139291533 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7eec15f850 0x7f7eec1491f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.229+0000 7f7ef485b640 1 --2- 10.20.193.58:0/3139291533 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7eec15f480 0x7f7eec1386e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.229+0000 7f7ef485b640 1 --2- 10.20.193.58:0/3139291533 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7eec05dab0 0x7f7eec13bcd0 unknown :-1 s=CLOSED pgs=11 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.229 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.229+0000 7f7ef485b640 1 -- 10.20.193.58:0/3139291533 >> 10.20.193.58:0/3139291533 conn(0x7f7eec0b8840 msgr2=0x7f7eec057670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.229 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.229+0000 7f7ef485b640 1 -- 10.20.193.58:0/3139291533 shutdown_connections 2026-02-23T06:21:02.229 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.231+0000 7f7ef485b640 1 -- 10.20.193.58:0/3139291533 wait complete. 2026-02-23T06:21:02.229 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.229+0000 7f2f72ffd640 1 -- 10.20.193.58:0/2200567402 <== mon.1 v2:10.20.193.93:3300/0 7 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f2f74012630 con 0x7f2f84056960 2026-02-23T06:21:02.243 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2026-02-23T06:21:02.244 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2026-02-23T06:21:02.256 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.261+0000 7f014b043640 1 -- 10.20.193.58:0/3345421246 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f01440b4ad0 msgr2=0x7f014415b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.256 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.261+0000 7f014b043640 1 --2- 10.20.193.58:0/3345421246 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f01440b4ad0 0x7f014415b460 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=10010162296325938659 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01440b6d00 tx=0x7f013802f280 comp rx=0 tx=0).stop 2026-02-23T06:21:02.261 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2026-02-23T06:21:02.261 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2026-02-23T06:21:02.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.266+0000 7f014b043640 1 -- 10.20.193.58:0/3345421246 shutdown_connections 2026-02-23T06:21:02.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.266+0000 7f014b043640 1 --2- 10.20.193.58:0/3345421246 >> v2:10.20.193.58:3300/0 conn(0x7f01441620e0 0x7f0144058ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.266+0000 7f014b043640 1 --2- 10.20.193.58:0/3345421246 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f01440b7050 0x7f0144161ba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.266+0000 7f014b043640 1 --2- 10.20.193.58:0/3345421246 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f01440b4ad0 0x7f014415b460 unknown :-1 s=CLOSED pgs=17 gs=1 cs=0 l=1 c_cookie=10010162296325938659 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.266+0000 7f014b043640 1 -- 10.20.193.58:0/3345421246 >> 10.20.193.58:0/3345421246 conn(0x7f01440b3c20 msgr2=0x7f01440b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.266+0000 7f014b043640 1 -- 10.20.193.58:0/3345421246 shutdown_connections 2026-02-23T06:21:02.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.266+0000 7f014b043640 1 -- 10.20.193.58:0/3345421246 wait complete. 2026-02-23T06:21:02.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.268+0000 7f014b043640 1 Processor -- start 2026-02-23T06:21:02.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.268+0000 7f014b043640 1 -- start start 2026-02-23T06:21:02.273 INFO:tasks.ceph:setting config [mds] mds_dir_prefetch = False 2026-02-23T06:21:02.274 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set mds mds_dir_prefetch False 2026-02-23T06:21:02.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.269+0000 7f014b043640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f01440b4ad0 0x7f0144138ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.269+0000 7f014b043640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f01440b7050 0x7f0144156ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.269+0000 7f014b043640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f01441620e0 0x7f014415f7e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.269+0000 7f014b043640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f0144161150 con 0x7f01441620e0 2026-02-23T06:21:02.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.269+0000 7f014a041640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f01440b4ad0 0x7f0144138ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.269+0000 7f014a041640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f01440b4ad0 0x7f0144138ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:54430/0 (socket says 10.20.193.58:54430) 2026-02-23T06:21:02.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.269+0000 7f0149840640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f01440b7050 0x7f0144156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.269+0000 7f014b043640 1 -- 10.20.193.58:0/799410149 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f01441fd630 con 0x7f01440b7050 2026-02-23T06:21:02.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.269+0000 7f014b043640 1 -- 10.20.193.58:0/799410149 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f01441fd0b0 con 0x7f01440b4ad0 2026-02-23T06:21:02.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.269+0000 7f014a041640 1 -- 10.20.193.58:0/799410149 learned_addr learned my addr 10.20.193.58:0/799410149 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:02.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.270+0000 7f0149840640 1 -- 10.20.193.58:0/799410149 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f01440b4ad0 msgr2=0x7f0144138ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.270+0000 7f0149840640 1 --2- 10.20.193.58:0/799410149 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f01440b4ad0 0x7f0144138ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.270+0000 7f0149840640 1 -- 10.20.193.58:0/799410149 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f01441620e0 msgr2=0x7f014415f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.270+0000 7f0149840640 1 --2- 10.20.193.58:0/799410149 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f01441620e0 0x7f014415f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.270+0000 7f0149840640 1 -- 10.20.193.58:0/799410149 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013c00a590 con 0x7f01440b7050 2026-02-23T06:21:02.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.270+0000 7f0149840640 1 --2- 10.20.193.58:0/799410149 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f01440b7050 0x7f0144156ca0 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f014000ead0 tx=0x7f014000ebd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:02.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.270+0000 7f0132ffd640 1 -- 10.20.193.58:0/799410149 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f014000cc00 con 0x7f01440b7050 2026-02-23T06:21:02.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.270+0000 7f014b043640 1 -- 10.20.193.58:0/799410149 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0138009570 con 0x7f01440b7050 2026-02-23T06:21:02.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.270+0000 7f0132ffd640 1 -- 10.20.193.58:0/799410149 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f014000ce30 con 0x7f01440b7050 2026-02-23T06:21:02.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.271+0000 7f0132ffd640 1 -- 10.20.193.58:0/799410149 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0140004ad0 con 0x7f01440b7050 2026-02-23T06:21:02.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.271+0000 7f0132ffd640 1 -- 10.20.193.58:0/799410149 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f014001d060 con 0x7f01440b7050 2026-02-23T06:21:02.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.271+0000 7f014b043640 1 -- 10.20.193.58:0/799410149 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0144160a90 con 0x7f01440b7050 2026-02-23T06:21:02.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.271+0000 7f0132ffd640 1 -- 10.20.193.58:0/799410149 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f0140005430 con 0x7f01440b7050 2026-02-23T06:21:02.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.272+0000 7f014b043640 1 -- 10.20.193.58:0/799410149 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0144161290 con 0x7f01440b7050 2026-02-23T06:21:02.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.273+0000 7f0132ffd640 1 -- 10.20.193.58:0/799410149 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f0140004d90 con 0x7f01440b7050 2026-02-23T06:21:02.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.274+0000 7f2f70ff9640 1 -- 10.20.193.58:0/2200567402 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f2f480053a0 con 0x7f2f84056960 2026-02-23T06:21:02.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.280+0000 7f0132ffd640 1 -- 10.20.193.58:0/799410149 <== mon.1 v2:10.20.193.93:3300/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01400055f0 con 0x7f01440b7050 2026-02-23T06:21:02.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.281+0000 7f2f72ffd640 1 -- 10.20.193.58:0/2200567402 <== mon.1 v2:10.20.193.93:3300/0 8 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f7401ba50 con 0x7f2f84056960 2026-02-23T06:21:02.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.281+0000 7f2f72ffd640 1 -- 10.20.193.58:0/2200567402 <== mon.1 v2:10.20.193.93:3300/0 9 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f2f7401bc40 con 0x7f2f84056960 2026-02-23T06:21:02.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.285+0000 7f2f70ff9640 1 -- 10.20.193.58:0/2200567402 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2f84056960 msgr2=0x7f2f8413f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.285+0000 7f2f70ff9640 1 --2- 10.20.193.58:0/2200567402 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2f84056960 0x7f2f8413f210 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f7400c4d0 tx=0x7f2f7400c9a0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.287+0000 7f2f70ff9640 1 -- 10.20.193.58:0/2200567402 shutdown_connections 2026-02-23T06:21:02.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.287+0000 7f2f70ff9640 1 --2- 10.20.193.58:0/2200567402 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f8415c4b0 0x7f2f84141640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.287+0000 7f2f70ff9640 1 --2- 10.20.193.58:0/2200567402 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2f840576d0 0x7f2f8413db60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.287+0000 7f2f70ff9640 1 --2- 10.20.193.58:0/2200567402 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2f84056960 0x7f2f8413f210 unknown :-1 s=CLOSED pgs=16 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.287+0000 7f2f70ff9640 1 -- 10.20.193.58:0/2200567402 >> 10.20.193.58:0/2200567402 conn(0x7f2f840b3c20 msgr2=0x7f2f8415b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.287+0000 7f2f70ff9640 1 -- 10.20.193.58:0/2200567402 shutdown_connections 2026-02-23T06:21:02.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.287+0000 7f2f70ff9640 1 -- 10.20.193.58:0/2200567402 wait complete. 2026-02-23T06:21:02.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.306+0000 7f0c059cd640 1 -- 10.20.193.58:0/744124142 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0c00168ce0 msgr2=0x7f0c000b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.306+0000 7f0c059cd640 1 --2- 10.20.193.58:0/744124142 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0c00168ce0 0x7f0c000b2120 secure :-1 s=READY pgs=7 gs=3 cs=0 l=1 c_cookie=4553336968668056957 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c000b4cb0 tx=0x7f0bf0030350 comp rx=0 tx=0).stop 2026-02-23T06:21:02.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.306+0000 7f0c059cd640 1 -- 10.20.193.58:0/744124142 shutdown_connections 2026-02-23T06:21:02.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.306+0000 7f0c059cd640 1 --2- 10.20.193.58:0/744124142 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0c00168ce0 0x7f0c000b2120 unknown :-1 s=CLOSED pgs=7 gs=3 cs=0 l=1 c_cookie=4553336968668056957 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.306+0000 7f0c059cd640 1 -- 10.20.193.58:0/744124142 >> 10.20.193.58:0/744124142 conn(0x7f0c000561f0 msgr2=0x7f0c000565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.306+0000 7f0c059cd640 1 -- 10.20.193.58:0/744124142 shutdown_connections 2026-02-23T06:21:02.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.306+0000 7f0c059cd640 1 -- 10.20.193.58:0/744124142 wait complete. 2026-02-23T06:21:02.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.308+0000 7f0c059cd640 1 Processor -- start 2026-02-23T06:21:02.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.308+0000 7f0c059cd640 1 -- start start 2026-02-23T06:21:02.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.309+0000 7f0c059cd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0c000aed00 0x7f0c001629f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.309+0000 7f0c059cd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0c000af120 0x7f0c0020add0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.309+0000 7f0c059cd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0c00168ce0 0x7f0c00161a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.309+0000 7f0c059cd640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0015f050 con 0x7f0c00168ce0 2026-02-23T06:21:02.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.309+0000 7f0c059cd640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0020a6a0 con 0x7f0c000af120 2026-02-23T06:21:02.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.309+0000 7f0c059cd640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f0c001600f0 con 0x7f0c000aed00 2026-02-23T06:21:02.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.309+0000 7f0bfeffd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0c000aed00 0x7f0c001629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.309+0000 7f0bfeffd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0c000aed00 0x7f0c001629f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:54432/0 (socket says 10.20.193.58:54432) 2026-02-23T06:21:02.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.309+0000 7f0bfeffd640 1 -- 10.20.193.58:0/2676072730 learned_addr learned my addr 10.20.193.58:0/2676072730 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.310+0000 7f0bfe7fc640 1 --2- 10.20.193.58:0/2676072730 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0c000af120 0x7f0c0020add0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.310+0000 7f0bff7fe640 1 --2- 10.20.193.58:0/2676072730 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0c00168ce0 0x7f0c00161a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.310+0000 7f0bfeffd640 1 -- 10.20.193.58:0/2676072730 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0c000af120 msgr2=0x7f0c0020add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.310+0000 7f0bfeffd640 1 --2- 10.20.193.58:0/2676072730 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0c000af120 0x7f0c0020add0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.310+0000 7f0bfeffd640 1 -- 10.20.193.58:0/2676072730 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0c00168ce0 msgr2=0x7f0c00161a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.310+0000 7f0bfeffd640 1 --2- 10.20.193.58:0/2676072730 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0c00168ce0 0x7f0c00161a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.310+0000 7f0bfeffd640 1 -- 10.20.193.58:0/2676072730 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf000a650 con 0x7f0c000aed00 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.310+0000 7f0bfe7fc640 1 --2- 10.20.193.58:0/2676072730 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0c000af120 0x7f0c0020add0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.310+0000 7f0bfeffd640 1 --2- 10.20.193.58:0/2676072730 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0c000aed00 0x7f0c001629f0 secure :-1 s=READY pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0bf000a230 tx=0x7f0bf0003d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.311+0000 7f0bdffff640 1 -- 10.20.193.58:0/2676072730 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0bf003d040 con 0x7f0c000aed00 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.311+0000 7f0bdffff640 1 -- 10.20.193.58:0/2676072730 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0bf0003e90 con 0x7f0c000aed00 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.311+0000 7f0bdffff640 1 -- 10.20.193.58:0/2676072730 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0bf0039b20 con 0x7f0c000aed00 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.311+0000 7f0c059cd640 1 -- 10.20.193.58:0/2676072730 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c0020a940 con 0x7f0c000aed00 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.311+0000 7f0c059cd640 1 -- 10.20.193.58:0/2676072730 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c001722b0 con 0x7f0c000aed00 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.311+0000 7f0bdffff640 1 -- 10.20.193.58:0/2676072730 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f0bf004a020 con 0x7f0c000aed00 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.311+0000 7f0bdffff640 1 -- 10.20.193.58:0/2676072730 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f0bf0040510 con 0x7f0c000aed00 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.314+0000 7f0c059cd640 1 -- 10.20.193.58:0/2676072730 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bc0005300 con 0x7f0c000aed00 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.315+0000 7f0bdffff640 1 -- 10.20.193.58:0/2676072730 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f0bf0048070 con 0x7f0c000aed00 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.325+0000 7fe401f75640 1 -- 10.20.193.58:0/348963343 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe3fc0b7050 msgr2=0x7fe3fc0561f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.325+0000 7fe401f75640 1 --2- 10.20.193.58:0/348963343 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe3fc0b7050 0x7fe3fc0561f0 secure :-1 s=READY pgs=21 gs=2 cs=0 l=1 c_cookie=124165218441885918 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3fc054f80 tx=0x7fe3e402f260 comp rx=0 tx=0).stop 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.325+0000 7fe401f75640 1 -- 10.20.193.58:0/348963343 shutdown_connections 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.325+0000 7fe401f75640 1 --2- 10.20.193.58:0/348963343 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe3fc0b7050 0x7fe3fc0561f0 unknown :-1 s=CLOSED pgs=21 gs=2 cs=0 l=1 c_cookie=124165218441885918 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.325+0000 7fe401f75640 1 --2- 10.20.193.58:0/348963343 >> v2:10.20.193.58:3300/0 conn(0x7fe3fc0b4ad0 0x7fe3fc15b460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.325+0000 7fe401f75640 1 -- 10.20.193.58:0/348963343 >> 10.20.193.58:0/348963343 conn(0x7fe3fc0b3c20 msgr2=0x7fe3fc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.325+0000 7fe401f75640 1 -- 10.20.193.58:0/348963343 shutdown_connections 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.326+0000 7fe401f75640 1 -- 10.20.193.58:0/348963343 wait complete. 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.327+0000 7fe401f75640 1 Processor -- start 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.328+0000 7fe401f75640 1 -- start start 2026-02-23T06:21:02.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.328+0000 7fe401f75640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe3fc0b4ad0 0x7fe3fc1367a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.328+0000 7fe401f75640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3fc0b7050 0x7fe3fc133000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.328+0000 7fe400f73640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe3fc0b4ad0 0x7fe3fc1367a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.329+0000 7fe400f73640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe3fc0b4ad0 0x7fe3fc1367a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:54438/0 (socket says 10.20.193.58:54438) 2026-02-23T06:21:02.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.329+0000 7fe400f73640 1 -- 10.20.193.58:0/3528952114 learned_addr learned my addr 10.20.193.58:0/3528952114 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:02.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.329+0000 7fe401f75640 1 --2- 10.20.193.58:0/3528952114 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe3fc161ba0 0x7fe3fc133540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.329+0000 7fe401f75640 1 -- 10.20.193.58:0/3528952114 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc159e40 con 0x7fe3fc0b7050 2026-02-23T06:21:02.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.329+0000 7fe401f75640 1 -- 10.20.193.58:0/3528952114 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc1ff600 con 0x7fe3fc161ba0 2026-02-23T06:21:02.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.329+0000 7fe401f75640 1 -- 10.20.193.58:0/3528952114 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe3fc134a20 con 0x7fe3fc0b4ad0 2026-02-23T06:21:02.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.329+0000 7fe401774640 1 --2- 10.20.193.58:0/3528952114 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe3fc161ba0 0x7fe3fc133540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.329+0000 7fe400f73640 1 -- 10.20.193.58:0/3528952114 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe3fc161ba0 msgr2=0x7fe3fc133540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.329+0000 7fe400f73640 1 --2- 10.20.193.58:0/3528952114 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe3fc161ba0 0x7fe3fc133540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.329+0000 7fe400f73640 1 -- 10.20.193.58:0/3528952114 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3fc0b7050 msgr2=0x7fe3fc133000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.329+0000 7fe400f73640 1 --2- 10.20.193.58:0/3528952114 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3fc0b7050 0x7fe3fc133000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.329+0000 7fe400f73640 1 -- 10.20.193.58:0/3528952114 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e4009570 con 0x7fe3fc0b4ad0 2026-02-23T06:21:02.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.330+0000 7fe400f73640 1 --2- 10.20.193.58:0/3528952114 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe3fc0b4ad0 0x7fe3fc1367a0 secure :-1 s=READY pgs=14 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3ec00b530 tx=0x7fe3ec00ba00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:02.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.330+0000 7fe3f17fa640 1 -- 10.20.193.58:0/3528952114 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3ec004560 con 0x7fe3fc0b4ad0 2026-02-23T06:21:02.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.330+0000 7fe401f75640 1 -- 10.20.193.58:0/3528952114 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3fc1fe9f0 con 0x7fe3fc0b4ad0 2026-02-23T06:21:02.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.331+0000 7fe3f17fa640 1 -- 10.20.193.58:0/3528952114 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3ec002790 con 0x7fe3fc0b4ad0 2026-02-23T06:21:02.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.331+0000 7fe3f17fa640 1 -- 10.20.193.58:0/3528952114 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3ec002b80 con 0x7fe3fc0b4ad0 2026-02-23T06:21:02.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.331+0000 7fe401f75640 1 -- 10.20.193.58:0/3528952114 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3fc1fefb0 con 0x7fe3fc0b4ad0 2026-02-23T06:21:02.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.332+0000 7fe3f17fa640 1 -- 10.20.193.58:0/3528952114 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7fe3ec00d040 con 0x7fe3fc0b4ad0 2026-02-23T06:21:02.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.332+0000 7fe3f17fa640 1 -- 10.20.193.58:0/3528952114 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7fe3ec018950 con 0x7fe3fc0b4ad0 2026-02-23T06:21:02.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.333+0000 7fe3daffd640 1 -- 10.20.193.58:0/3528952114 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3fc05b980 con 0x7fe3fc0b4ad0 2026-02-23T06:21:02.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.337+0000 7fe3f17fa640 1 -- 10.20.193.58:0/3528952114 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7fe3ec038f00 con 0x7fe3fc0b4ad0 2026-02-23T06:21:02.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.341+0000 7fb69d247640 1 -- 10.20.193.58:0/728402477 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb69815ba10 msgr2=0x7fb6980b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.341+0000 7fb69d247640 1 --2- 10.20.193.58:0/728402477 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb69815ba10 0x7fb6980b5610 secure :-1 s=READY pgs=8 gs=3 cs=0 l=1 c_cookie=10807797615622811000 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6980aeb00 tx=0x7fb68002f220 comp rx=0 tx=0).stop 2026-02-23T06:21:02.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.341+0000 7fb69d247640 1 -- 10.20.193.58:0/728402477 shutdown_connections 2026-02-23T06:21:02.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.341+0000 7fb69d247640 1 --2- 10.20.193.58:0/728402477 >> v2:10.20.193.93:3300/0 conn(0x7fb6980b39f0 0x7fb6980b68f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.341+0000 7fb69d247640 1 --2- 10.20.193.58:0/728402477 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb69815ba10 0x7fb6980b5610 unknown :-1 s=CLOSED pgs=8 gs=3 cs=0 l=1 c_cookie=10807797615622811000 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.341+0000 7fb69d247640 1 -- 10.20.193.58:0/728402477 >> 10.20.193.58:0/728402477 conn(0x7fb698058e50 msgr2=0x7fb698059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.345+0000 7fb69d247640 1 -- 10.20.193.58:0/728402477 shutdown_connections 2026-02-23T06:21:02.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.346+0000 7fb69d247640 1 -- 10.20.193.58:0/728402477 wait complete. 2026-02-23T06:21:02.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.347+0000 7fb69d247640 1 Processor -- start 2026-02-23T06:21:02.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.348+0000 7fb69d247640 1 -- start start 2026-02-23T06:21:02.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.348+0000 7fb69d247640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb6980b39f0 0x7fb698121d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.348+0000 7fb69d247640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb69815ba10 0x7fb698159270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.348+0000 7fb69d247640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb69815bde0 0x7fb69811d230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.348+0000 7fb69d247640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb69811f5d0 con 0x7fb69815bde0 2026-02-23T06:21:02.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.348+0000 7fb69d247640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb69811f8b0 con 0x7fb6980b39f0 2026-02-23T06:21:02.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.348+0000 7fb69d247640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb69811fb90 con 0x7fb69815ba10 2026-02-23T06:21:02.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.348+0000 7fb697577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb69815bde0 0x7fb69811d230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.348+0000 7fb696575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb69815ba10 0x7fb698159270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.348+0000 7fb696575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb69815ba10 0x7fb698159270 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:54454/0 (socket says 10.20.193.58:54454) 2026-02-23T06:21:02.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.348+0000 7fb696575640 1 -- 10.20.193.58:0/2293080373 learned_addr learned my addr 10.20.193.58:0/2293080373 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:02.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.349+0000 7fb696575640 1 -- 10.20.193.58:0/2293080373 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb6980b39f0 msgr2=0x7fb698121d10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:21:02.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.349+0000 7fb696575640 1 --2- 10.20.193.58:0/2293080373 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb6980b39f0 0x7fb698121d10 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.349+0000 7fb696575640 1 -- 10.20.193.58:0/2293080373 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb69815bde0 msgr2=0x7fb69811d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.349+0000 7fb696575640 1 --2- 10.20.193.58:0/2293080373 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb69815bde0 0x7fb69811d230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.349+0000 7fb696575640 1 -- 10.20.193.58:0/2293080373 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6800094b0 con 0x7fb69815ba10 2026-02-23T06:21:02.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.349+0000 7fb696575640 1 --2- 10.20.193.58:0/2293080373 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb69815ba10 0x7fb698159270 secure :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb68c00b520 tx=0x7fb68c00b9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:02.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.349+0000 7fb6777fe640 1 -- 10.20.193.58:0/2293080373 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb68c0044a0 con 0x7fb69815ba10 2026-02-23T06:21:02.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.349+0000 7fb6777fe640 1 -- 10.20.193.58:0/2293080373 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb68c002740 con 0x7fb69815ba10 2026-02-23T06:21:02.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.349+0000 7fb6777fe640 1 -- 10.20.193.58:0/2293080373 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb68c0044a0 con 0x7fb69815ba10 2026-02-23T06:21:02.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.350+0000 7fb69d247640 1 -- 10.20.193.58:0/2293080373 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb69811fe70 con 0x7fb69815ba10 2026-02-23T06:21:02.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.350+0000 7fb69d247640 1 -- 10.20.193.58:0/2293080373 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb698163d60 con 0x7fb69815ba10 2026-02-23T06:21:02.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.350+0000 7fb6777fe640 1 -- 10.20.193.58:0/2293080373 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7fb68c018400 con 0x7fb69815ba10 2026-02-23T06:21:02.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.350+0000 7fb6777fe640 1 -- 10.20.193.58:0/2293080373 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7fb68c00fb90 con 0x7fb69815ba10 2026-02-23T06:21:02.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.351+0000 7fb69d247640 1 -- 10.20.193.58:0/2293080373 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb660005300 con 0x7fb69815ba10 2026-02-23T06:21:02.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.352+0000 7fb6777fe640 1 -- 10.20.193.58:0/2293080373 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7fb68c013020 con 0x7fb69815ba10 2026-02-23T06:21:02.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.354+0000 7f0c059cd640 1 -- 10.20.193.58:0/2676072730 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f0bc00055b0 con 0x7f0c000aed00 2026-02-23T06:21:02.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.358+0000 7f0bdffff640 1 -- 10.20.193.58:0/2676072730 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v7)=0 v7) ==== 117+0+0 (secure 0 0 0) 0x7f0bf0039c80 con 0x7f0c000aed00 2026-02-23T06:21:02.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.359+0000 7f0c059cd640 1 -- 10.20.193.58:0/2676072730 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0c000aed00 msgr2=0x7f0c001629f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.359+0000 7f0c059cd640 1 --2- 10.20.193.58:0/2676072730 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0c000aed00 0x7f0c001629f0 secure :-1 s=READY pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0bf000a230 tx=0x7f0bf0003d20 comp rx=0 tx=0).stop 2026-02-23T06:21:02.359 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2026-02-23T06:21:02.359 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2026-02-23T06:21:02.359 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.361+0000 7f0c059cd640 1 -- 10.20.193.58:0/2676072730 shutdown_connections 2026-02-23T06:21:02.359 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.361+0000 7f0c059cd640 1 --2- 10.20.193.58:0/2676072730 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0c00168ce0 0x7f0c00161a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.359 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.361+0000 7f0c059cd640 1 --2- 10.20.193.58:0/2676072730 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0c000af120 0x7f0c0020add0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.359 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.361+0000 7f0c059cd640 1 --2- 10.20.193.58:0/2676072730 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0c000aed00 0x7f0c001629f0 unknown :-1 s=CLOSED pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.359 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.361+0000 7f0c059cd640 1 -- 10.20.193.58:0/2676072730 >> 10.20.193.58:0/2676072730 conn(0x7f0c000561f0 msgr2=0x7f0c000b1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.359 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.361+0000 7f0c059cd640 1 -- 10.20.193.58:0/2676072730 shutdown_connections 2026-02-23T06:21:02.359 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.361+0000 7f0c059cd640 1 -- 10.20.193.58:0/2676072730 wait complete. 2026-02-23T06:21:02.375 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.381+0000 7fe3daffd640 1 -- 10.20.193.58:0/3528952114 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7fe3fc05bee0 con 0x7fe3fc0b4ad0 2026-02-23T06:21:02.380 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2026-02-23T06:21:02.380 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2026-02-23T06:21:02.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.386+0000 7fe3f17fa640 1 -- 10.20.193.58:0/3528952114 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7fe3ec026030 con 0x7fe3fc0b4ad0 2026-02-23T06:21:02.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.390+0000 7fe3daffd640 1 -- 10.20.193.58:0/3528952114 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe3fc0b4ad0 msgr2=0x7fe3fc1367a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.390+0000 7fe3daffd640 1 --2- 10.20.193.58:0/3528952114 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe3fc0b4ad0 0x7fe3fc1367a0 secure :-1 s=READY pgs=14 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3ec00b530 tx=0x7fe3ec00ba00 comp rx=0 tx=0).stop 2026-02-23T06:21:02.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.390+0000 7fe3daffd640 1 -- 10.20.193.58:0/3528952114 shutdown_connections 2026-02-23T06:21:02.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.390+0000 7fe3daffd640 1 --2- 10.20.193.58:0/3528952114 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe3fc161ba0 0x7fe3fc133540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.390+0000 7fe3daffd640 1 --2- 10.20.193.58:0/3528952114 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3fc0b7050 0x7fe3fc133000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.390+0000 7fe3daffd640 1 --2- 10.20.193.58:0/3528952114 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe3fc0b4ad0 0x7fe3fc1367a0 unknown :-1 s=CLOSED pgs=14 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.390+0000 7fe3daffd640 1 -- 10.20.193.58:0/3528952114 >> 10.20.193.58:0/3528952114 conn(0x7fe3fc0b3c20 msgr2=0x7fe3fc0576a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.387 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2026-02-23T06:21:02.387 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2026-02-23T06:21:02.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.391+0000 7fe3daffd640 1 -- 10.20.193.58:0/3528952114 shutdown_connections 2026-02-23T06:21:02.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.391+0000 7fe3daffd640 1 -- 10.20.193.58:0/3528952114 wait complete. 2026-02-23T06:21:02.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.399+0000 7f6bf58cc640 1 -- 10.20.193.58:0/1310790785 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6bf00b39f0 msgr2=0x7f6bf00b68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.399+0000 7f6bf58cc640 1 --2- 10.20.193.58:0/1310790785 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6bf00b39f0 0x7f6bf00b68f0 secure :-1 s=READY pgs=10 gs=2 cs=0 l=1 c_cookie=13025356025429366511 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6bf00b5160 tx=0x7f6bdc02f360 comp rx=0 tx=0).stop 2026-02-23T06:21:02.397 INFO:tasks.ceph:setting config [mgr] client_mount_timeout = 30 2026-02-23T06:21:02.397 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set mgr client_mount_timeout 30 2026-02-23T06:21:02.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.400+0000 7f5a71b0b640 1 -- 10.20.193.58:0/295608289 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5a6c15c040 msgr2=0x7f5a6c05b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.400+0000 7f5a71b0b640 1 --2- 10.20.193.58:0/295608289 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5a6c15c040 0x7f5a6c05b0e0 secure :-1 s=READY pgs=12 gs=2 cs=0 l=1 c_cookie=6962962939881684259 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a5c004740 tx=0x7f5a5c02f1d0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.400+0000 7f5a71b0b640 1 -- 10.20.193.58:0/295608289 shutdown_connections 2026-02-23T06:21:02.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.400+0000 7f5a71b0b640 1 --2- 10.20.193.58:0/295608289 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5a6c15c040 0x7f5a6c05b0e0 unknown :-1 s=CLOSED pgs=12 gs=2 cs=0 l=1 c_cookie=6962962939881684259 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.400+0000 7f5a71b0b640 1 -- 10.20.193.58:0/295608289 >> 10.20.193.58:0/295608289 conn(0x7f5a6c0b3c20 msgr2=0x7f5a6c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.402+0000 7f5a71b0b640 1 -- 10.20.193.58:0/295608289 shutdown_connections 2026-02-23T06:21:02.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.402+0000 7f5a71b0b640 1 -- 10.20.193.58:0/295608289 wait complete. 2026-02-23T06:21:02.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.403+0000 7f5a71b0b640 1 Processor -- start 2026-02-23T06:21:02.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.403+0000 7f5a71b0b640 1 -- start start 2026-02-23T06:21:02.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.400+0000 7f6bf58cc640 1 -- 10.20.193.58:0/1310790785 shutdown_connections 2026-02-23T06:21:02.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.400+0000 7f6bf58cc640 1 --2- 10.20.193.58:0/1310790785 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6bf00b39f0 0x7f6bf00b68f0 unknown :-1 s=CLOSED pgs=10 gs=2 cs=0 l=1 c_cookie=13025356025429366511 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.400+0000 7f6bf58cc640 1 --2- 10.20.193.58:0/1310790785 >> v2:10.20.193.93:3300/0 conn(0x7f6bf015ba10 0x7f6bf00b5610 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.400+0000 7f6bf58cc640 1 -- 10.20.193.58:0/1310790785 >> 10.20.193.58:0/1310790785 conn(0x7f6bf0058e50 msgr2=0x7f6bf0059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.400+0000 7f6bf58cc640 1 -- 10.20.193.58:0/1310790785 shutdown_connections 2026-02-23T06:21:02.399 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.400+0000 7f6bf58cc640 1 -- 10.20.193.58:0/1310790785 wait complete. 2026-02-23T06:21:02.399 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.401+0000 7f6bf58cc640 1 Processor -- start 2026-02-23T06:21:02.399 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.402+0000 7f6bf58cc640 1 -- start start 2026-02-23T06:21:02.399 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.403+0000 7f6bf58cc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6bf00b39f0 0x7f6bf015a8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.399 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.404+0000 7f5a71b0b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5a6c056550 0x7f5a6c0af7e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.399 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.404+0000 7f5a71b0b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5a6c0b5680 0x7f5a6c058b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.399 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.404+0000 7f5a71b0b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5a6c15c040 0x7f5a6c1391f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.399 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.404+0000 7f5a71b0b640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f5a6c0b1690 con 0x7f5a6c15c040 2026-02-23T06:21:02.399 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.404+0000 7f6beeffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6bf00b39f0 0x7f6bf015a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.399 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.404+0000 7f6beeffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6bf00b39f0 0x7f6bf015a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:48490/0 (socket says 10.20.193.58:48490) 2026-02-23T06:21:02.399 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.404+0000 7f6beeffd640 1 -- 10.20.193.58:0/2353912017 learned_addr learned my addr 10.20.193.58:0/2353912017 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:02.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.404+0000 7f6bf58cc640 1 --2- 10.20.193.58:0/2353912017 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6bf015ba10 0x7f6bf0175ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.404+0000 7f6bf58cc640 1 --2- 10.20.193.58:0/2353912017 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6bf015bde0 0x7f6bf0176410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.404+0000 7f6bf58cc640 1 -- 10.20.193.58:0/2353912017 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf01759f0 con 0x7f6bf00b39f0 2026-02-23T06:21:02.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.404+0000 7f6bf58cc640 1 -- 10.20.193.58:0/2353912017 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf0172450 con 0x7f6bf015ba10 2026-02-23T06:21:02.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.404+0000 7f6bf58cc640 1 -- 10.20.193.58:0/2353912017 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f6bf01726f0 con 0x7f6bf015bde0 2026-02-23T06:21:02.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.404+0000 7f6bef7fe640 1 --2- 10.20.193.58:0/2353912017 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6bf015bde0 0x7f6bf0176410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.404+0000 7f6bee7fc640 1 --2- 10.20.193.58:0/2353912017 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6bf015ba10 0x7f6bf0175ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.404+0000 7f5a71b0b640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f5a6c0aec70 con 0x7f5a6c056550 2026-02-23T06:21:02.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.405+0000 7f5a71b0b640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f5a6c0b0b60 con 0x7f5a6c0b5680 2026-02-23T06:21:02.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.404+0000 7f5a70b09640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5a6c056550 0x7f5a6c0af7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.405+0000 7f5a70b09640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5a6c056550 0x7f5a6c0af7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:55628/0 (socket says 10.20.193.58:55628) 2026-02-23T06:21:02.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.405+0000 7f5a70b09640 1 -- 10.20.193.58:0/3051861302 learned_addr learned my addr 10.20.193.58:0/3051861302 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:02.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.405+0000 7f5a63fff640 1 --2- 10.20.193.58:0/3051861302 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5a6c0b5680 0x7f5a6c058b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.405+0000 7f6beeffd640 1 -- 10.20.193.58:0/2353912017 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6bf015bde0 msgr2=0x7f6bf0176410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.405+0000 7f6beeffd640 1 --2- 10.20.193.58:0/2353912017 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6bf015bde0 0x7f6bf0176410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.405+0000 7f6beeffd640 1 -- 10.20.193.58:0/2353912017 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6bf015ba10 msgr2=0x7f6bf0175ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.405+0000 7f6beeffd640 1 --2- 10.20.193.58:0/2353912017 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6bf015ba10 0x7f6bf0175ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.405+0000 7f6beeffd640 1 -- 10.20.193.58:0/2353912017 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bdc009570 con 0x7f6bf00b39f0 2026-02-23T06:21:02.402 INFO:tasks.ceph:setting config [mgr] debug_client = 20 2026-02-23T06:21:02.402 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set mgr debug_client 20 2026-02-23T06:21:02.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.406+0000 7f014b043640 1 -- 10.20.193.58:0/799410149 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f014405b980 con 0x7f01440b7050 2026-02-23T06:21:02.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.405+0000 7f5a70b09640 1 -- 10.20.193.58:0/3051861302 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5a6c0b5680 msgr2=0x7f5a6c058b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.405+0000 7f5a70b09640 1 --2- 10.20.193.58:0/3051861302 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5a6c0b5680 0x7f5a6c058b70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.405+0000 7f5a70b09640 1 -- 10.20.193.58:0/3051861302 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5a6c15c040 msgr2=0x7f5a6c1391f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.405+0000 7f5a70b09640 1 --2- 10.20.193.58:0/3051861302 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5a6c15c040 0x7f5a6c1391f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.405+0000 7f5a70b09640 1 -- 10.20.193.58:0/3051861302 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a5c0094b0 con 0x7f5a6c056550 2026-02-23T06:21:02.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.406+0000 7f5a70b09640 1 --2- 10.20.193.58:0/3051861302 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5a6c056550 0x7f5a6c0af7e0 secure :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a5c009960 tx=0x7f5a5c002cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:02.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.407+0000 7f5a617fa640 1 -- 10.20.193.58:0/3051861302 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5a5c0388a0 con 0x7f5a6c056550 2026-02-23T06:21:02.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.407+0000 7f5a71b0b640 1 -- 10.20.193.58:0/3051861302 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a6c0afd20 con 0x7f5a6c056550 2026-02-23T06:21:02.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.407+0000 7f5a71b0b640 1 -- 10.20.193.58:0/3051861302 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a6c0b1320 con 0x7f5a6c056550 2026-02-23T06:21:02.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.405+0000 7f6bee7fc640 1 --2- 10.20.193.58:0/2353912017 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6bf015ba10 0x7f6bf0175ed0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:21:02.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.405+0000 7f6beeffd640 1 --2- 10.20.193.58:0/2353912017 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6bf00b39f0 0x7f6bf015a8a0 secure :-1 s=READY pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6be000dcb0 tx=0x7f6be0008590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:02.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.407+0000 7f6be7fff640 1 -- 10.20.193.58:0/2353912017 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6be00050d0 con 0x7f6bf00b39f0 2026-02-23T06:21:02.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.407+0000 7f6be7fff640 1 -- 10.20.193.58:0/2353912017 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6be0005320 con 0x7f6bf00b39f0 2026-02-23T06:21:02.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.407+0000 7f6be7fff640 1 -- 10.20.193.58:0/2353912017 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6be0003780 con 0x7f6bf00b39f0 2026-02-23T06:21:02.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.407+0000 7f6bf58cc640 1 -- 10.20.193.58:0/2353912017 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bf01729d0 con 0x7f6bf00b39f0 2026-02-23T06:21:02.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.407+0000 7f5a617fa640 1 -- 10.20.193.58:0/3051861302 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a5c038af0 con 0x7f5a6c056550 2026-02-23T06:21:02.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.407+0000 7f5a617fa640 1 -- 10.20.193.58:0/3051861302 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5a5c02fc40 con 0x7f5a6c056550 2026-02-23T06:21:02.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.407+0000 7f5a617fa640 1 -- 10.20.193.58:0/3051861302 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f5a5c04a870 con 0x7f5a6c056550 2026-02-23T06:21:02.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.407+0000 7f5a617fa640 1 -- 10.20.193.58:0/3051861302 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f5a5c040d90 con 0x7f5a6c056550 2026-02-23T06:21:02.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.409+0000 7f6bf58cc640 1 -- 10.20.193.58:0/2353912017 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bf0172f90 con 0x7f6bf00b39f0 2026-02-23T06:21:02.408 INFO:tasks.ceph:setting config [mgr] debug_mgr = 20 2026-02-23T06:21:02.408 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set mgr debug_mgr 20 2026-02-23T06:21:02.408 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.412+0000 7f5a71b0b640 1 -- 10.20.193.58:0/3051861302 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a2c005300 con 0x7f5a6c056550 2026-02-23T06:21:02.408 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.413+0000 7f5a617fa640 1 -- 10.20.193.58:0/3051861302 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f5a5c040420 con 0x7f5a6c056550 2026-02-23T06:21:02.408 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.410+0000 7f6be7fff640 1 -- 10.20.193.58:0/2353912017 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f6be0003cf0 con 0x7f6bf00b39f0 2026-02-23T06:21:02.408 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.410+0000 7f6be7fff640 1 -- 10.20.193.58:0/2353912017 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f6be000f5e0 con 0x7f6bf00b39f0 2026-02-23T06:21:02.409 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.410+0000 7f6bf58cc640 1 -- 10.20.193.58:0/2353912017 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bf00b0d30 con 0x7f6bf00b39f0 2026-02-23T06:21:02.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.418+0000 7f0132ffd640 1 -- 10.20.193.58:0/799410149 <== mon.1 v2:10.20.193.93:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v9)=0 v9) ==== 108+0+0 (secure 0 0 0) 0x7f01400040d0 con 0x7f01440b7050 2026-02-23T06:21:02.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.420+0000 7f014b043640 1 -- 10.20.193.58:0/799410149 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f01440b7050 msgr2=0x7f0144156ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.420+0000 7f014b043640 1 --2- 10.20.193.58:0/799410149 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f01440b7050 0x7f0144156ca0 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f014000ead0 tx=0x7f014000ebd0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.420+0000 7f014b043640 1 -- 10.20.193.58:0/799410149 shutdown_connections 2026-02-23T06:21:02.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.420+0000 7f014b043640 1 --2- 10.20.193.58:0/799410149 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f01441620e0 0x7f014415f7e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.420+0000 7f014b043640 1 --2- 10.20.193.58:0/799410149 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f01440b7050 0x7f0144156ca0 unknown :-1 s=CLOSED pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.420+0000 7f014b043640 1 --2- 10.20.193.58:0/799410149 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f01440b4ad0 0x7f0144138ec0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.420+0000 7f014b043640 1 -- 10.20.193.58:0/799410149 >> 10.20.193.58:0/799410149 conn(0x7f01440b3c20 msgr2=0x7f0144058ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.420+0000 7f014b043640 1 -- 10.20.193.58:0/799410149 shutdown_connections 2026-02-23T06:21:02.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.420+0000 7f014b043640 1 -- 10.20.193.58:0/799410149 wait complete. 2026-02-23T06:21:02.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.418+0000 7f6be7fff640 1 -- 10.20.193.58:0/2353912017 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f6be001e060 con 0x7f6bf00b39f0 2026-02-23T06:21:02.422 INFO:tasks.ceph:setting config [mgr] debug_ms = 1 2026-02-23T06:21:02.422 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set mgr debug_ms 1 2026-02-23T06:21:02.424 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.428+0000 7f7bddc5b640 1 -- 10.20.193.58:0/46748351 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7bd80b4820 msgr2=0x7f7bd80b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.424 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.428+0000 7f7bddc5b640 1 --2- 10.20.193.58:0/46748351 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7bd80b4820 0x7f7bd80b5610 secure :-1 s=READY pgs=16 gs=3 cs=0 l=1 c_cookie=4042563484285217804 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bc0004740 tx=0x7f7bc002f0c0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.424 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.428+0000 7f7bddc5b640 1 -- 10.20.193.58:0/46748351 shutdown_connections 2026-02-23T06:21:02.424 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.428+0000 7f7bddc5b640 1 --2- 10.20.193.58:0/46748351 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7bd80b4820 0x7f7bd80b5610 unknown :-1 s=CLOSED pgs=16 gs=3 cs=0 l=1 c_cookie=4042563484285217804 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.425 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.428+0000 7f7bddc5b640 1 -- 10.20.193.58:0/46748351 >> 10.20.193.58:0/46748351 conn(0x7f7bd8058e50 msgr2=0x7f7bd8059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.425 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.428+0000 7f7bddc5b640 1 -- 10.20.193.58:0/46748351 shutdown_connections 2026-02-23T06:21:02.425 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.429+0000 7f7bddc5b640 1 -- 10.20.193.58:0/46748351 wait complete. 2026-02-23T06:21:02.437 INFO:tasks.ceph:setting config [mgr] mon_warn_on_pool_no_app = False 2026-02-23T06:21:02.437 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set mgr mon_warn_on_pool_no_app False 2026-02-23T06:21:02.438 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.433+0000 7f7bddc5b640 1 Processor -- start 2026-02-23T06:21:02.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.433+0000 7f7bddc5b640 1 -- start start 2026-02-23T06:21:02.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.434+0000 7f7bddc5b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7bd80b4450 0x7f7bd81527a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.434+0000 7f7bddc5b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7bd80b4820 0x7f7bd8167fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.434+0000 7f7bddc5b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7bd8168c20 0x7f7bd8135460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.435+0000 7f7bddc5b640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd815fcb0 con 0x7f7bd80b4450 2026-02-23T06:21:02.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.435+0000 7f7bd6ffd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7bd80b4820 0x7f7bd8167fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.435+0000 7f7bddc5b640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd8168500 con 0x7f7bd8168c20 2026-02-23T06:21:02.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.435+0000 7f7bd7fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7bd8168c20 0x7f7bd8135460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.435+0000 7f7bddc5b640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f7bd8166480 con 0x7f7bd80b4820 2026-02-23T06:21:02.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.435+0000 7f7bd77fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7bd80b4450 0x7f7bd81527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.435+0000 7f7bd77fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7bd80b4450 0x7f7bd81527a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:48502/0 (socket says 10.20.193.58:48502) 2026-02-23T06:21:02.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.435+0000 7f7bd77fe640 1 -- 10.20.193.58:0/613771380 learned_addr learned my addr 10.20.193.58:0/613771380 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:02.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.435+0000 7f7bd6ffd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7bd80b4820 0x7f7bd8167fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:54490/0 (socket says 10.20.193.58:54490) 2026-02-23T06:21:02.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.435+0000 7f7bd7fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7bd8168c20 0x7f7bd8135460 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:55646/0 (socket says 10.20.193.58:55646) 2026-02-23T06:21:02.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.438+0000 7f7bd77fe640 1 -- 10.20.193.58:0/613771380 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7bd80b4820 msgr2=0x7f7bd8167fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.438+0000 7f7bd77fe640 1 --2- 10.20.193.58:0/613771380 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7bd80b4820 0x7f7bd8167fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.438+0000 7f7bd77fe640 1 -- 10.20.193.58:0/613771380 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7bd8168c20 msgr2=0x7f7bd8135460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.438+0000 7f7bd77fe640 1 --2- 10.20.193.58:0/613771380 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7bd8168c20 0x7f7bd8135460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.438+0000 7f7bd77fe640 1 -- 10.20.193.58:0/613771380 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bc00094b0 con 0x7f7bd80b4450 2026-02-23T06:21:02.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.438+0000 7f7bd6ffd640 1 --2- 10.20.193.58:0/613771380 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7bd80b4820 0x7f7bd8167fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:21:02.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.438+0000 7f7bd7fff640 1 --2- 10.20.193.58:0/613771380 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7bd8168c20 0x7f7bd8135460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:21:02.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.440+0000 7f7bd77fe640 1 --2- 10.20.193.58:0/613771380 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7bd80b4450 0x7f7bd81527a0 secure :-1 s=READY pgs=18 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bd0008fd0 tx=0x7f7bd000dba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:02.441 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.441+0000 7f226023e640 1 -- 10.20.193.58:0/117746351 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f22580bc4f0 msgr2=0x7f22580bac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.441 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.441+0000 7f226023e640 1 --2- 10.20.193.58:0/117746351 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f22580bc4f0 0x7f22580bac30 secure :-1 s=READY pgs=17 gs=3 cs=0 l=1 c_cookie=1572398008555030590 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22580bfaf0 tx=0x7f224802f160 comp rx=0 tx=0).stop 2026-02-23T06:21:02.441 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.441+0000 7f226023e640 1 -- 10.20.193.58:0/117746351 shutdown_connections 2026-02-23T06:21:02.441 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.441+0000 7f226023e640 1 --2- 10.20.193.58:0/117746351 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f22580bc4f0 0x7f22580bac30 unknown :-1 s=CLOSED pgs=17 gs=3 cs=0 l=1 c_cookie=1572398008555030590 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.441 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.441+0000 7f226023e640 1 -- 10.20.193.58:0/117746351 >> 10.20.193.58:0/117746351 conn(0x7f2258054a90 msgr2=0x7f2258058e70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.441 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.441+0000 7f226023e640 1 -- 10.20.193.58:0/117746351 shutdown_connections 2026-02-23T06:21:02.441 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.441+0000 7f226023e640 1 -- 10.20.193.58:0/117746351 wait complete. 2026-02-23T06:21:02.442 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.438+0000 7f7b75714640 1 -- 10.20.193.58:0/1032156222 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7b54003b50 msgr2=0x7f7b54003f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.442 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.438+0000 7f7b75714640 1 --2- 10.20.193.58:0/1032156222 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7b54003b50 0x7f7b54003f20 secure :-1 s=READY pgs=17 gs=4 cs=0 l=1 c_cookie=1561317432354489335 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b64007fd0 tx=0x7f7b640300f0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.442 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.438+0000 7f7b74f13640 1 -- 10.20.193.58:0/1032156222 reap_dead start 2026-02-23T06:21:02.442 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.439+0000 7f7b74f13640 1 -- 10.20.193.58:0/1032156222 reap_dead start 2026-02-23T06:21:02.442 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.439+0000 7f7b75714640 1 -- 10.20.193.58:0/1032156222 shutdown_connections 2026-02-23T06:21:02.442 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.439+0000 7f7b75714640 1 -- 10.20.193.58:0/1032156222 >> 10.20.193.58:0/1032156222 conn(0x7f7b700b3c20 msgr2=0x7f7b700b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.442 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.439+0000 7f7b75714640 1 -- 10.20.193.58:0/1032156222 shutdown_connections 2026-02-23T06:21:02.442 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.439+0000 7f7b75714640 1 -- 10.20.193.58:0/1032156222 wait complete. 2026-02-23T06:21:02.442 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.440+0000 7f7b75714640 1 Processor -- start 2026-02-23T06:21:02.442 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.440+0000 7f7b75714640 1 -- start start 2026-02-23T06:21:02.442 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.441+0000 7f7b75714640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7b700b0010 0x7f7b7015ded0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.442 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.442+0000 7f7b75714640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b700b03e0 0x7f7b70137ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.443 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.442+0000 7f7b75714640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7b701380e0 0x7f7b7015be60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.443 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.442+0000 7f7b75714640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7015ea40 con 0x7f7b700b03e0 2026-02-23T06:21:02.443 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.442+0000 7f7b75714640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7015e620 con 0x7f7b700b0010 2026-02-23T06:21:02.443 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.442+0000 7f7b75714640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f7b70139ff0 con 0x7f7b701380e0 2026-02-23T06:21:02.443 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.442+0000 7f7b6ffff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7b700b0010 0x7f7b7015ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.443 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.442+0000 7f7b6ffff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7b700b0010 0x7f7b7015ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:55672/0 (socket says 10.20.193.58:55672) 2026-02-23T06:21:02.443 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.442+0000 7f7b6ffff640 1 -- 10.20.193.58:0/838981034 learned_addr learned my addr 10.20.193.58:0/838981034 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:02.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.442+0000 7f7b74f13640 1 --2- 10.20.193.58:0/838981034 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7b701380e0 0x7f7b7015be60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.442+0000 7f7b6ffff640 1 -- 10.20.193.58:0/838981034 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7b701380e0 msgr2=0x7f7b7015be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.442+0000 7f7b6ffff640 1 --2- 10.20.193.58:0/838981034 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7b701380e0 0x7f7b7015be60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.442+0000 7f7b6ffff640 1 -- 10.20.193.58:0/838981034 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b700b03e0 msgr2=0x7f7b70137ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.442+0000 7f7b6ffff640 1 --2- 10.20.193.58:0/838981034 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b700b03e0 0x7f7b70137ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.442+0000 7f7b6ffff640 1 -- 10.20.193.58:0/838981034 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b700ae6f0 con 0x7f7b700b0010 2026-02-23T06:21:02.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.440+0000 7f7bb7fff640 1 -- 10.20.193.58:0/613771380 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bd0007b90 con 0x7f7bd80b4450 2026-02-23T06:21:02.445 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.443+0000 7f226023e640 1 Processor -- start 2026-02-23T06:21:02.445 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.443+0000 7f226023e640 1 -- start start 2026-02-23T06:21:02.446 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.443+0000 7f7bb7fff640 1 -- 10.20.193.58:0/613771380 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7bd0007de0 con 0x7f7bd80b4450 2026-02-23T06:21:02.446 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.443+0000 7f7bb7fff640 1 -- 10.20.193.58:0/613771380 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bd00052b0 con 0x7f7bd80b4450 2026-02-23T06:21:02.446 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.443+0000 7f7bddc5b640 1 -- 10.20.193.58:0/613771380 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd8116c40 con 0x7f7bd80b4450 2026-02-23T06:21:02.446 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.443+0000 7f7bddc5b640 1 -- 10.20.193.58:0/613771380 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd8117200 con 0x7f7bd80b4450 2026-02-23T06:21:02.446 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.444+0000 7f7b6ffff640 1 --2- 10.20.193.58:0/838981034 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7b700b0010 0x7f7b7015ded0 secure :-1 s=READY pgs=27 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b64005030 tx=0x7f7b64007cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:02.447 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.446+0000 7fb69d247640 1 -- 10.20.193.58:0/2293080373 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fb660005950 con 0x7fb69815ba10 2026-02-23T06:21:02.447 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.445+0000 7f7bddc5b640 1 -- 10.20.193.58:0/613771380 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bd80b5610 con 0x7f7bd80b4450 2026-02-23T06:21:02.447 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.447+0000 7f7bb7fff640 1 -- 10.20.193.58:0/613771380 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f7bd0005410 con 0x7f7bd80b4450 2026-02-23T06:21:02.447 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.447+0000 7f7bb7fff640 1 -- 10.20.193.58:0/613771380 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f7bd0008010 con 0x7f7bd80b4450 2026-02-23T06:21:02.447 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.444+0000 7f226023e640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f22580bbfa0 0x7f22581614e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.448 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.444+0000 7f226023e640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f22580bc4f0 0x7f225813dfd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.448 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.444+0000 7f226023e640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2258163950 0x7f2258141620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.448 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.444+0000 7f226023e640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f2258140930 con 0x7f22580bc4f0 2026-02-23T06:21:02.448 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.444+0000 7f226023e640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f2258206020 con 0x7f2258163950 2026-02-23T06:21:02.448 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.444+0000 7f226023e640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f225813ff90 con 0x7f22580bbfa0 2026-02-23T06:21:02.448 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.444+0000 7f225d7b2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f22580bc4f0 0x7f225813dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.448 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.444+0000 7f225d7b2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f22580bc4f0 0x7f225813dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:48534/0 (socket says 10.20.193.58:48534) 2026-02-23T06:21:02.448 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.444+0000 7f225d7b2640 1 -- 10.20.193.58:0/1565599656 learned_addr learned my addr 10.20.193.58:0/1565599656 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:02.448 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.444+0000 7f225e7b4640 1 --2- 10.20.193.58:0/1565599656 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2258163950 0x7f2258141620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.448 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.447+0000 7f225d7b2640 1 -- 10.20.193.58:0/1565599656 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f22580bbfa0 msgr2=0x7f22581614e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.448 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.445+0000 7f225dfb3640 1 --2- 10.20.193.58:0/1565599656 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f22580bbfa0 0x7f22581614e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.449 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.447+0000 7f225d7b2640 1 --2- 10.20.193.58:0/1565599656 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f22580bbfa0 0x7f22581614e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.449 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.447+0000 7f225d7b2640 1 -- 10.20.193.58:0/1565599656 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2258163950 msgr2=0x7f2258141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.449 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.447+0000 7f225d7b2640 1 --2- 10.20.193.58:0/1565599656 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2258163950 0x7f2258141620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.449 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.447+0000 7f225d7b2640 1 -- 10.20.193.58:0/1565599656 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22480094b0 con 0x7f22580bc4f0 2026-02-23T06:21:02.449 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.447+0000 7f225dfb3640 1 --2- 10.20.193.58:0/1565599656 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f22580bbfa0 0x7f22581614e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:21:02.449 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.448+0000 7f225e7b4640 1 --2- 10.20.193.58:0/1565599656 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2258163950 0x7f2258141620 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:21:02.449 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.449+0000 7f225d7b2640 1 --2- 10.20.193.58:0/1565599656 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f22580bc4f0 0x7f225813dfd0 secure :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22580bddb0 tx=0x7f22480029a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:02.449 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.444+0000 7f7b6cff9640 1 -- 10.20.193.58:0/838981034 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7b640058c0 con 0x7f7b700b0010 2026-02-23T06:21:02.449 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.445+0000 7f7b75714640 1 -- 10.20.193.58:0/838981034 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b7015cf10 con 0x7f7b700b0010 2026-02-23T06:21:02.449 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.445+0000 7f7b75714640 1 -- 10.20.193.58:0/838981034 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b7015ee60 con 0x7f7b700b0010 2026-02-23T06:21:02.450 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.446+0000 7f7b6cff9640 1 -- 10.20.193.58:0/838981034 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b64005b10 con 0x7f7b700b0010 2026-02-23T06:21:02.450 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.446+0000 7f7b6cff9640 1 -- 10.20.193.58:0/838981034 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7b640058c0 con 0x7f7b700b0010 2026-02-23T06:21:02.450 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.448+0000 7f7b527fc640 1 -- 10.20.193.58:0/838981034 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b7013d590 con 0x7f7b700b0010 2026-02-23T06:21:02.450 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.448+0000 7f7b6cff9640 1 -- 10.20.193.58:0/838981034 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f7b64054060 con 0x7f7b700b0010 2026-02-23T06:21:02.450 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.449+0000 7f7b6cff9640 1 -- 10.20.193.58:0/838981034 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f7b6404d830 con 0x7f7b700b0010 2026-02-23T06:21:02.450 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.450+0000 7f7bb7fff640 1 -- 10.20.193.58:0/613771380 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f7bd0017070 con 0x7f7bd80b4450 2026-02-23T06:21:02.451 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.456+0000 7f22467fc640 1 -- 10.20.193.58:0/1565599656 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f224803c040 con 0x7f22580bc4f0 2026-02-23T06:21:02.451 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.456+0000 7f22467fc640 1 -- 10.20.193.58:0/1565599656 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f22480386b0 con 0x7f22580bc4f0 2026-02-23T06:21:02.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.456+0000 7f226023e640 1 -- 10.20.193.58:0/1565599656 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2258140270 con 0x7f22580bc4f0 2026-02-23T06:21:02.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.456+0000 7f22467fc640 1 -- 10.20.193.58:0/1565599656 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2248038ae0 con 0x7f22580bc4f0 2026-02-23T06:21:02.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.456+0000 7f226023e640 1 -- 10.20.193.58:0/1565599656 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f225805b360 con 0x7f22580bc4f0 2026-02-23T06:21:02.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.457+0000 7f22467fc640 1 -- 10.20.193.58:0/1565599656 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f2248038c40 con 0x7f22580bc4f0 2026-02-23T06:21:02.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.457+0000 7f22467fc640 1 -- 10.20.193.58:0/1565599656 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f2248042ba0 con 0x7f22580bc4f0 2026-02-23T06:21:02.458 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2026-02-23T06:21:02.458 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2026-02-23T06:21:02.459 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.459+0000 7fb6777fe640 1 -- 10.20.193.58:0/2293080373 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v10)=0 v10) ==== 106+0+0 (secure 0 0 0) 0x7fb68c00fde0 con 0x7fb69815ba10 2026-02-23T06:21:02.459 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.458+0000 7f226023e640 1 -- 10.20.193.58:0/1565599656 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22580bac30 con 0x7f22580bc4f0 2026-02-23T06:21:02.459 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.459+0000 7f22467fc640 1 -- 10.20.193.58:0/1565599656 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f2248042410 con 0x7f22580bc4f0 2026-02-23T06:21:02.460 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.458+0000 7f7b6cff9640 1 -- 10.20.193.58:0/838981034 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f7b64030e60 con 0x7f7b700b0010 2026-02-23T06:21:02.460 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.464+0000 7fb69d247640 1 -- 10.20.193.58:0/2293080373 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb69815ba10 msgr2=0x7fb698159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.460 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.464+0000 7fb69d247640 1 --2- 10.20.193.58:0/2293080373 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb69815ba10 0x7fb698159270 secure :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb68c00b520 tx=0x7fb68c00b9f0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.460 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.464+0000 7fb69d247640 1 -- 10.20.193.58:0/2293080373 shutdown_connections 2026-02-23T06:21:02.460 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.464+0000 7fb69d247640 1 --2- 10.20.193.58:0/2293080373 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb69815bde0 0x7fb69811d230 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.460 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.464+0000 7fb69d247640 1 --2- 10.20.193.58:0/2293080373 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb69815ba10 0x7fb698159270 unknown :-1 s=CLOSED pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.461 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.464+0000 7fb69d247640 1 --2- 10.20.193.58:0/2293080373 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb6980b39f0 0x7fb698121d10 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.461 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.464+0000 7fb69d247640 1 -- 10.20.193.58:0/2293080373 >> 10.20.193.58:0/2293080373 conn(0x7fb698058e50 msgr2=0x7fb698164600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.461 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.464+0000 7fb69d247640 1 -- 10.20.193.58:0/2293080373 shutdown_connections 2026-02-23T06:21:02.461 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.464+0000 7fb69d247640 1 -- 10.20.193.58:0/2293080373 wait complete. 2026-02-23T06:21:02.484 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2026-02-23T06:21:02.484 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2026-02-23T06:21:02.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.485+0000 7f5a71b0b640 1 -- 10.20.193.58:0/3051861302 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f5a2c005950 con 0x7f5a6c056550 2026-02-23T06:21:02.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.485+0000 7f6bf58cc640 1 -- 10.20.193.58:0/2353912017 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f6bf00b7590 con 0x7f6bf00b39f0 2026-02-23T06:21:02.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.488+0000 7f6be7fff640 1 -- 10.20.193.58:0/2353912017 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v11)=0 v11) ==== 116+0+0 (secure 0 0 0) 0x7f6be001e060 con 0x7f6bf00b39f0 2026-02-23T06:21:02.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.490+0000 7f6be5ffb640 1 -- 10.20.193.58:0/2353912017 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6bf00b39f0 msgr2=0x7f6bf015a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.490+0000 7f6be5ffb640 1 --2- 10.20.193.58:0/2353912017 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6bf00b39f0 0x7f6bf015a8a0 secure :-1 s=READY pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6be000dcb0 tx=0x7f6be0008590 comp rx=0 tx=0).stop 2026-02-23T06:21:02.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.490+0000 7f6be5ffb640 1 -- 10.20.193.58:0/2353912017 shutdown_connections 2026-02-23T06:21:02.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.490+0000 7f6be5ffb640 1 --2- 10.20.193.58:0/2353912017 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6bf015bde0 0x7f6bf0176410 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.490+0000 7f6be5ffb640 1 --2- 10.20.193.58:0/2353912017 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6bf015ba10 0x7f6bf0175ed0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.487 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.490+0000 7f6be5ffb640 1 --2- 10.20.193.58:0/2353912017 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6bf00b39f0 0x7f6bf015a8a0 unknown :-1 s=CLOSED pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.487 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.490+0000 7f6be5ffb640 1 -- 10.20.193.58:0/2353912017 >> 10.20.193.58:0/2353912017 conn(0x7f6bf0058e50 msgr2=0x7f6bf0162e10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.487 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.490+0000 7f6be5ffb640 1 -- 10.20.193.58:0/2353912017 shutdown_connections 2026-02-23T06:21:02.487 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.490+0000 7f6be5ffb640 1 -- 10.20.193.58:0/2353912017 wait complete. 2026-02-23T06:21:02.487 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.493+0000 7f5a617fa640 1 -- 10.20.193.58:0/3051861302 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v12)=0 v12) ==== 116+0+0 (secure 0 0 0) 0x7f5a5c0405c0 con 0x7f5a6c056550 2026-02-23T06:21:02.492 DEBUG:tasks.ceph:set 27 configs 2026-02-23T06:21:02.492 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='trial058') 2026-02-23T06:21:02.493 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='trial058') 2026-02-23T06:21:02.493 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='trial058') 2026-02-23T06:21:02.493 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial058') 2026-02-23T06:21:02.493 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial058') 2026-02-23T06:21:02.493 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='trial058') 2026-02-23T06:21:02.493 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='trial058') 2026-02-23T06:21:02.494 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='trial058') 2026-02-23T06:21:02.494 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='trial058') 2026-02-23T06:21:02.494 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='trial058') 2026-02-23T06:21:02.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.495+0000 7f5a71b0b640 1 -- 10.20.193.58:0/3051861302 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5a6c056550 msgr2=0x7f5a6c0af7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.495+0000 7f5a71b0b640 1 --2- 10.20.193.58:0/3051861302 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5a6c056550 0x7f5a6c0af7e0 secure :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a5c009960 tx=0x7f5a5c002cc0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.498 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.503+0000 7f5a71b0b640 1 -- 10.20.193.58:0/3051861302 shutdown_connections 2026-02-23T06:21:02.498 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.503+0000 7f5a71b0b640 1 --2- 10.20.193.58:0/3051861302 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5a6c15c040 0x7f5a6c1391f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.503+0000 7f5a71b0b640 1 --2- 10.20.193.58:0/3051861302 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5a6c0b5680 0x7f5a6c058b70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.503+0000 7f5a71b0b640 1 --2- 10.20.193.58:0/3051861302 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5a6c056550 0x7f5a6c0af7e0 unknown :-1 s=CLOSED pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.503+0000 7f5a71b0b640 1 -- 10.20.193.58:0/3051861302 >> 10.20.193.58:0/3051861302 conn(0x7f5a6c0b3c20 msgr2=0x7f5a6c05d190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.503+0000 7f5a71b0b640 1 -- 10.20.193.58:0/3051861302 shutdown_connections 2026-02-23T06:21:02.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.503+0000 7f5a71b0b640 1 -- 10.20.193.58:0/3051861302 wait complete. 2026-02-23T06:21:02.501 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='trial058') 2026-02-23T06:21:02.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.507+0000 7f4b39ffe640 1 -- 10.20.193.58:0/649160289 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4b340b3e70 msgr2=0x7f4b340b46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.507+0000 7f4b39ffe640 1 --2- 10.20.193.58:0/649160289 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4b340b3e70 0x7f4b340b46c0 secure :-1 s=READY pgs=28 gs=3 cs=0 l=1 c_cookie=8470917408356340601 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4b340586a0 tx=0x7f4b1c02f1d0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.510+0000 7f4b39ffe640 1 -- 10.20.193.58:0/649160289 shutdown_connections 2026-02-23T06:21:02.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.510+0000 7f4b39ffe640 1 --2- 10.20.193.58:0/649160289 >> v2:10.20.193.58:3300/0 conn(0x7f4b340b1770 0x7f4b340b4c00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.510+0000 7f4b39ffe640 1 --2- 10.20.193.58:0/649160289 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4b340b3e70 0x7f4b340b46c0 unknown :-1 s=CLOSED pgs=28 gs=3 cs=0 l=1 c_cookie=8470917408356340601 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.510+0000 7f4b39ffe640 1 -- 10.20.193.58:0/649160289 >> 10.20.193.58:0/649160289 conn(0x7f4b34058e50 msgr2=0x7f4b34059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.510+0000 7f4b39ffe640 1 -- 10.20.193.58:0/649160289 shutdown_connections 2026-02-23T06:21:02.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.510+0000 7f4b39ffe640 1 -- 10.20.193.58:0/649160289 wait complete. 2026-02-23T06:21:02.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.511+0000 7f4b39ffe640 1 Processor -- start 2026-02-23T06:21:02.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.511+0000 7f4b39ffe640 1 -- start start 2026-02-23T06:21:02.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.512+0000 7f4b39ffe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4b340b1770 0x7f4b340b5840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.512+0000 7f4b39ffe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4b340b3e70 0x7f4b34162cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.513+0000 7f4b39ffe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4b3415b4c0 0x7f4b34163210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.513+0000 7f4b39ffe640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3413e530 con 0x7f4b340b1770 2026-02-23T06:21:02.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.513+0000 7f4b39ffe640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f4b34139e20 con 0x7f4b340b3e70 2026-02-23T06:21:02.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.513+0000 7f4b39ffe640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f4b34139b40 con 0x7f4b3415b4c0 2026-02-23T06:21:02.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.513+0000 7f4b32ffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4b340b3e70 0x7f4b34162cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.513+0000 7f4b32ffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4b340b3e70 0x7f4b34162cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:55690/0 (socket says 10.20.193.58:55690) 2026-02-23T06:21:02.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.513+0000 7f4b32ffd640 1 -- 10.20.193.58:0/3372538383 learned_addr learned my addr 10.20.193.58:0/3372538383 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:02.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.513+0000 7f4b33fff640 1 --2- 10.20.193.58:0/3372538383 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4b3415b4c0 0x7f4b34163210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.513+0000 7f4b32ffd640 1 -- 10.20.193.58:0/3372538383 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4b3415b4c0 msgr2=0x7f4b34163210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.513+0000 7f4b32ffd640 1 --2- 10.20.193.58:0/3372538383 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4b3415b4c0 0x7f4b34163210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.513+0000 7f4b32ffd640 1 -- 10.20.193.58:0/3372538383 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4b340b1770 msgr2=0x7f4b340b5840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:21:02.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.513+0000 7f4b32ffd640 1 --2- 10.20.193.58:0/3372538383 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4b340b1770 0x7f4b340b5840 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.513+0000 7f4b32ffd640 1 -- 10.20.193.58:0/3372538383 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b1c0094b0 con 0x7f4b340b3e70 2026-02-23T06:21:02.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.515+0000 7f4b32ffd640 1 --2- 10.20.193.58:0/3372538383 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4b340b3e70 0x7f4b34162cd0 secure :-1 s=READY pgs=29 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4b1c0023d0 tx=0x7f4b1c002a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:02.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.515+0000 7f4b2bfff640 1 -- 10.20.193.58:0/3372538383 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4b1c03c040 con 0x7f4b340b3e70 2026-02-23T06:21:02.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.515+0000 7f4b2bfff640 1 -- 10.20.193.58:0/3372538383 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b1c038690 con 0x7f4b340b3e70 2026-02-23T06:21:02.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.515+0000 7f4b2bfff640 1 -- 10.20.193.58:0/3372538383 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4b1c038a80 con 0x7f4b340b3e70 2026-02-23T06:21:02.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.515+0000 7f4b39ffe640 1 -- 10.20.193.58:0/3372538383 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b3413c7e0 con 0x7f4b340b3e70 2026-02-23T06:21:02.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.515+0000 7f4b39ffe640 1 -- 10.20.193.58:0/3372538383 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b3413cda0 con 0x7f4b340b3e70 2026-02-23T06:21:02.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.515+0000 7f4b2bfff640 1 -- 10.20.193.58:0/3372538383 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f4b1c049410 con 0x7f4b340b3e70 2026-02-23T06:21:02.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.516+0000 7f4b2bfff640 1 -- 10.20.193.58:0/3372538383 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f4b1c002e40 con 0x7f4b340b3e70 2026-02-23T06:21:02.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.516+0000 7f4b39ffe640 1 -- 10.20.193.58:0/3372538383 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b340af310 con 0x7f4b340b3e70 2026-02-23T06:21:02.516 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.521+0000 7f4b2bfff640 1 -- 10.20.193.58:0/3372538383 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f4b1c044020 con 0x7f4b340b3e70 2026-02-23T06:21:02.525 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='trial058') 2026-02-23T06:21:02.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.549+0000 7f226023e640 1 -- 10.20.193.58:0/1565599656 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f2258058fc0 con 0x7f22580bc4f0 2026-02-23T06:21:02.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.554+0000 7f1067ccc640 1 -- 10.20.193.58:0/1804265308 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1060163bb0 msgr2=0x7f106016d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.554+0000 7f1067ccc640 1 --2- 10.20.193.58:0/1804265308 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1060163bb0 0x7f106016d8d0 secure :-1 s=READY pgs=21 gs=2 cs=0 l=1 c_cookie=2871541621247244309 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f105c006f50 tx=0x7f105c030360 comp rx=0 tx=0).stop 2026-02-23T06:21:02.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.554+0000 7f1067ccc640 1 -- 10.20.193.58:0/1804265308 shutdown_connections 2026-02-23T06:21:02.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.554+0000 7f1067ccc640 1 --2- 10.20.193.58:0/1804265308 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f10600a1d60 0x7f10600b8720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.554+0000 7f1067ccc640 1 --2- 10.20.193.58:0/1804265308 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1060163bb0 0x7f106016d8d0 unknown :-1 s=CLOSED pgs=21 gs=2 cs=0 l=1 c_cookie=2871541621247244309 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.554+0000 7f1067ccc640 1 -- 10.20.193.58:0/1804265308 >> 10.20.193.58:0/1804265308 conn(0x7f10600b9c30 msgr2=0x7f1060057cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.554+0000 7f1067ccc640 1 -- 10.20.193.58:0/1804265308 shutdown_connections 2026-02-23T06:21:02.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.554+0000 7f1067ccc640 1 -- 10.20.193.58:0/1804265308 wait complete. 2026-02-23T06:21:02.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.553+0000 7f22467fc640 1 -- 10.20.193.58:0/1565599656 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v13)=0 v13) ==== 115+0+0 (secure 0 0 0) 0x7f2248042d60 con 0x7f22580bc4f0 2026-02-23T06:21:02.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.556+0000 7f1067ccc640 1 Processor -- start 2026-02-23T06:21:02.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.556+0000 7f1067ccc640 1 -- start start 2026-02-23T06:21:02.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.556+0000 7f1067ccc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f10600a1d60 0x7f1060125460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.557+0000 7f1067ccc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1060163bb0 0x7f1060150f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.557+0000 7f1067ccc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1060169960 0x7f1060143fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.557+0000 7f226023e640 1 -- 10.20.193.58:0/1565599656 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f22580bc4f0 msgr2=0x7f225813dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.557+0000 7f226023e640 1 --2- 10.20.193.58:0/1565599656 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f22580bc4f0 0x7f225813dfd0 secure :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22580bddb0 tx=0x7f22480029a0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.557+0000 7f1067ccc640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f1060154d10 con 0x7f10600a1d60 2026-02-23T06:21:02.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.557+0000 7f1067ccc640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f1060128d20 con 0x7f1060169960 2026-02-23T06:21:02.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.557+0000 7f1067ccc640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f1060126260 con 0x7f1060163bb0 2026-02-23T06:21:02.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.557+0000 7f1065a41640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f10600a1d60 0x7f1060125460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.557+0000 7f1065240640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1060163bb0 0x7f1060150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.557+0000 7f1065240640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1060163bb0 0x7f1060150f50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:54534/0 (socket says 10.20.193.58:54534) 2026-02-23T06:21:02.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.557+0000 7f1065240640 1 -- 10.20.193.58:0/3861575795 learned_addr learned my addr 10.20.193.58:0/3861575795 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:02.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.557+0000 7f1066242640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1060169960 0x7f1060143fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.557+0000 7f1065240640 1 -- 10.20.193.58:0/3861575795 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1060169960 msgr2=0x7f1060143fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.557+0000 7f226023e640 1 -- 10.20.193.58:0/1565599656 shutdown_connections 2026-02-23T06:21:02.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.557+0000 7f226023e640 1 --2- 10.20.193.58:0/1565599656 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2258163950 0x7f2258141620 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.557+0000 7f226023e640 1 --2- 10.20.193.58:0/1565599656 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f22580bc4f0 0x7f225813dfd0 unknown :-1 s=CLOSED pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.558+0000 7f226023e640 1 --2- 10.20.193.58:0/1565599656 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f22580bbfa0 0x7f22581614e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.558+0000 7f226023e640 1 -- 10.20.193.58:0/1565599656 >> 10.20.193.58:0/1565599656 conn(0x7f2258054a90 msgr2=0x7f2258167d20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.558+0000 7f226023e640 1 -- 10.20.193.58:0/1565599656 shutdown_connections 2026-02-23T06:21:02.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.557+0000 7f1065240640 1 --2- 10.20.193.58:0/3861575795 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1060169960 0x7f1060143fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.557+0000 7f1065240640 1 -- 10.20.193.58:0/3861575795 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f10600a1d60 msgr2=0x7f1060125460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.557+0000 7f1065240640 1 --2- 10.20.193.58:0/3861575795 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f10600a1d60 0x7f1060125460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.557+0000 7f1065240640 1 -- 10.20.193.58:0/3861575795 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f105c00a650 con 0x7f1060163bb0 2026-02-23T06:21:02.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.557+0000 7f1065a41640 1 --2- 10.20.193.58:0/3861575795 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f10600a1d60 0x7f1060125460 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:02.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.558+0000 7f1065240640 1 --2- 10.20.193.58:0/3861575795 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1060163bb0 0x7f1060150f50 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f105000e790 tx=0x7f105000ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:02.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.558+0000 7f226023e640 1 -- 10.20.193.58:0/1565599656 wait complete. 2026-02-23T06:21:02.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.558+0000 7f104e7fc640 1 -- 10.20.193.58:0/3861575795 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f105000cce0 con 0x7f1060163bb0 2026-02-23T06:21:02.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.558+0000 7f104e7fc640 1 -- 10.20.193.58:0/3861575795 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f105000ce40 con 0x7f1060163bb0 2026-02-23T06:21:02.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.558+0000 7f104e7fc640 1 -- 10.20.193.58:0/3861575795 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f10500042b0 con 0x7f1060163bb0 2026-02-23T06:21:02.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.558+0000 7f1067ccc640 1 -- 10.20.193.58:0/3861575795 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1060154790 con 0x7f1060163bb0 2026-02-23T06:21:02.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.558+0000 7f1067ccc640 1 -- 10.20.193.58:0/3861575795 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1060154a30 con 0x7f1060163bb0 2026-02-23T06:21:02.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.561+0000 7f104e7fc640 1 -- 10.20.193.58:0/3861575795 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f105001f060 con 0x7f1060163bb0 2026-02-23T06:21:02.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.561+0000 7f104e7fc640 1 -- 10.20.193.58:0/3861575795 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f1050014070 con 0x7f1060163bb0 2026-02-23T06:21:02.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.562+0000 7f1067ccc640 1 -- 10.20.193.58:0/3861575795 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f102c005300 con 0x7f1060163bb0 2026-02-23T06:21:02.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.563+0000 7f104e7fc640 1 -- 10.20.193.58:0/3861575795 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f1050004410 con 0x7f1060163bb0 2026-02-23T06:21:02.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.588+0000 7f7b527fc640 1 -- 10.20.193.58:0/838981034 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f7b70164580 con 0x7f7b700b0010 2026-02-23T06:21:02.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.600+0000 7f7b6cff9640 1 -- 10.20.193.58:0/838981034 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f7b64004b60 con 0x7f7b700b0010 2026-02-23T06:21:02.596 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.600+0000 7f55e1b0c640 1 -- 10.20.193.58:0/1193933969 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f55d404f470 msgr2=0x7f55d40e26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.596 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.600+0000 7f55e1b0c640 1 --2- 10.20.193.58:0/1193933969 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f55d404f470 0x7f55d40e26d0 secure :-1 s=READY pgs=31 gs=2 cs=0 l=1 c_cookie=16423466681944867422 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55d404a3e0 tx=0x7f55d0030300 comp rx=0 tx=0).stop 2026-02-23T06:21:02.596 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.601+0000 7f55e1b0c640 1 -- 10.20.193.58:0/1193933969 shutdown_connections 2026-02-23T06:21:02.597 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.601+0000 7f55e1b0c640 1 --2- 10.20.193.58:0/1193933969 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f55d404f470 0x7f55d40e26d0 unknown :-1 s=CLOSED pgs=31 gs=2 cs=0 l=1 c_cookie=16423466681944867422 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.597 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.601+0000 7f55e1b0c640 1 --2- 10.20.193.58:0/1193933969 >> v2:10.20.193.58:3300/0 conn(0x7f55d4044eb0 0x7f55d404a780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.597 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.601+0000 7f55e1b0c640 1 -- 10.20.193.58:0/1193933969 >> 10.20.193.58:0/1193933969 conn(0x7f55d400a260 msgr2=0x7f55d400ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.597 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.601+0000 7f55e1b0c640 1 -- 10.20.193.58:0/1193933969 shutdown_connections 2026-02-23T06:21:02.597 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.601+0000 7f55e1b0c640 1 -- 10.20.193.58:0/1193933969 wait complete. 2026-02-23T06:21:02.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.601+0000 7f7b527fc640 1 -- 10.20.193.58:0/838981034 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7b700b0010 msgr2=0x7f7b7015ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.601+0000 7f7b527fc640 1 --2- 10.20.193.58:0/838981034 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7b700b0010 0x7f7b7015ded0 secure :-1 s=READY pgs=27 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b64005030 tx=0x7f7b64007cc0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.601+0000 7f7b527fc640 1 -- 10.20.193.58:0/838981034 shutdown_connections 2026-02-23T06:21:02.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.601+0000 7f7b527fc640 1 --2- 10.20.193.58:0/838981034 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7b701380e0 0x7f7b7015be60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.601+0000 7f7b527fc640 1 --2- 10.20.193.58:0/838981034 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b700b03e0 0x7f7b70137ba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.601+0000 7f7b527fc640 1 --2- 10.20.193.58:0/838981034 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7b700b0010 0x7f7b7015ded0 unknown :-1 s=CLOSED pgs=27 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.601+0000 7f7b527fc640 1 -- 10.20.193.58:0/838981034 >> 10.20.193.58:0/838981034 conn(0x7f7b700b3c20 msgr2=0x7f7b7013c930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.601+0000 7f7b527fc640 1 -- 10.20.193.58:0/838981034 shutdown_connections 2026-02-23T06:21:02.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.601+0000 7f7b527fc640 1 -- 10.20.193.58:0/838981034 wait complete. 2026-02-23T06:21:02.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.602+0000 7f55e1b0c640 1 Processor -- start 2026-02-23T06:21:02.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.602+0000 7f55e1b0c640 1 -- start start 2026-02-23T06:21:02.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.603+0000 7f55e1b0c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f55d4044eb0 0x7f55d40c7910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.604+0000 7f55e1b0c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f55d4045280 0x7f55d40c7e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.604+0000 7f55e1b0c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f55d404f470 0x7f55d40bffa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.604+0000 7f55e1b0c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f55d40c9d90 con 0x7f55d4044eb0 2026-02-23T06:21:02.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.604+0000 7f55e1b0c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f55d40cabf0 con 0x7f55d4045280 2026-02-23T06:21:02.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.604+0000 7f55e1b0c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f55d40bf1b0 con 0x7f55d404f470 2026-02-23T06:21:02.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.604+0000 7f55db7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f55d4044eb0 0x7f55d40c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.604+0000 7f55db7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f55d4044eb0 0x7f55d40c7910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:48572/0 (socket says 10.20.193.58:48572) 2026-02-23T06:21:02.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.604+0000 7f55db7fe640 1 -- 10.20.193.58:0/1224569251 learned_addr learned my addr 10.20.193.58:0/1224569251 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:02.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.604+0000 7f55daffd640 1 --2- 10.20.193.58:0/1224569251 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f55d4045280 0x7f55d40c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.604+0000 7f55dbfff640 1 --2- 10.20.193.58:0/1224569251 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f55d404f470 0x7f55d40bffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.604+0000 7f55db7fe640 1 -- 10.20.193.58:0/1224569251 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f55d404f470 msgr2=0x7f55d40bffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.604+0000 7f55db7fe640 1 --2- 10.20.193.58:0/1224569251 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f55d404f470 0x7f55d40bffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.604+0000 7f55db7fe640 1 -- 10.20.193.58:0/1224569251 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f55d4045280 msgr2=0x7f55d40c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.604+0000 7f55db7fe640 1 --2- 10.20.193.58:0/1224569251 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f55d4045280 0x7f55d40c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.604+0000 7f55db7fe640 1 -- 10.20.193.58:0/1224569251 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d000a590 con 0x7f55d4044eb0 2026-02-23T06:21:02.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.604+0000 7f55daffd640 1 --2- 10.20.193.58:0/1224569251 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f55d4045280 0x7f55d40c7e50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:21:02.602 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.605+0000 7f55db7fe640 1 --2- 10.20.193.58:0/1224569251 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f55d4044eb0 0x7f55d40c7910 secure :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55c800c940 tx=0x7f55c800ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:02.602 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.605+0000 7f55bffff640 1 -- 10.20.193.58:0/1224569251 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55c80044a0 con 0x7f55d4044eb0 2026-02-23T06:21:02.602 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.605+0000 7f55e1b0c640 1 -- 10.20.193.58:0/1224569251 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55d40f32f0 con 0x7f55d4044eb0 2026-02-23T06:21:02.602 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.605+0000 7f55e1b0c640 1 -- 10.20.193.58:0/1224569251 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55d40bf7a0 con 0x7f55d4044eb0 2026-02-23T06:21:02.602 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.606+0000 7f55bffff640 1 -- 10.20.193.58:0/1224569251 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55c80077a0 con 0x7f55d4044eb0 2026-02-23T06:21:02.602 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.606+0000 7f55bffff640 1 -- 10.20.193.58:0/1224569251 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55c8007b50 con 0x7f55d4044eb0 2026-02-23T06:21:02.602 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.606+0000 7f55bffff640 1 -- 10.20.193.58:0/1224569251 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f55c8007cb0 con 0x7f55d4044eb0 2026-02-23T06:21:02.602 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.606+0000 7f55bffff640 1 -- 10.20.193.58:0/1224569251 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f55c8018db0 con 0x7f55d4044eb0 2026-02-23T06:21:02.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.610+0000 7f1067ccc640 1 -- 10.20.193.58:0/3861575795 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f102c0055b0 con 0x7f1060163bb0 2026-02-23T06:21:02.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.613+0000 7f55bdffb640 1 -- 10.20.193.58:0/1224569251 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55d4032a70 con 0x7f55d4044eb0 2026-02-23T06:21:02.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.613+0000 7f104e7fc640 1 -- 10.20.193.58:0/3861575795 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v15)=0 v15) ==== 121+0+0 (secure 0 0 0) 0x7f1050004410 con 0x7f1060163bb0 2026-02-23T06:21:02.616 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.614+0000 7f55bffff640 1 -- 10.20.193.58:0/1224569251 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f55c8038f00 con 0x7f55d4044eb0 2026-02-23T06:21:02.621 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.626+0000 7f1067ccc640 1 -- 10.20.193.58:0/3861575795 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1060163bb0 msgr2=0x7f1060150f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.621 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.626+0000 7f1067ccc640 1 --2- 10.20.193.58:0/3861575795 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1060163bb0 0x7f1060150f50 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f105000e790 tx=0x7f105000ec60 comp rx=0 tx=0).stop 2026-02-23T06:21:02.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.618+0000 7f7bddc5b640 1 -- 10.20.193.58:0/613771380 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f7bd8116930 con 0x7f7bd80b4450 2026-02-23T06:21:02.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.624+0000 7f7bb7fff640 1 -- 10.20.193.58:0/613771380 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v16)=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f7bd8166250 con 0x7f7bd80b4450 2026-02-23T06:21:02.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.628+0000 7f7bddc5b640 1 -- 10.20.193.58:0/613771380 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7bd80b4450 msgr2=0x7f7bd81527a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.628+0000 7f7bddc5b640 1 --2- 10.20.193.58:0/613771380 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7bd80b4450 0x7f7bd81527a0 secure :-1 s=READY pgs=18 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bd0008fd0 tx=0x7f7bd000dba0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.628+0000 7f7bddc5b640 1 -- 10.20.193.58:0/613771380 shutdown_connections 2026-02-23T06:21:02.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.628+0000 7f7bddc5b640 1 --2- 10.20.193.58:0/613771380 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7bd8168c20 0x7f7bd8135460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.628+0000 7f7bddc5b640 1 --2- 10.20.193.58:0/613771380 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7bd80b4820 0x7f7bd8167fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.628+0000 7f7bddc5b640 1 --2- 10.20.193.58:0/613771380 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7bd80b4450 0x7f7bd81527a0 unknown :-1 s=CLOSED pgs=18 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.628+0000 7f7bddc5b640 1 -- 10.20.193.58:0/613771380 >> 10.20.193.58:0/613771380 conn(0x7f7bd8058e50 msgr2=0x7f7bd8154a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.628+0000 7f7bddc5b640 1 -- 10.20.193.58:0/613771380 shutdown_connections 2026-02-23T06:21:02.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.628+0000 7f7bddc5b640 1 -- 10.20.193.58:0/613771380 wait complete. 2026-02-23T06:21:02.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.630+0000 7f4b39ffe640 1 -- 10.20.193.58:0/3372538383 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f4b340b0f90 con 0x7f4b340b3e70 2026-02-23T06:21:02.625 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.630+0000 7f1067ccc640 1 -- 10.20.193.58:0/3861575795 shutdown_connections 2026-02-23T06:21:02.625 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.630+0000 7f1067ccc640 1 --2- 10.20.193.58:0/3861575795 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1060169960 0x7f1060143fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.625 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.630+0000 7f1067ccc640 1 --2- 10.20.193.58:0/3861575795 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1060163bb0 0x7f1060150f50 unknown :-1 s=CLOSED pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.625 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.630+0000 7f1067ccc640 1 --2- 10.20.193.58:0/3861575795 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f10600a1d60 0x7f1060125460 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.625 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.630+0000 7f1067ccc640 1 -- 10.20.193.58:0/3861575795 >> 10.20.193.58:0/3861575795 conn(0x7f10600b9c30 msgr2=0x7f10600a01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.625 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.630+0000 7f1067ccc640 1 -- 10.20.193.58:0/3861575795 shutdown_connections 2026-02-23T06:21:02.625 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.630+0000 7f1067ccc640 1 -- 10.20.193.58:0/3861575795 wait complete. 2026-02-23T06:21:02.631 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.636+0000 7f0080407640 1 -- 10.20.193.58:0/3921864006 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f007815bb60 msgr2=0x7f00780b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.631 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.636+0000 7f0080407640 1 --2- 10.20.193.58:0/3921864006 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f007815bb60 0x7f00780b2120 secure :-1 s=READY pgs=33 gs=1 cs=0 l=1 c_cookie=1826648689720488921 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0068009890 tx=0x7f006802f260 comp rx=0 tx=0).stop 2026-02-23T06:21:02.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.638+0000 7f4b2bfff640 1 -- 10.20.193.58:0/3372538383 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v17)=0 v17) ==== 119+0+0 (secure 0 0 0) 0x7f4b1c040400 con 0x7f4b340b3e70 2026-02-23T06:21:02.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.640+0000 7f4b39ffe640 1 -- 10.20.193.58:0/3372538383 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4b340b3e70 msgr2=0x7f4b34162cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.640+0000 7f4b39ffe640 1 --2- 10.20.193.58:0/3372538383 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4b340b3e70 0x7f4b34162cd0 secure :-1 s=READY pgs=29 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4b1c0023d0 tx=0x7f4b1c002a10 comp rx=0 tx=0).stop 2026-02-23T06:21:02.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.641+0000 7f4b39ffe640 1 -- 10.20.193.58:0/3372538383 shutdown_connections 2026-02-23T06:21:02.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.641+0000 7f4b39ffe640 1 --2- 10.20.193.58:0/3372538383 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4b3415b4c0 0x7f4b34163210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.641+0000 7f4b39ffe640 1 --2- 10.20.193.58:0/3372538383 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4b340b3e70 0x7f4b34162cd0 unknown :-1 s=CLOSED pgs=29 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.641+0000 7f4b39ffe640 1 --2- 10.20.193.58:0/3372538383 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4b340b1770 0x7f4b340b5840 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.641+0000 7f4b39ffe640 1 -- 10.20.193.58:0/3372538383 >> 10.20.193.58:0/3372538383 conn(0x7f4b34058e50 msgr2=0x7f4b340aebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.641+0000 7f4b39ffe640 1 -- 10.20.193.58:0/3372538383 shutdown_connections 2026-02-23T06:21:02.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.641+0000 7f4b39ffe640 1 -- 10.20.193.58:0/3372538383 wait complete. 2026-02-23T06:21:02.637 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.641+0000 7f0080407640 1 -- 10.20.193.58:0/3921864006 shutdown_connections 2026-02-23T06:21:02.638 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.641+0000 7f0080407640 1 --2- 10.20.193.58:0/3921864006 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f00780b71f0 0x7f007815bf30 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.638 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.641+0000 7f0080407640 1 --2- 10.20.193.58:0/3921864006 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f007815bb60 0x7f00780b2120 unknown :-1 s=CLOSED pgs=33 gs=1 cs=0 l=1 c_cookie=1826648689720488921 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.638 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.641+0000 7f0080407640 1 -- 10.20.193.58:0/3921864006 >> 10.20.193.58:0/3921864006 conn(0x7f00780561f0 msgr2=0x7f00780565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.638 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.641+0000 7f0080407640 1 -- 10.20.193.58:0/3921864006 shutdown_connections 2026-02-23T06:21:02.638 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.643+0000 7f0080407640 1 -- 10.20.193.58:0/3921864006 wait complete. 2026-02-23T06:21:02.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.644+0000 7f0080407640 1 Processor -- start 2026-02-23T06:21:02.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.644+0000 7f0080407640 1 -- start start 2026-02-23T06:21:02.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.644+0000 7f0080407640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00780b71f0 0x7f0078141320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.644+0000 7f0080407640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f007815bb60 0x7f0078122770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.644+0000 7f0080407640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0078165e00 0x7f0078120cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.644+0000 7f0080407640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f0078122cb0 con 0x7f00780b71f0 2026-02-23T06:21:02.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.644+0000 7f0080407640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f0078125f30 con 0x7f007815bb60 2026-02-23T06:21:02.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.644+0000 7f0080407640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f0078125c50 con 0x7f0078165e00 2026-02-23T06:21:02.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.645+0000 7f007e17c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00780b71f0 0x7f0078141320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.645+0000 7f007e97d640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0078165e00 0x7f0078120cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.645+0000 7f007e97d640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0078165e00 0x7f0078120cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:54546/0 (socket says 10.20.193.58:54546) 2026-02-23T06:21:02.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.645+0000 7f007e97d640 1 -- 10.20.193.58:0/1126685661 learned_addr learned my addr 10.20.193.58:0/1126685661 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:02.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.645+0000 7f007e17c640 1 -- 10.20.193.58:0/1126685661 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0078165e00 msgr2=0x7f0078120cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.645+0000 7efc5d483640 1 -- 10.20.193.58:0/1489154433 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc5815f990 msgr2=0x7efc581cb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.645+0000 7efc5d483640 1 --2- 10.20.193.58:0/1489154433 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc5815f990 0x7efc581cb090 secure :-1 s=READY pgs=25 gs=3 cs=0 l=1 c_cookie=14349900752373828208 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc40004740 tx=0x7efc4002f280 comp rx=0 tx=0).stop 2026-02-23T06:21:02.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.645+0000 7f007e17c640 1 --2- 10.20.193.58:0/1126685661 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0078165e00 0x7f0078120cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.645+0000 7f007e17c640 1 -- 10.20.193.58:0/1126685661 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f007815bb60 msgr2=0x7f0078122770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:21:02.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.645+0000 7f007e17c640 1 --2- 10.20.193.58:0/1126685661 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f007815bb60 0x7f0078122770 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.645+0000 7f007e17c640 1 -- 10.20.193.58:0/1126685661 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00680094b0 con 0x7f00780b71f0 2026-02-23T06:21:02.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.646+0000 7efc5d483640 1 -- 10.20.193.58:0/1489154433 shutdown_connections 2026-02-23T06:21:02.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.646+0000 7efc5d483640 1 --2- 10.20.193.58:0/1489154433 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc5815f990 0x7efc581cb090 unknown :-1 s=CLOSED pgs=25 gs=3 cs=0 l=1 c_cookie=14349900752373828208 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.646+0000 7efc5d483640 1 -- 10.20.193.58:0/1489154433 >> 10.20.193.58:0/1489154433 conn(0x7efc580b3c20 msgr2=0x7efc580b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.646+0000 7efc5d483640 1 -- 10.20.193.58:0/1489154433 shutdown_connections 2026-02-23T06:21:02.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.646+0000 7efc5d483640 1 -- 10.20.193.58:0/1489154433 wait complete. 2026-02-23T06:21:02.644 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='trial058') 2026-02-23T06:21:02.644 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='trial058') 2026-02-23T06:21:02.645 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='trial058') 2026-02-23T06:21:02.645 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='trial058') 2026-02-23T06:21:02.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.647+0000 7efc5d483640 1 Processor -- start 2026-02-23T06:21:02.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.647+0000 7efc5d483640 1 -- start start 2026-02-23T06:21:02.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.648+0000 7efc5d483640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc5805d8b0 0x7efc58133350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.648+0000 7efc5d483640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc5815f5c0 0x7efc5815e380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.648+0000 7efc5d483640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc5815f990 0x7efc58145890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.648+0000 7efc5d483640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7efc58137e30 con 0x7efc5805d8b0 2026-02-23T06:21:02.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.648+0000 7efc5d483640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7efc58133890 con 0x7efc5815f990 2026-02-23T06:21:02.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.648+0000 7efc5d483640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7efc581345a0 con 0x7efc5815f5c0 2026-02-23T06:21:02.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.651+0000 7efc577fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc5815f5c0 0x7efc5815e380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.651+0000 7efc577fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc5815f5c0 0x7efc5815e380 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:54552/0 (socket says 10.20.193.58:54552) 2026-02-23T06:21:02.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.651+0000 7efc577fe640 1 -- 10.20.193.58:0/2757284761 learned_addr learned my addr 10.20.193.58:0/2757284761 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:02.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.651+0000 7efc5cc82640 1 --2- 10.20.193.58:0/2757284761 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc5815f990 0x7efc58145890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.651+0000 7efc5cc82640 1 -- 10.20.193.58:0/2757284761 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc5815f5c0 msgr2=0x7efc5815e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.651+0000 7efc5cc82640 1 --2- 10.20.193.58:0/2757284761 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc5815f5c0 0x7efc5815e380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.651+0000 7efc5cc82640 1 -- 10.20.193.58:0/2757284761 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc5805d8b0 msgr2=0x7efc58133350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.651+0000 7efc5cc82640 1 --2- 10.20.193.58:0/2757284761 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc5805d8b0 0x7efc58133350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.651+0000 7efc5cc82640 1 -- 10.20.193.58:0/2757284761 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc400094b0 con 0x7efc5815f990 2026-02-23T06:21:02.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.651+0000 7efc577fe640 1 --2- 10.20.193.58:0/2757284761 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc5815f5c0 0x7efc5815e380 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:02.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.652+0000 7efc5cc82640 1 --2- 10.20.193.58:0/2757284761 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc5815f990 0x7efc58145890 secure :-1 s=READY pgs=34 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc40009230 tx=0x7efc40002a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:02.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.652+0000 7f007e17c640 1 --2- 10.20.193.58:0/1126685661 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00780b71f0 0x7f0078141320 secure :-1 s=READY pgs=26 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0068009230 tx=0x7f0068002c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:02.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.652+0000 7efc54ff9640 1 -- 10.20.193.58:0/2757284761 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc40044070 con 0x7efc5815f990 2026-02-23T06:21:02.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.652+0000 7efc54ff9640 1 -- 10.20.193.58:0/2757284761 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc40004ba0 con 0x7efc5815f990 2026-02-23T06:21:02.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.652+0000 7efc54ff9640 1 -- 10.20.193.58:0/2757284761 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc40002e50 con 0x7efc5815f990 2026-02-23T06:21:02.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.652+0000 7efc5d483640 1 -- 10.20.193.58:0/2757284761 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc58133c40 con 0x7efc5815f990 2026-02-23T06:21:02.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.652+0000 7efc5d483640 1 -- 10.20.193.58:0/2757284761 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc5813c5f0 con 0x7efc5815f990 2026-02-23T06:21:02.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.652+0000 7efc54ff9640 1 -- 10.20.193.58:0/2757284761 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7efc40005430 con 0x7efc5815f990 2026-02-23T06:21:02.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.652+0000 7efc54ff9640 1 -- 10.20.193.58:0/2757284761 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7efc400407a0 con 0x7efc5815f990 2026-02-23T06:21:02.651 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_dir_prefetch', 'False'], check_status=True, hostname='trial058') 2026-02-23T06:21:02.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.654+0000 7efc5d483640 1 -- 10.20.193.58:0/2757284761 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc18005300 con 0x7efc5815f990 2026-02-23T06:21:02.654 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.655+0000 7f0066ffd640 1 -- 10.20.193.58:0/1126685661 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0068044070 con 0x7f00780b71f0 2026-02-23T06:21:02.654 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.655+0000 7f0066ffd640 1 -- 10.20.193.58:0/1126685661 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0068004b60 con 0x7f00780b71f0 2026-02-23T06:21:02.654 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.655+0000 7f0066ffd640 1 -- 10.20.193.58:0/1126685661 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f006802fcd0 con 0x7f00780b71f0 2026-02-23T06:21:02.654 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.655+0000 7f0080407640 1 -- 10.20.193.58:0/1126685661 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f007813de40 con 0x7f00780b71f0 2026-02-23T06:21:02.654 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.655+0000 7f0080407640 1 -- 10.20.193.58:0/1126685661 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f007813e400 con 0x7f00780b71f0 2026-02-23T06:21:02.654 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.656+0000 7f0066ffd640 1 -- 10.20.193.58:0/1126685661 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f0068005340 con 0x7f00780b71f0 2026-02-23T06:21:02.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.656+0000 7f0066ffd640 1 -- 10.20.193.58:0/1126685661 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f00680407f0 con 0x7f00780b71f0 2026-02-23T06:21:02.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.658+0000 7f0064ff9640 1 -- 10.20.193.58:0/1126685661 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0078058640 con 0x7f00780b71f0 2026-02-23T06:21:02.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.659+0000 7f0066ffd640 1 -- 10.20.193.58:0/1126685661 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f0068040a00 con 0x7f00780b71f0 2026-02-23T06:21:02.657 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.663+0000 7efc54ff9640 1 -- 10.20.193.58:0/2757284761 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7efc400409b0 con 0x7efc5815f990 2026-02-23T06:21:02.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.669+0000 7f55bdffb640 1 -- 10.20.193.58:0/1224569251 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command([{prefix=config set, name=mds_dir_prefetch}] v 0) -- 0x7f55d400bc40 con 0x7f55d4044eb0 2026-02-23T06:21:02.664 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.669+0000 7f6d01573640 1 -- 10.20.193.58:0/2491108154 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6cf0006290 con 0x7f6ce8004850 2026-02-23T06:21:02.664 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.670+0000 7f6d08ccc640 1 -- 10.20.193.58:0/2491108154 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ce8004850 msgr2=0x7f6ce8004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.665 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.670+0000 7f6d08ccc640 1 --2- 10.20.193.58:0/2491108154 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ce8004850 0x7f6ce8004cc0 secure :-1 s=READY pgs=27 gs=3 cs=0 l=1 c_cookie=17915513843610515389 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cf0002820 tx=0x7f6cf002f890 comp rx=0 tx=0).stop 2026-02-23T06:21:02.668 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.670+0000 7f6d08ccc640 1 -- 10.20.193.58:0/2491108154 shutdown_connections 2026-02-23T06:21:02.668 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.670+0000 7f6d08ccc640 1 --2- 10.20.193.58:0/2491108154 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ce8004850 0x7f6ce8004cc0 unknown :-1 s=CLOSED pgs=27 gs=3 cs=0 l=1 c_cookie=17915513843610515389 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.668 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.670+0000 7f6d08ccc640 1 -- 10.20.193.58:0/2491108154 >> 10.20.193.58:0/2491108154 conn(0x7f6d04058e50 msgr2=0x7f6d04059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.668 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.670+0000 7f6d08ccc640 1 -- 10.20.193.58:0/2491108154 shutdown_connections 2026-02-23T06:21:02.668 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.670+0000 7f6d08ccc640 1 -- 10.20.193.58:0/2491108154 wait complete. 2026-02-23T06:21:02.668 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.672+0000 7f6d08ccc640 1 Processor -- start 2026-02-23T06:21:02.668 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.672+0000 7f6d08ccc640 1 -- start start 2026-02-23T06:21:02.669 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.673+0000 7f6d08ccc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6ce8004850 0x7f6d0405c600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.669 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.673+0000 7f6d08ccc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6d0415fac0 0x7f6d04168fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.669 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.673+0000 7f6d08ccc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6d04203040 0x7f6d04203470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.669 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.673+0000 7f6d08ccc640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f6d04202910 con 0x7f6d04203040 2026-02-23T06:21:02.669 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.673+0000 7f6d08ccc640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0405cb40 con 0x7f6d0415fac0 2026-02-23T06:21:02.669 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.673+0000 7f6d08ccc640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f6d042039b0 con 0x7f6ce8004850 2026-02-23T06:21:02.669 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.673+0000 7f6d01d74640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6d0415fac0 0x7f6d04168fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.669 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.673+0000 7f6d02575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6ce8004850 0x7f6d0405c600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.669 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.673+0000 7f6d02575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6ce8004850 0x7f6d0405c600 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:54576/0 (socket says 10.20.193.58:54576) 2026-02-23T06:21:02.669 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.673+0000 7f6d02575640 1 -- 10.20.193.58:0/126762705 learned_addr learned my addr 10.20.193.58:0/126762705 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:02.669 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.673+0000 7f6d02d76640 1 --2- 10.20.193.58:0/126762705 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6d04203040 0x7f6d04203470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.670 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.674+0000 7f6d02d76640 1 -- 10.20.193.58:0/126762705 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6ce8004850 msgr2=0x7f6d0405c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.670 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.674+0000 7f6d02d76640 1 --2- 10.20.193.58:0/126762705 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6ce8004850 0x7f6d0405c600 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.670 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.674+0000 7f6d02d76640 1 -- 10.20.193.58:0/126762705 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6d0415fac0 msgr2=0x7f6d04168fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.671 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.674+0000 7f6d02d76640 1 --2- 10.20.193.58:0/126762705 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6d0415fac0 0x7f6d04168fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.671 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.674+0000 7f6d02d76640 1 -- 10.20.193.58:0/126762705 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d0405cd60 con 0x7f6d04203040 2026-02-23T06:21:02.671 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.674+0000 7f6d02d76640 1 --2- 10.20.193.58:0/126762705 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6d04203040 0x7f6d04203470 secure :-1 s=READY pgs=28 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d040b74e0 tx=0x7f6cf400a440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:02.671 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.675+0000 7f55bffff640 1 -- 10.20.193.58:0/1224569251 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_dir_prefetch}]=0 v18)=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f55c8026030 con 0x7f55d4044eb0 2026-02-23T06:21:02.672 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.676+0000 7f6ceeffd640 1 -- 10.20.193.58:0/126762705 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6cf400ab70 con 0x7f6d04203040 2026-02-23T06:21:02.672 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.676+0000 7f6d08ccc640 1 -- 10.20.193.58:0/126762705 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d0405d040 con 0x7f6d04203040 2026-02-23T06:21:02.672 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.676+0000 7f6ceeffd640 1 -- 10.20.193.58:0/126762705 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cf400acd0 con 0x7f6d04203040 2026-02-23T06:21:02.672 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.676+0000 7f6ceeffd640 1 -- 10.20.193.58:0/126762705 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6cf40116b0 con 0x7f6d04203040 2026-02-23T06:21:02.672 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.677+0000 7f55bdffb640 1 -- 10.20.193.58:0/1224569251 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f55d4044eb0 msgr2=0x7f55d40c7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.673 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.677+0000 7f55bdffb640 1 --2- 10.20.193.58:0/1224569251 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f55d4044eb0 0x7f55d40c7910 secure :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55c800c940 tx=0x7f55c800ce10 comp rx=0 tx=0).stop 2026-02-23T06:21:02.673 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.676+0000 7f6d08ccc640 1 -- 10.20.193.58:0/126762705 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d0405d600 con 0x7f6d04203040 2026-02-23T06:21:02.673 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.677+0000 7f6ceeffd640 1 -- 10.20.193.58:0/126762705 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f6cf4017020 con 0x7f6d04203040 2026-02-23T06:21:02.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.677+0000 7f55bdffb640 1 -- 10.20.193.58:0/1224569251 shutdown_connections 2026-02-23T06:21:02.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.677+0000 7f55bdffb640 1 --2- 10.20.193.58:0/1224569251 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f55d404f470 0x7f55d40bffa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.677+0000 7f55bdffb640 1 --2- 10.20.193.58:0/1224569251 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f55d4045280 0x7f55d40c7e50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.677+0000 7f55bdffb640 1 --2- 10.20.193.58:0/1224569251 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f55d4044eb0 0x7f55d40c7910 unknown :-1 s=CLOSED pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.677+0000 7f55bdffb640 1 -- 10.20.193.58:0/1224569251 >> 10.20.193.58:0/1224569251 conn(0x7f55d400a260 msgr2=0x7f55d4005280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.677+0000 7f55bdffb640 1 -- 10.20.193.58:0/1224569251 shutdown_connections 2026-02-23T06:21:02.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.677+0000 7f55bdffb640 1 -- 10.20.193.58:0/1224569251 wait complete. 2026-02-23T06:21:02.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.677+0000 7f6ceeffd640 1 -- 10.20.193.58:0/126762705 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f6cf40103c0 con 0x7f6d04203040 2026-02-23T06:21:02.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.678+0000 7f6d08ccc640 1 -- 10.20.193.58:0/126762705 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ccc005300 con 0x7f6d04203040 2026-02-23T06:21:02.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.679+0000 7f6ceeffd640 1 -- 10.20.193.58:0/126762705 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f6cf4011c20 con 0x7f6d04203040 2026-02-23T06:21:02.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.685+0000 7f74649d4640 1 -- 10.20.193.58:0/3011578488 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f745c1635a0 msgr2=0x7f745c0b45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.685+0000 7f74649d4640 1 --2- 10.20.193.58:0/3011578488 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f745c1635a0 0x7f745c0b45f0 secure :-1 s=READY pgs=19 gs=2 cs=0 l=1 c_cookie=7014410380602299963 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7448005e70 tx=0x7f744802f1b0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.685+0000 7f74649d4640 1 -- 10.20.193.58:0/3011578488 shutdown_connections 2026-02-23T06:21:02.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.685+0000 7f74649d4640 1 --2- 10.20.193.58:0/3011578488 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f745c1635a0 0x7f745c0b45f0 unknown :-1 s=CLOSED pgs=19 gs=2 cs=0 l=1 c_cookie=7014410380602299963 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.685+0000 7f74649d4640 1 --2- 10.20.193.58:0/3011578488 >> v2:10.20.193.93:3300/0 conn(0x7f745c15d240 0x7f745c163060 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.685+0000 7f74649d4640 1 -- 10.20.193.58:0/3011578488 >> 10.20.193.58:0/3011578488 conn(0x7f745c058e50 msgr2=0x7f745c059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.685+0000 7f74649d4640 1 -- 10.20.193.58:0/3011578488 shutdown_connections 2026-02-23T06:21:02.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.685+0000 7f74649d4640 1 -- 10.20.193.58:0/3011578488 wait complete. 2026-02-23T06:21:02.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.686+0000 7f74649d4640 1 Processor -- start 2026-02-23T06:21:02.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.686+0000 7f74649d4640 1 -- start start 2026-02-23T06:21:02.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.687+0000 7f74649d4640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f745c0b62f0 0x7f745c13ae30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.687+0000 7f74649d4640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f745c15d240 0x7f745c119420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.687+0000 7f74649d4640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f745c1635a0 0x7f745c13cd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.687+0000 7f7461f48640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f745c15d240 0x7f745c119420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.687+0000 7f7461f48640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f745c15d240 0x7f745c119420 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:55792/0 (socket says 10.20.193.58:55792) 2026-02-23T06:21:02.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.687+0000 7f7462f4a640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f745c1635a0 0x7f745c13cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.687+0000 7f74649d4640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f745c1189b0 con 0x7f745c1635a0 2026-02-23T06:21:02.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.687+0000 7f74649d4640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f745c11ca20 con 0x7f745c15d240 2026-02-23T06:21:02.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.687+0000 7f74649d4640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f745c117e30 con 0x7f745c0b62f0 2026-02-23T06:21:02.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.687+0000 7f7461f48640 1 -- 10.20.193.58:0/3117359751 learned_addr learned my addr 10.20.193.58:0/3117359751 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:02.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.687+0000 7f7462749640 1 --2- 10.20.193.58:0/3117359751 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f745c0b62f0 0x7f745c13ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.688+0000 7f7461f48640 1 -- 10.20.193.58:0/3117359751 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f745c0b62f0 msgr2=0x7f745c13ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.688+0000 7f7461f48640 1 --2- 10.20.193.58:0/3117359751 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f745c0b62f0 0x7f745c13ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.688+0000 7f7461f48640 1 -- 10.20.193.58:0/3117359751 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f745c1635a0 msgr2=0x7f745c13cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.688+0000 7f7461f48640 1 --2- 10.20.193.58:0/3117359751 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f745c1635a0 0x7f745c13cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.688+0000 7f7461f48640 1 -- 10.20.193.58:0/3117359751 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f745000a590 con 0x7f745c15d240 2026-02-23T06:21:02.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.688+0000 7f7462f4a640 1 --2- 10.20.193.58:0/3117359751 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f745c1635a0 0x7f745c13cd90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:02.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.688+0000 7f7461f48640 1 --2- 10.20.193.58:0/3117359751 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f745c15d240 0x7f745c119420 secure :-1 s=READY pgs=37 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7448004740 tx=0x7f74480028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:02.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.688+0000 7f744effd640 1 -- 10.20.193.58:0/3117359751 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f744803d070 con 0x7f745c15d240 2026-02-23T06:21:02.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.688+0000 7f74649d4640 1 -- 10.20.193.58:0/3117359751 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7448009570 con 0x7f745c15d240 2026-02-23T06:21:02.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.688+0000 7f74649d4640 1 -- 10.20.193.58:0/3117359751 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f745c1183f0 con 0x7f745c15d240 2026-02-23T06:21:02.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.688+0000 7f744effd640 1 -- 10.20.193.58:0/3117359751 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74480045b0 con 0x7f745c15d240 2026-02-23T06:21:02.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.688+0000 7f744effd640 1 -- 10.20.193.58:0/3117359751 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f74480386f0 con 0x7f745c15d240 2026-02-23T06:21:02.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.689+0000 7f744effd640 1 -- 10.20.193.58:0/3117359751 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f7448038c60 con 0x7f745c15d240 2026-02-23T06:21:02.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.690+0000 7f744effd640 1 -- 10.20.193.58:0/3117359751 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f744804a730 con 0x7f745c15d240 2026-02-23T06:21:02.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.691+0000 7f744cff9640 1 -- 10.20.193.58:0/3117359751 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7420005300 con 0x7f745c15d240 2026-02-23T06:21:02.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.692+0000 7f549ffff640 1 -- 10.20.193.58:0/2247872995 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f54a015c2f0 msgr2=0x7f54a005ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.692+0000 7f549ffff640 1 --2- 10.20.193.58:0/2247872995 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f54a015c2f0 0x7f54a005ce30 secure :-1 s=READY pgs=29 gs=2 cs=0 l=1 c_cookie=110248743337947023 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54a00b4cb0 tx=0x7f548802f2d0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.693+0000 7f549ffff640 1 -- 10.20.193.58:0/2247872995 shutdown_connections 2026-02-23T06:21:02.688 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.693+0000 7f549ffff640 1 --2- 10.20.193.58:0/2247872995 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f54a015c2f0 0x7f54a005ce30 unknown :-1 s=CLOSED pgs=29 gs=2 cs=0 l=1 c_cookie=110248743337947023 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.688 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.693+0000 7f549ffff640 1 --2- 10.20.193.58:0/2247872995 >> v2:10.20.193.93:3300/0 conn(0x7f54a015bf20 0x7f54a005b0e0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.688 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.693+0000 7f549ffff640 1 -- 10.20.193.58:0/2247872995 >> 10.20.193.58:0/2247872995 conn(0x7f54a00b3c20 msgr2=0x7f54a00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.688 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.693+0000 7f549ffff640 1 -- 10.20.193.58:0/2247872995 shutdown_connections 2026-02-23T06:21:02.688 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.693+0000 7f549ffff640 1 -- 10.20.193.58:0/2247872995 wait complete. 2026-02-23T06:21:02.689 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.694+0000 7f549ffff640 1 Processor -- start 2026-02-23T06:21:02.689 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.695+0000 7f0064ff9640 1 -- 10.20.193.58:0/1126685661 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f00780b5520 con 0x7f00780b71f0 2026-02-23T06:21:02.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.696+0000 7f549ffff640 1 -- start start 2026-02-23T06:21:02.691 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.696+0000 7f549ffff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f54a0056550 0x7f54a00589e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.691 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.696+0000 7f549ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f54a015bf20 0x7f54a013a200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.697+0000 7f549e7fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f54a015bf20 0x7f54a013a200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.697+0000 7f549e7fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f54a015bf20 0x7f54a013a200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:48652/0 (socket says 10.20.193.58:48652) 2026-02-23T06:21:02.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.698+0000 7f549e7fc640 1 -- 10.20.193.58:0/658009361 learned_addr learned my addr 10.20.193.58:0/658009361 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:02.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.698+0000 7f549ffff640 1 --2- 10.20.193.58:0/658009361 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f54a015c2f0 0x7f54a013a740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.698+0000 7f549effd640 1 --2- 10.20.193.58:0/658009361 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f54a0056550 0x7f54a00589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.698+0000 7f549ffff640 1 -- 10.20.193.58:0/658009361 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f54a015cc60 con 0x7f54a015bf20 2026-02-23T06:21:02.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.698+0000 7f549ffff640 1 -- 10.20.193.58:0/658009361 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f54a0160280 con 0x7f54a0056550 2026-02-23T06:21:02.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.699+0000 7f549ffff640 1 -- 10.20.193.58:0/658009361 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f54a015d6b0 con 0x7f54a015c2f0 2026-02-23T06:21:02.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.699+0000 7f0066ffd640 1 -- 10.20.193.58:0/1126685661 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v19)=0 v19) ==== 119+0+0 (secure 0 0 0) 0x7f0068040ba0 con 0x7f00780b71f0 2026-02-23T06:21:02.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.699+0000 7f549f7fe640 1 --2- 10.20.193.58:0/658009361 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f54a015c2f0 0x7f54a013a740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.699+0000 7f744effd640 1 -- 10.20.193.58:0/3117359751 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f7448046070 con 0x7f745c15d240 2026-02-23T06:21:02.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.699+0000 7f0064ff9640 1 -- 10.20.193.58:0/1126685661 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00780b71f0 msgr2=0x7f0078141320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.699+0000 7f549e7fc640 1 -- 10.20.193.58:0/658009361 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f54a015c2f0 msgr2=0x7f54a013a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.699+0000 7f549e7fc640 1 --2- 10.20.193.58:0/658009361 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f54a015c2f0 0x7f54a013a740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.699+0000 7f549e7fc640 1 -- 10.20.193.58:0/658009361 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f54a0056550 msgr2=0x7f54a00589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.699+0000 7f549e7fc640 1 --2- 10.20.193.58:0/658009361 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f54a0056550 0x7f54a00589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.699+0000 7f549e7fc640 1 -- 10.20.193.58:0/658009361 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5488009570 con 0x7f54a015bf20 2026-02-23T06:21:02.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.699+0000 7f549e7fc640 1 --2- 10.20.193.58:0/658009361 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f54a015bf20 0x7f54a013a200 secure :-1 s=READY pgs=32 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5488004740 tx=0x7f5488002a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:02.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.700+0000 7f0064ff9640 1 --2- 10.20.193.58:0/1126685661 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00780b71f0 0x7f0078141320 secure :-1 s=READY pgs=26 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0068009230 tx=0x7f0068002c40 comp rx=0 tx=0).stop 2026-02-23T06:21:02.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.700+0000 7f0064ff9640 1 -- 10.20.193.58:0/1126685661 shutdown_connections 2026-02-23T06:21:02.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.700+0000 7f0064ff9640 1 --2- 10.20.193.58:0/1126685661 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0078165e00 0x7f0078120cd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.700+0000 7f0064ff9640 1 --2- 10.20.193.58:0/1126685661 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f007815bb60 0x7f0078122770 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.700+0000 7f0064ff9640 1 --2- 10.20.193.58:0/1126685661 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00780b71f0 0x7f0078141320 unknown :-1 s=CLOSED pgs=26 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.700+0000 7f0064ff9640 1 -- 10.20.193.58:0/1126685661 >> 10.20.193.58:0/1126685661 conn(0x7f00780561f0 msgr2=0x7f0078143440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.700+0000 7f0064ff9640 1 -- 10.20.193.58:0/1126685661 shutdown_connections 2026-02-23T06:21:02.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.700+0000 7f9126243640 1 -- 10.20.193.58:0/1864625032 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f912016d770 msgr2=0x7f9120163300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.700+0000 7f9126243640 1 --2- 10.20.193.58:0/1864625032 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f912016d770 0x7f9120163300 secure :-1 s=READY pgs=31 gs=2 cs=0 l=1 c_cookie=3689328251566119724 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f912009ed80 tx=0x7f911402f220 comp rx=0 tx=0).stop 2026-02-23T06:21:02.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.701+0000 7f9126243640 1 -- 10.20.193.58:0/1864625032 shutdown_connections 2026-02-23T06:21:02.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.701+0000 7f9126243640 1 --2- 10.20.193.58:0/1864625032 >> v2:10.20.193.93:3300/0 conn(0x7f9120055130 0x7f9120163840 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.701+0000 7f9126243640 1 --2- 10.20.193.58:0/1864625032 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f912016d770 0x7f9120163300 unknown :-1 s=CLOSED pgs=31 gs=2 cs=0 l=1 c_cookie=3689328251566119724 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.701+0000 7f9126243640 1 -- 10.20.193.58:0/1864625032 >> 10.20.193.58:0/1864625032 conn(0x7f91200571f0 msgr2=0x7f91200bae30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.700+0000 7f547f7fe640 1 -- 10.20.193.58:0/658009361 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5488004a70 con 0x7f54a015bf20 2026-02-23T06:21:02.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.700+0000 7f549ffff640 1 -- 10.20.193.58:0/658009361 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54a01610c0 con 0x7f54a015bf20 2026-02-23T06:21:02.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.700+0000 7f547f7fe640 1 -- 10.20.193.58:0/658009361 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5488002e90 con 0x7f54a015bf20 2026-02-23T06:21:02.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.700+0000 7f549ffff640 1 -- 10.20.193.58:0/658009361 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54a015c980 con 0x7f54a015bf20 2026-02-23T06:21:02.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.701+0000 7f547f7fe640 1 -- 10.20.193.58:0/658009361 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5488004a70 con 0x7f54a015bf20 2026-02-23T06:21:02.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.700+0000 7f0064ff9640 1 -- 10.20.193.58:0/1126685661 wait complete. 2026-02-23T06:21:02.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.701+0000 7f9126243640 1 -- 10.20.193.58:0/1864625032 shutdown_connections 2026-02-23T06:21:02.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.701+0000 7f9126243640 1 -- 10.20.193.58:0/1864625032 wait complete. 2026-02-23T06:21:02.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.703+0000 7f9126243640 1 Processor -- start 2026-02-23T06:21:02.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.703+0000 7f9126243640 1 -- start start 2026-02-23T06:21:02.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.704+0000 7f9126243640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9120055130 0x7f912016a8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.704+0000 7f9126243640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f91200bc000 0x7f9120162070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.704+0000 7f9126243640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f912016d770 0x7f91201625b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.704+0000 7f9126243640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f912009fea0 con 0x7f912016d770 2026-02-23T06:21:02.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.704+0000 7f9126243640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f912016c670 con 0x7f9120055130 2026-02-23T06:21:02.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.704+0000 7f9126243640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f91200a0320 con 0x7f91200bc000 2026-02-23T06:21:02.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.704+0000 7f9125241640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9120055130 0x7f912016a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.704+0000 7f9124a40640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f91200bc000 0x7f9120162070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.704+0000 7f9124a40640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f91200bc000 0x7f9120162070 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:54616/0 (socket says 10.20.193.58:54616) 2026-02-23T06:21:02.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.704+0000 7f9124a40640 1 -- 10.20.193.58:0/1596019106 learned_addr learned my addr 10.20.193.58:0/1596019106 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:02.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.704+0000 7f9125a42640 1 --2- 10.20.193.58:0/1596019106 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f912016d770 0x7f91201625b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.705+0000 7f9124a40640 1 -- 10.20.193.58:0/1596019106 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9120055130 msgr2=0x7f912016a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.705+0000 7f9124a40640 1 --2- 10.20.193.58:0/1596019106 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9120055130 0x7f912016a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.705+0000 7f9124a40640 1 -- 10.20.193.58:0/1596019106 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f912016d770 msgr2=0x7f91201625b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.705+0000 7f9124a40640 1 --2- 10.20.193.58:0/1596019106 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f912016d770 0x7f91201625b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.705+0000 7f9124a40640 1 -- 10.20.193.58:0/1596019106 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91140094b0 con 0x7f91200bc000 2026-02-23T06:21:02.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.705+0000 7f9125241640 1 --2- 10.20.193.58:0/1596019106 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9120055130 0x7f912016a8f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:02.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.705+0000 7f9125a42640 1 --2- 10.20.193.58:0/1596019106 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f912016d770 0x7f91201625b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:02.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.701+0000 7f547f7fe640 1 -- 10.20.193.58:0/658009361 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f548803f070 con 0x7f54a015bf20 2026-02-23T06:21:02.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.702+0000 7f547f7fe640 1 -- 10.20.193.58:0/658009361 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f5488041450 con 0x7f54a015bf20 2026-02-23T06:21:02.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.702+0000 7f549ffff640 1 -- 10.20.193.58:0/658009361 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5460005300 con 0x7f54a015bf20 2026-02-23T06:21:02.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.703+0000 7f547f7fe640 1 -- 10.20.193.58:0/658009361 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f548804f060 con 0x7f54a015bf20 2026-02-23T06:21:02.703 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.702+0000 7f0f7039d640 1 -- 10.20.193.58:0/3604072371 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0f6004d2a0 msgr2=0x7f0f6015e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.703 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.702+0000 7f0f7039d640 1 --2- 10.20.193.58:0/3604072371 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0f6004d2a0 0x7f0f6015e5f0 secure :-1 s=READY pgs=39 gs=3 cs=0 l=1 c_cookie=4651518309954748388 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f600fe380 tx=0x7f0f5802f110 comp rx=0 tx=0).stop 2026-02-23T06:21:02.703 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.705+0000 7f0f7039d640 1 -- 10.20.193.58:0/3604072371 shutdown_connections 2026-02-23T06:21:02.703 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.705+0000 7f0f7039d640 1 --2- 10.20.193.58:0/3604072371 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0f6004d2a0 0x7f0f6015e5f0 unknown :-1 s=CLOSED pgs=39 gs=3 cs=0 l=1 c_cookie=4651518309954748388 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.703 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.705+0000 7f0f7039d640 1 --2- 10.20.193.58:0/3604072371 >> v2:10.20.193.58:3300/0 conn(0x7f0f600fd260 0x7f0f6004cd60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.703 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.705+0000 7f0f7039d640 1 -- 10.20.193.58:0/3604072371 >> 10.20.193.58:0/3604072371 conn(0x7f0f6000a5f0 msgr2=0x7f0f6000bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.705+0000 7f0f7039d640 1 -- 10.20.193.58:0/3604072371 shutdown_connections 2026-02-23T06:21:02.704 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial058') 2026-02-23T06:21:02.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.706+0000 7f9124a40640 1 --2- 10.20.193.58:0/1596019106 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f91200bc000 0x7f9120162070 secure :-1 s=READY pgs=20 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91140023d0 tx=0x7f9114002a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:02.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.706+0000 7f910dffb640 1 -- 10.20.193.58:0/1596019106 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f911403c040 con 0x7f91200bc000 2026-02-23T06:21:02.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.706+0000 7f910dffb640 1 -- 10.20.193.58:0/1596019106 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9114038470 con 0x7f91200bc000 2026-02-23T06:21:02.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.706+0000 7f910dffb640 1 -- 10.20.193.58:0/1596019106 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9114038880 con 0x7f91200bc000 2026-02-23T06:21:02.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.706+0000 7f9126243640 1 -- 10.20.193.58:0/1596019106 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91200a0600 con 0x7f91200bc000 2026-02-23T06:21:02.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.706+0000 7f9126243640 1 -- 10.20.193.58:0/1596019106 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9120167350 con 0x7f91200bc000 2026-02-23T06:21:02.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.706+0000 7f910dffb640 1 -- 10.20.193.58:0/1596019106 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f9114049450 con 0x7f91200bc000 2026-02-23T06:21:02.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.706+0000 7f910dffb640 1 -- 10.20.193.58:0/1596019106 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f9114040a00 con 0x7f91200bc000 2026-02-23T06:21:02.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.707+0000 7f9126243640 1 -- 10.20.193.58:0/1596019106 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91200a0a80 con 0x7f91200bc000 2026-02-23T06:21:02.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.708+0000 7f910dffb640 1 -- 10.20.193.58:0/1596019106 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f9114044020 con 0x7f91200bc000 2026-02-23T06:21:02.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.707+0000 7f0f7039d640 1 -- 10.20.193.58:0/3604072371 wait complete. 2026-02-23T06:21:02.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.712+0000 7f0f7039d640 1 Processor -- start 2026-02-23T06:21:02.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.712+0000 7f0f7039d640 1 -- start start 2026-02-23T06:21:02.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.713+0000 7f0f7039d640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0f600352c0 0x7f0f600d8e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.713+0000 7f0f7039d640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6004d2a0 0x7f0f600dc120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.713+0000 7f0f6d911640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6004d2a0 0x7f0f600dc120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.713+0000 7f0f6d911640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6004d2a0 0x7f0f600dc120 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:48684/0 (socket says 10.20.193.58:48684) 2026-02-23T06:21:02.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.713+0000 7f0f6d911640 1 -- 10.20.193.58:0/2273819575 learned_addr learned my addr 10.20.193.58:0/2273819575 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:02.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.713+0000 7f0f7039d640 1 --2- 10.20.193.58:0/2273819575 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0f600fd260 0x7f0f600dc660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.713+0000 7f0f7039d640 1 -- 10.20.193.58:0/2273819575 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f0f600d50f0 con 0x7f0f6004d2a0 2026-02-23T06:21:02.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.713+0000 7f0f7039d640 1 -- 10.20.193.58:0/2273819575 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f0f600e9070 con 0x7f0f600fd260 2026-02-23T06:21:02.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.713+0000 7f0f7039d640 1 -- 10.20.193.58:0/2273819575 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f0f600e9350 con 0x7f0f600352c0 2026-02-23T06:21:02.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.713+0000 7f0f6f114640 1 --2- 10.20.193.58:0/2273819575 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0f600fd260 0x7f0f600dc660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.714+0000 7f0f6e112640 1 --2- 10.20.193.58:0/2273819575 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0f600352c0 0x7f0f600d8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.714+0000 7f0f6d911640 1 -- 10.20.193.58:0/2273819575 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0f600352c0 msgr2=0x7f0f600d8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.714+0000 7f0f6d911640 1 --2- 10.20.193.58:0/2273819575 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0f600352c0 0x7f0f600d8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.714+0000 7f0f6d911640 1 -- 10.20.193.58:0/2273819575 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0f600fd260 msgr2=0x7f0f600dc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.714+0000 7f0f6d911640 1 --2- 10.20.193.58:0/2273819575 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0f600fd260 0x7f0f600dc660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.714+0000 7f0f6d911640 1 -- 10.20.193.58:0/2273819575 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f580094b0 con 0x7f0f6004d2a0 2026-02-23T06:21:02.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.715+0000 7f0f6d911640 1 --2- 10.20.193.58:0/2273819575 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6004d2a0 0x7f0f600dc120 secure :-1 s=READY pgs=33 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f5c00b260 tx=0x7f0f5c00df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:02.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.715+0000 7f0f4effd640 1 -- 10.20.193.58:0/2273819575 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0f5c0042f0 con 0x7f0f6004d2a0 2026-02-23T06:21:02.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.715+0000 7f0f7039d640 1 -- 10.20.193.58:0/2273819575 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f600e9630 con 0x7f0f6004d2a0 2026-02-23T06:21:02.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.715+0000 7f0f7039d640 1 -- 10.20.193.58:0/2273819575 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f600e9bf0 con 0x7f0f6004d2a0 2026-02-23T06:21:02.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.716+0000 7f0f4effd640 1 -- 10.20.193.58:0/2273819575 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f5c004540 con 0x7f0f6004d2a0 2026-02-23T06:21:02.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.716+0000 7f0f4effd640 1 -- 10.20.193.58:0/2273819575 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0f5c0042f0 con 0x7f0f6004d2a0 2026-02-23T06:21:02.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.717+0000 7f0f4effd640 1 -- 10.20.193.58:0/2273819575 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f0f5c0026a0 con 0x7f0f6004d2a0 2026-02-23T06:21:02.712 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.717+0000 7f0f4effd640 1 -- 10.20.193.58:0/2273819575 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f0f5c010b90 con 0x7f0f6004d2a0 2026-02-23T06:21:02.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.719+0000 7efc5d483640 1 -- 10.20.193.58:0/2757284761 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7efc18005950 con 0x7efc5815f990 2026-02-23T06:21:02.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.718+0000 7f0f4cff9640 1 -- 10.20.193.58:0/2273819575 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f60007010 con 0x7f0f6004d2a0 2026-02-23T06:21:02.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.722+0000 7efc54ff9640 1 -- 10.20.193.58:0/2757284761 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v20)=0 v20) ==== 120+0+0 (secure 0 0 0) 0x7efc40040b50 con 0x7efc5815f990 2026-02-23T06:21:02.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.723+0000 7efc2e7fc640 1 -- 10.20.193.58:0/2757284761 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc5815f990 msgr2=0x7efc58145890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.723+0000 7efc2e7fc640 1 --2- 10.20.193.58:0/2757284761 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc5815f990 0x7efc58145890 secure :-1 s=READY pgs=34 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc40009230 tx=0x7efc40002a10 comp rx=0 tx=0).stop 2026-02-23T06:21:02.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.723+0000 7efc2e7fc640 1 -- 10.20.193.58:0/2757284761 shutdown_connections 2026-02-23T06:21:02.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.723+0000 7efc2e7fc640 1 --2- 10.20.193.58:0/2757284761 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc5815f990 0x7efc58145890 unknown :-1 s=CLOSED pgs=34 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.723+0000 7efc2e7fc640 1 --2- 10.20.193.58:0/2757284761 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc5815f5c0 0x7efc5815e380 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.723+0000 7efc2e7fc640 1 --2- 10.20.193.58:0/2757284761 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc5805d8b0 0x7efc58133350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.723+0000 7efc2e7fc640 1 -- 10.20.193.58:0/2757284761 >> 10.20.193.58:0/2757284761 conn(0x7efc580b3c20 msgr2=0x7efc58163d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.723+0000 7efc2e7fc640 1 -- 10.20.193.58:0/2757284761 shutdown_connections 2026-02-23T06:21:02.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.723+0000 7efc2e7fc640 1 -- 10.20.193.58:0/2757284761 wait complete. 2026-02-23T06:21:02.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.727+0000 7f0f4effd640 1 -- 10.20.193.58:0/2273819575 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f0f60007010 con 0x7f0f6004d2a0 2026-02-23T06:21:02.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.730+0000 7f7f7f25b640 1 -- 10.20.193.58:0/1573283761 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7f7815be70 msgr2=0x7f7f780b1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.730+0000 7f7f6f7fe640 1 -- 10.20.193.58:0/1573283761 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f6802fd00 con 0x7f7f7815be70 2026-02-23T06:21:02.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.730+0000 7f7f7f25b640 1 --2- 10.20.193.58:0/1573283761 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7f7815be70 0x7f7f780b1310 secure :-1 s=READY pgs=35 gs=2 cs=0 l=1 c_cookie=7080719894563889011 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f68005e70 tx=0x7f7f6802f280 comp rx=0 tx=0).stop 2026-02-23T06:21:02.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.731+0000 7f7f7f25b640 1 -- 10.20.193.58:0/1573283761 shutdown_connections 2026-02-23T06:21:02.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.731+0000 7f7f7f25b640 1 --2- 10.20.193.58:0/1573283761 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7f780b39f0 0x7f7f780b1850 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.731+0000 7f7f7f25b640 1 --2- 10.20.193.58:0/1573283761 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7f7815be70 0x7f7f780b1310 unknown :-1 s=CLOSED pgs=35 gs=2 cs=0 l=1 c_cookie=7080719894563889011 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.731+0000 7f7f7f25b640 1 -- 10.20.193.58:0/1573283761 >> 10.20.193.58:0/1573283761 conn(0x7f7f78058e50 msgr2=0x7f7f78059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.731+0000 7f7f7f25b640 1 -- 10.20.193.58:0/1573283761 shutdown_connections 2026-02-23T06:21:02.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.731+0000 7f7f7f25b640 1 -- 10.20.193.58:0/1573283761 wait complete. 2026-02-23T06:21:02.727 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.732+0000 7f7f7f25b640 1 Processor -- start 2026-02-23T06:21:02.727 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.732+0000 7f7f7f25b640 1 -- start start 2026-02-23T06:21:02.727 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.733+0000 7f7f7f25b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7f780b39f0 0x7f7f7815af50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.728 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.733+0000 7f7f7f25b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7f7815baa0 0x7f7f7812a1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.728 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.733+0000 7f7f7f25b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7f7815be70 0x7f7f7813b500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.734+0000 7f7f7f25b640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7812c780 con 0x7f7f780b39f0 2026-02-23T06:21:02.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.734+0000 7f7f7d7d1640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7f7815be70 0x7f7f7813b500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.734+0000 7f744cff9640 1 -- 10.20.193.58:0/3117359751 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f7420005880 con 0x7f745c15d240 2026-02-23T06:21:02.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.734+0000 7f7f6ffff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7f7815baa0 0x7f7f7812a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.734+0000 7f7f7d7d1640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7f7815be70 0x7f7f7813b500 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:55868/0 (socket says 10.20.193.58:55868) 2026-02-23T06:21:02.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.734+0000 7f7f7d7d1640 1 -- 10.20.193.58:0/1767293377 learned_addr learned my addr 10.20.193.58:0/1767293377 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:02.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.734+0000 7f7f7f25b640 1 -- 10.20.193.58:0/1767293377 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7812b330 con 0x7f7f7815be70 2026-02-23T06:21:02.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.734+0000 7f7f7f25b640 1 -- 10.20.193.58:0/1767293377 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f7f7820e100 con 0x7f7f7815baa0 2026-02-23T06:21:02.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.734+0000 7f7f7cfd0640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7f780b39f0 0x7f7f7815af50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.734+0000 7f7f7d7d1640 1 -- 10.20.193.58:0/1767293377 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7f7815baa0 msgr2=0x7f7f7812a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.735+0000 7f7f7d7d1640 1 --2- 10.20.193.58:0/1767293377 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7f7815baa0 0x7f7f7812a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.735+0000 7f7f7d7d1640 1 -- 10.20.193.58:0/1767293377 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7f780b39f0 msgr2=0x7f7f7815af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.735+0000 7f7f7d7d1640 1 --2- 10.20.193.58:0/1767293377 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7f780b39f0 0x7f7f7815af50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.736+0000 7f744effd640 1 -- 10.20.193.58:0/3117359751 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v21)=0 v21) ==== 111+0+0 (secure 0 0 0) 0x7f744804a930 con 0x7f745c15d240 2026-02-23T06:21:02.733 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.735+0000 7f7f7d7d1640 1 -- 10.20.193.58:0/1767293377 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f68009570 con 0x7f7f7815be70 2026-02-23T06:21:02.733 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.735+0000 7f7f7d7d1640 1 --2- 10.20.193.58:0/1767293377 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7f7815be70 0x7f7f7813b500 secure :-1 s=READY pgs=40 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f74006fd0 tx=0x7f7f7400dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:02.733 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.736+0000 7f7f6d7fa640 1 -- 10.20.193.58:0/1767293377 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f74005560 con 0x7f7f7815be70 2026-02-23T06:21:02.733 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.736+0000 7f7f6d7fa640 1 -- 10.20.193.58:0/1767293377 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f74008800 con 0x7f7f7815be70 2026-02-23T06:21:02.733 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.737+0000 7f7f6d7fa640 1 -- 10.20.193.58:0/1767293377 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f74008c30 con 0x7f7f7815be70 2026-02-23T06:21:02.733 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.737+0000 7f7f7f25b640 1 -- 10.20.193.58:0/1767293377 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f7812c4e0 con 0x7f7f7815be70 2026-02-23T06:21:02.733 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.737+0000 7f7f7f25b640 1 -- 10.20.193.58:0/1767293377 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f7820d620 con 0x7f7f7815be70 2026-02-23T06:21:02.733 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.737+0000 7f7f7cfd0640 1 --2- 10.20.193.58:0/1767293377 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7f780b39f0 0x7f7f7815af50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:21:02.733 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.738+0000 7f7f6d7fa640 1 -- 10.20.193.58:0/1767293377 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f7f74003b90 con 0x7f7f7815be70 2026-02-23T06:21:02.734 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.738+0000 7f9bdb577640 1 -- 10.20.193.58:0/3729149595 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9bdc15c040 msgr2=0x7f9bdc05b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.734 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.738+0000 7f9bdb577640 1 --2- 10.20.193.58:0/3729149595 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9bdc15c040 0x7f9bdc05b0e0 secure :-1 s=READY pgs=21 gs=2 cs=0 l=1 c_cookie=8082033764752778126 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bd0005e70 tx=0x7f9bd002f2d0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.734 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.738+0000 7f7f6d7fa640 1 -- 10.20.193.58:0/1767293377 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f7f7400f3b0 con 0x7f7f7815be70 2026-02-23T06:21:02.734 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.738+0000 7f7f7f25b640 1 -- 10.20.193.58:0/1767293377 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f780b6310 con 0x7f7f7815be70 2026-02-23T06:21:02.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.739+0000 7f9bdb577640 1 -- 10.20.193.58:0/3729149595 shutdown_connections 2026-02-23T06:21:02.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.739+0000 7f9bdb577640 1 --2- 10.20.193.58:0/3729149595 >> v2:10.20.193.58:3300/0 conn(0x7f9bdc0b5680 0x7f9bdc0b5b20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.739+0000 7f9bdb577640 1 --2- 10.20.193.58:0/3729149595 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9bdc15c040 0x7f9bdc05b0e0 unknown :-1 s=CLOSED pgs=21 gs=2 cs=0 l=1 c_cookie=8082033764752778126 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.741+0000 7f9bdb577640 1 -- 10.20.193.58:0/3729149595 >> 10.20.193.58:0/3729149595 conn(0x7f9bdc0b3c20 msgr2=0x7f9bdc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.741+0000 7f9bdb577640 1 -- 10.20.193.58:0/3729149595 shutdown_connections 2026-02-23T06:21:02.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.741+0000 7f9bdb577640 1 -- 10.20.193.58:0/3729149595 wait complete. 2026-02-23T06:21:02.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.742+0000 7f9bdb577640 1 Processor -- start 2026-02-23T06:21:02.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.743+0000 7f9bdb577640 1 -- start start 2026-02-23T06:21:02.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.743+0000 7f9bdb577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9bdc056550 0x7f9bdc1615d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.743+0000 7f9bdb577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9bdc0b5680 0x7f9bdc160790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.743+0000 7f9bdb577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9bdc15c040 0x7f9bdc13db80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.743+0000 7f9bdb577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc13d6f0 con 0x7f9bdc056550 2026-02-23T06:21:02.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.743+0000 7f9bdb577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc162290 con 0x7f9bdc0b5680 2026-02-23T06:21:02.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.743+0000 7f9bdb577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f9bdc161ff0 con 0x7f9bdc15c040 2026-02-23T06:21:02.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.744+0000 7f9bd9d74640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9bdc0b5680 0x7f9bdc160790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.740 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.744+0000 7f9bd9d74640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9bdc0b5680 0x7f9bdc160790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:55884/0 (socket says 10.20.193.58:55884) 2026-02-23T06:21:02.740 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.744+0000 7f9bd9d74640 1 -- 10.20.193.58:0/2097311357 learned_addr learned my addr 10.20.193.58:0/2097311357 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:02.740 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.744+0000 7f9bdad76640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9bdc15c040 0x7f9bdc13db80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.740 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.739+0000 7f744cff9640 1 -- 10.20.193.58:0/3117359751 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f745c15d240 msgr2=0x7f745c119420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.740 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.739+0000 7f744cff9640 1 --2- 10.20.193.58:0/3117359751 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f745c15d240 0x7f745c119420 secure :-1 s=READY pgs=37 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7448004740 tx=0x7f74480028d0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.740 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.739+0000 7f744cff9640 1 -- 10.20.193.58:0/3117359751 shutdown_connections 2026-02-23T06:21:02.740 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.739+0000 7f744cff9640 1 --2- 10.20.193.58:0/3117359751 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f745c1635a0 0x7f745c13cd90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.739+0000 7f744cff9640 1 --2- 10.20.193.58:0/3117359751 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f745c15d240 0x7f745c119420 unknown :-1 s=CLOSED pgs=37 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.739+0000 7f744cff9640 1 --2- 10.20.193.58:0/3117359751 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f745c0b62f0 0x7f745c13ae30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.739+0000 7f744cff9640 1 -- 10.20.193.58:0/3117359751 >> 10.20.193.58:0/3117359751 conn(0x7f745c058e50 msgr2=0x7f745c0b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.739+0000 7f744cff9640 1 -- 10.20.193.58:0/3117359751 shutdown_connections 2026-02-23T06:21:02.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.739+0000 7f744cff9640 1 -- 10.20.193.58:0/3117359751 wait complete. 2026-02-23T06:21:02.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.743+0000 7f7f6d7fa640 1 -- 10.20.193.58:0/1767293377 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f7f7401e060 con 0x7f7f7815be70 2026-02-23T06:21:02.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.744+0000 7f9bd9d74640 1 -- 10.20.193.58:0/2097311357 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9bdc15c040 msgr2=0x7f9bdc13db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.744+0000 7f9bd9d74640 1 --2- 10.20.193.58:0/2097311357 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9bdc15c040 0x7f9bdc13db80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.744+0000 7f9bd9d74640 1 -- 10.20.193.58:0/2097311357 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9bdc056550 msgr2=0x7f9bdc1615d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.744+0000 7f9bd9d74640 1 --2- 10.20.193.58:0/2097311357 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9bdc056550 0x7f9bdc1615d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.744+0000 7f9bd9d74640 1 -- 10.20.193.58:0/2097311357 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd0009570 con 0x7f9bdc0b5680 2026-02-23T06:21:02.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.744+0000 7f9bd9d74640 1 --2- 10.20.193.58:0/2097311357 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9bdc0b5680 0x7f9bdc160790 secure :-1 s=READY pgs=41 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bc400c4b0 tx=0x7f9bc400c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:02.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.745+0000 7f9bc2ffd640 1 -- 10.20.193.58:0/2097311357 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9bc4006ab0 con 0x7f9bdc0b5680 2026-02-23T06:21:02.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.745+0000 7f9bc2ffd640 1 -- 10.20.193.58:0/2097311357 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9bc4006d00 con 0x7f9bdc0b5680 2026-02-23T06:21:02.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.745+0000 7f9bc2ffd640 1 -- 10.20.193.58:0/2097311357 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9bc40072b0 con 0x7f9bdc0b5680 2026-02-23T06:21:02.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.745+0000 7f9bdb577640 1 -- 10.20.193.58:0/2097311357 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bdc201700 con 0x7f9bdc0b5680 2026-02-23T06:21:02.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.745+0000 7f9bdb577640 1 -- 10.20.193.58:0/2097311357 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bdc13d0a0 con 0x7f9bdc0b5680 2026-02-23T06:21:02.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.745+0000 7f9bc2ffd640 1 -- 10.20.193.58:0/2097311357 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f9bc4019070 con 0x7f9bdc0b5680 2026-02-23T06:21:02.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.745+0000 7f9bc2ffd640 1 -- 10.20.193.58:0/2097311357 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f9bc401bb90 con 0x7f9bdc0b5680 2026-02-23T06:21:02.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.746+0000 7f9bdb577640 1 -- 10.20.193.58:0/2097311357 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bdc05d9c0 con 0x7f9bdc0b5680 2026-02-23T06:21:02.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.747+0000 7f9bc2ffd640 1 -- 10.20.193.58:0/2097311357 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f9bc401b400 con 0x7f9bdc0b5680 2026-02-23T06:21:02.744 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.748+0000 7f549ffff640 1 -- 10.20.193.58:0/658009361 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f5460005b30 con 0x7f54a015bf20 2026-02-23T06:21:02.745 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.751+0000 7f9126243640 1 -- 10.20.193.58:0/1596019106 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f9120054e30 con 0x7f91200bc000 2026-02-23T06:21:02.749 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.755+0000 7f547f7fe640 1 -- 10.20.193.58:0/658009361 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v22)=0 v22) ==== 120+0+0 (secure 0 0 0) 0x7f548804f060 con 0x7f54a015bf20 2026-02-23T06:21:02.752 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.757+0000 7f910dffb640 1 -- 10.20.193.58:0/1596019106 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v23)=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f9114005b20 con 0x7f91200bc000 2026-02-23T06:21:02.753 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.758+0000 7efc6121b640 1 -- 10.20.193.58:0/1836732051 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc54035a10 msgr2=0x7efc5404de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.753 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.758+0000 7efc6121b640 1 --2- 10.20.193.58:0/1836732051 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc54035a10 0x7efc5404de70 secure :-1 s=READY pgs=43 gs=2 cs=0 l=1 c_cookie=13416867994837506940 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc44004740 tx=0x7efc4402f1d0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.753 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.758+0000 7efc6121b640 1 -- 10.20.193.58:0/1836732051 shutdown_connections 2026-02-23T06:21:02.753 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.758+0000 7efc6121b640 1 --2- 10.20.193.58:0/1836732051 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc5404f230 0x7efc5404e3b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.753 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.758+0000 7efc6121b640 1 --2- 10.20.193.58:0/1836732051 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc54035a10 0x7efc5404de70 unknown :-1 s=CLOSED pgs=43 gs=2 cs=0 l=1 c_cookie=13416867994837506940 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.753 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.758+0000 7efc6121b640 1 -- 10.20.193.58:0/1836732051 >> 10.20.193.58:0/1836732051 conn(0x7efc5400a790 msgr2=0x7efc5400bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.753 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.758+0000 7efc6121b640 1 -- 10.20.193.58:0/1836732051 shutdown_connections 2026-02-23T06:21:02.753 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.758+0000 7efc6121b640 1 -- 10.20.193.58:0/1836732051 wait complete. 2026-02-23T06:21:02.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.758+0000 7f9126243640 1 -- 10.20.193.58:0/1596019106 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f91200bc000 msgr2=0x7f9120162070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.758+0000 7f9126243640 1 --2- 10.20.193.58:0/1596019106 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f91200bc000 0x7f9120162070 secure :-1 s=READY pgs=20 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91140023d0 tx=0x7f9114002a10 comp rx=0 tx=0).stop 2026-02-23T06:21:02.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.758+0000 7f9126243640 1 -- 10.20.193.58:0/1596019106 shutdown_connections 2026-02-23T06:21:02.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.758+0000 7f9126243640 1 --2- 10.20.193.58:0/1596019106 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f912016d770 0x7f91201625b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.758+0000 7f9126243640 1 --2- 10.20.193.58:0/1596019106 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f91200bc000 0x7f9120162070 unknown :-1 s=CLOSED pgs=20 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.758+0000 7f9126243640 1 --2- 10.20.193.58:0/1596019106 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9120055130 0x7f912016a8f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.758+0000 7f9126243640 1 -- 10.20.193.58:0/1596019106 >> 10.20.193.58:0/1596019106 conn(0x7f91200571f0 msgr2=0x7f91200b6140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.758+0000 7f9126243640 1 -- 10.20.193.58:0/1596019106 shutdown_connections 2026-02-23T06:21:02.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.758+0000 7f9126243640 1 -- 10.20.193.58:0/1596019106 wait complete. 2026-02-23T06:21:02.757 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.759+0000 7efc6121b640 1 Processor -- start 2026-02-23T06:21:02.757 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.759+0000 7efc6121b640 1 -- start start 2026-02-23T06:21:02.757 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.760+0000 7efc6121b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc54035a10 0x7efc54048d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.757 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.760+0000 7efc6121b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc5404f230 0x7efc540b4d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.757 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.760+0000 7efc6121b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc540f5aa0 0x7efc5404ff50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.757 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.760+0000 7efc6121b640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7efc540b4610 con 0x7efc5404f230 2026-02-23T06:21:02.757 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.760+0000 7efc6121b640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7efc54048a60 con 0x7efc540f5aa0 2026-02-23T06:21:02.757 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.760+0000 7efc6121b640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7efc540d5170 con 0x7efc54035a10 2026-02-23T06:21:02.757 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.761+0000 7efc5ad76640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc540f5aa0 0x7efc5404ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.757 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.761+0000 7efc5ad76640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc540f5aa0 0x7efc5404ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:55910/0 (socket says 10.20.193.58:55910) 2026-02-23T06:21:02.757 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.761+0000 7efc5ad76640 1 -- 10.20.193.58:0/3491262915 learned_addr learned my addr 10.20.193.58:0/3491262915 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:02.757 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.761+0000 7efc5a575640 1 --2- 10.20.193.58:0/3491262915 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc54035a10 0x7efc54048d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.758 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.761+0000 7efc5a575640 1 -- 10.20.193.58:0/3491262915 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc540f5aa0 msgr2=0x7efc5404ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.758 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.761+0000 7efc5a575640 1 --2- 10.20.193.58:0/3491262915 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc540f5aa0 0x7efc5404ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.758 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.761+0000 7efc5a575640 1 -- 10.20.193.58:0/3491262915 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc5404f230 msgr2=0x7efc540b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.758 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.761+0000 7efc5a575640 1 --2- 10.20.193.58:0/3491262915 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc5404f230 0x7efc540b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.758 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.761+0000 7efc5a575640 1 -- 10.20.193.58:0/3491262915 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc440094b0 con 0x7efc54035a10 2026-02-23T06:21:02.758 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.761+0000 7efc5a575640 1 --2- 10.20.193.58:0/3491262915 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc54035a10 0x7efc54048d20 secure :-1 s=READY pgs=22 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc50003810 tx=0x7efc50011740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:02.758 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.761+0000 7efc3b7fe640 1 -- 10.20.193.58:0/3491262915 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc50019070 con 0x7efc54035a10 2026-02-23T06:21:02.758 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.762+0000 7efc3b7fe640 1 -- 10.20.193.58:0/3491262915 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc50006500 con 0x7efc54035a10 2026-02-23T06:21:02.758 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.762+0000 7efc3b7fe640 1 -- 10.20.193.58:0/3491262915 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc50011ea0 con 0x7efc54035a10 2026-02-23T06:21:02.759 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.762+0000 7efc6121b640 1 -- 10.20.193.58:0/3491262915 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc540d53c0 con 0x7efc54035a10 2026-02-23T06:21:02.759 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.762+0000 7efc6121b640 1 -- 10.20.193.58:0/3491262915 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efc540473a0 con 0x7efc54035a10 2026-02-23T06:21:02.759 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.763+0000 7efc3b7fe640 1 -- 10.20.193.58:0/3491262915 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7efc50026060 con 0x7efc54035a10 2026-02-23T06:21:02.760 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.763+0000 7efc397fa640 1 -- 10.20.193.58:0/3491262915 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc54007010 con 0x7efc54035a10 2026-02-23T06:21:02.760 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.763+0000 7efc3b7fe640 1 -- 10.20.193.58:0/3491262915 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7efc50012710 con 0x7efc54035a10 2026-02-23T06:21:02.760 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.765+0000 7efc3b7fe640 1 -- 10.20.193.58:0/3491262915 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7efc54007010 con 0x7efc54035a10 2026-02-23T06:21:02.760 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.764+0000 7f549ffff640 1 -- 10.20.193.58:0/658009361 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f54a015bf20 msgr2=0x7f54a013a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.760 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.764+0000 7f549ffff640 1 --2- 10.20.193.58:0/658009361 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f54a015bf20 0x7f54a013a200 secure :-1 s=READY pgs=32 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5488004740 tx=0x7f5488002a90 comp rx=0 tx=0).stop 2026-02-23T06:21:02.760 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.765+0000 7f549ffff640 1 -- 10.20.193.58:0/658009361 shutdown_connections 2026-02-23T06:21:02.761 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.765+0000 7f549ffff640 1 --2- 10.20.193.58:0/658009361 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f54a015c2f0 0x7f54a013a740 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.761 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.765+0000 7f549ffff640 1 --2- 10.20.193.58:0/658009361 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f54a015bf20 0x7f54a013a200 unknown :-1 s=CLOSED pgs=32 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.761 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.765+0000 7f549ffff640 1 --2- 10.20.193.58:0/658009361 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f54a0056550 0x7f54a00589e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.761 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.765+0000 7f549ffff640 1 -- 10.20.193.58:0/658009361 >> 10.20.193.58:0/658009361 conn(0x7f54a00b3c20 msgr2=0x7f54a0163530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.761 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.765+0000 7f549ffff640 1 -- 10.20.193.58:0/658009361 shutdown_connections 2026-02-23T06:21:02.761 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.765+0000 7f549ffff640 1 -- 10.20.193.58:0/658009361 wait complete. 2026-02-23T06:21:02.761 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.765+0000 7f0f4cff9640 1 -- 10.20.193.58:0/2273819575 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f0f6004a8f0 con 0x7f0f6004d2a0 2026-02-23T06:21:02.761 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.766+0000 7f6d08ccc640 1 -- 10.20.193.58:0/126762705 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f6ccc005880 con 0x7f6d04203040 2026-02-23T06:21:02.762 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.768+0000 7f0f4effd640 1 -- 10.20.193.58:0/2273819575 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v24)=0 v24) ==== 106+0+0 (secure 0 0 0) 0x7f0f60007010 con 0x7f0f6004d2a0 2026-02-23T06:21:02.763 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.769+0000 7f0f7039d640 1 -- 10.20.193.58:0/2273819575 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6004d2a0 msgr2=0x7f0f600dc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.764 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.769+0000 7f0f7039d640 1 --2- 10.20.193.58:0/2273819575 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6004d2a0 0x7f0f600dc120 secure :-1 s=READY pgs=33 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f5c00b260 tx=0x7f0f5c00df30 comp rx=0 tx=0).stop 2026-02-23T06:21:02.764 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.769+0000 7f0f7039d640 1 -- 10.20.193.58:0/2273819575 shutdown_connections 2026-02-23T06:21:02.764 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.769+0000 7f0f7039d640 1 --2- 10.20.193.58:0/2273819575 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0f600fd260 0x7f0f600dc660 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.764 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.769+0000 7f0f7039d640 1 --2- 10.20.193.58:0/2273819575 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6004d2a0 0x7f0f600dc120 unknown :-1 s=CLOSED pgs=33 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.764 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.769+0000 7f0f7039d640 1 --2- 10.20.193.58:0/2273819575 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0f600352c0 0x7f0f600d8e30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.764 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.769+0000 7f0f7039d640 1 -- 10.20.193.58:0/2273819575 >> 10.20.193.58:0/2273819575 conn(0x7f0f6000a5f0 msgr2=0x7f0f600fc720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.764 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.769+0000 7f0f7039d640 1 -- 10.20.193.58:0/2273819575 shutdown_connections 2026-02-23T06:21:02.764 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.769+0000 7f0f7039d640 1 -- 10.20.193.58:0/2273819575 wait complete. 2026-02-23T06:21:02.765 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.769+0000 7f6ceeffd640 1 -- 10.20.193.58:0/126762705 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v25)=0 v25) ==== 108+0+0 (secure 0 0 0) 0x7f6cf4011e00 con 0x7f6d04203040 2026-02-23T06:21:02.766 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.770+0000 7f6cecff9640 1 -- 10.20.193.58:0/126762705 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6d04203040 msgr2=0x7f6d04203470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.766 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.770+0000 7f6cecff9640 1 --2- 10.20.193.58:0/126762705 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6d04203040 0x7f6d04203470 secure :-1 s=READY pgs=28 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d040b74e0 tx=0x7f6cf400a440 comp rx=0 tx=0).stop 2026-02-23T06:21:02.766 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.771+0000 7f6cecff9640 1 -- 10.20.193.58:0/126762705 shutdown_connections 2026-02-23T06:21:02.766 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.771+0000 7f6cecff9640 1 --2- 10.20.193.58:0/126762705 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6d04203040 0x7f6d04203470 unknown :-1 s=CLOSED pgs=28 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.766 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.771+0000 7f6cecff9640 1 --2- 10.20.193.58:0/126762705 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6d0415fac0 0x7f6d04168fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.766 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.771+0000 7f6cecff9640 1 --2- 10.20.193.58:0/126762705 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6ce8004850 0x7f6d0405c600 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.766 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.771+0000 7f6cecff9640 1 -- 10.20.193.58:0/126762705 >> 10.20.193.58:0/126762705 conn(0x7f6d04058e50 msgr2=0x7f6d040b75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.766 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.771+0000 7f6cecff9640 1 -- 10.20.193.58:0/126762705 shutdown_connections 2026-02-23T06:21:02.766 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.771+0000 7f6cecff9640 1 -- 10.20.193.58:0/126762705 wait complete. 2026-02-23T06:21:02.767 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial058') 2026-02-23T06:21:02.768 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial058') 2026-02-23T06:21:02.774 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.779+0000 7f9bdb577640 1 -- 10.20.193.58:0/2097311357 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f9bdc056330 con 0x7f9bdc0b5680 2026-02-23T06:21:02.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.782+0000 7f9bc2ffd640 1 -- 10.20.193.58:0/2097311357 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v26)=0 v26) ==== 121+0+0 (secure 0 0 0) 0x7f9bc401bde0 con 0x7f9bdc0b5680 2026-02-23T06:21:02.779 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='trial058') 2026-02-23T06:21:02.779 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='trial058') 2026-02-23T06:21:02.779 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='trial058') 2026-02-23T06:21:02.780 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='trial058') 2026-02-23T06:21:02.780 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='trial058') 2026-02-23T06:21:02.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.785+0000 7f9bdb577640 1 -- 10.20.193.58:0/2097311357 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9bdc0b5680 msgr2=0x7f9bdc160790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.785+0000 7f9bdb577640 1 --2- 10.20.193.58:0/2097311357 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9bdc0b5680 0x7f9bdc160790 secure :-1 s=READY pgs=41 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bc400c4b0 tx=0x7f9bc400c980 comp rx=0 tx=0).stop 2026-02-23T06:21:02.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.786+0000 7f9bdb577640 1 -- 10.20.193.58:0/2097311357 shutdown_connections 2026-02-23T06:21:02.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.786+0000 7f9bdb577640 1 --2- 10.20.193.58:0/2097311357 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9bdc15c040 0x7f9bdc13db80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.786+0000 7f9bdb577640 1 --2- 10.20.193.58:0/2097311357 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9bdc0b5680 0x7f9bdc160790 unknown :-1 s=CLOSED pgs=41 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.786+0000 7f9bdb577640 1 --2- 10.20.193.58:0/2097311357 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9bdc056550 0x7f9bdc1615d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.786+0000 7f9bdb577640 1 -- 10.20.193.58:0/2097311357 >> 10.20.193.58:0/2097311357 conn(0x7f9bdc0b3c20 msgr2=0x7f9bdc0b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.786+0000 7f9bdb577640 1 -- 10.20.193.58:0/2097311357 shutdown_connections 2026-02-23T06:21:02.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.786+0000 7f9bdb577640 1 -- 10.20.193.58:0/2097311357 wait complete. 2026-02-23T06:21:02.782 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.786+0000 7f7f7f25b640 1 -- 10.20.193.58:0/1767293377 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f7f780b3100 con 0x7f7f7815be70 2026-02-23T06:21:02.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.788+0000 7f7f6d7fa640 1 -- 10.20.193.58:0/1767293377 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v27)=0 v27) ==== 125+0+0 (secure 0 0 0) 0x7f7f74014070 con 0x7f7f7815be70 2026-02-23T06:21:02.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.789+0000 7f7f7f25b640 1 -- 10.20.193.58:0/1767293377 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7f7815be70 msgr2=0x7f7f7813b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.789+0000 7f7f7f25b640 1 --2- 10.20.193.58:0/1767293377 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7f7815be70 0x7f7f7813b500 secure :-1 s=READY pgs=40 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f74006fd0 tx=0x7f7f7400dde0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.789+0000 7f7f7f25b640 1 -- 10.20.193.58:0/1767293377 shutdown_connections 2026-02-23T06:21:02.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.789+0000 7f7f7f25b640 1 --2- 10.20.193.58:0/1767293377 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7f7815be70 0x7f7f7813b500 unknown :-1 s=CLOSED pgs=40 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.789+0000 7f7f7f25b640 1 --2- 10.20.193.58:0/1767293377 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7f7815baa0 0x7f7f7812a1b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.789+0000 7f7f7f25b640 1 --2- 10.20.193.58:0/1767293377 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7f780b39f0 0x7f7f7815af50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.789+0000 7f7f7f25b640 1 -- 10.20.193.58:0/1767293377 >> 10.20.193.58:0/1767293377 conn(0x7f7f78058e50 msgr2=0x7f7f780b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.789+0000 7f7f7f25b640 1 -- 10.20.193.58:0/1767293377 shutdown_connections 2026-02-23T06:21:02.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.789+0000 7f7f7f25b640 1 -- 10.20.193.58:0/1767293377 wait complete. 2026-02-23T06:21:02.794 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.800+0000 7efc397fa640 1 -- 10.20.193.58:0/3491262915 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7efc54044df0 con 0x7efc54035a10 2026-02-23T06:21:02.795 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='trial058') 2026-02-23T06:21:02.795 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial058') 2026-02-23T06:21:02.796 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.802+0000 7efc3b7fe640 1 -- 10.20.193.58:0/3491262915 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v28)=0 v28) ==== 121+0+0 (secure 0 0 0) 0x7efc50004c00 con 0x7efc54035a10 2026-02-23T06:21:02.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.802+0000 7efc397fa640 1 -- 10.20.193.58:0/3491262915 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc54035a10 msgr2=0x7efc54048d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.803+0000 7efc397fa640 1 --2- 10.20.193.58:0/3491262915 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc54035a10 0x7efc54048d20 secure :-1 s=READY pgs=22 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc50003810 tx=0x7efc50011740 comp rx=0 tx=0).stop 2026-02-23T06:21:02.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.803+0000 7efc397fa640 1 -- 10.20.193.58:0/3491262915 shutdown_connections 2026-02-23T06:21:02.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.803+0000 7efc397fa640 1 --2- 10.20.193.58:0/3491262915 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc540f5aa0 0x7efc5404ff50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.803+0000 7efc397fa640 1 --2- 10.20.193.58:0/3491262915 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc5404f230 0x7efc540b4d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.803+0000 7efc397fa640 1 --2- 10.20.193.58:0/3491262915 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc54035a10 0x7efc54048d20 unknown :-1 s=CLOSED pgs=22 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.803+0000 7efc397fa640 1 -- 10.20.193.58:0/3491262915 >> 10.20.193.58:0/3491262915 conn(0x7efc5400a790 msgr2=0x7efc540fb210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.803+0000 7efc397fa640 1 -- 10.20.193.58:0/3491262915 shutdown_connections 2026-02-23T06:21:02.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.803+0000 7efc397fa640 1 -- 10.20.193.58:0/3491262915 wait complete. 2026-02-23T06:21:02.807 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config dump 2026-02-23T06:21:02.963 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.968+0000 7fce6bfff640 1 -- 10.20.193.58:0/3842820406 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fce6c0b5680 msgr2=0x7fce6c0b5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.963 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.968+0000 7fce6bfff640 1 --2- 10.20.193.58:0/3842820406 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fce6c0b5680 0x7fce6c0b5ac0 secure :-1 s=READY pgs=45 gs=3 cs=0 l=1 c_cookie=9864378985397558484 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce5c005820 tx=0x7fce5c030300 comp rx=0 tx=0).stop 2026-02-23T06:21:02.964 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.968+0000 7fce6bfff640 1 -- 10.20.193.58:0/3842820406 shutdown_connections 2026-02-23T06:21:02.964 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.968+0000 7fce6bfff640 1 --2- 10.20.193.58:0/3842820406 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fce6c0b5680 0x7fce6c0b5ac0 unknown :-1 s=CLOSED pgs=45 gs=3 cs=0 l=1 c_cookie=9864378985397558484 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.964 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.968+0000 7fce6bfff640 1 -- 10.20.193.58:0/3842820406 >> 10.20.193.58:0/3842820406 conn(0x7fce6c0b3c20 msgr2=0x7fce6c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:02.964 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.968+0000 7fce6bfff640 1 -- 10.20.193.58:0/3842820406 shutdown_connections 2026-02-23T06:21:02.964 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.968+0000 7fce6bfff640 1 -- 10.20.193.58:0/3842820406 wait complete. 2026-02-23T06:21:02.967 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.969+0000 7fce6bfff640 1 Processor -- start 2026-02-23T06:21:02.967 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.969+0000 7fce6bfff640 1 -- start start 2026-02-23T06:21:02.967 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.970+0000 7fce6bfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fce6c056550 0x7fce6c151930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.967 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.970+0000 7fce6bfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fce6c0b5680 0x7fce6c1fdef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.967 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.970+0000 7fce6bfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fce6c15c040 0x7fce6c164530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:02.967 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.970+0000 7fce6bfff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fce6c152b90 con 0x7fce6c15c040 2026-02-23T06:21:02.968 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.970+0000 7fce6bfff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fce6c1fd750 con 0x7fce6c0b5680 2026-02-23T06:21:02.968 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.970+0000 7fce6bfff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fce6c201b10 con 0x7fce6c056550 2026-02-23T06:21:02.968 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.970+0000 7fce6a7fc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fce6c0b5680 0x7fce6c1fdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.968 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.970+0000 7fce6a7fc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fce6c0b5680 0x7fce6c1fdef0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:55924/0 (socket says 10.20.193.58:55924) 2026-02-23T06:21:02.968 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.970+0000 7fce6a7fc640 1 -- 10.20.193.58:0/3402090739 learned_addr learned my addr 10.20.193.58:0/3402090739 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:02.968 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.970+0000 7fce6affd640 1 --2- 10.20.193.58:0/3402090739 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fce6c056550 0x7fce6c151930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.968 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.970+0000 7fce6b7fe640 1 --2- 10.20.193.58:0/3402090739 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fce6c15c040 0x7fce6c164530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:02.968 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.971+0000 7fce6b7fe640 1 -- 10.20.193.58:0/3402090739 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fce6c056550 msgr2=0x7fce6c151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.968 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.971+0000 7fce6b7fe640 1 --2- 10.20.193.58:0/3402090739 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fce6c056550 0x7fce6c151930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.968 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.971+0000 7fce6b7fe640 1 -- 10.20.193.58:0/3402090739 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fce6c0b5680 msgr2=0x7fce6c1fdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:02.969 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.971+0000 7fce6b7fe640 1 --2- 10.20.193.58:0/3402090739 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fce6c0b5680 0x7fce6c1fdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:02.969 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.971+0000 7fce6b7fe640 1 -- 10.20.193.58:0/3402090739 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce5c00a590 con 0x7fce6c15c040 2026-02-23T06:21:02.969 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.971+0000 7fce6a7fc640 1 --2- 10.20.193.58:0/3402090739 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fce6c0b5680 0x7fce6c1fdef0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:02.969 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.971+0000 7fce6b7fe640 1 --2- 10.20.193.58:0/3402090739 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fce6c15c040 0x7fce6c164530 secure :-1 s=READY pgs=38 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce5c005820 tx=0x7fce5c003d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:02.969 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.971+0000 7fce4b7fe640 1 -- 10.20.193.58:0/3402090739 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce5c03e070 con 0x7fce6c15c040 2026-02-23T06:21:02.969 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.971+0000 7fce4b7fe640 1 -- 10.20.193.58:0/3402090739 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce5c003e90 con 0x7fce6c15c040 2026-02-23T06:21:02.969 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.971+0000 7fce4b7fe640 1 -- 10.20.193.58:0/3402090739 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce5c039b00 con 0x7fce6c15c040 2026-02-23T06:21:02.969 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.971+0000 7fce6bfff640 1 -- 10.20.193.58:0/3402090739 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce6c155660 con 0x7fce6c15c040 2026-02-23T06:21:02.969 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.971+0000 7fce6bfff640 1 -- 10.20.193.58:0/3402090739 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce6c155c20 con 0x7fce6c15c040 2026-02-23T06:21:02.969 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.972+0000 7fce4b7fe640 1 -- 10.20.193.58:0/3402090739 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7fce5c039c60 con 0x7fce6c15c040 2026-02-23T06:21:02.969 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.972+0000 7fce4b7fe640 1 -- 10.20.193.58:0/3402090739 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7fce5c04abd0 con 0x7fce6c15c040 2026-02-23T06:21:02.969 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.972+0000 7fce6bfff640 1 -- 10.20.193.58:0/3402090739 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce6c0b5a50 con 0x7fce6c15c040 2026-02-23T06:21:02.970 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:02.973+0000 7fce4b7fe640 1 -- 10.20.193.58:0/3402090739 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7fce5c047070 con 0x7fce6c15c040 2026-02-23T06:21:02.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.004+0000 7fce6bfff640 1 -- 10.20.193.58:0/3402090739 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fce6c15a1b0 con 0x7fce6c15c040 2026-02-23T06:21:02.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.004+0000 7fce4b7fe640 1 -- 10.20.193.58:0/3402090739 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v28) ==== 59+0+1848 (secure 0 0 0) 0x7fce5c04add0 con 0x7fce6c15c040 2026-02-23T06:21:02.999 INFO:teuthology.orchestra.run.trial058.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-23T06:21:02.999 INFO:teuthology.orchestra.run.trial058.stdout:mon advanced mon_op_complaint_time 120 2026-02-23T06:21:02.999 INFO:teuthology.orchestra.run.trial058.stdout:mgr advanced client_mount_timeout 30 2026-02-23T06:21:02.999 INFO:teuthology.orchestra.run.trial058.stdout:mgr advanced debug_client 20/20 2026-02-23T06:21:02.999 INFO:teuthology.orchestra.run.trial058.stdout:mgr advanced debug_mgr 20/20 2026-02-23T06:21:03.000 INFO:teuthology.orchestra.run.trial058.stdout:mgr advanced debug_ms 1/1 2026-02-23T06:21:03.000 INFO:teuthology.orchestra.run.trial058.stdout:mgr dev mon_warn_on_pool_no_app false 2026-02-23T06:21:03.000 INFO:teuthology.orchestra.run.trial058.stdout:osd advanced osd_op_complaint_time 180.000000 2026-02-23T06:21:03.000 INFO:teuthology.orchestra.run.trial058.stdout:mds advanced debug_mds 20/20 2026-02-23T06:21:03.000 INFO:teuthology.orchestra.run.trial058.stdout:mds advanced debug_mds_balancer 20/20 2026-02-23T06:21:03.000 INFO:teuthology.orchestra.run.trial058.stdout:mds advanced debug_ms 2/2 2026-02-23T06:21:03.000 INFO:teuthology.orchestra.run.trial058.stdout:mds advanced mds_bal_fragment_size_max 10000 2026-02-23T06:21:03.000 INFO:teuthology.orchestra.run.trial058.stdout:mds advanced mds_bal_merge_size 5 2026-02-23T06:21:03.000 INFO:teuthology.orchestra.run.trial058.stdout:mds advanced mds_bal_split_bits 3 2026-02-23T06:21:03.000 INFO:teuthology.orchestra.run.trial058.stdout:mds advanced mds_bal_split_size 100 2026-02-23T06:21:03.000 INFO:teuthology.orchestra.run.trial058.stdout:mds dev mds_debug_frag true 2026-02-23T06:21:03.000 INFO:teuthology.orchestra.run.trial058.stdout:mds dev mds_debug_scatterstat true 2026-02-23T06:21:03.001 INFO:teuthology.orchestra.run.trial058.stdout:mds advanced mds_dir_prefetch false 2026-02-23T06:21:03.001 INFO:teuthology.orchestra.run.trial058.stdout:mds advanced mds_op_complaint_time 180.000000 2026-02-23T06:21:03.001 INFO:teuthology.orchestra.run.trial058.stdout:mds dev mds_verify_scatter true 2026-02-23T06:21:03.001 INFO:teuthology.orchestra.run.trial058.stdout:mds advanced osd_op_complaint_time 180.000000 2026-02-23T06:21:03.001 INFO:teuthology.orchestra.run.trial058.stdout:mds advanced rados_mon_op_timeout 900 2026-02-23T06:21:03.001 INFO:teuthology.orchestra.run.trial058.stdout:mds advanced rados_osd_op_timeout 900 2026-02-23T06:21:03.001 INFO:teuthology.orchestra.run.trial058.stdout:client advanced client_mount_timeout 600 2026-02-23T06:21:03.001 INFO:teuthology.orchestra.run.trial058.stdout:client advanced debug_client 20/20 2026-02-23T06:21:03.001 INFO:teuthology.orchestra.run.trial058.stdout:client advanced debug_ms 1/1 2026-02-23T06:21:03.001 INFO:teuthology.orchestra.run.trial058.stdout:client advanced rados_mon_op_timeout 900 2026-02-23T06:21:03.001 INFO:teuthology.orchestra.run.trial058.stdout:client advanced rados_osd_op_timeout 900 2026-02-23T06:21:03.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.004+0000 7fce6bfff640 1 -- 10.20.193.58:0/3402090739 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fce6c15c040 msgr2=0x7fce6c164530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:03.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.004+0000 7fce6bfff640 1 --2- 10.20.193.58:0/3402090739 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fce6c15c040 0x7fce6c164530 secure :-1 s=READY pgs=38 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce5c005820 tx=0x7fce5c003d20 comp rx=0 tx=0).stop 2026-02-23T06:21:03.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.005+0000 7fce6bfff640 1 -- 10.20.193.58:0/3402090739 shutdown_connections 2026-02-23T06:21:03.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.005+0000 7fce6bfff640 1 --2- 10.20.193.58:0/3402090739 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fce6c15c040 0x7fce6c164530 unknown :-1 s=CLOSED pgs=38 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:03.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.005+0000 7fce6bfff640 1 --2- 10.20.193.58:0/3402090739 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fce6c0b5680 0x7fce6c1fdef0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:03.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.005+0000 7fce6bfff640 1 --2- 10.20.193.58:0/3402090739 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fce6c056550 0x7fce6c151930 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:03.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.005+0000 7fce6bfff640 1 -- 10.20.193.58:0/3402090739 >> 10.20.193.58:0/3402090739 conn(0x7fce6c0b3c20 msgr2=0x7fce6c156800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:03.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.005+0000 7fce6bfff640 1 -- 10.20.193.58:0/3402090739 shutdown_connections 2026-02-23T06:21:03.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.005+0000 7fce6bfff640 1 -- 10.20.193.58:0/3402090739 wait complete. 2026-02-23T06:21:03.005 INFO:tasks.ceph.mgr.x.trial093.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-23T06:21:03.005 INFO:tasks.ceph.mgr.x.trial093.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-23T06:21:03.005 INFO:tasks.ceph.mgr.x.trial093.stderr: from numpy import show_config as show_numpy_config 2026-02-23T06:21:03.010 INFO:tasks.ceph:Setting crush tunables to default 2026-02-23T06:21:03.010 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph osd crush tunables default 2026-02-23T06:21:03.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.131+0000 7f66f5603640 1 -- 10.20.193.58:0/1347994309 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f66f00bb0b0 msgr2=0x7f66f015b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:03.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.131+0000 7f66f5603640 1 --2- 10.20.193.58:0/1347994309 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f66f00bb0b0 0x7f66f015b620 secure :-1 s=READY pgs=39 gs=3 cs=0 l=1 c_cookie=11179762945711533177 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66e4005820 tx=0x7f66e40302b0 comp rx=0 tx=0).stop 2026-02-23T06:21:03.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.131+0000 7f66f5603640 1 -- 10.20.193.58:0/1347994309 shutdown_connections 2026-02-23T06:21:03.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.131+0000 7f66f5603640 1 --2- 10.20.193.58:0/1347994309 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f66f00bb0b0 0x7f66f015b620 unknown :-1 s=CLOSED pgs=39 gs=3 cs=0 l=1 c_cookie=11179762945711533177 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:03.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.131+0000 7f66f5603640 1 --2- 10.20.193.58:0/1347994309 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f66f00b6440 0x7f66f00ba2d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:03.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.131+0000 7f66f5603640 1 -- 10.20.193.58:0/1347994309 >> 10.20.193.58:0/1347994309 conn(0x7f66f0054e40 msgr2=0x7f66f0057b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:03.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.131+0000 7f66f5603640 1 -- 10.20.193.58:0/1347994309 shutdown_connections 2026-02-23T06:21:03.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.131+0000 7f66f5603640 1 -- 10.20.193.58:0/1347994309 wait complete. 2026-02-23T06:21:03.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.132+0000 7f66f5603640 1 Processor -- start 2026-02-23T06:21:03.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.133+0000 7f66f5603640 1 -- start start 2026-02-23T06:21:03.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.133+0000 7f66f5603640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f66f00b6440 0x7f66f01492c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:03.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.133+0000 7f66f5603640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f66f00bb0b0 0x7f66f011cee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:03.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.133+0000 7f66f5603640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f66f01688d0 0x7f66f011d420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:03.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.133+0000 7f66f5603640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f66f011fcc0 con 0x7f66f01688d0 2026-02-23T06:21:03.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.133+0000 7f66f5603640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f66f01455f0 con 0x7f66f00b6440 2026-02-23T06:21:03.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.133+0000 7f66f5603640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f66f009fc90 con 0x7f66f00bb0b0 2026-02-23T06:21:03.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.133+0000 7f66effff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f66f00b6440 0x7f66f01492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:03.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.133+0000 7f66f4e02640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f66f01688d0 0x7f66f011d420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:03.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.133+0000 7f66effff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f66f00b6440 0x7f66f01492c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:55928/0 (socket says 10.20.193.58:55928) 2026-02-23T06:21:03.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.133+0000 7f66f4e02640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f66f01688d0 0x7f66f011d420 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:48748/0 (socket says 10.20.193.58:48748) 2026-02-23T06:21:03.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.133+0000 7f66effff640 1 -- 10.20.193.58:0/1364477285 learned_addr learned my addr 10.20.193.58:0/1364477285 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:03.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.133+0000 7f66ef7fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f66f00bb0b0 0x7f66f011cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:03.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.134+0000 7f66f4e02640 1 -- 10.20.193.58:0/1364477285 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f66f00bb0b0 msgr2=0x7f66f011cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:03.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.134+0000 7f66f4e02640 1 --2- 10.20.193.58:0/1364477285 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f66f00bb0b0 0x7f66f011cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:03.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.134+0000 7f66f4e02640 1 -- 10.20.193.58:0/1364477285 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f66f00b6440 msgr2=0x7f66f01492c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:03.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.134+0000 7f66f4e02640 1 --2- 10.20.193.58:0/1364477285 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f66f00b6440 0x7f66f01492c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:03.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.134+0000 7f66f4e02640 1 -- 10.20.193.58:0/1364477285 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e400a590 con 0x7f66f01688d0 2026-02-23T06:21:03.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.134+0000 7f66f4e02640 1 --2- 10.20.193.58:0/1364477285 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f66f01688d0 0x7f66f011d420 secure :-1 s=READY pgs=40 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66f0058bd0 tx=0x7f66e4003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:03.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.134+0000 7f66ecff9640 1 -- 10.20.193.58:0/1364477285 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66e403e070 con 0x7f66f01688d0 2026-02-23T06:21:03.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.134+0000 7f66ecff9640 1 -- 10.20.193.58:0/1364477285 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66e40398a0 con 0x7f66f01688d0 2026-02-23T06:21:03.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.134+0000 7f66ecff9640 1 -- 10.20.193.58:0/1364477285 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66e4039c30 con 0x7f66f01688d0 2026-02-23T06:21:03.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.134+0000 7f66f5603640 1 -- 10.20.193.58:0/1364477285 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66f009ff70 con 0x7f66f01688d0 2026-02-23T06:21:03.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.134+0000 7f66f5603640 1 -- 10.20.193.58:0/1364477285 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66f011ded0 con 0x7f66f01688d0 2026-02-23T06:21:03.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.134+0000 7f66ecff9640 1 -- 10.20.193.58:0/1364477285 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f66e404b800 con 0x7f66f01688d0 2026-02-23T06:21:03.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.134+0000 7f66ecff9640 1 -- 10.20.193.58:0/1364477285 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f66e4041d20 con 0x7f66f01688d0 2026-02-23T06:21:03.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.135+0000 7f66f5603640 1 -- 10.20.193.58:0/1364477285 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66f0148c00 con 0x7f66f01688d0 2026-02-23T06:21:03.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.136+0000 7f66ecff9640 1 -- 10.20.193.58:0/1364477285 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f66f0148c00 con 0x7f66f01688d0 2026-02-23T06:21:03.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.168+0000 7f66f5603640 1 -- 10.20.193.58:0/1364477285 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f66f0148fa0 con 0x7f66f01688d0 2026-02-23T06:21:03.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.169+0000 7f66ecff9640 1 -- 10.20.193.58:0/1364477285 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f66e4047070 con 0x7f66f01688d0 2026-02-23T06:21:03.164 INFO:teuthology.orchestra.run.trial058.stderr:adjusted tunables profile to default 2026-02-23T06:21:03.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.170+0000 7f66f5603640 1 -- 10.20.193.58:0/1364477285 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f66f01688d0 msgr2=0x7f66f011d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:03.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.170+0000 7f66f5603640 1 --2- 10.20.193.58:0/1364477285 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f66f01688d0 0x7f66f011d420 secure :-1 s=READY pgs=40 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66f0058bd0 tx=0x7f66e4003d00 comp rx=0 tx=0).stop 2026-02-23T06:21:03.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.170+0000 7f66f5603640 1 -- 10.20.193.58:0/1364477285 shutdown_connections 2026-02-23T06:21:03.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.170+0000 7f66f5603640 1 --2- 10.20.193.58:0/1364477285 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f66f01688d0 0x7f66f011d420 unknown :-1 s=CLOSED pgs=40 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:03.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.170+0000 7f66f5603640 1 --2- 10.20.193.58:0/1364477285 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f66f00bb0b0 0x7f66f011cee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:03.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.170+0000 7f66f5603640 1 --2- 10.20.193.58:0/1364477285 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f66f00b6440 0x7f66f01492c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:03.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.170+0000 7f66f5603640 1 -- 10.20.193.58:0/1364477285 >> 10.20.193.58:0/1364477285 conn(0x7f66f0054e40 msgr2=0x7f66f01675a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:03.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.170+0000 7f66f5603640 1 -- 10.20.193.58:0/1364477285 shutdown_connections 2026-02-23T06:21:03.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:03.170+0000 7f66f5603640 1 -- 10.20.193.58:0/1364477285 wait complete. 2026-02-23T06:21:03.175 INFO:tasks.ceph:check_enable_crimson: False 2026-02-23T06:21:03.176 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-23T06:21:03.176 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:21:03.176 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-23T06:21:03.234 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:21:03.234 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-23T06:21:03.284 INFO:tasks.ceph.mgr.y.trial058.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-23T06:21:03.284 INFO:tasks.ceph.mgr.y.trial058.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-23T06:21:03.284 INFO:tasks.ceph.mgr.y.trial058.stderr: from numpy import show_config as show_numpy_config 2026-02-23T06:21:03.333 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:21:03.333 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-23T06:21:03.433 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:21:03.433 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-23T06:21:03.533 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-23T06:21:03.533 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-23T06:21:03.559 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-23T06:21:03.559 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-23T06:21:03.622 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-23T06:21:03.623 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2026-02-23T06:21:03.686 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-23T06:21:03.686 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2026-02-23T06:21:03.751 DEBUG:teuthology.orchestra.run.trial093:> sudo ceph --cluster ceph osd new 96cc0898-14bb-4d56-827a-8845bd4307c4 0 2026-02-23T06:21:03.856 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.860+0000 7f69239d4640 1 -- 10.20.193.93:0/2786400483 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f691c0b74c0 msgr2=0x7f691c05e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:03.856 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.860+0000 7f69239d4640 1 --2- 10.20.193.93:0/2786400483 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f691c0b74c0 0x7f691c05e130 secure :-1 s=READY pgs=23 gs=3 cs=0 l=1 c_cookie=5635543319720616155 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f691800a970 tx=0x7f6918030240 comp rx=0 tx=0).stop 2026-02-23T06:21:03.856 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.860+0000 7f69239d4640 1 -- 10.20.193.93:0/2786400483 shutdown_connections 2026-02-23T06:21:03.856 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.860+0000 7f69239d4640 1 --2- 10.20.193.93:0/2786400483 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f691c0b74c0 0x7f691c05e130 unknown :-1 s=CLOSED pgs=23 gs=3 cs=0 l=1 c_cookie=5635543319720616155 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:03.857 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.860+0000 7f69239d4640 1 -- 10.20.193.93:0/2786400483 >> 10.20.193.93:0/2786400483 conn(0x7f691c0b8840 msgr2=0x7f691c0b8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:03.857 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.860+0000 7f69239d4640 1 -- 10.20.193.93:0/2786400483 shutdown_connections 2026-02-23T06:21:03.857 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.860+0000 7f69239d4640 1 -- 10.20.193.93:0/2786400483 wait complete. 2026-02-23T06:21:03.857 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.861+0000 7f69239d4640 1 Processor -- start 2026-02-23T06:21:03.857 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.861+0000 7f69239d4640 1 -- start start 2026-02-23T06:21:03.860 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.861+0000 7f69239d4640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f691c0b3c60 0x7f691c168f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:03.860 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.861+0000 7f69239d4640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f691c0b74c0 0x7f691c13f8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:03.860 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.861+0000 7f69239d4640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f691c15c130 0x7f691c1667a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:03.860 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.861+0000 7f69239d4640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f691c15e6a0 con 0x7f691c0b74c0 2026-02-23T06:21:03.860 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.861+0000 7f69239d4640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f691c2018d0 con 0x7f691c15c130 2026-02-23T06:21:03.860 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.861+0000 7f69239d4640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f691c201bb0 con 0x7f691c0b3c60 2026-02-23T06:21:03.860 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.861+0000 7f6921f4a640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f691c15c130 0x7f691c1667a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:03.861 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.861+0000 7f6921749640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f691c0b3c60 0x7f691c168f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:03.861 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.861+0000 7f6921f4a640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f691c15c130 0x7f691c1667a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.93:51852/0 (socket says 10.20.193.93:51852) 2026-02-23T06:21:03.861 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.861+0000 7f6921f4a640 1 -- 10.20.193.93:0/2599315419 learned_addr learned my addr 10.20.193.93:0/2599315419 (peer_addr_for_me v2:10.20.193.93:0/0) 2026-02-23T06:21:03.861 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.862+0000 7f6920f48640 1 --2- 10.20.193.93:0/2599315419 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f691c0b74c0 0x7f691c13f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:03.861 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.862+0000 7f6921749640 1 -- 10.20.193.93:0/2599315419 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f691c15c130 msgr2=0x7f691c1667a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:03.861 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.862+0000 7f6921749640 1 --2- 10.20.193.93:0/2599315419 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f691c15c130 0x7f691c1667a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:03.861 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.862+0000 7f6921749640 1 -- 10.20.193.93:0/2599315419 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f691c0b74c0 msgr2=0x7f691c13f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:03.861 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.862+0000 7f6921749640 1 --2- 10.20.193.93:0/2599315419 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f691c0b74c0 0x7f691c13f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:03.861 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.862+0000 7f6921749640 1 -- 10.20.193.93:0/2599315419 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f691800a590 con 0x7f691c0b3c60 2026-02-23T06:21:03.861 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.862+0000 7f6921f4a640 1 --2- 10.20.193.93:0/2599315419 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f691c15c130 0x7f691c1667a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:03.861 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.862+0000 7f6920f48640 1 --2- 10.20.193.93:0/2599315419 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f691c0b74c0 0x7f691c13f8d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:21:03.861 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.862+0000 7f6921749640 1 --2- 10.20.193.93:0/2599315419 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f691c0b3c60 0x7f691c168f30 secure :-1 s=READY pgs=24 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f690c0029a0 tx=0x7f690c00c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:03.862 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.862+0000 7f6909ffb640 1 -- 10.20.193.93:0/2599315419 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f690c012850 con 0x7f691c0b3c60 2026-02-23T06:21:03.862 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.862+0000 7f6909ffb640 1 -- 10.20.193.93:0/2599315419 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f690c012aa0 con 0x7f691c0b3c60 2026-02-23T06:21:03.862 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.862+0000 7f69239d4640 1 -- 10.20.193.93:0/2599315419 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f691c15e330 con 0x7f691c0b3c60 2026-02-23T06:21:03.862 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.862+0000 7f6909ffb640 1 -- 10.20.193.93:0/2599315419 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f690c011380 con 0x7f691c0b3c60 2026-02-23T06:21:03.862 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.862+0000 7f69239d4640 1 -- 10.20.193.93:0/2599315419 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f691c15d9c0 con 0x7f691c0b3c60 2026-02-23T06:21:03.862 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.862+0000 7f6909ffb640 1 -- 10.20.193.93:0/2599315419 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f690c022020 con 0x7f691c0b3c60 2026-02-23T06:21:03.862 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.862+0000 7f6909ffb640 1 -- 10.20.193.93:0/2599315419 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 720+0+0 (secure 0 0 0) 0x7f690c01bcc0 con 0x7f691c0b3c60 2026-02-23T06:21:03.862 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.862+0000 7f69239d4640 1 -- 10.20.193.93:0/2599315419 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f691c166030 con 0x7f691c0b3c60 2026-02-23T06:21:03.862 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.863+0000 7f6909ffb640 1 -- 10.20.193.93:0/2599315419 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f690c016020 con 0x7f691c0b3c60 2026-02-23T06:21:03.898 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.903+0000 7f69239d4640 1 -- 10.20.193.93:0/2599315419 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "osd new", "uuid": "96cc0898-14bb-4d56-827a-8845bd4307c4", "id": 0} v 0) -- 0x7f691c0b8030 con 0x7f691c0b3c60 2026-02-23T06:21:03.901 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.906+0000 7f6909ffb640 1 -- 10.20.193.93:0/2599315419 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "96cc0898-14bb-4d56-827a-8845bd4307c4", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f690c028030 con 0x7f691c0b3c60 2026-02-23T06:21:03.901 INFO:teuthology.orchestra.run.trial093.stdout:0 2026-02-23T06:21:03.902 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.906+0000 7f69239d4640 1 -- 10.20.193.93:0/2599315419 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f691c0b3c60 msgr2=0x7f691c168f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:03.903 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.906+0000 7f69239d4640 1 --2- 10.20.193.93:0/2599315419 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f691c0b3c60 0x7f691c168f30 secure :-1 s=READY pgs=24 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f690c0029a0 tx=0x7f690c00c970 comp rx=0 tx=0).stop 2026-02-23T06:21:03.903 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.907+0000 7f69239d4640 1 -- 10.20.193.93:0/2599315419 shutdown_connections 2026-02-23T06:21:03.903 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.907+0000 7f69239d4640 1 --2- 10.20.193.93:0/2599315419 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f691c15c130 0x7f691c1667a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:03.903 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.907+0000 7f69239d4640 1 --2- 10.20.193.93:0/2599315419 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f691c0b74c0 0x7f691c13f8d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:03.903 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.907+0000 7f69239d4640 1 --2- 10.20.193.93:0/2599315419 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f691c0b3c60 0x7f691c168f30 unknown :-1 s=CLOSED pgs=24 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:03.903 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.907+0000 7f69239d4640 1 -- 10.20.193.93:0/2599315419 >> 10.20.193.93:0/2599315419 conn(0x7f691c0b8840 msgr2=0x7f691c163b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:03.903 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.907+0000 7f69239d4640 1 -- 10.20.193.93:0/2599315419 shutdown_connections 2026-02-23T06:21:03.903 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.907+0000 7f69239d4640 1 -- 10.20.193.93:0/2599315419 wait complete. 2026-02-23T06:21:03.909 DEBUG:teuthology.orchestra.run.trial093:> sudo ceph --cluster ceph osd new bf665af4-6e3c-4cb3-899c-acede65c31f2 1 2026-02-23T06:21:03.976 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.980+0000 7f53e3f0c640 1 -- 10.20.193.93:0/2561320538 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f53dc0b4350 msgr2=0x7f53dc059880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:03.976 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.980+0000 7f53e3f0c640 1 --2- 10.20.193.93:0/2561320538 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f53dc0b4350 0x7f53dc059880 secure :-1 s=READY pgs=25 gs=3 cs=0 l=1 c_cookie=5485647465966972129 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53d0009890 tx=0x7f53d002f280 comp rx=0 tx=0).stop 2026-02-23T06:21:03.976 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.980+0000 7f53e3f0c640 1 -- 10.20.193.93:0/2561320538 shutdown_connections 2026-02-23T06:21:03.976 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.980+0000 7f53e3f0c640 1 --2- 10.20.193.93:0/2561320538 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f53dc0b4350 0x7f53dc059880 unknown :-1 s=CLOSED pgs=25 gs=3 cs=0 l=1 c_cookie=5485647465966972129 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:03.977 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.980+0000 7f53e3f0c640 1 -- 10.20.193.93:0/2561320538 >> 10.20.193.93:0/2561320538 conn(0x7f53dc0b81b0 msgr2=0x7f53dc0b85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:03.977 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.980+0000 7f53e3f0c640 1 -- 10.20.193.93:0/2561320538 shutdown_connections 2026-02-23T06:21:03.977 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.980+0000 7f53e3f0c640 1 -- 10.20.193.93:0/2561320538 wait complete. 2026-02-23T06:21:03.980 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.981+0000 7f53e3f0c640 1 Processor -- start 2026-02-23T06:21:03.980 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.981+0000 7f53e3f0c640 1 -- start start 2026-02-23T06:21:03.980 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.982+0000 7f53e3f0c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f53dc0b38b0 0x7f53dc1ff1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:03.980 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.982+0000 7f53e3f0c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f53dc0b4350 0x7f53dc1fbc10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:03.980 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.982+0000 7f53e3f0c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f53dc15d610 0x7f53dc164150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:03.980 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.982+0000 7f53e3f0c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc165040 con 0x7f53dc0b38b0 2026-02-23T06:21:03.980 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.982+0000 7f53e3f0c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc1fb780 con 0x7f53dc0b4350 2026-02-23T06:21:03.980 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.982+0000 7f53e3f0c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f53dc158fb0 con 0x7f53dc15d610 2026-02-23T06:21:03.980 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.982+0000 7f53e1480640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f53dc0b4350 0x7f53dc1fbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:03.980 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.982+0000 7f53e2482640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f53dc15d610 0x7f53dc164150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:03.981 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.982+0000 7f53e1480640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f53dc0b4350 0x7f53dc1fbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.93:51868/0 (socket says 10.20.193.93:51868) 2026-02-23T06:21:03.981 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.982+0000 7f53e1480640 1 -- 10.20.193.93:0/3970772874 learned_addr learned my addr 10.20.193.93:0/3970772874 (peer_addr_for_me v2:10.20.193.93:0/0) 2026-02-23T06:21:03.981 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.982+0000 7f53e1c81640 1 --2- 10.20.193.93:0/3970772874 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f53dc0b38b0 0x7f53dc1ff1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:03.981 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.982+0000 7f53e1480640 1 -- 10.20.193.93:0/3970772874 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f53dc15d610 msgr2=0x7f53dc164150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:03.981 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.982+0000 7f53e1480640 1 --2- 10.20.193.93:0/3970772874 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f53dc15d610 0x7f53dc164150 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:03.981 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.982+0000 7f53e1480640 1 -- 10.20.193.93:0/3970772874 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f53dc0b38b0 msgr2=0x7f53dc1ff1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:03.981 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.982+0000 7f53e1480640 1 --2- 10.20.193.93:0/3970772874 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f53dc0b38b0 0x7f53dc1ff1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:03.981 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.982+0000 7f53e1480640 1 -- 10.20.193.93:0/3970772874 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d00094b0 con 0x7f53dc0b4350 2026-02-23T06:21:03.981 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.982+0000 7f53e1c81640 1 --2- 10.20.193.93:0/3970772874 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f53dc0b38b0 0x7f53dc1ff1f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:21:03.981 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.982+0000 7f53e1480640 1 --2- 10.20.193.93:0/3970772874 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f53dc0b4350 0x7f53dc1fbc10 secure :-1 s=READY pgs=49 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53d0009990 tx=0x7f53d0002950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:03.981 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.982+0000 7f53ca7fc640 1 -- 10.20.193.93:0/3970772874 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53d0038470 con 0x7f53dc0b4350 2026-02-23T06:21:03.981 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.982+0000 7f53ca7fc640 1 -- 10.20.193.93:0/3970772874 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53d00386c0 con 0x7f53dc0b4350 2026-02-23T06:21:03.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.982+0000 7f53e3f0c640 1 -- 10.20.193.93:0/3970772874 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53dc159290 con 0x7f53dc0b4350 2026-02-23T06:21:03.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.982+0000 7f53ca7fc640 1 -- 10.20.193.93:0/3970772874 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53d0038a90 con 0x7f53dc0b4350 2026-02-23T06:21:03.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.982+0000 7f53e3f0c640 1 -- 10.20.193.93:0/3970772874 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53dc1fb410 con 0x7f53dc0b4350 2026-02-23T06:21:03.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.982+0000 7f53ca7fc640 1 -- 10.20.193.93:0/3970772874 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f53d0040420 con 0x7f53dc0b4350 2026-02-23T06:21:03.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.982+0000 7f53ca7fc640 1 -- 10.20.193.93:0/3970772874 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 835+0+0 (secure 0 0 0) 0x7f53d0049a50 con 0x7f53dc0b4350 2026-02-23T06:21:03.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.983+0000 7f53e3f0c640 1 -- 10.20.193.93:0/3970772874 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53dc1668f0 con 0x7f53dc0b4350 2026-02-23T06:21:03.982 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:03.983+0000 7f53ca7fc640 1 -- 10.20.193.93:0/3970772874 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f53dc0b36f0 con 0x7f53dc0b4350 2026-02-23T06:21:04.012 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.017+0000 7f53e3f0c640 1 -- 10.20.193.93:0/3970772874 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bf665af4-6e3c-4cb3-899c-acede65c31f2", "id": 1} v 0) -- 0x7f53dc0b7cd0 con 0x7f53dc0b4350 2026-02-23T06:21:04.015 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.020+0000 7f53ca7fc640 1 -- 10.20.193.93:0/3970772874 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bf665af4-6e3c-4cb3-899c-acede65c31f2", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f53d0049d30 con 0x7f53dc0b4350 2026-02-23T06:21:04.015 INFO:teuthology.orchestra.run.trial093.stdout:1 2026-02-23T06:21:04.016 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.020+0000 7f53e3f0c640 1 -- 10.20.193.93:0/3970772874 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f53dc0b4350 msgr2=0x7f53dc1fbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.016 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.020+0000 7f53e3f0c640 1 --2- 10.20.193.93:0/3970772874 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f53dc0b4350 0x7f53dc1fbc10 secure :-1 s=READY pgs=49 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53d0009990 tx=0x7f53d0002950 comp rx=0 tx=0).stop 2026-02-23T06:21:04.016 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.021+0000 7f53e3f0c640 1 -- 10.20.193.93:0/3970772874 shutdown_connections 2026-02-23T06:21:04.017 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.021+0000 7f53e3f0c640 1 --2- 10.20.193.93:0/3970772874 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f53dc15d610 0x7f53dc164150 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.017 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.021+0000 7f53e3f0c640 1 --2- 10.20.193.93:0/3970772874 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f53dc0b4350 0x7f53dc1fbc10 unknown :-1 s=CLOSED pgs=49 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.017 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.021+0000 7f53e3f0c640 1 --2- 10.20.193.93:0/3970772874 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f53dc0b38b0 0x7f53dc1ff1f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.017 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.021+0000 7f53e3f0c640 1 -- 10.20.193.93:0/3970772874 >> 10.20.193.93:0/3970772874 conn(0x7f53dc0b81b0 msgr2=0x7f53dc0b8580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:04.017 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.021+0000 7f53e3f0c640 1 -- 10.20.193.93:0/3970772874 shutdown_connections 2026-02-23T06:21:04.017 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.021+0000 7f53e3f0c640 1 -- 10.20.193.93:0/3970772874 wait complete. 2026-02-23T06:21:04.024 DEBUG:teuthology.orchestra.run.trial093:> sudo ceph --cluster ceph osd new 2bcb3165-28ad-45d6-9a49-9d9da08501f7 2 2026-02-23T06:21:04.091 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.095+0000 7f246ee3e640 1 -- 10.20.193.93:0/2726945617 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f24680b9500 msgr2=0x7f24680b2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.091 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.095+0000 7f246ee3e640 1 --2- 10.20.193.93:0/2726945617 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f24680b9500 0x7f24680b2290 secure :-1 s=READY pgs=51 gs=3 cs=0 l=1 c_cookie=13273229036126597115 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2450004740 tx=0x7f245002f260 comp rx=0 tx=0).stop 2026-02-23T06:21:04.091 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.095+0000 7f246ee3e640 1 -- 10.20.193.93:0/2726945617 shutdown_connections 2026-02-23T06:21:04.091 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.095+0000 7f246ee3e640 1 --2- 10.20.193.93:0/2726945617 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f24680b9500 0x7f24680b2290 unknown :-1 s=CLOSED pgs=51 gs=3 cs=0 l=1 c_cookie=13273229036126597115 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.091 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.095+0000 7f246ee3e640 1 -- 10.20.193.93:0/2726945617 >> 10.20.193.93:0/2726945617 conn(0x7f24680b9b30 msgr2=0x7f24680b9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:04.091 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.095+0000 7f246ee3e640 1 -- 10.20.193.93:0/2726945617 shutdown_connections 2026-02-23T06:21:04.092 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.095+0000 7f246ee3e640 1 -- 10.20.193.93:0/2726945617 wait complete. 2026-02-23T06:21:04.092 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.096+0000 7f246ee3e640 1 Processor -- start 2026-02-23T06:21:04.092 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.096+0000 7f246ee3e640 1 -- start start 2026-02-23T06:21:04.094 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.096+0000 7f246ee3e640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f24680b9500 0x7f246815f4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:04.094 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.096+0000 7f246ee3e640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f246815d360 0x7f246815c2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:04.095 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.096+0000 7f246ee3e640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f24681675e0 0x7f2468153130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:04.095 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.096+0000 7f246ee3e640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f246815fe10 con 0x7f24680b9500 2026-02-23T06:21:04.095 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.096+0000 7f246ee3e640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f24681fbe50 con 0x7f246815d360 2026-02-23T06:21:04.095 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.096+0000 7f246ee3e640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f24681ff540 con 0x7f24681675e0 2026-02-23T06:21:04.095 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.096+0000 7f245ffff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f246815d360 0x7f246815c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:04.095 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.096+0000 7f245ffff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f246815d360 0x7f246815c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.93:51890/0 (socket says 10.20.193.93:51890) 2026-02-23T06:21:04.095 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.096+0000 7f245ffff640 1 -- 10.20.193.93:0/2116485711 learned_addr learned my addr 10.20.193.93:0/2116485711 (peer_addr_for_me v2:10.20.193.93:0/0) 2026-02-23T06:21:04.095 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.096+0000 7f246d3b4640 1 --2- 10.20.193.93:0/2116485711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f24681675e0 0x7f2468153130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:04.095 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.096+0000 7f246cbb3640 1 --2- 10.20.193.93:0/2116485711 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f24680b9500 0x7f246815f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:04.095 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.096+0000 7f245ffff640 1 -- 10.20.193.93:0/2116485711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f24681675e0 msgr2=0x7f2468153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.095 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.096+0000 7f245ffff640 1 --2- 10.20.193.93:0/2116485711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f24681675e0 0x7f2468153130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.096 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.096+0000 7f245ffff640 1 -- 10.20.193.93:0/2116485711 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f24680b9500 msgr2=0x7f246815f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.096 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.096+0000 7f245ffff640 1 --2- 10.20.193.93:0/2116485711 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f24680b9500 0x7f246815f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.096 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.096+0000 7f245ffff640 1 -- 10.20.193.93:0/2116485711 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24500094b0 con 0x7f246815d360 2026-02-23T06:21:04.096 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.096+0000 7f246cbb3640 1 --2- 10.20.193.93:0/2116485711 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f24680b9500 0x7f246815f4c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:21:04.096 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.096+0000 7f245ffff640 1 --2- 10.20.193.93:0/2116485711 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f246815d360 0x7f246815c2c0 secure :-1 s=READY pgs=52 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2450009230 tx=0x7f2450002c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:04.096 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.097+0000 7f245d7fa640 1 -- 10.20.193.93:0/2116485711 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f24500388a0 con 0x7f246815d360 2026-02-23T06:21:04.096 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.097+0000 7f245d7fa640 1 -- 10.20.193.93:0/2116485711 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2450038af0 con 0x7f246815d360 2026-02-23T06:21:04.096 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.097+0000 7f246ee3e640 1 -- 10.20.193.93:0/2116485711 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24681ff800 con 0x7f246815d360 2026-02-23T06:21:04.096 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.097+0000 7f245d7fa640 1 -- 10.20.193.93:0/2116485711 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2450002e60 con 0x7f246815d360 2026-02-23T06:21:04.096 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.097+0000 7f246ee3e640 1 -- 10.20.193.93:0/2116485711 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24681ffdc0 con 0x7f246815d360 2026-02-23T06:21:04.096 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.097+0000 7f245d7fa640 1 -- 10.20.193.93:0/2116485711 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f2450040830 con 0x7f246815d360 2026-02-23T06:21:04.096 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.097+0000 7f245d7fa640 1 -- 10.20.193.93:0/2116485711 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 950+0+0 (secure 0 0 0) 0x7f245003f380 con 0x7f246815d360 2026-02-23T06:21:04.097 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.097+0000 7f246ee3e640 1 -- 10.20.193.93:0/2116485711 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24681fbfa0 con 0x7f246815d360 2026-02-23T06:21:04.097 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.098+0000 7f245d7fa640 1 -- 10.20.193.93:0/2116485711 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f245002fcd0 con 0x7f246815d360 2026-02-23T06:21:04.126 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.131+0000 7f246ee3e640 1 -- 10.20.193.93:0/2116485711 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2bcb3165-28ad-45d6-9a49-9d9da08501f7", "id": 2} v 0) -- 0x7f2468160be0 con 0x7f246815d360 2026-02-23T06:21:04.129 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.134+0000 7f245d7fa640 1 -- 10.20.193.93:0/2116485711 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2bcb3165-28ad-45d6-9a49-9d9da08501f7", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f24500580b0 con 0x7f246815d360 2026-02-23T06:21:04.129 INFO:teuthology.orchestra.run.trial093.stdout:2 2026-02-23T06:21:04.130 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.134+0000 7f246ee3e640 1 -- 10.20.193.93:0/2116485711 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f246815d360 msgr2=0x7f246815c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.130 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.134+0000 7f246ee3e640 1 --2- 10.20.193.93:0/2116485711 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f246815d360 0x7f246815c2c0 secure :-1 s=READY pgs=52 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2450009230 tx=0x7f2450002c40 comp rx=0 tx=0).stop 2026-02-23T06:21:04.130 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.134+0000 7f246ee3e640 1 -- 10.20.193.93:0/2116485711 shutdown_connections 2026-02-23T06:21:04.130 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.134+0000 7f246ee3e640 1 --2- 10.20.193.93:0/2116485711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f24681675e0 0x7f2468153130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.130 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.134+0000 7f246ee3e640 1 --2- 10.20.193.93:0/2116485711 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f246815d360 0x7f246815c2c0 unknown :-1 s=CLOSED pgs=52 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.131 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.134+0000 7f246ee3e640 1 --2- 10.20.193.93:0/2116485711 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f24680b9500 0x7f246815f4c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.131 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.134+0000 7f246ee3e640 1 -- 10.20.193.93:0/2116485711 >> 10.20.193.93:0/2116485711 conn(0x7f24680b9b30 msgr2=0x7f2468162a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:04.131 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.134+0000 7f246ee3e640 1 -- 10.20.193.93:0/2116485711 shutdown_connections 2026-02-23T06:21:04.131 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.134+0000 7f246ee3e640 1 -- 10.20.193.93:0/2116485711 wait complete. 2026-02-23T06:21:04.136 DEBUG:teuthology.orchestra.run.trial093:> sudo ceph --cluster ceph osd new 4750309a-5bf2-4f48-a550-ca677b0b0f61 3 2026-02-23T06:21:04.204 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.205+0000 7f547e3b9640 1 -- 10.20.193.93:0/2047840236 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f54780b1540 msgr2=0x7f5478163110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.204 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.205+0000 7f547e3b9640 1 --2- 10.20.193.93:0/2047840236 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f54780b1540 0x7f5478163110 secure :-1 s=READY pgs=26 gs=3 cs=0 l=1 c_cookie=10297610467583688955 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5468009890 tx=0x7f546802f1f0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.204 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.205+0000 7f547e3b9640 1 -- 10.20.193.93:0/2047840236 shutdown_connections 2026-02-23T06:21:04.204 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.205+0000 7f547e3b9640 1 --2- 10.20.193.93:0/2047840236 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f54780b1540 0x7f5478163110 unknown :-1 s=CLOSED pgs=26 gs=3 cs=0 l=1 c_cookie=10297610467583688955 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.204 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.205+0000 7f547e3b9640 1 -- 10.20.193.93:0/2047840236 >> 10.20.193.93:0/2047840236 conn(0x7f5478058e50 msgr2=0x7f5478059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:04.204 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.205+0000 7f547e3b9640 1 -- 10.20.193.93:0/2047840236 shutdown_connections 2026-02-23T06:21:04.204 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.205+0000 7f547e3b9640 1 -- 10.20.193.93:0/2047840236 wait complete. 2026-02-23T06:21:04.205 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.206+0000 7f547e3b9640 1 Processor -- start 2026-02-23T06:21:04.205 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.206+0000 7f547e3b9640 1 -- start start 2026-02-23T06:21:04.205 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.206+0000 7f547e3b9640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f54780b1170 0x7f54781fdc60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:04.205 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.206+0000 7f547e3b9640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f54780b1540 0x7f5478139480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:04.205 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.206+0000 7f547e3b9640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f54780b58a0 0x7f5478158ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:04.205 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.206+0000 7f547e3b9640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f547813a6b0 con 0x7f54780b1170 2026-02-23T06:21:04.205 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.206+0000 7f547e3b9640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f547813aed0 con 0x7f54780b1540 2026-02-23T06:21:04.205 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.206+0000 7f547e3b9640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f547813b170 con 0x7f54780b58a0 2026-02-23T06:21:04.205 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.206+0000 7f54777fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f54780b1540 0x7f5478139480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:04.205 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.206+0000 7f547c92f640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f54780b58a0 0x7f5478158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:04.206 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.206+0000 7f54777fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f54780b1540 0x7f5478139480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.93:51898/0 (socket says 10.20.193.93:51898) 2026-02-23T06:21:04.206 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.206+0000 7f54777fe640 1 -- 10.20.193.93:0/32371899 learned_addr learned my addr 10.20.193.93:0/32371899 (peer_addr_for_me v2:10.20.193.93:0/0) 2026-02-23T06:21:04.206 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.206+0000 7f5477fff640 1 --2- 10.20.193.93:0/32371899 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f54780b1170 0x7f54781fdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:04.206 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.206+0000 7f54777fe640 1 -- 10.20.193.93:0/32371899 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f54780b58a0 msgr2=0x7f5478158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.206 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.206+0000 7f54777fe640 1 --2- 10.20.193.93:0/32371899 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f54780b58a0 0x7f5478158ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.206 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.207+0000 7f54777fe640 1 -- 10.20.193.93:0/32371899 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f54780b1170 msgr2=0x7f54781fdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.206 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.207+0000 7f54777fe640 1 --2- 10.20.193.93:0/32371899 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f54780b1170 0x7f54781fdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.206 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.207+0000 7f54777fe640 1 -- 10.20.193.93:0/32371899 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54680094b0 con 0x7f54780b1540 2026-02-23T06:21:04.206 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.207+0000 7f54777fe640 1 --2- 10.20.193.93:0/32371899 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f54780b1540 0x7f5478139480 secure :-1 s=READY pgs=54 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5468009990 tx=0x7f54680028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:04.206 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.207+0000 7f5474ff9640 1 -- 10.20.193.93:0/32371899 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5468038470 con 0x7f54780b1540 2026-02-23T06:21:04.207 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.207+0000 7f5474ff9640 1 -- 10.20.193.93:0/32371899 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54680386c0 con 0x7f54780b1540 2026-02-23T06:21:04.207 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.207+0000 7f5474ff9640 1 -- 10.20.193.93:0/32371899 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5468038a90 con 0x7f54780b1540 2026-02-23T06:21:04.207 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.207+0000 7f547e3b9640 1 -- 10.20.193.93:0/32371899 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54781fd180 con 0x7f54780b1540 2026-02-23T06:21:04.207 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.207+0000 7f547e3b9640 1 -- 10.20.193.93:0/32371899 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54781fd740 con 0x7f54780b1540 2026-02-23T06:21:04.207 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.207+0000 7f5474ff9640 1 -- 10.20.193.93:0/32371899 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f5468040420 con 0x7f54780b1540 2026-02-23T06:21:04.207 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.207+0000 7f5474ff9640 1 -- 10.20.193.93:0/32371899 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1065+0+0 (secure 0 0 0) 0x7f5468049df0 con 0x7f54780b1540 2026-02-23T06:21:04.207 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.207+0000 7f547e3b9640 1 -- 10.20.193.93:0/32371899 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f547805b2d0 con 0x7f54780b1540 2026-02-23T06:21:04.207 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.208+0000 7f5474ff9640 1 -- 10.20.193.93:0/32371899 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f5468049410 con 0x7f54780b1540 2026-02-23T06:21:04.237 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.242+0000 7f547e3b9640 1 -- 10.20.193.93:0/32371899 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4750309a-5bf2-4f48-a550-ca677b0b0f61", "id": 3} v 0) -- 0x7f5478160a30 con 0x7f54780b1540 2026-02-23T06:21:04.239 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.244+0000 7f5474ff9640 1 -- 10.20.193.93:0/32371899 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4750309a-5bf2-4f48-a550-ca677b0b0f61", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f5468049960 con 0x7f54780b1540 2026-02-23T06:21:04.240 INFO:teuthology.orchestra.run.trial093.stdout:3 2026-02-23T06:21:04.240 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.244+0000 7f547e3b9640 1 -- 10.20.193.93:0/32371899 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f54780b1540 msgr2=0x7f5478139480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.244+0000 7f547e3b9640 1 --2- 10.20.193.93:0/32371899 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f54780b1540 0x7f5478139480 secure :-1 s=READY pgs=54 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5468009990 tx=0x7f54680028d0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.244+0000 7f547e3b9640 1 -- 10.20.193.93:0/32371899 shutdown_connections 2026-02-23T06:21:04.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.244+0000 7f547e3b9640 1 --2- 10.20.193.93:0/32371899 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f54780b58a0 0x7f5478158ba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.244+0000 7f547e3b9640 1 --2- 10.20.193.93:0/32371899 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f54780b1540 0x7f5478139480 unknown :-1 s=CLOSED pgs=54 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.244+0000 7f547e3b9640 1 --2- 10.20.193.93:0/32371899 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f54780b1170 0x7f54781fdc60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.244+0000 7f547e3b9640 1 -- 10.20.193.93:0/32371899 >> 10.20.193.93:0/32371899 conn(0x7f5478058e50 msgr2=0x7f54780b4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:04.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.244+0000 7f547e3b9640 1 -- 10.20.193.93:0/32371899 shutdown_connections 2026-02-23T06:21:04.241 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.245+0000 7f547e3b9640 1 -- 10.20.193.93:0/32371899 wait complete. 2026-02-23T06:21:04.248 DEBUG:teuthology.orchestra.run.trial093:> sudo ceph --cluster ceph osd new 5cbb50f2-4e49-46eb-bd84-d92706459d2f 4 2026-02-23T06:21:04.317 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.319+0000 7f3eaf1c2640 1 -- 10.20.193.93:0/986079081 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3ea80b1170 msgr2=0x7f3ea815ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.317 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.319+0000 7f3eaf1c2640 1 --2- 10.20.193.93:0/986079081 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3ea80b1170 0x7f3ea815ce40 secure :-1 s=READY pgs=27 gs=3 cs=0 l=1 c_cookie=17548243677514990481 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e98009890 tx=0x7f3e9802f1f0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.317 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.319+0000 7f3eaf1c2640 1 -- 10.20.193.93:0/986079081 shutdown_connections 2026-02-23T06:21:04.318 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.319+0000 7f3eaf1c2640 1 --2- 10.20.193.93:0/986079081 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3ea80b1170 0x7f3ea815ce40 unknown :-1 s=CLOSED pgs=27 gs=3 cs=0 l=1 c_cookie=17548243677514990481 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.318 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.319+0000 7f3eaf1c2640 1 -- 10.20.193.93:0/986079081 >> 10.20.193.93:0/986079081 conn(0x7f3ea8058e50 msgr2=0x7f3ea8059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:04.318 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.319+0000 7f3eaf1c2640 1 -- 10.20.193.93:0/986079081 shutdown_connections 2026-02-23T06:21:04.318 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.319+0000 7f3eaf1c2640 1 -- 10.20.193.93:0/986079081 wait complete. 2026-02-23T06:21:04.318 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.319+0000 7f3eaf1c2640 1 Processor -- start 2026-02-23T06:21:04.318 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.319+0000 7f3eaf1c2640 1 -- start start 2026-02-23T06:21:04.318 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.320+0000 7f3eaf1c2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3ea80b1170 0x7f3ea8130a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:04.318 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.320+0000 7f3eaf1c2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3ea80b1540 0x7f3ea815c2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:04.318 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.320+0000 7f3eaf1c2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3ea8163820 0x7f3ea80b4670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:04.319 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.320+0000 7f3eaf1c2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea8130f40 con 0x7f3ea80b1540 2026-02-23T06:21:04.319 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.320+0000 7f3eaf1c2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea8136c90 con 0x7f3ea8163820 2026-02-23T06:21:04.319 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.320+0000 7f3eaf1c2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f3ea815c810 con 0x7f3ea80b1170 2026-02-23T06:21:04.319 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.320+0000 7f3eacf37640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3ea80b1170 0x7f3ea8130a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:04.319 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.320+0000 7f3eacf37640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3ea80b1170 0x7f3ea8130a00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.93:59854/0 (socket says 10.20.193.93:59854) 2026-02-23T06:21:04.319 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.320+0000 7f3ead738640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3ea8163820 0x7f3ea80b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:04.319 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.320+0000 7f3eacf37640 1 -- 10.20.193.93:0/4141049754 learned_addr learned my addr 10.20.193.93:0/4141049754 (peer_addr_for_me v2:10.20.193.93:0/0) 2026-02-23T06:21:04.319 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.320+0000 7f3e9ffff640 1 --2- 10.20.193.93:0/4141049754 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3ea80b1540 0x7f3ea815c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:04.319 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.320+0000 7f3eacf37640 1 -- 10.20.193.93:0/4141049754 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3ea8163820 msgr2=0x7f3ea80b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.319 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.320+0000 7f3eacf37640 1 --2- 10.20.193.93:0/4141049754 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3ea8163820 0x7f3ea80b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.320 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.320+0000 7f3eacf37640 1 -- 10.20.193.93:0/4141049754 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3ea80b1540 msgr2=0x7f3ea815c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.320 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.320+0000 7f3eacf37640 1 --2- 10.20.193.93:0/4141049754 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3ea80b1540 0x7f3ea815c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.320 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.320+0000 7f3eacf37640 1 -- 10.20.193.93:0/4141049754 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e980094b0 con 0x7f3ea80b1170 2026-02-23T06:21:04.320 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.320+0000 7f3e9ffff640 1 --2- 10.20.193.93:0/4141049754 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3ea80b1540 0x7f3ea815c2d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:21:04.320 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.320+0000 7f3eacf37640 1 --2- 10.20.193.93:0/4141049754 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3ea80b1170 0x7f3ea8130a00 secure :-1 s=READY pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e98009990 tx=0x7f3e980028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:04.320 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.320+0000 7f3e9d7fa640 1 -- 10.20.193.93:0/4141049754 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e98038470 con 0x7f3ea80b1170 2026-02-23T06:21:04.320 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.320+0000 7f3e9d7fa640 1 -- 10.20.193.93:0/4141049754 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e980386c0 con 0x7f3ea80b1170 2026-02-23T06:21:04.320 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.320+0000 7f3eaf1c2640 1 -- 10.20.193.93:0/4141049754 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ea815a8d0 con 0x7f3ea80b1170 2026-02-23T06:21:04.320 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.320+0000 7f3e9d7fa640 1 -- 10.20.193.93:0/4141049754 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e98038a90 con 0x7f3ea80b1170 2026-02-23T06:21:04.320 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.320+0000 7f3eaf1c2640 1 -- 10.20.193.93:0/4141049754 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ea8136640 con 0x7f3ea80b1170 2026-02-23T06:21:04.320 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.320+0000 7f3e9d7fa640 1 -- 10.20.193.93:0/4141049754 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f3e98040420 con 0x7f3ea80b1170 2026-02-23T06:21:04.321 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.320+0000 7f3e9d7fa640 1 -- 10.20.193.93:0/4141049754 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1180+0+0 (secure 0 0 0) 0x7f3e9803f380 con 0x7f3ea80b1170 2026-02-23T06:21:04.321 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.321+0000 7f3eaf1c2640 1 -- 10.20.193.93:0/4141049754 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ea805b2d0 con 0x7f3ea80b1170 2026-02-23T06:21:04.321 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.322+0000 7f3e9d7fa640 1 -- 10.20.193.93:0/4141049754 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f3e98049410 con 0x7f3ea80b1170 2026-02-23T06:21:04.350 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.355+0000 7f3eaf1c2640 1 -- 10.20.193.93:0/4141049754 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5cbb50f2-4e49-46eb-bd84-d92706459d2f", "id": 4} v 0) -- 0x7f3ea8160a30 con 0x7f3ea80b1170 2026-02-23T06:21:04.352 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.357+0000 7f3e9d7fa640 1 -- 10.20.193.93:0/4141049754 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5cbb50f2-4e49-46eb-bd84-d92706459d2f", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f3e980580b0 con 0x7f3ea80b1170 2026-02-23T06:21:04.353 INFO:teuthology.orchestra.run.trial093.stdout:4 2026-02-23T06:21:04.354 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.358+0000 7f3eaf1c2640 1 -- 10.20.193.93:0/4141049754 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3ea80b1170 msgr2=0x7f3ea8130a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.354 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.358+0000 7f3eaf1c2640 1 --2- 10.20.193.93:0/4141049754 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3ea80b1170 0x7f3ea8130a00 secure :-1 s=READY pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e98009990 tx=0x7f3e980028d0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.354 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.358+0000 7f3eaf1c2640 1 -- 10.20.193.93:0/4141049754 shutdown_connections 2026-02-23T06:21:04.354 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.358+0000 7f3eaf1c2640 1 --2- 10.20.193.93:0/4141049754 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3ea8163820 0x7f3ea80b4670 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.354 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.358+0000 7f3eaf1c2640 1 --2- 10.20.193.93:0/4141049754 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3ea80b1540 0x7f3ea815c2d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.354 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.358+0000 7f3eaf1c2640 1 --2- 10.20.193.93:0/4141049754 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3ea80b1170 0x7f3ea8130a00 unknown :-1 s=CLOSED pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.355 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.358+0000 7f3eaf1c2640 1 -- 10.20.193.93:0/4141049754 >> 10.20.193.93:0/4141049754 conn(0x7f3ea8058e50 msgr2=0x7f3ea8138810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:04.355 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.358+0000 7f3eaf1c2640 1 -- 10.20.193.93:0/4141049754 shutdown_connections 2026-02-23T06:21:04.355 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.358+0000 7f3eaf1c2640 1 -- 10.20.193.93:0/4141049754 wait complete. 2026-02-23T06:21:04.361 DEBUG:teuthology.orchestra.run.trial093:> sudo ceph --cluster ceph osd new 2806c775-4720-43a7-ab9f-85a4adb31098 5 2026-02-23T06:21:04.427 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.432+0000 7fa69a50c640 1 -- 10.20.193.93:0/3997002795 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa678003a80 msgr2=0x7fa678003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.427 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.432+0000 7fa69a50c640 1 --2- 10.20.193.93:0/3997002795 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa678003a80 0x7fa678003e70 secure :-1 s=READY pgs=61 gs=4 cs=0 l=1 c_cookie=12318223365341417859 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa68000c2e0 tx=0x7fa68002f900 comp rx=0 tx=0).stop 2026-02-23T06:21:04.427 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.432+0000 7fa69a50c640 1 -- 10.20.193.93:0/3997002795 shutdown_connections 2026-02-23T06:21:04.427 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.432+0000 7fa69a50c640 1 --2- 10.20.193.93:0/3997002795 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa678003a80 0x7fa678003e70 unknown :-1 s=CLOSED pgs=61 gs=4 cs=0 l=1 c_cookie=12318223365341417859 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.427 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.432+0000 7fa69a50c640 1 -- 10.20.193.93:0/3997002795 >> 10.20.193.93:0/3997002795 conn(0x7fa694058e50 msgr2=0x7fa694059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:04.427 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.432+0000 7fa69a50c640 1 -- 10.20.193.93:0/3997002795 shutdown_connections 2026-02-23T06:21:04.427 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.432+0000 7fa69a50c640 1 -- 10.20.193.93:0/3997002795 wait complete. 2026-02-23T06:21:04.428 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.433+0000 7fa69a50c640 1 Processor -- start 2026-02-23T06:21:04.428 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.433+0000 7fa69a50c640 1 -- start start 2026-02-23T06:21:04.428 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.433+0000 7fa69a50c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa678003a80 0x7fa694148bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:04.429 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.433+0000 7fa69a50c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa69411cc50 0x7fa69413b7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:04.429 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.433+0000 7fa69a50c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa69414b7c0 0x7fa694164450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:04.429 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.433+0000 7fa69a50c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa69411b530 con 0x7fa678003a80 2026-02-23T06:21:04.429 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.433+0000 7fa69a50c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fa694148220 con 0x7fa69411cc50 2026-02-23T06:21:04.429 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.433+0000 7fa69a50c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa69414c7c0 con 0x7fa69414b7c0 2026-02-23T06:21:04.429 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.434+0000 7fa6937fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa69411cc50 0x7fa69413b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:04.429 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.434+0000 7fa6937fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa69411cc50 0x7fa69413b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.93:51990/0 (socket says 10.20.193.93:51990) 2026-02-23T06:21:04.429 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.434+0000 7fa6937fe640 1 -- 10.20.193.93:0/947439920 learned_addr learned my addr 10.20.193.93:0/947439920 (peer_addr_for_me v2:10.20.193.93:0/0) 2026-02-23T06:21:04.429 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.434+0000 7fa698a82640 1 --2- 10.20.193.93:0/947439920 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa69414b7c0 0x7fa694164450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:04.429 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.434+0000 7fa693fff640 1 --2- 10.20.193.93:0/947439920 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa678003a80 0x7fa694148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:04.429 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.434+0000 7fa6937fe640 1 -- 10.20.193.93:0/947439920 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa69414b7c0 msgr2=0x7fa694164450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.429 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.434+0000 7fa6937fe640 1 --2- 10.20.193.93:0/947439920 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa69414b7c0 0x7fa694164450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.429 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.434+0000 7fa6937fe640 1 -- 10.20.193.93:0/947439920 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa678003a80 msgr2=0x7fa694148bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.429 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.434+0000 7fa6937fe640 1 --2- 10.20.193.93:0/947439920 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa678003a80 0x7fa694148bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.429 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.434+0000 7fa6937fe640 1 -- 10.20.193.93:0/947439920 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa694158e60 con 0x7fa69411cc50 2026-02-23T06:21:04.429 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.434+0000 7fa6937fe640 1 --2- 10.20.193.93:0/947439920 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa69411cc50 0x7fa69413b7a0 secure :-1 s=READY pgs=62 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa684010a70 tx=0x7fa684010f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:04.429 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.434+0000 7fa690ff9640 1 -- 10.20.193.93:0/947439920 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa6840040d0 con 0x7fa69411cc50 2026-02-23T06:21:04.429 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.434+0000 7fa690ff9640 1 -- 10.20.193.93:0/947439920 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa684004230 con 0x7fa69411cc50 2026-02-23T06:21:04.429 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.434+0000 7fa690ff9640 1 -- 10.20.193.93:0/947439920 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa6840045c0 con 0x7fa69411cc50 2026-02-23T06:21:04.429 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.434+0000 7fa69a50c640 1 -- 10.20.193.93:0/947439920 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa694148430 con 0x7fa69411cc50 2026-02-23T06:21:04.429 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.434+0000 7fa69a50c640 1 -- 10.20.193.93:0/947439920 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa69411c4f0 con 0x7fa69411cc50 2026-02-23T06:21:04.429 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.434+0000 7fa69a50c640 1 -- 10.20.193.93:0/947439920 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6940b5610 con 0x7fa69411cc50 2026-02-23T06:21:04.429 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.434+0000 7fa690ff9640 1 -- 10.20.193.93:0/947439920 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 2) ==== 52538+0+0 (secure 0 0 0) 0x7fa6840026a0 con 0x7fa69411cc50 2026-02-23T06:21:04.429 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.435+0000 7fa690ff9640 1 -- 10.20.193.93:0/947439920 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1295+0+0 (secure 0 0 0) 0x7fa684054070 con 0x7fa69411cc50 2026-02-23T06:21:04.430 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.435+0000 7fa690ff9640 1 -- 10.20.193.93:0/947439920 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7fa684002980 con 0x7fa69411cc50 2026-02-23T06:21:04.464 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.469+0000 7fa69a50c640 1 -- 10.20.193.93:0/947439920 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2806c775-4720-43a7-ab9f-85a4adb31098", "id": 5} v 0) -- 0x7fa6940b6310 con 0x7fa69411cc50 2026-02-23T06:21:04.466 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.471+0000 7fa690ff9640 1 -- 10.20.193.93:0/947439920 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2806c775-4720-43a7-ab9f-85a4adb31098", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fa68401f020 con 0x7fa69411cc50 2026-02-23T06:21:04.467 INFO:teuthology.orchestra.run.trial093.stdout:5 2026-02-23T06:21:04.468 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.472+0000 7fa69a50c640 1 -- 10.20.193.93:0/947439920 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa69411cc50 msgr2=0x7fa69413b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.468 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.472+0000 7fa69a50c640 1 --2- 10.20.193.93:0/947439920 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa69411cc50 0x7fa69413b7a0 secure :-1 s=READY pgs=62 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa684010a70 tx=0x7fa684010f40 comp rx=0 tx=0).stop 2026-02-23T06:21:04.468 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.472+0000 7fa69a50c640 1 -- 10.20.193.93:0/947439920 shutdown_connections 2026-02-23T06:21:04.468 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.472+0000 7fa69a50c640 1 --2- 10.20.193.93:0/947439920 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa69414b7c0 0x7fa694164450 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.468 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.472+0000 7fa69a50c640 1 --2- 10.20.193.93:0/947439920 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa69411cc50 0x7fa69413b7a0 unknown :-1 s=CLOSED pgs=62 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.468 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.472+0000 7fa69a50c640 1 --2- 10.20.193.93:0/947439920 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa678003a80 0x7fa694148bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.468 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.472+0000 7fa69a50c640 1 -- 10.20.193.93:0/947439920 >> 10.20.193.93:0/947439920 conn(0x7fa694058e50 msgr2=0x7fa69415a900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:04.468 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.472+0000 7fa69a50c640 1 -- 10.20.193.93:0/947439920 shutdown_connections 2026-02-23T06:21:04.469 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.472+0000 7fa69a50c640 1 -- 10.20.193.93:0/947439920 wait complete. 2026-02-23T06:21:04.473 DEBUG:teuthology.orchestra.run.trial093:> sudo ceph --cluster ceph osd new aa03b46d-d30f-4b09-9251-c9514e8b8b6d 6 2026-02-23T06:21:04.538 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.543+0000 7fb62830c640 1 -- 10.20.193.93:0/2974943546 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb6200b6a20 msgr2=0x7fb6200b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.538 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.543+0000 7fb62830c640 1 --2- 10.20.193.93:0/2974943546 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb6200b6a20 0x7fb6200b3300 secure :-1 s=READY pgs=32 gs=2 cs=0 l=1 c_cookie=17967933073383707136 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb61c006f50 tx=0x7fb61c030360 comp rx=0 tx=0).stop 2026-02-23T06:21:04.538 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.543+0000 7fb62830c640 1 -- 10.20.193.93:0/2974943546 shutdown_connections 2026-02-23T06:21:04.538 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.543+0000 7fb62830c640 1 --2- 10.20.193.93:0/2974943546 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb6200b6a20 0x7fb6200b3300 unknown :-1 s=CLOSED pgs=32 gs=2 cs=0 l=1 c_cookie=17967933073383707136 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.538 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.543+0000 7fb62830c640 1 --2- 10.20.193.93:0/2974943546 >> v2:10.20.193.58:3300/0 conn(0x7fb620161ee0 0x7fb6200b72c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.539 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.543+0000 7fb62830c640 1 -- 10.20.193.93:0/2974943546 >> 10.20.193.93:0/2974943546 conn(0x7fb620058e50 msgr2=0x7fb620059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:04.539 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.543+0000 7fb62830c640 1 -- 10.20.193.93:0/2974943546 shutdown_connections 2026-02-23T06:21:04.539 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.543+0000 7fb62830c640 1 -- 10.20.193.93:0/2974943546 wait complete. 2026-02-23T06:21:04.542 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.543+0000 7fb62830c640 1 Processor -- start 2026-02-23T06:21:04.542 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.543+0000 7fb62830c640 1 -- start start 2026-02-23T06:21:04.542 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.544+0000 7fb62830c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb6200b6a20 0x7fb620135140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:04.542 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.544+0000 7fb62830c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb620158740 0x7fb6200b03a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:04.542 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.544+0000 7fb62830c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb620161ee0 0x7fb6200b08e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:04.542 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.544+0000 7fb62830c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb620163740 con 0x7fb620161ee0 2026-02-23T06:21:04.542 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.544+0000 7fb62830c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb620163d00 con 0x7fb620158740 2026-02-23T06:21:04.542 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.544+0000 7fb62830c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb62005ba80 con 0x7fb6200b6a20 2026-02-23T06:21:04.542 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.544+0000 7fb626081640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb6200b6a20 0x7fb620135140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:04.543 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.544+0000 7fb626081640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb6200b6a20 0x7fb620135140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.93:59938/0 (socket says 10.20.193.93:59938) 2026-02-23T06:21:04.543 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.544+0000 7fb625880640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb620158740 0x7fb6200b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:04.543 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.544+0000 7fb626081640 1 -- 10.20.193.93:0/2691408662 learned_addr learned my addr 10.20.193.93:0/2691408662 (peer_addr_for_me v2:10.20.193.93:0/0) 2026-02-23T06:21:04.543 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.544+0000 7fb626882640 1 --2- 10.20.193.93:0/2691408662 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb620161ee0 0x7fb6200b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:04.543 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.544+0000 7fb626081640 1 -- 10.20.193.93:0/2691408662 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb620158740 msgr2=0x7fb6200b03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.543 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.544+0000 7fb626081640 1 --2- 10.20.193.93:0/2691408662 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb620158740 0x7fb6200b03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.543 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.544+0000 7fb626081640 1 -- 10.20.193.93:0/2691408662 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb620161ee0 msgr2=0x7fb6200b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.543 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.544+0000 7fb626081640 1 --2- 10.20.193.93:0/2691408662 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb620161ee0 0x7fb6200b08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.543 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.544+0000 7fb626081640 1 -- 10.20.193.93:0/2691408662 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb61c00a650 con 0x7fb6200b6a20 2026-02-23T06:21:04.543 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.544+0000 7fb626081640 1 --2- 10.20.193.93:0/2691408662 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb6200b6a20 0x7fb620135140 secure :-1 s=READY pgs=33 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb61000c480 tx=0x7fb61000c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:04.543 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.544+0000 7fb606ffd640 1 -- 10.20.193.93:0/2691408662 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb610006ab0 con 0x7fb6200b6a20 2026-02-23T06:21:04.543 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.544+0000 7fb606ffd640 1 -- 10.20.193.93:0/2691408662 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb610006d00 con 0x7fb6200b6a20 2026-02-23T06:21:04.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.544+0000 7fb62830c640 1 -- 10.20.193.93:0/2691408662 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb62005bd60 con 0x7fb6200b6a20 2026-02-23T06:21:04.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.544+0000 7fb606ffd640 1 -- 10.20.193.93:0/2691408662 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6100072b0 con 0x7fb6200b6a20 2026-02-23T06:21:04.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.544+0000 7fb62830c640 1 -- 10.20.193.93:0/2691408662 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6200b5ec0 con 0x7fb6200b6a20 2026-02-23T06:21:04.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.545+0000 7fb62830c640 1 -- 10.20.193.93:0/2691408662 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb620163b30 con 0x7fb6200b6a20 2026-02-23T06:21:04.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.545+0000 7fb606ffd640 1 -- 10.20.193.93:0/2691408662 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 2) ==== 52538+0+0 (secure 0 0 0) 0x7fb610007410 con 0x7fb6200b6a20 2026-02-23T06:21:04.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.545+0000 7fb606ffd640 1 -- 10.20.193.93:0/2691408662 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1410+0+0 (secure 0 0 0) 0x7fb610052e40 con 0x7fb6200b6a20 2026-02-23T06:21:04.544 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.546+0000 7fb606ffd640 1 -- 10.20.193.93:0/2691408662 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7fb610019740 con 0x7fb6200b6a20 2026-02-23T06:21:04.573 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.578+0000 7fb62830c640 1 -- 10.20.193.93:0/2691408662 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "osd new", "uuid": "aa03b46d-d30f-4b09-9251-c9514e8b8b6d", "id": 6} v 0) -- 0x7fb6201629b0 con 0x7fb6200b6a20 2026-02-23T06:21:04.576 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.581+0000 7fb606ffd640 1 -- 10.20.193.93:0/2691408662 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aa03b46d-d30f-4b09-9251-c9514e8b8b6d", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fb61001a360 con 0x7fb6200b6a20 2026-02-23T06:21:04.576 INFO:teuthology.orchestra.run.trial093.stdout:6 2026-02-23T06:21:04.577 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.581+0000 7fb62830c640 1 -- 10.20.193.93:0/2691408662 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb6200b6a20 msgr2=0x7fb620135140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.577 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.581+0000 7fb62830c640 1 --2- 10.20.193.93:0/2691408662 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb6200b6a20 0x7fb620135140 secure :-1 s=READY pgs=33 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb61000c480 tx=0x7fb61000c950 comp rx=0 tx=0).stop 2026-02-23T06:21:04.577 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.581+0000 7fb62830c640 1 -- 10.20.193.93:0/2691408662 shutdown_connections 2026-02-23T06:21:04.577 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.581+0000 7fb62830c640 1 --2- 10.20.193.93:0/2691408662 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb620161ee0 0x7fb6200b08e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.577 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.581+0000 7fb62830c640 1 --2- 10.20.193.93:0/2691408662 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb620158740 0x7fb6200b03a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.578 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.581+0000 7fb62830c640 1 --2- 10.20.193.93:0/2691408662 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb6200b6a20 0x7fb620135140 unknown :-1 s=CLOSED pgs=33 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.578 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.581+0000 7fb62830c640 1 -- 10.20.193.93:0/2691408662 >> 10.20.193.93:0/2691408662 conn(0x7fb620058e50 msgr2=0x7fb620160180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:04.578 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.581+0000 7fb62830c640 1 -- 10.20.193.93:0/2691408662 shutdown_connections 2026-02-23T06:21:04.578 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.581+0000 7fb62830c640 1 -- 10.20.193.93:0/2691408662 wait complete. 2026-02-23T06:21:04.583 DEBUG:teuthology.orchestra.run.trial093:> sudo ceph --cluster ceph osd new b15519bf-2b7b-4fd5-8ef6-e09af0ad9817 7 2026-02-23T06:21:04.648 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.652+0000 7fd74b81b640 1 -- 10.20.193.93:0/888974153 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd74415baa0 msgr2=0x7fd7440b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.648 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.652+0000 7fd74b81b640 1 --2- 10.20.193.93:0/888974153 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd74415baa0 0x7fd7440b5610 secure :-1 s=READY pgs=34 gs=3 cs=0 l=1 c_cookie=12695408066431465476 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd734009890 tx=0x7fd73402f1f0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.649 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.652+0000 7fd74b81b640 1 -- 10.20.193.93:0/888974153 shutdown_connections 2026-02-23T06:21:04.649 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.652+0000 7fd74b81b640 1 --2- 10.20.193.93:0/888974153 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd74415baa0 0x7fd7440b5610 unknown :-1 s=CLOSED pgs=34 gs=3 cs=0 l=1 c_cookie=12695408066431465476 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.649 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.652+0000 7fd74b81b640 1 -- 10.20.193.93:0/888974153 >> 10.20.193.93:0/888974153 conn(0x7fd744058e50 msgr2=0x7fd744059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:04.649 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.652+0000 7fd74b81b640 1 -- 10.20.193.93:0/888974153 shutdown_connections 2026-02-23T06:21:04.649 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.652+0000 7fd74b81b640 1 -- 10.20.193.93:0/888974153 wait complete. 2026-02-23T06:21:04.649 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.653+0000 7fd74b81b640 1 Processor -- start 2026-02-23T06:21:04.649 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.653+0000 7fd74b81b640 1 -- start start 2026-02-23T06:21:04.652 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.654+0000 7fd74b81b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd7440b39f0 0x7fd744159300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:04.652 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.654+0000 7fd74b81b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd74415baa0 0x7fd744122e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:04.652 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.654+0000 7fd74b81b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd74415be70 0x7fd74413b8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:04.652 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.654+0000 7fd74b81b640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fd744123390 con 0x7fd7440b39f0 2026-02-23T06:21:04.652 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.654+0000 7fd74b81b640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fd74411dc50 con 0x7fd74415be70 2026-02-23T06:21:04.652 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.654+0000 7fd74b81b640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fd744159a70 con 0x7fd74415baa0 2026-02-23T06:21:04.652 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.654+0000 7fd749d91640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd74415be70 0x7fd74413b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:04.652 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.654+0000 7fd748d8f640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd74415baa0 0x7fd744122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:04.653 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.654+0000 7fd749d91640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd74415be70 0x7fd74413b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.93:52008/0 (socket says 10.20.193.93:52008) 2026-02-23T06:21:04.653 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.654+0000 7fd748d8f640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd74415baa0 0x7fd744122e50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.93:59966/0 (socket says 10.20.193.93:59966) 2026-02-23T06:21:04.653 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.654+0000 7fd749d91640 1 -- 10.20.193.93:0/1695247485 learned_addr learned my addr 10.20.193.93:0/1695247485 (peer_addr_for_me v2:10.20.193.93:0/0) 2026-02-23T06:21:04.653 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.654+0000 7fd749d91640 1 -- 10.20.193.93:0/1695247485 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd74415baa0 msgr2=0x7fd744122e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.653 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.654+0000 7fd749d91640 1 --2- 10.20.193.93:0/1695247485 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd74415baa0 0x7fd744122e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.653 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.654+0000 7fd749d91640 1 -- 10.20.193.93:0/1695247485 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd7440b39f0 msgr2=0x7fd744159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.653 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.654+0000 7fd749590640 1 --2- 10.20.193.93:0/1695247485 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd7440b39f0 0x7fd744159300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:04.653 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.654+0000 7fd749d91640 1 --2- 10.20.193.93:0/1695247485 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd7440b39f0 0x7fd744159300 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.653 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.654+0000 7fd749d91640 1 -- 10.20.193.93:0/1695247485 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7340094b0 con 0x7fd74415be70 2026-02-23T06:21:04.653 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.654+0000 7fd748d8f640 1 --2- 10.20.193.93:0/1695247485 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd74415baa0 0x7fd744122e50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:04.653 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.654+0000 7fd749d91640 1 --2- 10.20.193.93:0/1695247485 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd74415be70 0x7fd74413b8f0 secure :-1 s=READY pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd74000d520 tx=0x7fd74000d9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:04.653 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.654+0000 7fd731ffb640 1 -- 10.20.193.93:0/1695247485 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd740007b90 con 0x7fd74415be70 2026-02-23T06:21:04.654 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.654+0000 7fd731ffb640 1 -- 10.20.193.93:0/1695247485 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd740007de0 con 0x7fd74415be70 2026-02-23T06:21:04.654 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.654+0000 7fd74b81b640 1 -- 10.20.193.93:0/1695247485 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd74411def0 con 0x7fd74415be70 2026-02-23T06:21:04.654 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.654+0000 7fd731ffb640 1 -- 10.20.193.93:0/1695247485 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd7400062b0 con 0x7fd74415be70 2026-02-23T06:21:04.654 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.654+0000 7fd74b81b640 1 -- 10.20.193.93:0/1695247485 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd74411e4b0 con 0x7fd74415be70 2026-02-23T06:21:04.654 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.654+0000 7fd74b81b640 1 -- 10.20.193.93:0/1695247485 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd74411e6a0 con 0x7fd74415be70 2026-02-23T06:21:04.654 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.654+0000 7fd731ffb640 1 -- 10.20.193.93:0/1695247485 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 2) ==== 52538+0+0 (secure 0 0 0) 0x7fd740006410 con 0x7fd74415be70 2026-02-23T06:21:04.654 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.655+0000 7fd731ffb640 1 -- 10.20.193.93:0/1695247485 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1525+0+0 (secure 0 0 0) 0x7fd740054380 con 0x7fd74415be70 2026-02-23T06:21:04.654 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.656+0000 7fd731ffb640 1 -- 10.20.193.93:0/1695247485 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7fd74001a7d0 con 0x7fd74415be70 2026-02-23T06:21:04.683 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.688+0000 7fd74b81b640 1 -- 10.20.193.93:0/1695247485 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b15519bf-2b7b-4fd5-8ef6-e09af0ad9817", "id": 7} v 0) -- 0x7fd7440b5610 con 0x7fd74415be70 2026-02-23T06:21:04.686 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.691+0000 7fd731ffb640 1 -- 10.20.193.93:0/1695247485 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b15519bf-2b7b-4fd5-8ef6-e09af0ad9817", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fd7400170b0 con 0x7fd74415be70 2026-02-23T06:21:04.686 INFO:teuthology.orchestra.run.trial093.stdout:7 2026-02-23T06:21:04.687 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.691+0000 7fd74b81b640 1 -- 10.20.193.93:0/1695247485 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd74415be70 msgr2=0x7fd74413b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.687 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.691+0000 7fd74b81b640 1 --2- 10.20.193.93:0/1695247485 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd74415be70 0x7fd74413b8f0 secure :-1 s=READY pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd74000d520 tx=0x7fd74000d9f0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.687 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.691+0000 7fd74b81b640 1 -- 10.20.193.93:0/1695247485 shutdown_connections 2026-02-23T06:21:04.688 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.691+0000 7fd74b81b640 1 --2- 10.20.193.93:0/1695247485 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd74415be70 0x7fd74413b8f0 unknown :-1 s=CLOSED pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.688 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.691+0000 7fd74b81b640 1 --2- 10.20.193.93:0/1695247485 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd74415baa0 0x7fd744122e50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.688 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.691+0000 7fd74b81b640 1 --2- 10.20.193.93:0/1695247485 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd7440b39f0 0x7fd744159300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.688 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.691+0000 7fd74b81b640 1 -- 10.20.193.93:0/1695247485 >> 10.20.193.93:0/1695247485 conn(0x7fd744058e50 msgr2=0x7fd744157fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:04.688 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.691+0000 7fd74b81b640 1 -- 10.20.193.93:0/1695247485 shutdown_connections 2026-02-23T06:21:04.688 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-23T06:21:04.691+0000 7fd74b81b640 1 -- 10.20.193.93:0/1695247485 wait complete. 2026-02-23T06:21:04.693 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-23T06:21:04.694 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-23T06:21:04.698 INFO:tasks.ceph.osd.0:Started 2026-02-23T06:21:04.698 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-23T06:21:04.698 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-23T06:21:04.702 INFO:tasks.ceph.osd.1:Started 2026-02-23T06:21:04.702 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-23T06:21:04.702 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-23T06:21:04.706 INFO:tasks.ceph.osd.2:Started 2026-02-23T06:21:04.706 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-23T06:21:04.706 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-23T06:21:04.710 INFO:tasks.ceph.osd.3:Started 2026-02-23T06:21:04.710 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-23T06:21:04.710 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2026-02-23T06:21:04.712 INFO:tasks.ceph.osd.4:Started 2026-02-23T06:21:04.713 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-23T06:21:04.713 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2026-02-23T06:21:04.715 INFO:tasks.ceph.osd.5:Started 2026-02-23T06:21:04.715 INFO:tasks.ceph.osd.6:Restarting daemon 2026-02-23T06:21:04.715 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2026-02-23T06:21:04.718 INFO:tasks.ceph.osd.6:Started 2026-02-23T06:21:04.718 INFO:tasks.ceph.osd.7:Restarting daemon 2026-02-23T06:21:04.718 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2026-02-23T06:21:04.720 INFO:tasks.ceph.osd.7:Started 2026-02-23T06:21:04.720 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-23T06:21:04.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.855+0000 7fbafbfff640 1 -- 10.20.193.58:0/1158531330 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbafc15d4a0 msgr2=0x7fbafc0affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.855+0000 7fbafbfff640 1 --2- 10.20.193.58:0/1158531330 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbafc15d4a0 0x7fbafc0affb0 secure :-1 s=READY pgs=39 gs=1 cs=0 l=1 c_cookie=870414904228680348 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbafc0b1b90 tx=0x7fbaf002f250 comp rx=0 tx=0).stop 2026-02-23T06:21:04.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.855+0000 7fbafbfff640 1 -- 10.20.193.58:0/1158531330 shutdown_connections 2026-02-23T06:21:04.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.855+0000 7fbafbfff640 1 --2- 10.20.193.58:0/1158531330 >> v2:10.20.193.93:3300/0 conn(0x7fbafc0b6690 0x7fbafc058cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.855+0000 7fbafbfff640 1 --2- 10.20.193.58:0/1158531330 >> v2:10.20.193.58:3300/0 conn(0x7fbafc15d870 0x7fbafc0587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.855+0000 7fbafbfff640 1 --2- 10.20.193.58:0/1158531330 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbafc15d4a0 0x7fbafc0affb0 unknown :-1 s=CLOSED pgs=39 gs=1 cs=0 l=1 c_cookie=870414904228680348 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.855+0000 7fbafbfff640 1 -- 10.20.193.58:0/1158531330 >> 10.20.193.58:0/1158531330 conn(0x7fbafc0b3c20 msgr2=0x7fbafc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:04.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.855+0000 7fbafbfff640 1 -- 10.20.193.58:0/1158531330 shutdown_connections 2026-02-23T06:21:04.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.855+0000 7fbafbfff640 1 -- 10.20.193.58:0/1158531330 wait complete. 2026-02-23T06:21:04.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.856+0000 7fbafbfff640 1 Processor -- start 2026-02-23T06:21:04.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.857+0000 7fbafbfff640 1 -- start start 2026-02-23T06:21:04.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.857+0000 7fbafbfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbafc0b6690 0x7fbafc1624f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:04.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.857+0000 7fbafbfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbafc15d4a0 0x7fbafc17e8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:04.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.857+0000 7fbafbfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbafc15d870 0x7fbafc15f280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:04.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.857+0000 7fbafbfff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc1399d0 con 0x7fbafc15d870 2026-02-23T06:21:04.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.857+0000 7fbafbfff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc15a7e0 con 0x7fbafc0b6690 2026-02-23T06:21:04.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.857+0000 7fbafbfff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fbafc17b300 con 0x7fbafc15d4a0 2026-02-23T06:21:04.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.857+0000 7fbafaffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbafc0b6690 0x7fbafc1624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:04.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.857+0000 7fbafaffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbafc0b6690 0x7fbafc1624f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:55984/0 (socket says 10.20.193.58:55984) 2026-02-23T06:21:04.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.857+0000 7fbafaffd640 1 -- 10.20.193.58:0/3178750076 learned_addr learned my addr 10.20.193.58:0/3178750076 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:04.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.857+0000 7fbafb7fe640 1 --2- 10.20.193.58:0/3178750076 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbafc15d870 0x7fbafc15f280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:04.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.858+0000 7fbafa7fc640 1 --2- 10.20.193.58:0/3178750076 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbafc15d4a0 0x7fbafc17e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:04.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.858+0000 7fbafaffd640 1 -- 10.20.193.58:0/3178750076 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbafc15d4a0 msgr2=0x7fbafc17e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.858+0000 7fbafaffd640 1 --2- 10.20.193.58:0/3178750076 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbafc15d4a0 0x7fbafc17e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.858+0000 7fbafaffd640 1 -- 10.20.193.58:0/3178750076 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbafc15d870 msgr2=0x7fbafc15f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.858+0000 7fbafaffd640 1 --2- 10.20.193.58:0/3178750076 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbafc15d870 0x7fbafc15f280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.858+0000 7fbafaffd640 1 -- 10.20.193.58:0/3178750076 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae40094b0 con 0x7fbafc0b6690 2026-02-23T06:21:04.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.858+0000 7fbafaffd640 1 --2- 10.20.193.58:0/3178750076 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbafc0b6690 0x7fbafc1624f0 secure :-1 s=READY pgs=74 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbaf0004740 tx=0x7fbaf00028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:04.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.858+0000 7fbadb7fe640 1 -- 10.20.193.58:0/3178750076 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbaf003d070 con 0x7fbafc0b6690 2026-02-23T06:21:04.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.858+0000 7fbadb7fe640 1 -- 10.20.193.58:0/3178750076 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbaf0038470 con 0x7fbafc0b6690 2026-02-23T06:21:04.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.858+0000 7fbadb7fe640 1 -- 10.20.193.58:0/3178750076 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbaf00388a0 con 0x7fbafc0b6690 2026-02-23T06:21:04.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.858+0000 7fbafbfff640 1 -- 10.20.193.58:0/3178750076 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf0009570 con 0x7fbafc0b6690 2026-02-23T06:21:04.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.858+0000 7fbafbfff640 1 -- 10.20.193.58:0/3178750076 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbafc17b510 con 0x7fbafc0b6690 2026-02-23T06:21:04.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.859+0000 7fbafbfff640 1 -- 10.20.193.58:0/3178750076 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbafc17bf60 con 0x7fbafc0b6690 2026-02-23T06:21:04.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.859+0000 7fbadb7fe640 1 -- 10.20.193.58:0/3178750076 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 2) ==== 52538+0+0 (secure 0 0 0) 0x7fbaf0038a00 con 0x7fbafc0b6690 2026-02-23T06:21:04.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.860+0000 7fbadb7fe640 1 -- 10.20.193.58:0/3178750076 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1640+0+0 (secure 0 0 0) 0x7fbaf0078370 con 0x7fbafc0b6690 2026-02-23T06:21:04.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.860+0000 7fbadb7fe640 1 -- 10.20.193.58:0/3178750076 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7fbafc17bf60 con 0x7fbafc0b6690 2026-02-23T06:21:04.886 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.891+0000 7fbafbfff640 1 -- 10.20.193.58:0/3178750076 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbafc17bf60 con 0x7fbafc0b6690 2026-02-23T06:21:04.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.892+0000 7fbadb7fe640 1 -- 10.20.193.58:0/3178750076 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7056 (secure 0 0 0) 0x7fbafc17bf60 con 0x7fbafc0b6690 2026-02-23T06:21:04.887 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:04.887 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":10,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","created":"2026-02-23T06:21:02.010508+0000","modified":"2026-02-23T06:21:04.690899+0000","last_up_change":"0.000000","last_in_change":"2026-02-23T06:21:04.690899+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"96cc0898-14bb-4d56-827a-8845bd4307c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bf665af4-6e3c-4cb3-899c-acede65c31f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2bcb3165-28ad-45d6-9a49-9d9da08501f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4750309a-5bf2-4f48-a550-ca677b0b0f61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5cbb50f2-4e49-46eb-bd84-d92706459d2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2806c775-4720-43a7-ab9f-85a4adb31098","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"aa03b46d-d30f-4b09-9251-c9514e8b8b6d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b15519bf-2b7b-4fd5-8ef6-e09af0ad9817","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-23T06:21:04.888 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.892+0000 7fbafbfff640 1 -- 10.20.193.58:0/3178750076 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbafc0b6690 msgr2=0x7fbafc1624f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:04.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.892+0000 7fbafbfff640 1 --2- 10.20.193.58:0/3178750076 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbafc0b6690 0x7fbafc1624f0 secure :-1 s=READY pgs=74 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbaf0004740 tx=0x7fbaf00028d0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.892+0000 7fbafbfff640 1 -- 10.20.193.58:0/3178750076 shutdown_connections 2026-02-23T06:21:04.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.892+0000 7fbafbfff640 1 --2- 10.20.193.58:0/3178750076 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbafc15d870 0x7fbafc15f280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.892+0000 7fbafbfff640 1 --2- 10.20.193.58:0/3178750076 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbafc15d4a0 0x7fbafc17e8f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.892+0000 7fbafbfff640 1 --2- 10.20.193.58:0/3178750076 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbafc0b6690 0x7fbafc1624f0 unknown :-1 s=CLOSED pgs=74 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:04.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.892+0000 7fbafbfff640 1 -- 10.20.193.58:0/3178750076 >> 10.20.193.58:0/3178750076 conn(0x7fbafc0b3c20 msgr2=0x7fbafc13a550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:04.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.892+0000 7fbafbfff640 1 -- 10.20.193.58:0/3178750076 shutdown_connections 2026-02-23T06:21:04.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:04.892+0000 7fbafbfff640 1 -- 10.20.193.58:0/3178750076 wait complete. 2026-02-23T06:21:04.899 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-23T06:21:04.899 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-23T06:21:04.940 INFO:tasks.ceph.osd.4.trial093.stderr:2026-02-23T06:21:04.945+0000 7f6745e0c780 -1 Falling back to public interface 2026-02-23T06:21:04.941 INFO:tasks.ceph.osd.5.trial093.stderr:2026-02-23T06:21:04.945+0000 7f1621836780 -1 Falling back to public interface 2026-02-23T06:21:04.941 INFO:tasks.ceph.osd.4.trial093.stderr:2026-02-23T06:21:04.945+0000 7f67441fd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6802/0: (98) Address already in use 2026-02-23T06:21:04.942 INFO:tasks.ceph.osd.5.trial093.stderr:2026-02-23T06:21:04.946+0000 7f161fbfd640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6807/0: (98) Address already in use 2026-02-23T06:21:04.948 INFO:tasks.ceph.osd.7.trial093.stderr:2026-02-23T06:21:04.953+0000 7f0c70835780 -1 Falling back to public interface 2026-02-23T06:21:04.948 INFO:tasks.ceph.osd.6.trial093.stderr:2026-02-23T06:21:04.953+0000 7fe330427780 -1 Falling back to public interface 2026-02-23T06:21:04.977 INFO:tasks.ceph.osd.1.trial058.stderr:2026-02-23T06:21:04.982+0000 7f8effc0c780 -1 Falling back to public interface 2026-02-23T06:21:04.996 INFO:tasks.ceph.osd.0.trial058.stderr:2026-02-23T06:21:05.001+0000 7f3f9680e780 -1 Falling back to public interface 2026-02-23T06:21:05.015 INFO:tasks.ceph.osd.3.trial058.stderr:2026-02-23T06:21:05.021+0000 7f79a0a36780 -1 Falling back to public interface 2026-02-23T06:21:05.020 INFO:tasks.ceph.osd.2.trial058.stderr:2026-02-23T06:21:05.026+0000 7fbf3804d780 -1 Falling back to public interface 2026-02-23T06:21:05.377 INFO:tasks.ceph.mgr.x.trial093.stderr:2026-02-23T06:21:05.381+0000 7fd0b48ea640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-23T06:21:05.377 INFO:tasks.ceph.mgr.x.trial093.stderr:2026-02-23T06:21:05.381+0000 7fd0b48ea640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-23T06:21:05.470 INFO:tasks.ceph.osd.7.trial093.stderr:2026-02-23T06:21:05.475+0000 7f0c70835780 -1 osd.7 0 log_to_monitors true 2026-02-23T06:21:05.485 INFO:tasks.ceph.osd.4.trial093.stderr:2026-02-23T06:21:05.490+0000 7f6745e0c780 -1 osd.4 0 log_to_monitors true 2026-02-23T06:21:05.496 INFO:tasks.ceph.osd.6.trial093.stderr:2026-02-23T06:21:05.501+0000 7fe330427780 -1 osd.6 0 log_to_monitors true 2026-02-23T06:21:05.496 INFO:tasks.ceph.osd.5.trial093.stderr:2026-02-23T06:21:05.501+0000 7f1621836780 -1 osd.5 0 log_to_monitors true 2026-02-23T06:21:05.704 DEBUG:teuthology.orchestra.run.trial058:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-23T06:21:05.728 INFO:tasks.ceph.osd.0.trial058.stderr:2026-02-23T06:21:05.734+0000 7f3f9680e780 -1 osd.0 0 log_to_monitors true 2026-02-23T06:21:05.730 INFO:tasks.ceph.osd.1.trial058.stderr:2026-02-23T06:21:05.736+0000 7f8effc0c780 -1 osd.1 0 log_to_monitors true 2026-02-23T06:21:05.790 INFO:tasks.ceph.osd.3.trial058.stderr:2026-02-23T06:21:05.796+0000 7f79a0a36780 -1 osd.3 0 log_to_monitors true 2026-02-23T06:21:05.798 INFO:tasks.ceph.osd.2.trial058.stderr:2026-02-23T06:21:05.803+0000 7fbf3804d780 -1 osd.2 0 log_to_monitors true 2026-02-23T06:21:05.816 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.821+0000 7fe723577640 1 -- 10.20.193.58:0/2570764324 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe7240b3c20 msgr2=0x7fe7240b6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:05.816 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.821+0000 7fe723577640 1 --2- 10.20.193.58:0/2570764324 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe7240b3c20 0x7fe7240b6620 secure :-1 s=READY pgs=50 gs=1 cs=0 l=1 c_cookie=6092871172193700887 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe72405e220 tx=0x7fe71802f300 comp rx=0 tx=0).stop 2026-02-23T06:21:05.816 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.821+0000 7fe723577640 1 -- 10.20.193.58:0/2570764324 shutdown_connections 2026-02-23T06:21:05.817 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.821+0000 7fe723577640 1 --2- 10.20.193.58:0/2570764324 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe7240b54d0 0x7fe7240b7a10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:05.817 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.821+0000 7fe723577640 1 --2- 10.20.193.58:0/2570764324 >> v2:10.20.193.93:3300/0 conn(0x7fe724168c50 0x7fe724166070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:05.817 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.821+0000 7fe723577640 1 --2- 10.20.193.58:0/2570764324 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe7240b3c20 0x7fe7240b6620 unknown :-1 s=CLOSED pgs=50 gs=1 cs=0 l=1 c_cookie=6092871172193700887 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:05.817 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.821+0000 7fe723577640 1 -- 10.20.193.58:0/2570764324 >> 10.20.193.58:0/2570764324 conn(0x7fe7240562f0 msgr2=0x7fe7240566f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:05.817 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.821+0000 7fe723577640 1 -- 10.20.193.58:0/2570764324 shutdown_connections 2026-02-23T06:21:05.817 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.821+0000 7fe723577640 1 -- 10.20.193.58:0/2570764324 wait complete. 2026-02-23T06:21:05.820 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.822+0000 7fe723577640 1 Processor -- start 2026-02-23T06:21:05.820 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.823+0000 7fe723577640 1 -- start start 2026-02-23T06:21:05.820 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.823+0000 7fe723577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe7240b3c20 0x7fe724130af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:05.820 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.823+0000 7fe723577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe7240b54d0 0x7fe72413e060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:05.820 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.823+0000 7fe723577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe724168c50 0x7fe72413e5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:05.820 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.823+0000 7fe723577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe724131d80 con 0x7fe7240b54d0 2026-02-23T06:21:05.820 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.823+0000 7fe723577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe72413f4d0 con 0x7fe7240b3c20 2026-02-23T06:21:05.820 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.823+0000 7fe723577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe72413fa70 con 0x7fe724168c50 2026-02-23T06:21:05.820 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.823+0000 7fe721d74640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe7240b54d0 0x7fe72413e060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:05.820 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.823+0000 7fe722575640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe7240b3c20 0x7fe724130af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:05.821 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.823+0000 7fe722575640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe7240b3c20 0x7fe724130af0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:56060/0 (socket says 10.20.193.58:56060) 2026-02-23T06:21:05.821 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.823+0000 7fe722575640 1 -- 10.20.193.58:0/2269247742 learned_addr learned my addr 10.20.193.58:0/2269247742 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:05.821 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.823+0000 7fe722d76640 1 --2- 10.20.193.58:0/2269247742 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe724168c50 0x7fe72413e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:05.821 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.824+0000 7fe721d74640 1 -- 10.20.193.58:0/2269247742 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe724168c50 msgr2=0x7fe72413e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:05.821 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.824+0000 7fe721d74640 1 --2- 10.20.193.58:0/2269247742 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe724168c50 0x7fe72413e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:05.821 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.824+0000 7fe721d74640 1 -- 10.20.193.58:0/2269247742 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe7240b3c20 msgr2=0x7fe724130af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:05.821 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.824+0000 7fe721d74640 1 --2- 10.20.193.58:0/2269247742 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe7240b3c20 0x7fe724130af0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:05.821 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.824+0000 7fe721d74640 1 -- 10.20.193.58:0/2269247742 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe718009570 con 0x7fe7240b54d0 2026-02-23T06:21:05.821 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.824+0000 7fe721d74640 1 --2- 10.20.193.58:0/2269247742 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe7240b54d0 0x7fe72413e060 secure :-1 s=READY pgs=51 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe70c00e9c0 tx=0x7fe70c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:05.821 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.824+0000 7fe70affd640 1 -- 10.20.193.58:0/2269247742 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe70c00ccb0 con 0x7fe7240b54d0 2026-02-23T06:21:05.821 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.824+0000 7fe70affd640 1 -- 10.20.193.58:0/2269247742 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe70c00ce10 con 0x7fe7240b54d0 2026-02-23T06:21:05.821 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.824+0000 7fe70affd640 1 -- 10.20.193.58:0/2269247742 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe70c004ad0 con 0x7fe7240b54d0 2026-02-23T06:21:05.822 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.824+0000 7fe723577640 1 -- 10.20.193.58:0/2269247742 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe72413f790 con 0x7fe7240b54d0 2026-02-23T06:21:05.822 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.824+0000 7fe723577640 1 -- 10.20.193.58:0/2269247742 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe72413b730 con 0x7fe7240b54d0 2026-02-23T06:21:05.822 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.825+0000 7fe723577640 1 -- 10.20.193.58:0/2269247742 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe724057260 con 0x7fe7240b54d0 2026-02-23T06:21:05.823 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.826+0000 7fe70affd640 1 -- 10.20.193.58:0/2269247742 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 3) ==== 104731+0+0 (secure 0 0 0) 0x7fe70c01f060 con 0x7fe7240b54d0 2026-02-23T06:21:05.823 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.827+0000 7fe70affd640 1 --2- 10.20.193.58:0/2269247742 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe6f007a510 0x7fe6f009a9c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:05.823 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.827+0000 7fe70affd640 1 -- 10.20.193.58:0/2269247742 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1640+0+0 (secure 0 0 0) 0x7fe70c014070 con 0x7fe7240b54d0 2026-02-23T06:21:05.823 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.827+0000 7fe722575640 1 --2- 10.20.193.58:0/2269247742 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe6f007a510 0x7fe6f009a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:05.823 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.827+0000 7fe722575640 1 --2- 10.20.193.58:0/2269247742 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe6f007a510 0x7fe6f009a9c0 secure :-1 s=READY pgs=9 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7180023d0 tx=0x7fe71803a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:05.823 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.829+0000 7fe70affd640 1 -- 10.20.193.58:0/2269247742 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fe724057260 con 0x7fe7240b54d0 2026-02-23T06:21:05.938 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.943+0000 7fe723577640 1 -- 10.20.193.58:0/2269247742 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe724057260 con 0x7fe7240b54d0 2026-02-23T06:21:05.938 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.943+0000 7fe70affd640 1 -- 10.20.193.58:0/2269247742 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7056 (secure 0 0 0) 0x7fe724057260 con 0x7fe7240b54d0 2026-02-23T06:21:05.938 INFO:teuthology.misc.health.trial058.stdout: 2026-02-23T06:21:05.938 INFO:teuthology.misc.health.trial058.stdout:{"epoch":10,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","created":"2026-02-23T06:21:02.010508+0000","modified":"2026-02-23T06:21:04.690899+0000","last_up_change":"0.000000","last_in_change":"2026-02-23T06:21:04.690899+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"96cc0898-14bb-4d56-827a-8845bd4307c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bf665af4-6e3c-4cb3-899c-acede65c31f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2bcb3165-28ad-45d6-9a49-9d9da08501f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4750309a-5bf2-4f48-a550-ca677b0b0f61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5cbb50f2-4e49-46eb-bd84-d92706459d2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2806c775-4720-43a7-ab9f-85a4adb31098","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"aa03b46d-d30f-4b09-9251-c9514e8b8b6d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b15519bf-2b7b-4fd5-8ef6-e09af0ad9817","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-23T06:21:05.940 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.944+0000 7fe723577640 1 -- 10.20.193.58:0/2269247742 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe6f007a510 msgr2=0x7fe6f009a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:05.940 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.944+0000 7fe723577640 1 --2- 10.20.193.58:0/2269247742 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe6f007a510 0x7fe6f009a9c0 secure :-1 s=READY pgs=9 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7180023d0 tx=0x7fe71803a040 comp rx=0 tx=0).stop 2026-02-23T06:21:05.940 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.944+0000 7fe723577640 1 -- 10.20.193.58:0/2269247742 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe7240b54d0 msgr2=0x7fe72413e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:05.940 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.944+0000 7fe723577640 1 --2- 10.20.193.58:0/2269247742 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe7240b54d0 0x7fe72413e060 secure :-1 s=READY pgs=51 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe70c00e9c0 tx=0x7fe70c00ee90 comp rx=0 tx=0).stop 2026-02-23T06:21:05.940 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.944+0000 7fe723577640 1 -- 10.20.193.58:0/2269247742 shutdown_connections 2026-02-23T06:21:05.940 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.944+0000 7fe723577640 1 --2- 10.20.193.58:0/2269247742 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe6f007a510 0x7fe6f009a9c0 unknown :-1 s=CLOSED pgs=9 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:05.940 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.944+0000 7fe723577640 1 --2- 10.20.193.58:0/2269247742 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe724168c50 0x7fe72413e5a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:05.940 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.944+0000 7fe723577640 1 --2- 10.20.193.58:0/2269247742 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe7240b54d0 0x7fe72413e060 unknown :-1 s=CLOSED pgs=51 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:05.940 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.944+0000 7fe723577640 1 --2- 10.20.193.58:0/2269247742 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe7240b3c20 0x7fe724130af0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:05.940 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.944+0000 7fe723577640 1 -- 10.20.193.58:0/2269247742 >> 10.20.193.58:0/2269247742 conn(0x7fe7240562f0 msgr2=0x7fe7241681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:05.941 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.944+0000 7fe723577640 1 -- 10.20.193.58:0/2269247742 shutdown_connections 2026-02-23T06:21:05.941 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:05.944+0000 7fe723577640 1 -- 10.20.193.58:0/2269247742 wait complete. 2026-02-23T06:21:05.948 DEBUG:teuthology.misc:0 of 8 OSDs are up 2026-02-23T06:21:07.376 INFO:tasks.ceph.osd.5.trial093.stderr:2026-02-23T06:21:07.381+0000 7f161cbf7640 -1 osd.5 0 waiting for initial osdmap 2026-02-23T06:21:07.378 INFO:tasks.ceph.osd.4.trial093.stderr:2026-02-23T06:21:07.383+0000 7f67411f7640 -1 osd.4 0 waiting for initial osdmap 2026-02-23T06:21:07.378 INFO:tasks.ceph.osd.6.trial093.stderr:2026-02-23T06:21:07.383+0000 7fe32b7f7640 -1 osd.6 0 waiting for initial osdmap 2026-02-23T06:21:07.378 INFO:tasks.ceph.osd.2.trial058.stderr:2026-02-23T06:21:07.384+0000 7fbf32ff7640 -1 osd.2 0 waiting for initial osdmap 2026-02-23T06:21:07.378 INFO:tasks.ceph.osd.7.trial093.stderr:2026-02-23T06:21:07.383+0000 7f0c6b7f7640 -1 osd.7 0 waiting for initial osdmap 2026-02-23T06:21:07.378 INFO:tasks.ceph.osd.0.trial058.stderr:2026-02-23T06:21:07.384+0000 7f3f91bf7640 -1 osd.0 0 waiting for initial osdmap 2026-02-23T06:21:07.379 INFO:tasks.ceph.osd.3.trial058.stderr:2026-02-23T06:21:07.384+0000 7f799bdf7640 -1 osd.3 0 waiting for initial osdmap 2026-02-23T06:21:07.379 INFO:tasks.ceph.osd.5.trial093.stderr:2026-02-23T06:21:07.385+0000 7f1614be7640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-23T06:21:07.380 INFO:tasks.ceph.osd.6.trial093.stderr:2026-02-23T06:21:07.385+0000 7fe3237e7640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-23T06:21:07.380 INFO:tasks.ceph.osd.4.trial093.stderr:2026-02-23T06:21:07.385+0000 7f67391e7640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-23T06:21:07.380 INFO:tasks.ceph.osd.7.trial093.stderr:2026-02-23T06:21:07.385+0000 7f0c637e7640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-23T06:21:07.380 INFO:tasks.ceph.osd.1.trial058.stderr:2026-02-23T06:21:07.385+0000 7f8efaff7640 -1 osd.1 0 waiting for initial osdmap 2026-02-23T06:21:07.383 INFO:tasks.ceph.osd.2.trial058.stderr:2026-02-23T06:21:07.389+0000 7fbf2afe7640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-23T06:21:07.383 INFO:tasks.ceph.osd.1.trial058.stderr:2026-02-23T06:21:07.389+0000 7f8ef2fe7640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-23T06:21:07.383 INFO:tasks.ceph.osd.3.trial058.stderr:2026-02-23T06:21:07.389+0000 7f7993de7640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-23T06:21:07.383 INFO:tasks.ceph.osd.0.trial058.stderr:2026-02-23T06:21:07.389+0000 7f3f89be7640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-23T06:21:11.761 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:21:11.765 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:21:12.755 DEBUG:teuthology.orchestra.run.trial058:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-23T06:21:12.859 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.864+0000 7fc2a33c9640 1 -- 10.20.193.58:0/752204350 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc29c0b54d0 msgr2=0x7fc29c0afe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:12.860 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.864+0000 7fc2a33c9640 1 --2- 10.20.193.58:0/752204350 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc29c0b54d0 0x7fc29c0afe00 secure :-1 s=READY pgs=82 gs=3 cs=0 l=1 c_cookie=15393515727855923796 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc298005820 tx=0x7fc298030300 comp rx=0 tx=0).stop 2026-02-23T06:21:12.860 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.864+0000 7fc2a33c9640 1 -- 10.20.193.58:0/752204350 shutdown_connections 2026-02-23T06:21:12.860 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.864+0000 7fc2a33c9640 1 --2- 10.20.193.58:0/752204350 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc29c0b54d0 0x7fc29c0afe00 unknown :-1 s=CLOSED pgs=82 gs=3 cs=0 l=1 c_cookie=15393515727855923796 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:12.860 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.864+0000 7fc2a33c9640 1 -- 10.20.193.58:0/752204350 >> 10.20.193.58:0/752204350 conn(0x7fc29c0562f0 msgr2=0x7fc29c0566f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:12.860 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.864+0000 7fc2a33c9640 1 -- 10.20.193.58:0/752204350 shutdown_connections 2026-02-23T06:21:12.860 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.864+0000 7fc2a33c9640 1 -- 10.20.193.58:0/752204350 wait complete. 2026-02-23T06:21:12.862 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.865+0000 7fc2a33c9640 1 Processor -- start 2026-02-23T06:21:12.862 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.865+0000 7fc2a33c9640 1 -- start start 2026-02-23T06:21:12.862 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.866+0000 7fc2a33c9640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc29c0b54d0 0x7fc29c059500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:12.862 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.866+0000 7fc2a33c9640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc29c15d200 0x7fc29c164920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:12.862 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.866+0000 7fc2a33c9640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc29c15d5d0 0x7fc29c1659b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:12.863 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.866+0000 7fc2a33c9640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc29c1fe120 con 0x7fc29c15d200 2026-02-23T06:21:12.863 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.866+0000 7fc2a33c9640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc29c165500 con 0x7fc29c15d5d0 2026-02-23T06:21:12.863 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.866+0000 7fc2a33c9640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc29c1fe370 con 0x7fc29c0b54d0 2026-02-23T06:21:12.863 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.866+0000 7fc2a1bc6640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc29c15d200 0x7fc29c164920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:12.863 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.866+0000 7fc2a1bc6640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc29c15d200 0x7fc29c164920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:36394/0 (socket says 10.20.193.58:36394) 2026-02-23T06:21:12.863 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.866+0000 7fc2a1bc6640 1 -- 10.20.193.58:0/1465018340 learned_addr learned my addr 10.20.193.58:0/1465018340 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:12.863 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.866+0000 7fc2a23c7640 1 --2- 10.20.193.58:0/1465018340 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc29c0b54d0 0x7fc29c059500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:12.863 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.866+0000 7fc2a2bc8640 1 --2- 10.20.193.58:0/1465018340 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc29c15d5d0 0x7fc29c1659b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:12.863 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.866+0000 7fc2a1bc6640 1 -- 10.20.193.58:0/1465018340 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc29c0b54d0 msgr2=0x7fc29c059500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:12.863 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.866+0000 7fc2a1bc6640 1 --2- 10.20.193.58:0/1465018340 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc29c0b54d0 0x7fc29c059500 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:12.863 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.866+0000 7fc2a1bc6640 1 -- 10.20.193.58:0/1465018340 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc29c15d5d0 msgr2=0x7fc29c1659b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:12.864 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.866+0000 7fc2a1bc6640 1 --2- 10.20.193.58:0/1465018340 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc29c15d5d0 0x7fc29c1659b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:12.864 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.866+0000 7fc2a1bc6640 1 -- 10.20.193.58:0/1465018340 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc29800a590 con 0x7fc29c15d200 2026-02-23T06:21:12.864 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.867+0000 7fc2a1bc6640 1 --2- 10.20.193.58:0/1465018340 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc29c15d200 0x7fc29c164920 secure :-1 s=READY pgs=54 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc29000c500 tx=0x7fc29000c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:12.864 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.867+0000 7fc282ffd640 1 -- 10.20.193.58:0/1465018340 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc2900052f0 con 0x7fc29c15d200 2026-02-23T06:21:12.864 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.867+0000 7fc282ffd640 1 -- 10.20.193.58:0/1465018340 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc290005540 con 0x7fc29c15d200 2026-02-23T06:21:12.864 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.867+0000 7fc282ffd640 1 -- 10.20.193.58:0/1465018340 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc290003930 con 0x7fc29c15d200 2026-02-23T06:21:12.864 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.867+0000 7fc2a33c9640 1 -- 10.20.193.58:0/1465018340 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc29c1429e0 con 0x7fc29c15d200 2026-02-23T06:21:12.864 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.867+0000 7fc2a33c9640 1 -- 10.20.193.58:0/1465018340 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc29c163e40 con 0x7fc29c15d200 2026-02-23T06:21:12.864 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.867+0000 7fc2a33c9640 1 -- 10.20.193.58:0/1465018340 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc29c057260 con 0x7fc29c15d200 2026-02-23T06:21:12.865 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.869+0000 7fc282ffd640 1 -- 10.20.193.58:0/1465018340 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fc290003a90 con 0x7fc29c15d200 2026-02-23T06:21:12.865 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.870+0000 7fc282ffd640 1 --2- 10.20.193.58:0/1465018340 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc26c07a790 0x7fc26c09ac40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:12.865 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.870+0000 7fc282ffd640 1 -- 10.20.193.58:0/1465018340 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4851+0+0 (secure 0 0 0) 0x7fc29009c8f0 con 0x7fc29c15d200 2026-02-23T06:21:12.865 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.870+0000 7fc2a23c7640 1 --2- 10.20.193.58:0/1465018340 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc26c07a790 0x7fc26c09ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:12.865 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.870+0000 7fc2a23c7640 1 --2- 10.20.193.58:0/1465018340 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc26c07a790 0x7fc26c09ac40 secure :-1 s=READY pgs=35 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc28c0023d0 tx=0x7fc28c007db0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:12.866 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.871+0000 7fc282ffd640 1 -- 10.20.193.58:0/1465018340 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fc2900601b0 con 0x7fc29c15d200 2026-02-23T06:21:12.981 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.986+0000 7fc2a33c9640 1 -- 10.20.193.58:0/1465018340 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc29c142840 con 0x7fc29c15d200 2026-02-23T06:21:12.982 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.987+0000 7fc282ffd640 1 -- 10.20.193.58:0/1465018340 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12871 (secure 0 0 0) 0x7fc29c142840 con 0x7fc29c15d200 2026-02-23T06:21:12.982 INFO:teuthology.misc.health.trial058.stdout: 2026-02-23T06:21:12.983 INFO:teuthology.misc.health.trial058.stdout:{"epoch":17,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","created":"2026-02-23T06:21:02.010508+0000","modified":"2026-02-23T06:21:12.395316+0000","last_up_change":"2026-02-23T06:21:08.383048+0000","last_in_change":"2026-02-23T06:21:04.690899+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-23T06:21:10.389081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96cc0898-14bb-4d56-827a-8845bd4307c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6808","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6809","nonce":692913334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6810","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6811","nonce":692913334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6814","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6815","nonce":692913334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6812","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6813","nonce":692913334}]},"public_addr":"10.20.193.58:6809/692913334","cluster_addr":"10.20.193.58:6811/692913334","heartbeat_back_addr":"10.20.193.58:6815/692913334","heartbeat_front_addr":"10.20.193.58:6813/692913334","state":["exists","up"]},{"osd":1,"uuid":"bf665af4-6e3c-4cb3-899c-acede65c31f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6800","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6801","nonce":1850584280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6802","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6803","nonce":1850584280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6806","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6807","nonce":1850584280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6804","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6805","nonce":1850584280}]},"public_addr":"10.20.193.58:6801/1850584280","cluster_addr":"10.20.193.58:6803/1850584280","heartbeat_back_addr":"10.20.193.58:6807/1850584280","heartbeat_front_addr":"10.20.193.58:6805/1850584280","state":["exists","up"]},{"osd":2,"uuid":"2bcb3165-28ad-45d6-9a49-9d9da08501f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6823","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6825","nonce":4284600061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6826","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6827","nonce":4284600061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6830","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6831","nonce":4284600061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6828","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6829","nonce":4284600061}]},"public_addr":"10.20.193.58:6825/4284600061","cluster_addr":"10.20.193.58:6827/4284600061","heartbeat_back_addr":"10.20.193.58:6831/4284600061","heartbeat_front_addr":"10.20.193.58:6829/4284600061","state":["exists","up"]},{"osd":3,"uuid":"4750309a-5bf2-4f48-a550-ca677b0b0f61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6816","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6817","nonce":2858636994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6818","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6819","nonce":2858636994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6822","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6824","nonce":2858636994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6820","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6821","nonce":2858636994}]},"public_addr":"10.20.193.58:6817/2858636994","cluster_addr":"10.20.193.58:6819/2858636994","heartbeat_back_addr":"10.20.193.58:6824/2858636994","heartbeat_front_addr":"10.20.193.58:6821/2858636994","state":["exists","up"]},{"osd":4,"uuid":"5cbb50f2-4e49-46eb-bd84-d92706459d2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6803","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6805","nonce":1874834171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6807","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6809","nonce":1874834171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6816","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6817","nonce":1874834171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6812","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6814","nonce":1874834171}]},"public_addr":"10.20.193.93:6805/1874834171","cluster_addr":"10.20.193.93:6809/1874834171","heartbeat_back_addr":"10.20.193.93:6817/1874834171","heartbeat_front_addr":"10.20.193.93:6814/1874834171","state":["exists","up"]},{"osd":5,"uuid":"2806c775-4720-43a7-ab9f-85a4adb31098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6802","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6804","nonce":356968280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6806","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6808","nonce":356968280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6813","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6815","nonce":356968280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6810","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6811","nonce":356968280}]},"public_addr":"10.20.193.93:6804/356968280","cluster_addr":"10.20.193.93:6808/356968280","heartbeat_back_addr":"10.20.193.93:6815/356968280","heartbeat_front_addr":"10.20.193.93:6811/356968280","state":["exists","up"]},{"osd":6,"uuid":"aa03b46d-d30f-4b09-9251-c9514e8b8b6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6819","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6821","nonce":2948039088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6823","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6825","nonce":2948039088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6831","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6833","nonce":2948039088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6827","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6829","nonce":2948039088}]},"public_addr":"10.20.193.93:6821/2948039088","cluster_addr":"10.20.193.93:6825/2948039088","heartbeat_back_addr":"10.20.193.93:6833/2948039088","heartbeat_front_addr":"10.20.193.93:6829/2948039088","state":["exists","up"]},{"osd":7,"uuid":"b15519bf-2b7b-4fd5-8ef6-e09af0ad9817","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6818","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6820","nonce":2960650087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6822","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6824","nonce":2960650087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6830","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6832","nonce":2960650087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6826","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6828","nonce":2960650087}]},"public_addr":"10.20.193.93:6820/2960650087","cluster_addr":"10.20.193.93:6824/2960650087","heartbeat_back_addr":"10.20.193.93:6832/2960650087","heartbeat_front_addr":"10.20.193.93:6828/2960650087","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.717515+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.744114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.772247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.768341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.521808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.486005+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.480882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.473408+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-23T06:21:12.984 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.988+0000 7fc2a33c9640 1 -- 10.20.193.58:0/1465018340 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc26c07a790 msgr2=0x7fc26c09ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:12.984 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.988+0000 7fc2a33c9640 1 --2- 10.20.193.58:0/1465018340 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc26c07a790 0x7fc26c09ac40 secure :-1 s=READY pgs=35 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc28c0023d0 tx=0x7fc28c007db0 comp rx=0 tx=0).stop 2026-02-23T06:21:12.984 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.988+0000 7fc2a33c9640 1 -- 10.20.193.58:0/1465018340 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc29c15d200 msgr2=0x7fc29c164920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:12.984 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.988+0000 7fc2a33c9640 1 --2- 10.20.193.58:0/1465018340 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc29c15d200 0x7fc29c164920 secure :-1 s=READY pgs=54 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc29000c500 tx=0x7fc29000c9d0 comp rx=0 tx=0).stop 2026-02-23T06:21:12.984 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.988+0000 7fc2a33c9640 1 -- 10.20.193.58:0/1465018340 shutdown_connections 2026-02-23T06:21:12.984 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.988+0000 7fc2a33c9640 1 --2- 10.20.193.58:0/1465018340 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc26c07a790 0x7fc26c09ac40 unknown :-1 s=CLOSED pgs=35 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:12.985 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.988+0000 7fc2a33c9640 1 --2- 10.20.193.58:0/1465018340 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc29c15d5d0 0x7fc29c1659b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:12.985 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.988+0000 7fc2a33c9640 1 --2- 10.20.193.58:0/1465018340 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc29c15d200 0x7fc29c164920 unknown :-1 s=CLOSED pgs=54 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:12.985 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.988+0000 7fc2a33c9640 1 --2- 10.20.193.58:0/1465018340 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc29c0b54d0 0x7fc29c059500 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:12.985 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.988+0000 7fc2a33c9640 1 -- 10.20.193.58:0/1465018340 >> 10.20.193.58:0/1465018340 conn(0x7fc29c0562f0 msgr2=0x7fc29c143e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:12.985 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.988+0000 7fc2a33c9640 1 -- 10.20.193.58:0/1465018340 shutdown_connections 2026-02-23T06:21:12.985 INFO:teuthology.misc.health.trial058.stderr:2026-02-23T06:21:12.988+0000 7fc2a33c9640 1 -- 10.20.193.58:0/1465018340 wait complete. 2026-02-23T06:21:12.992 DEBUG:teuthology.misc:8 of 8 OSDs are up 2026-02-23T06:21:12.993 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-23T06:21:12.993 INFO:tasks.ceph.mds.a:Restarting daemon 2026-02-23T06:21:12.993 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2026-02-23T06:21:12.997 INFO:tasks.ceph.mds.a:Started 2026-02-23T06:21:12.998 INFO:tasks.ceph.mds.c:Restarting daemon 2026-02-23T06:21:12.998 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2026-02-23T06:21:13.001 INFO:tasks.ceph.mds.c:Started 2026-02-23T06:21:13.002 INFO:tasks.ceph.mds.e:Restarting daemon 2026-02-23T06:21:13.002 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2026-02-23T06:21:13.006 INFO:tasks.ceph.mds.e:Started 2026-02-23T06:21:13.006 INFO:tasks.ceph.mds.b:Restarting daemon 2026-02-23T06:21:13.006 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2026-02-23T06:21:13.008 INFO:tasks.ceph.mds.b:Started 2026-02-23T06:21:13.008 INFO:tasks.ceph.mds.d:Restarting daemon 2026-02-23T06:21:13.009 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2026-02-23T06:21:13.011 INFO:tasks.ceph.mds.d:Started 2026-02-23T06:21:13.011 INFO:tasks.ceph.mds.f:Restarting daemon 2026-02-23T06:21:13.011 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2026-02-23T06:21:13.013 INFO:tasks.ceph.mds.f:Started 2026-02-23T06:21:13.013 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2026-02-23T06:21:13.014 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2026-02-23T06:21:13.061 INFO:tasks.ceph.mds.b.trial093.stdout:starting mds.b at 2026-02-23T06:21:13.062 INFO:tasks.ceph.mds.d.trial093.stdout:starting mds.d at 2026-02-23T06:21:13.065 INFO:tasks.ceph.mds.f.trial093.stdout:starting mds.f at 2026-02-23T06:21:13.098 INFO:tasks.ceph.mds.a.trial058.stdout:starting mds.a at 2026-02-23T06:21:13.103 INFO:tasks.ceph.mds.c.trial058.stdout:starting mds.c at 2026-02-23T06:21:13.104 INFO:tasks.ceph.mds.e.trial058.stdout:starting mds.e at 2026-02-23T06:21:13.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.136+0000 7f1119b30640 1 -- 10.20.193.58:0/873584086 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f111405d450 msgr2=0x7f11140b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:13.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.136+0000 7f110b7fe640 1 -- 10.20.193.58:0/873584086 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f10fc02fbe0 con 0x7f111405d450 2026-02-23T06:21:13.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.136+0000 7f1119b30640 1 --2- 10.20.193.58:0/873584086 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f111405d450 0x7f11140b5680 secure :-1 s=READY pgs=50 gs=3 cs=0 l=1 c_cookie=1845495843044805142 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11140b5040 tx=0x7f10fc02f160 comp rx=0 tx=0).stop 2026-02-23T06:21:13.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.136+0000 7f1119b30640 1 -- 10.20.193.58:0/873584086 shutdown_connections 2026-02-23T06:21:13.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.136+0000 7f1119b30640 1 --2- 10.20.193.58:0/873584086 >> v2:10.20.193.58:3300/0 conn(0x7f1114056550 0x7f11140b5bc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:13.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.136+0000 7f1119b30640 1 --2- 10.20.193.58:0/873584086 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f111405d450 0x7f11140b5680 unknown :-1 s=CLOSED pgs=50 gs=3 cs=0 l=1 c_cookie=1845495843044805142 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:13.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.136+0000 7f1119b30640 1 --2- 10.20.193.58:0/873584086 >> v2:10.20.193.93:3300/0 conn(0x7f111405d080 0x7f111405b0e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:13.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.136+0000 7f1119b30640 1 -- 10.20.193.58:0/873584086 >> 10.20.193.58:0/873584086 conn(0x7f11140b3c20 msgr2=0x7f11140b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:13.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.136+0000 7f1119b30640 1 -- 10.20.193.58:0/873584086 shutdown_connections 2026-02-23T06:21:13.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.136+0000 7f1119b30640 1 -- 10.20.193.58:0/873584086 wait complete. 2026-02-23T06:21:13.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.137+0000 7f1119b30640 1 Processor -- start 2026-02-23T06:21:13.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.137+0000 7f1119b30640 1 -- start start 2026-02-23T06:21:13.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.138+0000 7f1119b30640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1114056550 0x7f11140b7dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:13.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.138+0000 7f1119b30640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f111405d080 0x7f11141510b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:13.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.138+0000 7f1119b30640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f111405d450 0x7f11141515f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:13.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.138+0000 7f1119b30640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f1114162b40 con 0x7f1114056550 2026-02-23T06:21:13.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.138+0000 7f1119b30640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f1114201a20 con 0x7f111405d080 2026-02-23T06:21:13.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.138+0000 7f1119b30640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f1114162860 con 0x7f111405d450 2026-02-23T06:21:13.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.138+0000 7f111932f640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f111405d450 0x7f11141515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:13.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.138+0000 7f111932f640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f111405d450 0x7f11141515f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:54884/0 (socket says 10.20.193.58:54884) 2026-02-23T06:21:13.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.138+0000 7f111932f640 1 -- 10.20.193.58:0/403746480 learned_addr learned my addr 10.20.193.58:0/403746480 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:13.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.138+0000 7f110bfff640 1 --2- 10.20.193.58:0/403746480 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f111405d080 0x7f11141510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:13.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.138+0000 7f1118b2e640 1 --2- 10.20.193.58:0/403746480 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1114056550 0x7f11140b7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:13.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.138+0000 7f111932f640 1 -- 10.20.193.58:0/403746480 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f111405d080 msgr2=0x7f11141510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:13.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.138+0000 7f111932f640 1 --2- 10.20.193.58:0/403746480 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f111405d080 0x7f11141510b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:13.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.138+0000 7f111932f640 1 -- 10.20.193.58:0/403746480 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1114056550 msgr2=0x7f11140b7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:13.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.138+0000 7f111932f640 1 --2- 10.20.193.58:0/403746480 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1114056550 0x7f11140b7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:13.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.138+0000 7f111932f640 1 -- 10.20.193.58:0/403746480 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10fc0094b0 con 0x7f111405d450 2026-02-23T06:21:13.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.138+0000 7f1118b2e640 1 --2- 10.20.193.58:0/403746480 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1114056550 0x7f11140b7dc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:13.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.139+0000 7f111932f640 1 --2- 10.20.193.58:0/403746480 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f111405d450 0x7f11141515f0 secure :-1 s=READY pgs=51 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1110006f20 tx=0x7f111000ea80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:13.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.139+0000 7f11097fa640 1 -- 10.20.193.58:0/403746480 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1110005b50 con 0x7f111405d450 2026-02-23T06:21:13.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.139+0000 7f11097fa640 1 -- 10.20.193.58:0/403746480 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1110005da0 con 0x7f111405d450 2026-02-23T06:21:13.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.139+0000 7f11097fa640 1 -- 10.20.193.58:0/403746480 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f111000a930 con 0x7f111405d450 2026-02-23T06:21:13.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.139+0000 7f1119b30640 1 -- 10.20.193.58:0/403746480 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1114154700 con 0x7f111405d450 2026-02-23T06:21:13.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.139+0000 7f1119b30640 1 -- 10.20.193.58:0/403746480 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1114154cc0 con 0x7f111405d450 2026-02-23T06:21:13.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.139+0000 7f1119b30640 1 -- 10.20.193.58:0/403746480 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1114056330 con 0x7f111405d450 2026-02-23T06:21:13.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.140+0000 7f11097fa640 1 -- 10.20.193.58:0/403746480 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f1110017030 con 0x7f111405d450 2026-02-23T06:21:13.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.142+0000 7f11097fa640 1 --2- 10.20.193.58:0/403746480 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f10e407a6c0 0x7f10e409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:13.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.142+0000 7f11097fa640 1 -- 10.20.193.58:0/403746480 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 4851+0+0 (secure 0 0 0) 0x7f111009e250 con 0x7f111405d450 2026-02-23T06:21:13.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.142+0000 7f1118b2e640 1 --2- 10.20.193.58:0/403746480 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f10e407a6c0 0x7f10e409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:13.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.142+0000 7f1118b2e640 1 --2- 10.20.193.58:0/403746480 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f10e407a6c0 0x7f10e409ab70 secure :-1 s=READY pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1104004740 tx=0x7f110400b410 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:13.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.143+0000 7f11097fa640 1 -- 10.20.193.58:0/403746480 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f1110061b30 con 0x7f111405d450 2026-02-23T06:21:13.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.282+0000 7f1119b30640 1 -- 10.20.193.58:0/403746480 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1114158e50 con 0x7f111405d450 2026-02-23T06:21:13.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.282+0000 7f11097fa640 1 -- 10.20.193.58:0/403746480 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7f1110064c50 con 0x7f111405d450 2026-02-23T06:21:13.278 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:13.278 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":2,"btime":"2026-02-23T06:21:13:071107+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4438,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6835/3715244768","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6834","nonce":3715244768},{"type":"v1","addr":"10.20.193.93:6835","nonce":3715244768}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2026-02-23T06:21:13.279 INFO:teuthology.orchestra.run.trial058.stderr:dumped fsmap epoch 2 2026-02-23T06:21:13.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.284+0000 7f1119b30640 1 -- 10.20.193.58:0/403746480 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f10e407a6c0 msgr2=0x7f10e409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:13.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.284+0000 7f1119b30640 1 --2- 10.20.193.58:0/403746480 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f10e407a6c0 0x7f10e409ab70 secure :-1 s=READY pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1104004740 tx=0x7f110400b410 comp rx=0 tx=0).stop 2026-02-23T06:21:13.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.284+0000 7f1119b30640 1 -- 10.20.193.58:0/403746480 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f111405d450 msgr2=0x7f11141515f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:13.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.284+0000 7f1119b30640 1 --2- 10.20.193.58:0/403746480 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f111405d450 0x7f11141515f0 secure :-1 s=READY pgs=51 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1110006f20 tx=0x7f111000ea80 comp rx=0 tx=0).stop 2026-02-23T06:21:13.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.284+0000 7f1119b30640 1 -- 10.20.193.58:0/403746480 shutdown_connections 2026-02-23T06:21:13.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.284+0000 7f1119b30640 1 --2- 10.20.193.58:0/403746480 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f10e407a6c0 0x7f10e409ab70 unknown :-1 s=CLOSED pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:13.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.284+0000 7f1119b30640 1 --2- 10.20.193.58:0/403746480 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f111405d450 0x7f11141515f0 unknown :-1 s=CLOSED pgs=51 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:13.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.284+0000 7f1119b30640 1 --2- 10.20.193.58:0/403746480 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f111405d080 0x7f11141510b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:13.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.284+0000 7f1119b30640 1 --2- 10.20.193.58:0/403746480 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1114056550 0x7f11140b7dc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:13.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.284+0000 7f1119b30640 1 -- 10.20.193.58:0/403746480 >> 10.20.193.58:0/403746480 conn(0x7f11140b3c20 msgr2=0x7f11140b5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:13.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.284+0000 7f1119b30640 1 -- 10.20.193.58:0/403746480 shutdown_connections 2026-02-23T06:21:13.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:13.284+0000 7f1119b30640 1 -- 10.20.193.58:0/403746480 wait complete. 2026-02-23T06:21:15.290 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2026-02-23T06:21:15.411 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.416+0000 7f17cd643640 1 -- 10.20.193.58:0/3784182200 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f17c815c040 msgr2=0x7f17c805b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:15.411 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.416+0000 7f17cd643640 1 --2- 10.20.193.58:0/3784182200 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f17c815c040 0x7f17c805b0e0 secure :-1 s=READY pgs=60 gs=1 cs=0 l=1 c_cookie=1788983561160477778 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17c8059aa0 tx=0x7f17b402f190 comp rx=0 tx=0).stop 2026-02-23T06:21:15.412 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.416+0000 7f17cd643640 1 -- 10.20.193.58:0/3784182200 shutdown_connections 2026-02-23T06:21:15.412 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.416+0000 7f17cd643640 1 --2- 10.20.193.58:0/3784182200 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f17c805d370 0x7f17c80b5680 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:15.412 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.416+0000 7f17cd643640 1 --2- 10.20.193.58:0/3784182200 >> v2:10.20.193.93:3300/0 conn(0x7f17c8056550 0x7f17c805ce30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:15.412 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.416+0000 7f17cd643640 1 --2- 10.20.193.58:0/3784182200 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f17c815c040 0x7f17c805b0e0 unknown :-1 s=CLOSED pgs=60 gs=1 cs=0 l=1 c_cookie=1788983561160477778 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:15.412 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.416+0000 7f17cd643640 1 -- 10.20.193.58:0/3784182200 >> 10.20.193.58:0/3784182200 conn(0x7f17c80b3c20 msgr2=0x7f17c80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:15.412 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.416+0000 7f17cd643640 1 -- 10.20.193.58:0/3784182200 shutdown_connections 2026-02-23T06:21:15.412 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.416+0000 7f17cd643640 1 -- 10.20.193.58:0/3784182200 wait complete. 2026-02-23T06:21:15.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.417+0000 7f17cd643640 1 Processor -- start 2026-02-23T06:21:15.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.417+0000 7f17cd643640 1 -- start start 2026-02-23T06:21:15.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.418+0000 7f17cd643640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f17c8056550 0x7f17c815eb80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:15.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.418+0000 7f17cd643640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f17c805d370 0x7f17c80589d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:15.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.418+0000 7f17cd643640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f17c815c040 0x7f17c8058f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:15.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.418+0000 7f17cd643640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f17c8156100 con 0x7f17c815c040 2026-02-23T06:21:15.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.418+0000 7f17cd643640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f17c81fd830 con 0x7f17c8056550 2026-02-23T06:21:15.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.418+0000 7f17cd643640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f17c81611c0 con 0x7f17c805d370 2026-02-23T06:21:15.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.418+0000 7f17c7fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f17c8056550 0x7f17c815eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:15.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.418+0000 7f17cce42640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f17c815c040 0x7f17c8058f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:15.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.418+0000 7f17c7fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f17c8056550 0x7f17c815eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:60800/0 (socket says 10.20.193.58:60800) 2026-02-23T06:21:15.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.418+0000 7f17c7fff640 1 -- 10.20.193.58:0/925280038 learned_addr learned my addr 10.20.193.58:0/925280038 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:15.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.418+0000 7f17c77fe640 1 --2- 10.20.193.58:0/925280038 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f17c805d370 0x7f17c80589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:15.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.418+0000 7f17c7fff640 1 -- 10.20.193.58:0/925280038 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f17c805d370 msgr2=0x7f17c80589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:15.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.418+0000 7f17c7fff640 1 --2- 10.20.193.58:0/925280038 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f17c805d370 0x7f17c80589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:15.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.418+0000 7f17c7fff640 1 -- 10.20.193.58:0/925280038 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f17c815c040 msgr2=0x7f17c8058f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:15.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.418+0000 7f17c7fff640 1 --2- 10.20.193.58:0/925280038 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f17c815c040 0x7f17c8058f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:15.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.418+0000 7f17c7fff640 1 -- 10.20.193.58:0/925280038 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b8009570 con 0x7f17c8056550 2026-02-23T06:21:15.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.418+0000 7f17cce42640 1 --2- 10.20.193.58:0/925280038 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f17c815c040 0x7f17c8058f10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:15.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.419+0000 7f17c7fff640 1 --2- 10.20.193.58:0/925280038 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f17c8056550 0x7f17c815eb80 secure :-1 s=READY pgs=93 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17b40023d0 tx=0x7f17b40028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:15.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.419+0000 7f17c4ff9640 1 -- 10.20.193.58:0/925280038 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f17b403d070 con 0x7f17c8056550 2026-02-23T06:21:15.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.419+0000 7f17c4ff9640 1 -- 10.20.193.58:0/925280038 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17b4002e70 con 0x7f17c8056550 2026-02-23T06:21:15.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.419+0000 7f17c4ff9640 1 -- 10.20.193.58:0/925280038 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f17b40386b0 con 0x7f17c8056550 2026-02-23T06:21:15.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.419+0000 7f17cd643640 1 -- 10.20.193.58:0/925280038 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17b40094b0 con 0x7f17c8056550 2026-02-23T06:21:15.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.419+0000 7f17cd643640 1 -- 10.20.193.58:0/925280038 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17c81fdd20 con 0x7f17c8056550 2026-02-23T06:21:15.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.419+0000 7f17cd643640 1 -- 10.20.193.58:0/925280038 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17c8161350 con 0x7f17c8056550 2026-02-23T06:21:15.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.421+0000 7f17c4ff9640 1 -- 10.20.193.58:0/925280038 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f17b4068b80 con 0x7f17c8056550 2026-02-23T06:21:15.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.422+0000 7f17c4ff9640 1 --2- 10.20.193.58:0/925280038 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f179807a6c0 0x7f179809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:15.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.422+0000 7f17c4ff9640 1 -- 10.20.193.58:0/925280038 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4851+0+0 (secure 0 0 0) 0x7f17b40c1dd0 con 0x7f17c8056550 2026-02-23T06:21:15.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.422+0000 7f17c77fe640 1 --2- 10.20.193.58:0/925280038 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f179807a6c0 0x7f179809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:15.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.422+0000 7f17c4ff9640 1 -- 10.20.193.58:0/925280038 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f17b4085730 con 0x7f17c8056550 2026-02-23T06:21:15.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.423+0000 7f17c77fe640 1 --2- 10.20.193.58:0/925280038 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f179807a6c0 0x7f179809ab70 secure :-1 s=READY pgs=43 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17c815b450 tx=0x7f17b8009310 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:15.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.563+0000 7f17cd643640 1 -- 10.20.193.58:0/925280038 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17c805ce30 con 0x7f17c8056550 2026-02-23T06:21:15.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.563+0000 7f17c4ff9640 1 -- 10.20.193.58:0/925280038 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5542 (secure 0 0 0) 0x7f17b4068e60 con 0x7f17c8056550 2026-02-23T06:21:15.558 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:15.558 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":3,"btime":"2026-02-23T06:21:14:072086+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4320,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.58:6836/332204623","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6834","nonce":332204623},{"type":"v1","addr":"10.20.193.58:6836","nonce":332204623}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4349,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6839/49797428","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6838","nonce":49797428},{"type":"v1","addr":"10.20.193.93:6839","nonce":49797428}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4355,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.58:6833/363105980","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6832","nonce":363105980},{"type":"v1","addr":"10.20.193.58:6833","nonce":363105980}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4438,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6835/3715244768","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6834","nonce":3715244768},{"type":"v1","addr":"10.20.193.93:6835","nonce":3715244768}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4444,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6837/3986540573","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6836","nonce":3986540573},{"type":"v1","addr":"10.20.193.93:6837","nonce":3986540573}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4468,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.58:6837/4266460647","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6835","nonce":4266460647},{"type":"v1","addr":"10.20.193.58:6837","nonce":4266460647}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2026-02-23T06:21:15.560 INFO:teuthology.orchestra.run.trial058.stderr:dumped fsmap epoch 3 2026-02-23T06:21:15.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.564+0000 7f17cd643640 1 -- 10.20.193.58:0/925280038 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f179807a6c0 msgr2=0x7f179809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:15.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.564+0000 7f17cd643640 1 --2- 10.20.193.58:0/925280038 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f179807a6c0 0x7f179809ab70 secure :-1 s=READY pgs=43 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17c815b450 tx=0x7f17b8009310 comp rx=0 tx=0).stop 2026-02-23T06:21:15.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.564+0000 7f17cd643640 1 -- 10.20.193.58:0/925280038 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f17c8056550 msgr2=0x7f17c815eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:15.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.564+0000 7f17cd643640 1 --2- 10.20.193.58:0/925280038 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f17c8056550 0x7f17c815eb80 secure :-1 s=READY pgs=93 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17b40023d0 tx=0x7f17b40028d0 comp rx=0 tx=0).stop 2026-02-23T06:21:15.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.564+0000 7f17cd643640 1 -- 10.20.193.58:0/925280038 shutdown_connections 2026-02-23T06:21:15.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.564+0000 7f17cd643640 1 --2- 10.20.193.58:0/925280038 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f179807a6c0 0x7f179809ab70 unknown :-1 s=CLOSED pgs=43 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:15.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.564+0000 7f17cd643640 1 --2- 10.20.193.58:0/925280038 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f17c815c040 0x7f17c8058f10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:15.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.564+0000 7f17cd643640 1 --2- 10.20.193.58:0/925280038 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f17c805d370 0x7f17c80589d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:15.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.564+0000 7f17cd643640 1 --2- 10.20.193.58:0/925280038 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f17c8056550 0x7f17c815eb80 unknown :-1 s=CLOSED pgs=93 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:15.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.564+0000 7f17cd643640 1 -- 10.20.193.58:0/925280038 >> 10.20.193.58:0/925280038 conn(0x7f17c80b3c20 msgr2=0x7f17c80b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:15.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.564+0000 7f17cd643640 1 -- 10.20.193.58:0/925280038 shutdown_connections 2026-02-23T06:21:15.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.564+0000 7f17cd643640 1 -- 10.20.193.58:0/925280038 wait complete. 2026-02-23T06:21:15.570 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2026-02-23T06:21:15.691 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.695+0000 7fb78302f640 1 -- 10.20.193.58:0/591597808 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb77c15d870 msgr2=0x7fb77c0587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:15.691 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.695+0000 7fb78302f640 1 --2- 10.20.193.58:0/591597808 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb77c15d870 0x7fb77c0587b0 secure :-1 s=READY pgs=94 gs=2 cs=0 l=1 c_cookie=4348839809930810242 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb77c0b5230 tx=0x7fb77002f250 comp rx=0 tx=0).stop 2026-02-23T06:21:15.691 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.695+0000 7fb78302f640 1 -- 10.20.193.58:0/591597808 shutdown_connections 2026-02-23T06:21:15.691 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.695+0000 7fb78302f640 1 --2- 10.20.193.58:0/591597808 >> v2:10.20.193.58:3300/0 conn(0x7fb77c0b6690 0x7fb77c058cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:15.691 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.695+0000 7fb78302f640 1 --2- 10.20.193.58:0/591597808 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb77c15d870 0x7fb77c0587b0 unknown :-1 s=CLOSED pgs=94 gs=2 cs=0 l=1 c_cookie=4348839809930810242 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:15.691 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.695+0000 7fb78302f640 1 --2- 10.20.193.58:0/591597808 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb77c15d4a0 0x7fb77c0affb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:15.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.695+0000 7fb78302f640 1 -- 10.20.193.58:0/591597808 >> 10.20.193.58:0/591597808 conn(0x7fb77c0b3c20 msgr2=0x7fb77c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:15.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.695+0000 7fb78302f640 1 -- 10.20.193.58:0/591597808 shutdown_connections 2026-02-23T06:21:15.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.696+0000 7fb78302f640 1 -- 10.20.193.58:0/591597808 wait complete. 2026-02-23T06:21:15.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.697+0000 7fb78302f640 1 Processor -- start 2026-02-23T06:21:15.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.697+0000 7fb78302f640 1 -- start start 2026-02-23T06:21:15.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.697+0000 7fb78302f640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb77c0b6690 0x7fb77c13b530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:15.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.697+0000 7fb78302f640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb77c15d4a0 0x7fb77c200d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:15.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.697+0000 7fb78302f640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb77c15d870 0x7fb77c057370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:15.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.697+0000 7fb78302f640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c163370 con 0x7fb77c15d4a0 2026-02-23T06:21:15.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.697+0000 7fb78302f640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c13fc90 con 0x7fb77c15d870 2026-02-23T06:21:15.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.697+0000 7fb78302f640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb77c160a40 con 0x7fb77c0b6690 2026-02-23T06:21:15.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.698+0000 7fb78202d640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb77c0b6690 0x7fb77c13b530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:15.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.698+0000 7fb78182c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb77c15d4a0 0x7fb77c200d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:15.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.698+0000 7fb78202d640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb77c0b6690 0x7fb77c13b530 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:54926/0 (socket says 10.20.193.58:54926) 2026-02-23T06:21:15.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.698+0000 7fb78202d640 1 -- 10.20.193.58:0/3319341426 learned_addr learned my addr 10.20.193.58:0/3319341426 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:15.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.698+0000 7fb78282e640 1 --2- 10.20.193.58:0/3319341426 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb77c15d870 0x7fb77c057370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:15.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.698+0000 7fb78182c640 1 -- 10.20.193.58:0/3319341426 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb77c0b6690 msgr2=0x7fb77c13b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:15.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.698+0000 7fb78182c640 1 --2- 10.20.193.58:0/3319341426 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb77c0b6690 0x7fb77c13b530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:15.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.698+0000 7fb78182c640 1 -- 10.20.193.58:0/3319341426 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb77c15d870 msgr2=0x7fb77c057370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:15.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.698+0000 7fb78182c640 1 --2- 10.20.193.58:0/3319341426 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb77c15d870 0x7fb77c057370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:15.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.698+0000 7fb78182c640 1 -- 10.20.193.58:0/3319341426 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb77800a590 con 0x7fb77c15d4a0 2026-02-23T06:21:15.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.698+0000 7fb78282e640 1 --2- 10.20.193.58:0/3319341426 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb77c15d870 0x7fb77c057370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:21:15.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.698+0000 7fb78182c640 1 --2- 10.20.193.58:0/3319341426 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb77c15d4a0 0x7fb77c200d20 secure :-1 s=READY pgs=61 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb77c0b5230 tx=0x7fb7700028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:15.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.698+0000 7fb762ffd640 1 -- 10.20.193.58:0/3319341426 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb77003d070 con 0x7fb77c15d4a0 2026-02-23T06:21:15.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.698+0000 7fb762ffd640 1 -- 10.20.193.58:0/3319341426 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb770038470 con 0x7fb77c15d4a0 2026-02-23T06:21:15.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.698+0000 7fb762ffd640 1 -- 10.20.193.58:0/3319341426 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7700388a0 con 0x7fb77c15d4a0 2026-02-23T06:21:15.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.698+0000 7fb78302f640 1 -- 10.20.193.58:0/3319341426 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb770009570 con 0x7fb77c15d4a0 2026-02-23T06:21:15.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.698+0000 7fb78302f640 1 -- 10.20.193.58:0/3319341426 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb77c160490 con 0x7fb77c15d4a0 2026-02-23T06:21:15.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.699+0000 7fb78302f640 1 -- 10.20.193.58:0/3319341426 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb77c0b7260 con 0x7fb77c15d4a0 2026-02-23T06:21:15.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.700+0000 7fb762ffd640 1 -- 10.20.193.58:0/3319341426 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fb770048060 con 0x7fb77c15d4a0 2026-02-23T06:21:15.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.701+0000 7fb762ffd640 1 --2- 10.20.193.58:0/3319341426 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb74c07a6c0 0x7fb74c09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:15.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.701+0000 7fb762ffd640 1 -- 10.20.193.58:0/3319341426 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4851+0+0 (secure 0 0 0) 0x7fb7700c1650 con 0x7fb77c15d4a0 2026-02-23T06:21:15.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.701+0000 7fb78202d640 1 --2- 10.20.193.58:0/3319341426 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb74c07a6c0 0x7fb74c09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:15.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.702+0000 7fb78202d640 1 --2- 10.20.193.58:0/3319341426 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb74c07a6c0 0x7fb74c09ab70 secure :-1 s=READY pgs=44 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb76c0095b0 tx=0x7fb76c005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:15.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.703+0000 7fb762ffd640 1 -- 10.20.193.58:0/3319341426 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fb770084f30 con 0x7fb77c15d4a0 2026-02-23T06:21:15.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.816+0000 7fb78302f640 1 -- 10.20.193.58:0/3319341426 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb77c13c9b0 con 0x7fb77c15d4a0 2026-02-23T06:21:15.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.816+0000 7fb762ffd640 1 -- 10.20.193.58:0/3319341426 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7fb770088050 con 0x7fb77c15d4a0 2026-02-23T06:21:15.811 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:15.811 INFO:teuthology.orchestra.run.trial058.stdout:[ 2026-02-23T06:21:15.812 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:15.812 INFO:teuthology.orchestra.run.trial058.stdout: "poolnum": 1, 2026-02-23T06:21:15.812 INFO:teuthology.orchestra.run.trial058.stdout: "poolname": ".mgr" 2026-02-23T06:21:15.812 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:21:15.812 INFO:teuthology.orchestra.run.trial058.stdout:] 2026-02-23T06:21:15.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.817+0000 7fb78302f640 1 -- 10.20.193.58:0/3319341426 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb74c07a6c0 msgr2=0x7fb74c09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:15.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.817+0000 7fb78302f640 1 --2- 10.20.193.58:0/3319341426 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb74c07a6c0 0x7fb74c09ab70 secure :-1 s=READY pgs=44 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb76c0095b0 tx=0x7fb76c005f90 comp rx=0 tx=0).stop 2026-02-23T06:21:15.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.817+0000 7fb78302f640 1 -- 10.20.193.58:0/3319341426 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb77c15d4a0 msgr2=0x7fb77c200d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:15.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.817+0000 7fb78302f640 1 --2- 10.20.193.58:0/3319341426 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb77c15d4a0 0x7fb77c200d20 secure :-1 s=READY pgs=61 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb77c0b5230 tx=0x7fb7700028d0 comp rx=0 tx=0).stop 2026-02-23T06:21:15.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.817+0000 7fb78302f640 1 -- 10.20.193.58:0/3319341426 shutdown_connections 2026-02-23T06:21:15.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.817+0000 7fb78302f640 1 --2- 10.20.193.58:0/3319341426 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb74c07a6c0 0x7fb74c09ab70 unknown :-1 s=CLOSED pgs=44 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:15.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.817+0000 7fb78302f640 1 --2- 10.20.193.58:0/3319341426 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb77c15d870 0x7fb77c057370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:15.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.817+0000 7fb78302f640 1 --2- 10.20.193.58:0/3319341426 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb77c15d4a0 0x7fb77c200d20 unknown :-1 s=CLOSED pgs=61 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:15.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.817+0000 7fb78302f640 1 --2- 10.20.193.58:0/3319341426 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb77c0b6690 0x7fb77c13b530 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:15.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.817+0000 7fb78302f640 1 -- 10.20.193.58:0/3319341426 >> 10.20.193.58:0/3319341426 conn(0x7fb77c0b3c20 msgr2=0x7fb77c05ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:15.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.817+0000 7fb78302f640 1 -- 10.20.193.58:0/3319341426 shutdown_connections 2026-02-23T06:21:15.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.817+0000 7fb78302f640 1 -- 10.20.193.58:0/3319341426 wait complete. 2026-02-23T06:21:15.824 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2026-02-23T06:21:15.824 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2026-02-23T06:21:15.947 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.952+0000 7f8606375640 1 -- 10.20.193.58:0/423794951 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f860015c040 msgr2=0x7f860005b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:15.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.952+0000 7f8606375640 1 --2- 10.20.193.58:0/423794951 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f860015c040 0x7f860005b0e0 secure :-1 s=READY pgs=63 gs=3 cs=0 l=1 c_cookie=7019459783385238200 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85f0005820 tx=0x7f85f00302b0 comp rx=0 tx=0).stop 2026-02-23T06:21:15.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.952+0000 7f8606375640 1 -- 10.20.193.58:0/423794951 shutdown_connections 2026-02-23T06:21:15.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.952+0000 7f8606375640 1 --2- 10.20.193.58:0/423794951 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f860015c040 0x7f860005b0e0 unknown :-1 s=CLOSED pgs=63 gs=3 cs=0 l=1 c_cookie=7019459783385238200 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:15.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.952+0000 7f8606375640 1 -- 10.20.193.58:0/423794951 >> 10.20.193.58:0/423794951 conn(0x7f86000b3c20 msgr2=0x7f86000b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:15.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.952+0000 7f8606375640 1 -- 10.20.193.58:0/423794951 shutdown_connections 2026-02-23T06:21:15.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.952+0000 7f8606375640 1 -- 10.20.193.58:0/423794951 wait complete. 2026-02-23T06:21:15.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.954+0000 7f8606375640 1 Processor -- start 2026-02-23T06:21:15.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.954+0000 7f8606375640 1 -- start start 2026-02-23T06:21:15.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.954+0000 7f8606375640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8600056550 0x7f86000b1740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:15.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.954+0000 7f8606375640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86000b5680 0x7f8600157890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:15.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.954+0000 7f8606375640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f860015c040 0x7f86001fdb60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:15.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.954+0000 7f8606375640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f86000af2d0 con 0x7f8600056550 2026-02-23T06:21:15.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.954+0000 7f8606375640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f8600201920 con 0x7f860015c040 2026-02-23T06:21:15.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.954+0000 7f8606375640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f86000b0bd0 con 0x7f86000b5680 2026-02-23T06:21:15.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.955+0000 7f8605373640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8600056550 0x7f86000b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:15.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.955+0000 7f8605373640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8600056550 0x7f86000b1740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:36540/0 (socket says 10.20.193.58:36540) 2026-02-23T06:21:15.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.955+0000 7f8605373640 1 -- 10.20.193.58:0/1491503465 learned_addr learned my addr 10.20.193.58:0/1491503465 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:15.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.955+0000 7f8605b74640 1 --2- 10.20.193.58:0/1491503465 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f860015c040 0x7f86001fdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:15.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.955+0000 7f8604b72640 1 --2- 10.20.193.58:0/1491503465 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86000b5680 0x7f8600157890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:15.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.955+0000 7f8605373640 1 -- 10.20.193.58:0/1491503465 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86000b5680 msgr2=0x7f8600157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:15.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.955+0000 7f8605373640 1 --2- 10.20.193.58:0/1491503465 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86000b5680 0x7f8600157890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:15.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.955+0000 7f8605373640 1 -- 10.20.193.58:0/1491503465 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f860015c040 msgr2=0x7f86001fdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:15.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.955+0000 7f8605373640 1 --2- 10.20.193.58:0/1491503465 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f860015c040 0x7f86001fdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:15.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.955+0000 7f8605373640 1 -- 10.20.193.58:0/1491503465 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f000a590 con 0x7f8600056550 2026-02-23T06:21:15.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.955+0000 7f8605373640 1 --2- 10.20.193.58:0/1491503465 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8600056550 0x7f86000b1740 secure :-1 s=READY pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85f0003e60 tx=0x7f85f0003e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:15.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.955+0000 7f85edffb640 1 -- 10.20.193.58:0/1491503465 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f85f003e070 con 0x7f8600056550 2026-02-23T06:21:15.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.955+0000 7f85edffb640 1 -- 10.20.193.58:0/1491503465 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85f0039960 con 0x7f8600056550 2026-02-23T06:21:15.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.955+0000 7f85edffb640 1 -- 10.20.193.58:0/1491503465 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f85f0039d30 con 0x7f8600056550 2026-02-23T06:21:15.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.955+0000 7f8606375640 1 -- 10.20.193.58:0/1491503465 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8600161960 con 0x7f8600056550 2026-02-23T06:21:15.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.956+0000 7f8606375640 1 -- 10.20.193.58:0/1491503465 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8600161c00 con 0x7f8600056550 2026-02-23T06:21:15.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.956+0000 7f8606375640 1 -- 10.20.193.58:0/1491503465 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f860005b0e0 con 0x7f8600056550 2026-02-23T06:21:15.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.957+0000 7f85edffb640 1 -- 10.20.193.58:0/1491503465 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f85f004b400 con 0x7f8600056550 2026-02-23T06:21:15.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.958+0000 7f85edffb640 1 --2- 10.20.193.58:0/1491503465 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f85d007a6c0 0x7f85d009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:15.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.958+0000 7f85edffb640 1 -- 10.20.193.58:0/1491503465 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4851+0+0 (secure 0 0 0) 0x7f85f00c3160 con 0x7f8600056550 2026-02-23T06:21:15.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.958+0000 7f8604b72640 1 --2- 10.20.193.58:0/1491503465 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f85d007a6c0 0x7f85d009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:15.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.959+0000 7f8604b72640 1 --2- 10.20.193.58:0/1491503465 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f85d007a6c0 0x7f85d009ab70 secure :-1 s=READY pgs=45 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8600161370 tx=0x7f85f4009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:15.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:15.960+0000 7f85edffb640 1 -- 10.20.193.58:0/1491503465 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f85f00869b0 con 0x7f8600056550 2026-02-23T06:21:16.067 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.073+0000 7f8606375640 1 -- 10.20.193.58:0/1491503465 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f86000af010 con 0x7f8600056550 2026-02-23T06:21:16.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.130+0000 7f85edffb640 1 -- 10.20.193.58:0/1491503465 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f85f0089ad0 con 0x7f8600056550 2026-02-23T06:21:16.125 INFO:teuthology.orchestra.run.trial058.stderr:pool 'cephfs_metadata' created 2026-02-23T06:21:16.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.132+0000 7f8606375640 1 -- 10.20.193.58:0/1491503465 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f85d007a6c0 msgr2=0x7f85d009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:16.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.132+0000 7f8606375640 1 --2- 10.20.193.58:0/1491503465 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f85d007a6c0 0x7f85d009ab70 secure :-1 s=READY pgs=45 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8600161370 tx=0x7f85f4009040 comp rx=0 tx=0).stop 2026-02-23T06:21:16.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.132+0000 7f8606375640 1 -- 10.20.193.58:0/1491503465 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8600056550 msgr2=0x7f86000b1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:16.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.132+0000 7f8606375640 1 --2- 10.20.193.58:0/1491503465 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8600056550 0x7f86000b1740 secure :-1 s=READY pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85f0003e60 tx=0x7f85f0003e90 comp rx=0 tx=0).stop 2026-02-23T06:21:16.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.133+0000 7f8606375640 1 -- 10.20.193.58:0/1491503465 shutdown_connections 2026-02-23T06:21:16.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.133+0000 7f8606375640 1 --2- 10.20.193.58:0/1491503465 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f85d007a6c0 0x7f85d009ab70 unknown :-1 s=CLOSED pgs=45 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:16.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.133+0000 7f8606375640 1 --2- 10.20.193.58:0/1491503465 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f860015c040 0x7f86001fdb60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:16.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.133+0000 7f8606375640 1 --2- 10.20.193.58:0/1491503465 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86000b5680 0x7f8600157890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:16.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.133+0000 7f8606375640 1 --2- 10.20.193.58:0/1491503465 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8600056550 0x7f86000b1740 unknown :-1 s=CLOSED pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:16.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.133+0000 7f8606375640 1 -- 10.20.193.58:0/1491503465 >> 10.20.193.58:0/1491503465 conn(0x7f86000b3c20 msgr2=0x7f860015a550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:16.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.133+0000 7f8606375640 1 -- 10.20.193.58:0/1491503465 shutdown_connections 2026-02-23T06:21:16.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.133+0000 7f8606375640 1 -- 10.20.193.58:0/1491503465 wait complete. 2026-02-23T06:21:16.141 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2026-02-23T06:21:16.265 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.270+0000 7f0b87114640 1 -- 10.20.193.58:0/1657280803 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b800b6690 msgr2=0x7f0b80058ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:16.266 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.270+0000 7f0b87114640 1 --2- 10.20.193.58:0/1657280803 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b800b6690 0x7f0b80058ec0 secure :-1 s=READY pgs=52 gs=3 cs=0 l=1 c_cookie=6818477623324674021 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b7c00a970 tx=0x7f0b7c0302d0 comp rx=0 tx=0).stop 2026-02-23T06:21:16.266 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.270+0000 7f0b87114640 1 -- 10.20.193.58:0/1657280803 shutdown_connections 2026-02-23T06:21:16.266 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.270+0000 7f0b87114640 1 --2- 10.20.193.58:0/1657280803 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b800b6690 0x7f0b80058ec0 unknown :-1 s=CLOSED pgs=52 gs=3 cs=0 l=1 c_cookie=6818477623324674021 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:16.266 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.270+0000 7f0b87114640 1 -- 10.20.193.58:0/1657280803 >> 10.20.193.58:0/1657280803 conn(0x7f0b800b3c20 msgr2=0x7f0b800b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:16.266 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.270+0000 7f0b87114640 1 -- 10.20.193.58:0/1657280803 shutdown_connections 2026-02-23T06:21:16.266 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.270+0000 7f0b87114640 1 -- 10.20.193.58:0/1657280803 wait complete. 2026-02-23T06:21:16.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.272+0000 7f0b87114640 1 Processor -- start 2026-02-23T06:21:16.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.272+0000 7f0b87114640 1 -- start start 2026-02-23T06:21:16.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.272+0000 7f0b87114640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0b800b6690 0x7f0b8011dcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:16.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.272+0000 7f0b87114640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b8015d4a0 0x7f0b80141350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:16.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.272+0000 7f0b87114640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b8015d870 0x7f0b80141890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:16.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.272+0000 7f0b87114640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f0b80058240 con 0x7f0b8015d4a0 2026-02-23T06:21:16.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.272+0000 7f0b87114640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f0b80160f90 con 0x7f0b800b6690 2026-02-23T06:21:16.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.272+0000 7f0b87114640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f0b80057fa0 con 0x7f0b8015d870 2026-02-23T06:21:16.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.272+0000 7f0b86112640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0b800b6690 0x7f0b8011dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:16.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.272+0000 7f0b85911640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b8015d4a0 0x7f0b80141350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:16.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.272+0000 7f0b86112640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0b800b6690 0x7f0b8011dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:60822/0 (socket says 10.20.193.58:60822) 2026-02-23T06:21:16.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.272+0000 7f0b86112640 1 -- 10.20.193.58:0/2231284660 learned_addr learned my addr 10.20.193.58:0/2231284660 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:16.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.272+0000 7f0b86913640 1 --2- 10.20.193.58:0/2231284660 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b8015d870 0x7f0b80141890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:16.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.273+0000 7f0b86112640 1 -- 10.20.193.58:0/2231284660 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b8015d870 msgr2=0x7f0b80141890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:16.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.273+0000 7f0b86112640 1 --2- 10.20.193.58:0/2231284660 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b8015d870 0x7f0b80141890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:16.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.273+0000 7f0b86112640 1 -- 10.20.193.58:0/2231284660 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b8015d4a0 msgr2=0x7f0b80141350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:16.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.273+0000 7f0b86112640 1 --2- 10.20.193.58:0/2231284660 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b8015d4a0 0x7f0b80141350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:16.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.273+0000 7f0b86112640 1 -- 10.20.193.58:0/2231284660 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b7c00a590 con 0x7f0b800b6690 2026-02-23T06:21:16.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.273+0000 7f0b85911640 1 --2- 10.20.193.58:0/2231284660 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b8015d4a0 0x7f0b80141350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:16.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.273+0000 7f0b86112640 1 --2- 10.20.193.58:0/2231284660 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0b800b6690 0x7f0b8011dcb0 secure :-1 s=READY pgs=97 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b70007fd0 tx=0x7f0b7000c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:16.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.273+0000 7f0b66ffd640 1 -- 10.20.193.58:0/2231284660 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b70012850 con 0x7f0b800b6690 2026-02-23T06:21:16.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.273+0000 7f0b66ffd640 1 -- 10.20.193.58:0/2231284660 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b70012aa0 con 0x7f0b800b6690 2026-02-23T06:21:16.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.273+0000 7f0b87114640 1 -- 10.20.193.58:0/2231284660 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b80056960 con 0x7f0b800b6690 2026-02-23T06:21:16.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.273+0000 7f0b66ffd640 1 -- 10.20.193.58:0/2231284660 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b70012e50 con 0x7f0b800b6690 2026-02-23T06:21:16.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.273+0000 7f0b87114640 1 -- 10.20.193.58:0/2231284660 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b801611e0 con 0x7f0b800b6690 2026-02-23T06:21:16.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.274+0000 7f0b87114640 1 -- 10.20.193.58:0/2231284660 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b800b6d50 con 0x7f0b800b6690 2026-02-23T06:21:16.272 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.275+0000 7f0b66ffd640 1 -- 10.20.193.58:0/2231284660 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f0b70025440 con 0x7f0b800b6690 2026-02-23T06:21:16.272 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.276+0000 7f0b66ffd640 1 --2- 10.20.193.58:0/2231284660 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0b5007a640 0x7f0b5009aaf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:16.272 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.276+0000 7f0b66ffd640 1 -- 10.20.193.58:0/2231284660 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5224+0+0 (secure 0 0 0) 0x7f0b7009d850 con 0x7f0b800b6690 2026-02-23T06:21:16.272 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.276+0000 7f0b85911640 1 --2- 10.20.193.58:0/2231284660 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0b5007a640 0x7f0b5009aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:16.272 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.277+0000 7f0b66ffd640 1 -- 10.20.193.58:0/2231284660 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f0b70060fc0 con 0x7f0b800b6690 2026-02-23T06:21:16.273 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.277+0000 7f0b85911640 1 --2- 10.20.193.58:0/2231284660 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0b5007a640 0x7f0b5009aaf0 secure :-1 s=READY pgs=46 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b800574c0 tx=0x7f0b74007ec0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:16.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:16.393+0000 7f0b87114640 1 -- 10.20.193.58:0/2231284660 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f0b80161400 con 0x7f0b800b6690 2026-02-23T06:21:17.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.134+0000 7f0b66ffd640 1 -- 10.20.193.58:0/2231284660 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7f0b700640e0 con 0x7f0b800b6690 2026-02-23T06:21:17.130 INFO:teuthology.orchestra.run.trial058.stderr:pool 'cephfs_data' created 2026-02-23T06:21:17.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.138+0000 7f0b87114640 1 -- 10.20.193.58:0/2231284660 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0b5007a640 msgr2=0x7f0b5009aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:17.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.138+0000 7f0b87114640 1 --2- 10.20.193.58:0/2231284660 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0b5007a640 0x7f0b5009aaf0 secure :-1 s=READY pgs=46 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b800574c0 tx=0x7f0b74007ec0 comp rx=0 tx=0).stop 2026-02-23T06:21:17.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.138+0000 7f0b87114640 1 -- 10.20.193.58:0/2231284660 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0b800b6690 msgr2=0x7f0b8011dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:17.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.138+0000 7f0b87114640 1 --2- 10.20.193.58:0/2231284660 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0b800b6690 0x7f0b8011dcb0 secure :-1 s=READY pgs=97 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b70007fd0 tx=0x7f0b7000c970 comp rx=0 tx=0).stop 2026-02-23T06:21:17.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.138+0000 7f0b87114640 1 -- 10.20.193.58:0/2231284660 shutdown_connections 2026-02-23T06:21:17.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.138+0000 7f0b87114640 1 --2- 10.20.193.58:0/2231284660 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0b5007a640 0x7f0b5009aaf0 unknown :-1 s=CLOSED pgs=46 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:17.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.138+0000 7f0b87114640 1 --2- 10.20.193.58:0/2231284660 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b8015d870 0x7f0b80141890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:17.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.138+0000 7f0b87114640 1 --2- 10.20.193.58:0/2231284660 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b8015d4a0 0x7f0b80141350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:17.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.138+0000 7f0b87114640 1 --2- 10.20.193.58:0/2231284660 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0b800b6690 0x7f0b8011dcb0 unknown :-1 s=CLOSED pgs=97 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:17.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.139+0000 7f0b87114640 1 -- 10.20.193.58:0/2231284660 >> 10.20.193.58:0/2231284660 conn(0x7f0b800b3c20 msgr2=0x7f0b800aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:17.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.139+0000 7f0b87114640 1 -- 10.20.193.58:0/2231284660 shutdown_connections 2026-02-23T06:21:17.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.141+0000 7f0b87114640 1 -- 10.20.193.58:0/2231284660 wait complete. 2026-02-23T06:21:17.152 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2026-02-23T06:21:17.274 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.279+0000 7fbd1dd1c640 1 -- 10.20.193.58:0/4093367016 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd1815c040 msgr2=0x7fbd1805b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:17.274 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.279+0000 7fbd1dd1c640 1 --2- 10.20.193.58:0/4093367016 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd1815c040 0x7fbd1805b0e0 secure :-1 s=READY pgs=66 gs=2 cs=0 l=1 c_cookie=4098691230443413276 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd08005e70 tx=0x7fbd0802f290 comp rx=0 tx=0).stop 2026-02-23T06:21:17.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.279+0000 7fbd1dd1c640 1 -- 10.20.193.58:0/4093367016 shutdown_connections 2026-02-23T06:21:17.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.279+0000 7fbd1dd1c640 1 --2- 10.20.193.58:0/4093367016 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd180b5680 0x7fbd180b5b00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:17.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.279+0000 7fbd1dd1c640 1 --2- 10.20.193.58:0/4093367016 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd1815c040 0x7fbd1805b0e0 unknown :-1 s=CLOSED pgs=66 gs=2 cs=0 l=1 c_cookie=4098691230443413276 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:17.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.279+0000 7fbd1dd1c640 1 -- 10.20.193.58:0/4093367016 >> 10.20.193.58:0/4093367016 conn(0x7fbd180b3c20 msgr2=0x7fbd180b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:17.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.279+0000 7fbd1dd1c640 1 -- 10.20.193.58:0/4093367016 shutdown_connections 2026-02-23T06:21:17.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.279+0000 7fbd1dd1c640 1 -- 10.20.193.58:0/4093367016 wait complete. 2026-02-23T06:21:17.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.280+0000 7fbd1dd1c640 1 Processor -- start 2026-02-23T06:21:17.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.281+0000 7fbd1dd1c640 1 -- start start 2026-02-23T06:21:17.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.281+0000 7fbd1dd1c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd18056550 0x7fbd1815cb70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:17.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.281+0000 7fbd1dd1c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd180b5680 0x7fbd181fe0c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:17.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.281+0000 7fbd1dd1c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd1815c040 0x7fbd18058430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:17.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.281+0000 7fbd1dd1c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fbd181fd6b0 con 0x7fbd18056550 2026-02-23T06:21:17.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.281+0000 7fbd1dd1c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fbd18162e50 con 0x7fbd180b5680 2026-02-23T06:21:17.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.281+0000 7fbd1dd1c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fbd181fdc30 con 0x7fbd1815c040 2026-02-23T06:21:17.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.281+0000 7fbd0ffff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd180b5680 0x7fbd181fe0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:17.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.281+0000 7fbd1cd1a640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd18056550 0x7fbd1815cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:17.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.281+0000 7fbd1d51b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd1815c040 0x7fbd18058430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:17.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.281+0000 7fbd1cd1a640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd18056550 0x7fbd1815cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:36558/0 (socket says 10.20.193.58:36558) 2026-02-23T06:21:17.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.281+0000 7fbd1cd1a640 1 -- 10.20.193.58:0/4074885833 learned_addr learned my addr 10.20.193.58:0/4074885833 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:17.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.282+0000 7fbd1cd1a640 1 -- 10.20.193.58:0/4074885833 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd1815c040 msgr2=0x7fbd18058430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:17.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.282+0000 7fbd1cd1a640 1 --2- 10.20.193.58:0/4074885833 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd1815c040 0x7fbd18058430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:17.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.282+0000 7fbd1cd1a640 1 -- 10.20.193.58:0/4074885833 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd180b5680 msgr2=0x7fbd181fe0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:17.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.282+0000 7fbd1cd1a640 1 --2- 10.20.193.58:0/4074885833 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd180b5680 0x7fbd181fe0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:17.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.282+0000 7fbd1cd1a640 1 -- 10.20.193.58:0/4074885833 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd08009570 con 0x7fbd18056550 2026-02-23T06:21:17.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.282+0000 7fbd1cd1a640 1 --2- 10.20.193.58:0/4074885833 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd18056550 0x7fbd1815cb70 secure :-1 s=READY pgs=67 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd08004740 tx=0x7fbd080028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:17.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.282+0000 7fbd0d7fa640 1 -- 10.20.193.58:0/4074885833 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd0803d070 con 0x7fbd18056550 2026-02-23T06:21:17.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.282+0000 7fbd0d7fa640 1 -- 10.20.193.58:0/4074885833 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd08038470 con 0x7fbd18056550 2026-02-23T06:21:17.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.282+0000 7fbd0d7fa640 1 -- 10.20.193.58:0/4074885833 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd080388a0 con 0x7fbd18056550 2026-02-23T06:21:17.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.282+0000 7fbd1dd1c640 1 -- 10.20.193.58:0/4074885833 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd18162be0 con 0x7fbd18056550 2026-02-23T06:21:17.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.282+0000 7fbd1dd1c640 1 -- 10.20.193.58:0/4074885833 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd1815e410 con 0x7fbd18056550 2026-02-23T06:21:17.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.283+0000 7fbd1dd1c640 1 -- 10.20.193.58:0/4074885833 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd1815e620 con 0x7fbd18056550 2026-02-23T06:21:17.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.284+0000 7fbd0d7fa640 1 -- 10.20.193.58:0/4074885833 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fbd08038a00 con 0x7fbd18056550 2026-02-23T06:21:17.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.285+0000 7fbd0d7fa640 1 --2- 10.20.193.58:0/4074885833 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbce807a6c0 0x7fbce809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:17.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.285+0000 7fbd0d7fa640 1 -- 10.20.193.58:0/4074885833 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7fbd080c1f10 con 0x7fbd18056550 2026-02-23T06:21:17.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.285+0000 7fbd0ffff640 1 --2- 10.20.193.58:0/4074885833 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbce807a6c0 0x7fbce809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:17.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.286+0000 7fbd0ffff640 1 --2- 10.20.193.58:0/4074885833 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbce807a6c0 0x7fbce809ab70 secure :-1 s=READY pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd1815b590 tx=0x7fbd00007ee0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:17.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.288+0000 7fbd0d7fa640 1 -- 10.20.193.58:0/4074885833 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fbd080853e0 con 0x7fbd18056550 2026-02-23T06:21:17.421 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:17.427+0000 7fbd1dd1c640 1 -- 10.20.193.58:0/4074885833 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fbd1805d9c0 con 0x7fbd18056550 2026-02-23T06:21:18.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.140+0000 7fbd0d7fa640 1 -- 10.20.193.58:0/4074885833 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fbd08088590 con 0x7fbd18056550 2026-02-23T06:21:18.136 INFO:teuthology.orchestra.run.trial058.stderr:new fs with metadata pool 2 and data pool 3 2026-02-23T06:21:18.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.144+0000 7fbd1dd1c640 1 -- 10.20.193.58:0/4074885833 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbce807a6c0 msgr2=0x7fbce809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:18.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.144+0000 7fbd1dd1c640 1 --2- 10.20.193.58:0/4074885833 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbce807a6c0 0x7fbce809ab70 secure :-1 s=READY pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd1815b590 tx=0x7fbd00007ee0 comp rx=0 tx=0).stop 2026-02-23T06:21:18.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.144+0000 7fbd1dd1c640 1 -- 10.20.193.58:0/4074885833 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd18056550 msgr2=0x7fbd1815cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:18.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.144+0000 7fbd1dd1c640 1 --2- 10.20.193.58:0/4074885833 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd18056550 0x7fbd1815cb70 secure :-1 s=READY pgs=67 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd08004740 tx=0x7fbd080028d0 comp rx=0 tx=0).stop 2026-02-23T06:21:18.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.147+0000 7fbd1dd1c640 1 -- 10.20.193.58:0/4074885833 shutdown_connections 2026-02-23T06:21:18.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.147+0000 7fbd1dd1c640 1 --2- 10.20.193.58:0/4074885833 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbce807a6c0 0x7fbce809ab70 unknown :-1 s=CLOSED pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:18.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.147+0000 7fbd1dd1c640 1 --2- 10.20.193.58:0/4074885833 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd1815c040 0x7fbd18058430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:18.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.147+0000 7fbd1dd1c640 1 --2- 10.20.193.58:0/4074885833 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd180b5680 0x7fbd181fe0c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:18.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.147+0000 7fbd1dd1c640 1 --2- 10.20.193.58:0/4074885833 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd18056550 0x7fbd1815cb70 unknown :-1 s=CLOSED pgs=67 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:18.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.147+0000 7fbd1dd1c640 1 -- 10.20.193.58:0/4074885833 >> 10.20.193.58:0/4074885833 conn(0x7fbd180b3c20 msgr2=0x7fbd1815a990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:18.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.147+0000 7fbd1dd1c640 1 -- 10.20.193.58:0/4074885833 shutdown_connections 2026-02-23T06:21:18.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.147+0000 7fbd1dd1c640 1 -- 10.20.193.58:0/4074885833 wait complete. 2026-02-23T06:21:18.158 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2026-02-23T06:21:18.159 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2026-02-23T06:21:18.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.286+0000 7f88a7fff640 1 -- 10.20.193.58:0/2118503531 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88a815d4a0 msgr2=0x7f88a80affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:18.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.286+0000 7f88a7fff640 1 --2- 10.20.193.58:0/2118503531 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88a815d4a0 0x7f88a80affb0 secure :-1 s=READY pgs=53 gs=3 cs=0 l=1 c_cookie=18162640361675245051 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f889c009890 tx=0x7f889c02f200 comp rx=0 tx=0).stop 2026-02-23T06:21:18.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.286+0000 7f88a7fff640 1 -- 10.20.193.58:0/2118503531 shutdown_connections 2026-02-23T06:21:18.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.286+0000 7f88a7fff640 1 --2- 10.20.193.58:0/2118503531 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88a815d4a0 0x7f88a80affb0 unknown :-1 s=CLOSED pgs=53 gs=3 cs=0 l=1 c_cookie=18162640361675245051 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:18.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.286+0000 7f88a7fff640 1 -- 10.20.193.58:0/2118503531 >> 10.20.193.58:0/2118503531 conn(0x7f88a80b3c20 msgr2=0x7f88a80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:18.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.286+0000 7f88a7fff640 1 -- 10.20.193.58:0/2118503531 shutdown_connections 2026-02-23T06:21:18.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.286+0000 7f88a7fff640 1 -- 10.20.193.58:0/2118503531 wait complete. 2026-02-23T06:21:18.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.287+0000 7f88a7fff640 1 Processor -- start 2026-02-23T06:21:18.285 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.288+0000 7f88a7fff640 1 -- start start 2026-02-23T06:21:18.285 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.288+0000 7f88a7fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f88a80b6690 0x7f88a813e850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:18.285 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.288+0000 7f88a7fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88a815d4a0 0x7f88a8057750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:18.285 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.288+0000 7f88a7fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f88a815d870 0x7f88a813b910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:18.285 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.288+0000 7f88a7fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f88a813c7d0 con 0x7f88a815d870 2026-02-23T06:21:18.285 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.288+0000 7f88a7fff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f88a81623e0 con 0x7f88a80b6690 2026-02-23T06:21:18.285 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.288+0000 7f88a7fff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f88a8162800 con 0x7f88a815d4a0 2026-02-23T06:21:18.285 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.288+0000 7f88a6ffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f88a80b6690 0x7f88a813e850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:18.285 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.288+0000 7f88a77fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f88a815d870 0x7f88a813b910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:18.285 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.288+0000 7f88a6ffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f88a80b6690 0x7f88a813e850 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:60844/0 (socket says 10.20.193.58:60844) 2026-02-23T06:21:18.285 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.288+0000 7f88a6ffd640 1 -- 10.20.193.58:0/1671796122 learned_addr learned my addr 10.20.193.58:0/1671796122 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:18.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.288+0000 7f88a67fc640 1 --2- 10.20.193.58:0/1671796122 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88a815d4a0 0x7f88a8057750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:18.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.289+0000 7f88a6ffd640 1 -- 10.20.193.58:0/1671796122 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88a815d4a0 msgr2=0x7f88a8057750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:18.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.289+0000 7f88a6ffd640 1 --2- 10.20.193.58:0/1671796122 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88a815d4a0 0x7f88a8057750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:18.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.289+0000 7f88a6ffd640 1 -- 10.20.193.58:0/1671796122 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f88a815d870 msgr2=0x7f88a813b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:18.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.289+0000 7f88a6ffd640 1 --2- 10.20.193.58:0/1671796122 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f88a815d870 0x7f88a813b910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:18.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.289+0000 7f88a6ffd640 1 -- 10.20.193.58:0/1671796122 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889c0094b0 con 0x7f88a80b6690 2026-02-23T06:21:18.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.289+0000 7f88a77fe640 1 --2- 10.20.193.58:0/1671796122 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f88a815d870 0x7f88a813b910 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:18.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.289+0000 7f88a6ffd640 1 --2- 10.20.193.58:0/1671796122 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f88a80b6690 0x7f88a813e850 secure :-1 s=READY pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f889c009990 tx=0x7f889c002950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:18.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.289+0000 7f887ffff640 1 -- 10.20.193.58:0/1671796122 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f889c005d40 con 0x7f88a80b6690 2026-02-23T06:21:18.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.289+0000 7f887ffff640 1 -- 10.20.193.58:0/1671796122 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f889c038560 con 0x7f88a80b6690 2026-02-23T06:21:18.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.289+0000 7f887ffff640 1 -- 10.20.193.58:0/1671796122 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f889c038990 con 0x7f88a80b6690 2026-02-23T06:21:18.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.289+0000 7f88a7fff640 1 -- 10.20.193.58:0/1671796122 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88a82017d0 con 0x7f88a80b6690 2026-02-23T06:21:18.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.289+0000 7f88a7fff640 1 -- 10.20.193.58:0/1671796122 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88a813c4f0 con 0x7f88a80b6690 2026-02-23T06:21:18.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.290+0000 7f88a7fff640 1 -- 10.20.193.58:0/1671796122 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88a8162650 con 0x7f88a80b6690 2026-02-23T06:21:18.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.291+0000 7f887ffff640 1 -- 10.20.193.58:0/1671796122 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f889c038af0 con 0x7f88a80b6690 2026-02-23T06:21:18.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.292+0000 7f887ffff640 1 --2- 10.20.193.58:0/1671796122 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f887807a6c0 0x7f887809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:18.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.292+0000 7f887ffff640 1 -- 10.20.193.58:0/1671796122 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f889c0c2850 con 0x7f88a80b6690 2026-02-23T06:21:18.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.293+0000 7f88a67fc640 1 --2- 10.20.193.58:0/1671796122 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f887807a6c0 0x7f887809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:18.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.293+0000 7f887ffff640 1 -- 10.20.193.58:0/1671796122 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f889c085f80 con 0x7f88a80b6690 2026-02-23T06:21:18.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.293+0000 7f88a67fc640 1 --2- 10.20.193.58:0/1671796122 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f887807a6c0 0x7f887809ab70 secure :-1 s=READY pgs=48 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88a815bfa0 tx=0x7f8890007d90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:18.406 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:18.411+0000 7f88a7fff640 1 -- 10.20.193.58:0/1671796122 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f88a81fecc0 con 0x7f88a80b6690 2026-02-23T06:21:19.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.143+0000 7f887ffff640 1 -- 10.20.193.58:0/1671796122 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 load: isa v21) ==== 167+0+0 (secure 0 0 0) 0x7f889c0890a0 con 0x7f88a80b6690 2026-02-23T06:21:19.138 INFO:teuthology.orchestra.run.trial058.stderr:load: isa 2026-02-23T06:21:19.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.144+0000 7f88a7fff640 1 -- 10.20.193.58:0/1671796122 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f887807a6c0 msgr2=0x7f887809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:19.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.144+0000 7f88a7fff640 1 --2- 10.20.193.58:0/1671796122 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f887807a6c0 0x7f887809ab70 secure :-1 s=READY pgs=48 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88a815bfa0 tx=0x7f8890007d90 comp rx=0 tx=0).stop 2026-02-23T06:21:19.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.144+0000 7f88a7fff640 1 -- 10.20.193.58:0/1671796122 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f88a80b6690 msgr2=0x7f88a813e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:19.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.144+0000 7f88a7fff640 1 --2- 10.20.193.58:0/1671796122 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f88a80b6690 0x7f88a813e850 secure :-1 s=READY pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f889c009990 tx=0x7f889c002950 comp rx=0 tx=0).stop 2026-02-23T06:21:19.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.145+0000 7f88a7fff640 1 -- 10.20.193.58:0/1671796122 shutdown_connections 2026-02-23T06:21:19.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.145+0000 7f88a7fff640 1 --2- 10.20.193.58:0/1671796122 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f887807a6c0 0x7f887809ab70 unknown :-1 s=CLOSED pgs=48 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:19.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.145+0000 7f88a7fff640 1 --2- 10.20.193.58:0/1671796122 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f88a815d870 0x7f88a813b910 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:19.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.145+0000 7f88a7fff640 1 --2- 10.20.193.58:0/1671796122 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88a815d4a0 0x7f88a8057750 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:19.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.145+0000 7f88a7fff640 1 --2- 10.20.193.58:0/1671796122 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f88a80b6690 0x7f88a813e850 unknown :-1 s=CLOSED pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:19.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.145+0000 7f88a7fff640 1 -- 10.20.193.58:0/1671796122 >> 10.20.193.58:0/1671796122 conn(0x7f88a80b3c20 msgr2=0x7f88a80b76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:19.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.145+0000 7f88a7fff640 1 -- 10.20.193.58:0/1671796122 shutdown_connections 2026-02-23T06:21:19.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.145+0000 7f88a7fff640 1 -- 10.20.193.58:0/1671796122 wait complete. 2026-02-23T06:21:19.152 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2026-02-23T06:21:19.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.282+0000 7f999ffff640 1 -- 10.20.193.58:0/1873145913 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f99a00b6e00 msgr2=0x7f99a0165490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:19.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.282+0000 7f999ffff640 1 --2- 10.20.193.58:0/1873145913 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f99a00b6e00 0x7f99a0165490 secure :-1 s=READY pgs=69 gs=2 cs=0 l=1 c_cookie=18410996753249475037 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99a00b5350 tx=0x7f998802f2e0 comp rx=0 tx=0).stop 2026-02-23T06:21:19.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.282+0000 7f999ffff640 1 -- 10.20.193.58:0/1873145913 shutdown_connections 2026-02-23T06:21:19.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.282+0000 7f999ffff640 1 --2- 10.20.193.58:0/1873145913 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f99a00b6e00 0x7f99a0165490 unknown :-1 s=CLOSED pgs=69 gs=2 cs=0 l=1 c_cookie=18410996753249475037 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:19.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.282+0000 7f999ffff640 1 --2- 10.20.193.58:0/1873145913 >> v2:10.20.193.93:3300/0 conn(0x7f99a00b6a30 0x7f99a00b4c50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:19.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.282+0000 7f999ffff640 1 -- 10.20.193.58:0/1873145913 >> 10.20.193.58:0/1873145913 conn(0x7f99a0054a90 msgr2=0x7f99a0058d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:19.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.282+0000 7f999ffff640 1 -- 10.20.193.58:0/1873145913 shutdown_connections 2026-02-23T06:21:19.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.282+0000 7f999ffff640 1 -- 10.20.193.58:0/1873145913 wait complete. 2026-02-23T06:21:19.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.283+0000 7f999ffff640 1 Processor -- start 2026-02-23T06:21:19.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.283+0000 7f999ffff640 1 -- start start 2026-02-23T06:21:19.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.284+0000 7f999ffff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f99a00b6a30 0x7f99a01572b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:19.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.284+0000 7f999ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f99a00b6e00 0x7f99a01371f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:19.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.284+0000 7f999ffff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f99a015b9f0 0x7f99a0137730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:19.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.284+0000 7f999ffff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f99a005daa0 con 0x7f99a00b6e00 2026-02-23T06:21:19.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.284+0000 7f999ffff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f99a00ae120 con 0x7f99a00b6a30 2026-02-23T06:21:19.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.284+0000 7f999ffff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f99a00ae400 con 0x7f99a015b9f0 2026-02-23T06:21:19.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.284+0000 7f999effd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f99a00b6a30 0x7f99a01572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:19.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.284+0000 7f999e7fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f99a00b6e00 0x7f99a01371f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:19.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.284+0000 7f999e7fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f99a00b6e00 0x7f99a01371f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:47016/0 (socket says 10.20.193.58:47016) 2026-02-23T06:21:19.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.284+0000 7f999e7fc640 1 -- 10.20.193.58:0/1239189861 learned_addr learned my addr 10.20.193.58:0/1239189861 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:19.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.284+0000 7f999f7fe640 1 --2- 10.20.193.58:0/1239189861 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f99a015b9f0 0x7f99a0137730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:19.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.284+0000 7f999e7fc640 1 -- 10.20.193.58:0/1239189861 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f99a015b9f0 msgr2=0x7f99a0137730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:19.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.284+0000 7f999e7fc640 1 --2- 10.20.193.58:0/1239189861 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f99a015b9f0 0x7f99a0137730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:19.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.284+0000 7f999e7fc640 1 -- 10.20.193.58:0/1239189861 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f99a00b6a30 msgr2=0x7f99a01572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:19.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.284+0000 7f999e7fc640 1 --2- 10.20.193.58:0/1239189861 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f99a00b6a30 0x7f99a01572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:19.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.284+0000 7f999e7fc640 1 -- 10.20.193.58:0/1239189861 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9988009570 con 0x7f99a00b6e00 2026-02-23T06:21:19.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.284+0000 7f999e7fc640 1 --2- 10.20.193.58:0/1239189861 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f99a00b6e00 0x7f99a01371f0 secure :-1 s=READY pgs=70 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9988004740 tx=0x7f9988002940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:19.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.284+0000 7f997f7fe640 1 -- 10.20.193.58:0/1239189861 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f998803d070 con 0x7f99a00b6e00 2026-02-23T06:21:19.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.284+0000 7f997f7fe640 1 -- 10.20.193.58:0/1239189861 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9988038690 con 0x7f99a00b6e00 2026-02-23T06:21:19.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.284+0000 7f997f7fe640 1 -- 10.20.193.58:0/1239189861 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9988038aa0 con 0x7f99a00b6e00 2026-02-23T06:21:19.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.284+0000 7f999ffff640 1 -- 10.20.193.58:0/1239189861 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99a005d170 con 0x7f99a00b6e00 2026-02-23T06:21:19.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.285+0000 7f999ffff640 1 -- 10.20.193.58:0/1239189861 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99a005d730 con 0x7f99a00b6e00 2026-02-23T06:21:19.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.285+0000 7f999ffff640 1 -- 10.20.193.58:0/1239189861 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99a005dc10 con 0x7f99a00b6e00 2026-02-23T06:21:19.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.286+0000 7f997f7fe640 1 -- 10.20.193.58:0/1239189861 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f9988038c00 con 0x7f99a00b6e00 2026-02-23T06:21:19.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.287+0000 7f997f7fe640 1 --2- 10.20.193.58:0/1239189861 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f996c07a6c0 0x7f996c09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:19.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.287+0000 7f997f7fe640 1 -- 10.20.193.58:0/1239189861 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5951+0+0 (secure 0 0 0) 0x7f99880c21a0 con 0x7f99a00b6e00 2026-02-23T06:21:19.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.287+0000 7f999effd640 1 --2- 10.20.193.58:0/1239189861 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f996c07a6c0 0x7f996c09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:19.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.288+0000 7f999effd640 1 --2- 10.20.193.58:0/1239189861 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f996c07a6c0 0x7f996c09ab70 secure :-1 s=READY pgs=49 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9994004740 tx=0x7f999400b410 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:19.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.289+0000 7f997f7fe640 1 -- 10.20.193.58:0/1239189861 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f99880856d0 con 0x7f99a00b6e00 2026-02-23T06:21:19.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:19.405+0000 7f999ffff640 1 -- 10.20.193.58:0/1239189861 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f99a005d8c0 con 0x7f99a00b6e00 2026-02-23T06:21:21.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.148+0000 7f997f7fe640 1 -- 10.20.193.58:0/1239189861 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7f99880887f0 con 0x7f99a00b6e00 2026-02-23T06:21:21.143 INFO:teuthology.orchestra.run.trial058.stderr:pool 'cephfs_data_ec' created 2026-02-23T06:21:21.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.151+0000 7f999ffff640 1 -- 10.20.193.58:0/1239189861 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f996c07a6c0 msgr2=0x7f996c09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:21.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.151+0000 7f999ffff640 1 --2- 10.20.193.58:0/1239189861 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f996c07a6c0 0x7f996c09ab70 secure :-1 s=READY pgs=49 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9994004740 tx=0x7f999400b410 comp rx=0 tx=0).stop 2026-02-23T06:21:21.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.151+0000 7f999ffff640 1 -- 10.20.193.58:0/1239189861 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f99a00b6e00 msgr2=0x7f99a01371f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:21.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.151+0000 7f999ffff640 1 --2- 10.20.193.58:0/1239189861 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f99a00b6e00 0x7f99a01371f0 secure :-1 s=READY pgs=70 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9988004740 tx=0x7f9988002940 comp rx=0 tx=0).stop 2026-02-23T06:21:21.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.151+0000 7f999ffff640 1 -- 10.20.193.58:0/1239189861 shutdown_connections 2026-02-23T06:21:21.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.151+0000 7f999ffff640 1 --2- 10.20.193.58:0/1239189861 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f996c07a6c0 0x7f996c09ab70 unknown :-1 s=CLOSED pgs=49 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:21.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.151+0000 7f999ffff640 1 --2- 10.20.193.58:0/1239189861 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f99a015b9f0 0x7f99a0137730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:21.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.151+0000 7f999ffff640 1 --2- 10.20.193.58:0/1239189861 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f99a00b6e00 0x7f99a01371f0 unknown :-1 s=CLOSED pgs=70 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:21.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.151+0000 7f999ffff640 1 --2- 10.20.193.58:0/1239189861 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f99a00b6a30 0x7f99a01572b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:21.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.151+0000 7f999ffff640 1 -- 10.20.193.58:0/1239189861 >> 10.20.193.58:0/1239189861 conn(0x7f99a0054a90 msgr2=0x7f99a00b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:21.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.151+0000 7f999ffff640 1 -- 10.20.193.58:0/1239189861 shutdown_connections 2026-02-23T06:21:21.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.151+0000 7f999ffff640 1 -- 10.20.193.58:0/1239189861 wait complete. 2026-02-23T06:21:21.160 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2026-02-23T06:21:21.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.287+0000 7feb25b44640 1 -- 10.20.193.58:0/1027815410 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feb2005d370 msgr2=0x7feb200b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:21.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.287+0000 7feb25b44640 1 --2- 10.20.193.58:0/1027815410 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feb2005d370 0x7feb200b5680 secure :-1 s=READY pgs=102 gs=3 cs=0 l=1 c_cookie=13805796587773067964 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb2005df80 tx=0x7feb1c030270 comp rx=0 tx=0).stop 2026-02-23T06:21:21.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.287+0000 7feb25b44640 1 -- 10.20.193.58:0/1027815410 shutdown_connections 2026-02-23T06:21:21.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.287+0000 7feb25b44640 1 --2- 10.20.193.58:0/1027815410 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feb2005d370 0x7feb200b5680 unknown :-1 s=CLOSED pgs=102 gs=3 cs=0 l=1 c_cookie=13805796587773067964 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:21.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.287+0000 7feb25b44640 1 --2- 10.20.193.58:0/1027815410 >> v2:10.20.193.58:3300/0 conn(0x7feb20056550 0x7feb2005ce30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:21.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.287+0000 7feb25b44640 1 --2- 10.20.193.58:0/1027815410 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb2015c040 0x7feb2005b0e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:21.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.287+0000 7feb25b44640 1 -- 10.20.193.58:0/1027815410 >> 10.20.193.58:0/1027815410 conn(0x7feb200b3c20 msgr2=0x7feb200b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:21.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.287+0000 7feb25b44640 1 -- 10.20.193.58:0/1027815410 shutdown_connections 2026-02-23T06:21:21.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.287+0000 7feb25b44640 1 -- 10.20.193.58:0/1027815410 wait complete. 2026-02-23T06:21:21.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.288+0000 7feb25b44640 1 Processor -- start 2026-02-23T06:21:21.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.288+0000 7feb25b44640 1 -- start start 2026-02-23T06:21:21.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.289+0000 7feb25b44640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feb20056550 0x7feb20162060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:21.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.289+0000 7feb25b44640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feb2005d370 0x7feb20160040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:21.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.289+0000 7feb25b44640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb2015c040 0x7feb20153dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:21.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.289+0000 7feb25b44640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7feb20162990 con 0x7feb20056550 2026-02-23T06:21:21.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.289+0000 7feb25b44640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7feb201625a0 con 0x7feb2005d370 2026-02-23T06:21:21.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.289+0000 7feb25b44640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7feb20058f00 con 0x7feb2015c040 2026-02-23T06:21:21.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.289+0000 7feb25343640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb2015c040 0x7feb20153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:21.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.289+0000 7feb24b42640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feb20056550 0x7feb20162060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:21.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.289+0000 7feb24b42640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feb20056550 0x7feb20162060 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:47034/0 (socket says 10.20.193.58:47034) 2026-02-23T06:21:21.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.289+0000 7feb25343640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb2015c040 0x7feb20153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:58914/0 (socket says 10.20.193.58:58914) 2026-02-23T06:21:21.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.289+0000 7feb24b42640 1 -- 10.20.193.58:0/969794313 learned_addr learned my addr 10.20.193.58:0/969794313 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:21.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.289+0000 7feb17fff640 1 --2- 10.20.193.58:0/969794313 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feb2005d370 0x7feb20160040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:21.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.289+0000 7feb24b42640 1 -- 10.20.193.58:0/969794313 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb2015c040 msgr2=0x7feb20153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:21.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.289+0000 7feb24b42640 1 --2- 10.20.193.58:0/969794313 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb2015c040 0x7feb20153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:21.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.289+0000 7feb24b42640 1 -- 10.20.193.58:0/969794313 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feb2005d370 msgr2=0x7feb20160040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:21.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.289+0000 7feb24b42640 1 --2- 10.20.193.58:0/969794313 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feb2005d370 0x7feb20160040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:21.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.289+0000 7feb24b42640 1 -- 10.20.193.58:0/969794313 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb080094b0 con 0x7feb20056550 2026-02-23T06:21:21.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.289+0000 7feb24b42640 1 --2- 10.20.193.58:0/969794313 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feb20056550 0x7feb20162060 secure :-1 s=READY pgs=71 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb10004740 tx=0x7feb1000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:21.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.290+0000 7feb157fa640 1 -- 10.20.193.58:0/969794313 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb1000cd40 con 0x7feb20056550 2026-02-23T06:21:21.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.290+0000 7feb157fa640 1 -- 10.20.193.58:0/969794313 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb10004020 con 0x7feb20056550 2026-02-23T06:21:21.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.290+0000 7feb157fa640 1 -- 10.20.193.58:0/969794313 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb10004450 con 0x7feb20056550 2026-02-23T06:21:21.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.290+0000 7feb25b44640 1 -- 10.20.193.58:0/969794313 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb1c00a590 con 0x7feb20056550 2026-02-23T06:21:21.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.290+0000 7feb25b44640 1 -- 10.20.193.58:0/969794313 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb20162be0 con 0x7feb20056550 2026-02-23T06:21:21.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.290+0000 7feb25b44640 1 -- 10.20.193.58:0/969794313 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb2005ce30 con 0x7feb20056550 2026-02-23T06:21:21.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.292+0000 7feb157fa640 1 -- 10.20.193.58:0/969794313 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7feb100036d0 con 0x7feb20056550 2026-02-23T06:21:21.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.293+0000 7feb157fa640 1 --2- 10.20.193.58:0/969794313 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7feaf007a6c0 0x7feaf009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:21.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.293+0000 7feb157fa640 1 -- 10.20.193.58:0/969794313 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6447+0+0 (secure 0 0 0) 0x7feb10014070 con 0x7feb20056550 2026-02-23T06:21:21.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.293+0000 7feb17fff640 1 --2- 10.20.193.58:0/969794313 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7feaf007a6c0 0x7feaf009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:21.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.294+0000 7feb17fff640 1 --2- 10.20.193.58:0/969794313 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7feaf007a6c0 0x7feaf009ab70 secure :-1 s=READY pgs=50 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb20152030 tx=0x7feb08005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:21.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.295+0000 7feb157fa640 1 -- 10.20.193.58:0/969794313 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7feb10060dc0 con 0x7feb20056550 2026-02-23T06:21:21.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:21.406+0000 7feb25b44640 1 -- 10.20.193.58:0/969794313 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7feb20056330 con 0x7feb20056550 2026-02-23T06:21:22.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.153+0000 7feb157fa640 1 -- 10.20.193.58:0/969794313 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7feb10063ee0 con 0x7feb20056550 2026-02-23T06:21:22.148 INFO:teuthology.orchestra.run.trial058.stderr:set pool 4 allow_ec_overwrites to true 2026-02-23T06:21:22.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.156+0000 7feb25b44640 1 -- 10.20.193.58:0/969794313 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7feaf007a6c0 msgr2=0x7feaf009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:22.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.156+0000 7feb25b44640 1 --2- 10.20.193.58:0/969794313 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7feaf007a6c0 0x7feaf009ab70 secure :-1 s=READY pgs=50 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb20152030 tx=0x7feb08005f90 comp rx=0 tx=0).stop 2026-02-23T06:21:22.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.156+0000 7feb25b44640 1 -- 10.20.193.58:0/969794313 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feb20056550 msgr2=0x7feb20162060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:22.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.156+0000 7feb25b44640 1 --2- 10.20.193.58:0/969794313 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feb20056550 0x7feb20162060 secure :-1 s=READY pgs=71 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb10004740 tx=0x7feb1000ee60 comp rx=0 tx=0).stop 2026-02-23T06:21:22.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.156+0000 7feb25b44640 1 -- 10.20.193.58:0/969794313 shutdown_connections 2026-02-23T06:21:22.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.156+0000 7feb25b44640 1 --2- 10.20.193.58:0/969794313 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7feaf007a6c0 0x7feaf009ab70 unknown :-1 s=CLOSED pgs=50 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:22.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.156+0000 7feb25b44640 1 --2- 10.20.193.58:0/969794313 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb2015c040 0x7feb20153dd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:22.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.156+0000 7feb25b44640 1 --2- 10.20.193.58:0/969794313 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feb2005d370 0x7feb20160040 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:22.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.156+0000 7feb25b44640 1 --2- 10.20.193.58:0/969794313 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feb20056550 0x7feb20162060 unknown :-1 s=CLOSED pgs=71 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:22.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.156+0000 7feb25b44640 1 -- 10.20.193.58:0/969794313 >> 10.20.193.58:0/969794313 conn(0x7feb200b3c20 msgr2=0x7feb200b5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:22.152 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.156+0000 7feb25b44640 1 -- 10.20.193.58:0/969794313 shutdown_connections 2026-02-23T06:21:22.152 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.157+0000 7feb25b44640 1 -- 10.20.193.58:0/969794313 wait complete. 2026-02-23T06:21:22.170 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2026-02-23T06:21:22.293 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.297+0000 7fcea59d2640 1 -- 10.20.193.58:0/3429325714 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcea005d370 msgr2=0x7fcea00b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:22.293 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.297+0000 7fcea59d2640 1 --2- 10.20.193.58:0/3429325714 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcea005d370 0x7fcea00b5680 secure :-1 s=READY pgs=54 gs=3 cs=0 l=1 c_cookie=14232119642606528112 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce9c006f50 tx=0x7fce9c030360 comp rx=0 tx=0).stop 2026-02-23T06:21:22.293 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.298+0000 7fcea59d2640 1 -- 10.20.193.58:0/3429325714 shutdown_connections 2026-02-23T06:21:22.293 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.298+0000 7fcea59d2640 1 --2- 10.20.193.58:0/3429325714 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcea005d370 0x7fcea00b5680 unknown :-1 s=CLOSED pgs=54 gs=3 cs=0 l=1 c_cookie=14232119642606528112 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:22.293 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.298+0000 7fcea59d2640 1 --2- 10.20.193.58:0/3429325714 >> v2:10.20.193.93:3300/0 conn(0x7fcea0056550 0x7fcea005ce30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:22.293 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.298+0000 7fcea59d2640 1 -- 10.20.193.58:0/3429325714 >> 10.20.193.58:0/3429325714 conn(0x7fcea00b3c20 msgr2=0x7fcea00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:22.293 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.298+0000 7fcea59d2640 1 -- 10.20.193.58:0/3429325714 shutdown_connections 2026-02-23T06:21:22.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.298+0000 7fcea59d2640 1 -- 10.20.193.58:0/3429325714 wait complete. 2026-02-23T06:21:22.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.299+0000 7fcea59d2640 1 Processor -- start 2026-02-23T06:21:22.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.299+0000 7fcea59d2640 1 -- start start 2026-02-23T06:21:22.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.299+0000 7fcea59d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcea0056550 0x7fcea0058bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:22.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.299+0000 7fcea59d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcea005d370 0x7fcea013a910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:22.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.299+0000 7fcea59d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcea015c040 0x7fcea0136ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:22.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.299+0000 7fcea59d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fcea0135e30 con 0x7fcea005d370 2026-02-23T06:21:22.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.299+0000 7fcea59d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fcea01363f0 con 0x7fcea0056550 2026-02-23T06:21:22.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.299+0000 7fcea59d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fcea00590f0 con 0x7fcea015c040 2026-02-23T06:21:22.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.300+0000 7fce97fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcea005d370 0x7fcea013a910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:22.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.300+0000 7fce97fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcea005d370 0x7fcea013a910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:47040/0 (socket says 10.20.193.58:47040) 2026-02-23T06:21:22.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.300+0000 7fce97fff640 1 -- 10.20.193.58:0/2037956008 learned_addr learned my addr 10.20.193.58:0/2037956008 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:22.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.300+0000 7fcea51d1640 1 --2- 10.20.193.58:0/2037956008 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcea015c040 0x7fcea0136ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:22.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.300+0000 7fcea49d0640 1 --2- 10.20.193.58:0/2037956008 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcea0056550 0x7fcea0058bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:22.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.300+0000 7fce97fff640 1 -- 10.20.193.58:0/2037956008 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcea015c040 msgr2=0x7fcea0136ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:22.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.300+0000 7fce97fff640 1 --2- 10.20.193.58:0/2037956008 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcea015c040 0x7fcea0136ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:22.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.300+0000 7fce97fff640 1 -- 10.20.193.58:0/2037956008 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcea0056550 msgr2=0x7fcea0058bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:22.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.300+0000 7fce97fff640 1 --2- 10.20.193.58:0/2037956008 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcea0056550 0x7fcea0058bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:22.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.300+0000 7fce97fff640 1 -- 10.20.193.58:0/2037956008 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce880094b0 con 0x7fcea005d370 2026-02-23T06:21:22.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.300+0000 7fce97fff640 1 --2- 10.20.193.58:0/2037956008 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcea005d370 0x7fcea013a910 secure :-1 s=READY pgs=72 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce88009fd0 tx=0x7fce88002bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:22.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.300+0000 7fce957fa640 1 -- 10.20.193.58:0/2037956008 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce8800ed60 con 0x7fcea005d370 2026-02-23T06:21:22.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.301+0000 7fcea59d2640 1 -- 10.20.193.58:0/2037956008 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce9c00a650 con 0x7fcea005d370 2026-02-23T06:21:22.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.301+0000 7fce957fa640 1 -- 10.20.193.58:0/2037956008 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce88002e20 con 0x7fcea005d370 2026-02-23T06:21:22.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.301+0000 7fce957fa640 1 -- 10.20.193.58:0/2037956008 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce880106b0 con 0x7fcea005d370 2026-02-23T06:21:22.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.301+0000 7fcea59d2640 1 -- 10.20.193.58:0/2037956008 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcea0164840 con 0x7fcea005d370 2026-02-23T06:21:22.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.301+0000 7fcea59d2640 1 -- 10.20.193.58:0/2037956008 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcea005ce30 con 0x7fcea005d370 2026-02-23T06:21:22.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.302+0000 7fce957fa640 1 -- 10.20.193.58:0/2037956008 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fce88016020 con 0x7fcea005d370 2026-02-23T06:21:22.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.303+0000 7fce957fa640 1 --2- 10.20.193.58:0/2037956008 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fce7007a640 0x7fce7009aaf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:22.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.303+0000 7fce957fa640 1 -- 10.20.193.58:0/2037956008 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6447+0+0 (secure 0 0 0) 0x7fce8809dbb0 con 0x7fcea005d370 2026-02-23T06:21:22.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.303+0000 7fcea49d0640 1 --2- 10.20.193.58:0/2037956008 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fce7007a640 0x7fce7009aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:22.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.304+0000 7fcea49d0640 1 --2- 10.20.193.58:0/2037956008 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fce7007a640 0x7fce7009aaf0 secure :-1 s=READY pgs=51 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce90007fd0 tx=0x7fce90007de0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:22.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.305+0000 7fce957fa640 1 -- 10.20.193.58:0/2037956008 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fce88060f30 con 0x7fcea005d370 2026-02-23T06:21:22.441 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:22.446+0000 7fcea59d2640 1 -- 10.20.193.58:0/2037956008 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fcea0136560 con 0x7fcea005d370 2026-02-23T06:21:23.152 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.157+0000 7fce957fa640 1 -- 10.20.193.58:0/2037956008 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7fcea0136560 con 0x7fcea005d370 2026-02-23T06:21:23.153 INFO:teuthology.orchestra.run.trial058.stderr:added data pool 4 to fsmap 2026-02-23T06:21:23.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.161+0000 7fcea59d2640 1 -- 10.20.193.58:0/2037956008 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fce7007a640 msgr2=0x7fce7009aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:23.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.161+0000 7fcea59d2640 1 --2- 10.20.193.58:0/2037956008 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fce7007a640 0x7fce7009aaf0 secure :-1 s=READY pgs=51 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce90007fd0 tx=0x7fce90007de0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.161+0000 7fcea59d2640 1 -- 10.20.193.58:0/2037956008 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcea005d370 msgr2=0x7fcea013a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:23.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.161+0000 7fcea59d2640 1 --2- 10.20.193.58:0/2037956008 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcea005d370 0x7fcea013a910 secure :-1 s=READY pgs=72 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce88009fd0 tx=0x7fce88002bc0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.161+0000 7fcea59d2640 1 -- 10.20.193.58:0/2037956008 shutdown_connections 2026-02-23T06:21:23.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.161+0000 7fcea59d2640 1 --2- 10.20.193.58:0/2037956008 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fce7007a640 0x7fce7009aaf0 unknown :-1 s=CLOSED pgs=51 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.161+0000 7fcea59d2640 1 --2- 10.20.193.58:0/2037956008 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcea015c040 0x7fcea0136ae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.161+0000 7fcea59d2640 1 --2- 10.20.193.58:0/2037956008 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcea005d370 0x7fcea013a910 unknown :-1 s=CLOSED pgs=72 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.161+0000 7fcea59d2640 1 --2- 10.20.193.58:0/2037956008 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcea0056550 0x7fcea0058bb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.161+0000 7fcea59d2640 1 -- 10.20.193.58:0/2037956008 >> 10.20.193.58:0/2037956008 conn(0x7fcea00b3c20 msgr2=0x7fcea00b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:23.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.161+0000 7fcea59d2640 1 -- 10.20.193.58:0/2037956008 shutdown_connections 2026-02-23T06:21:23.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.161+0000 7fcea59d2640 1 -- 10.20.193.58:0/2037956008 wait complete. 2026-02-23T06:21:23.169 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2026-02-23T06:21:23.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.295+0000 7f791e964640 1 -- 10.20.193.58:0/467708549 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f791815d4a0 msgr2=0x7f79180affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:23.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.295+0000 7f791e964640 1 --2- 10.20.193.58:0/467708549 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f791815d4a0 0x7f79180affb0 secure :-1 s=READY pgs=55 gs=3 cs=0 l=1 c_cookie=266966458701034555 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7908009890 tx=0x7f790802f200 comp rx=0 tx=0).stop 2026-02-23T06:21:23.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.295+0000 7f791e964640 1 -- 10.20.193.58:0/467708549 shutdown_connections 2026-02-23T06:21:23.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.295+0000 7f791e964640 1 --2- 10.20.193.58:0/467708549 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f791815d4a0 0x7f79180affb0 unknown :-1 s=CLOSED pgs=55 gs=3 cs=0 l=1 c_cookie=266966458701034555 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.295+0000 7f791e964640 1 -- 10.20.193.58:0/467708549 >> 10.20.193.58:0/467708549 conn(0x7f79180b3c20 msgr2=0x7f79180b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:23.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.295+0000 7f791e964640 1 -- 10.20.193.58:0/467708549 shutdown_connections 2026-02-23T06:21:23.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.295+0000 7f791e964640 1 -- 10.20.193.58:0/467708549 wait complete. 2026-02-23T06:21:23.293 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.296+0000 7f791e964640 1 Processor -- start 2026-02-23T06:21:23.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.296+0000 7f791e964640 1 -- start start 2026-02-23T06:21:23.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.296+0000 7f791e964640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f79180b6690 0x7f791811e6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:23.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.297+0000 7f791e964640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f791815d4a0 0x7f791811f5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:23.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.297+0000 7f791e964640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f791815d870 0x7f791811fb20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:23.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.297+0000 7f791e964640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f791811f150 con 0x7f79180b6690 2026-02-23T06:21:23.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.297+0000 7f791e964640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f7918162bb0 con 0x7f791815d870 2026-02-23T06:21:23.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.297+0000 7f791e964640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f791813ca10 con 0x7f791815d4a0 2026-02-23T06:21:23.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.297+0000 7f791d962640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f79180b6690 0x7f791811e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:23.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.297+0000 7f791d161640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f791815d4a0 0x7f791811f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:23.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.297+0000 7f791d962640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f79180b6690 0x7f791811e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:47044/0 (socket says 10.20.193.58:47044) 2026-02-23T06:21:23.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.297+0000 7f791d962640 1 -- 10.20.193.58:0/3941520525 learned_addr learned my addr 10.20.193.58:0/3941520525 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:23.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.297+0000 7f791e163640 1 --2- 10.20.193.58:0/3941520525 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f791815d870 0x7f791811fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:23.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.297+0000 7f791d161640 1 -- 10.20.193.58:0/3941520525 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f791815d870 msgr2=0x7f791811fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:23.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.297+0000 7f791d161640 1 --2- 10.20.193.58:0/3941520525 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f791815d870 0x7f791811fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.297+0000 7f791d161640 1 -- 10.20.193.58:0/3941520525 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f79180b6690 msgr2=0x7f791811e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:23.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.297+0000 7f791d161640 1 --2- 10.20.193.58:0/3941520525 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f79180b6690 0x7f791811e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.297+0000 7f791d161640 1 -- 10.20.193.58:0/3941520525 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79080094b0 con 0x7f791815d4a0 2026-02-23T06:21:23.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.297+0000 7f791d962640 1 --2- 10.20.193.58:0/3941520525 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f79180b6690 0x7f791811e6c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:23.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.297+0000 7f791d161640 1 --2- 10.20.193.58:0/3941520525 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f791815d4a0 0x7f791811f5e0 secure :-1 s=READY pgs=56 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f790c007fd0 tx=0x7f790c00c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:23.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.298+0000 7f79067fc640 1 -- 10.20.193.58:0/3941520525 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f790c004250 con 0x7f791815d4a0 2026-02-23T06:21:23.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.298+0000 7f79067fc640 1 -- 10.20.193.58:0/3941520525 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f790c0044a0 con 0x7f791815d4a0 2026-02-23T06:21:23.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.298+0000 7f79067fc640 1 -- 10.20.193.58:0/3941520525 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f790c0038b0 con 0x7f791815d4a0 2026-02-23T06:21:23.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.298+0000 7f791e964640 1 -- 10.20.193.58:0/3941520525 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7918058100 con 0x7f791815d4a0 2026-02-23T06:21:23.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.298+0000 7f791e964640 1 -- 10.20.193.58:0/3941520525 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f791811c360 con 0x7f791815d4a0 2026-02-23T06:21:23.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.298+0000 7f791e964640 1 -- 10.20.193.58:0/3941520525 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f791811f300 con 0x7f791815d4a0 2026-02-23T06:21:23.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.299+0000 7f79067fc640 1 -- 10.20.193.58:0/3941520525 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f790c039b80 con 0x7f791815d4a0 2026-02-23T06:21:23.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.301+0000 7f79067fc640 1 --2- 10.20.193.58:0/3941520525 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f78e807a6b0 0x7f78e809ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:23.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.301+0000 7f79067fc640 1 -- 10.20.193.58:0/3941520525 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f790c09cb40 con 0x7f791815d4a0 2026-02-23T06:21:23.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.301+0000 7f791d962640 1 --2- 10.20.193.58:0/3941520525 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f78e807a6b0 0x7f78e809ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:23.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.301+0000 7f79067fc640 1 -- 10.20.193.58:0/3941520525 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f790c05fe50 con 0x7f791815d4a0 2026-02-23T06:21:23.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.302+0000 7f791d962640 1 --2- 10.20.193.58:0/3941520525 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f78e807a6b0 0x7f78e809ab60 secure :-1 s=READY pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f790802f730 tx=0x7f7908031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:23.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.441+0000 7f791e964640 1 -- 10.20.193.58:0/3941520525 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f791811f2c0 con 0x7f791815d4a0 2026-02-23T06:21:23.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.441+0000 7f79067fc640 1 -- 10.20.193.58:0/3941520525 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6885 (secure 0 0 0) 0x7f790c039e60 con 0x7f791815d4a0 2026-02-23T06:21:23.436 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:23.437 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":6,"btime":"2026-02-23T06:21:23:160057+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4320,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.58:6836/332204623","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6834","nonce":332204623},{"type":"v1","addr":"10.20.193.58:6836","nonce":332204623}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4349,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6839/49797428","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6838","nonce":49797428},{"type":"v1","addr":"10.20.193.93:6839","nonce":49797428}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4355,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.58:6833/363105980","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6832","nonce":363105980},{"type":"v1","addr":"10.20.193.58:6833","nonce":363105980}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4438,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6835/3715244768","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6834","nonce":3715244768},{"type":"v1","addr":"10.20.193.93:6835","nonce":3715244768}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4444,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6837/3986540573","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6836","nonce":3986540573},{"type":"v1","addr":"10.20.193.93:6837","nonce":3986540573}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false,"allow_referent_inodes":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-23T06:21:17.428505+0000","modified":"2026-02-23T06:21:23.155223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4468},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4468":{"gid":4468,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"10.20.193.58:6837/4266460647","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6835","nonce":4266460647},{"type":"v1","addr":"10.20.193.58:6837","nonce":4266460647}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4468,"qdb_cluster":[4468]},"id":1}]} 2026-02-23T06:21:23.438 INFO:teuthology.orchestra.run.trial058.stderr:dumped fsmap epoch 6 2026-02-23T06:21:23.438 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.442+0000 7f791e964640 1 -- 10.20.193.58:0/3941520525 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f78e807a6b0 msgr2=0x7f78e809ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:23.438 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.442+0000 7f791e964640 1 --2- 10.20.193.58:0/3941520525 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f78e807a6b0 0x7f78e809ab60 secure :-1 s=READY pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f790802f730 tx=0x7f7908031040 comp rx=0 tx=0).stop 2026-02-23T06:21:23.438 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.442+0000 7f791e964640 1 -- 10.20.193.58:0/3941520525 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f791815d4a0 msgr2=0x7f791811f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:23.438 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.442+0000 7f791e964640 1 --2- 10.20.193.58:0/3941520525 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f791815d4a0 0x7f791811f5e0 secure :-1 s=READY pgs=56 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f790c007fd0 tx=0x7f790c00c970 comp rx=0 tx=0).stop 2026-02-23T06:21:23.438 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.442+0000 7f791e964640 1 -- 10.20.193.58:0/3941520525 shutdown_connections 2026-02-23T06:21:23.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.442+0000 7f791e964640 1 --2- 10.20.193.58:0/3941520525 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f78e807a6b0 0x7f78e809ab60 unknown :-1 s=CLOSED pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.442+0000 7f791e964640 1 --2- 10.20.193.58:0/3941520525 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f791815d870 0x7f791811fb20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.442+0000 7f791e964640 1 --2- 10.20.193.58:0/3941520525 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f791815d4a0 0x7f791811f5e0 unknown :-1 s=CLOSED pgs=56 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.442+0000 7f791e964640 1 --2- 10.20.193.58:0/3941520525 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f79180b6690 0x7f791811e6c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.442+0000 7f791e964640 1 -- 10.20.193.58:0/3941520525 >> 10.20.193.58:0/3941520525 conn(0x7f79180b3c20 msgr2=0x7f791805d100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:23.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.442+0000 7f791e964640 1 -- 10.20.193.58:0/3941520525 shutdown_connections 2026-02-23T06:21:23.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.442+0000 7f791e964640 1 -- 10.20.193.58:0/3941520525 wait complete. 2026-02-23T06:21:23.449 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-23T06:21:23.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.577+0000 7f12e861b640 1 -- 10.20.193.58:0/2969329556 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f12e00b1170 msgr2=0x7f12e015ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:23.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.577+0000 7f12e861b640 1 --2- 10.20.193.58:0/2969329556 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f12e00b1170 0x7f12e015ce40 secure :-1 s=READY pgs=106 gs=2 cs=0 l=1 c_cookie=6185033731140369497 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12d0004740 tx=0x7f12d002f1e0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.577+0000 7f12e861b640 1 -- 10.20.193.58:0/2969329556 shutdown_connections 2026-02-23T06:21:23.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.577+0000 7f12e861b640 1 --2- 10.20.193.58:0/2969329556 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f12e0163820 0x7f12e015d380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.577+0000 7f12e861b640 1 --2- 10.20.193.58:0/2969329556 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f12e00b1170 0x7f12e015ce40 unknown :-1 s=CLOSED pgs=106 gs=2 cs=0 l=1 c_cookie=6185033731140369497 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.577+0000 7f12e861b640 1 -- 10.20.193.58:0/2969329556 >> 10.20.193.58:0/2969329556 conn(0x7f12e0058e50 msgr2=0x7f12e0059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:23.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.577+0000 7f12e861b640 1 -- 10.20.193.58:0/2969329556 shutdown_connections 2026-02-23T06:21:23.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.577+0000 7f12e861b640 1 -- 10.20.193.58:0/2969329556 wait complete. 2026-02-23T06:21:23.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.578+0000 7f12e861b640 1 Processor -- start 2026-02-23T06:21:23.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.579+0000 7f12e861b640 1 -- start start 2026-02-23T06:21:23.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.579+0000 7f12e861b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f12e00b1170 0x7f12e0132140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:23.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.579+0000 7f12e861b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f12e00b1540 0x7f12e00affe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:23.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.579+0000 7f12e861b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f12e0163820 0x7f12e00b0520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:23.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.579+0000 7f12e861b640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f12e0132680 con 0x7f12e00b1540 2026-02-23T06:21:23.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.579+0000 7f12e861b640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f12e01328f0 con 0x7f12e0163820 2026-02-23T06:21:23.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.579+0000 7f12e861b640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f12e015b450 con 0x7f12e00b1170 2026-02-23T06:21:23.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.579+0000 7f12e5b8f640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f12e00b1540 0x7f12e00affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:23.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.579+0000 7f12e5b8f640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f12e00b1540 0x7f12e00affe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:47054/0 (socket says 10.20.193.58:47054) 2026-02-23T06:21:23.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.579+0000 7f12e5b8f640 1 -- 10.20.193.58:0/1235614213 learned_addr learned my addr 10.20.193.58:0/1235614213 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:23.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.579+0000 7f12e6390640 1 --2- 10.20.193.58:0/1235614213 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f12e00b1170 0x7f12e0132140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:23.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.579+0000 7f12e6b91640 1 --2- 10.20.193.58:0/1235614213 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f12e0163820 0x7f12e00b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:23.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.580+0000 7f12e5b8f640 1 -- 10.20.193.58:0/1235614213 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f12e00b1170 msgr2=0x7f12e0132140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:23.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.580+0000 7f12e5b8f640 1 --2- 10.20.193.58:0/1235614213 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f12e00b1170 0x7f12e0132140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.580+0000 7f12e5b8f640 1 -- 10.20.193.58:0/1235614213 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f12e0163820 msgr2=0x7f12e00b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:23.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.580+0000 7f12e5b8f640 1 --2- 10.20.193.58:0/1235614213 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f12e0163820 0x7f12e00b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.580+0000 7f12e5b8f640 1 -- 10.20.193.58:0/1235614213 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12dc00a590 con 0x7f12e00b1540 2026-02-23T06:21:23.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.580+0000 7f12e5b8f640 1 --2- 10.20.193.58:0/1235614213 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f12e00b1540 0x7f12e00affe0 secure :-1 s=READY pgs=74 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12d400c500 tx=0x7f12d400c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:23.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.580+0000 7f12c6ffd640 1 -- 10.20.193.58:0/1235614213 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f12d4012850 con 0x7f12e00b1540 2026-02-23T06:21:23.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.580+0000 7f12c6ffd640 1 -- 10.20.193.58:0/1235614213 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f12d4012aa0 con 0x7f12e00b1540 2026-02-23T06:21:23.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.580+0000 7f12c6ffd640 1 -- 10.20.193.58:0/1235614213 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f12d4012e90 con 0x7f12e00b1540 2026-02-23T06:21:23.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.580+0000 7f12e861b640 1 -- 10.20.193.58:0/1235614213 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12d00094b0 con 0x7f12e00b1540 2026-02-23T06:21:23.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.580+0000 7f12e861b640 1 -- 10.20.193.58:0/1235614213 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12e0132b40 con 0x7f12e00b1540 2026-02-23T06:21:23.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.581+0000 7f12e861b640 1 -- 10.20.193.58:0/1235614213 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12e015b900 con 0x7f12e00b1540 2026-02-23T06:21:23.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.582+0000 7f12c6ffd640 1 -- 10.20.193.58:0/1235614213 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f12d401c460 con 0x7f12e00b1540 2026-02-23T06:21:23.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.583+0000 7f12c6ffd640 1 --2- 10.20.193.58:0/1235614213 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f12b007a6c0 0x7f12b009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:23.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.583+0000 7f12c6ffd640 1 -- 10.20.193.58:0/1235614213 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f12d409d270 con 0x7f12e00b1540 2026-02-23T06:21:23.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.583+0000 7f12e6390640 1 --2- 10.20.193.58:0/1235614213 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f12b007a6c0 0x7f12b009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:23.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.584+0000 7f12e6390640 1 --2- 10.20.193.58:0/1235614213 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f12b007a6c0 0x7f12b009ab70 secure :-1 s=READY pgs=53 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12d00097e0 tx=0x7f12d0031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:23.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.584+0000 7f12c6ffd640 1 -- 10.20.193.58:0/1235614213 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f12e015b900 con 0x7f12e00b1540 2026-02-23T06:21:23.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.698+0000 7f12e861b640 1 -- 10.20.193.58:0/1235614213 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12e015b900 con 0x7f12e00b1540 2026-02-23T06:21:23.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.699+0000 7f12c6ffd640 1 -- 10.20.193.58:0/1235614213 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18600 (secure 0 0 0) 0x7f12e015b900 con 0x7f12e00b1540 2026-02-23T06:21:23.694 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:23.694 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":25,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","created":"2026-02-23T06:21:02.010508+0000","modified":"2026-02-23T06:21:22.447858+0000","last_up_change":"2026-02-23T06:21:08.383048+0000","last_in_change":"2026-02-23T06:21:04.690899+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-23T06:21:10.389081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-23T06:21:16.080621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-23T06:21:16.401311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-23T06:21:20.153808+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"96cc0898-14bb-4d56-827a-8845bd4307c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6808","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6809","nonce":692913334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6810","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6811","nonce":692913334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6814","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6815","nonce":692913334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6812","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6813","nonce":692913334}]},"public_addr":"10.20.193.58:6809/692913334","cluster_addr":"10.20.193.58:6811/692913334","heartbeat_back_addr":"10.20.193.58:6815/692913334","heartbeat_front_addr":"10.20.193.58:6813/692913334","state":["exists","up"]},{"osd":1,"uuid":"bf665af4-6e3c-4cb3-899c-acede65c31f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6800","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6801","nonce":1850584280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6802","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6803","nonce":1850584280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6806","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6807","nonce":1850584280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6804","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6805","nonce":1850584280}]},"public_addr":"10.20.193.58:6801/1850584280","cluster_addr":"10.20.193.58:6803/1850584280","heartbeat_back_addr":"10.20.193.58:6807/1850584280","heartbeat_front_addr":"10.20.193.58:6805/1850584280","state":["exists","up"]},{"osd":2,"uuid":"2bcb3165-28ad-45d6-9a49-9d9da08501f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6823","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6825","nonce":4284600061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6826","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6827","nonce":4284600061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6830","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6831","nonce":4284600061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6828","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6829","nonce":4284600061}]},"public_addr":"10.20.193.58:6825/4284600061","cluster_addr":"10.20.193.58:6827/4284600061","heartbeat_back_addr":"10.20.193.58:6831/4284600061","heartbeat_front_addr":"10.20.193.58:6829/4284600061","state":["exists","up"]},{"osd":3,"uuid":"4750309a-5bf2-4f48-a550-ca677b0b0f61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6816","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6817","nonce":2858636994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6818","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6819","nonce":2858636994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6822","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6824","nonce":2858636994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6820","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6821","nonce":2858636994}]},"public_addr":"10.20.193.58:6817/2858636994","cluster_addr":"10.20.193.58:6819/2858636994","heartbeat_back_addr":"10.20.193.58:6824/2858636994","heartbeat_front_addr":"10.20.193.58:6821/2858636994","state":["exists","up"]},{"osd":4,"uuid":"5cbb50f2-4e49-46eb-bd84-d92706459d2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6803","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6805","nonce":1874834171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6807","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6809","nonce":1874834171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6816","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6817","nonce":1874834171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6812","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6814","nonce":1874834171}]},"public_addr":"10.20.193.93:6805/1874834171","cluster_addr":"10.20.193.93:6809/1874834171","heartbeat_back_addr":"10.20.193.93:6817/1874834171","heartbeat_front_addr":"10.20.193.93:6814/1874834171","state":["exists","up"]},{"osd":5,"uuid":"2806c775-4720-43a7-ab9f-85a4adb31098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6802","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6804","nonce":356968280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6806","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6808","nonce":356968280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6813","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6815","nonce":356968280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6810","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6811","nonce":356968280}]},"public_addr":"10.20.193.93:6804/356968280","cluster_addr":"10.20.193.93:6808/356968280","heartbeat_back_addr":"10.20.193.93:6815/356968280","heartbeat_front_addr":"10.20.193.93:6811/356968280","state":["exists","up"]},{"osd":6,"uuid":"aa03b46d-d30f-4b09-9251-c9514e8b8b6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6819","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6821","nonce":2948039088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6823","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6825","nonce":2948039088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6831","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6833","nonce":2948039088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6827","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6829","nonce":2948039088}]},"public_addr":"10.20.193.93:6821/2948039088","cluster_addr":"10.20.193.93:6825/2948039088","heartbeat_back_addr":"10.20.193.93:6833/2948039088","heartbeat_front_addr":"10.20.193.93:6829/2948039088","state":["exists","up"]},{"osd":7,"uuid":"b15519bf-2b7b-4fd5-8ef6-e09af0ad9817","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6818","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6820","nonce":2960650087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6822","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6824","nonce":2960650087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6830","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6832","nonce":2960650087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6826","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6828","nonce":2960650087}]},"public_addr":"10.20.193.93:6820/2960650087","cluster_addr":"10.20.193.93:6824/2960650087","heartbeat_back_addr":"10.20.193.93:6832/2960650087","heartbeat_front_addr":"10.20.193.93:6828/2960650087","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.717515+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.744114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.772247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.768341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.521808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.486005+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.480882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.473408+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"2","m":"2","plugin":"isa","technique":"reed_sol_van"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-23T06:21:23.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.700+0000 7f12e861b640 1 -- 10.20.193.58:0/1235614213 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f12b007a6c0 msgr2=0x7f12b009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:23.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.700+0000 7f12e861b640 1 --2- 10.20.193.58:0/1235614213 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f12b007a6c0 0x7f12b009ab70 secure :-1 s=READY pgs=53 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12d00097e0 tx=0x7f12d0031040 comp rx=0 tx=0).stop 2026-02-23T06:21:23.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.700+0000 7f12e861b640 1 -- 10.20.193.58:0/1235614213 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f12e00b1540 msgr2=0x7f12e00affe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:23.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.700+0000 7f12e861b640 1 --2- 10.20.193.58:0/1235614213 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f12e00b1540 0x7f12e00affe0 secure :-1 s=READY pgs=74 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12d400c500 tx=0x7f12d400c9d0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.700+0000 7f12e861b640 1 -- 10.20.193.58:0/1235614213 shutdown_connections 2026-02-23T06:21:23.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.700+0000 7f12e861b640 1 --2- 10.20.193.58:0/1235614213 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f12b007a6c0 0x7f12b009ab70 unknown :-1 s=CLOSED pgs=53 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.700+0000 7f12e861b640 1 --2- 10.20.193.58:0/1235614213 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f12e0163820 0x7f12e00b0520 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.700+0000 7f12e861b640 1 --2- 10.20.193.58:0/1235614213 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f12e00b1540 0x7f12e00affe0 unknown :-1 s=CLOSED pgs=74 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.700+0000 7f12e861b640 1 --2- 10.20.193.58:0/1235614213 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f12e00b1170 0x7f12e0132140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.700+0000 7f12e861b640 1 -- 10.20.193.58:0/1235614213 >> 10.20.193.58:0/1235614213 conn(0x7f12e0058e50 msgr2=0x7f12e00b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:23.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.700+0000 7f12e861b640 1 -- 10.20.193.58:0/1235614213 shutdown_connections 2026-02-23T06:21:23.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.700+0000 7f12e861b640 1 -- 10.20.193.58:0/1235614213 wait complete. 2026-02-23T06:21:23.707 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-23T06:21:23.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.831+0000 7fc2b1a83640 1 -- 10.20.193.58:0/877932810 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc2ac0b5680 msgr2=0x7fc2ac0b5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:23.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.831+0000 7fc2b1a83640 1 --2- 10.20.193.58:0/877932810 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc2ac0b5680 0x7fc2ac0b5b00 secure :-1 s=READY pgs=57 gs=2 cs=0 l=1 c_cookie=13826859048877338914 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2ac0b5010 tx=0x7fc2a8030260 comp rx=0 tx=0).stop 2026-02-23T06:21:23.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.831+0000 7fc2b1a83640 1 -- 10.20.193.58:0/877932810 shutdown_connections 2026-02-23T06:21:23.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.831+0000 7fc2b1a83640 1 --2- 10.20.193.58:0/877932810 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc2ac0b5680 0x7fc2ac0b5b00 unknown :-1 s=CLOSED pgs=57 gs=2 cs=0 l=1 c_cookie=13826859048877338914 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.831+0000 7fc2b1a83640 1 --2- 10.20.193.58:0/877932810 >> v2:10.20.193.93:3300/0 conn(0x7fc2ac15c040 0x7fc2ac05b0e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.831+0000 7fc2b1a83640 1 -- 10.20.193.58:0/877932810 >> 10.20.193.58:0/877932810 conn(0x7fc2ac0b3c20 msgr2=0x7fc2ac0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:23.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.831+0000 7fc2b1a83640 1 -- 10.20.193.58:0/877932810 shutdown_connections 2026-02-23T06:21:23.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.831+0000 7fc2b1a83640 1 -- 10.20.193.58:0/877932810 wait complete. 2026-02-23T06:21:23.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.832+0000 7fc2b1a83640 1 Processor -- start 2026-02-23T06:21:23.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.832+0000 7fc2b1a83640 1 -- start start 2026-02-23T06:21:23.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.833+0000 7fc2b1a83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc2ac056550 0x7fc2ac151950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:23.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.833+0000 7fc2b1a83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc2ac0b5680 0x7fc2ac1550f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:23.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.833+0000 7fc2b1a83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc2ac15c040 0x7fc2ac0585e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:23.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.833+0000 7fc2b1a83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ac1561a0 con 0x7fc2ac15c040 2026-02-23T06:21:23.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.833+0000 7fc2b1a83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ac155cb0 con 0x7fc2ac0b5680 2026-02-23T06:21:23.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.833+0000 7fc2b1a83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc2ac153850 con 0x7fc2ac056550 2026-02-23T06:21:23.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.833+0000 7fc2b1282640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc2ac15c040 0x7fc2ac0585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:23.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.833+0000 7fc2b1282640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc2ac15c040 0x7fc2ac0585e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:47066/0 (socket says 10.20.193.58:47066) 2026-02-23T06:21:23.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.833+0000 7fc2b1282640 1 -- 10.20.193.58:0/546384800 learned_addr learned my addr 10.20.193.58:0/546384800 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:23.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.833+0000 7fc2b0a81640 1 --2- 10.20.193.58:0/546384800 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc2ac056550 0x7fc2ac151950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:23.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.833+0000 7fc2a3fff640 1 --2- 10.20.193.58:0/546384800 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc2ac0b5680 0x7fc2ac1550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:23.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.833+0000 7fc2b1282640 1 -- 10.20.193.58:0/546384800 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc2ac056550 msgr2=0x7fc2ac151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:23.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.833+0000 7fc2b1282640 1 --2- 10.20.193.58:0/546384800 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc2ac056550 0x7fc2ac151950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.833+0000 7fc2b1282640 1 -- 10.20.193.58:0/546384800 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc2ac0b5680 msgr2=0x7fc2ac1550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:23.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.833+0000 7fc2b1282640 1 --2- 10.20.193.58:0/546384800 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc2ac0b5680 0x7fc2ac1550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.833+0000 7fc2b1282640 1 -- 10.20.193.58:0/546384800 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a800a590 con 0x7fc2ac15c040 2026-02-23T06:21:23.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.833+0000 7fc2b1282640 1 --2- 10.20.193.58:0/546384800 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc2ac15c040 0x7fc2ac0585e0 secure :-1 s=READY pgs=76 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2a80039b0 tx=0x7fc2a80039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:23.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.833+0000 7fc2a17fa640 1 -- 10.20.193.58:0/546384800 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc2a803e070 con 0x7fc2ac15c040 2026-02-23T06:21:23.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.833+0000 7fc2a17fa640 1 -- 10.20.193.58:0/546384800 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2a8039470 con 0x7fc2ac15c040 2026-02-23T06:21:23.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.833+0000 7fc2a17fa640 1 -- 10.20.193.58:0/546384800 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc2a8039860 con 0x7fc2ac15c040 2026-02-23T06:21:23.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.833+0000 7fc2b1a83640 1 -- 10.20.193.58:0/546384800 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2ac155ec0 con 0x7fc2ac15c040 2026-02-23T06:21:23.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.834+0000 7fc2b1a83640 1 -- 10.20.193.58:0/546384800 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2ac151e90 con 0x7fc2ac15c040 2026-02-23T06:21:23.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.834+0000 7fc27affd640 1 -- 10.20.193.58:0/546384800 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2ac1fe260 con 0x7fc2ac15c040 2026-02-23T06:21:23.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.835+0000 7fc2a17fa640 1 -- 10.20.193.58:0/546384800 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fc2a8030d20 con 0x7fc2ac15c040 2026-02-23T06:21:23.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.836+0000 7fc2a17fa640 1 --2- 10.20.193.58:0/546384800 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc27c07a6c0 0x7fc27c09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:23.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.836+0000 7fc2a17fa640 1 -- 10.20.193.58:0/546384800 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7fc2a80c3500 con 0x7fc2ac15c040 2026-02-23T06:21:23.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.836+0000 7fc2b0a81640 1 --2- 10.20.193.58:0/546384800 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc27c07a6c0 0x7fc27c09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:23.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.837+0000 7fc2b0a81640 1 --2- 10.20.193.58:0/546384800 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc27c07a6c0 0x7fc27c09ab70 secure :-1 s=READY pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc29c004740 tx=0x7fc29c005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:23.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.839+0000 7fc2a17fa640 1 -- 10.20.193.58:0/546384800 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fc2ac1fe260 con 0x7fc2ac15c040 2026-02-23T06:21:23.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.951+0000 7fc27affd640 1 -- 10.20.193.58:0/546384800 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc2ac1fe260 con 0x7fc2ac15c040 2026-02-23T06:21:23.947 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.952+0000 7fc2a17fa640 1 -- 10.20.193.58:0/546384800 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18600 (secure 0 0 0) 0x7fc2ac1fe260 con 0x7fc2ac15c040 2026-02-23T06:21:23.947 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:23.948 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":25,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","created":"2026-02-23T06:21:02.010508+0000","modified":"2026-02-23T06:21:22.447858+0000","last_up_change":"2026-02-23T06:21:08.383048+0000","last_in_change":"2026-02-23T06:21:04.690899+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-23T06:21:10.389081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-23T06:21:16.080621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-23T06:21:16.401311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-23T06:21:20.153808+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"96cc0898-14bb-4d56-827a-8845bd4307c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6808","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6809","nonce":692913334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6810","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6811","nonce":692913334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6814","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6815","nonce":692913334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6812","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6813","nonce":692913334}]},"public_addr":"10.20.193.58:6809/692913334","cluster_addr":"10.20.193.58:6811/692913334","heartbeat_back_addr":"10.20.193.58:6815/692913334","heartbeat_front_addr":"10.20.193.58:6813/692913334","state":["exists","up"]},{"osd":1,"uuid":"bf665af4-6e3c-4cb3-899c-acede65c31f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6800","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6801","nonce":1850584280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6802","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6803","nonce":1850584280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6806","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6807","nonce":1850584280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6804","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6805","nonce":1850584280}]},"public_addr":"10.20.193.58:6801/1850584280","cluster_addr":"10.20.193.58:6803/1850584280","heartbeat_back_addr":"10.20.193.58:6807/1850584280","heartbeat_front_addr":"10.20.193.58:6805/1850584280","state":["exists","up"]},{"osd":2,"uuid":"2bcb3165-28ad-45d6-9a49-9d9da08501f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6823","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6825","nonce":4284600061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6826","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6827","nonce":4284600061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6830","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6831","nonce":4284600061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6828","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6829","nonce":4284600061}]},"public_addr":"10.20.193.58:6825/4284600061","cluster_addr":"10.20.193.58:6827/4284600061","heartbeat_back_addr":"10.20.193.58:6831/4284600061","heartbeat_front_addr":"10.20.193.58:6829/4284600061","state":["exists","up"]},{"osd":3,"uuid":"4750309a-5bf2-4f48-a550-ca677b0b0f61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6816","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6817","nonce":2858636994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6818","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6819","nonce":2858636994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6822","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6824","nonce":2858636994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6820","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6821","nonce":2858636994}]},"public_addr":"10.20.193.58:6817/2858636994","cluster_addr":"10.20.193.58:6819/2858636994","heartbeat_back_addr":"10.20.193.58:6824/2858636994","heartbeat_front_addr":"10.20.193.58:6821/2858636994","state":["exists","up"]},{"osd":4,"uuid":"5cbb50f2-4e49-46eb-bd84-d92706459d2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6803","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6805","nonce":1874834171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6807","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6809","nonce":1874834171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6816","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6817","nonce":1874834171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6812","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6814","nonce":1874834171}]},"public_addr":"10.20.193.93:6805/1874834171","cluster_addr":"10.20.193.93:6809/1874834171","heartbeat_back_addr":"10.20.193.93:6817/1874834171","heartbeat_front_addr":"10.20.193.93:6814/1874834171","state":["exists","up"]},{"osd":5,"uuid":"2806c775-4720-43a7-ab9f-85a4adb31098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6802","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6804","nonce":356968280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6806","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6808","nonce":356968280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6813","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6815","nonce":356968280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6810","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6811","nonce":356968280}]},"public_addr":"10.20.193.93:6804/356968280","cluster_addr":"10.20.193.93:6808/356968280","heartbeat_back_addr":"10.20.193.93:6815/356968280","heartbeat_front_addr":"10.20.193.93:6811/356968280","state":["exists","up"]},{"osd":6,"uuid":"aa03b46d-d30f-4b09-9251-c9514e8b8b6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6819","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6821","nonce":2948039088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6823","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6825","nonce":2948039088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6831","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6833","nonce":2948039088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6827","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6829","nonce":2948039088}]},"public_addr":"10.20.193.93:6821/2948039088","cluster_addr":"10.20.193.93:6825/2948039088","heartbeat_back_addr":"10.20.193.93:6833/2948039088","heartbeat_front_addr":"10.20.193.93:6829/2948039088","state":["exists","up"]},{"osd":7,"uuid":"b15519bf-2b7b-4fd5-8ef6-e09af0ad9817","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6818","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6820","nonce":2960650087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6822","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6824","nonce":2960650087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6830","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6832","nonce":2960650087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6826","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6828","nonce":2960650087}]},"public_addr":"10.20.193.93:6820/2960650087","cluster_addr":"10.20.193.93:6824/2960650087","heartbeat_back_addr":"10.20.193.93:6832/2960650087","heartbeat_front_addr":"10.20.193.93:6828/2960650087","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.717515+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.744114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.772247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.768341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.521808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.486005+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.480882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.473408+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"2","m":"2","plugin":"isa","technique":"reed_sol_van"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-23T06:21:23.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.953+0000 7fc27affd640 1 -- 10.20.193.58:0/546384800 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc27c07a6c0 msgr2=0x7fc27c09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:23.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.953+0000 7fc27affd640 1 --2- 10.20.193.58:0/546384800 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc27c07a6c0 0x7fc27c09ab70 secure :-1 s=READY pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc29c004740 tx=0x7fc29c005f90 comp rx=0 tx=0).stop 2026-02-23T06:21:23.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.953+0000 7fc27affd640 1 -- 10.20.193.58:0/546384800 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc2ac15c040 msgr2=0x7fc2ac0585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:23.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.953+0000 7fc27affd640 1 --2- 10.20.193.58:0/546384800 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc2ac15c040 0x7fc2ac0585e0 secure :-1 s=READY pgs=76 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2a80039b0 tx=0x7fc2a80039e0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.953+0000 7fc27affd640 1 -- 10.20.193.58:0/546384800 shutdown_connections 2026-02-23T06:21:23.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.953+0000 7fc27affd640 1 --2- 10.20.193.58:0/546384800 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc27c07a6c0 0x7fc27c09ab70 unknown :-1 s=CLOSED pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.953+0000 7fc27affd640 1 --2- 10.20.193.58:0/546384800 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc2ac15c040 0x7fc2ac0585e0 unknown :-1 s=CLOSED pgs=76 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.953+0000 7fc27affd640 1 --2- 10.20.193.58:0/546384800 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc2ac0b5680 0x7fc2ac1550f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.953+0000 7fc27affd640 1 --2- 10.20.193.58:0/546384800 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc2ac056550 0x7fc2ac151950 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:23.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.953+0000 7fc27affd640 1 -- 10.20.193.58:0/546384800 >> 10.20.193.58:0/546384800 conn(0x7fc2ac0b3c20 msgr2=0x7fc2ac1598a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:23.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.953+0000 7fc27affd640 1 -- 10.20.193.58:0/546384800 shutdown_connections 2026-02-23T06:21:23.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:23.953+0000 7fc27affd640 1 -- 10.20.193.58:0/546384800 wait complete. 2026-02-23T06:21:23.996 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2026-02-23T06:21:24.115 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.121+0000 7f9607fff640 1 -- 10.20.193.58:0/503788914 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f95f4003a80 msgr2=0x7f95f4003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:24.115 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.121+0000 7f9607fff640 1 --2- 10.20.193.58:0/503788914 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f95f4003a80 0x7f95f4003e90 secure :-1 s=READY pgs=78 gs=4 cs=0 l=1 c_cookie=10740394192847902417 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95fc00c260 tx=0x7f95fc02f920 comp rx=0 tx=0).stop 2026-02-23T06:21:24.115 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.121+0000 7f96077fe640 1 -- 10.20.193.58:0/503788914 reap_dead start 2026-02-23T06:21:24.116 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.121+0000 7f9607fff640 1 -- 10.20.193.58:0/503788914 shutdown_connections 2026-02-23T06:21:24.116 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.121+0000 7f9607fff640 1 -- 10.20.193.58:0/503788914 >> 10.20.193.58:0/503788914 conn(0x7f96080b3c20 msgr2=0x7f96080b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:24.116 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.121+0000 7f9607fff640 1 -- 10.20.193.58:0/503788914 shutdown_connections 2026-02-23T06:21:24.116 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.121+0000 7f9607fff640 1 -- 10.20.193.58:0/503788914 wait complete. 2026-02-23T06:21:24.116 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.122+0000 7f9607fff640 1 Processor -- start 2026-02-23T06:21:24.117 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.122+0000 7f9607fff640 1 -- start start 2026-02-23T06:21:24.117 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.123+0000 7f9607fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f95f4003a80 0x7f960813f920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:24.117 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.123+0000 7f9607fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9608159060 0x7f96081594b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:24.117 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.123+0000 7f9607fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f96080576c0 0x7f9608057b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:24.117 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.123+0000 7f9607fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f96080570a0 con 0x7f96080576c0 2026-02-23T06:21:24.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.123+0000 7f9607fff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f96080565b0 con 0x7f9608159060 2026-02-23T06:21:24.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.123+0000 7f9607fff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f9608058070 con 0x7f95f4003a80 2026-02-23T06:21:24.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.123+0000 7f96077fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f96080576c0 0x7f9608057b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:24.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.123+0000 7f96077fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f96080576c0 0x7f9608057b30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:47088/0 (socket says 10.20.193.58:47088) 2026-02-23T06:21:24.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.123+0000 7f96077fe640 1 -- 10.20.193.58:0/38984402 learned_addr learned my addr 10.20.193.58:0/38984402 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:24.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.123+0000 7f96067fc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9608159060 0x7f96081594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:24.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.123+0000 7f9606ffd640 1 --2- 10.20.193.58:0/38984402 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f95f4003a80 0x7f960813f920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:24.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.124+0000 7f96077fe640 1 -- 10.20.193.58:0/38984402 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f95f4003a80 msgr2=0x7f960813f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:24.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.124+0000 7f96077fe640 1 --2- 10.20.193.58:0/38984402 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f95f4003a80 0x7f960813f920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:24.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.124+0000 7f96077fe640 1 -- 10.20.193.58:0/38984402 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9608159060 msgr2=0x7f96081594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:24.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.124+0000 7f96077fe640 1 --2- 10.20.193.58:0/38984402 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9608159060 0x7f96081594b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:24.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.124+0000 7f96077fe640 1 -- 10.20.193.58:0/38984402 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96081419f0 con 0x7f96080576c0 2026-02-23T06:21:24.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.124+0000 7f96067fc640 1 --2- 10.20.193.58:0/38984402 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9608159060 0x7f96081594b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:21:24.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.124+0000 7f96077fe640 1 --2- 10.20.193.58:0/38984402 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f96080576c0 0x7f9608057b30 secure :-1 s=READY pgs=79 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95f4004800 tx=0x7f95f800f4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:24.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.124+0000 7f95e77fe640 1 -- 10.20.193.58:0/38984402 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f95f800d070 con 0x7f96080576c0 2026-02-23T06:21:24.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.124+0000 7f95e77fe640 1 -- 10.20.193.58:0/38984402 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95f800faf0 con 0x7f96080576c0 2026-02-23T06:21:24.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.124+0000 7f95e77fe640 1 -- 10.20.193.58:0/38984402 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f95f800fea0 con 0x7f96080576c0 2026-02-23T06:21:24.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.124+0000 7f9607fff640 1 -- 10.20.193.58:0/38984402 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9608141d30 con 0x7f96080576c0 2026-02-23T06:21:24.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.124+0000 7f9607fff640 1 -- 10.20.193.58:0/38984402 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9608056800 con 0x7f96080576c0 2026-02-23T06:21:24.119 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.124+0000 7f9607fff640 1 -- 10.20.193.58:0/38984402 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96080b6d50 con 0x7f96080576c0 2026-02-23T06:21:24.120 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.126+0000 7f95e77fe640 1 -- 10.20.193.58:0/38984402 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f95f801d3b0 con 0x7f96080576c0 2026-02-23T06:21:24.121 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.127+0000 7f95e77fe640 1 --2- 10.20.193.58:0/38984402 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f95d407a6c0 0x7f95d409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:24.121 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.127+0000 7f95e77fe640 1 -- 10.20.193.58:0/38984402 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f95f809cee0 con 0x7f96080576c0 2026-02-23T06:21:24.121 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.127+0000 7f9606ffd640 1 --2- 10.20.193.58:0/38984402 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f95d407a6c0 0x7f95d409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:24.122 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.128+0000 7f9606ffd640 1 --2- 10.20.193.58:0/38984402 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f95d407a6c0 0x7f95d409ab70 secure :-1 s=READY pgs=55 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95fc002b30 tx=0x7f95fc003130 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:24.122 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.128+0000 7f95e77fe640 1 -- 10.20.193.58:0/38984402 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f95f805ffa0 con 0x7f96080576c0 2026-02-23T06:21:24.261 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.267+0000 7f9607fff640 1 -- 10.20.193.58:0/38984402 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96080b06c0 con 0x7f96080576c0 2026-02-23T06:21:24.261 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.267+0000 7f95e77fe640 1 -- 10.20.193.58:0/38984402 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6885 (secure 0 0 0) 0x7f96080b06c0 con 0x7f96080576c0 2026-02-23T06:21:24.262 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:24.262 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":6,"btime":"2026-02-23T06:21:23:160057+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4320,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.58:6836/332204623","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6834","nonce":332204623},{"type":"v1","addr":"10.20.193.58:6836","nonce":332204623}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4349,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6839/49797428","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6838","nonce":49797428},{"type":"v1","addr":"10.20.193.93:6839","nonce":49797428}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4355,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.58:6833/363105980","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6832","nonce":363105980},{"type":"v1","addr":"10.20.193.58:6833","nonce":363105980}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4438,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6835/3715244768","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6834","nonce":3715244768},{"type":"v1","addr":"10.20.193.93:6835","nonce":3715244768}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4444,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6837/3986540573","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6836","nonce":3986540573},{"type":"v1","addr":"10.20.193.93:6837","nonce":3986540573}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false,"allow_referent_inodes":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-23T06:21:17.428505+0000","modified":"2026-02-23T06:21:23.155223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4468},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4468":{"gid":4468,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"10.20.193.58:6837/4266460647","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6835","nonce":4266460647},{"type":"v1","addr":"10.20.193.58:6837","nonce":4266460647}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4468,"qdb_cluster":[4468]},"id":1}]} 2026-02-23T06:21:24.262 INFO:teuthology.orchestra.run.trial058.stderr:dumped fsmap epoch 6 2026-02-23T06:21:24.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.268+0000 7f9607fff640 1 -- 10.20.193.58:0/38984402 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f95d407a6c0 msgr2=0x7f95d409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:24.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.268+0000 7f9607fff640 1 --2- 10.20.193.58:0/38984402 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f95d407a6c0 0x7f95d409ab70 secure :-1 s=READY pgs=55 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95fc002b30 tx=0x7f95fc003130 comp rx=0 tx=0).stop 2026-02-23T06:21:24.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.268+0000 7f9607fff640 1 -- 10.20.193.58:0/38984402 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f96080576c0 msgr2=0x7f9608057b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:24.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.268+0000 7f9607fff640 1 --2- 10.20.193.58:0/38984402 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f96080576c0 0x7f9608057b30 secure :-1 s=READY pgs=79 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95f4004800 tx=0x7f95f800f4f0 comp rx=0 tx=0).stop 2026-02-23T06:21:24.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.269+0000 7f9607fff640 1 -- 10.20.193.58:0/38984402 shutdown_connections 2026-02-23T06:21:24.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.269+0000 7f9607fff640 1 --2- 10.20.193.58:0/38984402 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f95d407a6c0 0x7f95d409ab70 unknown :-1 s=CLOSED pgs=55 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:24.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.269+0000 7f9607fff640 1 --2- 10.20.193.58:0/38984402 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f96080576c0 0x7f9608057b30 unknown :-1 s=CLOSED pgs=79 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:24.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.269+0000 7f9607fff640 1 --2- 10.20.193.58:0/38984402 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9608159060 0x7f96081594b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:24.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.269+0000 7f9607fff640 1 --2- 10.20.193.58:0/38984402 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f95f4003a80 0x7f960813f920 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:24.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.269+0000 7f9607fff640 1 -- 10.20.193.58:0/38984402 >> 10.20.193.58:0/38984402 conn(0x7f96080b3c20 msgr2=0x7f960805c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:24.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.269+0000 7f9607fff640 1 -- 10.20.193.58:0/38984402 shutdown_connections 2026-02-23T06:21:24.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.269+0000 7f9607fff640 1 -- 10.20.193.58:0/38984402 wait complete. 2026-02-23T06:21:24.275 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-23T06:21:24.397 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.402+0000 7fb3c3203640 1 -- 10.20.193.58:0/2231590616 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3bc056960 msgr2=0x7fb3bc0b6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:24.397 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.402+0000 7fb3c3203640 1 --2- 10.20.193.58:0/2231590616 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3bc056960 0x7fb3bc0b6720 secure :-1 s=READY pgs=81 gs=3 cs=0 l=1 c_cookie=14151758936542582573 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3b0004740 tx=0x7fb3b002f1e0 comp rx=0 tx=0).stop 2026-02-23T06:21:24.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.402+0000 7fb3c3203640 1 -- 10.20.193.58:0/2231590616 shutdown_connections 2026-02-23T06:21:24.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.402+0000 7fb3c3203640 1 --2- 10.20.193.58:0/2231590616 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3bc056960 0x7fb3bc0b6720 unknown :-1 s=CLOSED pgs=81 gs=3 cs=0 l=1 c_cookie=14151758936542582573 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:24.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.402+0000 7fb3c3203640 1 --2- 10.20.193.58:0/2231590616 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3bc15c4b0 0x7fb3bc058200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:24.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.402+0000 7fb3c3203640 1 -- 10.20.193.58:0/2231590616 >> 10.20.193.58:0/2231590616 conn(0x7fb3bc0b3c20 msgr2=0x7fb3bc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:24.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.402+0000 7fb3c3203640 1 -- 10.20.193.58:0/2231590616 shutdown_connections 2026-02-23T06:21:24.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.402+0000 7fb3c3203640 1 -- 10.20.193.58:0/2231590616 wait complete. 2026-02-23T06:21:24.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.403+0000 7fb3c3203640 1 Processor -- start 2026-02-23T06:21:24.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.403+0000 7fb3c3203640 1 -- start start 2026-02-23T06:21:24.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.404+0000 7fb3c3203640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3bc056960 0x7fb3bc164690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:24.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.404+0000 7fb3c3203640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3bc15c4b0 0x7fb3bc0b6b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:24.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.404+0000 7fb3c3203640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3bc162ca0 0x7fb3bc1202b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:24.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.404+0000 7fb3c3203640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb3bc160570 con 0x7fb3bc056960 2026-02-23T06:21:24.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.404+0000 7fb3c3203640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb3bc164200 con 0x7fb3bc15c4b0 2026-02-23T06:21:24.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.404+0000 7fb3c3203640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb3bc0b02d0 con 0x7fb3bc162ca0 2026-02-23T06:21:24.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.404+0000 7fb3c2201640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3bc056960 0x7fb3bc164690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:24.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.404+0000 7fb3c2a02640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3bc162ca0 0x7fb3bc1202b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:24.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.404+0000 7fb3c2a02640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3bc162ca0 0x7fb3bc1202b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:58994/0 (socket says 10.20.193.58:58994) 2026-02-23T06:21:24.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.404+0000 7fb3c2a02640 1 -- 10.20.193.58:0/307684387 learned_addr learned my addr 10.20.193.58:0/307684387 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:24.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.404+0000 7fb3c1a00640 1 --2- 10.20.193.58:0/307684387 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3bc15c4b0 0x7fb3bc0b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:24.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.404+0000 7fb3c2201640 1 -- 10.20.193.58:0/307684387 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3bc162ca0 msgr2=0x7fb3bc1202b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:24.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.404+0000 7fb3c2201640 1 --2- 10.20.193.58:0/307684387 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3bc162ca0 0x7fb3bc1202b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:24.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.404+0000 7fb3c2201640 1 -- 10.20.193.58:0/307684387 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3bc15c4b0 msgr2=0x7fb3bc0b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:24.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.404+0000 7fb3c2201640 1 --2- 10.20.193.58:0/307684387 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3bc15c4b0 0x7fb3bc0b6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:24.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.404+0000 7fb3c2201640 1 -- 10.20.193.58:0/307684387 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b00094b0 con 0x7fb3bc056960 2026-02-23T06:21:24.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.405+0000 7fb3c2201640 1 --2- 10.20.193.58:0/307684387 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3bc056960 0x7fb3bc164690 secure :-1 s=READY pgs=82 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3ac00e9c0 tx=0x7fb3ac00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:24.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.405+0000 7fb3a2ffd640 1 -- 10.20.193.58:0/307684387 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3ac00cd70 con 0x7fb3bc056960 2026-02-23T06:21:24.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.405+0000 7fb3a2ffd640 1 -- 10.20.193.58:0/307684387 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3ac004850 con 0x7fb3bc056960 2026-02-23T06:21:24.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.405+0000 7fb3a2ffd640 1 -- 10.20.193.58:0/307684387 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3ac004c80 con 0x7fb3bc056960 2026-02-23T06:21:24.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.405+0000 7fb3c3203640 1 -- 10.20.193.58:0/307684387 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3bc1638f0 con 0x7fb3bc056960 2026-02-23T06:21:24.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.405+0000 7fb3c3203640 1 -- 10.20.193.58:0/307684387 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3bc1650a0 con 0x7fb3bc056960 2026-02-23T06:21:24.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.406+0000 7fb3c3203640 1 -- 10.20.193.58:0/307684387 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3bc1214f0 con 0x7fb3bc056960 2026-02-23T06:21:24.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.406+0000 7fb3a2ffd640 1 -- 10.20.193.58:0/307684387 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fb3ac01f060 con 0x7fb3bc056960 2026-02-23T06:21:24.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.407+0000 7fb3a2ffd640 1 --2- 10.20.193.58:0/307684387 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb38c07a6c0 0x7fb38c09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:24.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.407+0000 7fb3a2ffd640 1 -- 10.20.193.58:0/307684387 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7fb3ac014070 con 0x7fb3bc056960 2026-02-23T06:21:24.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.408+0000 7fb3c1a00640 1 --2- 10.20.193.58:0/307684387 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb38c07a6c0 0x7fb38c09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:24.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.408+0000 7fb3c1a00640 1 --2- 10.20.193.58:0/307684387 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb38c07a6c0 0x7fb38c09ab70 secure :-1 s=READY pgs=56 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3b0004740 tx=0x7fb3b0031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:24.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.409+0000 7fb3a2ffd640 1 -- 10.20.193.58:0/307684387 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fb3ac060d10 con 0x7fb3bc056960 2026-02-23T06:21:24.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.523+0000 7fb3c3203640 1 -- 10.20.193.58:0/307684387 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb3bc061d30 con 0x7fb3bc056960 2026-02-23T06:21:24.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.524+0000 7fb3a2ffd640 1 -- 10.20.193.58:0/307684387 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18600 (secure 0 0 0) 0x7fb3ac063e30 con 0x7fb3bc056960 2026-02-23T06:21:24.519 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:24.519 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":25,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","created":"2026-02-23T06:21:02.010508+0000","modified":"2026-02-23T06:21:22.447858+0000","last_up_change":"2026-02-23T06:21:08.383048+0000","last_in_change":"2026-02-23T06:21:04.690899+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-23T06:21:10.389081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-23T06:21:16.080621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-23T06:21:16.401311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-23T06:21:20.153808+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"96cc0898-14bb-4d56-827a-8845bd4307c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6808","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6809","nonce":692913334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6810","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6811","nonce":692913334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6814","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6815","nonce":692913334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6812","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6813","nonce":692913334}]},"public_addr":"10.20.193.58:6809/692913334","cluster_addr":"10.20.193.58:6811/692913334","heartbeat_back_addr":"10.20.193.58:6815/692913334","heartbeat_front_addr":"10.20.193.58:6813/692913334","state":["exists","up"]},{"osd":1,"uuid":"bf665af4-6e3c-4cb3-899c-acede65c31f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6800","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6801","nonce":1850584280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6802","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6803","nonce":1850584280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6806","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6807","nonce":1850584280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6804","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6805","nonce":1850584280}]},"public_addr":"10.20.193.58:6801/1850584280","cluster_addr":"10.20.193.58:6803/1850584280","heartbeat_back_addr":"10.20.193.58:6807/1850584280","heartbeat_front_addr":"10.20.193.58:6805/1850584280","state":["exists","up"]},{"osd":2,"uuid":"2bcb3165-28ad-45d6-9a49-9d9da08501f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6823","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6825","nonce":4284600061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6826","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6827","nonce":4284600061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6830","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6831","nonce":4284600061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6828","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6829","nonce":4284600061}]},"public_addr":"10.20.193.58:6825/4284600061","cluster_addr":"10.20.193.58:6827/4284600061","heartbeat_back_addr":"10.20.193.58:6831/4284600061","heartbeat_front_addr":"10.20.193.58:6829/4284600061","state":["exists","up"]},{"osd":3,"uuid":"4750309a-5bf2-4f48-a550-ca677b0b0f61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6816","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6817","nonce":2858636994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6818","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6819","nonce":2858636994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6822","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6824","nonce":2858636994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6820","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6821","nonce":2858636994}]},"public_addr":"10.20.193.58:6817/2858636994","cluster_addr":"10.20.193.58:6819/2858636994","heartbeat_back_addr":"10.20.193.58:6824/2858636994","heartbeat_front_addr":"10.20.193.58:6821/2858636994","state":["exists","up"]},{"osd":4,"uuid":"5cbb50f2-4e49-46eb-bd84-d92706459d2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6803","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6805","nonce":1874834171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6807","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6809","nonce":1874834171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6816","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6817","nonce":1874834171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6812","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6814","nonce":1874834171}]},"public_addr":"10.20.193.93:6805/1874834171","cluster_addr":"10.20.193.93:6809/1874834171","heartbeat_back_addr":"10.20.193.93:6817/1874834171","heartbeat_front_addr":"10.20.193.93:6814/1874834171","state":["exists","up"]},{"osd":5,"uuid":"2806c775-4720-43a7-ab9f-85a4adb31098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6802","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6804","nonce":356968280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6806","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6808","nonce":356968280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6813","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6815","nonce":356968280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6810","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6811","nonce":356968280}]},"public_addr":"10.20.193.93:6804/356968280","cluster_addr":"10.20.193.93:6808/356968280","heartbeat_back_addr":"10.20.193.93:6815/356968280","heartbeat_front_addr":"10.20.193.93:6811/356968280","state":["exists","up"]},{"osd":6,"uuid":"aa03b46d-d30f-4b09-9251-c9514e8b8b6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6819","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6821","nonce":2948039088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6823","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6825","nonce":2948039088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6831","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6833","nonce":2948039088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6827","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6829","nonce":2948039088}]},"public_addr":"10.20.193.93:6821/2948039088","cluster_addr":"10.20.193.93:6825/2948039088","heartbeat_back_addr":"10.20.193.93:6833/2948039088","heartbeat_front_addr":"10.20.193.93:6829/2948039088","state":["exists","up"]},{"osd":7,"uuid":"b15519bf-2b7b-4fd5-8ef6-e09af0ad9817","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6818","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6820","nonce":2960650087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6822","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6824","nonce":2960650087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6830","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6832","nonce":2960650087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6826","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6828","nonce":2960650087}]},"public_addr":"10.20.193.93:6820/2960650087","cluster_addr":"10.20.193.93:6824/2960650087","heartbeat_back_addr":"10.20.193.93:6832/2960650087","heartbeat_front_addr":"10.20.193.93:6828/2960650087","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.717515+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.744114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.772247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.768341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.521808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.486005+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.480882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.473408+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"2","m":"2","plugin":"isa","technique":"reed_sol_van"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-23T06:21:24.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.525+0000 7fb3c3203640 1 -- 10.20.193.58:0/307684387 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb38c07a6c0 msgr2=0x7fb38c09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:24.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.525+0000 7fb3c3203640 1 --2- 10.20.193.58:0/307684387 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb38c07a6c0 0x7fb38c09ab70 secure :-1 s=READY pgs=56 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3b0004740 tx=0x7fb3b0031040 comp rx=0 tx=0).stop 2026-02-23T06:21:24.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.525+0000 7fb3c3203640 1 -- 10.20.193.58:0/307684387 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3bc056960 msgr2=0x7fb3bc164690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:24.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.525+0000 7fb3c3203640 1 --2- 10.20.193.58:0/307684387 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3bc056960 0x7fb3bc164690 secure :-1 s=READY pgs=82 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3ac00e9c0 tx=0x7fb3ac00ee90 comp rx=0 tx=0).stop 2026-02-23T06:21:24.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.525+0000 7fb3c3203640 1 -- 10.20.193.58:0/307684387 shutdown_connections 2026-02-23T06:21:24.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.525+0000 7fb3c3203640 1 --2- 10.20.193.58:0/307684387 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb38c07a6c0 0x7fb38c09ab70 unknown :-1 s=CLOSED pgs=56 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:24.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.525+0000 7fb3c3203640 1 --2- 10.20.193.58:0/307684387 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3bc162ca0 0x7fb3bc1202b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:24.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.525+0000 7fb3c3203640 1 --2- 10.20.193.58:0/307684387 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3bc15c4b0 0x7fb3bc0b6b30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:24.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.525+0000 7fb3c3203640 1 --2- 10.20.193.58:0/307684387 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3bc056960 0x7fb3bc164690 unknown :-1 s=CLOSED pgs=82 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:24.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.525+0000 7fb3c3203640 1 -- 10.20.193.58:0/307684387 >> 10.20.193.58:0/307684387 conn(0x7fb3bc0b3c20 msgr2=0x7fb3bc165670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:24.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.525+0000 7fb3c3203640 1 -- 10.20.193.58:0/307684387 shutdown_connections 2026-02-23T06:21:24.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:24.525+0000 7fb3c3203640 1 -- 10.20.193.58:0/307684387 wait complete. 2026-02-23T06:21:25.136 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False, 'allow_referent_inodes': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2026-02-23T06:21:17.428505+0000', 'modified': '2026-02-23T06:21:23.155223+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4468}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4468': {'gid': 4468, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '10.20.193.58:6837/4266460647', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.58:6835', 'nonce': 4266460647}, {'type': 'v1', 'addr': '10.20.193.58:6837', 'nonce': 4266460647}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4468, 'qdb_cluster': [4468]} 2026-02-23T06:21:25.137 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2026-02-23T06:21:25.137 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2026-02-23T06:21:25.259 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.264+0000 7f0b3c85a640 1 -- 10.20.193.58:0/3818095086 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b3815d4a0 msgr2=0x7f0b380affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:25.259 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.264+0000 7f0b3c85a640 1 --2- 10.20.193.58:0/3818095086 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b3815d4a0 0x7f0b380affb0 secure :-1 s=READY pgs=84 gs=3 cs=0 l=1 c_cookie=2639360703453590620 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b2c005e70 tx=0x7f0b2c02f2e0 comp rx=0 tx=0).stop 2026-02-23T06:21:25.259 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.264+0000 7f0b3c85a640 1 -- 10.20.193.58:0/3818095086 shutdown_connections 2026-02-23T06:21:25.259 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.264+0000 7f0b3c85a640 1 --2- 10.20.193.58:0/3818095086 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b3815d4a0 0x7f0b380affb0 unknown :-1 s=CLOSED pgs=84 gs=3 cs=0 l=1 c_cookie=2639360703453590620 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:25.260 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.264+0000 7f0b3c85a640 1 -- 10.20.193.58:0/3818095086 >> 10.20.193.58:0/3818095086 conn(0x7f0b380b3c20 msgr2=0x7f0b380b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:25.260 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.264+0000 7f0b3c85a640 1 -- 10.20.193.58:0/3818095086 shutdown_connections 2026-02-23T06:21:25.260 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.264+0000 7f0b3c85a640 1 -- 10.20.193.58:0/3818095086 wait complete. 2026-02-23T06:21:25.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.265+0000 7f0b3c85a640 1 Processor -- start 2026-02-23T06:21:25.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.265+0000 7f0b3c85a640 1 -- start start 2026-02-23T06:21:25.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.266+0000 7f0b3c85a640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0b380b6690 0x7f0b38160120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:25.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.266+0000 7f0b3c85a640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b3815d4a0 0x7f0b3813d580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:25.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.266+0000 7f0b3c85a640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b3815d870 0x7f0b38140a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:25.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.266+0000 7f0b3c85a640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f0b38161660 con 0x7f0b3815d870 2026-02-23T06:21:25.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.266+0000 7f0b3c85a640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f0b38141910 con 0x7f0b380b6690 2026-02-23T06:21:25.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.266+0000 7f0b3c85a640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f0b38057e80 con 0x7f0b3815d4a0 2026-02-23T06:21:25.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.266+0000 7f0b36d76640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0b380b6690 0x7f0b38160120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:25.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.266+0000 7f0b36575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b3815d4a0 0x7f0b3813d580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:25.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.266+0000 7f0b36d76640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0b380b6690 0x7f0b38160120 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:55442/0 (socket says 10.20.193.58:55442) 2026-02-23T06:21:25.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.266+0000 7f0b36d76640 1 -- 10.20.193.58:0/776287718 learned_addr learned my addr 10.20.193.58:0/776287718 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:25.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.266+0000 7f0b37577640 1 --2- 10.20.193.58:0/776287718 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b3815d870 0x7f0b38140a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:25.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.267+0000 7f0b36d76640 1 -- 10.20.193.58:0/776287718 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b3815d4a0 msgr2=0x7f0b3813d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:25.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.267+0000 7f0b36d76640 1 --2- 10.20.193.58:0/776287718 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b3815d4a0 0x7f0b3813d580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:25.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.267+0000 7f0b36d76640 1 -- 10.20.193.58:0/776287718 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b3815d870 msgr2=0x7f0b38140a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:25.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.267+0000 7f0b36d76640 1 --2- 10.20.193.58:0/776287718 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b3815d870 0x7f0b38140a50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:25.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.267+0000 7f0b36d76640 1 -- 10.20.193.58:0/776287718 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b2c009570 con 0x7f0b380b6690 2026-02-23T06:21:25.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.267+0000 7f0b36d76640 1 --2- 10.20.193.58:0/776287718 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0b380b6690 0x7f0b38160120 secure :-1 s=READY pgs=109 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b2c0098a0 tx=0x7f0b2c002a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:25.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.267+0000 7f0b177fe640 1 -- 10.20.193.58:0/776287718 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b2c03d070 con 0x7f0b380b6690 2026-02-23T06:21:25.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.267+0000 7f0b177fe640 1 -- 10.20.193.58:0/776287718 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b2c038690 con 0x7f0b380b6690 2026-02-23T06:21:25.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.267+0000 7f0b177fe640 1 -- 10.20.193.58:0/776287718 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b2c038aa0 con 0x7f0b380b6690 2026-02-23T06:21:25.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.267+0000 7f0b3c85a640 1 -- 10.20.193.58:0/776287718 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b38058160 con 0x7f0b380b6690 2026-02-23T06:21:25.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.267+0000 7f0b3c85a640 1 -- 10.20.193.58:0/776287718 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b38160660 con 0x7f0b380b6690 2026-02-23T06:21:25.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.269+0000 7f0b177fe640 1 -- 10.20.193.58:0/776287718 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f0b2c048060 con 0x7f0b380b6690 2026-02-23T06:21:25.265 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.270+0000 7f0b177fe640 1 --2- 10.20.193.58:0/776287718 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0b0407a6c0 0x7f0b0409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:25.265 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.270+0000 7f0b177fe640 1 -- 10.20.193.58:0/776287718 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f0b2c0c1eb0 con 0x7f0b380b6690 2026-02-23T06:21:25.265 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.271+0000 7f0b36575640 1 --2- 10.20.193.58:0/776287718 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0b0407a6c0 0x7f0b0409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:25.265 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.271+0000 7f0b36575640 1 --2- 10.20.193.58:0/776287718 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0b0407a6c0 0x7f0b0409ab70 secure :-1 s=READY pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b3813bca0 tx=0x7f0b20007ee0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:25.267 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.272+0000 7f0b3f650e00 1 Processor -- start 2026-02-23T06:21:25.267 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.272+0000 7f0b3f650e00 1 -- start start 2026-02-23T06:21:25.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.273+0000 7f0b3f650e00 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x559af2293880 0x559af22984f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:25.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.273+0000 7f0b3f650e00 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x559af2294540 0x559af2296ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:25.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.273+0000 7f0b3f650e00 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x559af22993e0 0x559af2297010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:25.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.273+0000 7f0b3f650e00 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x559af21890d0 con 0x559af22993e0 2026-02-23T06:21:25.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.273+0000 7f0b3f650e00 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x559af2184e00 con 0x559af2293880 2026-02-23T06:21:25.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.273+0000 7f0b3f650e00 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x559af217ef60 con 0x559af2294540 2026-02-23T06:21:25.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.273+0000 7f0b36575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x559af2294540 0x559af2296ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:25.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.273+0000 7f0b37577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x559af22993e0 0x559af2297010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:25.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.273+0000 7f0b36d76640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x559af2293880 0x559af22984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:25.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.273+0000 7f0b36d76640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x559af2293880 0x559af22984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:55452/0 (socket says 10.20.193.58:55452) 2026-02-23T06:21:25.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.273+0000 7f0b36d76640 1 -- 10.20.193.58:0/174250341 learned_addr learned my addr 10.20.193.58:0/174250341 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:25.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.273+0000 7f0b37577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x559af22993e0 0x559af2297010 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:47122/0 (socket says 10.20.193.58:47122) 2026-02-23T06:21:25.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.274+0000 7f0b37577640 1 -- 10.20.193.58:0/174250341 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x559af2294540 msgr2=0x559af2296ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-23T06:21:25.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.274+0000 7f0b37577640 1 --2- 10.20.193.58:0/174250341 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x559af2294540 0x559af2296ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:25.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.274+0000 7f0b37577640 1 -- 10.20.193.58:0/174250341 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x559af2293880 msgr2=0x559af22984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-23T06:21:25.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.274+0000 7f0b37577640 1 --2- 10.20.193.58:0/174250341 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x559af2293880 0x559af22984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:25.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.274+0000 7f0b37577640 1 -- 10.20.193.58:0/174250341 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559af212a2a0 con 0x559af22993e0 2026-02-23T06:21:25.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.274+0000 7f0b37577640 1 --2- 10.20.193.58:0/174250341 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x559af22993e0 0x559af2297010 secure :-1 s=READY pgs=85 gs=2 cs=0 l=1 c_cookie=15712650839534759086 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b28003810 tx=0x7f0b280064f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da0e8cb07a366cae server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:25.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.274+0000 7f0b14bfe640 1 -- 10.20.193.58:0/174250341 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b28019070 con 0x559af22993e0 2026-02-23T06:21:25.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.274+0000 7f0b14bfe640 1 -- 10.20.193.58:0/174250341 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b28007c80 con 0x559af22993e0 2026-02-23T06:21:25.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.274+0000 7f0b14bfe640 1 -- 10.20.193.58:0/174250341 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b2800fbd0 con 0x559af22993e0 2026-02-23T06:21:25.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.274+0000 7f0b3f650e00 1 -- 10.20.193.58:0/174250341 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x559af22993e0 msgr2=0x559af2297010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:25.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.274+0000 7f0b3f650e00 1 --2- 10.20.193.58:0/174250341 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x559af22993e0 0x559af2297010 secure :-1 s=READY pgs=85 gs=2 cs=0 l=1 c_cookie=15712650839534759086 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b28003810 tx=0x7f0b280064f0 comp rx=0 tx=0).stop 2026-02-23T06:21:25.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.274+0000 7f0b3f650e00 1 -- 10.20.193.58:0/174250341 shutdown_connections 2026-02-23T06:21:25.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.274+0000 7f0b3f650e00 1 --2- 10.20.193.58:0/174250341 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x559af22993e0 0x559af2297010 unknown :-1 s=CLOSED pgs=85 gs=2 cs=0 l=1 c_cookie=15712650839534759086 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:25.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.274+0000 7f0b3f650e00 1 --2- 10.20.193.58:0/174250341 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x559af2294540 0x559af2296ad0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:25.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.274+0000 7f0b3f650e00 1 --2- 10.20.193.58:0/174250341 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x559af2293880 0x559af22984f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:25.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.274+0000 7f0b3f650e00 1 -- 10.20.193.58:0/174250341 >> 10.20.193.58:0/174250341 conn(0x559af2192a60 msgr2=0x559af2298cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:25.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.274+0000 7f0b3f650e00 1 -- 10.20.193.58:0/174250341 shutdown_connections 2026-02-23T06:21:25.272 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.274+0000 7f0b3f650e00 1 -- 10.20.193.58:0/174250341 wait complete. 2026-02-23T06:21:25.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.291+0000 7f0b3f650e00 1 -- start start 2026-02-23T06:21:25.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.292+0000 7f0b3f650e00 1 Processor -- start 2026-02-23T06:21:25.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.292+0000 7f0b3f650e00 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x559af2293880 0x559af227f7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:25.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.292+0000 7f0b3f650e00 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x559af2294540 0x559af2280ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:25.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.292+0000 7f0b3f650e00 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x559af22993e0 0x559af2280ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:25.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.292+0000 7f0b3f650e00 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x559af2281d90 con 0x559af2293880 2026-02-23T06:21:25.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.292+0000 7f0b3f650e00 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x559af2282070 con 0x559af22993e0 2026-02-23T06:21:25.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.292+0000 7f0b3f650e00 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x559af2282350 con 0x559af2294540 2026-02-23T06:21:25.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.292+0000 7f0b37577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x559af22993e0 0x559af2280ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:25.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.292+0000 7f0b36d76640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x559af2293880 0x559af227f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:25.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.292+0000 7f0b37577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x559af22993e0 0x559af2280ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:55454/0 (socket says 10.20.193.58:55454) 2026-02-23T06:21:25.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.292+0000 7f0b37577640 1 -- 10.20.193.58:0/544282971 learned_addr learned my addr 10.20.193.58:0/544282971 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:25.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.292+0000 7f0b36575640 1 --2- 10.20.193.58:0/544282971 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x559af2294540 0x559af2280ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:25.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.293+0000 7f0b37577640 1 -- 10.20.193.58:0/544282971 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x559af2294540 msgr2=0x559af2280ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-23T06:21:25.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.293+0000 7f0b37577640 1 --2- 10.20.193.58:0/544282971 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x559af2294540 0x559af2280ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:25.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.293+0000 7f0b37577640 1 -- 10.20.193.58:0/544282971 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x559af2293880 msgr2=0x559af227f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-23T06:21:25.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.293+0000 7f0b37577640 1 --2- 10.20.193.58:0/544282971 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x559af2293880 0x559af227f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:25.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.293+0000 7f0b37577640 1 -- 10.20.193.58:0/544282971 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559af2102290 con 0x559af22993e0 2026-02-23T06:21:25.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.293+0000 7f0b36d76640 1 --2- 10.20.193.58:0/544282971 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x559af2293880 0x559af227f7d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:25.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.293+0000 7f0b37577640 1 --2- 10.20.193.58:0/544282971 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x559af22993e0 0x559af2280ff0 secure :-1 s=READY pgs=110 gs=2 cs=0 l=1 c_cookie=5243723969982602412 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b2800f970 tx=0x7f0b2800f9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48c5732b13039cac server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:25.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.293+0000 7f0ae3fff640 10 client.0 ms_handle_connect on v2:10.20.193.93:3300/0 2026-02-23T06:21:25.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.293+0000 7f0ae3fff640 1 -- 10.20.193.58:0/544282971 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b28019040 con 0x559af22993e0 2026-02-23T06:21:25.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.293+0000 7f0ae3fff640 1 -- 10.20.193.58:0/544282971 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b28015790 con 0x559af22993e0 2026-02-23T06:21:25.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.293+0000 7f0ae3fff640 1 -- 10.20.193.58:0/544282971 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b28015bc0 con 0x559af22993e0 2026-02-23T06:21:25.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.293+0000 7f0b3f650e00 1 -- 10.20.193.58:0/544282971 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b28010040 con 0x559af22993e0 2026-02-23T06:21:25.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.293+0000 7f0ae3fff640 1 -- 10.20.193.58:0/544282971 <== mon.1 v2:10.20.193.93:3300/0 4 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f0b28029dc0 con 0x559af22993e0 2026-02-23T06:21:25.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.293+0000 7f0ae3fff640 10 client.4570 inactive, discarding osd_map(25..25 src has 1..25) 2026-02-23T06:21:25.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.293+0000 7f0b3f650e00 10 client.4570 _ll_register_callbacks cb 0x559af2109280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-23T06:21:25.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.293+0000 7f0b3f650e00 1 -- 10.20.193.58:0/544282971 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559af1eaf460 con 0x559af22993e0 2026-02-23T06:21:25.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.294+0000 7f0ae3fff640 1 -- 10.20.193.58:0/544282971 <== mon.1 v2:10.20.193.93:3300/0 5 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f0b2800fe90 con 0x559af22993e0 2026-02-23T06:21:25.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.294+0000 7f0b3f650e00 10 client.4570 fetch_fsmap learned FSMap version 6 2026-02-23T06:21:25.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.294+0000 7f0b3f650e00 1 -- 10.20.193.58:0/544282971 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({fsmap=6}) -- 0x559af2114510 con 0x559af22993e0 2026-02-23T06:21:25.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.294+0000 7f0ae3fff640 1 -- 10.20.193.58:0/544282971 <== mon.1 v2:10.20.193.93:3300/0 6 ==== fsmap(e 6) ==== 4720+0+0 (secure 0 0 0) 0x7f0b28015d20 con 0x559af22993e0 2026-02-23T06:21:25.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.294+0000 7f0b3f650e00 10 client.4570 fetch_fsmap finished waiting for FSMap version 6 2026-02-23T06:21:25.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.294+0000 7f0b3f650e00 10 client.4570 resolve_mds: resolved name 'e' to daemon mds.e 2026-02-23T06:21:25.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.294+0000 7f0b3f650e00 20 client.4570 populate_metadata read hostname 'trial058' 2026-02-23T06:21:25.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.294+0000 7f0b3f650e00 1 --2- 10.20.193.58:0/544282971 >> [v2:10.20.193.58:6835/4266460647,v1:10.20.193.58:6837/4266460647] conn(0x559af22d25d0 0x559af22d5bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:25.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.294+0000 7f0b3f650e00 4 client.4570 mds_command: new command op to 4468 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-23T06:21:25.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.294+0000 7f0b3f650e00 1 -- 10.20.193.58:0/544282971 --> [v2:10.20.193.58:6835/4266460647,v1:10.20.193.58:6837/4266460647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559af21749a0 con 0x559af22d25d0 2026-02-23T06:21:25.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.294+0000 7f0b36d76640 1 --2- 10.20.193.58:0/544282971 >> [v2:10.20.193.58:6835/4266460647,v1:10.20.193.58:6837/4266460647] conn(0x559af22d25d0 0x559af22d5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:25.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.294+0000 7f0b36d76640 1 --2- 10.20.193.58:0/544282971 >> [v2:10.20.193.58:6835/4266460647,v1:10.20.193.58:6837/4266460647] conn(0x559af22d25d0 0x559af22d5bf0 crc :-1 s=READY pgs=13 gs=4 cs=0 l=0 c_cookie=5887638608368775263 s_cookie=14961472713223059356 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51b5181ec9b2305f server_cookie=cfa1d429d45c379c in_seq=0 out_seq=0 2026-02-23T06:21:25.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:25.294+0000 7f0ae3fff640 10 client.4570 ms_handle_connect on v2:10.20.193.58:6835/4266460647 2026-02-23T06:21:28.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.160+0000 7f0ae3fff640 1 -- 10.20.193.58:0/544282971 <== mds.0 v2:10.20.193.58:6835/4266460647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x559af21749a0 con 0x559af22d25d0 2026-02-23T06:21:28.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.160+0000 7f0ae3fff640 10 client.4570 handle_command_reply: tid=0 2026-02-23T06:21:28.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.160+0000 7f0b3f650e00 1 client.4570 shutdown 2026-02-23T06:21:28.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.160+0000 7f0b3f650e00 1 -- 10.20.193.58:0/544282971 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x559af22993e0 msgr2=0x559af2280ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:28.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.160+0000 7f0b3f650e00 1 --2- 10.20.193.58:0/544282971 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x559af22993e0 0x559af2280ff0 secure :-1 s=READY pgs=110 gs=2 cs=0 l=1 c_cookie=5243723969982602412 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b2800f970 tx=0x7f0b2800f9a0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.160+0000 7f0b3f650e00 1 -- 10.20.193.58:0/544282971 shutdown_connections 2026-02-23T06:21:28.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.160+0000 7f0b3f650e00 1 --2- 10.20.193.58:0/544282971 >> [v2:10.20.193.58:6835/4266460647,v1:10.20.193.58:6837/4266460647] conn(0x559af22d25d0 0x559af22d5bf0 crc :-1 s=READY pgs=13 gs=4 cs=0 l=0 c_cookie=5887638608368775263 s_cookie=14961472713223059356 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.160+0000 7f0b3f650e00 1 --2- 10.20.193.58:0/544282971 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x559af22993e0 0x559af2280ff0 unknown :-1 s=CLOSED pgs=110 gs=2 cs=0 l=1 c_cookie=5243723969982602412 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.160+0000 7f0b3f650e00 1 --2- 10.20.193.58:0/544282971 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x559af2294540 0x559af2280ab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.160+0000 7f0b3f650e00 1 --2- 10.20.193.58:0/544282971 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x559af2293880 0x559af227f7d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.160+0000 7f0ae3fff640 0 client.4570 ms_handle_reset on v2:10.20.193.58:6835/4266460647 2026-02-23T06:21:28.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.160+0000 7f0b3f650e00 1 -- 10.20.193.58:0/544282971 >> 10.20.193.58:0/544282971 conn(0x559af2192a60 msgr2=0x559af22b7620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:28.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.160+0000 7f0b3f650e00 1 -- 10.20.193.58:0/544282971 shutdown_connections 2026-02-23T06:21:28.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.160+0000 7f0b3f650e00 1 -- 10.20.193.58:0/544282971 wait complete. 2026-02-23T06:21:28.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.160+0000 7f0b3f650e00 20 client.4570 trim_cache size 0 max 16384 2026-02-23T06:21:28.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.170+0000 7f0b3f650e00 1 Processor -- start 2026-02-23T06:21:28.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.170+0000 7f0b3f650e00 1 -- start start 2026-02-23T06:21:28.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.170+0000 7f0b3f650e00 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x559af2293880 0x559af22b6860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:28.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.170+0000 7f0b3f650e00 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x559af2294540 0x559af2279950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:28.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.170+0000 7f0b3f650e00 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x559af22993e0 0x559af2279e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:28.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.170+0000 7f0b3f650e00 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x559af217cb90 con 0x559af2294540 2026-02-23T06:21:28.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.170+0000 7f0b3f650e00 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x559af1e1c3b0 con 0x559af22993e0 2026-02-23T06:21:28.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.170+0000 7f0b3f650e00 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x559af22d30b0 con 0x559af2293880 2026-02-23T06:21:28.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.171+0000 7f0b36575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x559af2294540 0x559af2279950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:28.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.171+0000 7f0b36575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x559af2294540 0x559af2279950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:47142/0 (socket says 10.20.193.58:47142) 2026-02-23T06:21:28.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.171+0000 7f0b36575640 1 -- 10.20.193.58:0/4106245596 learned_addr learned my addr 10.20.193.58:0/4106245596 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:28.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.171+0000 7f0b36d76640 1 --2- 10.20.193.58:0/4106245596 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x559af2293880 0x559af22b6860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:28.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.171+0000 7f0b37577640 1 --2- 10.20.193.58:0/4106245596 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x559af22993e0 0x559af2279e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:28.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.171+0000 7f0b36575640 1 -- 10.20.193.58:0/4106245596 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x559af2293880 msgr2=0x559af22b6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-23T06:21:28.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.171+0000 7f0b36575640 1 --2- 10.20.193.58:0/4106245596 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x559af2293880 0x559af22b6860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.171+0000 7f0b36575640 1 -- 10.20.193.58:0/4106245596 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x559af22993e0 msgr2=0x559af2279e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-23T06:21:28.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.171+0000 7f0b36575640 1 --2- 10.20.193.58:0/4106245596 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x559af22993e0 0x559af2279e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.171+0000 7f0b36575640 1 -- 10.20.193.58:0/4106245596 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559af210edb0 con 0x559af2294540 2026-02-23T06:21:28.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.171+0000 7f0b36575640 1 --2- 10.20.193.58:0/4106245596 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x559af2294540 0x559af2279950 secure :-1 s=READY pgs=86 gs=1 cs=0 l=1 c_cookie=14277451697826776856 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b2000ea20 tx=0x7f0b20009000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c623b2ac8ac34718 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:28.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.171+0000 7f0afa3ff640 1 -- 10.20.193.58:0/4106245596 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b20002e00 con 0x559af2294540 2026-02-23T06:21:28.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.171+0000 7f0afa3ff640 1 -- 10.20.193.58:0/4106245596 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b20015a80 con 0x559af2294540 2026-02-23T06:21:28.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.171+0000 7f0afa3ff640 1 -- 10.20.193.58:0/4106245596 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b20015e50 con 0x559af2294540 2026-02-23T06:21:28.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.172+0000 7f0b3f650e00 1 -- 10.20.193.58:0/4106245596 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x559af2294540 msgr2=0x559af2279950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:28.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.172+0000 7f0b3f650e00 1 --2- 10.20.193.58:0/4106245596 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x559af2294540 0x559af2279950 secure :-1 s=READY pgs=86 gs=1 cs=0 l=1 c_cookie=14277451697826776856 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b2000ea20 tx=0x7f0b20009000 comp rx=0 tx=0).stop 2026-02-23T06:21:28.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.172+0000 7f0b3f650e00 1 -- 10.20.193.58:0/4106245596 shutdown_connections 2026-02-23T06:21:28.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.172+0000 7f0b3f650e00 1 --2- 10.20.193.58:0/4106245596 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x559af22993e0 0x559af2279e90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.172+0000 7f0b3f650e00 1 --2- 10.20.193.58:0/4106245596 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x559af2294540 0x559af2279950 unknown :-1 s=CLOSED pgs=86 gs=1 cs=0 l=1 c_cookie=14277451697826776856 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.172+0000 7f0b3f650e00 1 --2- 10.20.193.58:0/4106245596 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x559af2293880 0x559af22b6860 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.172+0000 7f0b3f650e00 1 -- 10.20.193.58:0/4106245596 >> 10.20.193.58:0/4106245596 conn(0x559af2192a60 msgr2=0x559af22b7600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:28.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.172+0000 7f0b3f650e00 1 -- 10.20.193.58:0/4106245596 shutdown_connections 2026-02-23T06:21:28.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.172+0000 7f0b3f650e00 1 -- 10.20.193.58:0/4106245596 wait complete. 2026-02-23T06:21:28.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.172+0000 7f0b3f650e00 1 -- start start 2026-02-23T06:21:28.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.172+0000 7f0b3f650e00 1 Processor -- start 2026-02-23T06:21:28.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.173+0000 7f0b3f650e00 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x559af2293880 0x559af2318000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:28.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.173+0000 7f0b3f650e00 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x559af2294540 0x559af2297cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:28.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.173+0000 7f0b3f650e00 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x559af22993e0 0x559af2298230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:28.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.173+0000 7f0b3f650e00 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x559af2254d70 con 0x559af2293880 2026-02-23T06:21:28.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.173+0000 7f0b3f650e00 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x559af224ee60 con 0x559af22993e0 2026-02-23T06:21:28.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.173+0000 7f0b3f650e00 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x559af2284ee0 con 0x559af2294540 2026-02-23T06:21:28.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.173+0000 7f0b36d76640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x559af2293880 0x559af2318000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:28.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.173+0000 7f0b36575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x559af2294540 0x559af2297cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:28.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.173+0000 7f0b36d76640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x559af2293880 0x559af2318000 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:47154/0 (socket says 10.20.193.58:47154) 2026-02-23T06:21:28.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.173+0000 7f0b36d76640 1 -- 10.20.193.58:0/2670259370 learned_addr learned my addr 10.20.193.58:0/2670259370 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:28.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.173+0000 7f0b37577640 1 --2- 10.20.193.58:0/2670259370 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x559af22993e0 0x559af2298230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:28.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.174+0000 7f0b36d76640 1 -- 10.20.193.58:0/2670259370 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x559af2294540 msgr2=0x559af2297cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-23T06:21:28.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.174+0000 7f0b36d76640 1 --2- 10.20.193.58:0/2670259370 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x559af2294540 0x559af2297cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.174+0000 7f0b36d76640 1 -- 10.20.193.58:0/2670259370 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x559af22993e0 msgr2=0x559af2298230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-23T06:21:28.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.174+0000 7f0b36d76640 1 --2- 10.20.193.58:0/2670259370 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x559af22993e0 0x559af2298230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.174+0000 7f0b36d76640 1 -- 10.20.193.58:0/2670259370 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559af21025c0 con 0x559af2293880 2026-02-23T06:21:28.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.174+0000 7f0b36d76640 1 --2- 10.20.193.58:0/2670259370 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x559af2293880 0x559af2318000 secure :-1 s=READY pgs=87 gs=1 cs=0 l=1 c_cookie=938344511859600703 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b2c005d60 tx=0x7f0b2c002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d05ab5caa542d3f server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:28.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.174+0000 7f0ae3fff640 10 client.0 ms_handle_connect on v2:10.20.193.58:3300/0 2026-02-23T06:21:28.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.174+0000 7f0ae3fff640 1 -- 10.20.193.58:0/2670259370 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b2c093a60 con 0x559af2293880 2026-02-23T06:21:28.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.174+0000 7f0ae3fff640 1 -- 10.20.193.58:0/2670259370 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b2c08a8d0 con 0x559af2293880 2026-02-23T06:21:28.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.174+0000 7f0b3f650e00 1 -- 10.20.193.58:0/2670259370 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b2000f040 con 0x559af2293880 2026-02-23T06:21:28.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.174+0000 7f0ae3fff640 1 -- 10.20.193.58:0/2670259370 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b2c038e40 con 0x559af2293880 2026-02-23T06:21:28.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.174+0000 7f0b3f650e00 10 client.4431 _ll_register_callbacks cb 0x559af2109280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-23T06:21:28.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.174+0000 7f0b3f650e00 1 -- 10.20.193.58:0/2670259370 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b28007c80 con 0x559af2293880 2026-02-23T06:21:28.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.174+0000 7f0ae3fff640 1 -- 10.20.193.58:0/2670259370 <== mon.0 v2:10.20.193.58:3300/0 4 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f0b2c0ac1c0 con 0x559af2293880 2026-02-23T06:21:28.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.174+0000 7f0ae3fff640 1 -- 10.20.193.58:0/2670259370 <== mon.0 v2:10.20.193.58:3300/0 5 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f0b2c0ac3c0 con 0x559af2293880 2026-02-23T06:21:28.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.174+0000 7f0b3f650e00 10 client.4431 fetch_fsmap learned FSMap version 6 2026-02-23T06:21:28.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.174+0000 7f0b3f650e00 1 -- 10.20.193.58:0/2670259370 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({fsmap=6}) -- 0x559af2114770 con 0x559af2293880 2026-02-23T06:21:28.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.174+0000 7f0ae3fff640 1 -- 10.20.193.58:0/2670259370 <== mon.0 v2:10.20.193.58:3300/0 6 ==== fsmap(e 6) ==== 4720+0+0 (secure 0 0 0) 0x7f0b2c0a0380 con 0x559af2293880 2026-02-23T06:21:28.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.174+0000 7f0b3f650e00 10 client.4431 fetch_fsmap finished waiting for FSMap version 6 2026-02-23T06:21:28.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.174+0000 7f0b3f650e00 10 client.4431 resolve_mds: resolved name 'e' to daemon mds.e 2026-02-23T06:21:28.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.174+0000 7f0b3f650e00 20 client.4431 populate_metadata read hostname 'trial058' 2026-02-23T06:21:28.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.174+0000 7f0b3f650e00 1 --2- 10.20.193.58:0/2670259370 >> [v2:10.20.193.58:6835/4266460647,v1:10.20.193.58:6837/4266460647] conn(0x559af22861f0 0x559af231b1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:28.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.174+0000 7f0b3f650e00 4 client.4431 mds_command: new command op to 4468 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-23T06:21:28.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.174+0000 7f0b3f650e00 1 -- 10.20.193.58:0/2670259370 --> [v2:10.20.193.58:6835/4266460647,v1:10.20.193.58:6837/4266460647] -- command(tid 0: {"prefix": "status"}) -- 0x559af1efc960 con 0x559af22861f0 2026-02-23T06:21:28.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.175+0000 7f0b36575640 1 --2- 10.20.193.58:0/2670259370 >> [v2:10.20.193.58:6835/4266460647,v1:10.20.193.58:6837/4266460647] conn(0x559af22861f0 0x559af231b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:28.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.175+0000 7f0b36575640 1 -- 10.20.193.58:0/2670259370 >> [v2:10.20.193.58:6835/4266460647,v1:10.20.193.58:6837/4266460647] conn(0x559af22861f0 msgr2=0x559af231b1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 16 2026-02-23T06:21:28.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.175+0000 7f0b36575640 1 -- 10.20.193.58:0/2670259370 >> [v2:10.20.193.58:6835/4266460647,v1:10.20.193.58:6837/4266460647] conn(0x559af22861f0 msgr2=0x559af231b1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-23T06:21:28.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.175+0000 7f0b36575640 1 --2- 10.20.193.58:0/2670259370 >> [v2:10.20.193.58:6835/4266460647,v1:10.20.193.58:6837/4266460647] conn(0x559af22861f0 0x559af231b1c0 crc :-1 s=SESSION_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=17841622431121624822 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:21:28.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.175+0000 7f0b36575640 1 --2- 10.20.193.58:0/2670259370 >> [v2:10.20.193.58:6835/4266460647,v1:10.20.193.58:6837/4266460647] conn(0x559af22861f0 0x559af231b1c0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=0 c_cookie=17841622431121624822 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:21:28.370 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.376+0000 7f0b36575640 1 --2- 10.20.193.58:0/2670259370 >> [v2:10.20.193.58:6835/4266460647,v1:10.20.193.58:6837/4266460647] conn(0x559af22861f0 0x559af231b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=17841622431121624822 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:28.370 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.376+0000 7f0b36575640 1 --2- 10.20.193.58:0/2670259370 >> [v2:10.20.193.58:6835/4266460647,v1:10.20.193.58:6837/4266460647] conn(0x559af22861f0 0x559af231b1c0 crc :-1 s=READY pgs=15 gs=6 cs=0 l=0 c_cookie=17841622431121624822 s_cookie=14964986118454388960 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f79a2d1277a54ef6 server_cookie=cfae4f963b2028e0 in_seq=0 out_seq=0 2026-02-23T06:21:28.370 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.376+0000 7f0ae3fff640 10 client.4431 ms_handle_connect on v2:10.20.193.58:6835/4266460647 2026-02-23T06:21:28.370 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.376+0000 7f0ae3fff640 1 -- 10.20.193.58:0/2670259370 <== mds.0 v2:10.20.193.58:6835/4266460647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1045 (crc 0 0 0) 0x559af1efc960 con 0x559af22861f0 2026-02-23T06:21:28.370 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.376+0000 7f0ae3fff640 10 client.4431 handle_command_reply: tid=0 2026-02-23T06:21:28.370 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.376+0000 7f0b3f650e00 1 client.4431 shutdown 2026-02-23T06:21:28.371 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.376+0000 7f0b3f650e00 1 -- 10.20.193.58:0/2670259370 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x559af2293880 msgr2=0x559af2318000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:28.371 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.376+0000 7f0b3f650e00 1 --2- 10.20.193.58:0/2670259370 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x559af2293880 0x559af2318000 secure :-1 s=READY pgs=87 gs=1 cs=0 l=1 c_cookie=938344511859600703 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b2c005d60 tx=0x7f0b2c002390 comp rx=0 tx=0).stop 2026-02-23T06:21:28.371 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.376+0000 7f0b3f650e00 1 -- 10.20.193.58:0/2670259370 shutdown_connections 2026-02-23T06:21:28.371 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.376+0000 7f0b3f650e00 1 --2- 10.20.193.58:0/2670259370 >> [v2:10.20.193.58:6835/4266460647,v1:10.20.193.58:6837/4266460647] conn(0x559af22861f0 0x559af231b1c0 crc :-1 s=READY pgs=15 gs=6 cs=0 l=0 c_cookie=17841622431121624822 s_cookie=14964986118454388960 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.371 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.376+0000 7f0b3f650e00 1 --2- 10.20.193.58:0/2670259370 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x559af22993e0 0x559af2298230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.371 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.376+0000 7f0b3f650e00 1 --2- 10.20.193.58:0/2670259370 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x559af2294540 0x559af2297cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.371 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.376+0000 7f0b3f650e00 1 --2- 10.20.193.58:0/2670259370 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x559af2293880 0x559af2318000 unknown :-1 s=CLOSED pgs=87 gs=1 cs=0 l=1 c_cookie=938344511859600703 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.371 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.376+0000 7f0ae3fff640 0 client.4431 ms_handle_reset on v2:10.20.193.58:6835/4266460647 2026-02-23T06:21:28.371 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.376+0000 7f0b3f650e00 1 -- 10.20.193.58:0/2670259370 >> 10.20.193.58:0/2670259370 conn(0x559af2192a60 msgr2=0x559af22b6860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:28.371 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.376+0000 7f0b3f650e00 1 -- 10.20.193.58:0/2670259370 shutdown_connections 2026-02-23T06:21:28.371 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.377+0000 7f0b3f650e00 1 -- 10.20.193.58:0/2670259370 wait complete. 2026-02-23T06:21:28.371 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.377+0000 7f0b3f650e00 20 client.4431 trim_cache size 0 max 16384 2026-02-23T06:21:28.371 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:21:28.371 INFO:teuthology.orchestra.run.trial058.stdout: "cluster_fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:21:28.371 INFO:teuthology.orchestra.run.trial058.stdout: "whoami": 0, 2026-02-23T06:21:28.371 INFO:teuthology.orchestra.run.trial058.stdout: "id": 4468, 2026-02-23T06:21:28.371 INFO:teuthology.orchestra.run.trial058.stdout: "want_state": "up:active", 2026-02-23T06:21:28.372 INFO:teuthology.orchestra.run.trial058.stdout: "state": "up:active", 2026-02-23T06:21:28.372 INFO:teuthology.orchestra.run.trial058.stdout: "fs_name": "cephfs", 2026-02-23T06:21:28.372 INFO:teuthology.orchestra.run.trial058.stdout: "rank_uptime": 10.235831718, 2026-02-23T06:21:28.372 INFO:teuthology.orchestra.run.trial058.stdout: "mdsmap_epoch": 5, 2026-02-23T06:21:28.372 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap_epoch": 25, 2026-02-23T06:21:28.372 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap_epoch_barrier": 25, 2026-02-23T06:21:28.372 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 15.262861646999999, 2026-02-23T06:21:28.372 INFO:teuthology.orchestra.run.trial058.stdout: "sysinfo": { 2026-02-23T06:21:28.372 INFO:teuthology.orchestra.run.trial058.stdout: "arch": "x86_64", 2026-02-23T06:21:28.372 INFO:teuthology.orchestra.run.trial058.stdout: "ceph_release": "tentacle", 2026-02-23T06:21:28.372 INFO:teuthology.orchestra.run.trial058.stdout: "ceph_version": "ceph version 20.3.0-5449-gb60f8651 (b60f86513d744c550fab39595f0905abce2bdd7d) tentacle (dev - RelWithDebInfo)", 2026-02-23T06:21:28.372 INFO:teuthology.orchestra.run.trial058.stdout: "ceph_version_short": "20.3.0-5449-gb60f8651", 2026-02-23T06:21:28.372 INFO:teuthology.orchestra.run.trial058.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-23T06:21:28.372 INFO:teuthology.orchestra.run.trial058.stdout: "distro": "centos", 2026-02-23T06:21:28.372 INFO:teuthology.orchestra.run.trial058.stdout: "distro_description": "CentOS Stream 9", 2026-02-23T06:21:28.372 INFO:teuthology.orchestra.run.trial058.stdout: "distro_version": "9", 2026-02-23T06:21:28.372 INFO:teuthology.orchestra.run.trial058.stdout: "hostname": "trial058", 2026-02-23T06:21:28.372 INFO:teuthology.orchestra.run.trial058.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Feb 12 10:25:42 EST 2026", 2026-02-23T06:21:28.372 INFO:teuthology.orchestra.run.trial058.stdout: "kernel_version": "6.19.0-g8dec4b357aab", 2026-02-23T06:21:28.372 INFO:teuthology.orchestra.run.trial058.stdout: "mem_swap_kb": "8388604", 2026-02-23T06:21:28.372 INFO:teuthology.orchestra.run.trial058.stdout: "mem_total_kb": "130448332", 2026-02-23T06:21:28.372 INFO:teuthology.orchestra.run.trial058.stdout: "os": "Linux" 2026-02-23T06:21:28.372 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:28.372 INFO:teuthology.orchestra.run.trial058.stdout: "endian": "little" 2026-02-23T06:21:28.372 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:21:28.372 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.377+0000 7f0b3c85a640 1 -- 10.20.193.58:0/776287718 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0b0407a6c0 msgr2=0x7f0b0409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:28.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.377+0000 7f0b3c85a640 1 --2- 10.20.193.58:0/776287718 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0b0407a6c0 0x7f0b0409ab70 secure :-1 s=READY pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b3813bca0 tx=0x7f0b20007ee0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.377+0000 7f0b3c85a640 1 -- 10.20.193.58:0/776287718 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0b380b6690 msgr2=0x7f0b38160120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:28.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.377+0000 7f0b3c85a640 1 --2- 10.20.193.58:0/776287718 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0b380b6690 0x7f0b38160120 secure :-1 s=READY pgs=109 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b2c0098a0 tx=0x7f0b2c002a10 comp rx=0 tx=0).stop 2026-02-23T06:21:28.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.377+0000 7f0b3c85a640 1 -- 10.20.193.58:0/776287718 shutdown_connections 2026-02-23T06:21:28.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.377+0000 7f0b3c85a640 1 --2- 10.20.193.58:0/776287718 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0b0407a6c0 0x7f0b0409ab70 unknown :-1 s=CLOSED pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.377+0000 7f0b3c85a640 1 --2- 10.20.193.58:0/776287718 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b3815d870 0x7f0b38140a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.377+0000 7f0b3c85a640 1 --2- 10.20.193.58:0/776287718 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b3815d4a0 0x7f0b3813d580 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.377+0000 7f0b3c85a640 1 --2- 10.20.193.58:0/776287718 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0b380b6690 0x7f0b38160120 unknown :-1 s=CLOSED pgs=109 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.377+0000 7f0b3c85a640 1 -- 10.20.193.58:0/776287718 >> 10.20.193.58:0/776287718 conn(0x7f0b380b3c20 msgr2=0x7f0b3815ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:28.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.377+0000 7f0b3c85a640 1 -- 10.20.193.58:0/776287718 shutdown_connections 2026-02-23T06:21:28.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.377+0000 7f0b3c85a640 1 -- 10.20.193.58:0/776287718 wait complete. 2026-02-23T06:21:28.383 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2026-02-23T06:21:28.383 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2026-02-23T06:21:28.383 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2026-02-23T06:21:28.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.509+0000 7fa34e05b640 1 -- 10.20.193.58:0/1516551055 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa34815d470 msgr2=0x7fa3480b99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:28.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.509+0000 7fa34e05b640 1 --2- 10.20.193.58:0/1516551055 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa34815d470 0x7fa3480b99c0 secure :-1 s=READY pgs=58 gs=2 cs=0 l=1 c_cookie=14597762873096261649 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa334004740 tx=0x7fa33402f1e0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.509+0000 7fa34e05b640 1 -- 10.20.193.58:0/1516551055 shutdown_connections 2026-02-23T06:21:28.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.509+0000 7fa34e05b640 1 --2- 10.20.193.58:0/1516551055 >> v2:10.20.193.58:3300/0 conn(0x7fa3480b28c0 0x7fa3480b9f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.509+0000 7fa34e05b640 1 --2- 10.20.193.58:0/1516551055 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa34815d470 0x7fa3480b99c0 unknown :-1 s=CLOSED pgs=58 gs=2 cs=0 l=1 c_cookie=14597762873096261649 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.509+0000 7fa34e05b640 1 -- 10.20.193.58:0/1516551055 >> 10.20.193.58:0/1516551055 conn(0x7fa348054390 msgr2=0x7fa348054790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:28.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.509+0000 7fa34e05b640 1 -- 10.20.193.58:0/1516551055 shutdown_connections 2026-02-23T06:21:28.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.509+0000 7fa34e05b640 1 -- 10.20.193.58:0/1516551055 wait complete. 2026-02-23T06:21:28.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.510+0000 7fa34e05b640 1 Processor -- start 2026-02-23T06:21:28.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.510+0000 7fa34e05b640 1 -- start start 2026-02-23T06:21:28.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.510+0000 7fa34e05b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa3480b28c0 0x7fa348122230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:28.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.510+0000 7fa34e05b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa34815d470 0x7fa348057e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:28.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.510+0000 7fa34e05b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa3480b4200 0x7fa348058360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:28.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.510+0000 7fa34e05b640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa348057990 con 0x7fa3480b4200 2026-02-23T06:21:28.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.510+0000 7fa34e05b640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fa3480b48e0 con 0x7fa34815d470 2026-02-23T06:21:28.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.510+0000 7fa34e05b640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa348157950 con 0x7fa3480b28c0 2026-02-23T06:21:28.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.510+0000 7fa3477fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa3480b28c0 0x7fa348122230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:28.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.510+0000 7fa347fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa3480b4200 0x7fa348058360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:28.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.510+0000 7fa346ffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa34815d470 0x7fa348057e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:28.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.511+0000 7fa347fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa3480b4200 0x7fa348058360 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:47174/0 (socket says 10.20.193.58:47174) 2026-02-23T06:21:28.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.511+0000 7fa347fff640 1 -- 10.20.193.58:0/1091178068 learned_addr learned my addr 10.20.193.58:0/1091178068 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:28.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.511+0000 7fa3477fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa3480b28c0 0x7fa348122230 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:59064/0 (socket says 10.20.193.58:59064) 2026-02-23T06:21:28.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.511+0000 7fa347fff640 1 -- 10.20.193.58:0/1091178068 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa3480b28c0 msgr2=0x7fa348122230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:28.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.511+0000 7fa347fff640 1 --2- 10.20.193.58:0/1091178068 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa3480b28c0 0x7fa348122230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.511+0000 7fa347fff640 1 -- 10.20.193.58:0/1091178068 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa34815d470 msgr2=0x7fa348057e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:28.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.511+0000 7fa347fff640 1 --2- 10.20.193.58:0/1091178068 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa34815d470 0x7fa348057e20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.511+0000 7fa347fff640 1 -- 10.20.193.58:0/1091178068 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa33c00a590 con 0x7fa3480b4200 2026-02-23T06:21:28.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.511+0000 7fa347fff640 1 --2- 10.20.193.58:0/1091178068 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa3480b4200 0x7fa348058360 secure :-1 s=READY pgs=89 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa33c005780 tx=0x7fa33c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:28.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.511+0000 7fa323fff640 1 -- 10.20.193.58:0/1091178068 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa33c00fd60 con 0x7fa3480b4200 2026-02-23T06:21:28.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.511+0000 7fa323fff640 1 -- 10.20.193.58:0/1091178068 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa33c003e80 con 0x7fa3480b4200 2026-02-23T06:21:28.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.511+0000 7fa323fff640 1 -- 10.20.193.58:0/1091178068 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa33c0116b0 con 0x7fa3480b4200 2026-02-23T06:21:28.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.511+0000 7fa34e05b640 1 -- 10.20.193.58:0/1091178068 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3340094b0 con 0x7fa3480b4200 2026-02-23T06:21:28.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.511+0000 7fa34e05b640 1 -- 10.20.193.58:0/1091178068 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa348157eb0 con 0x7fa3480b4200 2026-02-23T06:21:28.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.512+0000 7fa34e05b640 1 -- 10.20.193.58:0/1091178068 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa34805bc10 con 0x7fa3480b4200 2026-02-23T06:21:28.507 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.513+0000 7fa323fff640 1 -- 10.20.193.58:0/1091178068 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fa33c017020 con 0x7fa3480b4200 2026-02-23T06:21:28.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.514+0000 7fa323fff640 1 --2- 10.20.193.58:0/1091178068 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa31807a6c0 0x7fa31809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:28.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.514+0000 7fa323fff640 1 -- 10.20.193.58:0/1091178068 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7fa33c09f1e0 con 0x7fa3480b4200 2026-02-23T06:21:28.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.514+0000 7fa3477fe640 1 --2- 10.20.193.58:0/1091178068 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa31807a6c0 0x7fa31809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:28.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.515+0000 7fa3477fe640 1 --2- 10.20.193.58:0/1091178068 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa31807a6c0 0x7fa31809ab70 secure :-1 s=READY pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3340023d0 tx=0x7fa334031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:28.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.515+0000 7fa323fff640 1 -- 10.20.193.58:0/1091178068 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fa33c062460 con 0x7fa3480b4200 2026-02-23T06:21:28.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.657+0000 7fa34e05b640 1 -- 10.20.193.58:0/1091178068 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa348163de0 con 0x7fa3480b4200 2026-02-23T06:21:28.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.657+0000 7fa323fff640 1 -- 10.20.193.58:0/1091178068 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7fa33c065580 con 0x7fa3480b4200 2026-02-23T06:21:28.651 INFO:teuthology.orchestra.run.trial058.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2026-02-23T06:21:28.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.658+0000 7fa34e05b640 1 -- 10.20.193.58:0/1091178068 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa31807a6c0 msgr2=0x7fa31809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:28.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.658+0000 7fa34e05b640 1 --2- 10.20.193.58:0/1091178068 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa31807a6c0 0x7fa31809ab70 secure :-1 s=READY pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3340023d0 tx=0x7fa334031040 comp rx=0 tx=0).stop 2026-02-23T06:21:28.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.658+0000 7fa34e05b640 1 -- 10.20.193.58:0/1091178068 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa3480b4200 msgr2=0x7fa348058360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:28.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.658+0000 7fa34e05b640 1 --2- 10.20.193.58:0/1091178068 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa3480b4200 0x7fa348058360 secure :-1 s=READY pgs=89 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa33c005780 tx=0x7fa33c003c20 comp rx=0 tx=0).stop 2026-02-23T06:21:28.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.658+0000 7fa34e05b640 1 -- 10.20.193.58:0/1091178068 shutdown_connections 2026-02-23T06:21:28.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.658+0000 7fa34e05b640 1 --2- 10.20.193.58:0/1091178068 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa31807a6c0 0x7fa31809ab70 unknown :-1 s=CLOSED pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.658+0000 7fa34e05b640 1 --2- 10.20.193.58:0/1091178068 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa3480b4200 0x7fa348058360 unknown :-1 s=CLOSED pgs=89 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.658+0000 7fa34e05b640 1 --2- 10.20.193.58:0/1091178068 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa34815d470 0x7fa348057e20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.658+0000 7fa34e05b640 1 --2- 10.20.193.58:0/1091178068 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa3480b28c0 0x7fa348122230 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:28.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.658+0000 7fa34e05b640 1 -- 10.20.193.58:0/1091178068 >> 10.20.193.58:0/1091178068 conn(0x7fa348054390 msgr2=0x7fa3480b2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:28.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.658+0000 7fa34e05b640 1 -- 10.20.193.58:0/1091178068 shutdown_connections 2026-02-23T06:21:28.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28.658+0000 7fa34e05b640 1 -- 10.20.193.58:0/1091178068 wait complete. 2026-02-23T06:21:28.663 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2026-02-23T06:21:28.663 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2026-02-23T06:21:28.663 INFO:tasks.cephfs.mount:self.client_remote.hostname = trial058.front.sepia.ceph.com 2026-02-23T06:21:28.663 INFO:tasks.cephfs.mount:self.client.name = client.admin 2026-02-23T06:21:28.663 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2026-02-23T06:21:28.663 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2026-02-23T06:21:28.664 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2026-02-23T06:21:28.664 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2026-02-23T06:21:28.664 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2026-02-23T06:21:28.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-23T06:21:28.664 DEBUG:teuthology.orchestra.run.trial058:> ip addr 2026-02-23T06:21:28.701 INFO:teuthology.orchestra.run.trial058.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2026-02-23T06:21:28.702 INFO:teuthology.orchestra.run.trial058.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2026-02-23T06:21:28.702 INFO:teuthology.orchestra.run.trial058.stdout: inet 127.0.0.1/8 scope host lo 2026-02-23T06:21:28.702 INFO:teuthology.orchestra.run.trial058.stdout: valid_lft forever preferred_lft forever 2026-02-23T06:21:28.702 INFO:teuthology.orchestra.run.trial058.stdout: inet6 ::1/128 scope host 2026-02-23T06:21:28.702 INFO:teuthology.orchestra.run.trial058.stdout: valid_lft forever preferred_lft forever 2026-02-23T06:21:28.702 INFO:teuthology.orchestra.run.trial058.stdout:2: enp1s0f0np0: mtu 1500 qdisc fq_codel state UP group default qlen 1000 2026-02-23T06:21:28.702 INFO:teuthology.orchestra.run.trial058.stdout: link/ether 90:5a:08:77:62:82 brd ff:ff:ff:ff:ff:ff 2026-02-23T06:21:28.702 INFO:teuthology.orchestra.run.trial058.stdout: inet 10.20.193.58/20 brd 10.20.207.255 scope global dynamic noprefixroute enp1s0f0np0 2026-02-23T06:21:28.702 INFO:teuthology.orchestra.run.trial058.stdout: valid_lft 527sec preferred_lft 527sec 2026-02-23T06:21:28.702 INFO:teuthology.orchestra.run.trial058.stdout: inet6 fe80::925a:8ff:fe77:6282/64 scope link proto kernel_ll 2026-02-23T06:21:28.702 INFO:teuthology.orchestra.run.trial058.stdout: valid_lft forever preferred_lft forever 2026-02-23T06:21:28.702 INFO:teuthology.orchestra.run.trial058.stdout:3: enp1s0f1np1: mtu 1500 qdisc fq_codel state DOWN group default qlen 1000 2026-02-23T06:21:28.702 INFO:teuthology.orchestra.run.trial058.stdout: link/ether 90:5a:08:77:62:83 brd ff:ff:ff:ff:ff:ff 2026-02-23T06:21:28.702 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.159.254/20 2026-02-23T06:21:28.703 DEBUG:teuthology.orchestra.run.trial058:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-23T06:21:28.703 DEBUG:teuthology.orchestra.run.trial058:> set -e 2026-02-23T06:21:28.703 DEBUG:teuthology.orchestra.run.trial058:> sudo ip link add name ceph-brx type bridge 2026-02-23T06:21:28.703 DEBUG:teuthology.orchestra.run.trial058:> sudo ip addr flush dev ceph-brx 2026-02-23T06:21:28.703 DEBUG:teuthology.orchestra.run.trial058:> sudo ip link set ceph-brx up 2026-02-23T06:21:28.703 DEBUG:teuthology.orchestra.run.trial058:> sudo ip addr add 192.168.159.254/20 brd 192.168.159.255 dev ceph-brx 2026-02-23T06:21:28.703 DEBUG:teuthology.orchestra.run.trial058:> ') 2026-02-23T06:21:28.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-23T06:21:28.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-23T06:21:28.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-23T06:21:28.966 DEBUG:teuthology.orchestra.run.trial058:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2026-02-23T06:21:29.019 INFO:teuthology.orchestra.run.trial058.stdout:1 2026-02-23T06:21:29.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-23T06:21:29.022 DEBUG:teuthology.orchestra.run.trial058:> ip r 2026-02-23T06:21:29.058 INFO:teuthology.orchestra.run.trial058.stdout:default via 10.20.192.1 dev enp1s0f0np0 proto dhcp src 10.20.193.58 metric 100 2026-02-23T06:21:29.059 INFO:teuthology.orchestra.run.trial058.stdout:10.20.192.0/20 dev enp1s0f0np0 proto kernel scope link src 10.20.193.58 metric 100 2026-02-23T06:21:29.059 INFO:teuthology.orchestra.run.trial058.stdout:192.168.144.0/20 dev ceph-brx proto kernel scope link src 192.168.159.254 2026-02-23T06:21:29.059 DEBUG:teuthology.orchestra.run.trial058:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-23T06:21:29.059 DEBUG:teuthology.orchestra.run.trial058:> set -e 2026-02-23T06:21:29.059 DEBUG:teuthology.orchestra.run.trial058:> sudo iptables -A FORWARD -o enp1s0f0np0 -i ceph-brx -j ACCEPT 2026-02-23T06:21:29.059 DEBUG:teuthology.orchestra.run.trial058:> sudo iptables -A FORWARD -i enp1s0f0np0 -o ceph-brx -j ACCEPT 2026-02-23T06:21:29.059 DEBUG:teuthology.orchestra.run.trial058:> sudo iptables -t nat -A POSTROUTING -s 192.168.159.254/20 -o enp1s0f0np0 -j MASQUERADE 2026-02-23T06:21:29.059 DEBUG:teuthology.orchestra.run.trial058:> ') 2026-02-23T06:21:29.072 INFO:tasks.ceph.mds.e.trial058.stderr:2026-02-23T06:21:29.077+0000 7feb659f1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2026-02-23T06:21:29.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-23T06:21:29.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-23T06:21:29.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-23T06:21:29.332 DEBUG:teuthology.orchestra.run.trial058:> ip netns list 2026-02-23T06:21:29.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-23T06:21:29.371 DEBUG:teuthology.orchestra.run.trial058:> ip netns list-id 2026-02-23T06:21:29.448 DEBUG:teuthology.orchestra.run.trial058:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-23T06:21:29.448 DEBUG:teuthology.orchestra.run.trial058:> set -e 2026-02-23T06:21:29.448 DEBUG:teuthology.orchestra.run.trial058:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-23T06:21:29.448 DEBUG:teuthology.orchestra.run.trial058:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2026-02-23T06:21:29.448 DEBUG:teuthology.orchestra.run.trial058:> ') 2026-02-23T06:21:29.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-23T06:21:29.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-23T06:21:29.605 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.144.1/20 2026-02-23T06:21:29.605 DEBUG:teuthology.orchestra.run.trial058:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-23T06:21:29.605 DEBUG:teuthology.orchestra.run.trial058:> set -e 2026-02-23T06:21:29.605 DEBUG:teuthology.orchestra.run.trial058:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2026-02-23T06:21:29.605 DEBUG:teuthology.orchestra.run.trial058:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.144.1/20 brd 192.168.159.255 dev veth0 2026-02-23T06:21:29.605 DEBUG:teuthology.orchestra.run.trial058:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2026-02-23T06:21:29.605 DEBUG:teuthology.orchestra.run.trial058:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2026-02-23T06:21:29.605 DEBUG:teuthology.orchestra.run.trial058:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.159.254 2026-02-23T06:21:29.605 DEBUG:teuthology.orchestra.run.trial058:> ') 2026-02-23T06:21:29.669 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-23T06:21:29.791 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-23T06:21:29.798 DEBUG:teuthology.orchestra.run.trial058:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-23T06:21:29.798 DEBUG:teuthology.orchestra.run.trial058:> set -e 2026-02-23T06:21:29.798 DEBUG:teuthology.orchestra.run.trial058:> sudo ip link set brx.0 up 2026-02-23T06:21:29.798 DEBUG:teuthology.orchestra.run.trial058:> sudo ip link set dev brx.0 master ceph-brx 2026-02-23T06:21:29.798 DEBUG:teuthology.orchestra.run.trial058:> ') 2026-02-23T06:21:29.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-23T06:21:29.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-23T06:21:29.945 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2026-02-23T06:21:29.945 INFO:teuthology.orchestra.run:Running command with timeout 60 2026-02-23T06:21:29.945 DEBUG:teuthology.orchestra.run.trial058:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2026-02-23T06:21:29.983 INFO:teuthology.orchestra.run.trial058.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2026-02-23T06:21:29.983 INFO:teuthology.orchestra.run:Running command with timeout 60 2026-02-23T06:21:29.983 DEBUG:teuthology.orchestra.run.trial058:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2026-02-23T06:21:30.059 DEBUG:teuthology.orchestra.run.trial058:> sudo modprobe fuse 2026-02-23T06:21:30.156 DEBUG:teuthology.orchestra.run.trial058:> cat /proc/self/mounts | awk '{print $2}' 2026-02-23T06:21:30.195 INFO:teuthology.orchestra.run.trial058.stdout:/proc 2026-02-23T06:21:30.195 INFO:teuthology.orchestra.run.trial058.stdout:/sys 2026-02-23T06:21:30.195 INFO:teuthology.orchestra.run.trial058.stdout:/dev 2026-02-23T06:21:30.195 INFO:teuthology.orchestra.run.trial058.stdout:/sys/kernel/security 2026-02-23T06:21:30.195 INFO:teuthology.orchestra.run.trial058.stdout:/dev/shm 2026-02-23T06:21:30.195 INFO:teuthology.orchestra.run.trial058.stdout:/dev/pts 2026-02-23T06:21:30.195 INFO:teuthology.orchestra.run.trial058.stdout:/run 2026-02-23T06:21:30.195 INFO:teuthology.orchestra.run.trial058.stdout:/sys/fs/cgroup 2026-02-23T06:21:30.195 INFO:teuthology.orchestra.run.trial058.stdout:/sys/fs/pstore 2026-02-23T06:21:30.195 INFO:teuthology.orchestra.run.trial058.stdout:/sys/firmware/efi/efivars 2026-02-23T06:21:30.195 INFO:teuthology.orchestra.run.trial058.stdout:/sys/fs/bpf 2026-02-23T06:21:30.195 INFO:teuthology.orchestra.run.trial058.stdout:/sys/kernel/config 2026-02-23T06:21:30.195 INFO:teuthology.orchestra.run.trial058.stdout:/ 2026-02-23T06:21:30.195 INFO:teuthology.orchestra.run.trial058.stdout:/sys/fs/selinux 2026-02-23T06:21:30.195 INFO:teuthology.orchestra.run.trial058.stdout:/proc/sys/fs/binfmt_misc 2026-02-23T06:21:30.195 INFO:teuthology.orchestra.run.trial058.stdout:/dev/hugepages 2026-02-23T06:21:30.195 INFO:teuthology.orchestra.run.trial058.stdout:/dev/mqueue 2026-02-23T06:21:30.195 INFO:teuthology.orchestra.run.trial058.stdout:/sys/kernel/debug 2026-02-23T06:21:30.195 INFO:teuthology.orchestra.run.trial058.stdout:/sys/kernel/tracing 2026-02-23T06:21:30.195 INFO:teuthology.orchestra.run.trial058.stdout:/sys/fs/fuse/connections 2026-02-23T06:21:30.195 INFO:teuthology.orchestra.run.trial058.stdout:/run/credentials/systemd-sysctl.service 2026-02-23T06:21:30.195 INFO:teuthology.orchestra.run.trial058.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2026-02-23T06:21:30.195 INFO:teuthology.orchestra.run.trial058.stdout:/boot/efi 2026-02-23T06:21:30.195 INFO:teuthology.orchestra.run.trial058.stdout:/run/credentials/systemd-tmpfiles-setup.service 2026-02-23T06:21:30.195 INFO:teuthology.orchestra.run.trial058.stdout:/var/lib/nfs/rpc_pipefs 2026-02-23T06:21:30.195 INFO:teuthology.orchestra.run.trial058.stdout:/run/user/1000 2026-02-23T06:21:30.195 INFO:teuthology.orchestra.run.trial058.stdout:/var/lib/ceph 2026-02-23T06:21:30.195 INFO:teuthology.orchestra.run.trial058.stdout:/var/lib/ceph/osd/ceph-0 2026-02-23T06:21:30.196 INFO:teuthology.orchestra.run.trial058.stdout:/var/lib/ceph/osd/ceph-1 2026-02-23T06:21:30.196 INFO:teuthology.orchestra.run.trial058.stdout:/var/lib/ceph/osd/ceph-2 2026-02-23T06:21:30.196 INFO:teuthology.orchestra.run.trial058.stdout:/var/lib/ceph/osd/ceph-3 2026-02-23T06:21:30.196 INFO:teuthology.orchestra.run.trial058.stdout:/run/netns 2026-02-23T06:21:30.196 INFO:teuthology.orchestra.run.trial058.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-23T06:21:30.196 INFO:teuthology.orchestra.run.trial058.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-23T06:21:30.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-23T06:21:30.196 DEBUG:teuthology.orchestra.run.trial058:> ls /sys/fs/fuse/connections 2026-02-23T06:21:30.273 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2026-02-23T06:21:30.273 DEBUG:teuthology.orchestra.run.trial058:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2026-02-23T06:21:30.317 DEBUG:teuthology.orchestra.run.trial058:> sudo modprobe fuse 2026-02-23T06:21:30.371 DEBUG:teuthology.orchestra.run.trial058:> cat /proc/self/mounts | awk '{print $2}' 2026-02-23T06:21:30.409 INFO:teuthology.orchestra.run.trial058.stdout:/proc 2026-02-23T06:21:30.409 INFO:teuthology.orchestra.run.trial058.stdout:/sys 2026-02-23T06:21:30.409 INFO:teuthology.orchestra.run.trial058.stdout:/dev 2026-02-23T06:21:30.409 INFO:teuthology.orchestra.run.trial058.stdout:/sys/kernel/security 2026-02-23T06:21:30.409 INFO:teuthology.orchestra.run.trial058.stdout:/dev/shm 2026-02-23T06:21:30.409 INFO:teuthology.orchestra.run.trial058.stdout:/dev/pts 2026-02-23T06:21:30.410 INFO:teuthology.orchestra.run.trial058.stdout:/run 2026-02-23T06:21:30.410 INFO:teuthology.orchestra.run.trial058.stdout:/sys/fs/cgroup 2026-02-23T06:21:30.410 INFO:teuthology.orchestra.run.trial058.stdout:/sys/fs/pstore 2026-02-23T06:21:30.410 INFO:teuthology.orchestra.run.trial058.stdout:/sys/firmware/efi/efivars 2026-02-23T06:21:30.410 INFO:teuthology.orchestra.run.trial058.stdout:/sys/fs/bpf 2026-02-23T06:21:30.410 INFO:teuthology.orchestra.run.trial058.stdout:/sys/kernel/config 2026-02-23T06:21:30.410 INFO:teuthology.orchestra.run.trial058.stdout:/ 2026-02-23T06:21:30.410 INFO:teuthology.orchestra.run.trial058.stdout:/sys/fs/selinux 2026-02-23T06:21:30.410 INFO:teuthology.orchestra.run.trial058.stdout:/proc/sys/fs/binfmt_misc 2026-02-23T06:21:30.410 INFO:teuthology.orchestra.run.trial058.stdout:/dev/hugepages 2026-02-23T06:21:30.410 INFO:teuthology.orchestra.run.trial058.stdout:/dev/mqueue 2026-02-23T06:21:30.410 INFO:teuthology.orchestra.run.trial058.stdout:/sys/kernel/debug 2026-02-23T06:21:30.410 INFO:teuthology.orchestra.run.trial058.stdout:/sys/kernel/tracing 2026-02-23T06:21:30.410 INFO:teuthology.orchestra.run.trial058.stdout:/sys/fs/fuse/connections 2026-02-23T06:21:30.410 INFO:teuthology.orchestra.run.trial058.stdout:/run/credentials/systemd-sysctl.service 2026-02-23T06:21:30.410 INFO:teuthology.orchestra.run.trial058.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2026-02-23T06:21:30.410 INFO:teuthology.orchestra.run.trial058.stdout:/boot/efi 2026-02-23T06:21:30.410 INFO:teuthology.orchestra.run.trial058.stdout:/run/credentials/systemd-tmpfiles-setup.service 2026-02-23T06:21:30.410 INFO:teuthology.orchestra.run.trial058.stdout:/var/lib/nfs/rpc_pipefs 2026-02-23T06:21:30.410 INFO:teuthology.orchestra.run.trial058.stdout:/run/user/1000 2026-02-23T06:21:30.410 INFO:teuthology.orchestra.run.trial058.stdout:/var/lib/ceph 2026-02-23T06:21:30.410 INFO:teuthology.orchestra.run.trial058.stdout:/var/lib/ceph/osd/ceph-0 2026-02-23T06:21:30.410 INFO:teuthology.orchestra.run.trial058.stdout:/var/lib/ceph/osd/ceph-1 2026-02-23T06:21:30.410 INFO:teuthology.orchestra.run.trial058.stdout:/var/lib/ceph/osd/ceph-2 2026-02-23T06:21:30.410 INFO:teuthology.orchestra.run.trial058.stdout:/var/lib/ceph/osd/ceph-3 2026-02-23T06:21:30.410 INFO:teuthology.orchestra.run.trial058.stdout:/run/netns 2026-02-23T06:21:30.410 INFO:teuthology.orchestra.run.trial058.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-23T06:21:30.410 INFO:teuthology.orchestra.run.trial058.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-23T06:21:30.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-23T06:21:30.411 DEBUG:teuthology.orchestra.run.trial058:> ls /sys/fs/fuse/connections 2026-02-23T06:21:30.435 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.trial058.stderr:2026-02-23T06:21:30.440+0000 7fa57388a400 -1 init, newargv = 0x12d55340 newargc=13 2026-02-23T06:21:30.435 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.trial058.stderr:2026-02-23T06:21:30.440+0000 7fa57388a400 -1 init, args.argv = 0x12de1260 args.argc=4 2026-02-23T06:21:30.435 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.trial058.stderr:ceph-fuse[51103]: starting ceph client 2026-02-23T06:21:30.443 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.trial058.stderr:ceph-fuse[51103]: starting fuse 2026-02-23T06:21:30.473 INFO:teuthology.orchestra.run.trial058.stdout:43 2026-02-23T06:21:30.474 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2026-02-23T06:21:30.474 DEBUG:teuthology.orchestra.run.trial058:> sudo stdin-killer -- python3 -c ' 2026-02-23T06:21:30.474 DEBUG:teuthology.orchestra.run.trial058:> import glob 2026-02-23T06:21:30.474 DEBUG:teuthology.orchestra.run.trial058:> import re 2026-02-23T06:21:30.474 DEBUG:teuthology.orchestra.run.trial058:> import os 2026-02-23T06:21:30.475 DEBUG:teuthology.orchestra.run.trial058:> import subprocess 2026-02-23T06:21:30.475 DEBUG:teuthology.orchestra.run.trial058:> 2026-02-23T06:21:30.475 DEBUG:teuthology.orchestra.run.trial058:> def _find_admin_socket(client_name): 2026-02-23T06:21:30.475 DEBUG:teuthology.orchestra.run.trial058:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2026-02-23T06:21:30.475 DEBUG:teuthology.orchestra.run.trial058:> files = glob.glob(asok_path) 2026-02-23T06:21:30.475 DEBUG:teuthology.orchestra.run.trial058:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2026-02-23T06:21:30.475 DEBUG:teuthology.orchestra.run.trial058:> 2026-02-23T06:21:30.475 DEBUG:teuthology.orchestra.run.trial058:> # Given a non-glob path, it better be there 2026-02-23T06:21:30.475 DEBUG:teuthology.orchestra.run.trial058:> if "*" not in asok_path: 2026-02-23T06:21:30.475 DEBUG:teuthology.orchestra.run.trial058:> assert(len(files) == 1) 2026-02-23T06:21:30.476 DEBUG:teuthology.orchestra.run.trial058:> return files[0] 2026-02-23T06:21:30.476 DEBUG:teuthology.orchestra.run.trial058:> 2026-02-23T06:21:30.476 DEBUG:teuthology.orchestra.run.trial058:> for f in files: 2026-02-23T06:21:30.476 DEBUG:teuthology.orchestra.run.trial058:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2026-02-23T06:21:30.476 DEBUG:teuthology.orchestra.run.trial058:> if os.path.exists("/proc/{0}".format(pid)): 2026-02-23T06:21:30.476 DEBUG:teuthology.orchestra.run.trial058:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2026-02-23T06:21:30.476 DEBUG:teuthology.orchestra.run.trial058:> contents = proc_f.read() 2026-02-23T06:21:30.476 DEBUG:teuthology.orchestra.run.trial058:> if mountpoint in contents: 2026-02-23T06:21:30.476 DEBUG:teuthology.orchestra.run.trial058:> return f 2026-02-23T06:21:30.476 DEBUG:teuthology.orchestra.run.trial058:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2026-02-23T06:21:30.476 DEBUG:teuthology.orchestra.run.trial058:> 2026-02-23T06:21:30.476 DEBUG:teuthology.orchestra.run.trial058:> print(_find_admin_socket("client.admin")) 2026-02-23T06:21:30.477 DEBUG:teuthology.orchestra.run.trial058:> ' 2026-02-23T06:21:30.610 INFO:teuthology.orchestra.run.trial058.stdout:/var/run/ceph/ceph-client.admin.51103.asok 2026-02-23T06:21:30.612 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-23T06:21:30.620 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.51103.asok 2026-02-23T06:21:30.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-23T06:21:30.621 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.51103.asok status 2026-02-23T06:21:30.768 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:21:30.768 INFO:teuthology.orchestra.run.trial058.stdout: "metadata": { 2026-02-23T06:21:30.768 INFO:teuthology.orchestra.run.trial058.stdout: "ceph_sha1": "b60f86513d744c550fab39595f0905abce2bdd7d", 2026-02-23T06:21:30.768 INFO:teuthology.orchestra.run.trial058.stdout: "ceph_version": "ceph version 20.3.0-5449-gb60f8651 (b60f86513d744c550fab39595f0905abce2bdd7d) tentacle (dev - RelWithDebInfo)", 2026-02-23T06:21:30.769 INFO:teuthology.orchestra.run.trial058.stdout: "entity_id": "admin", 2026-02-23T06:21:30.769 INFO:teuthology.orchestra.run.trial058.stdout: "hostname": "trial058", 2026-02-23T06:21:30.769 INFO:teuthology.orchestra.run.trial058.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2026-02-23T06:21:30.769 INFO:teuthology.orchestra.run.trial058.stdout: "pid": "51103", 2026-02-23T06:21:30.769 INFO:teuthology.orchestra.run.trial058.stdout: "root": "/" 2026-02-23T06:21:30.769 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:30.769 INFO:teuthology.orchestra.run.trial058.stdout: "dentry_count": 0, 2026-02-23T06:21:30.769 INFO:teuthology.orchestra.run.trial058.stdout: "dentry_pinned_count": 0, 2026-02-23T06:21:30.769 INFO:teuthology.orchestra.run.trial058.stdout: "id": 4582, 2026-02-23T06:21:30.769 INFO:teuthology.orchestra.run.trial058.stdout: "inst": { 2026-02-23T06:21:30.770 INFO:teuthology.orchestra.run.trial058.stdout: "name": { 2026-02-23T06:21:30.770 INFO:teuthology.orchestra.run.trial058.stdout: "type": "client", 2026-02-23T06:21:30.770 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4582 2026-02-23T06:21:30.770 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:30.770 INFO:teuthology.orchestra.run.trial058.stdout: "addr": { 2026-02-23T06:21:30.770 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:21:30.770 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:0", 2026-02-23T06:21:30.770 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 867469145 2026-02-23T06:21:30.770 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:21:30.770 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:30.770 INFO:teuthology.orchestra.run.trial058.stdout: "addr": { 2026-02-23T06:21:30.771 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:21:30.771 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:0", 2026-02-23T06:21:30.771 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 867469145 2026-02-23T06:21:30.771 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:30.771 INFO:teuthology.orchestra.run.trial058.stdout: "inst_str": "client.4582 10.20.193.58:0/867469145", 2026-02-23T06:21:30.771 INFO:teuthology.orchestra.run.trial058.stdout: "addr_str": "10.20.193.58:0/867469145", 2026-02-23T06:21:30.771 INFO:teuthology.orchestra.run.trial058.stdout: "inode_count": 1, 2026-02-23T06:21:30.771 INFO:teuthology.orchestra.run.trial058.stdout: "mds_epoch": 5, 2026-02-23T06:21:30.771 INFO:teuthology.orchestra.run.trial058.stdout: "osd_epoch": 25, 2026-02-23T06:21:30.771 INFO:teuthology.orchestra.run.trial058.stdout: "osd_epoch_barrier": 0, 2026-02-23T06:21:30.772 INFO:teuthology.orchestra.run.trial058.stdout: "blocklisted": false, 2026-02-23T06:21:30.772 INFO:teuthology.orchestra.run.trial058.stdout: "fs_name": "cephfs" 2026-02-23T06:21:30.772 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:21:30.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-23T06:21:30.776 DEBUG:teuthology.orchestra.run.trial058:> stat --file-system '--printf=%T 2026-02-23T06:21:30.776 DEBUG:teuthology.orchestra.run.trial058:> ' -- /home/ubuntu/cephtest/mnt.admin 2026-02-23T06:21:30.815 INFO:teuthology.orchestra.run.trial058.stdout:fuseblk 2026-02-23T06:21:30.816 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2026-02-23T06:21:30.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-23T06:21:30.816 DEBUG:teuthology.orchestra.run.trial058:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2026-02-23T06:21:30.912 DEBUG:teuthology.orchestra.run.trial058:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2026-02-23T06:21:30.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2026-02-23T06:21:30.988 INFO:teuthology.orchestra.run.trial058.stdout:# file: . 2026-02-23T06:21:30.988 INFO:teuthology.orchestra.run.trial058.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2026-02-23T06:21:30.988 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:30.988 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-23T06:21:30.994 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:21:30.994 DEBUG:teuthology.orchestra.run.trial058:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-23T06:21:31.034 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2026-02-23T06:21:31.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.200+0000 7f4a333d2640 1 -- 10.20.193.58:0/255945039 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4a2c15c040 msgr2=0x7f4a2c05b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:31.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.200+0000 7f4a333d2640 1 --2- 10.20.193.58:0/255945039 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4a2c15c040 0x7f4a2c05b0e0 secure :-1 s=READY pgs=92 gs=3 cs=0 l=1 c_cookie=9002503378348203339 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a2c059aa0 tx=0x7f4a2002f190 comp rx=0 tx=0).stop 2026-02-23T06:21:31.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.200+0000 7f4a333d2640 1 -- 10.20.193.58:0/255945039 shutdown_connections 2026-02-23T06:21:31.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.200+0000 7f4a333d2640 1 --2- 10.20.193.58:0/255945039 >> v2:10.20.193.93:3300/0 conn(0x7f4a2c056550 0x7f4a2c05ce30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:31.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.200+0000 7f4a333d2640 1 --2- 10.20.193.58:0/255945039 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4a2c15c040 0x7f4a2c05b0e0 unknown :-1 s=CLOSED pgs=92 gs=3 cs=0 l=1 c_cookie=9002503378348203339 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:31.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.200+0000 7f4a333d2640 1 -- 10.20.193.58:0/255945039 >> 10.20.193.58:0/255945039 conn(0x7f4a2c0b3c20 msgr2=0x7f4a2c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:31.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.200+0000 7f4a333d2640 1 -- 10.20.193.58:0/255945039 shutdown_connections 2026-02-23T06:21:31.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.200+0000 7f4a333d2640 1 -- 10.20.193.58:0/255945039 wait complete. 2026-02-23T06:21:31.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.201+0000 7f4a333d2640 1 Processor -- start 2026-02-23T06:21:31.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.201+0000 7f4a333d2640 1 -- start start 2026-02-23T06:21:31.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.202+0000 7f4a333d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4a2c056550 0x7f4a2c153260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:31.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.202+0000 7f4a333d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4a2c05d370 0x7f4a2c201c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:31.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.202+0000 7f4a333d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4a2c15c040 0x7f4a2c154f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:31.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.202+0000 7f4a333d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2c1559a0 con 0x7f4a2c15c040 2026-02-23T06:21:31.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.202+0000 7f4a333d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2c162b20 con 0x7f4a2c056550 2026-02-23T06:21:31.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.202+0000 7f4a333d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f4a2c162560 con 0x7f4a2c05d370 2026-02-23T06:21:31.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.202+0000 7f4a31bcf640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4a2c05d370 0x7f4a2c201c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:31.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.202+0000 7f4a31bcf640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4a2c05d370 0x7f4a2c201c00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:50444/0 (socket says 10.20.193.58:50444) 2026-02-23T06:21:31.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.202+0000 7f4a31bcf640 1 -- 10.20.193.58:0/3940516875 learned_addr learned my addr 10.20.193.58:0/3940516875 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:31.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.202+0000 7f4a323d0640 1 --2- 10.20.193.58:0/3940516875 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4a2c056550 0x7f4a2c153260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:31.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.202+0000 7f4a32bd1640 1 --2- 10.20.193.58:0/3940516875 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4a2c15c040 0x7f4a2c154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:31.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.202+0000 7f4a31bcf640 1 -- 10.20.193.58:0/3940516875 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4a2c056550 msgr2=0x7f4a2c153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:31.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.202+0000 7f4a31bcf640 1 --2- 10.20.193.58:0/3940516875 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4a2c056550 0x7f4a2c153260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:31.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.202+0000 7f4a31bcf640 1 -- 10.20.193.58:0/3940516875 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4a2c15c040 msgr2=0x7f4a2c154f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:31.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.202+0000 7f4a31bcf640 1 --2- 10.20.193.58:0/3940516875 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4a2c15c040 0x7f4a2c154f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:31.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.202+0000 7f4a31bcf640 1 -- 10.20.193.58:0/3940516875 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a200094b0 con 0x7f4a2c05d370 2026-02-23T06:21:31.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.203+0000 7f4a31bcf640 1 --2- 10.20.193.58:0/3940516875 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4a2c05d370 0x7f4a2c201c00 secure :-1 s=READY pgs=60 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a18009480 tx=0x7f4a1800ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:31.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.203+0000 7f4a16ffd640 1 -- 10.20.193.58:0/3940516875 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4a1800cd40 con 0x7f4a2c05d370 2026-02-23T06:21:31.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.203+0000 7f4a333d2640 1 -- 10.20.193.58:0/3940516875 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a2c162840 con 0x7f4a2c05d370 2026-02-23T06:21:31.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.203+0000 7f4a16ffd640 1 -- 10.20.193.58:0/3940516875 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a18004850 con 0x7f4a2c05d370 2026-02-23T06:21:31.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.203+0000 7f4a16ffd640 1 -- 10.20.193.58:0/3940516875 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4a1800cea0 con 0x7f4a2c05d370 2026-02-23T06:21:31.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.203+0000 7f4a333d2640 1 -- 10.20.193.58:0/3940516875 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a2c201400 con 0x7f4a2c05d370 2026-02-23T06:21:31.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.204+0000 7f4a333d2640 1 -- 10.20.193.58:0/3940516875 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a2c05d970 con 0x7f4a2c05d370 2026-02-23T06:21:31.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.205+0000 7f4a16ffd640 1 -- 10.20.193.58:0/3940516875 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f4a1801f060 con 0x7f4a2c05d370 2026-02-23T06:21:31.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.206+0000 7f4a16ffd640 1 --2- 10.20.193.58:0/3940516875 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f49fc07a6c0 0x7f49fc09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:31.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.206+0000 7f4a16ffd640 1 -- 10.20.193.58:0/3940516875 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f4a18014070 con 0x7f4a2c05d370 2026-02-23T06:21:31.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.206+0000 7f4a323d0640 1 --2- 10.20.193.58:0/3940516875 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f49fc07a6c0 0x7f49fc09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:31.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.207+0000 7f4a16ffd640 1 -- 10.20.193.58:0/3940516875 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f4a18060fb0 con 0x7f4a2c05d370 2026-02-23T06:21:31.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.207+0000 7f4a323d0640 1 --2- 10.20.193.58:0/3940516875 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f49fc07a6c0 0x7f49fc09ab70 secure :-1 s=READY pgs=59 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a200097e0 tx=0x7f4a20031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:31.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.329+0000 7f4a333d2640 1 -- 10.20.193.58:0/3940516875 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4a2c05ce30 con 0x7f4a2c05d370 2026-02-23T06:21:31.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.329+0000 7f4a16ffd640 1 -- 10.20.193.58:0/3940516875 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f4a180640d0 con 0x7f4a2c05d370 2026-02-23T06:21:31.324 INFO:teuthology.orchestra.run.trial058.stderr:listed 0 entries 2026-02-23T06:21:31.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.330+0000 7f4a333d2640 1 -- 10.20.193.58:0/3940516875 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f49fc07a6c0 msgr2=0x7f49fc09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:31.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.330+0000 7f4a333d2640 1 --2- 10.20.193.58:0/3940516875 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f49fc07a6c0 0x7f49fc09ab70 secure :-1 s=READY pgs=59 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a200097e0 tx=0x7f4a20031040 comp rx=0 tx=0).stop 2026-02-23T06:21:31.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.330+0000 7f4a333d2640 1 -- 10.20.193.58:0/3940516875 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4a2c05d370 msgr2=0x7f4a2c201c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:31.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.330+0000 7f4a333d2640 1 --2- 10.20.193.58:0/3940516875 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4a2c05d370 0x7f4a2c201c00 secure :-1 s=READY pgs=60 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a18009480 tx=0x7f4a1800ee60 comp rx=0 tx=0).stop 2026-02-23T06:21:31.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.330+0000 7f4a333d2640 1 -- 10.20.193.58:0/3940516875 shutdown_connections 2026-02-23T06:21:31.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.330+0000 7f4a333d2640 1 --2- 10.20.193.58:0/3940516875 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f49fc07a6c0 0x7f49fc09ab70 unknown :-1 s=CLOSED pgs=59 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:31.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.330+0000 7f4a333d2640 1 --2- 10.20.193.58:0/3940516875 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4a2c15c040 0x7f4a2c154f30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:31.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.330+0000 7f4a333d2640 1 --2- 10.20.193.58:0/3940516875 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4a2c05d370 0x7f4a2c201c00 unknown :-1 s=CLOSED pgs=60 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:31.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.330+0000 7f4a333d2640 1 --2- 10.20.193.58:0/3940516875 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4a2c056550 0x7f4a2c153260 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:31.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.330+0000 7f4a333d2640 1 -- 10.20.193.58:0/3940516875 >> 10.20.193.58:0/3940516875 conn(0x7f4a2c0b3c20 msgr2=0x7f4a2c0b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:31.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.330+0000 7f4a333d2640 1 -- 10.20.193.58:0/3940516875 shutdown_connections 2026-02-23T06:21:31.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.330+0000 7f4a333d2640 1 -- 10.20.193.58:0/3940516875 wait complete. 2026-02-23T06:21:31.337 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:21:31.337 DEBUG:teuthology.orchestra.run.trial058:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-23T06:21:31.376 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2026-02-23T06:21:31.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.541+0000 7ff1121d2640 1 -- 10.20.193.58:0/2769001292 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff10c0b5680 msgr2=0x7ff10c0b5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:31.538 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.541+0000 7ff1121d2640 1 --2- 10.20.193.58:0/2769001292 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff10c0b5680 0x7ff10c0b5b20 secure :-1 s=READY pgs=93 gs=3 cs=0 l=1 c_cookie=16465870487152237714 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff108006f50 tx=0x7ff108030360 comp rx=0 tx=0).stop 2026-02-23T06:21:31.538 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.541+0000 7ff1121d2640 1 -- 10.20.193.58:0/2769001292 shutdown_connections 2026-02-23T06:21:31.538 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.541+0000 7ff1121d2640 1 --2- 10.20.193.58:0/2769001292 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff10c0b5680 0x7ff10c0b5b20 unknown :-1 s=CLOSED pgs=93 gs=3 cs=0 l=1 c_cookie=16465870487152237714 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:31.538 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.541+0000 7ff1121d2640 1 --2- 10.20.193.58:0/2769001292 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff10c15c040 0x7ff10c05b0e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:31.538 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.541+0000 7ff1121d2640 1 -- 10.20.193.58:0/2769001292 >> 10.20.193.58:0/2769001292 conn(0x7ff10c0b3c20 msgr2=0x7ff10c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:31.538 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.541+0000 7ff1121d2640 1 -- 10.20.193.58:0/2769001292 shutdown_connections 2026-02-23T06:21:31.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.541+0000 7ff1121d2640 1 -- 10.20.193.58:0/2769001292 wait complete. 2026-02-23T06:21:31.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.542+0000 7ff1121d2640 1 Processor -- start 2026-02-23T06:21:31.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.543+0000 7ff1121d2640 1 -- start start 2026-02-23T06:21:31.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.543+0000 7ff1121d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff10c056550 0x7ff10c153b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:31.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.543+0000 7ff1121d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff10c0b5680 0x7ff10c1513d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:31.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.543+0000 7ff1121d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff10c15c040 0x7ff10c151910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:31.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.543+0000 7ff1121d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff10c15d5e0 con 0x7ff10c0b5680 2026-02-23T06:21:31.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.543+0000 7ff1121d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff10c1fda60 con 0x7ff10c056550 2026-02-23T06:21:31.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.543+0000 7ff1121d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7ff10c15c810 con 0x7ff10c15c040 2026-02-23T06:21:31.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.543+0000 7ff1111d0640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff10c056550 0x7ff10c153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:31.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.543+0000 7ff1109cf640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff10c0b5680 0x7ff10c1513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:31.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.543+0000 7ff1111d0640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff10c056550 0x7ff10c153b00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:50098/0 (socket says 10.20.193.58:50098) 2026-02-23T06:21:31.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.543+0000 7ff1111d0640 1 -- 10.20.193.58:0/2910443165 learned_addr learned my addr 10.20.193.58:0/2910443165 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:31.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.543+0000 7ff1119d1640 1 --2- 10.20.193.58:0/2910443165 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff10c15c040 0x7ff10c151910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:31.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.544+0000 7ff1109cf640 1 -- 10.20.193.58:0/2910443165 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff10c15c040 msgr2=0x7ff10c151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:31.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.544+0000 7ff1109cf640 1 --2- 10.20.193.58:0/2910443165 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff10c15c040 0x7ff10c151910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:31.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.544+0000 7ff1109cf640 1 -- 10.20.193.58:0/2910443165 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff10c056550 msgr2=0x7ff10c153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:31.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.544+0000 7ff1109cf640 1 --2- 10.20.193.58:0/2910443165 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff10c056550 0x7ff10c153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:31.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.544+0000 7ff1109cf640 1 -- 10.20.193.58:0/2910443165 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff10800a650 con 0x7ff10c0b5680 2026-02-23T06:21:31.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.544+0000 7ff1109cf640 1 --2- 10.20.193.58:0/2910443165 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff10c0b5680 0x7ff10c1513d0 secure :-1 s=READY pgs=94 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff10000c410 tx=0x7ff100003640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:31.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.544+0000 7ff0f9ffb640 1 -- 10.20.193.58:0/2910443165 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff100006ab0 con 0x7ff10c0b5680 2026-02-23T06:21:31.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.544+0000 7ff1121d2640 1 -- 10.20.193.58:0/2910443165 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff10c15ca60 con 0x7ff10c0b5680 2026-02-23T06:21:31.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.544+0000 7ff0f9ffb640 1 -- 10.20.193.58:0/2910443165 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff100006d00 con 0x7ff10c0b5680 2026-02-23T06:21:31.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.544+0000 7ff0f9ffb640 1 -- 10.20.193.58:0/2910443165 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff1000072b0 con 0x7ff10c0b5680 2026-02-23T06:21:31.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.544+0000 7ff1121d2640 1 -- 10.20.193.58:0/2910443165 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff10c15d020 con 0x7ff10c0b5680 2026-02-23T06:21:31.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.545+0000 7ff1121d2640 1 -- 10.20.193.58:0/2910443165 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff10c05d9c0 con 0x7ff10c0b5680 2026-02-23T06:21:31.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.546+0000 7ff0f9ffb640 1 -- 10.20.193.58:0/2910443165 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7ff100007410 con 0x7ff10c0b5680 2026-02-23T06:21:31.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.547+0000 7ff0f9ffb640 1 --2- 10.20.193.58:0/2910443165 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff0dc07a6c0 0x7ff0dc09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:31.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.547+0000 7ff0f9ffb640 1 -- 10.20.193.58:0/2910443165 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7ff10009cb30 con 0x7ff10c0b5680 2026-02-23T06:21:31.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.547+0000 7ff1111d0640 1 --2- 10.20.193.58:0/2910443165 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff0dc07a6c0 0x7ff0dc09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:31.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.548+0000 7ff1111d0640 1 --2- 10.20.193.58:0/2910443165 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff0dc07a6c0 0x7ff0dc09ab70 secure :-1 s=READY pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0fc005c70 tx=0x7ff0fc00b4a0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:31.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.549+0000 7ff0f9ffb640 1 -- 10.20.193.58:0/2910443165 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7ff10005fe00 con 0x7ff10c0b5680 2026-02-23T06:21:31.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.666+0000 7ff1121d2640 1 -- 10.20.193.58:0/2910443165 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff10c056330 con 0x7ff10c0b5680 2026-02-23T06:21:31.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.666+0000 7ff0f9ffb640 1 -- 10.20.193.58:0/2910443165 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7ff100062f20 con 0x7ff10c0b5680 2026-02-23T06:21:31.661 INFO:teuthology.orchestra.run.trial058.stderr:listed 0 entries 2026-02-23T06:21:31.662 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.667+0000 7ff1121d2640 1 -- 10.20.193.58:0/2910443165 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff0dc07a6c0 msgr2=0x7ff0dc09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:31.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.667+0000 7ff1121d2640 1 --2- 10.20.193.58:0/2910443165 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff0dc07a6c0 0x7ff0dc09ab70 secure :-1 s=READY pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0fc005c70 tx=0x7ff0fc00b4a0 comp rx=0 tx=0).stop 2026-02-23T06:21:31.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.667+0000 7ff1121d2640 1 -- 10.20.193.58:0/2910443165 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff10c0b5680 msgr2=0x7ff10c1513d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:31.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.667+0000 7ff1121d2640 1 --2- 10.20.193.58:0/2910443165 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff10c0b5680 0x7ff10c1513d0 secure :-1 s=READY pgs=94 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff10000c410 tx=0x7ff100003640 comp rx=0 tx=0).stop 2026-02-23T06:21:31.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.667+0000 7ff1121d2640 1 -- 10.20.193.58:0/2910443165 shutdown_connections 2026-02-23T06:21:31.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.667+0000 7ff1121d2640 1 --2- 10.20.193.58:0/2910443165 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff0dc07a6c0 0x7ff0dc09ab70 unknown :-1 s=CLOSED pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:31.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.667+0000 7ff1121d2640 1 --2- 10.20.193.58:0/2910443165 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff10c15c040 0x7ff10c151910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:31.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.667+0000 7ff1121d2640 1 --2- 10.20.193.58:0/2910443165 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff10c0b5680 0x7ff10c1513d0 unknown :-1 s=CLOSED pgs=94 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:31.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.667+0000 7ff1121d2640 1 --2- 10.20.193.58:0/2910443165 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff10c056550 0x7ff10c153b00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:31.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.667+0000 7ff1121d2640 1 -- 10.20.193.58:0/2910443165 >> 10.20.193.58:0/2910443165 conn(0x7ff10c0b3c20 msgr2=0x7ff10c05cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:31.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.668+0000 7ff1121d2640 1 -- 10.20.193.58:0/2910443165 shutdown_connections 2026-02-23T06:21:31.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:31.668+0000 7ff1121d2640 1 -- 10.20.193.58:0/2910443165 wait complete. 2026-02-23T06:21:31.675 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@trial058.front.sepia.ceph.com... 2026-02-23T06:21:31.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-23T06:21:31.675 DEBUG:teuthology.orchestra.run.trial058:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2026-02-23T06:21:31.729 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.trial058.stderr:ceph-fuse[51103]: fuse finished with error 0 and tester_r 0 2026-02-23T06:21:31.732 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:21:31.825 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@trial058.front.sepia.ceph.com 2026-02-23T06:21:31.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-23T06:21:31.826 DEBUG:teuthology.orchestra.run.trial058:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2026-02-23T06:21:31.865 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-23T06:21:32.027 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.032+0000 7fbf4ab1c640 1 -- 10.20.193.58:0/1741120529 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf2c0050b0 msgr2=0x7fbf2c065a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:32.027 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.032+0000 7fbf4ab1c640 1 --2- 10.20.193.58:0/1741120529 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf2c0050b0 0x7fbf2c065a10 secure :-1 s=READY pgs=96 gs=6 cs=0 l=1 c_cookie=1140676202007439525 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf40007fd0 tx=0x7fbf40030990 comp rx=0 tx=0).stop 2026-02-23T06:21:32.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.032+0000 7fbf4a31b640 1 -- 10.20.193.58:0/1741120529 reap_dead start 2026-02-23T06:21:32.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.032+0000 7fbf4ab1c640 1 -- 10.20.193.58:0/1741120529 shutdown_connections 2026-02-23T06:21:32.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.032+0000 7fbf4ab1c640 1 -- 10.20.193.58:0/1741120529 >> 10.20.193.58:0/1741120529 conn(0x7fbf440b3c20 msgr2=0x7fbf440b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:32.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.032+0000 7fbf4ab1c640 1 -- 10.20.193.58:0/1741120529 shutdown_connections 2026-02-23T06:21:32.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.032+0000 7fbf4ab1c640 1 -- 10.20.193.58:0/1741120529 wait complete. 2026-02-23T06:21:32.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.033+0000 7fbf4ab1c640 1 Processor -- start 2026-02-23T06:21:32.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.033+0000 7fbf4ab1c640 1 -- start start 2026-02-23T06:21:32.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.034+0000 7fbf4ab1c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf44126e30 0x7fbf44162db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:32.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.034+0000 7fbf4ab1c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbf44057ae0 0x7fbf44127200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:32.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.034+0000 7fbf4ab1c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf44162310 0x7fbf441505b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:32.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.034+0000 7fbf4ab1c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fbf44140f30 con 0x7fbf44162310 2026-02-23T06:21:32.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.034+0000 7fbf4ab1c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fbf44057f30 con 0x7fbf44126e30 2026-02-23T06:21:32.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.034+0000 7fbf4ab1c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fbf44127740 con 0x7fbf44057ae0 2026-02-23T06:21:32.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.034+0000 7fbf4a31b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf44162310 0x7fbf441505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:32.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.034+0000 7fbf4a31b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf44162310 0x7fbf441505b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50610/0 (socket says 10.20.193.58:50610) 2026-02-23T06:21:32.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.034+0000 7fbf4a31b640 1 -- 10.20.193.58:0/1539653831 learned_addr learned my addr 10.20.193.58:0/1539653831 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:32.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.034+0000 7fbf49b1a640 1 --2- 10.20.193.58:0/1539653831 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf44126e30 0x7fbf44162db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:32.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.034+0000 7fbf49319640 1 --2- 10.20.193.58:0/1539653831 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbf44057ae0 0x7fbf44127200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:32.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.034+0000 7fbf4a31b640 1 -- 10.20.193.58:0/1539653831 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbf44057ae0 msgr2=0x7fbf44127200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:32.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.034+0000 7fbf4a31b640 1 --2- 10.20.193.58:0/1539653831 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbf44057ae0 0x7fbf44127200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:32.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.034+0000 7fbf4a31b640 1 -- 10.20.193.58:0/1539653831 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf44126e30 msgr2=0x7fbf44162db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:32.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.034+0000 7fbf4a31b640 1 --2- 10.20.193.58:0/1539653831 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf44126e30 0x7fbf44162db0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:32.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.034+0000 7fbf4a31b640 1 -- 10.20.193.58:0/1539653831 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf44140440 con 0x7fbf44162310 2026-02-23T06:21:32.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.034+0000 7fbf4a31b640 1 --2- 10.20.193.58:0/1539653831 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf44162310 0x7fbf441505b0 secure :-1 s=READY pgs=97 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf400039c0 tx=0x7fbf40004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:32.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.035+0000 7fbf327fc640 1 -- 10.20.193.58:0/1539653831 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf40003e00 con 0x7fbf44162310 2026-02-23T06:21:32.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.035+0000 7fbf327fc640 1 -- 10.20.193.58:0/1539653831 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf400070e0 con 0x7fbf44162310 2026-02-23T06:21:32.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.035+0000 7fbf327fc640 1 -- 10.20.193.58:0/1539653831 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf40007510 con 0x7fbf44162310 2026-02-23T06:21:32.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.035+0000 7fbf4ab1c640 1 -- 10.20.193.58:0/1539653831 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf44058140 con 0x7fbf44162310 2026-02-23T06:21:32.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.035+0000 7fbf4ab1c640 1 -- 10.20.193.58:0/1539653831 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf44140970 con 0x7fbf44162310 2026-02-23T06:21:32.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.035+0000 7fbf4ab1c640 1 -- 10.20.193.58:0/1539653831 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf440b7260 con 0x7fbf44162310 2026-02-23T06:21:32.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.037+0000 7fbf327fc640 1 -- 10.20.193.58:0/1539653831 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fbf4004a020 con 0x7fbf44162310 2026-02-23T06:21:32.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.038+0000 7fbf327fc640 1 --2- 10.20.193.58:0/1539653831 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbf1407a6c0 0x7fbf1409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:32.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.038+0000 7fbf327fc640 1 -- 10.20.193.58:0/1539653831 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7fbf40089580 con 0x7fbf44162310 2026-02-23T06:21:32.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.038+0000 7fbf49b1a640 1 --2- 10.20.193.58:0/1539653831 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbf1407a6c0 0x7fbf1409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:32.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.039+0000 7fbf327fc640 1 -- 10.20.193.58:0/1539653831 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fbf40085260 con 0x7fbf44162310 2026-02-23T06:21:32.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.039+0000 7fbf49b1a640 1 --2- 10.20.193.58:0/1539653831 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbf1407a6c0 0x7fbf1409ab70 secure :-1 s=READY pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf440b5040 tx=0x7fbf34005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:32.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.152+0000 7fbf4ab1c640 1 -- 10.20.193.58:0/1539653831 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbf4415af30 con 0x7fbf44162310 2026-02-23T06:21:32.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.153+0000 7fbf327fc640 1 -- 10.20.193.58:0/1539653831 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18600 (secure 0 0 0) 0x7fbf40088380 con 0x7fbf44162310 2026-02-23T06:21:32.147 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:32.148 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":25,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","created":"2026-02-23T06:21:02.010508+0000","modified":"2026-02-23T06:21:22.447858+0000","last_up_change":"2026-02-23T06:21:08.383048+0000","last_in_change":"2026-02-23T06:21:04.690899+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-23T06:21:10.389081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-23T06:21:16.080621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-23T06:21:16.401311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-23T06:21:20.153808+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"96cc0898-14bb-4d56-827a-8845bd4307c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6808","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6809","nonce":692913334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6810","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6811","nonce":692913334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6814","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6815","nonce":692913334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6812","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6813","nonce":692913334}]},"public_addr":"10.20.193.58:6809/692913334","cluster_addr":"10.20.193.58:6811/692913334","heartbeat_back_addr":"10.20.193.58:6815/692913334","heartbeat_front_addr":"10.20.193.58:6813/692913334","state":["exists","up"]},{"osd":1,"uuid":"bf665af4-6e3c-4cb3-899c-acede65c31f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6800","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6801","nonce":1850584280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6802","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6803","nonce":1850584280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6806","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6807","nonce":1850584280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6804","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6805","nonce":1850584280}]},"public_addr":"10.20.193.58:6801/1850584280","cluster_addr":"10.20.193.58:6803/1850584280","heartbeat_back_addr":"10.20.193.58:6807/1850584280","heartbeat_front_addr":"10.20.193.58:6805/1850584280","state":["exists","up"]},{"osd":2,"uuid":"2bcb3165-28ad-45d6-9a49-9d9da08501f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6823","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6825","nonce":4284600061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6826","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6827","nonce":4284600061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6830","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6831","nonce":4284600061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6828","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6829","nonce":4284600061}]},"public_addr":"10.20.193.58:6825/4284600061","cluster_addr":"10.20.193.58:6827/4284600061","heartbeat_back_addr":"10.20.193.58:6831/4284600061","heartbeat_front_addr":"10.20.193.58:6829/4284600061","state":["exists","up"]},{"osd":3,"uuid":"4750309a-5bf2-4f48-a550-ca677b0b0f61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6816","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6817","nonce":2858636994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6818","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6819","nonce":2858636994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6822","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6824","nonce":2858636994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6820","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6821","nonce":2858636994}]},"public_addr":"10.20.193.58:6817/2858636994","cluster_addr":"10.20.193.58:6819/2858636994","heartbeat_back_addr":"10.20.193.58:6824/2858636994","heartbeat_front_addr":"10.20.193.58:6821/2858636994","state":["exists","up"]},{"osd":4,"uuid":"5cbb50f2-4e49-46eb-bd84-d92706459d2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6803","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6805","nonce":1874834171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6807","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6809","nonce":1874834171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6816","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6817","nonce":1874834171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6812","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6814","nonce":1874834171}]},"public_addr":"10.20.193.93:6805/1874834171","cluster_addr":"10.20.193.93:6809/1874834171","heartbeat_back_addr":"10.20.193.93:6817/1874834171","heartbeat_front_addr":"10.20.193.93:6814/1874834171","state":["exists","up"]},{"osd":5,"uuid":"2806c775-4720-43a7-ab9f-85a4adb31098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6802","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6804","nonce":356968280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6806","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6808","nonce":356968280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6813","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6815","nonce":356968280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6810","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6811","nonce":356968280}]},"public_addr":"10.20.193.93:6804/356968280","cluster_addr":"10.20.193.93:6808/356968280","heartbeat_back_addr":"10.20.193.93:6815/356968280","heartbeat_front_addr":"10.20.193.93:6811/356968280","state":["exists","up"]},{"osd":6,"uuid":"aa03b46d-d30f-4b09-9251-c9514e8b8b6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6819","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6821","nonce":2948039088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6823","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6825","nonce":2948039088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6831","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6833","nonce":2948039088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6827","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6829","nonce":2948039088}]},"public_addr":"10.20.193.93:6821/2948039088","cluster_addr":"10.20.193.93:6825/2948039088","heartbeat_back_addr":"10.20.193.93:6833/2948039088","heartbeat_front_addr":"10.20.193.93:6829/2948039088","state":["exists","up"]},{"osd":7,"uuid":"b15519bf-2b7b-4fd5-8ef6-e09af0ad9817","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6818","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6820","nonce":2960650087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6822","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6824","nonce":2960650087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6830","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6832","nonce":2960650087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6826","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6828","nonce":2960650087}]},"public_addr":"10.20.193.93:6820/2960650087","cluster_addr":"10.20.193.93:6824/2960650087","heartbeat_back_addr":"10.20.193.93:6832/2960650087","heartbeat_front_addr":"10.20.193.93:6828/2960650087","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.717515+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.744114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.772247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.768341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.521808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.486005+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.480882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.473408+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"2","m":"2","plugin":"isa","technique":"reed_sol_van"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-23T06:21:32.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.154+0000 7fbf4ab1c640 1 -- 10.20.193.58:0/1539653831 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbf1407a6c0 msgr2=0x7fbf1409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:32.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.154+0000 7fbf4ab1c640 1 --2- 10.20.193.58:0/1539653831 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbf1407a6c0 0x7fbf1409ab70 secure :-1 s=READY pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf440b5040 tx=0x7fbf34005f90 comp rx=0 tx=0).stop 2026-02-23T06:21:32.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.154+0000 7fbf4ab1c640 1 -- 10.20.193.58:0/1539653831 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf44162310 msgr2=0x7fbf441505b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:32.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.154+0000 7fbf4ab1c640 1 --2- 10.20.193.58:0/1539653831 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf44162310 0x7fbf441505b0 secure :-1 s=READY pgs=97 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf400039c0 tx=0x7fbf40004600 comp rx=0 tx=0).stop 2026-02-23T06:21:32.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.154+0000 7fbf4ab1c640 1 -- 10.20.193.58:0/1539653831 shutdown_connections 2026-02-23T06:21:32.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.154+0000 7fbf4ab1c640 1 --2- 10.20.193.58:0/1539653831 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbf1407a6c0 0x7fbf1409ab70 unknown :-1 s=CLOSED pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:32.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.154+0000 7fbf4ab1c640 1 --2- 10.20.193.58:0/1539653831 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf44162310 0x7fbf441505b0 unknown :-1 s=CLOSED pgs=97 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:32.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.154+0000 7fbf4ab1c640 1 --2- 10.20.193.58:0/1539653831 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbf44057ae0 0x7fbf44127200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:32.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.154+0000 7fbf4ab1c640 1 --2- 10.20.193.58:0/1539653831 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf44126e30 0x7fbf44162db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:32.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.154+0000 7fbf4ab1c640 1 -- 10.20.193.58:0/1539653831 >> 10.20.193.58:0/1539653831 conn(0x7fbf440b3c20 msgr2=0x7fbf440b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:32.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.154+0000 7fbf4ab1c640 1 -- 10.20.193.58:0/1539653831 shutdown_connections 2026-02-23T06:21:32.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.154+0000 7fbf4ab1c640 1 -- 10.20.193.58:0/1539653831 wait complete. 2026-02-23T06:21:32.161 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-23T06:21:32.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.287+0000 7feccdc43640 1 -- 10.20.193.58:0/3465560196 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fecc815d870 msgr2=0x7fecc80587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:32.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.287+0000 7feccdc43640 1 --2- 10.20.193.58:0/3465560196 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fecc815d870 0x7fecc80587b0 secure :-1 s=READY pgs=114 gs=3 cs=0 l=1 c_cookie=9209396739566063238 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecc8059740 tx=0x7fecb002f190 comp rx=0 tx=0).stop 2026-02-23T06:21:32.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.287+0000 7feccdc43640 1 -- 10.20.193.58:0/3465560196 shutdown_connections 2026-02-23T06:21:32.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.287+0000 7feccdc43640 1 --2- 10.20.193.58:0/3465560196 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fecc815d870 0x7fecc80587b0 unknown :-1 s=CLOSED pgs=114 gs=3 cs=0 l=1 c_cookie=9209396739566063238 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:32.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.287+0000 7feccdc43640 1 --2- 10.20.193.58:0/3465560196 >> v2:10.20.193.58:3300/0 conn(0x7fecc815d4a0 0x7fecc80affb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:32.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.287+0000 7feccdc43640 1 -- 10.20.193.58:0/3465560196 >> 10.20.193.58:0/3465560196 conn(0x7fecc80b3c20 msgr2=0x7fecc80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:32.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.287+0000 7feccdc43640 1 -- 10.20.193.58:0/3465560196 shutdown_connections 2026-02-23T06:21:32.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.287+0000 7feccdc43640 1 -- 10.20.193.58:0/3465560196 wait complete. 2026-02-23T06:21:32.285 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.288+0000 7feccdc43640 1 Processor -- start 2026-02-23T06:21:32.285 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.288+0000 7feccdc43640 1 -- start start 2026-02-23T06:21:32.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.289+0000 7feccdc43640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fecc80b6690 0x7fecc814dfb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:32.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.289+0000 7feccdc43640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fecc815d4a0 0x7fecc8121e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:32.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.289+0000 7fecbffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fecc815d4a0 0x7fecc8121e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:32.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.289+0000 7fecccc41640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fecc80b6690 0x7fecc814dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:32.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.289+0000 7fecbffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fecc815d4a0 0x7fecc8121e60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50634/0 (socket says 10.20.193.58:50634) 2026-02-23T06:21:32.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.289+0000 7fecccc41640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fecc80b6690 0x7fecc814dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:50522/0 (socket says 10.20.193.58:50522) 2026-02-23T06:21:32.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.289+0000 7feccdc43640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fecc815d870 0x7fecc813f520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:32.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.289+0000 7feccdc43640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fecc814db90 con 0x7fecc815d4a0 2026-02-23T06:21:32.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.289+0000 7feccdc43640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fecc8120d80 con 0x7fecc815d870 2026-02-23T06:21:32.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.289+0000 7feccdc43640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fecc8121500 con 0x7fecc80b6690 2026-02-23T06:21:32.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.289+0000 7fecbffff640 1 -- 10.20.193.58:0/1467483118 learned_addr learned my addr 10.20.193.58:0/1467483118 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:32.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.289+0000 7fecbffff640 1 -- 10.20.193.58:0/1467483118 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fecc80b6690 msgr2=0x7fecc814dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:32.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.289+0000 7fecbffff640 1 --2- 10.20.193.58:0/1467483118 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fecc80b6690 0x7fecc814dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:32.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.289+0000 7fecbffff640 1 -- 10.20.193.58:0/1467483118 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fecc815d870 msgr2=0x7fecc813f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:32.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.289+0000 7fecbffff640 1 --2- 10.20.193.58:0/1467483118 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fecc815d870 0x7fecc813f520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:32.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.289+0000 7fecbffff640 1 -- 10.20.193.58:0/1467483118 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb00094b0 con 0x7fecc815d4a0 2026-02-23T06:21:32.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.290+0000 7fecbffff640 1 --2- 10.20.193.58:0/1467483118 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fecc815d4a0 0x7fecc8121e60 secure :-1 s=READY pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecb00023d0 tx=0x7fecb0002950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:32.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.290+0000 7fecbd7fa640 1 -- 10.20.193.58:0/1467483118 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fecb0038470 con 0x7fecc815d4a0 2026-02-23T06:21:32.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.290+0000 7fecbd7fa640 1 -- 10.20.193.58:0/1467483118 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fecb00386c0 con 0x7fecc815d4a0 2026-02-23T06:21:32.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.290+0000 7fecbd7fa640 1 -- 10.20.193.58:0/1467483118 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fecb0038ab0 con 0x7fecc815d4a0 2026-02-23T06:21:32.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.290+0000 7feccdc43640 1 -- 10.20.193.58:0/1467483118 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecc81217c0 con 0x7fecc815d4a0 2026-02-23T06:21:32.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.290+0000 7feccdc43640 1 -- 10.20.193.58:0/1467483118 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecc814d7b0 con 0x7fecc815d4a0 2026-02-23T06:21:32.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.291+0000 7feccdc43640 1 -- 10.20.193.58:0/1467483118 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecc80b6d50 con 0x7fecc815d4a0 2026-02-23T06:21:32.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.292+0000 7fecbd7fa640 1 -- 10.20.193.58:0/1467483118 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fecb0038c10 con 0x7fecc815d4a0 2026-02-23T06:21:32.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.293+0000 7fecbd7fa640 1 --2- 10.20.193.58:0/1467483118 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fec9807a6b0 0x7fec9809ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:32.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.293+0000 7fecbd7fa640 1 -- 10.20.193.58:0/1467483118 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7fecb00c2ac0 con 0x7fecc815d4a0 2026-02-23T06:21:32.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.293+0000 7fecccc41640 1 --2- 10.20.193.58:0/1467483118 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fec9807a6b0 0x7fec9809ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:32.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.294+0000 7fecccc41640 1 --2- 10.20.193.58:0/1467483118 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fec9807a6b0 0x7fec9809ab60 secure :-1 s=READY pgs=62 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecb8004740 tx=0x7fecb8005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:32.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.295+0000 7fecbd7fa640 1 -- 10.20.193.58:0/1467483118 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fecb00c4e60 con 0x7fecc815d4a0 2026-02-23T06:21:32.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.408+0000 7feccdc43640 1 -- 10.20.193.58:0/1467483118 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fecc814dcd0 con 0x7fecc815d4a0 2026-02-23T06:21:32.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.408+0000 7fecbd7fa640 1 -- 10.20.193.58:0/1467483118 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18600 (secure 0 0 0) 0x7fecc814dcd0 con 0x7fecc815d4a0 2026-02-23T06:21:32.403 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:32.404 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":25,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","created":"2026-02-23T06:21:02.010508+0000","modified":"2026-02-23T06:21:22.447858+0000","last_up_change":"2026-02-23T06:21:08.383048+0000","last_in_change":"2026-02-23T06:21:04.690899+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-23T06:21:10.389081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-23T06:21:16.080621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-23T06:21:16.401311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-23T06:21:20.153808+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"96cc0898-14bb-4d56-827a-8845bd4307c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6808","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6809","nonce":692913334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6810","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6811","nonce":692913334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6814","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6815","nonce":692913334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6812","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6813","nonce":692913334}]},"public_addr":"10.20.193.58:6809/692913334","cluster_addr":"10.20.193.58:6811/692913334","heartbeat_back_addr":"10.20.193.58:6815/692913334","heartbeat_front_addr":"10.20.193.58:6813/692913334","state":["exists","up"]},{"osd":1,"uuid":"bf665af4-6e3c-4cb3-899c-acede65c31f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6800","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6801","nonce":1850584280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6802","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6803","nonce":1850584280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6806","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6807","nonce":1850584280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6804","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6805","nonce":1850584280}]},"public_addr":"10.20.193.58:6801/1850584280","cluster_addr":"10.20.193.58:6803/1850584280","heartbeat_back_addr":"10.20.193.58:6807/1850584280","heartbeat_front_addr":"10.20.193.58:6805/1850584280","state":["exists","up"]},{"osd":2,"uuid":"2bcb3165-28ad-45d6-9a49-9d9da08501f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6823","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6825","nonce":4284600061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6826","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6827","nonce":4284600061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6830","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6831","nonce":4284600061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6828","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6829","nonce":4284600061}]},"public_addr":"10.20.193.58:6825/4284600061","cluster_addr":"10.20.193.58:6827/4284600061","heartbeat_back_addr":"10.20.193.58:6831/4284600061","heartbeat_front_addr":"10.20.193.58:6829/4284600061","state":["exists","up"]},{"osd":3,"uuid":"4750309a-5bf2-4f48-a550-ca677b0b0f61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6816","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6817","nonce":2858636994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6818","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6819","nonce":2858636994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6822","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6824","nonce":2858636994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6820","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6821","nonce":2858636994}]},"public_addr":"10.20.193.58:6817/2858636994","cluster_addr":"10.20.193.58:6819/2858636994","heartbeat_back_addr":"10.20.193.58:6824/2858636994","heartbeat_front_addr":"10.20.193.58:6821/2858636994","state":["exists","up"]},{"osd":4,"uuid":"5cbb50f2-4e49-46eb-bd84-d92706459d2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6803","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6805","nonce":1874834171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6807","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6809","nonce":1874834171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6816","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6817","nonce":1874834171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6812","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6814","nonce":1874834171}]},"public_addr":"10.20.193.93:6805/1874834171","cluster_addr":"10.20.193.93:6809/1874834171","heartbeat_back_addr":"10.20.193.93:6817/1874834171","heartbeat_front_addr":"10.20.193.93:6814/1874834171","state":["exists","up"]},{"osd":5,"uuid":"2806c775-4720-43a7-ab9f-85a4adb31098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6802","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6804","nonce":356968280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6806","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6808","nonce":356968280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6813","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6815","nonce":356968280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6810","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6811","nonce":356968280}]},"public_addr":"10.20.193.93:6804/356968280","cluster_addr":"10.20.193.93:6808/356968280","heartbeat_back_addr":"10.20.193.93:6815/356968280","heartbeat_front_addr":"10.20.193.93:6811/356968280","state":["exists","up"]},{"osd":6,"uuid":"aa03b46d-d30f-4b09-9251-c9514e8b8b6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6819","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6821","nonce":2948039088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6823","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6825","nonce":2948039088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6831","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6833","nonce":2948039088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6827","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6829","nonce":2948039088}]},"public_addr":"10.20.193.93:6821/2948039088","cluster_addr":"10.20.193.93:6825/2948039088","heartbeat_back_addr":"10.20.193.93:6833/2948039088","heartbeat_front_addr":"10.20.193.93:6829/2948039088","state":["exists","up"]},{"osd":7,"uuid":"b15519bf-2b7b-4fd5-8ef6-e09af0ad9817","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6818","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6820","nonce":2960650087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6822","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6824","nonce":2960650087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6830","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6832","nonce":2960650087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6826","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6828","nonce":2960650087}]},"public_addr":"10.20.193.93:6820/2960650087","cluster_addr":"10.20.193.93:6824/2960650087","heartbeat_back_addr":"10.20.193.93:6832/2960650087","heartbeat_front_addr":"10.20.193.93:6828/2960650087","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.717515+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.744114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.772247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.768341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.521808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.486005+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.480882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.473408+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"2","m":"2","plugin":"isa","technique":"reed_sol_van"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-23T06:21:32.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.409+0000 7feccdc43640 1 -- 10.20.193.58:0/1467483118 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fec9807a6b0 msgr2=0x7fec9809ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:32.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.409+0000 7feccdc43640 1 --2- 10.20.193.58:0/1467483118 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fec9807a6b0 0x7fec9809ab60 secure :-1 s=READY pgs=62 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecb8004740 tx=0x7fecb8005f90 comp rx=0 tx=0).stop 2026-02-23T06:21:32.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.409+0000 7feccdc43640 1 -- 10.20.193.58:0/1467483118 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fecc815d4a0 msgr2=0x7fecc8121e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:32.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.409+0000 7feccdc43640 1 --2- 10.20.193.58:0/1467483118 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fecc815d4a0 0x7fecc8121e60 secure :-1 s=READY pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecb00023d0 tx=0x7fecb0002950 comp rx=0 tx=0).stop 2026-02-23T06:21:32.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.409+0000 7feccdc43640 1 -- 10.20.193.58:0/1467483118 shutdown_connections 2026-02-23T06:21:32.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.409+0000 7feccdc43640 1 --2- 10.20.193.58:0/1467483118 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fec9807a6b0 0x7fec9809ab60 unknown :-1 s=CLOSED pgs=62 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:32.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.409+0000 7feccdc43640 1 --2- 10.20.193.58:0/1467483118 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fecc815d870 0x7fecc813f520 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:32.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.409+0000 7feccdc43640 1 --2- 10.20.193.58:0/1467483118 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fecc815d4a0 0x7fecc8121e60 unknown :-1 s=CLOSED pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:32.406 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.409+0000 7feccdc43640 1 --2- 10.20.193.58:0/1467483118 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fecc80b6690 0x7fecc814dfb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:32.406 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.409+0000 7feccdc43640 1 -- 10.20.193.58:0/1467483118 >> 10.20.193.58:0/1467483118 conn(0x7fecc80b3c20 msgr2=0x7fecc815ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:32.406 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.410+0000 7feccdc43640 1 -- 10.20.193.58:0/1467483118 shutdown_connections 2026-02-23T06:21:32.406 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.410+0000 7feccdc43640 1 -- 10.20.193.58:0/1467483118 wait complete. 2026-02-23T06:21:32.417 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2026-02-23T06:21:32.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.546+0000 7ff014e83640 1 -- 10.20.193.58:0/307030883 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff01015d870 msgr2=0x7ff0100587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:32.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.546+0000 7ff014e83640 1 --2- 10.20.193.58:0/307030883 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff01015d870 0x7ff0100587b0 secure :-1 s=READY pgs=61 gs=2 cs=0 l=1 c_cookie=3903235213971386040 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff000004740 tx=0x7ff00002f1e0 comp rx=0 tx=0).stop 2026-02-23T06:21:32.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.546+0000 7ff014e83640 1 -- 10.20.193.58:0/307030883 shutdown_connections 2026-02-23T06:21:32.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.546+0000 7ff014e83640 1 --2- 10.20.193.58:0/307030883 >> v2:10.20.193.58:3300/0 conn(0x7ff0100b6690 0x7ff010058cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:32.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.546+0000 7ff014e83640 1 --2- 10.20.193.58:0/307030883 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff01015d870 0x7ff0100587b0 unknown :-1 s=CLOSED pgs=61 gs=2 cs=0 l=1 c_cookie=3903235213971386040 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:32.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.546+0000 7ff014e83640 1 -- 10.20.193.58:0/307030883 >> 10.20.193.58:0/307030883 conn(0x7ff0100b3c20 msgr2=0x7ff0100b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:32.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.546+0000 7ff014e83640 1 -- 10.20.193.58:0/307030883 shutdown_connections 2026-02-23T06:21:32.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.546+0000 7ff014e83640 1 -- 10.20.193.58:0/307030883 wait complete. 2026-02-23T06:21:32.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.547+0000 7ff014e83640 1 Processor -- start 2026-02-23T06:21:32.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.547+0000 7ff014e83640 1 -- start start 2026-02-23T06:21:32.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.548+0000 7ff014e83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff0100b6690 0x7ff01011e9a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:32.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.548+0000 7ff014e83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff01015d4a0 0x7ff010122ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:32.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.548+0000 7ff014e83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff01015d870 0x7ff010149fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:32.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.548+0000 7ff014e83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff010161b60 con 0x7ff01015d4a0 2026-02-23T06:21:32.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.548+0000 7ff014e83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff010162f00 con 0x7ff0100b6690 2026-02-23T06:21:32.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.548+0000 7ff014e83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7ff010161030 con 0x7ff01015d870 2026-02-23T06:21:32.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.548+0000 7ff00effd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff01015d4a0 0x7ff010122ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:32.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.548+0000 7ff00f7fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff0100b6690 0x7ff01011e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:32.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.548+0000 7ff00effd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff01015d4a0 0x7ff010122ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50654/0 (socket says 10.20.193.58:50654) 2026-02-23T06:21:32.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.548+0000 7ff00effd640 1 -- 10.20.193.58:0/3258667347 learned_addr learned my addr 10.20.193.58:0/3258667347 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:32.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.548+0000 7ff00ffff640 1 --2- 10.20.193.58:0/3258667347 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff01015d870 0x7ff010149fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:32.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.548+0000 7ff00effd640 1 -- 10.20.193.58:0/3258667347 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff01015d870 msgr2=0x7ff010149fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:32.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.548+0000 7ff00effd640 1 --2- 10.20.193.58:0/3258667347 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff01015d870 0x7ff010149fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:32.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.548+0000 7ff00effd640 1 -- 10.20.193.58:0/3258667347 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff0100b6690 msgr2=0x7ff01011e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:32.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.548+0000 7ff00effd640 1 --2- 10.20.193.58:0/3258667347 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff0100b6690 0x7ff01011e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:32.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.548+0000 7ff00effd640 1 -- 10.20.193.58:0/3258667347 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0000094b0 con 0x7ff01015d4a0 2026-02-23T06:21:32.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.548+0000 7ff00ffff640 1 --2- 10.20.193.58:0/3258667347 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff01015d870 0x7ff010149fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:21:32.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.548+0000 7ff00effd640 1 --2- 10.20.193.58:0/3258667347 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff01015d4a0 0x7ff010122ab0 secure :-1 s=READY pgs=100 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff000009960 tx=0x7ff000002950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:32.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.549+0000 7fefebfff640 1 -- 10.20.193.58:0/3258667347 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff000038470 con 0x7ff01015d4a0 2026-02-23T06:21:32.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.549+0000 7fefebfff640 1 -- 10.20.193.58:0/3258667347 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0000386c0 con 0x7ff01015d4a0 2026-02-23T06:21:32.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.549+0000 7fefebfff640 1 -- 10.20.193.58:0/3258667347 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff000038a90 con 0x7ff01015d4a0 2026-02-23T06:21:32.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.549+0000 7ff014e83640 1 -- 10.20.193.58:0/3258667347 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0101629d0 con 0x7ff01015d4a0 2026-02-23T06:21:32.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.549+0000 7ff014e83640 1 -- 10.20.193.58:0/3258667347 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff010162c20 con 0x7ff01015d4a0 2026-02-23T06:21:32.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.549+0000 7ff014e83640 1 -- 10.20.193.58:0/3258667347 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0100b6d50 con 0x7ff01015d4a0 2026-02-23T06:21:32.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.551+0000 7fefebfff640 1 -- 10.20.193.58:0/3258667347 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7ff000038bf0 con 0x7ff01015d4a0 2026-02-23T06:21:32.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.552+0000 7fefebfff640 1 --2- 10.20.193.58:0/3258667347 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fefe007a6c0 0x7fefe009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:32.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.552+0000 7fefebfff640 1 -- 10.20.193.58:0/3258667347 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7ff0000c3730 con 0x7ff01015d4a0 2026-02-23T06:21:32.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.552+0000 7fefebfff640 1 -- 10.20.193.58:0/3258667347 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7ff000086a20 con 0x7ff01015d4a0 2026-02-23T06:21:32.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.552+0000 7ff00f7fe640 1 --2- 10.20.193.58:0/3258667347 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fefe007a6c0 0x7fefe009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:32.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.553+0000 7ff00f7fe640 1 --2- 10.20.193.58:0/3258667347 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fefe007a6c0 0x7fefe009ab70 secure :-1 s=READY pgs=63 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feffc0026a0 tx=0x7feffc007c10 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:32.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:32.691+0000 7ff014e83640 1 -- 10.20.193.58:0/3258667347 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff01005b0e0 con 0x7ff01015d4a0 2026-02-23T06:21:33.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.176+0000 7fefebfff640 1 -- 10.20.193.58:0/3258667347 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7ff000089b40 con 0x7ff01015d4a0 2026-02-23T06:21:33.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.178+0000 7ff014e83640 1 -- 10.20.193.58:0/3258667347 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fefe007a6c0 msgr2=0x7fefe009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:33.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.178+0000 7ff014e83640 1 --2- 10.20.193.58:0/3258667347 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fefe007a6c0 0x7fefe009ab70 secure :-1 s=READY pgs=63 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feffc0026a0 tx=0x7feffc007c10 comp rx=0 tx=0).stop 2026-02-23T06:21:33.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.178+0000 7ff014e83640 1 -- 10.20.193.58:0/3258667347 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff01015d4a0 msgr2=0x7ff010122ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:33.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.178+0000 7ff014e83640 1 --2- 10.20.193.58:0/3258667347 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff01015d4a0 0x7ff010122ab0 secure :-1 s=READY pgs=100 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff000009960 tx=0x7ff000002950 comp rx=0 tx=0).stop 2026-02-23T06:21:33.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.178+0000 7ff014e83640 1 -- 10.20.193.58:0/3258667347 shutdown_connections 2026-02-23T06:21:33.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.178+0000 7ff014e83640 1 --2- 10.20.193.58:0/3258667347 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fefe007a6c0 0x7fefe009ab70 unknown :-1 s=CLOSED pgs=63 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:33.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.178+0000 7ff014e83640 1 --2- 10.20.193.58:0/3258667347 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff01015d870 0x7ff010149fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:33.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.178+0000 7ff014e83640 1 --2- 10.20.193.58:0/3258667347 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff01015d4a0 0x7ff010122ab0 unknown :-1 s=CLOSED pgs=100 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:33.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.178+0000 7ff014e83640 1 --2- 10.20.193.58:0/3258667347 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff0100b6690 0x7ff01011e9a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:33.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.178+0000 7ff014e83640 1 -- 10.20.193.58:0/3258667347 >> 10.20.193.58:0/3258667347 conn(0x7ff0100b3c20 msgr2=0x7ff0101631c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:33.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.178+0000 7ff014e83640 1 -- 10.20.193.58:0/3258667347 shutdown_connections 2026-02-23T06:21:33.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.178+0000 7ff014e83640 1 -- 10.20.193.58:0/3258667347 wait complete. 2026-02-23T06:21:33.185 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300} 2026-02-23T06:21:33.186 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2026-02-23T06:21:33.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.314+0000 7f2c33fff640 1 -- 10.20.193.58:0/3055696725 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2c340b6690 msgr2=0x7f2c34058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:33.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.314+0000 7f2c33fff640 1 --2- 10.20.193.58:0/3055696725 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2c340b6690 0x7f2c34058cf0 secure :-1 s=READY pgs=117 gs=3 cs=0 l=1 c_cookie=10471794751179800844 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c24005820 tx=0x7f2c240302b0 comp rx=0 tx=0).stop 2026-02-23T06:21:33.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.314+0000 7f2c33fff640 1 -- 10.20.193.58:0/3055696725 shutdown_connections 2026-02-23T06:21:33.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.314+0000 7f2c33fff640 1 --2- 10.20.193.58:0/3055696725 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2c340b6690 0x7f2c34058cf0 unknown :-1 s=CLOSED pgs=117 gs=3 cs=0 l=1 c_cookie=10471794751179800844 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:33.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.314+0000 7f2c33fff640 1 --2- 10.20.193.58:0/3055696725 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2c3415d870 0x7f2c340587b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:33.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.314+0000 7f2c33fff640 1 -- 10.20.193.58:0/3055696725 >> 10.20.193.58:0/3055696725 conn(0x7f2c340b3c20 msgr2=0x7f2c340b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:33.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.315+0000 7f2c33fff640 1 -- 10.20.193.58:0/3055696725 shutdown_connections 2026-02-23T06:21:33.311 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.315+0000 7f2c33fff640 1 -- 10.20.193.58:0/3055696725 wait complete. 2026-02-23T06:21:33.313 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.316+0000 7f2c33fff640 1 Processor -- start 2026-02-23T06:21:33.313 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.316+0000 7f2c33fff640 1 -- start start 2026-02-23T06:21:33.314 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.316+0000 7f2c33fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2c340b6690 0x7f2c34201c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:33.314 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.316+0000 7f2c33fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2c3415d4a0 0x7f2c341fdba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:33.314 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.316+0000 7f2c33fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2c3415d870 0x7f2c34166980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:33.314 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.316+0000 7f2c33fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f2c341fe0e0 con 0x7f2c3415d870 2026-02-23T06:21:33.314 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.316+0000 7f2c33fff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f2c34201800 con 0x7f2c340b6690 2026-02-23T06:21:33.314 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.316+0000 7f2c33fff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f2c3415f040 con 0x7f2c3415d4a0 2026-02-23T06:21:33.314 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.317+0000 7f2c32ffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2c340b6690 0x7f2c34201c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:33.314 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.317+0000 7f2c327fc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2c3415d4a0 0x7f2c341fdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:33.314 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.317+0000 7f2c327fc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2c3415d4a0 0x7f2c341fdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:50556/0 (socket says 10.20.193.58:50556) 2026-02-23T06:21:33.314 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.317+0000 7f2c327fc640 1 -- 10.20.193.58:0/1815607954 learned_addr learned my addr 10.20.193.58:0/1815607954 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:33.315 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.317+0000 7f2c337fe640 1 --2- 10.20.193.58:0/1815607954 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2c3415d870 0x7f2c34166980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:33.315 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.317+0000 7f2c327fc640 1 -- 10.20.193.58:0/1815607954 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2c340b6690 msgr2=0x7f2c34201c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:33.315 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.317+0000 7f2c327fc640 1 --2- 10.20.193.58:0/1815607954 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2c340b6690 0x7f2c34201c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:33.315 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.317+0000 7f2c327fc640 1 -- 10.20.193.58:0/1815607954 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2c3415d870 msgr2=0x7f2c34166980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:33.315 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.317+0000 7f2c327fc640 1 --2- 10.20.193.58:0/1815607954 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2c3415d870 0x7f2c34166980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:33.315 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.317+0000 7f2c327fc640 1 -- 10.20.193.58:0/1815607954 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c2400a590 con 0x7f2c3415d4a0 2026-02-23T06:21:33.315 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.317+0000 7f2c337fe640 1 --2- 10.20.193.58:0/1815607954 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2c3415d870 0x7f2c34166980 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:21:33.315 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.317+0000 7f2c327fc640 1 --2- 10.20.193.58:0/1815607954 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2c3415d4a0 0x7f2c341fdba0 secure :-1 s=READY pgs=62 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c1c009480 tx=0x7f2c1c00ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:33.315 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.317+0000 7f2c137fe640 1 -- 10.20.193.58:0/1815607954 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2c1c00cd40 con 0x7f2c3415d4a0 2026-02-23T06:21:33.315 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.317+0000 7f2c137fe640 1 -- 10.20.193.58:0/1815607954 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c1c004850 con 0x7f2c3415d4a0 2026-02-23T06:21:33.316 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.317+0000 7f2c137fe640 1 -- 10.20.193.58:0/1815607954 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2c1c00cea0 con 0x7f2c3415d4a0 2026-02-23T06:21:33.316 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.317+0000 7f2c33fff640 1 -- 10.20.193.58:0/1815607954 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c3415eda0 con 0x7f2c3415d4a0 2026-02-23T06:21:33.316 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.317+0000 7f2c33fff640 1 -- 10.20.193.58:0/1815607954 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c3413e640 con 0x7f2c3415d4a0 2026-02-23T06:21:33.316 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.318+0000 7f2c33fff640 1 -- 10.20.193.58:0/1815607954 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c340b6d50 con 0x7f2c3415d4a0 2026-02-23T06:21:33.316 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.319+0000 7f2c137fe640 1 -- 10.20.193.58:0/1815607954 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f2c1c01f060 con 0x7f2c3415d4a0 2026-02-23T06:21:33.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.320+0000 7f2c137fe640 1 --2- 10.20.193.58:0/1815607954 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2c0007a730 0x7f2c0009abe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:33.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.320+0000 7f2c137fe640 1 -- 10.20.193.58:0/1815607954 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f2c1c014070 con 0x7f2c3415d4a0 2026-02-23T06:21:33.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.320+0000 7f2c32ffd640 1 --2- 10.20.193.58:0/1815607954 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2c0007a730 0x7f2c0009abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:33.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.321+0000 7f2c32ffd640 1 --2- 10.20.193.58:0/1815607954 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2c0007a730 0x7f2c0009abe0 secure :-1 s=READY pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c280026a0 tx=0x7f2c28007c10 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:33.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.321+0000 7f2c137fe640 1 -- 10.20.193.58:0/1815607954 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f2c1c060e20 con 0x7f2c3415d4a0 2026-02-23T06:21:33.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:33.460+0000 7f2c33fff640 1 -- 10.20.193.58:0/1815607954 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f2c34201990 con 0x7f2c3415d4a0 2026-02-23T06:21:34.175 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.180+0000 7f2c137fe640 1 -- 10.20.193.58:0/1815607954 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f2c1c063fd0 con 0x7f2c3415d4a0 2026-02-23T06:21:34.177 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.182+0000 7f2c33fff640 1 -- 10.20.193.58:0/1815607954 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2c0007a730 msgr2=0x7f2c0009abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:34.178 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.182+0000 7f2c33fff640 1 --2- 10.20.193.58:0/1815607954 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2c0007a730 0x7f2c0009abe0 secure :-1 s=READY pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c280026a0 tx=0x7f2c28007c10 comp rx=0 tx=0).stop 2026-02-23T06:21:34.178 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.182+0000 7f2c33fff640 1 -- 10.20.193.58:0/1815607954 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2c3415d4a0 msgr2=0x7f2c341fdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:34.178 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.182+0000 7f2c33fff640 1 --2- 10.20.193.58:0/1815607954 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2c3415d4a0 0x7f2c341fdba0 secure :-1 s=READY pgs=62 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c1c009480 tx=0x7f2c1c00ee60 comp rx=0 tx=0).stop 2026-02-23T06:21:34.178 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.182+0000 7f2c33fff640 1 -- 10.20.193.58:0/1815607954 shutdown_connections 2026-02-23T06:21:34.178 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.182+0000 7f2c33fff640 1 --2- 10.20.193.58:0/1815607954 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2c0007a730 0x7f2c0009abe0 unknown :-1 s=CLOSED pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:34.178 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.182+0000 7f2c33fff640 1 --2- 10.20.193.58:0/1815607954 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2c3415d870 0x7f2c34166980 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:34.178 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.182+0000 7f2c33fff640 1 --2- 10.20.193.58:0/1815607954 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2c3415d4a0 0x7f2c341fdba0 unknown :-1 s=CLOSED pgs=62 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:34.178 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.182+0000 7f2c33fff640 1 --2- 10.20.193.58:0/1815607954 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2c340b6690 0x7f2c34201c90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:34.178 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.182+0000 7f2c33fff640 1 -- 10.20.193.58:0/1815607954 >> 10.20.193.58:0/1815607954 conn(0x7f2c340b3c20 msgr2=0x7f2c3415ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:34.178 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.182+0000 7f2c33fff640 1 -- 10.20.193.58:0/1815607954 shutdown_connections 2026-02-23T06:21:34.179 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.182+0000 7f2c33fff640 1 -- 10.20.193.58:0/1815607954 wait complete. 2026-02-23T06:21:34.190 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2026-02-23T06:21:34.312 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.317+0000 7f0cfb1d2640 1 -- 10.20.193.58:0/4018469428 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0cf40b5680 msgr2=0x7f0cf40b5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:34.313 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.317+0000 7f0cfb1d2640 1 --2- 10.20.193.58:0/4018469428 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0cf40b5680 0x7f0cf40b5b00 secure :-1 s=READY pgs=63 gs=3 cs=0 l=1 c_cookie=16379076000728245270 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0cf000a970 tx=0x7f0cf00302d0 comp rx=0 tx=0).stop 2026-02-23T06:21:34.313 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.317+0000 7f0cfb1d2640 1 -- 10.20.193.58:0/4018469428 shutdown_connections 2026-02-23T06:21:34.313 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.317+0000 7f0cfb1d2640 1 --2- 10.20.193.58:0/4018469428 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0cf40b5680 0x7f0cf40b5b00 unknown :-1 s=CLOSED pgs=63 gs=3 cs=0 l=1 c_cookie=16379076000728245270 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:34.313 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.317+0000 7f0cfb1d2640 1 -- 10.20.193.58:0/4018469428 >> 10.20.193.58:0/4018469428 conn(0x7f0cf40b3c20 msgr2=0x7f0cf40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:34.313 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.317+0000 7f0cfb1d2640 1 -- 10.20.193.58:0/4018469428 shutdown_connections 2026-02-23T06:21:34.313 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.318+0000 7f0cfb1d2640 1 -- 10.20.193.58:0/4018469428 wait complete. 2026-02-23T06:21:34.316 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.319+0000 7f0cfb1d2640 1 Processor -- start 2026-02-23T06:21:34.316 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.319+0000 7f0cfb1d2640 1 -- start start 2026-02-23T06:21:34.316 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.319+0000 7f0cfb1d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0cf4056550 0x7f0cf415ed30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:34.316 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.319+0000 7f0cfb1d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0cf40b5680 0x7f0cf40b0900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:34.316 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.319+0000 7f0cfb1d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0cf415c040 0x7f0cf4200e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:34.316 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.319+0000 7f0cfb1d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf415fab0 con 0x7f0cf40b5680 2026-02-23T06:21:34.316 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.319+0000 7f0cfb1d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf415f580 con 0x7f0cf4056550 2026-02-23T06:21:34.316 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.319+0000 7f0cfb1d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f0cf4161c20 con 0x7f0cf415c040 2026-02-23T06:21:34.316 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.320+0000 7f0cfa1d0640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0cf4056550 0x7f0cf415ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:34.316 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.320+0000 7f0cfa9d1640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0cf415c040 0x7f0cf4200e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:34.316 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.320+0000 7f0cfa1d0640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0cf4056550 0x7f0cf415ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:50194/0 (socket says 10.20.193.58:50194) 2026-02-23T06:21:34.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.320+0000 7f0cfa1d0640 1 -- 10.20.193.58:0/1257552741 learned_addr learned my addr 10.20.193.58:0/1257552741 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:34.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.320+0000 7f0cf99cf640 1 --2- 10.20.193.58:0/1257552741 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0cf40b5680 0x7f0cf40b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:34.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.320+0000 7f0cf99cf640 1 -- 10.20.193.58:0/1257552741 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0cf415c040 msgr2=0x7f0cf4200e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:34.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.320+0000 7f0cf99cf640 1 --2- 10.20.193.58:0/1257552741 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0cf415c040 0x7f0cf4200e80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:34.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.320+0000 7f0cf99cf640 1 -- 10.20.193.58:0/1257552741 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0cf4056550 msgr2=0x7f0cf415ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:34.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.320+0000 7f0cf99cf640 1 --2- 10.20.193.58:0/1257552741 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0cf4056550 0x7f0cf415ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:34.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.320+0000 7f0cf99cf640 1 -- 10.20.193.58:0/1257552741 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf000a590 con 0x7f0cf40b5680 2026-02-23T06:21:34.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.320+0000 7f0cfa1d0640 1 --2- 10.20.193.58:0/1257552741 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0cf4056550 0x7f0cf415ed30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:34.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.320+0000 7f0cf99cf640 1 --2- 10.20.193.58:0/1257552741 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0cf40b5680 0x7f0cf40b0900 secure :-1 s=READY pgs=102 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ce8002800 tx=0x7f0ce800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:34.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.320+0000 7f0cdaffd640 1 -- 10.20.193.58:0/1257552741 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ce80054a0 con 0x7f0cf40b5680 2026-02-23T06:21:34.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.320+0000 7f0cdaffd640 1 -- 10.20.193.58:0/1257552741 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ce8003690 con 0x7f0cf40b5680 2026-02-23T06:21:34.318 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.320+0000 7f0cdaffd640 1 -- 10.20.193.58:0/1257552741 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ce8003aa0 con 0x7f0cf40b5680 2026-02-23T06:21:34.318 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.320+0000 7f0cfb1d2640 1 -- 10.20.193.58:0/1257552741 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cf4201c20 con 0x7f0cf40b5680 2026-02-23T06:21:34.318 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.320+0000 7f0cfb1d2640 1 -- 10.20.193.58:0/1257552741 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cf4161700 con 0x7f0cf40b5680 2026-02-23T06:21:34.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.322+0000 7f0cfb1d2640 1 -- 10.20.193.58:0/1257552741 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cc0005300 con 0x7f0cf40b5680 2026-02-23T06:21:34.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.322+0000 7f0cdaffd640 1 -- 10.20.193.58:0/1257552741 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f0ce8003c00 con 0x7f0cf40b5680 2026-02-23T06:21:34.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.323+0000 7f0cdaffd640 1 --2- 10.20.193.58:0/1257552741 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0cc407a6c0 0x7f0cc409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:34.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.323+0000 7f0cdaffd640 1 -- 10.20.193.58:0/1257552741 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f0ce809cad0 con 0x7f0cf40b5680 2026-02-23T06:21:34.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.323+0000 7f0cfa1d0640 1 --2- 10.20.193.58:0/1257552741 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0cc407a6c0 0x7f0cc409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:34.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.324+0000 7f0cfa1d0640 1 --2- 10.20.193.58:0/1257552741 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0cc407a6c0 0x7f0cc409ab70 secure :-1 s=READY pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ce4007c00 tx=0x7f0ce40026d0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:34.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.325+0000 7f0cdaffd640 1 -- 10.20.193.58:0/1257552741 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f0ce805fe30 con 0x7f0cf40b5680 2026-02-23T06:21:34.462 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:34.467+0000 7f0cfb1d2640 1 -- 10.20.193.58:0/1257552741 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f0cc0005b30 con 0x7f0cf40b5680 2026-02-23T06:21:35.177 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.182+0000 7f0cdaffd640 1 -- 10.20.193.58:0/1257552741 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v9) ==== 115+0+0 (secure 0 0 0) 0x7f0ce8062f50 con 0x7f0cf40b5680 2026-02-23T06:21:35.179 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.184+0000 7f0cfb1d2640 1 -- 10.20.193.58:0/1257552741 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0cc407a6c0 msgr2=0x7f0cc409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:35.180 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.184+0000 7f0cfb1d2640 1 --2- 10.20.193.58:0/1257552741 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0cc407a6c0 0x7f0cc409ab70 secure :-1 s=READY pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ce4007c00 tx=0x7f0ce40026d0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.180 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.184+0000 7f0cfb1d2640 1 -- 10.20.193.58:0/1257552741 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0cf40b5680 msgr2=0x7f0cf40b0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:35.180 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.184+0000 7f0cfb1d2640 1 --2- 10.20.193.58:0/1257552741 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0cf40b5680 0x7f0cf40b0900 secure :-1 s=READY pgs=102 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ce8002800 tx=0x7f0ce800c970 comp rx=0 tx=0).stop 2026-02-23T06:21:35.180 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.185+0000 7f0cfb1d2640 1 -- 10.20.193.58:0/1257552741 shutdown_connections 2026-02-23T06:21:35.180 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.185+0000 7f0cfb1d2640 1 --2- 10.20.193.58:0/1257552741 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0cc407a6c0 0x7f0cc409ab70 unknown :-1 s=CLOSED pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.180 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.185+0000 7f0cfb1d2640 1 --2- 10.20.193.58:0/1257552741 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0cf415c040 0x7f0cf4200e80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.180 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.185+0000 7f0cfb1d2640 1 --2- 10.20.193.58:0/1257552741 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0cf40b5680 0x7f0cf40b0900 unknown :-1 s=CLOSED pgs=102 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.180 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.185+0000 7f0cfb1d2640 1 --2- 10.20.193.58:0/1257552741 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0cf4056550 0x7f0cf415ed30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.180 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.185+0000 7f0cfb1d2640 1 -- 10.20.193.58:0/1257552741 >> 10.20.193.58:0/1257552741 conn(0x7f0cf40b3c20 msgr2=0x7f0cf40b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:35.180 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.185+0000 7f0cfb1d2640 1 -- 10.20.193.58:0/1257552741 shutdown_connections 2026-02-23T06:21:35.181 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.185+0000 7f0cfb1d2640 1 -- 10.20.193.58:0/1257552741 wait complete. 2026-02-23T06:21:35.193 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2026-02-23T06:21:35.193 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2026-02-23T06:21:35.314 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.319+0000 7fcfdc50c640 1 -- 10.20.193.58:0/4102415207 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcfd4163c70 msgr2=0x7fcfd4166fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:35.315 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.319+0000 7fcfdc50c640 1 --2- 10.20.193.58:0/4102415207 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcfd4163c70 0x7fcfd4166fa0 secure :-1 s=READY pgs=103 gs=3 cs=0 l=1 c_cookie=15758309929009027000 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfd40b5260 tx=0x7fcfc802f2e0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.315 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.319+0000 7fcfdc50c640 1 -- 10.20.193.58:0/4102415207 shutdown_connections 2026-02-23T06:21:35.315 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.319+0000 7fcfdc50c640 1 --2- 10.20.193.58:0/4102415207 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcfd4163c70 0x7fcfd4166fa0 unknown :-1 s=CLOSED pgs=103 gs=3 cs=0 l=1 c_cookie=15758309929009027000 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.315 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.319+0000 7fcfdc50c640 1 --2- 10.20.193.58:0/4102415207 >> v2:10.20.193.93:3300/0 conn(0x7fcfd40b10e0 0x7fcfd405b230 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.315 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.319+0000 7fcfdc50c640 1 -- 10.20.193.58:0/4102415207 >> 10.20.193.58:0/4102415207 conn(0x7fcfd40561f0 msgr2=0x7fcfd40565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:35.315 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.319+0000 7fcfdc50c640 1 -- 10.20.193.58:0/4102415207 shutdown_connections 2026-02-23T06:21:35.315 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.320+0000 7fcfdc50c640 1 -- 10.20.193.58:0/4102415207 wait complete. 2026-02-23T06:21:35.318 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.321+0000 7fcfdc50c640 1 Processor -- start 2026-02-23T06:21:35.318 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.321+0000 7fcfdc50c640 1 -- start start 2026-02-23T06:21:35.318 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.321+0000 7fcfdc50c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcfd40b10e0 0x7fcfd415bfe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:35.318 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.321+0000 7fcfdc50c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcfd40b6020 0x7fcfd40b06d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:35.318 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.321+0000 7fcfdc50c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcfd4163c70 0x7fcfd413ef90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:35.318 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.321+0000 7fcfdc50c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd41407b0 con 0x7fcfd4163c70 2026-02-23T06:21:35.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.321+0000 7fcfdc50c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd40aec20 con 0x7fcfd40b6020 2026-02-23T06:21:35.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.321+0000 7fcfdc50c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fcfd415c520 con 0x7fcfd40b10e0 2026-02-23T06:21:35.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.321+0000 7fcfd9a80640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcfd40b6020 0x7fcfd40b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:35.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.321+0000 7fcfdaa82640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcfd4163c70 0x7fcfd413ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:35.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.321+0000 7fcfd9a80640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcfd40b6020 0x7fcfd40b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:50216/0 (socket says 10.20.193.58:50216) 2026-02-23T06:21:35.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.321+0000 7fcfd9a80640 1 -- 10.20.193.58:0/2091223180 learned_addr learned my addr 10.20.193.58:0/2091223180 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:35.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.322+0000 7fcfda281640 1 --2- 10.20.193.58:0/2091223180 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcfd40b10e0 0x7fcfd415bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:35.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.322+0000 7fcfdaa82640 1 -- 10.20.193.58:0/2091223180 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcfd40b10e0 msgr2=0x7fcfd415bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:35.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.322+0000 7fcfdaa82640 1 --2- 10.20.193.58:0/2091223180 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcfd40b10e0 0x7fcfd415bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.322+0000 7fcfdaa82640 1 -- 10.20.193.58:0/2091223180 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcfd40b6020 msgr2=0x7fcfd40b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:35.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.322+0000 7fcfdaa82640 1 --2- 10.20.193.58:0/2091223180 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcfd40b6020 0x7fcfd40b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.322+0000 7fcfdaa82640 1 -- 10.20.193.58:0/2091223180 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc8009570 con 0x7fcfd4163c70 2026-02-23T06:21:35.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.322+0000 7fcfdaa82640 1 --2- 10.20.193.58:0/2091223180 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcfd4163c70 0x7fcfd413ef90 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfd0003810 tx=0x7fcfd000d8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:35.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.322+0000 7fcfbaffd640 1 -- 10.20.193.58:0/2091223180 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcfd0007b90 con 0x7fcfd4163c70 2026-02-23T06:21:35.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.322+0000 7fcfbaffd640 1 -- 10.20.193.58:0/2091223180 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfd0007de0 con 0x7fcfd4163c70 2026-02-23T06:21:35.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.322+0000 7fcfbaffd640 1 -- 10.20.193.58:0/2091223180 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcfd00082b0 con 0x7fcfd4163c70 2026-02-23T06:21:35.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.322+0000 7fcfdc50c640 1 -- 10.20.193.58:0/2091223180 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfd4141cc0 con 0x7fcfd4163c70 2026-02-23T06:21:35.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.322+0000 7fcfdc50c640 1 -- 10.20.193.58:0/2091223180 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfd40aeec0 con 0x7fcfd4163c70 2026-02-23T06:21:35.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.323+0000 7fcfb8ff9640 1 -- 10.20.193.58:0/2091223180 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfd40af050 con 0x7fcfd4163c70 2026-02-23T06:21:35.321 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.324+0000 7fcfbaffd640 1 -- 10.20.193.58:0/2091223180 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fcfd0008410 con 0x7fcfd4163c70 2026-02-23T06:21:35.321 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.325+0000 7fcfbaffd640 1 --2- 10.20.193.58:0/2091223180 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcfa407a6b0 0x7fcfa409ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:35.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.325+0000 7fcfbaffd640 1 -- 10.20.193.58:0/2091223180 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7fcfd009e2c0 con 0x7fcfd4163c70 2026-02-23T06:21:35.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.326+0000 7fcfda281640 1 --2- 10.20.193.58:0/2091223180 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcfa407a6b0 0x7fcfa409ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:35.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.326+0000 7fcfda281640 1 --2- 10.20.193.58:0/2091223180 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcfa407a6b0 0x7fcfa409ab60 secure :-1 s=READY pgs=66 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfc4004740 tx=0x7fcfc4005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:35.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.326+0000 7fcfbaffd640 1 -- 10.20.193.58:0/2091223180 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fcfd00615d0 con 0x7fcfd4163c70 2026-02-23T06:21:35.461 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.466+0000 7fcfb8ff9640 1 -- 10.20.193.58:0/2091223180 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcfd40b0c10 con 0x7fcfd4163c70 2026-02-23T06:21:35.461 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.466+0000 7fcfbaffd640 1 -- 10.20.193.58:0/2091223180 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6886 (secure 0 0 0) 0x7fcfd00646f0 con 0x7fcfd4163c70 2026-02-23T06:21:35.462 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:35.462 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":9,"btime":"2026-02-23T06:21:35:181391+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4320,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.58:6836/332204623","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6834","nonce":332204623},{"type":"v1","addr":"10.20.193.58:6836","nonce":332204623}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4349,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6839/49797428","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6838","nonce":49797428},{"type":"v1","addr":"10.20.193.93:6839","nonce":49797428}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4355,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.58:6833/363105980","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6832","nonce":363105980},{"type":"v1","addr":"10.20.193.58:6833","nonce":363105980}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4438,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6835/3715244768","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6834","nonce":3715244768},{"type":"v1","addr":"10.20.193.93:6835","nonce":3715244768}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4444,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6837/3986540573","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6836","nonce":3986540573},{"type":"v1","addr":"10.20.193.93:6837","nonce":3986540573}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false,"allow_referent_inodes":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-23T06:21:17.428505+0000","modified":"2026-02-23T06:21:34.468900+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4468},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4468":{"gid":4468,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"10.20.193.58:6837/4266460647","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6835","nonce":4266460647},{"type":"v1","addr":"10.20.193.58:6837","nonce":4266460647}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4468,"qdb_cluster":[4468]},"id":1}]} 2026-02-23T06:21:35.463 INFO:teuthology.orchestra.run.trial058.stderr:dumped fsmap epoch 9 2026-02-23T06:21:35.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.468+0000 7fcfb8ff9640 1 -- 10.20.193.58:0/2091223180 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcfa407a6b0 msgr2=0x7fcfa409ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:35.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.468+0000 7fcfb8ff9640 1 --2- 10.20.193.58:0/2091223180 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcfa407a6b0 0x7fcfa409ab60 secure :-1 s=READY pgs=66 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfc4004740 tx=0x7fcfc4005f90 comp rx=0 tx=0).stop 2026-02-23T06:21:35.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.468+0000 7fcfb8ff9640 1 -- 10.20.193.58:0/2091223180 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcfd4163c70 msgr2=0x7fcfd413ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:35.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.468+0000 7fcfb8ff9640 1 --2- 10.20.193.58:0/2091223180 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcfd4163c70 0x7fcfd413ef90 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfd0003810 tx=0x7fcfd000d8a0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.468+0000 7fcfb8ff9640 1 -- 10.20.193.58:0/2091223180 shutdown_connections 2026-02-23T06:21:35.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.468+0000 7fcfb8ff9640 1 --2- 10.20.193.58:0/2091223180 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcfa407a6b0 0x7fcfa409ab60 unknown :-1 s=CLOSED pgs=66 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.468+0000 7fcfb8ff9640 1 --2- 10.20.193.58:0/2091223180 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcfd4163c70 0x7fcfd413ef90 unknown :-1 s=CLOSED pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.468+0000 7fcfb8ff9640 1 --2- 10.20.193.58:0/2091223180 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcfd40b6020 0x7fcfd40b06d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.468+0000 7fcfb8ff9640 1 --2- 10.20.193.58:0/2091223180 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcfd40b10e0 0x7fcfd415bfe0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.468+0000 7fcfb8ff9640 1 -- 10.20.193.58:0/2091223180 >> 10.20.193.58:0/2091223180 conn(0x7fcfd40561f0 msgr2=0x7fcfd415d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:35.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.468+0000 7fcfb8ff9640 1 -- 10.20.193.58:0/2091223180 shutdown_connections 2026-02-23T06:21:35.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.468+0000 7fcfb8ff9640 1 -- 10.20.193.58:0/2091223180 wait complete. 2026-02-23T06:21:35.474 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-23T06:21:35.594 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.599+0000 7f7187fff640 1 -- 10.20.193.58:0/3128227785 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f718815c4b0 msgr2=0x7f7188058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:35.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.599+0000 7f7187fff640 1 --2- 10.20.193.58:0/3128227785 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f718815c4b0 0x7f7188058200 secure :-1 s=READY pgs=120 gs=2 cs=0 l=1 c_cookie=10162080827068886508 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f717c004740 tx=0x7f717c02f1e0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.599+0000 7f7187fff640 1 -- 10.20.193.58:0/3128227785 shutdown_connections 2026-02-23T06:21:35.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.599+0000 7f7187fff640 1 --2- 10.20.193.58:0/3128227785 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7188162ca0 0x7f7188056fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.599+0000 7f7187fff640 1 --2- 10.20.193.58:0/3128227785 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f718815c4b0 0x7f7188058200 unknown :-1 s=CLOSED pgs=120 gs=2 cs=0 l=1 c_cookie=10162080827068886508 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.599+0000 7f7187fff640 1 -- 10.20.193.58:0/3128227785 >> 10.20.193.58:0/3128227785 conn(0x7f71880b3c20 msgr2=0x7f71880b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:35.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.599+0000 7f7187fff640 1 -- 10.20.193.58:0/3128227785 shutdown_connections 2026-02-23T06:21:35.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.599+0000 7f7187fff640 1 -- 10.20.193.58:0/3128227785 wait complete. 2026-02-23T06:21:35.597 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.601+0000 7f7187fff640 1 Processor -- start 2026-02-23T06:21:35.597 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.601+0000 7f7187fff640 1 -- start start 2026-02-23T06:21:35.597 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.602+0000 7f7187fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7188056960 0x7f7188164700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:35.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.602+0000 7f7187fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f718815c4b0 0x7f71880b7660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:35.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.602+0000 7f7187fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7188162ca0 0x7f71880b7ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:35.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.602+0000 7f7187fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f71880ada30 con 0x7f718815c4b0 2026-02-23T06:21:35.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.602+0000 7f7187fff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f7188163830 con 0x7f7188056960 2026-02-23T06:21:35.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.602+0000 7f7187fff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f7188163af0 con 0x7f7188162ca0 2026-02-23T06:21:35.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.602+0000 7f7186ffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7188056960 0x7f7188164700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:35.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.602+0000 7f71867fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f718815c4b0 0x7f71880b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:35.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.602+0000 7f71877fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7188162ca0 0x7f71880b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:35.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.602+0000 7f7186ffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7188056960 0x7f7188164700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:50224/0 (socket says 10.20.193.58:50224) 2026-02-23T06:21:35.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.602+0000 7f7186ffd640 1 -- 10.20.193.58:0/2351801429 learned_addr learned my addr 10.20.193.58:0/2351801429 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:35.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.602+0000 7f71867fc640 1 -- 10.20.193.58:0/2351801429 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7188162ca0 msgr2=0x7f71880b7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:35.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.602+0000 7f71867fc640 1 --2- 10.20.193.58:0/2351801429 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7188162ca0 0x7f71880b7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.602+0000 7f71867fc640 1 -- 10.20.193.58:0/2351801429 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7188056960 msgr2=0x7f7188164700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:35.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.602+0000 7f71867fc640 1 --2- 10.20.193.58:0/2351801429 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7188056960 0x7f7188164700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.602+0000 7f71867fc640 1 -- 10.20.193.58:0/2351801429 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717c0094b0 con 0x7f718815c4b0 2026-02-23T06:21:35.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.602+0000 7f71867fc640 1 --2- 10.20.193.58:0/2351801429 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f718815c4b0 0x7f71880b7660 secure :-1 s=READY pgs=106 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f717000c400 tx=0x7f717000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:35.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.602+0000 7f71677fe640 1 -- 10.20.193.58:0/2351801429 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71700117b0 con 0x7f718815c4b0 2026-02-23T06:21:35.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.602+0000 7f7187fff640 1 -- 10.20.193.58:0/2351801429 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f718815f7b0 con 0x7f718815c4b0 2026-02-23T06:21:35.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.603+0000 7f71677fe640 1 -- 10.20.193.58:0/2351801429 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7170011a00 con 0x7f718815c4b0 2026-02-23T06:21:35.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.603+0000 7f71677fe640 1 -- 10.20.193.58:0/2351801429 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7170011db0 con 0x7f718815c4b0 2026-02-23T06:21:35.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.603+0000 7f7187fff640 1 -- 10.20.193.58:0/2351801429 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7188164c40 con 0x7f718815c4b0 2026-02-23T06:21:35.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.603+0000 7f7187fff640 1 -- 10.20.193.58:0/2351801429 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71880ade80 con 0x7f718815c4b0 2026-02-23T06:21:35.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.604+0000 7f71677fe640 1 -- 10.20.193.58:0/2351801429 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f717001c460 con 0x7f718815c4b0 2026-02-23T06:21:35.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.605+0000 7f71677fe640 1 --2- 10.20.193.58:0/2351801429 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f715407a6b0 0x7f715409ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:35.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.605+0000 7f71677fe640 1 -- 10.20.193.58:0/2351801429 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f717009d380 con 0x7f718815c4b0 2026-02-23T06:21:35.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.605+0000 7f7186ffd640 1 --2- 10.20.193.58:0/2351801429 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f715407a6b0 0x7f715409ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:35.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.606+0000 7f7186ffd640 1 --2- 10.20.193.58:0/2351801429 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f715407a6b0 0x7f715409ab60 secure :-1 s=READY pgs=67 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f717c0097e0 tx=0x7f717c031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:35.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.607+0000 7f71677fe640 1 -- 10.20.193.58:0/2351801429 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f7170060580 con 0x7f718815c4b0 2026-02-23T06:21:35.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.720+0000 7f7187fff640 1 -- 10.20.193.58:0/2351801429 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f718813e6a0 con 0x7f718815c4b0 2026-02-23T06:21:35.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.721+0000 7f71677fe640 1 -- 10.20.193.58:0/2351801429 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18600 (secure 0 0 0) 0x7f71700636a0 con 0x7f718815c4b0 2026-02-23T06:21:35.716 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:35.717 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":25,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","created":"2026-02-23T06:21:02.010508+0000","modified":"2026-02-23T06:21:22.447858+0000","last_up_change":"2026-02-23T06:21:08.383048+0000","last_in_change":"2026-02-23T06:21:04.690899+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-23T06:21:10.389081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-23T06:21:16.080621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-23T06:21:16.401311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-23T06:21:20.153808+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"96cc0898-14bb-4d56-827a-8845bd4307c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6808","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6809","nonce":692913334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6810","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6811","nonce":692913334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6814","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6815","nonce":692913334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6812","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6813","nonce":692913334}]},"public_addr":"10.20.193.58:6809/692913334","cluster_addr":"10.20.193.58:6811/692913334","heartbeat_back_addr":"10.20.193.58:6815/692913334","heartbeat_front_addr":"10.20.193.58:6813/692913334","state":["exists","up"]},{"osd":1,"uuid":"bf665af4-6e3c-4cb3-899c-acede65c31f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6800","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6801","nonce":1850584280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6802","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6803","nonce":1850584280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6806","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6807","nonce":1850584280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6804","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6805","nonce":1850584280}]},"public_addr":"10.20.193.58:6801/1850584280","cluster_addr":"10.20.193.58:6803/1850584280","heartbeat_back_addr":"10.20.193.58:6807/1850584280","heartbeat_front_addr":"10.20.193.58:6805/1850584280","state":["exists","up"]},{"osd":2,"uuid":"2bcb3165-28ad-45d6-9a49-9d9da08501f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6823","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6825","nonce":4284600061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6826","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6827","nonce":4284600061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6830","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6831","nonce":4284600061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6828","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6829","nonce":4284600061}]},"public_addr":"10.20.193.58:6825/4284600061","cluster_addr":"10.20.193.58:6827/4284600061","heartbeat_back_addr":"10.20.193.58:6831/4284600061","heartbeat_front_addr":"10.20.193.58:6829/4284600061","state":["exists","up"]},{"osd":3,"uuid":"4750309a-5bf2-4f48-a550-ca677b0b0f61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6816","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6817","nonce":2858636994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6818","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6819","nonce":2858636994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6822","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6824","nonce":2858636994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6820","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6821","nonce":2858636994}]},"public_addr":"10.20.193.58:6817/2858636994","cluster_addr":"10.20.193.58:6819/2858636994","heartbeat_back_addr":"10.20.193.58:6824/2858636994","heartbeat_front_addr":"10.20.193.58:6821/2858636994","state":["exists","up"]},{"osd":4,"uuid":"5cbb50f2-4e49-46eb-bd84-d92706459d2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6803","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6805","nonce":1874834171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6807","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6809","nonce":1874834171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6816","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6817","nonce":1874834171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6812","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6814","nonce":1874834171}]},"public_addr":"10.20.193.93:6805/1874834171","cluster_addr":"10.20.193.93:6809/1874834171","heartbeat_back_addr":"10.20.193.93:6817/1874834171","heartbeat_front_addr":"10.20.193.93:6814/1874834171","state":["exists","up"]},{"osd":5,"uuid":"2806c775-4720-43a7-ab9f-85a4adb31098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6802","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6804","nonce":356968280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6806","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6808","nonce":356968280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6813","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6815","nonce":356968280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6810","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6811","nonce":356968280}]},"public_addr":"10.20.193.93:6804/356968280","cluster_addr":"10.20.193.93:6808/356968280","heartbeat_back_addr":"10.20.193.93:6815/356968280","heartbeat_front_addr":"10.20.193.93:6811/356968280","state":["exists","up"]},{"osd":6,"uuid":"aa03b46d-d30f-4b09-9251-c9514e8b8b6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6819","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6821","nonce":2948039088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6823","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6825","nonce":2948039088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6831","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6833","nonce":2948039088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6827","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6829","nonce":2948039088}]},"public_addr":"10.20.193.93:6821/2948039088","cluster_addr":"10.20.193.93:6825/2948039088","heartbeat_back_addr":"10.20.193.93:6833/2948039088","heartbeat_front_addr":"10.20.193.93:6829/2948039088","state":["exists","up"]},{"osd":7,"uuid":"b15519bf-2b7b-4fd5-8ef6-e09af0ad9817","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6818","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6820","nonce":2960650087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6822","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6824","nonce":2960650087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6830","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6832","nonce":2960650087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6826","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6828","nonce":2960650087}]},"public_addr":"10.20.193.93:6820/2960650087","cluster_addr":"10.20.193.93:6824/2960650087","heartbeat_back_addr":"10.20.193.93:6832/2960650087","heartbeat_front_addr":"10.20.193.93:6828/2960650087","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.717515+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.744114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.772247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.768341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.521808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.486005+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.480882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.473408+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"2","m":"2","plugin":"isa","technique":"reed_sol_van"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-23T06:21:35.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.722+0000 7f7187fff640 1 -- 10.20.193.58:0/2351801429 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f715407a6b0 msgr2=0x7f715409ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:35.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.722+0000 7f7187fff640 1 --2- 10.20.193.58:0/2351801429 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f715407a6b0 0x7f715409ab60 secure :-1 s=READY pgs=67 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f717c0097e0 tx=0x7f717c031040 comp rx=0 tx=0).stop 2026-02-23T06:21:35.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.722+0000 7f7187fff640 1 -- 10.20.193.58:0/2351801429 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f718815c4b0 msgr2=0x7f71880b7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:35.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.722+0000 7f7187fff640 1 --2- 10.20.193.58:0/2351801429 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f718815c4b0 0x7f71880b7660 secure :-1 s=READY pgs=106 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f717000c400 tx=0x7f717000c8d0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.722+0000 7f7187fff640 1 -- 10.20.193.58:0/2351801429 shutdown_connections 2026-02-23T06:21:35.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.722+0000 7f7187fff640 1 --2- 10.20.193.58:0/2351801429 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f715407a6b0 0x7f715409ab60 unknown :-1 s=CLOSED pgs=67 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.722+0000 7f7187fff640 1 --2- 10.20.193.58:0/2351801429 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7188162ca0 0x7f71880b7ba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.722+0000 7f7187fff640 1 --2- 10.20.193.58:0/2351801429 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f718815c4b0 0x7f71880b7660 unknown :-1 s=CLOSED pgs=106 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.722+0000 7f7187fff640 1 --2- 10.20.193.58:0/2351801429 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7188056960 0x7f7188164700 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.722+0000 7f7187fff640 1 -- 10.20.193.58:0/2351801429 >> 10.20.193.58:0/2351801429 conn(0x7f71880b3c20 msgr2=0x7f7188160750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:35.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.722+0000 7f7187fff640 1 -- 10.20.193.58:0/2351801429 shutdown_connections 2026-02-23T06:21:35.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.722+0000 7f7187fff640 1 -- 10.20.193.58:0/2351801429 wait complete. 2026-02-23T06:21:35.730 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-23T06:21:35.730 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-23T06:21:35.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.856+0000 7f02bd5b5640 1 -- 10.20.193.58:0/2290024840 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f02b815c4b0 msgr2=0x7f02b8058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:35.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.856+0000 7f02bd5b5640 1 --2- 10.20.193.58:0/2290024840 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f02b815c4b0 0x7f02b8058200 secure :-1 s=READY pgs=64 gs=2 cs=0 l=1 c_cookie=6312882569994507510 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02a4005e70 tx=0x7f02a402f230 comp rx=0 tx=0).stop 2026-02-23T06:21:35.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.856+0000 7f02bd5b5640 1 -- 10.20.193.58:0/2290024840 shutdown_connections 2026-02-23T06:21:35.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.856+0000 7f02bd5b5640 1 --2- 10.20.193.58:0/2290024840 >> v2:10.20.193.93:3300/0 conn(0x7f02b8056960 0x7f02b80b6720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.856+0000 7f02bd5b5640 1 --2- 10.20.193.58:0/2290024840 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f02b815c4b0 0x7f02b8058200 unknown :-1 s=CLOSED pgs=64 gs=2 cs=0 l=1 c_cookie=6312882569994507510 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.856+0000 7f02bd5b5640 1 -- 10.20.193.58:0/2290024840 >> 10.20.193.58:0/2290024840 conn(0x7f02b80b3c20 msgr2=0x7f02b80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:35.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.856+0000 7f02bd5b5640 1 -- 10.20.193.58:0/2290024840 shutdown_connections 2026-02-23T06:21:35.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.856+0000 7f02bd5b5640 1 -- 10.20.193.58:0/2290024840 wait complete. 2026-02-23T06:21:35.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.857+0000 7f02bd5b5640 1 Processor -- start 2026-02-23T06:21:35.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.857+0000 7f02bd5b5640 1 -- start start 2026-02-23T06:21:35.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.858+0000 7f02bd5b5640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02b8056960 0x7f02b815b7f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:35.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.858+0000 7f02bd5b5640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f02b815c4b0 0x7f02b80ada30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:35.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.858+0000 7f02bd5b5640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f02b8162ca0 0x7f02b80adf70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:35.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.858+0000 7f02bd5b5640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f02b80b1070 con 0x7f02b8056960 2026-02-23T06:21:35.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.858+0000 7f02bd5b5640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f02b815b3d0 con 0x7f02b815c4b0 2026-02-23T06:21:35.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.858+0000 7f02bd5b5640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f02b815bd30 con 0x7f02b8162ca0 2026-02-23T06:21:35.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.858+0000 7f02b7fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02b8056960 0x7f02b815b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:35.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.858+0000 7f02b7fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02b8056960 0x7f02b815b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50688/0 (socket says 10.20.193.58:50688) 2026-02-23T06:21:35.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.858+0000 7f02b7fff640 1 -- 10.20.193.58:0/1088293601 learned_addr learned my addr 10.20.193.58:0/1088293601 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:35.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.858+0000 7f02b77fe640 1 --2- 10.20.193.58:0/1088293601 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f02b815c4b0 0x7f02b80ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:35.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.858+0000 7f02bcdb4640 1 --2- 10.20.193.58:0/1088293601 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f02b8162ca0 0x7f02b80adf70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:35.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.858+0000 7f02b7fff640 1 -- 10.20.193.58:0/1088293601 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f02b8162ca0 msgr2=0x7f02b80adf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:35.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.858+0000 7f02b7fff640 1 --2- 10.20.193.58:0/1088293601 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f02b8162ca0 0x7f02b80adf70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.858+0000 7f02b7fff640 1 -- 10.20.193.58:0/1088293601 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f02b815c4b0 msgr2=0x7f02b80ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:35.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.858+0000 7f02b7fff640 1 --2- 10.20.193.58:0/1088293601 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f02b815c4b0 0x7f02b80ada30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.858+0000 7f02b7fff640 1 -- 10.20.193.58:0/1088293601 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a80094b0 con 0x7f02b8056960 2026-02-23T06:21:35.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.858+0000 7f02b7fff640 1 --2- 10.20.193.58:0/1088293601 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02b8056960 0x7f02b815b7f0 secure :-1 s=READY pgs=107 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02a4005970 tx=0x7f02a40028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:35.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.859+0000 7f02b4ff9640 1 -- 10.20.193.58:0/1088293601 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f02a403d070 con 0x7f02b8056960 2026-02-23T06:21:35.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.859+0000 7f02bd5b5640 1 -- 10.20.193.58:0/1088293601 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02a4009570 con 0x7f02b8056960 2026-02-23T06:21:35.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.859+0000 7f02bd5b5640 1 -- 10.20.193.58:0/1088293601 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02b80b0ab0 con 0x7f02b8056960 2026-02-23T06:21:35.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.859+0000 7f02b4ff9640 1 -- 10.20.193.58:0/1088293601 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02a4038470 con 0x7f02b8056960 2026-02-23T06:21:35.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.859+0000 7f02b4ff9640 1 -- 10.20.193.58:0/1088293601 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f02a40388a0 con 0x7f02b8056960 2026-02-23T06:21:35.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.859+0000 7f02bd5b5640 1 -- 10.20.193.58:0/1088293601 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02b815b510 con 0x7f02b8056960 2026-02-23T06:21:35.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.860+0000 7f02b4ff9640 1 -- 10.20.193.58:0/1088293601 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f02a4038a00 con 0x7f02b8056960 2026-02-23T06:21:35.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.861+0000 7f02b4ff9640 1 --2- 10.20.193.58:0/1088293601 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f028807a6c0 0x7f028809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:35.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.861+0000 7f02b4ff9640 1 -- 10.20.193.58:0/1088293601 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f02a40c2120 con 0x7f02b8056960 2026-02-23T06:21:35.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.862+0000 7f02b77fe640 1 --2- 10.20.193.58:0/1088293601 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f028807a6c0 0x7f028809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:35.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.863+0000 7f02b77fe640 1 --2- 10.20.193.58:0/1088293601 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f028807a6c0 0x7f028809ab70 secure :-1 s=READY pgs=68 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02b8139220 tx=0x7f02a8005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:35.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.863+0000 7f02b4ff9640 1 -- 10.20.193.58:0/1088293601 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f02b815b510 con 0x7f02b8056960 2026-02-23T06:21:35.970 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.976+0000 7f02bd5b5640 1 -- 10.20.193.58:0/1088293601 --> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f02b8059690 con 0x7f028807a6c0 2026-02-23T06:21:35.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.980+0000 7f02b4ff9640 1 -- 10.20.193.58:0/1088293601 <== mgr.4126 v2:10.20.193.93:6800/4124709854 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332647 (secure 0 0 0) 0x7f02a8016070 con 0x7f028807a6c0 2026-02-23T06:21:35.976 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:35.980 INFO:teuthology.orchestra.run.trial058.stderr:dumped all 2026-02-23T06:21:35.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.982+0000 7f02bd5b5640 1 -- 10.20.193.58:0/1088293601 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f028807a6c0 msgr2=0x7f028809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:35.982 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.982+0000 7f02bd5b5640 1 --2- 10.20.193.58:0/1088293601 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f028807a6c0 0x7f028809ab70 secure :-1 s=READY pgs=68 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02b8139220 tx=0x7f02a8005f90 comp rx=0 tx=0).stop 2026-02-23T06:21:35.982 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.982+0000 7f02bd5b5640 1 -- 10.20.193.58:0/1088293601 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02b8056960 msgr2=0x7f02b815b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:35.982 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.982+0000 7f02bd5b5640 1 --2- 10.20.193.58:0/1088293601 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02b8056960 0x7f02b815b7f0 secure :-1 s=READY pgs=107 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02a4005970 tx=0x7f02a40028d0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.982 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.982+0000 7f02bd5b5640 1 -- 10.20.193.58:0/1088293601 shutdown_connections 2026-02-23T06:21:35.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.982+0000 7f02bd5b5640 1 --2- 10.20.193.58:0/1088293601 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f028807a6c0 0x7f028809ab70 unknown :-1 s=CLOSED pgs=68 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.982+0000 7f02bd5b5640 1 --2- 10.20.193.58:0/1088293601 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f02b8162ca0 0x7f02b80adf70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.982+0000 7f02bd5b5640 1 --2- 10.20.193.58:0/1088293601 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f02b815c4b0 0x7f02b80ada30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.982+0000 7f02bd5b5640 1 --2- 10.20.193.58:0/1088293601 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02b8056960 0x7f02b815b7f0 unknown :-1 s=CLOSED pgs=107 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:35.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.982+0000 7f02bd5b5640 1 -- 10.20.193.58:0/1088293601 >> 10.20.193.58:0/1088293601 conn(0x7f02b80b3c20 msgr2=0x7f02b813c340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:35.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.983+0000 7f02bd5b5640 1 -- 10.20.193.58:0/1088293601 shutdown_connections 2026-02-23T06:21:35.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:35.983+0000 7f02bd5b5640 1 -- 10.20.193.58:0/1088293601 wait complete. 2026-02-23T06:21:35.989 INFO:teuthology.orchestra.run.trial058.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2026-02-23T06:21:34.376495+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592822,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":190,"num_write_kb":2686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":217952,"kb_used_data":2272,"kb_used_omap":107,"kb_used_meta":215444,"kb_avail":754756768,"statfs":{"total":773094113280,"available":772870930432,"internally_reserved":0,"allocated":2326528,"data_stored":2021844,"data_compressed":70172,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":110106,"internal_metadata":220615142},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2454,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.220833"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156952+0000","last_change":"2026-02-23T06:21:17.142582+0000","last_active":"2026-02-23T06:21:23.156952+0000","last_peered":"2026-02-23T06:21:23.156952+0000","last_clean":"2026-02-23T06:21:23.156952+0000","last_became_active":"2026-02-23T06:21:17.142416+0000","last_became_peered":"2026-02-23T06:21:17.142416+0000","last_unstale":"2026-02-23T06:21:23.156952+0000","last_undegraded":"2026-02-23T06:21:23.156952+0000","last_fullsized":"2026-02-23T06:21:23.156952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:13:12.649937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157112+0000","last_change":"2026-02-23T06:21:18.148362+0000","last_active":"2026-02-23T06:21:23.157112+0000","last_peered":"2026-02-23T06:21:23.157112+0000","last_clean":"2026-02-23T06:21:23.157112+0000","last_became_active":"2026-02-23T06:21:18.148276+0000","last_became_peered":"2026-02-23T06:21:18.148276+0000","last_unstale":"2026-02-23T06:21:23.157112+0000","last_undegraded":"2026-02-23T06:21:23.157112+0000","last_fullsized":"2026-02-23T06:21:23.157112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:47.221741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156473+0000","last_change":"2026-02-23T06:21:22.169541+0000","last_active":"2026-02-23T06:21:23.156473+0000","last_peered":"2026-02-23T06:21:23.156473+0000","last_clean":"2026-02-23T06:21:23.156473+0000","last_became_active":"2026-02-23T06:21:22.169307+0000","last_became_peered":"2026-02-23T06:21:22.169307+0000","last_unstale":"2026-02-23T06:21:23.156473+0000","last_undegraded":"2026-02-23T06:21:23.156473+0000","last_fullsized":"2026-02-23T06:21:23.156473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:40:10.952374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157171+0000","last_change":"2026-02-23T06:21:17.138864+0000","last_active":"2026-02-23T06:21:23.157171+0000","last_peered":"2026-02-23T06:21:23.157171+0000","last_clean":"2026-02-23T06:21:23.157171+0000","last_became_active":"2026-02-23T06:21:17.138651+0000","last_became_peered":"2026-02-23T06:21:17.138651+0000","last_unstale":"2026-02-23T06:21:23.157171+0000","last_undegraded":"2026-02-23T06:21:23.157171+0000","last_fullsized":"2026-02-23T06:21:23.157171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:24.172617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157312+0000","last_change":"2026-02-23T06:21:18.145040+0000","last_active":"2026-02-23T06:21:23.157312+0000","last_peered":"2026-02-23T06:21:23.157312+0000","last_clean":"2026-02-23T06:21:23.157312+0000","last_became_active":"2026-02-23T06:21:18.144915+0000","last_became_peered":"2026-02-23T06:21:18.144915+0000","last_unstale":"2026-02-23T06:21:23.157312+0000","last_undegraded":"2026-02-23T06:21:23.157312+0000","last_fullsized":"2026-02-23T06:21:23.157312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:17:30.105623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158170+0000","last_change":"2026-02-23T06:21:22.172729+0000","last_active":"2026-02-23T06:21:23.158170+0000","last_peered":"2026-02-23T06:21:23.158170+0000","last_clean":"2026-02-23T06:21:23.158170+0000","last_became_active":"2026-02-23T06:21:22.172510+0000","last_became_peered":"2026-02-23T06:21:22.172510+0000","last_unstale":"2026-02-23T06:21:23.158170+0000","last_undegraded":"2026-02-23T06:21:23.158170+0000","last_fullsized":"2026-02-23T06:21:23.158170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:53:55.801734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158943+0000","last_change":"2026-02-23T06:21:17.150375+0000","last_active":"2026-02-23T06:21:23.158943+0000","last_peered":"2026-02-23T06:21:23.158943+0000","last_clean":"2026-02-23T06:21:23.158943+0000","last_became_active":"2026-02-23T06:21:17.150244+0000","last_became_peered":"2026-02-23T06:21:17.150244+0000","last_unstale":"2026-02-23T06:21:23.158943+0000","last_undegraded":"2026-02-23T06:21:23.158943+0000","last_fullsized":"2026-02-23T06:21:23.158943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:06:21.465108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157674+0000","last_change":"2026-02-23T06:21:18.150247+0000","last_active":"2026-02-23T06:21:23.157674+0000","last_peered":"2026-02-23T06:21:23.157674+0000","last_clean":"2026-02-23T06:21:23.157674+0000","last_became_active":"2026-02-23T06:21:18.149827+0000","last_became_peered":"2026-02-23T06:21:18.149827+0000","last_unstale":"2026-02-23T06:21:23.157674+0000","last_undegraded":"2026-02-23T06:21:23.157674+0000","last_fullsized":"2026-02-23T06:21:23.157674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:37:58.944726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158517+0000","last_change":"2026-02-23T06:21:22.174417+0000","last_active":"2026-02-23T06:21:23.158517+0000","last_peered":"2026-02-23T06:21:23.158517+0000","last_clean":"2026-02-23T06:21:23.158517+0000","last_became_active":"2026-02-23T06:21:22.173939+0000","last_became_peered":"2026-02-23T06:21:22.173939+0000","last_unstale":"2026-02-23T06:21:23.158517+0000","last_undegraded":"2026-02-23T06:21:23.158517+0000","last_fullsized":"2026-02-23T06:21:23.158517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:41:53.008301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158816+0000","last_change":"2026-02-23T06:21:17.145244+0000","last_active":"2026-02-23T06:21:23.158816+0000","last_peered":"2026-02-23T06:21:23.158816+0000","last_clean":"2026-02-23T06:21:23.158816+0000","last_became_active":"2026-02-23T06:21:17.144122+0000","last_became_peered":"2026-02-23T06:21:17.144122+0000","last_unstale":"2026-02-23T06:21:23.158816+0000","last_undegraded":"2026-02-23T06:21:23.158816+0000","last_fullsized":"2026-02-23T06:21:23.158816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:42:56.020005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159068+0000","last_change":"2026-02-23T06:21:18.155799+0000","last_active":"2026-02-23T06:21:23.159068+0000","last_peered":"2026-02-23T06:21:23.159068+0000","last_clean":"2026-02-23T06:21:23.159068+0000","last_became_active":"2026-02-23T06:21:18.154985+0000","last_became_peered":"2026-02-23T06:21:18.154985+0000","last_unstale":"2026-02-23T06:21:23.159068+0000","last_undegraded":"2026-02-23T06:21:23.159068+0000","last_fullsized":"2026-02-23T06:21:23.159068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:11:13.595733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158472+0000","last_change":"2026-02-23T06:21:22.168755+0000","last_active":"2026-02-23T06:21:23.158472+0000","last_peered":"2026-02-23T06:21:23.158472+0000","last_clean":"2026-02-23T06:21:23.158472+0000","last_became_active":"2026-02-23T06:21:22.165671+0000","last_became_peered":"2026-02-23T06:21:22.165671+0000","last_unstale":"2026-02-23T06:21:23.158472+0000","last_undegraded":"2026-02-23T06:21:23.158472+0000","last_fullsized":"2026-02-23T06:21:23.158472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:04:32.848929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157587+0000","last_change":"2026-02-23T06:21:18.150907+0000","last_active":"2026-02-23T06:21:23.157587+0000","last_peered":"2026-02-23T06:21:23.157587+0000","last_clean":"2026-02-23T06:21:23.157587+0000","last_became_active":"2026-02-23T06:21:18.150604+0000","last_became_peered":"2026-02-23T06:21:18.150604+0000","last_unstale":"2026-02-23T06:21:23.157587+0000","last_undegraded":"2026-02-23T06:21:23.157587+0000","last_fullsized":"2026-02-23T06:21:23.157587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:15:21.672153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157971+0000","last_change":"2026-02-23T06:21:17.147523+0000","last_active":"2026-02-23T06:21:23.157971+0000","last_peered":"2026-02-23T06:21:23.157971+0000","last_clean":"2026-02-23T06:21:23.157971+0000","last_became_active":"2026-02-23T06:21:17.147351+0000","last_became_peered":"2026-02-23T06:21:17.147351+0000","last_unstale":"2026-02-23T06:21:23.157971+0000","last_undegraded":"2026-02-23T06:21:23.157971+0000","last_fullsized":"2026-02-23T06:21:23.157971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:36:34.550499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158924+0000","last_change":"2026-02-23T06:21:22.169413+0000","last_active":"2026-02-23T06:21:23.158924+0000","last_peered":"2026-02-23T06:21:23.158924+0000","last_clean":"2026-02-23T06:21:23.158924+0000","last_became_active":"2026-02-23T06:21:22.169259+0000","last_became_peered":"2026-02-23T06:21:22.169259+0000","last_unstale":"2026-02-23T06:21:23.158924+0000","last_undegraded":"2026-02-23T06:21:23.158924+0000","last_fullsized":"2026-02-23T06:21:23.158924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:14:12.944321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156495+0000","last_change":"2026-02-23T06:21:18.142316+0000","last_active":"2026-02-23T06:21:23.156495+0000","last_peered":"2026-02-23T06:21:23.156495+0000","last_clean":"2026-02-23T06:21:23.156495+0000","last_became_active":"2026-02-23T06:21:18.142144+0000","last_became_peered":"2026-02-23T06:21:18.142144+0000","last_unstale":"2026-02-23T06:21:23.156495+0000","last_undegraded":"2026-02-23T06:21:23.156495+0000","last_fullsized":"2026-02-23T06:21:23.156495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:53:33.429271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157370+0000","last_change":"2026-02-23T06:21:17.137576+0000","last_active":"2026-02-23T06:21:23.157370+0000","last_peered":"2026-02-23T06:21:23.157370+0000","last_clean":"2026-02-23T06:21:23.157370+0000","last_became_active":"2026-02-23T06:21:17.137371+0000","last_became_peered":"2026-02-23T06:21:17.137371+0000","last_unstale":"2026-02-23T06:21:23.157370+0000","last_undegraded":"2026-02-23T06:21:23.157370+0000","last_fullsized":"2026-02-23T06:21:23.157370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:27.159743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158222+0000","last_change":"2026-02-23T06:21:22.163003+0000","last_active":"2026-02-23T06:21:23.158222+0000","last_peered":"2026-02-23T06:21:23.158222+0000","last_clean":"2026-02-23T06:21:23.158222+0000","last_became_active":"2026-02-23T06:21:22.162898+0000","last_became_peered":"2026-02-23T06:21:22.162898+0000","last_unstale":"2026-02-23T06:21:23.158222+0000","last_undegraded":"2026-02-23T06:21:23.158222+0000","last_fullsized":"2026-02-23T06:21:23.158222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:29:18.161667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156351+0000","last_change":"2026-02-23T06:21:18.141281+0000","last_active":"2026-02-23T06:21:23.156351+0000","last_peered":"2026-02-23T06:21:23.156351+0000","last_clean":"2026-02-23T06:21:23.156351+0000","last_became_active":"2026-02-23T06:21:18.141090+0000","last_became_peered":"2026-02-23T06:21:18.141090+0000","last_unstale":"2026-02-23T06:21:23.156351+0000","last_undegraded":"2026-02-23T06:21:23.156351+0000","last_fullsized":"2026-02-23T06:21:23.156351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:12:21.750595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156633+0000","last_change":"2026-02-23T06:21:17.144179+0000","last_active":"2026-02-23T06:21:23.156633+0000","last_peered":"2026-02-23T06:21:23.156633+0000","last_clean":"2026-02-23T06:21:23.156633+0000","last_became_active":"2026-02-23T06:21:17.144017+0000","last_became_peered":"2026-02-23T06:21:17.144017+0000","last_unstale":"2026-02-23T06:21:23.156633+0000","last_undegraded":"2026-02-23T06:21:23.156633+0000","last_fullsized":"2026-02-23T06:21:23.156633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:25:41.992201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156888+0000","last_change":"2026-02-23T06:21:22.174826+0000","last_active":"2026-02-23T06:21:23.156888+0000","last_peered":"2026-02-23T06:21:23.156888+0000","last_clean":"2026-02-23T06:21:23.156888+0000","last_became_active":"2026-02-23T06:21:22.174683+0000","last_became_peered":"2026-02-23T06:21:22.174683+0000","last_unstale":"2026-02-23T06:21:23.156888+0000","last_undegraded":"2026-02-23T06:21:23.156888+0000","last_fullsized":"2026-02-23T06:21:23.156888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:04:49.277580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157342+0000","last_change":"2026-02-23T06:21:18.145331+0000","last_active":"2026-02-23T06:21:23.157342+0000","last_peered":"2026-02-23T06:21:23.157342+0000","last_clean":"2026-02-23T06:21:23.157342+0000","last_became_active":"2026-02-23T06:21:18.145231+0000","last_became_peered":"2026-02-23T06:21:18.145231+0000","last_unstale":"2026-02-23T06:21:23.157342+0000","last_undegraded":"2026-02-23T06:21:23.157342+0000","last_fullsized":"2026-02-23T06:21:23.157342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:32:44.487867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157126+0000","last_change":"2026-02-23T06:21:17.147584+0000","last_active":"2026-02-23T06:21:23.157126+0000","last_peered":"2026-02-23T06:21:23.157126+0000","last_clean":"2026-02-23T06:21:23.157126+0000","last_became_active":"2026-02-23T06:21:17.147431+0000","last_became_peered":"2026-02-23T06:21:17.147431+0000","last_unstale":"2026-02-23T06:21:23.157126+0000","last_undegraded":"2026-02-23T06:21:23.157126+0000","last_fullsized":"2026-02-23T06:21:23.157126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:10:39.127457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159080+0000","last_change":"2026-02-23T06:21:22.175656+0000","last_active":"2026-02-23T06:21:23.159080+0000","last_peered":"2026-02-23T06:21:23.159080+0000","last_clean":"2026-02-23T06:21:23.159080+0000","last_became_active":"2026-02-23T06:21:22.175493+0000","last_became_peered":"2026-02-23T06:21:22.175493+0000","last_unstale":"2026-02-23T06:21:23.159080+0000","last_undegraded":"2026-02-23T06:21:23.159080+0000","last_fullsized":"2026-02-23T06:21:23.159080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:10:41.366772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156769+0000","last_change":"2026-02-23T06:21:18.141486+0000","last_active":"2026-02-23T06:21:23.156769+0000","last_peered":"2026-02-23T06:21:23.156769+0000","last_clean":"2026-02-23T06:21:23.156769+0000","last_became_active":"2026-02-23T06:21:18.141277+0000","last_became_peered":"2026-02-23T06:21:18.141277+0000","last_unstale":"2026-02-23T06:21:23.156769+0000","last_undegraded":"2026-02-23T06:21:23.156769+0000","last_fullsized":"2026-02-23T06:21:23.156769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:21:15.738187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158970+0000","last_change":"2026-02-23T06:21:17.148536+0000","last_active":"2026-02-23T06:21:23.158970+0000","last_peered":"2026-02-23T06:21:23.158970+0000","last_clean":"2026-02-23T06:21:23.158970+0000","last_became_active":"2026-02-23T06:21:17.148424+0000","last_became_peered":"2026-02-23T06:21:17.148424+0000","last_unstale":"2026-02-23T06:21:23.158970+0000","last_undegraded":"2026-02-23T06:21:23.158970+0000","last_fullsized":"2026-02-23T06:21:23.158970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:02:54.995144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158363+0000","last_change":"2026-02-23T06:21:22.171333+0000","last_active":"2026-02-23T06:21:23.158363+0000","last_peered":"2026-02-23T06:21:23.158363+0000","last_clean":"2026-02-23T06:21:23.158363+0000","last_became_active":"2026-02-23T06:21:22.170496+0000","last_became_peered":"2026-02-23T06:21:22.170496+0000","last_unstale":"2026-02-23T06:21:23.158363+0000","last_undegraded":"2026-02-23T06:21:23.158363+0000","last_fullsized":"2026-02-23T06:21:23.158363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:40:07.996281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156943+0000","last_change":"2026-02-23T06:21:18.142135+0000","last_active":"2026-02-23T06:21:23.156943+0000","last_peered":"2026-02-23T06:21:23.156943+0000","last_clean":"2026-02-23T06:21:23.156943+0000","last_became_active":"2026-02-23T06:21:18.141771+0000","last_became_peered":"2026-02-23T06:21:18.141771+0000","last_unstale":"2026-02-23T06:21:23.156943+0000","last_undegraded":"2026-02-23T06:21:23.156943+0000","last_fullsized":"2026-02-23T06:21:23.156943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:10:18.195986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156859+0000","last_change":"2026-02-23T06:21:17.142326+0000","last_active":"2026-02-23T06:21:23.156859+0000","last_peered":"2026-02-23T06:21:23.156859+0000","last_clean":"2026-02-23T06:21:23.156859+0000","last_became_active":"2026-02-23T06:21:17.142203+0000","last_became_peered":"2026-02-23T06:21:17.142203+0000","last_unstale":"2026-02-23T06:21:23.156859+0000","last_undegraded":"2026-02-23T06:21:23.156859+0000","last_fullsized":"2026-02-23T06:21:23.156859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:49:44.262210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156453+0000","last_change":"2026-02-23T06:21:22.168717+0000","last_active":"2026-02-23T06:21:23.156453+0000","last_peered":"2026-02-23T06:21:23.156453+0000","last_clean":"2026-02-23T06:21:23.156453+0000","last_became_active":"2026-02-23T06:21:22.168375+0000","last_became_peered":"2026-02-23T06:21:22.168375+0000","last_unstale":"2026-02-23T06:21:23.156453+0000","last_undegraded":"2026-02-23T06:21:23.156453+0000","last_fullsized":"2026-02-23T06:21:23.156453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:03:53.993581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157404+0000","last_change":"2026-02-23T06:21:18.141908+0000","last_active":"2026-02-23T06:21:23.157404+0000","last_peered":"2026-02-23T06:21:23.157404+0000","last_clean":"2026-02-23T06:21:23.157404+0000","last_became_active":"2026-02-23T06:21:18.141363+0000","last_became_peered":"2026-02-23T06:21:18.141363+0000","last_unstale":"2026-02-23T06:21:23.157404+0000","last_undegraded":"2026-02-23T06:21:23.157404+0000","last_fullsized":"2026-02-23T06:21:23.157404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:06:26.731868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159168+0000","last_change":"2026-02-23T06:21:17.144716+0000","last_active":"2026-02-23T06:21:23.159168+0000","last_peered":"2026-02-23T06:21:23.159168+0000","last_clean":"2026-02-23T06:21:23.159168+0000","last_became_active":"2026-02-23T06:21:17.144515+0000","last_became_peered":"2026-02-23T06:21:17.144515+0000","last_unstale":"2026-02-23T06:21:23.159168+0000","last_undegraded":"2026-02-23T06:21:23.159168+0000","last_fullsized":"2026-02-23T06:21:23.159168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:38:35.014170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157139+0000","last_change":"2026-02-23T06:21:22.171364+0000","last_active":"2026-02-23T06:21:23.157139+0000","last_peered":"2026-02-23T06:21:23.157139+0000","last_clean":"2026-02-23T06:21:23.157139+0000","last_became_active":"2026-02-23T06:21:22.171165+0000","last_became_peered":"2026-02-23T06:21:22.171165+0000","last_unstale":"2026-02-23T06:21:23.157139+0000","last_undegraded":"2026-02-23T06:21:23.157139+0000","last_fullsized":"2026-02-23T06:21:23.157139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:00:42.055334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158796+0000","last_change":"2026-02-23T06:21:18.144182+0000","last_active":"2026-02-23T06:21:23.158796+0000","last_peered":"2026-02-23T06:21:23.158796+0000","last_clean":"2026-02-23T06:21:23.158796+0000","last_became_active":"2026-02-23T06:21:18.143585+0000","last_became_peered":"2026-02-23T06:21:18.143585+0000","last_unstale":"2026-02-23T06:21:23.158796+0000","last_undegraded":"2026-02-23T06:21:23.158796+0000","last_fullsized":"2026-02-23T06:21:23.158796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:07:05.513990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156754+0000","last_change":"2026-02-23T06:21:17.137935+0000","last_active":"2026-02-23T06:21:23.156754+0000","last_peered":"2026-02-23T06:21:23.156754+0000","last_clean":"2026-02-23T06:21:23.156754+0000","last_became_active":"2026-02-23T06:21:17.137386+0000","last_became_peered":"2026-02-23T06:21:17.137386+0000","last_unstale":"2026-02-23T06:21:23.156754+0000","last_undegraded":"2026-02-23T06:21:23.156754+0000","last_fullsized":"2026-02-23T06:21:23.156754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:51:24.646436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157353+0000","last_change":"2026-02-23T06:21:22.163110+0000","last_active":"2026-02-23T06:21:23.157353+0000","last_peered":"2026-02-23T06:21:23.157353+0000","last_clean":"2026-02-23T06:21:23.157353+0000","last_became_active":"2026-02-23T06:21:22.162891+0000","last_became_peered":"2026-02-23T06:21:22.162891+0000","last_unstale":"2026-02-23T06:21:23.157353+0000","last_undegraded":"2026-02-23T06:21:23.157353+0000","last_fullsized":"2026-02-23T06:21:23.157353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:06:23.664613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157998+0000","last_change":"2026-02-23T06:21:18.152606+0000","last_active":"2026-02-23T06:21:23.157998+0000","last_peered":"2026-02-23T06:21:23.157998+0000","last_clean":"2026-02-23T06:21:23.157998+0000","last_became_active":"2026-02-23T06:21:18.152102+0000","last_became_peered":"2026-02-23T06:21:18.152102+0000","last_unstale":"2026-02-23T06:21:23.157998+0000","last_undegraded":"2026-02-23T06:21:23.157998+0000","last_fullsized":"2026-02-23T06:21:23.157998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:59:30.188417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157850+0000","last_change":"2026-02-23T06:21:17.143289+0000","last_active":"2026-02-23T06:21:23.157850+0000","last_peered":"2026-02-23T06:21:23.157850+0000","last_clean":"2026-02-23T06:21:23.157850+0000","last_became_active":"2026-02-23T06:21:17.143201+0000","last_became_peered":"2026-02-23T06:21:17.143201+0000","last_unstale":"2026-02-23T06:21:23.157850+0000","last_undegraded":"2026-02-23T06:21:23.157850+0000","last_fullsized":"2026-02-23T06:21:23.157850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:33:06.892035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157325+0000","last_change":"2026-02-23T06:21:22.163932+0000","last_active":"2026-02-23T06:21:23.157325+0000","last_peered":"2026-02-23T06:21:23.157325+0000","last_clean":"2026-02-23T06:21:23.157325+0000","last_became_active":"2026-02-23T06:21:22.163734+0000","last_became_peered":"2026-02-23T06:21:22.163734+0000","last_unstale":"2026-02-23T06:21:23.157325+0000","last_undegraded":"2026-02-23T06:21:23.157325+0000","last_fullsized":"2026-02-23T06:21:23.157325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:44:47.208608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156436+0000","last_change":"2026-02-23T06:21:18.141664+0000","last_active":"2026-02-23T06:21:23.156436+0000","last_peered":"2026-02-23T06:21:23.156436+0000","last_clean":"2026-02-23T06:21:23.156436+0000","last_became_active":"2026-02-23T06:21:18.141350+0000","last_became_peered":"2026-02-23T06:21:18.141350+0000","last_unstale":"2026-02-23T06:21:23.156436+0000","last_undegraded":"2026-02-23T06:21:23.156436+0000","last_fullsized":"2026-02-23T06:21:23.156436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:01:50.434732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156433+0000","last_change":"2026-02-23T06:21:17.139311+0000","last_active":"2026-02-23T06:21:23.156433+0000","last_peered":"2026-02-23T06:21:23.156433+0000","last_clean":"2026-02-23T06:21:23.156433+0000","last_became_active":"2026-02-23T06:21:17.139200+0000","last_became_peered":"2026-02-23T06:21:17.139200+0000","last_unstale":"2026-02-23T06:21:23.156433+0000","last_undegraded":"2026-02-23T06:21:23.156433+0000","last_fullsized":"2026-02-23T06:21:23.156433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:52:23.863807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157449+0000","last_change":"2026-02-23T06:21:22.164793+0000","last_active":"2026-02-23T06:21:23.157449+0000","last_peered":"2026-02-23T06:21:23.157449+0000","last_clean":"2026-02-23T06:21:23.157449+0000","last_became_active":"2026-02-23T06:21:22.164667+0000","last_became_peered":"2026-02-23T06:21:22.164667+0000","last_unstale":"2026-02-23T06:21:23.157449+0000","last_undegraded":"2026-02-23T06:21:23.157449+0000","last_fullsized":"2026-02-23T06:21:23.157449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:36:39.520044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156948+0000","last_change":"2026-02-23T06:21:18.146624+0000","last_active":"2026-02-23T06:21:23.156948+0000","last_peered":"2026-02-23T06:21:23.156948+0000","last_clean":"2026-02-23T06:21:23.156948+0000","last_became_active":"2026-02-23T06:21:18.146491+0000","last_became_peered":"2026-02-23T06:21:18.146491+0000","last_unstale":"2026-02-23T06:21:23.156948+0000","last_undegraded":"2026-02-23T06:21:23.156948+0000","last_fullsized":"2026-02-23T06:21:23.156948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:11:23.574241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157493+0000","last_change":"2026-02-23T06:21:17.143128+0000","last_active":"2026-02-23T06:21:23.157493+0000","last_peered":"2026-02-23T06:21:23.157493+0000","last_clean":"2026-02-23T06:21:23.157493+0000","last_became_active":"2026-02-23T06:21:17.143050+0000","last_became_peered":"2026-02-23T06:21:17.143050+0000","last_unstale":"2026-02-23T06:21:23.157493+0000","last_undegraded":"2026-02-23T06:21:23.157493+0000","last_fullsized":"2026-02-23T06:21:23.157493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:15.628487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156942+0000","last_change":"2026-02-23T06:21:22.168755+0000","last_active":"2026-02-23T06:21:23.156942+0000","last_peered":"2026-02-23T06:21:23.156942+0000","last_clean":"2026-02-23T06:21:23.156942+0000","last_became_active":"2026-02-23T06:21:22.168510+0000","last_became_peered":"2026-02-23T06:21:22.168510+0000","last_unstale":"2026-02-23T06:21:23.156942+0000","last_undegraded":"2026-02-23T06:21:23.156942+0000","last_fullsized":"2026-02-23T06:21:23.156942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:19:06.716318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156576+0000","last_change":"2026-02-23T06:21:18.145397+0000","last_active":"2026-02-23T06:21:23.156576+0000","last_peered":"2026-02-23T06:21:23.156576+0000","last_clean":"2026-02-23T06:21:23.156576+0000","last_became_active":"2026-02-23T06:21:18.145214+0000","last_became_peered":"2026-02-23T06:21:18.145214+0000","last_unstale":"2026-02-23T06:21:23.156576+0000","last_undegraded":"2026-02-23T06:21:23.156576+0000","last_fullsized":"2026-02-23T06:21:23.156576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:33:41.870582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158977+0000","last_change":"2026-02-23T06:21:17.147696+0000","last_active":"2026-02-23T06:21:23.158977+0000","last_peered":"2026-02-23T06:21:23.158977+0000","last_clean":"2026-02-23T06:21:23.158977+0000","last_became_active":"2026-02-23T06:21:17.147619+0000","last_became_peered":"2026-02-23T06:21:17.147619+0000","last_unstale":"2026-02-23T06:21:23.158977+0000","last_undegraded":"2026-02-23T06:21:23.158977+0000","last_fullsized":"2026-02-23T06:21:23.158977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:49:09.070245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'112","reported_seq":164,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157640+0000","last_change":"2026-02-23T06:21:11.397748+0000","last_active":"2026-02-23T06:21:23.157640+0000","last_peered":"2026-02-23T06:21:23.157640+0000","last_clean":"2026-02-23T06:21:23.157640+0000","last_became_active":"2026-02-23T06:21:11.397664+0000","last_became_peered":"2026-02-23T06:21:11.397664+0000","last_unstale":"2026-02-23T06:21:23.157640+0000","last_undegraded":"2026-02-23T06:21:23.157640+0000","last_fullsized":"2026-02-23T06:21:23.157640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:10.392316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:10.392316+0000","last_clean_scrub_stamp":"2026-02-23T06:21:10.392316+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:43.157572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159148+0000","last_change":"2026-02-23T06:21:22.174696+0000","last_active":"2026-02-23T06:21:23.159148+0000","last_peered":"2026-02-23T06:21:23.159148+0000","last_clean":"2026-02-23T06:21:23.159148+0000","last_became_active":"2026-02-23T06:21:22.174253+0000","last_became_peered":"2026-02-23T06:21:22.174253+0000","last_unstale":"2026-02-23T06:21:23.159148+0000","last_undegraded":"2026-02-23T06:21:23.159148+0000","last_fullsized":"2026-02-23T06:21:23.159148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:28.487343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159093+0000","last_change":"2026-02-23T06:21:18.150652+0000","last_active":"2026-02-23T06:21:23.159093+0000","last_peered":"2026-02-23T06:21:23.159093+0000","last_clean":"2026-02-23T06:21:23.159093+0000","last_became_active":"2026-02-23T06:21:18.150501+0000","last_became_peered":"2026-02-23T06:21:18.150501+0000","last_unstale":"2026-02-23T06:21:23.159093+0000","last_undegraded":"2026-02-23T06:21:23.159093+0000","last_fullsized":"2026-02-23T06:21:23.159093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:34:20.113034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157473+0000","last_change":"2026-02-23T06:21:17.146074+0000","last_active":"2026-02-23T06:21:23.157473+0000","last_peered":"2026-02-23T06:21:23.157473+0000","last_clean":"2026-02-23T06:21:23.157473+0000","last_became_active":"2026-02-23T06:21:17.145938+0000","last_became_peered":"2026-02-23T06:21:17.145938+0000","last_unstale":"2026-02-23T06:21:23.157473+0000","last_undegraded":"2026-02-23T06:21:23.157473+0000","last_fullsized":"2026-02-23T06:21:23.157473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:41:42.571718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158551+0000","last_change":"2026-02-23T06:21:22.172266+0000","last_active":"2026-02-23T06:21:23.158551+0000","last_peered":"2026-02-23T06:21:23.158551+0000","last_clean":"2026-02-23T06:21:23.158551+0000","last_became_active":"2026-02-23T06:21:22.171828+0000","last_became_peered":"2026-02-23T06:21:22.171828+0000","last_unstale":"2026-02-23T06:21:23.158551+0000","last_undegraded":"2026-02-23T06:21:23.158551+0000","last_fullsized":"2026-02-23T06:21:23.158551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:34:06.583640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158339+0000","last_change":"2026-02-23T06:21:18.147056+0000","last_active":"2026-02-23T06:21:23.158339+0000","last_peered":"2026-02-23T06:21:23.158339+0000","last_clean":"2026-02-23T06:21:23.158339+0000","last_became_active":"2026-02-23T06:21:18.146977+0000","last_became_peered":"2026-02-23T06:21:18.146977+0000","last_unstale":"2026-02-23T06:21:23.158339+0000","last_undegraded":"2026-02-23T06:21:23.158339+0000","last_fullsized":"2026-02-23T06:21:23.158339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:02:14.013207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156871+0000","last_change":"2026-02-23T06:21:17.139417+0000","last_active":"2026-02-23T06:21:23.156871+0000","last_peered":"2026-02-23T06:21:23.156871+0000","last_clean":"2026-02-23T06:21:23.156871+0000","last_became_active":"2026-02-23T06:21:17.139209+0000","last_became_peered":"2026-02-23T06:21:17.139209+0000","last_unstale":"2026-02-23T06:21:23.156871+0000","last_undegraded":"2026-02-23T06:21:23.156871+0000","last_fullsized":"2026-02-23T06:21:23.156871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:02:19.925669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156792+0000","last_change":"2026-02-23T06:21:22.162912+0000","last_active":"2026-02-23T06:21:23.156792+0000","last_peered":"2026-02-23T06:21:23.156792+0000","last_clean":"2026-02-23T06:21:23.156792+0000","last_became_active":"2026-02-23T06:21:22.162777+0000","last_became_peered":"2026-02-23T06:21:22.162777+0000","last_unstale":"2026-02-23T06:21:23.156792+0000","last_undegraded":"2026-02-23T06:21:23.156792+0000","last_fullsized":"2026-02-23T06:21:23.156792+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:40:10.012263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158597+0000","last_change":"2026-02-23T06:21:18.149281+0000","last_active":"2026-02-23T06:21:23.158597+0000","last_peered":"2026-02-23T06:21:23.158597+0000","last_clean":"2026-02-23T06:21:23.158597+0000","last_became_active":"2026-02-23T06:21:18.149038+0000","last_became_peered":"2026-02-23T06:21:18.149038+0000","last_unstale":"2026-02-23T06:21:23.158597+0000","last_undegraded":"2026-02-23T06:21:23.158597+0000","last_fullsized":"2026-02-23T06:21:23.158597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:57:13.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156819+0000","last_change":"2026-02-23T06:21:17.137649+0000","last_active":"2026-02-23T06:21:23.156819+0000","last_peered":"2026-02-23T06:21:23.156819+0000","last_clean":"2026-02-23T06:21:23.156819+0000","last_became_active":"2026-02-23T06:21:17.137476+0000","last_became_peered":"2026-02-23T06:21:17.137476+0000","last_unstale":"2026-02-23T06:21:23.156819+0000","last_undegraded":"2026-02-23T06:21:23.156819+0000","last_fullsized":"2026-02-23T06:21:23.156819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:47:43.648999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157315+0000","last_change":"2026-02-23T06:21:22.174081+0000","last_active":"2026-02-23T06:21:23.157315+0000","last_peered":"2026-02-23T06:21:23.157315+0000","last_clean":"2026-02-23T06:21:23.157315+0000","last_became_active":"2026-02-23T06:21:22.173501+0000","last_became_peered":"2026-02-23T06:21:22.173501+0000","last_unstale":"2026-02-23T06:21:23.157315+0000","last_undegraded":"2026-02-23T06:21:23.157315+0000","last_fullsized":"2026-02-23T06:21:23.157315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:29:42.370894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159159+0000","last_change":"2026-02-23T06:21:18.155183+0000","last_active":"2026-02-23T06:21:23.159159+0000","last_peered":"2026-02-23T06:21:23.159159+0000","last_clean":"2026-02-23T06:21:23.159159+0000","last_became_active":"2026-02-23T06:21:18.154271+0000","last_became_peered":"2026-02-23T06:21:18.154271+0000","last_unstale":"2026-02-23T06:21:23.159159+0000","last_undegraded":"2026-02-23T06:21:23.159159+0000","last_fullsized":"2026-02-23T06:21:23.159159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:34:53.495073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158641+0000","last_change":"2026-02-23T06:21:17.144988+0000","last_active":"2026-02-23T06:21:23.158641+0000","last_peered":"2026-02-23T06:21:23.158641+0000","last_clean":"2026-02-23T06:21:23.158641+0000","last_became_active":"2026-02-23T06:21:17.144914+0000","last_became_peered":"2026-02-23T06:21:17.144914+0000","last_unstale":"2026-02-23T06:21:23.158641+0000","last_undegraded":"2026-02-23T06:21:23.158641+0000","last_fullsized":"2026-02-23T06:21:23.158641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:20:30.802189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157321+0000","last_change":"2026-02-23T06:21:22.169035+0000","last_active":"2026-02-23T06:21:23.157321+0000","last_peered":"2026-02-23T06:21:23.157321+0000","last_clean":"2026-02-23T06:21:23.157321+0000","last_became_active":"2026-02-23T06:21:22.168516+0000","last_became_peered":"2026-02-23T06:21:22.168516+0000","last_unstale":"2026-02-23T06:21:23.157321+0000","last_undegraded":"2026-02-23T06:21:23.157321+0000","last_fullsized":"2026-02-23T06:21:23.157321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:53:53.761208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157305+0000","last_change":"2026-02-23T06:21:18.152543+0000","last_active":"2026-02-23T06:21:23.157305+0000","last_peered":"2026-02-23T06:21:23.157305+0000","last_clean":"2026-02-23T06:21:23.157305+0000","last_became_active":"2026-02-23T06:21:18.152381+0000","last_became_peered":"2026-02-23T06:21:18.152381+0000","last_unstale":"2026-02-23T06:21:23.157305+0000","last_undegraded":"2026-02-23T06:21:23.157305+0000","last_fullsized":"2026-02-23T06:21:23.157305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:20:11.159653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156443+0000","last_change":"2026-02-23T06:21:17.137277+0000","last_active":"2026-02-23T06:21:23.156443+0000","last_peered":"2026-02-23T06:21:23.156443+0000","last_clean":"2026-02-23T06:21:23.156443+0000","last_became_active":"2026-02-23T06:21:17.137101+0000","last_became_peered":"2026-02-23T06:21:17.137101+0000","last_unstale":"2026-02-23T06:21:23.156443+0000","last_undegraded":"2026-02-23T06:21:23.156443+0000","last_fullsized":"2026-02-23T06:21:23.156443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:26:19.732037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157108+0000","last_change":"2026-02-23T06:21:22.168965+0000","last_active":"2026-02-23T06:21:23.157108+0000","last_peered":"2026-02-23T06:21:23.157108+0000","last_clean":"2026-02-23T06:21:23.157108+0000","last_became_active":"2026-02-23T06:21:22.168603+0000","last_became_peered":"2026-02-23T06:21:22.168603+0000","last_unstale":"2026-02-23T06:21:23.157108+0000","last_undegraded":"2026-02-23T06:21:23.157108+0000","last_fullsized":"2026-02-23T06:21:23.157108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:15:47.100236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157608+0000","last_change":"2026-02-23T06:21:18.143842+0000","last_active":"2026-02-23T06:21:23.157608+0000","last_peered":"2026-02-23T06:21:23.157608+0000","last_clean":"2026-02-23T06:21:23.157608+0000","last_became_active":"2026-02-23T06:21:18.143002+0000","last_became_peered":"2026-02-23T06:21:18.143002+0000","last_unstale":"2026-02-23T06:21:23.157608+0000","last_undegraded":"2026-02-23T06:21:23.157608+0000","last_fullsized":"2026-02-23T06:21:23.157608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:04:36.461970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157835+0000","last_change":"2026-02-23T06:21:17.143842+0000","last_active":"2026-02-23T06:21:23.157835+0000","last_peered":"2026-02-23T06:21:23.157835+0000","last_clean":"2026-02-23T06:21:23.157835+0000","last_became_active":"2026-02-23T06:21:17.143700+0000","last_became_peered":"2026-02-23T06:21:17.143700+0000","last_unstale":"2026-02-23T06:21:23.157835+0000","last_undegraded":"2026-02-23T06:21:23.157835+0000","last_fullsized":"2026-02-23T06:21:23.157835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:14:07.166043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157290+0000","last_change":"2026-02-23T06:21:22.168834+0000","last_active":"2026-02-23T06:21:23.157290+0000","last_peered":"2026-02-23T06:21:23.157290+0000","last_clean":"2026-02-23T06:21:23.157290+0000","last_became_active":"2026-02-23T06:21:22.168593+0000","last_became_peered":"2026-02-23T06:21:22.168593+0000","last_unstale":"2026-02-23T06:21:23.157290+0000","last_undegraded":"2026-02-23T06:21:23.157290+0000","last_fullsized":"2026-02-23T06:21:23.157290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:15:01.999978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157649+0000","last_change":"2026-02-23T06:21:18.155135+0000","last_active":"2026-02-23T06:21:23.157649+0000","last_peered":"2026-02-23T06:21:23.157649+0000","last_clean":"2026-02-23T06:21:23.157649+0000","last_became_active":"2026-02-23T06:21:18.155022+0000","last_became_peered":"2026-02-23T06:21:18.155022+0000","last_unstale":"2026-02-23T06:21:23.157649+0000","last_undegraded":"2026-02-23T06:21:23.157649+0000","last_fullsized":"2026-02-23T06:21:23.157649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:50.396096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157857+0000","last_change":"2026-02-23T06:21:17.144113+0000","last_active":"2026-02-23T06:21:23.157857+0000","last_peered":"2026-02-23T06:21:23.157857+0000","last_clean":"2026-02-23T06:21:23.157857+0000","last_became_active":"2026-02-23T06:21:17.144052+0000","last_became_peered":"2026-02-23T06:21:17.144052+0000","last_unstale":"2026-02-23T06:21:23.157857+0000","last_undegraded":"2026-02-23T06:21:23.157857+0000","last_fullsized":"2026-02-23T06:21:23.157857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:52:50.479411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157276+0000","last_change":"2026-02-23T06:21:22.163712+0000","last_active":"2026-02-23T06:21:23.157276+0000","last_peered":"2026-02-23T06:21:23.157276+0000","last_clean":"2026-02-23T06:21:23.157276+0000","last_became_active":"2026-02-23T06:21:22.163563+0000","last_became_peered":"2026-02-23T06:21:22.163563+0000","last_unstale":"2026-02-23T06:21:23.157276+0000","last_undegraded":"2026-02-23T06:21:23.157276+0000","last_fullsized":"2026-02-23T06:21:23.157276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:58:44.301443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157241+0000","last_change":"2026-02-23T06:21:18.152736+0000","last_active":"2026-02-23T06:21:23.157241+0000","last_peered":"2026-02-23T06:21:23.157241+0000","last_clean":"2026-02-23T06:21:23.157241+0000","last_became_active":"2026-02-23T06:21:18.152627+0000","last_became_peered":"2026-02-23T06:21:18.152627+0000","last_unstale":"2026-02-23T06:21:23.157241+0000","last_undegraded":"2026-02-23T06:21:23.157241+0000","last_fullsized":"2026-02-23T06:21:23.157241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:26:04.233805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156590+0000","last_change":"2026-02-23T06:21:17.144924+0000","last_active":"2026-02-23T06:21:23.156590+0000","last_peered":"2026-02-23T06:21:23.156590+0000","last_clean":"2026-02-23T06:21:23.156590+0000","last_became_active":"2026-02-23T06:21:17.144847+0000","last_became_peered":"2026-02-23T06:21:17.144847+0000","last_unstale":"2026-02-23T06:21:23.156590+0000","last_undegraded":"2026-02-23T06:21:23.156590+0000","last_fullsized":"2026-02-23T06:21:23.156590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:09:16.703922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159051+0000","last_change":"2026-02-23T06:21:22.164167+0000","last_active":"2026-02-23T06:21:23.159051+0000","last_peered":"2026-02-23T06:21:23.159051+0000","last_clean":"2026-02-23T06:21:23.159051+0000","last_became_active":"2026-02-23T06:21:22.164057+0000","last_became_peered":"2026-02-23T06:21:22.164057+0000","last_unstale":"2026-02-23T06:21:23.159051+0000","last_undegraded":"2026-02-23T06:21:23.159051+0000","last_fullsized":"2026-02-23T06:21:23.159051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:19:45.888728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158866+0000","last_change":"2026-02-23T06:21:18.148382+0000","last_active":"2026-02-23T06:21:23.158866+0000","last_peered":"2026-02-23T06:21:23.158866+0000","last_clean":"2026-02-23T06:21:23.158866+0000","last_became_active":"2026-02-23T06:21:18.147826+0000","last_became_peered":"2026-02-23T06:21:18.147826+0000","last_unstale":"2026-02-23T06:21:23.158866+0000","last_undegraded":"2026-02-23T06:21:23.158866+0000","last_fullsized":"2026-02-23T06:21:23.158866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:52:32.524186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"24'6","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158401+0000","last_change":"2026-02-23T06:21:17.151131+0000","last_active":"2026-02-23T06:21:23.158401+0000","last_peered":"2026-02-23T06:21:23.158401+0000","last_clean":"2026-02-23T06:21:23.158401+0000","last_became_active":"2026-02-23T06:21:17.151030+0000","last_became_peered":"2026-02-23T06:21:17.151030+0000","last_unstale":"2026-02-23T06:21:23.158401+0000","last_undegraded":"2026-02-23T06:21:23.158401+0000","last_fullsized":"2026-02-23T06:21:23.158401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:19:57.049773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1634,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156776+0000","last_change":"2026-02-23T06:21:22.165171+0000","last_active":"2026-02-23T06:21:23.156776+0000","last_peered":"2026-02-23T06:21:23.156776+0000","last_clean":"2026-02-23T06:21:23.156776+0000","last_became_active":"2026-02-23T06:21:22.164972+0000","last_became_peered":"2026-02-23T06:21:22.164972+0000","last_unstale":"2026-02-23T06:21:23.156776+0000","last_undegraded":"2026-02-23T06:21:23.156776+0000","last_fullsized":"2026-02-23T06:21:23.156776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:58:26.519641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157682+0000","last_change":"2026-02-23T06:21:18.153296+0000","last_active":"2026-02-23T06:21:23.157682+0000","last_peered":"2026-02-23T06:21:23.157682+0000","last_clean":"2026-02-23T06:21:23.157682+0000","last_became_active":"2026-02-23T06:21:18.153052+0000","last_became_peered":"2026-02-23T06:21:18.153052+0000","last_unstale":"2026-02-23T06:21:23.157682+0000","last_undegraded":"2026-02-23T06:21:23.157682+0000","last_fullsized":"2026-02-23T06:21:23.157682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:38:32.662334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156686+0000","last_change":"2026-02-23T06:21:17.137568+0000","last_active":"2026-02-23T06:21:23.156686+0000","last_peered":"2026-02-23T06:21:23.156686+0000","last_clean":"2026-02-23T06:21:23.156686+0000","last_became_active":"2026-02-23T06:21:17.137479+0000","last_became_peered":"2026-02-23T06:21:17.137479+0000","last_unstale":"2026-02-23T06:21:23.156686+0000","last_undegraded":"2026-02-23T06:21:23.156686+0000","last_fullsized":"2026-02-23T06:21:23.156686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:50:22.850887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158615+0000","last_change":"2026-02-23T06:21:22.175837+0000","last_active":"2026-02-23T06:21:23.158615+0000","last_peered":"2026-02-23T06:21:23.158615+0000","last_clean":"2026-02-23T06:21:23.158615+0000","last_became_active":"2026-02-23T06:21:22.175638+0000","last_became_peered":"2026-02-23T06:21:22.175638+0000","last_unstale":"2026-02-23T06:21:23.158615+0000","last_undegraded":"2026-02-23T06:21:23.158615+0000","last_fullsized":"2026-02-23T06:21:23.158615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:24:39.312650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157339+0000","last_change":"2026-02-23T06:21:18.155473+0000","last_active":"2026-02-23T06:21:23.157339+0000","last_peered":"2026-02-23T06:21:23.157339+0000","last_clean":"2026-02-23T06:21:23.157339+0000","last_became_active":"2026-02-23T06:21:18.155349+0000","last_became_peered":"2026-02-23T06:21:18.155349+0000","last_unstale":"2026-02-23T06:21:23.157339+0000","last_undegraded":"2026-02-23T06:21:23.157339+0000","last_fullsized":"2026-02-23T06:21:23.157339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:20:20.345986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158459+0000","last_change":"2026-02-23T06:21:17.148953+0000","last_active":"2026-02-23T06:21:23.158459+0000","last_peered":"2026-02-23T06:21:23.158459+0000","last_clean":"2026-02-23T06:21:23.158459+0000","last_became_active":"2026-02-23T06:21:17.148841+0000","last_became_peered":"2026-02-23T06:21:17.148841+0000","last_unstale":"2026-02-23T06:21:23.158459+0000","last_undegraded":"2026-02-23T06:21:23.158459+0000","last_fullsized":"2026-02-23T06:21:23.158459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:48:14.620108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156366+0000","last_change":"2026-02-23T06:21:22.172897+0000","last_active":"2026-02-23T06:21:23.156366+0000","last_peered":"2026-02-23T06:21:23.156366+0000","last_clean":"2026-02-23T06:21:23.156366+0000","last_became_active":"2026-02-23T06:21:22.172683+0000","last_became_peered":"2026-02-23T06:21:22.172683+0000","last_unstale":"2026-02-23T06:21:23.156366+0000","last_undegraded":"2026-02-23T06:21:23.156366+0000","last_fullsized":"2026-02-23T06:21:23.156366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:17:41.991286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159118+0000","last_change":"2026-02-23T06:21:18.154897+0000","last_active":"2026-02-23T06:21:23.159118+0000","last_peered":"2026-02-23T06:21:23.159118+0000","last_clean":"2026-02-23T06:21:23.159118+0000","last_became_active":"2026-02-23T06:21:18.154586+0000","last_became_peered":"2026-02-23T06:21:18.154586+0000","last_unstale":"2026-02-23T06:21:23.159118+0000","last_undegraded":"2026-02-23T06:21:23.159118+0000","last_fullsized":"2026-02-23T06:21:23.159118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:22:13.361673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158486+0000","last_change":"2026-02-23T06:21:17.140774+0000","last_active":"2026-02-23T06:21:23.158486+0000","last_peered":"2026-02-23T06:21:23.158486+0000","last_clean":"2026-02-23T06:21:23.158486+0000","last_became_active":"2026-02-23T06:21:17.140699+0000","last_became_peered":"2026-02-23T06:21:17.140699+0000","last_unstale":"2026-02-23T06:21:23.158486+0000","last_undegraded":"2026-02-23T06:21:23.158486+0000","last_fullsized":"2026-02-23T06:21:23.158486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:59:47.987932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156705+0000","last_change":"2026-02-23T06:21:22.166371+0000","last_active":"2026-02-23T06:21:23.156705+0000","last_peered":"2026-02-23T06:21:23.156705+0000","last_clean":"2026-02-23T06:21:23.156705+0000","last_became_active":"2026-02-23T06:21:22.166204+0000","last_became_peered":"2026-02-23T06:21:22.166204+0000","last_unstale":"2026-02-23T06:21:23.156705+0000","last_undegraded":"2026-02-23T06:21:23.156705+0000","last_fullsized":"2026-02-23T06:21:23.156705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:50:51.116428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156852+0000","last_change":"2026-02-23T06:21:22.167411+0000","last_active":"2026-02-23T06:21:23.156852+0000","last_peered":"2026-02-23T06:21:23.156852+0000","last_clean":"2026-02-23T06:21:23.156852+0000","last_became_active":"2026-02-23T06:21:22.167217+0000","last_became_peered":"2026-02-23T06:21:22.167217+0000","last_unstale":"2026-02-23T06:21:23.156852+0000","last_undegraded":"2026-02-23T06:21:23.156852+0000","last_fullsized":"2026-02-23T06:21:23.156852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:20:54.687551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156512+0000","last_change":"2026-02-23T06:21:18.146043+0000","last_active":"2026-02-23T06:21:23.156512+0000","last_peered":"2026-02-23T06:21:23.156512+0000","last_clean":"2026-02-23T06:21:23.156512+0000","last_became_active":"2026-02-23T06:21:18.145938+0000","last_became_peered":"2026-02-23T06:21:18.145938+0000","last_unstale":"2026-02-23T06:21:23.156512+0000","last_undegraded":"2026-02-23T06:21:23.156512+0000","last_fullsized":"2026-02-23T06:21:23.156512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:03:21.252772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157446+0000","last_change":"2026-02-23T06:21:17.149581+0000","last_active":"2026-02-23T06:21:23.157446+0000","last_peered":"2026-02-23T06:21:23.157446+0000","last_clean":"2026-02-23T06:21:23.157446+0000","last_became_active":"2026-02-23T06:21:17.149490+0000","last_became_peered":"2026-02-23T06:21:17.149490+0000","last_unstale":"2026-02-23T06:21:23.157446+0000","last_undegraded":"2026-02-23T06:21:23.157446+0000","last_fullsized":"2026-02-23T06:21:23.157446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:18:42.211307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158840+0000","last_change":"2026-02-23T06:21:22.175655+0000","last_active":"2026-02-23T06:21:23.158840+0000","last_peered":"2026-02-23T06:21:23.158840+0000","last_clean":"2026-02-23T06:21:23.158840+0000","last_became_active":"2026-02-23T06:21:22.174906+0000","last_became_peered":"2026-02-23T06:21:22.174906+0000","last_unstale":"2026-02-23T06:21:23.158840+0000","last_undegraded":"2026-02-23T06:21:23.158840+0000","last_fullsized":"2026-02-23T06:21:23.158840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:50:34.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156556+0000","last_change":"2026-02-23T06:21:18.142560+0000","last_active":"2026-02-23T06:21:23.156556+0000","last_peered":"2026-02-23T06:21:23.156556+0000","last_clean":"2026-02-23T06:21:23.156556+0000","last_became_active":"2026-02-23T06:21:18.142325+0000","last_became_peered":"2026-02-23T06:21:18.142325+0000","last_unstale":"2026-02-23T06:21:23.156556+0000","last_undegraded":"2026-02-23T06:21:23.156556+0000","last_fullsized":"2026-02-23T06:21:23.156556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:45:44.641652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156988+0000","last_change":"2026-02-23T06:21:17.146195+0000","last_active":"2026-02-23T06:21:23.156988+0000","last_peered":"2026-02-23T06:21:23.156988+0000","last_clean":"2026-02-23T06:21:23.156988+0000","last_became_active":"2026-02-23T06:21:17.146022+0000","last_became_peered":"2026-02-23T06:21:17.146022+0000","last_unstale":"2026-02-23T06:21:23.156988+0000","last_undegraded":"2026-02-23T06:21:23.156988+0000","last_fullsized":"2026-02-23T06:21:23.156988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:34:32.822540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157689+0000","last_change":"2026-02-23T06:21:17.148590+0000","last_active":"2026-02-23T06:21:23.157689+0000","last_peered":"2026-02-23T06:21:23.157689+0000","last_clean":"2026-02-23T06:21:23.157689+0000","last_became_active":"2026-02-23T06:21:17.148417+0000","last_became_peered":"2026-02-23T06:21:17.148417+0000","last_unstale":"2026-02-23T06:21:23.157689+0000","last_undegraded":"2026-02-23T06:21:23.157689+0000","last_fullsized":"2026-02-23T06:21:23.157689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:21:11.877590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156606+0000","last_change":"2026-02-23T06:21:18.152383+0000","last_active":"2026-02-23T06:21:23.156606+0000","last_peered":"2026-02-23T06:21:23.156606+0000","last_clean":"2026-02-23T06:21:23.156606+0000","last_became_active":"2026-02-23T06:21:18.152267+0000","last_became_peered":"2026-02-23T06:21:18.152267+0000","last_unstale":"2026-02-23T06:21:23.156606+0000","last_undegraded":"2026-02-23T06:21:23.156606+0000","last_fullsized":"2026-02-23T06:21:23.156606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:34:11.558509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156801+0000","last_change":"2026-02-23T06:21:22.158812+0000","last_active":"2026-02-23T06:21:23.156801+0000","last_peered":"2026-02-23T06:21:23.156801+0000","last_clean":"2026-02-23T06:21:23.156801+0000","last_became_active":"2026-02-23T06:21:22.158607+0000","last_became_peered":"2026-02-23T06:21:22.158607+0000","last_unstale":"2026-02-23T06:21:23.156801+0000","last_undegraded":"2026-02-23T06:21:23.156801+0000","last_fullsized":"2026-02-23T06:21:23.156801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:59:07.000053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156780+0000","last_change":"2026-02-23T06:21:17.138744+0000","last_active":"2026-02-23T06:21:23.156780+0000","last_peered":"2026-02-23T06:21:23.156780+0000","last_clean":"2026-02-23T06:21:23.156780+0000","last_became_active":"2026-02-23T06:21:17.138245+0000","last_became_peered":"2026-02-23T06:21:17.138245+0000","last_unstale":"2026-02-23T06:21:23.156780+0000","last_undegraded":"2026-02-23T06:21:23.156780+0000","last_fullsized":"2026-02-23T06:21:23.156780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:08:03.143401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157483+0000","last_change":"2026-02-23T06:21:18.143640+0000","last_active":"2026-02-23T06:21:23.157483+0000","last_peered":"2026-02-23T06:21:23.157483+0000","last_clean":"2026-02-23T06:21:23.157483+0000","last_became_active":"2026-02-23T06:21:18.143550+0000","last_became_peered":"2026-02-23T06:21:18.143550+0000","last_unstale":"2026-02-23T06:21:23.157483+0000","last_undegraded":"2026-02-23T06:21:23.157483+0000","last_fullsized":"2026-02-23T06:21:23.157483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:11:40.394042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156644+0000","last_change":"2026-02-23T06:21:22.169641+0000","last_active":"2026-02-23T06:21:23.156644+0000","last_peered":"2026-02-23T06:21:23.156644+0000","last_clean":"2026-02-23T06:21:23.156644+0000","last_became_active":"2026-02-23T06:21:22.169432+0000","last_became_peered":"2026-02-23T06:21:22.169432+0000","last_unstale":"2026-02-23T06:21:23.156644+0000","last_undegraded":"2026-02-23T06:21:23.156644+0000","last_fullsized":"2026-02-23T06:21:23.156644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:00:17.622113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158222+0000","last_change":"2026-02-23T06:21:18.143781+0000","last_active":"2026-02-23T06:21:23.158222+0000","last_peered":"2026-02-23T06:21:23.158222+0000","last_clean":"2026-02-23T06:21:23.158222+0000","last_became_active":"2026-02-23T06:21:18.143724+0000","last_became_peered":"2026-02-23T06:21:18.143724+0000","last_unstale":"2026-02-23T06:21:23.158222+0000","last_undegraded":"2026-02-23T06:21:23.158222+0000","last_fullsized":"2026-02-23T06:21:23.158222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:25:55.416021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156366+0000","last_change":"2026-02-23T06:21:18.145425+0000","last_active":"2026-02-23T06:21:23.156366+0000","last_peered":"2026-02-23T06:21:23.156366+0000","last_clean":"2026-02-23T06:21:23.156366+0000","last_became_active":"2026-02-23T06:21:18.145325+0000","last_became_peered":"2026-02-23T06:21:18.145325+0000","last_unstale":"2026-02-23T06:21:23.156366+0000","last_undegraded":"2026-02-23T06:21:23.156366+0000","last_fullsized":"2026-02-23T06:21:23.156366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:55:31.700518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157544+0000","last_change":"2026-02-23T06:21:18.150997+0000","last_active":"2026-02-23T06:21:23.157544+0000","last_peered":"2026-02-23T06:21:23.157544+0000","last_clean":"2026-02-23T06:21:23.157544+0000","last_became_active":"2026-02-23T06:21:18.150738+0000","last_became_peered":"2026-02-23T06:21:18.150738+0000","last_unstale":"2026-02-23T06:21:23.157544+0000","last_undegraded":"2026-02-23T06:21:23.157544+0000","last_fullsized":"2026-02-23T06:21:23.157544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:11:13.400669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156727+0000","last_change":"2026-02-23T06:21:18.142305+0000","last_active":"2026-02-23T06:21:23.156727+0000","last_peered":"2026-02-23T06:21:23.156727+0000","last_clean":"2026-02-23T06:21:23.156727+0000","last_became_active":"2026-02-23T06:21:18.141484+0000","last_became_peered":"2026-02-23T06:21:18.141484+0000","last_unstale":"2026-02-23T06:21:23.156727+0000","last_undegraded":"2026-02-23T06:21:23.156727+0000","last_fullsized":"2026-02-23T06:21:23.156727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:12:36.003405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157376+0000","last_change":"2026-02-23T06:21:18.148610+0000","last_active":"2026-02-23T06:21:23.157376+0000","last_peered":"2026-02-23T06:21:23.157376+0000","last_clean":"2026-02-23T06:21:23.157376+0000","last_became_active":"2026-02-23T06:21:18.148489+0000","last_became_peered":"2026-02-23T06:21:18.148489+0000","last_unstale":"2026-02-23T06:21:23.157376+0000","last_undegraded":"2026-02-23T06:21:23.157376+0000","last_fullsized":"2026-02-23T06:21:23.157376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:36:29.486147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157279+0000","last_change":"2026-02-23T06:21:18.142438+0000","last_active":"2026-02-23T06:21:23.157279+0000","last_peered":"2026-02-23T06:21:23.157279+0000","last_clean":"2026-02-23T06:21:23.157279+0000","last_became_active":"2026-02-23T06:21:18.141854+0000","last_became_peered":"2026-02-23T06:21:18.141854+0000","last_unstale":"2026-02-23T06:21:23.157279+0000","last_undegraded":"2026-02-23T06:21:23.157279+0000","last_fullsized":"2026-02-23T06:21:23.157279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:23:35.379462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159075+0000","last_change":"2026-02-23T06:21:18.153825+0000","last_active":"2026-02-23T06:21:23.159075+0000","last_peered":"2026-02-23T06:21:23.159075+0000","last_clean":"2026-02-23T06:21:23.159075+0000","last_became_active":"2026-02-23T06:21:18.153133+0000","last_became_peered":"2026-02-23T06:21:18.153133+0000","last_unstale":"2026-02-23T06:21:23.159075+0000","last_undegraded":"2026-02-23T06:21:23.159075+0000","last_fullsized":"2026-02-23T06:21:23.159075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:15:03.662362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157187+0000","last_change":"2026-02-23T06:21:18.144945+0000","last_active":"2026-02-23T06:21:23.157187+0000","last_peered":"2026-02-23T06:21:23.157187+0000","last_clean":"2026-02-23T06:21:23.157187+0000","last_became_active":"2026-02-23T06:21:18.144832+0000","last_became_peered":"2026-02-23T06:21:18.144832+0000","last_unstale":"2026-02-23T06:21:23.157187+0000","last_undegraded":"2026-02-23T06:21:23.157187+0000","last_fullsized":"2026-02-23T06:21:23.157187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:41:07.968870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157406+0000","last_change":"2026-02-23T06:21:18.150652+0000","last_active":"2026-02-23T06:21:23.157406+0000","last_peered":"2026-02-23T06:21:23.157406+0000","last_clean":"2026-02-23T06:21:23.157406+0000","last_became_active":"2026-02-23T06:21:18.150489+0000","last_became_peered":"2026-02-23T06:21:18.150489+0000","last_unstale":"2026-02-23T06:21:23.157406+0000","last_undegraded":"2026-02-23T06:21:23.157406+0000","last_fullsized":"2026-02-23T06:21:23.157406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:42:35.233149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156538+0000","last_change":"2026-02-23T06:21:18.143636+0000","last_active":"2026-02-23T06:21:23.156538+0000","last_peered":"2026-02-23T06:21:23.156538+0000","last_clean":"2026-02-23T06:21:23.156538+0000","last_became_active":"2026-02-23T06:21:18.143495+0000","last_became_peered":"2026-02-23T06:21:18.143495+0000","last_unstale":"2026-02-23T06:21:23.156538+0000","last_undegraded":"2026-02-23T06:21:23.156538+0000","last_fullsized":"2026-02-23T06:21:23.156538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:47:19.057181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157427+0000","last_change":"2026-02-23T06:21:18.148787+0000","last_active":"2026-02-23T06:21:23.157427+0000","last_peered":"2026-02-23T06:21:23.157427+0000","last_clean":"2026-02-23T06:21:23.157427+0000","last_became_active":"2026-02-23T06:21:18.148701+0000","last_became_peered":"2026-02-23T06:21:18.148701+0000","last_unstale":"2026-02-23T06:21:23.157427+0000","last_undegraded":"2026-02-23T06:21:23.157427+0000","last_fullsized":"2026-02-23T06:21:23.157427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:19:32.878202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156524+0000","last_change":"2026-02-23T06:21:18.145498+0000","last_active":"2026-02-23T06:21:23.156524+0000","last_peered":"2026-02-23T06:21:23.156524+0000","last_clean":"2026-02-23T06:21:23.156524+0000","last_became_active":"2026-02-23T06:21:18.145346+0000","last_became_peered":"2026-02-23T06:21:18.145346+0000","last_unstale":"2026-02-23T06:21:23.156524+0000","last_undegraded":"2026-02-23T06:21:23.156524+0000","last_fullsized":"2026-02-23T06:21:23.156524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:44:15.203843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158314+0000","last_change":"2026-02-23T06:21:18.147453+0000","last_active":"2026-02-23T06:21:23.158314+0000","last_peered":"2026-02-23T06:21:23.158314+0000","last_clean":"2026-02-23T06:21:23.158314+0000","last_became_active":"2026-02-23T06:21:18.147357+0000","last_became_peered":"2026-02-23T06:21:18.147357+0000","last_unstale":"2026-02-23T06:21:23.158314+0000","last_undegraded":"2026-02-23T06:21:23.158314+0000","last_fullsized":"2026-02-23T06:21:23.158314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:41:05.063786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159167+0000","last_change":"2026-02-23T06:21:18.151381+0000","last_active":"2026-02-23T06:21:23.159167+0000","last_peered":"2026-02-23T06:21:23.159167+0000","last_clean":"2026-02-23T06:21:23.159167+0000","last_became_active":"2026-02-23T06:21:18.151269+0000","last_became_peered":"2026-02-23T06:21:18.151269+0000","last_unstale":"2026-02-23T06:21:23.159167+0000","last_undegraded":"2026-02-23T06:21:23.159167+0000","last_fullsized":"2026-02-23T06:21:23.159167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:50:46.152385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156748+0000","last_change":"2026-02-23T06:21:18.148411+0000","last_active":"2026-02-23T06:21:23.156748+0000","last_peered":"2026-02-23T06:21:23.156748+0000","last_clean":"2026-02-23T06:21:23.156748+0000","last_became_active":"2026-02-23T06:21:18.148262+0000","last_became_peered":"2026-02-23T06:21:18.148262+0000","last_unstale":"2026-02-23T06:21:23.156748+0000","last_undegraded":"2026-02-23T06:21:23.156748+0000","last_fullsized":"2026-02-23T06:21:23.156748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:09:54.723244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158936+0000","last_change":"2026-02-23T06:21:18.155275+0000","last_active":"2026-02-23T06:21:23.158936+0000","last_peered":"2026-02-23T06:21:23.158936+0000","last_clean":"2026-02-23T06:21:23.158936+0000","last_became_active":"2026-02-23T06:21:18.155214+0000","last_became_peered":"2026-02-23T06:21:18.155214+0000","last_unstale":"2026-02-23T06:21:23.158936+0000","last_undegraded":"2026-02-23T06:21:23.158936+0000","last_fullsized":"2026-02-23T06:21:23.158936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:44:47.367234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157370+0000","last_change":"2026-02-23T06:21:18.153381+0000","last_active":"2026-02-23T06:21:23.157370+0000","last_peered":"2026-02-23T06:21:23.157370+0000","last_clean":"2026-02-23T06:21:23.157370+0000","last_became_active":"2026-02-23T06:21:18.152456+0000","last_became_peered":"2026-02-23T06:21:18.152456+0000","last_unstale":"2026-02-23T06:21:23.157370+0000","last_undegraded":"2026-02-23T06:21:23.157370+0000","last_fullsized":"2026-02-23T06:21:23.157370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:14:46.231331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156471+0000","last_change":"2026-02-23T06:21:18.148599+0000","last_active":"2026-02-23T06:21:23.156471+0000","last_peered":"2026-02-23T06:21:23.156471+0000","last_clean":"2026-02-23T06:21:23.156471+0000","last_became_active":"2026-02-23T06:21:18.148498+0000","last_became_peered":"2026-02-23T06:21:18.148498+0000","last_unstale":"2026-02-23T06:21:23.156471+0000","last_undegraded":"2026-02-23T06:21:23.156471+0000","last_fullsized":"2026-02-23T06:21:23.156471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:05:56.074928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157128+0000","last_change":"2026-02-23T06:21:18.142621+0000","last_active":"2026-02-23T06:21:23.157128+0000","last_peered":"2026-02-23T06:21:23.157128+0000","last_clean":"2026-02-23T06:21:23.157128+0000","last_became_active":"2026-02-23T06:21:18.141938+0000","last_became_peered":"2026-02-23T06:21:18.141938+0000","last_unstale":"2026-02-23T06:21:23.157128+0000","last_undegraded":"2026-02-23T06:21:23.157128+0000","last_fullsized":"2026-02-23T06:21:23.157128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:25:55.390738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157141+0000","last_change":"2026-02-23T06:21:18.153183+0000","last_active":"2026-02-23T06:21:23.157141+0000","last_peered":"2026-02-23T06:21:23.157141+0000","last_clean":"2026-02-23T06:21:23.157141+0000","last_became_active":"2026-02-23T06:21:18.153090+0000","last_became_peered":"2026-02-23T06:21:18.153090+0000","last_unstale":"2026-02-23T06:21:23.157141+0000","last_undegraded":"2026-02-23T06:21:23.157141+0000","last_fullsized":"2026-02-23T06:21:23.157141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:26:17.749612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158286+0000","last_change":"2026-02-23T06:21:18.148055+0000","last_active":"2026-02-23T06:21:23.158286+0000","last_peered":"2026-02-23T06:21:23.158286+0000","last_clean":"2026-02-23T06:21:23.158286+0000","last_became_active":"2026-02-23T06:21:18.147956+0000","last_became_peered":"2026-02-23T06:21:18.147956+0000","last_unstale":"2026-02-23T06:21:23.158286+0000","last_undegraded":"2026-02-23T06:21:23.158286+0000","last_fullsized":"2026-02-23T06:21:23.158286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:22:55.028859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158650+0000","last_change":"2026-02-23T06:21:18.155576+0000","last_active":"2026-02-23T06:21:23.158650+0000","last_peered":"2026-02-23T06:21:23.158650+0000","last_clean":"2026-02-23T06:21:23.158650+0000","last_became_active":"2026-02-23T06:21:18.155130+0000","last_became_peered":"2026-02-23T06:21:18.155130+0000","last_unstale":"2026-02-23T06:21:23.158650+0000","last_undegraded":"2026-02-23T06:21:23.158650+0000","last_fullsized":"2026-02-23T06:21:23.158650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:43:12.801427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158425+0000","last_change":"2026-02-23T06:21:18.152980+0000","last_active":"2026-02-23T06:21:23.158425+0000","last_peered":"2026-02-23T06:21:23.158425+0000","last_clean":"2026-02-23T06:21:23.158425+0000","last_became_active":"2026-02-23T06:21:18.152790+0000","last_became_peered":"2026-02-23T06:21:18.152790+0000","last_unstale":"2026-02-23T06:21:23.158425+0000","last_undegraded":"2026-02-23T06:21:23.158425+0000","last_fullsized":"2026-02-23T06:21:23.158425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:33:09.398040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158457+0000","last_change":"2026-02-23T06:21:18.155247+0000","last_active":"2026-02-23T06:21:23.158457+0000","last_peered":"2026-02-23T06:21:23.158457+0000","last_clean":"2026-02-23T06:21:23.158457+0000","last_became_active":"2026-02-23T06:21:18.155122+0000","last_became_peered":"2026-02-23T06:21:18.155122+0000","last_unstale":"2026-02-23T06:21:23.158457+0000","last_undegraded":"2026-02-23T06:21:23.158457+0000","last_fullsized":"2026-02-23T06:21:23.158457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:45:08.775934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156432+0000","last_change":"2026-02-23T06:21:18.151259+0000","last_active":"2026-02-23T06:21:23.156432+0000","last_peered":"2026-02-23T06:21:23.156432+0000","last_clean":"2026-02-23T06:21:23.156432+0000","last_became_active":"2026-02-23T06:21:18.151151+0000","last_became_peered":"2026-02-23T06:21:18.151151+0000","last_unstale":"2026-02-23T06:21:23.156432+0000","last_undegraded":"2026-02-23T06:21:23.156432+0000","last_fullsized":"2026-02-23T06:21:23.156432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:08:03.361054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157811+0000","last_change":"2026-02-23T06:21:18.146606+0000","last_active":"2026-02-23T06:21:23.157811+0000","last_peered":"2026-02-23T06:21:23.157811+0000","last_clean":"2026-02-23T06:21:23.157811+0000","last_became_active":"2026-02-23T06:21:18.146527+0000","last_became_peered":"2026-02-23T06:21:18.146527+0000","last_unstale":"2026-02-23T06:21:23.157811+0000","last_undegraded":"2026-02-23T06:21:23.157811+0000","last_fullsized":"2026-02-23T06:21:23.157811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:30:44.739034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158602+0000","last_change":"2026-02-23T06:21:18.145872+0000","last_active":"2026-02-23T06:21:23.158602+0000","last_peered":"2026-02-23T06:21:23.158602+0000","last_clean":"2026-02-23T06:21:23.158602+0000","last_became_active":"2026-02-23T06:21:18.145770+0000","last_became_peered":"2026-02-23T06:21:18.145770+0000","last_unstale":"2026-02-23T06:21:23.158602+0000","last_undegraded":"2026-02-23T06:21:23.158602+0000","last_fullsized":"2026-02-23T06:21:23.158602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:21:28.063960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158049+0000","last_change":"2026-02-23T06:21:18.152478+0000","last_active":"2026-02-23T06:21:23.158049+0000","last_peered":"2026-02-23T06:21:23.158049+0000","last_clean":"2026-02-23T06:21:23.158049+0000","last_became_active":"2026-02-23T06:21:18.151948+0000","last_became_peered":"2026-02-23T06:21:18.151948+0000","last_unstale":"2026-02-23T06:21:23.158049+0000","last_undegraded":"2026-02-23T06:21:23.158049+0000","last_fullsized":"2026-02-23T06:21:23.158049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:58:02.829593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158363+0000","last_change":"2026-02-23T06:21:18.144778+0000","last_active":"2026-02-23T06:21:23.158363+0000","last_peered":"2026-02-23T06:21:23.158363+0000","last_clean":"2026-02-23T06:21:23.158363+0000","last_became_active":"2026-02-23T06:21:18.144346+0000","last_became_peered":"2026-02-23T06:21:18.144346+0000","last_unstale":"2026-02-23T06:21:23.158363+0000","last_undegraded":"2026-02-23T06:21:23.158363+0000","last_fullsized":"2026-02-23T06:21:23.158363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:25:27.650673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156824+0000","last_change":"2026-02-23T06:21:18.141648+0000","last_active":"2026-02-23T06:21:23.156824+0000","last_peered":"2026-02-23T06:21:23.156824+0000","last_clean":"2026-02-23T06:21:23.156824+0000","last_became_active":"2026-02-23T06:21:18.141449+0000","last_became_peered":"2026-02-23T06:21:18.141449+0000","last_unstale":"2026-02-23T06:21:23.156824+0000","last_undegraded":"2026-02-23T06:21:23.156824+0000","last_fullsized":"2026-02-23T06:21:23.156824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:33:18.986892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157020+0000","last_change":"2026-02-23T06:21:18.142536+0000","last_active":"2026-02-23T06:21:23.157020+0000","last_peered":"2026-02-23T06:21:23.157020+0000","last_clean":"2026-02-23T06:21:23.157020+0000","last_became_active":"2026-02-23T06:21:18.142359+0000","last_became_peered":"2026-02-23T06:21:18.142359+0000","last_unstale":"2026-02-23T06:21:23.157020+0000","last_undegraded":"2026-02-23T06:21:23.157020+0000","last_fullsized":"2026-02-23T06:21:23.157020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:54:09.503227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158607+0000","last_change":"2026-02-23T06:21:18.156667+0000","last_active":"2026-02-23T06:21:23.158607+0000","last_peered":"2026-02-23T06:21:23.158607+0000","last_clean":"2026-02-23T06:21:23.158607+0000","last_became_active":"2026-02-23T06:21:18.156564+0000","last_became_peered":"2026-02-23T06:21:18.156564+0000","last_unstale":"2026-02-23T06:21:23.158607+0000","last_undegraded":"2026-02-23T06:21:23.158607+0000","last_fullsized":"2026-02-23T06:21:23.158607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:11:13.967668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2454,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25597,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70172,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":328,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":335872,"data_stored":694963,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":12046,"internal_metadata":27578610},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":268,"kb_used_omap":19,"kb_used_meta":26924,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":274432,"data_stored":104649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19702,"internal_metadata":27570954},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":260,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":266240,"data_stored":104525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11374,"internal_metadata":27579282},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":332,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":339968,"data_stored":694985,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":11711,"internal_metadata":27578945},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":106853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13524,"internal_metadata":27577132},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":105129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11474,"internal_metadata":27579182},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":272,"kb_used_omap":10,"kb_used_meta":26933,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":278528,"data_stored":106159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11136,"internal_metadata":27579520},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":268,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":274432,"data_stored":104581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":27571517},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8618,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":702,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":320,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1500,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4712,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":336,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9409,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T06:21:35.999 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-23T06:21:36.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.156+0000 7eff499cd640 1 -- 10.20.193.58:0/672833022 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7eff440b1540 msgr2=0x7eff4415d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:36.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.156+0000 7eff499cd640 1 --2- 10.20.193.58:0/672833022 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7eff440b1540 0x7eff4415d380 secure :-1 s=READY pgs=109 gs=2 cs=0 l=1 c_cookie=9563967038956885007 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff2c004740 tx=0x7eff2c02f1e0 comp rx=0 tx=0).stop 2026-02-23T06:21:36.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.156+0000 7eff499cd640 1 -- 10.20.193.58:0/672833022 shutdown_connections 2026-02-23T06:21:36.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.156+0000 7eff499cd640 1 --2- 10.20.193.58:0/672833022 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7eff440b1540 0x7eff4415d380 unknown :-1 s=CLOSED pgs=109 gs=2 cs=0 l=1 c_cookie=9563967038956885007 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:36.152 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.156+0000 7eff499cd640 1 --2- 10.20.193.58:0/672833022 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7eff440b1170 0x7eff4415ce40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:36.152 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.156+0000 7eff499cd640 1 -- 10.20.193.58:0/672833022 >> 10.20.193.58:0/672833022 conn(0x7eff44058e50 msgr2=0x7eff44059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:36.152 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.156+0000 7eff499cd640 1 -- 10.20.193.58:0/672833022 shutdown_connections 2026-02-23T06:21:36.152 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.156+0000 7eff499cd640 1 -- 10.20.193.58:0/672833022 wait complete. 2026-02-23T06:21:36.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.157+0000 7eff499cd640 1 Processor -- start 2026-02-23T06:21:36.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.157+0000 7eff499cd640 1 -- start start 2026-02-23T06:21:36.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.158+0000 7eff499cd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7eff440b1170 0x7eff4415c3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:36.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.158+0000 7eff499cd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7eff440b1540 0x7eff44158890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:36.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.158+0000 7eff499cd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7eff440b58a0 0x7eff440b75a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:36.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.158+0000 7eff499cd640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7eff4405d6a0 con 0x7eff440b1170 2026-02-23T06:21:36.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.158+0000 7eff499cd640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7eff4405de70 con 0x7eff440b58a0 2026-02-23T06:21:36.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.158+0000 7eff499cd640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7eff4415c930 con 0x7eff440b1540 2026-02-23T06:21:36.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.158+0000 7eff42ffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7eff440b1170 0x7eff4415c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:36.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.158+0000 7eff42ffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7eff440b1170 0x7eff4415c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50692/0 (socket says 10.20.193.58:50692) 2026-02-23T06:21:36.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.158+0000 7eff42ffd640 1 -- 10.20.193.58:0/1703584543 learned_addr learned my addr 10.20.193.58:0/1703584543 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:36.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.158+0000 7eff427fc640 1 --2- 10.20.193.58:0/1703584543 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7eff440b1540 0x7eff44158890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:36.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.158+0000 7eff42ffd640 1 -- 10.20.193.58:0/1703584543 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7eff440b1540 msgr2=0x7eff44158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:36.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.158+0000 7eff42ffd640 1 --2- 10.20.193.58:0/1703584543 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7eff440b1540 0x7eff44158890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:36.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.158+0000 7eff42ffd640 1 -- 10.20.193.58:0/1703584543 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7eff440b58a0 msgr2=0x7eff440b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:36.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.158+0000 7eff42ffd640 1 --2- 10.20.193.58:0/1703584543 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7eff440b58a0 0x7eff440b75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:36.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.158+0000 7eff42ffd640 1 -- 10.20.193.58:0/1703584543 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff2c0094b0 con 0x7eff440b1170 2026-02-23T06:21:36.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.158+0000 7eff42ffd640 1 --2- 10.20.193.58:0/1703584543 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7eff440b1170 0x7eff4415c3f0 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff38009480 tx=0x7eff3800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:36.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.158+0000 7eff1bfff640 1 -- 10.20.193.58:0/1703584543 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7eff3800cd40 con 0x7eff440b1170 2026-02-23T06:21:36.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.159+0000 7eff499cd640 1 -- 10.20.193.58:0/1703584543 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff4405d8d0 con 0x7eff440b1170 2026-02-23T06:21:36.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.159+0000 7eff1bfff640 1 -- 10.20.193.58:0/1703584543 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff38004850 con 0x7eff440b1170 2026-02-23T06:21:36.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.159+0000 7eff1bfff640 1 -- 10.20.193.58:0/1703584543 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7eff3800cea0 con 0x7eff440b1170 2026-02-23T06:21:36.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.159+0000 7eff499cd640 1 -- 10.20.193.58:0/1703584543 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff44161210 con 0x7eff440b1170 2026-02-23T06:21:36.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.159+0000 7eff499cd640 1 -- 10.20.193.58:0/1703584543 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff04005300 con 0x7eff440b1170 2026-02-23T06:21:36.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.160+0000 7eff1bfff640 1 -- 10.20.193.58:0/1703584543 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7eff3801f060 con 0x7eff440b1170 2026-02-23T06:21:36.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.161+0000 7eff1bfff640 1 --2- 10.20.193.58:0/1703584543 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7eff1407a6c0 0x7eff1409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:36.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.161+0000 7eff1bfff640 1 -- 10.20.193.58:0/1703584543 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7eff38014070 con 0x7eff440b1170 2026-02-23T06:21:36.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.161+0000 7eff427fc640 1 --2- 10.20.193.58:0/1703584543 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7eff1407a6c0 0x7eff1409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:36.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.162+0000 7eff427fc640 1 --2- 10.20.193.58:0/1703584543 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7eff1407a6c0 0x7eff1409ab70 secure :-1 s=READY pgs=69 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff2c0023d0 tx=0x7eff2c031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:36.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.162+0000 7eff1bfff640 1 -- 10.20.193.58:0/1703584543 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7eff38060e80 con 0x7eff440b1170 2026-02-23T06:21:36.268 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.274+0000 7eff499cd640 1 -- 10.20.193.58:0/1703584543 --> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7eff04002bb0 con 0x7eff1407a6c0 2026-02-23T06:21:36.272 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.277+0000 7eff1bfff640 1 -- 10.20.193.58:0/1703584543 <== mgr.4126 v2:10.20.193.93:6800/4124709854 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332647 (secure 0 0 0) 0x7eff04002bb0 con 0x7eff1407a6c0 2026-02-23T06:21:36.276 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:36.278 INFO:teuthology.orchestra.run.trial058.stderr:dumped all 2026-02-23T06:21:36.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.280+0000 7eff499cd640 1 -- 10.20.193.58:0/1703584543 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7eff1407a6c0 msgr2=0x7eff1409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:36.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.280+0000 7eff499cd640 1 --2- 10.20.193.58:0/1703584543 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7eff1407a6c0 0x7eff1409ab70 secure :-1 s=READY pgs=69 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff2c0023d0 tx=0x7eff2c031040 comp rx=0 tx=0).stop 2026-02-23T06:21:36.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.280+0000 7eff499cd640 1 -- 10.20.193.58:0/1703584543 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7eff440b1170 msgr2=0x7eff4415c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:36.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.280+0000 7eff499cd640 1 --2- 10.20.193.58:0/1703584543 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7eff440b1170 0x7eff4415c3f0 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff38009480 tx=0x7eff3800ee60 comp rx=0 tx=0).stop 2026-02-23T06:21:36.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.280+0000 7eff499cd640 1 -- 10.20.193.58:0/1703584543 shutdown_connections 2026-02-23T06:21:36.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.280+0000 7eff499cd640 1 --2- 10.20.193.58:0/1703584543 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7eff1407a6c0 0x7eff1409ab70 unknown :-1 s=CLOSED pgs=69 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:36.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.280+0000 7eff499cd640 1 --2- 10.20.193.58:0/1703584543 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7eff440b58a0 0x7eff440b75a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:36.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.280+0000 7eff499cd640 1 --2- 10.20.193.58:0/1703584543 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7eff440b1540 0x7eff44158890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:36.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.280+0000 7eff499cd640 1 --2- 10.20.193.58:0/1703584543 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7eff440b1170 0x7eff4415c3f0 unknown :-1 s=CLOSED pgs=110 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:36.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.280+0000 7eff499cd640 1 -- 10.20.193.58:0/1703584543 >> 10.20.193.58:0/1703584543 conn(0x7eff44058e50 msgr2=0x7eff440b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:36.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.280+0000 7eff499cd640 1 -- 10.20.193.58:0/1703584543 shutdown_connections 2026-02-23T06:21:36.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.280+0000 7eff499cd640 1 -- 10.20.193.58:0/1703584543 wait complete. 2026-02-23T06:21:36.287 INFO:teuthology.orchestra.run.trial058.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2026-02-23T06:21:34.376495+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592822,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":190,"num_write_kb":2686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":217952,"kb_used_data":2272,"kb_used_omap":107,"kb_used_meta":215444,"kb_avail":754756768,"statfs":{"total":773094113280,"available":772870930432,"internally_reserved":0,"allocated":2326528,"data_stored":2021844,"data_compressed":70172,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":110106,"internal_metadata":220615142},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2454,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.220833"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156952+0000","last_change":"2026-02-23T06:21:17.142582+0000","last_active":"2026-02-23T06:21:23.156952+0000","last_peered":"2026-02-23T06:21:23.156952+0000","last_clean":"2026-02-23T06:21:23.156952+0000","last_became_active":"2026-02-23T06:21:17.142416+0000","last_became_peered":"2026-02-23T06:21:17.142416+0000","last_unstale":"2026-02-23T06:21:23.156952+0000","last_undegraded":"2026-02-23T06:21:23.156952+0000","last_fullsized":"2026-02-23T06:21:23.156952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:13:12.649937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157112+0000","last_change":"2026-02-23T06:21:18.148362+0000","last_active":"2026-02-23T06:21:23.157112+0000","last_peered":"2026-02-23T06:21:23.157112+0000","last_clean":"2026-02-23T06:21:23.157112+0000","last_became_active":"2026-02-23T06:21:18.148276+0000","last_became_peered":"2026-02-23T06:21:18.148276+0000","last_unstale":"2026-02-23T06:21:23.157112+0000","last_undegraded":"2026-02-23T06:21:23.157112+0000","last_fullsized":"2026-02-23T06:21:23.157112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:47.221741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156473+0000","last_change":"2026-02-23T06:21:22.169541+0000","last_active":"2026-02-23T06:21:23.156473+0000","last_peered":"2026-02-23T06:21:23.156473+0000","last_clean":"2026-02-23T06:21:23.156473+0000","last_became_active":"2026-02-23T06:21:22.169307+0000","last_became_peered":"2026-02-23T06:21:22.169307+0000","last_unstale":"2026-02-23T06:21:23.156473+0000","last_undegraded":"2026-02-23T06:21:23.156473+0000","last_fullsized":"2026-02-23T06:21:23.156473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:40:10.952374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157171+0000","last_change":"2026-02-23T06:21:17.138864+0000","last_active":"2026-02-23T06:21:23.157171+0000","last_peered":"2026-02-23T06:21:23.157171+0000","last_clean":"2026-02-23T06:21:23.157171+0000","last_became_active":"2026-02-23T06:21:17.138651+0000","last_became_peered":"2026-02-23T06:21:17.138651+0000","last_unstale":"2026-02-23T06:21:23.157171+0000","last_undegraded":"2026-02-23T06:21:23.157171+0000","last_fullsized":"2026-02-23T06:21:23.157171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:24.172617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157312+0000","last_change":"2026-02-23T06:21:18.145040+0000","last_active":"2026-02-23T06:21:23.157312+0000","last_peered":"2026-02-23T06:21:23.157312+0000","last_clean":"2026-02-23T06:21:23.157312+0000","last_became_active":"2026-02-23T06:21:18.144915+0000","last_became_peered":"2026-02-23T06:21:18.144915+0000","last_unstale":"2026-02-23T06:21:23.157312+0000","last_undegraded":"2026-02-23T06:21:23.157312+0000","last_fullsized":"2026-02-23T06:21:23.157312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:17:30.105623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158170+0000","last_change":"2026-02-23T06:21:22.172729+0000","last_active":"2026-02-23T06:21:23.158170+0000","last_peered":"2026-02-23T06:21:23.158170+0000","last_clean":"2026-02-23T06:21:23.158170+0000","last_became_active":"2026-02-23T06:21:22.172510+0000","last_became_peered":"2026-02-23T06:21:22.172510+0000","last_unstale":"2026-02-23T06:21:23.158170+0000","last_undegraded":"2026-02-23T06:21:23.158170+0000","last_fullsized":"2026-02-23T06:21:23.158170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:53:55.801734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158943+0000","last_change":"2026-02-23T06:21:17.150375+0000","last_active":"2026-02-23T06:21:23.158943+0000","last_peered":"2026-02-23T06:21:23.158943+0000","last_clean":"2026-02-23T06:21:23.158943+0000","last_became_active":"2026-02-23T06:21:17.150244+0000","last_became_peered":"2026-02-23T06:21:17.150244+0000","last_unstale":"2026-02-23T06:21:23.158943+0000","last_undegraded":"2026-02-23T06:21:23.158943+0000","last_fullsized":"2026-02-23T06:21:23.158943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:06:21.465108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157674+0000","last_change":"2026-02-23T06:21:18.150247+0000","last_active":"2026-02-23T06:21:23.157674+0000","last_peered":"2026-02-23T06:21:23.157674+0000","last_clean":"2026-02-23T06:21:23.157674+0000","last_became_active":"2026-02-23T06:21:18.149827+0000","last_became_peered":"2026-02-23T06:21:18.149827+0000","last_unstale":"2026-02-23T06:21:23.157674+0000","last_undegraded":"2026-02-23T06:21:23.157674+0000","last_fullsized":"2026-02-23T06:21:23.157674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:37:58.944726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158517+0000","last_change":"2026-02-23T06:21:22.174417+0000","last_active":"2026-02-23T06:21:23.158517+0000","last_peered":"2026-02-23T06:21:23.158517+0000","last_clean":"2026-02-23T06:21:23.158517+0000","last_became_active":"2026-02-23T06:21:22.173939+0000","last_became_peered":"2026-02-23T06:21:22.173939+0000","last_unstale":"2026-02-23T06:21:23.158517+0000","last_undegraded":"2026-02-23T06:21:23.158517+0000","last_fullsized":"2026-02-23T06:21:23.158517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:41:53.008301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158816+0000","last_change":"2026-02-23T06:21:17.145244+0000","last_active":"2026-02-23T06:21:23.158816+0000","last_peered":"2026-02-23T06:21:23.158816+0000","last_clean":"2026-02-23T06:21:23.158816+0000","last_became_active":"2026-02-23T06:21:17.144122+0000","last_became_peered":"2026-02-23T06:21:17.144122+0000","last_unstale":"2026-02-23T06:21:23.158816+0000","last_undegraded":"2026-02-23T06:21:23.158816+0000","last_fullsized":"2026-02-23T06:21:23.158816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:42:56.020005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159068+0000","last_change":"2026-02-23T06:21:18.155799+0000","last_active":"2026-02-23T06:21:23.159068+0000","last_peered":"2026-02-23T06:21:23.159068+0000","last_clean":"2026-02-23T06:21:23.159068+0000","last_became_active":"2026-02-23T06:21:18.154985+0000","last_became_peered":"2026-02-23T06:21:18.154985+0000","last_unstale":"2026-02-23T06:21:23.159068+0000","last_undegraded":"2026-02-23T06:21:23.159068+0000","last_fullsized":"2026-02-23T06:21:23.159068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:11:13.595733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158472+0000","last_change":"2026-02-23T06:21:22.168755+0000","last_active":"2026-02-23T06:21:23.158472+0000","last_peered":"2026-02-23T06:21:23.158472+0000","last_clean":"2026-02-23T06:21:23.158472+0000","last_became_active":"2026-02-23T06:21:22.165671+0000","last_became_peered":"2026-02-23T06:21:22.165671+0000","last_unstale":"2026-02-23T06:21:23.158472+0000","last_undegraded":"2026-02-23T06:21:23.158472+0000","last_fullsized":"2026-02-23T06:21:23.158472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:04:32.848929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157587+0000","last_change":"2026-02-23T06:21:18.150907+0000","last_active":"2026-02-23T06:21:23.157587+0000","last_peered":"2026-02-23T06:21:23.157587+0000","last_clean":"2026-02-23T06:21:23.157587+0000","last_became_active":"2026-02-23T06:21:18.150604+0000","last_became_peered":"2026-02-23T06:21:18.150604+0000","last_unstale":"2026-02-23T06:21:23.157587+0000","last_undegraded":"2026-02-23T06:21:23.157587+0000","last_fullsized":"2026-02-23T06:21:23.157587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:15:21.672153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157971+0000","last_change":"2026-02-23T06:21:17.147523+0000","last_active":"2026-02-23T06:21:23.157971+0000","last_peered":"2026-02-23T06:21:23.157971+0000","last_clean":"2026-02-23T06:21:23.157971+0000","last_became_active":"2026-02-23T06:21:17.147351+0000","last_became_peered":"2026-02-23T06:21:17.147351+0000","last_unstale":"2026-02-23T06:21:23.157971+0000","last_undegraded":"2026-02-23T06:21:23.157971+0000","last_fullsized":"2026-02-23T06:21:23.157971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:36:34.550499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158924+0000","last_change":"2026-02-23T06:21:22.169413+0000","last_active":"2026-02-23T06:21:23.158924+0000","last_peered":"2026-02-23T06:21:23.158924+0000","last_clean":"2026-02-23T06:21:23.158924+0000","last_became_active":"2026-02-23T06:21:22.169259+0000","last_became_peered":"2026-02-23T06:21:22.169259+0000","last_unstale":"2026-02-23T06:21:23.158924+0000","last_undegraded":"2026-02-23T06:21:23.158924+0000","last_fullsized":"2026-02-23T06:21:23.158924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:14:12.944321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156495+0000","last_change":"2026-02-23T06:21:18.142316+0000","last_active":"2026-02-23T06:21:23.156495+0000","last_peered":"2026-02-23T06:21:23.156495+0000","last_clean":"2026-02-23T06:21:23.156495+0000","last_became_active":"2026-02-23T06:21:18.142144+0000","last_became_peered":"2026-02-23T06:21:18.142144+0000","last_unstale":"2026-02-23T06:21:23.156495+0000","last_undegraded":"2026-02-23T06:21:23.156495+0000","last_fullsized":"2026-02-23T06:21:23.156495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:53:33.429271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157370+0000","last_change":"2026-02-23T06:21:17.137576+0000","last_active":"2026-02-23T06:21:23.157370+0000","last_peered":"2026-02-23T06:21:23.157370+0000","last_clean":"2026-02-23T06:21:23.157370+0000","last_became_active":"2026-02-23T06:21:17.137371+0000","last_became_peered":"2026-02-23T06:21:17.137371+0000","last_unstale":"2026-02-23T06:21:23.157370+0000","last_undegraded":"2026-02-23T06:21:23.157370+0000","last_fullsized":"2026-02-23T06:21:23.157370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:27.159743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158222+0000","last_change":"2026-02-23T06:21:22.163003+0000","last_active":"2026-02-23T06:21:23.158222+0000","last_peered":"2026-02-23T06:21:23.158222+0000","last_clean":"2026-02-23T06:21:23.158222+0000","last_became_active":"2026-02-23T06:21:22.162898+0000","last_became_peered":"2026-02-23T06:21:22.162898+0000","last_unstale":"2026-02-23T06:21:23.158222+0000","last_undegraded":"2026-02-23T06:21:23.158222+0000","last_fullsized":"2026-02-23T06:21:23.158222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:29:18.161667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156351+0000","last_change":"2026-02-23T06:21:18.141281+0000","last_active":"2026-02-23T06:21:23.156351+0000","last_peered":"2026-02-23T06:21:23.156351+0000","last_clean":"2026-02-23T06:21:23.156351+0000","last_became_active":"2026-02-23T06:21:18.141090+0000","last_became_peered":"2026-02-23T06:21:18.141090+0000","last_unstale":"2026-02-23T06:21:23.156351+0000","last_undegraded":"2026-02-23T06:21:23.156351+0000","last_fullsized":"2026-02-23T06:21:23.156351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:12:21.750595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156633+0000","last_change":"2026-02-23T06:21:17.144179+0000","last_active":"2026-02-23T06:21:23.156633+0000","last_peered":"2026-02-23T06:21:23.156633+0000","last_clean":"2026-02-23T06:21:23.156633+0000","last_became_active":"2026-02-23T06:21:17.144017+0000","last_became_peered":"2026-02-23T06:21:17.144017+0000","last_unstale":"2026-02-23T06:21:23.156633+0000","last_undegraded":"2026-02-23T06:21:23.156633+0000","last_fullsized":"2026-02-23T06:21:23.156633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:25:41.992201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156888+0000","last_change":"2026-02-23T06:21:22.174826+0000","last_active":"2026-02-23T06:21:23.156888+0000","last_peered":"2026-02-23T06:21:23.156888+0000","last_clean":"2026-02-23T06:21:23.156888+0000","last_became_active":"2026-02-23T06:21:22.174683+0000","last_became_peered":"2026-02-23T06:21:22.174683+0000","last_unstale":"2026-02-23T06:21:23.156888+0000","last_undegraded":"2026-02-23T06:21:23.156888+0000","last_fullsized":"2026-02-23T06:21:23.156888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:04:49.277580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157342+0000","last_change":"2026-02-23T06:21:18.145331+0000","last_active":"2026-02-23T06:21:23.157342+0000","last_peered":"2026-02-23T06:21:23.157342+0000","last_clean":"2026-02-23T06:21:23.157342+0000","last_became_active":"2026-02-23T06:21:18.145231+0000","last_became_peered":"2026-02-23T06:21:18.145231+0000","last_unstale":"2026-02-23T06:21:23.157342+0000","last_undegraded":"2026-02-23T06:21:23.157342+0000","last_fullsized":"2026-02-23T06:21:23.157342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:32:44.487867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157126+0000","last_change":"2026-02-23T06:21:17.147584+0000","last_active":"2026-02-23T06:21:23.157126+0000","last_peered":"2026-02-23T06:21:23.157126+0000","last_clean":"2026-02-23T06:21:23.157126+0000","last_became_active":"2026-02-23T06:21:17.147431+0000","last_became_peered":"2026-02-23T06:21:17.147431+0000","last_unstale":"2026-02-23T06:21:23.157126+0000","last_undegraded":"2026-02-23T06:21:23.157126+0000","last_fullsized":"2026-02-23T06:21:23.157126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:10:39.127457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159080+0000","last_change":"2026-02-23T06:21:22.175656+0000","last_active":"2026-02-23T06:21:23.159080+0000","last_peered":"2026-02-23T06:21:23.159080+0000","last_clean":"2026-02-23T06:21:23.159080+0000","last_became_active":"2026-02-23T06:21:22.175493+0000","last_became_peered":"2026-02-23T06:21:22.175493+0000","last_unstale":"2026-02-23T06:21:23.159080+0000","last_undegraded":"2026-02-23T06:21:23.159080+0000","last_fullsized":"2026-02-23T06:21:23.159080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:10:41.366772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156769+0000","last_change":"2026-02-23T06:21:18.141486+0000","last_active":"2026-02-23T06:21:23.156769+0000","last_peered":"2026-02-23T06:21:23.156769+0000","last_clean":"2026-02-23T06:21:23.156769+0000","last_became_active":"2026-02-23T06:21:18.141277+0000","last_became_peered":"2026-02-23T06:21:18.141277+0000","last_unstale":"2026-02-23T06:21:23.156769+0000","last_undegraded":"2026-02-23T06:21:23.156769+0000","last_fullsized":"2026-02-23T06:21:23.156769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:21:15.738187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158970+0000","last_change":"2026-02-23T06:21:17.148536+0000","last_active":"2026-02-23T06:21:23.158970+0000","last_peered":"2026-02-23T06:21:23.158970+0000","last_clean":"2026-02-23T06:21:23.158970+0000","last_became_active":"2026-02-23T06:21:17.148424+0000","last_became_peered":"2026-02-23T06:21:17.148424+0000","last_unstale":"2026-02-23T06:21:23.158970+0000","last_undegraded":"2026-02-23T06:21:23.158970+0000","last_fullsized":"2026-02-23T06:21:23.158970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:02:54.995144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158363+0000","last_change":"2026-02-23T06:21:22.171333+0000","last_active":"2026-02-23T06:21:23.158363+0000","last_peered":"2026-02-23T06:21:23.158363+0000","last_clean":"2026-02-23T06:21:23.158363+0000","last_became_active":"2026-02-23T06:21:22.170496+0000","last_became_peered":"2026-02-23T06:21:22.170496+0000","last_unstale":"2026-02-23T06:21:23.158363+0000","last_undegraded":"2026-02-23T06:21:23.158363+0000","last_fullsized":"2026-02-23T06:21:23.158363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:40:07.996281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156943+0000","last_change":"2026-02-23T06:21:18.142135+0000","last_active":"2026-02-23T06:21:23.156943+0000","last_peered":"2026-02-23T06:21:23.156943+0000","last_clean":"2026-02-23T06:21:23.156943+0000","last_became_active":"2026-02-23T06:21:18.141771+0000","last_became_peered":"2026-02-23T06:21:18.141771+0000","last_unstale":"2026-02-23T06:21:23.156943+0000","last_undegraded":"2026-02-23T06:21:23.156943+0000","last_fullsized":"2026-02-23T06:21:23.156943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:10:18.195986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156859+0000","last_change":"2026-02-23T06:21:17.142326+0000","last_active":"2026-02-23T06:21:23.156859+0000","last_peered":"2026-02-23T06:21:23.156859+0000","last_clean":"2026-02-23T06:21:23.156859+0000","last_became_active":"2026-02-23T06:21:17.142203+0000","last_became_peered":"2026-02-23T06:21:17.142203+0000","last_unstale":"2026-02-23T06:21:23.156859+0000","last_undegraded":"2026-02-23T06:21:23.156859+0000","last_fullsized":"2026-02-23T06:21:23.156859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:49:44.262210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156453+0000","last_change":"2026-02-23T06:21:22.168717+0000","last_active":"2026-02-23T06:21:23.156453+0000","last_peered":"2026-02-23T06:21:23.156453+0000","last_clean":"2026-02-23T06:21:23.156453+0000","last_became_active":"2026-02-23T06:21:22.168375+0000","last_became_peered":"2026-02-23T06:21:22.168375+0000","last_unstale":"2026-02-23T06:21:23.156453+0000","last_undegraded":"2026-02-23T06:21:23.156453+0000","last_fullsized":"2026-02-23T06:21:23.156453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:03:53.993581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157404+0000","last_change":"2026-02-23T06:21:18.141908+0000","last_active":"2026-02-23T06:21:23.157404+0000","last_peered":"2026-02-23T06:21:23.157404+0000","last_clean":"2026-02-23T06:21:23.157404+0000","last_became_active":"2026-02-23T06:21:18.141363+0000","last_became_peered":"2026-02-23T06:21:18.141363+0000","last_unstale":"2026-02-23T06:21:23.157404+0000","last_undegraded":"2026-02-23T06:21:23.157404+0000","last_fullsized":"2026-02-23T06:21:23.157404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:06:26.731868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159168+0000","last_change":"2026-02-23T06:21:17.144716+0000","last_active":"2026-02-23T06:21:23.159168+0000","last_peered":"2026-02-23T06:21:23.159168+0000","last_clean":"2026-02-23T06:21:23.159168+0000","last_became_active":"2026-02-23T06:21:17.144515+0000","last_became_peered":"2026-02-23T06:21:17.144515+0000","last_unstale":"2026-02-23T06:21:23.159168+0000","last_undegraded":"2026-02-23T06:21:23.159168+0000","last_fullsized":"2026-02-23T06:21:23.159168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:38:35.014170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157139+0000","last_change":"2026-02-23T06:21:22.171364+0000","last_active":"2026-02-23T06:21:23.157139+0000","last_peered":"2026-02-23T06:21:23.157139+0000","last_clean":"2026-02-23T06:21:23.157139+0000","last_became_active":"2026-02-23T06:21:22.171165+0000","last_became_peered":"2026-02-23T06:21:22.171165+0000","last_unstale":"2026-02-23T06:21:23.157139+0000","last_undegraded":"2026-02-23T06:21:23.157139+0000","last_fullsized":"2026-02-23T06:21:23.157139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:00:42.055334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158796+0000","last_change":"2026-02-23T06:21:18.144182+0000","last_active":"2026-02-23T06:21:23.158796+0000","last_peered":"2026-02-23T06:21:23.158796+0000","last_clean":"2026-02-23T06:21:23.158796+0000","last_became_active":"2026-02-23T06:21:18.143585+0000","last_became_peered":"2026-02-23T06:21:18.143585+0000","last_unstale":"2026-02-23T06:21:23.158796+0000","last_undegraded":"2026-02-23T06:21:23.158796+0000","last_fullsized":"2026-02-23T06:21:23.158796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:07:05.513990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156754+0000","last_change":"2026-02-23T06:21:17.137935+0000","last_active":"2026-02-23T06:21:23.156754+0000","last_peered":"2026-02-23T06:21:23.156754+0000","last_clean":"2026-02-23T06:21:23.156754+0000","last_became_active":"2026-02-23T06:21:17.137386+0000","last_became_peered":"2026-02-23T06:21:17.137386+0000","last_unstale":"2026-02-23T06:21:23.156754+0000","last_undegraded":"2026-02-23T06:21:23.156754+0000","last_fullsized":"2026-02-23T06:21:23.156754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:51:24.646436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157353+0000","last_change":"2026-02-23T06:21:22.163110+0000","last_active":"2026-02-23T06:21:23.157353+0000","last_peered":"2026-02-23T06:21:23.157353+0000","last_clean":"2026-02-23T06:21:23.157353+0000","last_became_active":"2026-02-23T06:21:22.162891+0000","last_became_peered":"2026-02-23T06:21:22.162891+0000","last_unstale":"2026-02-23T06:21:23.157353+0000","last_undegraded":"2026-02-23T06:21:23.157353+0000","last_fullsized":"2026-02-23T06:21:23.157353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:06:23.664613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157998+0000","last_change":"2026-02-23T06:21:18.152606+0000","last_active":"2026-02-23T06:21:23.157998+0000","last_peered":"2026-02-23T06:21:23.157998+0000","last_clean":"2026-02-23T06:21:23.157998+0000","last_became_active":"2026-02-23T06:21:18.152102+0000","last_became_peered":"2026-02-23T06:21:18.152102+0000","last_unstale":"2026-02-23T06:21:23.157998+0000","last_undegraded":"2026-02-23T06:21:23.157998+0000","last_fullsized":"2026-02-23T06:21:23.157998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:59:30.188417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157850+0000","last_change":"2026-02-23T06:21:17.143289+0000","last_active":"2026-02-23T06:21:23.157850+0000","last_peered":"2026-02-23T06:21:23.157850+0000","last_clean":"2026-02-23T06:21:23.157850+0000","last_became_active":"2026-02-23T06:21:17.143201+0000","last_became_peered":"2026-02-23T06:21:17.143201+0000","last_unstale":"2026-02-23T06:21:23.157850+0000","last_undegraded":"2026-02-23T06:21:23.157850+0000","last_fullsized":"2026-02-23T06:21:23.157850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:33:06.892035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157325+0000","last_change":"2026-02-23T06:21:22.163932+0000","last_active":"2026-02-23T06:21:23.157325+0000","last_peered":"2026-02-23T06:21:23.157325+0000","last_clean":"2026-02-23T06:21:23.157325+0000","last_became_active":"2026-02-23T06:21:22.163734+0000","last_became_peered":"2026-02-23T06:21:22.163734+0000","last_unstale":"2026-02-23T06:21:23.157325+0000","last_undegraded":"2026-02-23T06:21:23.157325+0000","last_fullsized":"2026-02-23T06:21:23.157325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:44:47.208608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156436+0000","last_change":"2026-02-23T06:21:18.141664+0000","last_active":"2026-02-23T06:21:23.156436+0000","last_peered":"2026-02-23T06:21:23.156436+0000","last_clean":"2026-02-23T06:21:23.156436+0000","last_became_active":"2026-02-23T06:21:18.141350+0000","last_became_peered":"2026-02-23T06:21:18.141350+0000","last_unstale":"2026-02-23T06:21:23.156436+0000","last_undegraded":"2026-02-23T06:21:23.156436+0000","last_fullsized":"2026-02-23T06:21:23.156436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:01:50.434732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156433+0000","last_change":"2026-02-23T06:21:17.139311+0000","last_active":"2026-02-23T06:21:23.156433+0000","last_peered":"2026-02-23T06:21:23.156433+0000","last_clean":"2026-02-23T06:21:23.156433+0000","last_became_active":"2026-02-23T06:21:17.139200+0000","last_became_peered":"2026-02-23T06:21:17.139200+0000","last_unstale":"2026-02-23T06:21:23.156433+0000","last_undegraded":"2026-02-23T06:21:23.156433+0000","last_fullsized":"2026-02-23T06:21:23.156433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:52:23.863807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157449+0000","last_change":"2026-02-23T06:21:22.164793+0000","last_active":"2026-02-23T06:21:23.157449+0000","last_peered":"2026-02-23T06:21:23.157449+0000","last_clean":"2026-02-23T06:21:23.157449+0000","last_became_active":"2026-02-23T06:21:22.164667+0000","last_became_peered":"2026-02-23T06:21:22.164667+0000","last_unstale":"2026-02-23T06:21:23.157449+0000","last_undegraded":"2026-02-23T06:21:23.157449+0000","last_fullsized":"2026-02-23T06:21:23.157449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:36:39.520044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156948+0000","last_change":"2026-02-23T06:21:18.146624+0000","last_active":"2026-02-23T06:21:23.156948+0000","last_peered":"2026-02-23T06:21:23.156948+0000","last_clean":"2026-02-23T06:21:23.156948+0000","last_became_active":"2026-02-23T06:21:18.146491+0000","last_became_peered":"2026-02-23T06:21:18.146491+0000","last_unstale":"2026-02-23T06:21:23.156948+0000","last_undegraded":"2026-02-23T06:21:23.156948+0000","last_fullsized":"2026-02-23T06:21:23.156948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:11:23.574241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157493+0000","last_change":"2026-02-23T06:21:17.143128+0000","last_active":"2026-02-23T06:21:23.157493+0000","last_peered":"2026-02-23T06:21:23.157493+0000","last_clean":"2026-02-23T06:21:23.157493+0000","last_became_active":"2026-02-23T06:21:17.143050+0000","last_became_peered":"2026-02-23T06:21:17.143050+0000","last_unstale":"2026-02-23T06:21:23.157493+0000","last_undegraded":"2026-02-23T06:21:23.157493+0000","last_fullsized":"2026-02-23T06:21:23.157493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:15.628487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156942+0000","last_change":"2026-02-23T06:21:22.168755+0000","last_active":"2026-02-23T06:21:23.156942+0000","last_peered":"2026-02-23T06:21:23.156942+0000","last_clean":"2026-02-23T06:21:23.156942+0000","last_became_active":"2026-02-23T06:21:22.168510+0000","last_became_peered":"2026-02-23T06:21:22.168510+0000","last_unstale":"2026-02-23T06:21:23.156942+0000","last_undegraded":"2026-02-23T06:21:23.156942+0000","last_fullsized":"2026-02-23T06:21:23.156942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:19:06.716318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156576+0000","last_change":"2026-02-23T06:21:18.145397+0000","last_active":"2026-02-23T06:21:23.156576+0000","last_peered":"2026-02-23T06:21:23.156576+0000","last_clean":"2026-02-23T06:21:23.156576+0000","last_became_active":"2026-02-23T06:21:18.145214+0000","last_became_peered":"2026-02-23T06:21:18.145214+0000","last_unstale":"2026-02-23T06:21:23.156576+0000","last_undegraded":"2026-02-23T06:21:23.156576+0000","last_fullsized":"2026-02-23T06:21:23.156576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:33:41.870582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158977+0000","last_change":"2026-02-23T06:21:17.147696+0000","last_active":"2026-02-23T06:21:23.158977+0000","last_peered":"2026-02-23T06:21:23.158977+0000","last_clean":"2026-02-23T06:21:23.158977+0000","last_became_active":"2026-02-23T06:21:17.147619+0000","last_became_peered":"2026-02-23T06:21:17.147619+0000","last_unstale":"2026-02-23T06:21:23.158977+0000","last_undegraded":"2026-02-23T06:21:23.158977+0000","last_fullsized":"2026-02-23T06:21:23.158977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:49:09.070245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'112","reported_seq":164,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157640+0000","last_change":"2026-02-23T06:21:11.397748+0000","last_active":"2026-02-23T06:21:23.157640+0000","last_peered":"2026-02-23T06:21:23.157640+0000","last_clean":"2026-02-23T06:21:23.157640+0000","last_became_active":"2026-02-23T06:21:11.397664+0000","last_became_peered":"2026-02-23T06:21:11.397664+0000","last_unstale":"2026-02-23T06:21:23.157640+0000","last_undegraded":"2026-02-23T06:21:23.157640+0000","last_fullsized":"2026-02-23T06:21:23.157640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:10.392316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:10.392316+0000","last_clean_scrub_stamp":"2026-02-23T06:21:10.392316+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:43.157572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159148+0000","last_change":"2026-02-23T06:21:22.174696+0000","last_active":"2026-02-23T06:21:23.159148+0000","last_peered":"2026-02-23T06:21:23.159148+0000","last_clean":"2026-02-23T06:21:23.159148+0000","last_became_active":"2026-02-23T06:21:22.174253+0000","last_became_peered":"2026-02-23T06:21:22.174253+0000","last_unstale":"2026-02-23T06:21:23.159148+0000","last_undegraded":"2026-02-23T06:21:23.159148+0000","last_fullsized":"2026-02-23T06:21:23.159148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:28.487343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159093+0000","last_change":"2026-02-23T06:21:18.150652+0000","last_active":"2026-02-23T06:21:23.159093+0000","last_peered":"2026-02-23T06:21:23.159093+0000","last_clean":"2026-02-23T06:21:23.159093+0000","last_became_active":"2026-02-23T06:21:18.150501+0000","last_became_peered":"2026-02-23T06:21:18.150501+0000","last_unstale":"2026-02-23T06:21:23.159093+0000","last_undegraded":"2026-02-23T06:21:23.159093+0000","last_fullsized":"2026-02-23T06:21:23.159093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:34:20.113034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157473+0000","last_change":"2026-02-23T06:21:17.146074+0000","last_active":"2026-02-23T06:21:23.157473+0000","last_peered":"2026-02-23T06:21:23.157473+0000","last_clean":"2026-02-23T06:21:23.157473+0000","last_became_active":"2026-02-23T06:21:17.145938+0000","last_became_peered":"2026-02-23T06:21:17.145938+0000","last_unstale":"2026-02-23T06:21:23.157473+0000","last_undegraded":"2026-02-23T06:21:23.157473+0000","last_fullsized":"2026-02-23T06:21:23.157473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:41:42.571718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158551+0000","last_change":"2026-02-23T06:21:22.172266+0000","last_active":"2026-02-23T06:21:23.158551+0000","last_peered":"2026-02-23T06:21:23.158551+0000","last_clean":"2026-02-23T06:21:23.158551+0000","last_became_active":"2026-02-23T06:21:22.171828+0000","last_became_peered":"2026-02-23T06:21:22.171828+0000","last_unstale":"2026-02-23T06:21:23.158551+0000","last_undegraded":"2026-02-23T06:21:23.158551+0000","last_fullsized":"2026-02-23T06:21:23.158551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:34:06.583640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158339+0000","last_change":"2026-02-23T06:21:18.147056+0000","last_active":"2026-02-23T06:21:23.158339+0000","last_peered":"2026-02-23T06:21:23.158339+0000","last_clean":"2026-02-23T06:21:23.158339+0000","last_became_active":"2026-02-23T06:21:18.146977+0000","last_became_peered":"2026-02-23T06:21:18.146977+0000","last_unstale":"2026-02-23T06:21:23.158339+0000","last_undegraded":"2026-02-23T06:21:23.158339+0000","last_fullsized":"2026-02-23T06:21:23.158339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:02:14.013207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156871+0000","last_change":"2026-02-23T06:21:17.139417+0000","last_active":"2026-02-23T06:21:23.156871+0000","last_peered":"2026-02-23T06:21:23.156871+0000","last_clean":"2026-02-23T06:21:23.156871+0000","last_became_active":"2026-02-23T06:21:17.139209+0000","last_became_peered":"2026-02-23T06:21:17.139209+0000","last_unstale":"2026-02-23T06:21:23.156871+0000","last_undegraded":"2026-02-23T06:21:23.156871+0000","last_fullsized":"2026-02-23T06:21:23.156871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:02:19.925669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156792+0000","last_change":"2026-02-23T06:21:22.162912+0000","last_active":"2026-02-23T06:21:23.156792+0000","last_peered":"2026-02-23T06:21:23.156792+0000","last_clean":"2026-02-23T06:21:23.156792+0000","last_became_active":"2026-02-23T06:21:22.162777+0000","last_became_peered":"2026-02-23T06:21:22.162777+0000","last_unstale":"2026-02-23T06:21:23.156792+0000","last_undegraded":"2026-02-23T06:21:23.156792+0000","last_fullsized":"2026-02-23T06:21:23.156792+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:40:10.012263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158597+0000","last_change":"2026-02-23T06:21:18.149281+0000","last_active":"2026-02-23T06:21:23.158597+0000","last_peered":"2026-02-23T06:21:23.158597+0000","last_clean":"2026-02-23T06:21:23.158597+0000","last_became_active":"2026-02-23T06:21:18.149038+0000","last_became_peered":"2026-02-23T06:21:18.149038+0000","last_unstale":"2026-02-23T06:21:23.158597+0000","last_undegraded":"2026-02-23T06:21:23.158597+0000","last_fullsized":"2026-02-23T06:21:23.158597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:57:13.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156819+0000","last_change":"2026-02-23T06:21:17.137649+0000","last_active":"2026-02-23T06:21:23.156819+0000","last_peered":"2026-02-23T06:21:23.156819+0000","last_clean":"2026-02-23T06:21:23.156819+0000","last_became_active":"2026-02-23T06:21:17.137476+0000","last_became_peered":"2026-02-23T06:21:17.137476+0000","last_unstale":"2026-02-23T06:21:23.156819+0000","last_undegraded":"2026-02-23T06:21:23.156819+0000","last_fullsized":"2026-02-23T06:21:23.156819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:47:43.648999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157315+0000","last_change":"2026-02-23T06:21:22.174081+0000","last_active":"2026-02-23T06:21:23.157315+0000","last_peered":"2026-02-23T06:21:23.157315+0000","last_clean":"2026-02-23T06:21:23.157315+0000","last_became_active":"2026-02-23T06:21:22.173501+0000","last_became_peered":"2026-02-23T06:21:22.173501+0000","last_unstale":"2026-02-23T06:21:23.157315+0000","last_undegraded":"2026-02-23T06:21:23.157315+0000","last_fullsized":"2026-02-23T06:21:23.157315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:29:42.370894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159159+0000","last_change":"2026-02-23T06:21:18.155183+0000","last_active":"2026-02-23T06:21:23.159159+0000","last_peered":"2026-02-23T06:21:23.159159+0000","last_clean":"2026-02-23T06:21:23.159159+0000","last_became_active":"2026-02-23T06:21:18.154271+0000","last_became_peered":"2026-02-23T06:21:18.154271+0000","last_unstale":"2026-02-23T06:21:23.159159+0000","last_undegraded":"2026-02-23T06:21:23.159159+0000","last_fullsized":"2026-02-23T06:21:23.159159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:34:53.495073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158641+0000","last_change":"2026-02-23T06:21:17.144988+0000","last_active":"2026-02-23T06:21:23.158641+0000","last_peered":"2026-02-23T06:21:23.158641+0000","last_clean":"2026-02-23T06:21:23.158641+0000","last_became_active":"2026-02-23T06:21:17.144914+0000","last_became_peered":"2026-02-23T06:21:17.144914+0000","last_unstale":"2026-02-23T06:21:23.158641+0000","last_undegraded":"2026-02-23T06:21:23.158641+0000","last_fullsized":"2026-02-23T06:21:23.158641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:20:30.802189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157321+0000","last_change":"2026-02-23T06:21:22.169035+0000","last_active":"2026-02-23T06:21:23.157321+0000","last_peered":"2026-02-23T06:21:23.157321+0000","last_clean":"2026-02-23T06:21:23.157321+0000","last_became_active":"2026-02-23T06:21:22.168516+0000","last_became_peered":"2026-02-23T06:21:22.168516+0000","last_unstale":"2026-02-23T06:21:23.157321+0000","last_undegraded":"2026-02-23T06:21:23.157321+0000","last_fullsized":"2026-02-23T06:21:23.157321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:53:53.761208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157305+0000","last_change":"2026-02-23T06:21:18.152543+0000","last_active":"2026-02-23T06:21:23.157305+0000","last_peered":"2026-02-23T06:21:23.157305+0000","last_clean":"2026-02-23T06:21:23.157305+0000","last_became_active":"2026-02-23T06:21:18.152381+0000","last_became_peered":"2026-02-23T06:21:18.152381+0000","last_unstale":"2026-02-23T06:21:23.157305+0000","last_undegraded":"2026-02-23T06:21:23.157305+0000","last_fullsized":"2026-02-23T06:21:23.157305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:20:11.159653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156443+0000","last_change":"2026-02-23T06:21:17.137277+0000","last_active":"2026-02-23T06:21:23.156443+0000","last_peered":"2026-02-23T06:21:23.156443+0000","last_clean":"2026-02-23T06:21:23.156443+0000","last_became_active":"2026-02-23T06:21:17.137101+0000","last_became_peered":"2026-02-23T06:21:17.137101+0000","last_unstale":"2026-02-23T06:21:23.156443+0000","last_undegraded":"2026-02-23T06:21:23.156443+0000","last_fullsized":"2026-02-23T06:21:23.156443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:26:19.732037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157108+0000","last_change":"2026-02-23T06:21:22.168965+0000","last_active":"2026-02-23T06:21:23.157108+0000","last_peered":"2026-02-23T06:21:23.157108+0000","last_clean":"2026-02-23T06:21:23.157108+0000","last_became_active":"2026-02-23T06:21:22.168603+0000","last_became_peered":"2026-02-23T06:21:22.168603+0000","last_unstale":"2026-02-23T06:21:23.157108+0000","last_undegraded":"2026-02-23T06:21:23.157108+0000","last_fullsized":"2026-02-23T06:21:23.157108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:15:47.100236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157608+0000","last_change":"2026-02-23T06:21:18.143842+0000","last_active":"2026-02-23T06:21:23.157608+0000","last_peered":"2026-02-23T06:21:23.157608+0000","last_clean":"2026-02-23T06:21:23.157608+0000","last_became_active":"2026-02-23T06:21:18.143002+0000","last_became_peered":"2026-02-23T06:21:18.143002+0000","last_unstale":"2026-02-23T06:21:23.157608+0000","last_undegraded":"2026-02-23T06:21:23.157608+0000","last_fullsized":"2026-02-23T06:21:23.157608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:04:36.461970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157835+0000","last_change":"2026-02-23T06:21:17.143842+0000","last_active":"2026-02-23T06:21:23.157835+0000","last_peered":"2026-02-23T06:21:23.157835+0000","last_clean":"2026-02-23T06:21:23.157835+0000","last_became_active":"2026-02-23T06:21:17.143700+0000","last_became_peered":"2026-02-23T06:21:17.143700+0000","last_unstale":"2026-02-23T06:21:23.157835+0000","last_undegraded":"2026-02-23T06:21:23.157835+0000","last_fullsized":"2026-02-23T06:21:23.157835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:14:07.166043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157290+0000","last_change":"2026-02-23T06:21:22.168834+0000","last_active":"2026-02-23T06:21:23.157290+0000","last_peered":"2026-02-23T06:21:23.157290+0000","last_clean":"2026-02-23T06:21:23.157290+0000","last_became_active":"2026-02-23T06:21:22.168593+0000","last_became_peered":"2026-02-23T06:21:22.168593+0000","last_unstale":"2026-02-23T06:21:23.157290+0000","last_undegraded":"2026-02-23T06:21:23.157290+0000","last_fullsized":"2026-02-23T06:21:23.157290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:15:01.999978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157649+0000","last_change":"2026-02-23T06:21:18.155135+0000","last_active":"2026-02-23T06:21:23.157649+0000","last_peered":"2026-02-23T06:21:23.157649+0000","last_clean":"2026-02-23T06:21:23.157649+0000","last_became_active":"2026-02-23T06:21:18.155022+0000","last_became_peered":"2026-02-23T06:21:18.155022+0000","last_unstale":"2026-02-23T06:21:23.157649+0000","last_undegraded":"2026-02-23T06:21:23.157649+0000","last_fullsized":"2026-02-23T06:21:23.157649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:50.396096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157857+0000","last_change":"2026-02-23T06:21:17.144113+0000","last_active":"2026-02-23T06:21:23.157857+0000","last_peered":"2026-02-23T06:21:23.157857+0000","last_clean":"2026-02-23T06:21:23.157857+0000","last_became_active":"2026-02-23T06:21:17.144052+0000","last_became_peered":"2026-02-23T06:21:17.144052+0000","last_unstale":"2026-02-23T06:21:23.157857+0000","last_undegraded":"2026-02-23T06:21:23.157857+0000","last_fullsized":"2026-02-23T06:21:23.157857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:52:50.479411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157276+0000","last_change":"2026-02-23T06:21:22.163712+0000","last_active":"2026-02-23T06:21:23.157276+0000","last_peered":"2026-02-23T06:21:23.157276+0000","last_clean":"2026-02-23T06:21:23.157276+0000","last_became_active":"2026-02-23T06:21:22.163563+0000","last_became_peered":"2026-02-23T06:21:22.163563+0000","last_unstale":"2026-02-23T06:21:23.157276+0000","last_undegraded":"2026-02-23T06:21:23.157276+0000","last_fullsized":"2026-02-23T06:21:23.157276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:58:44.301443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157241+0000","last_change":"2026-02-23T06:21:18.152736+0000","last_active":"2026-02-23T06:21:23.157241+0000","last_peered":"2026-02-23T06:21:23.157241+0000","last_clean":"2026-02-23T06:21:23.157241+0000","last_became_active":"2026-02-23T06:21:18.152627+0000","last_became_peered":"2026-02-23T06:21:18.152627+0000","last_unstale":"2026-02-23T06:21:23.157241+0000","last_undegraded":"2026-02-23T06:21:23.157241+0000","last_fullsized":"2026-02-23T06:21:23.157241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:26:04.233805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156590+0000","last_change":"2026-02-23T06:21:17.144924+0000","last_active":"2026-02-23T06:21:23.156590+0000","last_peered":"2026-02-23T06:21:23.156590+0000","last_clean":"2026-02-23T06:21:23.156590+0000","last_became_active":"2026-02-23T06:21:17.144847+0000","last_became_peered":"2026-02-23T06:21:17.144847+0000","last_unstale":"2026-02-23T06:21:23.156590+0000","last_undegraded":"2026-02-23T06:21:23.156590+0000","last_fullsized":"2026-02-23T06:21:23.156590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:09:16.703922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159051+0000","last_change":"2026-02-23T06:21:22.164167+0000","last_active":"2026-02-23T06:21:23.159051+0000","last_peered":"2026-02-23T06:21:23.159051+0000","last_clean":"2026-02-23T06:21:23.159051+0000","last_became_active":"2026-02-23T06:21:22.164057+0000","last_became_peered":"2026-02-23T06:21:22.164057+0000","last_unstale":"2026-02-23T06:21:23.159051+0000","last_undegraded":"2026-02-23T06:21:23.159051+0000","last_fullsized":"2026-02-23T06:21:23.159051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:19:45.888728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158866+0000","last_change":"2026-02-23T06:21:18.148382+0000","last_active":"2026-02-23T06:21:23.158866+0000","last_peered":"2026-02-23T06:21:23.158866+0000","last_clean":"2026-02-23T06:21:23.158866+0000","last_became_active":"2026-02-23T06:21:18.147826+0000","last_became_peered":"2026-02-23T06:21:18.147826+0000","last_unstale":"2026-02-23T06:21:23.158866+0000","last_undegraded":"2026-02-23T06:21:23.158866+0000","last_fullsized":"2026-02-23T06:21:23.158866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:52:32.524186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"24'6","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158401+0000","last_change":"2026-02-23T06:21:17.151131+0000","last_active":"2026-02-23T06:21:23.158401+0000","last_peered":"2026-02-23T06:21:23.158401+0000","last_clean":"2026-02-23T06:21:23.158401+0000","last_became_active":"2026-02-23T06:21:17.151030+0000","last_became_peered":"2026-02-23T06:21:17.151030+0000","last_unstale":"2026-02-23T06:21:23.158401+0000","last_undegraded":"2026-02-23T06:21:23.158401+0000","last_fullsized":"2026-02-23T06:21:23.158401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:19:57.049773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1634,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156776+0000","last_change":"2026-02-23T06:21:22.165171+0000","last_active":"2026-02-23T06:21:23.156776+0000","last_peered":"2026-02-23T06:21:23.156776+0000","last_clean":"2026-02-23T06:21:23.156776+0000","last_became_active":"2026-02-23T06:21:22.164972+0000","last_became_peered":"2026-02-23T06:21:22.164972+0000","last_unstale":"2026-02-23T06:21:23.156776+0000","last_undegraded":"2026-02-23T06:21:23.156776+0000","last_fullsized":"2026-02-23T06:21:23.156776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:58:26.519641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157682+0000","last_change":"2026-02-23T06:21:18.153296+0000","last_active":"2026-02-23T06:21:23.157682+0000","last_peered":"2026-02-23T06:21:23.157682+0000","last_clean":"2026-02-23T06:21:23.157682+0000","last_became_active":"2026-02-23T06:21:18.153052+0000","last_became_peered":"2026-02-23T06:21:18.153052+0000","last_unstale":"2026-02-23T06:21:23.157682+0000","last_undegraded":"2026-02-23T06:21:23.157682+0000","last_fullsized":"2026-02-23T06:21:23.157682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:38:32.662334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156686+0000","last_change":"2026-02-23T06:21:17.137568+0000","last_active":"2026-02-23T06:21:23.156686+0000","last_peered":"2026-02-23T06:21:23.156686+0000","last_clean":"2026-02-23T06:21:23.156686+0000","last_became_active":"2026-02-23T06:21:17.137479+0000","last_became_peered":"2026-02-23T06:21:17.137479+0000","last_unstale":"2026-02-23T06:21:23.156686+0000","last_undegraded":"2026-02-23T06:21:23.156686+0000","last_fullsized":"2026-02-23T06:21:23.156686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:50:22.850887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158615+0000","last_change":"2026-02-23T06:21:22.175837+0000","last_active":"2026-02-23T06:21:23.158615+0000","last_peered":"2026-02-23T06:21:23.158615+0000","last_clean":"2026-02-23T06:21:23.158615+0000","last_became_active":"2026-02-23T06:21:22.175638+0000","last_became_peered":"2026-02-23T06:21:22.175638+0000","last_unstale":"2026-02-23T06:21:23.158615+0000","last_undegraded":"2026-02-23T06:21:23.158615+0000","last_fullsized":"2026-02-23T06:21:23.158615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:24:39.312650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157339+0000","last_change":"2026-02-23T06:21:18.155473+0000","last_active":"2026-02-23T06:21:23.157339+0000","last_peered":"2026-02-23T06:21:23.157339+0000","last_clean":"2026-02-23T06:21:23.157339+0000","last_became_active":"2026-02-23T06:21:18.155349+0000","last_became_peered":"2026-02-23T06:21:18.155349+0000","last_unstale":"2026-02-23T06:21:23.157339+0000","last_undegraded":"2026-02-23T06:21:23.157339+0000","last_fullsized":"2026-02-23T06:21:23.157339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:20:20.345986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158459+0000","last_change":"2026-02-23T06:21:17.148953+0000","last_active":"2026-02-23T06:21:23.158459+0000","last_peered":"2026-02-23T06:21:23.158459+0000","last_clean":"2026-02-23T06:21:23.158459+0000","last_became_active":"2026-02-23T06:21:17.148841+0000","last_became_peered":"2026-02-23T06:21:17.148841+0000","last_unstale":"2026-02-23T06:21:23.158459+0000","last_undegraded":"2026-02-23T06:21:23.158459+0000","last_fullsized":"2026-02-23T06:21:23.158459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:48:14.620108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156366+0000","last_change":"2026-02-23T06:21:22.172897+0000","last_active":"2026-02-23T06:21:23.156366+0000","last_peered":"2026-02-23T06:21:23.156366+0000","last_clean":"2026-02-23T06:21:23.156366+0000","last_became_active":"2026-02-23T06:21:22.172683+0000","last_became_peered":"2026-02-23T06:21:22.172683+0000","last_unstale":"2026-02-23T06:21:23.156366+0000","last_undegraded":"2026-02-23T06:21:23.156366+0000","last_fullsized":"2026-02-23T06:21:23.156366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:17:41.991286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159118+0000","last_change":"2026-02-23T06:21:18.154897+0000","last_active":"2026-02-23T06:21:23.159118+0000","last_peered":"2026-02-23T06:21:23.159118+0000","last_clean":"2026-02-23T06:21:23.159118+0000","last_became_active":"2026-02-23T06:21:18.154586+0000","last_became_peered":"2026-02-23T06:21:18.154586+0000","last_unstale":"2026-02-23T06:21:23.159118+0000","last_undegraded":"2026-02-23T06:21:23.159118+0000","last_fullsized":"2026-02-23T06:21:23.159118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:22:13.361673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158486+0000","last_change":"2026-02-23T06:21:17.140774+0000","last_active":"2026-02-23T06:21:23.158486+0000","last_peered":"2026-02-23T06:21:23.158486+0000","last_clean":"2026-02-23T06:21:23.158486+0000","last_became_active":"2026-02-23T06:21:17.140699+0000","last_became_peered":"2026-02-23T06:21:17.140699+0000","last_unstale":"2026-02-23T06:21:23.158486+0000","last_undegraded":"2026-02-23T06:21:23.158486+0000","last_fullsized":"2026-02-23T06:21:23.158486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:59:47.987932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156705+0000","last_change":"2026-02-23T06:21:22.166371+0000","last_active":"2026-02-23T06:21:23.156705+0000","last_peered":"2026-02-23T06:21:23.156705+0000","last_clean":"2026-02-23T06:21:23.156705+0000","last_became_active":"2026-02-23T06:21:22.166204+0000","last_became_peered":"2026-02-23T06:21:22.166204+0000","last_unstale":"2026-02-23T06:21:23.156705+0000","last_undegraded":"2026-02-23T06:21:23.156705+0000","last_fullsized":"2026-02-23T06:21:23.156705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:50:51.116428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156852+0000","last_change":"2026-02-23T06:21:22.167411+0000","last_active":"2026-02-23T06:21:23.156852+0000","last_peered":"2026-02-23T06:21:23.156852+0000","last_clean":"2026-02-23T06:21:23.156852+0000","last_became_active":"2026-02-23T06:21:22.167217+0000","last_became_peered":"2026-02-23T06:21:22.167217+0000","last_unstale":"2026-02-23T06:21:23.156852+0000","last_undegraded":"2026-02-23T06:21:23.156852+0000","last_fullsized":"2026-02-23T06:21:23.156852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:20:54.687551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156512+0000","last_change":"2026-02-23T06:21:18.146043+0000","last_active":"2026-02-23T06:21:23.156512+0000","last_peered":"2026-02-23T06:21:23.156512+0000","last_clean":"2026-02-23T06:21:23.156512+0000","last_became_active":"2026-02-23T06:21:18.145938+0000","last_became_peered":"2026-02-23T06:21:18.145938+0000","last_unstale":"2026-02-23T06:21:23.156512+0000","last_undegraded":"2026-02-23T06:21:23.156512+0000","last_fullsized":"2026-02-23T06:21:23.156512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:03:21.252772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157446+0000","last_change":"2026-02-23T06:21:17.149581+0000","last_active":"2026-02-23T06:21:23.157446+0000","last_peered":"2026-02-23T06:21:23.157446+0000","last_clean":"2026-02-23T06:21:23.157446+0000","last_became_active":"2026-02-23T06:21:17.149490+0000","last_became_peered":"2026-02-23T06:21:17.149490+0000","last_unstale":"2026-02-23T06:21:23.157446+0000","last_undegraded":"2026-02-23T06:21:23.157446+0000","last_fullsized":"2026-02-23T06:21:23.157446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:18:42.211307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158840+0000","last_change":"2026-02-23T06:21:22.175655+0000","last_active":"2026-02-23T06:21:23.158840+0000","last_peered":"2026-02-23T06:21:23.158840+0000","last_clean":"2026-02-23T06:21:23.158840+0000","last_became_active":"2026-02-23T06:21:22.174906+0000","last_became_peered":"2026-02-23T06:21:22.174906+0000","last_unstale":"2026-02-23T06:21:23.158840+0000","last_undegraded":"2026-02-23T06:21:23.158840+0000","last_fullsized":"2026-02-23T06:21:23.158840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:50:34.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156556+0000","last_change":"2026-02-23T06:21:18.142560+0000","last_active":"2026-02-23T06:21:23.156556+0000","last_peered":"2026-02-23T06:21:23.156556+0000","last_clean":"2026-02-23T06:21:23.156556+0000","last_became_active":"2026-02-23T06:21:18.142325+0000","last_became_peered":"2026-02-23T06:21:18.142325+0000","last_unstale":"2026-02-23T06:21:23.156556+0000","last_undegraded":"2026-02-23T06:21:23.156556+0000","last_fullsized":"2026-02-23T06:21:23.156556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:45:44.641652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156988+0000","last_change":"2026-02-23T06:21:17.146195+0000","last_active":"2026-02-23T06:21:23.156988+0000","last_peered":"2026-02-23T06:21:23.156988+0000","last_clean":"2026-02-23T06:21:23.156988+0000","last_became_active":"2026-02-23T06:21:17.146022+0000","last_became_peered":"2026-02-23T06:21:17.146022+0000","last_unstale":"2026-02-23T06:21:23.156988+0000","last_undegraded":"2026-02-23T06:21:23.156988+0000","last_fullsized":"2026-02-23T06:21:23.156988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:34:32.822540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157689+0000","last_change":"2026-02-23T06:21:17.148590+0000","last_active":"2026-02-23T06:21:23.157689+0000","last_peered":"2026-02-23T06:21:23.157689+0000","last_clean":"2026-02-23T06:21:23.157689+0000","last_became_active":"2026-02-23T06:21:17.148417+0000","last_became_peered":"2026-02-23T06:21:17.148417+0000","last_unstale":"2026-02-23T06:21:23.157689+0000","last_undegraded":"2026-02-23T06:21:23.157689+0000","last_fullsized":"2026-02-23T06:21:23.157689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:21:11.877590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156606+0000","last_change":"2026-02-23T06:21:18.152383+0000","last_active":"2026-02-23T06:21:23.156606+0000","last_peered":"2026-02-23T06:21:23.156606+0000","last_clean":"2026-02-23T06:21:23.156606+0000","last_became_active":"2026-02-23T06:21:18.152267+0000","last_became_peered":"2026-02-23T06:21:18.152267+0000","last_unstale":"2026-02-23T06:21:23.156606+0000","last_undegraded":"2026-02-23T06:21:23.156606+0000","last_fullsized":"2026-02-23T06:21:23.156606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:34:11.558509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156801+0000","last_change":"2026-02-23T06:21:22.158812+0000","last_active":"2026-02-23T06:21:23.156801+0000","last_peered":"2026-02-23T06:21:23.156801+0000","last_clean":"2026-02-23T06:21:23.156801+0000","last_became_active":"2026-02-23T06:21:22.158607+0000","last_became_peered":"2026-02-23T06:21:22.158607+0000","last_unstale":"2026-02-23T06:21:23.156801+0000","last_undegraded":"2026-02-23T06:21:23.156801+0000","last_fullsized":"2026-02-23T06:21:23.156801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:59:07.000053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156780+0000","last_change":"2026-02-23T06:21:17.138744+0000","last_active":"2026-02-23T06:21:23.156780+0000","last_peered":"2026-02-23T06:21:23.156780+0000","last_clean":"2026-02-23T06:21:23.156780+0000","last_became_active":"2026-02-23T06:21:17.138245+0000","last_became_peered":"2026-02-23T06:21:17.138245+0000","last_unstale":"2026-02-23T06:21:23.156780+0000","last_undegraded":"2026-02-23T06:21:23.156780+0000","last_fullsized":"2026-02-23T06:21:23.156780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:08:03.143401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157483+0000","last_change":"2026-02-23T06:21:18.143640+0000","last_active":"2026-02-23T06:21:23.157483+0000","last_peered":"2026-02-23T06:21:23.157483+0000","last_clean":"2026-02-23T06:21:23.157483+0000","last_became_active":"2026-02-23T06:21:18.143550+0000","last_became_peered":"2026-02-23T06:21:18.143550+0000","last_unstale":"2026-02-23T06:21:23.157483+0000","last_undegraded":"2026-02-23T06:21:23.157483+0000","last_fullsized":"2026-02-23T06:21:23.157483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:11:40.394042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156644+0000","last_change":"2026-02-23T06:21:22.169641+0000","last_active":"2026-02-23T06:21:23.156644+0000","last_peered":"2026-02-23T06:21:23.156644+0000","last_clean":"2026-02-23T06:21:23.156644+0000","last_became_active":"2026-02-23T06:21:22.169432+0000","last_became_peered":"2026-02-23T06:21:22.169432+0000","last_unstale":"2026-02-23T06:21:23.156644+0000","last_undegraded":"2026-02-23T06:21:23.156644+0000","last_fullsized":"2026-02-23T06:21:23.156644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:00:17.622113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158222+0000","last_change":"2026-02-23T06:21:18.143781+0000","last_active":"2026-02-23T06:21:23.158222+0000","last_peered":"2026-02-23T06:21:23.158222+0000","last_clean":"2026-02-23T06:21:23.158222+0000","last_became_active":"2026-02-23T06:21:18.143724+0000","last_became_peered":"2026-02-23T06:21:18.143724+0000","last_unstale":"2026-02-23T06:21:23.158222+0000","last_undegraded":"2026-02-23T06:21:23.158222+0000","last_fullsized":"2026-02-23T06:21:23.158222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:25:55.416021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156366+0000","last_change":"2026-02-23T06:21:18.145425+0000","last_active":"2026-02-23T06:21:23.156366+0000","last_peered":"2026-02-23T06:21:23.156366+0000","last_clean":"2026-02-23T06:21:23.156366+0000","last_became_active":"2026-02-23T06:21:18.145325+0000","last_became_peered":"2026-02-23T06:21:18.145325+0000","last_unstale":"2026-02-23T06:21:23.156366+0000","last_undegraded":"2026-02-23T06:21:23.156366+0000","last_fullsized":"2026-02-23T06:21:23.156366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:55:31.700518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157544+0000","last_change":"2026-02-23T06:21:18.150997+0000","last_active":"2026-02-23T06:21:23.157544+0000","last_peered":"2026-02-23T06:21:23.157544+0000","last_clean":"2026-02-23T06:21:23.157544+0000","last_became_active":"2026-02-23T06:21:18.150738+0000","last_became_peered":"2026-02-23T06:21:18.150738+0000","last_unstale":"2026-02-23T06:21:23.157544+0000","last_undegraded":"2026-02-23T06:21:23.157544+0000","last_fullsized":"2026-02-23T06:21:23.157544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:11:13.400669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156727+0000","last_change":"2026-02-23T06:21:18.142305+0000","last_active":"2026-02-23T06:21:23.156727+0000","last_peered":"2026-02-23T06:21:23.156727+0000","last_clean":"2026-02-23T06:21:23.156727+0000","last_became_active":"2026-02-23T06:21:18.141484+0000","last_became_peered":"2026-02-23T06:21:18.141484+0000","last_unstale":"2026-02-23T06:21:23.156727+0000","last_undegraded":"2026-02-23T06:21:23.156727+0000","last_fullsized":"2026-02-23T06:21:23.156727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:12:36.003405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157376+0000","last_change":"2026-02-23T06:21:18.148610+0000","last_active":"2026-02-23T06:21:23.157376+0000","last_peered":"2026-02-23T06:21:23.157376+0000","last_clean":"2026-02-23T06:21:23.157376+0000","last_became_active":"2026-02-23T06:21:18.148489+0000","last_became_peered":"2026-02-23T06:21:18.148489+0000","last_unstale":"2026-02-23T06:21:23.157376+0000","last_undegraded":"2026-02-23T06:21:23.157376+0000","last_fullsized":"2026-02-23T06:21:23.157376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:36:29.486147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157279+0000","last_change":"2026-02-23T06:21:18.142438+0000","last_active":"2026-02-23T06:21:23.157279+0000","last_peered":"2026-02-23T06:21:23.157279+0000","last_clean":"2026-02-23T06:21:23.157279+0000","last_became_active":"2026-02-23T06:21:18.141854+0000","last_became_peered":"2026-02-23T06:21:18.141854+0000","last_unstale":"2026-02-23T06:21:23.157279+0000","last_undegraded":"2026-02-23T06:21:23.157279+0000","last_fullsized":"2026-02-23T06:21:23.157279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:23:35.379462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159075+0000","last_change":"2026-02-23T06:21:18.153825+0000","last_active":"2026-02-23T06:21:23.159075+0000","last_peered":"2026-02-23T06:21:23.159075+0000","last_clean":"2026-02-23T06:21:23.159075+0000","last_became_active":"2026-02-23T06:21:18.153133+0000","last_became_peered":"2026-02-23T06:21:18.153133+0000","last_unstale":"2026-02-23T06:21:23.159075+0000","last_undegraded":"2026-02-23T06:21:23.159075+0000","last_fullsized":"2026-02-23T06:21:23.159075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:15:03.662362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157187+0000","last_change":"2026-02-23T06:21:18.144945+0000","last_active":"2026-02-23T06:21:23.157187+0000","last_peered":"2026-02-23T06:21:23.157187+0000","last_clean":"2026-02-23T06:21:23.157187+0000","last_became_active":"2026-02-23T06:21:18.144832+0000","last_became_peered":"2026-02-23T06:21:18.144832+0000","last_unstale":"2026-02-23T06:21:23.157187+0000","last_undegraded":"2026-02-23T06:21:23.157187+0000","last_fullsized":"2026-02-23T06:21:23.157187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:41:07.968870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157406+0000","last_change":"2026-02-23T06:21:18.150652+0000","last_active":"2026-02-23T06:21:23.157406+0000","last_peered":"2026-02-23T06:21:23.157406+0000","last_clean":"2026-02-23T06:21:23.157406+0000","last_became_active":"2026-02-23T06:21:18.150489+0000","last_became_peered":"2026-02-23T06:21:18.150489+0000","last_unstale":"2026-02-23T06:21:23.157406+0000","last_undegraded":"2026-02-23T06:21:23.157406+0000","last_fullsized":"2026-02-23T06:21:23.157406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:42:35.233149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156538+0000","last_change":"2026-02-23T06:21:18.143636+0000","last_active":"2026-02-23T06:21:23.156538+0000","last_peered":"2026-02-23T06:21:23.156538+0000","last_clean":"2026-02-23T06:21:23.156538+0000","last_became_active":"2026-02-23T06:21:18.143495+0000","last_became_peered":"2026-02-23T06:21:18.143495+0000","last_unstale":"2026-02-23T06:21:23.156538+0000","last_undegraded":"2026-02-23T06:21:23.156538+0000","last_fullsized":"2026-02-23T06:21:23.156538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:47:19.057181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157427+0000","last_change":"2026-02-23T06:21:18.148787+0000","last_active":"2026-02-23T06:21:23.157427+0000","last_peered":"2026-02-23T06:21:23.157427+0000","last_clean":"2026-02-23T06:21:23.157427+0000","last_became_active":"2026-02-23T06:21:18.148701+0000","last_became_peered":"2026-02-23T06:21:18.148701+0000","last_unstale":"2026-02-23T06:21:23.157427+0000","last_undegraded":"2026-02-23T06:21:23.157427+0000","last_fullsized":"2026-02-23T06:21:23.157427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:19:32.878202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156524+0000","last_change":"2026-02-23T06:21:18.145498+0000","last_active":"2026-02-23T06:21:23.156524+0000","last_peered":"2026-02-23T06:21:23.156524+0000","last_clean":"2026-02-23T06:21:23.156524+0000","last_became_active":"2026-02-23T06:21:18.145346+0000","last_became_peered":"2026-02-23T06:21:18.145346+0000","last_unstale":"2026-02-23T06:21:23.156524+0000","last_undegraded":"2026-02-23T06:21:23.156524+0000","last_fullsized":"2026-02-23T06:21:23.156524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:44:15.203843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158314+0000","last_change":"2026-02-23T06:21:18.147453+0000","last_active":"2026-02-23T06:21:23.158314+0000","last_peered":"2026-02-23T06:21:23.158314+0000","last_clean":"2026-02-23T06:21:23.158314+0000","last_became_active":"2026-02-23T06:21:18.147357+0000","last_became_peered":"2026-02-23T06:21:18.147357+0000","last_unstale":"2026-02-23T06:21:23.158314+0000","last_undegraded":"2026-02-23T06:21:23.158314+0000","last_fullsized":"2026-02-23T06:21:23.158314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:41:05.063786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159167+0000","last_change":"2026-02-23T06:21:18.151381+0000","last_active":"2026-02-23T06:21:23.159167+0000","last_peered":"2026-02-23T06:21:23.159167+0000","last_clean":"2026-02-23T06:21:23.159167+0000","last_became_active":"2026-02-23T06:21:18.151269+0000","last_became_peered":"2026-02-23T06:21:18.151269+0000","last_unstale":"2026-02-23T06:21:23.159167+0000","last_undegraded":"2026-02-23T06:21:23.159167+0000","last_fullsized":"2026-02-23T06:21:23.159167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:50:46.152385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156748+0000","last_change":"2026-02-23T06:21:18.148411+0000","last_active":"2026-02-23T06:21:23.156748+0000","last_peered":"2026-02-23T06:21:23.156748+0000","last_clean":"2026-02-23T06:21:23.156748+0000","last_became_active":"2026-02-23T06:21:18.148262+0000","last_became_peered":"2026-02-23T06:21:18.148262+0000","last_unstale":"2026-02-23T06:21:23.156748+0000","last_undegraded":"2026-02-23T06:21:23.156748+0000","last_fullsized":"2026-02-23T06:21:23.156748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:09:54.723244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158936+0000","last_change":"2026-02-23T06:21:18.155275+0000","last_active":"2026-02-23T06:21:23.158936+0000","last_peered":"2026-02-23T06:21:23.158936+0000","last_clean":"2026-02-23T06:21:23.158936+0000","last_became_active":"2026-02-23T06:21:18.155214+0000","last_became_peered":"2026-02-23T06:21:18.155214+0000","last_unstale":"2026-02-23T06:21:23.158936+0000","last_undegraded":"2026-02-23T06:21:23.158936+0000","last_fullsized":"2026-02-23T06:21:23.158936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:44:47.367234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157370+0000","last_change":"2026-02-23T06:21:18.153381+0000","last_active":"2026-02-23T06:21:23.157370+0000","last_peered":"2026-02-23T06:21:23.157370+0000","last_clean":"2026-02-23T06:21:23.157370+0000","last_became_active":"2026-02-23T06:21:18.152456+0000","last_became_peered":"2026-02-23T06:21:18.152456+0000","last_unstale":"2026-02-23T06:21:23.157370+0000","last_undegraded":"2026-02-23T06:21:23.157370+0000","last_fullsized":"2026-02-23T06:21:23.157370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:14:46.231331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156471+0000","last_change":"2026-02-23T06:21:18.148599+0000","last_active":"2026-02-23T06:21:23.156471+0000","last_peered":"2026-02-23T06:21:23.156471+0000","last_clean":"2026-02-23T06:21:23.156471+0000","last_became_active":"2026-02-23T06:21:18.148498+0000","last_became_peered":"2026-02-23T06:21:18.148498+0000","last_unstale":"2026-02-23T06:21:23.156471+0000","last_undegraded":"2026-02-23T06:21:23.156471+0000","last_fullsized":"2026-02-23T06:21:23.156471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:05:56.074928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157128+0000","last_change":"2026-02-23T06:21:18.142621+0000","last_active":"2026-02-23T06:21:23.157128+0000","last_peered":"2026-02-23T06:21:23.157128+0000","last_clean":"2026-02-23T06:21:23.157128+0000","last_became_active":"2026-02-23T06:21:18.141938+0000","last_became_peered":"2026-02-23T06:21:18.141938+0000","last_unstale":"2026-02-23T06:21:23.157128+0000","last_undegraded":"2026-02-23T06:21:23.157128+0000","last_fullsized":"2026-02-23T06:21:23.157128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:25:55.390738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157141+0000","last_change":"2026-02-23T06:21:18.153183+0000","last_active":"2026-02-23T06:21:23.157141+0000","last_peered":"2026-02-23T06:21:23.157141+0000","last_clean":"2026-02-23T06:21:23.157141+0000","last_became_active":"2026-02-23T06:21:18.153090+0000","last_became_peered":"2026-02-23T06:21:18.153090+0000","last_unstale":"2026-02-23T06:21:23.157141+0000","last_undegraded":"2026-02-23T06:21:23.157141+0000","last_fullsized":"2026-02-23T06:21:23.157141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:26:17.749612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158286+0000","last_change":"2026-02-23T06:21:18.148055+0000","last_active":"2026-02-23T06:21:23.158286+0000","last_peered":"2026-02-23T06:21:23.158286+0000","last_clean":"2026-02-23T06:21:23.158286+0000","last_became_active":"2026-02-23T06:21:18.147956+0000","last_became_peered":"2026-02-23T06:21:18.147956+0000","last_unstale":"2026-02-23T06:21:23.158286+0000","last_undegraded":"2026-02-23T06:21:23.158286+0000","last_fullsized":"2026-02-23T06:21:23.158286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:22:55.028859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158650+0000","last_change":"2026-02-23T06:21:18.155576+0000","last_active":"2026-02-23T06:21:23.158650+0000","last_peered":"2026-02-23T06:21:23.158650+0000","last_clean":"2026-02-23T06:21:23.158650+0000","last_became_active":"2026-02-23T06:21:18.155130+0000","last_became_peered":"2026-02-23T06:21:18.155130+0000","last_unstale":"2026-02-23T06:21:23.158650+0000","last_undegraded":"2026-02-23T06:21:23.158650+0000","last_fullsized":"2026-02-23T06:21:23.158650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:43:12.801427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158425+0000","last_change":"2026-02-23T06:21:18.152980+0000","last_active":"2026-02-23T06:21:23.158425+0000","last_peered":"2026-02-23T06:21:23.158425+0000","last_clean":"2026-02-23T06:21:23.158425+0000","last_became_active":"2026-02-23T06:21:18.152790+0000","last_became_peered":"2026-02-23T06:21:18.152790+0000","last_unstale":"2026-02-23T06:21:23.158425+0000","last_undegraded":"2026-02-23T06:21:23.158425+0000","last_fullsized":"2026-02-23T06:21:23.158425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:33:09.398040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158457+0000","last_change":"2026-02-23T06:21:18.155247+0000","last_active":"2026-02-23T06:21:23.158457+0000","last_peered":"2026-02-23T06:21:23.158457+0000","last_clean":"2026-02-23T06:21:23.158457+0000","last_became_active":"2026-02-23T06:21:18.155122+0000","last_became_peered":"2026-02-23T06:21:18.155122+0000","last_unstale":"2026-02-23T06:21:23.158457+0000","last_undegraded":"2026-02-23T06:21:23.158457+0000","last_fullsized":"2026-02-23T06:21:23.158457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:45:08.775934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156432+0000","last_change":"2026-02-23T06:21:18.151259+0000","last_active":"2026-02-23T06:21:23.156432+0000","last_peered":"2026-02-23T06:21:23.156432+0000","last_clean":"2026-02-23T06:21:23.156432+0000","last_became_active":"2026-02-23T06:21:18.151151+0000","last_became_peered":"2026-02-23T06:21:18.151151+0000","last_unstale":"2026-02-23T06:21:23.156432+0000","last_undegraded":"2026-02-23T06:21:23.156432+0000","last_fullsized":"2026-02-23T06:21:23.156432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:08:03.361054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157811+0000","last_change":"2026-02-23T06:21:18.146606+0000","last_active":"2026-02-23T06:21:23.157811+0000","last_peered":"2026-02-23T06:21:23.157811+0000","last_clean":"2026-02-23T06:21:23.157811+0000","last_became_active":"2026-02-23T06:21:18.146527+0000","last_became_peered":"2026-02-23T06:21:18.146527+0000","last_unstale":"2026-02-23T06:21:23.157811+0000","last_undegraded":"2026-02-23T06:21:23.157811+0000","last_fullsized":"2026-02-23T06:21:23.157811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:30:44.739034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158602+0000","last_change":"2026-02-23T06:21:18.145872+0000","last_active":"2026-02-23T06:21:23.158602+0000","last_peered":"2026-02-23T06:21:23.158602+0000","last_clean":"2026-02-23T06:21:23.158602+0000","last_became_active":"2026-02-23T06:21:18.145770+0000","last_became_peered":"2026-02-23T06:21:18.145770+0000","last_unstale":"2026-02-23T06:21:23.158602+0000","last_undegraded":"2026-02-23T06:21:23.158602+0000","last_fullsized":"2026-02-23T06:21:23.158602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:21:28.063960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158049+0000","last_change":"2026-02-23T06:21:18.152478+0000","last_active":"2026-02-23T06:21:23.158049+0000","last_peered":"2026-02-23T06:21:23.158049+0000","last_clean":"2026-02-23T06:21:23.158049+0000","last_became_active":"2026-02-23T06:21:18.151948+0000","last_became_peered":"2026-02-23T06:21:18.151948+0000","last_unstale":"2026-02-23T06:21:23.158049+0000","last_undegraded":"2026-02-23T06:21:23.158049+0000","last_fullsized":"2026-02-23T06:21:23.158049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:58:02.829593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158363+0000","last_change":"2026-02-23T06:21:18.144778+0000","last_active":"2026-02-23T06:21:23.158363+0000","last_peered":"2026-02-23T06:21:23.158363+0000","last_clean":"2026-02-23T06:21:23.158363+0000","last_became_active":"2026-02-23T06:21:18.144346+0000","last_became_peered":"2026-02-23T06:21:18.144346+0000","last_unstale":"2026-02-23T06:21:23.158363+0000","last_undegraded":"2026-02-23T06:21:23.158363+0000","last_fullsized":"2026-02-23T06:21:23.158363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:25:27.650673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156824+0000","last_change":"2026-02-23T06:21:18.141648+0000","last_active":"2026-02-23T06:21:23.156824+0000","last_peered":"2026-02-23T06:21:23.156824+0000","last_clean":"2026-02-23T06:21:23.156824+0000","last_became_active":"2026-02-23T06:21:18.141449+0000","last_became_peered":"2026-02-23T06:21:18.141449+0000","last_unstale":"2026-02-23T06:21:23.156824+0000","last_undegraded":"2026-02-23T06:21:23.156824+0000","last_fullsized":"2026-02-23T06:21:23.156824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:33:18.986892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157020+0000","last_change":"2026-02-23T06:21:18.142536+0000","last_active":"2026-02-23T06:21:23.157020+0000","last_peered":"2026-02-23T06:21:23.157020+0000","last_clean":"2026-02-23T06:21:23.157020+0000","last_became_active":"2026-02-23T06:21:18.142359+0000","last_became_peered":"2026-02-23T06:21:18.142359+0000","last_unstale":"2026-02-23T06:21:23.157020+0000","last_undegraded":"2026-02-23T06:21:23.157020+0000","last_fullsized":"2026-02-23T06:21:23.157020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:54:09.503227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158607+0000","last_change":"2026-02-23T06:21:18.156667+0000","last_active":"2026-02-23T06:21:23.158607+0000","last_peered":"2026-02-23T06:21:23.158607+0000","last_clean":"2026-02-23T06:21:23.158607+0000","last_became_active":"2026-02-23T06:21:18.156564+0000","last_became_peered":"2026-02-23T06:21:18.156564+0000","last_unstale":"2026-02-23T06:21:23.158607+0000","last_undegraded":"2026-02-23T06:21:23.158607+0000","last_fullsized":"2026-02-23T06:21:23.158607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:11:13.967668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2454,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25597,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70172,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":328,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":335872,"data_stored":694963,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":12046,"internal_metadata":27578610},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":268,"kb_used_omap":19,"kb_used_meta":26924,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":274432,"data_stored":104649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19702,"internal_metadata":27570954},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":260,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":266240,"data_stored":104525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11374,"internal_metadata":27579282},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":332,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":339968,"data_stored":694985,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":11711,"internal_metadata":27578945},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":106853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13524,"internal_metadata":27577132},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":105129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11474,"internal_metadata":27579182},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":272,"kb_used_omap":10,"kb_used_meta":26933,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":278528,"data_stored":106159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11136,"internal_metadata":27579520},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":268,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":274432,"data_stored":104581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":27571517},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8618,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":702,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":320,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1500,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4712,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":336,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9409,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T06:21:36.296 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-23T06:21:36.297 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-23T06:21:36.298 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-23T06:21:36.450 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.455+0000 7f6d7575c640 1 -- 10.20.193.58:0/1430246779 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6d700b6690 msgr2=0x7f6d70058ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:36.450 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.455+0000 7f6d7575c640 1 --2- 10.20.193.58:0/1430246779 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6d700b6690 0x7f6d70058ec0 secure :-1 s=READY pgs=112 gs=2 cs=0 l=1 c_cookie=17343935281920062013 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d64005820 tx=0x7f6d640302b0 comp rx=0 tx=0).stop 2026-02-23T06:21:36.450 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.455+0000 7f6d7575c640 1 -- 10.20.193.58:0/1430246779 shutdown_connections 2026-02-23T06:21:36.451 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.455+0000 7f6d7575c640 1 --2- 10.20.193.58:0/1430246779 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6d700b6690 0x7f6d70058ec0 unknown :-1 s=CLOSED pgs=112 gs=2 cs=0 l=1 c_cookie=17343935281920062013 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:36.451 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.455+0000 7f6d7575c640 1 --2- 10.20.193.58:0/1430246779 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6d7015d4a0 0x7f6d700affb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:36.451 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.455+0000 7f6d7575c640 1 -- 10.20.193.58:0/1430246779 >> 10.20.193.58:0/1430246779 conn(0x7f6d700b3c20 msgr2=0x7f6d700b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:36.451 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.455+0000 7f6d7575c640 1 -- 10.20.193.58:0/1430246779 shutdown_connections 2026-02-23T06:21:36.451 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.455+0000 7f6d7575c640 1 -- 10.20.193.58:0/1430246779 wait complete. 2026-02-23T06:21:36.453 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.456+0000 7f6d7575c640 1 Processor -- start 2026-02-23T06:21:36.453 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.456+0000 7f6d7575c640 1 -- start start 2026-02-23T06:21:36.454 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.457+0000 7f6d7575c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6d700b6690 0x7f6d70057860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:36.454 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.457+0000 7f6d7575c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6d7015d4a0 0x7f6d70057da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:36.454 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.457+0000 7f6d7575c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6d7015d870 0x7f6d70056420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:36.454 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.457+0000 7f6d7575c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f6d7013f3a0 con 0x7f6d7015d4a0 2026-02-23T06:21:36.454 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.457+0000 7f6d7575c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f6d70057440 con 0x7f6d7015d870 2026-02-23T06:21:36.454 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.457+0000 7f6d7575c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f6d70141070 con 0x7f6d700b6690 2026-02-23T06:21:36.454 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.457+0000 7f6d6f7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6d7015d4a0 0x7f6d70057da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:36.454 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.457+0000 7f6d6f7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6d7015d4a0 0x7f6d70057da0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50702/0 (socket says 10.20.193.58:50702) 2026-02-23T06:21:36.454 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.457+0000 7f6d6f7fe640 1 -- 10.20.193.58:0/3621149150 learned_addr learned my addr 10.20.193.58:0/3621149150 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:36.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.457+0000 7f6d6ffff640 1 --2- 10.20.193.58:0/3621149150 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6d700b6690 0x7f6d70057860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:36.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.457+0000 7f6d74f5b640 1 --2- 10.20.193.58:0/3621149150 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6d7015d870 0x7f6d70056420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:36.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.457+0000 7f6d6f7fe640 1 -- 10.20.193.58:0/3621149150 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6d700b6690 msgr2=0x7f6d70057860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:36.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.457+0000 7f6d6f7fe640 1 --2- 10.20.193.58:0/3621149150 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6d700b6690 0x7f6d70057860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:36.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.457+0000 7f6d6f7fe640 1 -- 10.20.193.58:0/3621149150 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6d7015d870 msgr2=0x7f6d70056420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:36.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.457+0000 7f6d6f7fe640 1 --2- 10.20.193.58:0/3621149150 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6d7015d870 0x7f6d70056420 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:36.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.457+0000 7f6d6f7fe640 1 -- 10.20.193.58:0/3621149150 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d6400a590 con 0x7f6d7015d4a0 2026-02-23T06:21:36.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.457+0000 7f6d6ffff640 1 --2- 10.20.193.58:0/3621149150 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6d700b6690 0x7f6d70057860 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:21:36.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.457+0000 7f6d74f5b640 1 --2- 10.20.193.58:0/3621149150 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6d7015d870 0x7f6d70056420 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:21:36.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.458+0000 7f6d6f7fe640 1 --2- 10.20.193.58:0/3621149150 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6d7015d4a0 0x7f6d70057da0 secure :-1 s=READY pgs=113 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d6000c4b0 tx=0x7f6d6000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:36.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.458+0000 7f6d6cff9640 1 -- 10.20.193.58:0/3621149150 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6d60012850 con 0x7f6d7015d4a0 2026-02-23T06:21:36.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.458+0000 7f6d6cff9640 1 -- 10.20.193.58:0/3621149150 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d60012aa0 con 0x7f6d7015d4a0 2026-02-23T06:21:36.456 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.458+0000 7f6d6cff9640 1 -- 10.20.193.58:0/3621149150 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6d60012e50 con 0x7f6d7015d4a0 2026-02-23T06:21:36.456 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.458+0000 7f6d7575c640 1 -- 10.20.193.58:0/3621149150 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d70149bf0 con 0x7f6d7015d4a0 2026-02-23T06:21:36.456 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.458+0000 7f6d7575c640 1 -- 10.20.193.58:0/3621149150 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d70140ab0 con 0x7f6d7015d4a0 2026-02-23T06:21:36.456 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.458+0000 7f6d7575c640 1 -- 10.20.193.58:0/3621149150 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d30005300 con 0x7f6d7015d4a0 2026-02-23T06:21:36.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.460+0000 7f6d6cff9640 1 -- 10.20.193.58:0/3621149150 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f6d60025480 con 0x7f6d7015d4a0 2026-02-23T06:21:36.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.461+0000 7f6d6cff9640 1 --2- 10.20.193.58:0/3621149150 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6d4007a6c0 0x7f6d4009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:36.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.461+0000 7f6d6cff9640 1 -- 10.20.193.58:0/3621149150 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f6d6009ddd0 con 0x7f6d7015d4a0 2026-02-23T06:21:36.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.461+0000 7f6d6ffff640 1 --2- 10.20.193.58:0/3621149150 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6d4007a6c0 0x7f6d4009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:36.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.461+0000 7f6d6cff9640 1 -- 10.20.193.58:0/3621149150 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f6d60064a00 con 0x7f6d7015d4a0 2026-02-23T06:21:36.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.462+0000 7f6d6ffff640 1 --2- 10.20.193.58:0/3621149150 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6d4007a6c0 0x7f6d4009ab70 secure :-1 s=READY pgs=70 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d5c005970 tx=0x7f6d5c005900 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:36.570 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.575+0000 7f6d7575c640 1 -- 10.20.193.58:0/3621149150 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f6d30005880 con 0x7f6d7015d4a0 2026-02-23T06:21:36.570 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.576+0000 7f6d6cff9640 1 -- 10.20.193.58:0/3621149150 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v28) ==== 86+0+146 (secure 0 0 0) 0x7f6d60064150 con 0x7f6d7015d4a0 2026-02-23T06:21:36.571 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:36.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.577+0000 7f6d7575c640 1 -- 10.20.193.58:0/3621149150 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6d4007a6c0 msgr2=0x7f6d4009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:36.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.577+0000 7f6d7575c640 1 --2- 10.20.193.58:0/3621149150 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6d4007a6c0 0x7f6d4009ab70 secure :-1 s=READY pgs=70 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d5c005970 tx=0x7f6d5c005900 comp rx=0 tx=0).stop 2026-02-23T06:21:36.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.577+0000 7f6d7575c640 1 -- 10.20.193.58:0/3621149150 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6d7015d4a0 msgr2=0x7f6d70057da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:36.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.577+0000 7f6d7575c640 1 --2- 10.20.193.58:0/3621149150 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6d7015d4a0 0x7f6d70057da0 secure :-1 s=READY pgs=113 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d6000c4b0 tx=0x7f6d6000c980 comp rx=0 tx=0).stop 2026-02-23T06:21:36.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.577+0000 7f6d7575c640 1 -- 10.20.193.58:0/3621149150 shutdown_connections 2026-02-23T06:21:36.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.577+0000 7f6d7575c640 1 --2- 10.20.193.58:0/3621149150 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6d4007a6c0 0x7f6d4009ab70 unknown :-1 s=CLOSED pgs=70 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:36.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.577+0000 7f6d7575c640 1 --2- 10.20.193.58:0/3621149150 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6d7015d870 0x7f6d70056420 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:36.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.577+0000 7f6d7575c640 1 --2- 10.20.193.58:0/3621149150 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6d7015d4a0 0x7f6d70057da0 unknown :-1 s=CLOSED pgs=113 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:36.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.577+0000 7f6d7575c640 1 --2- 10.20.193.58:0/3621149150 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6d700b6690 0x7f6d70057860 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:36.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.577+0000 7f6d7575c640 1 -- 10.20.193.58:0/3621149150 >> 10.20.193.58:0/3621149150 conn(0x7f6d700b3c20 msgr2=0x7f6d700b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:36.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.577+0000 7f6d7575c640 1 -- 10.20.193.58:0/3621149150 shutdown_connections 2026-02-23T06:21:36.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.577+0000 7f6d7575c640 1 -- 10.20.193.58:0/3621149150 wait complete. 2026-02-23T06:21:36.583 INFO:teuthology.orchestra.run.trial058.stdout:[{"version":28,"timestamp":"2026-02-23T06:21:02.801951+0000","name":"","changes":[{"name":"osd/osd_op_complaint_time","new_value":"180.000000"}]}] 2026-02-23T06:21:36.583 INFO:tasks.ceph_manager:config epoch is 28 2026-02-23T06:21:36.584 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-23T06:21:36.584 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-23T06:21:36.584 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-23T06:21:36.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.710+0000 7f8864c03640 1 -- 10.20.193.58:0/1405372947 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f886015d4a0 msgr2=0x7f88600affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:36.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.710+0000 7f8864c03640 1 --2- 10.20.193.58:0/1405372947 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f886015d4a0 0x7f88600affb0 secure :-1 s=READY pgs=114 gs=2 cs=0 l=1 c_cookie=5469899660459109423 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f884c004740 tx=0x7f884c02f1e0 comp rx=0 tx=0).stop 2026-02-23T06:21:36.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.710+0000 7f8864c03640 1 -- 10.20.193.58:0/1405372947 shutdown_connections 2026-02-23T06:21:36.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.710+0000 7f8864c03640 1 --2- 10.20.193.58:0/1405372947 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88600b6690 0x7f8860058ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:36.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.710+0000 7f8864c03640 1 --2- 10.20.193.58:0/1405372947 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f886015d4a0 0x7f88600affb0 unknown :-1 s=CLOSED pgs=114 gs=2 cs=0 l=1 c_cookie=5469899660459109423 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:36.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.710+0000 7f8864c03640 1 -- 10.20.193.58:0/1405372947 >> 10.20.193.58:0/1405372947 conn(0x7f88600b3c20 msgr2=0x7f88600b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:36.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.710+0000 7f8864c03640 1 -- 10.20.193.58:0/1405372947 shutdown_connections 2026-02-23T06:21:36.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.710+0000 7f8864c03640 1 -- 10.20.193.58:0/1405372947 wait complete. 2026-02-23T06:21:36.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.712+0000 7f8864c03640 1 Processor -- start 2026-02-23T06:21:36.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.712+0000 7f8864c03640 1 -- start start 2026-02-23T06:21:36.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.712+0000 7f8864c03640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88600b6690 0x7f886014d180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:36.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.712+0000 7f8864c03640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f886015d4a0 0x7f886011e490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:36.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.712+0000 7f8864c03640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f886015d870 0x7f886013c980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:36.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.712+0000 7f8864c03640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f886013dc80 con 0x7f886015d870 2026-02-23T06:21:36.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.712+0000 7f8864c03640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f88600563f0 con 0x7f886015d4a0 2026-02-23T06:21:36.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.712+0000 7f8864c03640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f886013cec0 con 0x7f88600b6690 2026-02-23T06:21:36.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.712+0000 7f885ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f886015d870 0x7f886013c980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:36.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.712+0000 7f885ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f886015d870 0x7f886013c980 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50714/0 (socket says 10.20.193.58:50714) 2026-02-23T06:21:36.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.712+0000 7f885ffff640 1 -- 10.20.193.58:0/2336544941 learned_addr learned my addr 10.20.193.58:0/2336544941 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:36.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.712+0000 7f885f7fe640 1 --2- 10.20.193.58:0/2336544941 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88600b6690 0x7f886014d180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:36.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.712+0000 7f885effd640 1 --2- 10.20.193.58:0/2336544941 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f886015d4a0 0x7f886011e490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:36.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.713+0000 7f885ffff640 1 -- 10.20.193.58:0/2336544941 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88600b6690 msgr2=0x7f886014d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:36.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.713+0000 7f885ffff640 1 --2- 10.20.193.58:0/2336544941 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88600b6690 0x7f886014d180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:36.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.713+0000 7f885ffff640 1 -- 10.20.193.58:0/2336544941 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f886015d4a0 msgr2=0x7f886011e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:36.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.713+0000 7f885ffff640 1 --2- 10.20.193.58:0/2336544941 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f886015d4a0 0x7f886011e490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:36.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.713+0000 7f885ffff640 1 -- 10.20.193.58:0/2336544941 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f884c0094b0 con 0x7f886015d870 2026-02-23T06:21:36.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.713+0000 7f885ffff640 1 --2- 10.20.193.58:0/2336544941 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f886015d870 0x7f886013c980 secure :-1 s=READY pgs=115 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f885400f900 tx=0x7f885400fdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:36.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.713+0000 7f883bfff640 1 -- 10.20.193.58:0/2336544941 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f885400dda0 con 0x7f886015d870 2026-02-23T06:21:36.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.713+0000 7f883bfff640 1 -- 10.20.193.58:0/2336544941 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8854005930 con 0x7f886015d870 2026-02-23T06:21:36.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.713+0000 7f883bfff640 1 -- 10.20.193.58:0/2336544941 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8854005d60 con 0x7f886015d870 2026-02-23T06:21:36.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.713+0000 7f8864c03640 1 -- 10.20.193.58:0/2336544941 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f886011e000 con 0x7f886015d870 2026-02-23T06:21:36.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.713+0000 7f8864c03640 1 -- 10.20.193.58:0/2336544941 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f886013d3e0 con 0x7f886015d870 2026-02-23T06:21:36.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.714+0000 7f8864c03640 1 -- 10.20.193.58:0/2336544941 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8820005300 con 0x7f886015d870 2026-02-23T06:21:36.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.715+0000 7f883bfff640 1 -- 10.20.193.58:0/2336544941 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f8854020060 con 0x7f886015d870 2026-02-23T06:21:36.712 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.716+0000 7f883bfff640 1 --2- 10.20.193.58:0/2336544941 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f883007a6b0 0x7f883009ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:36.712 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.716+0000 7f883bfff640 1 -- 10.20.193.58:0/2336544941 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f8854015070 con 0x7f886015d870 2026-02-23T06:21:36.712 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.716+0000 7f885f7fe640 1 --2- 10.20.193.58:0/2336544941 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f883007a6b0 0x7f883009ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:36.712 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.717+0000 7f885f7fe640 1 --2- 10.20.193.58:0/2336544941 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f883007a6b0 0x7f883009ab60 secure :-1 s=READY pgs=71 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f884c0023d0 tx=0x7f884c031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:36.712 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.718+0000 7f883bfff640 1 -- 10.20.193.58:0/2336544941 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f8854061f00 con 0x7f886015d870 2026-02-23T06:21:36.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.860+0000 7f8864c03640 1 -- 10.20.193.58:0/2336544941 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f88200055b0 con 0x7f886015d870 2026-02-23T06:21:36.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.861+0000 7f883bfff640 1 -- 10.20.193.58:0/2336544941 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+198788 (secure 0 0 0) 0x7f8854065020 con 0x7f886015d870 2026-02-23T06:21:36.858 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:36.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.863+0000 7f8864c03640 1 -- 10.20.193.58:0/2336544941 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f883007a6b0 msgr2=0x7f883009ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:36.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.863+0000 7f8864c03640 1 --2- 10.20.193.58:0/2336544941 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f883007a6b0 0x7f883009ab60 secure :-1 s=READY pgs=71 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f884c0023d0 tx=0x7f884c031040 comp rx=0 tx=0).stop 2026-02-23T06:21:36.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.863+0000 7f8864c03640 1 -- 10.20.193.58:0/2336544941 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f886015d870 msgr2=0x7f886013c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:36.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.863+0000 7f8864c03640 1 --2- 10.20.193.58:0/2336544941 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f886015d870 0x7f886013c980 secure :-1 s=READY pgs=115 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f885400f900 tx=0x7f885400fdd0 comp rx=0 tx=0).stop 2026-02-23T06:21:36.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.863+0000 7f8864c03640 1 -- 10.20.193.58:0/2336544941 shutdown_connections 2026-02-23T06:21:36.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.863+0000 7f8864c03640 1 --2- 10.20.193.58:0/2336544941 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f883007a6b0 0x7f883009ab60 unknown :-1 s=CLOSED pgs=71 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:36.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.863+0000 7f8864c03640 1 --2- 10.20.193.58:0/2336544941 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f886015d870 0x7f886013c980 unknown :-1 s=CLOSED pgs=115 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:36.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.863+0000 7f8864c03640 1 --2- 10.20.193.58:0/2336544941 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f886015d4a0 0x7f886011e490 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:36.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.863+0000 7f8864c03640 1 --2- 10.20.193.58:0/2336544941 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88600b6690 0x7f886014d180 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:36.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.863+0000 7f8864c03640 1 -- 10.20.193.58:0/2336544941 >> 10.20.193.58:0/2336544941 conn(0x7f88600b3c20 msgr2=0x7f886005d100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:36.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.863+0000 7f8864c03640 1 -- 10.20.193.58:0/2336544941 shutdown_connections 2026-02-23T06:21:36.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:36.863+0000 7f8864c03640 1 -- 10.20.193.58:0/2336544941 wait complete. 2026-02-23T06:21:36.870 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":5,"flags":0,"active_gid":4126,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6800","nonce":4124709854},{"type":"v1","addr":"10.20.193.93:6801","nonce":4124709854}]},"active_addr":"10.20.193.93:6801/4124709854","active_change":"2026-02-23T06:21:04.368671+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[{"gid":4105,"name":"y","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.93:0","nonce":945518024}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.93:0","nonce":2282228141}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.93:0","nonce":1039473274}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.93:0","nonce":1239411066}]}]} 2026-02-23T06:21:36.877 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-23T06:21:36.877 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-23T06:21:36.877 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-23T06:21:37.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.038+0000 7f948c904640 1 -- 10.20.193.58:0/539790131 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f948815d4a0 msgr2=0x7f94880affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.038+0000 7f948c904640 1 --2- 10.20.193.58:0/539790131 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f948815d4a0 0x7f94880affb0 secure :-1 s=READY pgs=65 gs=2 cs=0 l=1 c_cookie=6218709645678632126 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9474004740 tx=0x7f947402f1e0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.038+0000 7f948c904640 1 -- 10.20.193.58:0/539790131 shutdown_connections 2026-02-23T06:21:37.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.038+0000 7f948c904640 1 --2- 10.20.193.58:0/539790131 >> v2:10.20.193.58:3300/0 conn(0x7f948815d870 0x7f94880587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.038+0000 7f948c904640 1 --2- 10.20.193.58:0/539790131 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f948815d4a0 0x7f94880affb0 unknown :-1 s=CLOSED pgs=65 gs=2 cs=0 l=1 c_cookie=6218709645678632126 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.039+0000 7f948c904640 1 -- 10.20.193.58:0/539790131 >> 10.20.193.58:0/539790131 conn(0x7f94880b3c20 msgr2=0x7f94880b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.039+0000 7f948c904640 1 -- 10.20.193.58:0/539790131 shutdown_connections 2026-02-23T06:21:37.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.039+0000 7f948c904640 1 -- 10.20.193.58:0/539790131 wait complete. 2026-02-23T06:21:37.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.040+0000 7f948c904640 1 Processor -- start 2026-02-23T06:21:37.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.040+0000 7f948c904640 1 -- start start 2026-02-23T06:21:37.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.040+0000 7f948c904640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f94880b6690 0x7f94881fe050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.040+0000 7f948c904640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f948815d4a0 0x7f9488162a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.040+0000 7f948c904640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f948815d870 0x7f94880b76d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.040+0000 7f948c904640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f94881621b0 con 0x7f948815d4a0 2026-02-23T06:21:37.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.040+0000 7f948c904640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9488162490 con 0x7f94880b6690 2026-02-23T06:21:37.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.040+0000 7f948c904640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f94881fe590 con 0x7f948815d870 2026-02-23T06:21:37.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.040+0000 7f9486ffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f948815d4a0 0x7f9488162a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.041+0000 7f9486ffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f948815d4a0 0x7f9488162a80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50736/0 (socket says 10.20.193.58:50736) 2026-02-23T06:21:37.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.041+0000 7f9486ffd640 1 -- 10.20.193.58:0/2258092581 learned_addr learned my addr 10.20.193.58:0/2258092581 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:37.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.041+0000 7f94877fe640 1 --2- 10.20.193.58:0/2258092581 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f94880b6690 0x7f94881fe050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.041+0000 7f9487fff640 1 --2- 10.20.193.58:0/2258092581 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f948815d870 0x7f94880b76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.041+0000 7f9486ffd640 1 -- 10.20.193.58:0/2258092581 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f948815d870 msgr2=0x7f94880b76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.041+0000 7f9486ffd640 1 --2- 10.20.193.58:0/2258092581 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f948815d870 0x7f94880b76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.041+0000 7f9486ffd640 1 -- 10.20.193.58:0/2258092581 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f94880b6690 msgr2=0x7f94881fe050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.041+0000 7f9486ffd640 1 --2- 10.20.193.58:0/2258092581 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f94880b6690 0x7f94881fe050 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.041+0000 7f9486ffd640 1 -- 10.20.193.58:0/2258092581 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94780094b0 con 0x7f948815d4a0 2026-02-23T06:21:37.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.041+0000 7f9486ffd640 1 --2- 10.20.193.58:0/2258092581 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f948815d4a0 0x7f9488162a80 secure :-1 s=READY pgs=117 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94780026a0 tx=0x7f9478002b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.041+0000 7f9463fff640 1 -- 10.20.193.58:0/2258092581 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f947800eaf0 con 0x7f948815d4a0 2026-02-23T06:21:37.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.041+0000 7f9463fff640 1 -- 10.20.193.58:0/2258092581 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f947800ed40 con 0x7f948815d4a0 2026-02-23T06:21:37.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.041+0000 7f9463fff640 1 -- 10.20.193.58:0/2258092581 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94780106b0 con 0x7f948815d4a0 2026-02-23T06:21:37.039 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.041+0000 7f948c904640 1 -- 10.20.193.58:0/2258092581 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94740094b0 con 0x7f948815d4a0 2026-02-23T06:21:37.039 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.041+0000 7f948c904640 1 -- 10.20.193.58:0/2258092581 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f948813e7e0 con 0x7f948815d4a0 2026-02-23T06:21:37.039 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.042+0000 7f948c904640 1 -- 10.20.193.58:0/2258092581 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94880b6d50 con 0x7f948815d4a0 2026-02-23T06:21:37.040 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.044+0000 7f9463fff640 1 -- 10.20.193.58:0/2258092581 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f9478016020 con 0x7f948815d4a0 2026-02-23T06:21:37.040 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.044+0000 7f9463fff640 1 --2- 10.20.193.58:0/2258092581 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f945807a740 0x7f945809abf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.040 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.044+0000 7f9463fff640 1 -- 10.20.193.58:0/2258092581 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f947809def0 con 0x7f948815d4a0 2026-02-23T06:21:37.040 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.045+0000 7f94877fe640 1 --2- 10.20.193.58:0/2258092581 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f945807a740 0x7f945809abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.040 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.045+0000 7f9463fff640 1 -- 10.20.193.58:0/2258092581 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f9478061320 con 0x7f948815d4a0 2026-02-23T06:21:37.041 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.046+0000 7f94877fe640 1 --2- 10.20.193.58:0/2258092581 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f945807a740 0x7f945809abf0 secure :-1 s=READY pgs=72 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94740023d0 tx=0x7f9474031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.153 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.159+0000 7f948c904640 1 -- 10.20.193.58:0/2258092581 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f948805b0e0 con 0x7f948815d4a0 2026-02-23T06:21:37.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.159+0000 7f9463fff640 1 -- 10.20.193.58:0/2258092581 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18600 (secure 0 0 0) 0x7f9478064440 con 0x7f948815d4a0 2026-02-23T06:21:37.154 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:37.154 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":25,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","created":"2026-02-23T06:21:02.010508+0000","modified":"2026-02-23T06:21:22.447858+0000","last_up_change":"2026-02-23T06:21:08.383048+0000","last_in_change":"2026-02-23T06:21:04.690899+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-23T06:21:10.389081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-23T06:21:16.080621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-23T06:21:16.401311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-23T06:21:20.153808+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"96cc0898-14bb-4d56-827a-8845bd4307c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6808","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6809","nonce":692913334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6810","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6811","nonce":692913334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6814","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6815","nonce":692913334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6812","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6813","nonce":692913334}]},"public_addr":"10.20.193.58:6809/692913334","cluster_addr":"10.20.193.58:6811/692913334","heartbeat_back_addr":"10.20.193.58:6815/692913334","heartbeat_front_addr":"10.20.193.58:6813/692913334","state":["exists","up"]},{"osd":1,"uuid":"bf665af4-6e3c-4cb3-899c-acede65c31f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6800","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6801","nonce":1850584280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6802","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6803","nonce":1850584280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6806","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6807","nonce":1850584280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6804","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6805","nonce":1850584280}]},"public_addr":"10.20.193.58:6801/1850584280","cluster_addr":"10.20.193.58:6803/1850584280","heartbeat_back_addr":"10.20.193.58:6807/1850584280","heartbeat_front_addr":"10.20.193.58:6805/1850584280","state":["exists","up"]},{"osd":2,"uuid":"2bcb3165-28ad-45d6-9a49-9d9da08501f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6823","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6825","nonce":4284600061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6826","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6827","nonce":4284600061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6830","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6831","nonce":4284600061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6828","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6829","nonce":4284600061}]},"public_addr":"10.20.193.58:6825/4284600061","cluster_addr":"10.20.193.58:6827/4284600061","heartbeat_back_addr":"10.20.193.58:6831/4284600061","heartbeat_front_addr":"10.20.193.58:6829/4284600061","state":["exists","up"]},{"osd":3,"uuid":"4750309a-5bf2-4f48-a550-ca677b0b0f61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6816","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6817","nonce":2858636994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6818","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6819","nonce":2858636994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6822","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6824","nonce":2858636994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6820","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6821","nonce":2858636994}]},"public_addr":"10.20.193.58:6817/2858636994","cluster_addr":"10.20.193.58:6819/2858636994","heartbeat_back_addr":"10.20.193.58:6824/2858636994","heartbeat_front_addr":"10.20.193.58:6821/2858636994","state":["exists","up"]},{"osd":4,"uuid":"5cbb50f2-4e49-46eb-bd84-d92706459d2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6803","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6805","nonce":1874834171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6807","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6809","nonce":1874834171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6816","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6817","nonce":1874834171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6812","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6814","nonce":1874834171}]},"public_addr":"10.20.193.93:6805/1874834171","cluster_addr":"10.20.193.93:6809/1874834171","heartbeat_back_addr":"10.20.193.93:6817/1874834171","heartbeat_front_addr":"10.20.193.93:6814/1874834171","state":["exists","up"]},{"osd":5,"uuid":"2806c775-4720-43a7-ab9f-85a4adb31098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6802","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6804","nonce":356968280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6806","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6808","nonce":356968280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6813","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6815","nonce":356968280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6810","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6811","nonce":356968280}]},"public_addr":"10.20.193.93:6804/356968280","cluster_addr":"10.20.193.93:6808/356968280","heartbeat_back_addr":"10.20.193.93:6815/356968280","heartbeat_front_addr":"10.20.193.93:6811/356968280","state":["exists","up"]},{"osd":6,"uuid":"aa03b46d-d30f-4b09-9251-c9514e8b8b6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6819","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6821","nonce":2948039088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6823","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6825","nonce":2948039088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6831","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6833","nonce":2948039088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6827","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6829","nonce":2948039088}]},"public_addr":"10.20.193.93:6821/2948039088","cluster_addr":"10.20.193.93:6825/2948039088","heartbeat_back_addr":"10.20.193.93:6833/2948039088","heartbeat_front_addr":"10.20.193.93:6829/2948039088","state":["exists","up"]},{"osd":7,"uuid":"b15519bf-2b7b-4fd5-8ef6-e09af0ad9817","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6818","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6820","nonce":2960650087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6822","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6824","nonce":2960650087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6830","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6832","nonce":2960650087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6826","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6828","nonce":2960650087}]},"public_addr":"10.20.193.93:6820/2960650087","cluster_addr":"10.20.193.93:6824/2960650087","heartbeat_back_addr":"10.20.193.93:6832/2960650087","heartbeat_front_addr":"10.20.193.93:6828/2960650087","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.717515+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.744114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.772247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.768341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.521808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.486005+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.480882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.473408+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"2","m":"2","plugin":"isa","technique":"reed_sol_van"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-23T06:21:37.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.160+0000 7f948c904640 1 -- 10.20.193.58:0/2258092581 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f945807a740 msgr2=0x7f945809abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.160+0000 7f948c904640 1 --2- 10.20.193.58:0/2258092581 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f945807a740 0x7f945809abf0 secure :-1 s=READY pgs=72 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94740023d0 tx=0x7f9474031040 comp rx=0 tx=0).stop 2026-02-23T06:21:37.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.160+0000 7f948c904640 1 -- 10.20.193.58:0/2258092581 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f948815d4a0 msgr2=0x7f9488162a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.160+0000 7f948c904640 1 --2- 10.20.193.58:0/2258092581 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f948815d4a0 0x7f9488162a80 secure :-1 s=READY pgs=117 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94780026a0 tx=0x7f9478002b70 comp rx=0 tx=0).stop 2026-02-23T06:21:37.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.160+0000 7f948c904640 1 -- 10.20.193.58:0/2258092581 shutdown_connections 2026-02-23T06:21:37.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.160+0000 7f948c904640 1 --2- 10.20.193.58:0/2258092581 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f945807a740 0x7f945809abf0 unknown :-1 s=CLOSED pgs=72 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.160+0000 7f948c904640 1 --2- 10.20.193.58:0/2258092581 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f948815d870 0x7f94880b76d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.160+0000 7f948c904640 1 --2- 10.20.193.58:0/2258092581 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f948815d4a0 0x7f9488162a80 unknown :-1 s=CLOSED pgs=117 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.160+0000 7f948c904640 1 --2- 10.20.193.58:0/2258092581 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f94880b6690 0x7f94881fe050 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.160+0000 7f948c904640 1 -- 10.20.193.58:0/2258092581 >> 10.20.193.58:0/2258092581 conn(0x7f94880b3c20 msgr2=0x7f9488163450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.160+0000 7f948c904640 1 -- 10.20.193.58:0/2258092581 shutdown_connections 2026-02-23T06:21:37.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.160+0000 7f948c904640 1 -- 10.20.193.58:0/2258092581 wait complete. 2026-02-23T06:21:37.167 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-23T06:21:37.167 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-23T06:21:37.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.296+0000 7f78bb443640 1 -- 10.20.193.58:0/839794941 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f789c005200 msgr2=0x7f789c065a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.296+0000 7f78bb443640 1 --2- 10.20.193.58:0/839794941 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f789c005200 0x7f789c065a10 secure :-1 s=READY pgs=119 gs=5 cs=0 l=1 c_cookie=9365486433454140480 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78b0004760 tx=0x7f78b00309d0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.296+0000 7f78bb443640 1 -- 10.20.193.58:0/839794941 shutdown_connections 2026-02-23T06:21:37.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.296+0000 7f78bb443640 1 --2- 10.20.193.58:0/839794941 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f789c005200 0x7f789c065a10 unknown :-1 s=CLOSED pgs=119 gs=5 cs=0 l=1 c_cookie=9365486433454140480 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.296+0000 7f78bb443640 1 -- 10.20.193.58:0/839794941 >> 10.20.193.58:0/839794941 conn(0x7f78b40b3c20 msgr2=0x7f78b40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.296+0000 7f78bb443640 1 -- 10.20.193.58:0/839794941 shutdown_connections 2026-02-23T06:21:37.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.296+0000 7f78bb443640 1 -- 10.20.193.58:0/839794941 wait complete. 2026-02-23T06:21:37.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.297+0000 7f78bb443640 1 Processor -- start 2026-02-23T06:21:37.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.297+0000 7f78bb443640 1 -- start start 2026-02-23T06:21:37.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.298+0000 7f78bb443640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f789c005200 0x7f78b413d1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.298+0000 7f78bb443640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f78b413e040 0x7f78b414d540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.298+0000 7f78bb443640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f78b414da80 0x7f78b412f6d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.298+0000 7f78bb443640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f78b4141230 con 0x7f78b413e040 2026-02-23T06:21:37.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.298+0000 7f78bb443640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f78b414ab70 con 0x7f789c005200 2026-02-23T06:21:37.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.298+0000 7f78bb443640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f78b414def0 con 0x7f78b414da80 2026-02-23T06:21:37.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.298+0000 7f78b9c40640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f78b413e040 0x7f78b414d540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.298+0000 7f78b9c40640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f78b413e040 0x7f78b414d540 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50756/0 (socket says 10.20.193.58:50756) 2026-02-23T06:21:37.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.298+0000 7f78b9c40640 1 -- 10.20.193.58:0/1871797635 learned_addr learned my addr 10.20.193.58:0/1871797635 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:37.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.298+0000 7f78ba441640 1 --2- 10.20.193.58:0/1871797635 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f789c005200 0x7f78b413d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.298+0000 7f78bac42640 1 --2- 10.20.193.58:0/1871797635 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f78b414da80 0x7f78b412f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.298+0000 7f78b9c40640 1 -- 10.20.193.58:0/1871797635 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f78b414da80 msgr2=0x7f78b412f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.298+0000 7f78b9c40640 1 --2- 10.20.193.58:0/1871797635 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f78b414da80 0x7f78b412f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.298+0000 7f78b9c40640 1 -- 10.20.193.58:0/1871797635 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f789c005200 msgr2=0x7f78b413d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.298+0000 7f78b9c40640 1 --2- 10.20.193.58:0/1871797635 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f789c005200 0x7f78b413d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.298+0000 7f78b9c40640 1 -- 10.20.193.58:0/1871797635 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b4149d10 con 0x7f78b413e040 2026-02-23T06:21:37.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.299+0000 7f78b9c40640 1 --2- 10.20.193.58:0/1871797635 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f78b413e040 0x7f78b414d540 secure :-1 s=READY pgs=120 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78a8002fb0 tx=0x7f78a80099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.299+0000 7f789affd640 1 -- 10.20.193.58:0/1871797635 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78a80109c0 con 0x7f78b413e040 2026-02-23T06:21:37.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.299+0000 7f789affd640 1 -- 10.20.193.58:0/1871797635 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78a8010c10 con 0x7f78b413e040 2026-02-23T06:21:37.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.299+0000 7f789affd640 1 -- 10.20.193.58:0/1871797635 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78a8011440 con 0x7f78b413e040 2026-02-23T06:21:37.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.299+0000 7f78bb443640 1 -- 10.20.193.58:0/1871797635 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78b4149ff0 con 0x7f78b413e040 2026-02-23T06:21:37.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.299+0000 7f78bb443640 1 -- 10.20.193.58:0/1871797635 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78b414a5b0 con 0x7f78b413e040 2026-02-23T06:21:37.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.300+0000 7f78bb443640 1 -- 10.20.193.58:0/1871797635 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78b415bb80 con 0x7f78b413e040 2026-02-23T06:21:37.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.301+0000 7f789affd640 1 -- 10.20.193.58:0/1871797635 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f78a80115a0 con 0x7f78b413e040 2026-02-23T06:21:37.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.301+0000 7f789affd640 1 --2- 10.20.193.58:0/1871797635 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f788407a6b0 0x7f788409ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.301+0000 7f789affd640 1 -- 10.20.193.58:0/1871797635 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f78a809e370 con 0x7f78b413e040 2026-02-23T06:21:37.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.302+0000 7f78ba441640 1 --2- 10.20.193.58:0/1871797635 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f788407a6b0 0x7f788409ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.302+0000 7f78ba441640 1 --2- 10.20.193.58:0/1871797635 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f788407a6b0 0x7f788409ab60 secure :-1 s=READY pgs=73 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78a40067a0 tx=0x7f78a4003bc0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.303+0000 7f789affd640 1 -- 10.20.193.58:0/1871797635 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f78a80614c0 con 0x7f78b413e040 2026-02-23T06:21:37.411 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.417+0000 7f78bb443640 1 -- 10.20.193.58:0/1871797635 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f78b415b8a0 con 0x7f78b413e040 2026-02-23T06:21:37.412 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.417+0000 7f789affd640 1 -- 10.20.193.58:0/1871797635 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18600 (secure 0 0 0) 0x7f78a80645e0 con 0x7f78b413e040 2026-02-23T06:21:37.412 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:37.413 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":25,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","created":"2026-02-23T06:21:02.010508+0000","modified":"2026-02-23T06:21:22.447858+0000","last_up_change":"2026-02-23T06:21:08.383048+0000","last_in_change":"2026-02-23T06:21:04.690899+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-23T06:21:10.389081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-23T06:21:16.080621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-23T06:21:16.401311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-23T06:21:20.153808+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"96cc0898-14bb-4d56-827a-8845bd4307c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6808","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6809","nonce":692913334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6810","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6811","nonce":692913334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6814","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6815","nonce":692913334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6812","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6813","nonce":692913334}]},"public_addr":"10.20.193.58:6809/692913334","cluster_addr":"10.20.193.58:6811/692913334","heartbeat_back_addr":"10.20.193.58:6815/692913334","heartbeat_front_addr":"10.20.193.58:6813/692913334","state":["exists","up"]},{"osd":1,"uuid":"bf665af4-6e3c-4cb3-899c-acede65c31f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6800","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6801","nonce":1850584280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6802","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6803","nonce":1850584280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6806","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6807","nonce":1850584280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6804","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6805","nonce":1850584280}]},"public_addr":"10.20.193.58:6801/1850584280","cluster_addr":"10.20.193.58:6803/1850584280","heartbeat_back_addr":"10.20.193.58:6807/1850584280","heartbeat_front_addr":"10.20.193.58:6805/1850584280","state":["exists","up"]},{"osd":2,"uuid":"2bcb3165-28ad-45d6-9a49-9d9da08501f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6823","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6825","nonce":4284600061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6826","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6827","nonce":4284600061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6830","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6831","nonce":4284600061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6828","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6829","nonce":4284600061}]},"public_addr":"10.20.193.58:6825/4284600061","cluster_addr":"10.20.193.58:6827/4284600061","heartbeat_back_addr":"10.20.193.58:6831/4284600061","heartbeat_front_addr":"10.20.193.58:6829/4284600061","state":["exists","up"]},{"osd":3,"uuid":"4750309a-5bf2-4f48-a550-ca677b0b0f61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6816","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6817","nonce":2858636994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6818","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6819","nonce":2858636994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6822","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6824","nonce":2858636994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6820","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6821","nonce":2858636994}]},"public_addr":"10.20.193.58:6817/2858636994","cluster_addr":"10.20.193.58:6819/2858636994","heartbeat_back_addr":"10.20.193.58:6824/2858636994","heartbeat_front_addr":"10.20.193.58:6821/2858636994","state":["exists","up"]},{"osd":4,"uuid":"5cbb50f2-4e49-46eb-bd84-d92706459d2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6803","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6805","nonce":1874834171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6807","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6809","nonce":1874834171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6816","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6817","nonce":1874834171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6812","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6814","nonce":1874834171}]},"public_addr":"10.20.193.93:6805/1874834171","cluster_addr":"10.20.193.93:6809/1874834171","heartbeat_back_addr":"10.20.193.93:6817/1874834171","heartbeat_front_addr":"10.20.193.93:6814/1874834171","state":["exists","up"]},{"osd":5,"uuid":"2806c775-4720-43a7-ab9f-85a4adb31098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6802","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6804","nonce":356968280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6806","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6808","nonce":356968280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6813","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6815","nonce":356968280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6810","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6811","nonce":356968280}]},"public_addr":"10.20.193.93:6804/356968280","cluster_addr":"10.20.193.93:6808/356968280","heartbeat_back_addr":"10.20.193.93:6815/356968280","heartbeat_front_addr":"10.20.193.93:6811/356968280","state":["exists","up"]},{"osd":6,"uuid":"aa03b46d-d30f-4b09-9251-c9514e8b8b6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6819","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6821","nonce":2948039088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6823","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6825","nonce":2948039088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6831","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6833","nonce":2948039088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6827","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6829","nonce":2948039088}]},"public_addr":"10.20.193.93:6821/2948039088","cluster_addr":"10.20.193.93:6825/2948039088","heartbeat_back_addr":"10.20.193.93:6833/2948039088","heartbeat_front_addr":"10.20.193.93:6829/2948039088","state":["exists","up"]},{"osd":7,"uuid":"b15519bf-2b7b-4fd5-8ef6-e09af0ad9817","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6818","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6820","nonce":2960650087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6822","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6824","nonce":2960650087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6830","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6832","nonce":2960650087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6826","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6828","nonce":2960650087}]},"public_addr":"10.20.193.93:6820/2960650087","cluster_addr":"10.20.193.93:6824/2960650087","heartbeat_back_addr":"10.20.193.93:6832/2960650087","heartbeat_front_addr":"10.20.193.93:6828/2960650087","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.717515+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.744114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.772247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.768341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.521808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.486005+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.480882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.473408+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"2","m":"2","plugin":"isa","technique":"reed_sol_van"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-23T06:21:37.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.418+0000 7f78bb443640 1 -- 10.20.193.58:0/1871797635 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f788407a6b0 msgr2=0x7f788409ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.418+0000 7f78bb443640 1 --2- 10.20.193.58:0/1871797635 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f788407a6b0 0x7f788409ab60 secure :-1 s=READY pgs=73 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78a40067a0 tx=0x7f78a4003bc0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.418+0000 7f78bb443640 1 -- 10.20.193.58:0/1871797635 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f78b413e040 msgr2=0x7f78b414d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.418+0000 7f78bb443640 1 --2- 10.20.193.58:0/1871797635 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f78b413e040 0x7f78b414d540 secure :-1 s=READY pgs=120 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78a8002fb0 tx=0x7f78a80099f0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.418+0000 7f78bb443640 1 -- 10.20.193.58:0/1871797635 shutdown_connections 2026-02-23T06:21:37.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.418+0000 7f78bb443640 1 --2- 10.20.193.58:0/1871797635 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f788407a6b0 0x7f788409ab60 unknown :-1 s=CLOSED pgs=73 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.418+0000 7f78bb443640 1 --2- 10.20.193.58:0/1871797635 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f78b414da80 0x7f78b412f6d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.418+0000 7f78bb443640 1 --2- 10.20.193.58:0/1871797635 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f78b413e040 0x7f78b414d540 unknown :-1 s=CLOSED pgs=120 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.418+0000 7f78bb443640 1 --2- 10.20.193.58:0/1871797635 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f789c005200 0x7f78b413d1c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.418+0000 7f78bb443640 1 -- 10.20.193.58:0/1871797635 >> 10.20.193.58:0/1871797635 conn(0x7f78b40b3c20 msgr2=0x7f78b4159f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.418+0000 7f78bb443640 1 -- 10.20.193.58:0/1871797635 shutdown_connections 2026-02-23T06:21:37.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.418+0000 7f78bb443640 1 -- 10.20.193.58:0/1871797635 wait complete. 2026-02-23T06:21:37.427 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-23T06:21:37.428 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-23T06:21:37.428 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-23T06:21:37.429 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-23T06:21:37.429 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-23T06:21:37.430 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-23T06:21:37.430 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2026-02-23T06:21:37.431 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2026-02-23T06:21:37.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.578+0000 7fac799d2640 1 -- 10.20.193.58:0/3545957135 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fac740b7050 msgr2=0x7fac74161ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.578+0000 7fac737fe640 1 -- 10.20.193.58:0/3545957135 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac68002e40 con 0x7fac740b7050 2026-02-23T06:21:37.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.578+0000 7fac799d2640 1 --2- 10.20.193.58:0/3545957135 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fac740b7050 0x7fac74161ba0 secure :-1 s=READY pgs=124 gs=3 cs=0 l=1 c_cookie=14335028117725643816 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac74059950 tx=0x7fac640302f0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.578+0000 7f6e30c43640 1 -- 10.20.193.58:0/1963046231 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6e2400c0f0 msgr2=0x7f6e2404b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.575 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.579+0000 7fac799d2640 1 -- 10.20.193.58:0/3545957135 shutdown_connections 2026-02-23T06:21:37.575 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.579+0000 7fac799d2640 1 --2- 10.20.193.58:0/3545957135 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fac740b7050 0x7fac74161ba0 unknown :-1 s=CLOSED pgs=124 gs=3 cs=0 l=1 c_cookie=14335028117725643816 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.575 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.579+0000 7fac799d2640 1 --2- 10.20.193.58:0/3545957135 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac7415b460 0x7fac740561f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.575 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.579+0000 7fac799d2640 1 -- 10.20.193.58:0/3545957135 >> 10.20.193.58:0/3545957135 conn(0x7fac740b3c20 msgr2=0x7fac740b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.579+0000 7fac799d2640 1 -- 10.20.193.58:0/3545957135 shutdown_connections 2026-02-23T06:21:37.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.579+0000 7fac799d2640 1 -- 10.20.193.58:0/3545957135 wait complete. 2026-02-23T06:21:37.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.578+0000 7f6e30c43640 1 --2- 10.20.193.58:0/1963046231 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6e2400c0f0 0x7f6e2404b930 secure :-1 s=READY pgs=125 gs=3 cs=0 l=1 c_cookie=16791998996334217597 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e14005e70 tx=0x7f6e1402f260 comp rx=0 tx=0).stop 2026-02-23T06:21:37.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.580+0000 7fac799d2640 1 Processor -- start 2026-02-23T06:21:37.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.580+0000 7fac799d2640 1 -- start start 2026-02-23T06:21:37.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.581+0000 7f6e30c43640 1 -- 10.20.193.58:0/1963046231 shutdown_connections 2026-02-23T06:21:37.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.581+0000 7f6e30c43640 1 --2- 10.20.193.58:0/1963046231 >> v2:10.20.193.58:3300/0 conn(0x7f6e240f3590 0x7f6e240f39f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.581+0000 7f6e30c43640 1 --2- 10.20.193.58:0/1963046231 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6e2400c0f0 0x7f6e2404b930 unknown :-1 s=CLOSED pgs=125 gs=3 cs=0 l=1 c_cookie=16791998996334217597 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.581+0000 7f6e30c43640 1 -- 10.20.193.58:0/1963046231 >> 10.20.193.58:0/1963046231 conn(0x7f6e2400a260 msgr2=0x7f6e2400b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.581+0000 7fe24dbed640 1 -- 10.20.193.58:0/3481365085 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe2480b1540 msgr2=0x7fe2480b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.581+0000 7fe24dbed640 1 --2- 10.20.193.58:0/3481365085 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe2480b1540 0x7fe2480b5610 secure :-1 s=READY pgs=123 gs=2 cs=0 l=1 c_cookie=8904890609281498607 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2480b0ac0 tx=0x7fe23802f360 comp rx=0 tx=0).stop 2026-02-23T06:21:37.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.581+0000 7fac799d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fac740b7050 0x7fac74135830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.581+0000 7fac799d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac7415b460 0x7fac74151010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.581+0000 7fac799d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac741620e0 0x7fac74156a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.582+0000 7fac799d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fac741389b0 con 0x7fac7415b460 2026-02-23T06:21:37.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.582+0000 7fac789d0640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fac740b7050 0x7fac74135830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.582+0000 7fac799d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fac740b13e0 con 0x7fac740b7050 2026-02-23T06:21:37.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.582+0000 7fac799d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fac74151550 con 0x7fac741620e0 2026-02-23T06:21:37.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.582+0000 7fe24dbed640 1 -- 10.20.193.58:0/3481365085 shutdown_connections 2026-02-23T06:21:37.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.582+0000 7fe24dbed640 1 --2- 10.20.193.58:0/3481365085 >> v2:10.20.193.93:3300/0 conn(0x7fe2480b7110 0x7fe248156dd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.582+0000 7fac73fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac7415b460 0x7fac74151010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.582+0000 7fac73fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac7415b460 0x7fac74151010 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50784/0 (socket says 10.20.193.58:50784) 2026-02-23T06:21:37.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.582+0000 7fac73fff640 1 -- 10.20.193.58:0/1727461241 learned_addr learned my addr 10.20.193.58:0/1727461241 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:37.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.582+0000 7fac791d1640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac741620e0 0x7fac74156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.583+0000 7fe24dbed640 1 --2- 10.20.193.58:0/3481365085 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe2480b1540 0x7fe2480b5610 unknown :-1 s=CLOSED pgs=123 gs=2 cs=0 l=1 c_cookie=8904890609281498607 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.582 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.583+0000 7fe24dbed640 1 -- 10.20.193.58:0/3481365085 >> 10.20.193.58:0/3481365085 conn(0x7fe248058e50 msgr2=0x7fe248059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.582 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.583+0000 7f6e30c43640 1 -- 10.20.193.58:0/1963046231 shutdown_connections 2026-02-23T06:21:37.582 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.583+0000 7fac789d0640 1 -- 10.20.193.58:0/1727461241 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac741620e0 msgr2=0x7fac74156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.583 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.583+0000 7fac789d0640 1 --2- 10.20.193.58:0/1727461241 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac741620e0 0x7fac74156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.583 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.583+0000 7fac789d0640 1 -- 10.20.193.58:0/1727461241 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac7415b460 msgr2=0x7fac74151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.583 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.583+0000 7fac789d0640 1 --2- 10.20.193.58:0/1727461241 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac7415b460 0x7fac74151010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.583 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.583+0000 7fac789d0640 1 -- 10.20.193.58:0/1727461241 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac6400ae40 con 0x7fac740b7050 2026-02-23T06:21:37.583 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.583+0000 7fac789d0640 1 --2- 10.20.193.58:0/1727461241 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fac740b7050 0x7fac74135830 secure :-1 s=READY pgs=126 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac5c004740 tx=0x7fac5c00ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.583 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.584+0000 7fac717fa640 1 -- 10.20.193.58:0/1727461241 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac5c00cd40 con 0x7fac740b7050 2026-02-23T06:21:37.583 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.584+0000 7fac717fa640 1 -- 10.20.193.58:0/1727461241 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac5c004850 con 0x7fac740b7050 2026-02-23T06:21:37.583 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.584+0000 7fac717fa640 1 -- 10.20.193.58:0/1727461241 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac5c00cea0 con 0x7fac740b7050 2026-02-23T06:21:37.583 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.584+0000 7fac799d2640 1 -- 10.20.193.58:0/1727461241 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac74137c20 con 0x7fac740b7050 2026-02-23T06:21:37.584 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.584+0000 7fac799d2640 1 -- 10.20.193.58:0/1727461241 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac740ae800 con 0x7fac740b7050 2026-02-23T06:21:37.584 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.583+0000 7f6e30c43640 1 -- 10.20.193.58:0/1963046231 wait complete. 2026-02-23T06:21:37.584 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.584+0000 7f6e30c43640 1 Processor -- start 2026-02-23T06:21:37.584 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.583+0000 7fe24dbed640 1 -- 10.20.193.58:0/3481365085 shutdown_connections 2026-02-23T06:21:37.584 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.583+0000 7fe24dbed640 1 -- 10.20.193.58:0/3481365085 wait complete. 2026-02-23T06:21:37.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.584+0000 7fe24dbed640 1 Processor -- start 2026-02-23T06:21:37.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.584+0000 7fe24dbed640 1 -- start start 2026-02-23T06:21:37.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.585+0000 7ff14167f640 1 -- 10.20.193.58:0/3220439121 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff130005070 con 0x7ff13c0b7110 2026-02-23T06:21:37.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.585+0000 7f6e30c43640 1 -- start start 2026-02-23T06:21:37.586 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.585+0000 7fe24dbed640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2480b1540 0x7fe2481682d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.586 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.585+0000 7ff14490c640 1 -- 10.20.193.58:0/3220439121 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff13c0b7110 msgr2=0x7ff13c156dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.586 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.585+0000 7ff14490c640 1 --2- 10.20.193.58:0/3220439121 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff13c0b7110 0x7ff13c156dd0 secure :-1 s=READY pgs=124 gs=3 cs=0 l=1 c_cookie=17439193037564858907 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff130006f50 tx=0x7ff130030400 comp rx=0 tx=0).stop 2026-02-23T06:21:37.586 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.585+0000 7f6e30c43640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6e2400c0f0 0x7f6e240bca50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.585+0000 7f6e30c43640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6e2404f6a0 0x7f6e240d6400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.585+0000 7fe24dbed640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe2480b1910 0x7fe24805d010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.585+0000 7ff14490c640 1 -- 10.20.193.58:0/3220439121 shutdown_connections 2026-02-23T06:21:37.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.585+0000 7ff14490c640 1 --2- 10.20.193.58:0/3220439121 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff13c0b7110 0x7ff13c156dd0 unknown :-1 s=CLOSED pgs=124 gs=3 cs=0 l=1 c_cookie=17439193037564858907 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.585+0000 7ff14490c640 1 --2- 10.20.193.58:0/3220439121 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff13c0b1540 0x7ff13c0b5610 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.585+0000 7ff14490c640 1 -- 10.20.193.58:0/3220439121 >> 10.20.193.58:0/3220439121 conn(0x7ff13c058e50 msgr2=0x7ff13c059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.585+0000 7fe24dbed640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe2480b7110 0x7fe24805d550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.586+0000 7f6e2b7fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6e2400c0f0 0x7f6e240bca50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.589 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.585+0000 7fe2477fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2480b1540 0x7fe2481682d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.589 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.586+0000 7ff14490c640 1 -- 10.20.193.58:0/3220439121 shutdown_connections 2026-02-23T06:21:37.589 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.586+0000 7ff14490c640 1 -- 10.20.193.58:0/3220439121 wait complete. 2026-02-23T06:21:37.590 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.586+0000 7f6e30c43640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6e240f3590 0x7f6e240bdff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.590 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.586+0000 7f6e30c43640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f6e240bd8c0 con 0x7f6e2404f6a0 2026-02-23T06:21:37.590 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.586+0000 7f6e30c43640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f6e240ebf00 con 0x7f6e2400c0f0 2026-02-23T06:21:37.590 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.586+0000 7f6e30c43640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f6e240ec760 con 0x7f6e240f3590 2026-02-23T06:21:37.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.586+0000 7f6e2b7fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6e2400c0f0 0x7f6e240bca50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:50372/0 (socket says 10.20.193.58:50372) 2026-02-23T06:21:37.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.586+0000 7f6e2b7fe640 1 -- 10.20.193.58:0/745799557 learned_addr learned my addr 10.20.193.58:0/745799557 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:37.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.586+0000 7fe2477fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2480b1540 0x7fe2481682d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:50374/0 (socket says 10.20.193.58:50374) 2026-02-23T06:21:37.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.586+0000 7f6e2affd640 1 --2- 10.20.193.58:0/745799557 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6e2404f6a0 0x7f6e240d6400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.586+0000 7fe2477fe640 1 -- 10.20.193.58:0/946453996 learned_addr learned my addr 10.20.193.58:0/946453996 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:37.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.586+0000 7f6e2bfff640 1 --2- 10.20.193.58:0/745799557 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6e240f3590 0x7f6e240bdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.586+0000 7fe24dbed640 1 -- 10.20.193.58:0/946453996 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe2481412d0 con 0x7fe2480b1910 2026-02-23T06:21:37.593 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.586+0000 7f6e2b7fe640 1 -- 10.20.193.58:0/745799557 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6e240f3590 msgr2=0x7f6e240bdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.593 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.586+0000 7f6e2b7fe640 1 --2- 10.20.193.58:0/745799557 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6e240f3590 0x7f6e240bdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.593 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.586+0000 7f6e2b7fe640 1 -- 10.20.193.58:0/745799557 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6e2404f6a0 msgr2=0x7f6e240d6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.593 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.586+0000 7f6e2b7fe640 1 --2- 10.20.193.58:0/745799557 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6e2404f6a0 0x7f6e240d6400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.593 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.586+0000 7f6e2b7fe640 1 -- 10.20.193.58:0/745799557 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e14009570 con 0x7f6e2400c0f0 2026-02-23T06:21:37.594 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.586+0000 7fe24dbed640 1 -- 10.20.193.58:0/946453996 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe248162470 con 0x7fe2480b1540 2026-02-23T06:21:37.594 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.586+0000 7f6e2affd640 1 --2- 10.20.193.58:0/745799557 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6e2404f6a0 0x7f6e240d6400 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:21:37.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.586+0000 7fe24dbed640 1 -- 10.20.193.58:0/946453996 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe248144120 con 0x7fe2480b7110 2026-02-23T06:21:37.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.586+0000 7fe247fff640 1 --2- 10.20.193.58:0/946453996 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe2480b7110 0x7fe24805d550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.586+0000 7fe246ffd640 1 --2- 10.20.193.58:0/946453996 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe2480b1910 0x7fe24805d010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.586+0000 7f6e2b7fe640 1 --2- 10.20.193.58:0/745799557 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6e2400c0f0 0x7f6e240bca50 secure :-1 s=READY pgs=128 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e1402fe10 tx=0x7f6e140028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.596 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.587+0000 7fe2477fe640 1 -- 10.20.193.58:0/946453996 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe2480b7110 msgr2=0x7fe24805d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.596 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.587+0000 7fe2477fe640 1 --2- 10.20.193.58:0/946453996 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe2480b7110 0x7fe24805d550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.596 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.587+0000 7fe2477fe640 1 -- 10.20.193.58:0/946453996 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe2480b1910 msgr2=0x7fe24805d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.596 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.587+0000 7fe2477fe640 1 --2- 10.20.193.58:0/946453996 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe2480b1910 0x7fe24805d010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.596 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.587+0000 7fe2477fe640 1 -- 10.20.193.58:0/946453996 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe238009570 con 0x7fe2480b1540 2026-02-23T06:21:37.597 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.586+0000 7fac717fa640 1 -- 10.20.193.58:0/1727461241 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fac5c01f060 con 0x7fac740b7050 2026-02-23T06:21:37.597 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.586+0000 7fac799d2640 1 -- 10.20.193.58:0/1727461241 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fac7405b6a0 con 0x7fac740b7050 2026-02-23T06:21:37.597 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.587+0000 7ff14490c640 1 Processor -- start 2026-02-23T06:21:37.597 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.587+0000 7ff14490c640 1 -- start start 2026-02-23T06:21:37.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.588+0000 7ff14490c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff13c0b1540 0x7ff13c166390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.588+0000 7ff14490c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff13c0b1910 0x7ff13c161030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.588+0000 7ff14490c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff13c0b7110 0x7ff13c161570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.588+0000 7ff14490c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff13c05dc20 con 0x7ff13c0b1910 2026-02-23T06:21:37.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.588+0000 7ff14490c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff13c05d070 con 0x7ff13c0b7110 2026-02-23T06:21:37.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.588+0000 7ff14490c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7ff13c1623b0 con 0x7ff13c0b1540 2026-02-23T06:21:37.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.588+0000 7fac717fa640 1 --2- 10.20.193.58:0/1727461241 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fac4407a740 0x7fac4409abf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.588+0000 7fac717fa640 1 -- 10.20.193.58:0/1727461241 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7fac5c014070 con 0x7fac740b7050 2026-02-23T06:21:37.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.588+0000 7fac73fff640 1 --2- 10.20.193.58:0/1727461241 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fac4407a740 0x7fac4409abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.588+0000 7fac717fa640 1 --2- 10.20.193.58:0/1727461241 >> [v2:10.20.193.58:6808/692913334,v1:10.20.193.58:6809/692913334] conn(0x7fac440a1c90 0x7fac440c20c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.588+0000 7ff142681640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff13c0b1540 0x7ff13c166390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.588+0000 7ff142e82640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff13c0b7110 0x7ff13c161570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.588+0000 7ff141e80640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff13c0b1910 0x7ff13c161030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.588+0000 7ff141e80640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff13c0b1910 0x7ff13c161030 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50824/0 (socket says 10.20.193.58:50824) 2026-02-23T06:21:37.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.588+0000 7ff142e82640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff13c0b7110 0x7ff13c161570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:50380/0 (socket says 10.20.193.58:50380) 2026-02-23T06:21:37.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.588+0000 7ff142e82640 1 -- 10.20.193.58:0/2933202033 learned_addr learned my addr 10.20.193.58:0/2933202033 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:37.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.588+0000 7f6e03fff640 1 -- 10.20.193.58:0/745799557 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6e1403d070 con 0x7f6e2400c0f0 2026-02-23T06:21:37.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.588+0000 7f6e30c43640 1 -- 10.20.193.58:0/745799557 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e240d6940 con 0x7f6e2400c0f0 2026-02-23T06:21:37.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.588+0000 7f6e03fff640 1 -- 10.20.193.58:0/745799557 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e14004850 con 0x7f6e2400c0f0 2026-02-23T06:21:37.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.588+0000 7f6e03fff640 1 -- 10.20.193.58:0/745799557 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6e1403d070 con 0x7f6e2400c0f0 2026-02-23T06:21:37.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.588+0000 7ff141e80640 1 -- 10.20.193.58:0/2933202033 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff13c0b1540 msgr2=0x7ff13c166390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.588+0000 7ff141e80640 1 --2- 10.20.193.58:0/2933202033 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff13c0b1540 0x7ff13c166390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.588+0000 7ff141e80640 1 -- 10.20.193.58:0/2933202033 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff13c0b7110 msgr2=0x7ff13c161570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.602 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.588+0000 7ff141e80640 1 --2- 10.20.193.58:0/2933202033 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff13c0b7110 0x7ff13c161570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.602 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.588+0000 7ff141e80640 1 -- 10.20.193.58:0/2933202033 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff13000a650 con 0x7ff13c0b1910 2026-02-23T06:21:37.602 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.588+0000 7fe246ffd640 1 --2- 10.20.193.58:0/946453996 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe2480b1910 0x7fe24805d010 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:21:37.602 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.588+0000 7f6e30c43640 1 -- 10.20.193.58:0/745799557 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e240bd5e0 con 0x7f6e2400c0f0 2026-02-23T06:21:37.603 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.589+0000 7ff141e80640 1 --2- 10.20.193.58:0/2933202033 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff13c0b1910 0x7ff13c161030 secure :-1 s=READY pgs=125 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1280027d0 tx=0x7ff12800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.603 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.588+0000 7fac791d1640 1 --2- 10.20.193.58:0/1727461241 >> [v2:10.20.193.58:6808/692913334,v1:10.20.193.58:6809/692913334] conn(0x7fac440a1c90 0x7fac440c20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.589+0000 7fac717fa640 1 -- 10.20.193.58:0/1727461241 --> [v2:10.20.193.58:6808/692913334,v1:10.20.193.58:6809/692913334] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fac440c2790 con 0x7fac440a1c90 2026-02-23T06:21:37.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.589+0000 7fac717fa640 1 -- 10.20.193.58:0/1727461241 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fac5c09fde0 con 0x7fac740b7050 2026-02-23T06:21:37.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.589+0000 7ff126ffd640 1 -- 10.20.193.58:0/2933202033 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff128004240 con 0x7ff13c0b1910 2026-02-23T06:21:37.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.589+0000 7fac791d1640 1 --2- 10.20.193.58:0/1727461241 >> [v2:10.20.193.58:6808/692913334,v1:10.20.193.58:6809/692913334] conn(0x7fac440a1c90 0x7fac440c20c0 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.589+0000 7ff126ffd640 1 -- 10.20.193.58:0/2933202033 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff128004490 con 0x7ff13c0b1910 2026-02-23T06:21:37.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.589+0000 7ff126ffd640 1 -- 10.20.193.58:0/2933202033 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff128006b10 con 0x7ff13c0b1910 2026-02-23T06:21:37.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.589+0000 7ff14490c640 1 -- 10.20.193.58:0/2933202033 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff13c05d280 con 0x7ff13c0b1910 2026-02-23T06:21:37.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.589+0000 7ff14490c640 1 -- 10.20.193.58:0/2933202033 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff13c05d840 con 0x7ff13c0b1910 2026-02-23T06:21:37.606 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.590+0000 7fac717fa640 1 -- 10.20.193.58:0/1727461241 <== osd.0 v2:10.20.193.58:6808/692913334 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7fac440c2790 con 0x7fac440a1c90 2026-02-23T06:21:37.606 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.591+0000 7fac73fff640 1 --2- 10.20.193.58:0/1727461241 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fac4407a740 0x7fac4409abf0 secure :-1 s=READY pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac640034b0 tx=0x7fac64032040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.606 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.592+0000 7f6e30c43640 1 -- 10.20.193.58:0/745799557 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6e240fa510 con 0x7f6e2400c0f0 2026-02-23T06:21:37.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.592+0000 7fb35dd1c640 1 -- 10.20.193.58:0/851775684 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3500fb710 msgr2=0x7fb35004ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.592+0000 7fb35dd1c640 1 --2- 10.20.193.58:0/851775684 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3500fb710 0x7fb35004ec30 secure :-1 s=READY pgs=127 gs=1 cs=0 l=1 c_cookie=11612964092306281376 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb35004d8f0 tx=0x7fb34802f300 comp rx=0 tx=0).stop 2026-02-23T06:21:37.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.592+0000 7fb35dd1c640 1 -- 10.20.193.58:0/851775684 shutdown_connections 2026-02-23T06:21:37.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.592+0000 7fb35dd1c640 1 --2- 10.20.193.58:0/851775684 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb35004f170 0x7fb350035070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.591+0000 7ff14490c640 1 -- 10.20.193.58:0/2933202033 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff13c166010 con 0x7ff13c0b1910 2026-02-23T06:21:37.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.591+0000 7fe2477fe640 1 --2- 10.20.193.58:0/946453996 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2480b1540 0x7fe2481682d0 secure :-1 s=READY pgs=129 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe238004740 tx=0x7fe2380046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.591+0000 7fe223fff640 1 -- 10.20.193.58:0/946453996 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe238004850 con 0x7fe2480b1540 2026-02-23T06:21:37.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.592+0000 7fe24dbed640 1 -- 10.20.193.58:0/946453996 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2481626c0 con 0x7fe2480b1540 2026-02-23T06:21:37.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.592+0000 7fe223fff640 1 -- 10.20.193.58:0/946453996 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe238004aa0 con 0x7fe2480b1540 2026-02-23T06:21:37.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.592+0000 7fe24dbed640 1 -- 10.20.193.58:0/946453996 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe248166430 con 0x7fe2480b1540 2026-02-23T06:21:37.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.592+0000 7fe223fff640 1 -- 10.20.193.58:0/946453996 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe238005020 con 0x7fe2480b1540 2026-02-23T06:21:37.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.592+0000 7fb35dd1c640 1 --2- 10.20.193.58:0/851775684 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3500fb710 0x7fb35004ec30 unknown :-1 s=CLOSED pgs=127 gs=1 cs=0 l=1 c_cookie=11612964092306281376 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.610 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.592+0000 7fb35dd1c640 1 --2- 10.20.193.58:0/851775684 >> v2:10.20.193.93:3300/0 conn(0x7fb3500f5aa0 0x7fb3500ff6a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.610 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.593+0000 7ff126ffd640 1 -- 10.20.193.58:0/2933202033 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7ff128006c70 con 0x7ff13c0b1910 2026-02-23T06:21:37.610 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.592+0000 7fb35dd1c640 1 -- 10.20.193.58:0/851775684 >> 10.20.193.58:0/851775684 conn(0x7fb35000a260 msgr2=0x7fb35000b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.611 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.593+0000 7fb35dd1c640 1 -- 10.20.193.58:0/851775684 shutdown_connections 2026-02-23T06:21:37.611 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.593+0000 7fb35dd1c640 1 -- 10.20.193.58:0/851775684 wait complete. 2026-02-23T06:21:37.611 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.592+0000 7f6e03fff640 1 -- 10.20.193.58:0/745799557 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f6e14038470 con 0x7f6e2400c0f0 2026-02-23T06:21:37.611 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.594+0000 7ff126ffd640 1 --2- 10.20.193.58:0/2933202033 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff10c07a800 0x7ff10c09acb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.612 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.594+0000 7fe24dbed640 1 -- 10.20.193.58:0/946453996 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe208000fd0 con 0x7fe2480b1540 2026-02-23T06:21:37.612 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.594+0000 7ff126ffd640 1 -- 10.20.193.58:0/2933202033 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7ff12809d0e0 con 0x7ff13c0b1910 2026-02-23T06:21:37.612 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.594+0000 7fb1c2b4b640 1 -- 10.20.193.58:0/1440798682 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb1b4053c10 msgr2=0x7fb1b40074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.612 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.594+0000 7fb1c2b4b640 1 --2- 10.20.193.58:0/1440798682 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb1b4053c10 0x7fb1b40074a0 secure :-1 s=READY pgs=130 gs=3 cs=0 l=1 c_cookie=8858120437432788517 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1b8003c10 tx=0x7fb1ac02f1f0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.613 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.594+0000 7fb1c2b4b640 1 -- 10.20.193.58:0/1440798682 shutdown_connections 2026-02-23T06:21:37.613 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.594+0000 7ff142681640 1 --2- 10.20.193.58:0/2933202033 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff10c07a800 0x7ff10c09acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.613 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.594+0000 7ff126ffd640 1 --2- 10.20.193.58:0/2933202033 >> [v2:10.20.193.93:6803/1874834171,v1:10.20.193.93:6805/1874834171] conn(0x7ff10c0a1d50 0x7ff10c0c2180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.613 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.594+0000 7ff126ffd640 1 -- 10.20.193.58:0/2933202033 --> [v2:10.20.193.93:6803/1874834171,v1:10.20.193.93:6805/1874834171] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff10c0c2850 con 0x7ff10c0a1d50 2026-02-23T06:21:37.613 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.594+0000 7fb1c2b4b640 1 --2- 10.20.193.58:0/1440798682 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb1b4053c10 0x7fb1b40074a0 unknown :-1 s=CLOSED pgs=130 gs=3 cs=0 l=1 c_cookie=8858120437432788517 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.594+0000 7ff126ffd640 1 -- 10.20.193.58:0/2933202033 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff12809f680 con 0x7ff13c0b1910 2026-02-23T06:21:37.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.594+0000 7fb1c2b4b640 1 --2- 10.20.193.58:0/1440798682 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb1b40f80e0 0x7fb1b4006f60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.594+0000 7fb1c2b4b640 1 -- 10.20.193.58:0/1440798682 >> 10.20.193.58:0/1440798682 conn(0x7fb1b4054ad0 msgr2=0x7fb1b4050d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.594+0000 7f6e03fff640 1 --2- 10.20.193.58:0/745799557 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6dfc07a720 0x7f6dfc09abd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.594+0000 7f6e03fff640 1 -- 10.20.193.58:0/745799557 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f6e140c8dc0 con 0x7f6e2400c0f0 2026-02-23T06:21:37.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.594+0000 7f6e2affd640 1 --2- 10.20.193.58:0/745799557 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6dfc07a720 0x7f6dfc09abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.594+0000 7ff142e82640 1 --2- 10.20.193.58:0/2933202033 >> [v2:10.20.193.93:6803/1874834171,v1:10.20.193.93:6805/1874834171] conn(0x7ff10c0a1d50 0x7ff10c0c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.595+0000 7fb35dd1c640 1 Processor -- start 2026-02-23T06:21:37.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.595+0000 7fb1c2b4b640 1 -- 10.20.193.58:0/1440798682 shutdown_connections 2026-02-23T06:21:37.616 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.595+0000 7fe223fff640 1 -- 10.20.193.58:0/946453996 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fe23803f070 con 0x7fe2480b1540 2026-02-23T06:21:37.616 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.595+0000 7ff142681640 1 --2- 10.20.193.58:0/2933202033 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff10c07a800 0x7ff10c09acb0 secure :-1 s=READY pgs=75 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff134005970 tx=0x7ff134005900 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.616 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.595+0000 7fb1c2b4b640 1 -- 10.20.193.58:0/1440798682 wait complete. 2026-02-23T06:21:37.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.595+0000 7fb35dd1c640 1 -- start start 2026-02-23T06:21:37.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.595+0000 7fb35dd1c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb35004f170 0x7fb3500fb1a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.595+0000 7fb35dd1c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3500f5aa0 0x7fb3500d5d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.595+0000 7fb35dd1c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3500fb710 0x7fb3500d6890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.595+0000 7fb35dd1c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb3500d6250 con 0x7fb3500fb710 2026-02-23T06:21:37.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.595+0000 7fb35dd1c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb350034c10 con 0x7fb35004f170 2026-02-23T06:21:37.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.595+0000 7fb35dd1c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb3500d65b0 con 0x7fb3500f5aa0 2026-02-23T06:21:37.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.596+0000 7fb35d51b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3500fb710 0x7fb3500d6890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.596+0000 7fb35d51b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3500fb710 0x7fb3500d6890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50852/0 (socket says 10.20.193.58:50852) 2026-02-23T06:21:37.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.596+0000 7fb35d51b640 1 -- 10.20.193.58:0/3988902682 learned_addr learned my addr 10.20.193.58:0/3988902682 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:37.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.596+0000 7fb35cd1a640 1 --2- 10.20.193.58:0/3988902682 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb35004f170 0x7fb3500fb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.596+0000 7fe223fff640 1 --2- 10.20.193.58:0/946453996 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe21807a6b0 0x7fe21809ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.596+0000 7fe223fff640 1 -- 10.20.193.58:0/946453996 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7fe23808eb90 con 0x7fe2480b1540 2026-02-23T06:21:37.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.596+0000 7ff142e82640 1 --2- 10.20.193.58:0/2933202033 >> [v2:10.20.193.93:6803/1874834171,v1:10.20.193.93:6805/1874834171] conn(0x7ff10c0a1d50 0x7ff10c0c2180 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.596+0000 7fb35d51b640 1 -- 10.20.193.58:0/3988902682 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3500f5aa0 msgr2=0x7fb3500d5d10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-23T06:21:37.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.596+0000 7fb35d51b640 1 --2- 10.20.193.58:0/3988902682 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3500f5aa0 0x7fb3500d5d10 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.596+0000 7fb35d51b640 1 -- 10.20.193.58:0/3988902682 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb35004f170 msgr2=0x7fb3500fb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.596+0000 7fb35d51b640 1 --2- 10.20.193.58:0/3988902682 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb35004f170 0x7fb3500fb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.596+0000 7fb35d51b640 1 -- 10.20.193.58:0/3988902682 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb348009570 con 0x7fb3500fb710 2026-02-23T06:21:37.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.596+0000 7fe223fff640 1 --2- 10.20.193.58:0/946453996 >> [v2:10.20.193.58:6823/4284600061,v1:10.20.193.58:6825/4284600061] conn(0x7fe2180a29a0 0x7fe2180c2e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.596+0000 7fe223fff640 1 -- 10.20.193.58:0/946453996 --> [v2:10.20.193.58:6823/4284600061,v1:10.20.193.58:6825/4284600061] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe2180c3580 con 0x7fe2180a29a0 2026-02-23T06:21:37.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.596+0000 7fe246ffd640 1 --2- 10.20.193.58:0/946453996 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe21807a6b0 0x7fe21809ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.620 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.596+0000 7fe223fff640 1 -- 10.20.193.58:0/946453996 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe238004eb0 con 0x7fe2480b1540 2026-02-23T06:21:37.620 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.597+0000 7f6e03fff640 1 --2- 10.20.193.58:0/745799557 >> [v2:10.20.193.58:6800/1850584280,v1:10.20.193.58:6801/1850584280] conn(0x7f6dfc0a1c70 0x7f6dfc0c20a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.620 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.597+0000 7f6e03fff640 1 -- 10.20.193.58:0/745799557 --> [v2:10.20.193.58:6800/1850584280,v1:10.20.193.58:6801/1850584280] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6dfc0c2770 con 0x7f6dfc0a1c70 2026-02-23T06:21:37.620 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.597+0000 7f6e03fff640 1 -- 10.20.193.58:0/745799557 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6e140c2460 con 0x7f6e2400c0f0 2026-02-23T06:21:37.620 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.597+0000 7f6e2affd640 1 --2- 10.20.193.58:0/745799557 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6dfc07a720 0x7f6dfc09abd0 secure :-1 s=READY pgs=76 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e240db670 tx=0x7f6e1c008040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.620 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.597+0000 7ff126ffd640 1 -- 10.20.193.58:0/2933202033 <== osd.4 v2:10.20.193.93:6803/1874834171 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7ff10c0c2850 con 0x7ff10c0a1d50 2026-02-23T06:21:37.621 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.597+0000 7fb35d51b640 1 --2- 10.20.193.58:0/3988902682 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3500fb710 0x7fb3500d6890 secure :-1 s=READY pgs=128 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb35400f940 tx=0x7fb35400fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.621 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.597+0000 7fb34d7fa640 1 -- 10.20.193.58:0/3988902682 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb35400dce0 con 0x7fb3500fb710 2026-02-23T06:21:37.621 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.597+0000 7fb35dd1c640 1 -- 10.20.193.58:0/3988902682 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3500ea1e0 con 0x7fb3500fb710 2026-02-23T06:21:37.621 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.597+0000 7fb35dd1c640 1 -- 10.20.193.58:0/3988902682 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb350034930 con 0x7fb3500fb710 2026-02-23T06:21:37.621 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.597+0000 7fb1c2b4b640 1 Processor -- start 2026-02-23T06:21:37.621 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.597+0000 7fb34d7fa640 1 -- 10.20.193.58:0/3988902682 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb35400de40 con 0x7fb3500fb710 2026-02-23T06:21:37.621 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.597+0000 7fb34d7fa640 1 -- 10.20.193.58:0/3988902682 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb354005bb0 con 0x7fb3500fb710 2026-02-23T06:21:37.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.598+0000 7fe246ffd640 1 --2- 10.20.193.58:0/946453996 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe21807a6b0 0x7fe21809ab60 secure :-1 s=READY pgs=77 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe248117660 tx=0x7fe234009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.600+0000 7fe247fff640 1 --2- 10.20.193.58:0/946453996 >> [v2:10.20.193.58:6823/4284600061,v1:10.20.193.58:6825/4284600061] conn(0x7fe2180a29a0 0x7fe2180c2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.598+0000 7fb35dd1c640 1 -- 10.20.193.58:0/3988902682 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb3500ff180 con 0x7fb3500fb710 2026-02-23T06:21:37.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.599+0000 7fb34d7fa640 1 -- 10.20.193.58:0/3988902682 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fb354020060 con 0x7fb3500fb710 2026-02-23T06:21:37.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.600+0000 7f6e2bfff640 1 --2- 10.20.193.58:0/745799557 >> [v2:10.20.193.58:6800/1850584280,v1:10.20.193.58:6801/1850584280] conn(0x7f6dfc0a1c70 0x7f6dfc0c20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.600+0000 7fe247fff640 1 --2- 10.20.193.58:0/946453996 >> [v2:10.20.193.58:6823/4284600061,v1:10.20.193.58:6825/4284600061] conn(0x7fe2180a29a0 0x7fe2180c2e30 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.600+0000 7fb34d7fa640 1 --2- 10.20.193.58:0/3988902682 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb32807a6c0 0x7fb32809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.600+0000 7fb34d7fa640 1 -- 10.20.193.58:0/3988902682 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7fb354015070 con 0x7fb3500fb710 2026-02-23T06:21:37.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.600+0000 7fa5ce90c640 1 -- 10.20.193.58:0/3009013597 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa5c8161d50 msgr2=0x7fa5c8157670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.600+0000 7fa5ce90c640 1 --2- 10.20.193.58:0/3009013597 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa5c8161d50 0x7fa5c8157670 secure :-1 s=READY pgs=131 gs=3 cs=0 l=1 c_cookie=6435498830719550939 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5c80b4d10 tx=0x7fa5b802f220 comp rx=0 tx=0).stop 2026-02-23T06:21:37.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.600+0000 7fb34d7fa640 1 --2- 10.20.193.58:0/3988902682 >> [v2:10.20.193.58:6816/2858636994,v1:10.20.193.58:6817/2858636994] conn(0x7fb3280a1c00 0x7fb3280c2030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.600+0000 7fb34d7fa640 1 -- 10.20.193.58:0/3988902682 --> [v2:10.20.193.58:6816/2858636994,v1:10.20.193.58:6817/2858636994] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb3280c2700 con 0x7fb3280a1c00 2026-02-23T06:21:37.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.600+0000 7fb34d7fa640 1 -- 10.20.193.58:0/3988902682 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb35409f400 con 0x7fb3500fb710 2026-02-23T06:21:37.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.600+0000 7fa5ce90c640 1 -- 10.20.193.58:0/3009013597 shutdown_connections 2026-02-23T06:21:37.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.600+0000 7fa5ce90c640 1 --2- 10.20.193.58:0/3009013597 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5c80b1910 0x7fa5c8157bb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.600+0000 7fa5ce90c640 1 --2- 10.20.193.58:0/3009013597 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa5c8161d50 0x7fa5c8157670 unknown :-1 s=CLOSED pgs=131 gs=3 cs=0 l=1 c_cookie=6435498830719550939 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.600+0000 7fb35cd1a640 1 --2- 10.20.193.58:0/3988902682 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb32807a6c0 0x7fb32809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.625 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.600+0000 7fa5ce90c640 1 --2- 10.20.193.58:0/3009013597 >> v2:10.20.193.58:3300/0 conn(0x7fa5c80b1540 0x7fa5c80b5610 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.625 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.600+0000 7fa5ce90c640 1 -- 10.20.193.58:0/3009013597 >> 10.20.193.58:0/3009013597 conn(0x7fa5c8058e50 msgr2=0x7fa5c8059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.625 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.598+0000 7fb1c2b4b640 1 -- start start 2026-02-23T06:21:37.625 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.600+0000 7fa5ce90c640 1 -- 10.20.193.58:0/3009013597 shutdown_connections 2026-02-23T06:21:37.625 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.601+0000 7fa5ce90c640 1 -- 10.20.193.58:0/3009013597 wait complete. 2026-02-23T06:21:37.625 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.601+0000 7fe223fff640 1 -- 10.20.193.58:0/946453996 <== osd.2 v2:10.20.193.58:6823/4284600061 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7fe2180c3580 con 0x7fe2180a29a0 2026-02-23T06:21:37.626 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.601+0000 7f6e2bfff640 1 --2- 10.20.193.58:0/745799557 >> [v2:10.20.193.58:6800/1850584280,v1:10.20.193.58:6801/1850584280] conn(0x7f6dfc0a1c70 0x7f6dfc0c20a0 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.626 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.601+0000 7f6e03fff640 1 -- 10.20.193.58:0/745799557 <== osd.1 v2:10.20.193.58:6800/1850584280 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f6dfc0c2770 con 0x7f6dfc0a1c70 2026-02-23T06:21:37.626 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.601+0000 7fb35cd1a640 1 --2- 10.20.193.58:0/3988902682 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb32807a6c0 0x7fb32809ab70 secure :-1 s=READY pgs=78 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb340005fd0 tx=0x7fb34000a580 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.626 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.601+0000 7fb34ffff640 1 --2- 10.20.193.58:0/3988902682 >> [v2:10.20.193.58:6816/2858636994,v1:10.20.193.58:6817/2858636994] conn(0x7fb3280a1c00 0x7fb3280c2030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.626 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.598+0000 7fb1c2b4b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb1b4053c10 0x7fb1b40d9460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.598+0000 7fb1c2b4b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb1b40f7d10 0x7fb1b40d7f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.598+0000 7fb1c2b4b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb1b40f80e0 0x7fb1b40d84b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.598+0000 7fb1c2b4b640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b40be700 con 0x7fb1b40f80e0 2026-02-23T06:21:37.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.598+0000 7fb1c2b4b640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b40bdd00 con 0x7fb1b4053c10 2026-02-23T06:21:37.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.598+0000 7fb1c2b4b640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb1b40bdfe0 con 0x7fb1b40f7d10 2026-02-23T06:21:37.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.598+0000 7fb1c1b49640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb1b4053c10 0x7fb1b40d9460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.598+0000 7fb1c1348640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb1b40f7d10 0x7fb1b40d7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.599+0000 7fb1c1b49640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb1b4053c10 0x7fb1b40d9460 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:50422/0 (socket says 10.20.193.58:50422) 2026-02-23T06:21:37.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.599+0000 7fb1c1b49640 1 -- 10.20.193.58:0/1663732903 learned_addr learned my addr 10.20.193.58:0/1663732903 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:37.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.599+0000 7fb1c234a640 1 --2- 10.20.193.58:0/1663732903 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb1b40f80e0 0x7fb1b40d84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.599+0000 7fb1c1b49640 1 -- 10.20.193.58:0/1663732903 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb1b40f7d10 msgr2=0x7fb1b40d7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.599+0000 7fb1c1b49640 1 --2- 10.20.193.58:0/1663732903 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb1b40f7d10 0x7fb1b40d7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.599+0000 7fb1c1b49640 1 -- 10.20.193.58:0/1663732903 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb1b40f80e0 msgr2=0x7fb1b40d84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.599+0000 7fb1c1b49640 1 --2- 10.20.193.58:0/1663732903 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb1b40f80e0 0x7fb1b40d84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.599+0000 7fb1c1b49640 1 -- 10.20.193.58:0/1663732903 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1ac0094b0 con 0x7fb1b4053c10 2026-02-23T06:21:37.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.599+0000 7fb1c1348640 1 --2- 10.20.193.58:0/1663732903 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb1b40f7d10 0x7fb1b40d7f70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:37.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.599+0000 7fb1c234a640 1 --2- 10.20.193.58:0/1663732903 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb1b40f80e0 0x7fb1b40d84b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:37.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.600+0000 7fb1c1b49640 1 --2- 10.20.193.58:0/1663732903 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb1b4053c10 0x7fb1b40d9460 secure :-1 s=READY pgs=132 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1b800d7d0 tx=0x7fb1b800dca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.602+0000 7fa5ce90c640 1 Processor -- start 2026-02-23T06:21:37.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.601+0000 7fb1aa7fc640 1 -- 10.20.193.58:0/1663732903 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb1b8030d90 con 0x7fb1b4053c10 2026-02-23T06:21:37.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.601+0000 7fb1aa7fc640 1 -- 10.20.193.58:0/1663732903 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1b800b640 con 0x7fb1b4053c10 2026-02-23T06:21:37.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.601+0000 7fb1aa7fc640 1 -- 10.20.193.58:0/1663732903 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb1b800ba50 con 0x7fb1b4053c10 2026-02-23T06:21:37.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.601+0000 7fb1c2b4b640 1 -- 10.20.193.58:0/1663732903 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1b40d7490 con 0x7fb1b4053c10 2026-02-23T06:21:37.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.601+0000 7fb1c2b4b640 1 -- 10.20.193.58:0/1663732903 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1b40d7a50 con 0x7fb1b4053c10 2026-02-23T06:21:37.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.602+0000 7fb1c2b4b640 1 -- 10.20.193.58:0/1663732903 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb1b40feaa0 con 0x7fb1b4053c10 2026-02-23T06:21:37.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.602+0000 7fb34ffff640 1 --2- 10.20.193.58:0/3988902682 >> [v2:10.20.193.58:6816/2858636994,v1:10.20.193.58:6817/2858636994] conn(0x7fb3280a1c00 0x7fb3280c2030 crc :-1 s=READY pgs=9 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.602+0000 7fa5ce90c640 1 -- start start 2026-02-23T06:21:37.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.603+0000 7fa5ce90c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5c80b1540 0x7fa5c8155e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.603+0000 7fa5ce90c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa5c80b1910 0x7fa5c81604e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.603+0000 7fa5ce90c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5c8161d50 0x7fa5c8137310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.603+0000 7fa5c7fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5c80b1540 0x7fa5c8155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.603+0000 7fa5c7fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5c80b1540 0x7fa5c8155e60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:50852/0 (socket says 10.20.193.58:50852) 2026-02-23T06:21:37.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.603+0000 7fa5c7fff640 1 -- 10.20.193.58:0/4068123549 learned_addr learned my addr 10.20.193.58:0/4068123549 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:37.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.603+0000 7fa5c77fe640 1 --2- 10.20.193.58:0/4068123549 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa5c80b1910 0x7fa5c81604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.603+0000 7fa5ce90c640 1 -- 10.20.193.58:0/4068123549 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c8137fb0 con 0x7fa5c8161d50 2026-02-23T06:21:37.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.603+0000 7fa5ce90c640 1 -- 10.20.193.58:0/4068123549 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c8138220 con 0x7fa5c80b1910 2026-02-23T06:21:37.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.603+0000 7fa5ce90c640 1 -- 10.20.193.58:0/4068123549 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa5c8128fd0 con 0x7fa5c80b1540 2026-02-23T06:21:37.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.603+0000 7fbd3facc640 1 -- 10.20.193.58:0/3114635644 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd380b1170 msgr2=0x7fbd3815ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.603+0000 7fbd3facc640 1 --2- 10.20.193.58:0/3114635644 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd380b1170 0x7fbd3815ce40 secure :-1 s=READY pgs=129 gs=1 cs=0 l=1 c_cookie=11642213207392973140 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd380b1ce0 tx=0x7fbd2002f260 comp rx=0 tx=0).stop 2026-02-23T06:21:37.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.603+0000 7fa5cce82640 1 --2- 10.20.193.58:0/4068123549 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5c8161d50 0x7fa5c8137310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.604+0000 7fa5c77fe640 1 -- 10.20.193.58:0/4068123549 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5c80b1540 msgr2=0x7fa5c8155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.604+0000 7fa5c77fe640 1 --2- 10.20.193.58:0/4068123549 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5c80b1540 0x7fa5c8155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.604+0000 7fa5c77fe640 1 -- 10.20.193.58:0/4068123549 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5c8161d50 msgr2=0x7fa5c8137310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.604+0000 7fa5c77fe640 1 --2- 10.20.193.58:0/4068123549 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5c8161d50 0x7fa5c8137310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.604+0000 7fa5c77fe640 1 -- 10.20.193.58:0/4068123549 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5b40071c0 con 0x7fa5c80b1910 2026-02-23T06:21:37.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.604+0000 7fa5c7fff640 1 --2- 10.20.193.58:0/4068123549 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5c80b1540 0x7fa5c8155e60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:37.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.604+0000 7fa5c77fe640 1 --2- 10.20.193.58:0/4068123549 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa5c80b1910 0x7fa5c81604e0 secure :-1 s=READY pgs=133 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5c8162190 tx=0x7fa5b8002950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.604+0000 7fa5c4ff9640 1 -- 10.20.193.58:0/4068123549 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5b8038470 con 0x7fa5c80b1910 2026-02-23T06:21:37.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.604+0000 7fa5c4ff9640 1 -- 10.20.193.58:0/4068123549 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa5b80386c0 con 0x7fa5c80b1910 2026-02-23T06:21:37.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.604+0000 7fa5c4ff9640 1 -- 10.20.193.58:0/4068123549 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5b8038a90 con 0x7fa5c80b1910 2026-02-23T06:21:37.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.604+0000 7fbd3facc640 1 -- 10.20.193.58:0/3114635644 shutdown_connections 2026-02-23T06:21:37.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.604+0000 7fbd3facc640 1 --2- 10.20.193.58:0/3114635644 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd380b58a0 0x7fbd38163110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.604+0000 7fbd3facc640 1 --2- 10.20.193.58:0/3114635644 >> v2:10.20.193.93:3300/0 conn(0x7fbd380b1540 0x7fbd3815d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.631 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.604+0000 7fbd3facc640 1 --2- 10.20.193.58:0/3114635644 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd380b1170 0x7fbd3815ce40 unknown :-1 s=CLOSED pgs=129 gs=1 cs=0 l=1 c_cookie=11642213207392973140 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.631 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.604+0000 7fbd3facc640 1 -- 10.20.193.58:0/3114635644 >> 10.20.193.58:0/3114635644 conn(0x7fbd38058e50 msgr2=0x7fbd38059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.631 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.605+0000 7fbd3facc640 1 -- 10.20.193.58:0/3114635644 shutdown_connections 2026-02-23T06:21:37.631 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.605+0000 7fbd3facc640 1 -- 10.20.193.58:0/3114635644 wait complete. 2026-02-23T06:21:37.631 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.605+0000 7fac799d2640 1 -- 10.20.193.58:0/1727461241 --> [v2:10.20.193.58:6808/692913334,v1:10.20.193.58:6809/692913334] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fac7405b3c0 con 0x7fac440a1c90 2026-02-23T06:21:37.631 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.603+0000 7fb34d7fa640 1 -- 10.20.193.58:0/3988902682 <== osd.3 v2:10.20.193.58:6816/2858636994 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7fb3280c2700 con 0x7fb3280a1c00 2026-02-23T06:21:37.631 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.605+0000 7fa5ce90c640 1 -- 10.20.193.58:0/4068123549 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5b80094b0 con 0x7fa5c80b1910 2026-02-23T06:21:37.631 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.605+0000 7fa5ce90c640 1 -- 10.20.193.58:0/4068123549 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5c8129590 con 0x7fa5c80b1910 2026-02-23T06:21:37.631 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.605+0000 7fb1aa7fc640 1 -- 10.20.193.58:0/1663732903 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fb1b8049020 con 0x7fb1b4053c10 2026-02-23T06:21:37.632 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.606+0000 7fa5a27fc640 1 -- 10.20.193.58:0/4068123549 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa5c80aecb0 con 0x7fa5c80b1910 2026-02-23T06:21:37.632 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.606+0000 7fbd3facc640 1 Processor -- start 2026-02-23T06:21:37.632 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.606+0000 7fbd3facc640 1 -- start start 2026-02-23T06:21:37.632 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.607+0000 7fa5c4ff9640 1 -- 10.20.193.58:0/4068123549 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fa5b8038bf0 con 0x7fa5c80b1910 2026-02-23T06:21:37.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.607+0000 7fbd3facc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd380b1170 0x7fbd3805c950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.607+0000 7fbd3facc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd380b1540 0x7fbd380affe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.607+0000 7fbd3facc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd380b58a0 0x7fbd380b0520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.607+0000 7fbd3d841640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd380b1170 0x7fbd3805c950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.607+0000 7fbd3d841640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd380b1170 0x7fbd3805c950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:50450/0 (socket says 10.20.193.58:50450) 2026-02-23T06:21:37.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.607+0000 7fbd3d841640 1 -- 10.20.193.58:0/3755308073 learned_addr learned my addr 10.20.193.58:0/3755308073 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:37.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.607+0000 7fbd3facc640 1 -- 10.20.193.58:0/3755308073 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fbd38162470 con 0x7fbd380b1540 2026-02-23T06:21:37.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.607+0000 7fbd3e042640 1 --2- 10.20.193.58:0/3755308073 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd380b58a0 0x7fbd380b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.607+0000 7fbd3d040640 1 --2- 10.20.193.58:0/3755308073 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd380b1540 0x7fbd380affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.607+0000 7fbd3facc640 1 -- 10.20.193.58:0/3755308073 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fbd38132c20 con 0x7fbd380b1170 2026-02-23T06:21:37.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.607+0000 7fbd3facc640 1 -- 10.20.193.58:0/3755308073 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fbd38137cb0 con 0x7fbd380b58a0 2026-02-23T06:21:37.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.608+0000 7fac717fa640 1 -- 10.20.193.58:0/1727461241 <== osd.0 v2:10.20.193.58:6808/692913334 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fac680044c0 con 0x7fac440a1c90 2026-02-23T06:21:37.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.608+0000 7fa5c4ff9640 1 --2- 10.20.193.58:0/4068123549 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa59807a780 0x7fa59809ac30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.608+0000 7fa5c4ff9640 1 -- 10.20.193.58:0/4068123549 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7fa5b80c2980 con 0x7fa5c80b1910 2026-02-23T06:21:37.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.608+0000 7fb1aa7fc640 1 --2- 10.20.193.58:0/1663732903 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb18c07a810 0x7fb18c09acc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.608+0000 7fb1aa7fc640 1 -- 10.20.193.58:0/1663732903 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7fb1b80c1110 con 0x7fb1b4053c10 2026-02-23T06:21:37.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.608+0000 7fac799d2640 1 -- 10.20.193.58:0/1727461241 >> [v2:10.20.193.58:6808/692913334,v1:10.20.193.58:6809/692913334] conn(0x7fac440a1c90 msgr2=0x7fac440c20c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.608+0000 7fac799d2640 1 --2- 10.20.193.58:0/1727461241 >> [v2:10.20.193.58:6808/692913334,v1:10.20.193.58:6809/692913334] conn(0x7fac440a1c90 0x7fac440c20c0 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.608+0000 7fa5c4ff9640 1 --2- 10.20.193.58:0/4068123549 >> [v2:10.20.193.93:6802/356968280,v1:10.20.193.93:6804/356968280] conn(0x7fa5980a1c50 0x7fa5980c2080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.608+0000 7fa5c4ff9640 1 -- 10.20.193.58:0/4068123549 --> [v2:10.20.193.93:6802/356968280,v1:10.20.193.93:6804/356968280] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa5980c2750 con 0x7fa5980a1c50 2026-02-23T06:21:37.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.608+0000 7fb1c1348640 1 --2- 10.20.193.58:0/1663732903 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb18c07a810 0x7fb18c09acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.608+0000 7fac799d2640 1 -- 10.20.193.58:0/1727461241 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fac4407a740 msgr2=0x7fac4409abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.608+0000 7fac799d2640 1 --2- 10.20.193.58:0/1727461241 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fac4407a740 0x7fac4409abf0 secure :-1 s=READY pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac640034b0 tx=0x7fac64032040 comp rx=0 tx=0).stop 2026-02-23T06:21:37.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.608+0000 7fac799d2640 1 -- 10.20.193.58:0/1727461241 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fac740b7050 msgr2=0x7fac74135830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.608+0000 7fac799d2640 1 --2- 10.20.193.58:0/1727461241 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fac740b7050 0x7fac74135830 secure :-1 s=READY pgs=126 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac5c004740 tx=0x7fac5c00ee60 comp rx=0 tx=0).stop 2026-02-23T06:21:37.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.608+0000 7ff14490c640 1 -- 10.20.193.58:0/2933202033 --> [v2:10.20.193.93:6803/1874834171,v1:10.20.193.93:6805/1874834171] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff13c165d30 con 0x7ff10c0a1d50 2026-02-23T06:21:37.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.608+0000 7fa5c4ff9640 1 -- 10.20.193.58:0/4068123549 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa5b8085be0 con 0x7fa5c80b1910 2026-02-23T06:21:37.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.608+0000 7fa5c7fff640 1 --2- 10.20.193.58:0/4068123549 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa59807a780 0x7fa59809ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.608+0000 7fa5cce82640 1 --2- 10.20.193.58:0/4068123549 >> [v2:10.20.193.93:6802/356968280,v1:10.20.193.93:6804/356968280] conn(0x7fa5980a1c50 0x7fa5980c2080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.608+0000 7fac791d1640 1 -- 10.20.193.58:0/1727461241 reap_dead start 2026-02-23T06:21:37.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.608+0000 7ff126ffd640 1 -- 10.20.193.58:0/2933202033 <== osd.4 v2:10.20.193.93:6803/1874834171 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff10c0c2850 con 0x7ff10c0a1d50 2026-02-23T06:21:37.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.609+0000 7fac799d2640 1 -- 10.20.193.58:0/1727461241 shutdown_connections 2026-02-23T06:21:37.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.609+0000 7fac799d2640 1 -- 10.20.193.58:0/1727461241 >> 10.20.193.58:0/1727461241 conn(0x7fac740b3c20 msgr2=0x7fac7415f870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.609+0000 7ff14490c640 1 -- 10.20.193.58:0/2933202033 >> [v2:10.20.193.93:6803/1874834171,v1:10.20.193.93:6805/1874834171] conn(0x7ff10c0a1d50 msgr2=0x7ff10c0c2180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.609+0000 7ff14490c640 1 --2- 10.20.193.58:0/2933202033 >> [v2:10.20.193.93:6803/1874834171,v1:10.20.193.93:6805/1874834171] conn(0x7ff10c0a1d50 0x7ff10c0c2180 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.609+0000 7fbd3d841640 1 -- 10.20.193.58:0/3755308073 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd380b58a0 msgr2=0x7fbd380b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.637 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.609+0000 7fbd3d841640 1 --2- 10.20.193.58:0/3755308073 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd380b58a0 0x7fbd380b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.637 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.609+0000 7fbd3d841640 1 -- 10.20.193.58:0/3755308073 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd380b1540 msgr2=0x7fbd380affe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.637 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.609+0000 7fb1aa7fc640 1 --2- 10.20.193.58:0/1663732903 >> [v2:10.20.193.93:6818/2960650087,v1:10.20.193.93:6820/2960650087] conn(0x7fb18c0a1d60 0x7fb18c0c2190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.637 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.609+0000 7fb1aa7fc640 1 -- 10.20.193.58:0/1663732903 --> [v2:10.20.193.93:6818/2960650087,v1:10.20.193.93:6820/2960650087] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb18c0c2860 con 0x7fb18c0a1d60 2026-02-23T06:21:37.637 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.609+0000 7fa5cce82640 1 --2- 10.20.193.58:0/4068123549 >> [v2:10.20.193.93:6802/356968280,v1:10.20.193.93:6804/356968280] conn(0x7fa5980a1c50 0x7fa5980c2080 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.637 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.609+0000 7fb1aa7fc640 1 -- 10.20.193.58:0/1663732903 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb1b80c1440 con 0x7fb1b4053c10 2026-02-23T06:21:37.637 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.609+0000 7fac799d2640 1 -- 10.20.193.58:0/1727461241 shutdown_connections 2026-02-23T06:21:37.637 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.609+0000 7fbd3d841640 1 --2- 10.20.193.58:0/3755308073 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd380b1540 0x7fbd380affe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.638 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.609+0000 7fbd3d841640 1 -- 10.20.193.58:0/3755308073 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd20009570 con 0x7fbd380b1170 2026-02-23T06:21:37.638 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.609+0000 7fbd3d040640 1 --2- 10.20.193.58:0/3755308073 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd380b1540 0x7fbd380affe0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:21:37.638 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.609+0000 7ff14490c640 1 -- 10.20.193.58:0/2933202033 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff10c07a800 msgr2=0x7ff10c09acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.638 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.609+0000 7fb1c234a640 1 --2- 10.20.193.58:0/1663732903 >> [v2:10.20.193.93:6818/2960650087,v1:10.20.193.93:6820/2960650087] conn(0x7fb18c0a1d60 0x7fb18c0c2190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.638 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.609+0000 7ff14490c640 1 --2- 10.20.193.58:0/2933202033 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff10c07a800 0x7ff10c09acb0 secure :-1 s=READY pgs=75 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff134005970 tx=0x7ff134005900 comp rx=0 tx=0).stop 2026-02-23T06:21:37.638 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.609+0000 7fa5c7fff640 1 --2- 10.20.193.58:0/4068123549 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa59807a780 0x7fa59809ac30 secure :-1 s=READY pgs=79 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5b4005b30 tx=0x7fa5b400c040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.638 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.609+0000 7ff14490c640 1 -- 10.20.193.58:0/2933202033 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff13c0b1910 msgr2=0x7ff13c161030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.638 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.609+0000 7fbd3d841640 1 --2- 10.20.193.58:0/3755308073 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd380b1170 0x7fbd3805c950 secure :-1 s=READY pgs=134 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd20004740 tx=0x7fbd20002a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.609+0000 7ff14490c640 1 --2- 10.20.193.58:0/2933202033 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff13c0b1910 0x7ff13c161030 secure :-1 s=READY pgs=125 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1280027d0 tx=0x7ff12800c970 comp rx=0 tx=0).stop 2026-02-23T06:21:37.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.609+0000 7ff142e82640 1 -- 10.20.193.58:0/2933202033 reap_dead start 2026-02-23T06:21:37.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.609+0000 7fac799d2640 1 -- 10.20.193.58:0/1727461241 wait complete. 2026-02-23T06:21:37.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.609+0000 7ff14490c640 1 -- 10.20.193.58:0/2933202033 shutdown_connections 2026-02-23T06:21:37.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.609+0000 7ff14490c640 1 -- 10.20.193.58:0/2933202033 >> 10.20.193.58:0/2933202033 conn(0x7ff13c058e50 msgr2=0x7ff13c1641d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.610+0000 7fa5c4ff9640 1 -- 10.20.193.58:0/4068123549 <== osd.5 v2:10.20.193.93:6802/356968280 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7fa5980c2750 con 0x7fa5980a1c50 2026-02-23T06:21:37.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.610+0000 7fbd2e7fc640 1 -- 10.20.193.58:0/3755308073 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd2003c040 con 0x7fbd380b1170 2026-02-23T06:21:37.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.610+0000 7fbd2e7fc640 1 -- 10.20.193.58:0/3755308073 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd20038470 con 0x7fbd380b1170 2026-02-23T06:21:37.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.610+0000 7fbd2e7fc640 1 -- 10.20.193.58:0/3755308073 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd20038840 con 0x7fbd380b1170 2026-02-23T06:21:37.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.610+0000 7fbd3facc640 1 -- 10.20.193.58:0/3755308073 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd3805e8a0 con 0x7fbd380b1170 2026-02-23T06:21:37.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.610+0000 7fbd3facc640 1 -- 10.20.193.58:0/3755308073 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd380ae690 con 0x7fbd380b1170 2026-02-23T06:21:37.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.611+0000 7fbd3facc640 1 -- 10.20.193.58:0/3755308073 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbd38166fe0 con 0x7fbd380b1170 2026-02-23T06:21:37.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.610+0000 7fb1c1348640 1 --2- 10.20.193.58:0/1663732903 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb18c07a810 0x7fb18c09acc0 secure :-1 s=READY pgs=80 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1b4006240 tx=0x7fb1b000b410 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.610+0000 7fb1c234a640 1 --2- 10.20.193.58:0/1663732903 >> [v2:10.20.193.93:6818/2960650087,v1:10.20.193.93:6820/2960650087] conn(0x7fb18c0a1d60 0x7fb18c0c2190 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.611+0000 7fb1aa7fc640 1 -- 10.20.193.58:0/1663732903 <== osd.7 v2:10.20.193.93:6818/2960650087 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7fb18c0c2860 con 0x7fb18c0a1d60 2026-02-23T06:21:37.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.609+0000 7ff14490c640 1 -- 10.20.193.58:0/2933202033 shutdown_connections 2026-02-23T06:21:37.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.612+0000 7ff14490c640 1 -- 10.20.193.58:0/2933202033 wait complete. 2026-02-23T06:21:37.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.612+0000 7fb35dd1c640 1 -- 10.20.193.58:0/3988902682 --> [v2:10.20.193.58:6816/2858636994,v1:10.20.193.58:6817/2858636994] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb3500feea0 con 0x7fb3280a1c00 2026-02-23T06:21:37.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.613+0000 7fbd2e7fc640 1 -- 10.20.193.58:0/3755308073 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fbd200389a0 con 0x7fbd380b1170 2026-02-23T06:21:37.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.614+0000 7f6e30c43640 1 -- 10.20.193.58:0/745799557 --> [v2:10.20.193.58:6800/1850584280,v1:10.20.193.58:6801/1850584280] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6e240fa230 con 0x7f6dfc0a1c70 2026-02-23T06:21:37.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.614+0000 7f6e03fff640 1 -- 10.20.193.58:0/745799557 <== osd.1 v2:10.20.193.58:6800/1850584280 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6e2000a5a0 con 0x7f6dfc0a1c70 2026-02-23T06:21:37.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.614+0000 7f6e30c43640 1 -- 10.20.193.58:0/745799557 >> [v2:10.20.193.58:6800/1850584280,v1:10.20.193.58:6801/1850584280] conn(0x7f6dfc0a1c70 msgr2=0x7f6dfc0c20a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.614+0000 7f6e30c43640 1 --2- 10.20.193.58:0/745799557 >> [v2:10.20.193.58:6800/1850584280,v1:10.20.193.58:6801/1850584280] conn(0x7f6dfc0a1c70 0x7f6dfc0c20a0 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.614+0000 7f6e30c43640 1 -- 10.20.193.58:0/745799557 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6dfc07a720 msgr2=0x7f6dfc09abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.614+0000 7f6e30c43640 1 --2- 10.20.193.58:0/745799557 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6dfc07a720 0x7f6dfc09abd0 secure :-1 s=READY pgs=76 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e240db670 tx=0x7f6e1c008040 comp rx=0 tx=0).stop 2026-02-23T06:21:37.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.614+0000 7f6e30c43640 1 -- 10.20.193.58:0/745799557 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6e2400c0f0 msgr2=0x7f6e240bca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.614+0000 7f6e30c43640 1 --2- 10.20.193.58:0/745799557 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6e2400c0f0 0x7f6e240bca50 secure :-1 s=READY pgs=128 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e1402fe10 tx=0x7f6e140028d0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.615+0000 7f6e2bfff640 1 -- 10.20.193.58:0/745799557 reap_dead start 2026-02-23T06:21:37.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.615+0000 7fe24dbed640 1 -- 10.20.193.58:0/946453996 --> [v2:10.20.193.58:6823/4284600061,v1:10.20.193.58:6825/4284600061] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe208002da0 con 0x7fe2180a29a0 2026-02-23T06:21:37.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.615+0000 7fb34d7fa640 1 -- 10.20.193.58:0/3988902682 <== osd.3 v2:10.20.193.58:6816/2858636994 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb34803f040 con 0x7fb3280a1c00 2026-02-23T06:21:37.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.615+0000 7f6e30c43640 1 -- 10.20.193.58:0/745799557 shutdown_connections 2026-02-23T06:21:37.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.615+0000 7f6e30c43640 1 -- 10.20.193.58:0/745799557 >> 10.20.193.58:0/745799557 conn(0x7f6e2400a260 msgr2=0x7f6e240d7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.615+0000 7fbd2e7fc640 1 --2- 10.20.193.58:0/3755308073 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbd0807a790 0x7fbd0809ac40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.615+0000 7fbd2e7fc640 1 -- 10.20.193.58:0/3755308073 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7fbd2002fe40 con 0x7fbd380b1170 2026-02-23T06:21:37.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.615+0000 7fbd3d040640 1 --2- 10.20.193.58:0/3755308073 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbd0807a790 0x7fbd0809ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.615+0000 7fbd2e7fc640 1 --2- 10.20.193.58:0/3755308073 >> [v2:10.20.193.93:6819/2948039088,v1:10.20.193.93:6821/2948039088] conn(0x7fbd080a1ce0 0x7fbd080c2110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.615+0000 7f6e30c43640 1 -- 10.20.193.58:0/745799557 shutdown_connections 2026-02-23T06:21:37.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.615+0000 7f6e30c43640 1 -- 10.20.193.58:0/745799557 wait complete. 2026-02-23T06:21:37.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.615+0000 7fb35dd1c640 1 -- 10.20.193.58:0/3988902682 >> [v2:10.20.193.58:6816/2858636994,v1:10.20.193.58:6817/2858636994] conn(0x7fb3280a1c00 msgr2=0x7fb3280c2030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.615+0000 7fb35dd1c640 1 --2- 10.20.193.58:0/3988902682 >> [v2:10.20.193.58:6816/2858636994,v1:10.20.193.58:6817/2858636994] conn(0x7fb3280a1c00 0x7fb3280c2030 crc :-1 s=READY pgs=9 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.615+0000 7fbd2e7fc640 1 -- 10.20.193.58:0/3755308073 --> [v2:10.20.193.93:6819/2948039088,v1:10.20.193.93:6821/2948039088] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd080c27e0 con 0x7fbd080a1ce0 2026-02-23T06:21:37.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.615+0000 7fbd2e7fc640 1 -- 10.20.193.58:0/3755308073 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbd200c72a0 con 0x7fbd380b1170 2026-02-23T06:21:37.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.616+0000 7fbd3e042640 1 --2- 10.20.193.58:0/3755308073 >> [v2:10.20.193.93:6819/2948039088,v1:10.20.193.93:6821/2948039088] conn(0x7fbd080a1ce0 0x7fbd080c2110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.616+0000 7fe223fff640 1 -- 10.20.193.58:0/946453996 <== osd.2 v2:10.20.193.58:6823/4284600061 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe208002da0 con 0x7fe2180a29a0 2026-02-23T06:21:37.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.616+0000 7fbd3d040640 1 --2- 10.20.193.58:0/3755308073 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbd0807a790 0x7fbd0809ac40 secure :-1 s=READY pgs=81 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd28005e50 tx=0x7fbd28005de0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.616+0000 7fe24dbed640 1 -- 10.20.193.58:0/946453996 >> [v2:10.20.193.58:6823/4284600061,v1:10.20.193.58:6825/4284600061] conn(0x7fe2180a29a0 msgr2=0x7fe2180c2e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.616+0000 7fe24dbed640 1 --2- 10.20.193.58:0/946453996 >> [v2:10.20.193.58:6823/4284600061,v1:10.20.193.58:6825/4284600061] conn(0x7fe2180a29a0 0x7fe2180c2e30 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.616+0000 7fbd3e042640 1 --2- 10.20.193.58:0/3755308073 >> [v2:10.20.193.93:6819/2948039088,v1:10.20.193.93:6821/2948039088] conn(0x7fbd080a1ce0 0x7fbd080c2110 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.616+0000 7fe24dbed640 1 -- 10.20.193.58:0/946453996 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe21807a6b0 msgr2=0x7fe21809ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.617+0000 7fe24dbed640 1 --2- 10.20.193.58:0/946453996 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe21807a6b0 0x7fe21809ab60 secure :-1 s=READY pgs=77 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe248117660 tx=0x7fe234009040 comp rx=0 tx=0).stop 2026-02-23T06:21:37.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.617+0000 7fe24dbed640 1 -- 10.20.193.58:0/946453996 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2480b1540 msgr2=0x7fe2481682d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.617+0000 7fe24dbed640 1 --2- 10.20.193.58:0/946453996 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2480b1540 0x7fe2481682d0 secure :-1 s=READY pgs=129 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe238004740 tx=0x7fe2380046b0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.617+0000 7fe247fff640 1 -- 10.20.193.58:0/946453996 reap_dead start 2026-02-23T06:21:37.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.617+0000 7fe24dbed640 1 -- 10.20.193.58:0/946453996 shutdown_connections 2026-02-23T06:21:37.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.617+0000 7fe24dbed640 1 -- 10.20.193.58:0/946453996 >> 10.20.193.58:0/946453996 conn(0x7fe248058e50 msgr2=0x7fe248163a50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.617+0000 7fe24dbed640 1 -- 10.20.193.58:0/946453996 shutdown_connections 2026-02-23T06:21:37.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.617+0000 7fe24dbed640 1 -- 10.20.193.58:0/946453996 wait complete. 2026-02-23T06:21:37.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.615+0000 7fb35dd1c640 1 -- 10.20.193.58:0/3988902682 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb32807a6c0 msgr2=0x7fb32809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.618+0000 7fb35dd1c640 1 --2- 10.20.193.58:0/3988902682 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb32807a6c0 0x7fb32809ab70 secure :-1 s=READY pgs=78 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb340005fd0 tx=0x7fb34000a580 comp rx=0 tx=0).stop 2026-02-23T06:21:37.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.618+0000 7fb35dd1c640 1 -- 10.20.193.58:0/3988902682 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3500fb710 msgr2=0x7fb3500d6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.618+0000 7fb35dd1c640 1 --2- 10.20.193.58:0/3988902682 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3500fb710 0x7fb3500d6890 secure :-1 s=READY pgs=128 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb35400f940 tx=0x7fb35400fe10 comp rx=0 tx=0).stop 2026-02-23T06:21:37.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.617+0000 7fbd2e7fc640 1 -- 10.20.193.58:0/3755308073 <== osd.6 v2:10.20.193.93:6819/2948039088 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7fbd080c27e0 con 0x7fbd080a1ce0 2026-02-23T06:21:37.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.620+0000 7fb35d51b640 1 -- 10.20.193.58:0/3988902682 reap_dead start 2026-02-23T06:21:37.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.620+0000 7fa5a27fc640 1 -- 10.20.193.58:0/4068123549 --> [v2:10.20.193.93:6802/356968280,v1:10.20.193.93:6804/356968280] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa5c80b7540 con 0x7fa5980a1c50 2026-02-23T06:21:37.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.620+0000 7fa5c4ff9640 1 -- 10.20.193.58:0/4068123549 <== osd.5 v2:10.20.193.93:6802/356968280 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa5bc003a40 con 0x7fa5980a1c50 2026-02-23T06:21:37.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.621+0000 7fb35dd1c640 1 -- 10.20.193.58:0/3988902682 shutdown_connections 2026-02-23T06:21:37.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.621+0000 7fb35dd1c640 1 -- 10.20.193.58:0/3988902682 >> 10.20.193.58:0/3988902682 conn(0x7fb35000a260 msgr2=0x7fb3500506e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.622+0000 7fb35dd1c640 1 -- 10.20.193.58:0/3988902682 shutdown_connections 2026-02-23T06:21:37.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.622+0000 7fb35dd1c640 1 -- 10.20.193.58:0/3988902682 wait complete. 2026-02-23T06:21:37.646 INFO:teuthology.orchestra.run.trial058.stdout:55834574856 2026-02-23T06:21:37.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.622+0000 7fa5a27fc640 1 -- 10.20.193.58:0/4068123549 >> [v2:10.20.193.93:6802/356968280,v1:10.20.193.93:6804/356968280] conn(0x7fa5980a1c50 msgr2=0x7fa5980c2080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.622+0000 7fa5a27fc640 1 --2- 10.20.193.58:0/4068123549 >> [v2:10.20.193.93:6802/356968280,v1:10.20.193.93:6804/356968280] conn(0x7fa5980a1c50 0x7fa5980c2080 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.622+0000 7fa5a27fc640 1 -- 10.20.193.58:0/4068123549 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa59807a780 msgr2=0x7fa59809ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.622+0000 7fa5a27fc640 1 --2- 10.20.193.58:0/4068123549 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa59807a780 0x7fa59809ac30 secure :-1 s=READY pgs=79 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5b4005b30 tx=0x7fa5b400c040 comp rx=0 tx=0).stop 2026-02-23T06:21:37.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.622+0000 7fa5a27fc640 1 -- 10.20.193.58:0/4068123549 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa5c80b1910 msgr2=0x7fa5c81604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.622+0000 7fa5a27fc640 1 --2- 10.20.193.58:0/4068123549 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa5c80b1910 0x7fa5c81604e0 secure :-1 s=READY pgs=133 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5c8162190 tx=0x7fa5b8002950 comp rx=0 tx=0).stop 2026-02-23T06:21:37.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.622+0000 7fa5cce82640 1 -- 10.20.193.58:0/4068123549 reap_dead start 2026-02-23T06:21:37.647 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-23T06:21:37.647 INFO:teuthology.orchestra.run.trial058.stdout:55834574857 2026-02-23T06:21:37.647 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-23T06:21:37.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.625+0000 7fa5a27fc640 1 -- 10.20.193.58:0/4068123549 shutdown_connections 2026-02-23T06:21:37.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.625+0000 7fa5a27fc640 1 -- 10.20.193.58:0/4068123549 >> 10.20.193.58:0/4068123549 conn(0x7fa5c8058e50 msgr2=0x7fa5c8151c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.625+0000 7fb1c2b4b640 1 -- 10.20.193.58:0/1663732903 --> [v2:10.20.193.93:6818/2960650087,v1:10.20.193.93:6820/2960650087] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb1b40fe7c0 con 0x7fb18c0a1d60 2026-02-23T06:21:37.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.625+0000 7fb1aa7fc640 1 -- 10.20.193.58:0/1663732903 <== osd.7 v2:10.20.193.93:6818/2960650087 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb18c0c2860 con 0x7fb18c0a1d60 2026-02-23T06:21:37.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.625+0000 7fa5a27fc640 1 -- 10.20.193.58:0/4068123549 shutdown_connections 2026-02-23T06:21:37.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.625+0000 7fb1c2b4b640 1 -- 10.20.193.58:0/1663732903 >> [v2:10.20.193.93:6818/2960650087,v1:10.20.193.93:6820/2960650087] conn(0x7fb18c0a1d60 msgr2=0x7fb18c0c2190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.625+0000 7fb1c2b4b640 1 --2- 10.20.193.58:0/1663732903 >> [v2:10.20.193.93:6818/2960650087,v1:10.20.193.93:6820/2960650087] conn(0x7fb18c0a1d60 0x7fb18c0c2190 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.625+0000 7fa5a27fc640 1 -- 10.20.193.58:0/4068123549 wait complete. 2026-02-23T06:21:37.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.625+0000 7fb1c2b4b640 1 -- 10.20.193.58:0/1663732903 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb18c07a810 msgr2=0x7fb18c09acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.625+0000 7fb1c2b4b640 1 --2- 10.20.193.58:0/1663732903 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb18c07a810 0x7fb18c09acc0 secure :-1 s=READY pgs=80 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1b4006240 tx=0x7fb1b000b410 comp rx=0 tx=0).stop 2026-02-23T06:21:37.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.625+0000 7fb1c2b4b640 1 -- 10.20.193.58:0/1663732903 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb1b4053c10 msgr2=0x7fb1b40d9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.625+0000 7fb1c2b4b640 1 --2- 10.20.193.58:0/1663732903 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb1b4053c10 0x7fb1b40d9460 secure :-1 s=READY pgs=132 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1b800d7d0 tx=0x7fb1b800dca0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.625+0000 7fb1c234a640 1 -- 10.20.193.58:0/1663732903 reap_dead start 2026-02-23T06:21:37.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.626+0000 7fb1c2b4b640 1 -- 10.20.193.58:0/1663732903 shutdown_connections 2026-02-23T06:21:37.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.626+0000 7fb1c2b4b640 1 -- 10.20.193.58:0/1663732903 >> 10.20.193.58:0/1663732903 conn(0x7fb1b4054ad0 msgr2=0x7fb1b4049990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.626+0000 7fb1c2b4b640 1 -- 10.20.193.58:0/1663732903 shutdown_connections 2026-02-23T06:21:37.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.626+0000 7fb1c2b4b640 1 -- 10.20.193.58:0/1663732903 wait complete. 2026-02-23T06:21:37.649 INFO:teuthology.orchestra.run.trial058.stdout:55834574856 2026-02-23T06:21:37.649 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-23T06:21:37.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.628+0000 7fbd3facc640 1 -- 10.20.193.58:0/3755308073 --> [v2:10.20.193.93:6819/2948039088,v1:10.20.193.93:6821/2948039088] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbd38166d00 con 0x7fbd080a1ce0 2026-02-23T06:21:37.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.630+0000 7fbd2e7fc640 1 -- 10.20.193.58:0/3755308073 <== osd.6 v2:10.20.193.93:6819/2948039088 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbd34003a40 con 0x7fbd080a1ce0 2026-02-23T06:21:37.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.630+0000 7fbd3facc640 1 -- 10.20.193.58:0/3755308073 >> [v2:10.20.193.93:6819/2948039088,v1:10.20.193.93:6821/2948039088] conn(0x7fbd080a1ce0 msgr2=0x7fbd080c2110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.630+0000 7fbd3facc640 1 --2- 10.20.193.58:0/3755308073 >> [v2:10.20.193.93:6819/2948039088,v1:10.20.193.93:6821/2948039088] conn(0x7fbd080a1ce0 0x7fbd080c2110 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.630+0000 7fbd3facc640 1 -- 10.20.193.58:0/3755308073 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbd0807a790 msgr2=0x7fbd0809ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.630+0000 7fbd3facc640 1 --2- 10.20.193.58:0/3755308073 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbd0807a790 0x7fbd0809ac40 secure :-1 s=READY pgs=81 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd28005e50 tx=0x7fbd28005de0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.630+0000 7fbd3facc640 1 -- 10.20.193.58:0/3755308073 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd380b1170 msgr2=0x7fbd3805c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.630+0000 7fbd3facc640 1 --2- 10.20.193.58:0/3755308073 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd380b1170 0x7fbd3805c950 secure :-1 s=READY pgs=134 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd20004740 tx=0x7fbd20002a10 comp rx=0 tx=0).stop 2026-02-23T06:21:37.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.630+0000 7fbd3e042640 1 -- 10.20.193.58:0/3755308073 reap_dead start 2026-02-23T06:21:37.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.630+0000 7fbd3facc640 1 -- 10.20.193.58:0/3755308073 shutdown_connections 2026-02-23T06:21:37.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.630+0000 7fbd3facc640 1 -- 10.20.193.58:0/3755308073 >> 10.20.193.58:0/3755308073 conn(0x7fbd38058e50 msgr2=0x7fbd381358c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.630+0000 7fbd3facc640 1 -- 10.20.193.58:0/3755308073 shutdown_connections 2026-02-23T06:21:37.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.630+0000 7fbd3facc640 1 -- 10.20.193.58:0/3755308073 wait complete. 2026-02-23T06:21:37.651 INFO:teuthology.orchestra.run.trial058.stdout:55834574856 2026-02-23T06:21:37.651 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-23T06:21:37.651 INFO:teuthology.orchestra.run.trial058.stdout:55834574857 2026-02-23T06:21:37.651 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-23T06:21:37.652 INFO:teuthology.orchestra.run.trial058.stdout:55834574856 2026-02-23T06:21:37.652 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-23T06:21:37.652 INFO:teuthology.orchestra.run.trial058.stdout:55834574857 2026-02-23T06:21:37.652 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-23T06:21:37.653 INFO:teuthology.orchestra.run.trial058.stdout:55834574857 2026-02-23T06:21:37.653 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-23T06:21:37.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.840+0000 7f36bb4b8640 1 -- 10.20.193.58:0/3279424393 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f36b40b1910 msgr2=0x7f36b40b6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.840+0000 7f36bb4b8640 1 --2- 10.20.193.58:0/3279424393 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f36b40b1910 0x7f36b40b6a00 secure :-1 s=READY pgs=66 gs=2 cs=0 l=1 c_cookie=11316308222943161021 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f36b405e840 tx=0x7f36a802f2f0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.840+0000 7fea4aa83640 1 -- 10.20.193.58:0/4259246958 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fea24003ad0 msgr2=0x7fea24003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.840+0000 7fea4aa83640 1 --2- 10.20.193.58:0/4259246958 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fea24003ad0 0x7fea24003ee0 secure :-1 s=READY pgs=136 gs=4 cs=0 l=1 c_cookie=17170933759968529340 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea3c00cbf0 tx=0x7fea3c030810 comp rx=0 tx=0).stop 2026-02-23T06:21:37.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.840+0000 7fea4a282640 1 -- 10.20.193.58:0/4259246958 reap_dead start 2026-02-23T06:21:37.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.840+0000 7f36bb4b8640 1 -- 10.20.193.58:0/3279424393 shutdown_connections 2026-02-23T06:21:37.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.840+0000 7f36bb4b8640 1 --2- 10.20.193.58:0/3279424393 >> v2:10.20.193.93:3300/0 conn(0x7f36b40b39f0 0x7f36b40b6f40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.840+0000 7f36bb4b8640 1 --2- 10.20.193.58:0/3279424393 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f36b40b1910 0x7f36b40b6a00 unknown :-1 s=CLOSED pgs=66 gs=2 cs=0 l=1 c_cookie=11316308222943161021 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.840+0000 7f36bb4b8640 1 --2- 10.20.193.58:0/3279424393 >> v2:10.20.193.58:3300/0 conn(0x7f36b40b1540 0x7f36b40b5610 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.840+0000 7f36bb4b8640 1 -- 10.20.193.58:0/3279424393 >> 10.20.193.58:0/3279424393 conn(0x7f36b4058e50 msgr2=0x7f36b4059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.840+0000 7f36bb4b8640 1 -- 10.20.193.58:0/3279424393 shutdown_connections 2026-02-23T06:21:37.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.840+0000 7fea4aa83640 1 -- 10.20.193.58:0/4259246958 shutdown_connections 2026-02-23T06:21:37.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.840+0000 7fea4aa83640 1 -- 10.20.193.58:0/4259246958 >> 10.20.193.58:0/4259246958 conn(0x7fea440b3c20 msgr2=0x7fea440b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.840+0000 7f36bb4b8640 1 -- 10.20.193.58:0/3279424393 wait complete. 2026-02-23T06:21:37.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.840+0000 7fea4aa83640 1 -- 10.20.193.58:0/4259246958 shutdown_connections 2026-02-23T06:21:37.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.840+0000 7fea4aa83640 1 -- 10.20.193.58:0/4259246958 wait complete. 2026-02-23T06:21:37.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.842+0000 7fea4aa83640 1 Processor -- start 2026-02-23T06:21:37.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.842+0000 7fea4aa83640 1 -- start start 2026-02-23T06:21:37.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.842+0000 7f36bb4b8640 1 Processor -- start 2026-02-23T06:21:37.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.842+0000 7f36bb4b8640 1 -- start start 2026-02-23T06:21:37.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.843+0000 7f36bb4b8640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f36b40b1540 0x7f36b41367f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.843+0000 7f36bb4b8640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f36b40b1910 0x7f36b4130580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.843+0000 7f36bb4b8640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f36b40b39f0 0x7f36b4130ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.843+0000 7f36bb4b8640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f36b4157bc0 con 0x7f36b40b1910 2026-02-23T06:21:37.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.843+0000 7f36bb4b8640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f36b41413f0 con 0x7f36b40b1540 2026-02-23T06:21:37.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.843+0000 7f36bb4b8640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f36b4141110 con 0x7f36b40b39f0 2026-02-23T06:21:37.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.843+0000 7f36b922d640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f36b40b1540 0x7f36b41367f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.843+0000 7f36b922d640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f36b40b1540 0x7f36b41367f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:50516/0 (socket says 10.20.193.58:50516) 2026-02-23T06:21:37.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.843+0000 7f36b922d640 1 -- 10.20.193.58:0/3860701043 learned_addr learned my addr 10.20.193.58:0/3860701043 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:37.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.843+0000 7f36b9a2e640 1 --2- 10.20.193.58:0/3860701043 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f36b40b39f0 0x7f36b4130ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.843+0000 7f36b8a2c640 1 --2- 10.20.193.58:0/3860701043 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f36b40b1910 0x7f36b4130580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.844+0000 7f36b922d640 1 -- 10.20.193.58:0/3860701043 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f36b40b39f0 msgr2=0x7f36b4130ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.842 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.844+0000 7f36b922d640 1 --2- 10.20.193.58:0/3860701043 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f36b40b39f0 0x7f36b4130ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.842 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.844+0000 7f36b922d640 1 -- 10.20.193.58:0/3860701043 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f36b40b1910 msgr2=0x7f36b4130580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.842 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.844+0000 7f36b922d640 1 --2- 10.20.193.58:0/3860701043 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f36b40b1910 0x7f36b4130580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.842 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.844+0000 7fea4aa83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fea44132170 0x7fea441349d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.842 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.844+0000 7f36b922d640 1 -- 10.20.193.58:0/3860701043 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a8009570 con 0x7f36b40b1540 2026-02-23T06:21:37.843 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.844+0000 7fea4aa83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fea44132540 0x7fea44156890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.843 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.844+0000 7f36b8a2c640 1 --2- 10.20.193.58:0/3860701043 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f36b40b1910 0x7f36b4130580 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:37.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.844+0000 7fea4aa83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fea44135460 0x7fea44156dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.845+0000 7fea4aa83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fea441faba0 con 0x7fea44135460 2026-02-23T06:21:37.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.845+0000 7fea4a282640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fea44135460 0x7fea44156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.845+0000 7fea4a282640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fea44135460 0x7fea44156dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50950/0 (socket says 10.20.193.58:50950) 2026-02-23T06:21:37.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.845+0000 7fea4a282640 1 -- 10.20.193.58:0/1446814127 learned_addr learned my addr 10.20.193.58:0/1446814127 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:37.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.845+0000 7fea4aa83640 1 -- 10.20.193.58:0/1446814127 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fea44131210 con 0x7fea44132540 2026-02-23T06:21:37.845 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.845+0000 7f36b922d640 1 --2- 10.20.193.58:0/3860701043 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f36b40b1540 0x7f36b41367f0 secure :-1 s=READY pgs=138 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f36a4009480 tx=0x7f36a400ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.845+0000 7fea49280640 1 --2- 10.20.193.58:0/1446814127 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fea44132540 0x7fea44156890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.845+0000 7fea4aa83640 1 -- 10.20.193.58:0/1446814127 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fea441fa8e0 con 0x7fea44132170 2026-02-23T06:21:37.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.845+0000 7fea49a81640 1 --2- 10.20.193.58:0/1446814127 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fea44132170 0x7fea441349d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.845+0000 7fea4a282640 1 -- 10.20.193.58:0/1446814127 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fea44132170 msgr2=0x7fea441349d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.845+0000 7fea4a282640 1 --2- 10.20.193.58:0/1446814127 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fea44132170 0x7fea441349d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.845+0000 7fea4a282640 1 -- 10.20.193.58:0/1446814127 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fea44132540 msgr2=0x7fea44156890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.845+0000 7fea4a282640 1 --2- 10.20.193.58:0/1446814127 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fea44132540 0x7fea44156890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.845+0000 7f36a1ffb640 1 -- 10.20.193.58:0/3860701043 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f36a400cc80 con 0x7f36b40b1540 2026-02-23T06:21:37.848 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.845+0000 7f36a1ffb640 1 -- 10.20.193.58:0/3860701043 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36a400cde0 con 0x7f36b40b1540 2026-02-23T06:21:37.848 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.845+0000 7f36bb4b8640 1 -- 10.20.193.58:0/3860701043 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36b412e240 con 0x7f36b40b1540 2026-02-23T06:21:37.848 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.845+0000 7fea4a282640 1 -- 10.20.193.58:0/1446814127 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea441552e0 con 0x7fea44135460 2026-02-23T06:21:37.848 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.845+0000 7f36a1ffb640 1 -- 10.20.193.58:0/3860701043 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f36a4004ad0 con 0x7f36b40b1540 2026-02-23T06:21:37.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.845+0000 7fea49a81640 1 --2- 10.20.193.58:0/1446814127 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fea44132170 0x7fea441349d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:21:37.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.845+0000 7fea49280640 1 --2- 10.20.193.58:0/1446814127 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fea44132540 0x7fea44156890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:37.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.846+0000 7fea4a282640 1 --2- 10.20.193.58:0/1446814127 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fea44135460 0x7fea44156dd0 secure :-1 s=READY pgs=132 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea38004740 tx=0x7fea380088a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.846+0000 7fea327fc640 1 -- 10.20.193.58:0/1446814127 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea3800f050 con 0x7fea44135460 2026-02-23T06:21:37.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.846+0000 7fea4aa83640 1 -- 10.20.193.58:0/1446814127 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea44130c50 con 0x7fea44135460 2026-02-23T06:21:37.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.846+0000 7fea4aa83640 1 -- 10.20.193.58:0/1446814127 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea441341d0 con 0x7fea44135460 2026-02-23T06:21:37.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.846+0000 7ff169ffb640 1 -- 10.20.193.58:0/1214509512 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff15402fcd0 con 0x7ff16c15b4c0 2026-02-23T06:21:37.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.846+0000 7ff1714b8640 1 -- 10.20.193.58:0/1214509512 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff16c15b4c0 msgr2=0x7ff16c0b6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.846+0000 7ff1714b8640 1 --2- 10.20.193.58:0/1214509512 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff16c15b4c0 0x7ff16c0b6ef0 secure :-1 s=READY pgs=130 gs=1 cs=0 l=1 c_cookie=13094176457050750291 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff16c0b6370 tx=0x7ff15402f250 comp rx=0 tx=0).stop 2026-02-23T06:21:37.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.847+0000 7fea327fc640 1 -- 10.20.193.58:0/1446814127 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea38010040 con 0x7fea44135460 2026-02-23T06:21:37.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.847+0000 7f36bb4b8640 1 -- 10.20.193.58:0/3860701043 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36b412e800 con 0x7f36b40b1540 2026-02-23T06:21:37.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.847+0000 7fea4aa83640 1 -- 10.20.193.58:0/1446814127 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea44134030 con 0x7fea44135460 2026-02-23T06:21:37.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.847+0000 7fea327fc640 1 -- 10.20.193.58:0/1446814127 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea380042f0 con 0x7fea44135460 2026-02-23T06:21:37.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.848+0000 7ff1714b8640 1 -- 10.20.193.58:0/1214509512 shutdown_connections 2026-02-23T06:21:37.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.848+0000 7ff1714b8640 1 --2- 10.20.193.58:0/1214509512 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff16c0b3e70 0x7ff16c0b4c00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.848+0000 7ff1714b8640 1 --2- 10.20.193.58:0/1214509512 >> v2:10.20.193.93:3300/0 conn(0x7ff16c0b7430 0x7ff16c0b46c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.848+0000 7ff1714b8640 1 --2- 10.20.193.58:0/1214509512 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff16c15b4c0 0x7ff16c0b6ef0 unknown :-1 s=CLOSED pgs=130 gs=1 cs=0 l=1 c_cookie=13094176457050750291 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.848+0000 7ff1714b8640 1 -- 10.20.193.58:0/1214509512 >> 10.20.193.58:0/1214509512 conn(0x7ff16c058e50 msgr2=0x7ff16c059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.848+0000 7ff1714b8640 1 -- 10.20.193.58:0/1214509512 shutdown_connections 2026-02-23T06:21:37.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.848+0000 7f36a1ffb640 1 -- 10.20.193.58:0/3860701043 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f36a401f060 con 0x7f36b40b1540 2026-02-23T06:21:37.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.848+0000 7faa3ea36640 1 -- 10.20.193.58:0/1796154934 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa1c004850 msgr2=0x7faa1c004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.848+0000 7faa36ffd640 1 -- 10.20.193.58:0/1796154934 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa2802fb50 con 0x7faa1c004850 2026-02-23T06:21:37.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.848+0000 7faa3ea36640 1 --2- 10.20.193.58:0/1796154934 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa1c004850 0x7faa1c004cc0 secure :-1 s=READY pgs=67 gs=6 cs=0 l=1 c_cookie=11737794784631077904 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa28002ec0 tx=0x7faa2802f110 comp rx=0 tx=0).stop 2026-02-23T06:21:37.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.848+0000 7faa3ea36640 1 -- 10.20.193.58:0/1796154934 shutdown_connections 2026-02-23T06:21:37.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.848+0000 7faa3ea36640 1 --2- 10.20.193.58:0/1796154934 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa1c004850 0x7faa1c004cc0 unknown :-1 s=CLOSED pgs=67 gs=6 cs=0 l=1 c_cookie=11737794784631077904 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.848+0000 7faa3ea36640 1 -- 10.20.193.58:0/1796154934 >> 10.20.193.58:0/1796154934 conn(0x7faa38058e50 msgr2=0x7faa38059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.848+0000 7faa3ea36640 1 -- 10.20.193.58:0/1796154934 shutdown_connections 2026-02-23T06:21:37.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.848+0000 7faa3ea36640 1 -- 10.20.193.58:0/1796154934 wait complete. 2026-02-23T06:21:37.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.848+0000 7ff1714b8640 1 -- 10.20.193.58:0/1214509512 wait complete. 2026-02-23T06:21:37.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.849+0000 7f36bb4b8640 1 -- 10.20.193.58:0/3860701043 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36b40b5610 con 0x7f36b40b1540 2026-02-23T06:21:37.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.849+0000 7fea327fc640 1 -- 10.20.193.58:0/1446814127 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fea38027020 con 0x7fea44135460 2026-02-23T06:21:37.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.849+0000 7f36a1ffb640 1 --2- 10.20.193.58:0/3860701043 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f368c07a6c0 0x7f368c09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.849+0000 7f36a1ffb640 1 -- 10.20.193.58:0/3860701043 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f36a4014070 con 0x7f36b40b1540 2026-02-23T06:21:37.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.850+0000 7faa3ea36640 1 Processor -- start 2026-02-23T06:21:37.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.850+0000 7faa3ea36640 1 -- start start 2026-02-23T06:21:37.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.850+0000 7fea327fc640 1 --2- 10.20.193.58:0/1446814127 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fea2007a6c0 0x7fea2009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.850+0000 7fea327fc640 1 -- 10.20.193.58:0/1446814127 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7fea3809cb80 con 0x7fea44135460 2026-02-23T06:21:37.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.850+0000 7fea49a81640 1 --2- 10.20.193.58:0/1446814127 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fea2007a6c0 0x7fea2009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.851+0000 7fea49a81640 1 --2- 10.20.193.58:0/1446814127 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fea2007a6c0 0x7fea2009ab70 secure :-1 s=READY pgs=82 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea3c0034b0 tx=0x7fea3c005850 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.851+0000 7faa3ea36640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa1c004850 0x7faa3814ebb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.851+0000 7faa3ea36640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa381569c0 0x7faa3812ed40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.851+0000 7f36b8a2c640 1 --2- 10.20.193.58:0/3860701043 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f368c07a6c0 0x7f368c09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.851+0000 7faa3ea36640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa3812d4c0 0x7faa3812d930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.851+0000 7fca529d4640 1 -- 10.20.193.58:0/1418962058 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fca4c05b2d0 msgr2=0x7fca4c0b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.851+0000 7fca529d4640 1 --2- 10.20.193.58:0/1418962058 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fca4c05b2d0 0x7fca4c0b5610 secure :-1 s=READY pgs=68 gs=2 cs=0 l=1 c_cookie=16162692899433003751 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca3c005e70 tx=0x7fca3c02f290 comp rx=0 tx=0).stop 2026-02-23T06:21:37.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.851+0000 7faa3cfac640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa3812d4c0 0x7faa3812d930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.851+0000 7faa3cfac640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa3812d4c0 0x7faa3812d930 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:50572/0 (socket says 10.20.193.58:50572) 2026-02-23T06:21:37.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.851+0000 7faa3cfac640 1 -- 10.20.193.58:0/83309775 learned_addr learned my addr 10.20.193.58:0/83309775 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:37.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.851+0000 7faa377fe640 1 --2- 10.20.193.58:0/83309775 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa381569c0 0x7faa3812ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.852+0000 7faa3ea36640 1 -- 10.20.193.58:0/83309775 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7faa38157af0 con 0x7faa1c004850 2026-02-23T06:21:37.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.852+0000 7faa37fff640 1 --2- 10.20.193.58:0/83309775 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa1c004850 0x7faa3814ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.852+0000 7faa3ea36640 1 -- 10.20.193.58:0/83309775 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7faa38154ae0 con 0x7faa3812d4c0 2026-02-23T06:21:37.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.852+0000 7faa3ea36640 1 -- 10.20.193.58:0/83309775 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7faa38155ab0 con 0x7faa381569c0 2026-02-23T06:21:37.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.852+0000 7fba45483640 1 -- 10.20.193.58:0/2150949455 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba400b4e60 msgr2=0x7fba400b5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.852+0000 7fba45483640 1 --2- 10.20.193.58:0/2150949455 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba400b4e60 0x7fba400b5390 secure :-1 s=READY pgs=140 gs=3 cs=0 l=1 c_cookie=3741659663603270136 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba30004740 tx=0x7fba3002f2b0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.852+0000 7fba45483640 1 -- 10.20.193.58:0/2150949455 shutdown_connections 2026-02-23T06:21:37.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.852+0000 7fca529d4640 1 -- 10.20.193.58:0/1418962058 shutdown_connections 2026-02-23T06:21:37.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.852+0000 7fba45483640 1 --2- 10.20.193.58:0/2150949455 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba400b4e60 0x7fba400b5390 unknown :-1 s=CLOSED pgs=140 gs=3 cs=0 l=1 c_cookie=3741659663603270136 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.852+0000 7fca529d4640 1 --2- 10.20.193.58:0/1418962058 >> v2:10.20.193.93:3300/0 conn(0x7fca4c157670 0x7fca4c157aa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.852+0000 7fca529d4640 1 --2- 10.20.193.58:0/1418962058 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fca4c05b2d0 0x7fca4c0b5610 unknown :-1 s=CLOSED pgs=68 gs=2 cs=0 l=1 c_cookie=16162692899433003751 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.852+0000 7fca529d4640 1 -- 10.20.193.58:0/1418962058 >> 10.20.193.58:0/1418962058 conn(0x7fca4c058e50 msgr2=0x7fca4c059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.852+0000 7fba45483640 1 -- 10.20.193.58:0/2150949455 >> 10.20.193.58:0/2150949455 conn(0x7fba40059db0 msgr2=0x7fba4005a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.852+0000 7fba45483640 1 -- 10.20.193.58:0/2150949455 shutdown_connections 2026-02-23T06:21:37.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.852+0000 7faa3cfac640 1 -- 10.20.193.58:0/83309775 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa381569c0 msgr2=0x7faa3812ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.852+0000 7fca529d4640 1 -- 10.20.193.58:0/1418962058 shutdown_connections 2026-02-23T06:21:37.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.852+0000 7faa3cfac640 1 --2- 10.20.193.58:0/83309775 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa381569c0 0x7faa3812ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.852+0000 7faa3cfac640 1 -- 10.20.193.58:0/83309775 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa1c004850 msgr2=0x7faa3814ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.852+0000 7faa3cfac640 1 --2- 10.20.193.58:0/83309775 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa1c004850 0x7faa3814ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.852+0000 7ff1714b8640 1 Processor -- start 2026-02-23T06:21:37.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.852+0000 7fba45483640 1 -- 10.20.193.58:0/2150949455 wait complete. 2026-02-23T06:21:37.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.852+0000 7faa3cfac640 1 -- 10.20.193.58:0/83309775 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa38157570 con 0x7faa3812d4c0 2026-02-23T06:21:37.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.852+0000 7ff1714b8640 1 -- start start 2026-02-23T06:21:37.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.852+0000 7faa37fff640 1 --2- 10.20.193.58:0/83309775 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa1c004850 0x7faa3814ebb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:37.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.852+0000 7fca529d4640 1 -- 10.20.193.58:0/1418962058 wait complete. 2026-02-23T06:21:37.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.853+0000 7faa3cfac640 1 --2- 10.20.193.58:0/83309775 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa3812d4c0 0x7faa3812d930 secure :-1 s=READY pgs=141 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa2c011970 tx=0x7faa2c011a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.853+0000 7faa34ff9640 1 -- 10.20.193.58:0/83309775 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa2c005290 con 0x7faa3812d4c0 2026-02-23T06:21:37.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.853+0000 7faa34ff9640 1 -- 10.20.193.58:0/83309775 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa2c016070 con 0x7faa3812d4c0 2026-02-23T06:21:37.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.853+0000 7faa34ff9640 1 -- 10.20.193.58:0/83309775 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa2c005670 con 0x7faa3812d4c0 2026-02-23T06:21:37.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.853+0000 7fba45483640 1 Processor -- start 2026-02-23T06:21:37.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.853+0000 7fba45483640 1 -- start start 2026-02-23T06:21:37.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.853+0000 7f36b8a2c640 1 --2- 10.20.193.58:0/3860701043 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f368c07a6c0 0x7f368c09ab70 secure :-1 s=READY pgs=83 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f36a8005b30 tx=0x7f36a80047e0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.853+0000 7fb25f212640 1 -- 10.20.193.58:0/1510524993 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb2580b8d50 msgr2=0x7fb2580b80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.853+0000 7ff1714b8640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff16c0b3e70 0x7ff16c13a3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.853+0000 7faa3ea36640 1 -- 10.20.193.58:0/83309775 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa38157810 con 0x7faa3812d4c0 2026-02-23T06:21:37.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.853+0000 7faa3ea36640 1 -- 10.20.193.58:0/83309775 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa38154fd0 con 0x7faa3812d4c0 2026-02-23T06:21:37.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.853+0000 7ff1714b8640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff16c0b7430 0x7ff16c1418f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.853+0000 7fb25f212640 1 --2- 10.20.193.58:0/1510524993 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb2580b8d50 0x7fb2580b80c0 secure :-1 s=READY pgs=69 gs=2 cs=0 l=1 c_cookie=14235755861241281139 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb240004740 tx=0x7fb24002f280 comp rx=0 tx=0).stop 2026-02-23T06:21:37.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7ff1714b8640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff16c15b4c0 0x7ff16c200bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7ff1714b8640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff16c200780 con 0x7ff16c0b3e70 2026-02-23T06:21:37.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7ff1714b8640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff16c13fbb0 con 0x7ff16c15b4c0 2026-02-23T06:21:37.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7ff1714b8640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7ff16c13ac20 con 0x7ff16c0b7430 2026-02-23T06:21:37.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7fb25f212640 1 -- 10.20.193.58:0/1510524993 shutdown_connections 2026-02-23T06:21:37.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7fb25f212640 1 --2- 10.20.193.58:0/1510524993 >> v2:10.20.193.93:3300/0 conn(0x7fb258163b30 0x7fb258163fb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7faa3ea36640 1 -- 10.20.193.58:0/83309775 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa380b6310 con 0x7faa3812d4c0 2026-02-23T06:21:37.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7fb25f212640 1 --2- 10.20.193.58:0/1510524993 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb2580b8d50 0x7fb2580b80c0 unknown :-1 s=CLOSED pgs=69 gs=2 cs=0 l=1 c_cookie=14235755861241281139 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7fb25f212640 1 -- 10.20.193.58:0/1510524993 >> 10.20.193.58:0/1510524993 conn(0x7fb2580bb3b0 msgr2=0x7fb258057d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7fba45483640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba400b4e60 0x7fba4014ad70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7fba45483640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fba400b58d0 0x7fba40120510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7fba45483640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba4015c330 0x7fba40120a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7fb25f212640 1 -- 10.20.193.58:0/1510524993 shutdown_connections 2026-02-23T06:21:37.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7fb25f212640 1 -- 10.20.193.58:0/1510524993 wait complete. 2026-02-23T06:21:37.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7fba45483640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fba4011d6d0 con 0x7fba4015c330 2026-02-23T06:21:37.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7fba45483640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fba40165030 con 0x7fba400b4e60 2026-02-23T06:21:37.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7fba45483640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fba401654c0 con 0x7fba400b58d0 2026-02-23T06:21:37.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7fba3ffff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba400b4e60 0x7fba4014ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7fba44c82640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba4015c330 0x7fba40120a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7fba44c82640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba4015c330 0x7fba40120a50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50990/0 (socket says 10.20.193.58:50990) 2026-02-23T06:21:37.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7fba44c82640 1 -- 10.20.193.58:0/986329546 learned_addr learned my addr 10.20.193.58:0/986329546 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:37.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7fba3f7fe640 1 --2- 10.20.193.58:0/986329546 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fba400b58d0 0x7fba40120510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7ff16a7fc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff16c0b7430 0x7ff16c1418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7ff16a7fc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff16c0b7430 0x7ff16c1418f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:50936/0 (socket says 10.20.193.58:50936) 2026-02-23T06:21:37.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7ff16a7fc640 1 -- 10.20.193.58:0/3421086839 learned_addr learned my addr 10.20.193.58:0/3421086839 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:37.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7fba44c82640 1 -- 10.20.193.58:0/986329546 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fba400b58d0 msgr2=0x7fba40120510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7fba44c82640 1 --2- 10.20.193.58:0/986329546 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fba400b58d0 0x7fba40120510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7fba44c82640 1 -- 10.20.193.58:0/986329546 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba400b4e60 msgr2=0x7fba4014ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7fba44c82640 1 --2- 10.20.193.58:0/986329546 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba400b4e60 0x7fba4014ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7fba44c82640 1 -- 10.20.193.58:0/986329546 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba300094b0 con 0x7fba4015c330 2026-02-23T06:21:37.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.854+0000 7fba3f7fe640 1 --2- 10.20.193.58:0/986329546 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fba400b58d0 0x7fba40120510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:37.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.855+0000 7fba3ffff640 1 --2- 10.20.193.58:0/986329546 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba400b4e60 0x7fba4014ad70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:37.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.855+0000 7fba44c82640 1 --2- 10.20.193.58:0/986329546 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba4015c330 0x7fba40120a50 secure :-1 s=READY pgs=136 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba3400d730 tx=0x7fba3400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.855+0000 7fca529d4640 1 Processor -- start 2026-02-23T06:21:37.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.855+0000 7ff16affd640 1 --2- 10.20.193.58:0/3421086839 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff16c0b3e70 0x7ff16c13a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.855+0000 7ff16b7fe640 1 --2- 10.20.193.58:0/3421086839 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff16c15b4c0 0x7ff16c200bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.855+0000 7fca529d4640 1 -- start start 2026-02-23T06:21:37.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.855+0000 7faa34ff9640 1 -- 10.20.193.58:0/83309775 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7faa2c003780 con 0x7faa3812d4c0 2026-02-23T06:21:37.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.855+0000 7fe8db3a5640 1 -- 10.20.193.58:0/1894007149 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe8d40b1540 msgr2=0x7fe8d40b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.855+0000 7fe8db3a5640 1 --2- 10.20.193.58:0/1894007149 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe8d40b1540 0x7fe8d40b5610 secure :-1 s=READY pgs=70 gs=3 cs=0 l=1 c_cookie=12410035647636698092 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8c4005e70 tx=0x7fe8c4031420 comp rx=0 tx=0).stop 2026-02-23T06:21:37.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.855+0000 7fe8db3a5640 1 -- 10.20.193.58:0/1894007149 shutdown_connections 2026-02-23T06:21:37.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.855+0000 7fe8db3a5640 1 --2- 10.20.193.58:0/1894007149 >> v2:10.20.193.58:3300/0 conn(0x7fe8d4157d80 0x7fe8d40af1d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.855+0000 7fe8db3a5640 1 --2- 10.20.193.58:0/1894007149 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe8d40b1540 0x7fe8d40b5610 unknown :-1 s=CLOSED pgs=70 gs=3 cs=0 l=1 c_cookie=12410035647636698092 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.855+0000 7fe8db3a5640 1 -- 10.20.193.58:0/1894007149 >> 10.20.193.58:0/1894007149 conn(0x7fe8d4058e50 msgr2=0x7fe8d4059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.855+0000 7ff16affd640 1 -- 10.20.193.58:0/3421086839 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff16c0b7430 msgr2=0x7ff16c1418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.855+0000 7ff16affd640 1 --2- 10.20.193.58:0/3421086839 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff16c0b7430 0x7ff16c1418f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.855+0000 7ff16affd640 1 -- 10.20.193.58:0/3421086839 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff16c15b4c0 msgr2=0x7ff16c200bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.855+0000 7ff16affd640 1 --2- 10.20.193.58:0/3421086839 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff16c15b4c0 0x7ff16c200bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.855+0000 7ff16affd640 1 -- 10.20.193.58:0/3421086839 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff16000c050 con 0x7ff16c0b3e70 2026-02-23T06:21:37.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.855+0000 7fe8db3a5640 1 -- 10.20.193.58:0/1894007149 shutdown_connections 2026-02-23T06:21:37.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.855+0000 7fca529d4640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fca4c05b2d0 0x7fca4c156860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.856+0000 7fe8db3a5640 1 -- 10.20.193.58:0/1894007149 wait complete. 2026-02-23T06:21:37.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.855+0000 7ff16b7fe640 1 --2- 10.20.193.58:0/3421086839 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff16c15b4c0 0x7ff16c200bd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:37.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.855+0000 7ff16a7fc640 1 --2- 10.20.193.58:0/3421086839 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff16c0b7430 0x7ff16c1418f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:21:37.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.856+0000 7fca529d4640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fca4c157670 0x7fca4c132760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.856+0000 7fca529d4640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fca4c161d50 0x7fca4c1310e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.856+0000 7fca529d4640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fca4c130650 con 0x7fca4c161d50 2026-02-23T06:21:37.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.856+0000 7fca529d4640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fca4c0ae930 con 0x7fca4c05b2d0 2026-02-23T06:21:37.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.856+0000 7fca529d4640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fca4c0ae6e0 con 0x7fca4c157670 2026-02-23T06:21:37.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.856+0000 7fca4bfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fca4c05b2d0 0x7fca4c156860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.856+0000 7fca4bfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fca4c05b2d0 0x7fca4c156860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:50600/0 (socket says 10.20.193.58:50600) 2026-02-23T06:21:37.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.856+0000 7fca4bfff640 1 -- 10.20.193.58:0/466368010 learned_addr learned my addr 10.20.193.58:0/466368010 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:37.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.855+0000 7fb25f212640 1 Processor -- start 2026-02-23T06:21:37.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.856+0000 7fb25f212640 1 -- start start 2026-02-23T06:21:37.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.856+0000 7f36a1ffb640 1 -- 10.20.193.58:0/3860701043 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f36a40a2060 con 0x7f36b40b1540 2026-02-23T06:21:37.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.856+0000 7fba3cff9640 1 -- 10.20.193.58:0/986329546 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba34007b90 con 0x7fba4015c330 2026-02-23T06:21:37.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.856+0000 7fba3cff9640 1 -- 10.20.193.58:0/986329546 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba34007de0 con 0x7fba4015c330 2026-02-23T06:21:37.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.856+0000 7fba3cff9640 1 -- 10.20.193.58:0/986329546 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba34006280 con 0x7fba4015c330 2026-02-23T06:21:37.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.856+0000 7fea327fc640 1 -- 10.20.193.58:0/1446814127 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fea3805fe40 con 0x7fea44135460 2026-02-23T06:21:37.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.856+0000 7faa34ff9640 1 --2- 10.20.193.58:0/83309775 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa0807a7b0 0x7faa0809ac60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.856+0000 7faa34ff9640 1 -- 10.20.193.58:0/83309775 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7faa2c09e6c0 con 0x7faa3812d4c0 2026-02-23T06:21:37.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.856+0000 7faa34ff9640 1 -- 10.20.193.58:0/83309775 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7faa2c09eac0 con 0x7faa3812d4c0 2026-02-23T06:21:37.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.856+0000 7fba45483640 1 -- 10.20.193.58:0/986329546 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba4011e240 con 0x7fba4015c330 2026-02-23T06:21:37.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.856+0000 7fba45483640 1 -- 10.20.193.58:0/986329546 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba40164cc0 con 0x7fba4015c330 2026-02-23T06:21:37.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.857+0000 7faa37fff640 1 --2- 10.20.193.58:0/83309775 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa0807a7b0 0x7faa0809ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.857+0000 7fe8db3a5640 1 Processor -- start 2026-02-23T06:21:37.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.857+0000 7fb25f212640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb2580b8980 0x7fb25815d590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.857+0000 7fb25f212640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb2580b8d50 0x7fb2580a1270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.857+0000 7fb25f212640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb258163b30 0x7fb2580a17b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.857+0000 7faa37fff640 1 --2- 10.20.193.58:0/83309775 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa0807a7b0 0x7faa0809ac60 secure :-1 s=READY pgs=84 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa24002b30 tx=0x7faa240035d0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.857+0000 7fb25cf87640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb2580b8980 0x7fb25815d590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.857+0000 7fb25cf87640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb2580b8980 0x7fb25815d590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:50614/0 (socket says 10.20.193.58:50614) 2026-02-23T06:21:37.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.857+0000 7fb25cf87640 1 -- 10.20.193.58:0/946913166 learned_addr learned my addr 10.20.193.58:0/946913166 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:37.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.857+0000 7fb25f212640 1 -- 10.20.193.58:0/946913166 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb258205280 con 0x7fb258163b30 2026-02-23T06:21:37.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.857+0000 7fb25f212640 1 -- 10.20.193.58:0/946913166 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb2580b6070 con 0x7fb2580b8980 2026-02-23T06:21:37.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.857+0000 7fb25f212640 1 -- 10.20.193.58:0/946913166 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb25815dad0 con 0x7fb2580b8d50 2026-02-23T06:21:37.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.857+0000 7fe8db3a5640 1 -- start start 2026-02-23T06:21:37.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.858+0000 7fb24ffff640 1 --2- 10.20.193.58:0/946913166 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb2580b8d50 0x7fb2580a1270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.856+0000 7fca4bfff640 1 -- 10.20.193.58:0/466368010 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fca4c157670 msgr2=0x7fca4c132760 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-23T06:21:37.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.856+0000 7fca4bfff640 1 --2- 10.20.193.58:0/466368010 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fca4c157670 0x7fca4c132760 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.856+0000 7fca4bfff640 1 -- 10.20.193.58:0/466368010 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fca4c161d50 msgr2=0x7fca4c1310e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.856+0000 7fca4bfff640 1 --2- 10.20.193.58:0/466368010 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fca4c161d50 0x7fca4c1310e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.856+0000 7fca4bfff640 1 -- 10.20.193.58:0/466368010 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca3c009570 con 0x7fca4c05b2d0 2026-02-23T06:21:37.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.856+0000 7fca4bfff640 1 --2- 10.20.193.58:0/466368010 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fca4c05b2d0 0x7fca4c156860 secure :-1 s=READY pgs=143 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca3c0098a0 tx=0x7fca3c002c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.857+0000 7fca48ff9640 1 -- 10.20.193.58:0/466368010 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca3c02fd60 con 0x7fca4c05b2d0 2026-02-23T06:21:37.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.857+0000 7fca48ff9640 1 -- 10.20.193.58:0/466368010 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca3c002e70 con 0x7fca4c05b2d0 2026-02-23T06:21:37.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.857+0000 7fca48ff9640 1 -- 10.20.193.58:0/466368010 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca3c0388c0 con 0x7fca4c05b2d0 2026-02-23T06:21:37.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.857+0000 7fca529d4640 1 -- 10.20.193.58:0/466368010 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca4c15b060 con 0x7fca4c05b2d0 2026-02-23T06:21:37.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.858+0000 7fca529d4640 1 -- 10.20.193.58:0/466368010 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca4c131f60 con 0x7fca4c05b2d0 2026-02-23T06:21:37.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.858+0000 7fe8db3a5640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe8d40b1540 0x7fe8d4155460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.858+0000 7fe8db3a5640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe8d4157d80 0x7fe8d41559a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.858+0000 7fb25cf87640 1 -- 10.20.193.58:0/946913166 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb2580b8d50 msgr2=0x7fb2580a1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.858+0000 7fb25cf87640 1 --2- 10.20.193.58:0/946913166 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb2580b8d50 0x7fb2580a1270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.858+0000 7fb25cf87640 1 -- 10.20.193.58:0/946913166 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb258163b30 msgr2=0x7fb2580a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.858+0000 7fb25cf87640 1 --2- 10.20.193.58:0/946913166 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb258163b30 0x7fb2580a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.858+0000 7fb25cf87640 1 -- 10.20.193.58:0/946913166 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2400094b0 con 0x7fb2580b8980 2026-02-23T06:21:37.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.858+0000 7fe8db3a5640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe8d4161d50 0x7fe8d4144bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.858+0000 7fe8db3a5640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d4138370 con 0x7fe8d4157d80 2026-02-23T06:21:37.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.858+0000 7fe8db3a5640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d411df70 con 0x7fe8d4161d50 2026-02-23T06:21:37.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.858+0000 7fe8db3a5640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe8d4158210 con 0x7fe8d40b1540 2026-02-23T06:21:37.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.858+0000 7fba1a7fc640 1 -- 10.20.193.58:0/986329546 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba04005300 con 0x7fba4015c330 2026-02-23T06:21:37.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.858+0000 7ff16affd640 1 --2- 10.20.193.58:0/3421086839 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff16c0b3e70 0x7ff16c13a3e0 secure :-1 s=READY pgs=137 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff16c0b1e70 tx=0x7ff154002c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.858+0000 7fe8d8919640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe8d4157d80 0x7fe8d41559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.858+0000 7fb25cf87640 1 --2- 10.20.193.58:0/946913166 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb2580b8980 0x7fb25815d590 secure :-1 s=READY pgs=144 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb248007fd0 tx=0x7fb24800c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.858+0000 7fe8d8919640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe8d4157d80 0x7fe8d41559a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:51016/0 (socket says 10.20.193.58:51016) 2026-02-23T06:21:37.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.858+0000 7fe8d991b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe8d4161d50 0x7fe8d4144bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.858+0000 7fe8d991b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe8d4161d50 0x7fe8d4144bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:50622/0 (socket says 10.20.193.58:50622) 2026-02-23T06:21:37.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.858+0000 7fe8d991b640 1 -- 10.20.193.58:0/2704526744 learned_addr learned my addr 10.20.193.58:0/2704526744 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:37.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.859+0000 7fb24d7fa640 1 -- 10.20.193.58:0/946913166 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb248012850 con 0x7fb2580b8980 2026-02-23T06:21:37.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.859+0000 7fb24d7fa640 1 -- 10.20.193.58:0/946913166 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb248012aa0 con 0x7fb2580b8980 2026-02-23T06:21:37.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.859+0000 7fb24d7fa640 1 -- 10.20.193.58:0/946913166 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb248012e50 con 0x7fb2580b8980 2026-02-23T06:21:37.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.859+0000 7ff14b7fe640 1 -- 10.20.193.58:0/3421086839 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff1540388a0 con 0x7ff16c0b3e70 2026-02-23T06:21:37.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.859+0000 7fe8d911a640 1 --2- 10.20.193.58:0/2704526744 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe8d40b1540 0x7fe8d4155460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.859+0000 7fe8d8919640 1 -- 10.20.193.58:0/2704526744 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe8d40b1540 msgr2=0x7fe8d4155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.859+0000 7fe8d8919640 1 --2- 10.20.193.58:0/2704526744 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe8d40b1540 0x7fe8d4155460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.859+0000 7fe8d8919640 1 -- 10.20.193.58:0/2704526744 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe8d4161d50 msgr2=0x7fe8d4144bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.859+0000 7fe8d8919640 1 --2- 10.20.193.58:0/2704526744 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe8d4161d50 0x7fe8d4144bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.859+0000 7fe8d8919640 1 -- 10.20.193.58:0/2704526744 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c40081d0 con 0x7fe8d4157d80 2026-02-23T06:21:37.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.859+0000 7fe8d911a640 1 --2- 10.20.193.58:0/2704526744 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe8d40b1540 0x7fe8d4155460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:21:37.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.859+0000 7fb25f212640 1 -- 10.20.193.58:0/946913166 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2580b5d90 con 0x7fb2580b8980 2026-02-23T06:21:37.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.859+0000 7fb25f212640 1 -- 10.20.193.58:0/946913166 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb258169880 con 0x7fb2580b8980 2026-02-23T06:21:37.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.859+0000 7fe8d8919640 1 --2- 10.20.193.58:0/2704526744 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe8d4157d80 0x7fe8d41559a0 secure :-1 s=READY pgs=138 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8c8002730 tx=0x7fe8c800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.859+0000 7fca529d4640 1 -- 10.20.193.58:0/466368010 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca4c131da0 con 0x7fca4c05b2d0 2026-02-23T06:21:37.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.859+0000 7fe8c1ffb640 1 -- 10.20.193.58:0/2704526744 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe8c8006ab0 con 0x7fe8d4157d80 2026-02-23T06:21:37.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.859+0000 7ff14b7fe640 1 -- 10.20.193.58:0/3421086839 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff154038af0 con 0x7ff16c0b3e70 2026-02-23T06:21:37.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.859+0000 7fe8c1ffb640 1 -- 10.20.193.58:0/2704526744 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8c8006d00 con 0x7fe8d4157d80 2026-02-23T06:21:37.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.859+0000 7fe8c1ffb640 1 -- 10.20.193.58:0/2704526744 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe8c80072b0 con 0x7fe8d4157d80 2026-02-23T06:21:37.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.859+0000 7fe8db3a5640 1 -- 10.20.193.58:0/2704526744 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8d4145b50 con 0x7fe8d4157d80 2026-02-23T06:21:37.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.860+0000 7fe8db3a5640 1 -- 10.20.193.58:0/2704526744 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8d4156bb0 con 0x7fe8d4157d80 2026-02-23T06:21:37.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.860+0000 7fca48ff9640 1 -- 10.20.193.58:0/466368010 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fca3c038a20 con 0x7fca4c05b2d0 2026-02-23T06:21:37.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.860+0000 7fb25f212640 1 -- 10.20.193.58:0/946913166 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb25809e960 con 0x7fb2580b8980 2026-02-23T06:21:37.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.859+0000 7ff1714b8640 1 -- 10.20.193.58:0/3421086839 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff154009570 con 0x7ff16c0b3e70 2026-02-23T06:21:37.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.860+0000 7ff14b7fe640 1 -- 10.20.193.58:0/3421086839 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff154002e30 con 0x7ff16c0b3e70 2026-02-23T06:21:37.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.861+0000 7ff1714b8640 1 -- 10.20.193.58:0/3421086839 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff16c143210 con 0x7ff16c0b3e70 2026-02-23T06:21:37.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.861+0000 7fca48ff9640 1 --2- 10.20.193.58:0/466368010 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fca1c07a6c0 0x7fca1c09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.861+0000 7fca48ff9640 1 -- 10.20.193.58:0/466368010 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7fca3c0c22b0 con 0x7fca4c05b2d0 2026-02-23T06:21:37.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.861+0000 7fb24d7fa640 1 -- 10.20.193.58:0/946913166 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fb24801b410 con 0x7fb2580b8980 2026-02-23T06:21:37.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.861+0000 7fca4b7fe640 1 --2- 10.20.193.58:0/466368010 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fca1c07a6c0 0x7fca1c09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.862+0000 7fb24d7fa640 1 --2- 10.20.193.58:0/946913166 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb22807a810 0x7fb22809acc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.862+0000 7fb24d7fa640 1 -- 10.20.193.58:0/946913166 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7fb24809d640 con 0x7fb2580b8980 2026-02-23T06:21:37.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.862+0000 7fca4b7fe640 1 --2- 10.20.193.58:0/466368010 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fca1c07a6c0 0x7fca1c09ab70 secure :-1 s=READY pgs=85 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca4c1335d0 tx=0x7fca38007a10 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.862+0000 7fb24ffff640 1 --2- 10.20.193.58:0/946913166 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb22807a810 0x7fb22809acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.862+0000 7fba3cff9640 1 -- 10.20.193.58:0/986329546 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fba3401a030 con 0x7fba4015c330 2026-02-23T06:21:37.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.861+0000 7fe8c1ffb640 1 -- 10.20.193.58:0/2704526744 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fe8c8007410 con 0x7fe8d4157d80 2026-02-23T06:21:37.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.862+0000 7fe8c1ffb640 1 --2- 10.20.193.58:0/2704526744 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe8a807a810 0x7fe8a809acc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.862+0000 7fe8c1ffb640 1 -- 10.20.193.58:0/2704526744 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7fe8c809cb90 con 0x7fe8d4157d80 2026-02-23T06:21:37.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.863+0000 7fca48ff9640 1 -- 10.20.193.58:0/466368010 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fca3c085400 con 0x7fca4c05b2d0 2026-02-23T06:21:37.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.863+0000 7fb24ffff640 1 --2- 10.20.193.58:0/946913166 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb22807a810 0x7fb22809acc0 secure :-1 s=READY pgs=86 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2400023d0 tx=0x7fb24003a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.861+0000 7ff1714b8640 1 -- 10.20.193.58:0/3421086839 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff16c0b6150 con 0x7ff16c0b3e70 2026-02-23T06:21:37.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.863+0000 7ff14b7fe640 1 -- 10.20.193.58:0/3421086839 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7ff15404c440 con 0x7ff16c0b3e70 2026-02-23T06:21:37.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.863+0000 7fe8d911a640 1 --2- 10.20.193.58:0/2704526744 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe8a807a810 0x7fe8a809acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.864+0000 7fe8db3a5640 1 -- 10.20.193.58:0/2704526744 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8d4156a10 con 0x7fe8d4157d80 2026-02-23T06:21:37.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.864+0000 7fba3cff9640 1 --2- 10.20.193.58:0/986329546 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fba1007a800 0x7fba1009acb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.864+0000 7fba3cff9640 1 -- 10.20.193.58:0/986329546 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7fba3409d910 con 0x7fba4015c330 2026-02-23T06:21:37.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.864+0000 7ff14b7fe640 1 --2- 10.20.193.58:0/3421086839 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff13807a790 0x7ff13809ac40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:37.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.864+0000 7fba3ffff640 1 --2- 10.20.193.58:0/986329546 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fba1007a800 0x7fba1009acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.873 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.864+0000 7fe8d911a640 1 --2- 10.20.193.58:0/2704526744 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe8a807a810 0x7fe8a809acc0 secure :-1 s=READY pgs=87 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8c4005b30 tx=0x7fe8c40047e0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.873 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.864+0000 7fba3ffff640 1 --2- 10.20.193.58:0/986329546 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fba1007a800 0x7fba1009acb0 secure :-1 s=READY pgs=88 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba2c004770 tx=0x7fba2c007f40 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.873 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.865+0000 7ff14b7fe640 1 -- 10.20.193.58:0/3421086839 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7ff1540c28e0 con 0x7ff16c0b3e70 2026-02-23T06:21:37.873 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.865+0000 7ff16a7fc640 1 --2- 10.20.193.58:0/3421086839 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff13807a790 0x7ff13809ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:37.873 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.865+0000 7fba3cff9640 1 -- 10.20.193.58:0/986329546 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fba34060cb0 con 0x7fba4015c330 2026-02-23T06:21:37.873 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.865+0000 7fb24d7fa640 1 -- 10.20.193.58:0/946913166 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fb248060810 con 0x7fb2580b8980 2026-02-23T06:21:37.873 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.866+0000 7ff16a7fc640 1 --2- 10.20.193.58:0/3421086839 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff13807a790 0x7ff13809ac40 secure :-1 s=READY pgs=89 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff16c13cc40 tx=0x7ff160005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:37.873 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.868+0000 7ff14b7fe640 1 -- 10.20.193.58:0/3421086839 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7ff154085bf0 con 0x7ff16c0b3e70 2026-02-23T06:21:37.873 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.870+0000 7fe8c1ffb640 1 -- 10.20.193.58:0/2704526744 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fe8d4156a10 con 0x7fe8d4157d80 2026-02-23T06:21:37.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.982+0000 7fea4aa83640 1 -- 10.20.193.58:0/1446814127 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fea44134030 con 0x7fea44135460 2026-02-23T06:21:37.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.983+0000 7fea327fc640 1 -- 10.20.193.58:0/1446814127 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fea44134030 con 0x7fea44135460 2026-02-23T06:21:37.979 INFO:teuthology.orchestra.run.trial058.stdout:55834574855 2026-02-23T06:21:37.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.985+0000 7faa3ea36640 1 -- 10.20.193.58:0/83309775 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7faa380b23d0 con 0x7faa3812d4c0 2026-02-23T06:21:37.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.985+0000 7faa34ff9640 1 -- 10.20.193.58:0/83309775 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faa2c061a50 con 0x7faa3812d4c0 2026-02-23T06:21:37.980 INFO:teuthology.orchestra.run.trial058.stdout:55834574855 2026-02-23T06:21:37.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.986+0000 7fea4aa83640 1 -- 10.20.193.58:0/1446814127 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fea2007a6c0 msgr2=0x7fea2009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.986+0000 7fea4aa83640 1 --2- 10.20.193.58:0/1446814127 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fea2007a6c0 0x7fea2009ab70 secure :-1 s=READY pgs=82 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea3c0034b0 tx=0x7fea3c005850 comp rx=0 tx=0).stop 2026-02-23T06:21:37.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.986+0000 7fea4aa83640 1 -- 10.20.193.58:0/1446814127 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fea44135460 msgr2=0x7fea44156dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.986+0000 7fea4aa83640 1 --2- 10.20.193.58:0/1446814127 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fea44135460 0x7fea44156dd0 secure :-1 s=READY pgs=132 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea38004740 tx=0x7fea380088a0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.986+0000 7fea4aa83640 1 -- 10.20.193.58:0/1446814127 shutdown_connections 2026-02-23T06:21:37.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.986+0000 7fea4aa83640 1 --2- 10.20.193.58:0/1446814127 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fea2007a6c0 0x7fea2009ab70 unknown :-1 s=CLOSED pgs=82 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.986+0000 7fea4aa83640 1 --2- 10.20.193.58:0/1446814127 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fea44135460 0x7fea44156dd0 unknown :-1 s=CLOSED pgs=132 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.986+0000 7fea4aa83640 1 --2- 10.20.193.58:0/1446814127 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fea44132540 0x7fea44156890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.986+0000 7fea4aa83640 1 --2- 10.20.193.58:0/1446814127 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fea44132170 0x7fea441349d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.986+0000 7fea4aa83640 1 -- 10.20.193.58:0/1446814127 >> 10.20.193.58:0/1446814127 conn(0x7fea440b3c20 msgr2=0x7fea4415f020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.982 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.987+0000 7fea4aa83640 1 -- 10.20.193.58:0/1446814127 shutdown_connections 2026-02-23T06:21:37.982 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.987+0000 7fea4aa83640 1 -- 10.20.193.58:0/1446814127 wait complete. 2026-02-23T06:21:37.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.988+0000 7faa3ea36640 1 -- 10.20.193.58:0/83309775 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa0807a7b0 msgr2=0x7faa0809ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.988+0000 7faa3ea36640 1 --2- 10.20.193.58:0/83309775 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa0807a7b0 0x7faa0809ac60 secure :-1 s=READY pgs=84 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa24002b30 tx=0x7faa240035d0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.988+0000 7faa3ea36640 1 -- 10.20.193.58:0/83309775 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa3812d4c0 msgr2=0x7faa3812d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.988+0000 7faa3ea36640 1 --2- 10.20.193.58:0/83309775 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa3812d4c0 0x7faa3812d930 secure :-1 s=READY pgs=141 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa2c011970 tx=0x7faa2c011a70 comp rx=0 tx=0).stop 2026-02-23T06:21:37.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.988+0000 7faa3ea36640 1 -- 10.20.193.58:0/83309775 shutdown_connections 2026-02-23T06:21:37.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.988+0000 7faa3ea36640 1 --2- 10.20.193.58:0/83309775 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa0807a7b0 0x7faa0809ac60 unknown :-1 s=CLOSED pgs=84 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.988+0000 7faa3ea36640 1 --2- 10.20.193.58:0/83309775 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa3812d4c0 0x7faa3812d930 unknown :-1 s=CLOSED pgs=141 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.988+0000 7faa3ea36640 1 --2- 10.20.193.58:0/83309775 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa381569c0 0x7faa3812ed40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.988+0000 7faa3ea36640 1 --2- 10.20.193.58:0/83309775 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa1c004850 0x7faa3814ebb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.988+0000 7faa3ea36640 1 -- 10.20.193.58:0/83309775 >> 10.20.193.58:0/83309775 conn(0x7faa38058e50 msgr2=0x7faa38162df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.988+0000 7faa3ea36640 1 -- 10.20.193.58:0/83309775 shutdown_connections 2026-02-23T06:21:37.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.988+0000 7faa3ea36640 1 -- 10.20.193.58:0/83309775 wait complete. 2026-02-23T06:21:37.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.990+0000 7fca529d4640 1 -- 10.20.193.58:0/466368010 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fca4c157aa0 con 0x7fca4c05b2d0 2026-02-23T06:21:37.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.990+0000 7f36bb4b8640 1 -- 10.20.193.58:0/3860701043 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f36b4164ba0 con 0x7f36b40b1540 2026-02-23T06:21:37.985 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.990+0000 7f36a1ffb640 1 -- 10.20.193.58:0/3860701043 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f36a40606f0 con 0x7f36b40b1540 2026-02-23T06:21:37.985 INFO:teuthology.orchestra.run.trial058.stdout:55834574855 2026-02-23T06:21:37.985 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.991+0000 7fca48ff9640 1 -- 10.20.193.58:0/466368010 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fca3c088520 con 0x7fca4c05b2d0 2026-02-23T06:21:37.987 INFO:teuthology.orchestra.run.trial058.stdout:55834574856 2026-02-23T06:21:37.987 INFO:teuthology.orchestra.run.trial058.stdout:55834574856 2026-02-23T06:21:37.988 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.991+0000 7fb25f212640 1 -- 10.20.193.58:0/946913166 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb2580b7490 con 0x7fb2580b8980 2026-02-23T06:21:37.988 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.991+0000 7fb24d7fa640 1 -- 10.20.193.58:0/946913166 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb248063930 con 0x7fb2580b8980 2026-02-23T06:21:37.988 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.993+0000 7ff1714b8640 1 -- 10.20.193.58:0/3421086839 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff16c0b0f90 con 0x7ff16c0b3e70 2026-02-23T06:21:37.988 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.993+0000 7f36bb4b8640 1 -- 10.20.193.58:0/3860701043 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f368c07a6c0 msgr2=0x7f368c09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.993+0000 7f36bb4b8640 1 --2- 10.20.193.58:0/3860701043 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f368c07a6c0 0x7f368c09ab70 secure :-1 s=READY pgs=83 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f36a8005b30 tx=0x7f36a80047e0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.993+0000 7f36bb4b8640 1 -- 10.20.193.58:0/3860701043 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f36b40b1540 msgr2=0x7f36b41367f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.993+0000 7f36bb4b8640 1 --2- 10.20.193.58:0/3860701043 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f36b40b1540 0x7f36b41367f0 secure :-1 s=READY pgs=138 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f36a4009480 tx=0x7f36a400ee60 comp rx=0 tx=0).stop 2026-02-23T06:21:37.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.994+0000 7ff14b7fe640 1 -- 10.20.193.58:0/3421086839 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff154005bf0 con 0x7ff16c0b3e70 2026-02-23T06:21:37.989 INFO:teuthology.orchestra.run.trial058.stdout:55834574856 2026-02-23T06:21:37.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.994+0000 7f36bb4b8640 1 -- 10.20.193.58:0/3860701043 shutdown_connections 2026-02-23T06:21:37.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.994+0000 7f36bb4b8640 1 --2- 10.20.193.58:0/3860701043 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f368c07a6c0 0x7f368c09ab70 unknown :-1 s=CLOSED pgs=83 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.994+0000 7f36bb4b8640 1 --2- 10.20.193.58:0/3860701043 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f36b40b39f0 0x7f36b4130ac0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.994+0000 7f36bb4b8640 1 --2- 10.20.193.58:0/3860701043 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f36b40b1910 0x7f36b4130580 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.994+0000 7f36bb4b8640 1 --2- 10.20.193.58:0/3860701043 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f36b40b1540 0x7f36b41367f0 unknown :-1 s=CLOSED pgs=138 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.994+0000 7f36bb4b8640 1 -- 10.20.193.58:0/3860701043 >> 10.20.193.58:0/3860701043 conn(0x7f36b4058e50 msgr2=0x7f36b40b8000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.995+0000 7f36bb4b8640 1 -- 10.20.193.58:0/3860701043 shutdown_connections 2026-02-23T06:21:37.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.995+0000 7f36bb4b8640 1 -- 10.20.193.58:0/3860701043 wait complete. 2026-02-23T06:21:37.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.995+0000 7fca529d4640 1 -- 10.20.193.58:0/466368010 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fca1c07a6c0 msgr2=0x7fca1c09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.995+0000 7fb25f212640 1 -- 10.20.193.58:0/946913166 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb22807a810 msgr2=0x7fb22809acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.995+0000 7fb25f212640 1 --2- 10.20.193.58:0/946913166 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb22807a810 0x7fb22809acc0 secure :-1 s=READY pgs=86 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2400023d0 tx=0x7fb24003a040 comp rx=0 tx=0).stop 2026-02-23T06:21:37.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.995+0000 7fb25f212640 1 -- 10.20.193.58:0/946913166 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb2580b8980 msgr2=0x7fb25815d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.995+0000 7fb25f212640 1 --2- 10.20.193.58:0/946913166 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb2580b8980 0x7fb25815d590 secure :-1 s=READY pgs=144 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb248007fd0 tx=0x7fb24800c970 comp rx=0 tx=0).stop 2026-02-23T06:21:37.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.995+0000 7fca529d4640 1 --2- 10.20.193.58:0/466368010 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fca1c07a6c0 0x7fca1c09ab70 secure :-1 s=READY pgs=85 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca4c1335d0 tx=0x7fca38007a10 comp rx=0 tx=0).stop 2026-02-23T06:21:37.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.995+0000 7fca529d4640 1 -- 10.20.193.58:0/466368010 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fca4c05b2d0 msgr2=0x7fca4c156860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.995+0000 7fca529d4640 1 --2- 10.20.193.58:0/466368010 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fca4c05b2d0 0x7fca4c156860 secure :-1 s=READY pgs=143 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca3c0098a0 tx=0x7fca3c002c50 comp rx=0 tx=0).stop 2026-02-23T06:21:37.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.995+0000 7fca529d4640 1 -- 10.20.193.58:0/466368010 shutdown_connections 2026-02-23T06:21:37.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.995+0000 7fca529d4640 1 --2- 10.20.193.58:0/466368010 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fca1c07a6c0 0x7fca1c09ab70 unknown :-1 s=CLOSED pgs=85 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.995+0000 7fca529d4640 1 --2- 10.20.193.58:0/466368010 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fca4c161d50 0x7fca4c1310e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.995+0000 7fca529d4640 1 --2- 10.20.193.58:0/466368010 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fca4c157670 0x7fca4c132760 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.995+0000 7fca529d4640 1 --2- 10.20.193.58:0/466368010 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fca4c05b2d0 0x7fca4c156860 unknown :-1 s=CLOSED pgs=143 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.995+0000 7fca529d4640 1 -- 10.20.193.58:0/466368010 >> 10.20.193.58:0/466368010 conn(0x7fca4c058e50 msgr2=0x7fca4c139870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.995+0000 7fb25f212640 1 -- 10.20.193.58:0/946913166 shutdown_connections 2026-02-23T06:21:37.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.995+0000 7fb25f212640 1 --2- 10.20.193.58:0/946913166 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb22807a810 0x7fb22809acc0 unknown :-1 s=CLOSED pgs=86 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.995+0000 7fb25f212640 1 --2- 10.20.193.58:0/946913166 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb258163b30 0x7fb2580a17b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.995+0000 7fb25f212640 1 --2- 10.20.193.58:0/946913166 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb2580b8d50 0x7fb2580a1270 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.995+0000 7fb25f212640 1 --2- 10.20.193.58:0/946913166 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb2580b8980 0x7fb25815d590 unknown :-1 s=CLOSED pgs=144 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.995+0000 7fb25f212640 1 -- 10.20.193.58:0/946913166 >> 10.20.193.58:0/946913166 conn(0x7fb2580bb3b0 msgr2=0x7fb2580b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.995+0000 7fb25f212640 1 -- 10.20.193.58:0/946913166 shutdown_connections 2026-02-23T06:21:37.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.995+0000 7fb25f212640 1 -- 10.20.193.58:0/946913166 wait complete. 2026-02-23T06:21:37.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.995+0000 7fca529d4640 1 -- 10.20.193.58:0/466368010 shutdown_connections 2026-02-23T06:21:37.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.995+0000 7fca529d4640 1 -- 10.20.193.58:0/466368010 wait complete. 2026-02-23T06:21:37.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.997+0000 7fba1a7fc640 1 -- 10.20.193.58:0/986329546 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fba040055b0 con 0x7fba4015c330 2026-02-23T06:21:37.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.997+0000 7ff1714b8640 1 -- 10.20.193.58:0/3421086839 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff13807a790 msgr2=0x7ff13809ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.997+0000 7ff1714b8640 1 --2- 10.20.193.58:0/3421086839 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff13807a790 0x7ff13809ac40 secure :-1 s=READY pgs=89 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff16c13cc40 tx=0x7ff160005f90 comp rx=0 tx=0).stop 2026-02-23T06:21:37.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.997+0000 7ff1714b8640 1 -- 10.20.193.58:0/3421086839 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff16c0b3e70 msgr2=0x7ff16c13a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.997+0000 7ff1714b8640 1 --2- 10.20.193.58:0/3421086839 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff16c0b3e70 0x7ff16c13a3e0 secure :-1 s=READY pgs=137 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff16c0b1e70 tx=0x7ff154002c40 comp rx=0 tx=0).stop 2026-02-23T06:21:37.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.998+0000 7fba3cff9640 1 -- 10.20.193.58:0/986329546 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fba34063dd0 con 0x7fba4015c330 2026-02-23T06:21:37.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.998+0000 7ff1714b8640 1 -- 10.20.193.58:0/3421086839 shutdown_connections 2026-02-23T06:21:37.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.998+0000 7ff1714b8640 1 --2- 10.20.193.58:0/3421086839 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff13807a790 0x7ff13809ac40 unknown :-1 s=CLOSED pgs=89 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.998+0000 7ff1714b8640 1 --2- 10.20.193.58:0/3421086839 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff16c15b4c0 0x7ff16c200bd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.998+0000 7ff1714b8640 1 --2- 10.20.193.58:0/3421086839 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff16c0b7430 0x7ff16c1418f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.998+0000 7ff1714b8640 1 --2- 10.20.193.58:0/3421086839 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff16c0b3e70 0x7ff16c13a3e0 unknown :-1 s=CLOSED pgs=137 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.998+0000 7ff1714b8640 1 -- 10.20.193.58:0/3421086839 >> 10.20.193.58:0/3421086839 conn(0x7ff16c058e50 msgr2=0x7ff16c059220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.998+0000 7ff1714b8640 1 -- 10.20.193.58:0/3421086839 shutdown_connections 2026-02-23T06:21:37.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:37.998+0000 7ff1714b8640 1 -- 10.20.193.58:0/3421086839 wait complete. 2026-02-23T06:21:37.995 INFO:teuthology.orchestra.run.trial058.stdout:55834574856 2026-02-23T06:21:37.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:38.000+0000 7fe8db3a5640 1 -- 10.20.193.58:0/2704526744 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fe8d4156a10 con 0x7fe8d4157d80 2026-02-23T06:21:37.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2026-02-23T06:21:37.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:38.002+0000 7fe8c1ffb640 1 -- 10.20.193.58:0/2704526744 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe8d4156a10 con 0x7fe8d4157d80 2026-02-23T06:21:37.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2026-02-23T06:21:37.997 INFO:teuthology.orchestra.run.trial058.stdout:55834574855 2026-02-23T06:21:37.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:38.003+0000 7fba1a7fc640 1 -- 10.20.193.58:0/986329546 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fba1007a800 msgr2=0x7fba1009acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:38.003+0000 7fba1a7fc640 1 --2- 10.20.193.58:0/986329546 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fba1007a800 0x7fba1009acb0 secure :-1 s=READY pgs=88 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba2c004770 tx=0x7fba2c007f40 comp rx=0 tx=0).stop 2026-02-23T06:21:37.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:38.003+0000 7fba1a7fc640 1 -- 10.20.193.58:0/986329546 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba4015c330 msgr2=0x7fba40120a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:37.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:38.003+0000 7fba1a7fc640 1 --2- 10.20.193.58:0/986329546 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba4015c330 0x7fba40120a50 secure :-1 s=READY pgs=136 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba3400d730 tx=0x7fba3400dc00 comp rx=0 tx=0).stop 2026-02-23T06:21:37.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:38.003+0000 7fba1a7fc640 1 -- 10.20.193.58:0/986329546 shutdown_connections 2026-02-23T06:21:37.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:38.003+0000 7fba1a7fc640 1 --2- 10.20.193.58:0/986329546 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fba1007a800 0x7fba1009acb0 unknown :-1 s=CLOSED pgs=88 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:38.003+0000 7fba1a7fc640 1 --2- 10.20.193.58:0/986329546 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba4015c330 0x7fba40120a50 unknown :-1 s=CLOSED pgs=136 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:38.003+0000 7fba1a7fc640 1 --2- 10.20.193.58:0/986329546 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fba400b58d0 0x7fba40120510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:38.003+0000 7fba1a7fc640 1 --2- 10.20.193.58:0/986329546 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba400b4e60 0x7fba4014ad70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:37.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:38.003+0000 7fba1a7fc640 1 -- 10.20.193.58:0/986329546 >> 10.20.193.58:0/986329546 conn(0x7fba40059db0 msgr2=0x7fba400b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:37.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:38.004+0000 7fba1a7fc640 1 -- 10.20.193.58:0/986329546 shutdown_connections 2026-02-23T06:21:37.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:38.004+0000 7fba1a7fc640 1 -- 10.20.193.58:0/986329546 wait complete. 2026-02-23T06:21:38.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:38.005+0000 7fe8db3a5640 1 -- 10.20.193.58:0/2704526744 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe8a807a810 msgr2=0x7fe8a809acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:38.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:38.005+0000 7fe8db3a5640 1 --2- 10.20.193.58:0/2704526744 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe8a807a810 0x7fe8a809acc0 secure :-1 s=READY pgs=87 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8c4005b30 tx=0x7fe8c40047e0 comp rx=0 tx=0).stop 2026-02-23T06:21:38.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:38.005+0000 7fe8db3a5640 1 -- 10.20.193.58:0/2704526744 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe8d4157d80 msgr2=0x7fe8d41559a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:38.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:38.005+0000 7fe8db3a5640 1 --2- 10.20.193.58:0/2704526744 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe8d4157d80 0x7fe8d41559a0 secure :-1 s=READY pgs=138 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8c8002730 tx=0x7fe8c800c8f0 comp rx=0 tx=0).stop 2026-02-23T06:21:38.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:38.006+0000 7fe8db3a5640 1 -- 10.20.193.58:0/2704526744 shutdown_connections 2026-02-23T06:21:38.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:38.006+0000 7fe8db3a5640 1 --2- 10.20.193.58:0/2704526744 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe8a807a810 0x7fe8a809acc0 unknown :-1 s=CLOSED pgs=87 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:38.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:38.006+0000 7fe8db3a5640 1 --2- 10.20.193.58:0/2704526744 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe8d4161d50 0x7fe8d4144bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:38.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:38.006+0000 7fe8db3a5640 1 --2- 10.20.193.58:0/2704526744 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe8d4157d80 0x7fe8d41559a0 unknown :-1 s=CLOSED pgs=138 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:38.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:38.006+0000 7fe8db3a5640 1 --2- 10.20.193.58:0/2704526744 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe8d40b1540 0x7fe8d4155460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:38.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:38.006+0000 7fe8db3a5640 1 -- 10.20.193.58:0/2704526744 >> 10.20.193.58:0/2704526744 conn(0x7fe8d4058e50 msgr2=0x7fe8d4059220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:38.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:38.006+0000 7fe8db3a5640 1 -- 10.20.193.58:0/2704526744 shutdown_connections 2026-02-23T06:21:38.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:38.006+0000 7fe8db3a5640 1 -- 10.20.193.58:0/2704526744 wait complete. 2026-02-23T06:21:38.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.7 2026-02-23T06:21:38.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2026-02-23T06:21:38.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2026-02-23T06:21:38.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2026-02-23T06:21:38.011 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2026-02-23T06:21:38.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2026-02-23T06:21:38.997 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-23T06:21:38.998 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-23T06:21:39.003 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-23T06:21:39.004 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-23T06:21:39.006 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-23T06:21:39.009 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-23T06:21:39.012 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-23T06:21:39.014 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-23T06:21:39.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.139+0000 7ff979483640 1 -- 10.20.193.58:0/263687603 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff958045a00 msgr2=0x7ff958065de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.139+0000 7ff972ffd640 1 -- 10.20.193.58:0/263687603 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff968030ca0 con 0x7ff958045a00 2026-02-23T06:21:39.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.139+0000 7ff979483640 1 --2- 10.20.193.58:0/263687603 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff958045a00 0x7ff958065de0 secure :-1 s=READY pgs=141 gs=4 cs=0 l=1 c_cookie=1766994593198216355 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff968004080 tx=0x7ff968030220 comp rx=0 tx=0).stop 2026-02-23T06:21:39.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.139+0000 7ff979483640 1 -- 10.20.193.58:0/263687603 shutdown_connections 2026-02-23T06:21:39.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.139+0000 7ff979483640 1 --2- 10.20.193.58:0/263687603 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff958045a00 0x7ff958065de0 unknown :-1 s=CLOSED pgs=141 gs=4 cs=0 l=1 c_cookie=1766994593198216355 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.139+0000 7ff979483640 1 -- 10.20.193.58:0/263687603 >> 10.20.193.58:0/263687603 conn(0x7ff9740b3c20 msgr2=0x7ff9740b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:39.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.140+0000 7f3a4c7d4640 1 -- 10.20.193.58:0/3594882477 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3a440b7000 msgr2=0x7f3a440b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.140+0000 7f3a4c7d4640 1 --2- 10.20.193.58:0/3594882477 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3a440b7000 0x7f3a440b5610 secure :-1 s=READY pgs=71 gs=3 cs=0 l=1 c_cookie=17156923748334859577 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a38004740 tx=0x7f3a3802f0c0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.140+0000 7f3a4c7d4640 1 -- 10.20.193.58:0/3594882477 shutdown_connections 2026-02-23T06:21:39.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.140+0000 7f3a4c7d4640 1 --2- 10.20.193.58:0/3594882477 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3a440b7000 0x7f3a440b5610 unknown :-1 s=CLOSED pgs=71 gs=3 cs=0 l=1 c_cookie=17156923748334859577 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.140+0000 7f3a4c7d4640 1 -- 10.20.193.58:0/3594882477 >> 10.20.193.58:0/3594882477 conn(0x7f3a44058e50 msgr2=0x7f3a44059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:39.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.140+0000 7f3a4c7d4640 1 -- 10.20.193.58:0/3594882477 shutdown_connections 2026-02-23T06:21:39.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.140+0000 7f3a4c7d4640 1 -- 10.20.193.58:0/3594882477 wait complete. 2026-02-23T06:21:39.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.141+0000 7f3a4c7d4640 1 Processor -- start 2026-02-23T06:21:39.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.141+0000 7f3a4c7d4640 1 -- start start 2026-02-23T06:21:39.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.142+0000 7ff979483640 1 -- 10.20.193.58:0/263687603 shutdown_connections 2026-02-23T06:21:39.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.142+0000 7ff979483640 1 -- 10.20.193.58:0/263687603 wait complete. 2026-02-23T06:21:39.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.142+0000 7f3a4c7d4640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3a440b7000 0x7f3a4412b9a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.142+0000 7f3a4c7d4640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3a4415ba10 0x7f3a4413b6a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.142+0000 7f3a4c7d4640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3a4415bde0 0x7f3a44159c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.143+0000 7f3a4ad4a640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3a4415bde0 0x7f3a44159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.143+0000 7f3a4ad4a640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3a4415bde0 0x7f3a44159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:56728/0 (socket says 10.20.193.58:56728) 2026-02-23T06:21:39.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.143+0000 7f3a4ad4a640 1 -- 10.20.193.58:0/2142387402 learned_addr learned my addr 10.20.193.58:0/2142387402 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:39.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.143+0000 7f3a4c7d4640 1 -- 10.20.193.58:0/2142387402 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4412cdd0 con 0x7f3a4415bde0 2026-02-23T06:21:39.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.143+0000 7f3a4c7d4640 1 -- 10.20.193.58:0/2142387402 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4412a710 con 0x7f3a4415ba10 2026-02-23T06:21:39.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.143+0000 7f3a4a549640 1 --2- 10.20.193.58:0/2142387402 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3a440b7000 0x7f3a4412b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.143+0000 7f3a49d48640 1 --2- 10.20.193.58:0/2142387402 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3a4415ba10 0x7f3a4413b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.143+0000 7f3a4c7d4640 1 -- 10.20.193.58:0/2142387402 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f3a4412c500 con 0x7f3a440b7000 2026-02-23T06:21:39.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.143+0000 7ff979483640 1 Processor -- start 2026-02-23T06:21:39.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.143+0000 7ff979483640 1 -- start start 2026-02-23T06:21:39.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.143+0000 7f3a4ad4a640 1 -- 10.20.193.58:0/2142387402 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3a440b7000 msgr2=0x7f3a4412b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.143+0000 7f3a4ad4a640 1 --2- 10.20.193.58:0/2142387402 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3a440b7000 0x7f3a4412b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.143+0000 7f3a4ad4a640 1 -- 10.20.193.58:0/2142387402 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3a4415ba10 msgr2=0x7f3a4413b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.143+0000 7f3a4a549640 1 --2- 10.20.193.58:0/2142387402 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3a440b7000 0x7f3a4412b9a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:21:39.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.143+0000 7f3a4ad4a640 1 --2- 10.20.193.58:0/2142387402 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3a4415ba10 0x7f3a4413b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.144+0000 7f3a4ad4a640 1 -- 10.20.193.58:0/2142387402 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a380094b0 con 0x7f3a4415bde0 2026-02-23T06:21:39.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.143+0000 7ff979483640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff958045a00 0x7ff97415e860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.144+0000 7ff979483640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff974164220 0x7ff97415d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.144+0000 7ff979483640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff9741538a0 0x7ff9740587d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.144+0000 7ff979483640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff97415c170 con 0x7ff9741538a0 2026-02-23T06:21:39.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.144+0000 7ff979483640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff97415dcd0 con 0x7ff958045a00 2026-02-23T06:21:39.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.144+0000 7ff979483640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7ff974206370 con 0x7ff974164220 2026-02-23T06:21:39.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.144+0000 7ff973fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff958045a00 0x7ff97415e860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.144+0000 7ff973fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff958045a00 0x7ff97415e860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:59206/0 (socket says 10.20.193.58:59206) 2026-02-23T06:21:39.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.144+0000 7ff973fff640 1 -- 10.20.193.58:0/1433655339 learned_addr learned my addr 10.20.193.58:0/1433655339 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:39.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.144+0000 7ff978c82640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff9741538a0 0x7ff9740587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.144+0000 7f3a49d48640 1 --2- 10.20.193.58:0/2142387402 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3a4415ba10 0x7f3a4413b6a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:21:39.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.144+0000 7f3a4ad4a640 1 --2- 10.20.193.58:0/2142387402 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3a4415bde0 0x7f3a44159c10 secure :-1 s=READY pgs=142 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a38005db0 tx=0x7f3a380028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:39.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.144+0000 7ff9737fe640 1 --2- 10.20.193.58:0/1433655339 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff974164220 0x7ff97415d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.144+0000 7f3a2effd640 1 -- 10.20.193.58:0/2142387402 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a3803c040 con 0x7f3a4415bde0 2026-02-23T06:21:39.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.144+0000 7f3a2effd640 1 -- 10.20.193.58:0/2142387402 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a38038470 con 0x7f3a4415bde0 2026-02-23T06:21:39.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.144+0000 7f3a2effd640 1 -- 10.20.193.58:0/2142387402 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a38038800 con 0x7f3a4415bde0 2026-02-23T06:21:39.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.145+0000 7ff973fff640 1 -- 10.20.193.58:0/1433655339 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff974164220 msgr2=0x7ff97415d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.145+0000 7ff973fff640 1 --2- 10.20.193.58:0/1433655339 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff974164220 0x7ff97415d790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.145+0000 7ff973fff640 1 -- 10.20.193.58:0/1433655339 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff9741538a0 msgr2=0x7ff9740587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.144+0000 7f3a4c7d4640 1 -- 10.20.193.58:0/2142387402 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a4412d020 con 0x7f3a4415bde0 2026-02-23T06:21:39.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.144+0000 7f3a4c7d4640 1 -- 10.20.193.58:0/2142387402 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a4412bee0 con 0x7f3a4415bde0 2026-02-23T06:21:39.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.145+0000 7ff973fff640 1 --2- 10.20.193.58:0/1433655339 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff9741538a0 0x7ff9740587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.145+0000 7ff973fff640 1 -- 10.20.193.58:0/1433655339 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff974206610 con 0x7ff958045a00 2026-02-23T06:21:39.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.145+0000 7ff978c82640 1 --2- 10.20.193.58:0/1433655339 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff9741538a0 0x7ff9740587d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:39.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.146+0000 7ff973fff640 1 --2- 10.20.193.58:0/1433655339 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff958045a00 0x7ff97415e860 secure :-1 s=READY pgs=147 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff960005f10 tx=0x7ff96000ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:39.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.146+0000 7ff970ff9640 1 -- 10.20.193.58:0/1433655339 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff960004500 con 0x7ff958045a00 2026-02-23T06:21:39.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.146+0000 7ff970ff9640 1 -- 10.20.193.58:0/1433655339 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff96000aa40 con 0x7ff958045a00 2026-02-23T06:21:39.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.146+0000 7ff970ff9640 1 -- 10.20.193.58:0/1433655339 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff96000ae70 con 0x7ff958045a00 2026-02-23T06:21:39.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.146+0000 7ff979483640 1 -- 10.20.193.58:0/1433655339 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff97415ccb0 con 0x7ff958045a00 2026-02-23T06:21:39.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.146+0000 7ff979483640 1 -- 10.20.193.58:0/1433655339 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff97415d270 con 0x7ff958045a00 2026-02-23T06:21:39.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.146+0000 7f3a2effd640 1 -- 10.20.193.58:0/2142387402 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f3a38049030 con 0x7f3a4415bde0 2026-02-23T06:21:39.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.147+0000 7ff979483640 1 -- 10.20.193.58:0/1433655339 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff97415d490 con 0x7ff958045a00 2026-02-23T06:21:39.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.147+0000 7f3a2effd640 1 --2- 10.20.193.58:0/2142387402 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3a1c07a790 0x7f3a1c09ac40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.147+0000 7f3a2effd640 1 -- 10.20.193.58:0/2142387402 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f3a380c2930 con 0x7f3a4415bde0 2026-02-23T06:21:39.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.148+0000 7f3a4a549640 1 --2- 10.20.193.58:0/2142387402 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3a1c07a790 0x7f3a1c09ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.148+0000 7f3a4c7d4640 1 -- 10.20.193.58:0/2142387402 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a4412a540 con 0x7f3a4415bde0 2026-02-23T06:21:39.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.148+0000 7ff970ff9640 1 -- 10.20.193.58:0/1433655339 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7ff96003ca80 con 0x7ff958045a00 2026-02-23T06:21:39.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.149+0000 7f3a4a549640 1 --2- 10.20.193.58:0/2142387402 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3a1c07a790 0x7f3a1c09ac40 secure :-1 s=READY pgs=90 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a40008960 tx=0x7f3a4000a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:39.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.149+0000 7ff970ff9640 1 --2- 10.20.193.58:0/1433655339 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff94807a730 0x7ff94809abe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.149+0000 7ff970ff9640 1 -- 10.20.193.58:0/1433655339 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7ff960014070 con 0x7ff958045a00 2026-02-23T06:21:39.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.150+0000 7ff9737fe640 1 --2- 10.20.193.58:0/1433655339 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff94807a730 0x7ff94809abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.151+0000 7ff970ff9640 1 -- 10.20.193.58:0/1433655339 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7ff960061050 con 0x7ff958045a00 2026-02-23T06:21:39.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.151+0000 7ff9737fe640 1 --2- 10.20.193.58:0/1433655339 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff94807a730 0x7ff94809abe0 secure :-1 s=READY pgs=91 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff974164610 tx=0x7ff964002da0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:39.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.151+0000 7f3c0c28c640 1 -- 10.20.193.58:0/1337846905 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c040bbbf0 msgr2=0x7f3c040bc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.151+0000 7f3c0c28c640 1 --2- 10.20.193.58:0/1337846905 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c040bbbf0 0x7f3c040bc010 secure :-1 s=READY pgs=72 gs=2 cs=0 l=1 c_cookie=7773088143288965400 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c00005820 tx=0x7f3c000302b0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.151+0000 7ff753fff640 1 -- 10.20.193.58:0/2286836557 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff754058ba0 msgr2=0x7ff754058fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.151+0000 7ff753fff640 1 --2- 10.20.193.58:0/2286836557 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff754058ba0 0x7ff754058fa0 secure :-1 s=READY pgs=149 gs=2 cs=0 l=1 c_cookie=12400956898343545677 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff754059bf0 tx=0x7ff74402f240 comp rx=0 tx=0).stop 2026-02-23T06:21:39.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.151+0000 7f3c0c28c640 1 -- 10.20.193.58:0/1337846905 shutdown_connections 2026-02-23T06:21:39.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.152+0000 7f3c0c28c640 1 --2- 10.20.193.58:0/1337846905 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c040bbbf0 0x7f3c040bc010 unknown :-1 s=CLOSED pgs=72 gs=2 cs=0 l=1 c_cookie=7773088143288965400 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.152+0000 7f3c0c28c640 1 --2- 10.20.193.58:0/1337846905 >> v2:10.20.193.93:3300/0 conn(0x7f3c040b5ae0 0x7f3c04054ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.152+0000 7ff753fff640 1 -- 10.20.193.58:0/2286836557 shutdown_connections 2026-02-23T06:21:39.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.152+0000 7ff753fff640 1 --2- 10.20.193.58:0/2286836557 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff754058ba0 0x7ff754058fa0 unknown :-1 s=CLOSED pgs=149 gs=2 cs=0 l=1 c_cookie=12400956898343545677 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.152+0000 7ff753fff640 1 --2- 10.20.193.58:0/2286836557 >> v2:10.20.193.58:3300/0 conn(0x7ff75415b460 0x7ff7540561f0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.152+0000 7ff753fff640 1 -- 10.20.193.58:0/2286836557 >> 10.20.193.58:0/2286836557 conn(0x7ff7540b3c20 msgr2=0x7ff7540b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:39.152 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.152+0000 7f3c0c28c640 1 -- 10.20.193.58:0/1337846905 >> 10.20.193.58:0/1337846905 conn(0x7f3c04056790 msgr2=0x7f3c040bb010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:39.152 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.152+0000 7ff753fff640 1 -- 10.20.193.58:0/2286836557 shutdown_connections 2026-02-23T06:21:39.152 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.152+0000 7ff753fff640 1 -- 10.20.193.58:0/2286836557 wait complete. 2026-02-23T06:21:39.152 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.152+0000 7f4783fff640 1 -- 10.20.193.58:0/959388341 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f476c003ad0 msgr2=0x7f476c003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.153 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.152+0000 7f4783fff640 1 --2- 10.20.193.58:0/959388341 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f476c003ad0 0x7f476c003ee0 secure :-1 s=READY pgs=73 gs=4 cs=0 l=1 c_cookie=2166389998114815810 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4770004250 tx=0x7f4770030950 comp rx=0 tx=0).stop 2026-02-23T06:21:39.153 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.152+0000 7f47837fe640 1 -- 10.20.193.58:0/959388341 reap_dead start 2026-02-23T06:21:39.153 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.152+0000 7f3a2effd640 1 -- 10.20.193.58:0/2142387402 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f3a38085ca0 con 0x7f3a4415bde0 2026-02-23T06:21:39.153 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.152+0000 7f3c0c28c640 1 -- 10.20.193.58:0/1337846905 shutdown_connections 2026-02-23T06:21:39.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.152+0000 7f4783fff640 1 -- 10.20.193.58:0/959388341 shutdown_connections 2026-02-23T06:21:39.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.152+0000 7f4783fff640 1 -- 10.20.193.58:0/959388341 >> 10.20.193.58:0/959388341 conn(0x7f47840b3c20 msgr2=0x7f47840b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:39.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.152+0000 7f4783fff640 1 -- 10.20.193.58:0/959388341 shutdown_connections 2026-02-23T06:21:39.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.152+0000 7f4783fff640 1 -- 10.20.193.58:0/959388341 wait complete. 2026-02-23T06:21:39.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.153+0000 7ff753fff640 1 Processor -- start 2026-02-23T06:21:39.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.153+0000 7ff753fff640 1 -- start start 2026-02-23T06:21:39.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.154+0000 7ff753fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff754058ba0 0x7ff75415a220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.154+0000 7ff753fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff7540b7050 0x7ff75413bc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.154+0000 7ff753fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff75415b460 0x7ff75413c1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.154+0000 7ff753fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff754137520 con 0x7ff754058ba0 2026-02-23T06:21:39.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.154+0000 7ff753fff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff7541530e0 con 0x7ff7540b7050 2026-02-23T06:21:39.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.154+0000 7ff753fff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7ff754135c20 con 0x7ff75415b460 2026-02-23T06:21:39.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.155+0000 7ff752ffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff754058ba0 0x7ff75415a220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.155+0000 7ff752ffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff754058ba0 0x7ff75415a220 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:56758/0 (socket says 10.20.193.58:56758) 2026-02-23T06:21:39.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.155+0000 7ff752ffd640 1 -- 10.20.193.58:0/2464681864 learned_addr learned my addr 10.20.193.58:0/2464681864 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:39.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.155+0000 7ff752ffd640 1 -- 10.20.193.58:0/2464681864 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff75415b460 msgr2=0x7ff75413c1b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-23T06:21:39.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.155+0000 7f3c0c28c640 1 -- 10.20.193.58:0/1337846905 wait complete. 2026-02-23T06:21:39.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.155+0000 7ff7527fc640 1 --2- 10.20.193.58:0/2464681864 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff7540b7050 0x7ff75413bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.155+0000 7ff7537fe640 1 --2- 10.20.193.58:0/2464681864 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff75415b460 0x7ff75413c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.155+0000 7ff752ffd640 1 --2- 10.20.193.58:0/2464681864 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff75415b460 0x7ff75413c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.155+0000 7ff752ffd640 1 -- 10.20.193.58:0/2464681864 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff7540b7050 msgr2=0x7ff75413bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.155+0000 7ff752ffd640 1 --2- 10.20.193.58:0/2464681864 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff7540b7050 0x7ff75413bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.155+0000 7ff752ffd640 1 -- 10.20.193.58:0/2464681864 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7440094b0 con 0x7ff754058ba0 2026-02-23T06:21:39.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.155+0000 7ff7527fc640 1 --2- 10.20.193.58:0/2464681864 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff7540b7050 0x7ff75413bc70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:21:39.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.156+0000 7ff7537fe640 1 --2- 10.20.193.58:0/2464681864 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff75415b460 0x7ff75413c1b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:21:39.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.156+0000 7ff752ffd640 1 --2- 10.20.193.58:0/2464681864 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff754058ba0 0x7ff75415a220 secure :-1 s=READY pgs=145 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff73c00b520 tx=0x7ff73c00b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:39.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.157+0000 7f3c0c28c640 1 Processor -- start 2026-02-23T06:21:39.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.156+0000 7ff7337fe640 1 -- 10.20.193.58:0/2464681864 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff73c0044a0 con 0x7ff754058ba0 2026-02-23T06:21:39.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.156+0000 7ff753fff640 1 -- 10.20.193.58:0/2464681864 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff754135f40 con 0x7ff754058ba0 2026-02-23T06:21:39.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.157+0000 7ff753fff640 1 -- 10.20.193.58:0/2464681864 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff754137e60 con 0x7ff754058ba0 2026-02-23T06:21:39.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.157+0000 7ff7337fe640 1 -- 10.20.193.58:0/2464681864 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff73c002760 con 0x7ff754058ba0 2026-02-23T06:21:39.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.157+0000 7ff7337fe640 1 -- 10.20.193.58:0/2464681864 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff73c0044a0 con 0x7ff754058ba0 2026-02-23T06:21:39.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.157+0000 7f3c0c28c640 1 -- start start 2026-02-23T06:21:39.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.154+0000 7f4783fff640 1 Processor -- start 2026-02-23T06:21:39.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.154+0000 7f4783fff640 1 -- start start 2026-02-23T06:21:39.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.154+0000 7f4783fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f476c003ad0 0x7f478413fd50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.154+0000 7f4783fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f478413b610 0x7f478415e780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.154+0000 7f4783fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f478415ecc0 0x7f478413bf50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.155+0000 7f4783fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f478415e050 con 0x7f476c003ad0 2026-02-23T06:21:39.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.155+0000 7f47827fc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f478413b610 0x7f478415e780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.155+0000 7f47827fc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f478413b610 0x7f478415e780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:59258/0 (socket says 10.20.193.58:59258) 2026-02-23T06:21:39.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.155+0000 7f47827fc640 1 -- 10.20.193.58:0/4151062059 learned_addr learned my addr 10.20.193.58:0/4151062059 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:39.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.155+0000 7f4783fff640 1 -- 10.20.193.58:0/4151062059 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f478415c7e0 con 0x7f478413b610 2026-02-23T06:21:39.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.155+0000 7f4783fff640 1 -- 10.20.193.58:0/4151062059 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f478415ca10 con 0x7f478415ecc0 2026-02-23T06:21:39.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.155+0000 7f47837fe640 1 --2- 10.20.193.58:0/4151062059 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f478415ecc0 0x7f478413bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.156+0000 7f47827fc640 1 -- 10.20.193.58:0/4151062059 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f478415ecc0 msgr2=0x7f478413bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.156+0000 7f47827fc640 1 --2- 10.20.193.58:0/4151062059 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f478415ecc0 0x7f478413bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.156+0000 7f47827fc640 1 -- 10.20.193.58:0/4151062059 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f476c003ad0 msgr2=0x7f478413fd50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:21:39.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.156+0000 7f47827fc640 1 --2- 10.20.193.58:0/4151062059 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f476c003ad0 0x7f478413fd50 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.156+0000 7f47827fc640 1 -- 10.20.193.58:0/4151062059 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f478415be60 con 0x7f478413b610 2026-02-23T06:21:39.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.156+0000 7f47827fc640 1 --2- 10.20.193.58:0/4151062059 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f478413b610 0x7f478415e780 secure :-1 s=READY pgs=150 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f476800b4d0 tx=0x7f476800b5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:39.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.156+0000 7f477b7fe640 1 -- 10.20.193.58:0/4151062059 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f47680044a0 con 0x7f478413b610 2026-02-23T06:21:39.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.156+0000 7f4783fff640 1 -- 10.20.193.58:0/4151062059 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f478415c140 con 0x7f478413b610 2026-02-23T06:21:39.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.156+0000 7f477b7fe640 1 -- 10.20.193.58:0/4151062059 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47680026a0 con 0x7f478413b610 2026-02-23T06:21:39.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.156+0000 7f477b7fe640 1 -- 10.20.193.58:0/4151062059 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f47680044a0 con 0x7f478413b610 2026-02-23T06:21:39.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.157+0000 7f4783fff640 1 -- 10.20.193.58:0/4151062059 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f478415e260 con 0x7f478413b610 2026-02-23T06:21:39.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.157+0000 7f4783fff640 1 -- 10.20.193.58:0/4151062059 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f478415d340 con 0x7f478413b610 2026-02-23T06:21:39.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.158+0000 7f3c0c28c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3c040b5ae0 0x7f3c0409f420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.158+0000 7f3c0c28c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c040b5eb0 0x7f3c0413f810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.158+0000 7f3c0c28c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c040bbbf0 0x7f3c0415e620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.158+0000 7f3c0c28c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f3c04167b60 con 0x7f3c040b5eb0 2026-02-23T06:21:39.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.158+0000 7f3c0c28c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0409f960 con 0x7f3c040b5ae0 2026-02-23T06:21:39.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.158+0000 7f3c0c28c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f3c04200fd0 con 0x7f3c040bbbf0 2026-02-23T06:21:39.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.159+0000 7f3c0a001640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3c040b5ae0 0x7f3c0409f420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.159+0000 7f3c09800640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c040b5eb0 0x7f3c0413f810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.159+0000 7f3c09800640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c040b5eb0 0x7f3c0413f810 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:56768/0 (socket says 10.20.193.58:56768) 2026-02-23T06:21:39.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.159+0000 7f3c09800640 1 -- 10.20.193.58:0/3078067871 learned_addr learned my addr 10.20.193.58:0/3078067871 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:39.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.158+0000 7ff753fff640 1 -- 10.20.193.58:0/2464681864 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff754138070 con 0x7ff754058ba0 2026-02-23T06:21:39.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.159+0000 7f3c0a802640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c040bbbf0 0x7f3c0415e620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.159+0000 7f477b7fe640 1 -- 10.20.193.58:0/4151062059 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f4768005ae0 con 0x7f478413b610 2026-02-23T06:21:39.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.159+0000 7f3c09800640 1 -- 10.20.193.58:0/3078067871 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c040bbbf0 msgr2=0x7f3c0415e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.159+0000 7f3c09800640 1 --2- 10.20.193.58:0/3078067871 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c040bbbf0 0x7f3c0415e620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.159+0000 7f3c09800640 1 -- 10.20.193.58:0/3078067871 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3c040b5ae0 msgr2=0x7f3c0409f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.159+0000 7f3c09800640 1 --2- 10.20.193.58:0/3078067871 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3c040b5ae0 0x7f3c0409f420 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.159+0000 7f3c09800640 1 -- 10.20.193.58:0/3078067871 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0000a590 con 0x7f3c040b5eb0 2026-02-23T06:21:39.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.160+0000 7f3c09800640 1 --2- 10.20.193.58:0/3078067871 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c040b5eb0 0x7f3c0413f810 secure :-1 s=READY pgs=146 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3bf400c700 tx=0x7f3bf400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:39.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.161+0000 7f3bf27fc640 1 -- 10.20.193.58:0/3078067871 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3bf4004030 con 0x7f3c040b5eb0 2026-02-23T06:21:39.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.161+0000 7f477b7fe640 1 --2- 10.20.193.58:0/4151062059 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f475007a720 0x7f475009abd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.161+0000 7f3c0c28c640 1 -- 10.20.193.58:0/3078067871 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c042012b0 con 0x7f3c040b5eb0 2026-02-23T06:21:39.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.161+0000 7f3bf27fc640 1 -- 10.20.193.58:0/3078067871 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3bf4004280 con 0x7f3c040b5eb0 2026-02-23T06:21:39.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.161+0000 7f3bf27fc640 1 -- 10.20.193.58:0/3078067871 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3bf4004030 con 0x7f3c040b5eb0 2026-02-23T06:21:39.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.161+0000 7f477b7fe640 1 -- 10.20.193.58:0/4151062059 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f476809c9a0 con 0x7f478413b610 2026-02-23T06:21:39.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.161+0000 7f3c0c28c640 1 -- 10.20.193.58:0/3078067871 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c04201870 con 0x7f3c040b5eb0 2026-02-23T06:21:39.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.161+0000 7f477b7fe640 1 -- 10.20.193.58:0/4151062059 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f47680d5720 con 0x7f478413b610 2026-02-23T06:21:39.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.161+0000 7ff7337fe640 1 -- 10.20.193.58:0/2464681864 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7ff73c0028f0 con 0x7ff754058ba0 2026-02-23T06:21:39.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.161+0000 7f4782ffd640 1 --2- 10.20.193.58:0/4151062059 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f475007a720 0x7f475009abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.162+0000 7f4782ffd640 1 --2- 10.20.193.58:0/4151062059 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f475007a720 0x7f475009abd0 secure :-1 s=READY pgs=92 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4770007ef0 tx=0x7f478405be30 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:39.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.162+0000 7ff7337fe640 1 --2- 10.20.193.58:0/2464681864 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff72407a790 0x7ff72409ac40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.162+0000 7ff7337fe640 1 -- 10.20.193.58:0/2464681864 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7ff73c09d1e0 con 0x7ff754058ba0 2026-02-23T06:21:39.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.162+0000 7f3c0c28c640 1 -- 10.20.193.58:0/3078067871 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c04054ce0 con 0x7f3c040b5eb0 2026-02-23T06:21:39.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.163+0000 7ff7527fc640 1 --2- 10.20.193.58:0/2464681864 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff72407a790 0x7ff72409ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.163+0000 7ff7337fe640 1 -- 10.20.193.58:0/2464681864 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7ff73c0603c0 con 0x7ff754058ba0 2026-02-23T06:21:39.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.164+0000 7ff7527fc640 1 --2- 10.20.193.58:0/2464681864 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff72407a790 0x7ff72409ac40 secure :-1 s=READY pgs=93 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff754160cc0 tx=0x7ff748009240 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:39.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.164+0000 7f3bf27fc640 1 -- 10.20.193.58:0/3078067871 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f3bf4019070 con 0x7f3c040b5eb0 2026-02-23T06:21:39.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.165+0000 7f3bf27fc640 1 --2- 10.20.193.58:0/3078067871 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3be007a710 0x7f3be009abc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.166+0000 7f3bf27fc640 1 -- 10.20.193.58:0/3078067871 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f3bf409d910 con 0x7f3c040b5eb0 2026-02-23T06:21:39.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.166+0000 7f3c0a001640 1 --2- 10.20.193.58:0/3078067871 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3be007a710 0x7f3be009abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.166+0000 7f3c0a001640 1 --2- 10.20.193.58:0/3078067871 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3be007a710 0x7f3be009abc0 secure :-1 s=READY pgs=94 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3bf8005fd0 tx=0x7f3bf800a580 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:39.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.167+0000 7f3bf27fc640 1 -- 10.20.193.58:0/3078067871 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f3bf4060a50 con 0x7f3c040b5eb0 2026-02-23T06:21:39.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.216+0000 7f8acfd0c640 1 -- 10.20.193.58:0/229379925 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ac80b1540 msgr2=0x7f8ac80b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.211 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.216+0000 7f8acfd0c640 1 --2- 10.20.193.58:0/229379925 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ac80b1540 0x7f8ac80b5610 secure :-1 s=READY pgs=74 gs=2 cs=0 l=1 c_cookie=2420836061018988534 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ac81653c0 tx=0x7f8abc02f340 comp rx=0 tx=0).stop 2026-02-23T06:21:39.211 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.216+0000 7f8acfd0c640 1 -- 10.20.193.58:0/229379925 shutdown_connections 2026-02-23T06:21:39.211 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.216+0000 7f8acfd0c640 1 --2- 10.20.193.58:0/229379925 >> v2:10.20.193.93:3300/0 conn(0x7f8ac80b1910 0x7f8ac80b6a00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.211 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.216+0000 7f8acfd0c640 1 --2- 10.20.193.58:0/229379925 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ac80b1540 0x7f8ac80b5610 unknown :-1 s=CLOSED pgs=74 gs=2 cs=0 l=1 c_cookie=2420836061018988534 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.211 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.216+0000 7f8acfd0c640 1 -- 10.20.193.58:0/229379925 >> 10.20.193.58:0/229379925 conn(0x7f8ac8058e50 msgr2=0x7f8ac8059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:39.211 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.216+0000 7f8acfd0c640 1 -- 10.20.193.58:0/229379925 shutdown_connections 2026-02-23T06:21:39.211 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.216+0000 7f8acfd0c640 1 -- 10.20.193.58:0/229379925 wait complete. 2026-02-23T06:21:39.212 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.217+0000 7f8acfd0c640 1 Processor -- start 2026-02-23T06:21:39.212 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.218+0000 7f8acfd0c640 1 -- start start 2026-02-23T06:21:39.212 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.218+0000 7f8acfd0c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8ac80b1540 0x7f8ac805cdd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.212 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.218+0000 7f8acfd0c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ac80b1910 0x7f8ac81612d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.212 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.218+0000 7f8acfd0c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ac80b39f0 0x7f8ac805b2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.212 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.218+0000 7f8acfd0c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac805c930 con 0x7f8ac80b39f0 2026-02-23T06:21:39.212 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.218+0000 7f8acfd0c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac8140f30 con 0x7f8ac80b1540 2026-02-23T06:21:39.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.218+0000 7f8acfd0c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f8ac8140640 con 0x7f8ac80b1910 2026-02-23T06:21:39.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.218+0000 7f8ace282640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ac80b39f0 0x7f8ac805b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.218+0000 7f8ace282640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ac80b39f0 0x7f8ac805b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:56782/0 (socket says 10.20.193.58:56782) 2026-02-23T06:21:39.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.218+0000 7f8ace282640 1 -- 10.20.193.58:0/3786995394 learned_addr learned my addr 10.20.193.58:0/3786995394 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:39.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.219+0000 7f8acda81640 1 --2- 10.20.193.58:0/3786995394 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8ac80b1540 0x7f8ac805cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.219+0000 7f8acd280640 1 --2- 10.20.193.58:0/3786995394 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ac80b1910 0x7f8ac81612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.219+0000 7f8ace282640 1 -- 10.20.193.58:0/3786995394 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ac80b1910 msgr2=0x7f8ac81612d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.219+0000 7f8ace282640 1 --2- 10.20.193.58:0/3786995394 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ac80b1910 0x7f8ac81612d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.219+0000 7f8ace282640 1 -- 10.20.193.58:0/3786995394 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8ac80b1540 msgr2=0x7f8ac805cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.219+0000 7f8ace282640 1 --2- 10.20.193.58:0/3786995394 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8ac80b1540 0x7f8ac805cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.219+0000 7f8ace282640 1 -- 10.20.193.58:0/3786995394 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab80094b0 con 0x7f8ac80b39f0 2026-02-23T06:21:39.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.219+0000 7f8acd280640 1 --2- 10.20.193.58:0/3786995394 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ac80b1910 0x7f8ac81612d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:39.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.219+0000 7f4708a3f640 1 -- 10.20.193.58:0/3480161660 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f46fc030d00 con 0x7f46e4003ad0 2026-02-23T06:21:39.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.219+0000 7f8acda81640 1 --2- 10.20.193.58:0/3786995394 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8ac80b1540 0x7f8ac805cdd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:21:39.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.220+0000 7f470bccc640 1 -- 10.20.193.58:0/3480161660 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f46e4003ad0 msgr2=0x7f46e4003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.220+0000 7f470bccc640 1 --2- 10.20.193.58:0/3480161660 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f46e4003ad0 0x7f46e4003ee0 secure :-1 s=READY pgs=148 gs=4 cs=0 l=1 c_cookie=17230332827926971826 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47040b3920 tx=0x7f46fc0302c0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.220+0000 7f470a242640 1 -- 10.20.193.58:0/3480161660 reap_dead start 2026-02-23T06:21:39.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.220+0000 7f8ace282640 1 --2- 10.20.193.58:0/3786995394 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ac80b39f0 0x7f8ac805b2d0 secure :-1 s=READY pgs=149 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ac4008fd0 tx=0x7f8ac400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:39.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.220+0000 7f470bccc640 1 -- 10.20.193.58:0/3480161660 shutdown_connections 2026-02-23T06:21:39.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.220+0000 7f470bccc640 1 -- 10.20.193.58:0/3480161660 >> 10.20.193.58:0/3480161660 conn(0x7f4704058e50 msgr2=0x7f4704059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:39.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.220+0000 7f8ab67fc640 1 -- 10.20.193.58:0/3786995394 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8ac4007b90 con 0x7f8ac80b39f0 2026-02-23T06:21:39.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.220+0000 7f470bccc640 1 -- 10.20.193.58:0/3480161660 shutdown_connections 2026-02-23T06:21:39.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.220+0000 7f470bccc640 1 -- 10.20.193.58:0/3480161660 wait complete. 2026-02-23T06:21:39.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.220+0000 7f8ab67fc640 1 -- 10.20.193.58:0/3786995394 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ac4007de0 con 0x7f8ac80b39f0 2026-02-23T06:21:39.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.220+0000 7f8ab67fc640 1 -- 10.20.193.58:0/3786995394 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8ac40052b0 con 0x7f8ac80b39f0 2026-02-23T06:21:39.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.221+0000 7f8acfd0c640 1 -- 10.20.193.58:0/3786995394 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8abc009570 con 0x7f8ac80b39f0 2026-02-23T06:21:39.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.221+0000 7f8acfd0c640 1 -- 10.20.193.58:0/3786995394 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ac81330d0 con 0x7f8ac80b39f0 2026-02-23T06:21:39.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.221+0000 7fdb41a83640 1 -- 10.20.193.58:0/856586538 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdb28003aa0 msgr2=0x7fdb28003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.221+0000 7fdb41a83640 1 --2- 10.20.193.58:0/856586538 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdb28003aa0 0x7fdb28003ed0 secure :-1 s=READY pgs=153 gs=4 cs=0 l=1 c_cookie=16891158687287318567 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb2c00ac20 tx=0x7fdb2c030d10 comp rx=0 tx=0).stop 2026-02-23T06:21:39.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.221+0000 7fdb41282640 1 -- 10.20.193.58:0/856586538 reap_dead start 2026-02-23T06:21:39.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.222+0000 7f470bccc640 1 Processor -- start 2026-02-23T06:21:39.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.222+0000 7fdb41a83640 1 -- 10.20.193.58:0/856586538 shutdown_connections 2026-02-23T06:21:39.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.222+0000 7fdb41a83640 1 -- 10.20.193.58:0/856586538 >> 10.20.193.58:0/856586538 conn(0x7fdb34054ad0 msgr2=0x7fdb34050d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:39.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.222+0000 7fdb41a83640 1 -- 10.20.193.58:0/856586538 shutdown_connections 2026-02-23T06:21:39.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.222+0000 7fdb41a83640 1 -- 10.20.193.58:0/856586538 wait complete. 2026-02-23T06:21:39.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.222+0000 7f470bccc640 1 -- start start 2026-02-23T06:21:39.217 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.223+0000 7f470bccc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4704127720 0x7f4704139090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.217 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.222+0000 7f8a97fff640 1 -- 10.20.193.58:0/3786995394 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a8c005300 con 0x7f8ac80b39f0 2026-02-23T06:21:39.217 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.223+0000 7f470bccc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f47040b65c0 0x7f47041395d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.217 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.223+0000 7f470bccc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f470413b6b0 0x7f4704162e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.223+0000 7f470bccc640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f47041282f0 con 0x7f4704127720 2026-02-23T06:21:39.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.223+0000 7f470bccc640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f47041285b0 con 0x7f470413b6b0 2026-02-23T06:21:39.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.223+0000 7f470a242640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f470413b6b0 0x7f4704162e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.223+0000 7f470a242640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f470413b6b0 0x7f4704162e10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:59322/0 (socket says 10.20.193.58:59322) 2026-02-23T06:21:39.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.223+0000 7f470a242640 1 -- 10.20.193.58:0/602185486 learned_addr learned my addr 10.20.193.58:0/602185486 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:39.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.223+0000 7f470bccc640 1 -- 10.20.193.58:0/602185486 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f4704128890 con 0x7f47040b65c0 2026-02-23T06:21:39.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.223+0000 7f4709a41640 1 --2- 10.20.193.58:0/602185486 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4704127720 0x7f4704139090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.224+0000 7fdb41a83640 1 Processor -- start 2026-02-23T06:21:39.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.224+0000 7f4709240640 1 --2- 10.20.193.58:0/602185486 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f47040b65c0 0x7f47041395d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.224+0000 7f8ab67fc640 1 -- 10.20.193.58:0/3786995394 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f8ac4005410 con 0x7f8ac80b39f0 2026-02-23T06:21:39.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.224+0000 7f470a242640 1 -- 10.20.193.58:0/602185486 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f47040b65c0 msgr2=0x7f47041395d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.224+0000 7f470a242640 1 --2- 10.20.193.58:0/602185486 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f47040b65c0 0x7f47041395d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.224+0000 7f470a242640 1 -- 10.20.193.58:0/602185486 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4704127720 msgr2=0x7f4704139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.224+0000 7f470a242640 1 --2- 10.20.193.58:0/602185486 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4704127720 0x7f4704139090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.224+0000 7fdb41a83640 1 -- start start 2026-02-23T06:21:39.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.224+0000 7f470a242640 1 -- 10.20.193.58:0/602185486 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4704162330 con 0x7f470413b6b0 2026-02-23T06:21:39.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.224+0000 7f4709240640 1 --2- 10.20.193.58:0/602185486 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f47040b65c0 0x7f47041395d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:21:39.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.224+0000 7f470a242640 1 --2- 10.20.193.58:0/602185486 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f470413b6b0 0x7f4704162e10 secure :-1 s=READY pgs=154 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47040581f0 tx=0x7f46ec009610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:39.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.224+0000 7f4709a41640 1 --2- 10.20.193.58:0/602185486 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4704127720 0x7f4704139090 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:21:39.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.224+0000 7f46fa7fc640 1 -- 10.20.193.58:0/602185486 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f46ec009970 con 0x7f470413b6b0 2026-02-23T06:21:39.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.224+0000 7f46fa7fc640 1 -- 10.20.193.58:0/602185486 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46ec010050 con 0x7f470413b6b0 2026-02-23T06:21:39.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.224+0000 7f470bccc640 1 -- 10.20.193.58:0/602185486 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4704162610 con 0x7f470413b6b0 2026-02-23T06:21:39.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.225+0000 7f46fa7fc640 1 -- 10.20.193.58:0/602185486 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f46ec009d50 con 0x7f470413b6b0 2026-02-23T06:21:39.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.225+0000 7f470bccc640 1 -- 10.20.193.58:0/602185486 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4704165180 con 0x7f470413b6b0 2026-02-23T06:21:39.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.225+0000 7fdb41a83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdb28003aa0 0x7fdb341927b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.225+0000 7fdb41a83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdb34196770 0x7fdb340d2c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.225+0000 7fdb41a83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdb340d4cb0 0x7fdb340d9660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.225+0000 7fdb41a83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fdb34196350 con 0x7fdb28003aa0 2026-02-23T06:21:39.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.225+0000 7fdb41a83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fdb340d7cc0 con 0x7fdb34196770 2026-02-23T06:21:39.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.225+0000 7fdb41a83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fdb340d3150 con 0x7fdb340d4cb0 2026-02-23T06:21:39.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.225+0000 7fdb41282640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdb340d4cb0 0x7fdb340d9660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.225+0000 7fdb41282640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdb340d4cb0 0x7fdb340d9660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:58952/0 (socket says 10.20.193.58:58952) 2026-02-23T06:21:39.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.225+0000 7fdb41282640 1 -- 10.20.193.58:0/596598346 learned_addr learned my addr 10.20.193.58:0/596598346 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:39.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.225+0000 7fdb3bfff640 1 --2- 10.20.193.58:0/596598346 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdb34196770 0x7fdb340d2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.226+0000 7fdb40a81640 1 --2- 10.20.193.58:0/596598346 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdb28003aa0 0x7fdb341927b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.226+0000 7fdb41282640 1 -- 10.20.193.58:0/596598346 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdb34196770 msgr2=0x7fdb340d2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.226+0000 7fdb41282640 1 --2- 10.20.193.58:0/596598346 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdb34196770 0x7fdb340d2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.226+0000 7fdb41282640 1 -- 10.20.193.58:0/596598346 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdb28003aa0 msgr2=0x7fdb341927b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.226+0000 7f46fa7fc640 1 -- 10.20.193.58:0/602185486 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f46ec0026a0 con 0x7f470413b6b0 2026-02-23T06:21:39.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.226+0000 7fdb41282640 1 --2- 10.20.193.58:0/596598346 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdb28003aa0 0x7fdb341927b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.226+0000 7fdb41282640 1 -- 10.20.193.58:0/596598346 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb34196ba0 con 0x7fdb340d4cb0 2026-02-23T06:21:39.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.227+0000 7f46fa7fc640 1 --2- 10.20.193.58:0/602185486 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f46e007a6c0 0x7f46e009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.227+0000 7f46fa7fc640 1 -- 10.20.193.58:0/602185486 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f46ec09ca50 con 0x7f470413b6b0 2026-02-23T06:21:39.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.227+0000 7fdb41282640 1 --2- 10.20.193.58:0/596598346 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdb340d4cb0 0x7fdb340d9660 secure :-1 s=READY pgs=75 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb30006600 tx=0x7fdb30006700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:39.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.227+0000 7fdb397fa640 1 -- 10.20.193.58:0/596598346 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb30017070 con 0x7fdb340d4cb0 2026-02-23T06:21:39.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.227+0000 7f4709a41640 1 --2- 10.20.193.58:0/602185486 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f46e007a6c0 0x7f46e009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.228+0000 7fdb397fa640 1 -- 10.20.193.58:0/596598346 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb30003be0 con 0x7fdb340d4cb0 2026-02-23T06:21:39.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.228+0000 7f470bccc640 1 -- 10.20.193.58:0/602185486 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47040af2c0 con 0x7f470413b6b0 2026-02-23T06:21:39.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.228+0000 7f4709a41640 1 --2- 10.20.193.58:0/602185486 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f46e007a6c0 0x7f46e009ab70 secure :-1 s=READY pgs=95 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f470405f300 tx=0x7f46fc032040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:39.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.228+0000 7fdb397fa640 1 -- 10.20.193.58:0/596598346 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb30011430 con 0x7fdb340d4cb0 2026-02-23T06:21:39.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.228+0000 7f8ab67fc640 1 --2- 10.20.193.58:0/3786995394 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8a9807a790 0x7f8a9809ac40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.228+0000 7fdb41a83640 1 -- 10.20.193.58:0/596598346 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb34195cd0 con 0x7fdb340d4cb0 2026-02-23T06:21:39.223 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.228+0000 7fdb41a83640 1 -- 10.20.193.58:0/596598346 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb340da410 con 0x7fdb340d4cb0 2026-02-23T06:21:39.223 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.228+0000 7f8ab67fc640 1 -- 10.20.193.58:0/3786995394 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f8ac409dfb0 con 0x7f8ac80b39f0 2026-02-23T06:21:39.223 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.228+0000 7f8acda81640 1 --2- 10.20.193.58:0/3786995394 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8a9807a790 0x7f8a9809ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.223 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.229+0000 7f8ab67fc640 1 -- 10.20.193.58:0/3786995394 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f8ac40a25c0 con 0x7f8ac80b39f0 2026-02-23T06:21:39.223 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.229+0000 7fdb12ffd640 1 -- 10.20.193.58:0/596598346 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb34196490 con 0x7fdb340d4cb0 2026-02-23T06:21:39.223 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.229+0000 7f8acda81640 1 --2- 10.20.193.58:0/3786995394 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8a9807a790 0x7f8a9809ac40 secure :-1 s=READY pgs=96 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8abc005ca0 tx=0x7f8abc031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:39.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.230+0000 7f46fa7fc640 1 -- 10.20.193.58:0/602185486 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f46ec05fc00 con 0x7f470413b6b0 2026-02-23T06:21:39.225 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.231+0000 7fdb397fa640 1 -- 10.20.193.58:0/596598346 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fdb30011590 con 0x7fdb340d4cb0 2026-02-23T06:21:39.226 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.232+0000 7fdb397fa640 1 --2- 10.20.193.58:0/596598346 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdb0007a6b0 0x7fdb0009ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.226 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.232+0000 7fdb397fa640 1 -- 10.20.193.58:0/596598346 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7fdb3009d720 con 0x7fdb340d4cb0 2026-02-23T06:21:39.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.232+0000 7fdb397fa640 1 -- 10.20.193.58:0/596598346 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fdb3009dc10 con 0x7fdb340d4cb0 2026-02-23T06:21:39.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.233+0000 7fdb40a81640 1 --2- 10.20.193.58:0/596598346 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdb0007a6b0 0x7fdb0009ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.230 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.236+0000 7fdb40a81640 1 --2- 10.20.193.58:0/596598346 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdb0007a6b0 0x7fdb0009ab60 secure :-1 s=READY pgs=97 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb2c00ab70 tx=0x7fdb2c03b040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:39.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.280+0000 7ff979483640 1 -- 10.20.193.58:0/1433655339 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff974165880 con 0x7ff958045a00 2026-02-23T06:21:39.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.280+0000 7ff970ff9640 1 -- 10.20.193.58:0/1433655339 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff960064200 con 0x7ff958045a00 2026-02-23T06:21:39.276 INFO:teuthology.orchestra.run.trial058.stdout:55834574856 2026-02-23T06:21:39.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.283+0000 7f3a4c7d4640 1 -- 10.20.193.58:0/2142387402 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f3a4412d210 con 0x7f3a4415bde0 2026-02-23T06:21:39.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.283+0000 7f3a2effd640 1 -- 10.20.193.58:0/2142387402 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3a38088dc0 con 0x7f3a4415bde0 2026-02-23T06:21:39.279 INFO:teuthology.orchestra.run.trial058.stdout:55834574856 2026-02-23T06:21:39.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.283+0000 7ff979483640 1 -- 10.20.193.58:0/1433655339 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff94807a730 msgr2=0x7ff94809abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.283+0000 7ff979483640 1 --2- 10.20.193.58:0/1433655339 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff94807a730 0x7ff94809abe0 secure :-1 s=READY pgs=91 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff974164610 tx=0x7ff964002da0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.283+0000 7ff979483640 1 -- 10.20.193.58:0/1433655339 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff958045a00 msgr2=0x7ff97415e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.283+0000 7ff979483640 1 --2- 10.20.193.58:0/1433655339 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff958045a00 0x7ff97415e860 secure :-1 s=READY pgs=147 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff960005f10 tx=0x7ff96000ee60 comp rx=0 tx=0).stop 2026-02-23T06:21:39.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.285+0000 7ff979483640 1 -- 10.20.193.58:0/1433655339 shutdown_connections 2026-02-23T06:21:39.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.285+0000 7ff979483640 1 --2- 10.20.193.58:0/1433655339 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff94807a730 0x7ff94809abe0 unknown :-1 s=CLOSED pgs=91 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.285+0000 7ff979483640 1 --2- 10.20.193.58:0/1433655339 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff9741538a0 0x7ff9740587d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.285+0000 7ff979483640 1 --2- 10.20.193.58:0/1433655339 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff974164220 0x7ff97415d790 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.285+0000 7ff979483640 1 --2- 10.20.193.58:0/1433655339 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff958045a00 0x7ff97415e860 unknown :-1 s=CLOSED pgs=147 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.285+0000 7ff979483640 1 -- 10.20.193.58:0/1433655339 >> 10.20.193.58:0/1433655339 conn(0x7ff9740b3c20 msgr2=0x7ff974159e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:39.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.285+0000 7ff979483640 1 -- 10.20.193.58:0/1433655339 shutdown_connections 2026-02-23T06:21:39.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.285+0000 7ff979483640 1 -- 10.20.193.58:0/1433655339 wait complete. 2026-02-23T06:21:39.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.287+0000 7f3a4c7d4640 1 -- 10.20.193.58:0/2142387402 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3a1c07a790 msgr2=0x7f3a1c09ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.287+0000 7f3a4c7d4640 1 --2- 10.20.193.58:0/2142387402 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3a1c07a790 0x7f3a1c09ac40 secure :-1 s=READY pgs=90 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a40008960 tx=0x7f3a4000a040 comp rx=0 tx=0).stop 2026-02-23T06:21:39.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.287+0000 7f3a4c7d4640 1 -- 10.20.193.58:0/2142387402 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3a4415bde0 msgr2=0x7f3a44159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.287+0000 7f3a4c7d4640 1 --2- 10.20.193.58:0/2142387402 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3a4415bde0 0x7f3a44159c10 secure :-1 s=READY pgs=142 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a38005db0 tx=0x7f3a380028d0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.287+0000 7f3a4c7d4640 1 -- 10.20.193.58:0/2142387402 shutdown_connections 2026-02-23T06:21:39.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.287+0000 7f3a4c7d4640 1 --2- 10.20.193.58:0/2142387402 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3a1c07a790 0x7f3a1c09ac40 unknown :-1 s=CLOSED pgs=90 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.287+0000 7f3a4c7d4640 1 --2- 10.20.193.58:0/2142387402 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3a4415bde0 0x7f3a44159c10 unknown :-1 s=CLOSED pgs=142 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.287+0000 7f3a4c7d4640 1 --2- 10.20.193.58:0/2142387402 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3a4415ba10 0x7f3a4413b6a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.287+0000 7f3a4c7d4640 1 --2- 10.20.193.58:0/2142387402 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3a440b7000 0x7f3a4412b9a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.287+0000 7f3a4c7d4640 1 -- 10.20.193.58:0/2142387402 >> 10.20.193.58:0/2142387402 conn(0x7f3a44058e50 msgr2=0x7f3a440b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:39.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.288+0000 7f3a4c7d4640 1 -- 10.20.193.58:0/2142387402 shutdown_connections 2026-02-23T06:21:39.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.288+0000 7f3a4c7d4640 1 -- 10.20.193.58:0/2142387402 wait complete. 2026-02-23T06:21:39.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.292+0000 7f4783fff640 1 -- 10.20.193.58:0/4151062059 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f478413cee0 con 0x7f478413b610 2026-02-23T06:21:39.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.292+0000 7f477b7fe640 1 -- 10.20.193.58:0/4151062059 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f476805fcc0 con 0x7f478413b610 2026-02-23T06:21:39.289 INFO:teuthology.orchestra.run.trial058.stdout:55834574857 2026-02-23T06:21:39.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.295+0000 7f4783fff640 1 -- 10.20.193.58:0/4151062059 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f475007a720 msgr2=0x7f475009abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.295+0000 7f4783fff640 1 --2- 10.20.193.58:0/4151062059 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f475007a720 0x7f475009abd0 secure :-1 s=READY pgs=92 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4770007ef0 tx=0x7f478405be30 comp rx=0 tx=0).stop 2026-02-23T06:21:39.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.295+0000 7f4783fff640 1 -- 10.20.193.58:0/4151062059 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f478413b610 msgr2=0x7f478415e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.295+0000 7f4783fff640 1 --2- 10.20.193.58:0/4151062059 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f478413b610 0x7f478415e780 secure :-1 s=READY pgs=150 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f476800b4d0 tx=0x7f476800b5d0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.295+0000 7f4783fff640 1 -- 10.20.193.58:0/4151062059 shutdown_connections 2026-02-23T06:21:39.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.295+0000 7f4783fff640 1 --2- 10.20.193.58:0/4151062059 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f475007a720 0x7f475009abd0 unknown :-1 s=CLOSED pgs=92 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.295+0000 7f4783fff640 1 --2- 10.20.193.58:0/4151062059 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f478415ecc0 0x7f478413bf50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.295+0000 7f4783fff640 1 --2- 10.20.193.58:0/4151062059 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f478413b610 0x7f478415e780 unknown :-1 s=CLOSED pgs=150 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.295+0000 7f4783fff640 1 --2- 10.20.193.58:0/4151062059 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f476c003ad0 0x7f478413fd50 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.295+0000 7f4783fff640 1 -- 10.20.193.58:0/4151062059 >> 10.20.193.58:0/4151062059 conn(0x7f47840b3c20 msgr2=0x7f478405c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:39.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.295+0000 7f4783fff640 1 -- 10.20.193.58:0/4151062059 shutdown_connections 2026-02-23T06:21:39.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.296+0000 7f4783fff640 1 -- 10.20.193.58:0/4151062059 wait complete. 2026-02-23T06:21:39.293 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2026-02-23T06:21:39.293 DEBUG:teuthology.parallel:result is None 2026-02-23T06:21:39.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.299+0000 7ff753fff640 1 -- 10.20.193.58:0/2464681864 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ff75415b830 con 0x7ff754058ba0 2026-02-23T06:21:39.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.300+0000 7ff7337fe640 1 -- 10.20.193.58:0/2464681864 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff73c0634e0 con 0x7ff754058ba0 2026-02-23T06:21:39.295 INFO:teuthology.orchestra.run.trial058.stdout:55834574857 2026-02-23T06:21:39.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.301+0000 7f3c0c28c640 1 -- 10.20.193.58:0/3078067871 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f3c04144370 con 0x7f3c040b5eb0 2026-02-23T06:21:39.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2026-02-23T06:21:39.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.302+0000 7f3bf27fc640 1 -- 10.20.193.58:0/3078067871 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3bf4060a50 con 0x7f3c040b5eb0 2026-02-23T06:21:39.297 INFO:teuthology.orchestra.run.trial058.stdout:55834574856 2026-02-23T06:21:39.297 DEBUG:teuthology.parallel:result is None 2026-02-23T06:21:39.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.303+0000 7ff753fff640 1 -- 10.20.193.58:0/2464681864 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff72407a790 msgr2=0x7ff72409ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.303+0000 7ff753fff640 1 --2- 10.20.193.58:0/2464681864 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff72407a790 0x7ff72409ac40 secure :-1 s=READY pgs=93 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff754160cc0 tx=0x7ff748009240 comp rx=0 tx=0).stop 2026-02-23T06:21:39.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.303+0000 7ff753fff640 1 -- 10.20.193.58:0/2464681864 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff754058ba0 msgr2=0x7ff75415a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.303+0000 7ff753fff640 1 --2- 10.20.193.58:0/2464681864 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff754058ba0 0x7ff75415a220 secure :-1 s=READY pgs=145 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff73c00b520 tx=0x7ff73c00b9f0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.303+0000 7ff753fff640 1 -- 10.20.193.58:0/2464681864 shutdown_connections 2026-02-23T06:21:39.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.303+0000 7ff753fff640 1 --2- 10.20.193.58:0/2464681864 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff72407a790 0x7ff72409ac40 unknown :-1 s=CLOSED pgs=93 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.303+0000 7ff753fff640 1 --2- 10.20.193.58:0/2464681864 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff75415b460 0x7ff75413c1b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.303+0000 7ff753fff640 1 --2- 10.20.193.58:0/2464681864 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff7540b7050 0x7ff75413bc70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.303+0000 7ff753fff640 1 --2- 10.20.193.58:0/2464681864 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff754058ba0 0x7ff75415a220 unknown :-1 s=CLOSED pgs=145 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.303+0000 7ff753fff640 1 -- 10.20.193.58:0/2464681864 >> 10.20.193.58:0/2464681864 conn(0x7ff7540b3c20 msgr2=0x7ff7541620b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:39.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.304+0000 7ff753fff640 1 -- 10.20.193.58:0/2464681864 shutdown_connections 2026-02-23T06:21:39.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.304+0000 7ff753fff640 1 -- 10.20.193.58:0/2464681864 wait complete. 2026-02-23T06:21:39.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.304+0000 7f3c0c28c640 1 -- 10.20.193.58:0/3078067871 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3be007a710 msgr2=0x7f3be009abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.304+0000 7f3c0c28c640 1 --2- 10.20.193.58:0/3078067871 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3be007a710 0x7f3be009abc0 secure :-1 s=READY pgs=94 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3bf8005fd0 tx=0x7f3bf800a580 comp rx=0 tx=0).stop 2026-02-23T06:21:39.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.304+0000 7f3c0c28c640 1 -- 10.20.193.58:0/3078067871 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c040b5eb0 msgr2=0x7f3c0413f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.304+0000 7f3c0c28c640 1 --2- 10.20.193.58:0/3078067871 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c040b5eb0 0x7f3c0413f810 secure :-1 s=READY pgs=146 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3bf400c700 tx=0x7f3bf400cbd0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.305+0000 7f3c0c28c640 1 -- 10.20.193.58:0/3078067871 shutdown_connections 2026-02-23T06:21:39.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.305+0000 7f3c0c28c640 1 --2- 10.20.193.58:0/3078067871 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3be007a710 0x7f3be009abc0 unknown :-1 s=CLOSED pgs=94 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.305+0000 7f3c0c28c640 1 --2- 10.20.193.58:0/3078067871 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c040bbbf0 0x7f3c0415e620 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.305+0000 7f3c0c28c640 1 --2- 10.20.193.58:0/3078067871 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c040b5eb0 0x7f3c0413f810 unknown :-1 s=CLOSED pgs=146 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.305+0000 7f3c0c28c640 1 --2- 10.20.193.58:0/3078067871 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3c040b5ae0 0x7f3c0409f420 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.305+0000 7f3c0c28c640 1 -- 10.20.193.58:0/3078067871 >> 10.20.193.58:0/3078067871 conn(0x7f3c04056790 msgr2=0x7f3c04169600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:39.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.305+0000 7f3c0c28c640 1 -- 10.20.193.58:0/3078067871 shutdown_connections 2026-02-23T06:21:39.302 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.305+0000 7f3c0c28c640 1 -- 10.20.193.58:0/3078067871 wait complete. 2026-02-23T06:21:39.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2026-02-23T06:21:39.306 DEBUG:teuthology.parallel:result is None 2026-02-23T06:21:39.311 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.7 2026-02-23T06:21:39.311 DEBUG:teuthology.parallel:result is None 2026-02-23T06:21:39.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2026-02-23T06:21:39.314 DEBUG:teuthology.parallel:result is None 2026-02-23T06:21:39.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.352+0000 7f8a97fff640 1 -- 10.20.193.58:0/3786995394 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f8a8c0055b0 con 0x7f8ac80b39f0 2026-02-23T06:21:39.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.353+0000 7f8ab67fc640 1 -- 10.20.193.58:0/3786995394 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8ac4061330 con 0x7f8ac80b39f0 2026-02-23T06:21:39.348 INFO:teuthology.orchestra.run.trial058.stdout:55834574857 2026-02-23T06:21:39.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.354+0000 7fdb12ffd640 1 -- 10.20.193.58:0/596598346 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fdb3404ec80 con 0x7fdb340d4cb0 2026-02-23T06:21:39.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.354+0000 7fdb397fa640 1 -- 10.20.193.58:0/596598346 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdb30087e60 con 0x7fdb340d4cb0 2026-02-23T06:21:39.349 INFO:teuthology.orchestra.run.trial058.stdout:55834574856 2026-02-23T06:21:39.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.355+0000 7f470bccc640 1 -- 10.20.193.58:0/602185486 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f4704164710 con 0x7f470413b6b0 2026-02-23T06:21:39.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.355+0000 7f8a97fff640 1 -- 10.20.193.58:0/3786995394 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8a9807a790 msgr2=0x7f8a9809ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.355+0000 7f8a97fff640 1 --2- 10.20.193.58:0/3786995394 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8a9807a790 0x7f8a9809ac40 secure :-1 s=READY pgs=96 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8abc005ca0 tx=0x7f8abc031040 comp rx=0 tx=0).stop 2026-02-23T06:21:39.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.355+0000 7f8a97fff640 1 -- 10.20.193.58:0/3786995394 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ac80b39f0 msgr2=0x7f8ac805b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.355+0000 7f8a97fff640 1 --2- 10.20.193.58:0/3786995394 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ac80b39f0 0x7f8ac805b2d0 secure :-1 s=READY pgs=149 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ac4008fd0 tx=0x7f8ac400dc10 comp rx=0 tx=0).stop 2026-02-23T06:21:39.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.355+0000 7f8a97fff640 1 -- 10.20.193.58:0/3786995394 shutdown_connections 2026-02-23T06:21:39.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.355+0000 7f8a97fff640 1 --2- 10.20.193.58:0/3786995394 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8a9807a790 0x7f8a9809ac40 unknown :-1 s=CLOSED pgs=96 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.355+0000 7f8a97fff640 1 --2- 10.20.193.58:0/3786995394 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ac80b39f0 0x7f8ac805b2d0 unknown :-1 s=CLOSED pgs=149 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.355+0000 7f8a97fff640 1 --2- 10.20.193.58:0/3786995394 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ac80b1910 0x7f8ac81612d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.355+0000 7f8a97fff640 1 --2- 10.20.193.58:0/3786995394 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8ac80b1540 0x7f8ac805cdd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.355+0000 7f8a97fff640 1 -- 10.20.193.58:0/3786995394 >> 10.20.193.58:0/3786995394 conn(0x7f8ac8058e50 msgr2=0x7f8ac8163d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:39.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.355+0000 7f46fa7fc640 1 -- 10.20.193.58:0/602185486 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f46ec01b020 con 0x7f470413b6b0 2026-02-23T06:21:39.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.355+0000 7f8a97fff640 1 -- 10.20.193.58:0/3786995394 shutdown_connections 2026-02-23T06:21:39.352 INFO:teuthology.orchestra.run.trial058.stdout:55834574857 2026-02-23T06:21:39.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.355+0000 7f8a97fff640 1 -- 10.20.193.58:0/3786995394 wait complete. 2026-02-23T06:21:39.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.357+0000 7fdb12ffd640 1 -- 10.20.193.58:0/596598346 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdb0007a6b0 msgr2=0x7fdb0009ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.357+0000 7fdb12ffd640 1 --2- 10.20.193.58:0/596598346 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdb0007a6b0 0x7fdb0009ab60 secure :-1 s=READY pgs=97 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb2c00ab70 tx=0x7fdb2c03b040 comp rx=0 tx=0).stop 2026-02-23T06:21:39.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.357+0000 7fdb12ffd640 1 -- 10.20.193.58:0/596598346 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdb340d4cb0 msgr2=0x7fdb340d9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.357+0000 7fdb12ffd640 1 --2- 10.20.193.58:0/596598346 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdb340d4cb0 0x7fdb340d9660 secure :-1 s=READY pgs=75 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb30006600 tx=0x7fdb30006700 comp rx=0 tx=0).stop 2026-02-23T06:21:39.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.357+0000 7fdb12ffd640 1 -- 10.20.193.58:0/596598346 shutdown_connections 2026-02-23T06:21:39.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.357+0000 7fdb12ffd640 1 --2- 10.20.193.58:0/596598346 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdb0007a6b0 0x7fdb0009ab60 unknown :-1 s=CLOSED pgs=97 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.357+0000 7fdb12ffd640 1 --2- 10.20.193.58:0/596598346 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdb340d4cb0 0x7fdb340d9660 unknown :-1 s=CLOSED pgs=75 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.357+0000 7fdb12ffd640 1 --2- 10.20.193.58:0/596598346 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdb34196770 0x7fdb340d2c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.357+0000 7fdb12ffd640 1 --2- 10.20.193.58:0/596598346 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdb28003aa0 0x7fdb341927b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.357+0000 7fdb12ffd640 1 -- 10.20.193.58:0/596598346 >> 10.20.193.58:0/596598346 conn(0x7fdb34054ad0 msgr2=0x7fdb34004fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:39.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.357+0000 7fdb12ffd640 1 -- 10.20.193.58:0/596598346 shutdown_connections 2026-02-23T06:21:39.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.357+0000 7fdb12ffd640 1 -- 10.20.193.58:0/596598346 wait complete. 2026-02-23T06:21:39.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.358+0000 7f470bccc640 1 -- 10.20.193.58:0/602185486 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f46e007a6c0 msgr2=0x7f46e009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.358+0000 7f470bccc640 1 --2- 10.20.193.58:0/602185486 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f46e007a6c0 0x7f46e009ab70 secure :-1 s=READY pgs=95 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f470405f300 tx=0x7f46fc032040 comp rx=0 tx=0).stop 2026-02-23T06:21:39.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.358+0000 7f470bccc640 1 -- 10.20.193.58:0/602185486 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f470413b6b0 msgr2=0x7f4704162e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.358+0000 7f470bccc640 1 --2- 10.20.193.58:0/602185486 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f470413b6b0 0x7f4704162e10 secure :-1 s=READY pgs=154 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47040581f0 tx=0x7f46ec009610 comp rx=0 tx=0).stop 2026-02-23T06:21:39.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.358+0000 7f470bccc640 1 -- 10.20.193.58:0/602185486 shutdown_connections 2026-02-23T06:21:39.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.358+0000 7f470bccc640 1 --2- 10.20.193.58:0/602185486 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f46e007a6c0 0x7f46e009ab70 unknown :-1 s=CLOSED pgs=95 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.358+0000 7f470bccc640 1 --2- 10.20.193.58:0/602185486 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f470413b6b0 0x7f4704162e10 unknown :-1 s=CLOSED pgs=154 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.358+0000 7f470bccc640 1 --2- 10.20.193.58:0/602185486 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f47040b65c0 0x7f47041395d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.358+0000 7f470bccc640 1 --2- 10.20.193.58:0/602185486 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4704127720 0x7f4704139090 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.358+0000 7f470bccc640 1 -- 10.20.193.58:0/602185486 >> 10.20.193.58:0/602185486 conn(0x7f4704058e50 msgr2=0x7f47040b7830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:39.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.358+0000 7f470bccc640 1 -- 10.20.193.58:0/602185486 shutdown_connections 2026-02-23T06:21:39.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.358+0000 7f470bccc640 1 -- 10.20.193.58:0/602185486 wait complete. 2026-02-23T06:21:39.363 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2026-02-23T06:21:39.364 DEBUG:teuthology.parallel:result is None 2026-02-23T06:21:39.365 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2026-02-23T06:21:39.365 DEBUG:teuthology.parallel:result is None 2026-02-23T06:21:39.366 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2026-02-23T06:21:39.366 DEBUG:teuthology.parallel:result is None 2026-02-23T06:21:39.366 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-23T06:21:39.367 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-23T06:21:39.527 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.533+0000 7f6862dd2640 1 -- 10.20.193.58:0/554794087 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f685c15d870 msgr2=0x7f685c0587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.528 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.533+0000 7f6862dd2640 1 --2- 10.20.193.58:0/554794087 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f685c15d870 0x7f685c0587b0 secure :-1 s=READY pgs=150 gs=2 cs=0 l=1 c_cookie=14672360748809226044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f685c0b1b90 tx=0x7f685002f250 comp rx=0 tx=0).stop 2026-02-23T06:21:39.528 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.533+0000 7f6862dd2640 1 -- 10.20.193.58:0/554794087 shutdown_connections 2026-02-23T06:21:39.528 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.533+0000 7f6862dd2640 1 --2- 10.20.193.58:0/554794087 >> v2:10.20.193.93:3300/0 conn(0x7f685c0b6690 0x7f685c058cf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.528 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.533+0000 7f6862dd2640 1 --2- 10.20.193.58:0/554794087 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f685c15d870 0x7f685c0587b0 unknown :-1 s=CLOSED pgs=150 gs=2 cs=0 l=1 c_cookie=14672360748809226044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.528 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.533+0000 7f6862dd2640 1 --2- 10.20.193.58:0/554794087 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f685c15d4a0 0x7f685c0affb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.528 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.533+0000 7f6862dd2640 1 -- 10.20.193.58:0/554794087 >> 10.20.193.58:0/554794087 conn(0x7f685c0b3c20 msgr2=0x7f685c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:39.528 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.533+0000 7f6862dd2640 1 -- 10.20.193.58:0/554794087 shutdown_connections 2026-02-23T06:21:39.529 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.533+0000 7f6862dd2640 1 -- 10.20.193.58:0/554794087 wait complete. 2026-02-23T06:21:39.531 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.534+0000 7f6862dd2640 1 Processor -- start 2026-02-23T06:21:39.531 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.534+0000 7f6862dd2640 1 -- start start 2026-02-23T06:21:39.531 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.534+0000 7f6862dd2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f685c0b6690 0x7f685c13d200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.531 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.534+0000 7f6862dd2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f685c15d4a0 0x7f685c13dac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.531 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.534+0000 7f6862dd2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f685c15d870 0x7f685c13e000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.531 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.534+0000 7f6862dd2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f685c13e8a0 con 0x7f685c15d4a0 2026-02-23T06:21:39.531 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.534+0000 7f6862dd2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f685c15e940 con 0x7f685c0b6690 2026-02-23T06:21:39.531 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.534+0000 7f6862dd2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f685c13e5e0 con 0x7f685c15d870 2026-02-23T06:21:39.531 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.534+0000 7f68615cf640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f685c15d4a0 0x7f685c13dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.532 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.535+0000 7f68615cf640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f685c15d4a0 0x7f685c13dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:56832/0 (socket says 10.20.193.58:56832) 2026-02-23T06:21:39.532 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.535+0000 7f68615cf640 1 -- 10.20.193.58:0/748019350 learned_addr learned my addr 10.20.193.58:0/748019350 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:39.532 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.535+0000 7f68625d1640 1 --2- 10.20.193.58:0/748019350 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f685c15d870 0x7f685c13e000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.532 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.535+0000 7f6861dd0640 1 --2- 10.20.193.58:0/748019350 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f685c0b6690 0x7f685c13d200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.532 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.535+0000 7f68615cf640 1 -- 10.20.193.58:0/748019350 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f685c15d870 msgr2=0x7f685c13e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.532 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.535+0000 7f68615cf640 1 --2- 10.20.193.58:0/748019350 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f685c15d870 0x7f685c13e000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.532 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.535+0000 7f68615cf640 1 -- 10.20.193.58:0/748019350 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f685c0b6690 msgr2=0x7f685c13d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.532 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.535+0000 7f68615cf640 1 --2- 10.20.193.58:0/748019350 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f685c0b6690 0x7f685c13d200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.532 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.535+0000 7f68615cf640 1 -- 10.20.193.58:0/748019350 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6850009570 con 0x7f685c15d4a0 2026-02-23T06:21:39.532 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.535+0000 7f68615cf640 1 --2- 10.20.193.58:0/748019350 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f685c15d4a0 0x7f685c13dac0 secure :-1 s=READY pgs=151 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6850004740 tx=0x7f68500028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:39.532 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.535+0000 7f684a7fc640 1 -- 10.20.193.58:0/748019350 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f685003d070 con 0x7f685c15d4a0 2026-02-23T06:21:39.532 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.535+0000 7f684a7fc640 1 -- 10.20.193.58:0/748019350 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6850038470 con 0x7f685c15d4a0 2026-02-23T06:21:39.533 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.535+0000 7f684a7fc640 1 -- 10.20.193.58:0/748019350 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68500388a0 con 0x7f685c15d4a0 2026-02-23T06:21:39.533 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.535+0000 7f6862dd2640 1 -- 10.20.193.58:0/748019350 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f685c14a6d0 con 0x7f685c15d4a0 2026-02-23T06:21:39.533 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.535+0000 7f6862dd2640 1 -- 10.20.193.58:0/748019350 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f685c15e010 con 0x7f685c15d4a0 2026-02-23T06:21:39.533 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.536+0000 7f6862dd2640 1 -- 10.20.193.58:0/748019350 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f685c0b7260 con 0x7f685c15d4a0 2026-02-23T06:21:39.534 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.537+0000 7f684a7fc640 1 -- 10.20.193.58:0/748019350 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f6850038a00 con 0x7f685c15d4a0 2026-02-23T06:21:39.534 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.538+0000 7f684a7fc640 1 --2- 10.20.193.58:0/748019350 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f682c07a6c0 0x7f682c09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.534 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.538+0000 7f684a7fc640 1 -- 10.20.193.58:0/748019350 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f68500c2120 con 0x7f685c15d4a0 2026-02-23T06:21:39.534 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.538+0000 7f6861dd0640 1 --2- 10.20.193.58:0/748019350 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f682c07a6c0 0x7f682c09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.534 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.539+0000 7f6861dd0640 1 --2- 10.20.193.58:0/748019350 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f682c07a6c0 0x7f682c09ab70 secure :-1 s=READY pgs=98 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f684c004740 tx=0x7f684c005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:39.534 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.540+0000 7f684a7fc640 1 -- 10.20.193.58:0/748019350 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f6850085320 con 0x7f685c15d4a0 2026-02-23T06:21:39.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.651+0000 7f6862dd2640 1 -- 10.20.193.58:0/748019350 --> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f685c164250 con 0x7f682c07a6c0 2026-02-23T06:21:39.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.655+0000 7f684a7fc640 1 -- 10.20.193.58:0/748019350 <== mgr.4126 v2:10.20.193.93:6800/4124709854 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332641 (secure 0 0 0) 0x7f684c009900 con 0x7f682c07a6c0 2026-02-23T06:21:39.653 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:39.655 INFO:teuthology.orchestra.run.trial058.stderr:dumped all 2026-02-23T06:21:39.657 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.657+0000 7f6862dd2640 1 -- 10.20.193.58:0/748019350 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f682c07a6c0 msgr2=0x7f682c09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.657 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.657+0000 7f6862dd2640 1 --2- 10.20.193.58:0/748019350 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f682c07a6c0 0x7f682c09ab70 secure :-1 s=READY pgs=98 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f684c004740 tx=0x7f684c005f90 comp rx=0 tx=0).stop 2026-02-23T06:21:39.657 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.657+0000 7f6862dd2640 1 -- 10.20.193.58:0/748019350 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f685c15d4a0 msgr2=0x7f685c13dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.657 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.657+0000 7f6862dd2640 1 --2- 10.20.193.58:0/748019350 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f685c15d4a0 0x7f685c13dac0 secure :-1 s=READY pgs=151 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6850004740 tx=0x7f68500028d0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.657 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.658+0000 7f6862dd2640 1 -- 10.20.193.58:0/748019350 shutdown_connections 2026-02-23T06:21:39.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.658+0000 7f6862dd2640 1 --2- 10.20.193.58:0/748019350 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f682c07a6c0 0x7f682c09ab70 unknown :-1 s=CLOSED pgs=98 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.658+0000 7f6862dd2640 1 --2- 10.20.193.58:0/748019350 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f685c15d870 0x7f685c13e000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.658+0000 7f6862dd2640 1 --2- 10.20.193.58:0/748019350 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f685c15d4a0 0x7f685c13dac0 unknown :-1 s=CLOSED pgs=151 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.658+0000 7f6862dd2640 1 --2- 10.20.193.58:0/748019350 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f685c0b6690 0x7f685c13d200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.658+0000 7f6862dd2640 1 -- 10.20.193.58:0/748019350 >> 10.20.193.58:0/748019350 conn(0x7f685c0b3c20 msgr2=0x7f685c05ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:39.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.658+0000 7f6862dd2640 1 -- 10.20.193.58:0/748019350 shutdown_connections 2026-02-23T06:21:39.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.658+0000 7f6862dd2640 1 -- 10.20.193.58:0/748019350 wait complete. 2026-02-23T06:21:39.664 INFO:teuthology.orchestra.run.trial058.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2026-02-23T06:21:38.376952+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595115,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":193,"num_write_kb":2690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":217952,"kb_used_data":2272,"kb_used_omap":107,"kb_used_meta":215444,"kb_avail":754756768,"statfs":{"total":773094113280,"available":772870930432,"internally_reserved":0,"allocated":2326528,"data_stored":2026430,"data_compressed":70172,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":110106,"internal_metadata":220615142},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2293,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001556"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156952+0000","last_change":"2026-02-23T06:21:17.142582+0000","last_active":"2026-02-23T06:21:23.156952+0000","last_peered":"2026-02-23T06:21:23.156952+0000","last_clean":"2026-02-23T06:21:23.156952+0000","last_became_active":"2026-02-23T06:21:17.142416+0000","last_became_peered":"2026-02-23T06:21:17.142416+0000","last_unstale":"2026-02-23T06:21:23.156952+0000","last_undegraded":"2026-02-23T06:21:23.156952+0000","last_fullsized":"2026-02-23T06:21:23.156952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:13:12.649937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157112+0000","last_change":"2026-02-23T06:21:18.148362+0000","last_active":"2026-02-23T06:21:23.157112+0000","last_peered":"2026-02-23T06:21:23.157112+0000","last_clean":"2026-02-23T06:21:23.157112+0000","last_became_active":"2026-02-23T06:21:18.148276+0000","last_became_peered":"2026-02-23T06:21:18.148276+0000","last_unstale":"2026-02-23T06:21:23.157112+0000","last_undegraded":"2026-02-23T06:21:23.157112+0000","last_fullsized":"2026-02-23T06:21:23.157112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:47.221741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156473+0000","last_change":"2026-02-23T06:21:22.169541+0000","last_active":"2026-02-23T06:21:23.156473+0000","last_peered":"2026-02-23T06:21:23.156473+0000","last_clean":"2026-02-23T06:21:23.156473+0000","last_became_active":"2026-02-23T06:21:22.169307+0000","last_became_peered":"2026-02-23T06:21:22.169307+0000","last_unstale":"2026-02-23T06:21:23.156473+0000","last_undegraded":"2026-02-23T06:21:23.156473+0000","last_fullsized":"2026-02-23T06:21:23.156473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:40:10.952374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157171+0000","last_change":"2026-02-23T06:21:17.138864+0000","last_active":"2026-02-23T06:21:23.157171+0000","last_peered":"2026-02-23T06:21:23.157171+0000","last_clean":"2026-02-23T06:21:23.157171+0000","last_became_active":"2026-02-23T06:21:17.138651+0000","last_became_peered":"2026-02-23T06:21:17.138651+0000","last_unstale":"2026-02-23T06:21:23.157171+0000","last_undegraded":"2026-02-23T06:21:23.157171+0000","last_fullsized":"2026-02-23T06:21:23.157171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:24.172617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157312+0000","last_change":"2026-02-23T06:21:18.145040+0000","last_active":"2026-02-23T06:21:23.157312+0000","last_peered":"2026-02-23T06:21:23.157312+0000","last_clean":"2026-02-23T06:21:23.157312+0000","last_became_active":"2026-02-23T06:21:18.144915+0000","last_became_peered":"2026-02-23T06:21:18.144915+0000","last_unstale":"2026-02-23T06:21:23.157312+0000","last_undegraded":"2026-02-23T06:21:23.157312+0000","last_fullsized":"2026-02-23T06:21:23.157312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:17:30.105623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158170+0000","last_change":"2026-02-23T06:21:22.172729+0000","last_active":"2026-02-23T06:21:23.158170+0000","last_peered":"2026-02-23T06:21:23.158170+0000","last_clean":"2026-02-23T06:21:23.158170+0000","last_became_active":"2026-02-23T06:21:22.172510+0000","last_became_peered":"2026-02-23T06:21:22.172510+0000","last_unstale":"2026-02-23T06:21:23.158170+0000","last_undegraded":"2026-02-23T06:21:23.158170+0000","last_fullsized":"2026-02-23T06:21:23.158170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:53:55.801734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158943+0000","last_change":"2026-02-23T06:21:17.150375+0000","last_active":"2026-02-23T06:21:23.158943+0000","last_peered":"2026-02-23T06:21:23.158943+0000","last_clean":"2026-02-23T06:21:23.158943+0000","last_became_active":"2026-02-23T06:21:17.150244+0000","last_became_peered":"2026-02-23T06:21:17.150244+0000","last_unstale":"2026-02-23T06:21:23.158943+0000","last_undegraded":"2026-02-23T06:21:23.158943+0000","last_fullsized":"2026-02-23T06:21:23.158943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:06:21.465108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157674+0000","last_change":"2026-02-23T06:21:18.150247+0000","last_active":"2026-02-23T06:21:23.157674+0000","last_peered":"2026-02-23T06:21:23.157674+0000","last_clean":"2026-02-23T06:21:23.157674+0000","last_became_active":"2026-02-23T06:21:18.149827+0000","last_became_peered":"2026-02-23T06:21:18.149827+0000","last_unstale":"2026-02-23T06:21:23.157674+0000","last_undegraded":"2026-02-23T06:21:23.157674+0000","last_fullsized":"2026-02-23T06:21:23.157674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:37:58.944726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158517+0000","last_change":"2026-02-23T06:21:22.174417+0000","last_active":"2026-02-23T06:21:23.158517+0000","last_peered":"2026-02-23T06:21:23.158517+0000","last_clean":"2026-02-23T06:21:23.158517+0000","last_became_active":"2026-02-23T06:21:22.173939+0000","last_became_peered":"2026-02-23T06:21:22.173939+0000","last_unstale":"2026-02-23T06:21:23.158517+0000","last_undegraded":"2026-02-23T06:21:23.158517+0000","last_fullsized":"2026-02-23T06:21:23.158517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:41:53.008301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158816+0000","last_change":"2026-02-23T06:21:17.145244+0000","last_active":"2026-02-23T06:21:23.158816+0000","last_peered":"2026-02-23T06:21:23.158816+0000","last_clean":"2026-02-23T06:21:23.158816+0000","last_became_active":"2026-02-23T06:21:17.144122+0000","last_became_peered":"2026-02-23T06:21:17.144122+0000","last_unstale":"2026-02-23T06:21:23.158816+0000","last_undegraded":"2026-02-23T06:21:23.158816+0000","last_fullsized":"2026-02-23T06:21:23.158816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:42:56.020005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159068+0000","last_change":"2026-02-23T06:21:18.155799+0000","last_active":"2026-02-23T06:21:23.159068+0000","last_peered":"2026-02-23T06:21:23.159068+0000","last_clean":"2026-02-23T06:21:23.159068+0000","last_became_active":"2026-02-23T06:21:18.154985+0000","last_became_peered":"2026-02-23T06:21:18.154985+0000","last_unstale":"2026-02-23T06:21:23.159068+0000","last_undegraded":"2026-02-23T06:21:23.159068+0000","last_fullsized":"2026-02-23T06:21:23.159068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:11:13.595733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158472+0000","last_change":"2026-02-23T06:21:22.168755+0000","last_active":"2026-02-23T06:21:23.158472+0000","last_peered":"2026-02-23T06:21:23.158472+0000","last_clean":"2026-02-23T06:21:23.158472+0000","last_became_active":"2026-02-23T06:21:22.165671+0000","last_became_peered":"2026-02-23T06:21:22.165671+0000","last_unstale":"2026-02-23T06:21:23.158472+0000","last_undegraded":"2026-02-23T06:21:23.158472+0000","last_fullsized":"2026-02-23T06:21:23.158472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:04:32.848929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157587+0000","last_change":"2026-02-23T06:21:18.150907+0000","last_active":"2026-02-23T06:21:23.157587+0000","last_peered":"2026-02-23T06:21:23.157587+0000","last_clean":"2026-02-23T06:21:23.157587+0000","last_became_active":"2026-02-23T06:21:18.150604+0000","last_became_peered":"2026-02-23T06:21:18.150604+0000","last_unstale":"2026-02-23T06:21:23.157587+0000","last_undegraded":"2026-02-23T06:21:23.157587+0000","last_fullsized":"2026-02-23T06:21:23.157587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:15:21.672153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157971+0000","last_change":"2026-02-23T06:21:17.147523+0000","last_active":"2026-02-23T06:21:23.157971+0000","last_peered":"2026-02-23T06:21:23.157971+0000","last_clean":"2026-02-23T06:21:23.157971+0000","last_became_active":"2026-02-23T06:21:17.147351+0000","last_became_peered":"2026-02-23T06:21:17.147351+0000","last_unstale":"2026-02-23T06:21:23.157971+0000","last_undegraded":"2026-02-23T06:21:23.157971+0000","last_fullsized":"2026-02-23T06:21:23.157971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:36:34.550499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158924+0000","last_change":"2026-02-23T06:21:22.169413+0000","last_active":"2026-02-23T06:21:23.158924+0000","last_peered":"2026-02-23T06:21:23.158924+0000","last_clean":"2026-02-23T06:21:23.158924+0000","last_became_active":"2026-02-23T06:21:22.169259+0000","last_became_peered":"2026-02-23T06:21:22.169259+0000","last_unstale":"2026-02-23T06:21:23.158924+0000","last_undegraded":"2026-02-23T06:21:23.158924+0000","last_fullsized":"2026-02-23T06:21:23.158924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:14:12.944321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156495+0000","last_change":"2026-02-23T06:21:18.142316+0000","last_active":"2026-02-23T06:21:23.156495+0000","last_peered":"2026-02-23T06:21:23.156495+0000","last_clean":"2026-02-23T06:21:23.156495+0000","last_became_active":"2026-02-23T06:21:18.142144+0000","last_became_peered":"2026-02-23T06:21:18.142144+0000","last_unstale":"2026-02-23T06:21:23.156495+0000","last_undegraded":"2026-02-23T06:21:23.156495+0000","last_fullsized":"2026-02-23T06:21:23.156495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:53:33.429271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157370+0000","last_change":"2026-02-23T06:21:17.137576+0000","last_active":"2026-02-23T06:21:23.157370+0000","last_peered":"2026-02-23T06:21:23.157370+0000","last_clean":"2026-02-23T06:21:23.157370+0000","last_became_active":"2026-02-23T06:21:17.137371+0000","last_became_peered":"2026-02-23T06:21:17.137371+0000","last_unstale":"2026-02-23T06:21:23.157370+0000","last_undegraded":"2026-02-23T06:21:23.157370+0000","last_fullsized":"2026-02-23T06:21:23.157370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:27.159743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158222+0000","last_change":"2026-02-23T06:21:22.163003+0000","last_active":"2026-02-23T06:21:23.158222+0000","last_peered":"2026-02-23T06:21:23.158222+0000","last_clean":"2026-02-23T06:21:23.158222+0000","last_became_active":"2026-02-23T06:21:22.162898+0000","last_became_peered":"2026-02-23T06:21:22.162898+0000","last_unstale":"2026-02-23T06:21:23.158222+0000","last_undegraded":"2026-02-23T06:21:23.158222+0000","last_fullsized":"2026-02-23T06:21:23.158222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:29:18.161667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156351+0000","last_change":"2026-02-23T06:21:18.141281+0000","last_active":"2026-02-23T06:21:23.156351+0000","last_peered":"2026-02-23T06:21:23.156351+0000","last_clean":"2026-02-23T06:21:23.156351+0000","last_became_active":"2026-02-23T06:21:18.141090+0000","last_became_peered":"2026-02-23T06:21:18.141090+0000","last_unstale":"2026-02-23T06:21:23.156351+0000","last_undegraded":"2026-02-23T06:21:23.156351+0000","last_fullsized":"2026-02-23T06:21:23.156351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:12:21.750595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156633+0000","last_change":"2026-02-23T06:21:17.144179+0000","last_active":"2026-02-23T06:21:23.156633+0000","last_peered":"2026-02-23T06:21:23.156633+0000","last_clean":"2026-02-23T06:21:23.156633+0000","last_became_active":"2026-02-23T06:21:17.144017+0000","last_became_peered":"2026-02-23T06:21:17.144017+0000","last_unstale":"2026-02-23T06:21:23.156633+0000","last_undegraded":"2026-02-23T06:21:23.156633+0000","last_fullsized":"2026-02-23T06:21:23.156633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:25:41.992201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156888+0000","last_change":"2026-02-23T06:21:22.174826+0000","last_active":"2026-02-23T06:21:23.156888+0000","last_peered":"2026-02-23T06:21:23.156888+0000","last_clean":"2026-02-23T06:21:23.156888+0000","last_became_active":"2026-02-23T06:21:22.174683+0000","last_became_peered":"2026-02-23T06:21:22.174683+0000","last_unstale":"2026-02-23T06:21:23.156888+0000","last_undegraded":"2026-02-23T06:21:23.156888+0000","last_fullsized":"2026-02-23T06:21:23.156888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:04:49.277580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157342+0000","last_change":"2026-02-23T06:21:18.145331+0000","last_active":"2026-02-23T06:21:23.157342+0000","last_peered":"2026-02-23T06:21:23.157342+0000","last_clean":"2026-02-23T06:21:23.157342+0000","last_became_active":"2026-02-23T06:21:18.145231+0000","last_became_peered":"2026-02-23T06:21:18.145231+0000","last_unstale":"2026-02-23T06:21:23.157342+0000","last_undegraded":"2026-02-23T06:21:23.157342+0000","last_fullsized":"2026-02-23T06:21:23.157342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:32:44.487867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157126+0000","last_change":"2026-02-23T06:21:17.147584+0000","last_active":"2026-02-23T06:21:23.157126+0000","last_peered":"2026-02-23T06:21:23.157126+0000","last_clean":"2026-02-23T06:21:23.157126+0000","last_became_active":"2026-02-23T06:21:17.147431+0000","last_became_peered":"2026-02-23T06:21:17.147431+0000","last_unstale":"2026-02-23T06:21:23.157126+0000","last_undegraded":"2026-02-23T06:21:23.157126+0000","last_fullsized":"2026-02-23T06:21:23.157126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:10:39.127457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159080+0000","last_change":"2026-02-23T06:21:22.175656+0000","last_active":"2026-02-23T06:21:23.159080+0000","last_peered":"2026-02-23T06:21:23.159080+0000","last_clean":"2026-02-23T06:21:23.159080+0000","last_became_active":"2026-02-23T06:21:22.175493+0000","last_became_peered":"2026-02-23T06:21:22.175493+0000","last_unstale":"2026-02-23T06:21:23.159080+0000","last_undegraded":"2026-02-23T06:21:23.159080+0000","last_fullsized":"2026-02-23T06:21:23.159080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:10:41.366772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156769+0000","last_change":"2026-02-23T06:21:18.141486+0000","last_active":"2026-02-23T06:21:23.156769+0000","last_peered":"2026-02-23T06:21:23.156769+0000","last_clean":"2026-02-23T06:21:23.156769+0000","last_became_active":"2026-02-23T06:21:18.141277+0000","last_became_peered":"2026-02-23T06:21:18.141277+0000","last_unstale":"2026-02-23T06:21:23.156769+0000","last_undegraded":"2026-02-23T06:21:23.156769+0000","last_fullsized":"2026-02-23T06:21:23.156769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:21:15.738187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158970+0000","last_change":"2026-02-23T06:21:17.148536+0000","last_active":"2026-02-23T06:21:23.158970+0000","last_peered":"2026-02-23T06:21:23.158970+0000","last_clean":"2026-02-23T06:21:23.158970+0000","last_became_active":"2026-02-23T06:21:17.148424+0000","last_became_peered":"2026-02-23T06:21:17.148424+0000","last_unstale":"2026-02-23T06:21:23.158970+0000","last_undegraded":"2026-02-23T06:21:23.158970+0000","last_fullsized":"2026-02-23T06:21:23.158970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:02:54.995144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158363+0000","last_change":"2026-02-23T06:21:22.171333+0000","last_active":"2026-02-23T06:21:23.158363+0000","last_peered":"2026-02-23T06:21:23.158363+0000","last_clean":"2026-02-23T06:21:23.158363+0000","last_became_active":"2026-02-23T06:21:22.170496+0000","last_became_peered":"2026-02-23T06:21:22.170496+0000","last_unstale":"2026-02-23T06:21:23.158363+0000","last_undegraded":"2026-02-23T06:21:23.158363+0000","last_fullsized":"2026-02-23T06:21:23.158363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:40:07.996281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156943+0000","last_change":"2026-02-23T06:21:18.142135+0000","last_active":"2026-02-23T06:21:23.156943+0000","last_peered":"2026-02-23T06:21:23.156943+0000","last_clean":"2026-02-23T06:21:23.156943+0000","last_became_active":"2026-02-23T06:21:18.141771+0000","last_became_peered":"2026-02-23T06:21:18.141771+0000","last_unstale":"2026-02-23T06:21:23.156943+0000","last_undegraded":"2026-02-23T06:21:23.156943+0000","last_fullsized":"2026-02-23T06:21:23.156943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:10:18.195986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156859+0000","last_change":"2026-02-23T06:21:17.142326+0000","last_active":"2026-02-23T06:21:23.156859+0000","last_peered":"2026-02-23T06:21:23.156859+0000","last_clean":"2026-02-23T06:21:23.156859+0000","last_became_active":"2026-02-23T06:21:17.142203+0000","last_became_peered":"2026-02-23T06:21:17.142203+0000","last_unstale":"2026-02-23T06:21:23.156859+0000","last_undegraded":"2026-02-23T06:21:23.156859+0000","last_fullsized":"2026-02-23T06:21:23.156859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:49:44.262210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156453+0000","last_change":"2026-02-23T06:21:22.168717+0000","last_active":"2026-02-23T06:21:23.156453+0000","last_peered":"2026-02-23T06:21:23.156453+0000","last_clean":"2026-02-23T06:21:23.156453+0000","last_became_active":"2026-02-23T06:21:22.168375+0000","last_became_peered":"2026-02-23T06:21:22.168375+0000","last_unstale":"2026-02-23T06:21:23.156453+0000","last_undegraded":"2026-02-23T06:21:23.156453+0000","last_fullsized":"2026-02-23T06:21:23.156453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:03:53.993581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157404+0000","last_change":"2026-02-23T06:21:18.141908+0000","last_active":"2026-02-23T06:21:23.157404+0000","last_peered":"2026-02-23T06:21:23.157404+0000","last_clean":"2026-02-23T06:21:23.157404+0000","last_became_active":"2026-02-23T06:21:18.141363+0000","last_became_peered":"2026-02-23T06:21:18.141363+0000","last_unstale":"2026-02-23T06:21:23.157404+0000","last_undegraded":"2026-02-23T06:21:23.157404+0000","last_fullsized":"2026-02-23T06:21:23.157404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:06:26.731868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159168+0000","last_change":"2026-02-23T06:21:17.144716+0000","last_active":"2026-02-23T06:21:23.159168+0000","last_peered":"2026-02-23T06:21:23.159168+0000","last_clean":"2026-02-23T06:21:23.159168+0000","last_became_active":"2026-02-23T06:21:17.144515+0000","last_became_peered":"2026-02-23T06:21:17.144515+0000","last_unstale":"2026-02-23T06:21:23.159168+0000","last_undegraded":"2026-02-23T06:21:23.159168+0000","last_fullsized":"2026-02-23T06:21:23.159168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:38:35.014170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157139+0000","last_change":"2026-02-23T06:21:22.171364+0000","last_active":"2026-02-23T06:21:23.157139+0000","last_peered":"2026-02-23T06:21:23.157139+0000","last_clean":"2026-02-23T06:21:23.157139+0000","last_became_active":"2026-02-23T06:21:22.171165+0000","last_became_peered":"2026-02-23T06:21:22.171165+0000","last_unstale":"2026-02-23T06:21:23.157139+0000","last_undegraded":"2026-02-23T06:21:23.157139+0000","last_fullsized":"2026-02-23T06:21:23.157139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:00:42.055334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158796+0000","last_change":"2026-02-23T06:21:18.144182+0000","last_active":"2026-02-23T06:21:23.158796+0000","last_peered":"2026-02-23T06:21:23.158796+0000","last_clean":"2026-02-23T06:21:23.158796+0000","last_became_active":"2026-02-23T06:21:18.143585+0000","last_became_peered":"2026-02-23T06:21:18.143585+0000","last_unstale":"2026-02-23T06:21:23.158796+0000","last_undegraded":"2026-02-23T06:21:23.158796+0000","last_fullsized":"2026-02-23T06:21:23.158796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:07:05.513990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156754+0000","last_change":"2026-02-23T06:21:17.137935+0000","last_active":"2026-02-23T06:21:23.156754+0000","last_peered":"2026-02-23T06:21:23.156754+0000","last_clean":"2026-02-23T06:21:23.156754+0000","last_became_active":"2026-02-23T06:21:17.137386+0000","last_became_peered":"2026-02-23T06:21:17.137386+0000","last_unstale":"2026-02-23T06:21:23.156754+0000","last_undegraded":"2026-02-23T06:21:23.156754+0000","last_fullsized":"2026-02-23T06:21:23.156754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:51:24.646436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157353+0000","last_change":"2026-02-23T06:21:22.163110+0000","last_active":"2026-02-23T06:21:23.157353+0000","last_peered":"2026-02-23T06:21:23.157353+0000","last_clean":"2026-02-23T06:21:23.157353+0000","last_became_active":"2026-02-23T06:21:22.162891+0000","last_became_peered":"2026-02-23T06:21:22.162891+0000","last_unstale":"2026-02-23T06:21:23.157353+0000","last_undegraded":"2026-02-23T06:21:23.157353+0000","last_fullsized":"2026-02-23T06:21:23.157353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:06:23.664613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157998+0000","last_change":"2026-02-23T06:21:18.152606+0000","last_active":"2026-02-23T06:21:23.157998+0000","last_peered":"2026-02-23T06:21:23.157998+0000","last_clean":"2026-02-23T06:21:23.157998+0000","last_became_active":"2026-02-23T06:21:18.152102+0000","last_became_peered":"2026-02-23T06:21:18.152102+0000","last_unstale":"2026-02-23T06:21:23.157998+0000","last_undegraded":"2026-02-23T06:21:23.157998+0000","last_fullsized":"2026-02-23T06:21:23.157998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:59:30.188417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157850+0000","last_change":"2026-02-23T06:21:17.143289+0000","last_active":"2026-02-23T06:21:23.157850+0000","last_peered":"2026-02-23T06:21:23.157850+0000","last_clean":"2026-02-23T06:21:23.157850+0000","last_became_active":"2026-02-23T06:21:17.143201+0000","last_became_peered":"2026-02-23T06:21:17.143201+0000","last_unstale":"2026-02-23T06:21:23.157850+0000","last_undegraded":"2026-02-23T06:21:23.157850+0000","last_fullsized":"2026-02-23T06:21:23.157850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:33:06.892035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157325+0000","last_change":"2026-02-23T06:21:22.163932+0000","last_active":"2026-02-23T06:21:23.157325+0000","last_peered":"2026-02-23T06:21:23.157325+0000","last_clean":"2026-02-23T06:21:23.157325+0000","last_became_active":"2026-02-23T06:21:22.163734+0000","last_became_peered":"2026-02-23T06:21:22.163734+0000","last_unstale":"2026-02-23T06:21:23.157325+0000","last_undegraded":"2026-02-23T06:21:23.157325+0000","last_fullsized":"2026-02-23T06:21:23.157325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:44:47.208608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156436+0000","last_change":"2026-02-23T06:21:18.141664+0000","last_active":"2026-02-23T06:21:23.156436+0000","last_peered":"2026-02-23T06:21:23.156436+0000","last_clean":"2026-02-23T06:21:23.156436+0000","last_became_active":"2026-02-23T06:21:18.141350+0000","last_became_peered":"2026-02-23T06:21:18.141350+0000","last_unstale":"2026-02-23T06:21:23.156436+0000","last_undegraded":"2026-02-23T06:21:23.156436+0000","last_fullsized":"2026-02-23T06:21:23.156436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:01:50.434732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156433+0000","last_change":"2026-02-23T06:21:17.139311+0000","last_active":"2026-02-23T06:21:23.156433+0000","last_peered":"2026-02-23T06:21:23.156433+0000","last_clean":"2026-02-23T06:21:23.156433+0000","last_became_active":"2026-02-23T06:21:17.139200+0000","last_became_peered":"2026-02-23T06:21:17.139200+0000","last_unstale":"2026-02-23T06:21:23.156433+0000","last_undegraded":"2026-02-23T06:21:23.156433+0000","last_fullsized":"2026-02-23T06:21:23.156433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:52:23.863807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157449+0000","last_change":"2026-02-23T06:21:22.164793+0000","last_active":"2026-02-23T06:21:23.157449+0000","last_peered":"2026-02-23T06:21:23.157449+0000","last_clean":"2026-02-23T06:21:23.157449+0000","last_became_active":"2026-02-23T06:21:22.164667+0000","last_became_peered":"2026-02-23T06:21:22.164667+0000","last_unstale":"2026-02-23T06:21:23.157449+0000","last_undegraded":"2026-02-23T06:21:23.157449+0000","last_fullsized":"2026-02-23T06:21:23.157449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:36:39.520044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156948+0000","last_change":"2026-02-23T06:21:18.146624+0000","last_active":"2026-02-23T06:21:23.156948+0000","last_peered":"2026-02-23T06:21:23.156948+0000","last_clean":"2026-02-23T06:21:23.156948+0000","last_became_active":"2026-02-23T06:21:18.146491+0000","last_became_peered":"2026-02-23T06:21:18.146491+0000","last_unstale":"2026-02-23T06:21:23.156948+0000","last_undegraded":"2026-02-23T06:21:23.156948+0000","last_fullsized":"2026-02-23T06:21:23.156948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:11:23.574241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157493+0000","last_change":"2026-02-23T06:21:17.143128+0000","last_active":"2026-02-23T06:21:23.157493+0000","last_peered":"2026-02-23T06:21:23.157493+0000","last_clean":"2026-02-23T06:21:23.157493+0000","last_became_active":"2026-02-23T06:21:17.143050+0000","last_became_peered":"2026-02-23T06:21:17.143050+0000","last_unstale":"2026-02-23T06:21:23.157493+0000","last_undegraded":"2026-02-23T06:21:23.157493+0000","last_fullsized":"2026-02-23T06:21:23.157493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:15.628487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156942+0000","last_change":"2026-02-23T06:21:22.168755+0000","last_active":"2026-02-23T06:21:23.156942+0000","last_peered":"2026-02-23T06:21:23.156942+0000","last_clean":"2026-02-23T06:21:23.156942+0000","last_became_active":"2026-02-23T06:21:22.168510+0000","last_became_peered":"2026-02-23T06:21:22.168510+0000","last_unstale":"2026-02-23T06:21:23.156942+0000","last_undegraded":"2026-02-23T06:21:23.156942+0000","last_fullsized":"2026-02-23T06:21:23.156942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:19:06.716318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156576+0000","last_change":"2026-02-23T06:21:18.145397+0000","last_active":"2026-02-23T06:21:23.156576+0000","last_peered":"2026-02-23T06:21:23.156576+0000","last_clean":"2026-02-23T06:21:23.156576+0000","last_became_active":"2026-02-23T06:21:18.145214+0000","last_became_peered":"2026-02-23T06:21:18.145214+0000","last_unstale":"2026-02-23T06:21:23.156576+0000","last_undegraded":"2026-02-23T06:21:23.156576+0000","last_fullsized":"2026-02-23T06:21:23.156576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:33:41.870582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158977+0000","last_change":"2026-02-23T06:21:17.147696+0000","last_active":"2026-02-23T06:21:23.158977+0000","last_peered":"2026-02-23T06:21:23.158977+0000","last_clean":"2026-02-23T06:21:23.158977+0000","last_became_active":"2026-02-23T06:21:17.147619+0000","last_became_peered":"2026-02-23T06:21:17.147619+0000","last_unstale":"2026-02-23T06:21:23.158977+0000","last_undegraded":"2026-02-23T06:21:23.158977+0000","last_fullsized":"2026-02-23T06:21:23.158977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:49:09.070245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'112","reported_seq":164,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157640+0000","last_change":"2026-02-23T06:21:11.397748+0000","last_active":"2026-02-23T06:21:23.157640+0000","last_peered":"2026-02-23T06:21:23.157640+0000","last_clean":"2026-02-23T06:21:23.157640+0000","last_became_active":"2026-02-23T06:21:11.397664+0000","last_became_peered":"2026-02-23T06:21:11.397664+0000","last_unstale":"2026-02-23T06:21:23.157640+0000","last_undegraded":"2026-02-23T06:21:23.157640+0000","last_fullsized":"2026-02-23T06:21:23.157640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:10.392316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:10.392316+0000","last_clean_scrub_stamp":"2026-02-23T06:21:10.392316+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:43.157572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159148+0000","last_change":"2026-02-23T06:21:22.174696+0000","last_active":"2026-02-23T06:21:23.159148+0000","last_peered":"2026-02-23T06:21:23.159148+0000","last_clean":"2026-02-23T06:21:23.159148+0000","last_became_active":"2026-02-23T06:21:22.174253+0000","last_became_peered":"2026-02-23T06:21:22.174253+0000","last_unstale":"2026-02-23T06:21:23.159148+0000","last_undegraded":"2026-02-23T06:21:23.159148+0000","last_fullsized":"2026-02-23T06:21:23.159148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:28.487343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159093+0000","last_change":"2026-02-23T06:21:18.150652+0000","last_active":"2026-02-23T06:21:23.159093+0000","last_peered":"2026-02-23T06:21:23.159093+0000","last_clean":"2026-02-23T06:21:23.159093+0000","last_became_active":"2026-02-23T06:21:18.150501+0000","last_became_peered":"2026-02-23T06:21:18.150501+0000","last_unstale":"2026-02-23T06:21:23.159093+0000","last_undegraded":"2026-02-23T06:21:23.159093+0000","last_fullsized":"2026-02-23T06:21:23.159093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:34:20.113034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157473+0000","last_change":"2026-02-23T06:21:17.146074+0000","last_active":"2026-02-23T06:21:23.157473+0000","last_peered":"2026-02-23T06:21:23.157473+0000","last_clean":"2026-02-23T06:21:23.157473+0000","last_became_active":"2026-02-23T06:21:17.145938+0000","last_became_peered":"2026-02-23T06:21:17.145938+0000","last_unstale":"2026-02-23T06:21:23.157473+0000","last_undegraded":"2026-02-23T06:21:23.157473+0000","last_fullsized":"2026-02-23T06:21:23.157473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:41:42.571718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158551+0000","last_change":"2026-02-23T06:21:22.172266+0000","last_active":"2026-02-23T06:21:23.158551+0000","last_peered":"2026-02-23T06:21:23.158551+0000","last_clean":"2026-02-23T06:21:23.158551+0000","last_became_active":"2026-02-23T06:21:22.171828+0000","last_became_peered":"2026-02-23T06:21:22.171828+0000","last_unstale":"2026-02-23T06:21:23.158551+0000","last_undegraded":"2026-02-23T06:21:23.158551+0000","last_fullsized":"2026-02-23T06:21:23.158551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:34:06.583640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158339+0000","last_change":"2026-02-23T06:21:18.147056+0000","last_active":"2026-02-23T06:21:23.158339+0000","last_peered":"2026-02-23T06:21:23.158339+0000","last_clean":"2026-02-23T06:21:23.158339+0000","last_became_active":"2026-02-23T06:21:18.146977+0000","last_became_peered":"2026-02-23T06:21:18.146977+0000","last_unstale":"2026-02-23T06:21:23.158339+0000","last_undegraded":"2026-02-23T06:21:23.158339+0000","last_fullsized":"2026-02-23T06:21:23.158339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:02:14.013207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156871+0000","last_change":"2026-02-23T06:21:17.139417+0000","last_active":"2026-02-23T06:21:23.156871+0000","last_peered":"2026-02-23T06:21:23.156871+0000","last_clean":"2026-02-23T06:21:23.156871+0000","last_became_active":"2026-02-23T06:21:17.139209+0000","last_became_peered":"2026-02-23T06:21:17.139209+0000","last_unstale":"2026-02-23T06:21:23.156871+0000","last_undegraded":"2026-02-23T06:21:23.156871+0000","last_fullsized":"2026-02-23T06:21:23.156871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:02:19.925669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156792+0000","last_change":"2026-02-23T06:21:22.162912+0000","last_active":"2026-02-23T06:21:23.156792+0000","last_peered":"2026-02-23T06:21:23.156792+0000","last_clean":"2026-02-23T06:21:23.156792+0000","last_became_active":"2026-02-23T06:21:22.162777+0000","last_became_peered":"2026-02-23T06:21:22.162777+0000","last_unstale":"2026-02-23T06:21:23.156792+0000","last_undegraded":"2026-02-23T06:21:23.156792+0000","last_fullsized":"2026-02-23T06:21:23.156792+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:40:10.012263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158597+0000","last_change":"2026-02-23T06:21:18.149281+0000","last_active":"2026-02-23T06:21:23.158597+0000","last_peered":"2026-02-23T06:21:23.158597+0000","last_clean":"2026-02-23T06:21:23.158597+0000","last_became_active":"2026-02-23T06:21:18.149038+0000","last_became_peered":"2026-02-23T06:21:18.149038+0000","last_unstale":"2026-02-23T06:21:23.158597+0000","last_undegraded":"2026-02-23T06:21:23.158597+0000","last_fullsized":"2026-02-23T06:21:23.158597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:57:13.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156819+0000","last_change":"2026-02-23T06:21:17.137649+0000","last_active":"2026-02-23T06:21:23.156819+0000","last_peered":"2026-02-23T06:21:23.156819+0000","last_clean":"2026-02-23T06:21:23.156819+0000","last_became_active":"2026-02-23T06:21:17.137476+0000","last_became_peered":"2026-02-23T06:21:17.137476+0000","last_unstale":"2026-02-23T06:21:23.156819+0000","last_undegraded":"2026-02-23T06:21:23.156819+0000","last_fullsized":"2026-02-23T06:21:23.156819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:47:43.648999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157315+0000","last_change":"2026-02-23T06:21:22.174081+0000","last_active":"2026-02-23T06:21:23.157315+0000","last_peered":"2026-02-23T06:21:23.157315+0000","last_clean":"2026-02-23T06:21:23.157315+0000","last_became_active":"2026-02-23T06:21:22.173501+0000","last_became_peered":"2026-02-23T06:21:22.173501+0000","last_unstale":"2026-02-23T06:21:23.157315+0000","last_undegraded":"2026-02-23T06:21:23.157315+0000","last_fullsized":"2026-02-23T06:21:23.157315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:29:42.370894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159159+0000","last_change":"2026-02-23T06:21:18.155183+0000","last_active":"2026-02-23T06:21:23.159159+0000","last_peered":"2026-02-23T06:21:23.159159+0000","last_clean":"2026-02-23T06:21:23.159159+0000","last_became_active":"2026-02-23T06:21:18.154271+0000","last_became_peered":"2026-02-23T06:21:18.154271+0000","last_unstale":"2026-02-23T06:21:23.159159+0000","last_undegraded":"2026-02-23T06:21:23.159159+0000","last_fullsized":"2026-02-23T06:21:23.159159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:34:53.495073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158641+0000","last_change":"2026-02-23T06:21:17.144988+0000","last_active":"2026-02-23T06:21:23.158641+0000","last_peered":"2026-02-23T06:21:23.158641+0000","last_clean":"2026-02-23T06:21:23.158641+0000","last_became_active":"2026-02-23T06:21:17.144914+0000","last_became_peered":"2026-02-23T06:21:17.144914+0000","last_unstale":"2026-02-23T06:21:23.158641+0000","last_undegraded":"2026-02-23T06:21:23.158641+0000","last_fullsized":"2026-02-23T06:21:23.158641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:20:30.802189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157321+0000","last_change":"2026-02-23T06:21:22.169035+0000","last_active":"2026-02-23T06:21:23.157321+0000","last_peered":"2026-02-23T06:21:23.157321+0000","last_clean":"2026-02-23T06:21:23.157321+0000","last_became_active":"2026-02-23T06:21:22.168516+0000","last_became_peered":"2026-02-23T06:21:22.168516+0000","last_unstale":"2026-02-23T06:21:23.157321+0000","last_undegraded":"2026-02-23T06:21:23.157321+0000","last_fullsized":"2026-02-23T06:21:23.157321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:53:53.761208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157305+0000","last_change":"2026-02-23T06:21:18.152543+0000","last_active":"2026-02-23T06:21:23.157305+0000","last_peered":"2026-02-23T06:21:23.157305+0000","last_clean":"2026-02-23T06:21:23.157305+0000","last_became_active":"2026-02-23T06:21:18.152381+0000","last_became_peered":"2026-02-23T06:21:18.152381+0000","last_unstale":"2026-02-23T06:21:23.157305+0000","last_undegraded":"2026-02-23T06:21:23.157305+0000","last_fullsized":"2026-02-23T06:21:23.157305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:20:11.159653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156443+0000","last_change":"2026-02-23T06:21:17.137277+0000","last_active":"2026-02-23T06:21:23.156443+0000","last_peered":"2026-02-23T06:21:23.156443+0000","last_clean":"2026-02-23T06:21:23.156443+0000","last_became_active":"2026-02-23T06:21:17.137101+0000","last_became_peered":"2026-02-23T06:21:17.137101+0000","last_unstale":"2026-02-23T06:21:23.156443+0000","last_undegraded":"2026-02-23T06:21:23.156443+0000","last_fullsized":"2026-02-23T06:21:23.156443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:26:19.732037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157108+0000","last_change":"2026-02-23T06:21:22.168965+0000","last_active":"2026-02-23T06:21:23.157108+0000","last_peered":"2026-02-23T06:21:23.157108+0000","last_clean":"2026-02-23T06:21:23.157108+0000","last_became_active":"2026-02-23T06:21:22.168603+0000","last_became_peered":"2026-02-23T06:21:22.168603+0000","last_unstale":"2026-02-23T06:21:23.157108+0000","last_undegraded":"2026-02-23T06:21:23.157108+0000","last_fullsized":"2026-02-23T06:21:23.157108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:15:47.100236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157608+0000","last_change":"2026-02-23T06:21:18.143842+0000","last_active":"2026-02-23T06:21:23.157608+0000","last_peered":"2026-02-23T06:21:23.157608+0000","last_clean":"2026-02-23T06:21:23.157608+0000","last_became_active":"2026-02-23T06:21:18.143002+0000","last_became_peered":"2026-02-23T06:21:18.143002+0000","last_unstale":"2026-02-23T06:21:23.157608+0000","last_undegraded":"2026-02-23T06:21:23.157608+0000","last_fullsized":"2026-02-23T06:21:23.157608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:04:36.461970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157835+0000","last_change":"2026-02-23T06:21:17.143842+0000","last_active":"2026-02-23T06:21:23.157835+0000","last_peered":"2026-02-23T06:21:23.157835+0000","last_clean":"2026-02-23T06:21:23.157835+0000","last_became_active":"2026-02-23T06:21:17.143700+0000","last_became_peered":"2026-02-23T06:21:17.143700+0000","last_unstale":"2026-02-23T06:21:23.157835+0000","last_undegraded":"2026-02-23T06:21:23.157835+0000","last_fullsized":"2026-02-23T06:21:23.157835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:14:07.166043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157290+0000","last_change":"2026-02-23T06:21:22.168834+0000","last_active":"2026-02-23T06:21:23.157290+0000","last_peered":"2026-02-23T06:21:23.157290+0000","last_clean":"2026-02-23T06:21:23.157290+0000","last_became_active":"2026-02-23T06:21:22.168593+0000","last_became_peered":"2026-02-23T06:21:22.168593+0000","last_unstale":"2026-02-23T06:21:23.157290+0000","last_undegraded":"2026-02-23T06:21:23.157290+0000","last_fullsized":"2026-02-23T06:21:23.157290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:15:01.999978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157649+0000","last_change":"2026-02-23T06:21:18.155135+0000","last_active":"2026-02-23T06:21:23.157649+0000","last_peered":"2026-02-23T06:21:23.157649+0000","last_clean":"2026-02-23T06:21:23.157649+0000","last_became_active":"2026-02-23T06:21:18.155022+0000","last_became_peered":"2026-02-23T06:21:18.155022+0000","last_unstale":"2026-02-23T06:21:23.157649+0000","last_undegraded":"2026-02-23T06:21:23.157649+0000","last_fullsized":"2026-02-23T06:21:23.157649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:50.396096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157857+0000","last_change":"2026-02-23T06:21:17.144113+0000","last_active":"2026-02-23T06:21:23.157857+0000","last_peered":"2026-02-23T06:21:23.157857+0000","last_clean":"2026-02-23T06:21:23.157857+0000","last_became_active":"2026-02-23T06:21:17.144052+0000","last_became_peered":"2026-02-23T06:21:17.144052+0000","last_unstale":"2026-02-23T06:21:23.157857+0000","last_undegraded":"2026-02-23T06:21:23.157857+0000","last_fullsized":"2026-02-23T06:21:23.157857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:52:50.479411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157276+0000","last_change":"2026-02-23T06:21:22.163712+0000","last_active":"2026-02-23T06:21:23.157276+0000","last_peered":"2026-02-23T06:21:23.157276+0000","last_clean":"2026-02-23T06:21:23.157276+0000","last_became_active":"2026-02-23T06:21:22.163563+0000","last_became_peered":"2026-02-23T06:21:22.163563+0000","last_unstale":"2026-02-23T06:21:23.157276+0000","last_undegraded":"2026-02-23T06:21:23.157276+0000","last_fullsized":"2026-02-23T06:21:23.157276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:58:44.301443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157241+0000","last_change":"2026-02-23T06:21:18.152736+0000","last_active":"2026-02-23T06:21:23.157241+0000","last_peered":"2026-02-23T06:21:23.157241+0000","last_clean":"2026-02-23T06:21:23.157241+0000","last_became_active":"2026-02-23T06:21:18.152627+0000","last_became_peered":"2026-02-23T06:21:18.152627+0000","last_unstale":"2026-02-23T06:21:23.157241+0000","last_undegraded":"2026-02-23T06:21:23.157241+0000","last_fullsized":"2026-02-23T06:21:23.157241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:26:04.233805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156590+0000","last_change":"2026-02-23T06:21:17.144924+0000","last_active":"2026-02-23T06:21:23.156590+0000","last_peered":"2026-02-23T06:21:23.156590+0000","last_clean":"2026-02-23T06:21:23.156590+0000","last_became_active":"2026-02-23T06:21:17.144847+0000","last_became_peered":"2026-02-23T06:21:17.144847+0000","last_unstale":"2026-02-23T06:21:23.156590+0000","last_undegraded":"2026-02-23T06:21:23.156590+0000","last_fullsized":"2026-02-23T06:21:23.156590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:09:16.703922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159051+0000","last_change":"2026-02-23T06:21:22.164167+0000","last_active":"2026-02-23T06:21:23.159051+0000","last_peered":"2026-02-23T06:21:23.159051+0000","last_clean":"2026-02-23T06:21:23.159051+0000","last_became_active":"2026-02-23T06:21:22.164057+0000","last_became_peered":"2026-02-23T06:21:22.164057+0000","last_unstale":"2026-02-23T06:21:23.159051+0000","last_undegraded":"2026-02-23T06:21:23.159051+0000","last_fullsized":"2026-02-23T06:21:23.159051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:19:45.888728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158866+0000","last_change":"2026-02-23T06:21:18.148382+0000","last_active":"2026-02-23T06:21:23.158866+0000","last_peered":"2026-02-23T06:21:23.158866+0000","last_clean":"2026-02-23T06:21:23.158866+0000","last_became_active":"2026-02-23T06:21:18.147826+0000","last_became_peered":"2026-02-23T06:21:18.147826+0000","last_unstale":"2026-02-23T06:21:23.158866+0000","last_undegraded":"2026-02-23T06:21:23.158866+0000","last_fullsized":"2026-02-23T06:21:23.158866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:52:32.524186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:30.992346+0000","last_change":"2026-02-23T06:21:17.151131+0000","last_active":"2026-02-23T06:21:30.992346+0000","last_peered":"2026-02-23T06:21:30.992346+0000","last_clean":"2026-02-23T06:21:30.992346+0000","last_became_active":"2026-02-23T06:21:17.151030+0000","last_became_peered":"2026-02-23T06:21:17.151030+0000","last_unstale":"2026-02-23T06:21:30.992346+0000","last_undegraded":"2026-02-23T06:21:30.992346+0000","last_fullsized":"2026-02-23T06:21:30.992346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:19:57.049773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3927,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156776+0000","last_change":"2026-02-23T06:21:22.165171+0000","last_active":"2026-02-23T06:21:23.156776+0000","last_peered":"2026-02-23T06:21:23.156776+0000","last_clean":"2026-02-23T06:21:23.156776+0000","last_became_active":"2026-02-23T06:21:22.164972+0000","last_became_peered":"2026-02-23T06:21:22.164972+0000","last_unstale":"2026-02-23T06:21:23.156776+0000","last_undegraded":"2026-02-23T06:21:23.156776+0000","last_fullsized":"2026-02-23T06:21:23.156776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:58:26.519641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157682+0000","last_change":"2026-02-23T06:21:18.153296+0000","last_active":"2026-02-23T06:21:23.157682+0000","last_peered":"2026-02-23T06:21:23.157682+0000","last_clean":"2026-02-23T06:21:23.157682+0000","last_became_active":"2026-02-23T06:21:18.153052+0000","last_became_peered":"2026-02-23T06:21:18.153052+0000","last_unstale":"2026-02-23T06:21:23.157682+0000","last_undegraded":"2026-02-23T06:21:23.157682+0000","last_fullsized":"2026-02-23T06:21:23.157682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:38:32.662334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156686+0000","last_change":"2026-02-23T06:21:17.137568+0000","last_active":"2026-02-23T06:21:23.156686+0000","last_peered":"2026-02-23T06:21:23.156686+0000","last_clean":"2026-02-23T06:21:23.156686+0000","last_became_active":"2026-02-23T06:21:17.137479+0000","last_became_peered":"2026-02-23T06:21:17.137479+0000","last_unstale":"2026-02-23T06:21:23.156686+0000","last_undegraded":"2026-02-23T06:21:23.156686+0000","last_fullsized":"2026-02-23T06:21:23.156686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:50:22.850887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158615+0000","last_change":"2026-02-23T06:21:22.175837+0000","last_active":"2026-02-23T06:21:23.158615+0000","last_peered":"2026-02-23T06:21:23.158615+0000","last_clean":"2026-02-23T06:21:23.158615+0000","last_became_active":"2026-02-23T06:21:22.175638+0000","last_became_peered":"2026-02-23T06:21:22.175638+0000","last_unstale":"2026-02-23T06:21:23.158615+0000","last_undegraded":"2026-02-23T06:21:23.158615+0000","last_fullsized":"2026-02-23T06:21:23.158615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:24:39.312650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157339+0000","last_change":"2026-02-23T06:21:18.155473+0000","last_active":"2026-02-23T06:21:23.157339+0000","last_peered":"2026-02-23T06:21:23.157339+0000","last_clean":"2026-02-23T06:21:23.157339+0000","last_became_active":"2026-02-23T06:21:18.155349+0000","last_became_peered":"2026-02-23T06:21:18.155349+0000","last_unstale":"2026-02-23T06:21:23.157339+0000","last_undegraded":"2026-02-23T06:21:23.157339+0000","last_fullsized":"2026-02-23T06:21:23.157339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:20:20.345986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158459+0000","last_change":"2026-02-23T06:21:17.148953+0000","last_active":"2026-02-23T06:21:23.158459+0000","last_peered":"2026-02-23T06:21:23.158459+0000","last_clean":"2026-02-23T06:21:23.158459+0000","last_became_active":"2026-02-23T06:21:17.148841+0000","last_became_peered":"2026-02-23T06:21:17.148841+0000","last_unstale":"2026-02-23T06:21:23.158459+0000","last_undegraded":"2026-02-23T06:21:23.158459+0000","last_fullsized":"2026-02-23T06:21:23.158459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:48:14.620108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156366+0000","last_change":"2026-02-23T06:21:22.172897+0000","last_active":"2026-02-23T06:21:23.156366+0000","last_peered":"2026-02-23T06:21:23.156366+0000","last_clean":"2026-02-23T06:21:23.156366+0000","last_became_active":"2026-02-23T06:21:22.172683+0000","last_became_peered":"2026-02-23T06:21:22.172683+0000","last_unstale":"2026-02-23T06:21:23.156366+0000","last_undegraded":"2026-02-23T06:21:23.156366+0000","last_fullsized":"2026-02-23T06:21:23.156366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:17:41.991286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159118+0000","last_change":"2026-02-23T06:21:18.154897+0000","last_active":"2026-02-23T06:21:23.159118+0000","last_peered":"2026-02-23T06:21:23.159118+0000","last_clean":"2026-02-23T06:21:23.159118+0000","last_became_active":"2026-02-23T06:21:18.154586+0000","last_became_peered":"2026-02-23T06:21:18.154586+0000","last_unstale":"2026-02-23T06:21:23.159118+0000","last_undegraded":"2026-02-23T06:21:23.159118+0000","last_fullsized":"2026-02-23T06:21:23.159118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:22:13.361673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158486+0000","last_change":"2026-02-23T06:21:17.140774+0000","last_active":"2026-02-23T06:21:23.158486+0000","last_peered":"2026-02-23T06:21:23.158486+0000","last_clean":"2026-02-23T06:21:23.158486+0000","last_became_active":"2026-02-23T06:21:17.140699+0000","last_became_peered":"2026-02-23T06:21:17.140699+0000","last_unstale":"2026-02-23T06:21:23.158486+0000","last_undegraded":"2026-02-23T06:21:23.158486+0000","last_fullsized":"2026-02-23T06:21:23.158486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:59:47.987932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156705+0000","last_change":"2026-02-23T06:21:22.166371+0000","last_active":"2026-02-23T06:21:23.156705+0000","last_peered":"2026-02-23T06:21:23.156705+0000","last_clean":"2026-02-23T06:21:23.156705+0000","last_became_active":"2026-02-23T06:21:22.166204+0000","last_became_peered":"2026-02-23T06:21:22.166204+0000","last_unstale":"2026-02-23T06:21:23.156705+0000","last_undegraded":"2026-02-23T06:21:23.156705+0000","last_fullsized":"2026-02-23T06:21:23.156705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:50:51.116428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156852+0000","last_change":"2026-02-23T06:21:22.167411+0000","last_active":"2026-02-23T06:21:23.156852+0000","last_peered":"2026-02-23T06:21:23.156852+0000","last_clean":"2026-02-23T06:21:23.156852+0000","last_became_active":"2026-02-23T06:21:22.167217+0000","last_became_peered":"2026-02-23T06:21:22.167217+0000","last_unstale":"2026-02-23T06:21:23.156852+0000","last_undegraded":"2026-02-23T06:21:23.156852+0000","last_fullsized":"2026-02-23T06:21:23.156852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:20:54.687551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156512+0000","last_change":"2026-02-23T06:21:18.146043+0000","last_active":"2026-02-23T06:21:23.156512+0000","last_peered":"2026-02-23T06:21:23.156512+0000","last_clean":"2026-02-23T06:21:23.156512+0000","last_became_active":"2026-02-23T06:21:18.145938+0000","last_became_peered":"2026-02-23T06:21:18.145938+0000","last_unstale":"2026-02-23T06:21:23.156512+0000","last_undegraded":"2026-02-23T06:21:23.156512+0000","last_fullsized":"2026-02-23T06:21:23.156512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:03:21.252772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157446+0000","last_change":"2026-02-23T06:21:17.149581+0000","last_active":"2026-02-23T06:21:23.157446+0000","last_peered":"2026-02-23T06:21:23.157446+0000","last_clean":"2026-02-23T06:21:23.157446+0000","last_became_active":"2026-02-23T06:21:17.149490+0000","last_became_peered":"2026-02-23T06:21:17.149490+0000","last_unstale":"2026-02-23T06:21:23.157446+0000","last_undegraded":"2026-02-23T06:21:23.157446+0000","last_fullsized":"2026-02-23T06:21:23.157446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:18:42.211307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158840+0000","last_change":"2026-02-23T06:21:22.175655+0000","last_active":"2026-02-23T06:21:23.158840+0000","last_peered":"2026-02-23T06:21:23.158840+0000","last_clean":"2026-02-23T06:21:23.158840+0000","last_became_active":"2026-02-23T06:21:22.174906+0000","last_became_peered":"2026-02-23T06:21:22.174906+0000","last_unstale":"2026-02-23T06:21:23.158840+0000","last_undegraded":"2026-02-23T06:21:23.158840+0000","last_fullsized":"2026-02-23T06:21:23.158840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:50:34.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156556+0000","last_change":"2026-02-23T06:21:18.142560+0000","last_active":"2026-02-23T06:21:23.156556+0000","last_peered":"2026-02-23T06:21:23.156556+0000","last_clean":"2026-02-23T06:21:23.156556+0000","last_became_active":"2026-02-23T06:21:18.142325+0000","last_became_peered":"2026-02-23T06:21:18.142325+0000","last_unstale":"2026-02-23T06:21:23.156556+0000","last_undegraded":"2026-02-23T06:21:23.156556+0000","last_fullsized":"2026-02-23T06:21:23.156556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:45:44.641652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156988+0000","last_change":"2026-02-23T06:21:17.146195+0000","last_active":"2026-02-23T06:21:23.156988+0000","last_peered":"2026-02-23T06:21:23.156988+0000","last_clean":"2026-02-23T06:21:23.156988+0000","last_became_active":"2026-02-23T06:21:17.146022+0000","last_became_peered":"2026-02-23T06:21:17.146022+0000","last_unstale":"2026-02-23T06:21:23.156988+0000","last_undegraded":"2026-02-23T06:21:23.156988+0000","last_fullsized":"2026-02-23T06:21:23.156988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:34:32.822540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157689+0000","last_change":"2026-02-23T06:21:17.148590+0000","last_active":"2026-02-23T06:21:23.157689+0000","last_peered":"2026-02-23T06:21:23.157689+0000","last_clean":"2026-02-23T06:21:23.157689+0000","last_became_active":"2026-02-23T06:21:17.148417+0000","last_became_peered":"2026-02-23T06:21:17.148417+0000","last_unstale":"2026-02-23T06:21:23.157689+0000","last_undegraded":"2026-02-23T06:21:23.157689+0000","last_fullsized":"2026-02-23T06:21:23.157689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:21:11.877590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156606+0000","last_change":"2026-02-23T06:21:18.152383+0000","last_active":"2026-02-23T06:21:23.156606+0000","last_peered":"2026-02-23T06:21:23.156606+0000","last_clean":"2026-02-23T06:21:23.156606+0000","last_became_active":"2026-02-23T06:21:18.152267+0000","last_became_peered":"2026-02-23T06:21:18.152267+0000","last_unstale":"2026-02-23T06:21:23.156606+0000","last_undegraded":"2026-02-23T06:21:23.156606+0000","last_fullsized":"2026-02-23T06:21:23.156606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:34:11.558509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156801+0000","last_change":"2026-02-23T06:21:22.158812+0000","last_active":"2026-02-23T06:21:23.156801+0000","last_peered":"2026-02-23T06:21:23.156801+0000","last_clean":"2026-02-23T06:21:23.156801+0000","last_became_active":"2026-02-23T06:21:22.158607+0000","last_became_peered":"2026-02-23T06:21:22.158607+0000","last_unstale":"2026-02-23T06:21:23.156801+0000","last_undegraded":"2026-02-23T06:21:23.156801+0000","last_fullsized":"2026-02-23T06:21:23.156801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:59:07.000053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156780+0000","last_change":"2026-02-23T06:21:17.138744+0000","last_active":"2026-02-23T06:21:23.156780+0000","last_peered":"2026-02-23T06:21:23.156780+0000","last_clean":"2026-02-23T06:21:23.156780+0000","last_became_active":"2026-02-23T06:21:17.138245+0000","last_became_peered":"2026-02-23T06:21:17.138245+0000","last_unstale":"2026-02-23T06:21:23.156780+0000","last_undegraded":"2026-02-23T06:21:23.156780+0000","last_fullsized":"2026-02-23T06:21:23.156780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:08:03.143401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157483+0000","last_change":"2026-02-23T06:21:18.143640+0000","last_active":"2026-02-23T06:21:23.157483+0000","last_peered":"2026-02-23T06:21:23.157483+0000","last_clean":"2026-02-23T06:21:23.157483+0000","last_became_active":"2026-02-23T06:21:18.143550+0000","last_became_peered":"2026-02-23T06:21:18.143550+0000","last_unstale":"2026-02-23T06:21:23.157483+0000","last_undegraded":"2026-02-23T06:21:23.157483+0000","last_fullsized":"2026-02-23T06:21:23.157483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:11:40.394042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156644+0000","last_change":"2026-02-23T06:21:22.169641+0000","last_active":"2026-02-23T06:21:23.156644+0000","last_peered":"2026-02-23T06:21:23.156644+0000","last_clean":"2026-02-23T06:21:23.156644+0000","last_became_active":"2026-02-23T06:21:22.169432+0000","last_became_peered":"2026-02-23T06:21:22.169432+0000","last_unstale":"2026-02-23T06:21:23.156644+0000","last_undegraded":"2026-02-23T06:21:23.156644+0000","last_fullsized":"2026-02-23T06:21:23.156644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:00:17.622113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158222+0000","last_change":"2026-02-23T06:21:18.143781+0000","last_active":"2026-02-23T06:21:23.158222+0000","last_peered":"2026-02-23T06:21:23.158222+0000","last_clean":"2026-02-23T06:21:23.158222+0000","last_became_active":"2026-02-23T06:21:18.143724+0000","last_became_peered":"2026-02-23T06:21:18.143724+0000","last_unstale":"2026-02-23T06:21:23.158222+0000","last_undegraded":"2026-02-23T06:21:23.158222+0000","last_fullsized":"2026-02-23T06:21:23.158222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:25:55.416021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156366+0000","last_change":"2026-02-23T06:21:18.145425+0000","last_active":"2026-02-23T06:21:23.156366+0000","last_peered":"2026-02-23T06:21:23.156366+0000","last_clean":"2026-02-23T06:21:23.156366+0000","last_became_active":"2026-02-23T06:21:18.145325+0000","last_became_peered":"2026-02-23T06:21:18.145325+0000","last_unstale":"2026-02-23T06:21:23.156366+0000","last_undegraded":"2026-02-23T06:21:23.156366+0000","last_fullsized":"2026-02-23T06:21:23.156366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:55:31.700518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157544+0000","last_change":"2026-02-23T06:21:18.150997+0000","last_active":"2026-02-23T06:21:23.157544+0000","last_peered":"2026-02-23T06:21:23.157544+0000","last_clean":"2026-02-23T06:21:23.157544+0000","last_became_active":"2026-02-23T06:21:18.150738+0000","last_became_peered":"2026-02-23T06:21:18.150738+0000","last_unstale":"2026-02-23T06:21:23.157544+0000","last_undegraded":"2026-02-23T06:21:23.157544+0000","last_fullsized":"2026-02-23T06:21:23.157544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:11:13.400669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156727+0000","last_change":"2026-02-23T06:21:18.142305+0000","last_active":"2026-02-23T06:21:23.156727+0000","last_peered":"2026-02-23T06:21:23.156727+0000","last_clean":"2026-02-23T06:21:23.156727+0000","last_became_active":"2026-02-23T06:21:18.141484+0000","last_became_peered":"2026-02-23T06:21:18.141484+0000","last_unstale":"2026-02-23T06:21:23.156727+0000","last_undegraded":"2026-02-23T06:21:23.156727+0000","last_fullsized":"2026-02-23T06:21:23.156727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:12:36.003405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157376+0000","last_change":"2026-02-23T06:21:18.148610+0000","last_active":"2026-02-23T06:21:23.157376+0000","last_peered":"2026-02-23T06:21:23.157376+0000","last_clean":"2026-02-23T06:21:23.157376+0000","last_became_active":"2026-02-23T06:21:18.148489+0000","last_became_peered":"2026-02-23T06:21:18.148489+0000","last_unstale":"2026-02-23T06:21:23.157376+0000","last_undegraded":"2026-02-23T06:21:23.157376+0000","last_fullsized":"2026-02-23T06:21:23.157376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:36:29.486147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157279+0000","last_change":"2026-02-23T06:21:18.142438+0000","last_active":"2026-02-23T06:21:23.157279+0000","last_peered":"2026-02-23T06:21:23.157279+0000","last_clean":"2026-02-23T06:21:23.157279+0000","last_became_active":"2026-02-23T06:21:18.141854+0000","last_became_peered":"2026-02-23T06:21:18.141854+0000","last_unstale":"2026-02-23T06:21:23.157279+0000","last_undegraded":"2026-02-23T06:21:23.157279+0000","last_fullsized":"2026-02-23T06:21:23.157279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:23:35.379462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159075+0000","last_change":"2026-02-23T06:21:18.153825+0000","last_active":"2026-02-23T06:21:23.159075+0000","last_peered":"2026-02-23T06:21:23.159075+0000","last_clean":"2026-02-23T06:21:23.159075+0000","last_became_active":"2026-02-23T06:21:18.153133+0000","last_became_peered":"2026-02-23T06:21:18.153133+0000","last_unstale":"2026-02-23T06:21:23.159075+0000","last_undegraded":"2026-02-23T06:21:23.159075+0000","last_fullsized":"2026-02-23T06:21:23.159075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:15:03.662362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157187+0000","last_change":"2026-02-23T06:21:18.144945+0000","last_active":"2026-02-23T06:21:23.157187+0000","last_peered":"2026-02-23T06:21:23.157187+0000","last_clean":"2026-02-23T06:21:23.157187+0000","last_became_active":"2026-02-23T06:21:18.144832+0000","last_became_peered":"2026-02-23T06:21:18.144832+0000","last_unstale":"2026-02-23T06:21:23.157187+0000","last_undegraded":"2026-02-23T06:21:23.157187+0000","last_fullsized":"2026-02-23T06:21:23.157187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:41:07.968870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157406+0000","last_change":"2026-02-23T06:21:18.150652+0000","last_active":"2026-02-23T06:21:23.157406+0000","last_peered":"2026-02-23T06:21:23.157406+0000","last_clean":"2026-02-23T06:21:23.157406+0000","last_became_active":"2026-02-23T06:21:18.150489+0000","last_became_peered":"2026-02-23T06:21:18.150489+0000","last_unstale":"2026-02-23T06:21:23.157406+0000","last_undegraded":"2026-02-23T06:21:23.157406+0000","last_fullsized":"2026-02-23T06:21:23.157406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:42:35.233149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156538+0000","last_change":"2026-02-23T06:21:18.143636+0000","last_active":"2026-02-23T06:21:23.156538+0000","last_peered":"2026-02-23T06:21:23.156538+0000","last_clean":"2026-02-23T06:21:23.156538+0000","last_became_active":"2026-02-23T06:21:18.143495+0000","last_became_peered":"2026-02-23T06:21:18.143495+0000","last_unstale":"2026-02-23T06:21:23.156538+0000","last_undegraded":"2026-02-23T06:21:23.156538+0000","last_fullsized":"2026-02-23T06:21:23.156538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:47:19.057181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157427+0000","last_change":"2026-02-23T06:21:18.148787+0000","last_active":"2026-02-23T06:21:23.157427+0000","last_peered":"2026-02-23T06:21:23.157427+0000","last_clean":"2026-02-23T06:21:23.157427+0000","last_became_active":"2026-02-23T06:21:18.148701+0000","last_became_peered":"2026-02-23T06:21:18.148701+0000","last_unstale":"2026-02-23T06:21:23.157427+0000","last_undegraded":"2026-02-23T06:21:23.157427+0000","last_fullsized":"2026-02-23T06:21:23.157427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:19:32.878202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156524+0000","last_change":"2026-02-23T06:21:18.145498+0000","last_active":"2026-02-23T06:21:23.156524+0000","last_peered":"2026-02-23T06:21:23.156524+0000","last_clean":"2026-02-23T06:21:23.156524+0000","last_became_active":"2026-02-23T06:21:18.145346+0000","last_became_peered":"2026-02-23T06:21:18.145346+0000","last_unstale":"2026-02-23T06:21:23.156524+0000","last_undegraded":"2026-02-23T06:21:23.156524+0000","last_fullsized":"2026-02-23T06:21:23.156524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:44:15.203843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158314+0000","last_change":"2026-02-23T06:21:18.147453+0000","last_active":"2026-02-23T06:21:23.158314+0000","last_peered":"2026-02-23T06:21:23.158314+0000","last_clean":"2026-02-23T06:21:23.158314+0000","last_became_active":"2026-02-23T06:21:18.147357+0000","last_became_peered":"2026-02-23T06:21:18.147357+0000","last_unstale":"2026-02-23T06:21:23.158314+0000","last_undegraded":"2026-02-23T06:21:23.158314+0000","last_fullsized":"2026-02-23T06:21:23.158314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:41:05.063786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159167+0000","last_change":"2026-02-23T06:21:18.151381+0000","last_active":"2026-02-23T06:21:23.159167+0000","last_peered":"2026-02-23T06:21:23.159167+0000","last_clean":"2026-02-23T06:21:23.159167+0000","last_became_active":"2026-02-23T06:21:18.151269+0000","last_became_peered":"2026-02-23T06:21:18.151269+0000","last_unstale":"2026-02-23T06:21:23.159167+0000","last_undegraded":"2026-02-23T06:21:23.159167+0000","last_fullsized":"2026-02-23T06:21:23.159167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:50:46.152385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156748+0000","last_change":"2026-02-23T06:21:18.148411+0000","last_active":"2026-02-23T06:21:23.156748+0000","last_peered":"2026-02-23T06:21:23.156748+0000","last_clean":"2026-02-23T06:21:23.156748+0000","last_became_active":"2026-02-23T06:21:18.148262+0000","last_became_peered":"2026-02-23T06:21:18.148262+0000","last_unstale":"2026-02-23T06:21:23.156748+0000","last_undegraded":"2026-02-23T06:21:23.156748+0000","last_fullsized":"2026-02-23T06:21:23.156748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:09:54.723244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158936+0000","last_change":"2026-02-23T06:21:18.155275+0000","last_active":"2026-02-23T06:21:23.158936+0000","last_peered":"2026-02-23T06:21:23.158936+0000","last_clean":"2026-02-23T06:21:23.158936+0000","last_became_active":"2026-02-23T06:21:18.155214+0000","last_became_peered":"2026-02-23T06:21:18.155214+0000","last_unstale":"2026-02-23T06:21:23.158936+0000","last_undegraded":"2026-02-23T06:21:23.158936+0000","last_fullsized":"2026-02-23T06:21:23.158936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:44:47.367234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157370+0000","last_change":"2026-02-23T06:21:18.153381+0000","last_active":"2026-02-23T06:21:23.157370+0000","last_peered":"2026-02-23T06:21:23.157370+0000","last_clean":"2026-02-23T06:21:23.157370+0000","last_became_active":"2026-02-23T06:21:18.152456+0000","last_became_peered":"2026-02-23T06:21:18.152456+0000","last_unstale":"2026-02-23T06:21:23.157370+0000","last_undegraded":"2026-02-23T06:21:23.157370+0000","last_fullsized":"2026-02-23T06:21:23.157370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:14:46.231331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156471+0000","last_change":"2026-02-23T06:21:18.148599+0000","last_active":"2026-02-23T06:21:23.156471+0000","last_peered":"2026-02-23T06:21:23.156471+0000","last_clean":"2026-02-23T06:21:23.156471+0000","last_became_active":"2026-02-23T06:21:18.148498+0000","last_became_peered":"2026-02-23T06:21:18.148498+0000","last_unstale":"2026-02-23T06:21:23.156471+0000","last_undegraded":"2026-02-23T06:21:23.156471+0000","last_fullsized":"2026-02-23T06:21:23.156471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:05:56.074928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157128+0000","last_change":"2026-02-23T06:21:18.142621+0000","last_active":"2026-02-23T06:21:23.157128+0000","last_peered":"2026-02-23T06:21:23.157128+0000","last_clean":"2026-02-23T06:21:23.157128+0000","last_became_active":"2026-02-23T06:21:18.141938+0000","last_became_peered":"2026-02-23T06:21:18.141938+0000","last_unstale":"2026-02-23T06:21:23.157128+0000","last_undegraded":"2026-02-23T06:21:23.157128+0000","last_fullsized":"2026-02-23T06:21:23.157128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:25:55.390738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157141+0000","last_change":"2026-02-23T06:21:18.153183+0000","last_active":"2026-02-23T06:21:23.157141+0000","last_peered":"2026-02-23T06:21:23.157141+0000","last_clean":"2026-02-23T06:21:23.157141+0000","last_became_active":"2026-02-23T06:21:18.153090+0000","last_became_peered":"2026-02-23T06:21:18.153090+0000","last_unstale":"2026-02-23T06:21:23.157141+0000","last_undegraded":"2026-02-23T06:21:23.157141+0000","last_fullsized":"2026-02-23T06:21:23.157141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:26:17.749612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158286+0000","last_change":"2026-02-23T06:21:18.148055+0000","last_active":"2026-02-23T06:21:23.158286+0000","last_peered":"2026-02-23T06:21:23.158286+0000","last_clean":"2026-02-23T06:21:23.158286+0000","last_became_active":"2026-02-23T06:21:18.147956+0000","last_became_peered":"2026-02-23T06:21:18.147956+0000","last_unstale":"2026-02-23T06:21:23.158286+0000","last_undegraded":"2026-02-23T06:21:23.158286+0000","last_fullsized":"2026-02-23T06:21:23.158286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:22:55.028859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158650+0000","last_change":"2026-02-23T06:21:18.155576+0000","last_active":"2026-02-23T06:21:23.158650+0000","last_peered":"2026-02-23T06:21:23.158650+0000","last_clean":"2026-02-23T06:21:23.158650+0000","last_became_active":"2026-02-23T06:21:18.155130+0000","last_became_peered":"2026-02-23T06:21:18.155130+0000","last_unstale":"2026-02-23T06:21:23.158650+0000","last_undegraded":"2026-02-23T06:21:23.158650+0000","last_fullsized":"2026-02-23T06:21:23.158650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:43:12.801427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158425+0000","last_change":"2026-02-23T06:21:18.152980+0000","last_active":"2026-02-23T06:21:23.158425+0000","last_peered":"2026-02-23T06:21:23.158425+0000","last_clean":"2026-02-23T06:21:23.158425+0000","last_became_active":"2026-02-23T06:21:18.152790+0000","last_became_peered":"2026-02-23T06:21:18.152790+0000","last_unstale":"2026-02-23T06:21:23.158425+0000","last_undegraded":"2026-02-23T06:21:23.158425+0000","last_fullsized":"2026-02-23T06:21:23.158425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:33:09.398040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158457+0000","last_change":"2026-02-23T06:21:18.155247+0000","last_active":"2026-02-23T06:21:23.158457+0000","last_peered":"2026-02-23T06:21:23.158457+0000","last_clean":"2026-02-23T06:21:23.158457+0000","last_became_active":"2026-02-23T06:21:18.155122+0000","last_became_peered":"2026-02-23T06:21:18.155122+0000","last_unstale":"2026-02-23T06:21:23.158457+0000","last_undegraded":"2026-02-23T06:21:23.158457+0000","last_fullsized":"2026-02-23T06:21:23.158457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:45:08.775934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156432+0000","last_change":"2026-02-23T06:21:18.151259+0000","last_active":"2026-02-23T06:21:23.156432+0000","last_peered":"2026-02-23T06:21:23.156432+0000","last_clean":"2026-02-23T06:21:23.156432+0000","last_became_active":"2026-02-23T06:21:18.151151+0000","last_became_peered":"2026-02-23T06:21:18.151151+0000","last_unstale":"2026-02-23T06:21:23.156432+0000","last_undegraded":"2026-02-23T06:21:23.156432+0000","last_fullsized":"2026-02-23T06:21:23.156432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:08:03.361054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157811+0000","last_change":"2026-02-23T06:21:18.146606+0000","last_active":"2026-02-23T06:21:23.157811+0000","last_peered":"2026-02-23T06:21:23.157811+0000","last_clean":"2026-02-23T06:21:23.157811+0000","last_became_active":"2026-02-23T06:21:18.146527+0000","last_became_peered":"2026-02-23T06:21:18.146527+0000","last_unstale":"2026-02-23T06:21:23.157811+0000","last_undegraded":"2026-02-23T06:21:23.157811+0000","last_fullsized":"2026-02-23T06:21:23.157811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:30:44.739034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158602+0000","last_change":"2026-02-23T06:21:18.145872+0000","last_active":"2026-02-23T06:21:23.158602+0000","last_peered":"2026-02-23T06:21:23.158602+0000","last_clean":"2026-02-23T06:21:23.158602+0000","last_became_active":"2026-02-23T06:21:18.145770+0000","last_became_peered":"2026-02-23T06:21:18.145770+0000","last_unstale":"2026-02-23T06:21:23.158602+0000","last_undegraded":"2026-02-23T06:21:23.158602+0000","last_fullsized":"2026-02-23T06:21:23.158602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:21:28.063960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158049+0000","last_change":"2026-02-23T06:21:18.152478+0000","last_active":"2026-02-23T06:21:23.158049+0000","last_peered":"2026-02-23T06:21:23.158049+0000","last_clean":"2026-02-23T06:21:23.158049+0000","last_became_active":"2026-02-23T06:21:18.151948+0000","last_became_peered":"2026-02-23T06:21:18.151948+0000","last_unstale":"2026-02-23T06:21:23.158049+0000","last_undegraded":"2026-02-23T06:21:23.158049+0000","last_fullsized":"2026-02-23T06:21:23.158049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:58:02.829593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158363+0000","last_change":"2026-02-23T06:21:18.144778+0000","last_active":"2026-02-23T06:21:23.158363+0000","last_peered":"2026-02-23T06:21:23.158363+0000","last_clean":"2026-02-23T06:21:23.158363+0000","last_became_active":"2026-02-23T06:21:18.144346+0000","last_became_peered":"2026-02-23T06:21:18.144346+0000","last_unstale":"2026-02-23T06:21:23.158363+0000","last_undegraded":"2026-02-23T06:21:23.158363+0000","last_fullsized":"2026-02-23T06:21:23.158363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:25:27.650673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156824+0000","last_change":"2026-02-23T06:21:18.141648+0000","last_active":"2026-02-23T06:21:23.156824+0000","last_peered":"2026-02-23T06:21:23.156824+0000","last_clean":"2026-02-23T06:21:23.156824+0000","last_became_active":"2026-02-23T06:21:18.141449+0000","last_became_peered":"2026-02-23T06:21:18.141449+0000","last_unstale":"2026-02-23T06:21:23.156824+0000","last_undegraded":"2026-02-23T06:21:23.156824+0000","last_fullsized":"2026-02-23T06:21:23.156824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:33:18.986892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157020+0000","last_change":"2026-02-23T06:21:18.142536+0000","last_active":"2026-02-23T06:21:23.157020+0000","last_peered":"2026-02-23T06:21:23.157020+0000","last_clean":"2026-02-23T06:21:23.157020+0000","last_became_active":"2026-02-23T06:21:18.142359+0000","last_became_peered":"2026-02-23T06:21:18.142359+0000","last_unstale":"2026-02-23T06:21:23.157020+0000","last_undegraded":"2026-02-23T06:21:23.157020+0000","last_fullsized":"2026-02-23T06:21:23.157020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:54:09.503227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158607+0000","last_change":"2026-02-23T06:21:18.156667+0000","last_active":"2026-02-23T06:21:23.158607+0000","last_peered":"2026-02-23T06:21:23.158607+0000","last_clean":"2026-02-23T06:21:23.158607+0000","last_became_active":"2026-02-23T06:21:18.156564+0000","last_became_peered":"2026-02-23T06:21:18.156564+0000","last_unstale":"2026-02-23T06:21:23.158607+0000","last_undegraded":"2026-02-23T06:21:23.158607+0000","last_fullsized":"2026-02-23T06:21:23.158607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:11:13.967668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4747,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25597,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70172,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":328,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":335872,"data_stored":694963,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":12046,"internal_metadata":27578610},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":268,"kb_used_omap":19,"kb_used_meta":26924,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":274432,"data_stored":104649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19702,"internal_metadata":27570954},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":260,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":266240,"data_stored":104525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11374,"internal_metadata":27579282},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":332,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":339968,"data_stored":694985,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":11711,"internal_metadata":27578945},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":109146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13524,"internal_metadata":27577132},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":105129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11474,"internal_metadata":27579182},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":272,"kb_used_omap":10,"kb_used_meta":26933,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":278528,"data_stored":108452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11136,"internal_metadata":27579520},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":268,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":274432,"data_stored":104581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":27571517},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8618,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":702,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":320,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1500,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4712,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":336,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9409,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T06:21:39.673 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-23T06:21:39.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.831+0000 7fa719b75640 1 -- 10.20.193.58:0/3775638380 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa71415d870 msgr2=0x7fa7140587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.831+0000 7fa719b75640 1 --2- 10.20.193.58:0/3775638380 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa71415d870 0x7fa7140587b0 secure :-1 s=READY pgs=152 gs=1 cs=0 l=1 c_cookie=16938219858332429681 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7140b1b90 tx=0x7fa6fc02f250 comp rx=0 tx=0).stop 2026-02-23T06:21:39.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.831+0000 7fa719b75640 1 -- 10.20.193.58:0/3775638380 shutdown_connections 2026-02-23T06:21:39.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.831+0000 7fa719b75640 1 --2- 10.20.193.58:0/3775638380 >> v2:10.20.193.93:3300/0 conn(0x7fa7140b6690 0x7fa714058cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.831+0000 7fa719b75640 1 --2- 10.20.193.58:0/3775638380 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa71415d870 0x7fa7140587b0 unknown :-1 s=CLOSED pgs=152 gs=1 cs=0 l=1 c_cookie=16938219858332429681 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.831+0000 7fa719b75640 1 --2- 10.20.193.58:0/3775638380 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa71415d4a0 0x7fa7140affb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.831+0000 7fa719b75640 1 -- 10.20.193.58:0/3775638380 >> 10.20.193.58:0/3775638380 conn(0x7fa7140b3c20 msgr2=0x7fa7140b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:39.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.831+0000 7fa719b75640 1 -- 10.20.193.58:0/3775638380 shutdown_connections 2026-02-23T06:21:39.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.831+0000 7fa719b75640 1 -- 10.20.193.58:0/3775638380 wait complete. 2026-02-23T06:21:39.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.832+0000 7fa719b75640 1 Processor -- start 2026-02-23T06:21:39.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.832+0000 7fa719b75640 1 -- start start 2026-02-23T06:21:39.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.833+0000 7fa719b75640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa7140b6690 0x7fa7141feb80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.833+0000 7fa719b75640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa71415d4a0 0x7fa714162730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.833+0000 7fa719b75640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa71415d870 0x7fa714162c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.833+0000 7fa719b75640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa71405d4f0 con 0x7fa7140b6690 2026-02-23T06:21:39.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.833+0000 7fa719b75640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fa7141ff8b0 con 0x7fa71415d870 2026-02-23T06:21:39.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.833+0000 7fa719b75640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa71405d210 con 0x7fa71415d4a0 2026-02-23T06:21:39.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.833+0000 7fa718b73640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa7140b6690 0x7fa7141feb80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.833+0000 7fa718b73640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa7140b6690 0x7fa7141feb80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:56842/0 (socket says 10.20.193.58:56842) 2026-02-23T06:21:39.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.833+0000 7fa718b73640 1 -- 10.20.193.58:0/596471030 learned_addr learned my addr 10.20.193.58:0/596471030 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:39.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.833+0000 7fa70bfff640 1 --2- 10.20.193.58:0/596471030 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa71415d4a0 0x7fa714162730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.833+0000 7fa719374640 1 --2- 10.20.193.58:0/596471030 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa71415d870 0x7fa714162c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.833+0000 7fa718b73640 1 -- 10.20.193.58:0/596471030 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa71415d4a0 msgr2=0x7fa714162730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.833+0000 7fa718b73640 1 --2- 10.20.193.58:0/596471030 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa71415d4a0 0x7fa714162730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.833+0000 7fa718b73640 1 -- 10.20.193.58:0/596471030 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa71415d870 msgr2=0x7fa714162c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.833+0000 7fa718b73640 1 --2- 10.20.193.58:0/596471030 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa71415d870 0x7fa714162c70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.833+0000 7fa718b73640 1 -- 10.20.193.58:0/596471030 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6fc009570 con 0x7fa7140b6690 2026-02-23T06:21:39.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.833+0000 7fa719374640 1 --2- 10.20.193.58:0/596471030 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa71415d870 0x7fa714162c70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:21:39.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.833+0000 7fa718b73640 1 --2- 10.20.193.58:0/596471030 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa7140b6690 0x7fa7141feb80 secure :-1 s=READY pgs=153 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa70400d950 tx=0x7fa70400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:39.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.834+0000 7fa7097fa640 1 -- 10.20.193.58:0/596471030 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa704004540 con 0x7fa7140b6690 2026-02-23T06:21:39.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.834+0000 7fa7097fa640 1 -- 10.20.193.58:0/596471030 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa704009910 con 0x7fa7140b6690 2026-02-23T06:21:39.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.834+0000 7fa7097fa640 1 -- 10.20.193.58:0/596471030 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa704009d20 con 0x7fa7140b6690 2026-02-23T06:21:39.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.834+0000 7fa719b75640 1 -- 10.20.193.58:0/596471030 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7141ff5d0 con 0x7fa7140b6690 2026-02-23T06:21:39.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.834+0000 7fa719b75640 1 -- 10.20.193.58:0/596471030 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa71415e480 con 0x7fa7140b6690 2026-02-23T06:21:39.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.834+0000 7fa719b75640 1 -- 10.20.193.58:0/596471030 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7140b7260 con 0x7fa7140b6690 2026-02-23T06:21:39.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.836+0000 7fa7097fa640 1 -- 10.20.193.58:0/596471030 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fa7040026a0 con 0x7fa7140b6690 2026-02-23T06:21:39.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.836+0000 7fa7097fa640 1 --2- 10.20.193.58:0/596471030 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa6e407a640 0x7fa6e409aaf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:39.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.836+0000 7fa7097fa640 1 -- 10.20.193.58:0/596471030 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7fa70409dfa0 con 0x7fa7140b6690 2026-02-23T06:21:39.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.837+0000 7fa70bfff640 1 --2- 10.20.193.58:0/596471030 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa6e407a640 0x7fa6e409aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:39.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.837+0000 7fa70bfff640 1 --2- 10.20.193.58:0/596471030 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa6e407a640 0x7fa6e409aaf0 secure :-1 s=READY pgs=99 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6fc0023d0 tx=0x7fa6fc03a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:39.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.838+0000 7fa7097fa640 1 -- 10.20.193.58:0/596471030 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fa704061180 con 0x7fa7140b6690 2026-02-23T06:21:39.945 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.951+0000 7fa719b75640 1 -- 10.20.193.58:0/596471030 --> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa714164250 con 0x7fa6e407a640 2026-02-23T06:21:39.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.954+0000 7fa7097fa640 1 -- 10.20.193.58:0/596471030 <== mgr.4126 v2:10.20.193.93:6800/4124709854 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332641 (secure 0 0 0) 0x7fa6fc03e040 con 0x7fa6e407a640 2026-02-23T06:21:39.952 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:39.955 INFO:teuthology.orchestra.run.trial058.stderr:dumped all 2026-02-23T06:21:39.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.956+0000 7fa719b75640 1 -- 10.20.193.58:0/596471030 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa6e407a640 msgr2=0x7fa6e409aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.956+0000 7fa719b75640 1 --2- 10.20.193.58:0/596471030 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa6e407a640 0x7fa6e409aaf0 secure :-1 s=READY pgs=99 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6fc0023d0 tx=0x7fa6fc03a040 comp rx=0 tx=0).stop 2026-02-23T06:21:39.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.956+0000 7fa719b75640 1 -- 10.20.193.58:0/596471030 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa7140b6690 msgr2=0x7fa7141feb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:39.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.956+0000 7fa719b75640 1 --2- 10.20.193.58:0/596471030 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa7140b6690 0x7fa7141feb80 secure :-1 s=READY pgs=153 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa70400d950 tx=0x7fa70400de20 comp rx=0 tx=0).stop 2026-02-23T06:21:39.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.957+0000 7fa719b75640 1 -- 10.20.193.58:0/596471030 shutdown_connections 2026-02-23T06:21:39.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.957+0000 7fa719b75640 1 --2- 10.20.193.58:0/596471030 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa6e407a640 0x7fa6e409aaf0 unknown :-1 s=CLOSED pgs=99 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.957+0000 7fa719b75640 1 --2- 10.20.193.58:0/596471030 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa71415d870 0x7fa714162c70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.957+0000 7fa719b75640 1 --2- 10.20.193.58:0/596471030 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa71415d4a0 0x7fa714162730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.957+0000 7fa719b75640 1 --2- 10.20.193.58:0/596471030 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa7140b6690 0x7fa7141feb80 unknown :-1 s=CLOSED pgs=153 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:39.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.957+0000 7fa719b75640 1 -- 10.20.193.58:0/596471030 >> 10.20.193.58:0/596471030 conn(0x7fa7140b3c20 msgr2=0x7fa71405ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:39.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.957+0000 7fa719b75640 1 -- 10.20.193.58:0/596471030 shutdown_connections 2026-02-23T06:21:39.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:39.957+0000 7fa719b75640 1 -- 10.20.193.58:0/596471030 wait complete. 2026-02-23T06:21:39.964 INFO:teuthology.orchestra.run.trial058.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2026-02-23T06:21:38.376952+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595115,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":193,"num_write_kb":2690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":217952,"kb_used_data":2272,"kb_used_omap":107,"kb_used_meta":215444,"kb_avail":754756768,"statfs":{"total":773094113280,"available":772870930432,"internally_reserved":0,"allocated":2326528,"data_stored":2026430,"data_compressed":70172,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":110106,"internal_metadata":220615142},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2293,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001556"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156952+0000","last_change":"2026-02-23T06:21:17.142582+0000","last_active":"2026-02-23T06:21:23.156952+0000","last_peered":"2026-02-23T06:21:23.156952+0000","last_clean":"2026-02-23T06:21:23.156952+0000","last_became_active":"2026-02-23T06:21:17.142416+0000","last_became_peered":"2026-02-23T06:21:17.142416+0000","last_unstale":"2026-02-23T06:21:23.156952+0000","last_undegraded":"2026-02-23T06:21:23.156952+0000","last_fullsized":"2026-02-23T06:21:23.156952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:13:12.649937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157112+0000","last_change":"2026-02-23T06:21:18.148362+0000","last_active":"2026-02-23T06:21:23.157112+0000","last_peered":"2026-02-23T06:21:23.157112+0000","last_clean":"2026-02-23T06:21:23.157112+0000","last_became_active":"2026-02-23T06:21:18.148276+0000","last_became_peered":"2026-02-23T06:21:18.148276+0000","last_unstale":"2026-02-23T06:21:23.157112+0000","last_undegraded":"2026-02-23T06:21:23.157112+0000","last_fullsized":"2026-02-23T06:21:23.157112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:47.221741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156473+0000","last_change":"2026-02-23T06:21:22.169541+0000","last_active":"2026-02-23T06:21:23.156473+0000","last_peered":"2026-02-23T06:21:23.156473+0000","last_clean":"2026-02-23T06:21:23.156473+0000","last_became_active":"2026-02-23T06:21:22.169307+0000","last_became_peered":"2026-02-23T06:21:22.169307+0000","last_unstale":"2026-02-23T06:21:23.156473+0000","last_undegraded":"2026-02-23T06:21:23.156473+0000","last_fullsized":"2026-02-23T06:21:23.156473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:40:10.952374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157171+0000","last_change":"2026-02-23T06:21:17.138864+0000","last_active":"2026-02-23T06:21:23.157171+0000","last_peered":"2026-02-23T06:21:23.157171+0000","last_clean":"2026-02-23T06:21:23.157171+0000","last_became_active":"2026-02-23T06:21:17.138651+0000","last_became_peered":"2026-02-23T06:21:17.138651+0000","last_unstale":"2026-02-23T06:21:23.157171+0000","last_undegraded":"2026-02-23T06:21:23.157171+0000","last_fullsized":"2026-02-23T06:21:23.157171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:24.172617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157312+0000","last_change":"2026-02-23T06:21:18.145040+0000","last_active":"2026-02-23T06:21:23.157312+0000","last_peered":"2026-02-23T06:21:23.157312+0000","last_clean":"2026-02-23T06:21:23.157312+0000","last_became_active":"2026-02-23T06:21:18.144915+0000","last_became_peered":"2026-02-23T06:21:18.144915+0000","last_unstale":"2026-02-23T06:21:23.157312+0000","last_undegraded":"2026-02-23T06:21:23.157312+0000","last_fullsized":"2026-02-23T06:21:23.157312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:17:30.105623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158170+0000","last_change":"2026-02-23T06:21:22.172729+0000","last_active":"2026-02-23T06:21:23.158170+0000","last_peered":"2026-02-23T06:21:23.158170+0000","last_clean":"2026-02-23T06:21:23.158170+0000","last_became_active":"2026-02-23T06:21:22.172510+0000","last_became_peered":"2026-02-23T06:21:22.172510+0000","last_unstale":"2026-02-23T06:21:23.158170+0000","last_undegraded":"2026-02-23T06:21:23.158170+0000","last_fullsized":"2026-02-23T06:21:23.158170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:53:55.801734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158943+0000","last_change":"2026-02-23T06:21:17.150375+0000","last_active":"2026-02-23T06:21:23.158943+0000","last_peered":"2026-02-23T06:21:23.158943+0000","last_clean":"2026-02-23T06:21:23.158943+0000","last_became_active":"2026-02-23T06:21:17.150244+0000","last_became_peered":"2026-02-23T06:21:17.150244+0000","last_unstale":"2026-02-23T06:21:23.158943+0000","last_undegraded":"2026-02-23T06:21:23.158943+0000","last_fullsized":"2026-02-23T06:21:23.158943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:06:21.465108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157674+0000","last_change":"2026-02-23T06:21:18.150247+0000","last_active":"2026-02-23T06:21:23.157674+0000","last_peered":"2026-02-23T06:21:23.157674+0000","last_clean":"2026-02-23T06:21:23.157674+0000","last_became_active":"2026-02-23T06:21:18.149827+0000","last_became_peered":"2026-02-23T06:21:18.149827+0000","last_unstale":"2026-02-23T06:21:23.157674+0000","last_undegraded":"2026-02-23T06:21:23.157674+0000","last_fullsized":"2026-02-23T06:21:23.157674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:37:58.944726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158517+0000","last_change":"2026-02-23T06:21:22.174417+0000","last_active":"2026-02-23T06:21:23.158517+0000","last_peered":"2026-02-23T06:21:23.158517+0000","last_clean":"2026-02-23T06:21:23.158517+0000","last_became_active":"2026-02-23T06:21:22.173939+0000","last_became_peered":"2026-02-23T06:21:22.173939+0000","last_unstale":"2026-02-23T06:21:23.158517+0000","last_undegraded":"2026-02-23T06:21:23.158517+0000","last_fullsized":"2026-02-23T06:21:23.158517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:41:53.008301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158816+0000","last_change":"2026-02-23T06:21:17.145244+0000","last_active":"2026-02-23T06:21:23.158816+0000","last_peered":"2026-02-23T06:21:23.158816+0000","last_clean":"2026-02-23T06:21:23.158816+0000","last_became_active":"2026-02-23T06:21:17.144122+0000","last_became_peered":"2026-02-23T06:21:17.144122+0000","last_unstale":"2026-02-23T06:21:23.158816+0000","last_undegraded":"2026-02-23T06:21:23.158816+0000","last_fullsized":"2026-02-23T06:21:23.158816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:42:56.020005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159068+0000","last_change":"2026-02-23T06:21:18.155799+0000","last_active":"2026-02-23T06:21:23.159068+0000","last_peered":"2026-02-23T06:21:23.159068+0000","last_clean":"2026-02-23T06:21:23.159068+0000","last_became_active":"2026-02-23T06:21:18.154985+0000","last_became_peered":"2026-02-23T06:21:18.154985+0000","last_unstale":"2026-02-23T06:21:23.159068+0000","last_undegraded":"2026-02-23T06:21:23.159068+0000","last_fullsized":"2026-02-23T06:21:23.159068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:11:13.595733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158472+0000","last_change":"2026-02-23T06:21:22.168755+0000","last_active":"2026-02-23T06:21:23.158472+0000","last_peered":"2026-02-23T06:21:23.158472+0000","last_clean":"2026-02-23T06:21:23.158472+0000","last_became_active":"2026-02-23T06:21:22.165671+0000","last_became_peered":"2026-02-23T06:21:22.165671+0000","last_unstale":"2026-02-23T06:21:23.158472+0000","last_undegraded":"2026-02-23T06:21:23.158472+0000","last_fullsized":"2026-02-23T06:21:23.158472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:04:32.848929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157587+0000","last_change":"2026-02-23T06:21:18.150907+0000","last_active":"2026-02-23T06:21:23.157587+0000","last_peered":"2026-02-23T06:21:23.157587+0000","last_clean":"2026-02-23T06:21:23.157587+0000","last_became_active":"2026-02-23T06:21:18.150604+0000","last_became_peered":"2026-02-23T06:21:18.150604+0000","last_unstale":"2026-02-23T06:21:23.157587+0000","last_undegraded":"2026-02-23T06:21:23.157587+0000","last_fullsized":"2026-02-23T06:21:23.157587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:15:21.672153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157971+0000","last_change":"2026-02-23T06:21:17.147523+0000","last_active":"2026-02-23T06:21:23.157971+0000","last_peered":"2026-02-23T06:21:23.157971+0000","last_clean":"2026-02-23T06:21:23.157971+0000","last_became_active":"2026-02-23T06:21:17.147351+0000","last_became_peered":"2026-02-23T06:21:17.147351+0000","last_unstale":"2026-02-23T06:21:23.157971+0000","last_undegraded":"2026-02-23T06:21:23.157971+0000","last_fullsized":"2026-02-23T06:21:23.157971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:36:34.550499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158924+0000","last_change":"2026-02-23T06:21:22.169413+0000","last_active":"2026-02-23T06:21:23.158924+0000","last_peered":"2026-02-23T06:21:23.158924+0000","last_clean":"2026-02-23T06:21:23.158924+0000","last_became_active":"2026-02-23T06:21:22.169259+0000","last_became_peered":"2026-02-23T06:21:22.169259+0000","last_unstale":"2026-02-23T06:21:23.158924+0000","last_undegraded":"2026-02-23T06:21:23.158924+0000","last_fullsized":"2026-02-23T06:21:23.158924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:14:12.944321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156495+0000","last_change":"2026-02-23T06:21:18.142316+0000","last_active":"2026-02-23T06:21:23.156495+0000","last_peered":"2026-02-23T06:21:23.156495+0000","last_clean":"2026-02-23T06:21:23.156495+0000","last_became_active":"2026-02-23T06:21:18.142144+0000","last_became_peered":"2026-02-23T06:21:18.142144+0000","last_unstale":"2026-02-23T06:21:23.156495+0000","last_undegraded":"2026-02-23T06:21:23.156495+0000","last_fullsized":"2026-02-23T06:21:23.156495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:53:33.429271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157370+0000","last_change":"2026-02-23T06:21:17.137576+0000","last_active":"2026-02-23T06:21:23.157370+0000","last_peered":"2026-02-23T06:21:23.157370+0000","last_clean":"2026-02-23T06:21:23.157370+0000","last_became_active":"2026-02-23T06:21:17.137371+0000","last_became_peered":"2026-02-23T06:21:17.137371+0000","last_unstale":"2026-02-23T06:21:23.157370+0000","last_undegraded":"2026-02-23T06:21:23.157370+0000","last_fullsized":"2026-02-23T06:21:23.157370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:27.159743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158222+0000","last_change":"2026-02-23T06:21:22.163003+0000","last_active":"2026-02-23T06:21:23.158222+0000","last_peered":"2026-02-23T06:21:23.158222+0000","last_clean":"2026-02-23T06:21:23.158222+0000","last_became_active":"2026-02-23T06:21:22.162898+0000","last_became_peered":"2026-02-23T06:21:22.162898+0000","last_unstale":"2026-02-23T06:21:23.158222+0000","last_undegraded":"2026-02-23T06:21:23.158222+0000","last_fullsized":"2026-02-23T06:21:23.158222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:29:18.161667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156351+0000","last_change":"2026-02-23T06:21:18.141281+0000","last_active":"2026-02-23T06:21:23.156351+0000","last_peered":"2026-02-23T06:21:23.156351+0000","last_clean":"2026-02-23T06:21:23.156351+0000","last_became_active":"2026-02-23T06:21:18.141090+0000","last_became_peered":"2026-02-23T06:21:18.141090+0000","last_unstale":"2026-02-23T06:21:23.156351+0000","last_undegraded":"2026-02-23T06:21:23.156351+0000","last_fullsized":"2026-02-23T06:21:23.156351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:12:21.750595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156633+0000","last_change":"2026-02-23T06:21:17.144179+0000","last_active":"2026-02-23T06:21:23.156633+0000","last_peered":"2026-02-23T06:21:23.156633+0000","last_clean":"2026-02-23T06:21:23.156633+0000","last_became_active":"2026-02-23T06:21:17.144017+0000","last_became_peered":"2026-02-23T06:21:17.144017+0000","last_unstale":"2026-02-23T06:21:23.156633+0000","last_undegraded":"2026-02-23T06:21:23.156633+0000","last_fullsized":"2026-02-23T06:21:23.156633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:25:41.992201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156888+0000","last_change":"2026-02-23T06:21:22.174826+0000","last_active":"2026-02-23T06:21:23.156888+0000","last_peered":"2026-02-23T06:21:23.156888+0000","last_clean":"2026-02-23T06:21:23.156888+0000","last_became_active":"2026-02-23T06:21:22.174683+0000","last_became_peered":"2026-02-23T06:21:22.174683+0000","last_unstale":"2026-02-23T06:21:23.156888+0000","last_undegraded":"2026-02-23T06:21:23.156888+0000","last_fullsized":"2026-02-23T06:21:23.156888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:04:49.277580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157342+0000","last_change":"2026-02-23T06:21:18.145331+0000","last_active":"2026-02-23T06:21:23.157342+0000","last_peered":"2026-02-23T06:21:23.157342+0000","last_clean":"2026-02-23T06:21:23.157342+0000","last_became_active":"2026-02-23T06:21:18.145231+0000","last_became_peered":"2026-02-23T06:21:18.145231+0000","last_unstale":"2026-02-23T06:21:23.157342+0000","last_undegraded":"2026-02-23T06:21:23.157342+0000","last_fullsized":"2026-02-23T06:21:23.157342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:32:44.487867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157126+0000","last_change":"2026-02-23T06:21:17.147584+0000","last_active":"2026-02-23T06:21:23.157126+0000","last_peered":"2026-02-23T06:21:23.157126+0000","last_clean":"2026-02-23T06:21:23.157126+0000","last_became_active":"2026-02-23T06:21:17.147431+0000","last_became_peered":"2026-02-23T06:21:17.147431+0000","last_unstale":"2026-02-23T06:21:23.157126+0000","last_undegraded":"2026-02-23T06:21:23.157126+0000","last_fullsized":"2026-02-23T06:21:23.157126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:10:39.127457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159080+0000","last_change":"2026-02-23T06:21:22.175656+0000","last_active":"2026-02-23T06:21:23.159080+0000","last_peered":"2026-02-23T06:21:23.159080+0000","last_clean":"2026-02-23T06:21:23.159080+0000","last_became_active":"2026-02-23T06:21:22.175493+0000","last_became_peered":"2026-02-23T06:21:22.175493+0000","last_unstale":"2026-02-23T06:21:23.159080+0000","last_undegraded":"2026-02-23T06:21:23.159080+0000","last_fullsized":"2026-02-23T06:21:23.159080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:10:41.366772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156769+0000","last_change":"2026-02-23T06:21:18.141486+0000","last_active":"2026-02-23T06:21:23.156769+0000","last_peered":"2026-02-23T06:21:23.156769+0000","last_clean":"2026-02-23T06:21:23.156769+0000","last_became_active":"2026-02-23T06:21:18.141277+0000","last_became_peered":"2026-02-23T06:21:18.141277+0000","last_unstale":"2026-02-23T06:21:23.156769+0000","last_undegraded":"2026-02-23T06:21:23.156769+0000","last_fullsized":"2026-02-23T06:21:23.156769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:21:15.738187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158970+0000","last_change":"2026-02-23T06:21:17.148536+0000","last_active":"2026-02-23T06:21:23.158970+0000","last_peered":"2026-02-23T06:21:23.158970+0000","last_clean":"2026-02-23T06:21:23.158970+0000","last_became_active":"2026-02-23T06:21:17.148424+0000","last_became_peered":"2026-02-23T06:21:17.148424+0000","last_unstale":"2026-02-23T06:21:23.158970+0000","last_undegraded":"2026-02-23T06:21:23.158970+0000","last_fullsized":"2026-02-23T06:21:23.158970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:02:54.995144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158363+0000","last_change":"2026-02-23T06:21:22.171333+0000","last_active":"2026-02-23T06:21:23.158363+0000","last_peered":"2026-02-23T06:21:23.158363+0000","last_clean":"2026-02-23T06:21:23.158363+0000","last_became_active":"2026-02-23T06:21:22.170496+0000","last_became_peered":"2026-02-23T06:21:22.170496+0000","last_unstale":"2026-02-23T06:21:23.158363+0000","last_undegraded":"2026-02-23T06:21:23.158363+0000","last_fullsized":"2026-02-23T06:21:23.158363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:40:07.996281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156943+0000","last_change":"2026-02-23T06:21:18.142135+0000","last_active":"2026-02-23T06:21:23.156943+0000","last_peered":"2026-02-23T06:21:23.156943+0000","last_clean":"2026-02-23T06:21:23.156943+0000","last_became_active":"2026-02-23T06:21:18.141771+0000","last_became_peered":"2026-02-23T06:21:18.141771+0000","last_unstale":"2026-02-23T06:21:23.156943+0000","last_undegraded":"2026-02-23T06:21:23.156943+0000","last_fullsized":"2026-02-23T06:21:23.156943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:10:18.195986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156859+0000","last_change":"2026-02-23T06:21:17.142326+0000","last_active":"2026-02-23T06:21:23.156859+0000","last_peered":"2026-02-23T06:21:23.156859+0000","last_clean":"2026-02-23T06:21:23.156859+0000","last_became_active":"2026-02-23T06:21:17.142203+0000","last_became_peered":"2026-02-23T06:21:17.142203+0000","last_unstale":"2026-02-23T06:21:23.156859+0000","last_undegraded":"2026-02-23T06:21:23.156859+0000","last_fullsized":"2026-02-23T06:21:23.156859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:49:44.262210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156453+0000","last_change":"2026-02-23T06:21:22.168717+0000","last_active":"2026-02-23T06:21:23.156453+0000","last_peered":"2026-02-23T06:21:23.156453+0000","last_clean":"2026-02-23T06:21:23.156453+0000","last_became_active":"2026-02-23T06:21:22.168375+0000","last_became_peered":"2026-02-23T06:21:22.168375+0000","last_unstale":"2026-02-23T06:21:23.156453+0000","last_undegraded":"2026-02-23T06:21:23.156453+0000","last_fullsized":"2026-02-23T06:21:23.156453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:03:53.993581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157404+0000","last_change":"2026-02-23T06:21:18.141908+0000","last_active":"2026-02-23T06:21:23.157404+0000","last_peered":"2026-02-23T06:21:23.157404+0000","last_clean":"2026-02-23T06:21:23.157404+0000","last_became_active":"2026-02-23T06:21:18.141363+0000","last_became_peered":"2026-02-23T06:21:18.141363+0000","last_unstale":"2026-02-23T06:21:23.157404+0000","last_undegraded":"2026-02-23T06:21:23.157404+0000","last_fullsized":"2026-02-23T06:21:23.157404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:06:26.731868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159168+0000","last_change":"2026-02-23T06:21:17.144716+0000","last_active":"2026-02-23T06:21:23.159168+0000","last_peered":"2026-02-23T06:21:23.159168+0000","last_clean":"2026-02-23T06:21:23.159168+0000","last_became_active":"2026-02-23T06:21:17.144515+0000","last_became_peered":"2026-02-23T06:21:17.144515+0000","last_unstale":"2026-02-23T06:21:23.159168+0000","last_undegraded":"2026-02-23T06:21:23.159168+0000","last_fullsized":"2026-02-23T06:21:23.159168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:38:35.014170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157139+0000","last_change":"2026-02-23T06:21:22.171364+0000","last_active":"2026-02-23T06:21:23.157139+0000","last_peered":"2026-02-23T06:21:23.157139+0000","last_clean":"2026-02-23T06:21:23.157139+0000","last_became_active":"2026-02-23T06:21:22.171165+0000","last_became_peered":"2026-02-23T06:21:22.171165+0000","last_unstale":"2026-02-23T06:21:23.157139+0000","last_undegraded":"2026-02-23T06:21:23.157139+0000","last_fullsized":"2026-02-23T06:21:23.157139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:00:42.055334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158796+0000","last_change":"2026-02-23T06:21:18.144182+0000","last_active":"2026-02-23T06:21:23.158796+0000","last_peered":"2026-02-23T06:21:23.158796+0000","last_clean":"2026-02-23T06:21:23.158796+0000","last_became_active":"2026-02-23T06:21:18.143585+0000","last_became_peered":"2026-02-23T06:21:18.143585+0000","last_unstale":"2026-02-23T06:21:23.158796+0000","last_undegraded":"2026-02-23T06:21:23.158796+0000","last_fullsized":"2026-02-23T06:21:23.158796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:07:05.513990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156754+0000","last_change":"2026-02-23T06:21:17.137935+0000","last_active":"2026-02-23T06:21:23.156754+0000","last_peered":"2026-02-23T06:21:23.156754+0000","last_clean":"2026-02-23T06:21:23.156754+0000","last_became_active":"2026-02-23T06:21:17.137386+0000","last_became_peered":"2026-02-23T06:21:17.137386+0000","last_unstale":"2026-02-23T06:21:23.156754+0000","last_undegraded":"2026-02-23T06:21:23.156754+0000","last_fullsized":"2026-02-23T06:21:23.156754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:51:24.646436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157353+0000","last_change":"2026-02-23T06:21:22.163110+0000","last_active":"2026-02-23T06:21:23.157353+0000","last_peered":"2026-02-23T06:21:23.157353+0000","last_clean":"2026-02-23T06:21:23.157353+0000","last_became_active":"2026-02-23T06:21:22.162891+0000","last_became_peered":"2026-02-23T06:21:22.162891+0000","last_unstale":"2026-02-23T06:21:23.157353+0000","last_undegraded":"2026-02-23T06:21:23.157353+0000","last_fullsized":"2026-02-23T06:21:23.157353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:06:23.664613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157998+0000","last_change":"2026-02-23T06:21:18.152606+0000","last_active":"2026-02-23T06:21:23.157998+0000","last_peered":"2026-02-23T06:21:23.157998+0000","last_clean":"2026-02-23T06:21:23.157998+0000","last_became_active":"2026-02-23T06:21:18.152102+0000","last_became_peered":"2026-02-23T06:21:18.152102+0000","last_unstale":"2026-02-23T06:21:23.157998+0000","last_undegraded":"2026-02-23T06:21:23.157998+0000","last_fullsized":"2026-02-23T06:21:23.157998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:59:30.188417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157850+0000","last_change":"2026-02-23T06:21:17.143289+0000","last_active":"2026-02-23T06:21:23.157850+0000","last_peered":"2026-02-23T06:21:23.157850+0000","last_clean":"2026-02-23T06:21:23.157850+0000","last_became_active":"2026-02-23T06:21:17.143201+0000","last_became_peered":"2026-02-23T06:21:17.143201+0000","last_unstale":"2026-02-23T06:21:23.157850+0000","last_undegraded":"2026-02-23T06:21:23.157850+0000","last_fullsized":"2026-02-23T06:21:23.157850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:33:06.892035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157325+0000","last_change":"2026-02-23T06:21:22.163932+0000","last_active":"2026-02-23T06:21:23.157325+0000","last_peered":"2026-02-23T06:21:23.157325+0000","last_clean":"2026-02-23T06:21:23.157325+0000","last_became_active":"2026-02-23T06:21:22.163734+0000","last_became_peered":"2026-02-23T06:21:22.163734+0000","last_unstale":"2026-02-23T06:21:23.157325+0000","last_undegraded":"2026-02-23T06:21:23.157325+0000","last_fullsized":"2026-02-23T06:21:23.157325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:44:47.208608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156436+0000","last_change":"2026-02-23T06:21:18.141664+0000","last_active":"2026-02-23T06:21:23.156436+0000","last_peered":"2026-02-23T06:21:23.156436+0000","last_clean":"2026-02-23T06:21:23.156436+0000","last_became_active":"2026-02-23T06:21:18.141350+0000","last_became_peered":"2026-02-23T06:21:18.141350+0000","last_unstale":"2026-02-23T06:21:23.156436+0000","last_undegraded":"2026-02-23T06:21:23.156436+0000","last_fullsized":"2026-02-23T06:21:23.156436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:01:50.434732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156433+0000","last_change":"2026-02-23T06:21:17.139311+0000","last_active":"2026-02-23T06:21:23.156433+0000","last_peered":"2026-02-23T06:21:23.156433+0000","last_clean":"2026-02-23T06:21:23.156433+0000","last_became_active":"2026-02-23T06:21:17.139200+0000","last_became_peered":"2026-02-23T06:21:17.139200+0000","last_unstale":"2026-02-23T06:21:23.156433+0000","last_undegraded":"2026-02-23T06:21:23.156433+0000","last_fullsized":"2026-02-23T06:21:23.156433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:52:23.863807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157449+0000","last_change":"2026-02-23T06:21:22.164793+0000","last_active":"2026-02-23T06:21:23.157449+0000","last_peered":"2026-02-23T06:21:23.157449+0000","last_clean":"2026-02-23T06:21:23.157449+0000","last_became_active":"2026-02-23T06:21:22.164667+0000","last_became_peered":"2026-02-23T06:21:22.164667+0000","last_unstale":"2026-02-23T06:21:23.157449+0000","last_undegraded":"2026-02-23T06:21:23.157449+0000","last_fullsized":"2026-02-23T06:21:23.157449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:36:39.520044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156948+0000","last_change":"2026-02-23T06:21:18.146624+0000","last_active":"2026-02-23T06:21:23.156948+0000","last_peered":"2026-02-23T06:21:23.156948+0000","last_clean":"2026-02-23T06:21:23.156948+0000","last_became_active":"2026-02-23T06:21:18.146491+0000","last_became_peered":"2026-02-23T06:21:18.146491+0000","last_unstale":"2026-02-23T06:21:23.156948+0000","last_undegraded":"2026-02-23T06:21:23.156948+0000","last_fullsized":"2026-02-23T06:21:23.156948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:11:23.574241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157493+0000","last_change":"2026-02-23T06:21:17.143128+0000","last_active":"2026-02-23T06:21:23.157493+0000","last_peered":"2026-02-23T06:21:23.157493+0000","last_clean":"2026-02-23T06:21:23.157493+0000","last_became_active":"2026-02-23T06:21:17.143050+0000","last_became_peered":"2026-02-23T06:21:17.143050+0000","last_unstale":"2026-02-23T06:21:23.157493+0000","last_undegraded":"2026-02-23T06:21:23.157493+0000","last_fullsized":"2026-02-23T06:21:23.157493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:15.628487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156942+0000","last_change":"2026-02-23T06:21:22.168755+0000","last_active":"2026-02-23T06:21:23.156942+0000","last_peered":"2026-02-23T06:21:23.156942+0000","last_clean":"2026-02-23T06:21:23.156942+0000","last_became_active":"2026-02-23T06:21:22.168510+0000","last_became_peered":"2026-02-23T06:21:22.168510+0000","last_unstale":"2026-02-23T06:21:23.156942+0000","last_undegraded":"2026-02-23T06:21:23.156942+0000","last_fullsized":"2026-02-23T06:21:23.156942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:19:06.716318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156576+0000","last_change":"2026-02-23T06:21:18.145397+0000","last_active":"2026-02-23T06:21:23.156576+0000","last_peered":"2026-02-23T06:21:23.156576+0000","last_clean":"2026-02-23T06:21:23.156576+0000","last_became_active":"2026-02-23T06:21:18.145214+0000","last_became_peered":"2026-02-23T06:21:18.145214+0000","last_unstale":"2026-02-23T06:21:23.156576+0000","last_undegraded":"2026-02-23T06:21:23.156576+0000","last_fullsized":"2026-02-23T06:21:23.156576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:33:41.870582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158977+0000","last_change":"2026-02-23T06:21:17.147696+0000","last_active":"2026-02-23T06:21:23.158977+0000","last_peered":"2026-02-23T06:21:23.158977+0000","last_clean":"2026-02-23T06:21:23.158977+0000","last_became_active":"2026-02-23T06:21:17.147619+0000","last_became_peered":"2026-02-23T06:21:17.147619+0000","last_unstale":"2026-02-23T06:21:23.158977+0000","last_undegraded":"2026-02-23T06:21:23.158977+0000","last_fullsized":"2026-02-23T06:21:23.158977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:49:09.070245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'112","reported_seq":164,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157640+0000","last_change":"2026-02-23T06:21:11.397748+0000","last_active":"2026-02-23T06:21:23.157640+0000","last_peered":"2026-02-23T06:21:23.157640+0000","last_clean":"2026-02-23T06:21:23.157640+0000","last_became_active":"2026-02-23T06:21:11.397664+0000","last_became_peered":"2026-02-23T06:21:11.397664+0000","last_unstale":"2026-02-23T06:21:23.157640+0000","last_undegraded":"2026-02-23T06:21:23.157640+0000","last_fullsized":"2026-02-23T06:21:23.157640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:10.392316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:10.392316+0000","last_clean_scrub_stamp":"2026-02-23T06:21:10.392316+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:43.157572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159148+0000","last_change":"2026-02-23T06:21:22.174696+0000","last_active":"2026-02-23T06:21:23.159148+0000","last_peered":"2026-02-23T06:21:23.159148+0000","last_clean":"2026-02-23T06:21:23.159148+0000","last_became_active":"2026-02-23T06:21:22.174253+0000","last_became_peered":"2026-02-23T06:21:22.174253+0000","last_unstale":"2026-02-23T06:21:23.159148+0000","last_undegraded":"2026-02-23T06:21:23.159148+0000","last_fullsized":"2026-02-23T06:21:23.159148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:28.487343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159093+0000","last_change":"2026-02-23T06:21:18.150652+0000","last_active":"2026-02-23T06:21:23.159093+0000","last_peered":"2026-02-23T06:21:23.159093+0000","last_clean":"2026-02-23T06:21:23.159093+0000","last_became_active":"2026-02-23T06:21:18.150501+0000","last_became_peered":"2026-02-23T06:21:18.150501+0000","last_unstale":"2026-02-23T06:21:23.159093+0000","last_undegraded":"2026-02-23T06:21:23.159093+0000","last_fullsized":"2026-02-23T06:21:23.159093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:34:20.113034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157473+0000","last_change":"2026-02-23T06:21:17.146074+0000","last_active":"2026-02-23T06:21:23.157473+0000","last_peered":"2026-02-23T06:21:23.157473+0000","last_clean":"2026-02-23T06:21:23.157473+0000","last_became_active":"2026-02-23T06:21:17.145938+0000","last_became_peered":"2026-02-23T06:21:17.145938+0000","last_unstale":"2026-02-23T06:21:23.157473+0000","last_undegraded":"2026-02-23T06:21:23.157473+0000","last_fullsized":"2026-02-23T06:21:23.157473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:41:42.571718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158551+0000","last_change":"2026-02-23T06:21:22.172266+0000","last_active":"2026-02-23T06:21:23.158551+0000","last_peered":"2026-02-23T06:21:23.158551+0000","last_clean":"2026-02-23T06:21:23.158551+0000","last_became_active":"2026-02-23T06:21:22.171828+0000","last_became_peered":"2026-02-23T06:21:22.171828+0000","last_unstale":"2026-02-23T06:21:23.158551+0000","last_undegraded":"2026-02-23T06:21:23.158551+0000","last_fullsized":"2026-02-23T06:21:23.158551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:34:06.583640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158339+0000","last_change":"2026-02-23T06:21:18.147056+0000","last_active":"2026-02-23T06:21:23.158339+0000","last_peered":"2026-02-23T06:21:23.158339+0000","last_clean":"2026-02-23T06:21:23.158339+0000","last_became_active":"2026-02-23T06:21:18.146977+0000","last_became_peered":"2026-02-23T06:21:18.146977+0000","last_unstale":"2026-02-23T06:21:23.158339+0000","last_undegraded":"2026-02-23T06:21:23.158339+0000","last_fullsized":"2026-02-23T06:21:23.158339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:02:14.013207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156871+0000","last_change":"2026-02-23T06:21:17.139417+0000","last_active":"2026-02-23T06:21:23.156871+0000","last_peered":"2026-02-23T06:21:23.156871+0000","last_clean":"2026-02-23T06:21:23.156871+0000","last_became_active":"2026-02-23T06:21:17.139209+0000","last_became_peered":"2026-02-23T06:21:17.139209+0000","last_unstale":"2026-02-23T06:21:23.156871+0000","last_undegraded":"2026-02-23T06:21:23.156871+0000","last_fullsized":"2026-02-23T06:21:23.156871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:02:19.925669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156792+0000","last_change":"2026-02-23T06:21:22.162912+0000","last_active":"2026-02-23T06:21:23.156792+0000","last_peered":"2026-02-23T06:21:23.156792+0000","last_clean":"2026-02-23T06:21:23.156792+0000","last_became_active":"2026-02-23T06:21:22.162777+0000","last_became_peered":"2026-02-23T06:21:22.162777+0000","last_unstale":"2026-02-23T06:21:23.156792+0000","last_undegraded":"2026-02-23T06:21:23.156792+0000","last_fullsized":"2026-02-23T06:21:23.156792+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:40:10.012263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158597+0000","last_change":"2026-02-23T06:21:18.149281+0000","last_active":"2026-02-23T06:21:23.158597+0000","last_peered":"2026-02-23T06:21:23.158597+0000","last_clean":"2026-02-23T06:21:23.158597+0000","last_became_active":"2026-02-23T06:21:18.149038+0000","last_became_peered":"2026-02-23T06:21:18.149038+0000","last_unstale":"2026-02-23T06:21:23.158597+0000","last_undegraded":"2026-02-23T06:21:23.158597+0000","last_fullsized":"2026-02-23T06:21:23.158597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:57:13.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156819+0000","last_change":"2026-02-23T06:21:17.137649+0000","last_active":"2026-02-23T06:21:23.156819+0000","last_peered":"2026-02-23T06:21:23.156819+0000","last_clean":"2026-02-23T06:21:23.156819+0000","last_became_active":"2026-02-23T06:21:17.137476+0000","last_became_peered":"2026-02-23T06:21:17.137476+0000","last_unstale":"2026-02-23T06:21:23.156819+0000","last_undegraded":"2026-02-23T06:21:23.156819+0000","last_fullsized":"2026-02-23T06:21:23.156819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:47:43.648999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157315+0000","last_change":"2026-02-23T06:21:22.174081+0000","last_active":"2026-02-23T06:21:23.157315+0000","last_peered":"2026-02-23T06:21:23.157315+0000","last_clean":"2026-02-23T06:21:23.157315+0000","last_became_active":"2026-02-23T06:21:22.173501+0000","last_became_peered":"2026-02-23T06:21:22.173501+0000","last_unstale":"2026-02-23T06:21:23.157315+0000","last_undegraded":"2026-02-23T06:21:23.157315+0000","last_fullsized":"2026-02-23T06:21:23.157315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:29:42.370894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159159+0000","last_change":"2026-02-23T06:21:18.155183+0000","last_active":"2026-02-23T06:21:23.159159+0000","last_peered":"2026-02-23T06:21:23.159159+0000","last_clean":"2026-02-23T06:21:23.159159+0000","last_became_active":"2026-02-23T06:21:18.154271+0000","last_became_peered":"2026-02-23T06:21:18.154271+0000","last_unstale":"2026-02-23T06:21:23.159159+0000","last_undegraded":"2026-02-23T06:21:23.159159+0000","last_fullsized":"2026-02-23T06:21:23.159159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:34:53.495073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158641+0000","last_change":"2026-02-23T06:21:17.144988+0000","last_active":"2026-02-23T06:21:23.158641+0000","last_peered":"2026-02-23T06:21:23.158641+0000","last_clean":"2026-02-23T06:21:23.158641+0000","last_became_active":"2026-02-23T06:21:17.144914+0000","last_became_peered":"2026-02-23T06:21:17.144914+0000","last_unstale":"2026-02-23T06:21:23.158641+0000","last_undegraded":"2026-02-23T06:21:23.158641+0000","last_fullsized":"2026-02-23T06:21:23.158641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:20:30.802189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157321+0000","last_change":"2026-02-23T06:21:22.169035+0000","last_active":"2026-02-23T06:21:23.157321+0000","last_peered":"2026-02-23T06:21:23.157321+0000","last_clean":"2026-02-23T06:21:23.157321+0000","last_became_active":"2026-02-23T06:21:22.168516+0000","last_became_peered":"2026-02-23T06:21:22.168516+0000","last_unstale":"2026-02-23T06:21:23.157321+0000","last_undegraded":"2026-02-23T06:21:23.157321+0000","last_fullsized":"2026-02-23T06:21:23.157321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:53:53.761208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157305+0000","last_change":"2026-02-23T06:21:18.152543+0000","last_active":"2026-02-23T06:21:23.157305+0000","last_peered":"2026-02-23T06:21:23.157305+0000","last_clean":"2026-02-23T06:21:23.157305+0000","last_became_active":"2026-02-23T06:21:18.152381+0000","last_became_peered":"2026-02-23T06:21:18.152381+0000","last_unstale":"2026-02-23T06:21:23.157305+0000","last_undegraded":"2026-02-23T06:21:23.157305+0000","last_fullsized":"2026-02-23T06:21:23.157305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:20:11.159653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156443+0000","last_change":"2026-02-23T06:21:17.137277+0000","last_active":"2026-02-23T06:21:23.156443+0000","last_peered":"2026-02-23T06:21:23.156443+0000","last_clean":"2026-02-23T06:21:23.156443+0000","last_became_active":"2026-02-23T06:21:17.137101+0000","last_became_peered":"2026-02-23T06:21:17.137101+0000","last_unstale":"2026-02-23T06:21:23.156443+0000","last_undegraded":"2026-02-23T06:21:23.156443+0000","last_fullsized":"2026-02-23T06:21:23.156443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:26:19.732037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157108+0000","last_change":"2026-02-23T06:21:22.168965+0000","last_active":"2026-02-23T06:21:23.157108+0000","last_peered":"2026-02-23T06:21:23.157108+0000","last_clean":"2026-02-23T06:21:23.157108+0000","last_became_active":"2026-02-23T06:21:22.168603+0000","last_became_peered":"2026-02-23T06:21:22.168603+0000","last_unstale":"2026-02-23T06:21:23.157108+0000","last_undegraded":"2026-02-23T06:21:23.157108+0000","last_fullsized":"2026-02-23T06:21:23.157108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:15:47.100236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157608+0000","last_change":"2026-02-23T06:21:18.143842+0000","last_active":"2026-02-23T06:21:23.157608+0000","last_peered":"2026-02-23T06:21:23.157608+0000","last_clean":"2026-02-23T06:21:23.157608+0000","last_became_active":"2026-02-23T06:21:18.143002+0000","last_became_peered":"2026-02-23T06:21:18.143002+0000","last_unstale":"2026-02-23T06:21:23.157608+0000","last_undegraded":"2026-02-23T06:21:23.157608+0000","last_fullsized":"2026-02-23T06:21:23.157608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:04:36.461970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157835+0000","last_change":"2026-02-23T06:21:17.143842+0000","last_active":"2026-02-23T06:21:23.157835+0000","last_peered":"2026-02-23T06:21:23.157835+0000","last_clean":"2026-02-23T06:21:23.157835+0000","last_became_active":"2026-02-23T06:21:17.143700+0000","last_became_peered":"2026-02-23T06:21:17.143700+0000","last_unstale":"2026-02-23T06:21:23.157835+0000","last_undegraded":"2026-02-23T06:21:23.157835+0000","last_fullsized":"2026-02-23T06:21:23.157835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:14:07.166043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157290+0000","last_change":"2026-02-23T06:21:22.168834+0000","last_active":"2026-02-23T06:21:23.157290+0000","last_peered":"2026-02-23T06:21:23.157290+0000","last_clean":"2026-02-23T06:21:23.157290+0000","last_became_active":"2026-02-23T06:21:22.168593+0000","last_became_peered":"2026-02-23T06:21:22.168593+0000","last_unstale":"2026-02-23T06:21:23.157290+0000","last_undegraded":"2026-02-23T06:21:23.157290+0000","last_fullsized":"2026-02-23T06:21:23.157290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:15:01.999978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157649+0000","last_change":"2026-02-23T06:21:18.155135+0000","last_active":"2026-02-23T06:21:23.157649+0000","last_peered":"2026-02-23T06:21:23.157649+0000","last_clean":"2026-02-23T06:21:23.157649+0000","last_became_active":"2026-02-23T06:21:18.155022+0000","last_became_peered":"2026-02-23T06:21:18.155022+0000","last_unstale":"2026-02-23T06:21:23.157649+0000","last_undegraded":"2026-02-23T06:21:23.157649+0000","last_fullsized":"2026-02-23T06:21:23.157649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:50.396096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157857+0000","last_change":"2026-02-23T06:21:17.144113+0000","last_active":"2026-02-23T06:21:23.157857+0000","last_peered":"2026-02-23T06:21:23.157857+0000","last_clean":"2026-02-23T06:21:23.157857+0000","last_became_active":"2026-02-23T06:21:17.144052+0000","last_became_peered":"2026-02-23T06:21:17.144052+0000","last_unstale":"2026-02-23T06:21:23.157857+0000","last_undegraded":"2026-02-23T06:21:23.157857+0000","last_fullsized":"2026-02-23T06:21:23.157857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:52:50.479411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157276+0000","last_change":"2026-02-23T06:21:22.163712+0000","last_active":"2026-02-23T06:21:23.157276+0000","last_peered":"2026-02-23T06:21:23.157276+0000","last_clean":"2026-02-23T06:21:23.157276+0000","last_became_active":"2026-02-23T06:21:22.163563+0000","last_became_peered":"2026-02-23T06:21:22.163563+0000","last_unstale":"2026-02-23T06:21:23.157276+0000","last_undegraded":"2026-02-23T06:21:23.157276+0000","last_fullsized":"2026-02-23T06:21:23.157276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:58:44.301443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157241+0000","last_change":"2026-02-23T06:21:18.152736+0000","last_active":"2026-02-23T06:21:23.157241+0000","last_peered":"2026-02-23T06:21:23.157241+0000","last_clean":"2026-02-23T06:21:23.157241+0000","last_became_active":"2026-02-23T06:21:18.152627+0000","last_became_peered":"2026-02-23T06:21:18.152627+0000","last_unstale":"2026-02-23T06:21:23.157241+0000","last_undegraded":"2026-02-23T06:21:23.157241+0000","last_fullsized":"2026-02-23T06:21:23.157241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:26:04.233805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156590+0000","last_change":"2026-02-23T06:21:17.144924+0000","last_active":"2026-02-23T06:21:23.156590+0000","last_peered":"2026-02-23T06:21:23.156590+0000","last_clean":"2026-02-23T06:21:23.156590+0000","last_became_active":"2026-02-23T06:21:17.144847+0000","last_became_peered":"2026-02-23T06:21:17.144847+0000","last_unstale":"2026-02-23T06:21:23.156590+0000","last_undegraded":"2026-02-23T06:21:23.156590+0000","last_fullsized":"2026-02-23T06:21:23.156590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:09:16.703922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159051+0000","last_change":"2026-02-23T06:21:22.164167+0000","last_active":"2026-02-23T06:21:23.159051+0000","last_peered":"2026-02-23T06:21:23.159051+0000","last_clean":"2026-02-23T06:21:23.159051+0000","last_became_active":"2026-02-23T06:21:22.164057+0000","last_became_peered":"2026-02-23T06:21:22.164057+0000","last_unstale":"2026-02-23T06:21:23.159051+0000","last_undegraded":"2026-02-23T06:21:23.159051+0000","last_fullsized":"2026-02-23T06:21:23.159051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:19:45.888728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158866+0000","last_change":"2026-02-23T06:21:18.148382+0000","last_active":"2026-02-23T06:21:23.158866+0000","last_peered":"2026-02-23T06:21:23.158866+0000","last_clean":"2026-02-23T06:21:23.158866+0000","last_became_active":"2026-02-23T06:21:18.147826+0000","last_became_peered":"2026-02-23T06:21:18.147826+0000","last_unstale":"2026-02-23T06:21:23.158866+0000","last_undegraded":"2026-02-23T06:21:23.158866+0000","last_fullsized":"2026-02-23T06:21:23.158866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:52:32.524186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:30.992346+0000","last_change":"2026-02-23T06:21:17.151131+0000","last_active":"2026-02-23T06:21:30.992346+0000","last_peered":"2026-02-23T06:21:30.992346+0000","last_clean":"2026-02-23T06:21:30.992346+0000","last_became_active":"2026-02-23T06:21:17.151030+0000","last_became_peered":"2026-02-23T06:21:17.151030+0000","last_unstale":"2026-02-23T06:21:30.992346+0000","last_undegraded":"2026-02-23T06:21:30.992346+0000","last_fullsized":"2026-02-23T06:21:30.992346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:19:57.049773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3927,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156776+0000","last_change":"2026-02-23T06:21:22.165171+0000","last_active":"2026-02-23T06:21:23.156776+0000","last_peered":"2026-02-23T06:21:23.156776+0000","last_clean":"2026-02-23T06:21:23.156776+0000","last_became_active":"2026-02-23T06:21:22.164972+0000","last_became_peered":"2026-02-23T06:21:22.164972+0000","last_unstale":"2026-02-23T06:21:23.156776+0000","last_undegraded":"2026-02-23T06:21:23.156776+0000","last_fullsized":"2026-02-23T06:21:23.156776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:58:26.519641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157682+0000","last_change":"2026-02-23T06:21:18.153296+0000","last_active":"2026-02-23T06:21:23.157682+0000","last_peered":"2026-02-23T06:21:23.157682+0000","last_clean":"2026-02-23T06:21:23.157682+0000","last_became_active":"2026-02-23T06:21:18.153052+0000","last_became_peered":"2026-02-23T06:21:18.153052+0000","last_unstale":"2026-02-23T06:21:23.157682+0000","last_undegraded":"2026-02-23T06:21:23.157682+0000","last_fullsized":"2026-02-23T06:21:23.157682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:38:32.662334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156686+0000","last_change":"2026-02-23T06:21:17.137568+0000","last_active":"2026-02-23T06:21:23.156686+0000","last_peered":"2026-02-23T06:21:23.156686+0000","last_clean":"2026-02-23T06:21:23.156686+0000","last_became_active":"2026-02-23T06:21:17.137479+0000","last_became_peered":"2026-02-23T06:21:17.137479+0000","last_unstale":"2026-02-23T06:21:23.156686+0000","last_undegraded":"2026-02-23T06:21:23.156686+0000","last_fullsized":"2026-02-23T06:21:23.156686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:50:22.850887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158615+0000","last_change":"2026-02-23T06:21:22.175837+0000","last_active":"2026-02-23T06:21:23.158615+0000","last_peered":"2026-02-23T06:21:23.158615+0000","last_clean":"2026-02-23T06:21:23.158615+0000","last_became_active":"2026-02-23T06:21:22.175638+0000","last_became_peered":"2026-02-23T06:21:22.175638+0000","last_unstale":"2026-02-23T06:21:23.158615+0000","last_undegraded":"2026-02-23T06:21:23.158615+0000","last_fullsized":"2026-02-23T06:21:23.158615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:24:39.312650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157339+0000","last_change":"2026-02-23T06:21:18.155473+0000","last_active":"2026-02-23T06:21:23.157339+0000","last_peered":"2026-02-23T06:21:23.157339+0000","last_clean":"2026-02-23T06:21:23.157339+0000","last_became_active":"2026-02-23T06:21:18.155349+0000","last_became_peered":"2026-02-23T06:21:18.155349+0000","last_unstale":"2026-02-23T06:21:23.157339+0000","last_undegraded":"2026-02-23T06:21:23.157339+0000","last_fullsized":"2026-02-23T06:21:23.157339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:20:20.345986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158459+0000","last_change":"2026-02-23T06:21:17.148953+0000","last_active":"2026-02-23T06:21:23.158459+0000","last_peered":"2026-02-23T06:21:23.158459+0000","last_clean":"2026-02-23T06:21:23.158459+0000","last_became_active":"2026-02-23T06:21:17.148841+0000","last_became_peered":"2026-02-23T06:21:17.148841+0000","last_unstale":"2026-02-23T06:21:23.158459+0000","last_undegraded":"2026-02-23T06:21:23.158459+0000","last_fullsized":"2026-02-23T06:21:23.158459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:48:14.620108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156366+0000","last_change":"2026-02-23T06:21:22.172897+0000","last_active":"2026-02-23T06:21:23.156366+0000","last_peered":"2026-02-23T06:21:23.156366+0000","last_clean":"2026-02-23T06:21:23.156366+0000","last_became_active":"2026-02-23T06:21:22.172683+0000","last_became_peered":"2026-02-23T06:21:22.172683+0000","last_unstale":"2026-02-23T06:21:23.156366+0000","last_undegraded":"2026-02-23T06:21:23.156366+0000","last_fullsized":"2026-02-23T06:21:23.156366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:17:41.991286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159118+0000","last_change":"2026-02-23T06:21:18.154897+0000","last_active":"2026-02-23T06:21:23.159118+0000","last_peered":"2026-02-23T06:21:23.159118+0000","last_clean":"2026-02-23T06:21:23.159118+0000","last_became_active":"2026-02-23T06:21:18.154586+0000","last_became_peered":"2026-02-23T06:21:18.154586+0000","last_unstale":"2026-02-23T06:21:23.159118+0000","last_undegraded":"2026-02-23T06:21:23.159118+0000","last_fullsized":"2026-02-23T06:21:23.159118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:22:13.361673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158486+0000","last_change":"2026-02-23T06:21:17.140774+0000","last_active":"2026-02-23T06:21:23.158486+0000","last_peered":"2026-02-23T06:21:23.158486+0000","last_clean":"2026-02-23T06:21:23.158486+0000","last_became_active":"2026-02-23T06:21:17.140699+0000","last_became_peered":"2026-02-23T06:21:17.140699+0000","last_unstale":"2026-02-23T06:21:23.158486+0000","last_undegraded":"2026-02-23T06:21:23.158486+0000","last_fullsized":"2026-02-23T06:21:23.158486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:59:47.987932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156705+0000","last_change":"2026-02-23T06:21:22.166371+0000","last_active":"2026-02-23T06:21:23.156705+0000","last_peered":"2026-02-23T06:21:23.156705+0000","last_clean":"2026-02-23T06:21:23.156705+0000","last_became_active":"2026-02-23T06:21:22.166204+0000","last_became_peered":"2026-02-23T06:21:22.166204+0000","last_unstale":"2026-02-23T06:21:23.156705+0000","last_undegraded":"2026-02-23T06:21:23.156705+0000","last_fullsized":"2026-02-23T06:21:23.156705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:50:51.116428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156852+0000","last_change":"2026-02-23T06:21:22.167411+0000","last_active":"2026-02-23T06:21:23.156852+0000","last_peered":"2026-02-23T06:21:23.156852+0000","last_clean":"2026-02-23T06:21:23.156852+0000","last_became_active":"2026-02-23T06:21:22.167217+0000","last_became_peered":"2026-02-23T06:21:22.167217+0000","last_unstale":"2026-02-23T06:21:23.156852+0000","last_undegraded":"2026-02-23T06:21:23.156852+0000","last_fullsized":"2026-02-23T06:21:23.156852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:20:54.687551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156512+0000","last_change":"2026-02-23T06:21:18.146043+0000","last_active":"2026-02-23T06:21:23.156512+0000","last_peered":"2026-02-23T06:21:23.156512+0000","last_clean":"2026-02-23T06:21:23.156512+0000","last_became_active":"2026-02-23T06:21:18.145938+0000","last_became_peered":"2026-02-23T06:21:18.145938+0000","last_unstale":"2026-02-23T06:21:23.156512+0000","last_undegraded":"2026-02-23T06:21:23.156512+0000","last_fullsized":"2026-02-23T06:21:23.156512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:03:21.252772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157446+0000","last_change":"2026-02-23T06:21:17.149581+0000","last_active":"2026-02-23T06:21:23.157446+0000","last_peered":"2026-02-23T06:21:23.157446+0000","last_clean":"2026-02-23T06:21:23.157446+0000","last_became_active":"2026-02-23T06:21:17.149490+0000","last_became_peered":"2026-02-23T06:21:17.149490+0000","last_unstale":"2026-02-23T06:21:23.157446+0000","last_undegraded":"2026-02-23T06:21:23.157446+0000","last_fullsized":"2026-02-23T06:21:23.157446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:18:42.211307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158840+0000","last_change":"2026-02-23T06:21:22.175655+0000","last_active":"2026-02-23T06:21:23.158840+0000","last_peered":"2026-02-23T06:21:23.158840+0000","last_clean":"2026-02-23T06:21:23.158840+0000","last_became_active":"2026-02-23T06:21:22.174906+0000","last_became_peered":"2026-02-23T06:21:22.174906+0000","last_unstale":"2026-02-23T06:21:23.158840+0000","last_undegraded":"2026-02-23T06:21:23.158840+0000","last_fullsized":"2026-02-23T06:21:23.158840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:50:34.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156556+0000","last_change":"2026-02-23T06:21:18.142560+0000","last_active":"2026-02-23T06:21:23.156556+0000","last_peered":"2026-02-23T06:21:23.156556+0000","last_clean":"2026-02-23T06:21:23.156556+0000","last_became_active":"2026-02-23T06:21:18.142325+0000","last_became_peered":"2026-02-23T06:21:18.142325+0000","last_unstale":"2026-02-23T06:21:23.156556+0000","last_undegraded":"2026-02-23T06:21:23.156556+0000","last_fullsized":"2026-02-23T06:21:23.156556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:45:44.641652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156988+0000","last_change":"2026-02-23T06:21:17.146195+0000","last_active":"2026-02-23T06:21:23.156988+0000","last_peered":"2026-02-23T06:21:23.156988+0000","last_clean":"2026-02-23T06:21:23.156988+0000","last_became_active":"2026-02-23T06:21:17.146022+0000","last_became_peered":"2026-02-23T06:21:17.146022+0000","last_unstale":"2026-02-23T06:21:23.156988+0000","last_undegraded":"2026-02-23T06:21:23.156988+0000","last_fullsized":"2026-02-23T06:21:23.156988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:34:32.822540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157689+0000","last_change":"2026-02-23T06:21:17.148590+0000","last_active":"2026-02-23T06:21:23.157689+0000","last_peered":"2026-02-23T06:21:23.157689+0000","last_clean":"2026-02-23T06:21:23.157689+0000","last_became_active":"2026-02-23T06:21:17.148417+0000","last_became_peered":"2026-02-23T06:21:17.148417+0000","last_unstale":"2026-02-23T06:21:23.157689+0000","last_undegraded":"2026-02-23T06:21:23.157689+0000","last_fullsized":"2026-02-23T06:21:23.157689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:21:11.877590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156606+0000","last_change":"2026-02-23T06:21:18.152383+0000","last_active":"2026-02-23T06:21:23.156606+0000","last_peered":"2026-02-23T06:21:23.156606+0000","last_clean":"2026-02-23T06:21:23.156606+0000","last_became_active":"2026-02-23T06:21:18.152267+0000","last_became_peered":"2026-02-23T06:21:18.152267+0000","last_unstale":"2026-02-23T06:21:23.156606+0000","last_undegraded":"2026-02-23T06:21:23.156606+0000","last_fullsized":"2026-02-23T06:21:23.156606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:34:11.558509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156801+0000","last_change":"2026-02-23T06:21:22.158812+0000","last_active":"2026-02-23T06:21:23.156801+0000","last_peered":"2026-02-23T06:21:23.156801+0000","last_clean":"2026-02-23T06:21:23.156801+0000","last_became_active":"2026-02-23T06:21:22.158607+0000","last_became_peered":"2026-02-23T06:21:22.158607+0000","last_unstale":"2026-02-23T06:21:23.156801+0000","last_undegraded":"2026-02-23T06:21:23.156801+0000","last_fullsized":"2026-02-23T06:21:23.156801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:59:07.000053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156780+0000","last_change":"2026-02-23T06:21:17.138744+0000","last_active":"2026-02-23T06:21:23.156780+0000","last_peered":"2026-02-23T06:21:23.156780+0000","last_clean":"2026-02-23T06:21:23.156780+0000","last_became_active":"2026-02-23T06:21:17.138245+0000","last_became_peered":"2026-02-23T06:21:17.138245+0000","last_unstale":"2026-02-23T06:21:23.156780+0000","last_undegraded":"2026-02-23T06:21:23.156780+0000","last_fullsized":"2026-02-23T06:21:23.156780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:08:03.143401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157483+0000","last_change":"2026-02-23T06:21:18.143640+0000","last_active":"2026-02-23T06:21:23.157483+0000","last_peered":"2026-02-23T06:21:23.157483+0000","last_clean":"2026-02-23T06:21:23.157483+0000","last_became_active":"2026-02-23T06:21:18.143550+0000","last_became_peered":"2026-02-23T06:21:18.143550+0000","last_unstale":"2026-02-23T06:21:23.157483+0000","last_undegraded":"2026-02-23T06:21:23.157483+0000","last_fullsized":"2026-02-23T06:21:23.157483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:11:40.394042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156644+0000","last_change":"2026-02-23T06:21:22.169641+0000","last_active":"2026-02-23T06:21:23.156644+0000","last_peered":"2026-02-23T06:21:23.156644+0000","last_clean":"2026-02-23T06:21:23.156644+0000","last_became_active":"2026-02-23T06:21:22.169432+0000","last_became_peered":"2026-02-23T06:21:22.169432+0000","last_unstale":"2026-02-23T06:21:23.156644+0000","last_undegraded":"2026-02-23T06:21:23.156644+0000","last_fullsized":"2026-02-23T06:21:23.156644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:00:17.622113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158222+0000","last_change":"2026-02-23T06:21:18.143781+0000","last_active":"2026-02-23T06:21:23.158222+0000","last_peered":"2026-02-23T06:21:23.158222+0000","last_clean":"2026-02-23T06:21:23.158222+0000","last_became_active":"2026-02-23T06:21:18.143724+0000","last_became_peered":"2026-02-23T06:21:18.143724+0000","last_unstale":"2026-02-23T06:21:23.158222+0000","last_undegraded":"2026-02-23T06:21:23.158222+0000","last_fullsized":"2026-02-23T06:21:23.158222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:25:55.416021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156366+0000","last_change":"2026-02-23T06:21:18.145425+0000","last_active":"2026-02-23T06:21:23.156366+0000","last_peered":"2026-02-23T06:21:23.156366+0000","last_clean":"2026-02-23T06:21:23.156366+0000","last_became_active":"2026-02-23T06:21:18.145325+0000","last_became_peered":"2026-02-23T06:21:18.145325+0000","last_unstale":"2026-02-23T06:21:23.156366+0000","last_undegraded":"2026-02-23T06:21:23.156366+0000","last_fullsized":"2026-02-23T06:21:23.156366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:55:31.700518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157544+0000","last_change":"2026-02-23T06:21:18.150997+0000","last_active":"2026-02-23T06:21:23.157544+0000","last_peered":"2026-02-23T06:21:23.157544+0000","last_clean":"2026-02-23T06:21:23.157544+0000","last_became_active":"2026-02-23T06:21:18.150738+0000","last_became_peered":"2026-02-23T06:21:18.150738+0000","last_unstale":"2026-02-23T06:21:23.157544+0000","last_undegraded":"2026-02-23T06:21:23.157544+0000","last_fullsized":"2026-02-23T06:21:23.157544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:11:13.400669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156727+0000","last_change":"2026-02-23T06:21:18.142305+0000","last_active":"2026-02-23T06:21:23.156727+0000","last_peered":"2026-02-23T06:21:23.156727+0000","last_clean":"2026-02-23T06:21:23.156727+0000","last_became_active":"2026-02-23T06:21:18.141484+0000","last_became_peered":"2026-02-23T06:21:18.141484+0000","last_unstale":"2026-02-23T06:21:23.156727+0000","last_undegraded":"2026-02-23T06:21:23.156727+0000","last_fullsized":"2026-02-23T06:21:23.156727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:12:36.003405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157376+0000","last_change":"2026-02-23T06:21:18.148610+0000","last_active":"2026-02-23T06:21:23.157376+0000","last_peered":"2026-02-23T06:21:23.157376+0000","last_clean":"2026-02-23T06:21:23.157376+0000","last_became_active":"2026-02-23T06:21:18.148489+0000","last_became_peered":"2026-02-23T06:21:18.148489+0000","last_unstale":"2026-02-23T06:21:23.157376+0000","last_undegraded":"2026-02-23T06:21:23.157376+0000","last_fullsized":"2026-02-23T06:21:23.157376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:36:29.486147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157279+0000","last_change":"2026-02-23T06:21:18.142438+0000","last_active":"2026-02-23T06:21:23.157279+0000","last_peered":"2026-02-23T06:21:23.157279+0000","last_clean":"2026-02-23T06:21:23.157279+0000","last_became_active":"2026-02-23T06:21:18.141854+0000","last_became_peered":"2026-02-23T06:21:18.141854+0000","last_unstale":"2026-02-23T06:21:23.157279+0000","last_undegraded":"2026-02-23T06:21:23.157279+0000","last_fullsized":"2026-02-23T06:21:23.157279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:23:35.379462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159075+0000","last_change":"2026-02-23T06:21:18.153825+0000","last_active":"2026-02-23T06:21:23.159075+0000","last_peered":"2026-02-23T06:21:23.159075+0000","last_clean":"2026-02-23T06:21:23.159075+0000","last_became_active":"2026-02-23T06:21:18.153133+0000","last_became_peered":"2026-02-23T06:21:18.153133+0000","last_unstale":"2026-02-23T06:21:23.159075+0000","last_undegraded":"2026-02-23T06:21:23.159075+0000","last_fullsized":"2026-02-23T06:21:23.159075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:15:03.662362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157187+0000","last_change":"2026-02-23T06:21:18.144945+0000","last_active":"2026-02-23T06:21:23.157187+0000","last_peered":"2026-02-23T06:21:23.157187+0000","last_clean":"2026-02-23T06:21:23.157187+0000","last_became_active":"2026-02-23T06:21:18.144832+0000","last_became_peered":"2026-02-23T06:21:18.144832+0000","last_unstale":"2026-02-23T06:21:23.157187+0000","last_undegraded":"2026-02-23T06:21:23.157187+0000","last_fullsized":"2026-02-23T06:21:23.157187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:41:07.968870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157406+0000","last_change":"2026-02-23T06:21:18.150652+0000","last_active":"2026-02-23T06:21:23.157406+0000","last_peered":"2026-02-23T06:21:23.157406+0000","last_clean":"2026-02-23T06:21:23.157406+0000","last_became_active":"2026-02-23T06:21:18.150489+0000","last_became_peered":"2026-02-23T06:21:18.150489+0000","last_unstale":"2026-02-23T06:21:23.157406+0000","last_undegraded":"2026-02-23T06:21:23.157406+0000","last_fullsized":"2026-02-23T06:21:23.157406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:42:35.233149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156538+0000","last_change":"2026-02-23T06:21:18.143636+0000","last_active":"2026-02-23T06:21:23.156538+0000","last_peered":"2026-02-23T06:21:23.156538+0000","last_clean":"2026-02-23T06:21:23.156538+0000","last_became_active":"2026-02-23T06:21:18.143495+0000","last_became_peered":"2026-02-23T06:21:18.143495+0000","last_unstale":"2026-02-23T06:21:23.156538+0000","last_undegraded":"2026-02-23T06:21:23.156538+0000","last_fullsized":"2026-02-23T06:21:23.156538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:47:19.057181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157427+0000","last_change":"2026-02-23T06:21:18.148787+0000","last_active":"2026-02-23T06:21:23.157427+0000","last_peered":"2026-02-23T06:21:23.157427+0000","last_clean":"2026-02-23T06:21:23.157427+0000","last_became_active":"2026-02-23T06:21:18.148701+0000","last_became_peered":"2026-02-23T06:21:18.148701+0000","last_unstale":"2026-02-23T06:21:23.157427+0000","last_undegraded":"2026-02-23T06:21:23.157427+0000","last_fullsized":"2026-02-23T06:21:23.157427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:19:32.878202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156524+0000","last_change":"2026-02-23T06:21:18.145498+0000","last_active":"2026-02-23T06:21:23.156524+0000","last_peered":"2026-02-23T06:21:23.156524+0000","last_clean":"2026-02-23T06:21:23.156524+0000","last_became_active":"2026-02-23T06:21:18.145346+0000","last_became_peered":"2026-02-23T06:21:18.145346+0000","last_unstale":"2026-02-23T06:21:23.156524+0000","last_undegraded":"2026-02-23T06:21:23.156524+0000","last_fullsized":"2026-02-23T06:21:23.156524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:44:15.203843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158314+0000","last_change":"2026-02-23T06:21:18.147453+0000","last_active":"2026-02-23T06:21:23.158314+0000","last_peered":"2026-02-23T06:21:23.158314+0000","last_clean":"2026-02-23T06:21:23.158314+0000","last_became_active":"2026-02-23T06:21:18.147357+0000","last_became_peered":"2026-02-23T06:21:18.147357+0000","last_unstale":"2026-02-23T06:21:23.158314+0000","last_undegraded":"2026-02-23T06:21:23.158314+0000","last_fullsized":"2026-02-23T06:21:23.158314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:41:05.063786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159167+0000","last_change":"2026-02-23T06:21:18.151381+0000","last_active":"2026-02-23T06:21:23.159167+0000","last_peered":"2026-02-23T06:21:23.159167+0000","last_clean":"2026-02-23T06:21:23.159167+0000","last_became_active":"2026-02-23T06:21:18.151269+0000","last_became_peered":"2026-02-23T06:21:18.151269+0000","last_unstale":"2026-02-23T06:21:23.159167+0000","last_undegraded":"2026-02-23T06:21:23.159167+0000","last_fullsized":"2026-02-23T06:21:23.159167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:50:46.152385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156748+0000","last_change":"2026-02-23T06:21:18.148411+0000","last_active":"2026-02-23T06:21:23.156748+0000","last_peered":"2026-02-23T06:21:23.156748+0000","last_clean":"2026-02-23T06:21:23.156748+0000","last_became_active":"2026-02-23T06:21:18.148262+0000","last_became_peered":"2026-02-23T06:21:18.148262+0000","last_unstale":"2026-02-23T06:21:23.156748+0000","last_undegraded":"2026-02-23T06:21:23.156748+0000","last_fullsized":"2026-02-23T06:21:23.156748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:09:54.723244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158936+0000","last_change":"2026-02-23T06:21:18.155275+0000","last_active":"2026-02-23T06:21:23.158936+0000","last_peered":"2026-02-23T06:21:23.158936+0000","last_clean":"2026-02-23T06:21:23.158936+0000","last_became_active":"2026-02-23T06:21:18.155214+0000","last_became_peered":"2026-02-23T06:21:18.155214+0000","last_unstale":"2026-02-23T06:21:23.158936+0000","last_undegraded":"2026-02-23T06:21:23.158936+0000","last_fullsized":"2026-02-23T06:21:23.158936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:44:47.367234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157370+0000","last_change":"2026-02-23T06:21:18.153381+0000","last_active":"2026-02-23T06:21:23.157370+0000","last_peered":"2026-02-23T06:21:23.157370+0000","last_clean":"2026-02-23T06:21:23.157370+0000","last_became_active":"2026-02-23T06:21:18.152456+0000","last_became_peered":"2026-02-23T06:21:18.152456+0000","last_unstale":"2026-02-23T06:21:23.157370+0000","last_undegraded":"2026-02-23T06:21:23.157370+0000","last_fullsized":"2026-02-23T06:21:23.157370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:14:46.231331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156471+0000","last_change":"2026-02-23T06:21:18.148599+0000","last_active":"2026-02-23T06:21:23.156471+0000","last_peered":"2026-02-23T06:21:23.156471+0000","last_clean":"2026-02-23T06:21:23.156471+0000","last_became_active":"2026-02-23T06:21:18.148498+0000","last_became_peered":"2026-02-23T06:21:18.148498+0000","last_unstale":"2026-02-23T06:21:23.156471+0000","last_undegraded":"2026-02-23T06:21:23.156471+0000","last_fullsized":"2026-02-23T06:21:23.156471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:05:56.074928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157128+0000","last_change":"2026-02-23T06:21:18.142621+0000","last_active":"2026-02-23T06:21:23.157128+0000","last_peered":"2026-02-23T06:21:23.157128+0000","last_clean":"2026-02-23T06:21:23.157128+0000","last_became_active":"2026-02-23T06:21:18.141938+0000","last_became_peered":"2026-02-23T06:21:18.141938+0000","last_unstale":"2026-02-23T06:21:23.157128+0000","last_undegraded":"2026-02-23T06:21:23.157128+0000","last_fullsized":"2026-02-23T06:21:23.157128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:25:55.390738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157141+0000","last_change":"2026-02-23T06:21:18.153183+0000","last_active":"2026-02-23T06:21:23.157141+0000","last_peered":"2026-02-23T06:21:23.157141+0000","last_clean":"2026-02-23T06:21:23.157141+0000","last_became_active":"2026-02-23T06:21:18.153090+0000","last_became_peered":"2026-02-23T06:21:18.153090+0000","last_unstale":"2026-02-23T06:21:23.157141+0000","last_undegraded":"2026-02-23T06:21:23.157141+0000","last_fullsized":"2026-02-23T06:21:23.157141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:26:17.749612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158286+0000","last_change":"2026-02-23T06:21:18.148055+0000","last_active":"2026-02-23T06:21:23.158286+0000","last_peered":"2026-02-23T06:21:23.158286+0000","last_clean":"2026-02-23T06:21:23.158286+0000","last_became_active":"2026-02-23T06:21:18.147956+0000","last_became_peered":"2026-02-23T06:21:18.147956+0000","last_unstale":"2026-02-23T06:21:23.158286+0000","last_undegraded":"2026-02-23T06:21:23.158286+0000","last_fullsized":"2026-02-23T06:21:23.158286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:22:55.028859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158650+0000","last_change":"2026-02-23T06:21:18.155576+0000","last_active":"2026-02-23T06:21:23.158650+0000","last_peered":"2026-02-23T06:21:23.158650+0000","last_clean":"2026-02-23T06:21:23.158650+0000","last_became_active":"2026-02-23T06:21:18.155130+0000","last_became_peered":"2026-02-23T06:21:18.155130+0000","last_unstale":"2026-02-23T06:21:23.158650+0000","last_undegraded":"2026-02-23T06:21:23.158650+0000","last_fullsized":"2026-02-23T06:21:23.158650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:43:12.801427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158425+0000","last_change":"2026-02-23T06:21:18.152980+0000","last_active":"2026-02-23T06:21:23.158425+0000","last_peered":"2026-02-23T06:21:23.158425+0000","last_clean":"2026-02-23T06:21:23.158425+0000","last_became_active":"2026-02-23T06:21:18.152790+0000","last_became_peered":"2026-02-23T06:21:18.152790+0000","last_unstale":"2026-02-23T06:21:23.158425+0000","last_undegraded":"2026-02-23T06:21:23.158425+0000","last_fullsized":"2026-02-23T06:21:23.158425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:33:09.398040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158457+0000","last_change":"2026-02-23T06:21:18.155247+0000","last_active":"2026-02-23T06:21:23.158457+0000","last_peered":"2026-02-23T06:21:23.158457+0000","last_clean":"2026-02-23T06:21:23.158457+0000","last_became_active":"2026-02-23T06:21:18.155122+0000","last_became_peered":"2026-02-23T06:21:18.155122+0000","last_unstale":"2026-02-23T06:21:23.158457+0000","last_undegraded":"2026-02-23T06:21:23.158457+0000","last_fullsized":"2026-02-23T06:21:23.158457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:45:08.775934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156432+0000","last_change":"2026-02-23T06:21:18.151259+0000","last_active":"2026-02-23T06:21:23.156432+0000","last_peered":"2026-02-23T06:21:23.156432+0000","last_clean":"2026-02-23T06:21:23.156432+0000","last_became_active":"2026-02-23T06:21:18.151151+0000","last_became_peered":"2026-02-23T06:21:18.151151+0000","last_unstale":"2026-02-23T06:21:23.156432+0000","last_undegraded":"2026-02-23T06:21:23.156432+0000","last_fullsized":"2026-02-23T06:21:23.156432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:08:03.361054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157811+0000","last_change":"2026-02-23T06:21:18.146606+0000","last_active":"2026-02-23T06:21:23.157811+0000","last_peered":"2026-02-23T06:21:23.157811+0000","last_clean":"2026-02-23T06:21:23.157811+0000","last_became_active":"2026-02-23T06:21:18.146527+0000","last_became_peered":"2026-02-23T06:21:18.146527+0000","last_unstale":"2026-02-23T06:21:23.157811+0000","last_undegraded":"2026-02-23T06:21:23.157811+0000","last_fullsized":"2026-02-23T06:21:23.157811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:30:44.739034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158602+0000","last_change":"2026-02-23T06:21:18.145872+0000","last_active":"2026-02-23T06:21:23.158602+0000","last_peered":"2026-02-23T06:21:23.158602+0000","last_clean":"2026-02-23T06:21:23.158602+0000","last_became_active":"2026-02-23T06:21:18.145770+0000","last_became_peered":"2026-02-23T06:21:18.145770+0000","last_unstale":"2026-02-23T06:21:23.158602+0000","last_undegraded":"2026-02-23T06:21:23.158602+0000","last_fullsized":"2026-02-23T06:21:23.158602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:21:28.063960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158049+0000","last_change":"2026-02-23T06:21:18.152478+0000","last_active":"2026-02-23T06:21:23.158049+0000","last_peered":"2026-02-23T06:21:23.158049+0000","last_clean":"2026-02-23T06:21:23.158049+0000","last_became_active":"2026-02-23T06:21:18.151948+0000","last_became_peered":"2026-02-23T06:21:18.151948+0000","last_unstale":"2026-02-23T06:21:23.158049+0000","last_undegraded":"2026-02-23T06:21:23.158049+0000","last_fullsized":"2026-02-23T06:21:23.158049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:58:02.829593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158363+0000","last_change":"2026-02-23T06:21:18.144778+0000","last_active":"2026-02-23T06:21:23.158363+0000","last_peered":"2026-02-23T06:21:23.158363+0000","last_clean":"2026-02-23T06:21:23.158363+0000","last_became_active":"2026-02-23T06:21:18.144346+0000","last_became_peered":"2026-02-23T06:21:18.144346+0000","last_unstale":"2026-02-23T06:21:23.158363+0000","last_undegraded":"2026-02-23T06:21:23.158363+0000","last_fullsized":"2026-02-23T06:21:23.158363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:25:27.650673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156824+0000","last_change":"2026-02-23T06:21:18.141648+0000","last_active":"2026-02-23T06:21:23.156824+0000","last_peered":"2026-02-23T06:21:23.156824+0000","last_clean":"2026-02-23T06:21:23.156824+0000","last_became_active":"2026-02-23T06:21:18.141449+0000","last_became_peered":"2026-02-23T06:21:18.141449+0000","last_unstale":"2026-02-23T06:21:23.156824+0000","last_undegraded":"2026-02-23T06:21:23.156824+0000","last_fullsized":"2026-02-23T06:21:23.156824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:33:18.986892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157020+0000","last_change":"2026-02-23T06:21:18.142536+0000","last_active":"2026-02-23T06:21:23.157020+0000","last_peered":"2026-02-23T06:21:23.157020+0000","last_clean":"2026-02-23T06:21:23.157020+0000","last_became_active":"2026-02-23T06:21:18.142359+0000","last_became_peered":"2026-02-23T06:21:18.142359+0000","last_unstale":"2026-02-23T06:21:23.157020+0000","last_undegraded":"2026-02-23T06:21:23.157020+0000","last_fullsized":"2026-02-23T06:21:23.157020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:54:09.503227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158607+0000","last_change":"2026-02-23T06:21:18.156667+0000","last_active":"2026-02-23T06:21:23.158607+0000","last_peered":"2026-02-23T06:21:23.158607+0000","last_clean":"2026-02-23T06:21:23.158607+0000","last_became_active":"2026-02-23T06:21:18.156564+0000","last_became_peered":"2026-02-23T06:21:18.156564+0000","last_unstale":"2026-02-23T06:21:23.158607+0000","last_undegraded":"2026-02-23T06:21:23.158607+0000","last_fullsized":"2026-02-23T06:21:23.158607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:11:13.967668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4747,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25597,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70172,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":328,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":335872,"data_stored":694963,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":12046,"internal_metadata":27578610},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":268,"kb_used_omap":19,"kb_used_meta":26924,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":274432,"data_stored":104649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19702,"internal_metadata":27570954},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":260,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":266240,"data_stored":104525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11374,"internal_metadata":27579282},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":332,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":339968,"data_stored":694985,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":11711,"internal_metadata":27578945},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":109146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13524,"internal_metadata":27577132},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":105129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11474,"internal_metadata":27579182},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":272,"kb_used_omap":10,"kb_used_meta":26933,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":278528,"data_stored":108452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11136,"internal_metadata":27579520},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":268,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":274432,"data_stored":104581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":27571517},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8618,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":702,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":320,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1500,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4712,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":336,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9409,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T06:21:39.973 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-23T06:21:39.974 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-23T06:21:39.974 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-23T06:21:39.974 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-23T06:21:40.123 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.128+0000 7f6425f7e640 1 -- 10.20.193.58:0/3372101175 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f642015c040 msgr2=0x7f642005b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:40.123 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.128+0000 7f6425f7e640 1 --2- 10.20.193.58:0/3372101175 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f642015c040 0x7f642005b0e0 secure :-1 s=READY pgs=155 gs=2 cs=0 l=1 c_cookie=16122276154919907471 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64200b5010 tx=0x7f641002f250 comp rx=0 tx=0).stop 2026-02-23T06:21:40.123 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.128+0000 7f6425f7e640 1 -- 10.20.193.58:0/3372101175 shutdown_connections 2026-02-23T06:21:40.123 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.128+0000 7f6425f7e640 1 --2- 10.20.193.58:0/3372101175 >> v2:10.20.193.58:3300/0 conn(0x7f6420056550 0x7f642005ce30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.124 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.128+0000 7f6425f7e640 1 --2- 10.20.193.58:0/3372101175 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f642015c040 0x7f642005b0e0 unknown :-1 s=CLOSED pgs=155 gs=2 cs=0 l=1 c_cookie=16122276154919907471 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.124 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.128+0000 7f6425f7e640 1 -- 10.20.193.58:0/3372101175 >> 10.20.193.58:0/3372101175 conn(0x7f64200b3c20 msgr2=0x7f64200b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:40.124 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.128+0000 7f6425f7e640 1 -- 10.20.193.58:0/3372101175 shutdown_connections 2026-02-23T06:21:40.124 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.128+0000 7f6425f7e640 1 -- 10.20.193.58:0/3372101175 wait complete. 2026-02-23T06:21:40.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.129+0000 7f6425f7e640 1 Processor -- start 2026-02-23T06:21:40.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.129+0000 7f6425f7e640 1 -- start start 2026-02-23T06:21:40.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.130+0000 7f6425f7e640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6420056550 0x7f64201fe940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:40.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.130+0000 7f6425f7e640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f642005d370 0x7f6420152c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:40.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.130+0000 7f6425f7e640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f642015c040 0x7f64201544e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:40.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.130+0000 7f6425f7e640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f6420155530 con 0x7f6420056550 2026-02-23T06:21:40.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.130+0000 7f6425f7e640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f6420154050 con 0x7f642005d370 2026-02-23T06:21:40.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.130+0000 7f6425f7e640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f6420153170 con 0x7f642015c040 2026-02-23T06:21:40.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.130+0000 7f6424f7c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6420056550 0x7f64201fe940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:40.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.130+0000 7f6417fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f642005d370 0x7f6420152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:40.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.130+0000 7f6424f7c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6420056550 0x7f64201fe940 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:56858/0 (socket says 10.20.193.58:56858) 2026-02-23T06:21:40.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.130+0000 7f6417fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f642005d370 0x7f6420152c30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:59374/0 (socket says 10.20.193.58:59374) 2026-02-23T06:21:40.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.130+0000 7f642577d640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f642015c040 0x7f64201544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:40.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.130+0000 7f6424f7c640 1 -- 10.20.193.58:0/2741248256 learned_addr learned my addr 10.20.193.58:0/2741248256 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:40.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.130+0000 7f6424f7c640 1 -- 10.20.193.58:0/2741248256 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f642015c040 msgr2=0x7f64201544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:40.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.130+0000 7f6424f7c640 1 --2- 10.20.193.58:0/2741248256 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f642015c040 0x7f64201544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.130+0000 7f6424f7c640 1 -- 10.20.193.58:0/2741248256 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f642005d370 msgr2=0x7f6420152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:40.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.130+0000 7f6424f7c640 1 --2- 10.20.193.58:0/2741248256 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f642005d370 0x7f6420152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.130+0000 7f6424f7c640 1 -- 10.20.193.58:0/2741248256 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6410009570 con 0x7f6420056550 2026-02-23T06:21:40.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.130+0000 7f6424f7c640 1 --2- 10.20.193.58:0/2741248256 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6420056550 0x7f64201fe940 secure :-1 s=READY pgs=155 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6410004740 tx=0x7f64100028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:40.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.131+0000 7f64157fa640 1 -- 10.20.193.58:0/2741248256 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f641003d070 con 0x7f6420056550 2026-02-23T06:21:40.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.131+0000 7f64157fa640 1 -- 10.20.193.58:0/2741248256 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6410038470 con 0x7f6420056550 2026-02-23T06:21:40.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.131+0000 7f64157fa640 1 -- 10.20.193.58:0/2741248256 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6410038880 con 0x7f6420056550 2026-02-23T06:21:40.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.131+0000 7f6425f7e640 1 -- 10.20.193.58:0/2741248256 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64201533f0 con 0x7f6420056550 2026-02-23T06:21:40.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.131+0000 7f6425f7e640 1 -- 10.20.193.58:0/2741248256 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64201539b0 con 0x7f6420056550 2026-02-23T06:21:40.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.131+0000 7f63f2ffd640 1 -- 10.20.193.58:0/2741248256 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f642005ce30 con 0x7f6420056550 2026-02-23T06:21:40.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.132+0000 7f64157fa640 1 -- 10.20.193.58:0/2741248256 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f64100389e0 con 0x7f6420056550 2026-02-23T06:21:40.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.133+0000 7f64157fa640 1 --2- 10.20.193.58:0/2741248256 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f63f807a6c0 0x7f63f809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:40.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.133+0000 7f64157fa640 1 -- 10.20.193.58:0/2741248256 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f64100c2070 con 0x7f6420056550 2026-02-23T06:21:40.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.134+0000 7f6417fff640 1 --2- 10.20.193.58:0/2741248256 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f63f807a6c0 0x7f63f809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:40.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.134+0000 7f6417fff640 1 --2- 10.20.193.58:0/2741248256 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f63f807a6c0 0x7f63f809ab70 secure :-1 s=READY pgs=100 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64200b1f40 tx=0x7f6408005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:40.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.135+0000 7f64157fa640 1 -- 10.20.193.58:0/2741248256 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f6410085390 con 0x7f6420056550 2026-02-23T06:21:40.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.276+0000 7f63f2ffd640 1 -- 10.20.193.58:0/2741248256 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f64200592d0 con 0x7f6420056550 2026-02-23T06:21:40.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.276+0000 7f64157fa640 1 -- 10.20.193.58:0/2741248256 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f64100884b0 con 0x7f6420056550 2026-02-23T06:21:40.271 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:40.271 INFO:teuthology.orchestra.run.trial058.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-23T06:21:40.272 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.277+0000 7f63f2ffd640 1 -- 10.20.193.58:0/2741248256 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f63f807a6c0 msgr2=0x7f63f809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:40.272 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.277+0000 7f63f2ffd640 1 --2- 10.20.193.58:0/2741248256 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f63f807a6c0 0x7f63f809ab70 secure :-1 s=READY pgs=100 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64200b1f40 tx=0x7f6408005f90 comp rx=0 tx=0).stop 2026-02-23T06:21:40.273 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.277+0000 7f63f2ffd640 1 -- 10.20.193.58:0/2741248256 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6420056550 msgr2=0x7f64201fe940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:40.273 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.277+0000 7f63f2ffd640 1 --2- 10.20.193.58:0/2741248256 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6420056550 0x7f64201fe940 secure :-1 s=READY pgs=155 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6410004740 tx=0x7f64100028d0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.273 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.277+0000 7f63f2ffd640 1 -- 10.20.193.58:0/2741248256 shutdown_connections 2026-02-23T06:21:40.273 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.277+0000 7f63f2ffd640 1 --2- 10.20.193.58:0/2741248256 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f63f807a6c0 0x7f63f809ab70 unknown :-1 s=CLOSED pgs=100 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.273 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.277+0000 7f63f2ffd640 1 --2- 10.20.193.58:0/2741248256 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f642015c040 0x7f64201544e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.273 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.277+0000 7f63f2ffd640 1 --2- 10.20.193.58:0/2741248256 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f642005d370 0x7f6420152c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.273 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.277+0000 7f63f2ffd640 1 --2- 10.20.193.58:0/2741248256 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6420056550 0x7f64201fe940 unknown :-1 s=CLOSED pgs=155 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.273 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.277+0000 7f63f2ffd640 1 -- 10.20.193.58:0/2741248256 >> 10.20.193.58:0/2741248256 conn(0x7f64200b3c20 msgr2=0x7f6420164820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:40.273 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.277+0000 7f63f2ffd640 1 -- 10.20.193.58:0/2741248256 shutdown_connections 2026-02-23T06:21:40.273 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.277+0000 7f63f2ffd640 1 -- 10.20.193.58:0/2741248256 wait complete. 2026-02-23T06:21:40.284 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-23T06:21:40.285 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2026-02-23T06:21:40.406 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.411+0000 7f92f5f1c640 1 -- 10.20.193.58:0/2328135995 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92f00b6690 msgr2=0x7f92f0058ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:40.407 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.411+0000 7f92f5f1c640 1 --2- 10.20.193.58:0/2328135995 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92f00b6690 0x7f92f0058ec0 secure :-1 s=READY pgs=157 gs=3 cs=0 l=1 c_cookie=14792904433224439742 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92ec005820 tx=0x7f92ec030300 comp rx=0 tx=0).stop 2026-02-23T06:21:40.407 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.411+0000 7f92f5f1c640 1 -- 10.20.193.58:0/2328135995 shutdown_connections 2026-02-23T06:21:40.407 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.411+0000 7f92f5f1c640 1 --2- 10.20.193.58:0/2328135995 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92f00b6690 0x7f92f0058ec0 unknown :-1 s=CLOSED pgs=157 gs=3 cs=0 l=1 c_cookie=14792904433224439742 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.407 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.411+0000 7f92f5f1c640 1 -- 10.20.193.58:0/2328135995 >> 10.20.193.58:0/2328135995 conn(0x7f92f00b3c20 msgr2=0x7f92f00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:40.407 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.412+0000 7f92f5f1c640 1 -- 10.20.193.58:0/2328135995 shutdown_connections 2026-02-23T06:21:40.407 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.412+0000 7f92f5f1c640 1 -- 10.20.193.58:0/2328135995 wait complete. 2026-02-23T06:21:40.409 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.413+0000 7f92f5f1c640 1 Processor -- start 2026-02-23T06:21:40.409 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.413+0000 7f92f5f1c640 1 -- start start 2026-02-23T06:21:40.409 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.413+0000 7f92f5f1c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f92f00b6690 0x7f92f0126790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:40.410 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.413+0000 7f92f5f1c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f92f015d4a0 0x7f92f0056520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:40.410 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.413+0000 7f92f5f1c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92f015d870 0x7f92f00b7480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:40.410 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.413+0000 7f92f5f1c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f92f0126370 con 0x7f92f015d4a0 2026-02-23T06:21:40.410 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.413+0000 7f92f5f1c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f92f0140720 con 0x7f92f015d870 2026-02-23T06:21:40.410 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.413+0000 7f92f5f1c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f92f013e7d0 con 0x7f92f00b6690 2026-02-23T06:21:40.410 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.413+0000 7f92f4f1a640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f92f00b6690 0x7f92f0126790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:40.410 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.413+0000 7f92f571b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92f015d870 0x7f92f00b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:40.410 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.413+0000 7f92e7fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f92f015d4a0 0x7f92f0056520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:40.410 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.414+0000 7f92f571b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92f015d870 0x7f92f00b7480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:59402/0 (socket says 10.20.193.58:59402) 2026-02-23T06:21:40.410 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.414+0000 7f92f571b640 1 -- 10.20.193.58:0/701351012 learned_addr learned my addr 10.20.193.58:0/701351012 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:40.410 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.414+0000 7f92f4f1a640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f92f00b6690 0x7f92f0126790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:58992/0 (socket says 10.20.193.58:58992) 2026-02-23T06:21:40.410 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.414+0000 7f92f571b640 1 -- 10.20.193.58:0/701351012 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f92f00b6690 msgr2=0x7f92f0126790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:40.411 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.414+0000 7f92f571b640 1 --2- 10.20.193.58:0/701351012 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f92f00b6690 0x7f92f0126790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.411 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.414+0000 7f92f571b640 1 -- 10.20.193.58:0/701351012 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f92f015d4a0 msgr2=0x7f92f0056520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:40.411 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.414+0000 7f92f571b640 1 --2- 10.20.193.58:0/701351012 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f92f015d4a0 0x7f92f0056520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.411 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.414+0000 7f92f571b640 1 -- 10.20.193.58:0/701351012 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92ec00a590 con 0x7f92f015d870 2026-02-23T06:21:40.411 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.414+0000 7f92f571b640 1 --2- 10.20.193.58:0/701351012 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92f015d870 0x7f92f00b7480 secure :-1 s=READY pgs=158 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92ec00aa40 tx=0x7f92ec003d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:40.411 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.414+0000 7f92e57fa640 1 -- 10.20.193.58:0/701351012 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f92ec03e070 con 0x7f92f015d870 2026-02-23T06:21:40.411 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.414+0000 7f92e57fa640 1 -- 10.20.193.58:0/701351012 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92ec0398a0 con 0x7f92f015d870 2026-02-23T06:21:40.411 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.414+0000 7f92e57fa640 1 -- 10.20.193.58:0/701351012 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f92ec039c30 con 0x7f92f015d870 2026-02-23T06:21:40.411 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.414+0000 7f92f5f1c640 1 -- 10.20.193.58:0/701351012 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92f013ea90 con 0x7f92f015d870 2026-02-23T06:21:40.411 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.414+0000 7f92f5f1c640 1 -- 10.20.193.58:0/701351012 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92f0125cb0 con 0x7f92f015d870 2026-02-23T06:21:40.411 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.415+0000 7f92f5f1c640 1 -- 10.20.193.58:0/701351012 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92f00b6d50 con 0x7f92f015d870 2026-02-23T06:21:40.412 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.416+0000 7f92e57fa640 1 -- 10.20.193.58:0/701351012 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f92ec06abd0 con 0x7f92f015d870 2026-02-23T06:21:40.412 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.417+0000 7f92e57fa640 1 --2- 10.20.193.58:0/701351012 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f92c007a6c0 0x7f92c009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:40.413 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.417+0000 7f92e57fa640 1 -- 10.20.193.58:0/701351012 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f92ec0c38a0 con 0x7f92f015d870 2026-02-23T06:21:40.413 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.417+0000 7f92f4f1a640 1 --2- 10.20.193.58:0/701351012 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f92c007a6c0 0x7f92c009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:40.413 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.418+0000 7f92e57fa640 1 -- 10.20.193.58:0/701351012 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f92ec086b20 con 0x7f92f015d870 2026-02-23T06:21:40.413 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.418+0000 7f92f4f1a640 1 --2- 10.20.193.58:0/701351012 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f92c007a6c0 0x7f92c009ab70 secure :-1 s=READY pgs=101 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92e0007fd0 tx=0x7f92e0007de0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:40.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.560+0000 7f92f5f1c640 1 -- 10.20.193.58:0/701351012 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92f01264b0 con 0x7f92f015d870 2026-02-23T06:21:40.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.561+0000 7f92e57fa640 1 -- 10.20.193.58:0/701351012 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6886 (secure 0 0 0) 0x7f92f01264b0 con 0x7f92f015d870 2026-02-23T06:21:40.556 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:40.556 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":9,"btime":"2026-02-23T06:21:35:181391+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4320,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.58:6836/332204623","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6834","nonce":332204623},{"type":"v1","addr":"10.20.193.58:6836","nonce":332204623}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4349,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6839/49797428","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6838","nonce":49797428},{"type":"v1","addr":"10.20.193.93:6839","nonce":49797428}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4355,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.58:6833/363105980","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6832","nonce":363105980},{"type":"v1","addr":"10.20.193.58:6833","nonce":363105980}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4438,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6835/3715244768","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6834","nonce":3715244768},{"type":"v1","addr":"10.20.193.93:6835","nonce":3715244768}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4444,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6837/3986540573","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6836","nonce":3986540573},{"type":"v1","addr":"10.20.193.93:6837","nonce":3986540573}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false,"allow_referent_inodes":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-23T06:21:17.428505+0000","modified":"2026-02-23T06:21:34.468900+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4468},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4468":{"gid":4468,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"10.20.193.58:6837/4266460647","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6835","nonce":4266460647},{"type":"v1","addr":"10.20.193.58:6837","nonce":4266460647}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4468,"qdb_cluster":[4468]},"id":1}]} 2026-02-23T06:21:40.557 INFO:teuthology.orchestra.run.trial058.stderr:dumped fsmap epoch 9 2026-02-23T06:21:40.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.562+0000 7f92f5f1c640 1 -- 10.20.193.58:0/701351012 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f92c007a6c0 msgr2=0x7f92c009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:40.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.562+0000 7f92f5f1c640 1 --2- 10.20.193.58:0/701351012 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f92c007a6c0 0x7f92c009ab70 secure :-1 s=READY pgs=101 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92e0007fd0 tx=0x7f92e0007de0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.562+0000 7f92f5f1c640 1 -- 10.20.193.58:0/701351012 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92f015d870 msgr2=0x7f92f00b7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:40.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.562+0000 7f92f5f1c640 1 --2- 10.20.193.58:0/701351012 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92f015d870 0x7f92f00b7480 secure :-1 s=READY pgs=158 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92ec00aa40 tx=0x7f92ec003d20 comp rx=0 tx=0).stop 2026-02-23T06:21:40.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.562+0000 7f92f5f1c640 1 -- 10.20.193.58:0/701351012 shutdown_connections 2026-02-23T06:21:40.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.562+0000 7f92f5f1c640 1 --2- 10.20.193.58:0/701351012 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f92c007a6c0 0x7f92c009ab70 unknown :-1 s=CLOSED pgs=101 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.562+0000 7f92f5f1c640 1 --2- 10.20.193.58:0/701351012 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92f015d870 0x7f92f00b7480 unknown :-1 s=CLOSED pgs=158 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.562+0000 7f92f5f1c640 1 --2- 10.20.193.58:0/701351012 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f92f015d4a0 0x7f92f0056520 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.562+0000 7f92f5f1c640 1 --2- 10.20.193.58:0/701351012 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f92f00b6690 0x7f92f0126790 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.562+0000 7f92f5f1c640 1 -- 10.20.193.58:0/701351012 >> 10.20.193.58:0/701351012 conn(0x7f92f00b3c20 msgr2=0x7f92f013f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:40.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.562+0000 7f92f5f1c640 1 -- 10.20.193.58:0/701351012 shutdown_connections 2026-02-23T06:21:40.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.562+0000 7f92f5f1c640 1 -- 10.20.193.58:0/701351012 wait complete. 2026-02-23T06:21:40.568 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2026-02-23T06:21:40.689 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.694+0000 7f8e82dd2640 1 -- 10.20.193.58:0/3401529498 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8e7c056550 msgr2=0x7f8e7c05ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:40.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.694+0000 7f8e82dd2640 1 --2- 10.20.193.58:0/3401529498 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8e7c056550 0x7f8e7c05ce30 secure :-1 s=READY pgs=159 gs=2 cs=0 l=1 c_cookie=10279697582184000349 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e70004740 tx=0x7f8e7002f1e0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.694+0000 7f8e82dd2640 1 -- 10.20.193.58:0/3401529498 shutdown_connections 2026-02-23T06:21:40.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.694+0000 7f8e82dd2640 1 --2- 10.20.193.58:0/3401529498 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8e7c05d370 0x7f8e7c0b5680 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.694+0000 7f8e82dd2640 1 --2- 10.20.193.58:0/3401529498 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8e7c056550 0x7f8e7c05ce30 unknown :-1 s=CLOSED pgs=159 gs=2 cs=0 l=1 c_cookie=10279697582184000349 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.694+0000 7f8e82dd2640 1 -- 10.20.193.58:0/3401529498 >> 10.20.193.58:0/3401529498 conn(0x7f8e7c0b3c20 msgr2=0x7f8e7c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:40.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.694+0000 7f8e82dd2640 1 -- 10.20.193.58:0/3401529498 shutdown_connections 2026-02-23T06:21:40.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.694+0000 7f8e82dd2640 1 -- 10.20.193.58:0/3401529498 wait complete. 2026-02-23T06:21:40.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.695+0000 7f8e82dd2640 1 Processor -- start 2026-02-23T06:21:40.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.696+0000 7f8e82dd2640 1 -- start start 2026-02-23T06:21:40.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.696+0000 7f8e82dd2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e7c056550 0x7f8e7c1312d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:40.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.696+0000 7f8e82dd2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8e7c05d370 0x7f8e7c155560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:40.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.696+0000 7f8e82dd2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8e7c15c040 0x7f8e7c1375b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:40.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.696+0000 7f8e82dd2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f8e7c200800 con 0x7f8e7c056550 2026-02-23T06:21:40.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.696+0000 7f8e82dd2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f8e7c132900 con 0x7f8e7c15c040 2026-02-23T06:21:40.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.696+0000 7f8e82dd2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f8e7c138f50 con 0x7f8e7c05d370 2026-02-23T06:21:40.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.696+0000 7f8e81dd0640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e7c056550 0x7f8e7c1312d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:40.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.696+0000 7f8e815cf640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8e7c05d370 0x7f8e7c155560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:40.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.696+0000 7f8e825d1640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8e7c15c040 0x7f8e7c1375b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:40.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.696+0000 7f8e81dd0640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e7c056550 0x7f8e7c1312d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:56882/0 (socket says 10.20.193.58:56882) 2026-02-23T06:21:40.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.696+0000 7f8e815cf640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8e7c05d370 0x7f8e7c155560 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:59006/0 (socket says 10.20.193.58:59006) 2026-02-23T06:21:40.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.696+0000 7f8e81dd0640 1 -- 10.20.193.58:0/780234271 learned_addr learned my addr 10.20.193.58:0/780234271 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:40.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.697+0000 7f8e815cf640 1 -- 10.20.193.58:0/780234271 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8e7c15c040 msgr2=0x7f8e7c1375b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:40.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.697+0000 7f8e815cf640 1 --2- 10.20.193.58:0/780234271 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8e7c15c040 0x7f8e7c1375b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.697+0000 7f8e815cf640 1 -- 10.20.193.58:0/780234271 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e7c056550 msgr2=0x7f8e7c1312d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:40.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.697+0000 7f8e815cf640 1 --2- 10.20.193.58:0/780234271 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e7c056550 0x7f8e7c1312d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.697+0000 7f8e815cf640 1 -- 10.20.193.58:0/780234271 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e700094b0 con 0x7f8e7c05d370 2026-02-23T06:21:40.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.697+0000 7f8e81dd0640 1 --2- 10.20.193.58:0/780234271 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e7c056550 0x7f8e7c1312d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:40.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.697+0000 7f8e815cf640 1 --2- 10.20.193.58:0/780234271 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8e7c05d370 0x7f8e7c155560 secure :-1 s=READY pgs=76 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e70009230 tx=0x7f8e700028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:40.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.697+0000 7f8e6a7fc640 1 -- 10.20.193.58:0/780234271 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e70038470 con 0x7f8e7c05d370 2026-02-23T06:21:40.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.697+0000 7f8e6a7fc640 1 -- 10.20.193.58:0/780234271 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e700386c0 con 0x7f8e7c05d370 2026-02-23T06:21:40.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.697+0000 7f8e6a7fc640 1 -- 10.20.193.58:0/780234271 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e70038af0 con 0x7f8e7c05d370 2026-02-23T06:21:40.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.697+0000 7f8e82dd2640 1 -- 10.20.193.58:0/780234271 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e7c057b90 con 0x7f8e7c05d370 2026-02-23T06:21:40.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.697+0000 7f8e82dd2640 1 -- 10.20.193.58:0/780234271 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e7c132490 con 0x7f8e7c05d370 2026-02-23T06:21:40.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.698+0000 7f8e82dd2640 1 -- 10.20.193.58:0/780234271 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e7c200970 con 0x7f8e7c05d370 2026-02-23T06:21:40.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.699+0000 7f8e6a7fc640 1 -- 10.20.193.58:0/780234271 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f8e70038c50 con 0x7f8e7c05d370 2026-02-23T06:21:40.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.700+0000 7f8e6a7fc640 1 --2- 10.20.193.58:0/780234271 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8e4c07a6c0 0x7f8e4c09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:40.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.700+0000 7f8e6a7fc640 1 -- 10.20.193.58:0/780234271 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f8e700c2dd0 con 0x7f8e7c05d370 2026-02-23T06:21:40.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.700+0000 7f8e81dd0640 1 --2- 10.20.193.58:0/780234271 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8e4c07a6c0 0x7f8e4c09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:40.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.701+0000 7f8e6a7fc640 1 -- 10.20.193.58:0/780234271 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f8e70086050 con 0x7f8e7c05d370 2026-02-23T06:21:40.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.701+0000 7f8e81dd0640 1 --2- 10.20.193.58:0/780234271 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8e4c07a6c0 0x7f8e4c09ab70 secure :-1 s=READY pgs=102 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e6c002730 tx=0x7f8e6c007e70 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:40.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.840+0000 7f8e82dd2640 1 -- 10.20.193.58:0/780234271 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e7c200970 con 0x7f8e7c05d370 2026-02-23T06:21:40.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.841+0000 7f8e6a7fc640 1 -- 10.20.193.58:0/780234271 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6886 (secure 0 0 0) 0x7f8e7c200970 con 0x7f8e7c05d370 2026-02-23T06:21:40.836 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:40.836 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":9,"btime":"2026-02-23T06:21:35:181391+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4320,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.58:6836/332204623","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6834","nonce":332204623},{"type":"v1","addr":"10.20.193.58:6836","nonce":332204623}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4349,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6839/49797428","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6838","nonce":49797428},{"type":"v1","addr":"10.20.193.93:6839","nonce":49797428}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4355,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.58:6833/363105980","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6832","nonce":363105980},{"type":"v1","addr":"10.20.193.58:6833","nonce":363105980}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4438,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6835/3715244768","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6834","nonce":3715244768},{"type":"v1","addr":"10.20.193.93:6835","nonce":3715244768}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4444,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6837/3986540573","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6836","nonce":3986540573},{"type":"v1","addr":"10.20.193.93:6837","nonce":3986540573}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false,"allow_referent_inodes":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-23T06:21:17.428505+0000","modified":"2026-02-23T06:21:34.468900+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4468},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4468":{"gid":4468,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"10.20.193.58:6837/4266460647","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6835","nonce":4266460647},{"type":"v1","addr":"10.20.193.58:6837","nonce":4266460647}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4468,"qdb_cluster":[4468]},"id":1}]} 2026-02-23T06:21:40.837 INFO:teuthology.orchestra.run.trial058.stderr:dumped fsmap epoch 9 2026-02-23T06:21:40.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.842+0000 7f8e82dd2640 1 -- 10.20.193.58:0/780234271 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8e4c07a6c0 msgr2=0x7f8e4c09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:40.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.842+0000 7f8e82dd2640 1 --2- 10.20.193.58:0/780234271 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8e4c07a6c0 0x7f8e4c09ab70 secure :-1 s=READY pgs=102 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e6c002730 tx=0x7f8e6c007e70 comp rx=0 tx=0).stop 2026-02-23T06:21:40.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.842+0000 7f8e82dd2640 1 -- 10.20.193.58:0/780234271 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8e7c05d370 msgr2=0x7f8e7c155560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:40.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.842+0000 7f8e82dd2640 1 --2- 10.20.193.58:0/780234271 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8e7c05d370 0x7f8e7c155560 secure :-1 s=READY pgs=76 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e70009230 tx=0x7f8e700028d0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.842+0000 7f8e82dd2640 1 -- 10.20.193.58:0/780234271 shutdown_connections 2026-02-23T06:21:40.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.842+0000 7f8e82dd2640 1 --2- 10.20.193.58:0/780234271 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8e4c07a6c0 0x7f8e4c09ab70 unknown :-1 s=CLOSED pgs=102 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.842+0000 7f8e82dd2640 1 --2- 10.20.193.58:0/780234271 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8e7c15c040 0x7f8e7c1375b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.842+0000 7f8e82dd2640 1 --2- 10.20.193.58:0/780234271 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8e7c05d370 0x7f8e7c155560 unknown :-1 s=CLOSED pgs=76 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.842+0000 7f8e82dd2640 1 --2- 10.20.193.58:0/780234271 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e7c056550 0x7f8e7c1312d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.842+0000 7f8e82dd2640 1 -- 10.20.193.58:0/780234271 >> 10.20.193.58:0/780234271 conn(0x7f8e7c0b3c20 msgr2=0x7f8e7c156ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:40.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.842+0000 7f8e82dd2640 1 -- 10.20.193.58:0/780234271 shutdown_connections 2026-02-23T06:21:40.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.842+0000 7f8e82dd2640 1 -- 10.20.193.58:0/780234271 wait complete. 2026-02-23T06:21:40.848 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-23T06:21:40.969 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.974+0000 7fdd49789640 1 -- 10.20.193.58:0/1841609479 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdd440b6690 msgr2=0x7fdd44058ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:40.970 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.974+0000 7fdd49789640 1 --2- 10.20.193.58:0/1841609479 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdd440b6690 0x7fdd44058ec0 secure :-1 s=READY pgs=77 gs=3 cs=0 l=1 c_cookie=4126603698298064750 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd3800a970 tx=0x7fdd380302d0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.970 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.974+0000 7fdd49789640 1 -- 10.20.193.58:0/1841609479 shutdown_connections 2026-02-23T06:21:40.970 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.974+0000 7fdd49789640 1 --2- 10.20.193.58:0/1841609479 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdd440b6690 0x7fdd44058ec0 unknown :-1 s=CLOSED pgs=77 gs=3 cs=0 l=1 c_cookie=4126603698298064750 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.970 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.974+0000 7fdd49789640 1 -- 10.20.193.58:0/1841609479 >> 10.20.193.58:0/1841609479 conn(0x7fdd440b3c20 msgr2=0x7fdd440b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:40.970 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.974+0000 7fdd49789640 1 -- 10.20.193.58:0/1841609479 shutdown_connections 2026-02-23T06:21:40.970 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.974+0000 7fdd49789640 1 -- 10.20.193.58:0/1841609479 wait complete. 2026-02-23T06:21:40.972 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.976+0000 7fdd49789640 1 Processor -- start 2026-02-23T06:21:40.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.976+0000 7fdd49789640 1 -- start start 2026-02-23T06:21:40.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.976+0000 7fdd49789640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdd440b6690 0x7fdd440561f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:40.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.976+0000 7fdd49789640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdd4415d4a0 0x7fdd44162390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:40.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.976+0000 7fdd49789640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdd4415d870 0x7fdd4415f9c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:40.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.976+0000 7fdd49789640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4415ff00 con 0x7fdd4415d870 2026-02-23T06:21:40.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.976+0000 7fdd49789640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fdd441602c0 con 0x7fdd440b6690 2026-02-23T06:21:40.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.976+0000 7fdd49789640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fdd44160bb0 con 0x7fdd4415d4a0 2026-02-23T06:21:40.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.976+0000 7fdd43fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdd440b6690 0x7fdd440561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:40.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.976+0000 7fdd437fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdd4415d4a0 0x7fdd44162390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:40.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.977+0000 7fdd43fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdd440b6690 0x7fdd440561f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:59422/0 (socket says 10.20.193.58:59422) 2026-02-23T06:21:40.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.977+0000 7fdd43fff640 1 -- 10.20.193.58:0/1010189872 learned_addr learned my addr 10.20.193.58:0/1010189872 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:40.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.977+0000 7fdd48f88640 1 --2- 10.20.193.58:0/1010189872 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdd4415d870 0x7fdd4415f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:40.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.977+0000 7fdd48f88640 1 -- 10.20.193.58:0/1010189872 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdd4415d4a0 msgr2=0x7fdd44162390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:40.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.977+0000 7fdd48f88640 1 --2- 10.20.193.58:0/1010189872 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdd4415d4a0 0x7fdd44162390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.977+0000 7fdd48f88640 1 -- 10.20.193.58:0/1010189872 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdd440b6690 msgr2=0x7fdd440561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:40.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.977+0000 7fdd48f88640 1 --2- 10.20.193.58:0/1010189872 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdd440b6690 0x7fdd440561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:40.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.977+0000 7fdd48f88640 1 -- 10.20.193.58:0/1010189872 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd3800a590 con 0x7fdd4415d870 2026-02-23T06:21:40.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.977+0000 7fdd437fe640 1 --2- 10.20.193.58:0/1010189872 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdd4415d4a0 0x7fdd44162390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:40.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.977+0000 7fdd43fff640 1 --2- 10.20.193.58:0/1010189872 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdd440b6690 0x7fdd440561f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:40.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.977+0000 7fdd48f88640 1 --2- 10.20.193.58:0/1010189872 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdd4415d870 0x7fdd4415f9c0 secure :-1 s=READY pgs=159 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd3800aaa0 tx=0x7fdd38003d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:40.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.977+0000 7fdd40ff9640 1 -- 10.20.193.58:0/1010189872 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd3803e070 con 0x7fdd4415d870 2026-02-23T06:21:40.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.977+0000 7fdd40ff9640 1 -- 10.20.193.58:0/1010189872 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd380398a0 con 0x7fdd4415d870 2026-02-23T06:21:40.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.977+0000 7fdd40ff9640 1 -- 10.20.193.58:0/1010189872 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd38039c90 con 0x7fdd4415d870 2026-02-23T06:21:40.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.977+0000 7fdd49789640 1 -- 10.20.193.58:0/1010189872 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd44160f90 con 0x7fdd4415d870 2026-02-23T06:21:40.975 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.977+0000 7fdd49789640 1 -- 10.20.193.58:0/1010189872 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd44160580 con 0x7fdd4415d870 2026-02-23T06:21:40.975 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.978+0000 7fdd49789640 1 -- 10.20.193.58:0/1010189872 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd440b6d50 con 0x7fdd4415d870 2026-02-23T06:21:40.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.979+0000 7fdd40ff9640 1 -- 10.20.193.58:0/1010189872 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fdd38042410 con 0x7fdd4415d870 2026-02-23T06:21:40.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.980+0000 7fdd40ff9640 1 --2- 10.20.193.58:0/1010189872 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdd1407a6c0 0x7fdd1409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:40.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.980+0000 7fdd40ff9640 1 -- 10.20.193.58:0/1010189872 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7fdd380c3c80 con 0x7fdd4415d870 2026-02-23T06:21:40.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.980+0000 7fdd43fff640 1 --2- 10.20.193.58:0/1010189872 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdd1407a6c0 0x7fdd1409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:40.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.981+0000 7fdd40ff9640 1 -- 10.20.193.58:0/1010189872 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fdd38086f00 con 0x7fdd4415d870 2026-02-23T06:21:40.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:40.981+0000 7fdd43fff640 1 --2- 10.20.193.58:0/1010189872 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdd1407a6c0 0x7fdd1409ab70 secure :-1 s=READY pgs=103 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd44161570 tx=0x7fdd300026d0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:41.091 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.096+0000 7fdd49789640 1 -- 10.20.193.58:0/1010189872 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd441620b0 con 0x7fdd4415d870 2026-02-23T06:21:41.091 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.097+0000 7fdd40ff9640 1 -- 10.20.193.58:0/1010189872 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18600 (secure 0 0 0) 0x7fdd441620b0 con 0x7fdd4415d870 2026-02-23T06:21:41.092 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:41.092 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":25,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","created":"2026-02-23T06:21:02.010508+0000","modified":"2026-02-23T06:21:22.447858+0000","last_up_change":"2026-02-23T06:21:08.383048+0000","last_in_change":"2026-02-23T06:21:04.690899+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-23T06:21:10.389081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-23T06:21:16.080621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-23T06:21:16.401311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-23T06:21:20.153808+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"96cc0898-14bb-4d56-827a-8845bd4307c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6808","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6809","nonce":692913334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6810","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6811","nonce":692913334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6814","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6815","nonce":692913334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6812","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6813","nonce":692913334}]},"public_addr":"10.20.193.58:6809/692913334","cluster_addr":"10.20.193.58:6811/692913334","heartbeat_back_addr":"10.20.193.58:6815/692913334","heartbeat_front_addr":"10.20.193.58:6813/692913334","state":["exists","up"]},{"osd":1,"uuid":"bf665af4-6e3c-4cb3-899c-acede65c31f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6800","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6801","nonce":1850584280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6802","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6803","nonce":1850584280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6806","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6807","nonce":1850584280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6804","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6805","nonce":1850584280}]},"public_addr":"10.20.193.58:6801/1850584280","cluster_addr":"10.20.193.58:6803/1850584280","heartbeat_back_addr":"10.20.193.58:6807/1850584280","heartbeat_front_addr":"10.20.193.58:6805/1850584280","state":["exists","up"]},{"osd":2,"uuid":"2bcb3165-28ad-45d6-9a49-9d9da08501f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6823","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6825","nonce":4284600061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6826","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6827","nonce":4284600061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6830","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6831","nonce":4284600061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6828","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6829","nonce":4284600061}]},"public_addr":"10.20.193.58:6825/4284600061","cluster_addr":"10.20.193.58:6827/4284600061","heartbeat_back_addr":"10.20.193.58:6831/4284600061","heartbeat_front_addr":"10.20.193.58:6829/4284600061","state":["exists","up"]},{"osd":3,"uuid":"4750309a-5bf2-4f48-a550-ca677b0b0f61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6816","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6817","nonce":2858636994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6818","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6819","nonce":2858636994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6822","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6824","nonce":2858636994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6820","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6821","nonce":2858636994}]},"public_addr":"10.20.193.58:6817/2858636994","cluster_addr":"10.20.193.58:6819/2858636994","heartbeat_back_addr":"10.20.193.58:6824/2858636994","heartbeat_front_addr":"10.20.193.58:6821/2858636994","state":["exists","up"]},{"osd":4,"uuid":"5cbb50f2-4e49-46eb-bd84-d92706459d2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6803","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6805","nonce":1874834171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6807","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6809","nonce":1874834171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6816","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6817","nonce":1874834171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6812","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6814","nonce":1874834171}]},"public_addr":"10.20.193.93:6805/1874834171","cluster_addr":"10.20.193.93:6809/1874834171","heartbeat_back_addr":"10.20.193.93:6817/1874834171","heartbeat_front_addr":"10.20.193.93:6814/1874834171","state":["exists","up"]},{"osd":5,"uuid":"2806c775-4720-43a7-ab9f-85a4adb31098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6802","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6804","nonce":356968280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6806","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6808","nonce":356968280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6813","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6815","nonce":356968280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6810","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6811","nonce":356968280}]},"public_addr":"10.20.193.93:6804/356968280","cluster_addr":"10.20.193.93:6808/356968280","heartbeat_back_addr":"10.20.193.93:6815/356968280","heartbeat_front_addr":"10.20.193.93:6811/356968280","state":["exists","up"]},{"osd":6,"uuid":"aa03b46d-d30f-4b09-9251-c9514e8b8b6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6819","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6821","nonce":2948039088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6823","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6825","nonce":2948039088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6831","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6833","nonce":2948039088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6827","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6829","nonce":2948039088}]},"public_addr":"10.20.193.93:6821/2948039088","cluster_addr":"10.20.193.93:6825/2948039088","heartbeat_back_addr":"10.20.193.93:6833/2948039088","heartbeat_front_addr":"10.20.193.93:6829/2948039088","state":["exists","up"]},{"osd":7,"uuid":"b15519bf-2b7b-4fd5-8ef6-e09af0ad9817","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6818","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6820","nonce":2960650087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6822","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6824","nonce":2960650087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6830","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6832","nonce":2960650087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6826","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6828","nonce":2960650087}]},"public_addr":"10.20.193.93:6820/2960650087","cluster_addr":"10.20.193.93:6824/2960650087","heartbeat_back_addr":"10.20.193.93:6832/2960650087","heartbeat_front_addr":"10.20.193.93:6828/2960650087","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.717515+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.744114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.772247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.768341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.521808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.486005+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.480882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.473408+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"2","m":"2","plugin":"isa","technique":"reed_sol_van"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-23T06:21:41.093 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.098+0000 7fdd49789640 1 -- 10.20.193.58:0/1010189872 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdd1407a6c0 msgr2=0x7fdd1409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:41.093 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.098+0000 7fdd49789640 1 --2- 10.20.193.58:0/1010189872 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdd1407a6c0 0x7fdd1409ab70 secure :-1 s=READY pgs=103 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd44161570 tx=0x7fdd300026d0 comp rx=0 tx=0).stop 2026-02-23T06:21:41.093 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.098+0000 7fdd49789640 1 -- 10.20.193.58:0/1010189872 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdd4415d870 msgr2=0x7fdd4415f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:41.093 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.098+0000 7fdd49789640 1 --2- 10.20.193.58:0/1010189872 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdd4415d870 0x7fdd4415f9c0 secure :-1 s=READY pgs=159 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd3800aaa0 tx=0x7fdd38003d20 comp rx=0 tx=0).stop 2026-02-23T06:21:41.094 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.098+0000 7fdd49789640 1 -- 10.20.193.58:0/1010189872 shutdown_connections 2026-02-23T06:21:41.094 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.098+0000 7fdd49789640 1 --2- 10.20.193.58:0/1010189872 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdd1407a6c0 0x7fdd1409ab70 unknown :-1 s=CLOSED pgs=103 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:41.094 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.098+0000 7fdd49789640 1 --2- 10.20.193.58:0/1010189872 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdd4415d870 0x7fdd4415f9c0 unknown :-1 s=CLOSED pgs=159 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:41.094 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.098+0000 7fdd49789640 1 --2- 10.20.193.58:0/1010189872 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdd4415d4a0 0x7fdd44162390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:41.094 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.098+0000 7fdd49789640 1 --2- 10.20.193.58:0/1010189872 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdd440b6690 0x7fdd440561f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:41.094 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.098+0000 7fdd49789640 1 -- 10.20.193.58:0/1010189872 >> 10.20.193.58:0/1010189872 conn(0x7fdd440b3c20 msgr2=0x7fdd440aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:41.094 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.098+0000 7fdd49789640 1 -- 10.20.193.58:0/1010189872 shutdown_connections 2026-02-23T06:21:41.094 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.098+0000 7fdd49789640 1 -- 10.20.193.58:0/1010189872 wait complete. 2026-02-23T06:21:41.106 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2026-02-23T06:21:41.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.232+0000 7f401a5ad640 1 -- 10.20.193.58:0/2830026955 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f401415d870 msgr2=0x7f40140587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:41.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.232+0000 7f401a5ad640 1 --2- 10.20.193.58:0/2830026955 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f401415d870 0x7f40140587b0 secure :-1 s=READY pgs=160 gs=1 cs=0 l=1 c_cookie=16780789078328875799 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40140b5040 tx=0x7f400802f250 comp rx=0 tx=0).stop 2026-02-23T06:21:41.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.232+0000 7f401a5ad640 1 -- 10.20.193.58:0/2830026955 shutdown_connections 2026-02-23T06:21:41.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.232+0000 7f401a5ad640 1 --2- 10.20.193.58:0/2830026955 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f40140b6690 0x7f4014058cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:41.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.232+0000 7f401a5ad640 1 --2- 10.20.193.58:0/2830026955 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f401415d870 0x7f40140587b0 unknown :-1 s=CLOSED pgs=160 gs=1 cs=0 l=1 c_cookie=16780789078328875799 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:41.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.232+0000 7f401a5ad640 1 --2- 10.20.193.58:0/2830026955 >> v2:10.20.193.93:3300/0 conn(0x7f401415d4a0 0x7f40140affb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:41.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.232+0000 7f401a5ad640 1 -- 10.20.193.58:0/2830026955 >> 10.20.193.58:0/2830026955 conn(0x7f40140b3c20 msgr2=0x7f40140b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:41.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.232+0000 7f401a5ad640 1 -- 10.20.193.58:0/2830026955 shutdown_connections 2026-02-23T06:21:41.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.232+0000 7f401a5ad640 1 -- 10.20.193.58:0/2830026955 wait complete. 2026-02-23T06:21:41.230 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.233+0000 7f401a5ad640 1 Processor -- start 2026-02-23T06:21:41.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.233+0000 7f401a5ad640 1 -- start start 2026-02-23T06:21:41.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.234+0000 7f401a5ad640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f40140b6690 0x7f401413d720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:41.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.234+0000 7f401a5ad640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f401415d4a0 0x7f401413f480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:41.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.234+0000 7f401a5ad640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f401415d870 0x7f401415a570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:41.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.234+0000 7f401a5ad640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f401415f9c0 con 0x7f40140b6690 2026-02-23T06:21:41.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.234+0000 7f401a5ad640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f401413dc60 con 0x7f401415d4a0 2026-02-23T06:21:41.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.234+0000 7f401a5ad640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f401413f9c0 con 0x7f401415d870 2026-02-23T06:21:41.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.234+0000 7f40195ab640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f40140b6690 0x7f401413d720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:41.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.234+0000 7f4018daa640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f401415d4a0 0x7f401413f480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:41.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.234+0000 7f40195ab640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f40140b6690 0x7f401413d720 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:56914/0 (socket says 10.20.193.58:56914) 2026-02-23T06:21:41.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.234+0000 7f40195ab640 1 -- 10.20.193.58:0/3526582961 learned_addr learned my addr 10.20.193.58:0/3526582961 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:41.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.234+0000 7f4018daa640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f401415d4a0 0x7f401413f480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:59440/0 (socket says 10.20.193.58:59440) 2026-02-23T06:21:41.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.234+0000 7f4019dac640 1 --2- 10.20.193.58:0/3526582961 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f401415d870 0x7f401415a570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:41.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.234+0000 7f40195ab640 1 -- 10.20.193.58:0/3526582961 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f401415d870 msgr2=0x7f401415a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:41.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.234+0000 7f40195ab640 1 --2- 10.20.193.58:0/3526582961 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f401415d870 0x7f401415a570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:41.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.234+0000 7f40195ab640 1 -- 10.20.193.58:0/3526582961 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f401415d4a0 msgr2=0x7f401413f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:41.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.234+0000 7f40195ab640 1 --2- 10.20.193.58:0/3526582961 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f401415d4a0 0x7f401413f480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:41.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.234+0000 7f40195ab640 1 -- 10.20.193.58:0/3526582961 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4008009570 con 0x7f40140b6690 2026-02-23T06:21:41.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.234+0000 7f4019dac640 1 --2- 10.20.193.58:0/3526582961 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f401415d870 0x7f401415a570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:21:41.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.235+0000 7f40195ab640 1 --2- 10.20.193.58:0/3526582961 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f40140b6690 0x7f401413d720 secure :-1 s=READY pgs=161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4004009480 tx=0x7f400400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:41.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.235+0000 7f4001ffb640 1 -- 10.20.193.58:0/3526582961 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f400400cd40 con 0x7f40140b6690 2026-02-23T06:21:41.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.235+0000 7f4001ffb640 1 -- 10.20.193.58:0/3526582961 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4004004850 con 0x7f40140b6690 2026-02-23T06:21:41.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.235+0000 7f401a5ad640 1 -- 10.20.193.58:0/3526582961 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40141fe550 con 0x7f40140b6690 2026-02-23T06:21:41.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.235+0000 7f4001ffb640 1 -- 10.20.193.58:0/3526582961 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f400400cea0 con 0x7f40140b6690 2026-02-23T06:21:41.233 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.235+0000 7f401a5ad640 1 -- 10.20.193.58:0/3526582961 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f401415fc10 con 0x7f40140b6690 2026-02-23T06:21:41.233 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.235+0000 7f401a5ad640 1 -- 10.20.193.58:0/3526582961 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40140b7260 con 0x7f40140b6690 2026-02-23T06:21:41.234 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.237+0000 7f4001ffb640 1 -- 10.20.193.58:0/3526582961 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f400401f060 con 0x7f40140b6690 2026-02-23T06:21:41.234 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.238+0000 7f4001ffb640 1 --2- 10.20.193.58:0/3526582961 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3fe407a6c0 0x7f3fe409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:41.234 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.238+0000 7f4001ffb640 1 -- 10.20.193.58:0/3526582961 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f4004014070 con 0x7f40140b6690 2026-02-23T06:21:41.234 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.238+0000 7f4018daa640 1 --2- 10.20.193.58:0/3526582961 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3fe407a6c0 0x7f3fe409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:41.234 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.239+0000 7f4018daa640 1 --2- 10.20.193.58:0/3526582961 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3fe407a6c0 0x7f3fe409ab70 secure :-1 s=READY pgs=104 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40080023d0 tx=0x7f400803a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:41.234 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.239+0000 7f4001ffb640 1 -- 10.20.193.58:0/3526582961 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f4004060e20 con 0x7f40140b6690 2026-02-23T06:21:41.375 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.380+0000 7f401a5ad640 1 -- 10.20.193.58:0/3526582961 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40140b7e50 con 0x7f40140b6690 2026-02-23T06:21:41.375 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.380+0000 7f4001ffb640 1 -- 10.20.193.58:0/3526582961 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6886 (secure 0 0 0) 0x7f4004063f40 con 0x7f40140b6690 2026-02-23T06:21:41.375 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:41.376 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":9,"btime":"2026-02-23T06:21:35:181391+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4320,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.58:6836/332204623","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6834","nonce":332204623},{"type":"v1","addr":"10.20.193.58:6836","nonce":332204623}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4349,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6839/49797428","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6838","nonce":49797428},{"type":"v1","addr":"10.20.193.93:6839","nonce":49797428}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4355,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.58:6833/363105980","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6832","nonce":363105980},{"type":"v1","addr":"10.20.193.58:6833","nonce":363105980}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4438,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6835/3715244768","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6834","nonce":3715244768},{"type":"v1","addr":"10.20.193.93:6835","nonce":3715244768}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4444,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6837/3986540573","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6836","nonce":3986540573},{"type":"v1","addr":"10.20.193.93:6837","nonce":3986540573}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false,"allow_referent_inodes":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-23T06:21:17.428505+0000","modified":"2026-02-23T06:21:34.468900+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4468},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4468":{"gid":4468,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"10.20.193.58:6837/4266460647","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6835","nonce":4266460647},{"type":"v1","addr":"10.20.193.58:6837","nonce":4266460647}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4468,"qdb_cluster":[4468]},"id":1}]} 2026-02-23T06:21:41.377 INFO:teuthology.orchestra.run.trial058.stderr:dumped fsmap epoch 9 2026-02-23T06:21:41.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.381+0000 7f401a5ad640 1 -- 10.20.193.58:0/3526582961 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3fe407a6c0 msgr2=0x7f3fe409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:41.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.381+0000 7f401a5ad640 1 --2- 10.20.193.58:0/3526582961 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3fe407a6c0 0x7f3fe409ab70 secure :-1 s=READY pgs=104 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40080023d0 tx=0x7f400803a040 comp rx=0 tx=0).stop 2026-02-23T06:21:41.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.381+0000 7f401a5ad640 1 -- 10.20.193.58:0/3526582961 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f40140b6690 msgr2=0x7f401413d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:41.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.381+0000 7f401a5ad640 1 --2- 10.20.193.58:0/3526582961 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f40140b6690 0x7f401413d720 secure :-1 s=READY pgs=161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4004009480 tx=0x7f400400ee60 comp rx=0 tx=0).stop 2026-02-23T06:21:41.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.381+0000 7f401a5ad640 1 -- 10.20.193.58:0/3526582961 shutdown_connections 2026-02-23T06:21:41.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.381+0000 7f401a5ad640 1 --2- 10.20.193.58:0/3526582961 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3fe407a6c0 0x7f3fe409ab70 unknown :-1 s=CLOSED pgs=104 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:41.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.381+0000 7f401a5ad640 1 --2- 10.20.193.58:0/3526582961 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f401415d870 0x7f401415a570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:41.378 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.381+0000 7f401a5ad640 1 --2- 10.20.193.58:0/3526582961 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f401415d4a0 0x7f401413f480 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:41.378 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.381+0000 7f401a5ad640 1 --2- 10.20.193.58:0/3526582961 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f40140b6690 0x7f401413d720 unknown :-1 s=CLOSED pgs=161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:41.378 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.381+0000 7f401a5ad640 1 -- 10.20.193.58:0/3526582961 >> 10.20.193.58:0/3526582961 conn(0x7f40140b3c20 msgr2=0x7f401415bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:41.378 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.381+0000 7f401a5ad640 1 -- 10.20.193.58:0/3526582961 shutdown_connections 2026-02-23T06:21:41.378 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:41.381+0000 7f401a5ad640 1 -- 10.20.193.58:0/3526582961 wait complete. 2026-02-23T06:21:41.823 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:21:41.828 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:21:41.992 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False, 'allow_referent_inodes': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2026-02-23T06:21:17.428505+0000', 'modified': '2026-02-23T06:21:34.468900+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4468}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4468': {'gid': 4468, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '10.20.193.58:6837/4266460647', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.58:6835', 'nonce': 4266460647}, {'type': 'v1', 'addr': '10.20.193.58:6837', 'nonce': 4266460647}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4468, 'qdb_cluster': [4468]} 2026-02-23T06:21:41.992 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2026-02-23T06:21:41.992 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2026-02-23T06:21:42.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.119+0000 7f83af4c3640 1 -- 10.20.193.58:0/1138451000 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f83a815d870 msgr2=0x7f83a80587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:42.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.119+0000 7f83af4c3640 1 --2- 10.20.193.58:0/1138451000 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f83a815d870 0x7f83a80587b0 secure :-1 s=READY pgs=162 gs=1 cs=0 l=1 c_cookie=1221410197337644595 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f83a80b5040 tx=0x7f839c02f250 comp rx=0 tx=0).stop 2026-02-23T06:21:42.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.119+0000 7f83af4c3640 1 -- 10.20.193.58:0/1138451000 shutdown_connections 2026-02-23T06:21:42.115 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.119+0000 7f83af4c3640 1 --2- 10.20.193.58:0/1138451000 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f83a80b6690 0x7f83a8058cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.115 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.119+0000 7f83af4c3640 1 --2- 10.20.193.58:0/1138451000 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f83a815d870 0x7f83a80587b0 unknown :-1 s=CLOSED pgs=162 gs=1 cs=0 l=1 c_cookie=1221410197337644595 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.115 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.119+0000 7f83af4c3640 1 --2- 10.20.193.58:0/1138451000 >> v2:10.20.193.93:3300/0 conn(0x7f83a815d4a0 0x7f83a80affb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.115 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.119+0000 7f83af4c3640 1 -- 10.20.193.58:0/1138451000 >> 10.20.193.58:0/1138451000 conn(0x7f83a80b3c20 msgr2=0x7f83a80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:42.115 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.119+0000 7f83af4c3640 1 -- 10.20.193.58:0/1138451000 shutdown_connections 2026-02-23T06:21:42.115 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.119+0000 7f83af4c3640 1 -- 10.20.193.58:0/1138451000 wait complete. 2026-02-23T06:21:42.117 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.120+0000 7f83af4c3640 1 Processor -- start 2026-02-23T06:21:42.117 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.120+0000 7f83af4c3640 1 -- start start 2026-02-23T06:21:42.117 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.121+0000 7f83af4c3640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f83a80b6690 0x7f83a8160f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:42.117 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.121+0000 7f83af4c3640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f83a815d4a0 0x7f83a813aff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:42.117 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.121+0000 7f83af4c3640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f83a815d870 0x7f83a8159fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:42.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.121+0000 7f83af4c3640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f83a813ffd0 con 0x7f83a815d870 2026-02-23T06:21:42.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.121+0000 7f83af4c3640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f83a8162c70 con 0x7f83a815d4a0 2026-02-23T06:21:42.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.121+0000 7f83af4c3640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f83a813fcf0 con 0x7f83a80b6690 2026-02-23T06:21:42.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.121+0000 7f83aecc2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f83a815d870 0x7f83a8159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:42.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.121+0000 7f83aecc2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f83a815d870 0x7f83a8159fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:56930/0 (socket says 10.20.193.58:56930) 2026-02-23T06:21:42.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.121+0000 7f83aecc2640 1 -- 10.20.193.58:0/315781305 learned_addr learned my addr 10.20.193.58:0/315781305 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:42.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.121+0000 7f83adcc0640 1 --2- 10.20.193.58:0/315781305 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f83a815d4a0 0x7f83a813aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:42.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.121+0000 7f83ae4c1640 1 --2- 10.20.193.58:0/315781305 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f83a80b6690 0x7f83a8160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:42.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.121+0000 7f83aecc2640 1 -- 10.20.193.58:0/315781305 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f83a80b6690 msgr2=0x7f83a8160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:42.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.121+0000 7f83aecc2640 1 --2- 10.20.193.58:0/315781305 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f83a80b6690 0x7f83a8160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.121+0000 7f83aecc2640 1 -- 10.20.193.58:0/315781305 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f83a815d4a0 msgr2=0x7f83a813aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:42.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.121+0000 7f83aecc2640 1 --2- 10.20.193.58:0/315781305 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f83a815d4a0 0x7f83a813aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.119 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.121+0000 7f83aecc2640 1 -- 10.20.193.58:0/315781305 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839c009570 con 0x7f83a815d870 2026-02-23T06:21:42.119 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.122+0000 7f83aecc2640 1 --2- 10.20.193.58:0/315781305 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f83a815d870 0x7f83a8159fb0 secure :-1 s=READY pgs=163 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f83a400f940 tx=0x7f83a400fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:42.119 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.122+0000 7f838effd640 1 -- 10.20.193.58:0/315781305 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f83a400dce0 con 0x7f83a815d870 2026-02-23T06:21:42.119 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.122+0000 7f838effd640 1 -- 10.20.193.58:0/315781305 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f83a400de40 con 0x7f83a815d870 2026-02-23T06:21:42.119 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.122+0000 7f838effd640 1 -- 10.20.193.58:0/315781305 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f83a4005bb0 con 0x7f83a815d870 2026-02-23T06:21:42.119 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.122+0000 7f83af4c3640 1 -- 10.20.193.58:0/315781305 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83a813e1d0 con 0x7f83a815d870 2026-02-23T06:21:42.119 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.122+0000 7f83af4c3640 1 -- 10.20.193.58:0/315781305 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83a8162ec0 con 0x7f83a815d870 2026-02-23T06:21:42.120 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.124+0000 7f838effd640 1 -- 10.20.193.58:0/315781305 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f83a4020060 con 0x7f83a815d870 2026-02-23T06:21:42.120 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.125+0000 7f838effd640 1 --2- 10.20.193.58:0/315781305 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f837807a640 0x7f837809aaf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:42.120 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.125+0000 7f838effd640 1 -- 10.20.193.58:0/315781305 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f83a4015070 con 0x7f83a815d870 2026-02-23T06:21:42.120 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.125+0000 7f83ae4c1640 1 --2- 10.20.193.58:0/315781305 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f837807a640 0x7f837809aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:42.120 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.126+0000 7f83ae4c1640 1 --2- 10.20.193.58:0/315781305 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f837807a640 0x7f837809aaf0 secure :-1 s=READY pgs=105 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8398004740 tx=0x7f8398005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:42.121 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.127+0000 7f83b2e48e00 1 Processor -- start 2026-02-23T06:21:42.121 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.127+0000 7f83b2e48e00 1 -- start start 2026-02-23T06:21:42.124 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.127+0000 7f83b2e48e00 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x558522174880 0x5585221794f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:42.124 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.127+0000 7f83b2e48e00 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x558522175540 0x558522177ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:42.124 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.128+0000 7f83b2e48e00 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x55852217a3e0 0x558522178010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:42.124 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.128+0000 7f83b2e48e00 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x55852206a0d0 con 0x558522175540 2026-02-23T06:21:42.124 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.128+0000 7f83b2e48e00 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x558522065e00 con 0x558522174880 2026-02-23T06:21:42.124 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.128+0000 7f83b2e48e00 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x55852205ff60 con 0x55852217a3e0 2026-02-23T06:21:42.124 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.128+0000 7f83ae4c1640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x558522174880 0x5585221794f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:42.124 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.128+0000 7f83ae4c1640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x558522174880 0x5585221794f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:59476/0 (socket says 10.20.193.58:59476) 2026-02-23T06:21:42.124 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.128+0000 7f83ae4c1640 1 -- 10.20.193.58:0/4217630016 learned_addr learned my addr 10.20.193.58:0/4217630016 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:42.124 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.128+0000 7f83adcc0640 1 --2- 10.20.193.58:0/4217630016 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x558522175540 0x558522177ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:42.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.128+0000 7f83aecc2640 1 --2- 10.20.193.58:0/4217630016 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x55852217a3e0 0x558522178010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:42.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.128+0000 7f83ae4c1640 1 -- 10.20.193.58:0/4217630016 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x55852217a3e0 msgr2=0x558522178010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-23T06:21:42.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.128+0000 7f83ae4c1640 1 --2- 10.20.193.58:0/4217630016 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x55852217a3e0 0x558522178010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.128+0000 7f83ae4c1640 1 -- 10.20.193.58:0/4217630016 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x558522175540 msgr2=0x558522177ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-23T06:21:42.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.128+0000 7f83ae4c1640 1 --2- 10.20.193.58:0/4217630016 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x558522175540 0x558522177ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.128+0000 7f83ae4c1640 1 -- 10.20.193.58:0/4217630016 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55852200b2a0 con 0x558522174880 2026-02-23T06:21:42.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.128+0000 7f83adcc0640 1 --2- 10.20.193.58:0/4217630016 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x558522175540 0x558522177ad0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:42.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.128+0000 7f83ae4c1640 1 --2- 10.20.193.58:0/4217630016 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x558522174880 0x5585221794f0 secure :-1 s=READY pgs=161 gs=1 cs=0 l=1 c_cookie=3802249024490380509 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8398009cd0 tx=0x7f8398014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34c44d57b4531cdd server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:42.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.129+0000 7f836e3ff640 1 -- 10.20.193.58:0/4217630016 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8398011e60 con 0x558522174880 2026-02-23T06:21:42.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.129+0000 7f836e3ff640 1 -- 10.20.193.58:0/4217630016 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8398004850 con 0x558522174880 2026-02-23T06:21:42.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.129+0000 7f83b2e48e00 1 -- 10.20.193.58:0/4217630016 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x558522174880 msgr2=0x5585221794f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:42.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.129+0000 7f83b2e48e00 1 --2- 10.20.193.58:0/4217630016 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x558522174880 0x5585221794f0 secure :-1 s=READY pgs=161 gs=1 cs=0 l=1 c_cookie=3802249024490380509 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8398009cd0 tx=0x7f8398014000 comp rx=0 tx=0).stop 2026-02-23T06:21:42.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.129+0000 7f83b2e48e00 1 -- 10.20.193.58:0/4217630016 shutdown_connections 2026-02-23T06:21:42.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.129+0000 7f83b2e48e00 1 --2- 10.20.193.58:0/4217630016 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x55852217a3e0 0x558522178010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.129+0000 7f83b2e48e00 1 --2- 10.20.193.58:0/4217630016 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x558522175540 0x558522177ad0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.129+0000 7f83b2e48e00 1 --2- 10.20.193.58:0/4217630016 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x558522174880 0x5585221794f0 unknown :-1 s=CLOSED pgs=161 gs=1 cs=0 l=1 c_cookie=3802249024490380509 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.129+0000 7f83b2e48e00 1 -- 10.20.193.58:0/4217630016 >> 10.20.193.58:0/4217630016 conn(0x558522073a60 msgr2=0x558522179cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:42.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.129+0000 7f83b2e48e00 1 -- 10.20.193.58:0/4217630016 shutdown_connections 2026-02-23T06:21:42.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.129+0000 7f83b2e48e00 1 -- 10.20.193.58:0/4217630016 wait complete. 2026-02-23T06:21:42.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.131+0000 7f83b2e48e00 1 -- start start 2026-02-23T06:21:42.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.131+0000 7f83b2e48e00 1 Processor -- start 2026-02-23T06:21:42.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.131+0000 7f83b2e48e00 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x558522174880 0x558522160c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:42.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.131+0000 7f83b2e48e00 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x558522175540 0x5585221b6770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:42.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.131+0000 7f83b2e48e00 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x55852217a3e0 0x558522193490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:42.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.131+0000 7f83b2e48e00 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x558522160800 con 0x558522175540 2026-02-23T06:21:42.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.131+0000 7f83b2e48e00 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x5585221611d0 con 0x558522174880 2026-02-23T06:21:42.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.131+0000 7f83b2e48e00 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x5585221632a0 con 0x55852217a3e0 2026-02-23T06:21:42.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.132+0000 7f83ae4c1640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x558522174880 0x558522160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:42.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.132+0000 7f83aecc2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x55852217a3e0 0x558522193490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:42.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.132+0000 7f83adcc0640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x558522175540 0x5585221b6770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:42.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.132+0000 7f83aecc2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x55852217a3e0 0x558522193490 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:59070/0 (socket says 10.20.193.58:59070) 2026-02-23T06:21:42.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.132+0000 7f83aecc2640 1 -- 10.20.193.58:0/1825116053 learned_addr learned my addr 10.20.193.58:0/1825116053 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:42.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.132+0000 7f83ae4c1640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x558522174880 0x558522160c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:59482/0 (socket says 10.20.193.58:59482) 2026-02-23T06:21:42.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.132+0000 7f83ae4c1640 1 -- 10.20.193.58:0/1825116053 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x55852217a3e0 msgr2=0x558522193490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-23T06:21:42.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.132+0000 7f83ae4c1640 1 --2- 10.20.193.58:0/1825116053 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x55852217a3e0 0x558522193490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.132+0000 7f83ae4c1640 1 -- 10.20.193.58:0/1825116053 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x558522175540 msgr2=0x5585221b6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-23T06:21:42.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.132+0000 7f83ae4c1640 1 --2- 10.20.193.58:0/1825116053 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x558522175540 0x5585221b6770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.132+0000 7f83ae4c1640 1 -- 10.20.193.58:0/1825116053 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8398009970 con 0x558522174880 2026-02-23T06:21:42.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.132+0000 7f83ae4c1640 1 --2- 10.20.193.58:0/1825116053 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x558522174880 0x558522160c90 secure :-1 s=READY pgs=162 gs=3 cs=0 l=1 c_cookie=18076881350577246012 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8398004220 tx=0x7f8398005500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=faddfbd01c0a4f3c server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:42.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.132+0000 7f835f7fe640 10 client.0 ms_handle_connect on v2:10.20.193.93:3300/0 2026-02-23T06:21:42.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.132+0000 7f835f7fe640 1 -- 10.20.193.58:0/1825116053 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f83980056f0 con 0x558522174880 2026-02-23T06:21:42.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.132+0000 7f835f7fe640 1 -- 10.20.193.58:0/1825116053 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f839801a690 con 0x558522174880 2026-02-23T06:21:42.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.132+0000 7f835f7fe640 1 -- 10.20.193.58:0/1825116053 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f839801a820 con 0x558522174880 2026-02-23T06:21:42.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.132+0000 7f83b2e48e00 1 -- 10.20.193.58:0/1825116053 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83a80b5b30 con 0x558522174880 2026-02-23T06:21:42.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.133+0000 7f835f7fe640 1 -- 10.20.193.58:0/1825116053 <== mon.1 v2:10.20.193.93:3300/0 4 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f839802fdf0 con 0x558522174880 2026-02-23T06:21:42.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.133+0000 7f835f7fe640 10 client.4852 inactive, discarding osd_map(25..25 src has 1..25) 2026-02-23T06:21:42.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.133+0000 7f83b2e48e00 10 client.4852 _ll_register_callbacks cb 0x558521fea280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-23T06:21:42.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.133+0000 7f83b2e48e00 1 -- 10.20.193.58:0/1825116053 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558521d90460 con 0x558522174880 2026-02-23T06:21:42.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.133+0000 7f835f7fe640 1 -- 10.20.193.58:0/1825116053 <== mon.1 v2:10.20.193.93:3300/0 5 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f839801a980 con 0x558522174880 2026-02-23T06:21:42.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.133+0000 7f83b2e48e00 10 client.4852 fetch_fsmap learned FSMap version 9 2026-02-23T06:21:42.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.133+0000 7f83b2e48e00 1 -- 10.20.193.58:0/1825116053 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({fsmap=9}) -- 0x558521fe3290 con 0x558522174880 2026-02-23T06:21:42.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.133+0000 7f835f7fe640 1 -- 10.20.193.58:0/1825116053 <== mon.1 v2:10.20.193.93:3300/0 6 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f8398035060 con 0x558522174880 2026-02-23T06:21:42.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.133+0000 7f83b2e48e00 10 client.4852 fetch_fsmap finished waiting for FSMap version 9 2026-02-23T06:21:42.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.133+0000 7f83b2e48e00 10 client.4852 resolve_mds: resolved name 'e' to daemon mds.e 2026-02-23T06:21:42.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.133+0000 7f83b2e48e00 20 client.4852 populate_metadata read hostname 'trial058' 2026-02-23T06:21:42.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.133+0000 7f83b2e48e00 1 --2- 10.20.193.58:0/1825116053 >> [v2:10.20.193.58:6835/4266460647,v1:10.20.193.58:6837/4266460647] conn(0x5585221b3150 0x558522162a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:42.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.133+0000 7f83b2e48e00 4 client.4852 mds_command: new command op to 4468 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-23T06:21:42.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.133+0000 7f83b2e48e00 1 -- 10.20.193.58:0/1825116053 --> [v2:10.20.193.58:6835/4266460647,v1:10.20.193.58:6837/4266460647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585220559a0 con 0x5585221b3150 2026-02-23T06:21:42.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.133+0000 7f83adcc0640 1 --2- 10.20.193.58:0/1825116053 >> [v2:10.20.193.58:6835/4266460647,v1:10.20.193.58:6837/4266460647] conn(0x5585221b3150 0x558522162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:42.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.134+0000 7f83adcc0640 1 --2- 10.20.193.58:0/1825116053 >> [v2:10.20.193.58:6835/4266460647,v1:10.20.193.58:6837/4266460647] conn(0x5585221b3150 0x558522162a50 crc :-1 s=READY pgs=18 gs=4 cs=0 l=0 c_cookie=17151283853794810871 s_cookie=17227235732838476702 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee0599cb2b551bf7 server_cookie=ef136fa00dc0eb9e in_seq=0 out_seq=0 2026-02-23T06:21:42.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.134+0000 7f835f7fe640 10 client.4852 ms_handle_connect on v2:10.20.193.58:6835/4266460647 2026-02-23T06:21:42.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.134+0000 7f835f7fe640 1 -- 10.20.193.58:0/1825116053 <== mds.0 v2:10.20.193.58:6835/4266460647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5585220559a0 con 0x5585221b3150 2026-02-23T06:21:42.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.134+0000 7f835f7fe640 10 client.4852 handle_command_reply: tid=0 2026-02-23T06:21:42.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.134+0000 7f83b2e48e00 1 client.4852 shutdown 2026-02-23T06:21:42.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.135+0000 7f83b2e48e00 1 -- 10.20.193.58:0/1825116053 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x558522174880 msgr2=0x558522160c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:42.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.135+0000 7f83b2e48e00 1 --2- 10.20.193.58:0/1825116053 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x558522174880 0x558522160c90 secure :-1 s=READY pgs=162 gs=3 cs=0 l=1 c_cookie=18076881350577246012 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8398004220 tx=0x7f8398005500 comp rx=0 tx=0).stop 2026-02-23T06:21:42.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.135+0000 7f83b2e48e00 1 -- 10.20.193.58:0/1825116053 shutdown_connections 2026-02-23T06:21:42.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.135+0000 7f83b2e48e00 1 --2- 10.20.193.58:0/1825116053 >> [v2:10.20.193.58:6835/4266460647,v1:10.20.193.58:6837/4266460647] conn(0x5585221b3150 0x558522162a50 crc :-1 s=READY pgs=18 gs=4 cs=0 l=0 c_cookie=17151283853794810871 s_cookie=17227235732838476702 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.135+0000 7f83b2e48e00 1 --2- 10.20.193.58:0/1825116053 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x55852217a3e0 0x558522193490 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.135+0000 7f83b2e48e00 1 --2- 10.20.193.58:0/1825116053 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x558522175540 0x5585221b6770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.135+0000 7f83b2e48e00 1 --2- 10.20.193.58:0/1825116053 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x558522174880 0x558522160c90 unknown :-1 s=CLOSED pgs=162 gs=3 cs=0 l=1 c_cookie=18076881350577246012 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.135+0000 7f83b2e48e00 1 -- 10.20.193.58:0/1825116053 >> 10.20.193.58:0/1825116053 conn(0x558522073a60 msgr2=0x558522197ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:42.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.135+0000 7f835f7fe640 0 client.4852 ms_handle_reset on v2:10.20.193.58:6835/4266460647 2026-02-23T06:21:42.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.135+0000 7f83b2e48e00 1 -- 10.20.193.58:0/1825116053 shutdown_connections 2026-02-23T06:21:42.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.135+0000 7f83b2e48e00 1 -- 10.20.193.58:0/1825116053 wait complete. 2026-02-23T06:21:42.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.135+0000 7f83b2e48e00 20 client.4852 trim_cache size 0 max 16384 2026-02-23T06:21:42.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.144+0000 7f83b2e48e00 1 Processor -- start 2026-02-23T06:21:42.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.144+0000 7f83b2e48e00 1 -- start start 2026-02-23T06:21:42.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.145+0000 7f83b2e48e00 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x558522174880 0x558522193030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:42.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.145+0000 7f83b2e48e00 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x558522175540 0x55852216fe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:42.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.145+0000 7f83b2e48e00 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x55852217a3e0 0x558522170380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:42.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.145+0000 7f83b2e48e00 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x55852205db90 con 0x558522175540 2026-02-23T06:21:42.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.145+0000 7f83b2e48e00 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x558521cfd3b0 con 0x558522174880 2026-02-23T06:21:42.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.145+0000 7f83b2e48e00 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x5585220c2160 con 0x55852217a3e0 2026-02-23T06:21:42.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.145+0000 7f83aecc2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x55852217a3e0 0x558522170380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:42.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.145+0000 7f83ae4c1640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x558522174880 0x558522193030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:42.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.145+0000 7f83aecc2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x55852217a3e0 0x558522170380 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:59076/0 (socket says 10.20.193.58:59076) 2026-02-23T06:21:42.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.145+0000 7f83aecc2640 1 -- 10.20.193.58:0/7680212 learned_addr learned my addr 10.20.193.58:0/7680212 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:42.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.145+0000 7f83adcc0640 1 --2- 10.20.193.58:0/7680212 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x558522175540 0x55852216fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:42.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.145+0000 7f83aecc2640 1 -- 10.20.193.58:0/7680212 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x558522174880 msgr2=0x558522193030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-23T06:21:42.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.145+0000 7f83aecc2640 1 --2- 10.20.193.58:0/7680212 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x558522174880 0x558522193030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.145+0000 7f83aecc2640 1 -- 10.20.193.58:0/7680212 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x558522175540 msgr2=0x55852216fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-23T06:21:42.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.145+0000 7f83aecc2640 1 --2- 10.20.193.58:0/7680212 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x558522175540 0x55852216fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.145+0000 7f83aecc2640 1 -- 10.20.193.58:0/7680212 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558521ff5510 con 0x55852217a3e0 2026-02-23T06:21:42.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.145+0000 7f83adcc0640 1 --2- 10.20.193.58:0/7680212 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x558522175540 0x55852216fe40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:42.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.145+0000 7f83aecc2640 1 --2- 10.20.193.58:0/7680212 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x55852217a3e0 0x558522170380 secure :-1 s=READY pgs=78 gs=1 cs=0 l=1 c_cookie=12156353467823711510 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f83a409ce30 tx=0x7f83a4061040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8b40b1265b86516 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:42.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.146+0000 7f836dbfe640 1 -- 10.20.193.58:0/7680212 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f83a40707d0 con 0x55852217a3e0 2026-02-23T06:21:42.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.146+0000 7f836dbfe640 1 -- 10.20.193.58:0/7680212 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f83a406b150 con 0x55852217a3e0 2026-02-23T06:21:42.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.146+0000 7f836dbfe640 1 -- 10.20.193.58:0/7680212 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f83a4065500 con 0x55852217a3e0 2026-02-23T06:21:42.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.146+0000 7f83b2e48e00 1 -- 10.20.193.58:0/7680212 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x55852217a3e0 msgr2=0x558522170380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:42.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.146+0000 7f83b2e48e00 1 --2- 10.20.193.58:0/7680212 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x55852217a3e0 0x558522170380 secure :-1 s=READY pgs=78 gs=1 cs=0 l=1 c_cookie=12156353467823711510 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f83a409ce30 tx=0x7f83a4061040 comp rx=0 tx=0).stop 2026-02-23T06:21:42.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.146+0000 7f83b2e48e00 1 -- 10.20.193.58:0/7680212 shutdown_connections 2026-02-23T06:21:42.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.146+0000 7f83b2e48e00 1 --2- 10.20.193.58:0/7680212 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x55852217a3e0 0x558522170380 unknown :-1 s=CLOSED pgs=78 gs=1 cs=0 l=1 c_cookie=12156353467823711510 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.146+0000 7f83b2e48e00 1 --2- 10.20.193.58:0/7680212 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x558522175540 0x55852216fe40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.146+0000 7f83b2e48e00 1 --2- 10.20.193.58:0/7680212 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x558522174880 0x558522193030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.146+0000 7f83b2e48e00 1 -- 10.20.193.58:0/7680212 >> 10.20.193.58:0/7680212 conn(0x558522073a60 msgr2=0x558522162a50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:42.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.146+0000 7f83b2e48e00 1 -- 10.20.193.58:0/7680212 shutdown_connections 2026-02-23T06:21:42.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.146+0000 7f83b2e48e00 1 -- 10.20.193.58:0/7680212 wait complete. 2026-02-23T06:21:42.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.146+0000 7f83b2e48e00 1 -- start start 2026-02-23T06:21:42.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.147+0000 7f83b2e48e00 1 Processor -- start 2026-02-23T06:21:42.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.147+0000 7f83b2e48e00 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x558522174880 0x5585221aba20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:42.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.147+0000 7f83b2e48e00 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x558522175540 0x5585222170d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:42.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.147+0000 7f83b2e48e00 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x55852217a3e0 0x558522177730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:42.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.147+0000 7f83b2e48e00 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x5585221ad250 con 0x558522174880 2026-02-23T06:21:42.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.147+0000 7f83b2e48e00 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x5585221fc5d0 con 0x55852217a3e0 2026-02-23T06:21:42.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.147+0000 7f83b2e48e00 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x55852215e450 con 0x558522175540 2026-02-23T06:21:42.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.147+0000 7f83ae4c1640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x558522174880 0x5585221aba20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:42.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.147+0000 7f83ae4c1640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x558522174880 0x5585221aba20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:56954/0 (socket says 10.20.193.58:56954) 2026-02-23T06:21:42.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.147+0000 7f83ae4c1640 1 -- 10.20.193.58:0/563367138 learned_addr learned my addr 10.20.193.58:0/563367138 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:42.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.147+0000 7f83aecc2640 1 --2- 10.20.193.58:0/563367138 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x55852217a3e0 0x558522177730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:42.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.148+0000 7f83ae4c1640 1 -- 10.20.193.58:0/563367138 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x558522175540 msgr2=0x5585222170d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-23T06:21:42.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.148+0000 7f83adcc0640 1 --2- 10.20.193.58:0/563367138 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x558522175540 0x5585222170d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:42.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.148+0000 7f83ae4c1640 1 --2- 10.20.193.58:0/563367138 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x558522175540 0x5585222170d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.148+0000 7f83ae4c1640 1 -- 10.20.193.58:0/563367138 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x55852217a3e0 msgr2=0x558522177730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-23T06:21:42.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.148+0000 7f83ae4c1640 1 --2- 10.20.193.58:0/563367138 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x55852217a3e0 0x558522177730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.148+0000 7f83ae4c1640 1 -- 10.20.193.58:0/563367138 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a8162ec0 con 0x558522174880 2026-02-23T06:21:42.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.148+0000 7f83aecc2640 1 --2- 10.20.193.58:0/563367138 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x55852217a3e0 0x558522177730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:42.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.148+0000 7f83ae4c1640 1 --2- 10.20.193.58:0/563367138 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x558522174880 0x5585221aba20 secure :-1 s=READY pgs=164 gs=1 cs=0 l=1 c_cookie=13541720087004317613 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8398009940 tx=0x7f839800e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbeddaac09aa07ad server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:42.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.148+0000 7f835f7fe640 10 client.0 ms_handle_connect on v2:10.20.193.58:3300/0 2026-02-23T06:21:42.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.148+0000 7f835f7fe640 1 -- 10.20.193.58:0/563367138 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f839801aee0 con 0x558522174880 2026-02-23T06:21:42.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.148+0000 7f835f7fe640 1 -- 10.20.193.58:0/563367138 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x558521d90460 con 0x558522174880 2026-02-23T06:21:42.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.148+0000 7f83b2e48e00 1 -- 10.20.193.58:0/563367138 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f839c02fbf0 con 0x558522174880 2026-02-23T06:21:42.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.148+0000 7f835f7fe640 1 -- 10.20.193.58:0/563367138 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8398041470 con 0x558522174880 2026-02-23T06:21:42.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.148+0000 7f83b2e48e00 10 client.4716 _ll_register_callbacks cb 0x558521fea280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-23T06:21:42.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.148+0000 7f83b2e48e00 1 -- 10.20.193.58:0/563367138 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8398004850 con 0x558522174880 2026-02-23T06:21:42.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.149+0000 7f835f7fe640 1 -- 10.20.193.58:0/563367138 <== mon.0 v2:10.20.193.58:3300/0 4 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f839802e440 con 0x558522174880 2026-02-23T06:21:42.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.149+0000 7f835f7fe640 1 -- 10.20.193.58:0/563367138 <== mon.0 v2:10.20.193.58:3300/0 5 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f839802e600 con 0x558522174880 2026-02-23T06:21:42.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.149+0000 7f83b2e48e00 10 client.4716 fetch_fsmap learned FSMap version 9 2026-02-23T06:21:42.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.149+0000 7f83b2e48e00 1 -- 10.20.193.58:0/563367138 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({fsmap=9}) -- 0x558521fefdb0 con 0x558522174880 2026-02-23T06:21:42.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.149+0000 7f835f7fe640 1 -- 10.20.193.58:0/563367138 <== mon.0 v2:10.20.193.58:3300/0 6 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f839802e760 con 0x558522174880 2026-02-23T06:21:42.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.149+0000 7f83b2e48e00 10 client.4716 fetch_fsmap finished waiting for FSMap version 9 2026-02-23T06:21:42.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.149+0000 7f83b2e48e00 10 client.4716 resolve_mds: resolved name 'e' to daemon mds.e 2026-02-23T06:21:42.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.149+0000 7f83b2e48e00 20 client.4716 populate_metadata read hostname 'trial058' 2026-02-23T06:21:42.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.149+0000 7f83b2e48e00 1 --2- 10.20.193.58:0/563367138 >> [v2:10.20.193.58:6835/4266460647,v1:10.20.193.58:6837/4266460647] conn(0x558522134190 0x558522134560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:42.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.149+0000 7f83b2e48e00 4 client.4716 mds_command: new command op to 4468 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-23T06:21:42.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.149+0000 7f83b2e48e00 1 -- 10.20.193.58:0/563367138 --> [v2:10.20.193.58:6835/4266460647,v1:10.20.193.58:6837/4266460647] -- command(tid 0: {"prefix": "status"}) -- 0x558521ddd960 con 0x558522134190 2026-02-23T06:21:42.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.149+0000 7f83adcc0640 1 --2- 10.20.193.58:0/563367138 >> [v2:10.20.193.58:6835/4266460647,v1:10.20.193.58:6837/4266460647] conn(0x558522134190 0x558522134560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:42.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.150+0000 7f83adcc0640 1 --2- 10.20.193.58:0/563367138 >> [v2:10.20.193.58:6835/4266460647,v1:10.20.193.58:6837/4266460647] conn(0x558522134190 0x558522134560 crc :-1 s=READY pgs=19 gs=4 cs=0 l=0 c_cookie=15446415005585395063 s_cookie=752375636989390151 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d65cb09be52e4d77 server_cookie=a70f9a7d4692d47 in_seq=0 out_seq=0 2026-02-23T06:21:42.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.150+0000 7f835f7fe640 10 client.4716 ms_handle_connect on v2:10.20.193.58:6835/4266460647 2026-02-23T06:21:42.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.150+0000 7f835f7fe640 1 -- 10.20.193.58:0/563367138 <== mds.0 v2:10.20.193.58:6835/4266460647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1051 (crc 0 0 0) 0x558521ddd960 con 0x558522134190 2026-02-23T06:21:42.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.150+0000 7f835f7fe640 10 client.4716 handle_command_reply: tid=0 2026-02-23T06:21:42.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.150+0000 7f83b2e48e00 1 client.4716 shutdown 2026-02-23T06:21:42.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.150+0000 7f83b2e48e00 1 -- 10.20.193.58:0/563367138 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x558522174880 msgr2=0x5585221aba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:42.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.150+0000 7f83b2e48e00 1 --2- 10.20.193.58:0/563367138 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x558522174880 0x5585221aba20 secure :-1 s=READY pgs=164 gs=1 cs=0 l=1 c_cookie=13541720087004317613 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8398009940 tx=0x7f839800e000 comp rx=0 tx=0).stop 2026-02-23T06:21:42.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.150+0000 7f83b2e48e00 1 -- 10.20.193.58:0/563367138 shutdown_connections 2026-02-23T06:21:42.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.150+0000 7f83b2e48e00 1 --2- 10.20.193.58:0/563367138 >> [v2:10.20.193.58:6835/4266460647,v1:10.20.193.58:6837/4266460647] conn(0x558522134190 0x558522134560 crc :-1 s=READY pgs=19 gs=4 cs=0 l=0 c_cookie=15446415005585395063 s_cookie=752375636989390151 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.150+0000 7f83b2e48e00 1 --2- 10.20.193.58:0/563367138 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x55852217a3e0 0x558522177730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.150+0000 7f83b2e48e00 1 --2- 10.20.193.58:0/563367138 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x558522175540 0x5585222170d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.150+0000 7f83b2e48e00 1 --2- 10.20.193.58:0/563367138 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x558522174880 0x5585221aba20 unknown :-1 s=CLOSED pgs=164 gs=1 cs=0 l=1 c_cookie=13541720087004317613 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.150+0000 7f835f7fe640 0 client.4716 ms_handle_reset on v2:10.20.193.58:6835/4266460647 2026-02-23T06:21:42.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.150+0000 7f83b2e48e00 1 -- 10.20.193.58:0/563367138 >> 10.20.193.58:0/563367138 conn(0x558522073a60 msgr2=0x558522174c50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:42.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.150+0000 7f83b2e48e00 1 -- 10.20.193.58:0/563367138 shutdown_connections 2026-02-23T06:21:42.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.150+0000 7f83b2e48e00 1 -- 10.20.193.58:0/563367138 wait complete. 2026-02-23T06:21:42.152 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.151+0000 7f83b2e48e00 20 client.4716 trim_cache size 0 max 16384 2026-02-23T06:21:42.152 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:21:42.152 INFO:teuthology.orchestra.run.trial058.stdout: "cluster_fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:21:42.152 INFO:teuthology.orchestra.run.trial058.stdout: "whoami": 0, 2026-02-23T06:21:42.152 INFO:teuthology.orchestra.run.trial058.stdout: "id": 4468, 2026-02-23T06:21:42.152 INFO:teuthology.orchestra.run.trial058.stdout: "want_state": "up:active", 2026-02-23T06:21:42.152 INFO:teuthology.orchestra.run.trial058.stdout: "state": "up:active", 2026-02-23T06:21:42.153 INFO:teuthology.orchestra.run.trial058.stdout: "fs_name": "cephfs", 2026-02-23T06:21:42.153 INFO:teuthology.orchestra.run.trial058.stdout: "rank_uptime": 24.009658000000002, 2026-02-23T06:21:42.153 INFO:teuthology.orchestra.run.trial058.stdout: "mdsmap_epoch": 9, 2026-02-23T06:21:42.153 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap_epoch": 25, 2026-02-23T06:21:42.153 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap_epoch_barrier": 25, 2026-02-23T06:21:42.153 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 29.036689833000001, 2026-02-23T06:21:42.153 INFO:teuthology.orchestra.run.trial058.stdout: "sysinfo": { 2026-02-23T06:21:42.153 INFO:teuthology.orchestra.run.trial058.stdout: "arch": "x86_64", 2026-02-23T06:21:42.153 INFO:teuthology.orchestra.run.trial058.stdout: "ceph_release": "tentacle", 2026-02-23T06:21:42.153 INFO:teuthology.orchestra.run.trial058.stdout: "ceph_version": "ceph version 20.3.0-5449-gb60f8651 (b60f86513d744c550fab39595f0905abce2bdd7d) tentacle (dev - RelWithDebInfo)", 2026-02-23T06:21:42.153 INFO:teuthology.orchestra.run.trial058.stdout: "ceph_version_short": "20.3.0-5449-gb60f8651", 2026-02-23T06:21:42.153 INFO:teuthology.orchestra.run.trial058.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-23T06:21:42.154 INFO:teuthology.orchestra.run.trial058.stdout: "distro": "centos", 2026-02-23T06:21:42.154 INFO:teuthology.orchestra.run.trial058.stdout: "distro_description": "CentOS Stream 9", 2026-02-23T06:21:42.154 INFO:teuthology.orchestra.run.trial058.stdout: "distro_version": "9", 2026-02-23T06:21:42.154 INFO:teuthology.orchestra.run.trial058.stdout: "hostname": "trial058", 2026-02-23T06:21:42.154 INFO:teuthology.orchestra.run.trial058.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Feb 12 10:25:42 EST 2026", 2026-02-23T06:21:42.154 INFO:teuthology.orchestra.run.trial058.stdout: "kernel_version": "6.19.0-g8dec4b357aab", 2026-02-23T06:21:42.154 INFO:teuthology.orchestra.run.trial058.stdout: "mem_swap_kb": "8388604", 2026-02-23T06:21:42.154 INFO:teuthology.orchestra.run.trial058.stdout: "mem_total_kb": "130448332", 2026-02-23T06:21:42.154 INFO:teuthology.orchestra.run.trial058.stdout: "os": "Linux" 2026-02-23T06:21:42.154 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:42.154 INFO:teuthology.orchestra.run.trial058.stdout: "endian": "little" 2026-02-23T06:21:42.154 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:21:42.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.151+0000 7f83af4c3640 1 -- 10.20.193.58:0/315781305 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f837807a640 msgr2=0x7f837809aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:42.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.151+0000 7f83af4c3640 1 --2- 10.20.193.58:0/315781305 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f837807a640 0x7f837809aaf0 secure :-1 s=READY pgs=105 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8398004740 tx=0x7f8398005f90 comp rx=0 tx=0).stop 2026-02-23T06:21:42.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.151+0000 7f83af4c3640 1 -- 10.20.193.58:0/315781305 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f83a815d870 msgr2=0x7f83a8159fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:42.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.151+0000 7f83af4c3640 1 --2- 10.20.193.58:0/315781305 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f83a815d870 0x7f83a8159fb0 secure :-1 s=READY pgs=163 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f83a400f940 tx=0x7f83a400fe10 comp rx=0 tx=0).stop 2026-02-23T06:21:42.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.151+0000 7f83af4c3640 1 -- 10.20.193.58:0/315781305 shutdown_connections 2026-02-23T06:21:42.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.151+0000 7f83af4c3640 1 --2- 10.20.193.58:0/315781305 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f837807a640 0x7f837809aaf0 unknown :-1 s=CLOSED pgs=105 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.151+0000 7f83af4c3640 1 --2- 10.20.193.58:0/315781305 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f83a815d870 0x7f83a8159fb0 unknown :-1 s=CLOSED pgs=163 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.151+0000 7f83af4c3640 1 --2- 10.20.193.58:0/315781305 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f83a815d4a0 0x7f83a813aff0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.151+0000 7f83af4c3640 1 --2- 10.20.193.58:0/315781305 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f83a80b6690 0x7f83a8160f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.151+0000 7f83af4c3640 1 -- 10.20.193.58:0/315781305 >> 10.20.193.58:0/315781305 conn(0x7f83a80b3c20 msgr2=0x7f83a815bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:42.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.152+0000 7f83af4c3640 1 -- 10.20.193.58:0/315781305 shutdown_connections 2026-02-23T06:21:42.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.152+0000 7f83af4c3640 1 -- 10.20.193.58:0/315781305 wait complete. 2026-02-23T06:21:42.160 INFO:teuthology.run_tasks:Running task kclient... 2026-02-23T06:21:42.185 INFO:tasks.kclient:Mounting kernel clients... 2026-02-23T06:21:42.185 INFO:tasks.kclient:config is {'client.0': {}} 2026-02-23T06:21:42.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-23T06:21:42.185 DEBUG:teuthology.orchestra.run.trial058:> ip netns list 2026-02-23T06:21:42.223 INFO:teuthology.orchestra.run.trial058.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2026-02-23T06:21:42.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-23T06:21:42.225 DEBUG:teuthology.orchestra.run.trial058:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-23T06:21:42.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-23T06:21:42.322 DEBUG:teuthology.orchestra.run.trial058:> sudo ip link delete ceph-brx 2026-02-23T06:21:42.422 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2026-02-23T06:21:42.422 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2026-02-23T06:21:42.422 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2026-02-23T06:21:42.422 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2026-02-23T06:21:42.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.551+0000 7f6ae88c2640 1 -- 10.20.193.58:0/250927878 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6ae40b5680 msgr2=0x7f6ae40b5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:42.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.551+0000 7f6ae88c2640 1 --2- 10.20.193.58:0/250927878 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6ae40b5680 0x7f6ae40b5b00 secure :-1 s=READY pgs=79 gs=3 cs=0 l=1 c_cookie=2547200500314918951 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ad400a970 tx=0x7f6ad40302d0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.551+0000 7f6ae88c2640 1 -- 10.20.193.58:0/250927878 shutdown_connections 2026-02-23T06:21:42.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.551+0000 7f6ae88c2640 1 --2- 10.20.193.58:0/250927878 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6ae40b5680 0x7f6ae40b5b00 unknown :-1 s=CLOSED pgs=79 gs=3 cs=0 l=1 c_cookie=2547200500314918951 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.551+0000 7f6ae88c2640 1 -- 10.20.193.58:0/250927878 >> 10.20.193.58:0/250927878 conn(0x7f6ae40b3c20 msgr2=0x7f6ae40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:42.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.552+0000 7f6ae88c2640 1 -- 10.20.193.58:0/250927878 shutdown_connections 2026-02-23T06:21:42.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.552+0000 7f6ae88c2640 1 -- 10.20.193.58:0/250927878 wait complete. 2026-02-23T06:21:42.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.553+0000 7f6ae88c2640 1 Processor -- start 2026-02-23T06:21:42.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.553+0000 7f6ae88c2640 1 -- start start 2026-02-23T06:21:42.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.553+0000 7f6ae88c2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6ae4056550 0x7f6ae4161440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:42.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.553+0000 7f6ae88c2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6ae40b5680 0x7f6ae4161980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:42.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.554+0000 7f6ae88c2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ae415c040 0x7f6ae40b10d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:42.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.554+0000 7f6ae88c2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae41622a0 con 0x7f6ae415c040 2026-02-23T06:21:42.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.554+0000 7f6ae88c2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae41fe3e0 con 0x7f6ae4056550 2026-02-23T06:21:42.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.554+0000 7f6ae88c2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f6ae40b0a20 con 0x7f6ae40b5680 2026-02-23T06:21:42.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.554+0000 7f6ae3577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ae415c040 0x7f6ae40b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:42.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.554+0000 7f6ae3577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ae415c040 0x7f6ae40b10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:56970/0 (socket says 10.20.193.58:56970) 2026-02-23T06:21:42.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.554+0000 7f6ae3577640 1 -- 10.20.193.58:0/1272803565 learned_addr learned my addr 10.20.193.58:0/1272803565 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:42.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.554+0000 7f6ae3577640 1 -- 10.20.193.58:0/1272803565 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6ae40b5680 msgr2=0x7f6ae4161980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:42.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.554+0000 7f6ae3577640 1 --2- 10.20.193.58:0/1272803565 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6ae40b5680 0x7f6ae4161980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.554+0000 7f6ae3577640 1 -- 10.20.193.58:0/1272803565 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6ae4056550 msgr2=0x7f6ae4161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:42.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.554+0000 7f6ae3577640 1 --2- 10.20.193.58:0/1272803565 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6ae4056550 0x7f6ae4161440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.554+0000 7f6ae3577640 1 -- 10.20.193.58:0/1272803565 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad400a590 con 0x7f6ae415c040 2026-02-23T06:21:42.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.554+0000 7f6ae3577640 1 --2- 10.20.193.58:0/1272803565 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ae415c040 0x7f6ae40b10d0 secure :-1 s=READY pgs=166 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ad4003ad0 tx=0x7f6ad4003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:42.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.554+0000 7f6ac37fe640 1 -- 10.20.193.58:0/1272803565 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ad403e070 con 0x7f6ae415c040 2026-02-23T06:21:42.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.554+0000 7f6ac37fe640 1 -- 10.20.193.58:0/1272803565 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ad4039690 con 0x7f6ae415c040 2026-02-23T06:21:42.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.554+0000 7f6ac37fe640 1 -- 10.20.193.58:0/1272803565 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ad4039a60 con 0x7f6ae415c040 2026-02-23T06:21:42.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.554+0000 7f6ae88c2640 1 -- 10.20.193.58:0/1272803565 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae415feb0 con 0x7f6ae415c040 2026-02-23T06:21:42.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.554+0000 7f6ae88c2640 1 -- 10.20.193.58:0/1272803565 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae41fe630 con 0x7f6ae415c040 2026-02-23T06:21:42.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.555+0000 7f6ae88c2640 1 -- 10.20.193.58:0/1272803565 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ae40b5aa0 con 0x7f6ae415c040 2026-02-23T06:21:42.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.556+0000 7f6ac37fe640 1 -- 10.20.193.58:0/1272803565 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f6ad4039bc0 con 0x7f6ae415c040 2026-02-23T06:21:42.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.557+0000 7f6ac37fe640 1 --2- 10.20.193.58:0/1272803565 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6ab007a6c0 0x7f6ab009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:42.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.557+0000 7f6ac37fe640 1 -- 10.20.193.58:0/1272803565 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f6ad40c38a0 con 0x7f6ae415c040 2026-02-23T06:21:42.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.558+0000 7f6ae2d76640 1 --2- 10.20.193.58:0/1272803565 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6ab007a6c0 0x7f6ab009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:42.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.558+0000 7f6ae2d76640 1 --2- 10.20.193.58:0/1272803565 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6ab007a6c0 0x7f6ab009ab70 secure :-1 s=READY pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ad80029a0 tx=0x7f6ad80079d0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:42.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.559+0000 7f6ac37fe640 1 -- 10.20.193.58:0/1272803565 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f6ad4086a80 con 0x7f6ae415c040 2026-02-23T06:21:42.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.700+0000 7f6ae88c2640 1 -- 10.20.193.58:0/1272803565 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6ae4057090 con 0x7f6ae415c040 2026-02-23T06:21:42.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.700+0000 7f6ac37fe640 1 -- 10.20.193.58:0/1272803565 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f6ad4089ba0 con 0x7f6ae415c040 2026-02-23T06:21:42.695 INFO:teuthology.orchestra.run.trial058.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2026-02-23T06:21:42.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.701+0000 7f6ae88c2640 1 -- 10.20.193.58:0/1272803565 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6ab007a6c0 msgr2=0x7f6ab009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:42.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.701+0000 7f6ae88c2640 1 --2- 10.20.193.58:0/1272803565 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6ab007a6c0 0x7f6ab009ab70 secure :-1 s=READY pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ad80029a0 tx=0x7f6ad80079d0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.701+0000 7f6ae88c2640 1 -- 10.20.193.58:0/1272803565 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ae415c040 msgr2=0x7f6ae40b10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:42.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.701+0000 7f6ae88c2640 1 --2- 10.20.193.58:0/1272803565 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ae415c040 0x7f6ae40b10d0 secure :-1 s=READY pgs=166 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ad4003ad0 tx=0x7f6ad4003b00 comp rx=0 tx=0).stop 2026-02-23T06:21:42.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.701+0000 7f6ae88c2640 1 -- 10.20.193.58:0/1272803565 shutdown_connections 2026-02-23T06:21:42.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.701+0000 7f6ae88c2640 1 --2- 10.20.193.58:0/1272803565 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6ab007a6c0 0x7f6ab009ab70 unknown :-1 s=CLOSED pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.701+0000 7f6ae88c2640 1 --2- 10.20.193.58:0/1272803565 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ae415c040 0x7f6ae40b10d0 unknown :-1 s=CLOSED pgs=166 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.701+0000 7f6ae88c2640 1 --2- 10.20.193.58:0/1272803565 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6ae40b5680 0x7f6ae4161980 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.701+0000 7f6ae88c2640 1 --2- 10.20.193.58:0/1272803565 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6ae4056550 0x7f6ae4161440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:42.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.701+0000 7f6ae88c2640 1 -- 10.20.193.58:0/1272803565 >> 10.20.193.58:0/1272803565 conn(0x7f6ae40b3c20 msgr2=0x7f6ae4156ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:42.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.701+0000 7f6ae88c2640 1 -- 10.20.193.58:0/1272803565 shutdown_connections 2026-02-23T06:21:42.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42.701+0000 7f6ae88c2640 1 -- 10.20.193.58:0/1272803565 wait complete. 2026-02-23T06:21:42.707 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2026-02-23T06:21:42.707 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2026-02-23T06:21:42.708 INFO:tasks.cephfs.mount:self.client_remote.hostname = trial058.front.sepia.ceph.com 2026-02-23T06:21:42.708 INFO:tasks.cephfs.mount:self.client.name = client.0 2026-02-23T06:21:42.708 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2026-02-23T06:21:42.708 INFO:tasks.cephfs.mount:self.cephfs_name = None 2026-02-23T06:21:42.708 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2026-02-23T06:21:42.708 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2026-02-23T06:21:42.708 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2026-02-23T06:21:42.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-23T06:21:42.708 DEBUG:teuthology.orchestra.run.trial058:> ip addr 2026-02-23T06:21:42.748 INFO:teuthology.orchestra.run.trial058.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2026-02-23T06:21:42.748 INFO:teuthology.orchestra.run.trial058.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2026-02-23T06:21:42.749 INFO:teuthology.orchestra.run.trial058.stdout: inet 127.0.0.1/8 scope host lo 2026-02-23T06:21:42.749 INFO:teuthology.orchestra.run.trial058.stdout: valid_lft forever preferred_lft forever 2026-02-23T06:21:42.749 INFO:teuthology.orchestra.run.trial058.stdout: inet6 ::1/128 scope host 2026-02-23T06:21:42.749 INFO:teuthology.orchestra.run.trial058.stdout: valid_lft forever preferred_lft forever 2026-02-23T06:21:42.749 INFO:teuthology.orchestra.run.trial058.stdout:2: enp1s0f0np0: mtu 1500 qdisc fq_codel state UP group default qlen 1000 2026-02-23T06:21:42.749 INFO:teuthology.orchestra.run.trial058.stdout: link/ether 90:5a:08:77:62:82 brd ff:ff:ff:ff:ff:ff 2026-02-23T06:21:42.749 INFO:teuthology.orchestra.run.trial058.stdout: inet 10.20.193.58/20 brd 10.20.207.255 scope global dynamic noprefixroute enp1s0f0np0 2026-02-23T06:21:42.749 INFO:teuthology.orchestra.run.trial058.stdout: valid_lft 513sec preferred_lft 513sec 2026-02-23T06:21:42.749 INFO:teuthology.orchestra.run.trial058.stdout: inet6 fe80::925a:8ff:fe77:6282/64 scope link proto kernel_ll 2026-02-23T06:21:42.749 INFO:teuthology.orchestra.run.trial058.stdout: valid_lft forever preferred_lft forever 2026-02-23T06:21:42.750 INFO:teuthology.orchestra.run.trial058.stdout:3: enp1s0f1np1: mtu 1500 qdisc fq_codel state DOWN group default qlen 1000 2026-02-23T06:21:42.750 INFO:teuthology.orchestra.run.trial058.stdout: link/ether 90:5a:08:77:62:83 brd ff:ff:ff:ff:ff:ff 2026-02-23T06:21:42.750 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.159.254/20 2026-02-23T06:21:42.750 DEBUG:teuthology.orchestra.run.trial058:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-23T06:21:42.750 DEBUG:teuthology.orchestra.run.trial058:> set -e 2026-02-23T06:21:42.750 DEBUG:teuthology.orchestra.run.trial058:> sudo ip link add name ceph-brx type bridge 2026-02-23T06:21:42.751 DEBUG:teuthology.orchestra.run.trial058:> sudo ip addr flush dev ceph-brx 2026-02-23T06:21:42.751 DEBUG:teuthology.orchestra.run.trial058:> sudo ip link set ceph-brx up 2026-02-23T06:21:42.751 DEBUG:teuthology.orchestra.run.trial058:> sudo ip addr add 192.168.159.254/20 brd 192.168.159.255 dev ceph-brx 2026-02-23T06:21:42.751 DEBUG:teuthology.orchestra.run.trial058:> ') 2026-02-23T06:21:42.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-23T06:21:42.938 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-23T06:21:42.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-23T06:21:42.944 DEBUG:teuthology.orchestra.run.trial058:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2026-02-23T06:21:43.000 INFO:teuthology.orchestra.run.trial058.stdout:1 2026-02-23T06:21:43.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-23T06:21:43.003 DEBUG:teuthology.orchestra.run.trial058:> ip r 2026-02-23T06:21:43.042 INFO:teuthology.orchestra.run.trial058.stdout:default via 10.20.192.1 dev enp1s0f0np0 proto dhcp src 10.20.193.58 metric 100 2026-02-23T06:21:43.042 INFO:teuthology.orchestra.run.trial058.stdout:10.20.192.0/20 dev enp1s0f0np0 proto kernel scope link src 10.20.193.58 metric 100 2026-02-23T06:21:43.042 INFO:teuthology.orchestra.run.trial058.stdout:192.168.144.0/20 dev ceph-brx proto kernel scope link src 192.168.159.254 2026-02-23T06:21:43.043 DEBUG:teuthology.orchestra.run.trial058:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-23T06:21:43.043 DEBUG:teuthology.orchestra.run.trial058:> set -e 2026-02-23T06:21:43.043 DEBUG:teuthology.orchestra.run.trial058:> sudo iptables -A FORWARD -o enp1s0f0np0 -i ceph-brx -j ACCEPT 2026-02-23T06:21:43.043 DEBUG:teuthology.orchestra.run.trial058:> sudo iptables -A FORWARD -i enp1s0f0np0 -o ceph-brx -j ACCEPT 2026-02-23T06:21:43.043 DEBUG:teuthology.orchestra.run.trial058:> sudo iptables -t nat -A POSTROUTING -s 192.168.159.254/20 -o enp1s0f0np0 -j MASQUERADE 2026-02-23T06:21:43.043 DEBUG:teuthology.orchestra.run.trial058:> ') 2026-02-23T06:21:43.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-23T06:21:43.212 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-23T06:21:43.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-23T06:21:43.219 DEBUG:teuthology.orchestra.run.trial058:> ip netns list 2026-02-23T06:21:43.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-23T06:21:43.258 DEBUG:teuthology.orchestra.run.trial058:> ip netns list-id 2026-02-23T06:21:43.337 DEBUG:teuthology.orchestra.run.trial058:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-23T06:21:43.337 DEBUG:teuthology.orchestra.run.trial058:> set -e 2026-02-23T06:21:43.338 DEBUG:teuthology.orchestra.run.trial058:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2026-02-23T06:21:43.338 DEBUG:teuthology.orchestra.run.trial058:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2026-02-23T06:21:43.338 DEBUG:teuthology.orchestra.run.trial058:> ') 2026-02-23T06:21:43.442 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-23T06:21:43.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-23T06:21:43.492 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.144.1/20 2026-02-23T06:21:43.493 DEBUG:teuthology.orchestra.run.trial058:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-23T06:21:43.493 DEBUG:teuthology.orchestra.run.trial058:> set -e 2026-02-23T06:21:43.493 DEBUG:teuthology.orchestra.run.trial058:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2026-02-23T06:21:43.493 DEBUG:teuthology.orchestra.run.trial058:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.144.1/20 brd 192.168.159.255 dev veth0 2026-02-23T06:21:43.493 DEBUG:teuthology.orchestra.run.trial058:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2026-02-23T06:21:43.493 DEBUG:teuthology.orchestra.run.trial058:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2026-02-23T06:21:43.493 DEBUG:teuthology.orchestra.run.trial058:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.159.254 2026-02-23T06:21:43.494 DEBUG:teuthology.orchestra.run.trial058:> ') 2026-02-23T06:21:43.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-23T06:21:43.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-23T06:21:43.681 DEBUG:teuthology.orchestra.run.trial058:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-23T06:21:43.681 DEBUG:teuthology.orchestra.run.trial058:> set -e 2026-02-23T06:21:43.681 DEBUG:teuthology.orchestra.run.trial058:> sudo ip link set brx.0 up 2026-02-23T06:21:43.681 DEBUG:teuthology.orchestra.run.trial058:> sudo ip link set dev brx.0 master ceph-brx 2026-02-23T06:21:43.681 DEBUG:teuthology.orchestra.run.trial058:> ') 2026-02-23T06:21:43.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-23T06:21:43.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-23T06:21:43.829 INFO:teuthology.orchestra.run:Running command with timeout 60 2026-02-23T06:21:43.829 DEBUG:teuthology.orchestra.run.trial058:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2026-02-23T06:21:43.868 INFO:teuthology.orchestra.run.trial058.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2026-02-23T06:21:43.868 INFO:teuthology.orchestra.run:Running command with timeout 60 2026-02-23T06:21:43.869 DEBUG:teuthology.orchestra.run.trial058:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2026-02-23T06:21:43.949 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2026-02-23T06:21:43.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-23T06:21:43.949 DEBUG:teuthology.orchestra.run.trial058:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2026-02-23T06:21:44.066 INFO:teuthology.orchestra.run.trial058.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2026-02-23T06:21:44.067 INFO:teuthology.orchestra.run.trial058.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2026-02-23T06:21:44.067 INFO:teuthology.orchestra.run.trial058.stdout:invalid new device string format 2026-02-23T06:21:44.196 INFO:teuthology.orchestra.run.trial058.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2026-02-23T06:21:44.196 INFO:teuthology.orchestra.run.trial058.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2026-02-23T06:21:44.196 INFO:teuthology.orchestra.run.trial058.stdout:invalid new device string format 2026-02-23T06:21:44.197 INFO:teuthology.orchestra.run.trial058.stdout:mount.ceph: resolved to: "10.20.193.58:3300,10.20.193.93:3300,10.20.193.93:3301" 2026-02-23T06:21:44.197 INFO:teuthology.orchestra.run.trial058.stdout:mount.ceph: switching to using v1 address with old syntax 2026-02-23T06:21:44.219 INFO:teuthology.orchestra.run.trial058.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2026-02-23T06:21:44.220 INFO:teuthology.orchestra.run.trial058.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2026-02-23T06:21:44.220 INFO:teuthology.orchestra.run.trial058.stdout:invalid new device string format 2026-02-23T06:21:44.220 INFO:teuthology.orchestra.run.trial058.stdout:mount.ceph: resolved to: "10.20.193.58:3300,10.20.193.93:3300,10.20.193.93:3301" 2026-02-23T06:21:44.220 INFO:teuthology.orchestra.run.trial058.stdout:mount.ceph: switching to using v1 address with old syntax 2026-02-23T06:21:44.220 INFO:teuthology.orchestra.run.trial058.stdout:mount.ceph: resolved to: "10.20.193.58:6789,10.20.193.93:6789,10.20.193.93:6790" 2026-02-23T06:21:44.220 INFO:teuthology.orchestra.run.trial058.stdout:mount.ceph: trying mount with old device syntax: 10.20.193.58:6789,10.20.193.93:6789,10.20.193.93:6790:/ 2026-02-23T06:21:44.220 INFO:teuthology.orchestra.run.trial058.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=2624bd29-dc40-41ea-9c77-09981694f232" will pass to kernel 2026-02-23T06:21:44.221 INFO:teuthology.orchestra.run.trial058.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2026-02-23T06:21:44.221 INFO:teuthology.orchestra.run.trial058.stdout: You just mounted a file system that supports labels which does not 2026-02-23T06:21:44.221 INFO:teuthology.orchestra.run.trial058.stdout: contain labels, onto an SELinux box. It is likely that confined 2026-02-23T06:21:44.221 INFO:teuthology.orchestra.run.trial058.stdout: applications will generate AVC messages and not be allowed access to 2026-02-23T06:21:44.221 INFO:teuthology.orchestra.run.trial058.stdout: this file system. For more details see restorecon(8) and mount(8). 2026-02-23T06:21:44.224 INFO:tasks.cephfs.kernel_mount:mount command passed 2026-02-23T06:21:44.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-23T06:21:44.224 DEBUG:teuthology.orchestra.run.trial058:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2026-02-23T06:21:44.282 DEBUG:teuthology.orchestra.run.trial058:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2026-02-23T06:21:44.346 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2026-02-23T06:21:44.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-23T06:21:44.355 INFO:teuthology.orchestra.run.trial058.stdout:client4709 2026-02-23T06:21:44.355 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:21:44.355 DEBUG:teuthology.orchestra.run.trial058:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-23T06:21:44.394 DEBUG:teuthology.orchestra.run.trial058:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2026-02-23T06:21:44.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2026-02-23T06:21:44.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-23T06:21:44.507 INFO:teuthology.orchestra.run.trial058.stdout:client4709 2026-02-23T06:21:44.508 DEBUG:teuthology.orchestra.run.trial058:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2026-02-23T06:21:44.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2026-02-23T06:21:44.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-23T06:21:44.580 INFO:teuthology.orchestra.run.trial058.stdout:client4709 2026-02-23T06:21:44.581 DEBUG:teuthology.orchestra.run.trial058:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/2624bd29-dc40-41ea-9c77-09981694f232.client4709/status') 2026-02-23T06:21:44.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-23T06:21:44.665 INFO:teuthology.orchestra.run.trial058.stdout:instance: client.4709 (3)10.20.193.58:0/2730976118 2026-02-23T06:21:44.665 INFO:teuthology.orchestra.run.trial058.stdout:blocklisted: false 2026-02-23T06:21:44.665 INFO:teuthology.orchestra.run.trial058.stderr:0+1 records in 2026-02-23T06:21:44.666 INFO:teuthology.orchestra.run.trial058.stderr:0+1 records out 2026-02-23T06:21:44.666 INFO:teuthology.orchestra.run.trial058.stderr:70 bytes copied, 4.7159e-05 s, 1.5 MB/s 2026-02-23T06:21:44.667 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-23T06:21:44.673 INFO:teuthology.run_tasks:Running task mon_thrash... 2026-02-23T06:21:44.698 INFO:tasks.mon_thrash:Beginning mon_thrash... 2026-02-23T06:21:44.698 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-23T06:21:44.818 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.823+0000 7fb3d1f14640 1 -- 10.20.193.58:0/205676683 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3cc15d4a0 msgr2=0x7fb3cc0affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:44.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.823+0000 7fb3d1f14640 1 --2- 10.20.193.58:0/205676683 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3cc15d4a0 0x7fb3cc0affb0 secure :-1 s=READY pgs=164 gs=3 cs=0 l=1 c_cookie=9016346198481588434 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3bc004740 tx=0x7fb3bc02f1d0 comp rx=0 tx=0).stop 2026-02-23T06:21:44.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.823+0000 7fb3d1f14640 1 -- 10.20.193.58:0/205676683 shutdown_connections 2026-02-23T06:21:44.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.823+0000 7fb3d1f14640 1 --2- 10.20.193.58:0/205676683 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3cc15d870 0x7fb3cc0587b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:44.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.823+0000 7fb3d1f14640 1 --2- 10.20.193.58:0/205676683 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3cc15d4a0 0x7fb3cc0affb0 unknown :-1 s=CLOSED pgs=164 gs=3 cs=0 l=1 c_cookie=9016346198481588434 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:44.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.823+0000 7fb3d1f14640 1 -- 10.20.193.58:0/205676683 >> 10.20.193.58:0/205676683 conn(0x7fb3cc0b3c20 msgr2=0x7fb3cc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:44.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.823+0000 7fb3d1f14640 1 -- 10.20.193.58:0/205676683 shutdown_connections 2026-02-23T06:21:44.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.823+0000 7fb3d1f14640 1 -- 10.20.193.58:0/205676683 wait complete. 2026-02-23T06:21:44.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.824+0000 7fb3d1f14640 1 Processor -- start 2026-02-23T06:21:44.822 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.825+0000 7fb3d1f14640 1 -- start start 2026-02-23T06:21:44.822 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.825+0000 7fb3d1f14640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3cc0b6690 0x7fb3cc120fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:44.822 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.825+0000 7fb3d1f14640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3cc15d4a0 0x7fb3cc13d5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:44.822 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.825+0000 7fb3d1f14640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3cc15d870 0x7fb3cc057750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:44.822 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.825+0000 7fb3d1f14640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb3cc120ac0 con 0x7fb3cc0b6690 2026-02-23T06:21:44.822 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.825+0000 7fb3d1f14640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb3cc13bea0 con 0x7fb3cc15d870 2026-02-23T06:21:44.822 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.825+0000 7fb3d1f14640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb3cc13bae0 con 0x7fb3cc15d4a0 2026-02-23T06:21:44.822 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.825+0000 7fb3c3fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3cc15d4a0 0x7fb3cc13d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:44.822 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.825+0000 7fb3d1713640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3cc15d870 0x7fb3cc057750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:44.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.825+0000 7fb3c3fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3cc15d4a0 0x7fb3cc13d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:59112/0 (socket says 10.20.193.58:59112) 2026-02-23T06:21:44.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.825+0000 7fb3c3fff640 1 -- 10.20.193.58:0/9499422 learned_addr learned my addr 10.20.193.58:0/9499422 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:44.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.825+0000 7fb3d0f12640 1 --2- 10.20.193.58:0/9499422 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3cc0b6690 0x7fb3cc120fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:44.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.825+0000 7fb3d1713640 1 -- 10.20.193.58:0/9499422 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3cc15d4a0 msgr2=0x7fb3cc13d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:44.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.825+0000 7fb3d1713640 1 --2- 10.20.193.58:0/9499422 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3cc15d4a0 0x7fb3cc13d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:44.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.825+0000 7fb3d1713640 1 -- 10.20.193.58:0/9499422 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3cc0b6690 msgr2=0x7fb3cc120fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:44.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.825+0000 7fb3d1713640 1 --2- 10.20.193.58:0/9499422 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3cc0b6690 0x7fb3cc120fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:44.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.825+0000 7fb3d1713640 1 -- 10.20.193.58:0/9499422 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3bc0094b0 con 0x7fb3cc15d870 2026-02-23T06:21:44.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.825+0000 7fb3c3fff640 1 --2- 10.20.193.58:0/9499422 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3cc15d4a0 0x7fb3cc13d5e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:44.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.826+0000 7fb3d1713640 1 --2- 10.20.193.58:0/9499422 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3cc15d870 0x7fb3cc057750 secure :-1 s=READY pgs=165 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3c8003a80 tx=0x7fb3c800d970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:44.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.826+0000 7fb3c17fa640 1 -- 10.20.193.58:0/9499422 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3c8013850 con 0x7fb3cc15d870 2026-02-23T06:21:44.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.826+0000 7fb3c17fa640 1 -- 10.20.193.58:0/9499422 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3c8013aa0 con 0x7fb3cc15d870 2026-02-23T06:21:44.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.826+0000 7fb3c17fa640 1 -- 10.20.193.58:0/9499422 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3c8012380 con 0x7fb3cc15d870 2026-02-23T06:21:44.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.826+0000 7fb3d1f14640 1 -- 10.20.193.58:0/9499422 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3cc1207e0 con 0x7fb3cc15d870 2026-02-23T06:21:44.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.826+0000 7fb3d1f14640 1 -- 10.20.193.58:0/9499422 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3cc121c40 con 0x7fb3cc15d870 2026-02-23T06:21:44.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.827+0000 7fb3d1f14640 1 -- 10.20.193.58:0/9499422 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3cc0b6d50 con 0x7fb3cc15d870 2026-02-23T06:21:44.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.828+0000 7fb3c17fa640 1 -- 10.20.193.58:0/9499422 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fb3c80124e0 con 0x7fb3cc15d870 2026-02-23T06:21:44.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.829+0000 7fb3c17fa640 1 --2- 10.20.193.58:0/9499422 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb39c07a6c0 0x7fb39c09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:44.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.829+0000 7fb3c17fa640 1 -- 10.20.193.58:0/9499422 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7fb3c809eb90 con 0x7fb3cc15d870 2026-02-23T06:21:44.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.829+0000 7fb3d0f12640 1 --2- 10.20.193.58:0/9499422 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb39c07a6c0 0x7fb39c09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:44.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.830+0000 7fb3d0f12640 1 --2- 10.20.193.58:0/9499422 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb39c07a6c0 0x7fb39c09ab70 secure :-1 s=READY pgs=107 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3bc0023d0 tx=0x7fb3bc031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:44.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.830+0000 7fb3c17fa640 1 -- 10.20.193.58:0/9499422 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fb3c8061ea0 con 0x7fb3cc15d870 2026-02-23T06:21:44.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.944+0000 7fb3d1f14640 1 -- 10.20.193.58:0/9499422 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb3cc1217a0 con 0x7fb3cc15d870 2026-02-23T06:21:44.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.946+0000 7fb3c17fa640 1 -- 10.20.193.58:0/9499422 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18600 (secure 0 0 0) 0x7fb3c8064fc0 con 0x7fb3cc15d870 2026-02-23T06:21:44.940 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:44.940 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":25,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","created":"2026-02-23T06:21:02.010508+0000","modified":"2026-02-23T06:21:22.447858+0000","last_up_change":"2026-02-23T06:21:08.383048+0000","last_in_change":"2026-02-23T06:21:04.690899+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-23T06:21:10.389081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-23T06:21:16.080621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-23T06:21:16.401311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-23T06:21:20.153808+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"96cc0898-14bb-4d56-827a-8845bd4307c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6808","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6809","nonce":692913334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6810","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6811","nonce":692913334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6814","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6815","nonce":692913334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6812","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6813","nonce":692913334}]},"public_addr":"10.20.193.58:6809/692913334","cluster_addr":"10.20.193.58:6811/692913334","heartbeat_back_addr":"10.20.193.58:6815/692913334","heartbeat_front_addr":"10.20.193.58:6813/692913334","state":["exists","up"]},{"osd":1,"uuid":"bf665af4-6e3c-4cb3-899c-acede65c31f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6800","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6801","nonce":1850584280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6802","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6803","nonce":1850584280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6806","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6807","nonce":1850584280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6804","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6805","nonce":1850584280}]},"public_addr":"10.20.193.58:6801/1850584280","cluster_addr":"10.20.193.58:6803/1850584280","heartbeat_back_addr":"10.20.193.58:6807/1850584280","heartbeat_front_addr":"10.20.193.58:6805/1850584280","state":["exists","up"]},{"osd":2,"uuid":"2bcb3165-28ad-45d6-9a49-9d9da08501f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6823","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6825","nonce":4284600061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6826","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6827","nonce":4284600061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6830","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6831","nonce":4284600061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6828","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6829","nonce":4284600061}]},"public_addr":"10.20.193.58:6825/4284600061","cluster_addr":"10.20.193.58:6827/4284600061","heartbeat_back_addr":"10.20.193.58:6831/4284600061","heartbeat_front_addr":"10.20.193.58:6829/4284600061","state":["exists","up"]},{"osd":3,"uuid":"4750309a-5bf2-4f48-a550-ca677b0b0f61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6816","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6817","nonce":2858636994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6818","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6819","nonce":2858636994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6822","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6824","nonce":2858636994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6820","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6821","nonce":2858636994}]},"public_addr":"10.20.193.58:6817/2858636994","cluster_addr":"10.20.193.58:6819/2858636994","heartbeat_back_addr":"10.20.193.58:6824/2858636994","heartbeat_front_addr":"10.20.193.58:6821/2858636994","state":["exists","up"]},{"osd":4,"uuid":"5cbb50f2-4e49-46eb-bd84-d92706459d2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6803","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6805","nonce":1874834171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6807","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6809","nonce":1874834171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6816","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6817","nonce":1874834171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6812","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6814","nonce":1874834171}]},"public_addr":"10.20.193.93:6805/1874834171","cluster_addr":"10.20.193.93:6809/1874834171","heartbeat_back_addr":"10.20.193.93:6817/1874834171","heartbeat_front_addr":"10.20.193.93:6814/1874834171","state":["exists","up"]},{"osd":5,"uuid":"2806c775-4720-43a7-ab9f-85a4adb31098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6802","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6804","nonce":356968280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6806","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6808","nonce":356968280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6813","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6815","nonce":356968280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6810","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6811","nonce":356968280}]},"public_addr":"10.20.193.93:6804/356968280","cluster_addr":"10.20.193.93:6808/356968280","heartbeat_back_addr":"10.20.193.93:6815/356968280","heartbeat_front_addr":"10.20.193.93:6811/356968280","state":["exists","up"]},{"osd":6,"uuid":"aa03b46d-d30f-4b09-9251-c9514e8b8b6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6819","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6821","nonce":2948039088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6823","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6825","nonce":2948039088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6831","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6833","nonce":2948039088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6827","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6829","nonce":2948039088}]},"public_addr":"10.20.193.93:6821/2948039088","cluster_addr":"10.20.193.93:6825/2948039088","heartbeat_back_addr":"10.20.193.93:6833/2948039088","heartbeat_front_addr":"10.20.193.93:6829/2948039088","state":["exists","up"]},{"osd":7,"uuid":"b15519bf-2b7b-4fd5-8ef6-e09af0ad9817","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6818","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6820","nonce":2960650087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6822","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6824","nonce":2960650087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6830","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6832","nonce":2960650087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6826","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6828","nonce":2960650087}]},"public_addr":"10.20.193.93:6820/2960650087","cluster_addr":"10.20.193.93:6824/2960650087","heartbeat_back_addr":"10.20.193.93:6832/2960650087","heartbeat_front_addr":"10.20.193.93:6828/2960650087","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.717515+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.744114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.772247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.768341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.521808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.486005+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.480882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.473408+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"2","m":"2","plugin":"isa","technique":"reed_sol_van"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-23T06:21:44.941 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.946+0000 7fb3d1f14640 1 -- 10.20.193.58:0/9499422 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb39c07a6c0 msgr2=0x7fb39c09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:44.941 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.946+0000 7fb3d1f14640 1 --2- 10.20.193.58:0/9499422 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb39c07a6c0 0x7fb39c09ab70 secure :-1 s=READY pgs=107 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3bc0023d0 tx=0x7fb3bc031040 comp rx=0 tx=0).stop 2026-02-23T06:21:44.941 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.946+0000 7fb3d1f14640 1 -- 10.20.193.58:0/9499422 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3cc15d870 msgr2=0x7fb3cc057750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:44.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.946+0000 7fb3d1f14640 1 --2- 10.20.193.58:0/9499422 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3cc15d870 0x7fb3cc057750 secure :-1 s=READY pgs=165 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3c8003a80 tx=0x7fb3c800d970 comp rx=0 tx=0).stop 2026-02-23T06:21:44.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.946+0000 7fb3d1f14640 1 -- 10.20.193.58:0/9499422 shutdown_connections 2026-02-23T06:21:44.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.946+0000 7fb3d1f14640 1 --2- 10.20.193.58:0/9499422 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb39c07a6c0 0x7fb39c09ab70 unknown :-1 s=CLOSED pgs=107 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:44.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.946+0000 7fb3d1f14640 1 --2- 10.20.193.58:0/9499422 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3cc15d870 0x7fb3cc057750 unknown :-1 s=CLOSED pgs=165 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:44.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.946+0000 7fb3d1f14640 1 --2- 10.20.193.58:0/9499422 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3cc15d4a0 0x7fb3cc13d5e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:44.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.946+0000 7fb3d1f14640 1 --2- 10.20.193.58:0/9499422 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3cc0b6690 0x7fb3cc120fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:44.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.946+0000 7fb3d1f14640 1 -- 10.20.193.58:0/9499422 >> 10.20.193.58:0/9499422 conn(0x7fb3cc0b3c20 msgr2=0x7fb3cc15bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:44.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.946+0000 7fb3d1f14640 1 -- 10.20.193.58:0/9499422 shutdown_connections 2026-02-23T06:21:44.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:44.946+0000 7fb3d1f14640 1 -- 10.20.193.58:0/9499422 wait complete. 2026-02-23T06:21:44.953 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-23T06:21:10.389081+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2026-02-23T06:21:16.080621+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2026-02-23T06:21:16.401311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2026-02-23T06:21:20.153808+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2026-02-23T06:21:44.954 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2026-02-23T06:21:45.075 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.080+0000 7fa478e83640 1 -- 10.20.193.58:0/1406329293 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa4740b6690 msgr2=0x7fa474058ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:45.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.080+0000 7fa478e83640 1 --2- 10.20.193.58:0/1406329293 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa4740b6690 0x7fa474058ec0 secure :-1 s=READY pgs=169 gs=3 cs=0 l=1 c_cookie=11403680648984099343 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa468005820 tx=0x7fa468030300 comp rx=0 tx=0).stop 2026-02-23T06:21:45.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.080+0000 7fa478e83640 1 -- 10.20.193.58:0/1406329293 shutdown_connections 2026-02-23T06:21:45.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.080+0000 7fa478e83640 1 --2- 10.20.193.58:0/1406329293 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa4740b6690 0x7fa474058ec0 unknown :-1 s=CLOSED pgs=169 gs=3 cs=0 l=1 c_cookie=11403680648984099343 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.080+0000 7fa478e83640 1 -- 10.20.193.58:0/1406329293 >> 10.20.193.58:0/1406329293 conn(0x7fa4740b3c20 msgr2=0x7fa4740b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:45.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.080+0000 7fa478e83640 1 -- 10.20.193.58:0/1406329293 shutdown_connections 2026-02-23T06:21:45.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.080+0000 7fa478e83640 1 -- 10.20.193.58:0/1406329293 wait complete. 2026-02-23T06:21:45.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.081+0000 7fa478e83640 1 Processor -- start 2026-02-23T06:21:45.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.082+0000 7fa478e83640 1 -- start start 2026-02-23T06:21:45.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.082+0000 7fa478e83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa4740b6690 0x7fa47413a9a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:45.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.082+0000 7fa478e83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa47415d4a0 0x7fa47413f4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:45.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.082+0000 7fa478e83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa47415d870 0x7fa47413b5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:45.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.082+0000 7fa478e83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa47415a590 con 0x7fa47415d870 2026-02-23T06:21:45.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.082+0000 7fa478e83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fa47413e960 con 0x7fa4740b6690 2026-02-23T06:21:45.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.082+0000 7fa478e83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa47413aee0 con 0x7fa47415d4a0 2026-02-23T06:21:45.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.082+0000 7fa4737fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa4740b6690 0x7fa47413a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:45.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.082+0000 7fa472ffd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa47415d4a0 0x7fa47413f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:45.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.082+0000 7fa473fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa47415d870 0x7fa47413b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:45.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.082+0000 7fa4737fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa4740b6690 0x7fa47413a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:59526/0 (socket says 10.20.193.58:59526) 2026-02-23T06:21:45.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.082+0000 7fa4737fe640 1 -- 10.20.193.58:0/559078117 learned_addr learned my addr 10.20.193.58:0/559078117 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:45.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.083+0000 7fa473fff640 1 -- 10.20.193.58:0/559078117 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa47415d4a0 msgr2=0x7fa47413f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:45.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.083+0000 7fa473fff640 1 --2- 10.20.193.58:0/559078117 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa47415d4a0 0x7fa47413f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.083+0000 7fa473fff640 1 -- 10.20.193.58:0/559078117 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa4740b6690 msgr2=0x7fa47413a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:45.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.083+0000 7fa473fff640 1 --2- 10.20.193.58:0/559078117 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa4740b6690 0x7fa47413a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.083+0000 7fa473fff640 1 -- 10.20.193.58:0/559078117 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46800a590 con 0x7fa47415d870 2026-02-23T06:21:45.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.083+0000 7fa4737fe640 1 --2- 10.20.193.58:0/559078117 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa4740b6690 0x7fa47413a9a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:45.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.083+0000 7fa473fff640 1 --2- 10.20.193.58:0/559078117 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa47415d870 0x7fa47413b5f0 secure :-1 s=READY pgs=170 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa474059c90 tx=0x7fa468003d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:45.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.083+0000 7fa44ffff640 1 -- 10.20.193.58:0/559078117 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa46803e070 con 0x7fa47415d870 2026-02-23T06:21:45.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.083+0000 7fa44ffff640 1 -- 10.20.193.58:0/559078117 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4680398a0 con 0x7fa47415d870 2026-02-23T06:21:45.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.083+0000 7fa478e83640 1 -- 10.20.193.58:0/559078117 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4741400f0 con 0x7fa47415d870 2026-02-23T06:21:45.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.083+0000 7fa44ffff640 1 -- 10.20.193.58:0/559078117 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa468039c70 con 0x7fa47415d870 2026-02-23T06:21:45.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.083+0000 7fa478e83640 1 -- 10.20.193.58:0/559078117 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa47413eeb0 con 0x7fa47415d870 2026-02-23T06:21:45.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.084+0000 7fa478e83640 1 -- 10.20.193.58:0/559078117 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4740b6d50 con 0x7fa47415d870 2026-02-23T06:21:45.081 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.085+0000 7fa44ffff640 1 -- 10.20.193.58:0/559078117 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fa46804c440 con 0x7fa47415d870 2026-02-23T06:21:45.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.086+0000 7fa44ffff640 1 --2- 10.20.193.58:0/559078117 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa44407a6b0 0x7fa44409ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:45.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.086+0000 7fa44ffff640 1 -- 10.20.193.58:0/559078117 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7fa4680c3c40 con 0x7fa47415d870 2026-02-23T06:21:45.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.086+0000 7fa4737fe640 1 --2- 10.20.193.58:0/559078117 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa44407a6b0 0x7fa44409ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:45.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.086+0000 7fa44ffff640 1 -- 10.20.193.58:0/559078117 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fa468086fe0 con 0x7fa47415d870 2026-02-23T06:21:45.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.087+0000 7fa4737fe640 1 --2- 10.20.193.58:0/559078117 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa44407a6b0 0x7fa44409ab60 secure :-1 s=READY pgs=108 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa460007ca0 tx=0x7fa460007f00 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:45.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.199+0000 7fa478e83640 1 -- 10.20.193.58:0/559078117 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa474164250 con 0x7fa47415d870 2026-02-23T06:21:45.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.199+0000 7fa44ffff640 1 -- 10.20.193.58:0/559078117 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7fa46808a100 con 0x7fa47415d870 2026-02-23T06:21:45.195 INFO:teuthology.orchestra.run.trial058.stdout:pg_num: 1 2026-02-23T06:21:45.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.201+0000 7fa478e83640 1 -- 10.20.193.58:0/559078117 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa44407a6b0 msgr2=0x7fa44409ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:45.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.201+0000 7fa478e83640 1 --2- 10.20.193.58:0/559078117 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa44407a6b0 0x7fa44409ab60 secure :-1 s=READY pgs=108 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa460007ca0 tx=0x7fa460007f00 comp rx=0 tx=0).stop 2026-02-23T06:21:45.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.201+0000 7fa478e83640 1 -- 10.20.193.58:0/559078117 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa47415d870 msgr2=0x7fa47413b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:45.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.201+0000 7fa478e83640 1 --2- 10.20.193.58:0/559078117 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa47415d870 0x7fa47413b5f0 secure :-1 s=READY pgs=170 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa474059c90 tx=0x7fa468003d20 comp rx=0 tx=0).stop 2026-02-23T06:21:45.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.201+0000 7fa478e83640 1 -- 10.20.193.58:0/559078117 shutdown_connections 2026-02-23T06:21:45.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.201+0000 7fa478e83640 1 --2- 10.20.193.58:0/559078117 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa44407a6b0 0x7fa44409ab60 unknown :-1 s=CLOSED pgs=108 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.201+0000 7fa478e83640 1 --2- 10.20.193.58:0/559078117 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa47415d870 0x7fa47413b5f0 unknown :-1 s=CLOSED pgs=170 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.201+0000 7fa478e83640 1 --2- 10.20.193.58:0/559078117 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa47415d4a0 0x7fa47413f4a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.201+0000 7fa478e83640 1 --2- 10.20.193.58:0/559078117 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa4740b6690 0x7fa47413a9a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.201+0000 7fa478e83640 1 -- 10.20.193.58:0/559078117 >> 10.20.193.58:0/559078117 conn(0x7fa4740b3c20 msgr2=0x7fa4741633c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:45.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.201+0000 7fa478e83640 1 -- 10.20.193.58:0/559078117 shutdown_connections 2026-02-23T06:21:45.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.201+0000 7fa478e83640 1 -- 10.20.193.58:0/559078117 wait complete. 2026-02-23T06:21:45.208 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2026-02-23T06:21:45.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.335+0000 7f12a65c9640 1 -- 10.20.193.58:0/3943529292 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f12a015d870 msgr2=0x7f12a00587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:45.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.335+0000 7f12a65c9640 1 --2- 10.20.193.58:0/3943529292 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f12a015d870 0x7f12a00587b0 secure :-1 s=READY pgs=171 gs=1 cs=0 l=1 c_cookie=1236729464835076633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12a00b1b90 tx=0x7f129402f250 comp rx=0 tx=0).stop 2026-02-23T06:21:45.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.335+0000 7f12a65c9640 1 -- 10.20.193.58:0/3943529292 shutdown_connections 2026-02-23T06:21:45.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.335+0000 7f12a65c9640 1 --2- 10.20.193.58:0/3943529292 >> v2:10.20.193.93:3300/0 conn(0x7f12a00b6690 0x7f12a0058cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.335+0000 7f12a65c9640 1 --2- 10.20.193.58:0/3943529292 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f12a015d870 0x7f12a00587b0 unknown :-1 s=CLOSED pgs=171 gs=1 cs=0 l=1 c_cookie=1236729464835076633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.335+0000 7f12a65c9640 1 --2- 10.20.193.58:0/3943529292 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f12a015d4a0 0x7f12a00affb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.335+0000 7f12a65c9640 1 -- 10.20.193.58:0/3943529292 >> 10.20.193.58:0/3943529292 conn(0x7f12a00b3c20 msgr2=0x7f12a00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:45.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.335+0000 7f12a65c9640 1 -- 10.20.193.58:0/3943529292 shutdown_connections 2026-02-23T06:21:45.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.335+0000 7f12a65c9640 1 -- 10.20.193.58:0/3943529292 wait complete. 2026-02-23T06:21:45.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.337+0000 7f12a65c9640 1 Processor -- start 2026-02-23T06:21:45.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.337+0000 7f12a65c9640 1 -- start start 2026-02-23T06:21:45.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.337+0000 7f12a65c9640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f12a00b6690 0x7f12a013c140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:45.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.337+0000 7f12a65c9640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f12a015d4a0 0x7f12a013c920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:45.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.337+0000 7f12a65c9640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f12a015d870 0x7f12a01624f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:45.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.337+0000 7f12a65c9640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f12a0140300 con 0x7f12a015d870 2026-02-23T06:21:45.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.337+0000 7f12a65c9640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f12a013ce60 con 0x7f12a015d4a0 2026-02-23T06:21:45.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.337+0000 7f12a65c9640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f12a0058150 con 0x7f12a00b6690 2026-02-23T06:21:45.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.337+0000 7f12a55c7640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f12a00b6690 0x7f12a013c140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:45.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.337+0000 7f12a55c7640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f12a00b6690 0x7f12a013c140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:59152/0 (socket says 10.20.193.58:59152) 2026-02-23T06:21:45.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.337+0000 7f12a55c7640 1 -- 10.20.193.58:0/2673166137 learned_addr learned my addr 10.20.193.58:0/2673166137 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:45.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.337+0000 7f12a4dc6640 1 --2- 10.20.193.58:0/2673166137 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f12a015d4a0 0x7f12a013c920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:45.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.338+0000 7f12a5dc8640 1 --2- 10.20.193.58:0/2673166137 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f12a015d870 0x7f12a01624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:45.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.338+0000 7f12a55c7640 1 -- 10.20.193.58:0/2673166137 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f12a015d4a0 msgr2=0x7f12a013c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:45.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.338+0000 7f12a55c7640 1 --2- 10.20.193.58:0/2673166137 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f12a015d4a0 0x7f12a013c920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.338+0000 7f12a55c7640 1 -- 10.20.193.58:0/2673166137 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f12a015d870 msgr2=0x7f12a01624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:45.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.338+0000 7f12a55c7640 1 --2- 10.20.193.58:0/2673166137 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f12a015d870 0x7f12a01624f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.338+0000 7f12a55c7640 1 -- 10.20.193.58:0/2673166137 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1294009570 con 0x7f12a00b6690 2026-02-23T06:21:45.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.338+0000 7f12a55c7640 1 --2- 10.20.193.58:0/2673166137 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f12a00b6690 0x7f12a013c140 secure :-1 s=READY pgs=81 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f129000e9c0 tx=0x7f129000ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:45.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.338+0000 7f128dffb640 1 -- 10.20.193.58:0/2673166137 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f129000cd70 con 0x7f12a00b6690 2026-02-23T06:21:45.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.338+0000 7f128dffb640 1 -- 10.20.193.58:0/2673166137 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1290004850 con 0x7f12a00b6690 2026-02-23T06:21:45.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.338+0000 7f12a65c9640 1 -- 10.20.193.58:0/2673166137 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12a0140020 con 0x7f12a00b6690 2026-02-23T06:21:45.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.338+0000 7f128dffb640 1 -- 10.20.193.58:0/2673166137 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1290004c80 con 0x7f12a00b6690 2026-02-23T06:21:45.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.338+0000 7f12a65c9640 1 -- 10.20.193.58:0/2673166137 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f12a0057920 con 0x7f12a00b6690 2026-02-23T06:21:45.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.339+0000 7f12a65c9640 1 -- 10.20.193.58:0/2673166137 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12a00574a0 con 0x7f12a00b6690 2026-02-23T06:21:45.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.340+0000 7f128dffb640 1 -- 10.20.193.58:0/2673166137 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f129001f060 con 0x7f12a00b6690 2026-02-23T06:21:45.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.341+0000 7f128dffb640 1 --2- 10.20.193.58:0/2673166137 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f127007a6c0 0x7f127009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:45.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.341+0000 7f128dffb640 1 -- 10.20.193.58:0/2673166137 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f1290014070 con 0x7f12a00b6690 2026-02-23T06:21:45.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.341+0000 7f12a4dc6640 1 --2- 10.20.193.58:0/2673166137 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f127007a6c0 0x7f127009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:45.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.342+0000 7f12a4dc6640 1 --2- 10.20.193.58:0/2673166137 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f127007a6c0 0x7f127009ab70 secure :-1 s=READY pgs=109 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12940023d0 tx=0x7f129403a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:45.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.343+0000 7f128dffb640 1 -- 10.20.193.58:0/2673166137 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f12a00574a0 con 0x7f12a00b6690 2026-02-23T06:21:45.450 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.455+0000 7f12a65c9640 1 -- 10.20.193.58:0/2673166137 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f12a00574a0 con 0x7f12a00b6690 2026-02-23T06:21:45.450 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.455+0000 7f128dffb640 1 -- 10.20.193.58:0/2673166137 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f12a00574a0 con 0x7f12a00b6690 2026-02-23T06:21:45.450 INFO:teuthology.orchestra.run.trial058.stdout:pg_num: 32 2026-02-23T06:21:45.451 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.456+0000 7f12a65c9640 1 -- 10.20.193.58:0/2673166137 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f127007a6c0 msgr2=0x7f127009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:45.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.456+0000 7f12a65c9640 1 --2- 10.20.193.58:0/2673166137 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f127007a6c0 0x7f127009ab70 secure :-1 s=READY pgs=109 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12940023d0 tx=0x7f129403a040 comp rx=0 tx=0).stop 2026-02-23T06:21:45.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.456+0000 7f12a65c9640 1 -- 10.20.193.58:0/2673166137 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f12a00b6690 msgr2=0x7f12a013c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:45.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.456+0000 7f12a65c9640 1 --2- 10.20.193.58:0/2673166137 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f12a00b6690 0x7f12a013c140 secure :-1 s=READY pgs=81 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f129000e9c0 tx=0x7f129000ee90 comp rx=0 tx=0).stop 2026-02-23T06:21:45.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.456+0000 7f12a65c9640 1 -- 10.20.193.58:0/2673166137 shutdown_connections 2026-02-23T06:21:45.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.456+0000 7f12a65c9640 1 --2- 10.20.193.58:0/2673166137 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f127007a6c0 0x7f127009ab70 unknown :-1 s=CLOSED pgs=109 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.456+0000 7f12a65c9640 1 --2- 10.20.193.58:0/2673166137 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f12a015d870 0x7f12a01624f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.456+0000 7f12a65c9640 1 --2- 10.20.193.58:0/2673166137 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f12a015d4a0 0x7f12a013c920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.456+0000 7f12a65c9640 1 --2- 10.20.193.58:0/2673166137 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f12a00b6690 0x7f12a013c140 unknown :-1 s=CLOSED pgs=81 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.456+0000 7f12a65c9640 1 -- 10.20.193.58:0/2673166137 >> 10.20.193.58:0/2673166137 conn(0x7f12a00b3c20 msgr2=0x7f12a00b76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:45.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.456+0000 7f12a65c9640 1 -- 10.20.193.58:0/2673166137 shutdown_connections 2026-02-23T06:21:45.453 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.456+0000 7f12a65c9640 1 -- 10.20.193.58:0/2673166137 wait complete. 2026-02-23T06:21:45.464 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2026-02-23T06:21:45.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.592+0000 7ff25e36d640 1 -- 10.20.193.58:0/646339224 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff25815d4a0 msgr2=0x7ff2580affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:45.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.592+0000 7ff25e36d640 1 --2- 10.20.193.58:0/646339224 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff25815d4a0 0x7ff2580affb0 secure :-1 s=READY pgs=167 gs=3 cs=0 l=1 c_cookie=12683931293577315733 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2580b5040 tx=0x7ff24802f190 comp rx=0 tx=0).stop 2026-02-23T06:21:45.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.592+0000 7ff25e36d640 1 -- 10.20.193.58:0/646339224 shutdown_connections 2026-02-23T06:21:45.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.592+0000 7ff25e36d640 1 --2- 10.20.193.58:0/646339224 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff2580b6690 0x7ff258058cf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.592+0000 7ff25e36d640 1 --2- 10.20.193.58:0/646339224 >> v2:10.20.193.58:3300/0 conn(0x7ff25815d870 0x7ff2580587b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.592+0000 7ff25e36d640 1 --2- 10.20.193.58:0/646339224 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff25815d4a0 0x7ff2580affb0 unknown :-1 s=CLOSED pgs=167 gs=3 cs=0 l=1 c_cookie=12683931293577315733 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.592+0000 7ff25e36d640 1 -- 10.20.193.58:0/646339224 >> 10.20.193.58:0/646339224 conn(0x7ff2580b3c20 msgr2=0x7ff2580b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:45.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.592+0000 7ff25e36d640 1 -- 10.20.193.58:0/646339224 shutdown_connections 2026-02-23T06:21:45.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.592+0000 7ff25e36d640 1 -- 10.20.193.58:0/646339224 wait complete. 2026-02-23T06:21:45.590 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.593+0000 7ff25e36d640 1 Processor -- start 2026-02-23T06:21:45.590 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.593+0000 7ff25e36d640 1 -- start start 2026-02-23T06:21:45.590 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.594+0000 7ff25e36d640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff2580b6690 0x7ff25813f160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:45.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.594+0000 7ff25e36d640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff25815d4a0 0x7ff2580b76b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:45.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.594+0000 7ff25e36d640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff25815d870 0x7ff258162880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:45.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.594+0000 7ff25e36d640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff2580581d0 con 0x7ff2580b6690 2026-02-23T06:21:45.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.594+0000 7ff25e36d640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff25813b6d0 con 0x7ff25815d4a0 2026-02-23T06:21:45.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.594+0000 7ff25e36d640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7ff25813b9b0 con 0x7ff25815d870 2026-02-23T06:21:45.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.594+0000 7ff25d36b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff2580b6690 0x7ff25813f160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:45.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.594+0000 7ff25cb6a640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff25815d4a0 0x7ff2580b76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:45.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.594+0000 7ff25d36b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff2580b6690 0x7ff25813f160 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:57042/0 (socket says 10.20.193.58:57042) 2026-02-23T06:21:45.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.594+0000 7ff25d36b640 1 -- 10.20.193.58:0/2333449527 learned_addr learned my addr 10.20.193.58:0/2333449527 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:45.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.594+0000 7ff25db6c640 1 --2- 10.20.193.58:0/2333449527 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff25815d870 0x7ff258162880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:45.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.594+0000 7ff25d36b640 1 -- 10.20.193.58:0/2333449527 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff25815d870 msgr2=0x7ff258162880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:45.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.594+0000 7ff25d36b640 1 --2- 10.20.193.58:0/2333449527 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff25815d870 0x7ff258162880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.594+0000 7ff25d36b640 1 -- 10.20.193.58:0/2333449527 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff25815d4a0 msgr2=0x7ff2580b76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:45.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.594+0000 7ff25d36b640 1 --2- 10.20.193.58:0/2333449527 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff25815d4a0 0x7ff2580b76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.594+0000 7ff25d36b640 1 -- 10.20.193.58:0/2333449527 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2480094b0 con 0x7ff2580b6690 2026-02-23T06:21:45.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.594+0000 7ff25d36b640 1 --2- 10.20.193.58:0/2333449527 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff2580b6690 0x7ff25813f160 secure :-1 s=READY pgs=172 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2480023d0 tx=0x7ff2480028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:45.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.594+0000 7ff245ffb640 1 -- 10.20.193.58:0/2333449527 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff24803d070 con 0x7ff2580b6690 2026-02-23T06:21:45.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.594+0000 7ff245ffb640 1 -- 10.20.193.58:0/2333449527 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff248002e70 con 0x7ff2580b6690 2026-02-23T06:21:45.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.594+0000 7ff245ffb640 1 -- 10.20.193.58:0/2333449527 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2480386b0 con 0x7ff2580b6690 2026-02-23T06:21:45.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.594+0000 7ff25e36d640 1 -- 10.20.193.58:0/2333449527 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff258057c10 con 0x7ff2580b6690 2026-02-23T06:21:45.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.594+0000 7ff25e36d640 1 -- 10.20.193.58:0/2333449527 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff258162360 con 0x7ff2580b6690 2026-02-23T06:21:45.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.595+0000 7ff2277fe640 1 -- 10.20.193.58:0/2333449527 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2580b7260 con 0x7ff2580b6690 2026-02-23T06:21:45.593 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.596+0000 7ff245ffb640 1 -- 10.20.193.58:0/2333449527 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7ff248038810 con 0x7ff2580b6690 2026-02-23T06:21:45.593 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.597+0000 7ff245ffb640 1 --2- 10.20.193.58:0/2333449527 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff22807a6b0 0x7ff22809ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:45.594 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.597+0000 7ff245ffb640 1 -- 10.20.193.58:0/2333449527 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7ff2480c2560 con 0x7ff2580b6690 2026-02-23T06:21:45.594 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.597+0000 7ff25cb6a640 1 --2- 10.20.193.58:0/2333449527 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff22807a6b0 0x7ff22809ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:45.594 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.598+0000 7ff25cb6a640 1 --2- 10.20.193.58:0/2333449527 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff22807a6b0 0x7ff22809ab60 secure :-1 s=READY pgs=110 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff258160220 tx=0x7ff24c005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:45.594 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.599+0000 7ff245ffb640 1 -- 10.20.193.58:0/2333449527 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7ff2480856d0 con 0x7ff2580b6690 2026-02-23T06:21:45.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.712+0000 7ff2277fe640 1 -- 10.20.193.58:0/2333449527 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff2580ae710 con 0x7ff2580b6690 2026-02-23T06:21:45.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.712+0000 7ff245ffb640 1 -- 10.20.193.58:0/2333449527 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7ff248005d40 con 0x7ff2580b6690 2026-02-23T06:21:45.707 INFO:teuthology.orchestra.run.trial058.stdout:pg_num: 64 2026-02-23T06:21:45.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.713+0000 7ff2277fe640 1 -- 10.20.193.58:0/2333449527 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff22807a6b0 msgr2=0x7ff22809ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:45.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.713+0000 7ff2277fe640 1 --2- 10.20.193.58:0/2333449527 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff22807a6b0 0x7ff22809ab60 secure :-1 s=READY pgs=110 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff258160220 tx=0x7ff24c005f90 comp rx=0 tx=0).stop 2026-02-23T06:21:45.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.713+0000 7ff2277fe640 1 -- 10.20.193.58:0/2333449527 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff2580b6690 msgr2=0x7ff25813f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:45.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.713+0000 7ff2277fe640 1 --2- 10.20.193.58:0/2333449527 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff2580b6690 0x7ff25813f160 secure :-1 s=READY pgs=172 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2480023d0 tx=0x7ff2480028d0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.713+0000 7ff2277fe640 1 -- 10.20.193.58:0/2333449527 shutdown_connections 2026-02-23T06:21:45.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.713+0000 7ff2277fe640 1 --2- 10.20.193.58:0/2333449527 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff22807a6b0 0x7ff22809ab60 unknown :-1 s=CLOSED pgs=110 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.713+0000 7ff2277fe640 1 --2- 10.20.193.58:0/2333449527 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff25815d870 0x7ff258162880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.713+0000 7ff2277fe640 1 --2- 10.20.193.58:0/2333449527 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff25815d4a0 0x7ff2580b76b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.713+0000 7ff2277fe640 1 --2- 10.20.193.58:0/2333449527 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff2580b6690 0x7ff25813f160 unknown :-1 s=CLOSED pgs=172 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.713+0000 7ff2277fe640 1 -- 10.20.193.58:0/2333449527 >> 10.20.193.58:0/2333449527 conn(0x7ff2580b3c20 msgr2=0x7ff25815bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:45.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.713+0000 7ff2277fe640 1 -- 10.20.193.58:0/2333449527 shutdown_connections 2026-02-23T06:21:45.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.713+0000 7ff2277fe640 1 -- 10.20.193.58:0/2333449527 wait complete. 2026-02-23T06:21:45.722 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2026-02-23T06:21:45.845 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.850+0000 7fbdd4b30640 1 -- 10.20.193.58:0/212406558 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbdd00576d0 msgr2=0x7fbdd0058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:45.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.850+0000 7fbdd4b30640 1 --2- 10.20.193.58:0/212406558 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbdd00576d0 0x7fbdd0058200 secure :-1 s=READY pgs=174 gs=3 cs=0 l=1 c_cookie=10991706973133446514 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdc4005820 tx=0x7fbdc4030300 comp rx=0 tx=0).stop 2026-02-23T06:21:45.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.850+0000 7fbdd4b30640 1 -- 10.20.193.58:0/212406558 shutdown_connections 2026-02-23T06:21:45.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.850+0000 7fbdd4b30640 1 --2- 10.20.193.58:0/212406558 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbdd00576d0 0x7fbdd0058200 unknown :-1 s=CLOSED pgs=174 gs=3 cs=0 l=1 c_cookie=10991706973133446514 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.850+0000 7fbdd4b30640 1 -- 10.20.193.58:0/212406558 >> 10.20.193.58:0/212406558 conn(0x7fbdd00b3c20 msgr2=0x7fbdd00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:45.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.850+0000 7fbdd4b30640 1 -- 10.20.193.58:0/212406558 shutdown_connections 2026-02-23T06:21:45.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.850+0000 7fbdd4b30640 1 -- 10.20.193.58:0/212406558 wait complete. 2026-02-23T06:21:45.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.851+0000 7fbdd4b30640 1 Processor -- start 2026-02-23T06:21:45.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.852+0000 7fbdd4b30640 1 -- start start 2026-02-23T06:21:45.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.852+0000 7fbdd4b30640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbdd0056960 0x7fbdd0148350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:45.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.852+0000 7fbdd4b30640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbdd00576d0 0x7fbdd013cfd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:45.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.852+0000 7fbdd4b30640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbdd015c4b0 0x7fbdd01201a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:45.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.852+0000 7fbdd4b30640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd013bb00 con 0x7fbdd0056960 2026-02-23T06:21:45.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.852+0000 7fbdd4b30640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd014b7d0 con 0x7fbdd015c4b0 2026-02-23T06:21:45.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.852+0000 7fbdd4b30640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd0148890 con 0x7fbdd00576d0 2026-02-23T06:21:45.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.852+0000 7fbdcf7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbdd0056960 0x7fbdd0148350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:45.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.852+0000 7fbdceffd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbdd00576d0 0x7fbdd013cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:45.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.852+0000 7fbdcf7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbdd0056960 0x7fbdd0148350 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:57050/0 (socket says 10.20.193.58:57050) 2026-02-23T06:21:45.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.852+0000 7fbdcf7fe640 1 -- 10.20.193.58:0/2968401090 learned_addr learned my addr 10.20.193.58:0/2968401090 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:45.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.852+0000 7fbdcffff640 1 --2- 10.20.193.58:0/2968401090 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbdd015c4b0 0x7fbdd01201a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:45.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.853+0000 7fbdcf7fe640 1 -- 10.20.193.58:0/2968401090 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbdd00576d0 msgr2=0x7fbdd013cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:45.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.853+0000 7fbdcf7fe640 1 --2- 10.20.193.58:0/2968401090 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbdd00576d0 0x7fbdd013cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.853+0000 7fbdcf7fe640 1 -- 10.20.193.58:0/2968401090 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbdd015c4b0 msgr2=0x7fbdd01201a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:45.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.853+0000 7fbdcf7fe640 1 --2- 10.20.193.58:0/2968401090 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbdd015c4b0 0x7fbdd01201a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.853+0000 7fbdcf7fe640 1 -- 10.20.193.58:0/2968401090 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc400a590 con 0x7fbdd0056960 2026-02-23T06:21:45.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.853+0000 7fbdcf7fe640 1 --2- 10.20.193.58:0/2968401090 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbdd0056960 0x7fbdd0148350 secure :-1 s=READY pgs=175 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdbc00c4f0 tx=0x7fbdbc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:45.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.853+0000 7fbdabfff640 1 -- 10.20.193.58:0/2968401090 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbdbc006ab0 con 0x7fbdd0056960 2026-02-23T06:21:45.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.853+0000 7fbdabfff640 1 -- 10.20.193.58:0/2968401090 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbdbc006d00 con 0x7fbdd0056960 2026-02-23T06:21:45.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.853+0000 7fbdabfff640 1 -- 10.20.193.58:0/2968401090 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbdbc0072b0 con 0x7fbdd0056960 2026-02-23T06:21:45.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.853+0000 7fbdd4b30640 1 -- 10.20.193.58:0/2968401090 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdd014aec0 con 0x7fbdd0056960 2026-02-23T06:21:45.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.853+0000 7fbdd4b30640 1 -- 10.20.193.58:0/2968401090 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdd011e840 con 0x7fbdd0056960 2026-02-23T06:21:45.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.853+0000 7fbdd4b30640 1 -- 10.20.193.58:0/2968401090 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdd0058070 con 0x7fbdd0056960 2026-02-23T06:21:45.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.855+0000 7fbdabfff640 1 -- 10.20.193.58:0/2968401090 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fbdbc019070 con 0x7fbdd0056960 2026-02-23T06:21:45.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.856+0000 7fbdabfff640 1 --2- 10.20.193.58:0/2968401090 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbda007a6c0 0x7fbda009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:45.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.856+0000 7fbdabfff640 1 -- 10.20.193.58:0/2968401090 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7fbdbc09cb40 con 0x7fbdd0056960 2026-02-23T06:21:45.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.856+0000 7fbdceffd640 1 --2- 10.20.193.58:0/2968401090 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbda007a6c0 0x7fbda009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:45.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.857+0000 7fbdceffd640 1 --2- 10.20.193.58:0/2968401090 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbda007a6c0 0x7fbda009ab70 secure :-1 s=READY pgs=111 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdd015fca0 tx=0x7fbdc0007d70 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:45.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.858+0000 7fbdabfff640 1 -- 10.20.193.58:0/2968401090 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fbdbc05fc90 con 0x7fbdd0056960 2026-02-23T06:21:45.964 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.970+0000 7fbdd4b30640 1 -- 10.20.193.58:0/2968401090 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fbdd0162ca0 con 0x7fbdd0056960 2026-02-23T06:21:45.965 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.970+0000 7fbdabfff640 1 -- 10.20.193.58:0/2968401090 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7fbdbc062db0 con 0x7fbdd0056960 2026-02-23T06:21:45.965 INFO:teuthology.orchestra.run.trial058.stdout:pg_num: 32 2026-02-23T06:21:45.966 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.972+0000 7fbdd4b30640 1 -- 10.20.193.58:0/2968401090 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbda007a6c0 msgr2=0x7fbda009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:45.966 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.972+0000 7fbdd4b30640 1 --2- 10.20.193.58:0/2968401090 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbda007a6c0 0x7fbda009ab70 secure :-1 s=READY pgs=111 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdd015fca0 tx=0x7fbdc0007d70 comp rx=0 tx=0).stop 2026-02-23T06:21:45.966 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.972+0000 7fbdd4b30640 1 -- 10.20.193.58:0/2968401090 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbdd0056960 msgr2=0x7fbdd0148350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:45.966 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.972+0000 7fbdd4b30640 1 --2- 10.20.193.58:0/2968401090 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbdd0056960 0x7fbdd0148350 secure :-1 s=READY pgs=175 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdbc00c4f0 tx=0x7fbdbc00c9c0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.966 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.972+0000 7fbdd4b30640 1 -- 10.20.193.58:0/2968401090 shutdown_connections 2026-02-23T06:21:45.966 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.972+0000 7fbdd4b30640 1 --2- 10.20.193.58:0/2968401090 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbda007a6c0 0x7fbda009ab70 unknown :-1 s=CLOSED pgs=111 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.967 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.972+0000 7fbdd4b30640 1 --2- 10.20.193.58:0/2968401090 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbdd015c4b0 0x7fbdd01201a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.967 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.972+0000 7fbdd4b30640 1 --2- 10.20.193.58:0/2968401090 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbdd00576d0 0x7fbdd013cfd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.967 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.972+0000 7fbdd4b30640 1 --2- 10.20.193.58:0/2968401090 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbdd0056960 0x7fbdd0148350 unknown :-1 s=CLOSED pgs=175 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:45.967 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.972+0000 7fbdd4b30640 1 -- 10.20.193.58:0/2968401090 >> 10.20.193.58:0/2968401090 conn(0x7fbdd00b3c20 msgr2=0x7fbdd015b350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:45.967 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.972+0000 7fbdd4b30640 1 -- 10.20.193.58:0/2968401090 shutdown_connections 2026-02-23T06:21:45.967 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:45.972+0000 7fbdd4b30640 1 -- 10.20.193.58:0/2968401090 wait complete. 2026-02-23T06:21:45.978 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2026-02-23T06:21:45.978 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-23T06:21:46.099 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.104+0000 7ff93e5be640 1 -- 10.20.193.58:0/1161053083 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff938169100 msgr2=0x7ff93815f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:46.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.104+0000 7ff93e5be640 1 --2- 10.20.193.58:0/1161053083 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff938169100 0x7ff93815f1a0 secure :-1 s=READY pgs=170 gs=3 cs=0 l=1 c_cookie=15706517120823024865 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff93805d4b0 tx=0x7ff934030270 comp rx=0 tx=0).stop 2026-02-23T06:21:46.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.104+0000 7ff93e5be640 1 -- 10.20.193.58:0/1161053083 shutdown_connections 2026-02-23T06:21:46.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.104+0000 7ff93e5be640 1 --2- 10.20.193.58:0/1161053083 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff938169100 0x7ff93815f1a0 unknown :-1 s=CLOSED pgs=170 gs=3 cs=0 l=1 c_cookie=15706517120823024865 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.104+0000 7ff93e5be640 1 --2- 10.20.193.58:0/1161053083 >> v2:10.20.193.58:3300/0 conn(0x7ff9380b3d50 0x7ff938168bc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.104+0000 7ff93e5be640 1 -- 10.20.193.58:0/1161053083 >> 10.20.193.58:0/1161053083 conn(0x7ff938059db0 msgr2=0x7ff93805a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:46.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.104+0000 7ff93e5be640 1 -- 10.20.193.58:0/1161053083 shutdown_connections 2026-02-23T06:21:46.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.104+0000 7ff93e5be640 1 -- 10.20.193.58:0/1161053083 wait complete. 2026-02-23T06:21:46.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.105+0000 7ff93e5be640 1 Processor -- start 2026-02-23T06:21:46.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.106+0000 7ff93e5be640 1 -- start start 2026-02-23T06:21:46.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.106+0000 7ff93e5be640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff9380b3980 0x7ff9381fd140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:46.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.106+0000 7ff93e5be640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9380b3d50 0x7ff9380b2180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:46.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.106+0000 7ff93e5be640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff938169100 0x7ff93813d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:46.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.106+0000 7ff93e5be640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff9381682e0 con 0x7ff9380b3980 2026-02-23T06:21:46.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.106+0000 7ff93e5be640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff9381676b0 con 0x7ff9380b3d50 2026-02-23T06:21:46.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.106+0000 7ff93e5be640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7ff938201020 con 0x7ff938169100 2026-02-23T06:21:46.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.106+0000 7ff93cdbb640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9380b3d50 0x7ff9380b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:46.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.106+0000 7ff93d5bc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff9380b3980 0x7ff9381fd140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:46.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.106+0000 7ff93cdbb640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9380b3d50 0x7ff9380b2180 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:59586/0 (socket says 10.20.193.58:59586) 2026-02-23T06:21:46.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.106+0000 7ff93cdbb640 1 -- 10.20.193.58:0/616922981 learned_addr learned my addr 10.20.193.58:0/616922981 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:46.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.106+0000 7ff93ddbd640 1 --2- 10.20.193.58:0/616922981 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff938169100 0x7ff93813d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:46.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.107+0000 7ff93d5bc640 1 -- 10.20.193.58:0/616922981 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff938169100 msgr2=0x7ff93813d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:46.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.107+0000 7ff93d5bc640 1 --2- 10.20.193.58:0/616922981 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff938169100 0x7ff93813d570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.107+0000 7ff93d5bc640 1 -- 10.20.193.58:0/616922981 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9380b3d50 msgr2=0x7ff9380b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:46.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.107+0000 7ff93d5bc640 1 --2- 10.20.193.58:0/616922981 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9380b3d50 0x7ff9380b2180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.107+0000 7ff93d5bc640 1 -- 10.20.193.58:0/616922981 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff93400a590 con 0x7ff9380b3980 2026-02-23T06:21:46.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.107+0000 7ff93cdbb640 1 --2- 10.20.193.58:0/616922981 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9380b3d50 0x7ff9380b2180 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:46.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.107+0000 7ff93d5bc640 1 --2- 10.20.193.58:0/616922981 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff9380b3980 0x7ff9381fd140 secure :-1 s=READY pgs=176 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff92800c4d0 tx=0x7ff92800c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:46.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.107+0000 7ff925ffb640 1 -- 10.20.193.58:0/616922981 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff928012850 con 0x7ff9380b3980 2026-02-23T06:21:46.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.107+0000 7ff925ffb640 1 -- 10.20.193.58:0/616922981 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff928012aa0 con 0x7ff9380b3980 2026-02-23T06:21:46.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.107+0000 7ff93e5be640 1 -- 10.20.193.58:0/616922981 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff938134df0 con 0x7ff9380b3980 2026-02-23T06:21:46.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.107+0000 7ff925ffb640 1 -- 10.20.193.58:0/616922981 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff928011380 con 0x7ff9380b3980 2026-02-23T06:21:46.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.107+0000 7ff93e5be640 1 -- 10.20.193.58:0/616922981 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9382009d0 con 0x7ff9380b3980 2026-02-23T06:21:46.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.108+0000 7ff93e5be640 1 -- 10.20.193.58:0/616922981 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff93805dfc0 con 0x7ff9380b3980 2026-02-23T06:21:46.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.109+0000 7ff925ffb640 1 -- 10.20.193.58:0/616922981 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7ff928022020 con 0x7ff9380b3980 2026-02-23T06:21:46.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.110+0000 7ff925ffb640 1 --2- 10.20.193.58:0/616922981 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff90807a6c0 0x7ff90809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:46.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.110+0000 7ff925ffb640 1 -- 10.20.193.58:0/616922981 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7ff92809d250 con 0x7ff9380b3980 2026-02-23T06:21:46.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.110+0000 7ff93cdbb640 1 --2- 10.20.193.58:0/616922981 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff90807a6c0 0x7ff90809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:46.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.111+0000 7ff93cdbb640 1 --2- 10.20.193.58:0/616922981 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff90807a6c0 0x7ff90809ab70 secure :-1 s=READY pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9380b8650 tx=0x7ff92c00b4a0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:46.107 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.111+0000 7ff925ffb640 1 -- 10.20.193.58:0/616922981 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7ff928060450 con 0x7ff9380b3980 2026-02-23T06:21:46.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.223+0000 7ff93e5be640 1 -- 10.20.193.58:0/616922981 --> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff938165a50 con 0x7ff90807a6c0 2026-02-23T06:21:46.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.227+0000 7ff925ffb640 1 -- 10.20.193.58:0/616922981 <== mgr.4126 v2:10.20.193.93:6800/4124709854 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332641 (secure 0 0 0) 0x7ff92c015070 con 0x7ff90807a6c0 2026-02-23T06:21:46.226 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:46.228 INFO:teuthology.orchestra.run.trial058.stderr:dumped all 2026-02-23T06:21:46.230 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.229+0000 7ff93e5be640 1 -- 10.20.193.58:0/616922981 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff90807a6c0 msgr2=0x7ff90809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:46.230 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.229+0000 7ff93e5be640 1 --2- 10.20.193.58:0/616922981 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff90807a6c0 0x7ff90809ab70 secure :-1 s=READY pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9380b8650 tx=0x7ff92c00b4a0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.230 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.229+0000 7ff93e5be640 1 -- 10.20.193.58:0/616922981 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff9380b3980 msgr2=0x7ff9381fd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:46.230 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.229+0000 7ff93e5be640 1 --2- 10.20.193.58:0/616922981 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff9380b3980 0x7ff9381fd140 secure :-1 s=READY pgs=176 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff92800c4d0 tx=0x7ff92800c9a0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.230 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.229+0000 7ff93e5be640 1 -- 10.20.193.58:0/616922981 shutdown_connections 2026-02-23T06:21:46.230 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.229+0000 7ff93e5be640 1 --2- 10.20.193.58:0/616922981 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff90807a6c0 0x7ff90809ab70 unknown :-1 s=CLOSED pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.230 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.229+0000 7ff93e5be640 1 --2- 10.20.193.58:0/616922981 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff938169100 0x7ff93813d570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.229+0000 7ff93e5be640 1 --2- 10.20.193.58:0/616922981 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9380b3d50 0x7ff9380b2180 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.229+0000 7ff93e5be640 1 --2- 10.20.193.58:0/616922981 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff9380b3980 0x7ff9381fd140 unknown :-1 s=CLOSED pgs=176 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.229+0000 7ff93e5be640 1 -- 10.20.193.58:0/616922981 >> 10.20.193.58:0/616922981 conn(0x7ff938059db0 msgr2=0x7ff93815d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:46.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.229+0000 7ff93e5be640 1 -- 10.20.193.58:0/616922981 shutdown_connections 2026-02-23T06:21:46.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.230+0000 7ff93e5be640 1 -- 10.20.193.58:0/616922981 wait complete. 2026-02-23T06:21:46.236 INFO:teuthology.orchestra.run.trial058.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2026-02-23T06:21:44.378068+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595115,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":193,"num_write_kb":2690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":217952,"kb_used_data":2272,"kb_used_omap":107,"kb_used_meta":215444,"kb_avail":754756768,"statfs":{"total":773094113280,"available":772870930432,"internally_reserved":0,"allocated":2326528,"data_stored":2026430,"data_compressed":70172,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":110106,"internal_metadata":220615142},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2293,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001752"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156952+0000","last_change":"2026-02-23T06:21:17.142582+0000","last_active":"2026-02-23T06:21:23.156952+0000","last_peered":"2026-02-23T06:21:23.156952+0000","last_clean":"2026-02-23T06:21:23.156952+0000","last_became_active":"2026-02-23T06:21:17.142416+0000","last_became_peered":"2026-02-23T06:21:17.142416+0000","last_unstale":"2026-02-23T06:21:23.156952+0000","last_undegraded":"2026-02-23T06:21:23.156952+0000","last_fullsized":"2026-02-23T06:21:23.156952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:13:12.649937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157112+0000","last_change":"2026-02-23T06:21:18.148362+0000","last_active":"2026-02-23T06:21:23.157112+0000","last_peered":"2026-02-23T06:21:23.157112+0000","last_clean":"2026-02-23T06:21:23.157112+0000","last_became_active":"2026-02-23T06:21:18.148276+0000","last_became_peered":"2026-02-23T06:21:18.148276+0000","last_unstale":"2026-02-23T06:21:23.157112+0000","last_undegraded":"2026-02-23T06:21:23.157112+0000","last_fullsized":"2026-02-23T06:21:23.157112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:47.221741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156473+0000","last_change":"2026-02-23T06:21:22.169541+0000","last_active":"2026-02-23T06:21:23.156473+0000","last_peered":"2026-02-23T06:21:23.156473+0000","last_clean":"2026-02-23T06:21:23.156473+0000","last_became_active":"2026-02-23T06:21:22.169307+0000","last_became_peered":"2026-02-23T06:21:22.169307+0000","last_unstale":"2026-02-23T06:21:23.156473+0000","last_undegraded":"2026-02-23T06:21:23.156473+0000","last_fullsized":"2026-02-23T06:21:23.156473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:40:10.952374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157171+0000","last_change":"2026-02-23T06:21:17.138864+0000","last_active":"2026-02-23T06:21:23.157171+0000","last_peered":"2026-02-23T06:21:23.157171+0000","last_clean":"2026-02-23T06:21:23.157171+0000","last_became_active":"2026-02-23T06:21:17.138651+0000","last_became_peered":"2026-02-23T06:21:17.138651+0000","last_unstale":"2026-02-23T06:21:23.157171+0000","last_undegraded":"2026-02-23T06:21:23.157171+0000","last_fullsized":"2026-02-23T06:21:23.157171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:24.172617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157312+0000","last_change":"2026-02-23T06:21:18.145040+0000","last_active":"2026-02-23T06:21:23.157312+0000","last_peered":"2026-02-23T06:21:23.157312+0000","last_clean":"2026-02-23T06:21:23.157312+0000","last_became_active":"2026-02-23T06:21:18.144915+0000","last_became_peered":"2026-02-23T06:21:18.144915+0000","last_unstale":"2026-02-23T06:21:23.157312+0000","last_undegraded":"2026-02-23T06:21:23.157312+0000","last_fullsized":"2026-02-23T06:21:23.157312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:17:30.105623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158170+0000","last_change":"2026-02-23T06:21:22.172729+0000","last_active":"2026-02-23T06:21:23.158170+0000","last_peered":"2026-02-23T06:21:23.158170+0000","last_clean":"2026-02-23T06:21:23.158170+0000","last_became_active":"2026-02-23T06:21:22.172510+0000","last_became_peered":"2026-02-23T06:21:22.172510+0000","last_unstale":"2026-02-23T06:21:23.158170+0000","last_undegraded":"2026-02-23T06:21:23.158170+0000","last_fullsized":"2026-02-23T06:21:23.158170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:53:55.801734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158943+0000","last_change":"2026-02-23T06:21:17.150375+0000","last_active":"2026-02-23T06:21:23.158943+0000","last_peered":"2026-02-23T06:21:23.158943+0000","last_clean":"2026-02-23T06:21:23.158943+0000","last_became_active":"2026-02-23T06:21:17.150244+0000","last_became_peered":"2026-02-23T06:21:17.150244+0000","last_unstale":"2026-02-23T06:21:23.158943+0000","last_undegraded":"2026-02-23T06:21:23.158943+0000","last_fullsized":"2026-02-23T06:21:23.158943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:06:21.465108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157674+0000","last_change":"2026-02-23T06:21:18.150247+0000","last_active":"2026-02-23T06:21:23.157674+0000","last_peered":"2026-02-23T06:21:23.157674+0000","last_clean":"2026-02-23T06:21:23.157674+0000","last_became_active":"2026-02-23T06:21:18.149827+0000","last_became_peered":"2026-02-23T06:21:18.149827+0000","last_unstale":"2026-02-23T06:21:23.157674+0000","last_undegraded":"2026-02-23T06:21:23.157674+0000","last_fullsized":"2026-02-23T06:21:23.157674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:37:58.944726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158517+0000","last_change":"2026-02-23T06:21:22.174417+0000","last_active":"2026-02-23T06:21:23.158517+0000","last_peered":"2026-02-23T06:21:23.158517+0000","last_clean":"2026-02-23T06:21:23.158517+0000","last_became_active":"2026-02-23T06:21:22.173939+0000","last_became_peered":"2026-02-23T06:21:22.173939+0000","last_unstale":"2026-02-23T06:21:23.158517+0000","last_undegraded":"2026-02-23T06:21:23.158517+0000","last_fullsized":"2026-02-23T06:21:23.158517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:41:53.008301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158816+0000","last_change":"2026-02-23T06:21:17.145244+0000","last_active":"2026-02-23T06:21:23.158816+0000","last_peered":"2026-02-23T06:21:23.158816+0000","last_clean":"2026-02-23T06:21:23.158816+0000","last_became_active":"2026-02-23T06:21:17.144122+0000","last_became_peered":"2026-02-23T06:21:17.144122+0000","last_unstale":"2026-02-23T06:21:23.158816+0000","last_undegraded":"2026-02-23T06:21:23.158816+0000","last_fullsized":"2026-02-23T06:21:23.158816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:42:56.020005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159068+0000","last_change":"2026-02-23T06:21:18.155799+0000","last_active":"2026-02-23T06:21:23.159068+0000","last_peered":"2026-02-23T06:21:23.159068+0000","last_clean":"2026-02-23T06:21:23.159068+0000","last_became_active":"2026-02-23T06:21:18.154985+0000","last_became_peered":"2026-02-23T06:21:18.154985+0000","last_unstale":"2026-02-23T06:21:23.159068+0000","last_undegraded":"2026-02-23T06:21:23.159068+0000","last_fullsized":"2026-02-23T06:21:23.159068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:11:13.595733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158472+0000","last_change":"2026-02-23T06:21:22.168755+0000","last_active":"2026-02-23T06:21:23.158472+0000","last_peered":"2026-02-23T06:21:23.158472+0000","last_clean":"2026-02-23T06:21:23.158472+0000","last_became_active":"2026-02-23T06:21:22.165671+0000","last_became_peered":"2026-02-23T06:21:22.165671+0000","last_unstale":"2026-02-23T06:21:23.158472+0000","last_undegraded":"2026-02-23T06:21:23.158472+0000","last_fullsized":"2026-02-23T06:21:23.158472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:04:32.848929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157587+0000","last_change":"2026-02-23T06:21:18.150907+0000","last_active":"2026-02-23T06:21:23.157587+0000","last_peered":"2026-02-23T06:21:23.157587+0000","last_clean":"2026-02-23T06:21:23.157587+0000","last_became_active":"2026-02-23T06:21:18.150604+0000","last_became_peered":"2026-02-23T06:21:18.150604+0000","last_unstale":"2026-02-23T06:21:23.157587+0000","last_undegraded":"2026-02-23T06:21:23.157587+0000","last_fullsized":"2026-02-23T06:21:23.157587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:15:21.672153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157971+0000","last_change":"2026-02-23T06:21:17.147523+0000","last_active":"2026-02-23T06:21:23.157971+0000","last_peered":"2026-02-23T06:21:23.157971+0000","last_clean":"2026-02-23T06:21:23.157971+0000","last_became_active":"2026-02-23T06:21:17.147351+0000","last_became_peered":"2026-02-23T06:21:17.147351+0000","last_unstale":"2026-02-23T06:21:23.157971+0000","last_undegraded":"2026-02-23T06:21:23.157971+0000","last_fullsized":"2026-02-23T06:21:23.157971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:36:34.550499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158924+0000","last_change":"2026-02-23T06:21:22.169413+0000","last_active":"2026-02-23T06:21:23.158924+0000","last_peered":"2026-02-23T06:21:23.158924+0000","last_clean":"2026-02-23T06:21:23.158924+0000","last_became_active":"2026-02-23T06:21:22.169259+0000","last_became_peered":"2026-02-23T06:21:22.169259+0000","last_unstale":"2026-02-23T06:21:23.158924+0000","last_undegraded":"2026-02-23T06:21:23.158924+0000","last_fullsized":"2026-02-23T06:21:23.158924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:14:12.944321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156495+0000","last_change":"2026-02-23T06:21:18.142316+0000","last_active":"2026-02-23T06:21:23.156495+0000","last_peered":"2026-02-23T06:21:23.156495+0000","last_clean":"2026-02-23T06:21:23.156495+0000","last_became_active":"2026-02-23T06:21:18.142144+0000","last_became_peered":"2026-02-23T06:21:18.142144+0000","last_unstale":"2026-02-23T06:21:23.156495+0000","last_undegraded":"2026-02-23T06:21:23.156495+0000","last_fullsized":"2026-02-23T06:21:23.156495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:53:33.429271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157370+0000","last_change":"2026-02-23T06:21:17.137576+0000","last_active":"2026-02-23T06:21:23.157370+0000","last_peered":"2026-02-23T06:21:23.157370+0000","last_clean":"2026-02-23T06:21:23.157370+0000","last_became_active":"2026-02-23T06:21:17.137371+0000","last_became_peered":"2026-02-23T06:21:17.137371+0000","last_unstale":"2026-02-23T06:21:23.157370+0000","last_undegraded":"2026-02-23T06:21:23.157370+0000","last_fullsized":"2026-02-23T06:21:23.157370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:27.159743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158222+0000","last_change":"2026-02-23T06:21:22.163003+0000","last_active":"2026-02-23T06:21:23.158222+0000","last_peered":"2026-02-23T06:21:23.158222+0000","last_clean":"2026-02-23T06:21:23.158222+0000","last_became_active":"2026-02-23T06:21:22.162898+0000","last_became_peered":"2026-02-23T06:21:22.162898+0000","last_unstale":"2026-02-23T06:21:23.158222+0000","last_undegraded":"2026-02-23T06:21:23.158222+0000","last_fullsized":"2026-02-23T06:21:23.158222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:29:18.161667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156351+0000","last_change":"2026-02-23T06:21:18.141281+0000","last_active":"2026-02-23T06:21:23.156351+0000","last_peered":"2026-02-23T06:21:23.156351+0000","last_clean":"2026-02-23T06:21:23.156351+0000","last_became_active":"2026-02-23T06:21:18.141090+0000","last_became_peered":"2026-02-23T06:21:18.141090+0000","last_unstale":"2026-02-23T06:21:23.156351+0000","last_undegraded":"2026-02-23T06:21:23.156351+0000","last_fullsized":"2026-02-23T06:21:23.156351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:12:21.750595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156633+0000","last_change":"2026-02-23T06:21:17.144179+0000","last_active":"2026-02-23T06:21:23.156633+0000","last_peered":"2026-02-23T06:21:23.156633+0000","last_clean":"2026-02-23T06:21:23.156633+0000","last_became_active":"2026-02-23T06:21:17.144017+0000","last_became_peered":"2026-02-23T06:21:17.144017+0000","last_unstale":"2026-02-23T06:21:23.156633+0000","last_undegraded":"2026-02-23T06:21:23.156633+0000","last_fullsized":"2026-02-23T06:21:23.156633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:25:41.992201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156888+0000","last_change":"2026-02-23T06:21:22.174826+0000","last_active":"2026-02-23T06:21:23.156888+0000","last_peered":"2026-02-23T06:21:23.156888+0000","last_clean":"2026-02-23T06:21:23.156888+0000","last_became_active":"2026-02-23T06:21:22.174683+0000","last_became_peered":"2026-02-23T06:21:22.174683+0000","last_unstale":"2026-02-23T06:21:23.156888+0000","last_undegraded":"2026-02-23T06:21:23.156888+0000","last_fullsized":"2026-02-23T06:21:23.156888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:04:49.277580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157342+0000","last_change":"2026-02-23T06:21:18.145331+0000","last_active":"2026-02-23T06:21:23.157342+0000","last_peered":"2026-02-23T06:21:23.157342+0000","last_clean":"2026-02-23T06:21:23.157342+0000","last_became_active":"2026-02-23T06:21:18.145231+0000","last_became_peered":"2026-02-23T06:21:18.145231+0000","last_unstale":"2026-02-23T06:21:23.157342+0000","last_undegraded":"2026-02-23T06:21:23.157342+0000","last_fullsized":"2026-02-23T06:21:23.157342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:32:44.487867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157126+0000","last_change":"2026-02-23T06:21:17.147584+0000","last_active":"2026-02-23T06:21:23.157126+0000","last_peered":"2026-02-23T06:21:23.157126+0000","last_clean":"2026-02-23T06:21:23.157126+0000","last_became_active":"2026-02-23T06:21:17.147431+0000","last_became_peered":"2026-02-23T06:21:17.147431+0000","last_unstale":"2026-02-23T06:21:23.157126+0000","last_undegraded":"2026-02-23T06:21:23.157126+0000","last_fullsized":"2026-02-23T06:21:23.157126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:10:39.127457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159080+0000","last_change":"2026-02-23T06:21:22.175656+0000","last_active":"2026-02-23T06:21:23.159080+0000","last_peered":"2026-02-23T06:21:23.159080+0000","last_clean":"2026-02-23T06:21:23.159080+0000","last_became_active":"2026-02-23T06:21:22.175493+0000","last_became_peered":"2026-02-23T06:21:22.175493+0000","last_unstale":"2026-02-23T06:21:23.159080+0000","last_undegraded":"2026-02-23T06:21:23.159080+0000","last_fullsized":"2026-02-23T06:21:23.159080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:10:41.366772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156769+0000","last_change":"2026-02-23T06:21:18.141486+0000","last_active":"2026-02-23T06:21:23.156769+0000","last_peered":"2026-02-23T06:21:23.156769+0000","last_clean":"2026-02-23T06:21:23.156769+0000","last_became_active":"2026-02-23T06:21:18.141277+0000","last_became_peered":"2026-02-23T06:21:18.141277+0000","last_unstale":"2026-02-23T06:21:23.156769+0000","last_undegraded":"2026-02-23T06:21:23.156769+0000","last_fullsized":"2026-02-23T06:21:23.156769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:21:15.738187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158970+0000","last_change":"2026-02-23T06:21:17.148536+0000","last_active":"2026-02-23T06:21:23.158970+0000","last_peered":"2026-02-23T06:21:23.158970+0000","last_clean":"2026-02-23T06:21:23.158970+0000","last_became_active":"2026-02-23T06:21:17.148424+0000","last_became_peered":"2026-02-23T06:21:17.148424+0000","last_unstale":"2026-02-23T06:21:23.158970+0000","last_undegraded":"2026-02-23T06:21:23.158970+0000","last_fullsized":"2026-02-23T06:21:23.158970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:02:54.995144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158363+0000","last_change":"2026-02-23T06:21:22.171333+0000","last_active":"2026-02-23T06:21:23.158363+0000","last_peered":"2026-02-23T06:21:23.158363+0000","last_clean":"2026-02-23T06:21:23.158363+0000","last_became_active":"2026-02-23T06:21:22.170496+0000","last_became_peered":"2026-02-23T06:21:22.170496+0000","last_unstale":"2026-02-23T06:21:23.158363+0000","last_undegraded":"2026-02-23T06:21:23.158363+0000","last_fullsized":"2026-02-23T06:21:23.158363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:40:07.996281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156943+0000","last_change":"2026-02-23T06:21:18.142135+0000","last_active":"2026-02-23T06:21:23.156943+0000","last_peered":"2026-02-23T06:21:23.156943+0000","last_clean":"2026-02-23T06:21:23.156943+0000","last_became_active":"2026-02-23T06:21:18.141771+0000","last_became_peered":"2026-02-23T06:21:18.141771+0000","last_unstale":"2026-02-23T06:21:23.156943+0000","last_undegraded":"2026-02-23T06:21:23.156943+0000","last_fullsized":"2026-02-23T06:21:23.156943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:10:18.195986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156859+0000","last_change":"2026-02-23T06:21:17.142326+0000","last_active":"2026-02-23T06:21:23.156859+0000","last_peered":"2026-02-23T06:21:23.156859+0000","last_clean":"2026-02-23T06:21:23.156859+0000","last_became_active":"2026-02-23T06:21:17.142203+0000","last_became_peered":"2026-02-23T06:21:17.142203+0000","last_unstale":"2026-02-23T06:21:23.156859+0000","last_undegraded":"2026-02-23T06:21:23.156859+0000","last_fullsized":"2026-02-23T06:21:23.156859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:49:44.262210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156453+0000","last_change":"2026-02-23T06:21:22.168717+0000","last_active":"2026-02-23T06:21:23.156453+0000","last_peered":"2026-02-23T06:21:23.156453+0000","last_clean":"2026-02-23T06:21:23.156453+0000","last_became_active":"2026-02-23T06:21:22.168375+0000","last_became_peered":"2026-02-23T06:21:22.168375+0000","last_unstale":"2026-02-23T06:21:23.156453+0000","last_undegraded":"2026-02-23T06:21:23.156453+0000","last_fullsized":"2026-02-23T06:21:23.156453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:03:53.993581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157404+0000","last_change":"2026-02-23T06:21:18.141908+0000","last_active":"2026-02-23T06:21:23.157404+0000","last_peered":"2026-02-23T06:21:23.157404+0000","last_clean":"2026-02-23T06:21:23.157404+0000","last_became_active":"2026-02-23T06:21:18.141363+0000","last_became_peered":"2026-02-23T06:21:18.141363+0000","last_unstale":"2026-02-23T06:21:23.157404+0000","last_undegraded":"2026-02-23T06:21:23.157404+0000","last_fullsized":"2026-02-23T06:21:23.157404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:06:26.731868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159168+0000","last_change":"2026-02-23T06:21:17.144716+0000","last_active":"2026-02-23T06:21:23.159168+0000","last_peered":"2026-02-23T06:21:23.159168+0000","last_clean":"2026-02-23T06:21:23.159168+0000","last_became_active":"2026-02-23T06:21:17.144515+0000","last_became_peered":"2026-02-23T06:21:17.144515+0000","last_unstale":"2026-02-23T06:21:23.159168+0000","last_undegraded":"2026-02-23T06:21:23.159168+0000","last_fullsized":"2026-02-23T06:21:23.159168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:38:35.014170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157139+0000","last_change":"2026-02-23T06:21:22.171364+0000","last_active":"2026-02-23T06:21:23.157139+0000","last_peered":"2026-02-23T06:21:23.157139+0000","last_clean":"2026-02-23T06:21:23.157139+0000","last_became_active":"2026-02-23T06:21:22.171165+0000","last_became_peered":"2026-02-23T06:21:22.171165+0000","last_unstale":"2026-02-23T06:21:23.157139+0000","last_undegraded":"2026-02-23T06:21:23.157139+0000","last_fullsized":"2026-02-23T06:21:23.157139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:00:42.055334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158796+0000","last_change":"2026-02-23T06:21:18.144182+0000","last_active":"2026-02-23T06:21:23.158796+0000","last_peered":"2026-02-23T06:21:23.158796+0000","last_clean":"2026-02-23T06:21:23.158796+0000","last_became_active":"2026-02-23T06:21:18.143585+0000","last_became_peered":"2026-02-23T06:21:18.143585+0000","last_unstale":"2026-02-23T06:21:23.158796+0000","last_undegraded":"2026-02-23T06:21:23.158796+0000","last_fullsized":"2026-02-23T06:21:23.158796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:07:05.513990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156754+0000","last_change":"2026-02-23T06:21:17.137935+0000","last_active":"2026-02-23T06:21:23.156754+0000","last_peered":"2026-02-23T06:21:23.156754+0000","last_clean":"2026-02-23T06:21:23.156754+0000","last_became_active":"2026-02-23T06:21:17.137386+0000","last_became_peered":"2026-02-23T06:21:17.137386+0000","last_unstale":"2026-02-23T06:21:23.156754+0000","last_undegraded":"2026-02-23T06:21:23.156754+0000","last_fullsized":"2026-02-23T06:21:23.156754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:51:24.646436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157353+0000","last_change":"2026-02-23T06:21:22.163110+0000","last_active":"2026-02-23T06:21:23.157353+0000","last_peered":"2026-02-23T06:21:23.157353+0000","last_clean":"2026-02-23T06:21:23.157353+0000","last_became_active":"2026-02-23T06:21:22.162891+0000","last_became_peered":"2026-02-23T06:21:22.162891+0000","last_unstale":"2026-02-23T06:21:23.157353+0000","last_undegraded":"2026-02-23T06:21:23.157353+0000","last_fullsized":"2026-02-23T06:21:23.157353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:06:23.664613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157998+0000","last_change":"2026-02-23T06:21:18.152606+0000","last_active":"2026-02-23T06:21:23.157998+0000","last_peered":"2026-02-23T06:21:23.157998+0000","last_clean":"2026-02-23T06:21:23.157998+0000","last_became_active":"2026-02-23T06:21:18.152102+0000","last_became_peered":"2026-02-23T06:21:18.152102+0000","last_unstale":"2026-02-23T06:21:23.157998+0000","last_undegraded":"2026-02-23T06:21:23.157998+0000","last_fullsized":"2026-02-23T06:21:23.157998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:59:30.188417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157850+0000","last_change":"2026-02-23T06:21:17.143289+0000","last_active":"2026-02-23T06:21:23.157850+0000","last_peered":"2026-02-23T06:21:23.157850+0000","last_clean":"2026-02-23T06:21:23.157850+0000","last_became_active":"2026-02-23T06:21:17.143201+0000","last_became_peered":"2026-02-23T06:21:17.143201+0000","last_unstale":"2026-02-23T06:21:23.157850+0000","last_undegraded":"2026-02-23T06:21:23.157850+0000","last_fullsized":"2026-02-23T06:21:23.157850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:33:06.892035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157325+0000","last_change":"2026-02-23T06:21:22.163932+0000","last_active":"2026-02-23T06:21:23.157325+0000","last_peered":"2026-02-23T06:21:23.157325+0000","last_clean":"2026-02-23T06:21:23.157325+0000","last_became_active":"2026-02-23T06:21:22.163734+0000","last_became_peered":"2026-02-23T06:21:22.163734+0000","last_unstale":"2026-02-23T06:21:23.157325+0000","last_undegraded":"2026-02-23T06:21:23.157325+0000","last_fullsized":"2026-02-23T06:21:23.157325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:44:47.208608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156436+0000","last_change":"2026-02-23T06:21:18.141664+0000","last_active":"2026-02-23T06:21:23.156436+0000","last_peered":"2026-02-23T06:21:23.156436+0000","last_clean":"2026-02-23T06:21:23.156436+0000","last_became_active":"2026-02-23T06:21:18.141350+0000","last_became_peered":"2026-02-23T06:21:18.141350+0000","last_unstale":"2026-02-23T06:21:23.156436+0000","last_undegraded":"2026-02-23T06:21:23.156436+0000","last_fullsized":"2026-02-23T06:21:23.156436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:01:50.434732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156433+0000","last_change":"2026-02-23T06:21:17.139311+0000","last_active":"2026-02-23T06:21:23.156433+0000","last_peered":"2026-02-23T06:21:23.156433+0000","last_clean":"2026-02-23T06:21:23.156433+0000","last_became_active":"2026-02-23T06:21:17.139200+0000","last_became_peered":"2026-02-23T06:21:17.139200+0000","last_unstale":"2026-02-23T06:21:23.156433+0000","last_undegraded":"2026-02-23T06:21:23.156433+0000","last_fullsized":"2026-02-23T06:21:23.156433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:52:23.863807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157449+0000","last_change":"2026-02-23T06:21:22.164793+0000","last_active":"2026-02-23T06:21:23.157449+0000","last_peered":"2026-02-23T06:21:23.157449+0000","last_clean":"2026-02-23T06:21:23.157449+0000","last_became_active":"2026-02-23T06:21:22.164667+0000","last_became_peered":"2026-02-23T06:21:22.164667+0000","last_unstale":"2026-02-23T06:21:23.157449+0000","last_undegraded":"2026-02-23T06:21:23.157449+0000","last_fullsized":"2026-02-23T06:21:23.157449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:36:39.520044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156948+0000","last_change":"2026-02-23T06:21:18.146624+0000","last_active":"2026-02-23T06:21:23.156948+0000","last_peered":"2026-02-23T06:21:23.156948+0000","last_clean":"2026-02-23T06:21:23.156948+0000","last_became_active":"2026-02-23T06:21:18.146491+0000","last_became_peered":"2026-02-23T06:21:18.146491+0000","last_unstale":"2026-02-23T06:21:23.156948+0000","last_undegraded":"2026-02-23T06:21:23.156948+0000","last_fullsized":"2026-02-23T06:21:23.156948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:11:23.574241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157493+0000","last_change":"2026-02-23T06:21:17.143128+0000","last_active":"2026-02-23T06:21:23.157493+0000","last_peered":"2026-02-23T06:21:23.157493+0000","last_clean":"2026-02-23T06:21:23.157493+0000","last_became_active":"2026-02-23T06:21:17.143050+0000","last_became_peered":"2026-02-23T06:21:17.143050+0000","last_unstale":"2026-02-23T06:21:23.157493+0000","last_undegraded":"2026-02-23T06:21:23.157493+0000","last_fullsized":"2026-02-23T06:21:23.157493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:15.628487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156942+0000","last_change":"2026-02-23T06:21:22.168755+0000","last_active":"2026-02-23T06:21:23.156942+0000","last_peered":"2026-02-23T06:21:23.156942+0000","last_clean":"2026-02-23T06:21:23.156942+0000","last_became_active":"2026-02-23T06:21:22.168510+0000","last_became_peered":"2026-02-23T06:21:22.168510+0000","last_unstale":"2026-02-23T06:21:23.156942+0000","last_undegraded":"2026-02-23T06:21:23.156942+0000","last_fullsized":"2026-02-23T06:21:23.156942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:19:06.716318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156576+0000","last_change":"2026-02-23T06:21:18.145397+0000","last_active":"2026-02-23T06:21:23.156576+0000","last_peered":"2026-02-23T06:21:23.156576+0000","last_clean":"2026-02-23T06:21:23.156576+0000","last_became_active":"2026-02-23T06:21:18.145214+0000","last_became_peered":"2026-02-23T06:21:18.145214+0000","last_unstale":"2026-02-23T06:21:23.156576+0000","last_undegraded":"2026-02-23T06:21:23.156576+0000","last_fullsized":"2026-02-23T06:21:23.156576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:33:41.870582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158977+0000","last_change":"2026-02-23T06:21:17.147696+0000","last_active":"2026-02-23T06:21:23.158977+0000","last_peered":"2026-02-23T06:21:23.158977+0000","last_clean":"2026-02-23T06:21:23.158977+0000","last_became_active":"2026-02-23T06:21:17.147619+0000","last_became_peered":"2026-02-23T06:21:17.147619+0000","last_unstale":"2026-02-23T06:21:23.158977+0000","last_undegraded":"2026-02-23T06:21:23.158977+0000","last_fullsized":"2026-02-23T06:21:23.158977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:49:09.070245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'112","reported_seq":164,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157640+0000","last_change":"2026-02-23T06:21:11.397748+0000","last_active":"2026-02-23T06:21:23.157640+0000","last_peered":"2026-02-23T06:21:23.157640+0000","last_clean":"2026-02-23T06:21:23.157640+0000","last_became_active":"2026-02-23T06:21:11.397664+0000","last_became_peered":"2026-02-23T06:21:11.397664+0000","last_unstale":"2026-02-23T06:21:23.157640+0000","last_undegraded":"2026-02-23T06:21:23.157640+0000","last_fullsized":"2026-02-23T06:21:23.157640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:10.392316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:10.392316+0000","last_clean_scrub_stamp":"2026-02-23T06:21:10.392316+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:43.157572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159148+0000","last_change":"2026-02-23T06:21:22.174696+0000","last_active":"2026-02-23T06:21:23.159148+0000","last_peered":"2026-02-23T06:21:23.159148+0000","last_clean":"2026-02-23T06:21:23.159148+0000","last_became_active":"2026-02-23T06:21:22.174253+0000","last_became_peered":"2026-02-23T06:21:22.174253+0000","last_unstale":"2026-02-23T06:21:23.159148+0000","last_undegraded":"2026-02-23T06:21:23.159148+0000","last_fullsized":"2026-02-23T06:21:23.159148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:28.487343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159093+0000","last_change":"2026-02-23T06:21:18.150652+0000","last_active":"2026-02-23T06:21:23.159093+0000","last_peered":"2026-02-23T06:21:23.159093+0000","last_clean":"2026-02-23T06:21:23.159093+0000","last_became_active":"2026-02-23T06:21:18.150501+0000","last_became_peered":"2026-02-23T06:21:18.150501+0000","last_unstale":"2026-02-23T06:21:23.159093+0000","last_undegraded":"2026-02-23T06:21:23.159093+0000","last_fullsized":"2026-02-23T06:21:23.159093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:34:20.113034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157473+0000","last_change":"2026-02-23T06:21:17.146074+0000","last_active":"2026-02-23T06:21:23.157473+0000","last_peered":"2026-02-23T06:21:23.157473+0000","last_clean":"2026-02-23T06:21:23.157473+0000","last_became_active":"2026-02-23T06:21:17.145938+0000","last_became_peered":"2026-02-23T06:21:17.145938+0000","last_unstale":"2026-02-23T06:21:23.157473+0000","last_undegraded":"2026-02-23T06:21:23.157473+0000","last_fullsized":"2026-02-23T06:21:23.157473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:41:42.571718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158551+0000","last_change":"2026-02-23T06:21:22.172266+0000","last_active":"2026-02-23T06:21:23.158551+0000","last_peered":"2026-02-23T06:21:23.158551+0000","last_clean":"2026-02-23T06:21:23.158551+0000","last_became_active":"2026-02-23T06:21:22.171828+0000","last_became_peered":"2026-02-23T06:21:22.171828+0000","last_unstale":"2026-02-23T06:21:23.158551+0000","last_undegraded":"2026-02-23T06:21:23.158551+0000","last_fullsized":"2026-02-23T06:21:23.158551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:34:06.583640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158339+0000","last_change":"2026-02-23T06:21:18.147056+0000","last_active":"2026-02-23T06:21:23.158339+0000","last_peered":"2026-02-23T06:21:23.158339+0000","last_clean":"2026-02-23T06:21:23.158339+0000","last_became_active":"2026-02-23T06:21:18.146977+0000","last_became_peered":"2026-02-23T06:21:18.146977+0000","last_unstale":"2026-02-23T06:21:23.158339+0000","last_undegraded":"2026-02-23T06:21:23.158339+0000","last_fullsized":"2026-02-23T06:21:23.158339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:02:14.013207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156871+0000","last_change":"2026-02-23T06:21:17.139417+0000","last_active":"2026-02-23T06:21:23.156871+0000","last_peered":"2026-02-23T06:21:23.156871+0000","last_clean":"2026-02-23T06:21:23.156871+0000","last_became_active":"2026-02-23T06:21:17.139209+0000","last_became_peered":"2026-02-23T06:21:17.139209+0000","last_unstale":"2026-02-23T06:21:23.156871+0000","last_undegraded":"2026-02-23T06:21:23.156871+0000","last_fullsized":"2026-02-23T06:21:23.156871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:02:19.925669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156792+0000","last_change":"2026-02-23T06:21:22.162912+0000","last_active":"2026-02-23T06:21:23.156792+0000","last_peered":"2026-02-23T06:21:23.156792+0000","last_clean":"2026-02-23T06:21:23.156792+0000","last_became_active":"2026-02-23T06:21:22.162777+0000","last_became_peered":"2026-02-23T06:21:22.162777+0000","last_unstale":"2026-02-23T06:21:23.156792+0000","last_undegraded":"2026-02-23T06:21:23.156792+0000","last_fullsized":"2026-02-23T06:21:23.156792+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:40:10.012263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158597+0000","last_change":"2026-02-23T06:21:18.149281+0000","last_active":"2026-02-23T06:21:23.158597+0000","last_peered":"2026-02-23T06:21:23.158597+0000","last_clean":"2026-02-23T06:21:23.158597+0000","last_became_active":"2026-02-23T06:21:18.149038+0000","last_became_peered":"2026-02-23T06:21:18.149038+0000","last_unstale":"2026-02-23T06:21:23.158597+0000","last_undegraded":"2026-02-23T06:21:23.158597+0000","last_fullsized":"2026-02-23T06:21:23.158597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:57:13.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156819+0000","last_change":"2026-02-23T06:21:17.137649+0000","last_active":"2026-02-23T06:21:23.156819+0000","last_peered":"2026-02-23T06:21:23.156819+0000","last_clean":"2026-02-23T06:21:23.156819+0000","last_became_active":"2026-02-23T06:21:17.137476+0000","last_became_peered":"2026-02-23T06:21:17.137476+0000","last_unstale":"2026-02-23T06:21:23.156819+0000","last_undegraded":"2026-02-23T06:21:23.156819+0000","last_fullsized":"2026-02-23T06:21:23.156819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:47:43.648999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157315+0000","last_change":"2026-02-23T06:21:22.174081+0000","last_active":"2026-02-23T06:21:23.157315+0000","last_peered":"2026-02-23T06:21:23.157315+0000","last_clean":"2026-02-23T06:21:23.157315+0000","last_became_active":"2026-02-23T06:21:22.173501+0000","last_became_peered":"2026-02-23T06:21:22.173501+0000","last_unstale":"2026-02-23T06:21:23.157315+0000","last_undegraded":"2026-02-23T06:21:23.157315+0000","last_fullsized":"2026-02-23T06:21:23.157315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:29:42.370894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159159+0000","last_change":"2026-02-23T06:21:18.155183+0000","last_active":"2026-02-23T06:21:23.159159+0000","last_peered":"2026-02-23T06:21:23.159159+0000","last_clean":"2026-02-23T06:21:23.159159+0000","last_became_active":"2026-02-23T06:21:18.154271+0000","last_became_peered":"2026-02-23T06:21:18.154271+0000","last_unstale":"2026-02-23T06:21:23.159159+0000","last_undegraded":"2026-02-23T06:21:23.159159+0000","last_fullsized":"2026-02-23T06:21:23.159159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:34:53.495073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158641+0000","last_change":"2026-02-23T06:21:17.144988+0000","last_active":"2026-02-23T06:21:23.158641+0000","last_peered":"2026-02-23T06:21:23.158641+0000","last_clean":"2026-02-23T06:21:23.158641+0000","last_became_active":"2026-02-23T06:21:17.144914+0000","last_became_peered":"2026-02-23T06:21:17.144914+0000","last_unstale":"2026-02-23T06:21:23.158641+0000","last_undegraded":"2026-02-23T06:21:23.158641+0000","last_fullsized":"2026-02-23T06:21:23.158641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:20:30.802189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157321+0000","last_change":"2026-02-23T06:21:22.169035+0000","last_active":"2026-02-23T06:21:23.157321+0000","last_peered":"2026-02-23T06:21:23.157321+0000","last_clean":"2026-02-23T06:21:23.157321+0000","last_became_active":"2026-02-23T06:21:22.168516+0000","last_became_peered":"2026-02-23T06:21:22.168516+0000","last_unstale":"2026-02-23T06:21:23.157321+0000","last_undegraded":"2026-02-23T06:21:23.157321+0000","last_fullsized":"2026-02-23T06:21:23.157321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:53:53.761208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157305+0000","last_change":"2026-02-23T06:21:18.152543+0000","last_active":"2026-02-23T06:21:23.157305+0000","last_peered":"2026-02-23T06:21:23.157305+0000","last_clean":"2026-02-23T06:21:23.157305+0000","last_became_active":"2026-02-23T06:21:18.152381+0000","last_became_peered":"2026-02-23T06:21:18.152381+0000","last_unstale":"2026-02-23T06:21:23.157305+0000","last_undegraded":"2026-02-23T06:21:23.157305+0000","last_fullsized":"2026-02-23T06:21:23.157305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:20:11.159653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156443+0000","last_change":"2026-02-23T06:21:17.137277+0000","last_active":"2026-02-23T06:21:23.156443+0000","last_peered":"2026-02-23T06:21:23.156443+0000","last_clean":"2026-02-23T06:21:23.156443+0000","last_became_active":"2026-02-23T06:21:17.137101+0000","last_became_peered":"2026-02-23T06:21:17.137101+0000","last_unstale":"2026-02-23T06:21:23.156443+0000","last_undegraded":"2026-02-23T06:21:23.156443+0000","last_fullsized":"2026-02-23T06:21:23.156443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:26:19.732037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157108+0000","last_change":"2026-02-23T06:21:22.168965+0000","last_active":"2026-02-23T06:21:23.157108+0000","last_peered":"2026-02-23T06:21:23.157108+0000","last_clean":"2026-02-23T06:21:23.157108+0000","last_became_active":"2026-02-23T06:21:22.168603+0000","last_became_peered":"2026-02-23T06:21:22.168603+0000","last_unstale":"2026-02-23T06:21:23.157108+0000","last_undegraded":"2026-02-23T06:21:23.157108+0000","last_fullsized":"2026-02-23T06:21:23.157108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:15:47.100236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157608+0000","last_change":"2026-02-23T06:21:18.143842+0000","last_active":"2026-02-23T06:21:23.157608+0000","last_peered":"2026-02-23T06:21:23.157608+0000","last_clean":"2026-02-23T06:21:23.157608+0000","last_became_active":"2026-02-23T06:21:18.143002+0000","last_became_peered":"2026-02-23T06:21:18.143002+0000","last_unstale":"2026-02-23T06:21:23.157608+0000","last_undegraded":"2026-02-23T06:21:23.157608+0000","last_fullsized":"2026-02-23T06:21:23.157608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:04:36.461970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157835+0000","last_change":"2026-02-23T06:21:17.143842+0000","last_active":"2026-02-23T06:21:23.157835+0000","last_peered":"2026-02-23T06:21:23.157835+0000","last_clean":"2026-02-23T06:21:23.157835+0000","last_became_active":"2026-02-23T06:21:17.143700+0000","last_became_peered":"2026-02-23T06:21:17.143700+0000","last_unstale":"2026-02-23T06:21:23.157835+0000","last_undegraded":"2026-02-23T06:21:23.157835+0000","last_fullsized":"2026-02-23T06:21:23.157835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:14:07.166043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157290+0000","last_change":"2026-02-23T06:21:22.168834+0000","last_active":"2026-02-23T06:21:23.157290+0000","last_peered":"2026-02-23T06:21:23.157290+0000","last_clean":"2026-02-23T06:21:23.157290+0000","last_became_active":"2026-02-23T06:21:22.168593+0000","last_became_peered":"2026-02-23T06:21:22.168593+0000","last_unstale":"2026-02-23T06:21:23.157290+0000","last_undegraded":"2026-02-23T06:21:23.157290+0000","last_fullsized":"2026-02-23T06:21:23.157290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:15:01.999978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157649+0000","last_change":"2026-02-23T06:21:18.155135+0000","last_active":"2026-02-23T06:21:23.157649+0000","last_peered":"2026-02-23T06:21:23.157649+0000","last_clean":"2026-02-23T06:21:23.157649+0000","last_became_active":"2026-02-23T06:21:18.155022+0000","last_became_peered":"2026-02-23T06:21:18.155022+0000","last_unstale":"2026-02-23T06:21:23.157649+0000","last_undegraded":"2026-02-23T06:21:23.157649+0000","last_fullsized":"2026-02-23T06:21:23.157649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:50.396096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157857+0000","last_change":"2026-02-23T06:21:17.144113+0000","last_active":"2026-02-23T06:21:23.157857+0000","last_peered":"2026-02-23T06:21:23.157857+0000","last_clean":"2026-02-23T06:21:23.157857+0000","last_became_active":"2026-02-23T06:21:17.144052+0000","last_became_peered":"2026-02-23T06:21:17.144052+0000","last_unstale":"2026-02-23T06:21:23.157857+0000","last_undegraded":"2026-02-23T06:21:23.157857+0000","last_fullsized":"2026-02-23T06:21:23.157857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:52:50.479411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157276+0000","last_change":"2026-02-23T06:21:22.163712+0000","last_active":"2026-02-23T06:21:23.157276+0000","last_peered":"2026-02-23T06:21:23.157276+0000","last_clean":"2026-02-23T06:21:23.157276+0000","last_became_active":"2026-02-23T06:21:22.163563+0000","last_became_peered":"2026-02-23T06:21:22.163563+0000","last_unstale":"2026-02-23T06:21:23.157276+0000","last_undegraded":"2026-02-23T06:21:23.157276+0000","last_fullsized":"2026-02-23T06:21:23.157276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:58:44.301443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157241+0000","last_change":"2026-02-23T06:21:18.152736+0000","last_active":"2026-02-23T06:21:23.157241+0000","last_peered":"2026-02-23T06:21:23.157241+0000","last_clean":"2026-02-23T06:21:23.157241+0000","last_became_active":"2026-02-23T06:21:18.152627+0000","last_became_peered":"2026-02-23T06:21:18.152627+0000","last_unstale":"2026-02-23T06:21:23.157241+0000","last_undegraded":"2026-02-23T06:21:23.157241+0000","last_fullsized":"2026-02-23T06:21:23.157241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:26:04.233805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156590+0000","last_change":"2026-02-23T06:21:17.144924+0000","last_active":"2026-02-23T06:21:23.156590+0000","last_peered":"2026-02-23T06:21:23.156590+0000","last_clean":"2026-02-23T06:21:23.156590+0000","last_became_active":"2026-02-23T06:21:17.144847+0000","last_became_peered":"2026-02-23T06:21:17.144847+0000","last_unstale":"2026-02-23T06:21:23.156590+0000","last_undegraded":"2026-02-23T06:21:23.156590+0000","last_fullsized":"2026-02-23T06:21:23.156590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:09:16.703922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159051+0000","last_change":"2026-02-23T06:21:22.164167+0000","last_active":"2026-02-23T06:21:23.159051+0000","last_peered":"2026-02-23T06:21:23.159051+0000","last_clean":"2026-02-23T06:21:23.159051+0000","last_became_active":"2026-02-23T06:21:22.164057+0000","last_became_peered":"2026-02-23T06:21:22.164057+0000","last_unstale":"2026-02-23T06:21:23.159051+0000","last_undegraded":"2026-02-23T06:21:23.159051+0000","last_fullsized":"2026-02-23T06:21:23.159051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:19:45.888728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158866+0000","last_change":"2026-02-23T06:21:18.148382+0000","last_active":"2026-02-23T06:21:23.158866+0000","last_peered":"2026-02-23T06:21:23.158866+0000","last_clean":"2026-02-23T06:21:23.158866+0000","last_became_active":"2026-02-23T06:21:18.147826+0000","last_became_peered":"2026-02-23T06:21:18.147826+0000","last_unstale":"2026-02-23T06:21:23.158866+0000","last_undegraded":"2026-02-23T06:21:23.158866+0000","last_fullsized":"2026-02-23T06:21:23.158866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:52:32.524186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:30.992346+0000","last_change":"2026-02-23T06:21:17.151131+0000","last_active":"2026-02-23T06:21:30.992346+0000","last_peered":"2026-02-23T06:21:30.992346+0000","last_clean":"2026-02-23T06:21:30.992346+0000","last_became_active":"2026-02-23T06:21:17.151030+0000","last_became_peered":"2026-02-23T06:21:17.151030+0000","last_unstale":"2026-02-23T06:21:30.992346+0000","last_undegraded":"2026-02-23T06:21:30.992346+0000","last_fullsized":"2026-02-23T06:21:30.992346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:19:57.049773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3927,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156776+0000","last_change":"2026-02-23T06:21:22.165171+0000","last_active":"2026-02-23T06:21:23.156776+0000","last_peered":"2026-02-23T06:21:23.156776+0000","last_clean":"2026-02-23T06:21:23.156776+0000","last_became_active":"2026-02-23T06:21:22.164972+0000","last_became_peered":"2026-02-23T06:21:22.164972+0000","last_unstale":"2026-02-23T06:21:23.156776+0000","last_undegraded":"2026-02-23T06:21:23.156776+0000","last_fullsized":"2026-02-23T06:21:23.156776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:58:26.519641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157682+0000","last_change":"2026-02-23T06:21:18.153296+0000","last_active":"2026-02-23T06:21:23.157682+0000","last_peered":"2026-02-23T06:21:23.157682+0000","last_clean":"2026-02-23T06:21:23.157682+0000","last_became_active":"2026-02-23T06:21:18.153052+0000","last_became_peered":"2026-02-23T06:21:18.153052+0000","last_unstale":"2026-02-23T06:21:23.157682+0000","last_undegraded":"2026-02-23T06:21:23.157682+0000","last_fullsized":"2026-02-23T06:21:23.157682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:38:32.662334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156686+0000","last_change":"2026-02-23T06:21:17.137568+0000","last_active":"2026-02-23T06:21:23.156686+0000","last_peered":"2026-02-23T06:21:23.156686+0000","last_clean":"2026-02-23T06:21:23.156686+0000","last_became_active":"2026-02-23T06:21:17.137479+0000","last_became_peered":"2026-02-23T06:21:17.137479+0000","last_unstale":"2026-02-23T06:21:23.156686+0000","last_undegraded":"2026-02-23T06:21:23.156686+0000","last_fullsized":"2026-02-23T06:21:23.156686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:50:22.850887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158615+0000","last_change":"2026-02-23T06:21:22.175837+0000","last_active":"2026-02-23T06:21:23.158615+0000","last_peered":"2026-02-23T06:21:23.158615+0000","last_clean":"2026-02-23T06:21:23.158615+0000","last_became_active":"2026-02-23T06:21:22.175638+0000","last_became_peered":"2026-02-23T06:21:22.175638+0000","last_unstale":"2026-02-23T06:21:23.158615+0000","last_undegraded":"2026-02-23T06:21:23.158615+0000","last_fullsized":"2026-02-23T06:21:23.158615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:24:39.312650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157339+0000","last_change":"2026-02-23T06:21:18.155473+0000","last_active":"2026-02-23T06:21:23.157339+0000","last_peered":"2026-02-23T06:21:23.157339+0000","last_clean":"2026-02-23T06:21:23.157339+0000","last_became_active":"2026-02-23T06:21:18.155349+0000","last_became_peered":"2026-02-23T06:21:18.155349+0000","last_unstale":"2026-02-23T06:21:23.157339+0000","last_undegraded":"2026-02-23T06:21:23.157339+0000","last_fullsized":"2026-02-23T06:21:23.157339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:20:20.345986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158459+0000","last_change":"2026-02-23T06:21:17.148953+0000","last_active":"2026-02-23T06:21:23.158459+0000","last_peered":"2026-02-23T06:21:23.158459+0000","last_clean":"2026-02-23T06:21:23.158459+0000","last_became_active":"2026-02-23T06:21:17.148841+0000","last_became_peered":"2026-02-23T06:21:17.148841+0000","last_unstale":"2026-02-23T06:21:23.158459+0000","last_undegraded":"2026-02-23T06:21:23.158459+0000","last_fullsized":"2026-02-23T06:21:23.158459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:48:14.620108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156366+0000","last_change":"2026-02-23T06:21:22.172897+0000","last_active":"2026-02-23T06:21:23.156366+0000","last_peered":"2026-02-23T06:21:23.156366+0000","last_clean":"2026-02-23T06:21:23.156366+0000","last_became_active":"2026-02-23T06:21:22.172683+0000","last_became_peered":"2026-02-23T06:21:22.172683+0000","last_unstale":"2026-02-23T06:21:23.156366+0000","last_undegraded":"2026-02-23T06:21:23.156366+0000","last_fullsized":"2026-02-23T06:21:23.156366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:17:41.991286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159118+0000","last_change":"2026-02-23T06:21:18.154897+0000","last_active":"2026-02-23T06:21:23.159118+0000","last_peered":"2026-02-23T06:21:23.159118+0000","last_clean":"2026-02-23T06:21:23.159118+0000","last_became_active":"2026-02-23T06:21:18.154586+0000","last_became_peered":"2026-02-23T06:21:18.154586+0000","last_unstale":"2026-02-23T06:21:23.159118+0000","last_undegraded":"2026-02-23T06:21:23.159118+0000","last_fullsized":"2026-02-23T06:21:23.159118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:22:13.361673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158486+0000","last_change":"2026-02-23T06:21:17.140774+0000","last_active":"2026-02-23T06:21:23.158486+0000","last_peered":"2026-02-23T06:21:23.158486+0000","last_clean":"2026-02-23T06:21:23.158486+0000","last_became_active":"2026-02-23T06:21:17.140699+0000","last_became_peered":"2026-02-23T06:21:17.140699+0000","last_unstale":"2026-02-23T06:21:23.158486+0000","last_undegraded":"2026-02-23T06:21:23.158486+0000","last_fullsized":"2026-02-23T06:21:23.158486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:59:47.987932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156705+0000","last_change":"2026-02-23T06:21:22.166371+0000","last_active":"2026-02-23T06:21:23.156705+0000","last_peered":"2026-02-23T06:21:23.156705+0000","last_clean":"2026-02-23T06:21:23.156705+0000","last_became_active":"2026-02-23T06:21:22.166204+0000","last_became_peered":"2026-02-23T06:21:22.166204+0000","last_unstale":"2026-02-23T06:21:23.156705+0000","last_undegraded":"2026-02-23T06:21:23.156705+0000","last_fullsized":"2026-02-23T06:21:23.156705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:50:51.116428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156852+0000","last_change":"2026-02-23T06:21:22.167411+0000","last_active":"2026-02-23T06:21:23.156852+0000","last_peered":"2026-02-23T06:21:23.156852+0000","last_clean":"2026-02-23T06:21:23.156852+0000","last_became_active":"2026-02-23T06:21:22.167217+0000","last_became_peered":"2026-02-23T06:21:22.167217+0000","last_unstale":"2026-02-23T06:21:23.156852+0000","last_undegraded":"2026-02-23T06:21:23.156852+0000","last_fullsized":"2026-02-23T06:21:23.156852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:20:54.687551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156512+0000","last_change":"2026-02-23T06:21:18.146043+0000","last_active":"2026-02-23T06:21:23.156512+0000","last_peered":"2026-02-23T06:21:23.156512+0000","last_clean":"2026-02-23T06:21:23.156512+0000","last_became_active":"2026-02-23T06:21:18.145938+0000","last_became_peered":"2026-02-23T06:21:18.145938+0000","last_unstale":"2026-02-23T06:21:23.156512+0000","last_undegraded":"2026-02-23T06:21:23.156512+0000","last_fullsized":"2026-02-23T06:21:23.156512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:03:21.252772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157446+0000","last_change":"2026-02-23T06:21:17.149581+0000","last_active":"2026-02-23T06:21:23.157446+0000","last_peered":"2026-02-23T06:21:23.157446+0000","last_clean":"2026-02-23T06:21:23.157446+0000","last_became_active":"2026-02-23T06:21:17.149490+0000","last_became_peered":"2026-02-23T06:21:17.149490+0000","last_unstale":"2026-02-23T06:21:23.157446+0000","last_undegraded":"2026-02-23T06:21:23.157446+0000","last_fullsized":"2026-02-23T06:21:23.157446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:18:42.211307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158840+0000","last_change":"2026-02-23T06:21:22.175655+0000","last_active":"2026-02-23T06:21:23.158840+0000","last_peered":"2026-02-23T06:21:23.158840+0000","last_clean":"2026-02-23T06:21:23.158840+0000","last_became_active":"2026-02-23T06:21:22.174906+0000","last_became_peered":"2026-02-23T06:21:22.174906+0000","last_unstale":"2026-02-23T06:21:23.158840+0000","last_undegraded":"2026-02-23T06:21:23.158840+0000","last_fullsized":"2026-02-23T06:21:23.158840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:50:34.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156556+0000","last_change":"2026-02-23T06:21:18.142560+0000","last_active":"2026-02-23T06:21:23.156556+0000","last_peered":"2026-02-23T06:21:23.156556+0000","last_clean":"2026-02-23T06:21:23.156556+0000","last_became_active":"2026-02-23T06:21:18.142325+0000","last_became_peered":"2026-02-23T06:21:18.142325+0000","last_unstale":"2026-02-23T06:21:23.156556+0000","last_undegraded":"2026-02-23T06:21:23.156556+0000","last_fullsized":"2026-02-23T06:21:23.156556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:45:44.641652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156988+0000","last_change":"2026-02-23T06:21:17.146195+0000","last_active":"2026-02-23T06:21:23.156988+0000","last_peered":"2026-02-23T06:21:23.156988+0000","last_clean":"2026-02-23T06:21:23.156988+0000","last_became_active":"2026-02-23T06:21:17.146022+0000","last_became_peered":"2026-02-23T06:21:17.146022+0000","last_unstale":"2026-02-23T06:21:23.156988+0000","last_undegraded":"2026-02-23T06:21:23.156988+0000","last_fullsized":"2026-02-23T06:21:23.156988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:34:32.822540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157689+0000","last_change":"2026-02-23T06:21:17.148590+0000","last_active":"2026-02-23T06:21:23.157689+0000","last_peered":"2026-02-23T06:21:23.157689+0000","last_clean":"2026-02-23T06:21:23.157689+0000","last_became_active":"2026-02-23T06:21:17.148417+0000","last_became_peered":"2026-02-23T06:21:17.148417+0000","last_unstale":"2026-02-23T06:21:23.157689+0000","last_undegraded":"2026-02-23T06:21:23.157689+0000","last_fullsized":"2026-02-23T06:21:23.157689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:21:11.877590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156606+0000","last_change":"2026-02-23T06:21:18.152383+0000","last_active":"2026-02-23T06:21:23.156606+0000","last_peered":"2026-02-23T06:21:23.156606+0000","last_clean":"2026-02-23T06:21:23.156606+0000","last_became_active":"2026-02-23T06:21:18.152267+0000","last_became_peered":"2026-02-23T06:21:18.152267+0000","last_unstale":"2026-02-23T06:21:23.156606+0000","last_undegraded":"2026-02-23T06:21:23.156606+0000","last_fullsized":"2026-02-23T06:21:23.156606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:34:11.558509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156801+0000","last_change":"2026-02-23T06:21:22.158812+0000","last_active":"2026-02-23T06:21:23.156801+0000","last_peered":"2026-02-23T06:21:23.156801+0000","last_clean":"2026-02-23T06:21:23.156801+0000","last_became_active":"2026-02-23T06:21:22.158607+0000","last_became_peered":"2026-02-23T06:21:22.158607+0000","last_unstale":"2026-02-23T06:21:23.156801+0000","last_undegraded":"2026-02-23T06:21:23.156801+0000","last_fullsized":"2026-02-23T06:21:23.156801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:59:07.000053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156780+0000","last_change":"2026-02-23T06:21:17.138744+0000","last_active":"2026-02-23T06:21:23.156780+0000","last_peered":"2026-02-23T06:21:23.156780+0000","last_clean":"2026-02-23T06:21:23.156780+0000","last_became_active":"2026-02-23T06:21:17.138245+0000","last_became_peered":"2026-02-23T06:21:17.138245+0000","last_unstale":"2026-02-23T06:21:23.156780+0000","last_undegraded":"2026-02-23T06:21:23.156780+0000","last_fullsized":"2026-02-23T06:21:23.156780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:08:03.143401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157483+0000","last_change":"2026-02-23T06:21:18.143640+0000","last_active":"2026-02-23T06:21:23.157483+0000","last_peered":"2026-02-23T06:21:23.157483+0000","last_clean":"2026-02-23T06:21:23.157483+0000","last_became_active":"2026-02-23T06:21:18.143550+0000","last_became_peered":"2026-02-23T06:21:18.143550+0000","last_unstale":"2026-02-23T06:21:23.157483+0000","last_undegraded":"2026-02-23T06:21:23.157483+0000","last_fullsized":"2026-02-23T06:21:23.157483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:11:40.394042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156644+0000","last_change":"2026-02-23T06:21:22.169641+0000","last_active":"2026-02-23T06:21:23.156644+0000","last_peered":"2026-02-23T06:21:23.156644+0000","last_clean":"2026-02-23T06:21:23.156644+0000","last_became_active":"2026-02-23T06:21:22.169432+0000","last_became_peered":"2026-02-23T06:21:22.169432+0000","last_unstale":"2026-02-23T06:21:23.156644+0000","last_undegraded":"2026-02-23T06:21:23.156644+0000","last_fullsized":"2026-02-23T06:21:23.156644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:00:17.622113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158222+0000","last_change":"2026-02-23T06:21:18.143781+0000","last_active":"2026-02-23T06:21:23.158222+0000","last_peered":"2026-02-23T06:21:23.158222+0000","last_clean":"2026-02-23T06:21:23.158222+0000","last_became_active":"2026-02-23T06:21:18.143724+0000","last_became_peered":"2026-02-23T06:21:18.143724+0000","last_unstale":"2026-02-23T06:21:23.158222+0000","last_undegraded":"2026-02-23T06:21:23.158222+0000","last_fullsized":"2026-02-23T06:21:23.158222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:25:55.416021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156366+0000","last_change":"2026-02-23T06:21:18.145425+0000","last_active":"2026-02-23T06:21:23.156366+0000","last_peered":"2026-02-23T06:21:23.156366+0000","last_clean":"2026-02-23T06:21:23.156366+0000","last_became_active":"2026-02-23T06:21:18.145325+0000","last_became_peered":"2026-02-23T06:21:18.145325+0000","last_unstale":"2026-02-23T06:21:23.156366+0000","last_undegraded":"2026-02-23T06:21:23.156366+0000","last_fullsized":"2026-02-23T06:21:23.156366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:55:31.700518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157544+0000","last_change":"2026-02-23T06:21:18.150997+0000","last_active":"2026-02-23T06:21:23.157544+0000","last_peered":"2026-02-23T06:21:23.157544+0000","last_clean":"2026-02-23T06:21:23.157544+0000","last_became_active":"2026-02-23T06:21:18.150738+0000","last_became_peered":"2026-02-23T06:21:18.150738+0000","last_unstale":"2026-02-23T06:21:23.157544+0000","last_undegraded":"2026-02-23T06:21:23.157544+0000","last_fullsized":"2026-02-23T06:21:23.157544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:11:13.400669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156727+0000","last_change":"2026-02-23T06:21:18.142305+0000","last_active":"2026-02-23T06:21:23.156727+0000","last_peered":"2026-02-23T06:21:23.156727+0000","last_clean":"2026-02-23T06:21:23.156727+0000","last_became_active":"2026-02-23T06:21:18.141484+0000","last_became_peered":"2026-02-23T06:21:18.141484+0000","last_unstale":"2026-02-23T06:21:23.156727+0000","last_undegraded":"2026-02-23T06:21:23.156727+0000","last_fullsized":"2026-02-23T06:21:23.156727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:12:36.003405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157376+0000","last_change":"2026-02-23T06:21:18.148610+0000","last_active":"2026-02-23T06:21:23.157376+0000","last_peered":"2026-02-23T06:21:23.157376+0000","last_clean":"2026-02-23T06:21:23.157376+0000","last_became_active":"2026-02-23T06:21:18.148489+0000","last_became_peered":"2026-02-23T06:21:18.148489+0000","last_unstale":"2026-02-23T06:21:23.157376+0000","last_undegraded":"2026-02-23T06:21:23.157376+0000","last_fullsized":"2026-02-23T06:21:23.157376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:36:29.486147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157279+0000","last_change":"2026-02-23T06:21:18.142438+0000","last_active":"2026-02-23T06:21:23.157279+0000","last_peered":"2026-02-23T06:21:23.157279+0000","last_clean":"2026-02-23T06:21:23.157279+0000","last_became_active":"2026-02-23T06:21:18.141854+0000","last_became_peered":"2026-02-23T06:21:18.141854+0000","last_unstale":"2026-02-23T06:21:23.157279+0000","last_undegraded":"2026-02-23T06:21:23.157279+0000","last_fullsized":"2026-02-23T06:21:23.157279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:23:35.379462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159075+0000","last_change":"2026-02-23T06:21:18.153825+0000","last_active":"2026-02-23T06:21:23.159075+0000","last_peered":"2026-02-23T06:21:23.159075+0000","last_clean":"2026-02-23T06:21:23.159075+0000","last_became_active":"2026-02-23T06:21:18.153133+0000","last_became_peered":"2026-02-23T06:21:18.153133+0000","last_unstale":"2026-02-23T06:21:23.159075+0000","last_undegraded":"2026-02-23T06:21:23.159075+0000","last_fullsized":"2026-02-23T06:21:23.159075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:15:03.662362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157187+0000","last_change":"2026-02-23T06:21:18.144945+0000","last_active":"2026-02-23T06:21:23.157187+0000","last_peered":"2026-02-23T06:21:23.157187+0000","last_clean":"2026-02-23T06:21:23.157187+0000","last_became_active":"2026-02-23T06:21:18.144832+0000","last_became_peered":"2026-02-23T06:21:18.144832+0000","last_unstale":"2026-02-23T06:21:23.157187+0000","last_undegraded":"2026-02-23T06:21:23.157187+0000","last_fullsized":"2026-02-23T06:21:23.157187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:41:07.968870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157406+0000","last_change":"2026-02-23T06:21:18.150652+0000","last_active":"2026-02-23T06:21:23.157406+0000","last_peered":"2026-02-23T06:21:23.157406+0000","last_clean":"2026-02-23T06:21:23.157406+0000","last_became_active":"2026-02-23T06:21:18.150489+0000","last_became_peered":"2026-02-23T06:21:18.150489+0000","last_unstale":"2026-02-23T06:21:23.157406+0000","last_undegraded":"2026-02-23T06:21:23.157406+0000","last_fullsized":"2026-02-23T06:21:23.157406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:42:35.233149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156538+0000","last_change":"2026-02-23T06:21:18.143636+0000","last_active":"2026-02-23T06:21:23.156538+0000","last_peered":"2026-02-23T06:21:23.156538+0000","last_clean":"2026-02-23T06:21:23.156538+0000","last_became_active":"2026-02-23T06:21:18.143495+0000","last_became_peered":"2026-02-23T06:21:18.143495+0000","last_unstale":"2026-02-23T06:21:23.156538+0000","last_undegraded":"2026-02-23T06:21:23.156538+0000","last_fullsized":"2026-02-23T06:21:23.156538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:47:19.057181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157427+0000","last_change":"2026-02-23T06:21:18.148787+0000","last_active":"2026-02-23T06:21:23.157427+0000","last_peered":"2026-02-23T06:21:23.157427+0000","last_clean":"2026-02-23T06:21:23.157427+0000","last_became_active":"2026-02-23T06:21:18.148701+0000","last_became_peered":"2026-02-23T06:21:18.148701+0000","last_unstale":"2026-02-23T06:21:23.157427+0000","last_undegraded":"2026-02-23T06:21:23.157427+0000","last_fullsized":"2026-02-23T06:21:23.157427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:19:32.878202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156524+0000","last_change":"2026-02-23T06:21:18.145498+0000","last_active":"2026-02-23T06:21:23.156524+0000","last_peered":"2026-02-23T06:21:23.156524+0000","last_clean":"2026-02-23T06:21:23.156524+0000","last_became_active":"2026-02-23T06:21:18.145346+0000","last_became_peered":"2026-02-23T06:21:18.145346+0000","last_unstale":"2026-02-23T06:21:23.156524+0000","last_undegraded":"2026-02-23T06:21:23.156524+0000","last_fullsized":"2026-02-23T06:21:23.156524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:44:15.203843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158314+0000","last_change":"2026-02-23T06:21:18.147453+0000","last_active":"2026-02-23T06:21:23.158314+0000","last_peered":"2026-02-23T06:21:23.158314+0000","last_clean":"2026-02-23T06:21:23.158314+0000","last_became_active":"2026-02-23T06:21:18.147357+0000","last_became_peered":"2026-02-23T06:21:18.147357+0000","last_unstale":"2026-02-23T06:21:23.158314+0000","last_undegraded":"2026-02-23T06:21:23.158314+0000","last_fullsized":"2026-02-23T06:21:23.158314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:41:05.063786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159167+0000","last_change":"2026-02-23T06:21:18.151381+0000","last_active":"2026-02-23T06:21:23.159167+0000","last_peered":"2026-02-23T06:21:23.159167+0000","last_clean":"2026-02-23T06:21:23.159167+0000","last_became_active":"2026-02-23T06:21:18.151269+0000","last_became_peered":"2026-02-23T06:21:18.151269+0000","last_unstale":"2026-02-23T06:21:23.159167+0000","last_undegraded":"2026-02-23T06:21:23.159167+0000","last_fullsized":"2026-02-23T06:21:23.159167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:50:46.152385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156748+0000","last_change":"2026-02-23T06:21:18.148411+0000","last_active":"2026-02-23T06:21:23.156748+0000","last_peered":"2026-02-23T06:21:23.156748+0000","last_clean":"2026-02-23T06:21:23.156748+0000","last_became_active":"2026-02-23T06:21:18.148262+0000","last_became_peered":"2026-02-23T06:21:18.148262+0000","last_unstale":"2026-02-23T06:21:23.156748+0000","last_undegraded":"2026-02-23T06:21:23.156748+0000","last_fullsized":"2026-02-23T06:21:23.156748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:09:54.723244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158936+0000","last_change":"2026-02-23T06:21:18.155275+0000","last_active":"2026-02-23T06:21:23.158936+0000","last_peered":"2026-02-23T06:21:23.158936+0000","last_clean":"2026-02-23T06:21:23.158936+0000","last_became_active":"2026-02-23T06:21:18.155214+0000","last_became_peered":"2026-02-23T06:21:18.155214+0000","last_unstale":"2026-02-23T06:21:23.158936+0000","last_undegraded":"2026-02-23T06:21:23.158936+0000","last_fullsized":"2026-02-23T06:21:23.158936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:44:47.367234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157370+0000","last_change":"2026-02-23T06:21:18.153381+0000","last_active":"2026-02-23T06:21:23.157370+0000","last_peered":"2026-02-23T06:21:23.157370+0000","last_clean":"2026-02-23T06:21:23.157370+0000","last_became_active":"2026-02-23T06:21:18.152456+0000","last_became_peered":"2026-02-23T06:21:18.152456+0000","last_unstale":"2026-02-23T06:21:23.157370+0000","last_undegraded":"2026-02-23T06:21:23.157370+0000","last_fullsized":"2026-02-23T06:21:23.157370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:14:46.231331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156471+0000","last_change":"2026-02-23T06:21:18.148599+0000","last_active":"2026-02-23T06:21:23.156471+0000","last_peered":"2026-02-23T06:21:23.156471+0000","last_clean":"2026-02-23T06:21:23.156471+0000","last_became_active":"2026-02-23T06:21:18.148498+0000","last_became_peered":"2026-02-23T06:21:18.148498+0000","last_unstale":"2026-02-23T06:21:23.156471+0000","last_undegraded":"2026-02-23T06:21:23.156471+0000","last_fullsized":"2026-02-23T06:21:23.156471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:05:56.074928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157128+0000","last_change":"2026-02-23T06:21:18.142621+0000","last_active":"2026-02-23T06:21:23.157128+0000","last_peered":"2026-02-23T06:21:23.157128+0000","last_clean":"2026-02-23T06:21:23.157128+0000","last_became_active":"2026-02-23T06:21:18.141938+0000","last_became_peered":"2026-02-23T06:21:18.141938+0000","last_unstale":"2026-02-23T06:21:23.157128+0000","last_undegraded":"2026-02-23T06:21:23.157128+0000","last_fullsized":"2026-02-23T06:21:23.157128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:25:55.390738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157141+0000","last_change":"2026-02-23T06:21:18.153183+0000","last_active":"2026-02-23T06:21:23.157141+0000","last_peered":"2026-02-23T06:21:23.157141+0000","last_clean":"2026-02-23T06:21:23.157141+0000","last_became_active":"2026-02-23T06:21:18.153090+0000","last_became_peered":"2026-02-23T06:21:18.153090+0000","last_unstale":"2026-02-23T06:21:23.157141+0000","last_undegraded":"2026-02-23T06:21:23.157141+0000","last_fullsized":"2026-02-23T06:21:23.157141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:26:17.749612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158286+0000","last_change":"2026-02-23T06:21:18.148055+0000","last_active":"2026-02-23T06:21:23.158286+0000","last_peered":"2026-02-23T06:21:23.158286+0000","last_clean":"2026-02-23T06:21:23.158286+0000","last_became_active":"2026-02-23T06:21:18.147956+0000","last_became_peered":"2026-02-23T06:21:18.147956+0000","last_unstale":"2026-02-23T06:21:23.158286+0000","last_undegraded":"2026-02-23T06:21:23.158286+0000","last_fullsized":"2026-02-23T06:21:23.158286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:22:55.028859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158650+0000","last_change":"2026-02-23T06:21:18.155576+0000","last_active":"2026-02-23T06:21:23.158650+0000","last_peered":"2026-02-23T06:21:23.158650+0000","last_clean":"2026-02-23T06:21:23.158650+0000","last_became_active":"2026-02-23T06:21:18.155130+0000","last_became_peered":"2026-02-23T06:21:18.155130+0000","last_unstale":"2026-02-23T06:21:23.158650+0000","last_undegraded":"2026-02-23T06:21:23.158650+0000","last_fullsized":"2026-02-23T06:21:23.158650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:43:12.801427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158425+0000","last_change":"2026-02-23T06:21:18.152980+0000","last_active":"2026-02-23T06:21:23.158425+0000","last_peered":"2026-02-23T06:21:23.158425+0000","last_clean":"2026-02-23T06:21:23.158425+0000","last_became_active":"2026-02-23T06:21:18.152790+0000","last_became_peered":"2026-02-23T06:21:18.152790+0000","last_unstale":"2026-02-23T06:21:23.158425+0000","last_undegraded":"2026-02-23T06:21:23.158425+0000","last_fullsized":"2026-02-23T06:21:23.158425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:33:09.398040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158457+0000","last_change":"2026-02-23T06:21:18.155247+0000","last_active":"2026-02-23T06:21:23.158457+0000","last_peered":"2026-02-23T06:21:23.158457+0000","last_clean":"2026-02-23T06:21:23.158457+0000","last_became_active":"2026-02-23T06:21:18.155122+0000","last_became_peered":"2026-02-23T06:21:18.155122+0000","last_unstale":"2026-02-23T06:21:23.158457+0000","last_undegraded":"2026-02-23T06:21:23.158457+0000","last_fullsized":"2026-02-23T06:21:23.158457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:45:08.775934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156432+0000","last_change":"2026-02-23T06:21:18.151259+0000","last_active":"2026-02-23T06:21:23.156432+0000","last_peered":"2026-02-23T06:21:23.156432+0000","last_clean":"2026-02-23T06:21:23.156432+0000","last_became_active":"2026-02-23T06:21:18.151151+0000","last_became_peered":"2026-02-23T06:21:18.151151+0000","last_unstale":"2026-02-23T06:21:23.156432+0000","last_undegraded":"2026-02-23T06:21:23.156432+0000","last_fullsized":"2026-02-23T06:21:23.156432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:08:03.361054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157811+0000","last_change":"2026-02-23T06:21:18.146606+0000","last_active":"2026-02-23T06:21:23.157811+0000","last_peered":"2026-02-23T06:21:23.157811+0000","last_clean":"2026-02-23T06:21:23.157811+0000","last_became_active":"2026-02-23T06:21:18.146527+0000","last_became_peered":"2026-02-23T06:21:18.146527+0000","last_unstale":"2026-02-23T06:21:23.157811+0000","last_undegraded":"2026-02-23T06:21:23.157811+0000","last_fullsized":"2026-02-23T06:21:23.157811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:30:44.739034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158602+0000","last_change":"2026-02-23T06:21:18.145872+0000","last_active":"2026-02-23T06:21:23.158602+0000","last_peered":"2026-02-23T06:21:23.158602+0000","last_clean":"2026-02-23T06:21:23.158602+0000","last_became_active":"2026-02-23T06:21:18.145770+0000","last_became_peered":"2026-02-23T06:21:18.145770+0000","last_unstale":"2026-02-23T06:21:23.158602+0000","last_undegraded":"2026-02-23T06:21:23.158602+0000","last_fullsized":"2026-02-23T06:21:23.158602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:21:28.063960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158049+0000","last_change":"2026-02-23T06:21:18.152478+0000","last_active":"2026-02-23T06:21:23.158049+0000","last_peered":"2026-02-23T06:21:23.158049+0000","last_clean":"2026-02-23T06:21:23.158049+0000","last_became_active":"2026-02-23T06:21:18.151948+0000","last_became_peered":"2026-02-23T06:21:18.151948+0000","last_unstale":"2026-02-23T06:21:23.158049+0000","last_undegraded":"2026-02-23T06:21:23.158049+0000","last_fullsized":"2026-02-23T06:21:23.158049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:58:02.829593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158363+0000","last_change":"2026-02-23T06:21:18.144778+0000","last_active":"2026-02-23T06:21:23.158363+0000","last_peered":"2026-02-23T06:21:23.158363+0000","last_clean":"2026-02-23T06:21:23.158363+0000","last_became_active":"2026-02-23T06:21:18.144346+0000","last_became_peered":"2026-02-23T06:21:18.144346+0000","last_unstale":"2026-02-23T06:21:23.158363+0000","last_undegraded":"2026-02-23T06:21:23.158363+0000","last_fullsized":"2026-02-23T06:21:23.158363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:25:27.650673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156824+0000","last_change":"2026-02-23T06:21:18.141648+0000","last_active":"2026-02-23T06:21:23.156824+0000","last_peered":"2026-02-23T06:21:23.156824+0000","last_clean":"2026-02-23T06:21:23.156824+0000","last_became_active":"2026-02-23T06:21:18.141449+0000","last_became_peered":"2026-02-23T06:21:18.141449+0000","last_unstale":"2026-02-23T06:21:23.156824+0000","last_undegraded":"2026-02-23T06:21:23.156824+0000","last_fullsized":"2026-02-23T06:21:23.156824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:33:18.986892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157020+0000","last_change":"2026-02-23T06:21:18.142536+0000","last_active":"2026-02-23T06:21:23.157020+0000","last_peered":"2026-02-23T06:21:23.157020+0000","last_clean":"2026-02-23T06:21:23.157020+0000","last_became_active":"2026-02-23T06:21:18.142359+0000","last_became_peered":"2026-02-23T06:21:18.142359+0000","last_unstale":"2026-02-23T06:21:23.157020+0000","last_undegraded":"2026-02-23T06:21:23.157020+0000","last_fullsized":"2026-02-23T06:21:23.157020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:54:09.503227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158607+0000","last_change":"2026-02-23T06:21:18.156667+0000","last_active":"2026-02-23T06:21:23.158607+0000","last_peered":"2026-02-23T06:21:23.158607+0000","last_clean":"2026-02-23T06:21:23.158607+0000","last_became_active":"2026-02-23T06:21:18.156564+0000","last_became_peered":"2026-02-23T06:21:18.156564+0000","last_unstale":"2026-02-23T06:21:23.158607+0000","last_undegraded":"2026-02-23T06:21:23.158607+0000","last_fullsized":"2026-02-23T06:21:23.158607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:11:13.967668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4747,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25597,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70172,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":328,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":335872,"data_stored":694963,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":12046,"internal_metadata":27578610},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":268,"kb_used_omap":19,"kb_used_meta":26924,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":274432,"data_stored":104649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19702,"internal_metadata":27570954},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":260,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":266240,"data_stored":104525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11374,"internal_metadata":27579282},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":332,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":339968,"data_stored":694985,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":11711,"internal_metadata":27578945},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":109146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13524,"internal_metadata":27577132},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":105129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11474,"internal_metadata":27579182},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":272,"kb_used_omap":10,"kb_used_meta":26933,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":278528,"data_stored":108452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11136,"internal_metadata":27579520},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":268,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":274432,"data_stored":104581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":27571517},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8618,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":702,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":320,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1500,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4712,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":336,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9409,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T06:21:46.245 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-23T06:21:46.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.403+0000 7f2392883640 1 -- 10.20.193.58:0/3643285276 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f238c15d4a0 msgr2=0x7f238c0affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:46.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.403+0000 7f2392883640 1 --2- 10.20.193.58:0/3643285276 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f238c15d4a0 0x7f238c0affb0 secure :-1 s=READY pgs=178 gs=3 cs=0 l=1 c_cookie=12665622121329016419 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f237c004740 tx=0x7f237c02f230 comp rx=0 tx=0).stop 2026-02-23T06:21:46.399 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.403+0000 7f2392883640 1 -- 10.20.193.58:0/3643285276 shutdown_connections 2026-02-23T06:21:46.399 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.403+0000 7f2392883640 1 --2- 10.20.193.58:0/3643285276 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f238c15d4a0 0x7f238c0affb0 unknown :-1 s=CLOSED pgs=178 gs=3 cs=0 l=1 c_cookie=12665622121329016419 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.399 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.403+0000 7f2392883640 1 -- 10.20.193.58:0/3643285276 >> 10.20.193.58:0/3643285276 conn(0x7f238c0b3c20 msgr2=0x7f238c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:46.399 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.403+0000 7f2392883640 1 -- 10.20.193.58:0/3643285276 shutdown_connections 2026-02-23T06:21:46.399 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.403+0000 7f2392883640 1 -- 10.20.193.58:0/3643285276 wait complete. 2026-02-23T06:21:46.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.404+0000 7f2392883640 1 Processor -- start 2026-02-23T06:21:46.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.405+0000 7f2392883640 1 -- start start 2026-02-23T06:21:46.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.405+0000 7f2392883640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f238c0b6690 0x7f238c13d3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:46.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.405+0000 7f2392883640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f238c15d4a0 0x7f238c1590d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:46.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.405+0000 7f2392883640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f238c15d870 0x7f238c159610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:46.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.405+0000 7f2392883640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f238c058100 con 0x7f238c0b6690 2026-02-23T06:21:46.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.405+0000 7f2392883640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f238c1fe930 con 0x7f238c15d4a0 2026-02-23T06:21:46.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.405+0000 7f2392883640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f238c142550 con 0x7f238c15d870 2026-02-23T06:21:46.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.405+0000 7f2391881640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f238c0b6690 0x7f238c13d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:46.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.405+0000 7f2391881640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f238c0b6690 0x7f238c13d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:57086/0 (socket says 10.20.193.58:57086) 2026-02-23T06:21:46.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.405+0000 7f2391881640 1 -- 10.20.193.58:0/1665498081 learned_addr learned my addr 10.20.193.58:0/1665498081 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:46.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.405+0000 7f2391080640 1 --2- 10.20.193.58:0/1665498081 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f238c15d4a0 0x7f238c1590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:46.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.405+0000 7f2392082640 1 --2- 10.20.193.58:0/1665498081 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f238c15d870 0x7f238c159610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:46.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.406+0000 7f2391881640 1 -- 10.20.193.58:0/1665498081 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f238c15d870 msgr2=0x7f238c159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:46.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.406+0000 7f2391881640 1 --2- 10.20.193.58:0/1665498081 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f238c15d870 0x7f238c159610 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.406+0000 7f2391881640 1 -- 10.20.193.58:0/1665498081 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f238c15d4a0 msgr2=0x7f238c1590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:46.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.406+0000 7f2391881640 1 --2- 10.20.193.58:0/1665498081 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f238c15d4a0 0x7f238c1590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.406+0000 7f2391881640 1 -- 10.20.193.58:0/1665498081 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f237c0094b0 con 0x7f238c0b6690 2026-02-23T06:21:46.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.406+0000 7f2391881640 1 --2- 10.20.193.58:0/1665498081 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f238c0b6690 0x7f238c13d3d0 secure :-1 s=READY pgs=179 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f237c009960 tx=0x7f237c002950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:46.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.406+0000 7f237a7fc640 1 -- 10.20.193.58:0/1665498081 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f237c038470 con 0x7f238c0b6690 2026-02-23T06:21:46.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.406+0000 7f237a7fc640 1 -- 10.20.193.58:0/1665498081 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f237c0386c0 con 0x7f238c0b6690 2026-02-23T06:21:46.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.406+0000 7f237a7fc640 1 -- 10.20.193.58:0/1665498081 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f237c038ab0 con 0x7f238c0b6690 2026-02-23T06:21:46.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.406+0000 7f2392883640 1 -- 10.20.193.58:0/1665498081 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f238c057e20 con 0x7f238c0b6690 2026-02-23T06:21:46.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.406+0000 7f2392883640 1 -- 10.20.193.58:0/1665498081 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f238c0b7820 con 0x7f238c0b6690 2026-02-23T06:21:46.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.407+0000 7f2392883640 1 -- 10.20.193.58:0/1665498081 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f238c1fe6f0 con 0x7f238c0b6690 2026-02-23T06:21:46.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.408+0000 7f237a7fc640 1 -- 10.20.193.58:0/1665498081 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f237c038c10 con 0x7f238c0b6690 2026-02-23T06:21:46.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.409+0000 7f237a7fc640 1 --2- 10.20.193.58:0/1665498081 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f235c07a640 0x7f235c09aaf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:46.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.409+0000 7f237a7fc640 1 -- 10.20.193.58:0/1665498081 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f237c0c25d0 con 0x7f238c0b6690 2026-02-23T06:21:46.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.409+0000 7f2391080640 1 --2- 10.20.193.58:0/1665498081 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f235c07a640 0x7f235c09aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:46.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.410+0000 7f2391080640 1 --2- 10.20.193.58:0/1665498081 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f235c07a640 0x7f235c09aaf0 secure :-1 s=READY pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f238c162b90 tx=0x7f2380009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:46.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.411+0000 7f237a7fc640 1 -- 10.20.193.58:0/1665498081 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f237c0858d0 con 0x7f238c0b6690 2026-02-23T06:21:46.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.522+0000 7f2392883640 1 -- 10.20.193.58:0/1665498081 --> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f238c0b6330 con 0x7f235c07a640 2026-02-23T06:21:46.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.526+0000 7f237a7fc640 1 -- 10.20.193.58:0/1665498081 <== mgr.4126 v2:10.20.193.93:6800/4124709854 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332646 (secure 0 0 0) 0x7f2380003c40 con 0x7f235c07a640 2026-02-23T06:21:46.524 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:46.527 INFO:teuthology.orchestra.run.trial058.stderr:dumped all 2026-02-23T06:21:46.528 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.529+0000 7f2392883640 1 -- 10.20.193.58:0/1665498081 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f235c07a640 msgr2=0x7f235c09aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:46.528 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.529+0000 7f2392883640 1 --2- 10.20.193.58:0/1665498081 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f235c07a640 0x7f235c09aaf0 secure :-1 s=READY pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f238c162b90 tx=0x7f2380009040 comp rx=0 tx=0).stop 2026-02-23T06:21:46.528 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.529+0000 7f2392883640 1 -- 10.20.193.58:0/1665498081 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f238c0b6690 msgr2=0x7f238c13d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:46.528 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.529+0000 7f2392883640 1 --2- 10.20.193.58:0/1665498081 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f238c0b6690 0x7f238c13d3d0 secure :-1 s=READY pgs=179 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f237c009960 tx=0x7f237c002950 comp rx=0 tx=0).stop 2026-02-23T06:21:46.529 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.529+0000 7f2392883640 1 -- 10.20.193.58:0/1665498081 shutdown_connections 2026-02-23T06:21:46.529 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.529+0000 7f2392883640 1 --2- 10.20.193.58:0/1665498081 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f235c07a640 0x7f235c09aaf0 unknown :-1 s=CLOSED pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.529 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.529+0000 7f2392883640 1 --2- 10.20.193.58:0/1665498081 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f238c15d870 0x7f238c159610 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.529 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.529+0000 7f2392883640 1 --2- 10.20.193.58:0/1665498081 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f238c15d4a0 0x7f238c1590d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.529 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.529+0000 7f2392883640 1 --2- 10.20.193.58:0/1665498081 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f238c0b6690 0x7f238c13d3d0 unknown :-1 s=CLOSED pgs=179 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.529 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.529+0000 7f2392883640 1 -- 10.20.193.58:0/1665498081 >> 10.20.193.58:0/1665498081 conn(0x7f238c0b3c20 msgr2=0x7f238c0aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:46.529 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.529+0000 7f2392883640 1 -- 10.20.193.58:0/1665498081 shutdown_connections 2026-02-23T06:21:46.529 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.529+0000 7f2392883640 1 -- 10.20.193.58:0/1665498081 wait complete. 2026-02-23T06:21:46.535 INFO:teuthology.orchestra.run.trial058.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2026-02-23T06:21:46.378265+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595369,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":195,"num_write_kb":2692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":217952,"kb_used_data":2272,"kb_used_omap":107,"kb_used_meta":215444,"kb_avail":754756768,"statfs":{"total":773094113280,"available":772870930432,"internally_reserved":0,"allocated":2326528,"data_stored":2026430,"data_compressed":70172,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":110106,"internal_metadata":220615142},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2547,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001769"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156952+0000","last_change":"2026-02-23T06:21:17.142582+0000","last_active":"2026-02-23T06:21:23.156952+0000","last_peered":"2026-02-23T06:21:23.156952+0000","last_clean":"2026-02-23T06:21:23.156952+0000","last_became_active":"2026-02-23T06:21:17.142416+0000","last_became_peered":"2026-02-23T06:21:17.142416+0000","last_unstale":"2026-02-23T06:21:23.156952+0000","last_undegraded":"2026-02-23T06:21:23.156952+0000","last_fullsized":"2026-02-23T06:21:23.156952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:13:12.649937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157112+0000","last_change":"2026-02-23T06:21:18.148362+0000","last_active":"2026-02-23T06:21:23.157112+0000","last_peered":"2026-02-23T06:21:23.157112+0000","last_clean":"2026-02-23T06:21:23.157112+0000","last_became_active":"2026-02-23T06:21:18.148276+0000","last_became_peered":"2026-02-23T06:21:18.148276+0000","last_unstale":"2026-02-23T06:21:23.157112+0000","last_undegraded":"2026-02-23T06:21:23.157112+0000","last_fullsized":"2026-02-23T06:21:23.157112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:47.221741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156473+0000","last_change":"2026-02-23T06:21:22.169541+0000","last_active":"2026-02-23T06:21:23.156473+0000","last_peered":"2026-02-23T06:21:23.156473+0000","last_clean":"2026-02-23T06:21:23.156473+0000","last_became_active":"2026-02-23T06:21:22.169307+0000","last_became_peered":"2026-02-23T06:21:22.169307+0000","last_unstale":"2026-02-23T06:21:23.156473+0000","last_undegraded":"2026-02-23T06:21:23.156473+0000","last_fullsized":"2026-02-23T06:21:23.156473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:40:10.952374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157171+0000","last_change":"2026-02-23T06:21:17.138864+0000","last_active":"2026-02-23T06:21:23.157171+0000","last_peered":"2026-02-23T06:21:23.157171+0000","last_clean":"2026-02-23T06:21:23.157171+0000","last_became_active":"2026-02-23T06:21:17.138651+0000","last_became_peered":"2026-02-23T06:21:17.138651+0000","last_unstale":"2026-02-23T06:21:23.157171+0000","last_undegraded":"2026-02-23T06:21:23.157171+0000","last_fullsized":"2026-02-23T06:21:23.157171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:24.172617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157312+0000","last_change":"2026-02-23T06:21:18.145040+0000","last_active":"2026-02-23T06:21:23.157312+0000","last_peered":"2026-02-23T06:21:23.157312+0000","last_clean":"2026-02-23T06:21:23.157312+0000","last_became_active":"2026-02-23T06:21:18.144915+0000","last_became_peered":"2026-02-23T06:21:18.144915+0000","last_unstale":"2026-02-23T06:21:23.157312+0000","last_undegraded":"2026-02-23T06:21:23.157312+0000","last_fullsized":"2026-02-23T06:21:23.157312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:17:30.105623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158170+0000","last_change":"2026-02-23T06:21:22.172729+0000","last_active":"2026-02-23T06:21:23.158170+0000","last_peered":"2026-02-23T06:21:23.158170+0000","last_clean":"2026-02-23T06:21:23.158170+0000","last_became_active":"2026-02-23T06:21:22.172510+0000","last_became_peered":"2026-02-23T06:21:22.172510+0000","last_unstale":"2026-02-23T06:21:23.158170+0000","last_undegraded":"2026-02-23T06:21:23.158170+0000","last_fullsized":"2026-02-23T06:21:23.158170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:53:55.801734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158943+0000","last_change":"2026-02-23T06:21:17.150375+0000","last_active":"2026-02-23T06:21:23.158943+0000","last_peered":"2026-02-23T06:21:23.158943+0000","last_clean":"2026-02-23T06:21:23.158943+0000","last_became_active":"2026-02-23T06:21:17.150244+0000","last_became_peered":"2026-02-23T06:21:17.150244+0000","last_unstale":"2026-02-23T06:21:23.158943+0000","last_undegraded":"2026-02-23T06:21:23.158943+0000","last_fullsized":"2026-02-23T06:21:23.158943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:06:21.465108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157674+0000","last_change":"2026-02-23T06:21:18.150247+0000","last_active":"2026-02-23T06:21:23.157674+0000","last_peered":"2026-02-23T06:21:23.157674+0000","last_clean":"2026-02-23T06:21:23.157674+0000","last_became_active":"2026-02-23T06:21:18.149827+0000","last_became_peered":"2026-02-23T06:21:18.149827+0000","last_unstale":"2026-02-23T06:21:23.157674+0000","last_undegraded":"2026-02-23T06:21:23.157674+0000","last_fullsized":"2026-02-23T06:21:23.157674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:37:58.944726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158517+0000","last_change":"2026-02-23T06:21:22.174417+0000","last_active":"2026-02-23T06:21:23.158517+0000","last_peered":"2026-02-23T06:21:23.158517+0000","last_clean":"2026-02-23T06:21:23.158517+0000","last_became_active":"2026-02-23T06:21:22.173939+0000","last_became_peered":"2026-02-23T06:21:22.173939+0000","last_unstale":"2026-02-23T06:21:23.158517+0000","last_undegraded":"2026-02-23T06:21:23.158517+0000","last_fullsized":"2026-02-23T06:21:23.158517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:41:53.008301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158816+0000","last_change":"2026-02-23T06:21:17.145244+0000","last_active":"2026-02-23T06:21:23.158816+0000","last_peered":"2026-02-23T06:21:23.158816+0000","last_clean":"2026-02-23T06:21:23.158816+0000","last_became_active":"2026-02-23T06:21:17.144122+0000","last_became_peered":"2026-02-23T06:21:17.144122+0000","last_unstale":"2026-02-23T06:21:23.158816+0000","last_undegraded":"2026-02-23T06:21:23.158816+0000","last_fullsized":"2026-02-23T06:21:23.158816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:42:56.020005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159068+0000","last_change":"2026-02-23T06:21:18.155799+0000","last_active":"2026-02-23T06:21:23.159068+0000","last_peered":"2026-02-23T06:21:23.159068+0000","last_clean":"2026-02-23T06:21:23.159068+0000","last_became_active":"2026-02-23T06:21:18.154985+0000","last_became_peered":"2026-02-23T06:21:18.154985+0000","last_unstale":"2026-02-23T06:21:23.159068+0000","last_undegraded":"2026-02-23T06:21:23.159068+0000","last_fullsized":"2026-02-23T06:21:23.159068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:11:13.595733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158472+0000","last_change":"2026-02-23T06:21:22.168755+0000","last_active":"2026-02-23T06:21:23.158472+0000","last_peered":"2026-02-23T06:21:23.158472+0000","last_clean":"2026-02-23T06:21:23.158472+0000","last_became_active":"2026-02-23T06:21:22.165671+0000","last_became_peered":"2026-02-23T06:21:22.165671+0000","last_unstale":"2026-02-23T06:21:23.158472+0000","last_undegraded":"2026-02-23T06:21:23.158472+0000","last_fullsized":"2026-02-23T06:21:23.158472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:04:32.848929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157587+0000","last_change":"2026-02-23T06:21:18.150907+0000","last_active":"2026-02-23T06:21:23.157587+0000","last_peered":"2026-02-23T06:21:23.157587+0000","last_clean":"2026-02-23T06:21:23.157587+0000","last_became_active":"2026-02-23T06:21:18.150604+0000","last_became_peered":"2026-02-23T06:21:18.150604+0000","last_unstale":"2026-02-23T06:21:23.157587+0000","last_undegraded":"2026-02-23T06:21:23.157587+0000","last_fullsized":"2026-02-23T06:21:23.157587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:15:21.672153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157971+0000","last_change":"2026-02-23T06:21:17.147523+0000","last_active":"2026-02-23T06:21:23.157971+0000","last_peered":"2026-02-23T06:21:23.157971+0000","last_clean":"2026-02-23T06:21:23.157971+0000","last_became_active":"2026-02-23T06:21:17.147351+0000","last_became_peered":"2026-02-23T06:21:17.147351+0000","last_unstale":"2026-02-23T06:21:23.157971+0000","last_undegraded":"2026-02-23T06:21:23.157971+0000","last_fullsized":"2026-02-23T06:21:23.157971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:36:34.550499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158924+0000","last_change":"2026-02-23T06:21:22.169413+0000","last_active":"2026-02-23T06:21:23.158924+0000","last_peered":"2026-02-23T06:21:23.158924+0000","last_clean":"2026-02-23T06:21:23.158924+0000","last_became_active":"2026-02-23T06:21:22.169259+0000","last_became_peered":"2026-02-23T06:21:22.169259+0000","last_unstale":"2026-02-23T06:21:23.158924+0000","last_undegraded":"2026-02-23T06:21:23.158924+0000","last_fullsized":"2026-02-23T06:21:23.158924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:14:12.944321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156495+0000","last_change":"2026-02-23T06:21:18.142316+0000","last_active":"2026-02-23T06:21:23.156495+0000","last_peered":"2026-02-23T06:21:23.156495+0000","last_clean":"2026-02-23T06:21:23.156495+0000","last_became_active":"2026-02-23T06:21:18.142144+0000","last_became_peered":"2026-02-23T06:21:18.142144+0000","last_unstale":"2026-02-23T06:21:23.156495+0000","last_undegraded":"2026-02-23T06:21:23.156495+0000","last_fullsized":"2026-02-23T06:21:23.156495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:53:33.429271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157370+0000","last_change":"2026-02-23T06:21:17.137576+0000","last_active":"2026-02-23T06:21:23.157370+0000","last_peered":"2026-02-23T06:21:23.157370+0000","last_clean":"2026-02-23T06:21:23.157370+0000","last_became_active":"2026-02-23T06:21:17.137371+0000","last_became_peered":"2026-02-23T06:21:17.137371+0000","last_unstale":"2026-02-23T06:21:23.157370+0000","last_undegraded":"2026-02-23T06:21:23.157370+0000","last_fullsized":"2026-02-23T06:21:23.157370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:27.159743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158222+0000","last_change":"2026-02-23T06:21:22.163003+0000","last_active":"2026-02-23T06:21:23.158222+0000","last_peered":"2026-02-23T06:21:23.158222+0000","last_clean":"2026-02-23T06:21:23.158222+0000","last_became_active":"2026-02-23T06:21:22.162898+0000","last_became_peered":"2026-02-23T06:21:22.162898+0000","last_unstale":"2026-02-23T06:21:23.158222+0000","last_undegraded":"2026-02-23T06:21:23.158222+0000","last_fullsized":"2026-02-23T06:21:23.158222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:29:18.161667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156351+0000","last_change":"2026-02-23T06:21:18.141281+0000","last_active":"2026-02-23T06:21:23.156351+0000","last_peered":"2026-02-23T06:21:23.156351+0000","last_clean":"2026-02-23T06:21:23.156351+0000","last_became_active":"2026-02-23T06:21:18.141090+0000","last_became_peered":"2026-02-23T06:21:18.141090+0000","last_unstale":"2026-02-23T06:21:23.156351+0000","last_undegraded":"2026-02-23T06:21:23.156351+0000","last_fullsized":"2026-02-23T06:21:23.156351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:12:21.750595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156633+0000","last_change":"2026-02-23T06:21:17.144179+0000","last_active":"2026-02-23T06:21:23.156633+0000","last_peered":"2026-02-23T06:21:23.156633+0000","last_clean":"2026-02-23T06:21:23.156633+0000","last_became_active":"2026-02-23T06:21:17.144017+0000","last_became_peered":"2026-02-23T06:21:17.144017+0000","last_unstale":"2026-02-23T06:21:23.156633+0000","last_undegraded":"2026-02-23T06:21:23.156633+0000","last_fullsized":"2026-02-23T06:21:23.156633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:25:41.992201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156888+0000","last_change":"2026-02-23T06:21:22.174826+0000","last_active":"2026-02-23T06:21:23.156888+0000","last_peered":"2026-02-23T06:21:23.156888+0000","last_clean":"2026-02-23T06:21:23.156888+0000","last_became_active":"2026-02-23T06:21:22.174683+0000","last_became_peered":"2026-02-23T06:21:22.174683+0000","last_unstale":"2026-02-23T06:21:23.156888+0000","last_undegraded":"2026-02-23T06:21:23.156888+0000","last_fullsized":"2026-02-23T06:21:23.156888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:04:49.277580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157342+0000","last_change":"2026-02-23T06:21:18.145331+0000","last_active":"2026-02-23T06:21:23.157342+0000","last_peered":"2026-02-23T06:21:23.157342+0000","last_clean":"2026-02-23T06:21:23.157342+0000","last_became_active":"2026-02-23T06:21:18.145231+0000","last_became_peered":"2026-02-23T06:21:18.145231+0000","last_unstale":"2026-02-23T06:21:23.157342+0000","last_undegraded":"2026-02-23T06:21:23.157342+0000","last_fullsized":"2026-02-23T06:21:23.157342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:32:44.487867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157126+0000","last_change":"2026-02-23T06:21:17.147584+0000","last_active":"2026-02-23T06:21:23.157126+0000","last_peered":"2026-02-23T06:21:23.157126+0000","last_clean":"2026-02-23T06:21:23.157126+0000","last_became_active":"2026-02-23T06:21:17.147431+0000","last_became_peered":"2026-02-23T06:21:17.147431+0000","last_unstale":"2026-02-23T06:21:23.157126+0000","last_undegraded":"2026-02-23T06:21:23.157126+0000","last_fullsized":"2026-02-23T06:21:23.157126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:10:39.127457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159080+0000","last_change":"2026-02-23T06:21:22.175656+0000","last_active":"2026-02-23T06:21:23.159080+0000","last_peered":"2026-02-23T06:21:23.159080+0000","last_clean":"2026-02-23T06:21:23.159080+0000","last_became_active":"2026-02-23T06:21:22.175493+0000","last_became_peered":"2026-02-23T06:21:22.175493+0000","last_unstale":"2026-02-23T06:21:23.159080+0000","last_undegraded":"2026-02-23T06:21:23.159080+0000","last_fullsized":"2026-02-23T06:21:23.159080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:10:41.366772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156769+0000","last_change":"2026-02-23T06:21:18.141486+0000","last_active":"2026-02-23T06:21:23.156769+0000","last_peered":"2026-02-23T06:21:23.156769+0000","last_clean":"2026-02-23T06:21:23.156769+0000","last_became_active":"2026-02-23T06:21:18.141277+0000","last_became_peered":"2026-02-23T06:21:18.141277+0000","last_unstale":"2026-02-23T06:21:23.156769+0000","last_undegraded":"2026-02-23T06:21:23.156769+0000","last_fullsized":"2026-02-23T06:21:23.156769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:21:15.738187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158970+0000","last_change":"2026-02-23T06:21:17.148536+0000","last_active":"2026-02-23T06:21:23.158970+0000","last_peered":"2026-02-23T06:21:23.158970+0000","last_clean":"2026-02-23T06:21:23.158970+0000","last_became_active":"2026-02-23T06:21:17.148424+0000","last_became_peered":"2026-02-23T06:21:17.148424+0000","last_unstale":"2026-02-23T06:21:23.158970+0000","last_undegraded":"2026-02-23T06:21:23.158970+0000","last_fullsized":"2026-02-23T06:21:23.158970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:02:54.995144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158363+0000","last_change":"2026-02-23T06:21:22.171333+0000","last_active":"2026-02-23T06:21:23.158363+0000","last_peered":"2026-02-23T06:21:23.158363+0000","last_clean":"2026-02-23T06:21:23.158363+0000","last_became_active":"2026-02-23T06:21:22.170496+0000","last_became_peered":"2026-02-23T06:21:22.170496+0000","last_unstale":"2026-02-23T06:21:23.158363+0000","last_undegraded":"2026-02-23T06:21:23.158363+0000","last_fullsized":"2026-02-23T06:21:23.158363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:40:07.996281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156943+0000","last_change":"2026-02-23T06:21:18.142135+0000","last_active":"2026-02-23T06:21:23.156943+0000","last_peered":"2026-02-23T06:21:23.156943+0000","last_clean":"2026-02-23T06:21:23.156943+0000","last_became_active":"2026-02-23T06:21:18.141771+0000","last_became_peered":"2026-02-23T06:21:18.141771+0000","last_unstale":"2026-02-23T06:21:23.156943+0000","last_undegraded":"2026-02-23T06:21:23.156943+0000","last_fullsized":"2026-02-23T06:21:23.156943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:10:18.195986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156859+0000","last_change":"2026-02-23T06:21:17.142326+0000","last_active":"2026-02-23T06:21:23.156859+0000","last_peered":"2026-02-23T06:21:23.156859+0000","last_clean":"2026-02-23T06:21:23.156859+0000","last_became_active":"2026-02-23T06:21:17.142203+0000","last_became_peered":"2026-02-23T06:21:17.142203+0000","last_unstale":"2026-02-23T06:21:23.156859+0000","last_undegraded":"2026-02-23T06:21:23.156859+0000","last_fullsized":"2026-02-23T06:21:23.156859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:49:44.262210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156453+0000","last_change":"2026-02-23T06:21:22.168717+0000","last_active":"2026-02-23T06:21:23.156453+0000","last_peered":"2026-02-23T06:21:23.156453+0000","last_clean":"2026-02-23T06:21:23.156453+0000","last_became_active":"2026-02-23T06:21:22.168375+0000","last_became_peered":"2026-02-23T06:21:22.168375+0000","last_unstale":"2026-02-23T06:21:23.156453+0000","last_undegraded":"2026-02-23T06:21:23.156453+0000","last_fullsized":"2026-02-23T06:21:23.156453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:03:53.993581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157404+0000","last_change":"2026-02-23T06:21:18.141908+0000","last_active":"2026-02-23T06:21:23.157404+0000","last_peered":"2026-02-23T06:21:23.157404+0000","last_clean":"2026-02-23T06:21:23.157404+0000","last_became_active":"2026-02-23T06:21:18.141363+0000","last_became_peered":"2026-02-23T06:21:18.141363+0000","last_unstale":"2026-02-23T06:21:23.157404+0000","last_undegraded":"2026-02-23T06:21:23.157404+0000","last_fullsized":"2026-02-23T06:21:23.157404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:06:26.731868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159168+0000","last_change":"2026-02-23T06:21:17.144716+0000","last_active":"2026-02-23T06:21:23.159168+0000","last_peered":"2026-02-23T06:21:23.159168+0000","last_clean":"2026-02-23T06:21:23.159168+0000","last_became_active":"2026-02-23T06:21:17.144515+0000","last_became_peered":"2026-02-23T06:21:17.144515+0000","last_unstale":"2026-02-23T06:21:23.159168+0000","last_undegraded":"2026-02-23T06:21:23.159168+0000","last_fullsized":"2026-02-23T06:21:23.159168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:38:35.014170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157139+0000","last_change":"2026-02-23T06:21:22.171364+0000","last_active":"2026-02-23T06:21:23.157139+0000","last_peered":"2026-02-23T06:21:23.157139+0000","last_clean":"2026-02-23T06:21:23.157139+0000","last_became_active":"2026-02-23T06:21:22.171165+0000","last_became_peered":"2026-02-23T06:21:22.171165+0000","last_unstale":"2026-02-23T06:21:23.157139+0000","last_undegraded":"2026-02-23T06:21:23.157139+0000","last_fullsized":"2026-02-23T06:21:23.157139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:00:42.055334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158796+0000","last_change":"2026-02-23T06:21:18.144182+0000","last_active":"2026-02-23T06:21:23.158796+0000","last_peered":"2026-02-23T06:21:23.158796+0000","last_clean":"2026-02-23T06:21:23.158796+0000","last_became_active":"2026-02-23T06:21:18.143585+0000","last_became_peered":"2026-02-23T06:21:18.143585+0000","last_unstale":"2026-02-23T06:21:23.158796+0000","last_undegraded":"2026-02-23T06:21:23.158796+0000","last_fullsized":"2026-02-23T06:21:23.158796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:07:05.513990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156754+0000","last_change":"2026-02-23T06:21:17.137935+0000","last_active":"2026-02-23T06:21:23.156754+0000","last_peered":"2026-02-23T06:21:23.156754+0000","last_clean":"2026-02-23T06:21:23.156754+0000","last_became_active":"2026-02-23T06:21:17.137386+0000","last_became_peered":"2026-02-23T06:21:17.137386+0000","last_unstale":"2026-02-23T06:21:23.156754+0000","last_undegraded":"2026-02-23T06:21:23.156754+0000","last_fullsized":"2026-02-23T06:21:23.156754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:51:24.646436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157353+0000","last_change":"2026-02-23T06:21:22.163110+0000","last_active":"2026-02-23T06:21:23.157353+0000","last_peered":"2026-02-23T06:21:23.157353+0000","last_clean":"2026-02-23T06:21:23.157353+0000","last_became_active":"2026-02-23T06:21:22.162891+0000","last_became_peered":"2026-02-23T06:21:22.162891+0000","last_unstale":"2026-02-23T06:21:23.157353+0000","last_undegraded":"2026-02-23T06:21:23.157353+0000","last_fullsized":"2026-02-23T06:21:23.157353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:06:23.664613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157998+0000","last_change":"2026-02-23T06:21:18.152606+0000","last_active":"2026-02-23T06:21:23.157998+0000","last_peered":"2026-02-23T06:21:23.157998+0000","last_clean":"2026-02-23T06:21:23.157998+0000","last_became_active":"2026-02-23T06:21:18.152102+0000","last_became_peered":"2026-02-23T06:21:18.152102+0000","last_unstale":"2026-02-23T06:21:23.157998+0000","last_undegraded":"2026-02-23T06:21:23.157998+0000","last_fullsized":"2026-02-23T06:21:23.157998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:59:30.188417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157850+0000","last_change":"2026-02-23T06:21:17.143289+0000","last_active":"2026-02-23T06:21:23.157850+0000","last_peered":"2026-02-23T06:21:23.157850+0000","last_clean":"2026-02-23T06:21:23.157850+0000","last_became_active":"2026-02-23T06:21:17.143201+0000","last_became_peered":"2026-02-23T06:21:17.143201+0000","last_unstale":"2026-02-23T06:21:23.157850+0000","last_undegraded":"2026-02-23T06:21:23.157850+0000","last_fullsized":"2026-02-23T06:21:23.157850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:33:06.892035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157325+0000","last_change":"2026-02-23T06:21:22.163932+0000","last_active":"2026-02-23T06:21:23.157325+0000","last_peered":"2026-02-23T06:21:23.157325+0000","last_clean":"2026-02-23T06:21:23.157325+0000","last_became_active":"2026-02-23T06:21:22.163734+0000","last_became_peered":"2026-02-23T06:21:22.163734+0000","last_unstale":"2026-02-23T06:21:23.157325+0000","last_undegraded":"2026-02-23T06:21:23.157325+0000","last_fullsized":"2026-02-23T06:21:23.157325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:44:47.208608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156436+0000","last_change":"2026-02-23T06:21:18.141664+0000","last_active":"2026-02-23T06:21:23.156436+0000","last_peered":"2026-02-23T06:21:23.156436+0000","last_clean":"2026-02-23T06:21:23.156436+0000","last_became_active":"2026-02-23T06:21:18.141350+0000","last_became_peered":"2026-02-23T06:21:18.141350+0000","last_unstale":"2026-02-23T06:21:23.156436+0000","last_undegraded":"2026-02-23T06:21:23.156436+0000","last_fullsized":"2026-02-23T06:21:23.156436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:01:50.434732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156433+0000","last_change":"2026-02-23T06:21:17.139311+0000","last_active":"2026-02-23T06:21:23.156433+0000","last_peered":"2026-02-23T06:21:23.156433+0000","last_clean":"2026-02-23T06:21:23.156433+0000","last_became_active":"2026-02-23T06:21:17.139200+0000","last_became_peered":"2026-02-23T06:21:17.139200+0000","last_unstale":"2026-02-23T06:21:23.156433+0000","last_undegraded":"2026-02-23T06:21:23.156433+0000","last_fullsized":"2026-02-23T06:21:23.156433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:52:23.863807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157449+0000","last_change":"2026-02-23T06:21:22.164793+0000","last_active":"2026-02-23T06:21:23.157449+0000","last_peered":"2026-02-23T06:21:23.157449+0000","last_clean":"2026-02-23T06:21:23.157449+0000","last_became_active":"2026-02-23T06:21:22.164667+0000","last_became_peered":"2026-02-23T06:21:22.164667+0000","last_unstale":"2026-02-23T06:21:23.157449+0000","last_undegraded":"2026-02-23T06:21:23.157449+0000","last_fullsized":"2026-02-23T06:21:23.157449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:36:39.520044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156948+0000","last_change":"2026-02-23T06:21:18.146624+0000","last_active":"2026-02-23T06:21:23.156948+0000","last_peered":"2026-02-23T06:21:23.156948+0000","last_clean":"2026-02-23T06:21:23.156948+0000","last_became_active":"2026-02-23T06:21:18.146491+0000","last_became_peered":"2026-02-23T06:21:18.146491+0000","last_unstale":"2026-02-23T06:21:23.156948+0000","last_undegraded":"2026-02-23T06:21:23.156948+0000","last_fullsized":"2026-02-23T06:21:23.156948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:11:23.574241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157493+0000","last_change":"2026-02-23T06:21:17.143128+0000","last_active":"2026-02-23T06:21:23.157493+0000","last_peered":"2026-02-23T06:21:23.157493+0000","last_clean":"2026-02-23T06:21:23.157493+0000","last_became_active":"2026-02-23T06:21:17.143050+0000","last_became_peered":"2026-02-23T06:21:17.143050+0000","last_unstale":"2026-02-23T06:21:23.157493+0000","last_undegraded":"2026-02-23T06:21:23.157493+0000","last_fullsized":"2026-02-23T06:21:23.157493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:15.628487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156942+0000","last_change":"2026-02-23T06:21:22.168755+0000","last_active":"2026-02-23T06:21:23.156942+0000","last_peered":"2026-02-23T06:21:23.156942+0000","last_clean":"2026-02-23T06:21:23.156942+0000","last_became_active":"2026-02-23T06:21:22.168510+0000","last_became_peered":"2026-02-23T06:21:22.168510+0000","last_unstale":"2026-02-23T06:21:23.156942+0000","last_undegraded":"2026-02-23T06:21:23.156942+0000","last_fullsized":"2026-02-23T06:21:23.156942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:19:06.716318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156576+0000","last_change":"2026-02-23T06:21:18.145397+0000","last_active":"2026-02-23T06:21:23.156576+0000","last_peered":"2026-02-23T06:21:23.156576+0000","last_clean":"2026-02-23T06:21:23.156576+0000","last_became_active":"2026-02-23T06:21:18.145214+0000","last_became_peered":"2026-02-23T06:21:18.145214+0000","last_unstale":"2026-02-23T06:21:23.156576+0000","last_undegraded":"2026-02-23T06:21:23.156576+0000","last_fullsized":"2026-02-23T06:21:23.156576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:33:41.870582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158977+0000","last_change":"2026-02-23T06:21:17.147696+0000","last_active":"2026-02-23T06:21:23.158977+0000","last_peered":"2026-02-23T06:21:23.158977+0000","last_clean":"2026-02-23T06:21:23.158977+0000","last_became_active":"2026-02-23T06:21:17.147619+0000","last_became_peered":"2026-02-23T06:21:17.147619+0000","last_unstale":"2026-02-23T06:21:23.158977+0000","last_undegraded":"2026-02-23T06:21:23.158977+0000","last_fullsized":"2026-02-23T06:21:23.158977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:49:09.070245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'112","reported_seq":164,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157640+0000","last_change":"2026-02-23T06:21:11.397748+0000","last_active":"2026-02-23T06:21:23.157640+0000","last_peered":"2026-02-23T06:21:23.157640+0000","last_clean":"2026-02-23T06:21:23.157640+0000","last_became_active":"2026-02-23T06:21:11.397664+0000","last_became_peered":"2026-02-23T06:21:11.397664+0000","last_unstale":"2026-02-23T06:21:23.157640+0000","last_undegraded":"2026-02-23T06:21:23.157640+0000","last_fullsized":"2026-02-23T06:21:23.157640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:10.392316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:10.392316+0000","last_clean_scrub_stamp":"2026-02-23T06:21:10.392316+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:43.157572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159148+0000","last_change":"2026-02-23T06:21:22.174696+0000","last_active":"2026-02-23T06:21:23.159148+0000","last_peered":"2026-02-23T06:21:23.159148+0000","last_clean":"2026-02-23T06:21:23.159148+0000","last_became_active":"2026-02-23T06:21:22.174253+0000","last_became_peered":"2026-02-23T06:21:22.174253+0000","last_unstale":"2026-02-23T06:21:23.159148+0000","last_undegraded":"2026-02-23T06:21:23.159148+0000","last_fullsized":"2026-02-23T06:21:23.159148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:28.487343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159093+0000","last_change":"2026-02-23T06:21:18.150652+0000","last_active":"2026-02-23T06:21:23.159093+0000","last_peered":"2026-02-23T06:21:23.159093+0000","last_clean":"2026-02-23T06:21:23.159093+0000","last_became_active":"2026-02-23T06:21:18.150501+0000","last_became_peered":"2026-02-23T06:21:18.150501+0000","last_unstale":"2026-02-23T06:21:23.159093+0000","last_undegraded":"2026-02-23T06:21:23.159093+0000","last_fullsized":"2026-02-23T06:21:23.159093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:34:20.113034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157473+0000","last_change":"2026-02-23T06:21:17.146074+0000","last_active":"2026-02-23T06:21:23.157473+0000","last_peered":"2026-02-23T06:21:23.157473+0000","last_clean":"2026-02-23T06:21:23.157473+0000","last_became_active":"2026-02-23T06:21:17.145938+0000","last_became_peered":"2026-02-23T06:21:17.145938+0000","last_unstale":"2026-02-23T06:21:23.157473+0000","last_undegraded":"2026-02-23T06:21:23.157473+0000","last_fullsized":"2026-02-23T06:21:23.157473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:41:42.571718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158551+0000","last_change":"2026-02-23T06:21:22.172266+0000","last_active":"2026-02-23T06:21:23.158551+0000","last_peered":"2026-02-23T06:21:23.158551+0000","last_clean":"2026-02-23T06:21:23.158551+0000","last_became_active":"2026-02-23T06:21:22.171828+0000","last_became_peered":"2026-02-23T06:21:22.171828+0000","last_unstale":"2026-02-23T06:21:23.158551+0000","last_undegraded":"2026-02-23T06:21:23.158551+0000","last_fullsized":"2026-02-23T06:21:23.158551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:34:06.583640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158339+0000","last_change":"2026-02-23T06:21:18.147056+0000","last_active":"2026-02-23T06:21:23.158339+0000","last_peered":"2026-02-23T06:21:23.158339+0000","last_clean":"2026-02-23T06:21:23.158339+0000","last_became_active":"2026-02-23T06:21:18.146977+0000","last_became_peered":"2026-02-23T06:21:18.146977+0000","last_unstale":"2026-02-23T06:21:23.158339+0000","last_undegraded":"2026-02-23T06:21:23.158339+0000","last_fullsized":"2026-02-23T06:21:23.158339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:02:14.013207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156871+0000","last_change":"2026-02-23T06:21:17.139417+0000","last_active":"2026-02-23T06:21:23.156871+0000","last_peered":"2026-02-23T06:21:23.156871+0000","last_clean":"2026-02-23T06:21:23.156871+0000","last_became_active":"2026-02-23T06:21:17.139209+0000","last_became_peered":"2026-02-23T06:21:17.139209+0000","last_unstale":"2026-02-23T06:21:23.156871+0000","last_undegraded":"2026-02-23T06:21:23.156871+0000","last_fullsized":"2026-02-23T06:21:23.156871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:02:19.925669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156792+0000","last_change":"2026-02-23T06:21:22.162912+0000","last_active":"2026-02-23T06:21:23.156792+0000","last_peered":"2026-02-23T06:21:23.156792+0000","last_clean":"2026-02-23T06:21:23.156792+0000","last_became_active":"2026-02-23T06:21:22.162777+0000","last_became_peered":"2026-02-23T06:21:22.162777+0000","last_unstale":"2026-02-23T06:21:23.156792+0000","last_undegraded":"2026-02-23T06:21:23.156792+0000","last_fullsized":"2026-02-23T06:21:23.156792+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:40:10.012263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158597+0000","last_change":"2026-02-23T06:21:18.149281+0000","last_active":"2026-02-23T06:21:23.158597+0000","last_peered":"2026-02-23T06:21:23.158597+0000","last_clean":"2026-02-23T06:21:23.158597+0000","last_became_active":"2026-02-23T06:21:18.149038+0000","last_became_peered":"2026-02-23T06:21:18.149038+0000","last_unstale":"2026-02-23T06:21:23.158597+0000","last_undegraded":"2026-02-23T06:21:23.158597+0000","last_fullsized":"2026-02-23T06:21:23.158597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:57:13.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156819+0000","last_change":"2026-02-23T06:21:17.137649+0000","last_active":"2026-02-23T06:21:23.156819+0000","last_peered":"2026-02-23T06:21:23.156819+0000","last_clean":"2026-02-23T06:21:23.156819+0000","last_became_active":"2026-02-23T06:21:17.137476+0000","last_became_peered":"2026-02-23T06:21:17.137476+0000","last_unstale":"2026-02-23T06:21:23.156819+0000","last_undegraded":"2026-02-23T06:21:23.156819+0000","last_fullsized":"2026-02-23T06:21:23.156819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:47:43.648999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157315+0000","last_change":"2026-02-23T06:21:22.174081+0000","last_active":"2026-02-23T06:21:23.157315+0000","last_peered":"2026-02-23T06:21:23.157315+0000","last_clean":"2026-02-23T06:21:23.157315+0000","last_became_active":"2026-02-23T06:21:22.173501+0000","last_became_peered":"2026-02-23T06:21:22.173501+0000","last_unstale":"2026-02-23T06:21:23.157315+0000","last_undegraded":"2026-02-23T06:21:23.157315+0000","last_fullsized":"2026-02-23T06:21:23.157315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:29:42.370894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159159+0000","last_change":"2026-02-23T06:21:18.155183+0000","last_active":"2026-02-23T06:21:23.159159+0000","last_peered":"2026-02-23T06:21:23.159159+0000","last_clean":"2026-02-23T06:21:23.159159+0000","last_became_active":"2026-02-23T06:21:18.154271+0000","last_became_peered":"2026-02-23T06:21:18.154271+0000","last_unstale":"2026-02-23T06:21:23.159159+0000","last_undegraded":"2026-02-23T06:21:23.159159+0000","last_fullsized":"2026-02-23T06:21:23.159159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:34:53.495073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158641+0000","last_change":"2026-02-23T06:21:17.144988+0000","last_active":"2026-02-23T06:21:23.158641+0000","last_peered":"2026-02-23T06:21:23.158641+0000","last_clean":"2026-02-23T06:21:23.158641+0000","last_became_active":"2026-02-23T06:21:17.144914+0000","last_became_peered":"2026-02-23T06:21:17.144914+0000","last_unstale":"2026-02-23T06:21:23.158641+0000","last_undegraded":"2026-02-23T06:21:23.158641+0000","last_fullsized":"2026-02-23T06:21:23.158641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:20:30.802189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157321+0000","last_change":"2026-02-23T06:21:22.169035+0000","last_active":"2026-02-23T06:21:23.157321+0000","last_peered":"2026-02-23T06:21:23.157321+0000","last_clean":"2026-02-23T06:21:23.157321+0000","last_became_active":"2026-02-23T06:21:22.168516+0000","last_became_peered":"2026-02-23T06:21:22.168516+0000","last_unstale":"2026-02-23T06:21:23.157321+0000","last_undegraded":"2026-02-23T06:21:23.157321+0000","last_fullsized":"2026-02-23T06:21:23.157321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:53:53.761208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157305+0000","last_change":"2026-02-23T06:21:18.152543+0000","last_active":"2026-02-23T06:21:23.157305+0000","last_peered":"2026-02-23T06:21:23.157305+0000","last_clean":"2026-02-23T06:21:23.157305+0000","last_became_active":"2026-02-23T06:21:18.152381+0000","last_became_peered":"2026-02-23T06:21:18.152381+0000","last_unstale":"2026-02-23T06:21:23.157305+0000","last_undegraded":"2026-02-23T06:21:23.157305+0000","last_fullsized":"2026-02-23T06:21:23.157305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:20:11.159653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156443+0000","last_change":"2026-02-23T06:21:17.137277+0000","last_active":"2026-02-23T06:21:23.156443+0000","last_peered":"2026-02-23T06:21:23.156443+0000","last_clean":"2026-02-23T06:21:23.156443+0000","last_became_active":"2026-02-23T06:21:17.137101+0000","last_became_peered":"2026-02-23T06:21:17.137101+0000","last_unstale":"2026-02-23T06:21:23.156443+0000","last_undegraded":"2026-02-23T06:21:23.156443+0000","last_fullsized":"2026-02-23T06:21:23.156443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:26:19.732037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157108+0000","last_change":"2026-02-23T06:21:22.168965+0000","last_active":"2026-02-23T06:21:23.157108+0000","last_peered":"2026-02-23T06:21:23.157108+0000","last_clean":"2026-02-23T06:21:23.157108+0000","last_became_active":"2026-02-23T06:21:22.168603+0000","last_became_peered":"2026-02-23T06:21:22.168603+0000","last_unstale":"2026-02-23T06:21:23.157108+0000","last_undegraded":"2026-02-23T06:21:23.157108+0000","last_fullsized":"2026-02-23T06:21:23.157108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:15:47.100236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157608+0000","last_change":"2026-02-23T06:21:18.143842+0000","last_active":"2026-02-23T06:21:23.157608+0000","last_peered":"2026-02-23T06:21:23.157608+0000","last_clean":"2026-02-23T06:21:23.157608+0000","last_became_active":"2026-02-23T06:21:18.143002+0000","last_became_peered":"2026-02-23T06:21:18.143002+0000","last_unstale":"2026-02-23T06:21:23.157608+0000","last_undegraded":"2026-02-23T06:21:23.157608+0000","last_fullsized":"2026-02-23T06:21:23.157608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:04:36.461970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157835+0000","last_change":"2026-02-23T06:21:17.143842+0000","last_active":"2026-02-23T06:21:23.157835+0000","last_peered":"2026-02-23T06:21:23.157835+0000","last_clean":"2026-02-23T06:21:23.157835+0000","last_became_active":"2026-02-23T06:21:17.143700+0000","last_became_peered":"2026-02-23T06:21:17.143700+0000","last_unstale":"2026-02-23T06:21:23.157835+0000","last_undegraded":"2026-02-23T06:21:23.157835+0000","last_fullsized":"2026-02-23T06:21:23.157835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:14:07.166043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157290+0000","last_change":"2026-02-23T06:21:22.168834+0000","last_active":"2026-02-23T06:21:23.157290+0000","last_peered":"2026-02-23T06:21:23.157290+0000","last_clean":"2026-02-23T06:21:23.157290+0000","last_became_active":"2026-02-23T06:21:22.168593+0000","last_became_peered":"2026-02-23T06:21:22.168593+0000","last_unstale":"2026-02-23T06:21:23.157290+0000","last_undegraded":"2026-02-23T06:21:23.157290+0000","last_fullsized":"2026-02-23T06:21:23.157290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:15:01.999978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157649+0000","last_change":"2026-02-23T06:21:18.155135+0000","last_active":"2026-02-23T06:21:23.157649+0000","last_peered":"2026-02-23T06:21:23.157649+0000","last_clean":"2026-02-23T06:21:23.157649+0000","last_became_active":"2026-02-23T06:21:18.155022+0000","last_became_peered":"2026-02-23T06:21:18.155022+0000","last_unstale":"2026-02-23T06:21:23.157649+0000","last_undegraded":"2026-02-23T06:21:23.157649+0000","last_fullsized":"2026-02-23T06:21:23.157649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:50.396096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157857+0000","last_change":"2026-02-23T06:21:17.144113+0000","last_active":"2026-02-23T06:21:23.157857+0000","last_peered":"2026-02-23T06:21:23.157857+0000","last_clean":"2026-02-23T06:21:23.157857+0000","last_became_active":"2026-02-23T06:21:17.144052+0000","last_became_peered":"2026-02-23T06:21:17.144052+0000","last_unstale":"2026-02-23T06:21:23.157857+0000","last_undegraded":"2026-02-23T06:21:23.157857+0000","last_fullsized":"2026-02-23T06:21:23.157857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:52:50.479411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157276+0000","last_change":"2026-02-23T06:21:22.163712+0000","last_active":"2026-02-23T06:21:23.157276+0000","last_peered":"2026-02-23T06:21:23.157276+0000","last_clean":"2026-02-23T06:21:23.157276+0000","last_became_active":"2026-02-23T06:21:22.163563+0000","last_became_peered":"2026-02-23T06:21:22.163563+0000","last_unstale":"2026-02-23T06:21:23.157276+0000","last_undegraded":"2026-02-23T06:21:23.157276+0000","last_fullsized":"2026-02-23T06:21:23.157276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:58:44.301443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157241+0000","last_change":"2026-02-23T06:21:18.152736+0000","last_active":"2026-02-23T06:21:23.157241+0000","last_peered":"2026-02-23T06:21:23.157241+0000","last_clean":"2026-02-23T06:21:23.157241+0000","last_became_active":"2026-02-23T06:21:18.152627+0000","last_became_peered":"2026-02-23T06:21:18.152627+0000","last_unstale":"2026-02-23T06:21:23.157241+0000","last_undegraded":"2026-02-23T06:21:23.157241+0000","last_fullsized":"2026-02-23T06:21:23.157241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:26:04.233805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156590+0000","last_change":"2026-02-23T06:21:17.144924+0000","last_active":"2026-02-23T06:21:23.156590+0000","last_peered":"2026-02-23T06:21:23.156590+0000","last_clean":"2026-02-23T06:21:23.156590+0000","last_became_active":"2026-02-23T06:21:17.144847+0000","last_became_peered":"2026-02-23T06:21:17.144847+0000","last_unstale":"2026-02-23T06:21:23.156590+0000","last_undegraded":"2026-02-23T06:21:23.156590+0000","last_fullsized":"2026-02-23T06:21:23.156590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:09:16.703922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159051+0000","last_change":"2026-02-23T06:21:22.164167+0000","last_active":"2026-02-23T06:21:23.159051+0000","last_peered":"2026-02-23T06:21:23.159051+0000","last_clean":"2026-02-23T06:21:23.159051+0000","last_became_active":"2026-02-23T06:21:22.164057+0000","last_became_peered":"2026-02-23T06:21:22.164057+0000","last_unstale":"2026-02-23T06:21:23.159051+0000","last_undegraded":"2026-02-23T06:21:23.159051+0000","last_fullsized":"2026-02-23T06:21:23.159051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:19:45.888728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158866+0000","last_change":"2026-02-23T06:21:18.148382+0000","last_active":"2026-02-23T06:21:23.158866+0000","last_peered":"2026-02-23T06:21:23.158866+0000","last_clean":"2026-02-23T06:21:23.158866+0000","last_became_active":"2026-02-23T06:21:18.147826+0000","last_became_peered":"2026-02-23T06:21:18.147826+0000","last_unstale":"2026-02-23T06:21:23.158866+0000","last_undegraded":"2026-02-23T06:21:23.158866+0000","last_fullsized":"2026-02-23T06:21:23.158866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:52:32.524186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'11","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:44.224784+0000","last_change":"2026-02-23T06:21:17.151131+0000","last_active":"2026-02-23T06:21:44.224784+0000","last_peered":"2026-02-23T06:21:44.224784+0000","last_clean":"2026-02-23T06:21:44.224784+0000","last_became_active":"2026-02-23T06:21:17.151030+0000","last_became_peered":"2026-02-23T06:21:17.151030+0000","last_unstale":"2026-02-23T06:21:44.224784+0000","last_undegraded":"2026-02-23T06:21:44.224784+0000","last_fullsized":"2026-02-23T06:21:44.224784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:19:57.049773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4181,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156776+0000","last_change":"2026-02-23T06:21:22.165171+0000","last_active":"2026-02-23T06:21:23.156776+0000","last_peered":"2026-02-23T06:21:23.156776+0000","last_clean":"2026-02-23T06:21:23.156776+0000","last_became_active":"2026-02-23T06:21:22.164972+0000","last_became_peered":"2026-02-23T06:21:22.164972+0000","last_unstale":"2026-02-23T06:21:23.156776+0000","last_undegraded":"2026-02-23T06:21:23.156776+0000","last_fullsized":"2026-02-23T06:21:23.156776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:58:26.519641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157682+0000","last_change":"2026-02-23T06:21:18.153296+0000","last_active":"2026-02-23T06:21:23.157682+0000","last_peered":"2026-02-23T06:21:23.157682+0000","last_clean":"2026-02-23T06:21:23.157682+0000","last_became_active":"2026-02-23T06:21:18.153052+0000","last_became_peered":"2026-02-23T06:21:18.153052+0000","last_unstale":"2026-02-23T06:21:23.157682+0000","last_undegraded":"2026-02-23T06:21:23.157682+0000","last_fullsized":"2026-02-23T06:21:23.157682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:38:32.662334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156686+0000","last_change":"2026-02-23T06:21:17.137568+0000","last_active":"2026-02-23T06:21:23.156686+0000","last_peered":"2026-02-23T06:21:23.156686+0000","last_clean":"2026-02-23T06:21:23.156686+0000","last_became_active":"2026-02-23T06:21:17.137479+0000","last_became_peered":"2026-02-23T06:21:17.137479+0000","last_unstale":"2026-02-23T06:21:23.156686+0000","last_undegraded":"2026-02-23T06:21:23.156686+0000","last_fullsized":"2026-02-23T06:21:23.156686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:50:22.850887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158615+0000","last_change":"2026-02-23T06:21:22.175837+0000","last_active":"2026-02-23T06:21:23.158615+0000","last_peered":"2026-02-23T06:21:23.158615+0000","last_clean":"2026-02-23T06:21:23.158615+0000","last_became_active":"2026-02-23T06:21:22.175638+0000","last_became_peered":"2026-02-23T06:21:22.175638+0000","last_unstale":"2026-02-23T06:21:23.158615+0000","last_undegraded":"2026-02-23T06:21:23.158615+0000","last_fullsized":"2026-02-23T06:21:23.158615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:24:39.312650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157339+0000","last_change":"2026-02-23T06:21:18.155473+0000","last_active":"2026-02-23T06:21:23.157339+0000","last_peered":"2026-02-23T06:21:23.157339+0000","last_clean":"2026-02-23T06:21:23.157339+0000","last_became_active":"2026-02-23T06:21:18.155349+0000","last_became_peered":"2026-02-23T06:21:18.155349+0000","last_unstale":"2026-02-23T06:21:23.157339+0000","last_undegraded":"2026-02-23T06:21:23.157339+0000","last_fullsized":"2026-02-23T06:21:23.157339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:20:20.345986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158459+0000","last_change":"2026-02-23T06:21:17.148953+0000","last_active":"2026-02-23T06:21:23.158459+0000","last_peered":"2026-02-23T06:21:23.158459+0000","last_clean":"2026-02-23T06:21:23.158459+0000","last_became_active":"2026-02-23T06:21:17.148841+0000","last_became_peered":"2026-02-23T06:21:17.148841+0000","last_unstale":"2026-02-23T06:21:23.158459+0000","last_undegraded":"2026-02-23T06:21:23.158459+0000","last_fullsized":"2026-02-23T06:21:23.158459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:48:14.620108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156366+0000","last_change":"2026-02-23T06:21:22.172897+0000","last_active":"2026-02-23T06:21:23.156366+0000","last_peered":"2026-02-23T06:21:23.156366+0000","last_clean":"2026-02-23T06:21:23.156366+0000","last_became_active":"2026-02-23T06:21:22.172683+0000","last_became_peered":"2026-02-23T06:21:22.172683+0000","last_unstale":"2026-02-23T06:21:23.156366+0000","last_undegraded":"2026-02-23T06:21:23.156366+0000","last_fullsized":"2026-02-23T06:21:23.156366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:17:41.991286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159118+0000","last_change":"2026-02-23T06:21:18.154897+0000","last_active":"2026-02-23T06:21:23.159118+0000","last_peered":"2026-02-23T06:21:23.159118+0000","last_clean":"2026-02-23T06:21:23.159118+0000","last_became_active":"2026-02-23T06:21:18.154586+0000","last_became_peered":"2026-02-23T06:21:18.154586+0000","last_unstale":"2026-02-23T06:21:23.159118+0000","last_undegraded":"2026-02-23T06:21:23.159118+0000","last_fullsized":"2026-02-23T06:21:23.159118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:22:13.361673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158486+0000","last_change":"2026-02-23T06:21:17.140774+0000","last_active":"2026-02-23T06:21:23.158486+0000","last_peered":"2026-02-23T06:21:23.158486+0000","last_clean":"2026-02-23T06:21:23.158486+0000","last_became_active":"2026-02-23T06:21:17.140699+0000","last_became_peered":"2026-02-23T06:21:17.140699+0000","last_unstale":"2026-02-23T06:21:23.158486+0000","last_undegraded":"2026-02-23T06:21:23.158486+0000","last_fullsized":"2026-02-23T06:21:23.158486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:59:47.987932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156705+0000","last_change":"2026-02-23T06:21:22.166371+0000","last_active":"2026-02-23T06:21:23.156705+0000","last_peered":"2026-02-23T06:21:23.156705+0000","last_clean":"2026-02-23T06:21:23.156705+0000","last_became_active":"2026-02-23T06:21:22.166204+0000","last_became_peered":"2026-02-23T06:21:22.166204+0000","last_unstale":"2026-02-23T06:21:23.156705+0000","last_undegraded":"2026-02-23T06:21:23.156705+0000","last_fullsized":"2026-02-23T06:21:23.156705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:50:51.116428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156852+0000","last_change":"2026-02-23T06:21:22.167411+0000","last_active":"2026-02-23T06:21:23.156852+0000","last_peered":"2026-02-23T06:21:23.156852+0000","last_clean":"2026-02-23T06:21:23.156852+0000","last_became_active":"2026-02-23T06:21:22.167217+0000","last_became_peered":"2026-02-23T06:21:22.167217+0000","last_unstale":"2026-02-23T06:21:23.156852+0000","last_undegraded":"2026-02-23T06:21:23.156852+0000","last_fullsized":"2026-02-23T06:21:23.156852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:20:54.687551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156512+0000","last_change":"2026-02-23T06:21:18.146043+0000","last_active":"2026-02-23T06:21:23.156512+0000","last_peered":"2026-02-23T06:21:23.156512+0000","last_clean":"2026-02-23T06:21:23.156512+0000","last_became_active":"2026-02-23T06:21:18.145938+0000","last_became_peered":"2026-02-23T06:21:18.145938+0000","last_unstale":"2026-02-23T06:21:23.156512+0000","last_undegraded":"2026-02-23T06:21:23.156512+0000","last_fullsized":"2026-02-23T06:21:23.156512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:03:21.252772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157446+0000","last_change":"2026-02-23T06:21:17.149581+0000","last_active":"2026-02-23T06:21:23.157446+0000","last_peered":"2026-02-23T06:21:23.157446+0000","last_clean":"2026-02-23T06:21:23.157446+0000","last_became_active":"2026-02-23T06:21:17.149490+0000","last_became_peered":"2026-02-23T06:21:17.149490+0000","last_unstale":"2026-02-23T06:21:23.157446+0000","last_undegraded":"2026-02-23T06:21:23.157446+0000","last_fullsized":"2026-02-23T06:21:23.157446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:18:42.211307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158840+0000","last_change":"2026-02-23T06:21:22.175655+0000","last_active":"2026-02-23T06:21:23.158840+0000","last_peered":"2026-02-23T06:21:23.158840+0000","last_clean":"2026-02-23T06:21:23.158840+0000","last_became_active":"2026-02-23T06:21:22.174906+0000","last_became_peered":"2026-02-23T06:21:22.174906+0000","last_unstale":"2026-02-23T06:21:23.158840+0000","last_undegraded":"2026-02-23T06:21:23.158840+0000","last_fullsized":"2026-02-23T06:21:23.158840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:50:34.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156556+0000","last_change":"2026-02-23T06:21:18.142560+0000","last_active":"2026-02-23T06:21:23.156556+0000","last_peered":"2026-02-23T06:21:23.156556+0000","last_clean":"2026-02-23T06:21:23.156556+0000","last_became_active":"2026-02-23T06:21:18.142325+0000","last_became_peered":"2026-02-23T06:21:18.142325+0000","last_unstale":"2026-02-23T06:21:23.156556+0000","last_undegraded":"2026-02-23T06:21:23.156556+0000","last_fullsized":"2026-02-23T06:21:23.156556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:45:44.641652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156988+0000","last_change":"2026-02-23T06:21:17.146195+0000","last_active":"2026-02-23T06:21:23.156988+0000","last_peered":"2026-02-23T06:21:23.156988+0000","last_clean":"2026-02-23T06:21:23.156988+0000","last_became_active":"2026-02-23T06:21:17.146022+0000","last_became_peered":"2026-02-23T06:21:17.146022+0000","last_unstale":"2026-02-23T06:21:23.156988+0000","last_undegraded":"2026-02-23T06:21:23.156988+0000","last_fullsized":"2026-02-23T06:21:23.156988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:34:32.822540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157689+0000","last_change":"2026-02-23T06:21:17.148590+0000","last_active":"2026-02-23T06:21:23.157689+0000","last_peered":"2026-02-23T06:21:23.157689+0000","last_clean":"2026-02-23T06:21:23.157689+0000","last_became_active":"2026-02-23T06:21:17.148417+0000","last_became_peered":"2026-02-23T06:21:17.148417+0000","last_unstale":"2026-02-23T06:21:23.157689+0000","last_undegraded":"2026-02-23T06:21:23.157689+0000","last_fullsized":"2026-02-23T06:21:23.157689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:21:11.877590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156606+0000","last_change":"2026-02-23T06:21:18.152383+0000","last_active":"2026-02-23T06:21:23.156606+0000","last_peered":"2026-02-23T06:21:23.156606+0000","last_clean":"2026-02-23T06:21:23.156606+0000","last_became_active":"2026-02-23T06:21:18.152267+0000","last_became_peered":"2026-02-23T06:21:18.152267+0000","last_unstale":"2026-02-23T06:21:23.156606+0000","last_undegraded":"2026-02-23T06:21:23.156606+0000","last_fullsized":"2026-02-23T06:21:23.156606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:34:11.558509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156801+0000","last_change":"2026-02-23T06:21:22.158812+0000","last_active":"2026-02-23T06:21:23.156801+0000","last_peered":"2026-02-23T06:21:23.156801+0000","last_clean":"2026-02-23T06:21:23.156801+0000","last_became_active":"2026-02-23T06:21:22.158607+0000","last_became_peered":"2026-02-23T06:21:22.158607+0000","last_unstale":"2026-02-23T06:21:23.156801+0000","last_undegraded":"2026-02-23T06:21:23.156801+0000","last_fullsized":"2026-02-23T06:21:23.156801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:59:07.000053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156780+0000","last_change":"2026-02-23T06:21:17.138744+0000","last_active":"2026-02-23T06:21:23.156780+0000","last_peered":"2026-02-23T06:21:23.156780+0000","last_clean":"2026-02-23T06:21:23.156780+0000","last_became_active":"2026-02-23T06:21:17.138245+0000","last_became_peered":"2026-02-23T06:21:17.138245+0000","last_unstale":"2026-02-23T06:21:23.156780+0000","last_undegraded":"2026-02-23T06:21:23.156780+0000","last_fullsized":"2026-02-23T06:21:23.156780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:08:03.143401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157483+0000","last_change":"2026-02-23T06:21:18.143640+0000","last_active":"2026-02-23T06:21:23.157483+0000","last_peered":"2026-02-23T06:21:23.157483+0000","last_clean":"2026-02-23T06:21:23.157483+0000","last_became_active":"2026-02-23T06:21:18.143550+0000","last_became_peered":"2026-02-23T06:21:18.143550+0000","last_unstale":"2026-02-23T06:21:23.157483+0000","last_undegraded":"2026-02-23T06:21:23.157483+0000","last_fullsized":"2026-02-23T06:21:23.157483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:11:40.394042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156644+0000","last_change":"2026-02-23T06:21:22.169641+0000","last_active":"2026-02-23T06:21:23.156644+0000","last_peered":"2026-02-23T06:21:23.156644+0000","last_clean":"2026-02-23T06:21:23.156644+0000","last_became_active":"2026-02-23T06:21:22.169432+0000","last_became_peered":"2026-02-23T06:21:22.169432+0000","last_unstale":"2026-02-23T06:21:23.156644+0000","last_undegraded":"2026-02-23T06:21:23.156644+0000","last_fullsized":"2026-02-23T06:21:23.156644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:00:17.622113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158222+0000","last_change":"2026-02-23T06:21:18.143781+0000","last_active":"2026-02-23T06:21:23.158222+0000","last_peered":"2026-02-23T06:21:23.158222+0000","last_clean":"2026-02-23T06:21:23.158222+0000","last_became_active":"2026-02-23T06:21:18.143724+0000","last_became_peered":"2026-02-23T06:21:18.143724+0000","last_unstale":"2026-02-23T06:21:23.158222+0000","last_undegraded":"2026-02-23T06:21:23.158222+0000","last_fullsized":"2026-02-23T06:21:23.158222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:25:55.416021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156366+0000","last_change":"2026-02-23T06:21:18.145425+0000","last_active":"2026-02-23T06:21:23.156366+0000","last_peered":"2026-02-23T06:21:23.156366+0000","last_clean":"2026-02-23T06:21:23.156366+0000","last_became_active":"2026-02-23T06:21:18.145325+0000","last_became_peered":"2026-02-23T06:21:18.145325+0000","last_unstale":"2026-02-23T06:21:23.156366+0000","last_undegraded":"2026-02-23T06:21:23.156366+0000","last_fullsized":"2026-02-23T06:21:23.156366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:55:31.700518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157544+0000","last_change":"2026-02-23T06:21:18.150997+0000","last_active":"2026-02-23T06:21:23.157544+0000","last_peered":"2026-02-23T06:21:23.157544+0000","last_clean":"2026-02-23T06:21:23.157544+0000","last_became_active":"2026-02-23T06:21:18.150738+0000","last_became_peered":"2026-02-23T06:21:18.150738+0000","last_unstale":"2026-02-23T06:21:23.157544+0000","last_undegraded":"2026-02-23T06:21:23.157544+0000","last_fullsized":"2026-02-23T06:21:23.157544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:11:13.400669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156727+0000","last_change":"2026-02-23T06:21:18.142305+0000","last_active":"2026-02-23T06:21:23.156727+0000","last_peered":"2026-02-23T06:21:23.156727+0000","last_clean":"2026-02-23T06:21:23.156727+0000","last_became_active":"2026-02-23T06:21:18.141484+0000","last_became_peered":"2026-02-23T06:21:18.141484+0000","last_unstale":"2026-02-23T06:21:23.156727+0000","last_undegraded":"2026-02-23T06:21:23.156727+0000","last_fullsized":"2026-02-23T06:21:23.156727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:12:36.003405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157376+0000","last_change":"2026-02-23T06:21:18.148610+0000","last_active":"2026-02-23T06:21:23.157376+0000","last_peered":"2026-02-23T06:21:23.157376+0000","last_clean":"2026-02-23T06:21:23.157376+0000","last_became_active":"2026-02-23T06:21:18.148489+0000","last_became_peered":"2026-02-23T06:21:18.148489+0000","last_unstale":"2026-02-23T06:21:23.157376+0000","last_undegraded":"2026-02-23T06:21:23.157376+0000","last_fullsized":"2026-02-23T06:21:23.157376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:36:29.486147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157279+0000","last_change":"2026-02-23T06:21:18.142438+0000","last_active":"2026-02-23T06:21:23.157279+0000","last_peered":"2026-02-23T06:21:23.157279+0000","last_clean":"2026-02-23T06:21:23.157279+0000","last_became_active":"2026-02-23T06:21:18.141854+0000","last_became_peered":"2026-02-23T06:21:18.141854+0000","last_unstale":"2026-02-23T06:21:23.157279+0000","last_undegraded":"2026-02-23T06:21:23.157279+0000","last_fullsized":"2026-02-23T06:21:23.157279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:23:35.379462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159075+0000","last_change":"2026-02-23T06:21:18.153825+0000","last_active":"2026-02-23T06:21:23.159075+0000","last_peered":"2026-02-23T06:21:23.159075+0000","last_clean":"2026-02-23T06:21:23.159075+0000","last_became_active":"2026-02-23T06:21:18.153133+0000","last_became_peered":"2026-02-23T06:21:18.153133+0000","last_unstale":"2026-02-23T06:21:23.159075+0000","last_undegraded":"2026-02-23T06:21:23.159075+0000","last_fullsized":"2026-02-23T06:21:23.159075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:15:03.662362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157187+0000","last_change":"2026-02-23T06:21:18.144945+0000","last_active":"2026-02-23T06:21:23.157187+0000","last_peered":"2026-02-23T06:21:23.157187+0000","last_clean":"2026-02-23T06:21:23.157187+0000","last_became_active":"2026-02-23T06:21:18.144832+0000","last_became_peered":"2026-02-23T06:21:18.144832+0000","last_unstale":"2026-02-23T06:21:23.157187+0000","last_undegraded":"2026-02-23T06:21:23.157187+0000","last_fullsized":"2026-02-23T06:21:23.157187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:41:07.968870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157406+0000","last_change":"2026-02-23T06:21:18.150652+0000","last_active":"2026-02-23T06:21:23.157406+0000","last_peered":"2026-02-23T06:21:23.157406+0000","last_clean":"2026-02-23T06:21:23.157406+0000","last_became_active":"2026-02-23T06:21:18.150489+0000","last_became_peered":"2026-02-23T06:21:18.150489+0000","last_unstale":"2026-02-23T06:21:23.157406+0000","last_undegraded":"2026-02-23T06:21:23.157406+0000","last_fullsized":"2026-02-23T06:21:23.157406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:42:35.233149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156538+0000","last_change":"2026-02-23T06:21:18.143636+0000","last_active":"2026-02-23T06:21:23.156538+0000","last_peered":"2026-02-23T06:21:23.156538+0000","last_clean":"2026-02-23T06:21:23.156538+0000","last_became_active":"2026-02-23T06:21:18.143495+0000","last_became_peered":"2026-02-23T06:21:18.143495+0000","last_unstale":"2026-02-23T06:21:23.156538+0000","last_undegraded":"2026-02-23T06:21:23.156538+0000","last_fullsized":"2026-02-23T06:21:23.156538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:47:19.057181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157427+0000","last_change":"2026-02-23T06:21:18.148787+0000","last_active":"2026-02-23T06:21:23.157427+0000","last_peered":"2026-02-23T06:21:23.157427+0000","last_clean":"2026-02-23T06:21:23.157427+0000","last_became_active":"2026-02-23T06:21:18.148701+0000","last_became_peered":"2026-02-23T06:21:18.148701+0000","last_unstale":"2026-02-23T06:21:23.157427+0000","last_undegraded":"2026-02-23T06:21:23.157427+0000","last_fullsized":"2026-02-23T06:21:23.157427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:19:32.878202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156524+0000","last_change":"2026-02-23T06:21:18.145498+0000","last_active":"2026-02-23T06:21:23.156524+0000","last_peered":"2026-02-23T06:21:23.156524+0000","last_clean":"2026-02-23T06:21:23.156524+0000","last_became_active":"2026-02-23T06:21:18.145346+0000","last_became_peered":"2026-02-23T06:21:18.145346+0000","last_unstale":"2026-02-23T06:21:23.156524+0000","last_undegraded":"2026-02-23T06:21:23.156524+0000","last_fullsized":"2026-02-23T06:21:23.156524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:44:15.203843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158314+0000","last_change":"2026-02-23T06:21:18.147453+0000","last_active":"2026-02-23T06:21:23.158314+0000","last_peered":"2026-02-23T06:21:23.158314+0000","last_clean":"2026-02-23T06:21:23.158314+0000","last_became_active":"2026-02-23T06:21:18.147357+0000","last_became_peered":"2026-02-23T06:21:18.147357+0000","last_unstale":"2026-02-23T06:21:23.158314+0000","last_undegraded":"2026-02-23T06:21:23.158314+0000","last_fullsized":"2026-02-23T06:21:23.158314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:41:05.063786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.159167+0000","last_change":"2026-02-23T06:21:18.151381+0000","last_active":"2026-02-23T06:21:23.159167+0000","last_peered":"2026-02-23T06:21:23.159167+0000","last_clean":"2026-02-23T06:21:23.159167+0000","last_became_active":"2026-02-23T06:21:18.151269+0000","last_became_peered":"2026-02-23T06:21:18.151269+0000","last_unstale":"2026-02-23T06:21:23.159167+0000","last_undegraded":"2026-02-23T06:21:23.159167+0000","last_fullsized":"2026-02-23T06:21:23.159167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:50:46.152385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156748+0000","last_change":"2026-02-23T06:21:18.148411+0000","last_active":"2026-02-23T06:21:23.156748+0000","last_peered":"2026-02-23T06:21:23.156748+0000","last_clean":"2026-02-23T06:21:23.156748+0000","last_became_active":"2026-02-23T06:21:18.148262+0000","last_became_peered":"2026-02-23T06:21:18.148262+0000","last_unstale":"2026-02-23T06:21:23.156748+0000","last_undegraded":"2026-02-23T06:21:23.156748+0000","last_fullsized":"2026-02-23T06:21:23.156748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:09:54.723244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158936+0000","last_change":"2026-02-23T06:21:18.155275+0000","last_active":"2026-02-23T06:21:23.158936+0000","last_peered":"2026-02-23T06:21:23.158936+0000","last_clean":"2026-02-23T06:21:23.158936+0000","last_became_active":"2026-02-23T06:21:18.155214+0000","last_became_peered":"2026-02-23T06:21:18.155214+0000","last_unstale":"2026-02-23T06:21:23.158936+0000","last_undegraded":"2026-02-23T06:21:23.158936+0000","last_fullsized":"2026-02-23T06:21:23.158936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:44:47.367234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157370+0000","last_change":"2026-02-23T06:21:18.153381+0000","last_active":"2026-02-23T06:21:23.157370+0000","last_peered":"2026-02-23T06:21:23.157370+0000","last_clean":"2026-02-23T06:21:23.157370+0000","last_became_active":"2026-02-23T06:21:18.152456+0000","last_became_peered":"2026-02-23T06:21:18.152456+0000","last_unstale":"2026-02-23T06:21:23.157370+0000","last_undegraded":"2026-02-23T06:21:23.157370+0000","last_fullsized":"2026-02-23T06:21:23.157370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:14:46.231331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156471+0000","last_change":"2026-02-23T06:21:18.148599+0000","last_active":"2026-02-23T06:21:23.156471+0000","last_peered":"2026-02-23T06:21:23.156471+0000","last_clean":"2026-02-23T06:21:23.156471+0000","last_became_active":"2026-02-23T06:21:18.148498+0000","last_became_peered":"2026-02-23T06:21:18.148498+0000","last_unstale":"2026-02-23T06:21:23.156471+0000","last_undegraded":"2026-02-23T06:21:23.156471+0000","last_fullsized":"2026-02-23T06:21:23.156471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:05:56.074928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157128+0000","last_change":"2026-02-23T06:21:18.142621+0000","last_active":"2026-02-23T06:21:23.157128+0000","last_peered":"2026-02-23T06:21:23.157128+0000","last_clean":"2026-02-23T06:21:23.157128+0000","last_became_active":"2026-02-23T06:21:18.141938+0000","last_became_peered":"2026-02-23T06:21:18.141938+0000","last_unstale":"2026-02-23T06:21:23.157128+0000","last_undegraded":"2026-02-23T06:21:23.157128+0000","last_fullsized":"2026-02-23T06:21:23.157128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:25:55.390738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157141+0000","last_change":"2026-02-23T06:21:18.153183+0000","last_active":"2026-02-23T06:21:23.157141+0000","last_peered":"2026-02-23T06:21:23.157141+0000","last_clean":"2026-02-23T06:21:23.157141+0000","last_became_active":"2026-02-23T06:21:18.153090+0000","last_became_peered":"2026-02-23T06:21:18.153090+0000","last_unstale":"2026-02-23T06:21:23.157141+0000","last_undegraded":"2026-02-23T06:21:23.157141+0000","last_fullsized":"2026-02-23T06:21:23.157141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:26:17.749612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158286+0000","last_change":"2026-02-23T06:21:18.148055+0000","last_active":"2026-02-23T06:21:23.158286+0000","last_peered":"2026-02-23T06:21:23.158286+0000","last_clean":"2026-02-23T06:21:23.158286+0000","last_became_active":"2026-02-23T06:21:18.147956+0000","last_became_peered":"2026-02-23T06:21:18.147956+0000","last_unstale":"2026-02-23T06:21:23.158286+0000","last_undegraded":"2026-02-23T06:21:23.158286+0000","last_fullsized":"2026-02-23T06:21:23.158286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:22:55.028859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158650+0000","last_change":"2026-02-23T06:21:18.155576+0000","last_active":"2026-02-23T06:21:23.158650+0000","last_peered":"2026-02-23T06:21:23.158650+0000","last_clean":"2026-02-23T06:21:23.158650+0000","last_became_active":"2026-02-23T06:21:18.155130+0000","last_became_peered":"2026-02-23T06:21:18.155130+0000","last_unstale":"2026-02-23T06:21:23.158650+0000","last_undegraded":"2026-02-23T06:21:23.158650+0000","last_fullsized":"2026-02-23T06:21:23.158650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:43:12.801427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158425+0000","last_change":"2026-02-23T06:21:18.152980+0000","last_active":"2026-02-23T06:21:23.158425+0000","last_peered":"2026-02-23T06:21:23.158425+0000","last_clean":"2026-02-23T06:21:23.158425+0000","last_became_active":"2026-02-23T06:21:18.152790+0000","last_became_peered":"2026-02-23T06:21:18.152790+0000","last_unstale":"2026-02-23T06:21:23.158425+0000","last_undegraded":"2026-02-23T06:21:23.158425+0000","last_fullsized":"2026-02-23T06:21:23.158425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:33:09.398040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158457+0000","last_change":"2026-02-23T06:21:18.155247+0000","last_active":"2026-02-23T06:21:23.158457+0000","last_peered":"2026-02-23T06:21:23.158457+0000","last_clean":"2026-02-23T06:21:23.158457+0000","last_became_active":"2026-02-23T06:21:18.155122+0000","last_became_peered":"2026-02-23T06:21:18.155122+0000","last_unstale":"2026-02-23T06:21:23.158457+0000","last_undegraded":"2026-02-23T06:21:23.158457+0000","last_fullsized":"2026-02-23T06:21:23.158457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:45:08.775934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156432+0000","last_change":"2026-02-23T06:21:18.151259+0000","last_active":"2026-02-23T06:21:23.156432+0000","last_peered":"2026-02-23T06:21:23.156432+0000","last_clean":"2026-02-23T06:21:23.156432+0000","last_became_active":"2026-02-23T06:21:18.151151+0000","last_became_peered":"2026-02-23T06:21:18.151151+0000","last_unstale":"2026-02-23T06:21:23.156432+0000","last_undegraded":"2026-02-23T06:21:23.156432+0000","last_fullsized":"2026-02-23T06:21:23.156432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:08:03.361054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157811+0000","last_change":"2026-02-23T06:21:18.146606+0000","last_active":"2026-02-23T06:21:23.157811+0000","last_peered":"2026-02-23T06:21:23.157811+0000","last_clean":"2026-02-23T06:21:23.157811+0000","last_became_active":"2026-02-23T06:21:18.146527+0000","last_became_peered":"2026-02-23T06:21:18.146527+0000","last_unstale":"2026-02-23T06:21:23.157811+0000","last_undegraded":"2026-02-23T06:21:23.157811+0000","last_fullsized":"2026-02-23T06:21:23.157811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:30:44.739034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158602+0000","last_change":"2026-02-23T06:21:18.145872+0000","last_active":"2026-02-23T06:21:23.158602+0000","last_peered":"2026-02-23T06:21:23.158602+0000","last_clean":"2026-02-23T06:21:23.158602+0000","last_became_active":"2026-02-23T06:21:18.145770+0000","last_became_peered":"2026-02-23T06:21:18.145770+0000","last_unstale":"2026-02-23T06:21:23.158602+0000","last_undegraded":"2026-02-23T06:21:23.158602+0000","last_fullsized":"2026-02-23T06:21:23.158602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:21:28.063960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158049+0000","last_change":"2026-02-23T06:21:18.152478+0000","last_active":"2026-02-23T06:21:23.158049+0000","last_peered":"2026-02-23T06:21:23.158049+0000","last_clean":"2026-02-23T06:21:23.158049+0000","last_became_active":"2026-02-23T06:21:18.151948+0000","last_became_peered":"2026-02-23T06:21:18.151948+0000","last_unstale":"2026-02-23T06:21:23.158049+0000","last_undegraded":"2026-02-23T06:21:23.158049+0000","last_fullsized":"2026-02-23T06:21:23.158049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:58:02.829593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158363+0000","last_change":"2026-02-23T06:21:18.144778+0000","last_active":"2026-02-23T06:21:23.158363+0000","last_peered":"2026-02-23T06:21:23.158363+0000","last_clean":"2026-02-23T06:21:23.158363+0000","last_became_active":"2026-02-23T06:21:18.144346+0000","last_became_peered":"2026-02-23T06:21:18.144346+0000","last_unstale":"2026-02-23T06:21:23.158363+0000","last_undegraded":"2026-02-23T06:21:23.158363+0000","last_fullsized":"2026-02-23T06:21:23.158363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:25:27.650673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.156824+0000","last_change":"2026-02-23T06:21:18.141648+0000","last_active":"2026-02-23T06:21:23.156824+0000","last_peered":"2026-02-23T06:21:23.156824+0000","last_clean":"2026-02-23T06:21:23.156824+0000","last_became_active":"2026-02-23T06:21:18.141449+0000","last_became_peered":"2026-02-23T06:21:18.141449+0000","last_unstale":"2026-02-23T06:21:23.156824+0000","last_undegraded":"2026-02-23T06:21:23.156824+0000","last_fullsized":"2026-02-23T06:21:23.156824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:33:18.986892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.157020+0000","last_change":"2026-02-23T06:21:18.142536+0000","last_active":"2026-02-23T06:21:23.157020+0000","last_peered":"2026-02-23T06:21:23.157020+0000","last_clean":"2026-02-23T06:21:23.157020+0000","last_became_active":"2026-02-23T06:21:18.142359+0000","last_became_peered":"2026-02-23T06:21:18.142359+0000","last_unstale":"2026-02-23T06:21:23.157020+0000","last_undegraded":"2026-02-23T06:21:23.157020+0000","last_fullsized":"2026-02-23T06:21:23.157020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:54:09.503227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-23T06:21:23.158607+0000","last_change":"2026-02-23T06:21:18.156667+0000","last_active":"2026-02-23T06:21:23.158607+0000","last_peered":"2026-02-23T06:21:23.158607+0000","last_clean":"2026-02-23T06:21:23.158607+0000","last_became_active":"2026-02-23T06:21:18.156564+0000","last_became_peered":"2026-02-23T06:21:18.156564+0000","last_unstale":"2026-02-23T06:21:23.158607+0000","last_undegraded":"2026-02-23T06:21:23.158607+0000","last_fullsized":"2026-02-23T06:21:23.158607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:11:13.967668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5001,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":10002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25597,"internal_metadata":0},"log_size":44,"ondisk_log_size":44,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70172,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":328,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":335872,"data_stored":694963,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":12046,"internal_metadata":27578610},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":268,"kb_used_omap":19,"kb_used_meta":26924,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":274432,"data_stored":104649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19702,"internal_metadata":27570954},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":260,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":266240,"data_stored":104525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11374,"internal_metadata":27579282},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":332,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":339968,"data_stored":694985,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":11711,"internal_metadata":27578945},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":109146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13524,"internal_metadata":27577132},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":264,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":270336,"data_stored":105129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11474,"internal_metadata":27579182},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":272,"kb_used_omap":10,"kb_used_meta":26933,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":278528,"data_stored":108452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11136,"internal_metadata":27579520},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":268,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":274432,"data_stored":104581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19139,"internal_metadata":27571517},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8618,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":702,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":320,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1500,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4712,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":336,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9409,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T06:21:46.544 INFO:tasks.mon_thrash.ceph_manager:clean! 2026-02-23T06:21:46.544 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_netsplit_grace_period 30 2026-02-23T06:21:46.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.704+0000 7f778a3d2640 1 -- 10.20.193.58:0/1606949993 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f77841688d0 msgr2=0x7f7784168ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:46.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.704+0000 7f778a3d2640 1 --2- 10.20.193.58:0/1606949993 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f77841688d0 0x7f7784168ca0 secure :-1 s=READY pgs=82 gs=3 cs=0 l=1 c_cookie=1217449276634364356 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7774009950 tx=0x7f777402f2b0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.704+0000 7f778a3d2640 1 -- 10.20.193.58:0/1606949993 shutdown_connections 2026-02-23T06:21:46.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.704+0000 7f778a3d2640 1 --2- 10.20.193.58:0/1606949993 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f77841688d0 0x7f7784168ca0 unknown :-1 s=CLOSED pgs=82 gs=3 cs=0 l=1 c_cookie=1217449276634364356 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.704+0000 7f778a3d2640 1 -- 10.20.193.58:0/1606949993 >> 10.20.193.58:0/1606949993 conn(0x7f7784054e40 msgr2=0x7f7784057b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:46.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.704+0000 7f778a3d2640 1 -- 10.20.193.58:0/1606949993 shutdown_connections 2026-02-23T06:21:46.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.704+0000 7f778a3d2640 1 -- 10.20.193.58:0/1606949993 wait complete. 2026-02-23T06:21:46.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.705+0000 7f778a3d2640 1 Processor -- start 2026-02-23T06:21:46.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.705+0000 7f778a3d2640 1 -- start start 2026-02-23T06:21:46.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.705+0000 7f778a3d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f77840b6440 0x7f77841648a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:46.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.705+0000 7f778a3d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f77840bb0b0 0x7f77841638d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:46.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.706+0000 7f778a3d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f77841688d0 0x7f7784148d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:46.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.706+0000 7f778a3d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f7784163270 con 0x7f77841688d0 2026-02-23T06:21:46.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.706+0000 7f778a3d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f7784163e10 con 0x7f77840bb0b0 2026-02-23T06:21:46.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.706+0000 7f778a3d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f7784162cf0 con 0x7f77840b6440 2026-02-23T06:21:46.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.706+0000 7f7789bd1640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f77841688d0 0x7f7784148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:46.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.706+0000 7f77893d0640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f77840b6440 0x7f77841648a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:46.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.706+0000 7f77893d0640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f77840b6440 0x7f77841648a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:59204/0 (socket says 10.20.193.58:59204) 2026-02-23T06:21:46.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.706+0000 7f77893d0640 1 -- 10.20.193.58:0/4081105515 learned_addr learned my addr 10.20.193.58:0/4081105515 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:46.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.706+0000 7f7788bcf640 1 --2- 10.20.193.58:0/4081105515 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f77840bb0b0 0x7f77841638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:46.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.706+0000 7f77893d0640 1 -- 10.20.193.58:0/4081105515 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f77840bb0b0 msgr2=0x7f77841638d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:46.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.706+0000 7f77893d0640 1 --2- 10.20.193.58:0/4081105515 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f77840bb0b0 0x7f77841638d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.706+0000 7f77893d0640 1 -- 10.20.193.58:0/4081105515 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f77841688d0 msgr2=0x7f7784148d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:46.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.706+0000 7f77893d0640 1 --2- 10.20.193.58:0/4081105515 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f77841688d0 0x7f7784148d10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.706+0000 7f77893d0640 1 -- 10.20.193.58:0/4081105515 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7774009570 con 0x7f77840b6440 2026-02-23T06:21:46.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.706+0000 7f77893d0640 1 --2- 10.20.193.58:0/4081105515 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f77840b6440 0x7f77841648a0 secure :-1 s=READY pgs=83 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7774004740 tx=0x7f77740028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:46.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.707+0000 7f7771ffb640 1 -- 10.20.193.58:0/4081105515 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f777403d070 con 0x7f77840b6440 2026-02-23T06:21:46.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.707+0000 7f7771ffb640 1 -- 10.20.193.58:0/4081105515 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7774038470 con 0x7f77840b6440 2026-02-23T06:21:46.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.707+0000 7f7771ffb640 1 -- 10.20.193.58:0/4081105515 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7774038880 con 0x7f77840b6440 2026-02-23T06:21:46.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.707+0000 7f778a3d2640 1 -- 10.20.193.58:0/4081105515 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77840a1d70 con 0x7f77840b6440 2026-02-23T06:21:46.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.707+0000 7f778a3d2640 1 -- 10.20.193.58:0/4081105515 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7784149b20 con 0x7f77840b6440 2026-02-23T06:21:46.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.707+0000 7f778a3d2640 1 -- 10.20.193.58:0/4081105515 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77841691a0 con 0x7f77840b6440 2026-02-23T06:21:46.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.708+0000 7f7771ffb640 1 -- 10.20.193.58:0/4081105515 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f77740389e0 con 0x7f77840b6440 2026-02-23T06:21:46.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.709+0000 7f7771ffb640 1 --2- 10.20.193.58:0/4081105515 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f775407a6c0 0x7f775409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:46.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.709+0000 7f7771ffb640 1 -- 10.20.193.58:0/4081105515 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f77740c2390 con 0x7f77840b6440 2026-02-23T06:21:46.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.710+0000 7f7788bcf640 1 --2- 10.20.193.58:0/4081105515 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f775407a6c0 0x7f775409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:46.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.710+0000 7f7788bcf640 1 --2- 10.20.193.58:0/4081105515 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f775407a6c0 0x7f775409ab70 secure :-1 s=READY pgs=114 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77841655f0 tx=0x7f7778009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:46.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.711+0000 7f7771ffb640 1 -- 10.20.193.58:0/4081105515 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f7774085500 con 0x7f77840b6440 2026-02-23T06:21:46.818 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.823+0000 7f778a3d2640 1 -- 10.20.193.58:0/4081105515 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command([{prefix=config set, name=mon_netsplit_grace_period}] v 0) -- 0x7f77840b7170 con 0x7f77840b6440 2026-02-23T06:21:46.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.826+0000 7f7771ffb640 1 -- 10.20.193.58:0/4081105515 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_netsplit_grace_period}]=0 v29)=0 v29) ==== 124+0+0 (secure 0 0 0) 0x7f77740886b0 con 0x7f77840b6440 2026-02-23T06:21:46.822 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.827+0000 7f778a3d2640 1 -- 10.20.193.58:0/4081105515 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f775407a6c0 msgr2=0x7f775409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:46.822 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.827+0000 7f778a3d2640 1 --2- 10.20.193.58:0/4081105515 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f775407a6c0 0x7f775409ab70 secure :-1 s=READY pgs=114 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77841655f0 tx=0x7f7778009040 comp rx=0 tx=0).stop 2026-02-23T06:21:46.822 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.827+0000 7f778a3d2640 1 -- 10.20.193.58:0/4081105515 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f77840b6440 msgr2=0x7f77841648a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:46.822 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.827+0000 7f778a3d2640 1 --2- 10.20.193.58:0/4081105515 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f77840b6440 0x7f77841648a0 secure :-1 s=READY pgs=83 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7774004740 tx=0x7f77740028d0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.822 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.827+0000 7f778a3d2640 1 -- 10.20.193.58:0/4081105515 shutdown_connections 2026-02-23T06:21:46.822 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.827+0000 7f778a3d2640 1 --2- 10.20.193.58:0/4081105515 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f775407a6c0 0x7f775409ab70 unknown :-1 s=CLOSED pgs=114 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.827+0000 7f778a3d2640 1 --2- 10.20.193.58:0/4081105515 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f77841688d0 0x7f7784148d10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.827+0000 7f778a3d2640 1 --2- 10.20.193.58:0/4081105515 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f77840bb0b0 0x7f77841638d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.827+0000 7f778a3d2640 1 --2- 10.20.193.58:0/4081105515 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f77840b6440 0x7f77841648a0 unknown :-1 s=CLOSED pgs=83 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.827+0000 7f778a3d2640 1 -- 10.20.193.58:0/4081105515 >> 10.20.193.58:0/4081105515 conn(0x7f7784054e40 msgr2=0x7f778415a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:46.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.827+0000 7f778a3d2640 1 -- 10.20.193.58:0/4081105515 shutdown_connections 2026-02-23T06:21:46.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.827+0000 7f778a3d2640 1 -- 10.20.193.58:0/4081105515 wait complete. 2026-02-23T06:21:46.835 DEBUG:tasks.mon_thrash:Yielding 2026-02-23T06:21:46.835 INFO:teuthology.run_tasks:Running task workunit... 2026-02-23T06:21:46.861 INFO:tasks.workunit:Pulling workunits from ref b60f86513d744c550fab39595f0905abce2bdd7d 2026-02-23T06:21:46.862 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-23T06:21:46.862 INFO:tasks.workunit:timeout=3h 2026-02-23T06:21:46.862 INFO:tasks.workunit:cleanup=True 2026-02-23T06:21:46.862 DEBUG:teuthology.orchestra.run.trial058:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-23T06:21:46.863 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2026-02-23T06:21:46.902 INFO:teuthology.orchestra.run.trial058.stdout: File: /home/ubuntu/cephtest/mnt.0 2026-02-23T06:21:46.902 INFO:teuthology.orchestra.run.trial058.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2026-02-23T06:21:46.902 INFO:teuthology.orchestra.run.trial058.stdout:Device: 2bh/43d Inode: 1 Links: 2 2026-02-23T06:21:46.902 INFO:teuthology.orchestra.run.trial058.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-23T06:21:46.902 INFO:teuthology.orchestra.run.trial058.stdout:Context: system_u:object_r:unlabeled_t:s0 2026-02-23T06:21:46.902 INFO:teuthology.orchestra.run.trial058.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2026-02-23T06:21:46.902 INFO:teuthology.orchestra.run.trial058.stdout:Modify: 2026-02-23 06:21:23.144550697 +0000 2026-02-23T06:21:46.902 INFO:teuthology.orchestra.run.trial058.stdout:Change: 2026-02-23 06:21:30.991155613 +0000 2026-02-23T06:21:46.902 INFO:teuthology.orchestra.run.trial058.stdout: Birth: 2026-02-23 06:21:23.144550697 +0000 2026-02-23T06:21:46.902 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2026-02-23T06:21:46.902 DEBUG:teuthology.orchestra.run.trial058:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2026-02-23T06:21:46.988 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.993+0000 7ff87e192640 1 -- 10.20.193.58:0/596539151 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff87815d870 msgr2=0x7ff8780587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:46.988 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.993+0000 7ff87e192640 1 --2- 10.20.193.58:0/596539151 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff87815d870 0x7ff8780587b0 secure :-1 s=READY pgs=181 gs=3 cs=0 l=1 c_cookie=4472583044533648047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8780b5040 tx=0x7ff86c02f190 comp rx=0 tx=0).stop 2026-02-23T06:21:46.988 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.993+0000 7ff87e192640 1 -- 10.20.193.58:0/596539151 shutdown_connections 2026-02-23T06:21:46.988 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.993+0000 7ff87e192640 1 --2- 10.20.193.58:0/596539151 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff87815d870 0x7ff8780587b0 unknown :-1 s=CLOSED pgs=181 gs=3 cs=0 l=1 c_cookie=4472583044533648047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.988 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.993+0000 7ff87e192640 1 --2- 10.20.193.58:0/596539151 >> v2:10.20.193.93:3300/0 conn(0x7ff87815d4a0 0x7ff8780affb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.988 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.993+0000 7ff87e192640 1 -- 10.20.193.58:0/596539151 >> 10.20.193.58:0/596539151 conn(0x7ff8780b3c20 msgr2=0x7ff8780b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:46.988 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.993+0000 7ff87e192640 1 -- 10.20.193.58:0/596539151 shutdown_connections 2026-02-23T06:21:46.988 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.993+0000 7ff87e192640 1 -- 10.20.193.58:0/596539151 wait complete. 2026-02-23T06:21:46.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.995+0000 7ff87e192640 1 Processor -- start 2026-02-23T06:21:46.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.995+0000 7ff87e192640 1 -- start start 2026-02-23T06:21:46.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.995+0000 7ff87e192640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8780b6690 0x7ff878140590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:46.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.995+0000 7ff87e192640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff87815d4a0 0x7ff878161090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:46.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.995+0000 7ff87e192640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff87815d870 0x7ff8781615d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:46.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.995+0000 7ff87e192640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff878129540 con 0x7ff87815d870 2026-02-23T06:21:46.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.995+0000 7ff87e192640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff878129280 con 0x7ff8780b6690 2026-02-23T06:21:46.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.995+0000 7ff87e192640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7ff8780577b0 con 0x7ff87815d4a0 2026-02-23T06:21:46.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.996+0000 7ff87d190640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8780b6690 0x7ff878140590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:46.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.996+0000 7ff87d991640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff87815d870 0x7ff8781615d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:46.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.996+0000 7ff87d190640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8780b6690 0x7ff878140590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:59644/0 (socket says 10.20.193.58:59644) 2026-02-23T06:21:46.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.996+0000 7ff87d190640 1 -- 10.20.193.58:0/4041770242 learned_addr learned my addr 10.20.193.58:0/4041770242 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:46.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.996+0000 7ff87c98f640 1 --2- 10.20.193.58:0/4041770242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff87815d4a0 0x7ff878161090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:46.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.996+0000 7ff87d190640 1 -- 10.20.193.58:0/4041770242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff87815d4a0 msgr2=0x7ff878161090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:46.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.996+0000 7ff87d190640 1 --2- 10.20.193.58:0/4041770242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff87815d4a0 0x7ff878161090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.996+0000 7ff87d190640 1 -- 10.20.193.58:0/4041770242 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff87815d870 msgr2=0x7ff8781615d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:46.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.996+0000 7ff87d190640 1 --2- 10.20.193.58:0/4041770242 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff87815d870 0x7ff8781615d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:46.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.996+0000 7ff87d190640 1 -- 10.20.193.58:0/4041770242 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff86c0094b0 con 0x7ff8780b6690 2026-02-23T06:21:46.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.996+0000 7ff87d991640 1 --2- 10.20.193.58:0/4041770242 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff87815d870 0x7ff8781615d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:46.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.996+0000 7ff87d190640 1 --2- 10.20.193.58:0/4041770242 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8780b6690 0x7ff878140590 secure :-1 s=READY pgs=174 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff868009480 tx=0x7ff86800ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:46.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.996+0000 7ff865ffb640 1 -- 10.20.193.58:0/4041770242 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff86800cd40 con 0x7ff8780b6690 2026-02-23T06:21:46.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.996+0000 7ff865ffb640 1 -- 10.20.193.58:0/4041770242 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff868004850 con 0x7ff8780b6690 2026-02-23T06:21:46.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.996+0000 7ff865ffb640 1 -- 10.20.193.58:0/4041770242 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff86800cea0 con 0x7ff8780b6690 2026-02-23T06:21:46.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.996+0000 7ff87e192640 1 -- 10.20.193.58:0/4041770242 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff878057a90 con 0x7ff8780b6690 2026-02-23T06:21:46.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.997+0000 7ff87e192640 1 -- 10.20.193.58:0/4041770242 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff878058050 con 0x7ff8780b6690 2026-02-23T06:21:46.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.997+0000 7ff87e192640 1 -- 10.20.193.58:0/4041770242 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8780b6d50 con 0x7ff8780b6690 2026-02-23T06:21:46.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.998+0000 7ff865ffb640 1 -- 10.20.193.58:0/4041770242 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7ff86801f060 con 0x7ff8780b6690 2026-02-23T06:21:46.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:46.999+0000 7ff865ffb640 1 --2- 10.20.193.58:0/4041770242 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff84807a6b0 0x7ff84809ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:46.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.000+0000 7ff865ffb640 1 -- 10.20.193.58:0/4041770242 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7ff868014070 con 0x7ff8780b6690 2026-02-23T06:21:46.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.000+0000 7ff865ffb640 1 -- 10.20.193.58:0/4041770242 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7ff868060ff0 con 0x7ff8780b6690 2026-02-23T06:21:46.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.000+0000 7ff87c98f640 1 --2- 10.20.193.58:0/4041770242 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff84807a6b0 0x7ff84809ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:46.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.001+0000 7ff87c98f640 1 --2- 10.20.193.58:0/4041770242 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff84807a6b0 0x7ff84809ab60 secure :-1 s=READY pgs=115 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff86c0097e0 tx=0x7ff86c031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:47.004 DEBUG:teuthology.orchestra.run.trial058:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout b60f86513d744c550fab39595f0905abce2bdd7d 2026-02-23T06:21:47.095 INFO:tasks.workunit.client.0.trial058.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-23T06:21:47.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.143+0000 7ff87e192640 1 -- 10.20.193.58:0/4041770242 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff878129040 con 0x7ff8780b6690 2026-02-23T06:21:47.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.144+0000 7ff865ffb640 1 -- 10.20.193.58:0/4041770242 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6886 (secure 0 0 0) 0x7ff878129040 con 0x7ff8780b6690 2026-02-23T06:21:47.138 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:21:47.139 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":9,"btime":"2026-02-23T06:21:35:181391+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4320,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.58:6836/332204623","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6834","nonce":332204623},{"type":"v1","addr":"10.20.193.58:6836","nonce":332204623}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4349,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6839/49797428","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6838","nonce":49797428},{"type":"v1","addr":"10.20.193.93:6839","nonce":49797428}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4355,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.58:6833/363105980","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6832","nonce":363105980},{"type":"v1","addr":"10.20.193.58:6833","nonce":363105980}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4438,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6835/3715244768","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6834","nonce":3715244768},{"type":"v1","addr":"10.20.193.93:6835","nonce":3715244768}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4444,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6837/3986540573","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6836","nonce":3986540573},{"type":"v1","addr":"10.20.193.93:6837","nonce":3986540573}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false,"allow_referent_inodes":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-23T06:21:17.428505+0000","modified":"2026-02-23T06:21:34.468900+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4468},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4468":{"gid":4468,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"10.20.193.58:6837/4266460647","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6835","nonce":4266460647},{"type":"v1","addr":"10.20.193.58:6837","nonce":4266460647}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4468,"qdb_cluster":[4468]},"id":1}]} 2026-02-23T06:21:47.139 INFO:teuthology.orchestra.run.trial058.stderr:dumped fsmap epoch 9 2026-02-23T06:21:47.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.145+0000 7ff87e192640 1 -- 10.20.193.58:0/4041770242 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff84807a6b0 msgr2=0x7ff84809ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:47.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.145+0000 7ff87e192640 1 --2- 10.20.193.58:0/4041770242 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff84807a6b0 0x7ff84809ab60 secure :-1 s=READY pgs=115 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff86c0097e0 tx=0x7ff86c031040 comp rx=0 tx=0).stop 2026-02-23T06:21:47.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.145+0000 7ff87e192640 1 -- 10.20.193.58:0/4041770242 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8780b6690 msgr2=0x7ff878140590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:47.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.145+0000 7ff87e192640 1 --2- 10.20.193.58:0/4041770242 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8780b6690 0x7ff878140590 secure :-1 s=READY pgs=174 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff868009480 tx=0x7ff86800ee60 comp rx=0 tx=0).stop 2026-02-23T06:21:47.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.145+0000 7ff87e192640 1 -- 10.20.193.58:0/4041770242 shutdown_connections 2026-02-23T06:21:47.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.145+0000 7ff87e192640 1 --2- 10.20.193.58:0/4041770242 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff84807a6b0 0x7ff84809ab60 unknown :-1 s=CLOSED pgs=115 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.145+0000 7ff87e192640 1 --2- 10.20.193.58:0/4041770242 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff87815d870 0x7ff8781615d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.145+0000 7ff87e192640 1 --2- 10.20.193.58:0/4041770242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff87815d4a0 0x7ff878161090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.145+0000 7ff87e192640 1 --2- 10.20.193.58:0/4041770242 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8780b6690 0x7ff878140590 unknown :-1 s=CLOSED pgs=174 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.145+0000 7ff87e192640 1 -- 10.20.193.58:0/4041770242 >> 10.20.193.58:0/4041770242 conn(0x7ff8780b3c20 msgr2=0x7ff878141410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:47.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.145+0000 7ff87e192640 1 -- 10.20.193.58:0/4041770242 shutdown_connections 2026-02-23T06:21:47.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.145+0000 7ff87e192640 1 -- 10.20.193.58:0/4041770242 wait complete. 2026-02-23T06:21:47.153 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2026-02-23T06:21:47.153 INFO:tasks.mon_thrash.mon_thrasher:seed: 1771827706, revive delay: 20.0, thrash delay: 10.0 thrash many: False, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2026-02-23T06:21:47.154 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:21:47.154 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:21:47.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.280+0000 7fc13bfff640 1 -- 10.20.193.58:0/105593187 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc13c0b6690 msgr2=0x7fc13c058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:47.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.280+0000 7fc13bfff640 1 --2- 10.20.193.58:0/105593187 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc13c0b6690 0x7fc13c058cf0 secure :-1 s=READY pgs=84 gs=2 cs=0 l=1 c_cookie=15207354675317674727 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc13c059740 tx=0x7fc12c030340 comp rx=0 tx=0).stop 2026-02-23T06:21:47.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.280+0000 7fc13bfff640 1 -- 10.20.193.58:0/105593187 shutdown_connections 2026-02-23T06:21:47.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.280+0000 7fc13bfff640 1 --2- 10.20.193.58:0/105593187 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc13c0b6690 0x7fc13c058cf0 unknown :-1 s=CLOSED pgs=84 gs=2 cs=0 l=1 c_cookie=15207354675317674727 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.280+0000 7fc13bfff640 1 --2- 10.20.193.58:0/105593187 >> v2:10.20.193.93:3300/0 conn(0x7fc13c15d870 0x7fc13c0587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.280+0000 7fc13bfff640 1 --2- 10.20.193.58:0/105593187 >> v2:10.20.193.58:3300/0 conn(0x7fc13c15d4a0 0x7fc13c0affb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.280+0000 7fc13bfff640 1 -- 10.20.193.58:0/105593187 >> 10.20.193.58:0/105593187 conn(0x7fc13c0b3c20 msgr2=0x7fc13c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:47.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.280+0000 7fc13bfff640 1 -- 10.20.193.58:0/105593187 shutdown_connections 2026-02-23T06:21:47.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.280+0000 7fc13bfff640 1 -- 10.20.193.58:0/105593187 wait complete. 2026-02-23T06:21:47.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.281+0000 7fc13bfff640 1 Processor -- start 2026-02-23T06:21:47.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.281+0000 7fc13bfff640 1 -- start start 2026-02-23T06:21:47.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.282+0000 7fc13bfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc13c0b6690 0x7fc13c14d100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:47.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.282+0000 7fc13bfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc13c15d4a0 0x7fc13c13aff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:47.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.282+0000 7fc13bfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc13c15d870 0x7fc13c13b530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:47.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.282+0000 7fc13bfff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc13c149c20 con 0x7fc13c15d4a0 2026-02-23T06:21:47.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.282+0000 7fc13bfff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc13c13fd60 con 0x7fc13c0b6690 2026-02-23T06:21:47.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.282+0000 7fc13bfff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc13c149ec0 con 0x7fc13c15d870 2026-02-23T06:21:47.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.282+0000 7fc13affd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc13c0b6690 0x7fc13c14d100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:47.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.282+0000 7fc13affd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc13c0b6690 0x7fc13c14d100 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:59668/0 (socket says 10.20.193.58:59668) 2026-02-23T06:21:47.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.282+0000 7fc13affd640 1 -- 10.20.193.58:0/2295220347 learned_addr learned my addr 10.20.193.58:0/2295220347 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:47.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.282+0000 7fc13b7fe640 1 --2- 10.20.193.58:0/2295220347 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc13c15d870 0x7fc13c13b530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:47.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.282+0000 7fc13a7fc640 1 --2- 10.20.193.58:0/2295220347 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc13c15d4a0 0x7fc13c13aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:47.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.282+0000 7fc13b7fe640 1 -- 10.20.193.58:0/2295220347 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc13c0b6690 msgr2=0x7fc13c14d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:47.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.282+0000 7fc13b7fe640 1 --2- 10.20.193.58:0/2295220347 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc13c0b6690 0x7fc13c14d100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.282+0000 7fc13b7fe640 1 -- 10.20.193.58:0/2295220347 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc13c15d4a0 msgr2=0x7fc13c13aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:47.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.282+0000 7fc13b7fe640 1 --2- 10.20.193.58:0/2295220347 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc13c15d4a0 0x7fc13c13aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.282+0000 7fc13b7fe640 1 -- 10.20.193.58:0/2295220347 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc12c00a650 con 0x7fc13c15d870 2026-02-23T06:21:47.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.282+0000 7fc13a7fc640 1 --2- 10.20.193.58:0/2295220347 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc13c15d4a0 0x7fc13c13aff0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:47.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.283+0000 7fc13b7fe640 1 --2- 10.20.193.58:0/2295220347 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc13c15d870 0x7fc13c13b530 secure :-1 s=READY pgs=85 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc12c005820 tx=0x7fc12c0037a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:47.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.283+0000 7fc113fff640 1 -- 10.20.193.58:0/2295220347 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc12c003e80 con 0x7fc13c15d870 2026-02-23T06:21:47.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.283+0000 7fc113fff640 1 -- 10.20.193.58:0/2295220347 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc12c039560 con 0x7fc13c15d870 2026-02-23T06:21:47.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.283+0000 7fc113fff640 1 -- 10.20.193.58:0/2295220347 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc12c0398f0 con 0x7fc13c15d870 2026-02-23T06:21:47.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.283+0000 7fc13bfff640 1 -- 10.20.193.58:0/2295220347 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc13c14a1a0 con 0x7fc13c15d870 2026-02-23T06:21:47.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.283+0000 7fc13bfff640 1 -- 10.20.193.58:0/2295220347 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc13c14a9a0 con 0x7fc13c15d870 2026-02-23T06:21:47.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.283+0000 7fc13bfff640 1 -- 10.20.193.58:0/2295220347 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc13c163bb0 con 0x7fc13c15d870 2026-02-23T06:21:47.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.285+0000 7fc113fff640 1 -- 10.20.193.58:0/2295220347 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fc12c039a50 con 0x7fc13c15d870 2026-02-23T06:21:47.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.285+0000 7fc113fff640 1 --2- 10.20.193.58:0/2295220347 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc10c07a6c0 0x7fc10c09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:47.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.285+0000 7fc113fff640 1 -- 10.20.193.58:0/2295220347 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7fc12c0c3e90 con 0x7fc13c15d870 2026-02-23T06:21:47.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.286+0000 7fc13affd640 1 --2- 10.20.193.58:0/2295220347 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc10c07a6c0 0x7fc10c09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:47.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.286+0000 7fc13affd640 1 --2- 10.20.193.58:0/2295220347 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc10c07a6c0 0x7fc10c09ab70 secure :-1 s=READY pgs=116 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc130009550 tx=0x7fc130005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:47.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.288+0000 7fc113fff640 1 -- 10.20.193.58:0/2295220347 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fc12c087090 con 0x7fc13c15d870 2026-02-23T06:21:47.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.446+0000 7fc13bfff640 1 -- 10.20.193.58:0/2295220347 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc13c05b490 con 0x7fc13c15d870 2026-02-23T06:21:47.441 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.446+0000 7fc113fff640 1 -- 10.20.193.58:0/2295220347 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1754 (secure 0 0 0) 0x7fc12c08a1b0 con 0x7fc13c15d870 2026-02-23T06:21:47.441 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":45,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:21:47.443 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.447+0000 7fc13bfff640 1 -- 10.20.193.58:0/2295220347 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc10c07a6c0 msgr2=0x7fc10c09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:47.443 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.447+0000 7fc13bfff640 1 --2- 10.20.193.58:0/2295220347 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc10c07a6c0 0x7fc10c09ab70 secure :-1 s=READY pgs=116 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc130009550 tx=0x7fc130005f90 comp rx=0 tx=0).stop 2026-02-23T06:21:47.443 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.447+0000 7fc13bfff640 1 -- 10.20.193.58:0/2295220347 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc13c15d870 msgr2=0x7fc13c13b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:47.443 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.447+0000 7fc13bfff640 1 --2- 10.20.193.58:0/2295220347 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc13c15d870 0x7fc13c13b530 secure :-1 s=READY pgs=85 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc12c005820 tx=0x7fc12c0037a0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.443 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.448+0000 7fc13bfff640 1 -- 10.20.193.58:0/2295220347 shutdown_connections 2026-02-23T06:21:47.443 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.448+0000 7fc13bfff640 1 --2- 10.20.193.58:0/2295220347 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc10c07a6c0 0x7fc10c09ab70 unknown :-1 s=CLOSED pgs=116 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.443 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.448+0000 7fc13bfff640 1 --2- 10.20.193.58:0/2295220347 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc13c15d870 0x7fc13c13b530 unknown :-1 s=CLOSED pgs=85 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.443 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.448+0000 7fc13bfff640 1 --2- 10.20.193.58:0/2295220347 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc13c15d4a0 0x7fc13c13aff0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.443 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.448+0000 7fc13bfff640 1 --2- 10.20.193.58:0/2295220347 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc13c0b6690 0x7fc13c14d100 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.443 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.448+0000 7fc13bfff640 1 -- 10.20.193.58:0/2295220347 >> 10.20.193.58:0/2295220347 conn(0x7fc13c0b3c20 msgr2=0x7fc13c15bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:47.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.448+0000 7fc13bfff640 1 -- 10.20.193.58:0/2295220347 shutdown_connections 2026-02-23T06:21:47.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.448+0000 7fc13bfff640 1 -- 10.20.193.58:0/2295220347 wait complete. 2026-02-23T06:21:47.454 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:21:47.455 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:21:47.455 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:21:47.455 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:21:47.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.581+0000 7f0f6df75640 1 -- 10.20.193.58:0/676267223 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6815d4a0 msgr2=0x7f0f680affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:47.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.581+0000 7f0f6df75640 1 --2- 10.20.193.58:0/676267223 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6815d4a0 0x7f0f680affb0 secure :-1 s=READY pgs=182 gs=2 cs=0 l=1 c_cookie=1283624049975030825 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f68059740 tx=0x7f0f5802f260 comp rx=0 tx=0).stop 2026-02-23T06:21:47.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.582+0000 7f0f6df75640 1 -- 10.20.193.58:0/676267223 shutdown_connections 2026-02-23T06:21:47.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.582+0000 7f0f6df75640 1 --2- 10.20.193.58:0/676267223 >> v2:10.20.193.93:3300/0 conn(0x7f0f6815d870 0x7f0f680587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.582+0000 7f0f6df75640 1 --2- 10.20.193.58:0/676267223 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6815d4a0 0x7f0f680affb0 unknown :-1 s=CLOSED pgs=182 gs=2 cs=0 l=1 c_cookie=1283624049975030825 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.582+0000 7f0f6df75640 1 -- 10.20.193.58:0/676267223 >> 10.20.193.58:0/676267223 conn(0x7f0f680b3c20 msgr2=0x7f0f680b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:47.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.582+0000 7f0f6df75640 1 -- 10.20.193.58:0/676267223 shutdown_connections 2026-02-23T06:21:47.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.582+0000 7f0f6df75640 1 -- 10.20.193.58:0/676267223 wait complete. 2026-02-23T06:21:47.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.583+0000 7f0f6df75640 1 Processor -- start 2026-02-23T06:21:47.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.583+0000 7f0f6df75640 1 -- start start 2026-02-23T06:21:47.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.584+0000 7f0f6df75640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0f680b6690 0x7f0f68124b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:47.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.584+0000 7f0f6df75640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6815d4a0 0x7f0f6813da50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:47.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.584+0000 7f0f6df75640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0f6815d870 0x7f0f68150d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:47.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.584+0000 7f0f6df75640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f0f681201b0 con 0x7f0f6815d4a0 2026-02-23T06:21:47.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.584+0000 7f0f6df75640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f0f68057050 con 0x7f0f6815d870 2026-02-23T06:21:47.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.584+0000 7f0f6df75640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f0f6815bd90 con 0x7f0f680b6690 2026-02-23T06:21:47.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.584+0000 7f0f6cf73640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0f680b6690 0x7f0f68124b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:47.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.584+0000 7f0f6cf73640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0f680b6690 0x7f0f68124b70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:59232/0 (socket says 10.20.193.58:59232) 2026-02-23T06:21:47.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.584+0000 7f0f6cf73640 1 -- 10.20.193.58:0/1325732178 learned_addr learned my addr 10.20.193.58:0/1325732178 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:47.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.584+0000 7f0f5ffff640 1 --2- 10.20.193.58:0/1325732178 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6815d4a0 0x7f0f6813da50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:47.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.584+0000 7f0f6d774640 1 --2- 10.20.193.58:0/1325732178 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0f6815d870 0x7f0f68150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:47.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.584+0000 7f0f5ffff640 1 -- 10.20.193.58:0/1325732178 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0f680b6690 msgr2=0x7f0f68124b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:47.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.584+0000 7f0f5ffff640 1 --2- 10.20.193.58:0/1325732178 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0f680b6690 0x7f0f68124b70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.584+0000 7f0f5ffff640 1 -- 10.20.193.58:0/1325732178 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0f6815d870 msgr2=0x7f0f68150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:47.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.584+0000 7f0f5ffff640 1 --2- 10.20.193.58:0/1325732178 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0f6815d870 0x7f0f68150d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.584+0000 7f0f5ffff640 1 -- 10.20.193.58:0/1325732178 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f58009570 con 0x7f0f6815d4a0 2026-02-23T06:21:47.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.584+0000 7f0f5ffff640 1 --2- 10.20.193.58:0/1325732178 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6815d4a0 0x7f0f6813da50 secure :-1 s=READY pgs=183 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f5000e9c0 tx=0x7f0f5000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:47.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.584+0000 7f0f5d7fa640 1 -- 10.20.193.58:0/1325732178 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0f5000cc50 con 0x7f0f6815d4a0 2026-02-23T06:21:47.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.585+0000 7f0f6df75640 1 -- 10.20.193.58:0/1325732178 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f681203e0 con 0x7f0f6815d4a0 2026-02-23T06:21:47.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.585+0000 7f0f5d7fa640 1 -- 10.20.193.58:0/1325732178 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f5000cdb0 con 0x7f0f6815d4a0 2026-02-23T06:21:47.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.585+0000 7f0f5d7fa640 1 -- 10.20.193.58:0/1325732178 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0f50004ad0 con 0x7f0f6815d4a0 2026-02-23T06:21:47.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.585+0000 7f0f6df75640 1 -- 10.20.193.58:0/1325732178 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f68122490 con 0x7f0f6815d4a0 2026-02-23T06:21:47.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.585+0000 7f0f6df75640 1 --2- 10.20.193.58:0/1325732178 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6813c990 0x7f0f681226b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:47.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.585+0000 7f0f6df75640 1 -- 10.20.193.58:0/1325732178 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f0f680b6330 con 0x7f0f6813c990 2026-02-23T06:21:47.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.585+0000 7f0f6cf73640 1 --2- 10.20.193.58:0/1325732178 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6813c990 0x7f0f681226b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:47.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.586+0000 7f0f6cf73640 1 -- 10.20.193.58:0/1325732178 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0f680b5e10 con 0x7f0f6813c990 2026-02-23T06:21:47.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.586+0000 7f0f6cf73640 1 --2- 10.20.193.58:0/1325732178 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6813c990 0x7f0f681226b0 secure :-1 s=READY pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f580098a0 tx=0x7f0f580028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:47.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.586+0000 7f0f5d7fa640 1 -- 10.20.193.58:0/1325732178 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0f5803d050 con 0x7f0f6813c990 2026-02-23T06:21:47.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.586+0000 7f0f5d7fa640 1 -- 10.20.193.58:0/1325732178 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f0f5803e040 con 0x7f0f6813c990 2026-02-23T06:21:47.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.586+0000 7f0f5d7fa640 1 -- 10.20.193.58:0/1325732178 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6813c990 msgr2=0x7f0f681226b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:47.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.586+0000 7f0f5d7fa640 1 --2- 10.20.193.58:0/1325732178 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6813c990 0x7f0f681226b0 secure :-1 s=READY pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f580098a0 tx=0x7f0f580028d0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.586+0000 7f0f5d7fa640 1 -- 10.20.193.58:0/1325732178 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6813c990 msgr2=0x7f0f681226b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:21:47.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.586+0000 7f0f5d7fa640 1 --2- 10.20.193.58:0/1325732178 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6813c990 0x7f0f681226b0 unknown :-1 s=CLOSED pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.586+0000 7f0f5d7fa640 1 -- 10.20.193.58:0/1325732178 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f0f5001f060 con 0x7f0f6815d4a0 2026-02-23T06:21:47.582 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.587+0000 7f0f5d7fa640 1 --2- 10.20.193.58:0/1325732178 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0f3807a3c0 0x7f0f3809a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:47.582 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.587+0000 7f0f5d7fa640 1 -- 10.20.193.58:0/1325732178 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f0f50014070 con 0x7f0f6815d4a0 2026-02-23T06:21:47.582 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.588+0000 7f0f6cf73640 1 --2- 10.20.193.58:0/1325732178 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0f3807a3c0 0x7f0f3809a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:47.583 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.588+0000 7f0f6cf73640 1 --2- 10.20.193.58:0/1325732178 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0f3807a3c0 0x7f0f3809a870 secure :-1 s=READY pgs=117 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f5802f7e0 tx=0x7f0f58031030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:47.584 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.590+0000 7f0f6df75640 1 --2- 10.20.193.58:0/1325732178 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6813df90 0x7f0f68151240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:47.584 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.590+0000 7f0f6df75640 1 -- 10.20.193.58:0/1325732178 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f0f68056c10 con 0x7f0f6813df90 2026-02-23T06:21:47.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.590+0000 7f0f6d774640 1 --2- 10.20.193.58:0/1325732178 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6813df90 0x7f0f68151240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:47.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.591+0000 7f0f6d774640 1 -- 10.20.193.58:0/1325732178 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0f68122bf0 con 0x7f0f6813df90 2026-02-23T06:21:47.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.591+0000 7f0f6d774640 1 --2- 10.20.193.58:0/1325732178 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6813df90 0x7f0f68151240 secure :-1 s=READY pgs=185 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f640038b0 tx=0x7f0f6400ff10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:47.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.591+0000 7f0f5d7fa640 1 -- 10.20.193.58:0/1325732178 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0f6401a070 con 0x7f0f6813df90 2026-02-23T06:21:47.586 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:21:47.586 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:21:47.586 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:21:47.586 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:21:47.586 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 4, 2026-02-23T06:21:47.586 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 45601, 2026-02-23T06:21:47.586 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:21:47.586 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:21:47.586 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:21:47.586 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:21:47.586 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:21:47.586 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 45, 2026-02-23T06:21:47.586 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:21:47.586 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:21:47.586 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:21:47.586 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:21:47.586 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:21:47.587 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:21:47.587 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:21:47.587 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:21:47.587 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:21:47.587 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:21:47.587 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:21:47.587 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:21:47.587 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:21:47.587 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:21:47.587 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:21:47.587 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:21:47.587 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:21:47.587 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:21:47.587 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:21:47.587 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:21:47.587 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:21:47.587 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:21:47.587 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:21:47.587 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:21:47.587 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:21:47.587 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:21:47.588 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:21:47.588 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:21:47.588 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:21:47.588 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:21:47.588 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:21:47.588 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:21:47.588 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:21:47.588 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.588 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:21:47.588 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:21:47.588 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:21:47.588 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:21:47.588 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:21:47.588 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:21:47.588 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:21:47.588 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:21:47.588 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:21:47.588 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:21:47.588 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:21:47.588 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:21:47.588 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:21:47.588 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:21:47.589 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:21:47.589 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:21:47.589 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:21:47.589 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:21:47.589 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:21:47.589 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:21:47.589 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:21:47.589 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:21:47.589 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:21:47.589 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:21:47.589 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:21:47.589 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:21:47.589 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:21:47.589 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:21:47.589 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:21:47.589 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:21:47.589 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:21:47.589 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:21:47.589 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.589 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:21:47.589 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.589 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:21:47.589 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:21:47.590 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:21:47.590 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:21:47.590 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.590 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:21:47.590 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:21:47.590 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:21:47.590 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.590 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.590 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:21:47.590 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:21:47.590 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:21:47.590 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:21:47.590 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:21:47.590 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.590 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:21:47.590 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:21:47.590 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:21:47.590 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:21:47.590 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:21:47.590 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:21:47.590 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.590 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.591 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:21:47.591 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:21:47.591 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:21:47.591 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:21:47.591 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.591 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:21:47.591 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:21:47.591 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:21:47.591 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.591 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.591 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:21:47.591 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:21:47.591 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:21:47.591 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:21:47.591 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:21:47.591 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.591 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:21:47.591 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:21:47.591 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:21:47.591 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:21:47.591 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:21:47.591 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:21:47.591 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.592 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.592 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:21:47.592 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:21:47.592 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:21:47.592 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:21:47.592 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.592 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:21:47.592 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:21:47.592 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:21:47.592 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.592 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.592 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:21:47.592 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:21:47.592 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:21:47.592 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:21:47.592 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:21:47.592 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.592 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:21:47.592 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:21:47.592 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:21:47.592 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:21:47.593 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:21:47.593 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:21:47.593 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:21:47.593 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:21:47.593 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.593 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:21:47.593 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:21:47.593 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.593 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:21:47.593 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:21:47.593 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:21:47.593 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:21:47.593 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:21:47.593 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:21:47.593 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.593 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:21:47.593 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:21:47.593 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:21:47.593 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:21:47.593 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:21:47.593 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:21:47.593 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.593 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:21:47.594 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:21:47.594 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:21:47.594 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:21:47.594 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:21:47.594 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.594 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:21:47.594 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:21:47.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.591+0000 7f0f5d7fa640 1 -- 10.20.193.58:0/1325732178 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5079 (secure 0 0 0) 0x7f0f64007b90 con 0x7f0f6813df90 2026-02-23T06:21:47.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.591+0000 7f0f5d7fa640 1 -- 10.20.193.58:0/1325732178 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6813df90 msgr2=0x7f0f68151240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:47.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.591+0000 7f0f5d7fa640 1 --2- 10.20.193.58:0/1325732178 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6813df90 0x7f0f68151240 secure :-1 s=READY pgs=185 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f640038b0 tx=0x7f0f6400ff10 comp rx=0 tx=0).stop 2026-02-23T06:21:47.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.591+0000 7f0f5d7fa640 1 -- 10.20.193.58:0/1325732178 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6813df90 msgr2=0x7f0f68151240 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:21:47.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.591+0000 7f0f5d7fa640 1 --2- 10.20.193.58:0/1325732178 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6813df90 0x7f0f68151240 secure :-1 s=CLOSED pgs=185 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f640038b0 tx=0x7f0f6400ff10 comp rx=0 tx=0).stop 2026-02-23T06:21:47.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.591+0000 7f0f6df75640 1 -- 10.20.193.58:0/1325732178 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0f3807a3c0 msgr2=0x7f0f3809a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:47.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.591+0000 7f0f6df75640 1 --2- 10.20.193.58:0/1325732178 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0f3807a3c0 0x7f0f3809a870 secure :-1 s=READY pgs=117 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f5802f7e0 tx=0x7f0f58031030 comp rx=0 tx=0).stop 2026-02-23T06:21:47.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.591+0000 7f0f6df75640 1 -- 10.20.193.58:0/1325732178 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6815d4a0 msgr2=0x7f0f6813da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:47.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.591+0000 7f0f6df75640 1 --2- 10.20.193.58:0/1325732178 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0f6815d4a0 0x7f0f6813da50 secure :-1 s=READY pgs=183 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f5000e9c0 tx=0x7f0f5000ee90 comp rx=0 tx=0).stop 2026-02-23T06:21:47.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.591+0000 7f0f6d774640 1 -- 10.20.193.58:0/1325732178 reap_dead start 2026-02-23T06:21:47.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.592+0000 7f0f6df75640 1 -- 10.20.193.58:0/1325732178 shutdown_connections 2026-02-23T06:21:47.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.592+0000 7f0f6df75640 1 -- 10.20.193.58:0/1325732178 >> 10.20.193.58:0/1325732178 conn(0x7f0f680b3c20 msgr2=0x7f0f680b1120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:47.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.592+0000 7f0f6df75640 1 -- 10.20.193.58:0/1325732178 shutdown_connections 2026-02-23T06:21:47.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.592+0000 7f0f6df75640 1 -- 10.20.193.58:0/1325732178 wait complete. 2026-02-23T06:21:47.596 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:21:47.596 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:21:47.596 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:21:47.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.723+0000 7f9b1f407640 1 -- 10.20.193.58:0/3001585477 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b18163820 msgr2=0x7f9b1815d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:47.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.723+0000 7f9b1f407640 1 --2- 10.20.193.58:0/3001585477 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b18163820 0x7f9b1815d380 secure :-1 s=READY pgs=176 gs=2 cs=0 l=1 c_cookie=11334955355927784369 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b14005820 tx=0x7f9b140302b0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.723+0000 7f9b1f407640 1 -- 10.20.193.58:0/3001585477 shutdown_connections 2026-02-23T06:21:47.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.723+0000 7f9b1f407640 1 --2- 10.20.193.58:0/3001585477 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b18163820 0x7f9b1815d380 unknown :-1 s=CLOSED pgs=176 gs=2 cs=0 l=1 c_cookie=11334955355927784369 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.723+0000 7f9b1f407640 1 --2- 10.20.193.58:0/3001585477 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9b180b1170 0x7f9b1815ce40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.723+0000 7f9b1f407640 1 -- 10.20.193.58:0/3001585477 >> 10.20.193.58:0/3001585477 conn(0x7f9b18058e50 msgr2=0x7f9b18059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:47.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.723+0000 7f9b1f407640 1 -- 10.20.193.58:0/3001585477 shutdown_connections 2026-02-23T06:21:47.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.723+0000 7f9b1f407640 1 -- 10.20.193.58:0/3001585477 wait complete. 2026-02-23T06:21:47.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.724+0000 7f9b1f407640 1 Processor -- start 2026-02-23T06:21:47.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.724+0000 7f9b1f407640 1 -- start start 2026-02-23T06:21:47.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.725+0000 7f9b1f407640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9b180b1170 0x7f9b181162c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:47.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.725+0000 7f9b1f407640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b180b1540 0x7f9b18118e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:47.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.725+0000 7f9b1f407640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b18163820 0x7f9b18134ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:47.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.725+0000 7f9b1f407640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f9b18116d10 con 0x7f9b18163820 2026-02-23T06:21:47.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.725+0000 7f9b1f407640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9b181178a0 con 0x7f9b180b1540 2026-02-23T06:21:47.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.725+0000 7f9b1f407640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f9b18117b40 con 0x7f9b180b1170 2026-02-23T06:21:47.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.725+0000 7f9b1d17c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9b180b1170 0x7f9b181162c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:47.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.725+0000 7f9b1d97d640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b18163820 0x7f9b18134ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:47.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.725+0000 7f9b1d17c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9b180b1170 0x7f9b181162c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:59258/0 (socket says 10.20.193.58:59258) 2026-02-23T06:21:47.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.725+0000 7f9b1d17c640 1 -- 10.20.193.58:0/4007296811 learned_addr learned my addr 10.20.193.58:0/4007296811 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:47.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.725+0000 7f9b1c97b640 1 --2- 10.20.193.58:0/4007296811 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b180b1540 0x7f9b18118e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:47.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.725+0000 7f9b1d97d640 1 -- 10.20.193.58:0/4007296811 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9b180b1170 msgr2=0x7f9b181162c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:47.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.725+0000 7f9b1d97d640 1 --2- 10.20.193.58:0/4007296811 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9b180b1170 0x7f9b181162c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.725+0000 7f9b1d97d640 1 -- 10.20.193.58:0/4007296811 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b180b1540 msgr2=0x7f9b18118e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:47.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.725+0000 7f9b1d97d640 1 --2- 10.20.193.58:0/4007296811 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b180b1540 0x7f9b18118e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.725+0000 7f9b1d97d640 1 -- 10.20.193.58:0/4007296811 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b1400a590 con 0x7f9b18163820 2026-02-23T06:21:47.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.726+0000 7f9b1d97d640 1 --2- 10.20.193.58:0/4007296811 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b18163820 0x7f9b18134ed0 secure :-1 s=READY pgs=187 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b180b5870 tx=0x7f9b14003d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:47.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.726+0000 7f9b05ffb640 1 -- 10.20.193.58:0/4007296811 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9b1403e070 con 0x7f9b18163820 2026-02-23T06:21:47.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.726+0000 7f9b05ffb640 1 -- 10.20.193.58:0/4007296811 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b140398a0 con 0x7f9b18163820 2026-02-23T06:21:47.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.726+0000 7f9b05ffb640 1 -- 10.20.193.58:0/4007296811 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9b14039cd0 con 0x7f9b18163820 2026-02-23T06:21:47.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.726+0000 7f9b1f407640 1 -- 10.20.193.58:0/4007296811 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b1811ae50 con 0x7f9b18163820 2026-02-23T06:21:47.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.726+0000 7f9b1f407640 1 -- 10.20.193.58:0/4007296811 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b18116f60 con 0x7f9b18163820 2026-02-23T06:21:47.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.726+0000 7f9b1f407640 1 --2- 10.20.193.58:0/4007296811 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b1811a890 0x7f9b18135410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:47.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.726+0000 7f9b1f407640 1 -- 10.20.193.58:0/4007296811 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9b18119d30 con 0x7f9b1811a890 2026-02-23T06:21:47.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.726+0000 7f9b1d17c640 1 --2- 10.20.193.58:0/4007296811 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b1811a890 0x7f9b18135410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:47.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.727+0000 7f9b1d17c640 1 -- 10.20.193.58:0/4007296811 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b18166fe0 con 0x7f9b1811a890 2026-02-23T06:21:47.725 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.727+0000 7f9b1d17c640 1 --2- 10.20.193.58:0/4007296811 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b1811a890 0x7f9b18135410 secure :-1 s=READY pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b08009480 tx=0x7f9b08002d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:47.725 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.727+0000 7f9b05ffb640 1 -- 10.20.193.58:0/4007296811 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9b08009e20 con 0x7f9b1811a890 2026-02-23T06:21:47.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.728+0000 7f9b05ffb640 1 -- 10.20.193.58:0/4007296811 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f9b08011ca0 con 0x7f9b1811a890 2026-02-23T06:21:47.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.728+0000 7f9b05ffb640 1 -- 10.20.193.58:0/4007296811 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b1811a890 msgr2=0x7f9b18135410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:47.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.728+0000 7f9b05ffb640 1 --2- 10.20.193.58:0/4007296811 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b1811a890 0x7f9b18135410 secure :-1 s=READY pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b08009480 tx=0x7f9b08002d70 comp rx=0 tx=0).stop 2026-02-23T06:21:47.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.728+0000 7f9b05ffb640 1 -- 10.20.193.58:0/4007296811 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b1811a890 msgr2=0x7f9b18135410 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:21:47.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.728+0000 7f9b05ffb640 1 --2- 10.20.193.58:0/4007296811 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b1811a890 0x7f9b18135410 unknown :-1 s=CLOSED pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.728+0000 7f9b05ffb640 1 -- 10.20.193.58:0/4007296811 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f9b14049020 con 0x7f9b18163820 2026-02-23T06:21:47.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.729+0000 7f9b05ffb640 1 --2- 10.20.193.58:0/4007296811 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9ae807a3c0 0x7f9ae809a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:47.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.729+0000 7f9b05ffb640 1 -- 10.20.193.58:0/4007296811 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f9b140c30b0 con 0x7f9b18163820 2026-02-23T06:21:47.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.729+0000 7f9b1d17c640 1 --2- 10.20.193.58:0/4007296811 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9ae807a3c0 0x7f9ae809a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:47.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.730+0000 7f9b1d17c640 1 --2- 10.20.193.58:0/4007296811 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9ae807a3c0 0x7f9ae809a870 secure :-1 s=READY pgs=118 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b08009480 tx=0x7f9b0800e000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:47.728 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.731+0000 7f9b1f407640 1 --2- 10.20.193.58:0/4007296811 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b1811a2b0 0x7f9b18135950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:47.728 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.731+0000 7f9b1f407640 1 -- 10.20.193.58:0/4007296811 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9b18166d00 con 0x7f9b1811a2b0 2026-02-23T06:21:47.728 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.731+0000 7f9b1c97b640 1 --2- 10.20.193.58:0/4007296811 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b1811a2b0 0x7f9b18135950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:47.728 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.732+0000 7f9b1c97b640 1 -- 10.20.193.58:0/4007296811 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9b181672c0 con 0x7f9b1811a2b0 2026-02-23T06:21:47.728 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.732+0000 7f9b1c97b640 1 --2- 10.20.193.58:0/4007296811 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b1811a2b0 0x7f9b18135950 secure :-1 s=READY pgs=178 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b181570d0 tx=0x7f9b0c00eba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:47.728 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.732+0000 7f9b05ffb640 1 -- 10.20.193.58:0/4007296811 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9b0c019070 con 0x7f9b1811a2b0 2026-02-23T06:21:47.728 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.732+0000 7f9b05ffb640 1 -- 10.20.193.58:0/4007296811 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5411 (secure 0 0 0) 0x7f9b0c00c830 con 0x7f9b1811a2b0 2026-02-23T06:21:47.728 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.732+0000 7f9b05ffb640 1 -- 10.20.193.58:0/4007296811 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b1811a2b0 msgr2=0x7f9b18135950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:47.728 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.732+0000 7f9b05ffb640 1 --2- 10.20.193.58:0/4007296811 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b1811a2b0 0x7f9b18135950 secure :-1 s=READY pgs=178 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b181570d0 tx=0x7f9b0c00eba0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.732+0000 7f9b05ffb640 1 -- 10.20.193.58:0/4007296811 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b1811a2b0 msgr2=0x7f9b18135950 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:21:47.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.732+0000 7f9b05ffb640 1 --2- 10.20.193.58:0/4007296811 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b1811a2b0 0x7f9b18135950 unknown :-1 s=CLOSED pgs=178 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.729 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:21:47.729 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:21:47.729 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:21:47.729 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:21:47.729 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 4, 2026-02-23T06:21:47.730 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 45779, 2026-02-23T06:21:47.730 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:21:47.730 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:21:47.730 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:21:47.730 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:21:47.730 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:21:47.730 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 45, 2026-02-23T06:21:47.730 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:21:47.730 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:21:47.730 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:21:47.730 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:21:47.730 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:21:47.731 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:21:47.731 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:21:47.731 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:21:47.731 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:21:47.731 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:21:47.731 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:21:47.731 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:21:47.731 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:21:47.731 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:21:47.731 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:21:47.731 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:21:47.731 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:21:47.732 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:21:47.732 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:21:47.732 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:21:47.732 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:21:47.732 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:21:47.732 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:21:47.732 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:21:47.732 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:21:47.732 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:21:47.732 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:21:47.732 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:21:47.732 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:21:47.733 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:21:47.733 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:21:47.733 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:21:47.733 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:21:47.733 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.733 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:21:47.733 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:21:47.733 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:21:47.733 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:21:47.733 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:21:47.733 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:21:47.733 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:21:47.734 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:21:47.734 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:21:47.734 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:21:47.734 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:21:47.734 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:21:47.734 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:21:47.734 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:21:47.734 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:21:47.734 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:21:47.734 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:21:47.734 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:21:47.734 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:21:47.735 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:21:47.735 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:21:47.735 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:21:47.735 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:21:47.735 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:21:47.735 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:21:47.735 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:21:47.735 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:21:47.735 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:21:47.735 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:21:47.735 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:21:47.735 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:21:47.735 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:21:47.736 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.736 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:21:47.736 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.736 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:21:47.736 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:21:47.736 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:21:47.736 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:21:47.736 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.736 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:21:47.736 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:21:47.736 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:21:47.736 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.737 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.737 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:21:47.737 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:21:47.737 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:21:47.737 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:21:47.737 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:21:47.737 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.737 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:21:47.737 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:21:47.737 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:21:47.737 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:21:47.737 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:21:47.738 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:21:47.738 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.738 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.738 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:21:47.738 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:21:47.738 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:21:47.738 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:21:47.738 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.738 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:21:47.738 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:21:47.738 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:21:47.738 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.739 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.739 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:21:47.739 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:21:47.739 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:21:47.739 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:21:47.739 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:21:47.739 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.739 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:21:47.739 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:21:47.739 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:21:47.739 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:21:47.739 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:21:47.739 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:21:47.740 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.740 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.740 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:21:47.740 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:21:47.740 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:21:47.740 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:21:47.740 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.740 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:21:47.740 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:21:47.740 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:21:47.740 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.740 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.741 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:21:47.741 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:21:47.741 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:21:47.741 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:21:47.741 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:21:47.741 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.741 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:21:47.741 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:21:47.741 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:21:47.741 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:21:47.741 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:21:47.741 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:21:47.741 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:21:47.742 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:21:47.742 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.742 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:21:47.742 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:21:47.742 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.742 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:21:47.742 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:21:47.742 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:21:47.742 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:21:47.742 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:21:47.742 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:21:47.742 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.742 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:21:47.743 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:21:47.743 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:21:47.743 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:21:47.743 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:21:47.743 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:21:47.743 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.743 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:21:47.743 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:21:47.743 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:21:47.743 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:21:47.743 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:21:47.743 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:21:47.743 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.744 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:21:47.744 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:21:47.744 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:21:47.744 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:21:47.744 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:21:47.744 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:21:47.744 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.744 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:21:47.744 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:21:47.744 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:21:47.744 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:21:47.744 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:21:47.745 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.745 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:21:47.745 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:21:47.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.733+0000 7f9b1f407640 1 -- 10.20.193.58:0/4007296811 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9ae807a3c0 msgr2=0x7f9ae809a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:47.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.733+0000 7f9b1f407640 1 --2- 10.20.193.58:0/4007296811 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9ae807a3c0 0x7f9ae809a870 secure :-1 s=READY pgs=118 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b08009480 tx=0x7f9b0800e000 comp rx=0 tx=0).stop 2026-02-23T06:21:47.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.733+0000 7f9b1f407640 1 -- 10.20.193.58:0/4007296811 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b18163820 msgr2=0x7f9b18134ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:47.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.733+0000 7f9b1f407640 1 --2- 10.20.193.58:0/4007296811 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b18163820 0x7f9b18134ed0 secure :-1 s=READY pgs=187 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b180b5870 tx=0x7f9b14003d20 comp rx=0 tx=0).stop 2026-02-23T06:21:47.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.733+0000 7f9b1d97d640 1 -- 10.20.193.58:0/4007296811 reap_dead start 2026-02-23T06:21:47.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.733+0000 7f9b1d97d640 1 -- 10.20.193.58:0/4007296811 reap_dead start 2026-02-23T06:21:47.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.733+0000 7f9b1f407640 1 -- 10.20.193.58:0/4007296811 shutdown_connections 2026-02-23T06:21:47.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.733+0000 7f9b1f407640 1 -- 10.20.193.58:0/4007296811 >> 10.20.193.58:0/4007296811 conn(0x7f9b18058e50 msgr2=0x7f9b18059220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:47.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.733+0000 7f9b1f407640 1 -- 10.20.193.58:0/4007296811 shutdown_connections 2026-02-23T06:21:47.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.733+0000 7f9b1f407640 1 -- 10.20.193.58:0/4007296811 wait complete. 2026-02-23T06:21:47.747 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:21:47.748 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:21:47.748 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:21:47.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.875+0000 7f4101683640 1 -- 10.20.193.58:0/3833700626 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f40fc162ca0 msgr2=0x7f40fc056fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:47.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.875+0000 7f4101683640 1 --2- 10.20.193.58:0/3833700626 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f40fc162ca0 0x7f40fc056fc0 secure :-1 s=READY pgs=189 gs=2 cs=0 l=1 c_cookie=11966512780634034307 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40fc059b80 tx=0x7f40f0030270 comp rx=0 tx=0).stop 2026-02-23T06:21:47.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.875+0000 7f4101683640 1 -- 10.20.193.58:0/3833700626 shutdown_connections 2026-02-23T06:21:47.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.875+0000 7f4101683640 1 --2- 10.20.193.58:0/3833700626 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f40fc162ca0 0x7f40fc056fc0 unknown :-1 s=CLOSED pgs=189 gs=2 cs=0 l=1 c_cookie=11966512780634034307 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.875+0000 7f4101683640 1 --2- 10.20.193.58:0/3833700626 >> v2:10.20.193.93:3300/0 conn(0x7f40fc15c4b0 0x7f40fc058200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.875+0000 7f4101683640 1 -- 10.20.193.58:0/3833700626 >> 10.20.193.58:0/3833700626 conn(0x7f40fc0b3c20 msgr2=0x7f40fc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:47.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.875+0000 7f4101683640 1 -- 10.20.193.58:0/3833700626 shutdown_connections 2026-02-23T06:21:47.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.875+0000 7f4101683640 1 -- 10.20.193.58:0/3833700626 wait complete. 2026-02-23T06:21:47.873 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.876+0000 7f4101683640 1 Processor -- start 2026-02-23T06:21:47.873 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.876+0000 7f4101683640 1 -- start start 2026-02-23T06:21:47.873 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.877+0000 7f4101683640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f40fc056960 0x7f40fc13cea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:47.874 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.877+0000 7f4101683640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f40fc15c4b0 0x7f40fc15b550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:47.874 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.877+0000 7f4101683640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f40fc162ca0 0x7f40fc13ae60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:47.874 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.877+0000 7f4101683640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f40fc13c8a0 con 0x7f40fc15c4b0 2026-02-23T06:21:47.874 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.877+0000 7f4101683640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f40fc13d3e0 con 0x7f40fc162ca0 2026-02-23T06:21:47.874 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.877+0000 7f4101683640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f40fc0b5bf0 con 0x7f40fc056960 2026-02-23T06:21:47.874 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.877+0000 7f40fbfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f40fc056960 0x7f40fc13cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:47.874 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.877+0000 7f40fb7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f40fc15c4b0 0x7f40fc15b550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:47.874 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.877+0000 7f4100e82640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f40fc162ca0 0x7f40fc13ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:47.874 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.877+0000 7f40fbfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f40fc056960 0x7f40fc13cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:59268/0 (socket says 10.20.193.58:59268) 2026-02-23T06:21:47.874 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.877+0000 7f40fbfff640 1 -- 10.20.193.58:0/3523519687 learned_addr learned my addr 10.20.193.58:0/3523519687 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:47.874 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.877+0000 7f40fb7fe640 1 -- 10.20.193.58:0/3523519687 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f40fc056960 msgr2=0x7f40fc13cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:47.875 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.877+0000 7f40fb7fe640 1 --2- 10.20.193.58:0/3523519687 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f40fc056960 0x7f40fc13cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.875 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.877+0000 7f40fb7fe640 1 -- 10.20.193.58:0/3523519687 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f40fc162ca0 msgr2=0x7f40fc13ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:47.875 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.877+0000 7f40fb7fe640 1 --2- 10.20.193.58:0/3523519687 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f40fc162ca0 0x7f40fc13ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.875 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.877+0000 7f40fb7fe640 1 -- 10.20.193.58:0/3523519687 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f000a590 con 0x7f40fc15c4b0 2026-02-23T06:21:47.875 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.877+0000 7f40fb7fe640 1 --2- 10.20.193.58:0/3523519687 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f40fc15c4b0 0x7f40fc15b550 secure :-1 s=READY pgs=190 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40ec0029a0 tx=0x7f40ec00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:47.875 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.877+0000 7f40f8ff9640 1 -- 10.20.193.58:0/3523519687 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40ec0117b0 con 0x7f40fc15c4b0 2026-02-23T06:21:47.875 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.877+0000 7f40f8ff9640 1 -- 10.20.193.58:0/3523519687 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40ec011a00 con 0x7f40fc15c4b0 2026-02-23T06:21:47.875 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.877+0000 7f40f8ff9640 1 -- 10.20.193.58:0/3523519687 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40ec011df0 con 0x7f40fc15c4b0 2026-02-23T06:21:47.875 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.877+0000 7f4101683640 1 -- 10.20.193.58:0/3523519687 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40fc15b070 con 0x7f40fc15c4b0 2026-02-23T06:21:47.875 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.878+0000 7f4101683640 1 -- 10.20.193.58:0/3523519687 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40fc13dc10 con 0x7f40fc15c4b0 2026-02-23T06:21:47.875 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.878+0000 7f4101683640 1 --2- 10.20.193.58:0/3523519687 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f40fc13df50 0x7f40fc158a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:47.875 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.878+0000 7f4101683640 1 -- 10.20.193.58:0/3523519687 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f40fc059690 con 0x7f40fc13df50 2026-02-23T06:21:47.876 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.878+0000 7f40fbfff640 1 --2- 10.20.193.58:0/3523519687 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f40fc13df50 0x7f40fc158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:47.876 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.879+0000 7f40fbfff640 1 -- 10.20.193.58:0/3523519687 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f40fc0593b0 con 0x7f40fc13df50 2026-02-23T06:21:47.877 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.879+0000 7f40f8ff9640 1 -- 10.20.193.58:0/3523519687 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f40ec01c460 con 0x7f40fc15c4b0 2026-02-23T06:21:47.877 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.879+0000 7f40fbfff640 1 --2- 10.20.193.58:0/3523519687 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f40fc13df50 0x7f40fc158a60 secure :-1 s=READY pgs=86 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40e80109e0 tx=0x7f40e8010eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:47.877 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.880+0000 7f40f8ff9640 1 --2- 10.20.193.58:0/3523519687 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f40cc07a6b0 0x7f40cc09ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:47.877 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.880+0000 7f40f8ff9640 1 -- 10.20.193.58:0/3523519687 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f40ec09d240 con 0x7f40fc15c4b0 2026-02-23T06:21:47.877 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.880+0000 7f40f8ff9640 1 -- 10.20.193.58:0/3523519687 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40e8004110 con 0x7f40fc13df50 2026-02-23T06:21:47.877 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.880+0000 7f4100e82640 1 --2- 10.20.193.58:0/3523519687 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f40cc07a6b0 0x7f40cc09ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:47.877 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.880+0000 7f40f8ff9640 1 -- 10.20.193.58:0/3523519687 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f40e8004270 con 0x7f40fc13df50 2026-02-23T06:21:47.878 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.880+0000 7f40f8ff9640 1 -- 10.20.193.58:0/3523519687 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f40fc13df50 msgr2=0x7f40fc158a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:47.878 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.880+0000 7f40f8ff9640 1 --2- 10.20.193.58:0/3523519687 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f40fc13df50 0x7f40fc158a60 secure :-1 s=READY pgs=86 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40e80109e0 tx=0x7f40e8010eb0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.878 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.880+0000 7f40f8ff9640 1 -- 10.20.193.58:0/3523519687 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f40fc13df50 msgr2=0x7f40fc158a60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:21:47.878 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.880+0000 7f40f8ff9640 1 --2- 10.20.193.58:0/3523519687 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f40fc13df50 0x7f40fc158a60 unknown :-1 s=CLOSED pgs=86 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.878 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.881+0000 7f4100e82640 1 --2- 10.20.193.58:0/3523519687 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f40cc07a6b0 0x7f40cc09ab60 secure :-1 s=READY pgs=119 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40f000a8c0 tx=0x7f40f003b040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:47.879 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.884+0000 7f4101683640 1 --2- 10.20.193.58:0/3523519687 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f40fc158fa0 0x7f40fc0b7660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:47.879 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.884+0000 7f4101683640 1 -- 10.20.193.58:0/3523519687 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f40fc13f040 con 0x7f40fc158fa0 2026-02-23T06:21:47.879 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.884+0000 7f40fbfff640 1 --2- 10.20.193.58:0/3523519687 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f40fc158fa0 0x7f40fc0b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:47.880 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.885+0000 7f40fbfff640 1 -- 10.20.193.58:0/3523519687 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f40fc15a830 con 0x7f40fc158fa0 2026-02-23T06:21:47.880 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.885+0000 7f40fbfff640 1 --2- 10.20.193.58:0/3523519687 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f40fc158fa0 0x7f40fc0b7660 secure :-1 s=READY pgs=87 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40e80109e0 tx=0x7f40e8004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:47.880 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.885+0000 7f40f8ff9640 1 -- 10.20.193.58:0/3523519687 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40e8011870 con 0x7f40fc158fa0 2026-02-23T06:21:47.880 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.885+0000 7f40f8ff9640 1 -- 10.20.193.58:0/3523519687 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5387 (secure 0 0 0) 0x7f40e80119d0 con 0x7f40fc158fa0 2026-02-23T06:21:47.880 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.885+0000 7f40f8ff9640 1 -- 10.20.193.58:0/3523519687 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f40fc158fa0 msgr2=0x7f40fc0b7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:47.880 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.885+0000 7f40f8ff9640 1 --2- 10.20.193.58:0/3523519687 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f40fc158fa0 0x7f40fc0b7660 secure :-1 s=READY pgs=87 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40e80109e0 tx=0x7f40e8004770 comp rx=0 tx=0).stop 2026-02-23T06:21:47.880 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.885+0000 7f40f8ff9640 1 -- 10.20.193.58:0/3523519687 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f40fc158fa0 msgr2=0x7f40fc0b7660 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:21:47.881 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.885+0000 7f40f8ff9640 1 --2- 10.20.193.58:0/3523519687 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f40fc158fa0 0x7f40fc0b7660 secure :-1 s=CLOSED pgs=87 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40e80109e0 tx=0x7f40e8004770 comp rx=0 tx=0).stop 2026-02-23T06:21:47.881 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:21:47.881 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:21:47.881 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:21:47.881 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:21:47.881 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 4, 2026-02-23T06:21:47.881 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 45931, 2026-02-23T06:21:47.882 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:21:47.882 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:21:47.882 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:21:47.882 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:21:47.882 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:21:47.882 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 45, 2026-02-23T06:21:47.882 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:21:47.882 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:21:47.882 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:21:47.882 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:21:47.882 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:21:47.882 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:21:47.882 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:21:47.883 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:21:47.883 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:21:47.883 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:21:47.883 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:21:47.883 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:21:47.883 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:21:47.883 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:21:47.883 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:21:47.883 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:21:47.883 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:21:47.883 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:21:47.883 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:21:47.884 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:21:47.884 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:21:47.884 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:21:47.884 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:21:47.884 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:21:47.884 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:21:47.884 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:21:47.884 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:21:47.884 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:21:47.884 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:21:47.884 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:21:47.884 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:21:47.884 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:21:47.885 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:21:47.885 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.885 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:21:47.885 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:21:47.885 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:21:47.885 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:21:47.885 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:21:47.885 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:21:47.885 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:21:47.885 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:21:47.885 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:21:47.885 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:21:47.886 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:21:47.886 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:21:47.886 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:21:47.886 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:21:47.886 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:21:47.886 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:21:47.886 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:21:47.886 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:21:47.886 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:21:47.886 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:21:47.886 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:21:47.886 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:21:47.887 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:21:47.887 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:21:47.887 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:21:47.887 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:21:47.887 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:21:47.887 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:21:47.887 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:21:47.887 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:21:47.887 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:21:47.887 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:21:47.887 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.887 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:21:47.887 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.888 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:21:47.888 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:21:47.888 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:21:47.888 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:21:47.888 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.888 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:21:47.888 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:21:47.888 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:21:47.888 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.888 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.888 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:21:47.888 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:21:47.888 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:21:47.889 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:21:47.889 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:21:47.889 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.889 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:21:47.889 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:21:47.889 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:21:47.889 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:21:47.889 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:21:47.889 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:21:47.889 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.889 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.889 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:21:47.890 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:21:47.890 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:21:47.890 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:21:47.890 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.890 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:21:47.890 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:21:47.890 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:21:47.890 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.890 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.890 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:21:47.890 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:21:47.890 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:21:47.890 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:21:47.891 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:21:47.891 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.891 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:21:47.891 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:21:47.891 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:21:47.891 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:21:47.891 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:21:47.891 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:21:47.891 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.891 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.891 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:21:47.891 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:21:47.891 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:21:47.892 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:21:47.892 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.892 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:21:47.892 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:21:47.892 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:21:47.892 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.892 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.892 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:21:47.892 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:21:47.892 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:21:47.892 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:21:47.892 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:21:47.893 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.893 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:21:47.893 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:21:47.893 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:21:47.893 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:21:47.893 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:21:47.893 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:21:47.893 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:21:47.893 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:21:47.893 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.893 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:21:47.893 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:21:47.893 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.894 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:21:47.894 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:21:47.894 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:21:47.894 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:21:47.894 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:21:47.894 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:21:47.894 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.894 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:21:47.894 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:21:47.894 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:21:47.894 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:21:47.894 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:21:47.894 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:21:47.895 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.895 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:21:47.895 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:21:47.895 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:21:47.895 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:21:47.895 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:21:47.895 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:21:47.895 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.895 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:21:47.895 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:21:47.895 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:21:47.895 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.895 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:21:47.896 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:21:47.896 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:21:47.896 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:21:47.896 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:21:47.896 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:21:47.896 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:21:47.896 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:21:47.896 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:21:47.897 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.886+0000 7f4101683640 1 -- 10.20.193.58:0/3523519687 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f40cc07a6b0 msgr2=0x7f40cc09ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:47.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.886+0000 7f4101683640 1 --2- 10.20.193.58:0/3523519687 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f40cc07a6b0 0x7f40cc09ab60 secure :-1 s=READY pgs=119 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40f000a8c0 tx=0x7f40f003b040 comp rx=0 tx=0).stop 2026-02-23T06:21:47.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.886+0000 7f4101683640 1 -- 10.20.193.58:0/3523519687 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f40fc15c4b0 msgr2=0x7f40fc15b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:47.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.886+0000 7f4101683640 1 --2- 10.20.193.58:0/3523519687 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f40fc15c4b0 0x7f40fc15b550 secure :-1 s=READY pgs=190 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40ec0029a0 tx=0x7f40ec00c8c0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.886+0000 7f4100e82640 1 -- 10.20.193.58:0/3523519687 reap_dead start 2026-02-23T06:21:47.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.886+0000 7f4101683640 1 -- 10.20.193.58:0/3523519687 shutdown_connections 2026-02-23T06:21:47.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.886+0000 7f4101683640 1 --2- 10.20.193.58:0/3523519687 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f40fc15c4b0 0x7f40fc15b550 unknown :-1 s=CLOSED pgs=190 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:47.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.886+0000 7f4101683640 1 -- 10.20.193.58:0/3523519687 >> 10.20.193.58:0/3523519687 conn(0x7f40fc0b3c20 msgr2=0x7f40fc159620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:47.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.886+0000 7f4101683640 1 -- 10.20.193.58:0/3523519687 shutdown_connections 2026-02-23T06:21:47.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:47.886+0000 7f4101683640 1 -- 10.20.193.58:0/3523519687 wait complete. 2026-02-23T06:21:47.899 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:21:47.899 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-23T06:21:47.899 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-23T06:21:47.899 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-23T06:21:47.899 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-23T06:21:47.900 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-23T06:21:47.900 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:21:47.909 INFO:tasks.ceph.mon.c:Stopped 2026-02-23T06:21:47.910 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:21:47.910 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:21:48.040 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.045+0000 7f588821b640 1 -- 10.20.193.58:0/1490599606 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f58800b6020 msgr2=0x7f588015ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:48.040 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.045+0000 7f588821b640 1 --2- 10.20.193.58:0/1490599606 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f58800b6020 0x7f588015ce30 secure :-1 s=READY pgs=186 gs=3 cs=0 l=1 c_cookie=8963439733068100976 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f587c005820 tx=0x7f587c030360 comp rx=0 tx=0).stop 2026-02-23T06:21:48.041 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.045+0000 7f588821b640 1 -- 10.20.193.58:0/1490599606 shutdown_connections 2026-02-23T06:21:48.041 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.045+0000 7f588821b640 1 --2- 10.20.193.58:0/1490599606 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f58800b6020 0x7f588015ce30 unknown :-1 s=CLOSED pgs=186 gs=3 cs=0 l=1 c_cookie=8963439733068100976 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:48.041 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.045+0000 7f588821b640 1 --2- 10.20.193.58:0/1490599606 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f58800b10e0 0x7f588005b230 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:48.041 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.045+0000 7f588821b640 1 -- 10.20.193.58:0/1490599606 >> 10.20.193.58:0/1490599606 conn(0x7f58800561f0 msgr2=0x7f58800565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:48.041 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.045+0000 7f588821b640 1 -- 10.20.193.58:0/1490599606 shutdown_connections 2026-02-23T06:21:48.041 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.045+0000 7f588821b640 1 -- 10.20.193.58:0/1490599606 wait complete. 2026-02-23T06:21:48.044 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.046+0000 7f588821b640 1 Processor -- start 2026-02-23T06:21:48.044 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.047+0000 7f588821b640 1 -- start start 2026-02-23T06:21:48.044 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.047+0000 7f588821b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f58800b10e0 0x7f588013cd70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:48.044 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.047+0000 7f588821b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f58800b6020 0x7f588014d1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:48.044 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.047+0000 7f588821b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5880163c70 0x7f588014d700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:48.044 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.047+0000 7f588821b640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f5880118920 con 0x7f5880163c70 2026-02-23T06:21:48.044 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.047+0000 7f588821b640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f588011c900 con 0x7f58800b6020 2026-02-23T06:21:48.044 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.047+0000 7f588821b640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f588011cbe0 con 0x7f58800b10e0 2026-02-23T06:21:48.044 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.047+0000 7f5885f90640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f58800b10e0 msgr2=0x7f588013cd70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:21:48.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.047+0000 7f5885f90640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f58800b10e0 0x7f588013cd70 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:21:48.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.047+0000 7f5886791640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5880163c70 0x7f588014d700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:48.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.047+0000 7f588578f640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f58800b6020 0x7f588014d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:48.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.047+0000 7f5886791640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5880163c70 0x7f588014d700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:57240/0 (socket says 10.20.193.58:57240) 2026-02-23T06:21:48.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.047+0000 7f588578f640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f58800b6020 0x7f588014d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:59788/0 (socket says 10.20.193.58:59788) 2026-02-23T06:21:48.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.047+0000 7f5886791640 1 -- 10.20.193.58:0/619771551 learned_addr learned my addr 10.20.193.58:0/619771551 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:48.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.048+0000 7f5886791640 1 -- 10.20.193.58:0/619771551 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f58800b10e0 msgr2=0x7f588013cd70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:21:48.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.048+0000 7f5886791640 1 --2- 10.20.193.58:0/619771551 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f58800b10e0 0x7f588013cd70 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:48.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.048+0000 7f5886791640 1 -- 10.20.193.58:0/619771551 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f58800b6020 msgr2=0x7f588014d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:48.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.048+0000 7f5886791640 1 --2- 10.20.193.58:0/619771551 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f58800b6020 0x7f588014d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:48.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.048+0000 7f5886791640 1 -- 10.20.193.58:0/619771551 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f587c00a590 con 0x7f5880163c70 2026-02-23T06:21:48.046 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.048+0000 7f588578f640 1 --2- 10.20.193.58:0/619771551 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f58800b6020 0x7f588014d1c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:21:48.046 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.048+0000 7f5886791640 1 --2- 10.20.193.58:0/619771551 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5880163c70 0x7f588014d700 secure :-1 s=READY pgs=196 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f587c00aa70 tx=0x7f587c003d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:48.046 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.048+0000 7f586e7fc640 1 -- 10.20.193.58:0/619771551 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f587c03e070 con 0x7f5880163c70 2026-02-23T06:21:48.046 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.048+0000 7f586e7fc640 1 -- 10.20.193.58:0/619771551 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f587c005b50 con 0x7f5880163c70 2026-02-23T06:21:48.046 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.048+0000 7f586e7fc640 1 -- 10.20.193.58:0/619771551 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f587c006020 con 0x7f5880163c70 2026-02-23T06:21:48.046 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.048+0000 7f588821b640 1 -- 10.20.193.58:0/619771551 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f588011cec0 con 0x7f5880163c70 2026-02-23T06:21:48.046 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.048+0000 7f588821b640 1 -- 10.20.193.58:0/619771551 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5880141980 con 0x7f5880163c70 2026-02-23T06:21:48.046 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.049+0000 7f588821b640 1 -- 10.20.193.58:0/619771551 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5880058640 con 0x7f5880163c70 2026-02-23T06:21:48.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.050+0000 7f586e7fc640 1 -- 10.20.193.58:0/619771551 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f587c006180 con 0x7f5880163c70 2026-02-23T06:21:48.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.051+0000 7f586e7fc640 1 --2- 10.20.193.58:0/619771551 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f585007a5b0 0x7f585009aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:48.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.051+0000 7f586e7fc640 1 -- 10.20.193.58:0/619771551 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f587c0c3f00 con 0x7f5880163c70 2026-02-23T06:21:48.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.051+0000 7f5885f90640 1 --2- 10.20.193.58:0/619771551 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f585007a5b0 0x7f585009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:48.048 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.052+0000 7f5885f90640 1 --2- 10.20.193.58:0/619771551 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f585007a5b0 0x7f585009aa60 secure :-1 s=READY pgs=120 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5870002820 tx=0x7f5870006e10 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:48.048 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.052+0000 7f586e7fc640 1 -- 10.20.193.58:0/619771551 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f587c0870b0 con 0x7f5880163c70 2026-02-23T06:21:48.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.206+0000 7f588821b640 1 -- 10.20.193.58:0/619771551 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f588014cea0 con 0x7f5880163c70 2026-02-23T06:21:48.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.206+0000 7f586e7fc640 1 -- 10.20.193.58:0/619771551 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1754 (secure 0 0 0) 0x7f587c08a260 con 0x7f5880163c70 2026-02-23T06:21:48.201 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":46,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:21:48.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.207+0000 7f588821b640 1 -- 10.20.193.58:0/619771551 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f585007a5b0 msgr2=0x7f585009aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:48.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.207+0000 7f588821b640 1 --2- 10.20.193.58:0/619771551 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f585007a5b0 0x7f585009aa60 secure :-1 s=READY pgs=120 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5870002820 tx=0x7f5870006e10 comp rx=0 tx=0).stop 2026-02-23T06:21:48.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.207+0000 7f588821b640 1 -- 10.20.193.58:0/619771551 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5880163c70 msgr2=0x7f588014d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:48.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.207+0000 7f588821b640 1 --2- 10.20.193.58:0/619771551 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5880163c70 0x7f588014d700 secure :-1 s=READY pgs=196 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f587c00aa70 tx=0x7f587c003d90 comp rx=0 tx=0).stop 2026-02-23T06:21:48.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.207+0000 7f588821b640 1 -- 10.20.193.58:0/619771551 shutdown_connections 2026-02-23T06:21:48.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.207+0000 7f588821b640 1 --2- 10.20.193.58:0/619771551 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f585007a5b0 0x7f585009aa60 unknown :-1 s=CLOSED pgs=120 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:48.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.207+0000 7f588821b640 1 --2- 10.20.193.58:0/619771551 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5880163c70 0x7f588014d700 unknown :-1 s=CLOSED pgs=196 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:48.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.207+0000 7f588821b640 1 --2- 10.20.193.58:0/619771551 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f58800b6020 0x7f588014d1c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:48.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.207+0000 7f588821b640 1 --2- 10.20.193.58:0/619771551 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f58800b10e0 0x7f588013cd70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:48.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.207+0000 7f588821b640 1 -- 10.20.193.58:0/619771551 >> 10.20.193.58:0/619771551 conn(0x7f58800561f0 msgr2=0x7f588015cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:48.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.207+0000 7f588821b640 1 -- 10.20.193.58:0/619771551 shutdown_connections 2026-02-23T06:21:48.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:48.207+0000 7f588821b640 1 -- 10.20.193.58:0/619771551 wait complete. 2026-02-23T06:21:51.214 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:21:51.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.341+0000 7f921903e640 1 -- 10.20.193.58:0/2558086913 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92140b6020 msgr2=0x7f921405b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:51.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.341+0000 7f921903e640 1 --2- 10.20.193.58:0/2558086913 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92140b6020 0x7f921405b230 secure :-1 s=READY pgs=193 gs=3 cs=0 l=1 c_cookie=5741276112273169664 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9204005820 tx=0x7f92040303b0 comp rx=0 tx=0).stop 2026-02-23T06:21:51.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.341+0000 7f921903e640 1 -- 10.20.193.58:0/2558086913 shutdown_connections 2026-02-23T06:21:51.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.341+0000 7f921903e640 1 --2- 10.20.193.58:0/2558086913 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92140b6020 0x7f921405b230 unknown :-1 s=CLOSED pgs=193 gs=3 cs=0 l=1 c_cookie=5741276112273169664 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:51.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.341+0000 7f921903e640 1 -- 10.20.193.58:0/2558086913 >> 10.20.193.58:0/2558086913 conn(0x7f92140561f0 msgr2=0x7f92140565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:51.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.341+0000 7f921903e640 1 -- 10.20.193.58:0/2558086913 shutdown_connections 2026-02-23T06:21:51.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.341+0000 7f921903e640 1 -- 10.20.193.58:0/2558086913 wait complete. 2026-02-23T06:21:51.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.342+0000 7f921903e640 1 Processor -- start 2026-02-23T06:21:51.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.342+0000 7f921903e640 1 -- start start 2026-02-23T06:21:51.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.343+0000 7f921903e640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92140b10e0 0x7f921413faa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:51.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.343+0000 7f921903e640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f92140b6020 0x7f9214140730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:51.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.343+0000 7f921903e640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9214163c70 0x7f921413b7f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:51.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.343+0000 7f921903e640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f921413ed70 con 0x7f9214163c70 2026-02-23T06:21:51.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.343+0000 7f921903e640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f921413f610 con 0x7f92140b10e0 2026-02-23T06:21:51.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.343+0000 7f921903e640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f9214140c70 con 0x7f92140b6020 2026-02-23T06:21:51.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.343+0000 7f9212575640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f92140b6020 msgr2=0x7f9214140730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:21:51.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.343+0000 7f9212d76640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92140b10e0 0x7f921413faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:51.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.343+0000 7f9213577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9214163c70 0x7f921413b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:51.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.343+0000 7f9212575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f92140b6020 0x7f9214140730 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:21:51.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.343+0000 7f9212d76640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92140b10e0 0x7f921413faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:48236/0 (socket says 10.20.193.58:48236) 2026-02-23T06:21:51.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.343+0000 7f9212d76640 1 -- 10.20.193.58:0/1120532112 learned_addr learned my addr 10.20.193.58:0/1120532112 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:51.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.343+0000 7f9213577640 1 -- 10.20.193.58:0/1120532112 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f92140b6020 msgr2=0x7f9214140730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:21:51.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.343+0000 7f9213577640 1 --2- 10.20.193.58:0/1120532112 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f92140b6020 0x7f9214140730 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:51.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.343+0000 7f9213577640 1 -- 10.20.193.58:0/1120532112 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92140b10e0 msgr2=0x7f921413faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:51.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.343+0000 7f9213577640 1 --2- 10.20.193.58:0/1120532112 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92140b10e0 0x7f921413faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:51.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.343+0000 7f9213577640 1 -- 10.20.193.58:0/1120532112 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920400a590 con 0x7f9214163c70 2026-02-23T06:21:51.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.344+0000 7f9213577640 1 --2- 10.20.193.58:0/1120532112 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9214163c70 0x7f921413b7f0 secure :-1 s=READY pgs=202 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9204005820 tx=0x7f9204003d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:51.342 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.344+0000 7f91f37fe640 1 -- 10.20.193.58:0/1120532112 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f920403e070 con 0x7f9214163c70 2026-02-23T06:21:51.342 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.344+0000 7f91f37fe640 1 -- 10.20.193.58:0/1120532112 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9204003e90 con 0x7f9214163c70 2026-02-23T06:21:51.342 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.344+0000 7f91f37fe640 1 -- 10.20.193.58:0/1120532112 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9204039b00 con 0x7f9214163c70 2026-02-23T06:21:51.342 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.344+0000 7f921903e640 1 -- 10.20.193.58:0/1120532112 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f921413bd30 con 0x7f9214163c70 2026-02-23T06:21:51.342 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.344+0000 7f921903e640 1 -- 10.20.193.58:0/1120532112 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9214201810 con 0x7f9214163c70 2026-02-23T06:21:51.342 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.344+0000 7f921903e640 1 -- 10.20.193.58:0/1120532112 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f921413f7c0 con 0x7f9214163c70 2026-02-23T06:21:51.343 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.346+0000 7f91f37fe640 1 -- 10.20.193.58:0/1120532112 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f9204039c60 con 0x7f9214163c70 2026-02-23T06:21:51.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.347+0000 7f91f37fe640 1 --2- 10.20.193.58:0/1120532112 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f91e007a5b0 0x7f91e009aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:51.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.347+0000 7f91f37fe640 1 -- 10.20.193.58:0/1120532112 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f92040c3540 con 0x7f9214163c70 2026-02-23T06:21:51.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.347+0000 7f9212d76640 1 --2- 10.20.193.58:0/1120532112 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f91e007a5b0 0x7f91e009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:51.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.347+0000 7f91f37fe640 1 -- 10.20.193.58:0/1120532112 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f9204086890 con 0x7f9214163c70 2026-02-23T06:21:51.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.347+0000 7f9212d76640 1 --2- 10.20.193.58:0/1120532112 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f91e007a5b0 0x7f91e009aa60 secure :-1 s=READY pgs=121 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9208007fd0 tx=0x7f9208007e20 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:51.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.501+0000 7f921903e640 1 -- 10.20.193.58:0/1120532112 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9214058640 con 0x7f9214163c70 2026-02-23T06:21:51.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.502+0000 7f91f37fe640 1 -- 10.20.193.58:0/1120532112 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1754 (secure 0 0 0) 0x7f92040899b0 con 0x7f9214163c70 2026-02-23T06:21:51.497 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":49,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:21:51.498 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.503+0000 7f921903e640 1 -- 10.20.193.58:0/1120532112 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f91e007a5b0 msgr2=0x7f91e009aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:51.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.503+0000 7f921903e640 1 --2- 10.20.193.58:0/1120532112 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f91e007a5b0 0x7f91e009aa60 secure :-1 s=READY pgs=121 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9208007fd0 tx=0x7f9208007e20 comp rx=0 tx=0).stop 2026-02-23T06:21:51.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.503+0000 7f921903e640 1 -- 10.20.193.58:0/1120532112 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9214163c70 msgr2=0x7f921413b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:51.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.503+0000 7f921903e640 1 --2- 10.20.193.58:0/1120532112 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9214163c70 0x7f921413b7f0 secure :-1 s=READY pgs=202 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9204005820 tx=0x7f9204003d20 comp rx=0 tx=0).stop 2026-02-23T06:21:51.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.503+0000 7f921903e640 1 -- 10.20.193.58:0/1120532112 shutdown_connections 2026-02-23T06:21:51.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.503+0000 7f921903e640 1 --2- 10.20.193.58:0/1120532112 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f91e007a5b0 0x7f91e009aa60 unknown :-1 s=CLOSED pgs=121 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:51.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.503+0000 7f921903e640 1 --2- 10.20.193.58:0/1120532112 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9214163c70 0x7f921413b7f0 unknown :-1 s=CLOSED pgs=202 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:51.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.503+0000 7f921903e640 1 --2- 10.20.193.58:0/1120532112 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f92140b6020 0x7f9214140730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:51.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.503+0000 7f921903e640 1 --2- 10.20.193.58:0/1120532112 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92140b10e0 0x7f921413faa0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:51.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.503+0000 7f921903e640 1 -- 10.20.193.58:0/1120532112 >> 10.20.193.58:0/1120532112 conn(0x7f92140561f0 msgr2=0x7f9214061600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:51.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.503+0000 7f921903e640 1 -- 10.20.193.58:0/1120532112 shutdown_connections 2026-02-23T06:21:51.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:51.503+0000 7f921903e640 1 -- 10.20.193.58:0/1120532112 wait complete. 2026-02-23T06:21:54.511 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:21:54.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.634+0000 7f8ab9e43640 1 -- 10.20.193.58:0/1414895893 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ab415d870 msgr2=0x7f8ab40587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:54.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.634+0000 7f8ab9e43640 1 --2- 10.20.193.58:0/1414895893 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ab415d870 0x7f8ab40587b0 secure :-1 s=READY pgs=204 gs=1 cs=0 l=1 c_cookie=8312752915495481580 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ab40b5040 tx=0x7f8a9c02f270 comp rx=0 tx=0).stop 2026-02-23T06:21:54.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.634+0000 7f8ab9e43640 1 -- 10.20.193.58:0/1414895893 shutdown_connections 2026-02-23T06:21:54.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.634+0000 7f8ab9e43640 1 --2- 10.20.193.58:0/1414895893 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ab40b6690 0x7f8ab4058cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:54.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.634+0000 7f8ab9e43640 1 --2- 10.20.193.58:0/1414895893 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ab415d870 0x7f8ab40587b0 unknown :-1 s=CLOSED pgs=204 gs=1 cs=0 l=1 c_cookie=8312752915495481580 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:54.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.634+0000 7f8ab9e43640 1 --2- 10.20.193.58:0/1414895893 >> v2:10.20.193.93:3300/0 conn(0x7f8ab415d4a0 0x7f8ab40affb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:54.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.634+0000 7f8ab9e43640 1 -- 10.20.193.58:0/1414895893 >> 10.20.193.58:0/1414895893 conn(0x7f8ab40b3c20 msgr2=0x7f8ab40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:54.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.634+0000 7f8ab9e43640 1 -- 10.20.193.58:0/1414895893 shutdown_connections 2026-02-23T06:21:54.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.634+0000 7f8ab9e43640 1 -- 10.20.193.58:0/1414895893 wait complete. 2026-02-23T06:21:54.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.635+0000 7f8ab9e43640 1 Processor -- start 2026-02-23T06:21:54.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.636+0000 7f8ab9e43640 1 -- start start 2026-02-23T06:21:54.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.636+0000 7f8ab9e43640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8ab40b6690 0x7f8ab411e7c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:54.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.636+0000 7f8ab9e43640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ab415d4a0 0x7f8ab41476d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:54.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.636+0000 7f8ab9e43640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ab415d870 0x7f8ab413b080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:54.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.636+0000 7f8ab9e43640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab415f860 con 0x7f8ab415d4a0 2026-02-23T06:21:54.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.636+0000 7f8ab9e43640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab415dde0 con 0x7f8ab40b6690 2026-02-23T06:21:54.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.636+0000 7f8ab9e43640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab415e0c0 con 0x7f8ab415d870 2026-02-23T06:21:54.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.636+0000 7f8ab9642640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ab415d870 msgr2=0x7f8ab413b080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:21:54.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.636+0000 7f8ab9642640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ab415d870 0x7f8ab413b080 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:21:54.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.636+0000 7f8aabfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ab415d4a0 0x7f8ab41476d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:54.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.636+0000 7f8ab8e41640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8ab40b6690 0x7f8ab411e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:54.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.636+0000 7f8aabfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ab415d4a0 0x7f8ab41476d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:53760/0 (socket says 10.20.193.58:53760) 2026-02-23T06:21:54.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.636+0000 7f8aabfff640 1 -- 10.20.193.58:0/3846219914 learned_addr learned my addr 10.20.193.58:0/3846219914 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:21:54.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.637+0000 7f8aabfff640 1 -- 10.20.193.58:0/3846219914 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ab415d870 msgr2=0x7f8ab413b080 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:21:54.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.637+0000 7f8aabfff640 1 --2- 10.20.193.58:0/3846219914 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ab415d870 0x7f8ab413b080 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:54.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.637+0000 7f8aabfff640 1 -- 10.20.193.58:0/3846219914 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8ab40b6690 msgr2=0x7f8ab411e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:54.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.637+0000 7f8aabfff640 1 --2- 10.20.193.58:0/3846219914 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8ab40b6690 0x7f8ab411e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:54.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.637+0000 7f8aabfff640 1 -- 10.20.193.58:0/3846219914 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9c009570 con 0x7f8ab415d4a0 2026-02-23T06:21:54.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.637+0000 7f8aabfff640 1 --2- 10.20.193.58:0/3846219914 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ab415d4a0 0x7f8ab41476d0 secure :-1 s=READY pgs=205 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a9c004740 tx=0x7f8a9c0028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:54.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.637+0000 7f8aa97fa640 1 -- 10.20.193.58:0/3846219914 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a9c03d070 con 0x7f8ab415d4a0 2026-02-23T06:21:54.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.637+0000 7f8ab9e43640 1 -- 10.20.193.58:0/3846219914 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab415fad0 con 0x7f8ab415d4a0 2026-02-23T06:21:54.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.637+0000 7f8aa97fa640 1 -- 10.20.193.58:0/3846219914 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a9c004850 con 0x7f8ab415d4a0 2026-02-23T06:21:54.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.637+0000 7f8aa97fa640 1 -- 10.20.193.58:0/3846219914 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a9c03d070 con 0x7f8ab415d4a0 2026-02-23T06:21:54.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.637+0000 7f8ab9e43640 1 -- 10.20.193.58:0/3846219914 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab411ed00 con 0x7f8ab415d4a0 2026-02-23T06:21:54.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.638+0000 7f8ab9e43640 1 -- 10.20.193.58:0/3846219914 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ab40b7a20 con 0x7f8ab415d4a0 2026-02-23T06:21:54.637 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.639+0000 7f8aa97fa640 1 -- 10.20.193.58:0/3846219914 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f8a9c0049c0 con 0x7f8ab415d4a0 2026-02-23T06:21:54.637 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.640+0000 7f8aa97fa640 1 --2- 10.20.193.58:0/3846219914 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8a8407a660 0x7f8a8409ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:21:54.637 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.640+0000 7f8aa97fa640 1 -- 10.20.193.58:0/3846219914 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f8a9c0c21c0 con 0x7f8ab415d4a0 2026-02-23T06:21:54.637 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.640+0000 7f8ab8e41640 1 --2- 10.20.193.58:0/3846219914 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8a8407a660 0x7f8a8409ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:21:54.637 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.641+0000 7f8ab8e41640 1 --2- 10.20.193.58:0/3846219914 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8a8407a660 0x7f8a8409ab10 secure :-1 s=READY pgs=122 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8aa4004740 tx=0x7f8aa4005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:21:54.637 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.642+0000 7f8aa97fa640 1 -- 10.20.193.58:0/3846219914 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f8a9c085310 con 0x7f8ab415d4a0 2026-02-23T06:21:54.792 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.797+0000 7f8ab9e43640 1 -- 10.20.193.58:0/3846219914 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8ab415ff50 con 0x7f8ab415d4a0 2026-02-23T06:21:54.792 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.797+0000 7f8aa97fa640 1 -- 10.20.193.58:0/3846219914 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1754 (secure 0 0 0) 0x7f8a9c088430 con 0x7f8ab415d4a0 2026-02-23T06:21:54.793 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":52,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:21:54.794 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.798+0000 7f8ab9e43640 1 -- 10.20.193.58:0/3846219914 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8a8407a660 msgr2=0x7f8a8409ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:54.794 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.798+0000 7f8ab9e43640 1 --2- 10.20.193.58:0/3846219914 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8a8407a660 0x7f8a8409ab10 secure :-1 s=READY pgs=122 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8aa4004740 tx=0x7f8aa4005f90 comp rx=0 tx=0).stop 2026-02-23T06:21:54.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.798+0000 7f8ab9e43640 1 -- 10.20.193.58:0/3846219914 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ab415d4a0 msgr2=0x7f8ab41476d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:21:54.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.798+0000 7f8ab9e43640 1 --2- 10.20.193.58:0/3846219914 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ab415d4a0 0x7f8ab41476d0 secure :-1 s=READY pgs=205 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a9c004740 tx=0x7f8a9c0028d0 comp rx=0 tx=0).stop 2026-02-23T06:21:54.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.798+0000 7f8ab9e43640 1 -- 10.20.193.58:0/3846219914 shutdown_connections 2026-02-23T06:21:54.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.798+0000 7f8ab9e43640 1 --2- 10.20.193.58:0/3846219914 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8a8407a660 0x7f8a8409ab10 unknown :-1 s=CLOSED pgs=122 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:54.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.798+0000 7f8ab9e43640 1 --2- 10.20.193.58:0/3846219914 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ab415d870 0x7f8ab413b080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:54.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.798+0000 7f8ab9e43640 1 --2- 10.20.193.58:0/3846219914 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ab415d4a0 0x7f8ab41476d0 unknown :-1 s=CLOSED pgs=205 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:54.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.798+0000 7f8ab9e43640 1 --2- 10.20.193.58:0/3846219914 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8ab40b6690 0x7f8ab411e7c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:21:54.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.798+0000 7f8ab9e43640 1 -- 10.20.193.58:0/3846219914 >> 10.20.193.58:0/3846219914 conn(0x7f8ab40b3c20 msgr2=0x7f8ab413be00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:21:54.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.799+0000 7f8ab9e43640 1 -- 10.20.193.58:0/3846219914 shutdown_connections 2026-02-23T06:21:54.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:21:54.799+0000 7f8ab9e43640 1 -- 10.20.193.58:0/3846219914 wait complete. 2026-02-23T06:21:57.806 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:22:03.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.935+0000 7f1ae7fff640 1 -- 10.20.193.58:0/352865640 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1acc046ea0 msgr2=0x7f1acc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:03.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.935+0000 7f1ae7fff640 1 --2- 10.20.193.58:0/352865640 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1acc046ea0 0x7f1acc0672e0 secure :-1 s=READY pgs=197 gs=25 cs=0 l=1 c_cookie=2073727814597704520 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ae8059c90 tx=0x7f1ad802fb10 comp rx=0 tx=0).stop 2026-02-23T06:22:03.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.935+0000 7f1ae7fff640 1 -- 10.20.193.58:0/352865640 shutdown_connections 2026-02-23T06:22:03.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.935+0000 7f1ae7fff640 1 --2- 10.20.193.58:0/352865640 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1acc046ea0 0x7f1acc0672e0 unknown :-1 s=CLOSED pgs=197 gs=25 cs=0 l=1 c_cookie=2073727814597704520 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:03.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.935+0000 7f1ae7fff640 1 --2- 10.20.193.58:0/352865640 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1acc024680 0x7f1acc046960 unknown :-1 s=CLOSED pgs=0 gs=24 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:03.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.935+0000 7f1ae7fff640 1 -- 10.20.193.58:0/352865640 >> 10.20.193.58:0/352865640 conn(0x7f1ae80b3c20 msgr2=0x7f1ae80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:22:03.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.935+0000 7f1ae7fff640 1 -- 10.20.193.58:0/352865640 shutdown_connections 2026-02-23T06:22:03.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.935+0000 7f1ae7fff640 1 -- 10.20.193.58:0/352865640 wait complete. 2026-02-23T06:22:03.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.937+0000 7f1ae7fff640 1 Processor -- start 2026-02-23T06:22:03.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.937+0000 7f1ae7fff640 1 -- start start 2026-02-23T06:22:03.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.938+0000 7f1ae7fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1acc003c00 0x7f1ae8056fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:03.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.938+0000 7f1ae7fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1acc024680 0x7f1ae813b2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:03.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.938+0000 7f1ae7fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1acc046ea0 0x7f1ae811be90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:03.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.938+0000 7f1ae7fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae80574f0 con 0x7f1acc024680 2026-02-23T06:22:03.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.938+0000 7f1ae7fff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae811d180 con 0x7f1acc003c00 2026-02-23T06:22:03.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.938+0000 7f1ae7fff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f1ae811d400 con 0x7f1acc046ea0 2026-02-23T06:22:03.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.938+0000 7f1ae77fe640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1acc046ea0 msgr2=0x7f1ae811be90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:22:03.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.938+0000 7f1ae77fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1acc046ea0 0x7f1ae811be90 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:22:03.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.938+0000 7f1ae67fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1acc024680 0x7f1ae813b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:03.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.938+0000 7f1ae6ffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1acc003c00 0x7f1ae8056fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:03.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.938+0000 7f1ae67fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1acc024680 0x7f1ae813b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:34748/0 (socket says 10.20.193.58:34748) 2026-02-23T06:22:03.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.938+0000 7f1ae67fc640 1 -- 10.20.193.58:0/54292889 learned_addr learned my addr 10.20.193.58:0/54292889 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:22:03.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.938+0000 7f1ae67fc640 1 -- 10.20.193.58:0/54292889 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1acc046ea0 msgr2=0x7f1ae811be90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:22:03.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.938+0000 7f1ae67fc640 1 --2- 10.20.193.58:0/54292889 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1acc046ea0 0x7f1ae811be90 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:03.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.938+0000 7f1ae67fc640 1 -- 10.20.193.58:0/54292889 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1acc003c00 msgr2=0x7f1ae8056fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:03.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.938+0000 7f1ae67fc640 1 --2- 10.20.193.58:0/54292889 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1acc003c00 0x7f1ae8056fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:03.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.938+0000 7f1ae67fc640 1 -- 10.20.193.58:0/54292889 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ae8059400 con 0x7f1acc024680 2026-02-23T06:22:03.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.938+0000 7f1ae67fc640 1 --2- 10.20.193.58:0/54292889 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1acc024680 0x7f1ae813b2b0 secure :-1 s=READY pgs=209 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ad0005fd0 tx=0x7f1ad0012520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:03.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.938+0000 7f1ac77fe640 1 -- 10.20.193.58:0/54292889 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ad001e690 con 0x7f1acc024680 2026-02-23T06:22:03.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.938+0000 7f1ac77fe640 1 -- 10.20.193.58:0/54292889 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ad0018070 con 0x7f1acc024680 2026-02-23T06:22:03.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.938+0000 7f1ac77fe640 1 -- 10.20.193.58:0/54292889 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ad001ebc0 con 0x7f1acc024680 2026-02-23T06:22:03.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.938+0000 7f1ae7fff640 1 -- 10.20.193.58:0/54292889 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ae811e470 con 0x7f1acc024680 2026-02-23T06:22:03.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.939+0000 7f1ae7fff640 1 -- 10.20.193.58:0/54292889 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ae811ea30 con 0x7f1acc024680 2026-02-23T06:22:03.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.939+0000 7f1ae7fff640 1 -- 10.20.193.58:0/54292889 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ae80b6d50 con 0x7f1acc024680 2026-02-23T06:22:03.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.940+0000 7f1ac77fe640 1 -- 10.20.193.58:0/54292889 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f1ad001ed20 con 0x7f1acc024680 2026-02-23T06:22:03.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.942+0000 7f1ac77fe640 1 --2- 10.20.193.58:0/54292889 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1ab407a5b0 0x7f1ab409aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:03.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.942+0000 7f1ac77fe640 1 -- 10.20.193.58:0/54292889 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f1ad009eaa0 con 0x7f1acc024680 2026-02-23T06:22:03.938 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.942+0000 7f1ae6ffd640 1 --2- 10.20.193.58:0/54292889 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1ab407a5b0 0x7f1ab409aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:03.938 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.943+0000 7f1ae6ffd640 1 --2- 10.20.193.58:0/54292889 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1ab407a5b0 0x7f1ab409aa60 secure :-1 s=READY pgs=123 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1adc002c40 tx=0x7f1adc00a210 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:03.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:03.944+0000 7f1ac77fe640 1 -- 10.20.193.58:0/54292889 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f1ad0061cd0 con 0x7f1acc024680 2026-02-23T06:22:04.094 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.099+0000 7f1ae7fff640 1 -- 10.20.193.58:0/54292889 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1ae805c3a0 con 0x7f1acc024680 2026-02-23T06:22:04.094 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.100+0000 7f1ac77fe640 1 -- 10.20.193.58:0/54292889 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1747 (secure 0 0 0) 0x7f1ad0064e80 con 0x7f1acc024680 2026-02-23T06:22:04.095 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":8,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:22:04.096 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.101+0000 7f1ae7fff640 1 -- 10.20.193.58:0/54292889 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1ab407a5b0 msgr2=0x7f1ab409aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:04.096 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.101+0000 7f1ae7fff640 1 --2- 10.20.193.58:0/54292889 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1ab407a5b0 0x7f1ab409aa60 secure :-1 s=READY pgs=123 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1adc002c40 tx=0x7f1adc00a210 comp rx=0 tx=0).stop 2026-02-23T06:22:04.096 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.101+0000 7f1ae7fff640 1 -- 10.20.193.58:0/54292889 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1acc024680 msgr2=0x7f1ae813b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:04.096 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.101+0000 7f1ae7fff640 1 --2- 10.20.193.58:0/54292889 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1acc024680 0x7f1ae813b2b0 secure :-1 s=READY pgs=209 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ad0005fd0 tx=0x7f1ad0012520 comp rx=0 tx=0).stop 2026-02-23T06:22:04.096 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.101+0000 7f1ae7fff640 1 -- 10.20.193.58:0/54292889 shutdown_connections 2026-02-23T06:22:04.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.101+0000 7f1ae7fff640 1 --2- 10.20.193.58:0/54292889 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1ab407a5b0 0x7f1ab409aa60 unknown :-1 s=CLOSED pgs=123 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:04.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.101+0000 7f1ae7fff640 1 --2- 10.20.193.58:0/54292889 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1acc046ea0 0x7f1ae811be90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:04.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.101+0000 7f1ae7fff640 1 --2- 10.20.193.58:0/54292889 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1acc024680 0x7f1ae813b2b0 unknown :-1 s=CLOSED pgs=209 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:04.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.101+0000 7f1ae7fff640 1 --2- 10.20.193.58:0/54292889 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1acc003c00 0x7f1ae8056fb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:04.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.101+0000 7f1ae7fff640 1 -- 10.20.193.58:0/54292889 >> 10.20.193.58:0/54292889 conn(0x7f1ae80b3c20 msgr2=0x7f1ae80585b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:22:04.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.101+0000 7f1ae7fff640 1 -- 10.20.193.58:0/54292889 shutdown_connections 2026-02-23T06:22:04.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.101+0000 7f1ae7fff640 1 -- 10.20.193.58:0/54292889 wait complete. 2026-02-23T06:22:04.108 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:22:04.109 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-23T06:22:04.109 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:22:04.233 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.238+0000 7fe43a5d2640 1 -- 10.20.193.58:0/4247191386 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe43415d870 msgr2=0x7fe4340587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:04.233 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.238+0000 7fe43a5d2640 1 --2- 10.20.193.58:0/4247191386 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe43415d870 0x7fe4340587b0 secure :-1 s=READY pgs=199 gs=3 cs=0 l=1 c_cookie=13689372296709563187 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe428004740 tx=0x7fe42802f220 comp rx=0 tx=0).stop 2026-02-23T06:22:04.234 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.238+0000 7fe43a5d2640 1 -- 10.20.193.58:0/4247191386 shutdown_connections 2026-02-23T06:22:04.234 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.238+0000 7fe43a5d2640 1 --2- 10.20.193.58:0/4247191386 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe43415d870 0x7fe4340587b0 unknown :-1 s=CLOSED pgs=199 gs=3 cs=0 l=1 c_cookie=13689372296709563187 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:04.234 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.238+0000 7fe43a5d2640 1 -- 10.20.193.58:0/4247191386 >> 10.20.193.58:0/4247191386 conn(0x7fe4340b3c20 msgr2=0x7fe4340b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:22:04.234 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.238+0000 7fe43a5d2640 1 -- 10.20.193.58:0/4247191386 shutdown_connections 2026-02-23T06:22:04.234 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.238+0000 7fe43a5d2640 1 -- 10.20.193.58:0/4247191386 wait complete. 2026-02-23T06:22:04.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.239+0000 7fe43a5d2640 1 Processor -- start 2026-02-23T06:22:04.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.239+0000 7fe43a5d2640 1 -- start start 2026-02-23T06:22:04.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.240+0000 7fe43a5d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe4340b6690 0x7fe43413d3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:04.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.240+0000 7fe43a5d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe43415d4a0 0x7fe434057860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:04.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.240+0000 7fe43a5d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe43415d870 0x7fe434057da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:04.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.240+0000 7fe43a5d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe434202060 con 0x7fe43415d870 2026-02-23T06:22:04.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.240+0000 7fe43a5d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe434206500 con 0x7fe43415d4a0 2026-02-23T06:22:04.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.240+0000 7fe43a5d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe434202e60 con 0x7fe4340b6690 2026-02-23T06:22:04.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.240+0000 7fe4395d0640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe4340b6690 msgr2=0x7fe43413d3f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:22:04.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.240+0000 7fe4395d0640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe4340b6690 0x7fe43413d3f0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:22:04.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.240+0000 7fe438dcf640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe43415d4a0 0x7fe434057860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:04.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.240+0000 7fe438dcf640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe43415d4a0 0x7fe434057860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:53458/0 (socket says 10.20.193.58:53458) 2026-02-23T06:22:04.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.240+0000 7fe438dcf640 1 -- 10.20.193.58:0/2857959708 learned_addr learned my addr 10.20.193.58:0/2857959708 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:22:04.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.240+0000 7fe439dd1640 1 --2- 10.20.193.58:0/2857959708 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe43415d870 0x7fe434057da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:04.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.241+0000 7fe438dcf640 1 -- 10.20.193.58:0/2857959708 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe4340b6690 msgr2=0x7fe43413d3f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:22:04.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.241+0000 7fe438dcf640 1 --2- 10.20.193.58:0/2857959708 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe4340b6690 0x7fe43413d3f0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:04.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.241+0000 7fe438dcf640 1 -- 10.20.193.58:0/2857959708 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe43415d870 msgr2=0x7fe434057da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:04.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.241+0000 7fe438dcf640 1 --2- 10.20.193.58:0/2857959708 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe43415d870 0x7fe434057da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:04.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.241+0000 7fe438dcf640 1 -- 10.20.193.58:0/2857959708 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4280094b0 con 0x7fe43415d4a0 2026-02-23T06:22:04.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.241+0000 7fe438dcf640 1 --2- 10.20.193.58:0/2857959708 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe43415d4a0 0x7fe434057860 secure :-1 s=READY pgs=200 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4280097e0 tx=0x7fe428002a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:04.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.241+0000 7fe421ffb640 1 -- 10.20.193.58:0/2857959708 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe42803c040 con 0x7fe43415d4a0 2026-02-23T06:22:04.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.241+0000 7fe421ffb640 1 -- 10.20.193.58:0/2857959708 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe428038690 con 0x7fe43415d4a0 2026-02-23T06:22:04.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.241+0000 7fe421ffb640 1 -- 10.20.193.58:0/2857959708 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe428038a80 con 0x7fe43415d4a0 2026-02-23T06:22:04.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.241+0000 7fe43a5d2640 1 -- 10.20.193.58:0/2857959708 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe434202250 con 0x7fe43415d4a0 2026-02-23T06:22:04.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.241+0000 7fe43a5d2640 1 -- 10.20.193.58:0/2857959708 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe434202810 con 0x7fe43415d4a0 2026-02-23T06:22:04.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.242+0000 7fe43a5d2640 1 --2- 10.20.193.58:0/2857959708 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe434202a30 0x7fe43413fb10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:04.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.242+0000 7fe43a5d2640 1 -- 10.20.193.58:0/2857959708 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe4340b5e10 con 0x7fe434202a30 2026-02-23T06:22:04.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.242+0000 7fe4395d0640 1 --2- 10.20.193.58:0/2857959708 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe434202a30 0x7fe43413fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:04.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.242+0000 7fe4395d0640 1 -- 10.20.193.58:0/2857959708 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe4340b5b30 con 0x7fe434202a30 2026-02-23T06:22:04.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.242+0000 7fe4395d0640 1 --2- 10.20.193.58:0/2857959708 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe434202a30 0x7fe43413fb10 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe424003760 tx=0x7fe42400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:04.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.243+0000 7fe421ffb640 1 -- 10.20.193.58:0/2857959708 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe424005e30 con 0x7fe434202a30 2026-02-23T06:22:04.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.243+0000 7fe421ffb640 1 -- 10.20.193.58:0/2857959708 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fe4240070d0 con 0x7fe434202a30 2026-02-23T06:22:04.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.243+0000 7fe421ffb640 1 -- 10.20.193.58:0/2857959708 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe434202a30 msgr2=0x7fe43413fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:04.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.243+0000 7fe421ffb640 1 --2- 10.20.193.58:0/2857959708 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe434202a30 0x7fe43413fb10 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe424003760 tx=0x7fe42400c910 comp rx=0 tx=0).stop 2026-02-23T06:22:04.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.243+0000 7fe421ffb640 1 -- 10.20.193.58:0/2857959708 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe434202a30 msgr2=0x7fe43413fb10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:22:04.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.243+0000 7fe421ffb640 1 --2- 10.20.193.58:0/2857959708 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe434202a30 0x7fe43413fb10 unknown :-1 s=CLOSED pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:04.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.243+0000 7fe421ffb640 1 -- 10.20.193.58:0/2857959708 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fe428038be0 con 0x7fe43415d4a0 2026-02-23T06:22:04.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.244+0000 7fe421ffb640 1 --2- 10.20.193.58:0/2857959708 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe40407a3c0 0x7fe40409a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:04.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.244+0000 7fe421ffb640 1 -- 10.20.193.58:0/2857959708 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7fe4280c2c60 con 0x7fe43415d4a0 2026-02-23T06:22:04.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.244+0000 7fe4395d0640 1 --2- 10.20.193.58:0/2857959708 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe40407a3c0 0x7fe40409a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:04.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.245+0000 7fe4395d0640 1 --2- 10.20.193.58:0/2857959708 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe40407a3c0 0x7fe40409a870 secure :-1 s=READY pgs=124 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4240028e0 tx=0x7fe42400a000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:04.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.247+0000 7fe43a5d2640 1 --2- 10.20.193.58:0/2857959708 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe43413f430 0x7fe434140050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:04.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.247+0000 7fe43a5d2640 1 -- 10.20.193.58:0/2857959708 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe434140590 con 0x7fe43413f430 2026-02-23T06:22:04.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.247+0000 7fe439dd1640 1 --2- 10.20.193.58:0/2857959708 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe43413f430 0x7fe434140050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:04.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.247+0000 7fe439dd1640 1 -- 10.20.193.58:0/2857959708 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe4340b6d50 con 0x7fe43413f430 2026-02-23T06:22:04.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.247+0000 7fe439dd1640 1 --2- 10.20.193.58:0/2857959708 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe43413f430 0x7fe434140050 secure :-1 s=READY pgs=212 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe430008fd0 tx=0x7fe43000ff10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:04.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.247+0000 7fe421ffb640 1 -- 10.20.193.58:0/2857959708 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe43001a070 con 0x7fe43413f430 2026-02-23T06:22:04.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.248+0000 7fe421ffb640 1 -- 10.20.193.58:0/2857959708 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5234 (secure 0 0 0) 0x7fe43000d990 con 0x7fe43413f430 2026-02-23T06:22:04.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.248+0000 7fe421ffb640 1 -- 10.20.193.58:0/2857959708 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe43413f430 msgr2=0x7fe434140050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:04.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.248+0000 7fe421ffb640 1 --2- 10.20.193.58:0/2857959708 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe43413f430 0x7fe434140050 secure :-1 s=READY pgs=212 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe430008fd0 tx=0x7fe43000ff10 comp rx=0 tx=0).stop 2026-02-23T06:22:04.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.248+0000 7fe421ffb640 1 -- 10.20.193.58:0/2857959708 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe43413f430 msgr2=0x7fe434140050 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:22:04.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.248+0000 7fe421ffb640 1 --2- 10.20.193.58:0/2857959708 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe43413f430 0x7fe434140050 unknown :-1 s=CLOSED pgs=212 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:04.245 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:22:04.245 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:22:04.245 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:22:04.245 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:22:04.245 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 8, 2026-02-23T06:22:04.245 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 62257, 2026-02-23T06:22:04.245 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:22:04.246 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:22:04.246 INFO:teuthology.orchestra.run.trial058.stdout: 1 2026-02-23T06:22:04.246 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:04.246 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 1, 2026-02-23T06:22:04.246 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:22:04.246 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:22:04.246 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:22:04.246 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:22:04.246 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:22:04.246 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:22:04.247 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:22:04.247 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:22:04.247 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:22:04.247 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:22:04.247 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:22:04.247 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:22:04.247 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:22:04.247 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:22:04.247 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:22:04.247 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:22:04.247 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:04.248 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:22:04.248 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:22:04.248 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:22:04.248 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:22:04.248 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:22:04.248 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:22:04.248 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:22:04.248 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:22:04.248 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:22:04.248 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:22:04.248 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:22:04.249 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:22:04.249 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:22:04.249 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:22:04.249 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:22:04.249 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:04.249 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:04.249 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:22:04.249 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:22:04.249 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:22:04.249 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:22:04.250 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:22:04.250 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:22:04.250 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:22:04.250 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:22:04.250 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:22:04.250 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:22:04.250 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:22:04.250 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:22:04.250 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:22:04.250 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:22:04.251 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:22:04.251 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:22:04.251 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:22:04.251 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:22:04.251 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:22:04.251 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:22:04.251 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:22:04.251 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:22:04.251 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:22:04.251 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:22:04.251 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:22:04.252 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:22:04.252 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:22:04.252 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:22:04.252 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:22:04.252 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:22:04.252 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:04.252 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:22:04.252 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:04.252 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:22:04.252 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:04.252 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:22:04.253 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:22:04.253 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:22:04.253 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:22:04.253 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:04.253 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:22:04.253 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:22:04.253 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:04.253 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:04.253 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:04.253 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:22:04.254 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:22:04.254 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:04.254 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:04.254 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:04.254 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:04.254 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:22:04.254 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:22:04.254 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:22:04.254 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:22:04.254 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:22:04.254 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:22:04.255 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:04.255 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:04.255 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:22:04.255 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:22:04.255 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:22:04.255 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:22:04.255 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:04.255 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:22:04.255 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:22:04.255 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:04.255 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:04.256 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:04.256 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:22:04.256 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:22:04.256 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:04.256 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:04.256 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:04.256 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:04.256 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:22:04.256 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:22:04.256 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:22:04.256 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:22:04.257 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:22:04.257 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:22:04.257 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:04.257 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:04.257 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:22:04.257 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:22:04.257 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:22:04.257 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:22:04.257 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:04.257 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:22:04.257 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:22:04.258 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:04.258 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:04.258 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:04.258 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:22:04.258 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:22:04.258 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:04.258 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:04.258 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:04.258 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:04.258 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:22:04.258 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:22:04.259 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:22:04.259 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:22:04.259 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:22:04.259 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:22:04.259 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:04.259 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:04.259 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:04.259 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:22:04.259 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:22:04.259 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:04.259 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:04.260 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:04.260 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:22:04.260 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:04.260 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:04.260 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:22:04.260 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:04.260 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:04.260 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:04.260 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:22:04.260 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:04.260 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:04.261 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:22:04.261 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:04.261 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:04.261 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:04.261 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:22:04.261 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:04.261 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:04.261 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:22:04.261 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:04.261 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:04.261 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:04.262 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:22:04.262 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:04.262 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:04.262 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:04.262 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:22:04.262 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:22:04.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.248+0000 7fe43a5d2640 1 -- 10.20.193.58:0/2857959708 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe40407a3c0 msgr2=0x7fe40409a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:04.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.248+0000 7fe43a5d2640 1 --2- 10.20.193.58:0/2857959708 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe40407a3c0 0x7fe40409a870 secure :-1 s=READY pgs=124 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4240028e0 tx=0x7fe42400a000 comp rx=0 tx=0).stop 2026-02-23T06:22:04.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.248+0000 7fe43a5d2640 1 -- 10.20.193.58:0/2857959708 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe43415d4a0 msgr2=0x7fe434057860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:04.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.248+0000 7fe43a5d2640 1 --2- 10.20.193.58:0/2857959708 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe43415d4a0 0x7fe434057860 secure :-1 s=READY pgs=200 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4280097e0 tx=0x7fe428002a10 comp rx=0 tx=0).stop 2026-02-23T06:22:04.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.248+0000 7fe439dd1640 1 -- 10.20.193.58:0/2857959708 reap_dead start 2026-02-23T06:22:04.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.248+0000 7fe439dd1640 1 -- 10.20.193.58:0/2857959708 reap_dead start 2026-02-23T06:22:04.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.248+0000 7fe43a5d2640 1 -- 10.20.193.58:0/2857959708 shutdown_connections 2026-02-23T06:22:04.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.248+0000 7fe43a5d2640 1 -- 10.20.193.58:0/2857959708 >> 10.20.193.58:0/2857959708 conn(0x7fe4340b3c20 msgr2=0x7fe4341633c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:22:04.265 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.248+0000 7fe43a5d2640 1 -- 10.20.193.58:0/2857959708 shutdown_connections 2026-02-23T06:22:04.265 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.248+0000 7fe43a5d2640 1 -- 10.20.193.58:0/2857959708 wait complete. 2026-02-23T06:22:04.265 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:22:04.265 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-23T06:22:04.266 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:22:04.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.394+0000 7f1d2f577640 1 -- 10.20.193.58:0/536751903 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1d3015d870 msgr2=0x7f1d300587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:04.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.394+0000 7f1d2f577640 1 --2- 10.20.193.58:0/536751903 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1d3015d870 0x7f1d300587b0 secure :-1 s=READY pgs=201 gs=2 cs=0 l=1 c_cookie=8115166286513882288 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d18005e70 tx=0x7f1d1802f2b0 comp rx=0 tx=0).stop 2026-02-23T06:22:04.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.394+0000 7f1d2f577640 1 -- 10.20.193.58:0/536751903 shutdown_connections 2026-02-23T06:22:04.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.394+0000 7f1d2f577640 1 --2- 10.20.193.58:0/536751903 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1d300b6690 0x7f1d30058cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:04.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.394+0000 7f1d2f577640 1 --2- 10.20.193.58:0/536751903 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1d3015d870 0x7f1d300587b0 unknown :-1 s=CLOSED pgs=201 gs=2 cs=0 l=1 c_cookie=8115166286513882288 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:04.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.394+0000 7f1d2f577640 1 -- 10.20.193.58:0/536751903 >> 10.20.193.58:0/536751903 conn(0x7f1d300b3c20 msgr2=0x7f1d300b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:22:04.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.394+0000 7f1d2f577640 1 -- 10.20.193.58:0/536751903 shutdown_connections 2026-02-23T06:22:04.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.394+0000 7f1d2f577640 1 -- 10.20.193.58:0/536751903 wait complete. 2026-02-23T06:22:04.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.395+0000 7f1d2f577640 1 Processor -- start 2026-02-23T06:22:04.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.395+0000 7f1d2f577640 1 -- start start 2026-02-23T06:22:04.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.396+0000 7f1d2f577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1d300b6690 0x7f1d3015a530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:04.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.396+0000 7f1d2f577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1d3015d4a0 0x7f1d300adce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:04.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.396+0000 7f1d2f577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1d3015d870 0x7f1d300ae220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:04.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.396+0000 7f1d2f577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3005bfd0 con 0x7f1d3015d870 2026-02-23T06:22:04.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.396+0000 7f1d2f577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3005c3d0 con 0x7f1d3015d4a0 2026-02-23T06:22:04.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.396+0000 7f1d2f577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f1d3005bd30 con 0x7f1d300b6690 2026-02-23T06:22:04.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.396+0000 7f1d2e575640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1d300b6690 msgr2=0x7f1d3015a530 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:22:04.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.396+0000 7f1d2e575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1d300b6690 0x7f1d3015a530 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:22:04.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.397+0000 7f1d2dd74640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1d3015d4a0 0x7f1d300adce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:04.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.397+0000 7f1d2dd74640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1d3015d4a0 0x7f1d300adce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:53472/0 (socket says 10.20.193.58:53472) 2026-02-23T06:22:04.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.397+0000 7f1d2dd74640 1 -- 10.20.193.58:0/2349135756 learned_addr learned my addr 10.20.193.58:0/2349135756 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:22:04.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.397+0000 7f1d2ed76640 1 --2- 10.20.193.58:0/2349135756 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1d3015d870 0x7f1d300ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:04.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.397+0000 7f1d2dd74640 1 -- 10.20.193.58:0/2349135756 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1d300b6690 msgr2=0x7f1d3015a530 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:22:04.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.397+0000 7f1d2dd74640 1 --2- 10.20.193.58:0/2349135756 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1d300b6690 0x7f1d3015a530 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:04.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.397+0000 7f1d2dd74640 1 -- 10.20.193.58:0/2349135756 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1d3015d870 msgr2=0x7f1d300ae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:04.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.397+0000 7f1d2dd74640 1 --2- 10.20.193.58:0/2349135756 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1d3015d870 0x7f1d300ae220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:04.395 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.397+0000 7f1d2dd74640 1 -- 10.20.193.58:0/2349135756 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d18009570 con 0x7f1d3015d4a0 2026-02-23T06:22:04.395 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.397+0000 7f1d2dd74640 1 --2- 10.20.193.58:0/2349135756 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1d3015d4a0 0x7f1d300adce0 secure :-1 s=READY pgs=202 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d18004740 tx=0x7f1d18002a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:04.395 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.397+0000 7f1d16ffd640 1 -- 10.20.193.58:0/2349135756 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1d1803d070 con 0x7f1d3015d4a0 2026-02-23T06:22:04.395 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.397+0000 7f1d16ffd640 1 -- 10.20.193.58:0/2349135756 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d18004a70 con 0x7f1d3015d4a0 2026-02-23T06:22:04.395 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.397+0000 7f1d16ffd640 1 -- 10.20.193.58:0/2349135756 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1d18004e40 con 0x7f1d3015d4a0 2026-02-23T06:22:04.395 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.397+0000 7f1d2f577640 1 -- 10.20.193.58:0/2349135756 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d3013df50 con 0x7f1d3015d4a0 2026-02-23T06:22:04.395 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.397+0000 7f1d2f577640 1 -- 10.20.193.58:0/2349135756 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d30202eb0 con 0x7f1d3015d4a0 2026-02-23T06:22:04.395 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.398+0000 7f1d2f577640 1 --2- 10.20.193.58:0/2349135756 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1d3013e430 0x7f1d3013e800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:04.395 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.398+0000 7f1d2f577640 1 -- 10.20.193.58:0/2349135756 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f1d300609c0 con 0x7f1d3013e430 2026-02-23T06:22:04.395 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.398+0000 7f1d2e575640 1 --2- 10.20.193.58:0/2349135756 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1d3013e430 0x7f1d3013e800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:04.395 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.399+0000 7f1d2e575640 1 -- 10.20.193.58:0/2349135756 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1d300b6330 con 0x7f1d3013e430 2026-02-23T06:22:04.397 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.399+0000 7f1d2e575640 1 --2- 10.20.193.58:0/2349135756 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1d3013e430 0x7f1d3013e800 secure :-1 s=READY pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d2400c450 tx=0x7f1d2400c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:04.397 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.399+0000 7f1d16ffd640 1 -- 10.20.193.58:0/2349135756 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1d24005cb0 con 0x7f1d3013e430 2026-02-23T06:22:04.397 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.399+0000 7f1d16ffd640 1 -- 10.20.193.58:0/2349135756 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f1d24005e10 con 0x7f1d3013e430 2026-02-23T06:22:04.397 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.399+0000 7f1d16ffd640 1 -- 10.20.193.58:0/2349135756 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1d3013e430 msgr2=0x7f1d3013e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:04.397 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.399+0000 7f1d16ffd640 1 --2- 10.20.193.58:0/2349135756 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1d3013e430 0x7f1d3013e800 secure :-1 s=READY pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d2400c450 tx=0x7f1d2400c920 comp rx=0 tx=0).stop 2026-02-23T06:22:04.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.399+0000 7f1d16ffd640 1 -- 10.20.193.58:0/2349135756 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1d3013e430 msgr2=0x7f1d3013e800 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:22:04.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.399+0000 7f1d16ffd640 1 --2- 10.20.193.58:0/2349135756 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1d3013e430 0x7f1d3013e800 unknown :-1 s=CLOSED pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:04.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.400+0000 7f1d16ffd640 1 -- 10.20.193.58:0/2349135756 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f1d18004fa0 con 0x7f1d3015d4a0 2026-02-23T06:22:04.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.401+0000 7f1d16ffd640 1 --2- 10.20.193.58:0/2349135756 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1cfc07a3c0 0x7f1cfc09a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:04.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.401+0000 7f1d16ffd640 1 -- 10.20.193.58:0/2349135756 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6479+0+0 (secure 0 0 0) 0x7f1d180c2480 con 0x7f1d3015d4a0 2026-02-23T06:22:04.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.401+0000 7f1d2e575640 1 --2- 10.20.193.58:0/2349135756 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1cfc07a3c0 0x7f1cfc09a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:04.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.401+0000 7f1d2e575640 1 --2- 10.20.193.58:0/2349135756 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1cfc07a3c0 0x7f1cfc09a870 secure :-1 s=READY pgs=125 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d2400ce80 tx=0x7f1d24007f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:04.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.403+0000 7f1d2f577640 1 --2- 10.20.193.58:0/2349135756 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1d30205540 0x7f1d30205940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:04.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.403+0000 7f1d2f577640 1 -- 10.20.193.58:0/2349135756 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f1d30164250 con 0x7f1d30205540 2026-02-23T06:22:04.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.403+0000 7f1d2ed76640 1 --2- 10.20.193.58:0/2349135756 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1d30205540 0x7f1d30205940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:04.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.404+0000 7f1d2ed76640 1 -- 10.20.193.58:0/2349135756 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1d300b6d50 con 0x7f1d30205540 2026-02-23T06:22:04.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.404+0000 7f1d2ed76640 1 --2- 10.20.193.58:0/2349135756 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1d30205540 0x7f1d30205940 secure :-1 s=READY pgs=204 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d20003900 tx=0x7f1d2000a9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:04.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.404+0000 7f1d16ffd640 1 -- 10.20.193.58:0/2349135756 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1d2000f870 con 0x7f1d30205540 2026-02-23T06:22:04.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.404+0000 7f1d16ffd640 1 -- 10.20.193.58:0/2349135756 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5542 (secure 0 0 0) 0x7f1d2000f9d0 con 0x7f1d30205540 2026-02-23T06:22:04.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.404+0000 7f1d16ffd640 1 -- 10.20.193.58:0/2349135756 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1d30205540 msgr2=0x7f1d30205940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:04.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.404+0000 7f1d16ffd640 1 --2- 10.20.193.58:0/2349135756 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1d30205540 0x7f1d30205940 secure :-1 s=READY pgs=204 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d20003900 tx=0x7f1d2000a9f0 comp rx=0 tx=0).stop 2026-02-23T06:22:04.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.404+0000 7f1d16ffd640 1 -- 10.20.193.58:0/2349135756 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1d30205540 msgr2=0x7f1d30205940 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:22:04.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.404+0000 7f1d16ffd640 1 --2- 10.20.193.58:0/2349135756 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1d30205540 0x7f1d30205940 secure :-1 s=CLOSED pgs=204 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d20003900 tx=0x7f1d2000a9f0 comp rx=0 tx=0).stop 2026-02-23T06:22:04.401 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:22:04.401 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:22:04.401 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:22:04.401 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:22:04.402 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 8, 2026-02-23T06:22:04.402 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 62450, 2026-02-23T06:22:04.402 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:22:04.402 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:22:04.402 INFO:teuthology.orchestra.run.trial058.stdout: 1 2026-02-23T06:22:04.402 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:04.402 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 1, 2026-02-23T06:22:04.402 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:22:04.402 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:22:04.402 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:22:04.402 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:22:04.403 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:22:04.403 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:22:04.403 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:22:04.403 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:22:04.403 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:22:04.403 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:22:04.403 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:22:04.403 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:22:04.403 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:22:04.403 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:22:04.403 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:22:04.403 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:22:04.404 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:04.404 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:22:04.404 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:22:04.404 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:22:04.404 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:22:04.404 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:22:04.404 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:22:04.404 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:22:04.404 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:22:04.404 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:22:04.404 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:22:04.405 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:22:04.405 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:22:04.405 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:22:04.405 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:22:04.405 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:22:04.405 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:04.405 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:04.405 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:22:04.405 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:22:04.405 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:22:04.405 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:22:04.405 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:22:04.406 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:22:04.406 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:22:04.406 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:22:04.406 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:22:04.406 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:22:04.406 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:22:04.406 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:22:04.406 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:22:04.406 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:22:04.406 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:22:04.406 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:22:04.406 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:22:04.407 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:22:04.407 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:22:04.407 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:22:04.407 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:22:04.407 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:22:04.407 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:22:04.407 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:22:04.407 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:22:04.407 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:22:04.407 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:22:04.407 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:22:04.407 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:22:04.408 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:22:04.408 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:04.408 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:22:04.408 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:04.408 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:22:04.408 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:04.408 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:22:04.408 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:22:04.408 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:22:04.408 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:22:04.408 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:04.409 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:22:04.409 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:22:04.409 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:04.409 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:04.409 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:04.409 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:22:04.409 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:22:04.409 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:04.409 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:04.409 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:04.409 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:04.409 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:22:04.410 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:22:04.410 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:22:04.410 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:22:04.410 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:22:04.410 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:22:04.410 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:04.410 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:04.410 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:22:04.410 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:22:04.410 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:22:04.410 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:22:04.411 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:04.411 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:22:04.411 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:22:04.411 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:04.411 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:04.411 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:04.411 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:22:04.411 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:22:04.411 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:04.411 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:04.412 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:04.412 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:04.412 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:22:04.412 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:22:04.412 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:22:04.412 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:22:04.412 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:22:04.412 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:22:04.412 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:04.412 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:04.412 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:22:04.412 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:22:04.412 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:22:04.413 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:22:04.413 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:04.413 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:22:04.413 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:22:04.413 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:04.413 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:04.413 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:04.413 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:22:04.413 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:22:04.413 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:04.413 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:04.413 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:04.413 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:04.414 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:22:04.414 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:22:04.414 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:22:04.414 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:22:04.414 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:22:04.414 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:22:04.414 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:04.414 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:04.414 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:04.414 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:22:04.414 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:22:04.414 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:04.415 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:04.415 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:04.415 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:22:04.415 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:04.415 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:04.415 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:22:04.415 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:04.415 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:04.415 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:04.415 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:22:04.415 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:04.416 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:04.416 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:22:04.416 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:04.416 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:04.416 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:04.416 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:22:04.416 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:04.416 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:04.416 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:22:04.416 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:04.416 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:22:04.416 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:22:04.416 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:22:04.417 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:04.417 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:04.417 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:04.417 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:04.417 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:22:04.417 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:04.417 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:04.417 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:22:04.417 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:04.417 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:04.417 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:04.417 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:22:04.417 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:04.418 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:04.418 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:04.418 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:22:04.418 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:22:04.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.405+0000 7f1d2f577640 1 -- 10.20.193.58:0/2349135756 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1cfc07a3c0 msgr2=0x7f1cfc09a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:04.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.405+0000 7f1d2f577640 1 --2- 10.20.193.58:0/2349135756 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1cfc07a3c0 0x7f1cfc09a870 secure :-1 s=READY pgs=125 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d2400ce80 tx=0x7f1d24007f90 comp rx=0 tx=0).stop 2026-02-23T06:22:04.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.405+0000 7f1d2f577640 1 -- 10.20.193.58:0/2349135756 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1d3015d4a0 msgr2=0x7f1d300adce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:04.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.405+0000 7f1d2f577640 1 --2- 10.20.193.58:0/2349135756 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1d3015d4a0 0x7f1d300adce0 secure :-1 s=READY pgs=202 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d18004740 tx=0x7f1d18002a10 comp rx=0 tx=0).stop 2026-02-23T06:22:04.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.405+0000 7f1d2ed76640 1 -- 10.20.193.58:0/2349135756 reap_dead start 2026-02-23T06:22:04.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.405+0000 7f1d2f577640 1 -- 10.20.193.58:0/2349135756 shutdown_connections 2026-02-23T06:22:04.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.405+0000 7f1d2f577640 1 --2- 10.20.193.58:0/2349135756 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1d3015d4a0 0x7f1d300adce0 unknown :-1 s=CLOSED pgs=202 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:04.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.405+0000 7f1d2f577640 1 -- 10.20.193.58:0/2349135756 >> 10.20.193.58:0/2349135756 conn(0x7f1d300b3c20 msgr2=0x7f1d3013c750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:22:04.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.405+0000 7f1d2f577640 1 -- 10.20.193.58:0/2349135756 shutdown_connections 2026-02-23T06:22:04.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:04.405+0000 7f1d2f577640 1 -- 10.20.193.58:0/2349135756 wait complete. 2026-02-23T06:22:04.421 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:22:04.421 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:22:11.887 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:22:11.892 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:22:20.862 INFO:tasks.workunit.client.0.trial058.stderr:Note: switching to 'b60f86513d744c550fab39595f0905abce2bdd7d'. 2026-02-23T06:22:20.862 INFO:tasks.workunit.client.0.trial058.stderr: 2026-02-23T06:22:20.863 INFO:tasks.workunit.client.0.trial058.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-23T06:22:20.863 INFO:tasks.workunit.client.0.trial058.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-23T06:22:20.863 INFO:tasks.workunit.client.0.trial058.stderr:state without impacting any branches by switching back to a branch. 2026-02-23T06:22:20.863 INFO:tasks.workunit.client.0.trial058.stderr: 2026-02-23T06:22:20.863 INFO:tasks.workunit.client.0.trial058.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-23T06:22:20.863 INFO:tasks.workunit.client.0.trial058.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-23T06:22:20.863 INFO:tasks.workunit.client.0.trial058.stderr: 2026-02-23T06:22:20.863 INFO:tasks.workunit.client.0.trial058.stderr: git switch -c 2026-02-23T06:22:20.863 INFO:tasks.workunit.client.0.trial058.stderr: 2026-02-23T06:22:20.863 INFO:tasks.workunit.client.0.trial058.stderr:Or undo this operation with: 2026-02-23T06:22:20.863 INFO:tasks.workunit.client.0.trial058.stderr: 2026-02-23T06:22:20.863 INFO:tasks.workunit.client.0.trial058.stderr: git switch - 2026-02-23T06:22:20.863 INFO:tasks.workunit.client.0.trial058.stderr: 2026-02-23T06:22:20.863 INFO:tasks.workunit.client.0.trial058.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-23T06:22:20.863 INFO:tasks.workunit.client.0.trial058.stderr: 2026-02-23T06:22:20.863 INFO:tasks.workunit.client.0.trial058.stderr:HEAD is now at b60f86513d7 Merge PR #65858 into wip-vshankar-testing-20260222.101816 2026-02-23T06:22:20.881 DEBUG:teuthology.orchestra.run.trial058:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-23T06:22:20.922 INFO:tasks.workunit.client.0.trial058.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-23T06:22:20.926 INFO:tasks.workunit.client.0.trial058.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-23T06:22:20.926 INFO:tasks.workunit.client.0.trial058.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-23T06:22:21.069 INFO:tasks.workunit.client.0.trial058.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-23T06:22:21.129 INFO:tasks.workunit.client.0.trial058.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-23T06:22:21.180 INFO:tasks.workunit.client.0.trial058.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-23T06:22:21.183 INFO:tasks.workunit.client.0.trial058.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-23T06:22:21.183 INFO:tasks.workunit.client.0.trial058.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-23T06:22:21.236 INFO:tasks.workunit.client.0.trial058.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-23T06:22:21.244 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:22:21.244 DEBUG:teuthology.orchestra.run.trial058:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-23T06:22:21.322 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2026-02-23T06:22:21.325 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2026-02-23T06:22:21.325 DEBUG:teuthology.orchestra.run.trial058:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b60f86513d744c550fab39595f0905abce2bdd7d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2026-02-23T06:22:21.416 INFO:tasks.workunit.client.0.trial058.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2026-02-23T06:22:21.417 INFO:tasks.workunit.client.0.trial058.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/suites 2026-02-23T06:22:21.417 INFO:tasks.workunit.client.0.trial058.stderr:+ trap -- retry EXIT 2026-02-23T06:22:21.418 INFO:tasks.workunit.client.0.trial058.stderr:+ rm -rf ffsb 2026-02-23T06:22:21.419 INFO:tasks.workunit.client.0.trial058.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2026-02-23T06:22:21.424 INFO:tasks.workunit.client.0.trial058.stderr:Cloning into 'ffsb'... 2026-02-23T06:22:23.396 INFO:tasks.workunit.client.0.trial058.stderr:+ trap - EXIT 2026-02-23T06:22:23.396 INFO:tasks.workunit.client.0.trial058.stderr:+ cd ffsb 2026-02-23T06:22:23.396 INFO:tasks.workunit.client.0.trial058.stderr:+ ./configure 2026-02-23T06:22:23.580 INFO:tasks.workunit.client.0.trial058.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2026-02-23T06:22:24.422 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-23T06:22:24.422 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-23T06:22:24.422 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-23T06:22:24.423 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-23T06:22:24.425 INFO:tasks.ceph.mon.c:Started 2026-02-23T06:22:24.425 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:22:24.426 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:22:24.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.551+0000 7ff2c1b44640 1 -- 10.20.193.58:0/58435812 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff2bc0b6690 msgr2=0x7ff2bc058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:24.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.551+0000 7ff2c1b44640 1 --2- 10.20.193.58:0/58435812 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff2bc0b6690 0x7ff2bc058cf0 secure :-1 s=READY pgs=208 gs=3 cs=0 l=1 c_cookie=6085753288384296790 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2b8005820 tx=0x7ff2b80302b0 comp rx=0 tx=0).stop 2026-02-23T06:22:24.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.551+0000 7ff2c1b44640 1 -- 10.20.193.58:0/58435812 shutdown_connections 2026-02-23T06:22:24.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.551+0000 7ff2c1b44640 1 --2- 10.20.193.58:0/58435812 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff2bc0b6690 0x7ff2bc058cf0 unknown :-1 s=CLOSED pgs=208 gs=3 cs=0 l=1 c_cookie=6085753288384296790 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:24.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.551+0000 7ff2c1b44640 1 --2- 10.20.193.58:0/58435812 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff2bc15d870 0x7ff2bc0587b0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:24.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.551+0000 7ff2c1b44640 1 -- 10.20.193.58:0/58435812 >> 10.20.193.58:0/58435812 conn(0x7ff2bc0b3c20 msgr2=0x7ff2bc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:22:24.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.551+0000 7ff2c1b44640 1 -- 10.20.193.58:0/58435812 shutdown_connections 2026-02-23T06:22:24.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.551+0000 7ff2c1b44640 1 -- 10.20.193.58:0/58435812 wait complete. 2026-02-23T06:22:24.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.553+0000 7ff2c1b44640 1 Processor -- start 2026-02-23T06:22:24.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.553+0000 7ff2c1b44640 1 -- start start 2026-02-23T06:22:24.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.553+0000 7ff2c1b44640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff2bc0b6690 0x7ff2bc13ff30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:24.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.553+0000 7ff2c1b44640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff2bc15d4a0 0x7ff2bc129070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:24.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.553+0000 7ff2c1b44640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff2bc15d870 0x7ff2bc140ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:24.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.553+0000 7ff2c1b44640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc13f500 con 0x7ff2bc0b6690 2026-02-23T06:22:24.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.553+0000 7ff2c1b44640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc140470 con 0x7ff2bc15d4a0 2026-02-23T06:22:24.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.553+0000 7ff2c1b44640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7ff2bc142230 con 0x7ff2bc15d870 2026-02-23T06:22:24.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.553+0000 7ff2c1343640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff2bc15d870 0x7ff2bc140ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:24.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.553+0000 7ff2c0b42640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff2bc0b6690 0x7ff2bc13ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:24.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.553+0000 7ff2c0b42640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff2bc0b6690 0x7ff2bc13ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:40932/0 (socket says 10.20.193.58:40932) 2026-02-23T06:22:24.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.553+0000 7ff2c0b42640 1 -- 10.20.193.58:0/2094900104 learned_addr learned my addr 10.20.193.58:0/2094900104 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:22:24.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.553+0000 7ff2b3fff640 1 --2- 10.20.193.58:0/2094900104 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff2bc15d4a0 0x7ff2bc129070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:24.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.553+0000 7ff2c1343640 1 -- 10.20.193.58:0/2094900104 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff2bc15d870 msgr2=0x7ff2bc140ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-23T06:22:24.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.553+0000 7ff2c1343640 1 -- 10.20.193.58:0/2094900104 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff2bc15d870 msgr2=0x7ff2bc140ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:22:24.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.553+0000 7ff2c1343640 1 --2- 10.20.193.58:0/2094900104 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff2bc15d870 0x7ff2bc140ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:22:24.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.554+0000 7ff2c1343640 1 --2- 10.20.193.58:0/2094900104 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff2bc15d870 0x7ff2bc140ad0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:22:24.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.554+0000 7ff2c0b42640 1 -- 10.20.193.58:0/2094900104 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff2bc15d870 msgr2=0x7ff2bc140ad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:22:24.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.554+0000 7ff2c0b42640 1 --2- 10.20.193.58:0/2094900104 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff2bc15d870 0x7ff2bc140ad0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:24.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.554+0000 7ff2c0b42640 1 -- 10.20.193.58:0/2094900104 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff2bc15d4a0 msgr2=0x7ff2bc129070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:24.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.554+0000 7ff2c0b42640 1 --2- 10.20.193.58:0/2094900104 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff2bc15d4a0 0x7ff2bc129070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:24.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.554+0000 7ff2c0b42640 1 -- 10.20.193.58:0/2094900104 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b800a590 con 0x7ff2bc0b6690 2026-02-23T06:22:24.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.554+0000 7ff2c0b42640 1 --2- 10.20.193.58:0/2094900104 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff2bc0b6690 0x7ff2bc13ff30 secure :-1 s=READY pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2ac00c700 tx=0x7ff2ac00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:24.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.554+0000 7ff2b17fa640 1 -- 10.20.193.58:0/2094900104 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2ac005290 con 0x7ff2bc0b6690 2026-02-23T06:22:24.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.554+0000 7ff2b17fa640 1 -- 10.20.193.58:0/2094900104 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2ac005410 con 0x7ff2bc0b6690 2026-02-23T06:22:24.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.554+0000 7ff2b17fa640 1 -- 10.20.193.58:0/2094900104 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2ac003930 con 0x7ff2bc0b6690 2026-02-23T06:22:24.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.554+0000 7ff2c1b44640 1 -- 10.20.193.58:0/2094900104 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2bc13f220 con 0x7ff2bc0b6690 2026-02-23T06:22:24.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.554+0000 7ff2c1b44640 1 -- 10.20.193.58:0/2094900104 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2bc144550 con 0x7ff2bc0b6690 2026-02-23T06:22:24.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.555+0000 7ff2c1b44640 1 -- 10.20.193.58:0/2094900104 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2bc0b6d50 con 0x7ff2bc0b6690 2026-02-23T06:22:24.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.556+0000 7ff2b17fa640 1 -- 10.20.193.58:0/2094900104 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7ff2ac019020 con 0x7ff2bc0b6690 2026-02-23T06:22:24.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.557+0000 7ff2b17fa640 1 --2- 10.20.193.58:0/2094900104 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff28c07a790 0x7ff28c09ac40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:24.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.557+0000 7ff2b17fa640 1 -- 10.20.193.58:0/2094900104 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7ff2ac09d5a0 con 0x7ff2bc0b6690 2026-02-23T06:22:24.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.557+0000 7ff2b3fff640 1 --2- 10.20.193.58:0/2094900104 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff28c07a790 0x7ff28c09ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:24.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.557+0000 7ff2b17fa640 1 -- 10.20.193.58:0/2094900104 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7ff2ac060990 con 0x7ff2bc0b6690 2026-02-23T06:22:24.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.558+0000 7ff2b3fff640 1 --2- 10.20.193.58:0/2094900104 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff28c07a790 0x7ff28c09ac40 secure :-1 s=READY pgs=127 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2bc142100 tx=0x7ff2a400b410 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:24.590 INFO:tasks.workunit.client.0.trial058.stdout:checking whether build environment is sane... yes 2026-02-23T06:22:24.606 INFO:tasks.workunit.client.0.trial058.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2026-02-23T06:22:24.606 INFO:tasks.workunit.client.0.trial058.stdout:checking for gawk... gawk 2026-02-23T06:22:24.623 INFO:tasks.workunit.client.0.trial058.stdout:checking whether make sets $(MAKE)... yes 2026-02-23T06:22:24.686 INFO:tasks.workunit.client.0.trial058.stdout:checking build system type... x86_64-unknown-linux-gnu 2026-02-23T06:22:24.686 INFO:tasks.workunit.client.0.trial058.stdout:checking host system type... x86_64-unknown-linux-gnu 2026-02-23T06:22:24.696 INFO:tasks.workunit.client.0.trial058.stdout:checking for style of include used by make... GNU 2026-02-23T06:22:24.699 INFO:tasks.workunit.client.0.trial058.stdout:checking for gcc... gcc 2026-02-23T06:22:24.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.712+0000 7ff2c1b44640 1 -- 10.20.193.58:0/2094900104 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff2bc0b06c0 con 0x7ff2bc0b6690 2026-02-23T06:22:24.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.712+0000 7ff2b17fa640 1 -- 10.20.193.58:0/2094900104 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1754 (secure 0 0 0) 0x7ff2bc0b06c0 con 0x7ff2bc0b6690 2026-02-23T06:22:24.708 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:22:24.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.714+0000 7ff2c1b44640 1 -- 10.20.193.58:0/2094900104 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff28c07a790 msgr2=0x7ff28c09ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:24.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.714+0000 7ff2c1b44640 1 --2- 10.20.193.58:0/2094900104 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff28c07a790 0x7ff28c09ac40 secure :-1 s=READY pgs=127 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2bc142100 tx=0x7ff2a400b410 comp rx=0 tx=0).stop 2026-02-23T06:22:24.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.714+0000 7ff2c1b44640 1 -- 10.20.193.58:0/2094900104 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff2bc0b6690 msgr2=0x7ff2bc13ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:24.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.714+0000 7ff2c1b44640 1 --2- 10.20.193.58:0/2094900104 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff2bc0b6690 0x7ff2bc13ff30 secure :-1 s=READY pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2ac00c700 tx=0x7ff2ac00cbd0 comp rx=0 tx=0).stop 2026-02-23T06:22:24.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.714+0000 7ff2c1b44640 1 -- 10.20.193.58:0/2094900104 shutdown_connections 2026-02-23T06:22:24.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.714+0000 7ff2c1b44640 1 --2- 10.20.193.58:0/2094900104 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff28c07a790 0x7ff28c09ac40 unknown :-1 s=CLOSED pgs=127 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:24.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.714+0000 7ff2c1b44640 1 --2- 10.20.193.58:0/2094900104 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff2bc15d870 0x7ff2bc140ad0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:24.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.714+0000 7ff2c1b44640 1 --2- 10.20.193.58:0/2094900104 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff2bc15d4a0 0x7ff2bc129070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:24.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.714+0000 7ff2c1b44640 1 --2- 10.20.193.58:0/2094900104 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff2bc0b6690 0x7ff2bc13ff30 unknown :-1 s=CLOSED pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:24.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.714+0000 7ff2c1b44640 1 -- 10.20.193.58:0/2094900104 >> 10.20.193.58:0/2094900104 conn(0x7ff2bc0b3c20 msgr2=0x7ff2bc05c150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:22:24.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.714+0000 7ff2c1b44640 1 -- 10.20.193.58:0/2094900104 shutdown_connections 2026-02-23T06:22:24.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.714+0000 7ff2c1b44640 1 -- 10.20.193.58:0/2094900104 wait complete. 2026-02-23T06:22:24.722 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:22:24.722 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:22:24.722 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:22:24.779 INFO:tasks.workunit.client.0.trial058.stdout:checking for C compiler default output file name... a.out 2026-02-23T06:22:24.784 INFO:tasks.workunit.client.0.trial058.stdout:checking whether the C compiler works... yes 2026-02-23T06:22:24.786 INFO:tasks.workunit.client.0.trial058.stdout:checking whether we are cross compiling... no 2026-02-23T06:22:24.834 INFO:tasks.workunit.client.0.trial058.stdout:checking for suffix of executables... 2026-02-23T06:22:24.848 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.853+0000 7f6033083640 1 -- 10.20.193.58:0/1597021530 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6014004de0 msgr2=0x7f6014005250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:24.848 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.853+0000 7f6033083640 1 --2- 10.20.193.58:0/1597021530 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6014004de0 0x7f6014005250 secure :-1 s=READY pgs=218 gs=7 cs=0 l=1 c_cookie=3993486295649741232 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6028007fd0 tx=0x7f6028030960 comp rx=0 tx=0).stop 2026-02-23T06:22:24.848 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.853+0000 7f6032882640 1 -- 10.20.193.58:0/1597021530 reap_dead start 2026-02-23T06:22:24.848 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.853+0000 7f6033083640 1 -- 10.20.193.58:0/1597021530 shutdown_connections 2026-02-23T06:22:24.848 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.853+0000 7f6033083640 1 -- 10.20.193.58:0/1597021530 >> 10.20.193.58:0/1597021530 conn(0x7f602c054e40 msgr2=0x7f602c057b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:22:24.848 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.853+0000 7f6033083640 1 -- 10.20.193.58:0/1597021530 shutdown_connections 2026-02-23T06:22:24.848 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.854+0000 7f6033083640 1 -- 10.20.193.58:0/1597021530 wait complete. 2026-02-23T06:22:24.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.855+0000 7f6033083640 1 Processor -- start 2026-02-23T06:22:24.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.855+0000 7f6033083640 1 -- start start 2026-02-23T06:22:24.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.855+0000 7f6033083640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f602c119440 0x7f602c1160e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:24.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.855+0000 7f6033083640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f602c11ab00 0x7f602c116620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:24.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.855+0000 7f6033083640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f602c119810 0x7f602c1491e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:24.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.855+0000 7f6033083640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f602c114ed0 con 0x7f602c119810 2026-02-23T06:22:24.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.855+0000 7f6033083640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f602c137d10 con 0x7f602c11ab00 2026-02-23T06:22:24.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.855+0000 7f6033083640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f602c115d10 con 0x7f602c119440 2026-02-23T06:22:24.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.855+0000 7f6031880640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f602c11ab00 0x7f602c116620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:24.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.855+0000 7f6032882640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f602c119810 0x7f602c1491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:24.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.855+0000 7f6031880640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f602c11ab00 0x7f602c116620 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:50502/0 (socket says 10.20.193.58:50502) 2026-02-23T06:22:24.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.855+0000 7f6031880640 1 -- 10.20.193.58:0/942353771 learned_addr learned my addr 10.20.193.58:0/942353771 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:22:24.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.855+0000 7f6032081640 1 --2- 10.20.193.58:0/942353771 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f602c119440 0x7f602c1160e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:24.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.856+0000 7f6032882640 1 -- 10.20.193.58:0/942353771 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f602c119440 msgr2=0x7f602c1160e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:24.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.856+0000 7f6032882640 1 --2- 10.20.193.58:0/942353771 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f602c119440 0x7f602c1160e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:24.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.856+0000 7f6032882640 1 -- 10.20.193.58:0/942353771 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f602c11ab00 msgr2=0x7f602c116620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:24.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.856+0000 7f6032882640 1 --2- 10.20.193.58:0/942353771 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f602c11ab00 0x7f602c116620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:24.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.856+0000 7f6032882640 1 -- 10.20.193.58:0/942353771 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f602c137f70 con 0x7f602c119810 2026-02-23T06:22:24.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.856+0000 7f6032882640 1 --2- 10.20.193.58:0/942353771 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f602c119810 0x7f602c1491e0 secure :-1 s=READY pgs=219 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6028007fd0 tx=0x7f6028003e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:24.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.856+0000 7f6012ffd640 1 -- 10.20.193.58:0/942353771 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6028007280 con 0x7f602c119810 2026-02-23T06:22:24.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.856+0000 7f6033083640 1 -- 10.20.193.58:0/942353771 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f602c138250 con 0x7f602c119810 2026-02-23T06:22:24.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.856+0000 7f6033083640 1 -- 10.20.193.58:0/942353771 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f602c138810 con 0x7f602c119810 2026-02-23T06:22:24.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.856+0000 7f6012ffd640 1 -- 10.20.193.58:0/942353771 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6028007400 con 0x7f602c119810 2026-02-23T06:22:24.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.856+0000 7f6012ffd640 1 -- 10.20.193.58:0/942353771 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6028044480 con 0x7f602c119810 2026-02-23T06:22:24.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.857+0000 7f6033083640 1 --2- 10.20.193.58:0/942353771 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f602c138a00 0x7f602c149720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:24.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.857+0000 7f6033083640 1 -- 10.20.193.58:0/942353771 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f602c0609c0 con 0x7f602c138a00 2026-02-23T06:22:24.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.857+0000 7f6032081640 1 --2- 10.20.193.58:0/942353771 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f602c138a00 0x7f602c149720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:24.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.857+0000 7f6032081640 1 -- 10.20.193.58:0/942353771 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f602c0bb7d0 con 0x7f602c138a00 2026-02-23T06:22:24.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.858+0000 7f6032081640 1 --2- 10.20.193.58:0/942353771 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f602c138a00 0x7f602c149720 secure :-1 s=READY pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f601c0067a0 tx=0x7f601c00fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:24.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.858+0000 7f6012ffd640 1 -- 10.20.193.58:0/942353771 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f601c011920 con 0x7f602c138a00 2026-02-23T06:22:24.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.858+0000 7f6012ffd640 1 -- 10.20.193.58:0/942353771 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f601c011a80 con 0x7f602c138a00 2026-02-23T06:22:24.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.858+0000 7f6012ffd640 1 -- 10.20.193.58:0/942353771 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f602c138a00 msgr2=0x7f602c149720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:24.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.858+0000 7f6012ffd640 1 --2- 10.20.193.58:0/942353771 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f602c138a00 0x7f602c149720 secure :-1 s=READY pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f601c0067a0 tx=0x7f601c00fa20 comp rx=0 tx=0).stop 2026-02-23T06:22:24.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.858+0000 7f6012ffd640 1 -- 10.20.193.58:0/942353771 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f602c138a00 msgr2=0x7f602c149720 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:22:24.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.858+0000 7f6012ffd640 1 --2- 10.20.193.58:0/942353771 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f602c138a00 0x7f602c149720 secure :-1 s=CLOSED pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f601c0067a0 tx=0x7f601c00fa20 comp rx=0 tx=0).stop 2026-02-23T06:22:24.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.859+0000 7f6012ffd640 1 -- 10.20.193.58:0/942353771 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f6028036070 con 0x7f602c119810 2026-02-23T06:22:24.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.860+0000 7f6012ffd640 1 --2- 10.20.193.58:0/942353771 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5ffc07a430 0x7f5ffc09a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:24.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.860+0000 7f6012ffd640 1 -- 10.20.193.58:0/942353771 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f60280c32f0 con 0x7f602c119810 2026-02-23T06:22:24.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.860+0000 7f6032081640 1 --2- 10.20.193.58:0/942353771 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5ffc07a430 0x7f5ffc09a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:24.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.861+0000 7f6032081640 1 --2- 10.20.193.58:0/942353771 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5ffc07a430 0x7f5ffc09a8e0 secure :-1 s=READY pgs=128 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f601c0067a0 tx=0x7f601c005030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:24.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.862+0000 7f6033083640 1 --2- 10.20.193.58:0/942353771 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f602c149c60 0x7f602c1285a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:24.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.862+0000 7f6033083640 1 -- 10.20.193.58:0/942353771 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f602c0b7170 con 0x7f602c149c60 2026-02-23T06:22:24.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.862+0000 7f6031880640 1 --2- 10.20.193.58:0/942353771 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f602c149c60 0x7f602c1285a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:24.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.862+0000 7f6031880640 1 -- 10.20.193.58:0/942353771 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f602c14a030 con 0x7f602c149c60 2026-02-23T06:22:24.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.862+0000 7f6031880640 1 --2- 10.20.193.58:0/942353771 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f602c149c60 0x7f602c1285a0 secure :-1 s=READY pgs=221 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f602c146d60 tx=0x7f6020011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:24.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.862+0000 7f6012ffd640 1 -- 10.20.193.58:0/942353771 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6020016070 con 0x7f602c149c60 2026-02-23T06:22:24.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.863+0000 7f6012ffd640 1 -- 10.20.193.58:0/942353771 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5246 (secure 0 0 0) 0x7f6020004070 con 0x7f602c149c60 2026-02-23T06:22:24.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.863+0000 7f6012ffd640 1 -- 10.20.193.58:0/942353771 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f602c149c60 msgr2=0x7f602c1285a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:24.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.863+0000 7f6012ffd640 1 --2- 10.20.193.58:0/942353771 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f602c149c60 0x7f602c1285a0 secure :-1 s=READY pgs=221 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f602c146d60 tx=0x7f6020011f10 comp rx=0 tx=0).stop 2026-02-23T06:22:24.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.863+0000 7f6012ffd640 1 -- 10.20.193.58:0/942353771 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f602c149c60 msgr2=0x7f602c1285a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:22:24.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.863+0000 7f6012ffd640 1 --2- 10.20.193.58:0/942353771 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f602c149c60 0x7f602c1285a0 secure :-1 s=CLOSED pgs=221 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f602c146d60 tx=0x7f6020011f10 comp rx=0 tx=0).stop 2026-02-23T06:22:24.859 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:22:24.860 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:22:24.860 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:22:24.860 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:22:24.860 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 10, 2026-02-23T06:22:24.860 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 82872, 2026-02-23T06:22:24.860 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:22:24.860 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:22:24.860 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:22:24.860 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:22:24.860 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:24.860 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:22:24.860 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:22:24.860 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:22:24.861 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:22:24.861 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:22:24.861 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:22:24.861 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:22:24.861 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:22:24.861 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:22:24.861 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:22:24.861 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:22:24.861 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:22:24.861 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:22:24.861 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:22:24.861 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:22:24.861 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:22:24.861 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:22:24.861 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:24.862 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:22:24.862 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:22:24.862 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:22:24.862 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:22:24.862 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:22:24.862 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:22:24.862 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:22:24.862 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:22:24.862 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:22:24.862 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:22:24.862 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:22:24.862 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:22:24.862 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:22:24.862 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:22:24.862 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:22:24.862 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:24.862 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:24.863 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:22:24.863 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:22:24.863 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:22:24.863 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:22:24.863 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:22:24.863 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:22:24.863 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:22:24.863 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:22:24.863 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:22:24.863 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:22:24.863 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:22:24.863 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:22:24.863 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:22:24.863 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:22:24.863 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:22:24.863 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:22:24.863 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:22:24.864 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:22:24.864 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:22:24.864 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:22:24.864 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:22:24.864 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:22:24.864 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:22:24.864 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:22:24.864 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:22:24.864 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:22:24.864 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:22:24.864 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:22:24.864 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:22:24.864 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:22:24.864 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:24.864 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:22:24.864 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:24.864 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:22:24.864 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:24.864 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:22:24.865 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:22:24.865 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:22:24.865 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:22:24.865 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:24.865 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:22:24.865 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:22:24.865 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:24.865 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:24.865 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:24.865 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:22:24.865 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:22:24.865 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:24.865 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:24.865 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:24.865 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:24.865 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:22:24.865 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:22:24.865 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:22:24.866 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:22:24.866 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:22:24.866 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:22:24.866 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:24.866 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:24.866 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:22:24.866 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:22:24.866 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:22:24.866 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:22:24.866 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:24.866 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:22:24.866 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:22:24.866 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:24.866 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:24.866 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:24.866 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:22:24.866 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:22:24.866 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:24.866 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:24.867 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:24.867 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:24.867 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:22:24.867 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:22:24.867 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:22:24.867 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:22:24.867 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:22:24.867 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:22:24.867 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:24.867 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:24.867 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:22:24.867 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:22:24.867 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:22:24.867 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:22:24.867 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:24.867 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:22:24.867 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:22:24.867 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:24.867 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:24.868 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:24.868 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:22:24.868 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:22:24.868 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:24.868 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:24.868 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:24.868 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:24.868 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:22:24.868 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:22:24.868 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:22:24.868 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:22:24.868 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:22:24.868 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:22:24.868 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:24.868 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:24.868 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:24.868 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:22:24.868 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:22:24.868 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:24.869 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:24.869 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:24.869 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:22:24.869 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:24.869 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:24.869 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:22:24.869 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:24.869 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:24.869 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:24.869 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:22:24.869 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:24.869 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:24.869 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:22:24.869 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:24.869 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:24.869 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:24.869 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:22:24.870 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:24.870 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:24.870 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:22:24.870 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:24.870 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:24.870 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:24.870 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:22:24.870 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:24.870 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:24.870 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:24.870 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:22:24.870 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:22:24.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.863+0000 7f6033083640 1 -- 10.20.193.58:0/942353771 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5ffc07a430 msgr2=0x7f5ffc09a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:24.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.863+0000 7f6033083640 1 --2- 10.20.193.58:0/942353771 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5ffc07a430 0x7f5ffc09a8e0 secure :-1 s=READY pgs=128 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f601c0067a0 tx=0x7f601c005030 comp rx=0 tx=0).stop 2026-02-23T06:22:24.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.863+0000 7f6033083640 1 -- 10.20.193.58:0/942353771 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f602c119810 msgr2=0x7f602c1491e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:24.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.863+0000 7f6033083640 1 --2- 10.20.193.58:0/942353771 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f602c119810 0x7f602c1491e0 secure :-1 s=READY pgs=219 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6028007fd0 tx=0x7f6028003e40 comp rx=0 tx=0).stop 2026-02-23T06:22:24.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.863+0000 7f6032882640 1 -- 10.20.193.58:0/942353771 reap_dead start 2026-02-23T06:22:24.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.863+0000 7f6032882640 1 -- 10.20.193.58:0/942353771 reap_dead start 2026-02-23T06:22:24.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.863+0000 7f6033083640 1 -- 10.20.193.58:0/942353771 shutdown_connections 2026-02-23T06:22:24.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.863+0000 7f6033083640 1 -- 10.20.193.58:0/942353771 >> 10.20.193.58:0/942353771 conn(0x7f602c054e40 msgr2=0x7f602c13a820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:22:24.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.863+0000 7f6033083640 1 -- 10.20.193.58:0/942353771 shutdown_connections 2026-02-23T06:22:24.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.863+0000 7f6033083640 1 -- 10.20.193.58:0/942353771 wait complete. 2026-02-23T06:22:24.872 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:22:24.872 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:22:24.872 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:22:24.880 INFO:tasks.workunit.client.0.trial058.stdout:checking for suffix of object files... o 2026-02-23T06:22:24.923 INFO:tasks.workunit.client.0.trial058.stdout:checking whether we are using the GNU C compiler... yes 2026-02-23T06:22:24.969 INFO:tasks.workunit.client.0.trial058.stdout:checking whether gcc accepts -g... yes 2026-02-23T06:22:24.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.998+0000 7fb3b5192640 1 -- 10.20.193.58:0/2899660261 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3b015fb00 msgr2=0x7fb3b00b7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:24.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.998+0000 7fb3b5192640 1 --2- 10.20.193.58:0/2899660261 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3b015fb00 0x7fb3b00b7cd0 secure :-1 s=READY pgs=211 gs=3 cs=0 l=1 c_cookie=9317443824636951606 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3a0004740 tx=0x7fb3a002f1d0 comp rx=0 tx=0).stop 2026-02-23T06:22:24.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.999+0000 7fb3b5192640 1 -- 10.20.193.58:0/2899660261 shutdown_connections 2026-02-23T06:22:24.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.999+0000 7fb3b5192640 1 --2- 10.20.193.58:0/2899660261 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3b015fb00 0x7fb3b00b7cd0 unknown :-1 s=CLOSED pgs=211 gs=3 cs=0 l=1 c_cookie=9317443824636951606 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:24.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.999+0000 7fb3b5192640 1 --2- 10.20.193.58:0/2899660261 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3b015f730 0x7fb3b0168be0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:24.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.999+0000 7fb3b5192640 1 -- 10.20.193.58:0/2899660261 >> 10.20.193.58:0/2899660261 conn(0x7fb3b00b65c0 msgr2=0x7fb3b00b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:22:24.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.999+0000 7fb3b5192640 1 -- 10.20.193.58:0/2899660261 shutdown_connections 2026-02-23T06:22:24.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:24.999+0000 7fb3b5192640 1 -- 10.20.193.58:0/2899660261 wait complete. 2026-02-23T06:22:24.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.000+0000 7fb3b5192640 1 Processor -- start 2026-02-23T06:22:24.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.000+0000 7fb3b5192640 1 -- start start 2026-02-23T06:22:24.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.001+0000 7fb3b5192640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3b00b8210 0x7fb3b0140c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:24.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.001+0000 7fb3b5192640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3b015f730 0x7fb3b013cec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:24.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.001+0000 7fb3b5192640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3b015fb00 0x7fb3b0200de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:24.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.001+0000 7fb3b5192640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b013aa60 con 0x7fb3b00b8210 2026-02-23T06:22:24.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.001+0000 7fb3b5192640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b0141c60 con 0x7fb3b015f730 2026-02-23T06:22:24.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.001+0000 7fb3b5192640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb3b0139e50 con 0x7fb3b015fb00 2026-02-23T06:22:24.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.001+0000 7fb3affff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3b00b8210 0x7fb3b0140c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:24.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.001+0000 7fb3affff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3b00b8210 0x7fb3b0140c10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:40982/0 (socket says 10.20.193.58:40982) 2026-02-23T06:22:24.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.001+0000 7fb3affff640 1 -- 10.20.193.58:0/1078516064 learned_addr learned my addr 10.20.193.58:0/1078516064 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:22:24.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.001+0000 7fb3af7fe640 1 --2- 10.20.193.58:0/1078516064 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3b015f730 0x7fb3b013cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:24.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.001+0000 7fb3b4991640 1 --2- 10.20.193.58:0/1078516064 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3b015fb00 0x7fb3b0200de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:24.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.001+0000 7fb3affff640 1 -- 10.20.193.58:0/1078516064 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3b015fb00 msgr2=0x7fb3b0200de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:24.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.001+0000 7fb3affff640 1 --2- 10.20.193.58:0/1078516064 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3b015fb00 0x7fb3b0200de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:24.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.001+0000 7fb3affff640 1 -- 10.20.193.58:0/1078516064 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3b015f730 msgr2=0x7fb3b013cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:24.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.001+0000 7fb3affff640 1 --2- 10.20.193.58:0/1078516064 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3b015f730 0x7fb3b013cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:24.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.001+0000 7fb3affff640 1 -- 10.20.193.58:0/1078516064 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a00094b0 con 0x7fb3b00b8210 2026-02-23T06:22:24.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.002+0000 7fb3affff640 1 --2- 10.20.193.58:0/1078516064 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3b00b8210 0x7fb3b0140c10 secure :-1 s=READY pgs=222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb39c005db0 tx=0x7fb39c00ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:24.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.002+0000 7fb3acff9640 1 -- 10.20.193.58:0/1078516064 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb39c004540 con 0x7fb3b00b8210 2026-02-23T06:22:24.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.002+0000 7fb3acff9640 1 -- 10.20.193.58:0/1078516064 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb39c004960 con 0x7fb3b00b8210 2026-02-23T06:22:24.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.002+0000 7fb3acff9640 1 -- 10.20.193.58:0/1078516064 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb39c004d90 con 0x7fb3b00b8210 2026-02-23T06:22:24.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.002+0000 7fb3b5192640 1 -- 10.20.193.58:0/1078516064 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3b013a130 con 0x7fb3b00b8210 2026-02-23T06:22:24.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.002+0000 7fb3b5192640 1 -- 10.20.193.58:0/1078516064 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3b013a6f0 con 0x7fb3b00b8210 2026-02-23T06:22:24.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.002+0000 7fb3b5192640 1 --2- 10.20.193.58:0/1078516064 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3b013af60 0x7fb3b0201320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:24.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.002+0000 7fb3b5192640 1 -- 10.20.193.58:0/1078516064 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b013a2c0 con 0x7fb3b013af60 2026-02-23T06:22:24.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.003+0000 7fb3af7fe640 1 --2- 10.20.193.58:0/1078516064 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3b013af60 0x7fb3b0201320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:24.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.003+0000 7fb3af7fe640 1 -- 10.20.193.58:0/1078516064 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb3b01655f0 con 0x7fb3b013af60 2026-02-23T06:22:24.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.004+0000 7fb3af7fe640 1 --2- 10.20.193.58:0/1078516064 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3b013af60 0x7fb3b0201320 secure :-1 s=READY pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3a0004740 tx=0x7fb3a00028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:24.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.004+0000 7fb3acff9640 1 -- 10.20.193.58:0/1078516064 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3a0047070 con 0x7fb3b013af60 2026-02-23T06:22:24.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.004+0000 7fb3acff9640 1 -- 10.20.193.58:0/1078516064 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fb39c009820 con 0x7fb3b00b8210 2026-02-23T06:22:24.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.005+0000 7fb3acff9640 1 --2- 10.20.193.58:0/1078516064 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb38007a660 0x7fb38009ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:24.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.005+0000 7fb3acff9640 1 -- 10.20.193.58:0/1078516064 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fb39c09dc70 con 0x7fb3b00b8210 2026-02-23T06:22:24.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.005+0000 7fb3acff9640 1 -- 10.20.193.58:0/1078516064 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fb3a003e040 con 0x7fb3b013af60 2026-02-23T06:22:24.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.005+0000 7fb3acff9640 1 -- 10.20.193.58:0/1078516064 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3b013af60 msgr2=0x7fb3b0201320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:24.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.005+0000 7fb3acff9640 1 --2- 10.20.193.58:0/1078516064 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3b013af60 0x7fb3b0201320 secure :-1 s=READY pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3a0004740 tx=0x7fb3a00028d0 comp rx=0 tx=0).stop 2026-02-23T06:22:24.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.005+0000 7fb3acff9640 1 -- 10.20.193.58:0/1078516064 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3b013af60 msgr2=0x7fb3b0201320 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:22:25.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.005+0000 7fb3acff9640 1 --2- 10.20.193.58:0/1078516064 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3b013af60 0x7fb3b0201320 unknown :-1 s=CLOSED pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:25.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.005+0000 7fb3b4991640 1 --2- 10.20.193.58:0/1078516064 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb38007a660 0x7fb38009ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:25.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.006+0000 7fb3b4991640 1 --2- 10.20.193.58:0/1078516064 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb38007a660 0x7fb38009ab10 secure :-1 s=READY pgs=129 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3b01417f0 tx=0x7fb3a400a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:25.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.009+0000 7fb3b5192640 1 --2- 10.20.193.58:0/1078516064 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3b015b8d0 0x7fb3b015bca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:25.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.009+0000 7fb3b5192640 1 -- 10.20.193.58:0/1078516064 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b0141dd0 con 0x7fb3b015b8d0 2026-02-23T06:22:25.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.009+0000 7fb3af7fe640 1 --2- 10.20.193.58:0/1078516064 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3b015b8d0 0x7fb3b015bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:25.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.009+0000 7fb3af7fe640 1 -- 10.20.193.58:0/1078516064 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb3b0165c20 con 0x7fb3b015b8d0 2026-02-23T06:22:25.004 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.010+0000 7fb3af7fe640 1 --2- 10.20.193.58:0/1078516064 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3b015b8d0 0x7fb3b015bca0 secure :-1 s=READY pgs=213 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3a0004740 tx=0x7fb3a0005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:25.004 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.010+0000 7fb3acff9640 1 -- 10.20.193.58:0/1078516064 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3a0047070 con 0x7fb3b015b8d0 2026-02-23T06:22:25.004 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.010+0000 7fb3acff9640 1 -- 10.20.193.58:0/1078516064 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5554 (secure 0 0 0) 0x7fb3a0050070 con 0x7fb3b015b8d0 2026-02-23T06:22:25.004 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.010+0000 7fb3acff9640 1 -- 10.20.193.58:0/1078516064 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3b015b8d0 msgr2=0x7fb3b015bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:25.005 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.010+0000 7fb3acff9640 1 --2- 10.20.193.58:0/1078516064 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3b015b8d0 0x7fb3b015bca0 secure :-1 s=READY pgs=213 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3a0004740 tx=0x7fb3a0005f90 comp rx=0 tx=0).stop 2026-02-23T06:22:25.005 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.010+0000 7fb3acff9640 1 -- 10.20.193.58:0/1078516064 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3b015b8d0 msgr2=0x7fb3b015bca0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:22:25.005 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.010+0000 7fb3acff9640 1 --2- 10.20.193.58:0/1078516064 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3b015b8d0 0x7fb3b015bca0 secure :-1 s=CLOSED pgs=213 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3a0004740 tx=0x7fb3a0005f90 comp rx=0 tx=0).stop 2026-02-23T06:22:25.005 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:22:25.005 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:22:25.005 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:22:25.005 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:22:25.005 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 10, 2026-02-23T06:22:25.005 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 83057, 2026-02-23T06:22:25.005 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:22:25.005 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:22:25.005 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:22:25.005 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:22:25.005 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:25.005 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:22:25.005 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:22:25.006 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:22:25.006 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:22:25.006 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:22:25.006 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:22:25.006 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:22:25.006 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:22:25.006 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:22:25.006 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:22:25.006 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:22:25.006 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:22:25.006 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:22:25.006 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:22:25.006 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:22:25.006 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:22:25.006 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:22:25.006 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:25.006 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:22:25.006 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:22:25.006 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:22:25.006 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:22:25.006 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:22:25.006 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:22:25.006 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:22:25.007 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:22:25.007 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:22:25.007 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:22:25.007 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:22:25.007 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:22:25.007 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:22:25.007 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:22:25.007 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:22:25.007 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:25.007 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:25.007 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:22:25.007 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:22:25.007 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:22:25.007 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:22:25.007 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:22:25.007 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:22:25.007 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:22:25.007 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:22:25.007 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:22:25.007 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:22:25.007 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:22:25.008 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:22:25.008 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:22:25.008 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:22:25.008 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:22:25.008 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:22:25.008 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:22:25.008 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:22:25.008 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:22:25.008 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:22:25.008 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:22:25.008 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:22:25.008 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:22:25.008 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:22:25.008 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:22:25.008 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:22:25.008 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:22:25.008 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:22:25.008 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:22:25.008 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:22:25.008 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:25.008 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:22:25.008 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:25.008 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:22:25.009 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:25.009 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:22:25.009 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:22:25.009 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:22:25.009 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:22:25.009 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:25.009 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:22:25.009 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:22:25.009 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:25.009 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:25.009 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:25.009 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:22:25.009 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:22:25.009 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:25.009 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:25.009 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:25.009 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:25.009 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:22:25.009 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:22:25.009 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:22:25.009 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:22:25.009 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:22:25.009 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:22:25.010 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:25.010 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:25.010 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:22:25.010 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:22:25.010 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:22:25.010 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:22:25.010 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:25.010 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:22:25.010 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:22:25.010 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:25.010 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:25.010 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:25.010 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:22:25.010 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:22:25.010 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:25.010 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:25.010 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:25.010 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:25.010 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:22:25.010 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:22:25.010 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:22:25.010 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:22:25.010 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:22:25.011 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:22:25.011 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:25.011 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:25.011 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:22:25.011 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:22:25.011 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:22:25.011 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:22:25.011 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:25.011 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:22:25.011 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:22:25.011 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:25.011 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:25.011 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:25.011 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:22:25.011 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:22:25.011 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:25.011 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:25.011 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:25.011 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:25.011 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:22:25.011 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:22:25.011 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:22:25.011 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:22:25.011 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:22:25.012 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:22:25.012 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:25.012 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:25.012 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:25.012 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:22:25.012 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:22:25.012 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:25.012 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:25.012 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:25.012 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:22:25.012 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:25.012 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:25.012 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:22:25.012 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:25.012 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:25.012 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:25.012 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:22:25.012 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:25.012 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:25.012 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:22:25.012 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:25.012 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:25.012 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:25.012 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:22:25.012 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:25.013 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:25.013 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:22:25.013 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:25.013 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:22:25.013 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:22:25.013 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:22:25.013 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:25.013 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:25.013 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:25.013 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:25.013 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:22:25.013 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:25.013 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:25.013 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:22:25.013 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:25.013 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:25.013 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:25.013 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:22:25.013 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:25.013 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:25.013 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:25.013 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:22:25.013 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:22:25.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.010+0000 7fb3b5192640 1 -- 10.20.193.58:0/1078516064 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb38007a660 msgr2=0x7fb38009ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:25.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.010+0000 7fb3b5192640 1 --2- 10.20.193.58:0/1078516064 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb38007a660 0x7fb38009ab10 secure :-1 s=READY pgs=129 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3b01417f0 tx=0x7fb3a400a040 comp rx=0 tx=0).stop 2026-02-23T06:22:25.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.010+0000 7fb3b5192640 1 -- 10.20.193.58:0/1078516064 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3b00b8210 msgr2=0x7fb3b0140c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:25.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.010+0000 7fb3b5192640 1 --2- 10.20.193.58:0/1078516064 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3b00b8210 0x7fb3b0140c10 secure :-1 s=READY pgs=222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb39c005db0 tx=0x7fb39c00ddf0 comp rx=0 tx=0).stop 2026-02-23T06:22:25.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.010+0000 7fb3b4991640 1 -- 10.20.193.58:0/1078516064 reap_dead start 2026-02-23T06:22:25.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.010+0000 7fb3b4991640 1 -- 10.20.193.58:0/1078516064 reap_dead start 2026-02-23T06:22:25.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.010+0000 7fb3b5192640 1 -- 10.20.193.58:0/1078516064 shutdown_connections 2026-02-23T06:22:25.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.010+0000 7fb3b5192640 1 -- 10.20.193.58:0/1078516064 >> 10.20.193.58:0/1078516064 conn(0x7fb3b00b65c0 msgr2=0x7fb3b00586c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:22:25.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.010+0000 7fb3b5192640 1 -- 10.20.193.58:0/1078516064 shutdown_connections 2026-02-23T06:22:25.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.011+0000 7fb3b5192640 1 -- 10.20.193.58:0/1078516064 wait complete. 2026-02-23T06:22:25.015 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:22:25.015 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:22:25.015 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:22:25.032 INFO:tasks.workunit.client.0.trial058.stdout:checking for gcc option to accept ISO C89... none needed 2026-02-23T06:22:25.124 INFO:tasks.workunit.client.0.trial058.stdout:checking dependency style of gcc... gcc3 2026-02-23T06:22:25.153 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.157+0000 7fed771d2640 1 -- 10.20.193.58:0/363185906 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fed701688d0 msgr2=0x7fed70168ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:25.153 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.157+0000 7fed771d2640 1 --2- 10.20.193.58:0/363185906 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fed701688d0 0x7fed70168ca0 secure :-1 s=READY pgs=223 gs=2 cs=0 l=1 c_cookie=10352348587673668627 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed700b9560 tx=0x7fed6002f260 comp rx=0 tx=0).stop 2026-02-23T06:22:25.153 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.157+0000 7fed771d2640 1 -- 10.20.193.58:0/363185906 shutdown_connections 2026-02-23T06:22:25.153 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.157+0000 7fed771d2640 1 --2- 10.20.193.58:0/363185906 >> v2:10.20.193.93:3300/0 conn(0x7fed700bb0b0 0x7fed7015b620 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:25.153 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.157+0000 7fed771d2640 1 --2- 10.20.193.58:0/363185906 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fed701688d0 0x7fed70168ca0 unknown :-1 s=CLOSED pgs=223 gs=2 cs=0 l=1 c_cookie=10352348587673668627 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:25.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.157+0000 7fed771d2640 1 -- 10.20.193.58:0/363185906 >> 10.20.193.58:0/363185906 conn(0x7fed70054e40 msgr2=0x7fed70057b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:22:25.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.157+0000 7fed771d2640 1 -- 10.20.193.58:0/363185906 shutdown_connections 2026-02-23T06:22:25.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.157+0000 7fed771d2640 1 -- 10.20.193.58:0/363185906 wait complete. 2026-02-23T06:22:25.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.158+0000 7fed771d2640 1 Processor -- start 2026-02-23T06:22:25.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.159+0000 7fed771d2640 1 -- start start 2026-02-23T06:22:25.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.159+0000 7fed771d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fed700b6440 0x7fed70165ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:25.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.159+0000 7fed771d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fed700bb0b0 0x7fed70120280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:25.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.159+0000 7fed771d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed701688d0 0x7fed701207c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:25.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.159+0000 7fed771d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fed700b30e0 con 0x7fed700bb0b0 2026-02-23T06:22:25.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.159+0000 7fed771d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fed7013e520 con 0x7fed700b6440 2026-02-23T06:22:25.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.159+0000 7fed771d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fed7013e800 con 0x7fed701688d0 2026-02-23T06:22:25.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.159+0000 7fed761d0640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fed700b6440 0x7fed70165ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:25.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.159+0000 7fed759cf640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fed700bb0b0 0x7fed70120280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:25.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.159+0000 7fed761d0640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fed700b6440 0x7fed70165ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:50562/0 (socket says 10.20.193.58:50562) 2026-02-23T06:22:25.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.159+0000 7fed769d1640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed701688d0 0x7fed701207c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:25.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.159+0000 7fed761d0640 1 -- 10.20.193.58:0/3740483670 learned_addr learned my addr 10.20.193.58:0/3740483670 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:22:25.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.159+0000 7fed769d1640 1 -- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed701688d0 msgr2=0x7fed701207c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-23T06:22:25.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.159+0000 7fed769d1640 1 -- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed701688d0 msgr2=0x7fed701207c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:22:25.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.159+0000 7fed769d1640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed701688d0 0x7fed701207c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:22:25.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.159+0000 7fed769d1640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed701688d0 0x7fed701207c0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:22:25.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.160+0000 7fed761d0640 1 -- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed701688d0 msgr2=0x7fed701207c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:22:25.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.160+0000 7fed761d0640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed701688d0 0x7fed701207c0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:25.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.160+0000 7fed761d0640 1 -- 10.20.193.58:0/3740483670 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fed700bb0b0 msgr2=0x7fed70120280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:25.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.160+0000 7fed761d0640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fed700bb0b0 0x7fed70120280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:25.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.160+0000 7fed761d0640 1 -- 10.20.193.58:0/3740483670 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed60009570 con 0x7fed700b6440 2026-02-23T06:22:25.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.160+0000 7fed759cf640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fed700bb0b0 0x7fed70120280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:22:25.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.160+0000 7fed761d0640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fed700b6440 0x7fed70165ad0 secure :-1 s=READY pgs=215 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed60004740 tx=0x7fed600028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:25.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.160+0000 7fed56ffd640 1 -- 10.20.193.58:0/3740483670 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed6003d070 con 0x7fed700b6440 2026-02-23T06:22:25.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.160+0000 7fed56ffd640 1 -- 10.20.193.58:0/3740483670 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed60038470 con 0x7fed700b6440 2026-02-23T06:22:25.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.160+0000 7fed56ffd640 1 -- 10.20.193.58:0/3740483670 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed600388a0 con 0x7fed700b6440 2026-02-23T06:22:25.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.160+0000 7fed771d2640 1 -- 10.20.193.58:0/3740483670 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed7013eae0 con 0x7fed700b6440 2026-02-23T06:22:25.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.160+0000 7fed771d2640 1 -- 10.20.193.58:0/3740483670 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed7013f0a0 con 0x7fed700b6440 2026-02-23T06:22:25.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.161+0000 7fed771d2640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 0x7fed3c0246a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:25.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.161+0000 7fed771d2640 1 -- 10.20.193.58:0/3740483670 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fed3c025f20 con 0x7fed3c0041f0 2026-02-23T06:22:25.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.161+0000 7fed759cf640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 0x7fed3c0246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:25.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.161+0000 7fed759cf640 1 -- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 msgr2=0x7fed3c0246a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-23T06:22:25.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.161+0000 7fed759cf640 1 -- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 msgr2=0x7fed3c0246a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:22:25.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.161+0000 7fed759cf640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 0x7fed3c0246a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:22:25.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.161+0000 7fed759cf640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 0x7fed3c0246a0 unknown :-1 s=START_CONNECT pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:22:25.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.163+0000 7fed56ffd640 1 -- 10.20.193.58:0/3740483670 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fed60038a00 con 0x7fed700b6440 2026-02-23T06:22:25.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.163+0000 7fed56ffd640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fed4007a740 0x7fed4009abf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:25.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.163+0000 7fed56ffd640 1 -- 10.20.193.58:0/3740483670 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fed600c22b0 con 0x7fed700b6440 2026-02-23T06:22:25.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.164+0000 7fed769d1640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fed4007a740 0x7fed4009abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:25.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.164+0000 7fed769d1640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fed4007a740 0x7fed4009abf0 secure :-1 s=READY pgs=130 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed6c006a50 tx=0x7fed6c0069e0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:25.358 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.363+0000 7fed759cf640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 0x7fed3c0246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:25.358 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.363+0000 7fed759cf640 1 -- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 msgr2=0x7fed3c0246a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:22:25.358 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.363+0000 7fed759cf640 1 -- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 msgr2=0x7fed3c0246a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:22:25.359 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.363+0000 7fed759cf640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 0x7fed3c0246a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:22:25.359 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.363+0000 7fed759cf640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 0x7fed3c0246a0 unknown :-1 s=START_CONNECT pgs=0 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-23T06:22:25.716 INFO:tasks.workunit.client.0.trial058.stdout:checking how to run the C preprocessor... gcc -E 2026-02-23T06:22:25.759 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.764+0000 7fed759cf640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 0x7fed3c0246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=10 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:25.759 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.764+0000 7fed759cf640 1 -- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 msgr2=0x7fed3c0246a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:22:25.759 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.764+0000 7fed759cf640 1 -- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 msgr2=0x7fed3c0246a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:22:25.759 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.764+0000 7fed759cf640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 0x7fed3c0246a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=10 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:22:25.759 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:25.764+0000 7fed759cf640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 0x7fed3c0246a0 unknown :-1 s=START_CONNECT pgs=0 gs=11 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-23T06:22:25.781 INFO:tasks.workunit.client.0.trial058.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2026-02-23T06:22:25.784 INFO:tasks.workunit.client.0.trial058.stdout:checking for egrep... /usr/bin/grep -E 2026-02-23T06:22:25.802 INFO:tasks.workunit.client.0.trial058.stdout:checking for AIX... no 2026-02-23T06:22:25.813 INFO:tasks.workunit.client.0.trial058.stdout:checking for gcc... (cached) gcc 2026-02-23T06:22:25.831 INFO:tasks.workunit.client.0.trial058.stdout:checking whether we are using the GNU C compiler... (cached) yes 2026-02-23T06:22:25.833 INFO:tasks.workunit.client.0.trial058.stdout:checking whether gcc accepts -g... (cached) yes 2026-02-23T06:22:25.833 INFO:tasks.workunit.client.0.trial058.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2026-02-23T06:22:25.833 INFO:tasks.workunit.client.0.trial058.stdout:checking dependency style of gcc... (cached) gcc3 2026-02-23T06:22:25.900 INFO:tasks.workunit.client.0.trial058.stdout:checking for main in -lm... yes 2026-02-23T06:22:25.968 INFO:tasks.workunit.client.0.trial058.stdout:checking for main in -lpthread... yes 2026-02-23T06:22:26.152 INFO:tasks.workunit.client.0.trial058.stdout:checking for ANSI C header files... yes 2026-02-23T06:22:26.208 INFO:tasks.workunit.client.0.trial058.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2026-02-23T06:22:26.265 INFO:tasks.workunit.client.0.trial058.stdout:checking for sys/types.h... yes 2026-02-23T06:22:26.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:26.565+0000 7fed759cf640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 0x7fed3c0246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=12 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:26.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:26.565+0000 7fed759cf640 1 -- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 msgr2=0x7fed3c0246a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:22:26.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:26.565+0000 7fed759cf640 1 -- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 msgr2=0x7fed3c0246a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:22:26.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:26.565+0000 7fed759cf640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 0x7fed3c0246a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=12 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:22:26.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:26.565+0000 7fed759cf640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 0x7fed3c0246a0 unknown :-1 s=START_CONNECT pgs=0 gs=13 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-23T06:22:26.571 INFO:tasks.workunit.client.0.trial058.stdout:checking for sys/stat.h... yes 2026-02-23T06:22:26.635 INFO:tasks.workunit.client.0.trial058.stdout:checking for stdlib.h... yes 2026-02-23T06:22:26.698 INFO:tasks.workunit.client.0.trial058.stdout:checking for string.h... yes 2026-02-23T06:22:26.764 INFO:tasks.workunit.client.0.trial058.stdout:checking for memory.h... yes 2026-02-23T06:22:26.831 INFO:tasks.workunit.client.0.trial058.stdout:checking for strings.h... yes 2026-02-23T06:22:26.896 INFO:tasks.workunit.client.0.trial058.stdout:checking for inttypes.h... yes 2026-02-23T06:22:26.960 INFO:tasks.workunit.client.0.trial058.stdout:checking for stdint.h... yes 2026-02-23T06:22:27.026 INFO:tasks.workunit.client.0.trial058.stdout:checking for unistd.h... yes 2026-02-23T06:22:27.097 INFO:tasks.workunit.client.0.trial058.stdout:checking pthread.h usability... yes 2026-02-23T06:22:27.129 INFO:tasks.workunit.client.0.trial058.stdout:checking pthread.h presence... yes 2026-02-23T06:22:27.130 INFO:tasks.workunit.client.0.trial058.stdout:checking for pthread.h... yes 2026-02-23T06:22:27.196 INFO:tasks.workunit.client.0.trial058.stdout:checking fcntl.h usability... yes 2026-02-23T06:22:27.226 INFO:tasks.workunit.client.0.trial058.stdout:checking fcntl.h presence... yes 2026-02-23T06:22:27.227 INFO:tasks.workunit.client.0.trial058.stdout:checking for fcntl.h... yes 2026-02-23T06:22:27.294 INFO:tasks.workunit.client.0.trial058.stdout:checking limits.h usability... yes 2026-02-23T06:22:27.324 INFO:tasks.workunit.client.0.trial058.stdout:checking limits.h presence... yes 2026-02-23T06:22:27.325 INFO:tasks.workunit.client.0.trial058.stdout:checking for limits.h... yes 2026-02-23T06:22:27.784 INFO:tasks.workunit.client.0.trial058.stdout:checking for stdint.h... (cached) yes 2026-02-23T06:22:27.846 INFO:tasks.workunit.client.0.trial058.stdout:checking sys/time.h usability... yes 2026-02-23T06:22:27.877 INFO:tasks.workunit.client.0.trial058.stdout:checking sys/time.h presence... yes 2026-02-23T06:22:27.878 INFO:tasks.workunit.client.0.trial058.stdout:checking for sys/time.h... yes 2026-02-23T06:22:27.894 INFO:tasks.workunit.client.0.trial058.stdout:checking for unistd.h... (cached) yes 2026-02-23T06:22:27.956 INFO:tasks.workunit.client.0.trial058.stdout:checking sys/vfs.h usability... yes 2026-02-23T06:22:27.987 INFO:tasks.workunit.client.0.trial058.stdout:checking sys/vfs.h presence... yes 2026-02-23T06:22:27.988 INFO:tasks.workunit.client.0.trial058.stdout:checking for sys/vfs.h... yes 2026-02-23T06:22:28.048 INFO:tasks.workunit.client.0.trial058.stdout:checking sys/limits.h usability... no 2026-02-23T06:22:28.079 INFO:tasks.workunit.client.0.trial058.stdout:checking sys/limits.h presence... no 2026-02-23T06:22:28.079 INFO:tasks.workunit.client.0.trial058.stdout:checking for sys/limits.h... no 2026-02-23T06:22:28.127 INFO:tasks.workunit.client.0.trial058.stdout:checking for an ANSI C-conforming const... yes 2026-02-23T06:22:28.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:28.167+0000 7fed759cf640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 0x7fed3c0246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=14 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:28.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:28.167+0000 7fed759cf640 1 -- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 msgr2=0x7fed3c0246a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:22:28.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:28.167+0000 7fed759cf640 1 -- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 msgr2=0x7fed3c0246a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:22:28.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:28.167+0000 7fed759cf640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 0x7fed3c0246a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=14 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:22:28.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:28.167+0000 7fed759cf640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 0x7fed3c0246a0 unknown :-1 s=START_CONNECT pgs=0 gs=15 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2026-02-23T06:22:28.182 INFO:tasks.workunit.client.0.trial058.stdout:checking whether time.h and sys/time.h may both be included... yes 2026-02-23T06:22:28.183 INFO:tasks.workunit.client.0.trial058.stdout:checking for function prototypes... yes 2026-02-23T06:22:28.224 INFO:tasks.workunit.client.0.trial058.stdout:checking whether setvbuf arguments are reversed... no 2026-02-23T06:22:28.303 INFO:tasks.workunit.client.0.trial058.stdout:checking for system... yes 2026-02-23T06:22:28.386 INFO:tasks.workunit.client.0.trial058.stdout:checking for gettimeofday... yes 2026-02-23T06:22:28.471 INFO:tasks.workunit.client.0.trial058.stdout:checking for mkdir... yes 2026-02-23T06:22:28.557 INFO:tasks.workunit.client.0.trial058.stdout:checking for strerror... yes 2026-02-23T06:22:28.643 INFO:tasks.workunit.client.0.trial058.stdout:checking for open64... yes 2026-02-23T06:22:28.729 INFO:tasks.workunit.client.0.trial058.stdout:checking for stat64... yes 2026-02-23T06:22:28.814 INFO:tasks.workunit.client.0.trial058.stdout:checking for fseeko64... yes 2026-02-23T06:22:28.901 INFO:tasks.workunit.client.0.trial058.stdout:checking for lrand48_r... yes 2026-02-23T06:22:28.987 INFO:tasks.workunit.client.0.trial058.stdout:checking for srand48_r... yes 2026-02-23T06:22:29.020 INFO:tasks.workunit.client.0.trial058.stdout:configure: creating ./config.status 2026-02-23T06:22:29.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.159+0000 7fed55ffb640 1 -- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 msgr2=0x7fed3c0246a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:22:29.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.159+0000 7fed55ffb640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 0x7fed3c0246a0 unknown :-1 s=START_CONNECT pgs=0 gs=15 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:29.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.159+0000 7fed55ffb640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed38003600 0x7fed38023a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:29.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.159+0000 7fed55ffb640 1 -- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 msgr2=0x7fed3c0246a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:22:29.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.159+0000 7fed55ffb640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c0041f0 0x7fed3c0246a0 unknown :-1 s=CLOSED pgs=0 gs=15 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:29.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.159+0000 7fed55ffb640 1 -- 10.20.193.58:0/3740483670 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fed3c025f20 con 0x7fed38003600 2026-02-23T06:22:29.155 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.160+0000 7fed759cf640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed38003600 0x7fed38023a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=16 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:29.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.160+0000 7fed759cf640 1 -- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed38003600 msgr2=0x7fed38023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:22:29.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.160+0000 7fed759cf640 1 -- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed38003600 msgr2=0x7fed38023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:22:29.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.160+0000 7fed759cf640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed38003600 0x7fed38023a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=16 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:22:29.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.160+0000 7fed759cf640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed38003600 0x7fed38023a80 unknown :-1 s=START_CONNECT pgs=0 gs=17 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:22:29.197 INFO:tasks.workunit.client.0.trial058.stdout:config.status: creating Makefile 2026-02-23T06:22:29.226 INFO:tasks.workunit.client.0.trial058.stdout:config.status: creating config.h 2026-02-23T06:22:29.254 INFO:tasks.workunit.client.0.trial058.stdout:config.status: executing depfiles commands 2026-02-23T06:22:29.333 INFO:tasks.workunit.client.0.trial058.stdout:config.status: executing default commands 2026-02-23T06:22:29.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.362+0000 7fed759cf640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed38003600 0x7fed38023a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=18 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:29.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.362+0000 7fed759cf640 1 -- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed38003600 msgr2=0x7fed38023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:22:29.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.362+0000 7fed759cf640 1 -- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed38003600 msgr2=0x7fed38023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:22:29.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.362+0000 7fed759cf640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed38003600 0x7fed38023a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=18 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:22:29.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.362+0000 7fed759cf640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed38003600 0x7fed38023a80 unknown :-1 s=START_CONNECT pgs=0 gs=19 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-23T06:22:29.758 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.763+0000 7fed759cf640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed38003600 0x7fed38023a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=20 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:29.758 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.763+0000 7fed759cf640 1 -- 10.20.193.58:0/3740483670 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fed38024160 con 0x7fed38003600 2026-02-23T06:22:29.759 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.763+0000 7fed759cf640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed38003600 0x7fed38023a80 secure :-1 s=READY pgs=3 gs=20 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed70167750 tx=0x7fed64017800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:29.759 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.764+0000 7fed56ffd640 1 -- 10.20.193.58:0/3740483670 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed6401f070 con 0x7fed38003600 2026-02-23T06:22:29.759 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.764+0000 7fed56ffd640 1 -- 10.20.193.58:0/3740483670 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fed6401a2e0 con 0x7fed38003600 2026-02-23T06:22:29.759 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.764+0000 7fed56ffd640 1 -- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed38003600 msgr2=0x7fed38023a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:29.759 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.764+0000 7fed56ffd640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed38003600 0x7fed38023a80 secure :-1 s=READY pgs=3 gs=20 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed70167750 tx=0x7fed64017800 comp rx=0 tx=0).stop 2026-02-23T06:22:29.760 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.764+0000 7fed56ffd640 1 -- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed38003600 msgr2=0x7fed38023a80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:22:29.760 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.764+0000 7fed56ffd640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed38003600 0x7fed38023a80 unknown :-1 s=CLOSED pgs=3 gs=20 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:29.763 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.768+0000 7fed771d2640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c024f80 0x7fed3c0253e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:29.763 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.768+0000 7fed771d2640 1 -- 10.20.193.58:0/3740483670 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fed3c025ae0 con 0x7fed3c024f80 2026-02-23T06:22:29.763 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.768+0000 7fed759cf640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c024f80 0x7fed3c0253e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=21 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:29.764 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.769+0000 7fed759cf640 1 -- 10.20.193.58:0/3740483670 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fed3c025ca0 con 0x7fed3c024f80 2026-02-23T06:22:29.764 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.769+0000 7fed759cf640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c024f80 0x7fed3c0253e0 secure :-1 s=READY pgs=4 gs=21 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed640056e0 tx=0x7fed640037a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:29.764 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.769+0000 7fed56ffd640 1 -- 10.20.193.58:0/3740483670 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed6402e070 con 0x7fed3c024f80 2026-02-23T06:22:29.765 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.769+0000 7fed56ffd640 1 -- 10.20.193.58:0/3740483670 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4909 (secure 0 0 0) 0x7fed64003030 con 0x7fed3c024f80 2026-02-23T06:22:29.765 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.769+0000 7fed56ffd640 1 -- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c024f80 msgr2=0x7fed3c0253e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:29.765 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.769+0000 7fed56ffd640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c024f80 0x7fed3c0253e0 secure :-1 s=READY pgs=4 gs=21 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed640056e0 tx=0x7fed640037a0 comp rx=0 tx=0).stop 2026-02-23T06:22:29.765 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.770+0000 7fed56ffd640 1 -- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c024f80 msgr2=0x7fed3c0253e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:22:29.765 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.770+0000 7fed56ffd640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fed3c024f80 0x7fed3c0253e0 unknown :-1 s=CLOSED pgs=4 gs=21 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:29.765 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:22:29.766 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:22:29.766 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:22:29.766 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:22:29.766 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 10, 2026-02-23T06:22:29.766 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 5279, 2026-02-23T06:22:29.766 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:22:29.766 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:22:29.766 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:22:29.766 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:22:29.766 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:29.767 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 5, 2026-02-23T06:22:29.767 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:22:29.767 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:22:29.767 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:22:29.767 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:22:29.767 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:22:29.767 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:22:29.767 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:22:29.767 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:22:29.767 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:22:29.767 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:22:29.767 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:22:29.768 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:22:29.768 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:22:29.768 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:22:29.768 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:22:29.768 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:22:29.768 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:29.768 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:22:29.768 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:22:29.768 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:22:29.768 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:22:29.768 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:22:29.768 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:22:29.769 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:22:29.769 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:22:29.769 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:22:29.769 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:22:29.769 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:22:29.769 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:22:29.769 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:22:29.769 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:22:29.769 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:22:29.769 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:29.769 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:29.769 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:22:29.770 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:22:29.770 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:22:29.770 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:22:29.770 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:22:29.770 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:22:29.770 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:22:29.770 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:22:29.770 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:22:29.770 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:22:29.770 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:22:29.770 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:22:29.771 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:22:29.771 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:22:29.771 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:22:29.771 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:22:29.771 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:22:29.771 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:22:29.771 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:22:29.771 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:22:29.771 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:22:29.771 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:22:29.771 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:22:29.771 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:22:29.771 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:22:29.772 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:22:29.772 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:22:29.772 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:22:29.772 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:22:29.772 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:22:29.772 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:29.772 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:22:29.772 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:29.772 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:22:29.772 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:29.772 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:22:29.772 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:22:29.773 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:22:29.773 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:22:29.773 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:29.773 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:22:29.773 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:22:29.773 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:29.773 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:29.773 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:29.773 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:22:29.773 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:22:29.773 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:29.773 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:29.774 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:29.774 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:29.774 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:22:29.774 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:22:29.774 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:22:29.774 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:22:29.774 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:22:29.774 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:22:29.774 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:29.774 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:29.774 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:22:29.774 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:22:29.775 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:22:29.775 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:22:29.775 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:29.775 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:22:29.775 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:22:29.775 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:29.775 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:29.775 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:29.775 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:22:29.775 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:22:29.775 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:29.775 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:29.775 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:29.776 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:29.776 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:22:29.776 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:22:29.776 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:22:29.776 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:22:29.776 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:22:29.776 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:22:29.776 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:29.776 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:29.776 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:22:29.776 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:22:29.776 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:22:29.777 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:22:29.777 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:29.777 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:22:29.777 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:22:29.777 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:29.777 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:29.777 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:29.777 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:22:29.777 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:22:29.777 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:29.777 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:29.777 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:29.777 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:29.778 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:22:29.778 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:22:29.778 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:22:29.778 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:22:29.778 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:22:29.778 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:22:29.778 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:29.778 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:29.778 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:29.778 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:22:29.778 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:22:29.778 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:29.779 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:29.779 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:29.779 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:22:29.779 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:29.779 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:29.779 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:22:29.779 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:29.779 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:29.779 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:29.779 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:22:29.779 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:29.779 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:29.779 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:29.780 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:22:29.780 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:22:29.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.770+0000 7fed769d1640 1 -- 10.20.193.58:0/3740483670 reap_dead start 2026-02-23T06:22:29.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.770+0000 7fed771d2640 1 -- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fed4007a740 msgr2=0x7fed4009abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:29.782 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.770+0000 7fed771d2640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fed4007a740 0x7fed4009abf0 secure :-1 s=READY pgs=130 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed6c006a50 tx=0x7fed6c0069e0 comp rx=0 tx=0).stop 2026-02-23T06:22:29.782 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.770+0000 7fed771d2640 1 -- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fed700b6440 msgr2=0x7fed70165ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:29.782 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.770+0000 7fed771d2640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fed700b6440 0x7fed70165ad0 secure :-1 s=READY pgs=215 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed60004740 tx=0x7fed600028d0 comp rx=0 tx=0).stop 2026-02-23T06:22:29.782 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.770+0000 7fed771d2640 1 -- 10.20.193.58:0/3740483670 shutdown_connections 2026-02-23T06:22:29.782 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.770+0000 7fed771d2640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fed4007a740 0x7fed4009abf0 unknown :-1 s=CLOSED pgs=130 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:29.782 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.770+0000 7fed771d2640 1 --2- 10.20.193.58:0/3740483670 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fed700b6440 0x7fed70165ad0 unknown :-1 s=CLOSED pgs=215 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:29.782 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.770+0000 7fed771d2640 1 -- 10.20.193.58:0/3740483670 >> 10.20.193.58:0/3740483670 conn(0x7fed70054e40 msgr2=0x7fed701677d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:22:29.782 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.770+0000 7fed771d2640 1 -- 10.20.193.58:0/3740483670 shutdown_connections 2026-02-23T06:22:29.782 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.770+0000 7fed771d2640 1 -- 10.20.193.58:0/3740483670 wait complete. 2026-02-23T06:22:29.783 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:22:29.783 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:22:29.783 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:22:29.834 INFO:tasks.workunit.client.0.trial058.stderr:+ make 2026-02-23T06:22:29.841 INFO:tasks.workunit.client.0.trial058.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2026-02-23T06:22:29.845 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2026-02-23T06:22:29.846 INFO:tasks.workunit.client.0.trial058.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2026-02-23T06:22:29.846 INFO:tasks.workunit.client.0.trial058.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2026-02-23T06:22:29.847 INFO:tasks.workunit.client.0.trial058.stderr: to install the `Automake' and `Perl' packages. Grab them from 2026-02-23T06:22:29.847 INFO:tasks.workunit.client.0.trial058.stderr: any GNU archive site. 2026-02-23T06:22:29.851 INFO:tasks.workunit.client.0.trial058.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2026-02-23T06:22:29.854 INFO:tasks.workunit.client.0.trial058.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2026-02-23T06:22:29.855 INFO:tasks.workunit.client.0.trial058.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2026-02-23T06:22:29.855 INFO:tasks.workunit.client.0.trial058.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2026-02-23T06:22:29.855 INFO:tasks.workunit.client.0.trial058.stderr: You might want to install the `Automake' and `Perl' packages. 2026-02-23T06:22:29.855 INFO:tasks.workunit.client.0.trial058.stderr: Grab them from any GNU archive site. 2026-02-23T06:22:29.867 INFO:tasks.workunit.client.0.trial058.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2026-02-23T06:22:29.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.909+0000 7f8ad08cb640 1 -- 10.20.193.58:0/3912002863 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8acc056960 msgr2=0x7f8acc0b6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:29.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.909+0000 7f8ad08cb640 1 --2- 10.20.193.58:0/3912002863 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8acc056960 0x7f8acc0b6720 secure :-1 s=READY pgs=225 gs=2 cs=0 l=1 c_cookie=17696382074880310702 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ab4004740 tx=0x7f8ab402f1e0 comp rx=0 tx=0).stop 2026-02-23T06:22:29.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.909+0000 7f8ad08cb640 1 -- 10.20.193.58:0/3912002863 shutdown_connections 2026-02-23T06:22:29.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.909+0000 7f8ad08cb640 1 --2- 10.20.193.58:0/3912002863 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8acc056960 0x7f8acc0b6720 unknown :-1 s=CLOSED pgs=225 gs=2 cs=0 l=1 c_cookie=17696382074880310702 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:29.905 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.909+0000 7f8ad08cb640 1 --2- 10.20.193.58:0/3912002863 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8acc15c4b0 0x7f8acc058200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:29.905 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.909+0000 7f8ad08cb640 1 -- 10.20.193.58:0/3912002863 >> 10.20.193.58:0/3912002863 conn(0x7f8acc0b3c20 msgr2=0x7f8acc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:22:29.905 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.909+0000 7f8ad08cb640 1 -- 10.20.193.58:0/3912002863 shutdown_connections 2026-02-23T06:22:29.905 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.909+0000 7f8ad08cb640 1 -- 10.20.193.58:0/3912002863 wait complete. 2026-02-23T06:22:29.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.910+0000 7f8ad08cb640 1 Processor -- start 2026-02-23T06:22:29.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.910+0000 7f8ad08cb640 1 -- start start 2026-02-23T06:22:29.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.911+0000 7f8ad08cb640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8acc056960 0x7f8acc164230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:29.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.911+0000 7f8ad08cb640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8acc15c4b0 0x7f8acc1657c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:29.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.911+0000 7f8ad08cb640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8acc162ca0 0x7f8acc159510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:29.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.911+0000 7f8ad08cb640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f8acc0afaa0 con 0x7f8acc15c4b0 2026-02-23T06:22:29.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.911+0000 7f8ad08cb640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f8acc164770 con 0x7f8acc162ca0 2026-02-23T06:22:29.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.911+0000 7f8ad08cb640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f8acc05bab0 con 0x7f8acc056960 2026-02-23T06:22:29.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.911+0000 7f8aca575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8acc15c4b0 0x7f8acc1657c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:29.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.911+0000 7f8aca575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8acc15c4b0 0x7f8acc1657c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:46062/0 (socket says 10.20.193.58:46062) 2026-02-23T06:22:29.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.911+0000 7f8aca575640 1 -- 10.20.193.58:0/3035143626 learned_addr learned my addr 10.20.193.58:0/3035143626 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:22:29.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.911+0000 7f8acad76640 1 --2- 10.20.193.58:0/3035143626 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8acc056960 0x7f8acc164230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:29.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.911+0000 7f8acb577640 1 --2- 10.20.193.58:0/3035143626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8acc162ca0 0x7f8acc159510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:29.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.911+0000 7f8aca575640 1 -- 10.20.193.58:0/3035143626 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8acc056960 msgr2=0x7f8acc164230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:29.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.911+0000 7f8aca575640 1 --2- 10.20.193.58:0/3035143626 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8acc056960 0x7f8acc164230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:29.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.911+0000 7f8aca575640 1 -- 10.20.193.58:0/3035143626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8acc162ca0 msgr2=0x7f8acc159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:29.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.911+0000 7f8aca575640 1 --2- 10.20.193.58:0/3035143626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8acc162ca0 0x7f8acc159510 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:29.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.911+0000 7f8aca575640 1 -- 10.20.193.58:0/3035143626 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab40094b0 con 0x7f8acc15c4b0 2026-02-23T06:22:29.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.912+0000 7f8aca575640 1 --2- 10.20.193.58:0/3035143626 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8acc15c4b0 0x7f8acc1657c0 secure :-1 s=READY pgs=226 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ab402f740 tx=0x7f8ab4002950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:29.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.912+0000 7f8aab7fe640 1 -- 10.20.193.58:0/3035143626 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8ab4038470 con 0x7f8acc15c4b0 2026-02-23T06:22:29.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.912+0000 7f8aab7fe640 1 -- 10.20.193.58:0/3035143626 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ab40386c0 con 0x7f8acc15c4b0 2026-02-23T06:22:29.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.912+0000 7f8aab7fe640 1 -- 10.20.193.58:0/3035143626 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8ab4038ab0 con 0x7f8acc15c4b0 2026-02-23T06:22:29.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.912+0000 7f8ad08cb640 1 -- 10.20.193.58:0/3035143626 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8acc0afec0 con 0x7f8acc15c4b0 2026-02-23T06:22:29.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.912+0000 7f8ad08cb640 1 -- 10.20.193.58:0/3035143626 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8acc164ab0 con 0x7f8acc15c4b0 2026-02-23T06:22:29.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.912+0000 7f8aa97fa640 1 -- 10.20.193.58:0/3035143626 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8acc0afbe0 con 0x7f8acc15c4b0 2026-02-23T06:22:29.910 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.913+0000 7f8aab7fe640 1 -- 10.20.193.58:0/3035143626 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f8ab4038c10 con 0x7f8acc15c4b0 2026-02-23T06:22:29.910 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.914+0000 7f8aab7fe640 1 --2- 10.20.193.58:0/3035143626 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8a9807a6c0 0x7f8a9809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:29.910 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.915+0000 7f8aab7fe640 1 -- 10.20.193.58:0/3035143626 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f8ab40c2fe0 con 0x7f8acc15c4b0 2026-02-23T06:22:29.911 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.915+0000 7f8acad76640 1 --2- 10.20.193.58:0/3035143626 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8a9807a6c0 0x7f8a9809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:29.911 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.915+0000 7f8aab7fe640 1 -- 10.20.193.58:0/3035143626 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f8ab40862b0 con 0x7f8acc15c4b0 2026-02-23T06:22:29.911 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:29.915+0000 7f8acad76640 1 --2- 10.20.193.58:0/3035143626 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8a9807a6c0 0x7f8a9809ab70 secure :-1 s=READY pgs=131 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8acc1621f0 tx=0x7f8ac0005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:29.987 INFO:tasks.workunit.client.0.trial058.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2026-02-23T06:22:29.988 INFO:tasks.workunit.client.0.trial058.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2026-02-23T06:22:29.988 INFO:tasks.workunit.client.0.trial058.stderr:If you have problems, you may need to regenerate the build system entirely. 2026-02-23T06:22:29.988 INFO:tasks.workunit.client.0.trial058.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2026-02-23T06:22:30.052 INFO:tasks.workunit.client.0.trial058.stdout:/bin/sh ./config.status --recheck 2026-02-23T06:22:30.064 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:30.070+0000 7f8aa97fa640 1 -- 10.20.193.58:0/3035143626 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f8acc0afbe0 con 0x7f8acc15c4b0 2026-02-23T06:22:30.065 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:30.070+0000 7f8aab7fe640 1 -- 10.20.193.58:0/3035143626 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f8acc0afbe0 con 0x7f8acc15c4b0 2026-02-23T06:22:30.067 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:30.072+0000 7f8aa97fa640 1 -- 10.20.193.58:0/3035143626 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8a9807a6c0 msgr2=0x7f8a9809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:30.068 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:30.072+0000 7f8aa97fa640 1 --2- 10.20.193.58:0/3035143626 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8a9807a6c0 0x7f8a9809ab70 secure :-1 s=READY pgs=131 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8acc1621f0 tx=0x7f8ac0005f90 comp rx=0 tx=0).stop 2026-02-23T06:22:30.068 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:30.072+0000 7f8aa97fa640 1 -- 10.20.193.58:0/3035143626 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8acc15c4b0 msgr2=0x7f8acc1657c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:30.068 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:30.072+0000 7f8aa97fa640 1 --2- 10.20.193.58:0/3035143626 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8acc15c4b0 0x7f8acc1657c0 secure :-1 s=READY pgs=226 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ab402f740 tx=0x7f8ab4002950 comp rx=0 tx=0).stop 2026-02-23T06:22:30.068 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:30.072+0000 7f8aa97fa640 1 -- 10.20.193.58:0/3035143626 shutdown_connections 2026-02-23T06:22:30.068 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:30.072+0000 7f8aa97fa640 1 --2- 10.20.193.58:0/3035143626 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8a9807a6c0 0x7f8a9809ab70 unknown :-1 s=CLOSED pgs=131 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:30.068 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:30.072+0000 7f8aa97fa640 1 --2- 10.20.193.58:0/3035143626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8acc162ca0 0x7f8acc159510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:30.068 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:30.072+0000 7f8aa97fa640 1 --2- 10.20.193.58:0/3035143626 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8acc15c4b0 0x7f8acc1657c0 unknown :-1 s=CLOSED pgs=226 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:30.068 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:30.072+0000 7f8aa97fa640 1 --2- 10.20.193.58:0/3035143626 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8acc056960 0x7f8acc164230 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:30.068 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:30.072+0000 7f8aa97fa640 1 -- 10.20.193.58:0/3035143626 >> 10.20.193.58:0/3035143626 conn(0x7f8acc0b3c20 msgr2=0x7f8acc0b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:22:30.068 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:30.073+0000 7f8aa97fa640 1 -- 10.20.193.58:0/3035143626 shutdown_connections 2026-02-23T06:22:30.069 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:30.073+0000 7f8aa97fa640 1 -- 10.20.193.58:0/3035143626 wait complete. 2026-02-23T06:22:30.080 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:22:30.151 INFO:tasks.workunit.client.0.trial058.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2026-02-23T06:22:30.299 INFO:tasks.workunit.client.0.trial058.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2026-02-23T06:22:31.308 INFO:tasks.workunit.client.0.trial058.stdout:checking whether build environment is sane... yes 2026-02-23T06:22:31.317 INFO:tasks.workunit.client.0.trial058.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2026-02-23T06:22:31.318 INFO:tasks.workunit.client.0.trial058.stdout:checking for gawk... gawk 2026-02-23T06:22:31.333 INFO:tasks.workunit.client.0.trial058.stdout:checking whether make sets $(MAKE)... yes 2026-02-23T06:22:31.392 INFO:tasks.workunit.client.0.trial058.stdout:checking build system type... x86_64-unknown-linux-gnu 2026-02-23T06:22:31.393 INFO:tasks.workunit.client.0.trial058.stdout:checking host system type... x86_64-unknown-linux-gnu 2026-02-23T06:22:31.402 INFO:tasks.workunit.client.0.trial058.stdout:checking for style of include used by make... GNU 2026-02-23T06:22:31.405 INFO:tasks.workunit.client.0.trial058.stdout:checking for gcc... gcc 2026-02-23T06:22:32.471 INFO:tasks.workunit.client.0.trial058.stdout:checking whether the C compiler works... yes 2026-02-23T06:22:32.471 INFO:tasks.workunit.client.0.trial058.stdout:checking for C compiler default output file name... a.out 2026-02-23T06:22:32.519 INFO:tasks.workunit.client.0.trial058.stdout:checking for suffix of executables... 2026-02-23T06:22:32.573 INFO:tasks.workunit.client.0.trial058.stdout:checking whether we are cross compiling... no 2026-02-23T06:22:32.614 INFO:tasks.workunit.client.0.trial058.stdout:checking for suffix of object files... o 2026-02-23T06:22:32.645 INFO:tasks.workunit.client.0.trial058.stdout:checking whether we are using the GNU C compiler... yes 2026-02-23T06:22:32.677 INFO:tasks.workunit.client.0.trial058.stdout:checking whether gcc accepts -g... yes 2026-02-23T06:22:32.719 INFO:tasks.workunit.client.0.trial058.stdout:checking for gcc option to accept ISO C89... none needed 2026-02-23T06:22:32.808 INFO:tasks.workunit.client.0.trial058.stdout:checking dependency style of gcc... gcc3 2026-02-23T06:22:32.860 INFO:tasks.workunit.client.0.trial058.stdout:checking how to run the C preprocessor... gcc -E 2026-02-23T06:22:33.792 INFO:tasks.workunit.client.0.trial058.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2026-02-23T06:22:33.794 INFO:tasks.workunit.client.0.trial058.stdout:checking for egrep... /usr/bin/grep -E 2026-02-23T06:22:34.461 INFO:tasks.workunit.client.0.trial058.stdout:checking for ANSI C header files... yes 2026-02-23T06:22:34.764 INFO:tasks.workunit.client.0.trial058.stdout:checking for sys/types.h... yes 2026-02-23T06:22:34.814 INFO:tasks.workunit.client.0.trial058.stdout:checking for sys/stat.h... yes 2026-02-23T06:22:34.864 INFO:tasks.workunit.client.0.trial058.stdout:checking for stdlib.h... yes 2026-02-23T06:22:34.914 INFO:tasks.workunit.client.0.trial058.stdout:checking for string.h... yes 2026-02-23T06:22:34.964 INFO:tasks.workunit.client.0.trial058.stdout:checking for memory.h... yes 2026-02-23T06:22:35.016 INFO:tasks.workunit.client.0.trial058.stdout:checking for strings.h... yes 2026-02-23T06:22:35.067 INFO:tasks.workunit.client.0.trial058.stdout:checking for inttypes.h... yes 2026-02-23T06:22:35.292 INFO:tasks.workunit.client.0.trial058.stdout:checking for stdint.h... yes 2026-02-23T06:22:35.346 INFO:tasks.workunit.client.0.trial058.stdout:checking for unistd.h... yes 2026-02-23T06:22:35.397 INFO:tasks.workunit.client.0.trial058.stdout:checking minix/config.h usability... no 2026-02-23T06:22:35.428 INFO:tasks.workunit.client.0.trial058.stdout:checking minix/config.h presence... no 2026-02-23T06:22:35.428 INFO:tasks.workunit.client.0.trial058.stdout:checking for minix/config.h... no 2026-02-23T06:22:35.470 INFO:tasks.workunit.client.0.trial058.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2026-02-23T06:22:35.471 INFO:tasks.workunit.client.0.trial058.stdout:checking for gcc... (cached) gcc 2026-02-23T06:22:35.513 INFO:tasks.workunit.client.0.trial058.stdout:checking whether we are using the GNU C compiler... (cached) yes 2026-02-23T06:22:35.513 INFO:tasks.workunit.client.0.trial058.stdout:checking whether gcc accepts -g... (cached) yes 2026-02-23T06:22:35.513 INFO:tasks.workunit.client.0.trial058.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2026-02-23T06:22:35.513 INFO:tasks.workunit.client.0.trial058.stdout:checking dependency style of gcc... (cached) gcc3 2026-02-23T06:22:35.570 INFO:tasks.workunit.client.0.trial058.stdout:checking for main in -lm... yes 2026-02-23T06:22:35.627 INFO:tasks.workunit.client.0.trial058.stdout:checking for main in -lpthread... yes 2026-02-23T06:22:35.629 INFO:tasks.workunit.client.0.trial058.stdout:checking for ANSI C header files... (cached) yes 2026-02-23T06:22:35.670 INFO:tasks.workunit.client.0.trial058.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2026-02-23T06:22:35.820 INFO:tasks.workunit.client.0.trial058.stdout:checking pthread.h usability... yes 2026-02-23T06:22:35.844 INFO:tasks.workunit.client.0.trial058.stdout:checking pthread.h presence... yes 2026-02-23T06:22:35.844 INFO:tasks.workunit.client.0.trial058.stdout:checking for pthread.h... yes 2026-02-23T06:22:35.900 INFO:tasks.workunit.client.0.trial058.stdout:checking fcntl.h usability... yes 2026-02-23T06:22:35.921 INFO:tasks.workunit.client.0.trial058.stdout:checking fcntl.h presence... yes 2026-02-23T06:22:35.921 INFO:tasks.workunit.client.0.trial058.stdout:checking for fcntl.h... yes 2026-02-23T06:22:35.978 INFO:tasks.workunit.client.0.trial058.stdout:checking limits.h usability... yes 2026-02-23T06:22:35.998 INFO:tasks.workunit.client.0.trial058.stdout:checking limits.h presence... yes 2026-02-23T06:22:35.998 INFO:tasks.workunit.client.0.trial058.stdout:checking for limits.h... yes 2026-02-23T06:22:36.809 INFO:tasks.workunit.client.0.trial058.stdout:checking for stdint.h... (cached) yes 2026-02-23T06:22:36.996 INFO:tasks.workunit.client.0.trial058.stdout:checking sys/time.h usability... yes 2026-02-23T06:22:37.016 INFO:tasks.workunit.client.0.trial058.stdout:checking sys/time.h presence... yes 2026-02-23T06:22:37.016 INFO:tasks.workunit.client.0.trial058.stdout:checking for sys/time.h... yes 2026-02-23T06:22:37.032 INFO:tasks.workunit.client.0.trial058.stdout:checking for unistd.h... (cached) yes 2026-02-23T06:22:37.084 INFO:tasks.workunit.client.0.trial058.stdout:checking sys/vfs.h usability... yes 2026-02-23T06:22:37.104 INFO:tasks.workunit.client.0.trial058.stdout:checking sys/vfs.h presence... yes 2026-02-23T06:22:37.104 INFO:tasks.workunit.client.0.trial058.stdout:checking for sys/vfs.h... yes 2026-02-23T06:22:37.162 INFO:tasks.workunit.client.0.trial058.stdout:checking sys/limits.h usability... no 2026-02-23T06:22:37.192 INFO:tasks.workunit.client.0.trial058.stdout:checking sys/limits.h presence... no 2026-02-23T06:22:37.193 INFO:tasks.workunit.client.0.trial058.stdout:checking for sys/limits.h... no 2026-02-23T06:22:37.227 INFO:tasks.workunit.client.0.trial058.stdout:checking for an ANSI C-conforming const... yes 2026-02-23T06:22:37.264 INFO:tasks.workunit.client.0.trial058.stdout:checking whether time.h and sys/time.h may both be included... yes 2026-02-23T06:22:37.332 INFO:tasks.workunit.client.0.trial058.stdout:checking for system... yes 2026-02-23T06:22:37.406 INFO:tasks.workunit.client.0.trial058.stdout:checking for gettimeofday... yes 2026-02-23T06:22:37.478 INFO:tasks.workunit.client.0.trial058.stdout:checking for mkdir... yes 2026-02-23T06:22:37.550 INFO:tasks.workunit.client.0.trial058.stdout:checking for strerror... yes 2026-02-23T06:22:37.622 INFO:tasks.workunit.client.0.trial058.stdout:checking for open64... yes 2026-02-23T06:22:37.695 INFO:tasks.workunit.client.0.trial058.stdout:checking for stat64... yes 2026-02-23T06:22:37.820 INFO:tasks.workunit.client.0.trial058.stdout:checking for fseeko64... yes 2026-02-23T06:22:38.195 INFO:tasks.workunit.client.0.trial058.stdout:checking for lrand48_r... yes 2026-02-23T06:22:38.268 INFO:tasks.workunit.client.0.trial058.stdout:checking for srand48_r... yes 2026-02-23T06:22:38.298 INFO:tasks.workunit.client.0.trial058.stdout:configure: creating ./config.status 2026-02-23T06:22:38.396 INFO:tasks.workunit.client.0.trial058.stdout: /bin/sh ./config.status 2026-02-23T06:22:38.473 INFO:tasks.workunit.client.0.trial058.stdout:config.status: creating Makefile 2026-02-23T06:22:38.493 INFO:tasks.workunit.client.0.trial058.stdout:config.status: creating config.h 2026-02-23T06:22:38.515 INFO:tasks.workunit.client.0.trial058.stdout:config.status: executing depfiles commands 2026-02-23T06:22:38.543 INFO:tasks.workunit.client.0.trial058.stdout:config.status: executing default commands 2026-02-23T06:22:38.559 INFO:tasks.workunit.client.0.trial058.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2026-02-23T06:22:38.685 INFO:tasks.workunit.client.0.trial058.stdout:rm -f stamp-h1 2026-02-23T06:22:38.687 INFO:tasks.workunit.client.0.trial058.stdout:touch config.h.in 2026-02-23T06:22:38.690 INFO:tasks.workunit.client.0.trial058.stdout:cd . && /bin/sh ./config.status config.h 2026-02-23T06:22:39.015 INFO:tasks.workunit.client.0.trial058.stdout:config.status: creating config.h 2026-02-23T06:22:39.599 INFO:tasks.workunit.client.0.trial058.stdout:make all-am 2026-02-23T06:22:39.604 INFO:tasks.workunit.client.0.trial058.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2026-02-23T06:22:39.604 INFO:tasks.workunit.client.0.trial058.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2026-02-23T06:22:39.713 INFO:tasks.workunit.client.0.trial058.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2026-02-23T06:22:39.716 INFO:tasks.workunit.client.0.trial058.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2026-02-23T06:22:39.779 INFO:tasks.workunit.client.0.trial058.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2026-02-23T06:22:39.783 INFO:tasks.workunit.client.0.trial058.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2026-02-23T06:22:40.016 INFO:tasks.workunit.client.0.trial058.stdout:mv -f .deps/main.Tpo .deps/main.Po 2026-02-23T06:22:40.019 INFO:tasks.workunit.client.0.trial058.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2026-02-23T06:22:40.081 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:22:40.082 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:22:40.092 INFO:tasks.workunit.client.0.trial058.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2026-02-23T06:22:40.095 INFO:tasks.workunit.client.0.trial058.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2026-02-23T06:22:40.185 INFO:tasks.workunit.client.0.trial058.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2026-02-23T06:22:40.189 INFO:tasks.workunit.client.0.trial058.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2026-02-23T06:22:40.208 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.213+0000 7fe435043640 1 -- 10.20.193.58:0/3992401766 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe414003ad0 msgr2=0x7fe414003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:40.209 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.213+0000 7fe435043640 1 --2- 10.20.193.58:0/3992401766 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe414003ad0 0x7fe414003ee0 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=8943266822486541628 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe41c00c260 tx=0x7fe41c02f920 comp rx=0 tx=0).stop 2026-02-23T06:22:40.209 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.213+0000 7fe435043640 1 -- 10.20.193.58:0/3992401766 shutdown_connections 2026-02-23T06:22:40.209 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.213+0000 7fe435043640 1 --2- 10.20.193.58:0/3992401766 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe414003ad0 0x7fe414003ee0 unknown :-1 s=CLOSED pgs=228 gs=4 cs=0 l=1 c_cookie=8943266822486541628 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:40.209 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.213+0000 7fe435043640 1 -- 10.20.193.58:0/3992401766 >> 10.20.193.58:0/3992401766 conn(0x7fe42800e7f0 msgr2=0x7fe42800fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:22:40.209 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.214+0000 7fe435043640 1 -- 10.20.193.58:0/3992401766 shutdown_connections 2026-02-23T06:22:40.209 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.214+0000 7fe435043640 1 -- 10.20.193.58:0/3992401766 wait complete. 2026-02-23T06:22:40.212 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.215+0000 7fe435043640 1 Processor -- start 2026-02-23T06:22:40.212 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.215+0000 7fe435043640 1 -- start start 2026-02-23T06:22:40.212 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.215+0000 7fe435043640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe414003ad0 0x7fe428196260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:40.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.215+0000 7fe435043640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe4280fa700 0x7fe4280fab30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:40.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.216+0000 7fe435043640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe42804b980 0x7fe42804bdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:40.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.216+0000 7fe435043640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe4280fb070 con 0x7fe414003ad0 2026-02-23T06:22:40.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.216+0000 7fe435043640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe42804c330 con 0x7fe42804b980 2026-02-23T06:22:40.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.216+0000 7fe435043640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe42804d210 con 0x7fe4280fa700 2026-02-23T06:22:40.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.216+0000 7fe42ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe414003ad0 0x7fe428196260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:40.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.216+0000 7fe42ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe414003ad0 0x7fe428196260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:44838/0 (socket says 10.20.193.58:44838) 2026-02-23T06:22:40.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.216+0000 7fe42ffff640 1 -- 10.20.193.58:0/2998681357 learned_addr learned my addr 10.20.193.58:0/2998681357 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:22:40.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.216+0000 7fe42f7fe640 1 --2- 10.20.193.58:0/2998681357 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe4280fa700 0x7fe4280fab30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:40.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.216+0000 7fe434842640 1 --2- 10.20.193.58:0/2998681357 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe42804b980 0x7fe42804bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:40.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.216+0000 7fe42ffff640 1 -- 10.20.193.58:0/2998681357 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe4280fa700 msgr2=0x7fe4280fab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:40.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.216+0000 7fe42ffff640 1 --2- 10.20.193.58:0/2998681357 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe4280fa700 0x7fe4280fab30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:40.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.216+0000 7fe42ffff640 1 -- 10.20.193.58:0/2998681357 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe42804b980 msgr2=0x7fe42804bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:40.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.216+0000 7fe42ffff640 1 --2- 10.20.193.58:0/2998681357 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe42804b980 0x7fe42804bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:40.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.216+0000 7fe42ffff640 1 -- 10.20.193.58:0/2998681357 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42804d4f0 con 0x7fe414003ad0 2026-02-23T06:22:40.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.216+0000 7fe434842640 1 --2- 10.20.193.58:0/2998681357 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe42804b980 0x7fe42804bdf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:22:40.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.216+0000 7fe42f7fe640 1 --2- 10.20.193.58:0/2998681357 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe4280fa700 0x7fe4280fab30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:22:40.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.216+0000 7fe42ffff640 1 --2- 10.20.193.58:0/2998681357 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe414003ad0 0x7fe428196260 secure :-1 s=READY pgs=229 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe41c00c360 tx=0x7fe41c039720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:40.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.216+0000 7fe42cff9640 1 -- 10.20.193.58:0/2998681357 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe41c03c030 con 0x7fe414003ad0 2026-02-23T06:22:40.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.216+0000 7fe42cff9640 1 -- 10.20.193.58:0/2998681357 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe41c039b60 con 0x7fe414003ad0 2026-02-23T06:22:40.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.216+0000 7fe42cff9640 1 -- 10.20.193.58:0/2998681357 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe41c003470 con 0x7fe414003ad0 2026-02-23T06:22:40.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.216+0000 7fe435043640 1 -- 10.20.193.58:0/2998681357 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe42804d7d0 con 0x7fe414003ad0 2026-02-23T06:22:40.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.217+0000 7fe435043640 1 -- 10.20.193.58:0/2998681357 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe42804dd90 con 0x7fe414003ad0 2026-02-23T06:22:40.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.217+0000 7fe435043640 1 -- 10.20.193.58:0/2998681357 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4280537f0 con 0x7fe414003ad0 2026-02-23T06:22:40.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.218+0000 7fe42cff9640 1 -- 10.20.193.58:0/2998681357 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fe41c04a060 con 0x7fe414003ad0 2026-02-23T06:22:40.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.219+0000 7fe42cff9640 1 --2- 10.20.193.58:0/2998681357 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe40007a6c0 0x7fe40009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:40.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.220+0000 7fe42cff9640 1 -- 10.20.193.58:0/2998681357 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fe41c03f040 con 0x7fe414003ad0 2026-02-23T06:22:40.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.220+0000 7fe42f7fe640 1 --2- 10.20.193.58:0/2998681357 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe40007a6c0 0x7fe40009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:40.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.220+0000 7fe42cff9640 1 -- 10.20.193.58:0/2998681357 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fe41c088ef0 con 0x7fe414003ad0 2026-02-23T06:22:40.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.221+0000 7fe42f7fe640 1 --2- 10.20.193.58:0/2998681357 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe40007a6c0 0x7fe40009ab70 secure :-1 s=READY pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4200023d0 tx=0x7fe420006c50 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:40.241 INFO:tasks.workunit.client.0.trial058.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2026-02-23T06:22:40.245 INFO:tasks.workunit.client.0.trial058.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2026-02-23T06:22:40.289 INFO:tasks.workunit.client.0.trial058.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2026-02-23T06:22:40.292 INFO:tasks.workunit.client.0.trial058.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2026-02-23T06:22:40.341 INFO:tasks.workunit.client.0.trial058.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2026-02-23T06:22:40.344 INFO:tasks.workunit.client.0.trial058.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2026-02-23T06:22:40.370 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.375+0000 7fe435043640 1 -- 10.20.193.58:0/2998681357 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe4280fb2f0 con 0x7fe414003ad0 2026-02-23T06:22:40.370 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.375+0000 7fe42cff9640 1 -- 10.20.193.58:0/2998681357 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7fe41c088640 con 0x7fe414003ad0 2026-02-23T06:22:40.371 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:22:40.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.377+0000 7fe435043640 1 -- 10.20.193.58:0/2998681357 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe40007a6c0 msgr2=0x7fe40009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:40.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.377+0000 7fe435043640 1 --2- 10.20.193.58:0/2998681357 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe40007a6c0 0x7fe40009ab70 secure :-1 s=READY pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4200023d0 tx=0x7fe420006c50 comp rx=0 tx=0).stop 2026-02-23T06:22:40.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.377+0000 7fe435043640 1 -- 10.20.193.58:0/2998681357 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe414003ad0 msgr2=0x7fe428196260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:40.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.377+0000 7fe435043640 1 --2- 10.20.193.58:0/2998681357 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe414003ad0 0x7fe428196260 secure :-1 s=READY pgs=229 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe41c00c360 tx=0x7fe41c039720 comp rx=0 tx=0).stop 2026-02-23T06:22:40.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.377+0000 7fe435043640 1 -- 10.20.193.58:0/2998681357 shutdown_connections 2026-02-23T06:22:40.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.377+0000 7fe435043640 1 --2- 10.20.193.58:0/2998681357 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe40007a6c0 0x7fe40009ab70 unknown :-1 s=CLOSED pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:40.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.377+0000 7fe435043640 1 --2- 10.20.193.58:0/2998681357 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe42804b980 0x7fe42804bdf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:40.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.377+0000 7fe435043640 1 --2- 10.20.193.58:0/2998681357 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe4280fa700 0x7fe4280fab30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:40.374 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.377+0000 7fe435043640 1 --2- 10.20.193.58:0/2998681357 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe414003ad0 0x7fe428196260 unknown :-1 s=CLOSED pgs=229 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:40.374 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.377+0000 7fe435043640 1 -- 10.20.193.58:0/2998681357 >> 10.20.193.58:0/2998681357 conn(0x7fe42800e7f0 msgr2=0x7fe4280f1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:22:40.374 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.378+0000 7fe435043640 1 -- 10.20.193.58:0/2998681357 shutdown_connections 2026-02-23T06:22:40.374 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.378+0000 7fe435043640 1 -- 10.20.193.58:0/2998681357 wait complete. 2026-02-23T06:22:40.386 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:22:40.387 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:22:40.387 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:22:40.387 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:22:40.477 INFO:tasks.workunit.client.0.trial058.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2026-02-23T06:22:40.480 INFO:tasks.workunit.client.0.trial058.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2026-02-23T06:22:40.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.560+0000 7f38275d2640 1 -- 10.20.193.58:0/138857924 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3810003a80 msgr2=0x7f3810003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:40.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.560+0000 7f38275d2640 1 --2- 10.20.193.58:0/138857924 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3810003a80 0x7f3810003e90 secure :-1 s=READY pgs=231 gs=6 cs=0 l=1 c_cookie=6983713921077717118 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3818002cf0 tx=0x7f381802ef70 comp rx=0 tx=0).stop 2026-02-23T06:22:40.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.560+0000 7f3826dd1640 1 -- 10.20.193.58:0/138857924 reap_dead start 2026-02-23T06:22:40.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.560+0000 7f38275d2640 1 -- 10.20.193.58:0/138857924 shutdown_connections 2026-02-23T06:22:40.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.560+0000 7f38275d2640 1 -- 10.20.193.58:0/138857924 >> 10.20.193.58:0/138857924 conn(0x7f38200b3c20 msgr2=0x7f38200b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:22:40.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.560+0000 7f38275d2640 1 -- 10.20.193.58:0/138857924 shutdown_connections 2026-02-23T06:22:40.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.560+0000 7f38275d2640 1 -- 10.20.193.58:0/138857924 wait complete. 2026-02-23T06:22:40.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.561+0000 7f38275d2640 1 Processor -- start 2026-02-23T06:22:40.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.561+0000 7f38275d2640 1 -- start start 2026-02-23T06:22:40.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.562+0000 7f38275d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f382013e620 0x7f3820057230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:40.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.562+0000 7f38275d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3820140540 0x7f3820161450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:40.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.562+0000 7f38275d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f382013e9f0 0x7f38201409f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:40.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.562+0000 7f38275d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f3820056da0 con 0x7f3820140540 2026-02-23T06:22:40.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.562+0000 7f38275d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f3820143390 con 0x7f382013e620 2026-02-23T06:22:40.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.562+0000 7f38275d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f3820057980 con 0x7f382013e9f0 2026-02-23T06:22:40.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.562+0000 7f3825dcf640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3820140540 0x7f3820161450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:40.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.562+0000 7f3825dcf640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3820140540 0x7f3820161450 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:44844/0 (socket says 10.20.193.58:44844) 2026-02-23T06:22:40.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.562+0000 7f3825dcf640 1 -- 10.20.193.58:0/1647901248 learned_addr learned my addr 10.20.193.58:0/1647901248 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:22:40.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.562+0000 7f38265d0640 1 --2- 10.20.193.58:0/1647901248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f382013e620 0x7f3820057230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:40.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.562+0000 7f3825dcf640 1 -- 10.20.193.58:0/1647901248 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f382013e9f0 msgr2=0x7f38201409f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:40.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.562+0000 7f3825dcf640 1 --2- 10.20.193.58:0/1647901248 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f382013e9f0 0x7f38201409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:40.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.562+0000 7f3825dcf640 1 -- 10.20.193.58:0/1647901248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f382013e620 msgr2=0x7f3820057230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:40.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.562+0000 7f3825dcf640 1 --2- 10.20.193.58:0/1647901248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f382013e620 0x7f3820057230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:40.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.562+0000 7f3825dcf640 1 -- 10.20.193.58:0/1647901248 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3820142dd0 con 0x7f3820140540 2026-02-23T06:22:40.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.562+0000 7f3825dcf640 1 --2- 10.20.193.58:0/1647901248 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3820140540 0x7f3820161450 secure :-1 s=READY pgs=232 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f380c006fd0 tx=0x7f380c003b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:40.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.563+0000 7f380affd640 1 -- 10.20.193.58:0/1647901248 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f380c00fad0 con 0x7f3820140540 2026-02-23T06:22:40.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.563+0000 7f380affd640 1 -- 10.20.193.58:0/1647901248 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f380c00fc30 con 0x7f3820140540 2026-02-23T06:22:40.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.563+0000 7f380affd640 1 -- 10.20.193.58:0/1647901248 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f380c011430 con 0x7f3820140540 2026-02-23T06:22:40.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.563+0000 7f38275d2640 1 -- 10.20.193.58:0/1647901248 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38201430b0 con 0x7f3820140540 2026-02-23T06:22:40.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.563+0000 7f38275d2640 1 -- 10.20.193.58:0/1647901248 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3820140f30 con 0x7f3820140540 2026-02-23T06:22:40.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.563+0000 7f38275d2640 1 --2- 10.20.193.58:0/1647901248 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3820141210 0x7f382011b940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:40.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.563+0000 7f38275d2640 1 -- 10.20.193.58:0/1647901248 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f3820143240 con 0x7f3820141210 2026-02-23T06:22:40.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.564+0000 7f38265d0640 1 --2- 10.20.193.58:0/1647901248 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3820141210 0x7f382011b940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:40.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.564+0000 7f38265d0640 1 -- 10.20.193.58:0/1647901248 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3820056c00 con 0x7f3820141210 2026-02-23T06:22:40.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.564+0000 7f38265d0640 1 --2- 10.20.193.58:0/1647901248 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3820141210 0x7f382011b940 secure :-1 s=READY pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38180028f0 tx=0x7f3818006130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:40.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.564+0000 7f380affd640 1 -- 10.20.193.58:0/1647901248 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f381802fc00 con 0x7f3820141210 2026-02-23T06:22:40.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.565+0000 7f380affd640 1 -- 10.20.193.58:0/1647901248 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f3818040040 con 0x7f3820141210 2026-02-23T06:22:40.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.565+0000 7f380affd640 1 -- 10.20.193.58:0/1647901248 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3820141210 msgr2=0x7f382011b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:40.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.565+0000 7f380affd640 1 --2- 10.20.193.58:0/1647901248 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3820141210 0x7f382011b940 secure :-1 s=READY pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38180028f0 tx=0x7f3818006130 comp rx=0 tx=0).stop 2026-02-23T06:22:40.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.565+0000 7f380affd640 1 -- 10.20.193.58:0/1647901248 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3820141210 msgr2=0x7f382011b940 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:22:40.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.565+0000 7f380affd640 1 --2- 10.20.193.58:0/1647901248 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3820141210 0x7f382011b940 unknown :-1 s=CLOSED pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:40.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.565+0000 7f380affd640 1 -- 10.20.193.58:0/1647901248 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f380c011590 con 0x7f3820140540 2026-02-23T06:22:40.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.566+0000 7f380affd640 1 --2- 10.20.193.58:0/1647901248 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f37f007a3c0 0x7f37f009a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:40.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.566+0000 7f380affd640 1 -- 10.20.193.58:0/1647901248 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f380c09e2c0 con 0x7f3820140540 2026-02-23T06:22:40.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.566+0000 7f38265d0640 1 --2- 10.20.193.58:0/1647901248 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f37f007a3c0 0x7f37f009a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:40.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.567+0000 7f38265d0640 1 --2- 10.20.193.58:0/1647901248 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f37f007a3c0 0x7f37f009a870 secure :-1 s=READY pgs=133 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3818006480 tx=0x7f381803c030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:40.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.568+0000 7f38275d2640 1 --2- 10.20.193.58:0/1647901248 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f382011be80 0x7f382011c250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:40.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.568+0000 7f38275d2640 1 -- 10.20.193.58:0/1647901248 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f38200b5e10 con 0x7f382011be80 2026-02-23T06:22:40.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.568+0000 7f3826dd1640 1 --2- 10.20.193.58:0/1647901248 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f382011be80 0x7f382011c250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:40.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.569+0000 7f3826dd1640 1 -- 10.20.193.58:0/1647901248 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f38200b5b30 con 0x7f382011be80 2026-02-23T06:22:40.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.569+0000 7f3826dd1640 1 --2- 10.20.193.58:0/1647901248 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f382011be80 0x7f382011c250 secure :-1 s=READY pgs=234 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38200b5010 tx=0x7f3814011a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:40.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.569+0000 7f380affd640 1 -- 10.20.193.58:0/1647901248 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3814005b50 con 0x7f382011be80 2026-02-23T06:22:40.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.569+0000 7f380affd640 1 -- 10.20.193.58:0/1647901248 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5247 (secure 0 0 0) 0x7f3814011eb0 con 0x7f382011be80 2026-02-23T06:22:40.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.569+0000 7f380affd640 1 -- 10.20.193.58:0/1647901248 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f382011be80 msgr2=0x7f382011c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:40.564 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:22:40.564 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:22:40.564 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:22:40.564 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:22:40.564 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 10, 2026-02-23T06:22:40.564 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 98579, 2026-02-23T06:22:40.564 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:22:40.564 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:22:40.564 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:22:40.564 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:22:40.564 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:40.564 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 16, 2026-02-23T06:22:40.564 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:22:40.564 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:22:40.564 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:22:40.564 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:22:40.564 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:22:40.565 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:22:40.565 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:22:40.565 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:22:40.565 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:22:40.565 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:22:40.565 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:22:40.565 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:22:40.565 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:22:40.565 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:22:40.565 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:22:40.565 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:22:40.565 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:40.565 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:22:40.565 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:22:40.565 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:22:40.565 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:22:40.565 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:22:40.565 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:22:40.565 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:22:40.565 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:22:40.565 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:22:40.565 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:22:40.565 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:22:40.565 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:22:40.565 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:22:40.565 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:22:40.565 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:22:40.565 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:40.566 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.566 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:22:40.566 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:22:40.566 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:22:40.566 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:22:40.566 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:22:40.566 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:22:40.566 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:22:40.566 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:22:40.566 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:22:40.566 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:22:40.566 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:22:40.566 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:22:40.566 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:22:40.566 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:22:40.566 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:22:40.566 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:22:40.566 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:22:40.566 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:22:40.566 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:22:40.566 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:22:40.566 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:22:40.566 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:22:40.566 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:22:40.566 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:22:40.566 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:22:40.566 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:22:40.566 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:22:40.567 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:22:40.567 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:22:40.567 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:22:40.567 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:40.567 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:22:40.567 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.567 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:22:40.567 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.567 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:22:40.567 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:22:40.567 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:22:40.567 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:22:40.567 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.567 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:22:40.567 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:22:40.567 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:40.567 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.567 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.567 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:22:40.567 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:22:40.567 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:40.567 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:40.567 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:40.567 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.567 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:22:40.568 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:22:40.568 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:22:40.568 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:22:40.568 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:22:40.568 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:22:40.568 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.568 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.568 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:22:40.568 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:22:40.568 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:22:40.568 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:22:40.568 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.568 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:22:40.568 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:22:40.568 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:40.568 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.568 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.568 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:22:40.568 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:22:40.568 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:40.568 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:40.569 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:40.569 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.569 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:22:40.569 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:22:40.569 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:22:40.569 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:22:40.569 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:22:40.569 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:22:40.569 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.569 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.569 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:22:40.569 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:22:40.569 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:22:40.569 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:22:40.569 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.569 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:22:40.569 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:22:40.569 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:40.569 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.569 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.570 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:22:40.570 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:22:40.570 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:40.570 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:40.570 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:40.570 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.570 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:22:40.570 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:22:40.570 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:22:40.570 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:22:40.570 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:22:40.570 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:22:40.570 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:40.570 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:40.570 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.570 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:22:40.570 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:22:40.570 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.570 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:40.570 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:40.571 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:22:40.571 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:40.571 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:40.571 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:22:40.571 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.571 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:40.571 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:40.571 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:22:40.571 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:40.571 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:40.571 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:22:40.571 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.571 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:40.571 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:40.571 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:22:40.571 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:40.571 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:40.571 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:22:40.571 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.571 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:40.571 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:40.572 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:22:40.572 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:40.572 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:40.572 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.572 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:22:40.572 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:22:40.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.569+0000 7f380affd640 1 --2- 10.20.193.58:0/1647901248 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f382011be80 0x7f382011c250 secure :-1 s=READY pgs=234 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38200b5010 tx=0x7f3814011a40 comp rx=0 tx=0).stop 2026-02-23T06:22:40.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.569+0000 7f380affd640 1 -- 10.20.193.58:0/1647901248 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f382011be80 msgr2=0x7f382011c250 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:22:40.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.569+0000 7f380affd640 1 --2- 10.20.193.58:0/1647901248 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f382011be80 0x7f382011c250 secure :-1 s=CLOSED pgs=234 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38200b5010 tx=0x7f3814011a40 comp rx=0 tx=0).stop 2026-02-23T06:22:40.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.570+0000 7f38275d2640 1 -- 10.20.193.58:0/1647901248 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f37f007a3c0 msgr2=0x7f37f009a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:40.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.570+0000 7f38275d2640 1 --2- 10.20.193.58:0/1647901248 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f37f007a3c0 0x7f37f009a870 secure :-1 s=READY pgs=133 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3818006480 tx=0x7f381803c030 comp rx=0 tx=0).stop 2026-02-23T06:22:40.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.570+0000 7f38275d2640 1 -- 10.20.193.58:0/1647901248 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3820140540 msgr2=0x7f3820161450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:40.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.570+0000 7f38275d2640 1 --2- 10.20.193.58:0/1647901248 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3820140540 0x7f3820161450 secure :-1 s=READY pgs=232 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f380c006fd0 tx=0x7f380c003b60 comp rx=0 tx=0).stop 2026-02-23T06:22:40.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.570+0000 7f3826dd1640 1 -- 10.20.193.58:0/1647901248 reap_dead start 2026-02-23T06:22:40.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.570+0000 7f38275d2640 1 -- 10.20.193.58:0/1647901248 shutdown_connections 2026-02-23T06:22:40.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.570+0000 7f38275d2640 1 -- 10.20.193.58:0/1647901248 >> 10.20.193.58:0/1647901248 conn(0x7f38200b3c20 msgr2=0x7f382005c630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:22:40.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.570+0000 7f38275d2640 1 -- 10.20.193.58:0/1647901248 shutdown_connections 2026-02-23T06:22:40.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.570+0000 7f38275d2640 1 -- 10.20.193.58:0/1647901248 wait complete. 2026-02-23T06:22:40.574 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:22:40.574 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:22:40.574 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:22:40.574 INFO:tasks.workunit.client.0.trial058.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2026-02-23T06:22:40.575 INFO:tasks.workunit.client.0.trial058.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2026-02-23T06:22:40.680 INFO:tasks.workunit.client.0.trial058.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2026-02-23T06:22:40.684 INFO:tasks.workunit.client.0.trial058.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2026-02-23T06:22:40.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.704+0000 7fe95add2640 1 -- 10.20.193.58:0/1876737558 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe95415c2f0 msgr2=0x7fe95405a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:40.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.704+0000 7fe95add2640 1 --2- 10.20.193.58:0/1876737558 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe95415c2f0 0x7fe95405a620 secure :-1 s=READY pgs=218 gs=2 cs=0 l=1 c_cookie=8956535624338808023 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe948004740 tx=0x7fe94802f250 comp rx=0 tx=0).stop 2026-02-23T06:22:40.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.704+0000 7fe95add2640 1 -- 10.20.193.58:0/1876737558 shutdown_connections 2026-02-23T06:22:40.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.704+0000 7fe95add2640 1 --2- 10.20.193.58:0/1876737558 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe9540590d0 0x7fe95405ab60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:40.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.704+0000 7fe95add2640 1 --2- 10.20.193.58:0/1876737558 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe95415c2f0 0x7fe95405a620 unknown :-1 s=CLOSED pgs=218 gs=2 cs=0 l=1 c_cookie=8956535624338808023 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:40.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.704+0000 7fe95add2640 1 -- 10.20.193.58:0/1876737558 >> 10.20.193.58:0/1876737558 conn(0x7fe954054390 msgr2=0x7fe954054760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:22:40.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.704+0000 7fe95add2640 1 -- 10.20.193.58:0/1876737558 shutdown_connections 2026-02-23T06:22:40.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.704+0000 7fe95add2640 1 -- 10.20.193.58:0/1876737558 wait complete. 2026-02-23T06:22:40.703 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.706+0000 7fe95add2640 1 Processor -- start 2026-02-23T06:22:40.703 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.706+0000 7fe95add2640 1 -- start start 2026-02-23T06:22:40.703 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.706+0000 7fe95add2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe9540590d0 0x7fe954167430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:40.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.706+0000 7fe95add2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe95415bf20 0x7fe95405b010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:40.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.706+0000 7fe95add2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe95415c2f0 0x7fe954168230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:40.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.706+0000 7fe95add2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe9541667c0 con 0x7fe95415bf20 2026-02-23T06:22:40.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.706+0000 7fe95add2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe954167970 con 0x7fe95415c2f0 2026-02-23T06:22:40.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.706+0000 7fe95add2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe95413d0e0 con 0x7fe9540590d0 2026-02-23T06:22:40.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.707+0000 7fe959dd0640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe9540590d0 0x7fe954167430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:40.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.707+0000 7fe95a5d1640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe95415c2f0 0x7fe954168230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:40.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.707+0000 7fe95a5d1640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe95415c2f0 0x7fe954168230 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:39150/0 (socket says 10.20.193.58:39150) 2026-02-23T06:22:40.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.707+0000 7fe95a5d1640 1 -- 10.20.193.58:0/1453630000 learned_addr learned my addr 10.20.193.58:0/1453630000 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:22:40.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.707+0000 7fe9595cf640 1 --2- 10.20.193.58:0/1453630000 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe95415bf20 0x7fe95405b010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:40.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.707+0000 7fe9595cf640 1 -- 10.20.193.58:0/1453630000 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe9540590d0 msgr2=0x7fe954167430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:40.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.707+0000 7fe9595cf640 1 --2- 10.20.193.58:0/1453630000 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe9540590d0 0x7fe954167430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:40.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.707+0000 7fe9595cf640 1 -- 10.20.193.58:0/1453630000 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe95415c2f0 msgr2=0x7fe954168230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:40.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.707+0000 7fe9595cf640 1 --2- 10.20.193.58:0/1453630000 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe95415c2f0 0x7fe954168230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:40.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.707+0000 7fe9595cf640 1 -- 10.20.193.58:0/1453630000 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9480094b0 con 0x7fe95415bf20 2026-02-23T06:22:40.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.707+0000 7fe9595cf640 1 --2- 10.20.193.58:0/1453630000 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe95415bf20 0x7fe95405b010 secure :-1 s=READY pgs=236 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe948009230 tx=0x7fe948002950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:40.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.707+0000 7fe9427fc640 1 -- 10.20.193.58:0/1453630000 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe948005d40 con 0x7fe95415bf20 2026-02-23T06:22:40.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.707+0000 7fe9427fc640 1 -- 10.20.193.58:0/1453630000 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe948038560 con 0x7fe95415bf20 2026-02-23T06:22:40.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.707+0000 7fe9427fc640 1 -- 10.20.193.58:0/1453630000 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe948038910 con 0x7fe95415bf20 2026-02-23T06:22:40.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.707+0000 7fe95add2640 1 -- 10.20.193.58:0/1453630000 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe954166a10 con 0x7fe95415bf20 2026-02-23T06:22:40.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.707+0000 7fe95add2640 1 -- 10.20.193.58:0/1453630000 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe954140910 con 0x7fe95415bf20 2026-02-23T06:22:40.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.708+0000 7fe95add2640 1 --2- 10.20.193.58:0/1453630000 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe954168770 0x7fe954140b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:40.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.708+0000 7fe95add2640 1 -- 10.20.193.58:0/1453630000 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe954141070 con 0x7fe954168770 2026-02-23T06:22:40.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.708+0000 7fe959dd0640 1 --2- 10.20.193.58:0/1453630000 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe954168770 0x7fe954140b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:40.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.709+0000 7fe959dd0640 1 -- 10.20.193.58:0/1453630000 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe9540b76e0 con 0x7fe954168770 2026-02-23T06:22:40.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.709+0000 7fe9427fc640 1 -- 10.20.193.58:0/1453630000 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fe948038a70 con 0x7fe95415bf20 2026-02-23T06:22:40.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.709+0000 7fe959dd0640 1 --2- 10.20.193.58:0/1453630000 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe954168770 0x7fe954140b30 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9440029a0 tx=0x7fe94400fc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:40.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.710+0000 7fe9427fc640 1 --2- 10.20.193.58:0/1453630000 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe92407a6c0 0x7fe92409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:40.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.710+0000 7fe9427fc640 1 -- 10.20.193.58:0/1453630000 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fe9480c29a0 con 0x7fe95415bf20 2026-02-23T06:22:40.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.710+0000 7fe9427fc640 1 -- 10.20.193.58:0/1453630000 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe94400dae0 con 0x7fe954168770 2026-02-23T06:22:40.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.710+0000 7fe9427fc640 1 -- 10.20.193.58:0/1453630000 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fe94400fe10 con 0x7fe954168770 2026-02-23T06:22:40.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.710+0000 7fe9427fc640 1 -- 10.20.193.58:0/1453630000 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe954168770 msgr2=0x7fe954140b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:40.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.710+0000 7fe9427fc640 1 --2- 10.20.193.58:0/1453630000 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe954168770 0x7fe954140b30 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9440029a0 tx=0x7fe94400fc10 comp rx=0 tx=0).stop 2026-02-23T06:22:40.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.710+0000 7fe9427fc640 1 -- 10.20.193.58:0/1453630000 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe954168770 msgr2=0x7fe954140b30 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:22:40.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.710+0000 7fe9427fc640 1 --2- 10.20.193.58:0/1453630000 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe954168770 0x7fe954140b30 unknown :-1 s=CLOSED pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:40.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.710+0000 7fe95a5d1640 1 --2- 10.20.193.58:0/1453630000 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe92407a6c0 0x7fe92409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:40.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.711+0000 7fe95a5d1640 1 --2- 10.20.193.58:0/1453630000 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe92407a6c0 0x7fe92409ab70 secure :-1 s=READY pgs=134 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe954162ff0 tx=0x7fe95000a310 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:40.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.714+0000 7fe95add2640 1 --2- 10.20.193.58:0/1453630000 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe95415b100 0x7fe95415b500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:40.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.714+0000 7fe95add2640 1 -- 10.20.193.58:0/1453630000 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe9540b6ba0 con 0x7fe95415b100 2026-02-23T06:22:40.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.714+0000 7fe959dd0640 1 --2- 10.20.193.58:0/1453630000 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe95415b100 0x7fe95415b500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:40.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.715+0000 7fe959dd0640 1 -- 10.20.193.58:0/1453630000 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe9540b8430 con 0x7fe95415b100 2026-02-23T06:22:40.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.715+0000 7fe959dd0640 1 --2- 10.20.193.58:0/1453630000 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe95415b100 0x7fe95415b500 secure :-1 s=READY pgs=220 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9440023d0 tx=0x7fe9440046e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:40.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.715+0000 7fe9427fc640 1 -- 10.20.193.58:0/1453630000 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe944014b20 con 0x7fe95415b100 2026-02-23T06:22:40.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.715+0000 7fe9427fc640 1 -- 10.20.193.58:0/1453630000 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5555 (secure 0 0 0) 0x7fe94401f870 con 0x7fe95415b100 2026-02-23T06:22:40.711 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:22:40.711 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:22:40.711 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:22:40.711 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:22:40.711 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 10, 2026-02-23T06:22:40.711 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 98762, 2026-02-23T06:22:40.711 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:22:40.712 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:22:40.712 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:22:40.712 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:22:40.712 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:40.712 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 16, 2026-02-23T06:22:40.712 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:22:40.712 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:22:40.712 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:22:40.712 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:22:40.712 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:22:40.712 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:22:40.713 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:22:40.713 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:22:40.713 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:22:40.713 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:22:40.713 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:22:40.713 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:22:40.713 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:22:40.713 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:22:40.713 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:22:40.713 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:22:40.713 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:40.714 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:22:40.714 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:22:40.714 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:22:40.714 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:22:40.714 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:22:40.714 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:22:40.714 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:22:40.714 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:22:40.714 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:22:40.714 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:22:40.714 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:22:40.714 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:22:40.715 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:22:40.715 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:22:40.715 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:22:40.715 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:40.715 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.715 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:22:40.715 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:22:40.715 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:22:40.715 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:22:40.715 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:22:40.715 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:22:40.716 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:22:40.716 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:22:40.716 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:22:40.716 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:22:40.716 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:22:40.716 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:22:40.716 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:22:40.716 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:22:40.716 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:22:40.716 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:22:40.716 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:22:40.716 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:22:40.717 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:22:40.717 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:22:40.717 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:22:40.717 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:22:40.717 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:22:40.717 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:22:40.717 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:22:40.717 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:22:40.717 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:22:40.717 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:22:40.717 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:22:40.717 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:22:40.718 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:40.718 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:22:40.718 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.718 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:22:40.718 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.718 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:22:40.718 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:22:40.718 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:22:40.718 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:22:40.718 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.718 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:22:40.718 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:22:40.719 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:40.719 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.719 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.719 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:22:40.719 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:22:40.719 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:40.719 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:40.719 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:40.719 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.719 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:22:40.719 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:22:40.720 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:22:40.720 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:22:40.720 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:22:40.720 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:22:40.720 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.720 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.720 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:22:40.720 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:22:40.720 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:22:40.720 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:22:40.720 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.720 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:22:40.721 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:22:40.721 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:40.721 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.721 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.721 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:22:40.721 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:22:40.721 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:40.721 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:40.721 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:40.721 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.721 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:22:40.721 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:22:40.722 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:22:40.722 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:22:40.722 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:22:40.722 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:22:40.722 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.722 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.722 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:22:40.722 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:22:40.722 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:22:40.722 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:22:40.722 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.722 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:22:40.723 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:22:40.723 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:40.723 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.723 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.723 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:22:40.723 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:22:40.723 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:40.723 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:40.723 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:40.723 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.723 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:22:40.723 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:22:40.724 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:22:40.724 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:22:40.724 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:22:40.724 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:22:40.724 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:40.724 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:40.724 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.724 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:22:40.724 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:22:40.724 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.724 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:40.724 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:40.725 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:22:40.725 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:40.725 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:40.725 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:22:40.725 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.725 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:40.725 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:40.725 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:22:40.725 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:40.725 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:40.725 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:22:40.725 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.726 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:40.726 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:40.726 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:22:40.726 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:40.726 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:40.726 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:22:40.726 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.726 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:22:40.726 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:22:40.726 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:22:40.726 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.726 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.727 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:40.727 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:40.727 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:22:40.727 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:40.727 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:40.727 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:22:40.727 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.727 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:40.727 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:40.727 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:22:40.727 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:40.727 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:40.728 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.728 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:22:40.728 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:22:40.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.715+0000 7fe9427fc640 1 -- 10.20.193.58:0/1453630000 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe95415b100 msgr2=0x7fe95415b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:40.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.715+0000 7fe9427fc640 1 --2- 10.20.193.58:0/1453630000 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe95415b100 0x7fe95415b500 secure :-1 s=READY pgs=220 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9440023d0 tx=0x7fe9440046e0 comp rx=0 tx=0).stop 2026-02-23T06:22:40.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.715+0000 7fe9427fc640 1 -- 10.20.193.58:0/1453630000 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe95415b100 msgr2=0x7fe95415b500 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:22:40.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.715+0000 7fe9427fc640 1 --2- 10.20.193.58:0/1453630000 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe95415b100 0x7fe95415b500 secure :-1 s=CLOSED pgs=220 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9440023d0 tx=0x7fe9440046e0 comp rx=0 tx=0).stop 2026-02-23T06:22:40.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.716+0000 7fe95add2640 1 -- 10.20.193.58:0/1453630000 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe92407a6c0 msgr2=0x7fe92409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:40.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.716+0000 7fe95add2640 1 --2- 10.20.193.58:0/1453630000 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe92407a6c0 0x7fe92409ab70 secure :-1 s=READY pgs=134 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe954162ff0 tx=0x7fe95000a310 comp rx=0 tx=0).stop 2026-02-23T06:22:40.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.716+0000 7fe95add2640 1 -- 10.20.193.58:0/1453630000 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe95415bf20 msgr2=0x7fe95405b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:40.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.716+0000 7fe95add2640 1 --2- 10.20.193.58:0/1453630000 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe95415bf20 0x7fe95405b010 secure :-1 s=READY pgs=236 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe948009230 tx=0x7fe948002950 comp rx=0 tx=0).stop 2026-02-23T06:22:40.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.716+0000 7fe95a5d1640 1 -- 10.20.193.58:0/1453630000 reap_dead start 2026-02-23T06:22:40.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.716+0000 7fe95a5d1640 1 -- 10.20.193.58:0/1453630000 reap_dead start 2026-02-23T06:22:40.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.716+0000 7fe95add2640 1 -- 10.20.193.58:0/1453630000 shutdown_connections 2026-02-23T06:22:40.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.716+0000 7fe95add2640 1 -- 10.20.193.58:0/1453630000 >> 10.20.193.58:0/1453630000 conn(0x7fe954054390 msgr2=0x7fe9540b40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:22:40.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.716+0000 7fe95add2640 1 -- 10.20.193.58:0/1453630000 shutdown_connections 2026-02-23T06:22:40.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.716+0000 7fe95add2640 1 -- 10.20.193.58:0/1453630000 wait complete. 2026-02-23T06:22:40.731 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:22:40.731 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:22:40.731 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:22:40.745 INFO:tasks.workunit.client.0.trial058.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2026-02-23T06:22:40.749 INFO:tasks.workunit.client.0.trial058.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2026-02-23T06:22:40.812 INFO:tasks.workunit.client.0.trial058.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2026-02-23T06:22:40.814 INFO:tasks.workunit.client.0.trial058.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2026-02-23T06:22:40.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.862+0000 7ff900993640 1 -- 10.20.193.58:0/318338091 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff8fc162ca0 msgr2=0x7ff8fc056fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:40.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.862+0000 7ff900993640 1 --2- 10.20.193.58:0/318338091 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff8fc162ca0 0x7ff8fc056fc0 secure :-1 s=READY pgs=237 gs=2 cs=0 l=1 c_cookie=18239687901892600065 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8fc062070 tx=0x7ff8ec030270 comp rx=0 tx=0).stop 2026-02-23T06:22:40.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.862+0000 7ff900993640 1 -- 10.20.193.58:0/318338091 shutdown_connections 2026-02-23T06:22:40.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.862+0000 7ff900993640 1 --2- 10.20.193.58:0/318338091 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff8fc162ca0 0x7ff8fc056fc0 unknown :-1 s=CLOSED pgs=237 gs=2 cs=0 l=1 c_cookie=18239687901892600065 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:40.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.862+0000 7ff900993640 1 --2- 10.20.193.58:0/318338091 >> v2:10.20.193.93:3300/0 conn(0x7ff8fc056960 0x7ff8fc058200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:40.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.862+0000 7ff900993640 1 -- 10.20.193.58:0/318338091 >> 10.20.193.58:0/318338091 conn(0x7ff8fc0b3c20 msgr2=0x7ff8fc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:22:40.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.862+0000 7ff900993640 1 -- 10.20.193.58:0/318338091 shutdown_connections 2026-02-23T06:22:40.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.862+0000 7ff900993640 1 -- 10.20.193.58:0/318338091 wait complete. 2026-02-23T06:22:40.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.863+0000 7ff900993640 1 Processor -- start 2026-02-23T06:22:40.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.863+0000 7ff900993640 1 -- start start 2026-02-23T06:22:40.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.864+0000 7ff900993640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff8fc056960 0x7ff8fc13d1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:40.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.864+0000 7ff900993640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8fc15c4b0 0x7ff8fc1615f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:40.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.864+0000 7ff900993640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff8fc162ca0 0x7ff8fc1317e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:40.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.864+0000 7ff900993640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc13d730 con 0x7ff8fc056960 2026-02-23T06:22:40.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.864+0000 7ff900993640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc05c730 con 0x7ff8fc15c4b0 2026-02-23T06:22:40.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.864+0000 7ff900993640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7ff8fc13dae0 con 0x7ff8fc162ca0 2026-02-23T06:22:40.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.864+0000 7ff8fad76640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff8fc056960 0x7ff8fc13d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:40.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.864+0000 7ff8fad76640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff8fc056960 0x7ff8fc13d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:44882/0 (socket says 10.20.193.58:44882) 2026-02-23T06:22:40.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.864+0000 7ff8fad76640 1 -- 10.20.193.58:0/2134894290 learned_addr learned my addr 10.20.193.58:0/2134894290 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:22:40.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.864+0000 7ff8fa575640 1 --2- 10.20.193.58:0/2134894290 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8fc15c4b0 0x7ff8fc1615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:40.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.864+0000 7ff8fb577640 1 --2- 10.20.193.58:0/2134894290 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff8fc162ca0 0x7ff8fc1317e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:40.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.865+0000 7ff8fad76640 1 -- 10.20.193.58:0/2134894290 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff8fc162ca0 msgr2=0x7ff8fc1317e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:40.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.865+0000 7ff8fad76640 1 --2- 10.20.193.58:0/2134894290 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff8fc162ca0 0x7ff8fc1317e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:40.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.865+0000 7ff8fad76640 1 -- 10.20.193.58:0/2134894290 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8fc15c4b0 msgr2=0x7ff8fc1615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:40.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.865+0000 7ff8fad76640 1 --2- 10.20.193.58:0/2134894290 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8fc15c4b0 0x7ff8fc1615f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:40.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.865+0000 7ff8fad76640 1 -- 10.20.193.58:0/2134894290 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8ec00a590 con 0x7ff8fc056960 2026-02-23T06:22:40.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.865+0000 7ff8fb577640 1 --2- 10.20.193.58:0/2134894290 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff8fc162ca0 0x7ff8fc1317e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:22:40.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.865+0000 7ff8fad76640 1 --2- 10.20.193.58:0/2134894290 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff8fc056960 0x7ff8fc13d1f0 secure :-1 s=READY pgs=238 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8f000c4d0 tx=0x7ff8f000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:40.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.865+0000 7ff8db7fe640 1 -- 10.20.193.58:0/2134894290 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8f0012850 con 0x7ff8fc056960 2026-02-23T06:22:40.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.865+0000 7ff8db7fe640 1 -- 10.20.193.58:0/2134894290 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8f0012aa0 con 0x7ff8fc056960 2026-02-23T06:22:40.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.865+0000 7ff8db7fe640 1 -- 10.20.193.58:0/2134894290 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8f0012e30 con 0x7ff8fc056960 2026-02-23T06:22:40.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.865+0000 7ff900993640 1 -- 10.20.193.58:0/2134894290 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8fc13b1a0 con 0x7ff8fc056960 2026-02-23T06:22:40.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.865+0000 7ff900993640 1 -- 10.20.193.58:0/2134894290 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8fc0b0e10 con 0x7ff8fc056960 2026-02-23T06:22:40.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.866+0000 7ff900993640 1 --2- 10.20.193.58:0/2134894290 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff8fc131d20 0x7ff8fc13b330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:40.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.866+0000 7ff900993640 1 -- 10.20.193.58:0/2134894290 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7ff8fc1314c0 con 0x7ff8fc131d20 2026-02-23T06:22:40.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.866+0000 7ff8fa575640 1 --2- 10.20.193.58:0/2134894290 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff8fc131d20 0x7ff8fc13b330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:40.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.866+0000 7ff8fa575640 1 -- 10.20.193.58:0/2134894290 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff8fc059690 con 0x7ff8fc131d20 2026-02-23T06:22:40.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.867+0000 7ff8fa575640 1 --2- 10.20.193.58:0/2134894290 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff8fc131d20 0x7ff8fc13b330 secure :-1 s=READY pgs=5 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8fc0b6780 tx=0x7ff8e4010e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:40.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.867+0000 7ff8db7fe640 1 -- 10.20.193.58:0/2134894290 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8e4004500 con 0x7ff8fc131d20 2026-02-23T06:22:40.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.867+0000 7ff8db7fe640 1 -- 10.20.193.58:0/2134894290 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7ff8e400e9d0 con 0x7ff8fc131d20 2026-02-23T06:22:40.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.867+0000 7ff8db7fe640 1 -- 10.20.193.58:0/2134894290 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff8fc131d20 msgr2=0x7ff8fc13b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:40.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.867+0000 7ff8db7fe640 1 --2- 10.20.193.58:0/2134894290 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff8fc131d20 0x7ff8fc13b330 secure :-1 s=READY pgs=5 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8fc0b6780 tx=0x7ff8e4010e10 comp rx=0 tx=0).stop 2026-02-23T06:22:40.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.867+0000 7ff8db7fe640 1 -- 10.20.193.58:0/2134894290 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff8fc131d20 msgr2=0x7ff8fc13b330 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:22:40.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.867+0000 7ff8db7fe640 1 --2- 10.20.193.58:0/2134894290 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff8fc131d20 0x7ff8fc13b330 secure :-1 s=CLOSED pgs=5 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8fc0b6780 tx=0x7ff8e4010e10 comp rx=0 tx=0).stop 2026-02-23T06:22:40.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.867+0000 7ff8db7fe640 1 -- 10.20.193.58:0/2134894290 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7ff8f001b400 con 0x7ff8fc056960 2026-02-23T06:22:40.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.868+0000 7ff8db7fe640 1 --2- 10.20.193.58:0/2134894290 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff8c807a3c0 0x7ff8c809a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:40.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.868+0000 7ff8db7fe640 1 -- 10.20.193.58:0/2134894290 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7ff8f009d7d0 con 0x7ff8fc056960 2026-02-23T06:22:40.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.868+0000 7ff8fa575640 1 --2- 10.20.193.58:0/2134894290 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff8c807a3c0 0x7ff8c809a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:40.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.869+0000 7ff8fa575640 1 --2- 10.20.193.58:0/2134894290 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff8c807a3c0 0x7ff8c809a870 secure :-1 s=READY pgs=135 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8e40023d0 tx=0x7ff8e4014000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:40.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.871+0000 7ff900993640 1 --2- 10.20.193.58:0/2134894290 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff8fc2012b0 0x7ff8fc201680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:22:40.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.871+0000 7ff900993640 1 -- 10.20.193.58:0/2134894290 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7ff8fc0593b0 con 0x7ff8fc2012b0 2026-02-23T06:22:40.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.871+0000 7ff8fb577640 1 --2- 10.20.193.58:0/2134894290 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff8fc2012b0 0x7ff8fc201680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:22:40.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.871+0000 7ff8fb577640 1 -- 10.20.193.58:0/2134894290 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff8fc15c880 con 0x7ff8fc2012b0 2026-02-23T06:22:40.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.872+0000 7ff8fb577640 1 --2- 10.20.193.58:0/2134894290 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff8fc2012b0 0x7ff8fc201680 secure :-1 s=READY pgs=6 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8fc159bc0 tx=0x7ff8ec003d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:22:40.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.872+0000 7ff8db7fe640 1 -- 10.20.193.58:0/2134894290 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8ec040070 con 0x7ff8fc2012b0 2026-02-23T06:22:40.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.872+0000 7ff8db7fe640 1 -- 10.20.193.58:0/2134894290 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4911 (secure 0 0 0) 0x7ff8ec039690 con 0x7ff8fc2012b0 2026-02-23T06:22:40.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.872+0000 7ff8db7fe640 1 -- 10.20.193.58:0/2134894290 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff8fc2012b0 msgr2=0x7ff8fc201680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:40.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.872+0000 7ff8db7fe640 1 --2- 10.20.193.58:0/2134894290 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff8fc2012b0 0x7ff8fc201680 secure :-1 s=READY pgs=6 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8fc159bc0 tx=0x7ff8ec003d20 comp rx=0 tx=0).stop 2026-02-23T06:22:40.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.872+0000 7ff8db7fe640 1 -- 10.20.193.58:0/2134894290 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff8fc2012b0 msgr2=0x7ff8fc201680 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:22:40.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.872+0000 7ff8db7fe640 1 --2- 10.20.193.58:0/2134894290 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff8fc2012b0 0x7ff8fc201680 unknown :-1 s=CLOSED pgs=6 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:40.868 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:22:40.868 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:22:40.869 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:22:40.869 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:22:40.869 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 10, 2026-02-23T06:22:40.869 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 16381, 2026-02-23T06:22:40.869 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:22:40.869 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:22:40.869 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:22:40.869 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:22:40.869 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:40.869 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 16, 2026-02-23T06:22:40.869 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:22:40.870 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:22:40.870 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:22:40.870 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:22:40.870 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:22:40.870 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:22:40.870 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:22:40.870 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:22:40.870 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:22:40.870 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:22:40.870 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:22:40.870 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:22:40.870 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:22:40.871 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:22:40.871 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:22:40.871 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:22:40.871 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:40.871 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:22:40.871 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:22:40.871 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:22:40.871 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:22:40.871 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:22:40.871 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:22:40.871 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:22:40.871 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:22:40.871 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:22:40.872 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:22:40.872 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:22:40.872 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:22:40.872 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:22:40.872 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:22:40.872 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:22:40.872 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:40.872 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.872 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:22:40.872 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:22:40.872 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:22:40.872 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:22:40.873 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:22:40.873 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:22:40.873 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:22:40.873 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:22:40.873 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:22:40.873 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:22:40.873 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:22:40.873 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:22:40.873 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:22:40.873 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:22:40.873 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:22:40.873 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:22:40.874 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:22:40.874 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:22:40.874 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:22:40.874 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:22:40.874 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:22:40.874 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:22:40.874 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:22:40.874 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:22:40.874 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:22:40.874 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:22:40.874 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:22:40.875 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:22:40.875 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:22:40.875 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:22:40.875 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:40.875 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:22:40.875 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.875 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:22:40.875 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.875 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:22:40.875 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:22:40.875 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:22:40.875 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:22:40.876 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.876 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:22:40.876 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:22:40.876 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:40.876 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.876 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.876 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:22:40.876 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:22:40.876 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:40.876 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:40.876 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:40.876 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.876 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:22:40.877 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:22:40.877 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:22:40.877 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:22:40.877 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:22:40.877 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:22:40.877 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.877 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.877 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:22:40.877 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:22:40.877 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:22:40.877 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:22:40.877 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.878 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:22:40.878 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:22:40.878 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:40.878 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.878 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.878 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:22:40.878 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:22:40.878 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:40.878 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:40.878 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:40.878 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.878 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:22:40.879 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:22:40.879 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:22:40.879 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:22:40.879 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:22:40.879 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:22:40.879 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.879 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.879 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:22:40.879 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:22:40.879 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:22:40.879 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:22:40.879 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.879 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:22:40.880 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:22:40.880 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:40.880 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.880 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.880 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:22:40.880 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:22:40.880 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:22:40.880 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:40.880 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:40.880 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.880 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:22:40.880 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:22:40.881 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:22:40.881 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:22:40.881 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:22:40.881 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:22:40.881 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:40.881 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:40.881 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.881 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:22:40.881 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:22:40.881 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.881 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:40.881 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:40.881 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:22:40.882 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:40.882 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:22:40.882 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:22:40.882 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:22:40.882 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:22:40.882 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:22:40.882 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:22:40.882 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:22:40.882 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:22:40.882 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:22:40.882 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:22:40.882 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:22:40.884 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.872+0000 7ff900993640 1 -- 10.20.193.58:0/2134894290 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff8c807a3c0 msgr2=0x7ff8c809a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:40.884 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.872+0000 7ff900993640 1 --2- 10.20.193.58:0/2134894290 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff8c807a3c0 0x7ff8c809a870 secure :-1 s=READY pgs=135 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8e40023d0 tx=0x7ff8e4014000 comp rx=0 tx=0).stop 2026-02-23T06:22:40.884 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.872+0000 7ff900993640 1 -- 10.20.193.58:0/2134894290 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff8fc056960 msgr2=0x7ff8fc13d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:22:40.884 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.872+0000 7ff900993640 1 --2- 10.20.193.58:0/2134894290 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff8fc056960 0x7ff8fc13d1f0 secure :-1 s=READY pgs=238 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8f000c4d0 tx=0x7ff8f000c9a0 comp rx=0 tx=0).stop 2026-02-23T06:22:40.884 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.872+0000 7ff8fb577640 1 -- 10.20.193.58:0/2134894290 reap_dead start 2026-02-23T06:22:40.885 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.873+0000 7ff900993640 1 -- 10.20.193.58:0/2134894290 shutdown_connections 2026-02-23T06:22:40.885 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.873+0000 7ff900993640 1 --2- 10.20.193.58:0/2134894290 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff8fc056960 0x7ff8fc13d1f0 unknown :-1 s=CLOSED pgs=238 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:22:40.885 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.873+0000 7ff900993640 1 -- 10.20.193.58:0/2134894290 >> 10.20.193.58:0/2134894290 conn(0x7ff8fc0b3c20 msgr2=0x7ff8fc05b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:22:40.885 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.873+0000 7ff900993640 1 -- 10.20.193.58:0/2134894290 shutdown_connections 2026-02-23T06:22:40.885 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:22:40.873+0000 7ff900993640 1 -- 10.20.193.58:0/2134894290 wait complete. 2026-02-23T06:22:40.885 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:22:40.886 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-23T06:22:40.886 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2026-02-23T06:22:40.886 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-23T06:22:40.886 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-23T06:22:40.886 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-23T06:22:40.886 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:22:40.894 INFO:tasks.ceph.mon.c:Stopped 2026-02-23T06:22:40.894 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.a 2026-02-23T06:22:40.894 INFO:tasks.mon_thrash:Sending STOP to mon a 2026-02-23T06:22:40.895 INFO:tasks.ceph.mon.a:Sent signal 19 2026-02-23T06:22:40.895 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-23T06:22:40.900 INFO:tasks.workunit.client.0.trial058.stdout:mv -f .deps/util.Tpo .deps/util.Po 2026-02-23T06:22:40.903 INFO:tasks.workunit.client.0.trial058.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2026-02-23T06:22:40.935 INFO:tasks.workunit.client.0.trial058.stderr:In file included from parser.h:22, 2026-02-23T06:22:40.935 INFO:tasks.workunit.client.0.trial058.stderr: from parser.c:25: 2026-02-23T06:22:40.935 INFO:tasks.workunit.client.0.trial058.stderr:parser.c: In function ‘init_filesys’: 2026-02-23T06:22:40.935 INFO:tasks.workunit.client.0.trial058.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2026-02-23T06:22:40.935 INFO:tasks.workunit.client.0.trial058.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2026-02-23T06:22:40.935 INFO:tasks.workunit.client.0.trial058.stderr: | ^ 2026-02-23T06:22:40.935 INFO:tasks.workunit.client.0.trial058.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2026-02-23T06:22:40.935 INFO:tasks.workunit.client.0.trial058.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2026-02-23T06:22:40.935 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~ 2026-02-23T06:22:40.935 INFO:tasks.workunit.client.0.trial058.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2026-02-23T06:22:40.936 INFO:tasks.workunit.client.0.trial058.stderr: 36 | container_of(ptr, type, member) 2026-02-23T06:22:40.936 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~~~~~ 2026-02-23T06:22:40.936 INFO:tasks.workunit.client.0.trial058.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2026-02-23T06:22:40.936 INFO:tasks.workunit.client.0.trial058.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2026-02-23T06:22:40.936 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~~~ 2026-02-23T06:22:40.936 INFO:tasks.workunit.client.0.trial058.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2026-02-23T06:22:40.936 INFO:tasks.workunit.client.0.trial058.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2026-02-23T06:22:40.936 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~~~~~~~~~~~~ 2026-02-23T06:22:40.936 INFO:tasks.workunit.client.0.trial058.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2026-02-23T06:22:40.936 INFO:tasks.workunit.client.0.trial058.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2026-02-23T06:22:40.936 INFO:tasks.workunit.client.0.trial058.stderr: | ^ 2026-02-23T06:22:40.936 INFO:tasks.workunit.client.0.trial058.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2026-02-23T06:22:40.937 INFO:tasks.workunit.client.0.trial058.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2026-02-23T06:22:40.937 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~ 2026-02-23T06:22:40.937 INFO:tasks.workunit.client.0.trial058.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2026-02-23T06:22:40.937 INFO:tasks.workunit.client.0.trial058.stderr: 36 | container_of(ptr, type, member) 2026-02-23T06:22:40.937 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~~~~~ 2026-02-23T06:22:40.937 INFO:tasks.workunit.client.0.trial058.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2026-02-23T06:22:40.937 INFO:tasks.workunit.client.0.trial058.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2026-02-23T06:22:40.937 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~~~ 2026-02-23T06:22:40.937 INFO:tasks.workunit.client.0.trial058.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2026-02-23T06:22:40.937 INFO:tasks.workunit.client.0.trial058.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2026-02-23T06:22:40.937 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~~~~~~~~~~~~ 2026-02-23T06:22:40.938 INFO:tasks.workunit.client.0.trial058.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2026-02-23T06:22:40.938 INFO:tasks.workunit.client.0.trial058.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2026-02-23T06:22:40.938 INFO:tasks.workunit.client.0.trial058.stderr: | ^ 2026-02-23T06:22:40.938 INFO:tasks.workunit.client.0.trial058.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2026-02-23T06:22:40.938 INFO:tasks.workunit.client.0.trial058.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2026-02-23T06:22:40.938 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~ 2026-02-23T06:22:40.938 INFO:tasks.workunit.client.0.trial058.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2026-02-23T06:22:40.938 INFO:tasks.workunit.client.0.trial058.stderr: 36 | container_of(ptr, type, member) 2026-02-23T06:22:40.938 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~~~~~ 2026-02-23T06:22:40.938 INFO:tasks.workunit.client.0.trial058.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2026-02-23T06:22:40.938 INFO:tasks.workunit.client.0.trial058.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2026-02-23T06:22:40.938 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~~~ 2026-02-23T06:22:40.938 INFO:tasks.workunit.client.0.trial058.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2026-02-23T06:22:40.939 INFO:tasks.workunit.client.0.trial058.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2026-02-23T06:22:40.939 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~~~~~~~~~~~~ 2026-02-23T06:22:40.939 INFO:tasks.workunit.client.0.trial058.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2026-02-23T06:22:40.939 INFO:tasks.workunit.client.0.trial058.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2026-02-23T06:22:40.939 INFO:tasks.workunit.client.0.trial058.stderr: | ^ 2026-02-23T06:22:40.939 INFO:tasks.workunit.client.0.trial058.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2026-02-23T06:22:40.939 INFO:tasks.workunit.client.0.trial058.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2026-02-23T06:22:40.939 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~ 2026-02-23T06:22:40.939 INFO:tasks.workunit.client.0.trial058.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2026-02-23T06:22:40.939 INFO:tasks.workunit.client.0.trial058.stderr: 36 | container_of(ptr, type, member) 2026-02-23T06:22:40.939 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~~~~~ 2026-02-23T06:22:40.939 INFO:tasks.workunit.client.0.trial058.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2026-02-23T06:22:40.940 INFO:tasks.workunit.client.0.trial058.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2026-02-23T06:22:40.940 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~~~ 2026-02-23T06:22:40.940 INFO:tasks.workunit.client.0.trial058.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2026-02-23T06:22:40.940 INFO:tasks.workunit.client.0.trial058.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2026-02-23T06:22:40.940 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~~~~~~~~~~~~ 2026-02-23T06:22:40.940 INFO:tasks.workunit.client.0.trial058.stderr:parser.c: In function ‘init_tg_stats’: 2026-02-23T06:22:40.940 INFO:tasks.workunit.client.0.trial058.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2026-02-23T06:22:40.940 INFO:tasks.workunit.client.0.trial058.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2026-02-23T06:22:40.940 INFO:tasks.workunit.client.0.trial058.stderr: | ^ 2026-02-23T06:22:40.940 INFO:tasks.workunit.client.0.trial058.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2026-02-23T06:22:40.940 INFO:tasks.workunit.client.0.trial058.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2026-02-23T06:22:40.940 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~ 2026-02-23T06:22:40.940 INFO:tasks.workunit.client.0.trial058.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2026-02-23T06:22:40.941 INFO:tasks.workunit.client.0.trial058.stderr: 36 | container_of(ptr, type, member) 2026-02-23T06:22:40.941 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~~~~~ 2026-02-23T06:22:40.941 INFO:tasks.workunit.client.0.trial058.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2026-02-23T06:22:40.941 INFO:tasks.workunit.client.0.trial058.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2026-02-23T06:22:40.941 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~~~ 2026-02-23T06:22:40.941 INFO:tasks.workunit.client.0.trial058.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2026-02-23T06:22:40.941 INFO:tasks.workunit.client.0.trial058.stderr: 971 | list_for_each_entry(tmp_list, 2026-02-23T06:22:40.941 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~~~~~~~~~~~~ 2026-02-23T06:22:40.941 INFO:tasks.workunit.client.0.trial058.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2026-02-23T06:22:40.941 INFO:tasks.workunit.client.0.trial058.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2026-02-23T06:22:40.941 INFO:tasks.workunit.client.0.trial058.stderr: | ^ 2026-02-23T06:22:40.941 INFO:tasks.workunit.client.0.trial058.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2026-02-23T06:22:40.942 INFO:tasks.workunit.client.0.trial058.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2026-02-23T06:22:40.942 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~ 2026-02-23T06:22:40.942 INFO:tasks.workunit.client.0.trial058.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2026-02-23T06:22:40.942 INFO:tasks.workunit.client.0.trial058.stderr: 36 | container_of(ptr, type, member) 2026-02-23T06:22:40.942 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~~~~~ 2026-02-23T06:22:40.942 INFO:tasks.workunit.client.0.trial058.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2026-02-23T06:22:40.942 INFO:tasks.workunit.client.0.trial058.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2026-02-23T06:22:40.942 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~~~ 2026-02-23T06:22:40.942 INFO:tasks.workunit.client.0.trial058.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2026-02-23T06:22:40.942 INFO:tasks.workunit.client.0.trial058.stderr: 971 | list_for_each_entry(tmp_list, 2026-02-23T06:22:40.942 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~~~~~~~~~~~~ 2026-02-23T06:22:40.942 INFO:tasks.workunit.client.0.trial058.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2026-02-23T06:22:40.942 INFO:tasks.workunit.client.0.trial058.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2026-02-23T06:22:40.943 INFO:tasks.workunit.client.0.trial058.stderr: | ^ 2026-02-23T06:22:40.943 INFO:tasks.workunit.client.0.trial058.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2026-02-23T06:22:40.943 INFO:tasks.workunit.client.0.trial058.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2026-02-23T06:22:40.943 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~ 2026-02-23T06:22:40.943 INFO:tasks.workunit.client.0.trial058.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2026-02-23T06:22:40.943 INFO:tasks.workunit.client.0.trial058.stderr: 36 | container_of(ptr, type, member) 2026-02-23T06:22:40.943 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~~~~~ 2026-02-23T06:22:40.943 INFO:tasks.workunit.client.0.trial058.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2026-02-23T06:22:40.943 INFO:tasks.workunit.client.0.trial058.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2026-02-23T06:22:40.943 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~~~ 2026-02-23T06:22:40.943 INFO:tasks.workunit.client.0.trial058.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2026-02-23T06:22:40.943 INFO:tasks.workunit.client.0.trial058.stderr: 980 | list_for_each_entry(tmp_list, 2026-02-23T06:22:40.943 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~~~~~~~~~~~~ 2026-02-23T06:22:40.944 INFO:tasks.workunit.client.0.trial058.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2026-02-23T06:22:40.944 INFO:tasks.workunit.client.0.trial058.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2026-02-23T06:22:40.944 INFO:tasks.workunit.client.0.trial058.stderr: | ^ 2026-02-23T06:22:40.944 INFO:tasks.workunit.client.0.trial058.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2026-02-23T06:22:40.944 INFO:tasks.workunit.client.0.trial058.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2026-02-23T06:22:40.944 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~ 2026-02-23T06:22:40.944 INFO:tasks.workunit.client.0.trial058.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2026-02-23T06:22:40.944 INFO:tasks.workunit.client.0.trial058.stderr: 36 | container_of(ptr, type, member) 2026-02-23T06:22:40.944 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~~~~~ 2026-02-23T06:22:40.944 INFO:tasks.workunit.client.0.trial058.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2026-02-23T06:22:40.944 INFO:tasks.workunit.client.0.trial058.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2026-02-23T06:22:40.944 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~~~ 2026-02-23T06:22:40.944 INFO:tasks.workunit.client.0.trial058.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2026-02-23T06:22:40.945 INFO:tasks.workunit.client.0.trial058.stderr: 980 | list_for_each_entry(tmp_list, 2026-02-23T06:22:40.945 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~~~~~~~~~~~~ 2026-02-23T06:22:40.961 INFO:tasks.workunit.client.0.trial058.stderr:parser.c: In function ‘get_optstr’: 2026-02-23T06:22:40.961 INFO:tasks.workunit.client.0.trial058.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2026-02-23T06:22:40.962 INFO:tasks.workunit.client.0.trial058.stderr: 206 | len = strnlen(temp, 4095) + 1; 2026-02-23T06:22:40.962 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~~~~~~~~~~~~ 2026-02-23T06:22:40.962 INFO:tasks.workunit.client.0.trial058.stderr:parser.c:200:14: note: source object declared here 2026-02-23T06:22:40.962 INFO:tasks.workunit.client.0.trial058.stderr: 200 | char temp[BUFSIZE]; 2026-02-23T06:22:40.962 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~ 2026-02-23T06:22:40.964 INFO:tasks.workunit.client.0.trial058.stderr:parser.c: In function ‘size64_convert’: 2026-02-23T06:22:40.964 INFO:tasks.workunit.client.0.trial058.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2026-02-23T06:22:40.965 INFO:tasks.workunit.client.0.trial058.stderr: 119 | memcpy(unit, "\0", 3); 2026-02-23T06:22:40.965 INFO:tasks.workunit.client.0.trial058.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2026-02-23T06:22:41.127 INFO:tasks.workunit.client.0.trial058.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2026-02-23T06:22:41.130 INFO:tasks.workunit.client.0.trial058.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2026-02-23T06:22:41.186 INFO:tasks.workunit.client.0.trial058.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2026-02-23T06:22:41.189 INFO:tasks.workunit.client.0.trial058.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2026-02-23T06:22:41.262 INFO:tasks.workunit.client.0.trial058.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2026-02-23T06:22:41.265 INFO:tasks.workunit.client.0.trial058.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2026-02-23T06:22:41.301 INFO:tasks.workunit.client.0.trial058.stdout:mv -f .deps/list.Tpo .deps/list.Po 2026-02-23T06:22:41.307 INFO:tasks.workunit.client.0.trial058.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2026-02-23T06:22:41.347 INFO:tasks.workunit.client.0.trial058.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2026-02-23T06:22:41.348 INFO:tasks.workunit.client.0.trial058.stderr:+ cd .. 2026-02-23T06:22:41.348 INFO:tasks.workunit.client.0.trial058.stderr:+ mkdir tmp 2026-02-23T06:22:41.351 INFO:tasks.workunit.client.0.trial058.stderr:+ cd tmp 2026-02-23T06:22:41.351 INFO:tasks.workunit.client.0.trial058.stderr:+ for f in $mydir/*.ffsb 2026-02-23T06:22:41.351 INFO:tasks.workunit.client.0.trial058.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/random_write.32.ffsb 2026-02-23T06:22:41.352 INFO:tasks.workunit.client.0.trial058.stdout:FFSB version 6.0-RC2 started 2026-02-23T06:22:41.352 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-23T06:22:41.358 INFO:tasks.workunit.client.0.trial058.stdout:benchmark time = 300 2026-02-23T06:22:41.358 INFO:tasks.workunit.client.0.trial058.stdout:ThreadGroup 0 2026-02-23T06:22:41.358 INFO:tasks.workunit.client.0.trial058.stdout:================ 2026-02-23T06:22:41.358 INFO:tasks.workunit.client.0.trial058.stdout: num_threads = 32 2026-02-23T06:22:41.358 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-23T06:22:41.358 INFO:tasks.workunit.client.0.trial058.stdout: read_random = off 2026-02-23T06:22:41.359 INFO:tasks.workunit.client.0.trial058.stdout: read_size = 0 (0B) 2026-02-23T06:22:41.359 INFO:tasks.workunit.client.0.trial058.stdout: read_blocksize = 0 (0B) 2026-02-23T06:22:41.359 INFO:tasks.workunit.client.0.trial058.stdout: read_skip = off 2026-02-23T06:22:41.359 INFO:tasks.workunit.client.0.trial058.stdout: read_skipsize = 0 (0B) 2026-02-23T06:22:41.359 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-23T06:22:41.359 INFO:tasks.workunit.client.0.trial058.stdout: write_random = on 2026-02-23T06:22:41.359 INFO:tasks.workunit.client.0.trial058.stdout: write_size = 5242880 (5MB) 2026-02-23T06:22:41.359 INFO:tasks.workunit.client.0.trial058.stdout: fsync_file = 0 2026-02-23T06:22:41.359 INFO:tasks.workunit.client.0.trial058.stdout: write_blocksize = 4096 (4KB) 2026-02-23T06:22:41.359 INFO:tasks.workunit.client.0.trial058.stdout: wait time = 0 2026-02-23T06:22:41.360 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-23T06:22:41.360 INFO:tasks.workunit.client.0.trial058.stdout: op weights 2026-02-23T06:22:41.360 INFO:tasks.workunit.client.0.trial058.stdout: read = 0 (0.00%) 2026-02-23T06:22:41.360 INFO:tasks.workunit.client.0.trial058.stdout: readall = 0 (0.00%) 2026-02-23T06:22:41.360 INFO:tasks.workunit.client.0.trial058.stdout: write = 1 (100.00%) 2026-02-23T06:22:41.360 INFO:tasks.workunit.client.0.trial058.stdout: create = 0 (0.00%) 2026-02-23T06:22:41.360 INFO:tasks.workunit.client.0.trial058.stdout: append = 0 (0.00%) 2026-02-23T06:22:41.360 INFO:tasks.workunit.client.0.trial058.stdout: delete = 0 (0.00%) 2026-02-23T06:22:41.360 INFO:tasks.workunit.client.0.trial058.stdout: metaop = 0 (0.00%) 2026-02-23T06:22:41.360 INFO:tasks.workunit.client.0.trial058.stdout: createdir = 0 (0.00%) 2026-02-23T06:22:41.360 INFO:tasks.workunit.client.0.trial058.stdout: stat = 0 (0.00%) 2026-02-23T06:22:41.361 INFO:tasks.workunit.client.0.trial058.stdout: writeall = 0 (0.00%) 2026-02-23T06:22:41.361 INFO:tasks.workunit.client.0.trial058.stdout: writeall_fsync = 0 (0.00%) 2026-02-23T06:22:41.361 INFO:tasks.workunit.client.0.trial058.stdout: open_close = 0 (0.00%) 2026-02-23T06:22:41.361 INFO:tasks.workunit.client.0.trial058.stdout: write_fsync = 0 (0.00%) 2026-02-23T06:22:41.361 INFO:tasks.workunit.client.0.trial058.stdout: create_fsync = 0 (0.00%) 2026-02-23T06:22:41.361 INFO:tasks.workunit.client.0.trial058.stdout: append_fsync = 0 (0.00%) 2026-02-23T06:22:41.361 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-23T06:22:41.361 INFO:tasks.workunit.client.0.trial058.stdout:FileSystem . 2026-02-23T06:22:41.361 INFO:tasks.workunit.client.0.trial058.stdout:========== 2026-02-23T06:22:41.361 INFO:tasks.workunit.client.0.trial058.stdout: num_dirs = 0 2026-02-23T06:22:41.362 INFO:tasks.workunit.client.0.trial058.stdout: starting files = 128 2026-02-23T06:22:41.362 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-23T06:22:41.362 INFO:tasks.workunit.client.0.trial058.stdout: min file size = 104857600 (100MB) 2026-02-23T06:22:41.362 INFO:tasks.workunit.client.0.trial058.stdout: max file size = 104857600 (100MB) 2026-02-23T06:22:41.362 INFO:tasks.workunit.client.0.trial058.stdout: directio = off 2026-02-23T06:22:41.362 INFO:tasks.workunit.client.0.trial058.stdout: alignedio = on 2026-02-23T06:22:41.362 INFO:tasks.workunit.client.0.trial058.stdout: bufferedio = off 2026-02-23T06:22:41.362 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-23T06:22:41.362 INFO:tasks.workunit.client.0.trial058.stdout: aging is off 2026-02-23T06:22:41.362 INFO:tasks.workunit.client.0.trial058.stdout: current utilization = 0.03% 2026-02-23T06:22:41.363 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-23T06:22:41.363 INFO:tasks.workunit.client.0.trial058.stdout:checking existing fs: . 2026-02-23T06:22:41.637 INFO:tasks.workunit.client.0.trial058.stdout:recreating new fileset 2026-02-23T06:22:41.637 INFO:tasks.workunit.client.0.trial058.stderr:opendir: No such file or directory 2026-02-23T06:22:41.950 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:22:41.955 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:22:55.896 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.a 2026-02-23T06:22:55.896 INFO:tasks.mon_thrash:Sending CONT to mon a 2026-02-23T06:22:55.897 INFO:tasks.ceph.mon.a:Sent signal 18 2026-02-23T06:22:55.897 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:22:55.897 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:23:00.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.913+0000 7f1c15483640 1 -- 10.20.193.58:0/2879994879 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1bf4005320 msgr2=0x7f1bf4069f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:00.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.913+0000 7f1c15483640 1 --2- 10.20.193.58:0/2879994879 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1bf4005320 0x7f1bf4069f20 secure :-1 s=READY pgs=245 gs=23 cs=0 l=1 c_cookie=8854959913770913585 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c100b1b90 tx=0x7f1c0402fc50 comp rx=0 tx=0).stop 2026-02-23T06:23:00.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.914+0000 7f1c15483640 1 -- 10.20.193.58:0/2879994879 shutdown_connections 2026-02-23T06:23:00.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.914+0000 7f1c15483640 1 --2- 10.20.193.58:0/2879994879 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1bf4005320 0x7f1bf4069f20 unknown :-1 s=CLOSED pgs=245 gs=23 cs=0 l=1 c_cookie=8854959913770913585 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:00.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.914+0000 7f1c15483640 1 --2- 10.20.193.58:0/2879994879 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1bf4004850 0x7f1bf4004cc0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:00.910 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.914+0000 7f1c15483640 1 --2- 10.20.193.58:0/2879994879 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1bf4003a30 0x7f1bf4003e20 unknown :-1 s=CLOSED pgs=0 gs=24 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:00.910 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.914+0000 7f1c15483640 1 -- 10.20.193.58:0/2879994879 >> 10.20.193.58:0/2879994879 conn(0x7f1c100b3c20 msgr2=0x7f1c100b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:00.910 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.914+0000 7f1c15483640 1 -- 10.20.193.58:0/2879994879 shutdown_connections 2026-02-23T06:23:00.910 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.914+0000 7f1c15483640 1 -- 10.20.193.58:0/2879994879 wait complete. 2026-02-23T06:23:00.912 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.915+0000 7f1c15483640 1 Processor -- start 2026-02-23T06:23:00.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.915+0000 7f1c15483640 1 -- start start 2026-02-23T06:23:00.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.916+0000 7f1c15483640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1bf4003a30 0x7f1c101633d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:00.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.916+0000 7f1c15483640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1bf4004850 0x7f1c10138cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:00.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.916+0000 7f1c15483640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1bf4005320 0x7f1c101fc810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:00.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.916+0000 7f1c15483640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1013d710 con 0x7f1bf4005320 2026-02-23T06:23:00.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.916+0000 7f1c15483640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1013d150 con 0x7f1bf4003a30 2026-02-23T06:23:00.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.916+0000 7f1c15483640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f1c1013d430 con 0x7f1bf4004850 2026-02-23T06:23:00.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.916+0000 7f1c0f7fe640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1bf4004850 msgr2=0x7f1c10138cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:23:00.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.916+0000 7f1c0f7fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1bf4004850 0x7f1c10138cb0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:23:00.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.916+0000 7f1c14c82640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1bf4005320 0x7f1c101fc810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:00.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.916+0000 7f1c14c82640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1bf4005320 0x7f1c101fc810 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:49496/0 (socket says 10.20.193.58:49496) 2026-02-23T06:23:00.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.916+0000 7f1c14c82640 1 -- 10.20.193.58:0/2957419087 learned_addr learned my addr 10.20.193.58:0/2957419087 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:23:00.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.916+0000 7f1c0ffff640 1 --2- 10.20.193.58:0/2957419087 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1bf4003a30 0x7f1c101633d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:00.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.916+0000 7f1c14c82640 1 -- 10.20.193.58:0/2957419087 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1bf4004850 msgr2=0x7f1c10138cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:23:00.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.916+0000 7f1c14c82640 1 --2- 10.20.193.58:0/2957419087 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1bf4004850 0x7f1c10138cb0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:00.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.916+0000 7f1c14c82640 1 -- 10.20.193.58:0/2957419087 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1bf4003a30 msgr2=0x7f1c101633d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:00.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.916+0000 7f1c14c82640 1 --2- 10.20.193.58:0/2957419087 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1bf4003a30 0x7f1c101633d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:00.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.916+0000 7f1c14c82640 1 -- 10.20.193.58:0/2957419087 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c10161b70 con 0x7f1bf4005320 2026-02-23T06:23:00.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.916+0000 7f1c14c82640 1 --2- 10.20.193.58:0/2957419087 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1bf4005320 0x7f1c101fc810 secure :-1 s=READY pgs=246 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c0400d090 tx=0x7f1c04005300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:00.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.916+0000 7f1c0cff9640 1 -- 10.20.193.58:0/2957419087 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c040056a0 con 0x7f1bf4005320 2026-02-23T06:23:00.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.916+0000 7f1c0cff9640 1 -- 10.20.193.58:0/2957419087 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c04005800 con 0x7f1bf4005320 2026-02-23T06:23:00.915 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.917+0000 7f1c15483640 1 -- 10.20.193.58:0/2957419087 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c10161e50 con 0x7f1bf4005320 2026-02-23T06:23:00.915 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.917+0000 7f1c15483640 1 -- 10.20.193.58:0/2957419087 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c10163910 con 0x7f1bf4005320 2026-02-23T06:23:00.915 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.917+0000 7f1c0cff9640 1 -- 10.20.193.58:0/2957419087 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c04037430 con 0x7f1bf4005320 2026-02-23T06:23:00.915 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.917+0000 7f1c15483640 1 -- 10.20.193.58:0/2957419087 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c100b6d50 con 0x7f1bf4005320 2026-02-23T06:23:00.915 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.918+0000 7f1c0cff9640 1 -- 10.20.193.58:0/2957419087 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f1c04052020 con 0x7f1bf4005320 2026-02-23T06:23:00.916 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.919+0000 7f1c0cff9640 1 --2- 10.20.193.58:0/2957419087 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1be007a5b0 0x7f1be009aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:00.916 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.919+0000 7f1c0cff9640 1 -- 10.20.193.58:0/2957419087 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f1c040c2f10 con 0x7f1bf4005320 2026-02-23T06:23:00.916 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.919+0000 7f1c0ffff640 1 --2- 10.20.193.58:0/2957419087 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1be007a5b0 0x7f1be009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:00.916 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.920+0000 7f1c0ffff640 1 --2- 10.20.193.58:0/2957419087 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1be007a5b0 0x7f1be009aa60 secure :-1 s=READY pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1bfc0023d0 tx=0x7f1bfc00a3f0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:00.916 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:00.922+0000 7f1c0cff9640 1 -- 10.20.193.58:0/2957419087 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f1c040860b0 con 0x7f1bf4005320 2026-02-23T06:23:01.073 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.078+0000 7f1c15483640 1 -- 10.20.193.58:0/2957419087 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1c1005b0e0 con 0x7f1bf4005320 2026-02-23T06:23:01.073 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.078+0000 7f1c0cff9640 1 -- 10.20.193.58:0/2957419087 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1748 (secure 0 0 0) 0x7f1c040891d0 con 0x7f1bf4005320 2026-02-23T06:23:01.073 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":14,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:23:01.075 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.080+0000 7f1c15483640 1 -- 10.20.193.58:0/2957419087 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1be007a5b0 msgr2=0x7f1be009aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:01.075 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.080+0000 7f1c15483640 1 --2- 10.20.193.58:0/2957419087 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1be007a5b0 0x7f1be009aa60 secure :-1 s=READY pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1bfc0023d0 tx=0x7f1bfc00a3f0 comp rx=0 tx=0).stop 2026-02-23T06:23:01.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.080+0000 7f1c15483640 1 -- 10.20.193.58:0/2957419087 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1bf4005320 msgr2=0x7f1c101fc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:01.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.080+0000 7f1c15483640 1 --2- 10.20.193.58:0/2957419087 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1bf4005320 0x7f1c101fc810 secure :-1 s=READY pgs=246 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c0400d090 tx=0x7f1c04005300 comp rx=0 tx=0).stop 2026-02-23T06:23:01.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.080+0000 7f1c15483640 1 -- 10.20.193.58:0/2957419087 shutdown_connections 2026-02-23T06:23:01.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.080+0000 7f1c15483640 1 --2- 10.20.193.58:0/2957419087 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1be007a5b0 0x7f1be009aa60 unknown :-1 s=CLOSED pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:01.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.080+0000 7f1c15483640 1 --2- 10.20.193.58:0/2957419087 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1bf4005320 0x7f1c101fc810 unknown :-1 s=CLOSED pgs=246 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:01.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.080+0000 7f1c15483640 1 --2- 10.20.193.58:0/2957419087 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1bf4004850 0x7f1c10138cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:01.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.080+0000 7f1c15483640 1 --2- 10.20.193.58:0/2957419087 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1bf4003a30 0x7f1c101633d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:01.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.080+0000 7f1c15483640 1 -- 10.20.193.58:0/2957419087 >> 10.20.193.58:0/2957419087 conn(0x7f1c100b3c20 msgr2=0x7f1c100aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:01.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.080+0000 7f1c15483640 1 -- 10.20.193.58:0/2957419087 shutdown_connections 2026-02-23T06:23:01.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.080+0000 7f1c15483640 1 -- 10.20.193.58:0/2957419087 wait complete. 2026-02-23T06:23:01.087 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:23:01.087 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-23T06:23:01.087 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:23:01.209 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.214+0000 7fbf28b30640 1 -- 10.20.193.58:0/1904720956 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf24056550 msgr2=0x7fbf2405ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:01.209 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.214+0000 7fbf28b30640 1 --2- 10.20.193.58:0/1904720956 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf24056550 0x7fbf2405ce30 secure :-1 s=READY pgs=230 gs=2 cs=0 l=1 c_cookie=724559963422673552 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf24059aa0 tx=0x7fbf1402f190 comp rx=0 tx=0).stop 2026-02-23T06:23:01.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.214+0000 7fbf28b30640 1 -- 10.20.193.58:0/1904720956 shutdown_connections 2026-02-23T06:23:01.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.214+0000 7fbf28b30640 1 --2- 10.20.193.58:0/1904720956 >> v2:10.20.193.58:3300/0 conn(0x7fbf2405d370 0x7fbf240b5680 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:01.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.214+0000 7fbf28b30640 1 --2- 10.20.193.58:0/1904720956 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf24056550 0x7fbf2405ce30 unknown :-1 s=CLOSED pgs=230 gs=2 cs=0 l=1 c_cookie=724559963422673552 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:01.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.214+0000 7fbf28b30640 1 -- 10.20.193.58:0/1904720956 >> 10.20.193.58:0/1904720956 conn(0x7fbf240b3c20 msgr2=0x7fbf240b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:01.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.214+0000 7fbf28b30640 1 -- 10.20.193.58:0/1904720956 shutdown_connections 2026-02-23T06:23:01.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.214+0000 7fbf28b30640 1 -- 10.20.193.58:0/1904720956 wait complete. 2026-02-23T06:23:01.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.215+0000 7fbf28b30640 1 Processor -- start 2026-02-23T06:23:01.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.215+0000 7fbf28b30640 1 -- start start 2026-02-23T06:23:01.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.216+0000 7fbf28b30640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbf24056550 0x7fbf24162950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:01.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.216+0000 7fbf28b30640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf2405d370 0x7fbf2415d320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:01.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.216+0000 7fbf28b30640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf2415c040 0x7fbf2415d860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:01.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.216+0000 7fbf28b30640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fbf24154d60 con 0x7fbf2415c040 2026-02-23T06:23:01.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.216+0000 7fbf28b30640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fbf241fe200 con 0x7fbf2405d370 2026-02-23T06:23:01.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.216+0000 7fbf28b30640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fbf241fe4e0 con 0x7fbf24056550 2026-02-23T06:23:01.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.216+0000 7fbf237fe640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbf24056550 msgr2=0x7fbf24162950 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:23:01.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.216+0000 7fbf237fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbf24056550 0x7fbf24162950 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:23:01.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.216+0000 7fbf23fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf2415c040 0x7fbf2415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:01.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.216+0000 7fbf23fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf2415c040 0x7fbf2415d860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:49514/0 (socket says 10.20.193.58:49514) 2026-02-23T06:23:01.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.216+0000 7fbf23fff640 1 -- 10.20.193.58:0/2349257972 learned_addr learned my addr 10.20.193.58:0/2349257972 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:23:01.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.216+0000 7fbf22ffd640 1 --2- 10.20.193.58:0/2349257972 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf2405d370 0x7fbf2415d320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:01.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.217+0000 7fbf23fff640 1 -- 10.20.193.58:0/2349257972 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbf24056550 msgr2=0x7fbf24162950 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:23:01.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.217+0000 7fbf23fff640 1 --2- 10.20.193.58:0/2349257972 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbf24056550 0x7fbf24162950 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:01.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.217+0000 7fbf23fff640 1 -- 10.20.193.58:0/2349257972 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf2405d370 msgr2=0x7fbf2415d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:01.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.217+0000 7fbf23fff640 1 --2- 10.20.193.58:0/2349257972 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf2405d370 0x7fbf2415d320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:01.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.217+0000 7fbf23fff640 1 -- 10.20.193.58:0/2349257972 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1800a590 con 0x7fbf2415c040 2026-02-23T06:23:01.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.217+0000 7fbf23fff640 1 --2- 10.20.193.58:0/2349257972 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf2415c040 0x7fbf2415d860 secure :-1 s=READY pgs=248 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf18005790 tx=0x7fbf18003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:01.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.217+0000 7fbefffff640 1 -- 10.20.193.58:0/2349257972 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf1800fd60 con 0x7fbf2415c040 2026-02-23T06:23:01.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.217+0000 7fbefffff640 1 -- 10.20.193.58:0/2349257972 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf18003e80 con 0x7fbf2415c040 2026-02-23T06:23:01.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.217+0000 7fbefffff640 1 -- 10.20.193.58:0/2349257972 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf18011690 con 0x7fbf2415c040 2026-02-23T06:23:01.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.217+0000 7fbf28b30640 1 -- 10.20.193.58:0/2349257972 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf140094b0 con 0x7fbf2415c040 2026-02-23T06:23:01.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.217+0000 7fbf28b30640 1 -- 10.20.193.58:0/2349257972 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf2415cb20 con 0x7fbf2415c040 2026-02-23T06:23:01.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.218+0000 7fbefdffb640 1 --2- 10.20.193.58:0/2349257972 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf2415cd60 0x7fbf241556e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:01.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.218+0000 7fbefdffb640 1 -- 10.20.193.58:0/2349257972 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fbf240609c0 con 0x7fbf2415cd60 2026-02-23T06:23:01.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.218+0000 7fbf237fe640 1 --2- 10.20.193.58:0/2349257972 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf2415cd60 0x7fbf241556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:01.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.218+0000 7fbf237fe640 1 -- 10.20.193.58:0/2349257972 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbf2405d9c0 con 0x7fbf2415cd60 2026-02-23T06:23:01.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.218+0000 7fbf237fe640 1 --2- 10.20.193.58:0/2349257972 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf2415cd60 0x7fbf241556e0 secure :-1 s=READY pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf10002730 tx=0x7fbf1000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:01.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.219+0000 7fbefffff640 1 -- 10.20.193.58:0/2349257972 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf10004d40 con 0x7fbf2415cd60 2026-02-23T06:23:01.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.219+0000 7fbefffff640 1 -- 10.20.193.58:0/2349257972 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fbf100070d0 con 0x7fbf2415cd60 2026-02-23T06:23:01.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.219+0000 7fbefffff640 1 -- 10.20.193.58:0/2349257972 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf2415cd60 msgr2=0x7fbf241556e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:01.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.219+0000 7fbefffff640 1 --2- 10.20.193.58:0/2349257972 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf2415cd60 0x7fbf241556e0 secure :-1 s=READY pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf10002730 tx=0x7fbf1000c910 comp rx=0 tx=0).stop 2026-02-23T06:23:01.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.219+0000 7fbefffff640 1 -- 10.20.193.58:0/2349257972 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf2415cd60 msgr2=0x7fbf241556e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:23:01.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.219+0000 7fbefffff640 1 --2- 10.20.193.58:0/2349257972 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf2415cd60 0x7fbf241556e0 secure :-1 s=CLOSED pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf10002730 tx=0x7fbf1000c910 comp rx=0 tx=0).stop 2026-02-23T06:23:01.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.219+0000 7fbefffff640 1 -- 10.20.193.58:0/2349257972 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fbf18017020 con 0x7fbf2415c040 2026-02-23T06:23:01.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.220+0000 7fbefffff640 1 --2- 10.20.193.58:0/2349257972 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbef407a430 0x7fbef409a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:01.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.220+0000 7fbefffff640 1 -- 10.20.193.58:0/2349257972 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fbf1809ed60 con 0x7fbf2415c040 2026-02-23T06:23:01.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.220+0000 7fbf237fe640 1 --2- 10.20.193.58:0/2349257972 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbef407a430 0x7fbef409a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:01.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.221+0000 7fbf237fe640 1 --2- 10.20.193.58:0/2349257972 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbef407a430 0x7fbef409a8e0 secure :-1 s=READY pgs=137 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf1000ce90 tx=0x7fbf10006000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:01.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.222+0000 7fbefdffb640 1 --2- 10.20.193.58:0/2349257972 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf24059010 0x7fbf24200b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:01.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.222+0000 7fbefdffb640 1 -- 10.20.193.58:0/2349257972 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2415c410 con 0x7fbf24059010 2026-02-23T06:23:01.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.222+0000 7fbf22ffd640 1 --2- 10.20.193.58:0/2349257972 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf24059010 0x7fbf24200b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:01.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.223+0000 7fbf22ffd640 1 -- 10.20.193.58:0/2349257972 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbf240b5bc0 con 0x7fbf24059010 2026-02-23T06:23:01.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.223+0000 7fbf22ffd640 1 --2- 10.20.193.58:0/2349257972 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf24059010 0x7fbf24200b80 secure :-1 s=READY pgs=250 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf24059aa0 tx=0x7fbf140028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:01.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.223+0000 7fbefffff640 1 -- 10.20.193.58:0/2349257972 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf14047070 con 0x7fbf24059010 2026-02-23T06:23:01.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.223+0000 7fbefffff640 1 -- 10.20.193.58:0/2349257972 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5236 (secure 0 0 0) 0x7fbf1403e040 con 0x7fbf24059010 2026-02-23T06:23:01.219 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:23:01.220 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:23:01.220 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:23:01.220 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:23:01.220 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 14, 2026-02-23T06:23:01.220 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 119233, 2026-02-23T06:23:01.220 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:23:01.220 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:23:01.220 INFO:teuthology.orchestra.run.trial058.stdout: 1 2026-02-23T06:23:01.220 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:01.220 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:23:01.220 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:23:01.221 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:23:01.221 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:23:01.221 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:23:01.221 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:23:01.221 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:23:01.221 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:23:01.221 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:23:01.221 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:23:01.221 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:23:01.221 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:23:01.221 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:23:01.221 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:23:01.222 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:23:01.222 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:23:01.222 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:23:01.222 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:01.222 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:23:01.222 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:23:01.222 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:23:01.222 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:23:01.222 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:23:01.222 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:23:01.222 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:23:01.222 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:23:01.223 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:23:01.223 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:23:01.223 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:23:01.223 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:23:01.223 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:23:01.223 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:23:01.223 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:23:01.223 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:01.223 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:01.223 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:23:01.223 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:23:01.223 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:23:01.223 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:23:01.224 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:23:01.224 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:23:01.224 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:23:01.224 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:23:01.224 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:23:01.224 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:23:01.224 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:23:01.224 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:23:01.224 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:23:01.224 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:23:01.224 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:23:01.224 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:23:01.225 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:23:01.225 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:23:01.225 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:23:01.225 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:23:01.225 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:23:01.225 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:23:01.225 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:23:01.225 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:23:01.225 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:23:01.225 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:23:01.225 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:23:01.225 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:23:01.226 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:23:01.226 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:23:01.226 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:01.226 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:23:01.226 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:01.226 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:23:01.226 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:01.226 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:23:01.226 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:23:01.226 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:23:01.226 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:23:01.226 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:01.227 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:23:01.227 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:23:01.227 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:01.227 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:01.227 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:01.227 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:23:01.227 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:23:01.227 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:01.227 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:01.227 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:01.227 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:01.227 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:23:01.228 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:23:01.228 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:23:01.228 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:23:01.228 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:23:01.228 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:23:01.228 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:01.228 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:01.228 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:23:01.228 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:23:01.228 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:23:01.228 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:23:01.228 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:01.228 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:23:01.229 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:23:01.229 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:01.229 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:01.229 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:01.229 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:23:01.229 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:23:01.229 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:01.229 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:01.229 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:01.229 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:01.229 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:23:01.229 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:23:01.230 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:23:01.230 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:23:01.230 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:23:01.230 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:23:01.230 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:01.230 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:01.230 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:23:01.230 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:23:01.230 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:23:01.230 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:23:01.230 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:01.231 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:23:01.231 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:23:01.231 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:01.231 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:01.231 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:01.231 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:23:01.231 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:23:01.231 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:01.231 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:01.231 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:01.231 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:01.231 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:23:01.231 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:23:01.232 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:23:01.232 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:23:01.232 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:23:01.232 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:23:01.232 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:01.232 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:01.232 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:01.232 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:23:01.232 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:23:01.232 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:01.232 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:01.232 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:01.233 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:23:01.233 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:01.233 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:01.233 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:23:01.233 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:01.233 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:01.233 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:01.233 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:23:01.233 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:01.233 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:01.233 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:23:01.233 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:01.233 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:01.234 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:01.234 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:23:01.234 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:01.234 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:01.234 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:23:01.234 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:01.234 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:01.234 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:01.234 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:23:01.234 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:01.234 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:01.234 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:01.234 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:23:01.235 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:23:01.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.223+0000 7fbefffff640 1 -- 10.20.193.58:0/2349257972 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf24059010 msgr2=0x7fbf24200b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:01.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.223+0000 7fbefffff640 1 --2- 10.20.193.58:0/2349257972 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf24059010 0x7fbf24200b80 secure :-1 s=READY pgs=250 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf24059aa0 tx=0x7fbf140028d0 comp rx=0 tx=0).stop 2026-02-23T06:23:01.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.223+0000 7fbefffff640 1 -- 10.20.193.58:0/2349257972 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf24059010 msgr2=0x7fbf24200b80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:23:01.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.223+0000 7fbefffff640 1 --2- 10.20.193.58:0/2349257972 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf24059010 0x7fbf24200b80 unknown :-1 s=CLOSED pgs=250 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:01.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.223+0000 7fbefdffb640 1 -- 10.20.193.58:0/2349257972 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbef407a430 msgr2=0x7fbef409a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:01.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.223+0000 7fbefdffb640 1 --2- 10.20.193.58:0/2349257972 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbef407a430 0x7fbef409a8e0 secure :-1 s=READY pgs=137 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf1000ce90 tx=0x7fbf10006000 comp rx=0 tx=0).stop 2026-02-23T06:23:01.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.223+0000 7fbefdffb640 1 -- 10.20.193.58:0/2349257972 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf2415c040 msgr2=0x7fbf2415d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:01.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.223+0000 7fbefdffb640 1 --2- 10.20.193.58:0/2349257972 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf2415c040 0x7fbf2415d860 secure :-1 s=READY pgs=248 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf18005790 tx=0x7fbf18003c20 comp rx=0 tx=0).stop 2026-02-23T06:23:01.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.223+0000 7fbf23fff640 1 -- 10.20.193.58:0/2349257972 reap_dead start 2026-02-23T06:23:01.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.223+0000 7fbf23fff640 1 -- 10.20.193.58:0/2349257972 reap_dead start 2026-02-23T06:23:01.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.224+0000 7fbefdffb640 1 -- 10.20.193.58:0/2349257972 shutdown_connections 2026-02-23T06:23:01.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.224+0000 7fbefdffb640 1 -- 10.20.193.58:0/2349257972 >> 10.20.193.58:0/2349257972 conn(0x7fbf240b3c20 msgr2=0x7fbf241572e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:01.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.224+0000 7fbefdffb640 1 -- 10.20.193.58:0/2349257972 shutdown_connections 2026-02-23T06:23:01.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.224+0000 7fbefdffb640 1 -- 10.20.193.58:0/2349257972 wait complete. 2026-02-23T06:23:01.238 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:23:01.238 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-23T06:23:01.239 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:23:01.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.366+0000 7f49e5389640 1 -- 10.20.193.58:0/2734157399 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49e005d370 msgr2=0x7f49e00b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:01.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.366+0000 7f49e5389640 1 --2- 10.20.193.58:0/2734157399 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49e005d370 0x7f49e00b5680 secure :-1 s=READY pgs=232 gs=2 cs=0 l=1 c_cookie=5947627583964188196 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49d4005820 tx=0x7f49d40302d0 comp rx=0 tx=0).stop 2026-02-23T06:23:01.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.366+0000 7f49e5389640 1 -- 10.20.193.58:0/2734157399 shutdown_connections 2026-02-23T06:23:01.362 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.366+0000 7f49e5389640 1 --2- 10.20.193.58:0/2734157399 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49e005d370 0x7f49e00b5680 unknown :-1 s=CLOSED pgs=232 gs=2 cs=0 l=1 c_cookie=5947627583964188196 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:01.362 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.366+0000 7f49e5389640 1 --2- 10.20.193.58:0/2734157399 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f49e0056550 0x7f49e005ce30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:01.362 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.366+0000 7f49e5389640 1 -- 10.20.193.58:0/2734157399 >> 10.20.193.58:0/2734157399 conn(0x7f49e00b3c20 msgr2=0x7f49e00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:01.362 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.366+0000 7f49e5389640 1 -- 10.20.193.58:0/2734157399 shutdown_connections 2026-02-23T06:23:01.362 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.366+0000 7f49e5389640 1 -- 10.20.193.58:0/2734157399 wait complete. 2026-02-23T06:23:01.365 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.367+0000 7f49e5389640 1 Processor -- start 2026-02-23T06:23:01.365 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.367+0000 7f49e5389640 1 -- start start 2026-02-23T06:23:01.365 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.368+0000 7f49e5389640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f49e0056550 0x7f49e00af590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:01.365 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.368+0000 7f49e5389640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f49e005d370 0x7f49e01553e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:01.365 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.368+0000 7f49e5389640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49e015c040 0x7f49e0058780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:01.365 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.368+0000 7f49e5389640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f49e0162e90 con 0x7f49e005d370 2026-02-23T06:23:01.365 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.368+0000 7f49e5389640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f49e00afad0 con 0x7f49e015c040 2026-02-23T06:23:01.365 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.368+0000 7f49e5389640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f49e01fe9e0 con 0x7f49e0056550 2026-02-23T06:23:01.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.368+0000 7f49dffff640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f49e0056550 msgr2=0x7f49e00af590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:23:01.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.368+0000 7f49dffff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f49e0056550 0x7f49e00af590 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:23:01.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.368+0000 7f49df7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f49e005d370 0x7f49e01553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:01.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.368+0000 7f49e4b88640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49e015c040 0x7f49e0058780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:01.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.368+0000 7f49e4b88640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49e015c040 0x7f49e0058780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:54524/0 (socket says 10.20.193.58:54524) 2026-02-23T06:23:01.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.368+0000 7f49e4b88640 1 -- 10.20.193.58:0/2713426061 learned_addr learned my addr 10.20.193.58:0/2713426061 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:23:01.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.369+0000 7f49e4b88640 1 -- 10.20.193.58:0/2713426061 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f49e0056550 msgr2=0x7f49e00af590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:23:01.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.369+0000 7f49e4b88640 1 --2- 10.20.193.58:0/2713426061 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f49e0056550 0x7f49e00af590 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:01.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.369+0000 7f49e4b88640 1 -- 10.20.193.58:0/2713426061 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f49e005d370 msgr2=0x7f49e01553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:01.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.369+0000 7f49e4b88640 1 --2- 10.20.193.58:0/2713426061 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f49e005d370 0x7f49e01553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:01.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.369+0000 7f49e4b88640 1 -- 10.20.193.58:0/2713426061 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d400a590 con 0x7f49e015c040 2026-02-23T06:23:01.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.369+0000 7f49df7fe640 1 --2- 10.20.193.58:0/2713426061 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f49e005d370 0x7f49e01553e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:23:01.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.369+0000 7f49e4b88640 1 --2- 10.20.193.58:0/2713426061 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49e015c040 0x7f49e0058780 secure :-1 s=READY pgs=233 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49d4003e60 tx=0x7f49d4003e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:01.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.369+0000 7f49dcff9640 1 -- 10.20.193.58:0/2713426061 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f49d403e070 con 0x7f49e015c040 2026-02-23T06:23:01.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.369+0000 7f49dcff9640 1 -- 10.20.193.58:0/2713426061 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49d4005b50 con 0x7f49e015c040 2026-02-23T06:23:01.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.369+0000 7f49dcff9640 1 -- 10.20.193.58:0/2713426061 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f49d4039740 con 0x7f49e015c040 2026-02-23T06:23:01.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.369+0000 7f49e5389640 1 -- 10.20.193.58:0/2713426061 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e0155920 con 0x7f49e015c040 2026-02-23T06:23:01.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.369+0000 7f49e5389640 1 -- 10.20.193.58:0/2713426061 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e00aeab0 con 0x7f49e015c040 2026-02-23T06:23:01.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.370+0000 7f49e5389640 1 --2- 10.20.193.58:0/2713426061 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49e0058cc0 0x7f49e00aecd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:01.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.370+0000 7f49e5389640 1 -- 10.20.193.58:0/2713426061 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f49e0154bf0 con 0x7f49e0058cc0 2026-02-23T06:23:01.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.370+0000 7f49dffff640 1 --2- 10.20.193.58:0/2713426061 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49e0058cc0 0x7f49e00aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:01.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.370+0000 7f49dffff640 1 -- 10.20.193.58:0/2713426061 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f49e005d9c0 con 0x7f49e0058cc0 2026-02-23T06:23:01.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.371+0000 7f49dffff640 1 --2- 10.20.193.58:0/2713426061 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49e0058cc0 0x7f49e00aecd0 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49cc003760 tx=0x7f49cc00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:01.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.371+0000 7f49dcff9640 1 -- 10.20.193.58:0/2713426061 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f49cc005d70 con 0x7f49e0058cc0 2026-02-23T06:23:01.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.371+0000 7f49dcff9640 1 -- 10.20.193.58:0/2713426061 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f49cc0070d0 con 0x7f49e0058cc0 2026-02-23T06:23:01.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.371+0000 7f49dcff9640 1 -- 10.20.193.58:0/2713426061 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49e0058cc0 msgr2=0x7f49e00aecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:01.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.371+0000 7f49dcff9640 1 --2- 10.20.193.58:0/2713426061 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49e0058cc0 0x7f49e00aecd0 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49cc003760 tx=0x7f49cc00c8d0 comp rx=0 tx=0).stop 2026-02-23T06:23:01.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.371+0000 7f49dcff9640 1 -- 10.20.193.58:0/2713426061 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49e0058cc0 msgr2=0x7f49e00aecd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:23:01.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.371+0000 7f49dcff9640 1 --2- 10.20.193.58:0/2713426061 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49e0058cc0 0x7f49e00aecd0 unknown :-1 s=CLOSED pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:01.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.372+0000 7f49dcff9640 1 -- 10.20.193.58:0/2713426061 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f49d40398a0 con 0x7f49e015c040 2026-02-23T06:23:01.370 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.373+0000 7f49dcff9640 1 --2- 10.20.193.58:0/2713426061 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f49b007a3c0 0x7f49b009a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:01.370 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.373+0000 7f49dcff9640 1 -- 10.20.193.58:0/2713426061 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f49d40c3a60 con 0x7f49e015c040 2026-02-23T06:23:01.370 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.374+0000 7f49e5389640 1 --2- 10.20.193.58:0/2713426061 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49e00aff30 0x7f49e00b06d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:01.370 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.374+0000 7f49e5389640 1 -- 10.20.193.58:0/2713426061 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f49e00b5bc0 con 0x7f49e00aff30 2026-02-23T06:23:01.371 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.375+0000 7f49df7fe640 1 --2- 10.20.193.58:0/2713426061 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49e00aff30 0x7f49e00b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:01.371 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.375+0000 7f49dffff640 1 --2- 10.20.193.58:0/2713426061 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f49b007a3c0 0x7f49b009a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:01.371 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.375+0000 7f49df7fe640 1 -- 10.20.193.58:0/2713426061 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f49e005ce30 con 0x7f49e00aff30 2026-02-23T06:23:01.371 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.375+0000 7f49df7fe640 1 --2- 10.20.193.58:0/2713426061 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49e00aff30 0x7f49e00b06d0 secure :-1 s=READY pgs=235 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49e0059aa0 tx=0x7f49d0009e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:01.372 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.375+0000 7f49dffff640 1 --2- 10.20.193.58:0/2713426061 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f49b007a3c0 0x7f49b009a870 secure :-1 s=READY pgs=138 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49cc003760 tx=0x7f49cc00a000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:01.372 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.375+0000 7f49dcff9640 1 -- 10.20.193.58:0/2713426061 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f49d000ec70 con 0x7f49e00aff30 2026-02-23T06:23:01.372 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.376+0000 7f49dcff9640 1 -- 10.20.193.58:0/2713426061 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5544 (secure 0 0 0) 0x7f49d000edd0 con 0x7f49e00aff30 2026-02-23T06:23:01.372 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.376+0000 7f49dcff9640 1 -- 10.20.193.58:0/2713426061 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49e00aff30 msgr2=0x7f49e00b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:01.372 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:23:01.372 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:23:01.372 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:23:01.372 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:23:01.373 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 14, 2026-02-23T06:23:01.373 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 119422, 2026-02-23T06:23:01.373 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:23:01.373 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:23:01.373 INFO:teuthology.orchestra.run.trial058.stdout: 1 2026-02-23T06:23:01.373 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:01.373 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:23:01.373 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:23:01.373 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:23:01.373 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:23:01.373 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:23:01.373 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:23:01.374 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:23:01.374 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:23:01.374 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:23:01.374 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:23:01.374 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:23:01.374 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:23:01.374 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:23:01.374 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:23:01.374 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:23:01.374 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:23:01.374 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:23:01.374 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:01.375 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:23:01.375 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:23:01.375 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:23:01.375 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:23:01.375 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:23:01.375 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:23:01.375 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:23:01.375 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:23:01.375 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:23:01.375 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:23:01.375 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:23:01.375 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:23:01.375 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:23:01.376 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:23:01.376 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:23:01.376 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:01.376 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:01.376 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:23:01.376 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:23:01.376 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:23:01.376 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:23:01.376 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:23:01.376 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:23:01.376 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:23:01.377 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:23:01.377 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:23:01.377 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:23:01.377 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:23:01.377 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:23:01.377 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:23:01.377 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:23:01.377 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:23:01.377 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:23:01.377 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:23:01.377 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:23:01.377 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:23:01.377 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:23:01.378 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:23:01.378 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:23:01.378 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:23:01.378 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:23:01.378 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:23:01.378 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:23:01.378 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:23:01.378 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:23:01.378 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:23:01.378 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:23:01.378 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:01.378 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:23:01.379 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:01.379 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:23:01.379 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:01.379 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:23:01.379 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:23:01.379 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:23:01.379 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:23:01.379 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:01.379 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:23:01.379 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:23:01.379 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:01.379 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:01.379 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:01.380 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:23:01.380 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:23:01.380 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:01.380 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:01.380 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:01.380 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:01.380 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:23:01.380 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:23:01.380 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:23:01.380 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:23:01.380 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:23:01.380 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:23:01.380 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:01.381 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:01.381 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:23:01.381 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:23:01.381 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:23:01.381 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:23:01.381 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:01.381 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:23:01.381 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:23:01.381 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:01.381 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:01.381 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:01.381 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:23:01.381 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:23:01.382 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:01.382 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:01.382 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:01.382 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:01.382 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:23:01.382 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:23:01.382 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:23:01.382 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:23:01.382 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:23:01.382 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:23:01.382 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:01.382 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:01.383 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:23:01.383 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:23:01.383 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:23:01.383 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:23:01.383 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:01.383 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:23:01.383 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:23:01.383 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:01.383 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:01.383 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:01.383 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:23:01.383 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:23:01.383 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:01.384 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:01.384 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:01.384 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:01.384 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:23:01.384 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:23:01.384 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:23:01.384 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:23:01.384 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:23:01.384 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:23:01.384 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:01.384 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:01.384 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:01.384 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:23:01.385 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:23:01.385 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:01.385 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:01.385 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:01.385 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:23:01.385 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:01.385 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:01.385 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:23:01.385 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:01.385 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:01.385 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:01.385 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:23:01.385 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:01.386 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:01.386 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:23:01.386 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:01.386 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:01.386 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:01.386 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:23:01.386 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:01.386 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:01.386 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:23:01.386 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:01.386 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:23:01.386 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:23:01.386 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:23:01.387 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:01.387 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:01.387 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:01.387 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:01.387 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:23:01.387 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:01.387 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:01.387 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:23:01.387 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:01.387 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:01.387 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:01.387 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:23:01.387 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:01.388 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:01.388 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:01.388 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:23:01.388 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:23:01.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.376+0000 7f49dcff9640 1 --2- 10.20.193.58:0/2713426061 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49e00aff30 0x7f49e00b06d0 secure :-1 s=READY pgs=235 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49e0059aa0 tx=0x7f49d0009e40 comp rx=0 tx=0).stop 2026-02-23T06:23:01.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.376+0000 7f49dcff9640 1 -- 10.20.193.58:0/2713426061 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49e00aff30 msgr2=0x7f49e00b06d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:23:01.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.376+0000 7f49dcff9640 1 --2- 10.20.193.58:0/2713426061 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49e00aff30 0x7f49e00b06d0 secure :-1 s=CLOSED pgs=235 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49e0059aa0 tx=0x7f49d0009e40 comp rx=0 tx=0).stop 2026-02-23T06:23:01.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.376+0000 7f49e5389640 1 -- 10.20.193.58:0/2713426061 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f49b007a3c0 msgr2=0x7f49b009a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:01.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.376+0000 7f49e5389640 1 --2- 10.20.193.58:0/2713426061 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f49b007a3c0 0x7f49b009a870 secure :-1 s=READY pgs=138 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49cc003760 tx=0x7f49cc00a000 comp rx=0 tx=0).stop 2026-02-23T06:23:01.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.376+0000 7f49e5389640 1 -- 10.20.193.58:0/2713426061 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49e015c040 msgr2=0x7f49e0058780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:01.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.376+0000 7f49e5389640 1 --2- 10.20.193.58:0/2713426061 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49e015c040 0x7f49e0058780 secure :-1 s=READY pgs=233 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49d4003e60 tx=0x7f49d4003e90 comp rx=0 tx=0).stop 2026-02-23T06:23:01.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.376+0000 7f49e4b88640 1 -- 10.20.193.58:0/2713426061 reap_dead start 2026-02-23T06:23:01.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.376+0000 7f49e4b88640 1 -- 10.20.193.58:0/2713426061 reap_dead start 2026-02-23T06:23:01.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.376+0000 7f49e5389640 1 -- 10.20.193.58:0/2713426061 shutdown_connections 2026-02-23T06:23:01.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.376+0000 7f49e5389640 1 -- 10.20.193.58:0/2713426061 >> 10.20.193.58:0/2713426061 conn(0x7f49e00b3c20 msgr2=0x7f49e0159af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:01.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.376+0000 7f49e5389640 1 -- 10.20.193.58:0/2713426061 shutdown_connections 2026-02-23T06:23:01.391 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:01.376+0000 7f49e5389640 1 -- 10.20.193.58:0/2713426061 wait complete. 2026-02-23T06:23:01.391 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:23:01.391 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:23:12.014 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:23:12.019 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:23:21.391 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-23T06:23:21.392 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-23T06:23:21.392 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-23T06:23:21.392 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-23T06:23:21.395 INFO:tasks.ceph.mon.c:Started 2026-02-23T06:23:21.395 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.a 2026-02-23T06:23:21.395 INFO:tasks.mon_thrash:Sending STOP to mon a 2026-02-23T06:23:21.395 INFO:tasks.ceph.mon.a:Sent signal 19 2026-02-23T06:23:21.395 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-23T06:23:36.397 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.a 2026-02-23T06:23:36.397 INFO:tasks.mon_thrash:Sending CONT to mon a 2026-02-23T06:23:36.397 INFO:tasks.ceph.mon.a:Sent signal 18 2026-02-23T06:23:36.397 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:23:36.398 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:23:36.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.525+0000 7f1f83fff640 1 -- 10.20.193.58:0/29150228 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1f840b5680 msgr2=0x7f1f840b5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:36.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.525+0000 7f1f83fff640 1 --2- 10.20.193.58:0/29150228 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1f840b5680 0x7f1f840b5b00 secure :-1 s=READY pgs=5 gs=3 cs=0 l=1 c_cookie=9755780815202889004 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f7400a970 tx=0x7f1f740302d0 comp rx=0 tx=0).stop 2026-02-23T06:23:36.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.525+0000 7f1f83fff640 1 -- 10.20.193.58:0/29150228 shutdown_connections 2026-02-23T06:23:36.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.525+0000 7f1f83fff640 1 --2- 10.20.193.58:0/29150228 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1f840b5680 0x7f1f840b5b00 unknown :-1 s=CLOSED pgs=5 gs=3 cs=0 l=1 c_cookie=9755780815202889004 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:36.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.525+0000 7f1f83fff640 1 -- 10.20.193.58:0/29150228 >> 10.20.193.58:0/29150228 conn(0x7f1f840b3c20 msgr2=0x7f1f840b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:36.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.525+0000 7f1f83fff640 1 -- 10.20.193.58:0/29150228 shutdown_connections 2026-02-23T06:23:36.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.525+0000 7f1f83fff640 1 -- 10.20.193.58:0/29150228 wait complete. 2026-02-23T06:23:36.523 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.526+0000 7f1f83fff640 1 Processor -- start 2026-02-23T06:23:36.523 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.526+0000 7f1f83fff640 1 -- start start 2026-02-23T06:23:36.523 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.527+0000 7f1f83fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1f84056550 0x7f1f8415feb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:36.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.527+0000 7f1f83fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1f840b5680 0x7f1f84058660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:36.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.527+0000 7f1f83fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1f8415c040 0x7f1f8415c8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:36.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.527+0000 7f1f83fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8415eb30 con 0x7f1f840b5680 2026-02-23T06:23:36.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.527+0000 7f1f83fff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8415e240 con 0x7f1f84056550 2026-02-23T06:23:36.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.527+0000 7f1f83fff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f1f840b17a0 con 0x7f1f8415c040 2026-02-23T06:23:36.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.527+0000 7f1f827fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1f840b5680 0x7f1f84058660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:36.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.527+0000 7f1f827fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1f840b5680 0x7f1f84058660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:48620/0 (socket says 10.20.193.58:48620) 2026-02-23T06:23:36.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.527+0000 7f1f827fc640 1 -- 10.20.193.58:0/1107072450 learned_addr learned my addr 10.20.193.58:0/1107072450 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:23:36.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.527+0000 7f1f82ffd640 1 --2- 10.20.193.58:0/1107072450 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1f84056550 0x7f1f8415feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:36.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.527+0000 7f1f837fe640 1 --2- 10.20.193.58:0/1107072450 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1f8415c040 0x7f1f8415c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:36.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.527+0000 7f1f827fc640 1 -- 10.20.193.58:0/1107072450 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1f840b5680 msgr2=0x7f1f84058660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-23T06:23:36.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.527+0000 7f1f827fc640 1 -- 10.20.193.58:0/1107072450 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1f840b5680 msgr2=0x7f1f84058660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:23:36.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.527+0000 7f1f827fc640 1 --2- 10.20.193.58:0/1107072450 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1f840b5680 0x7f1f84058660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:23:36.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.527+0000 7f1f827fc640 1 --2- 10.20.193.58:0/1107072450 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1f840b5680 0x7f1f84058660 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:23:36.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.527+0000 7f1f82ffd640 1 -- 10.20.193.58:0/1107072450 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1f84056550 msgr2=0x7f1f8415feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-23T06:23:36.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.527+0000 7f1f82ffd640 1 -- 10.20.193.58:0/1107072450 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1f84056550 msgr2=0x7f1f8415feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:23:36.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.527+0000 7f1f82ffd640 1 --2- 10.20.193.58:0/1107072450 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1f84056550 0x7f1f8415feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:23:36.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.527+0000 7f1f82ffd640 1 --2- 10.20.193.58:0/1107072450 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1f84056550 0x7f1f8415feb0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:23:36.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.528+0000 7f1f837fe640 1 -- 10.20.193.58:0/1107072450 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1f84056550 msgr2=0x7f1f8415feb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:23:36.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.528+0000 7f1f837fe640 1 --2- 10.20.193.58:0/1107072450 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1f84056550 0x7f1f8415feb0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:36.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.528+0000 7f1f837fe640 1 -- 10.20.193.58:0/1107072450 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1f840b5680 msgr2=0x7f1f84058660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:23:36.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.528+0000 7f1f837fe640 1 --2- 10.20.193.58:0/1107072450 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1f840b5680 0x7f1f84058660 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:36.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.528+0000 7f1f837fe640 1 -- 10.20.193.58:0/1107072450 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f7400a590 con 0x7f1f8415c040 2026-02-23T06:23:36.526 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.528+0000 7f1f837fe640 1 --2- 10.20.193.58:0/1107072450 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1f8415c040 0x7f1f8415c8e0 secure :-1 s=READY pgs=6 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f74005820 tx=0x7f1f74003e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:36.526 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.528+0000 7f1f5bfff640 1 -- 10.20.193.58:0/1107072450 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1f7403e070 con 0x7f1f8415c040 2026-02-23T06:23:36.526 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.528+0000 7f1f5bfff640 1 -- 10.20.193.58:0/1107072450 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f74039960 con 0x7f1f8415c040 2026-02-23T06:23:36.526 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.528+0000 7f1f5bfff640 1 -- 10.20.193.58:0/1107072450 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1f74039d30 con 0x7f1f8415c040 2026-02-23T06:23:36.526 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.528+0000 7f1f83fff640 1 -- 10.20.193.58:0/1107072450 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f8415e4e0 con 0x7f1f8415c040 2026-02-23T06:23:36.526 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.528+0000 7f1f83fff640 1 -- 10.20.193.58:0/1107072450 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f8415fa10 con 0x7f1f8415c040 2026-02-23T06:23:36.526 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.529+0000 7f1f83fff640 1 -- 10.20.193.58:0/1107072450 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f8415e960 con 0x7f1f8415c040 2026-02-23T06:23:36.527 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.530+0000 7f1f5bfff640 1 -- 10.20.193.58:0/1107072450 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f1f74049020 con 0x7f1f8415c040 2026-02-23T06:23:36.527 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.531+0000 7f1f5bfff640 1 --2- 10.20.193.58:0/1107072450 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1f5407a6c0 0x7f1f5409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:36.527 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.531+0000 7f1f5bfff640 1 -- 10.20.193.58:0/1107072450 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f1f740c3410 con 0x7f1f8415c040 2026-02-23T06:23:36.527 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.531+0000 7f1f82ffd640 1 --2- 10.20.193.58:0/1107072450 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1f5407a6c0 0x7f1f5409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:36.528 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.532+0000 7f1f5bfff640 1 -- 10.20.193.58:0/1107072450 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f1f740865a0 con 0x7f1f8415c040 2026-02-23T06:23:36.528 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.532+0000 7f1f82ffd640 1 --2- 10.20.193.58:0/1107072450 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1f5407a6c0 0x7f1f5409ab70 secure :-1 s=READY pgs=140 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f78004770 tx=0x7f1f78009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:36.691 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.696+0000 7f1f83fff640 1 -- 10.20.193.58:0/1107072450 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1f840b5aa0 con 0x7f1f8415c040 2026-02-23T06:23:36.691 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.697+0000 7f1f5bfff640 1 -- 10.20.193.58:0/1107072450 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1749 (secure 0 0 0) 0x7f1f74094020 con 0x7f1f8415c040 2026-02-23T06:23:36.692 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":16,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":10,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:23:36.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.699+0000 7f1f83fff640 1 -- 10.20.193.58:0/1107072450 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1f5407a6c0 msgr2=0x7f1f5409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:36.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.699+0000 7f1f83fff640 1 --2- 10.20.193.58:0/1107072450 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1f5407a6c0 0x7f1f5409ab70 secure :-1 s=READY pgs=140 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f78004770 tx=0x7f1f78009040 comp rx=0 tx=0).stop 2026-02-23T06:23:36.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.699+0000 7f1f83fff640 1 -- 10.20.193.58:0/1107072450 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1f8415c040 msgr2=0x7f1f8415c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:36.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.699+0000 7f1f83fff640 1 --2- 10.20.193.58:0/1107072450 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1f8415c040 0x7f1f8415c8e0 secure :-1 s=READY pgs=6 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f74005820 tx=0x7f1f74003e60 comp rx=0 tx=0).stop 2026-02-23T06:23:36.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.699+0000 7f1f83fff640 1 -- 10.20.193.58:0/1107072450 shutdown_connections 2026-02-23T06:23:36.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.699+0000 7f1f83fff640 1 --2- 10.20.193.58:0/1107072450 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1f5407a6c0 0x7f1f5409ab70 unknown :-1 s=CLOSED pgs=140 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:36.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.699+0000 7f1f83fff640 1 --2- 10.20.193.58:0/1107072450 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1f8415c040 0x7f1f8415c8e0 unknown :-1 s=CLOSED pgs=6 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:36.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.699+0000 7f1f83fff640 1 --2- 10.20.193.58:0/1107072450 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1f840b5680 0x7f1f84058660 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:36.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.699+0000 7f1f83fff640 1 --2- 10.20.193.58:0/1107072450 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1f84056550 0x7f1f8415feb0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:36.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.699+0000 7f1f83fff640 1 -- 10.20.193.58:0/1107072450 >> 10.20.193.58:0/1107072450 conn(0x7f1f840b3c20 msgr2=0x7f1f84159f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:36.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.700+0000 7f1f83fff640 1 -- 10.20.193.58:0/1107072450 shutdown_connections 2026-02-23T06:23:36.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:36.701+0000 7f1f83fff640 1 -- 10.20.193.58:0/1107072450 wait complete. 2026-02-23T06:23:39.707 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:23:39.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.835+0000 7f104e554640 1 -- 10.20.193.58:0/3106839707 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f10480b6690 msgr2=0x7f1048058ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:39.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.835+0000 7f104e554640 1 --2- 10.20.193.58:0/3106839707 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f10480b6690 0x7f1048058ec0 secure :-1 s=READY pgs=7 gs=3 cs=0 l=1 c_cookie=3141816914286455687 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f104400a970 tx=0x7f10440302d0 comp rx=0 tx=0).stop 2026-02-23T06:23:39.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.835+0000 7f104e554640 1 -- 10.20.193.58:0/3106839707 shutdown_connections 2026-02-23T06:23:39.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.835+0000 7f104e554640 1 --2- 10.20.193.58:0/3106839707 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f10480b6690 0x7f1048058ec0 unknown :-1 s=CLOSED pgs=7 gs=3 cs=0 l=1 c_cookie=3141816914286455687 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:39.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.835+0000 7f104e554640 1 -- 10.20.193.58:0/3106839707 >> 10.20.193.58:0/3106839707 conn(0x7f10480b3c20 msgr2=0x7f10480b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:39.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.835+0000 7f104e554640 1 -- 10.20.193.58:0/3106839707 shutdown_connections 2026-02-23T06:23:39.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.835+0000 7f104e554640 1 -- 10.20.193.58:0/3106839707 wait complete. 2026-02-23T06:23:39.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.837+0000 7f104e554640 1 Processor -- start 2026-02-23T06:23:39.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.837+0000 7f104e554640 1 -- start start 2026-02-23T06:23:39.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.837+0000 7f104e554640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f10480b6690 0x7f1048127170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:39.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.837+0000 7f104e554640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f104815d4a0 0x7f1048056e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:39.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.837+0000 7f104e554640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f104815d870 0x7f1048057380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:39.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.837+0000 7f104e554640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f1048056850 con 0x7f104815d4a0 2026-02-23T06:23:39.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.837+0000 7f104e554640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f104813ed00 con 0x7f10480b6690 2026-02-23T06:23:39.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.837+0000 7f104e554640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f1048057b00 con 0x7f104815d870 2026-02-23T06:23:39.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.837+0000 7f104cd51640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f104815d4a0 0x7f1048056e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:39.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.837+0000 7f104cd51640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f104815d4a0 0x7f1048056e40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:52236/0 (socket says 10.20.193.58:52236) 2026-02-23T06:23:39.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.837+0000 7f104cd51640 1 -- 10.20.193.58:0/3755506010 learned_addr learned my addr 10.20.193.58:0/3755506010 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:23:39.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.837+0000 7f104d552640 1 --2- 10.20.193.58:0/3755506010 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f10480b6690 0x7f1048127170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:39.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.838+0000 7f104cd51640 1 -- 10.20.193.58:0/3755506010 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f104815d4a0 msgr2=0x7f1048056e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-23T06:23:39.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.838+0000 7f104cd51640 1 -- 10.20.193.58:0/3755506010 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f104815d4a0 msgr2=0x7f1048056e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:23:39.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.838+0000 7f104cd51640 1 --2- 10.20.193.58:0/3755506010 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f104815d4a0 0x7f1048056e40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:23:39.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.838+0000 7f104dd53640 1 --2- 10.20.193.58:0/3755506010 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f104815d870 0x7f1048057380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:39.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.838+0000 7f104cd51640 1 --2- 10.20.193.58:0/3755506010 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f104815d4a0 0x7f1048056e40 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:23:39.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.838+0000 7f104d552640 1 -- 10.20.193.58:0/3755506010 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f10480b6690 msgr2=0x7f1048127170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-23T06:23:39.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.838+0000 7f104d552640 1 -- 10.20.193.58:0/3755506010 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f10480b6690 msgr2=0x7f1048127170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:23:39.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.838+0000 7f104d552640 1 --2- 10.20.193.58:0/3755506010 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f10480b6690 0x7f1048127170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:23:39.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.838+0000 7f104d552640 1 --2- 10.20.193.58:0/3755506010 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f10480b6690 0x7f1048127170 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:23:39.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.838+0000 7f104dd53640 1 -- 10.20.193.58:0/3755506010 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f10480b6690 msgr2=0x7f1048127170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:23:39.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.838+0000 7f104dd53640 1 --2- 10.20.193.58:0/3755506010 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f10480b6690 0x7f1048127170 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:39.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.838+0000 7f104dd53640 1 -- 10.20.193.58:0/3755506010 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f104815d4a0 msgr2=0x7f1048056e40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:23:39.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.838+0000 7f104dd53640 1 --2- 10.20.193.58:0/3755506010 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f104815d4a0 0x7f1048056e40 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:39.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.838+0000 7f104dd53640 1 -- 10.20.193.58:0/3755506010 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104400a590 con 0x7f104815d870 2026-02-23T06:23:39.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.838+0000 7f104dd53640 1 --2- 10.20.193.58:0/3755506010 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f104815d870 0x7f1048057380 secure :-1 s=READY pgs=8 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1048059c90 tx=0x7f1044003e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:39.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.839+0000 7f1035ffb640 1 -- 10.20.193.58:0/3755506010 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f104403e070 con 0x7f104815d870 2026-02-23T06:23:39.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.839+0000 7f104e554640 1 -- 10.20.193.58:0/3755506010 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1048057dc0 con 0x7f104815d870 2026-02-23T06:23:39.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.839+0000 7f104e554640 1 -- 10.20.193.58:0/3755506010 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1048056570 con 0x7f104815d870 2026-02-23T06:23:39.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.839+0000 7f1035ffb640 1 -- 10.20.193.58:0/3755506010 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1044039960 con 0x7f104815d870 2026-02-23T06:23:39.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.839+0000 7f1035ffb640 1 -- 10.20.193.58:0/3755506010 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1044039cf0 con 0x7f104815d870 2026-02-23T06:23:39.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.839+0000 7f10177fe640 1 -- 10.20.193.58:0/3755506010 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10480b6d50 con 0x7f104815d870 2026-02-23T06:23:39.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.841+0000 7f1035ffb640 1 -- 10.20.193.58:0/3755506010 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f104404c440 con 0x7f104815d870 2026-02-23T06:23:39.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.842+0000 7f1035ffb640 1 --2- 10.20.193.58:0/3755506010 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f101807a6c0 0x7f101809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:39.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.842+0000 7f1035ffb640 1 -- 10.20.193.58:0/3755506010 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f10440c4240 con 0x7f104815d870 2026-02-23T06:23:39.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.842+0000 7f104d552640 1 --2- 10.20.193.58:0/3755506010 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f101807a6c0 0x7f101809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:39.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.842+0000 7f1035ffb640 1 -- 10.20.193.58:0/3755506010 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f1044087510 con 0x7f104815d870 2026-02-23T06:23:39.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.843+0000 7f104d552640 1 --2- 10.20.193.58:0/3755506010 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f101807a6c0 0x7f101809ab70 secure :-1 s=READY pgs=141 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1038004770 tx=0x7f1038009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:39.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.997+0000 7f10177fe640 1 -- 10.20.193.58:0/3755506010 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f104805b0e0 con 0x7f104815d870 2026-02-23T06:23:39.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.997+0000 7f1035ffb640 1 -- 10.20.193.58:0/3755506010 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1749 (secure 0 0 0) 0x7f104408a630 con 0x7f104815d870 2026-02-23T06:23:39.992 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":16,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":13,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:23:39.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.999+0000 7f10177fe640 1 -- 10.20.193.58:0/3755506010 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f101807a6c0 msgr2=0x7f101809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:39.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.999+0000 7f10177fe640 1 --2- 10.20.193.58:0/3755506010 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f101807a6c0 0x7f101809ab70 secure :-1 s=READY pgs=141 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1038004770 tx=0x7f1038009040 comp rx=0 tx=0).stop 2026-02-23T06:23:39.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.999+0000 7f10177fe640 1 -- 10.20.193.58:0/3755506010 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f104815d870 msgr2=0x7f1048057380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:39.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:39.999+0000 7f10177fe640 1 --2- 10.20.193.58:0/3755506010 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f104815d870 0x7f1048057380 secure :-1 s=READY pgs=8 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1048059c90 tx=0x7f1044003e60 comp rx=0 tx=0).stop 2026-02-23T06:23:39.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:40.000+0000 7f10177fe640 1 -- 10.20.193.58:0/3755506010 shutdown_connections 2026-02-23T06:23:39.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:40.000+0000 7f10177fe640 1 --2- 10.20.193.58:0/3755506010 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f101807a6c0 0x7f101809ab70 unknown :-1 s=CLOSED pgs=141 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:39.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:40.000+0000 7f10177fe640 1 --2- 10.20.193.58:0/3755506010 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f104815d870 0x7f1048057380 unknown :-1 s=CLOSED pgs=8 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:39.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:40.000+0000 7f10177fe640 1 --2- 10.20.193.58:0/3755506010 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f104815d4a0 0x7f1048056e40 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:39.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:40.000+0000 7f10177fe640 1 --2- 10.20.193.58:0/3755506010 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f10480b6690 0x7f1048127170 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:39.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:40.000+0000 7f10177fe640 1 -- 10.20.193.58:0/3755506010 >> 10.20.193.58:0/3755506010 conn(0x7f10480b3c20 msgr2=0x7f104815ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:39.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:40.000+0000 7f10177fe640 1 -- 10.20.193.58:0/3755506010 shutdown_connections 2026-02-23T06:23:39.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:40.000+0000 7f10177fe640 1 -- 10.20.193.58:0/3755506010 wait complete. 2026-02-23T06:23:42.075 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:23:42.079 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:23:42.967 INFO:tasks.workunit.client.0.trial058.stdout:fs setup took 61 secs 2026-02-23T06:23:43.007 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:23:43.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.138+0000 7f3c117c9640 1 -- 10.20.193.58:0/2286602782 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3bf0003ad0 msgr2=0x7f3bf0003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:43.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.138+0000 7f3c117c9640 1 --2- 10.20.193.58:0/2286602782 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3bf0003ad0 0x7f3bf0003ee0 secure :-1 s=READY pgs=241 gs=4 cs=0 l=1 c_cookie=15334880180061090895 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3bf8009b40 tx=0x7f3bf802fc50 comp rx=0 tx=0).stop 2026-02-23T06:23:43.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.138+0000 7f3c10fc8640 1 -- 10.20.193.58:0/2286602782 reap_dead start 2026-02-23T06:23:43.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.138+0000 7f3c117c9640 1 -- 10.20.193.58:0/2286602782 shutdown_connections 2026-02-23T06:23:43.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.138+0000 7f3c117c9640 1 -- 10.20.193.58:0/2286602782 >> 10.20.193.58:0/2286602782 conn(0x7f3c0c0b3c20 msgr2=0x7f3c0c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:43.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.138+0000 7f3c117c9640 1 -- 10.20.193.58:0/2286602782 shutdown_connections 2026-02-23T06:23:43.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.138+0000 7f3c117c9640 1 -- 10.20.193.58:0/2286602782 wait complete. 2026-02-23T06:23:43.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.139+0000 7f3c117c9640 1 Processor -- start 2026-02-23T06:23:43.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.140+0000 7f3c117c9640 1 -- start start 2026-02-23T06:23:43.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.140+0000 7f3c117c9640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3bf0003ad0 0x7f3c0c164360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:43.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.140+0000 7f3c117c9640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3c0c1648a0 0x7f3c0c161930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:43.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.140+0000 7f3c117c9640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c0c161e70 0x7f3c0c0b09b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:43.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.140+0000 7f3c117c9640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0c13b9c0 con 0x7f3c0c161e70 2026-02-23T06:23:43.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.140+0000 7f3c117c9640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0c1611c0 con 0x7f3c0c1648a0 2026-02-23T06:23:43.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.140+0000 7f3c117c9640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f3c0c1614a0 con 0x7f3bf0003ad0 2026-02-23T06:23:43.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.140+0000 7f3c10fc8640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c0c161e70 0x7f3c0c0b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:43.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.140+0000 7f3c0b7fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3c0c1648a0 0x7f3c0c161930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:43.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.140+0000 7f3c10fc8640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c0c161e70 0x7f3c0c0b09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:52254/0 (socket says 10.20.193.58:52254) 2026-02-23T06:23:43.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.140+0000 7f3c10fc8640 1 -- 10.20.193.58:0/3202090304 learned_addr learned my addr 10.20.193.58:0/3202090304 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:23:43.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.140+0000 7f3c0bfff640 1 --2- 10.20.193.58:0/3202090304 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3bf0003ad0 0x7f3c0c164360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:43.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.140+0000 7f3c10fc8640 1 -- 10.20.193.58:0/3202090304 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3bf0003ad0 msgr2=0x7f3c0c164360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:43.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.140+0000 7f3c10fc8640 1 --2- 10.20.193.58:0/3202090304 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3bf0003ad0 0x7f3c0c164360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:43.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.140+0000 7f3c10fc8640 1 -- 10.20.193.58:0/3202090304 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3c0c1648a0 msgr2=0x7f3c0c161930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:43.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.140+0000 7f3c10fc8640 1 --2- 10.20.193.58:0/3202090304 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3c0c1648a0 0x7f3c0c161930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:43.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.140+0000 7f3c10fc8640 1 -- 10.20.193.58:0/3202090304 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0c1622e0 con 0x7f3c0c161e70 2026-02-23T06:23:43.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.141+0000 7f3c10fc8640 1 --2- 10.20.193.58:0/3202090304 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c0c161e70 0x7f3c0c0b09b0 secure :-1 s=READY pgs=258 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c0c062050 tx=0x7f3c00007810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:43.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.141+0000 7f3c08ff9640 1 -- 10.20.193.58:0/3202090304 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3c00018070 con 0x7f3c0c161e70 2026-02-23T06:23:43.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.141+0000 7f3c117c9640 1 -- 10.20.193.58:0/3202090304 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c0c13b6e0 con 0x7f3c0c161e70 2026-02-23T06:23:43.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.141+0000 7f3c08ff9640 1 -- 10.20.193.58:0/3202090304 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c00012650 con 0x7f3c0c161e70 2026-02-23T06:23:43.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.141+0000 7f3c08ff9640 1 -- 10.20.193.58:0/3202090304 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3c00018070 con 0x7f3c0c161e70 2026-02-23T06:23:43.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.141+0000 7f3c117c9640 1 -- 10.20.193.58:0/3202090304 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c0c162da0 con 0x7f3c0c161e70 2026-02-23T06:23:43.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.141+0000 7f3be67fc640 1 -- 10.20.193.58:0/3202090304 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c0c05d9a0 con 0x7f3c0c161e70 2026-02-23T06:23:43.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.144+0000 7f3c08ff9640 1 -- 10.20.193.58:0/3202090304 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f3c000127c0 con 0x7f3c0c161e70 2026-02-23T06:23:43.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.145+0000 7f3c08ff9640 1 --2- 10.20.193.58:0/3202090304 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3bdc07a780 0x7f3bdc09ac30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:43.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.145+0000 7f3c08ff9640 1 -- 10.20.193.58:0/3202090304 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f3c0009eb90 con 0x7f3c0c161e70 2026-02-23T06:23:43.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.145+0000 7f3c08ff9640 1 -- 10.20.193.58:0/3202090304 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f3c000d7720 con 0x7f3c0c161e70 2026-02-23T06:23:43.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.146+0000 7f3c0bfff640 1 --2- 10.20.193.58:0/3202090304 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3bdc07a780 0x7f3bdc09ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:43.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.147+0000 7f3c0bfff640 1 --2- 10.20.193.58:0/3202090304 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3bdc07a780 0x7f3bdc09ac30 secure :-1 s=READY pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3bf80023d0 tx=0x7f3bf8004770 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:43.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.301+0000 7f3be67fc640 1 -- 10.20.193.58:0/3202090304 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3c0c05d9a0 con 0x7f3c0c161e70 2026-02-23T06:23:43.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.302+0000 7f3c08ff9640 1 -- 10.20.193.58:0/3202090304 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1748 (secure 0 0 0) 0x7f3c0c05d9a0 con 0x7f3c0c161e70 2026-02-23T06:23:43.297 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":18,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:23:43.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.303+0000 7f3be67fc640 1 -- 10.20.193.58:0/3202090304 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3bdc07a780 msgr2=0x7f3bdc09ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:43.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.303+0000 7f3be67fc640 1 --2- 10.20.193.58:0/3202090304 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3bdc07a780 0x7f3bdc09ac30 secure :-1 s=READY pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3bf80023d0 tx=0x7f3bf8004770 comp rx=0 tx=0).stop 2026-02-23T06:23:43.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.303+0000 7f3be67fc640 1 -- 10.20.193.58:0/3202090304 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c0c161e70 msgr2=0x7f3c0c0b09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:43.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.303+0000 7f3be67fc640 1 --2- 10.20.193.58:0/3202090304 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c0c161e70 0x7f3c0c0b09b0 secure :-1 s=READY pgs=258 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c0c062050 tx=0x7f3c00007810 comp rx=0 tx=0).stop 2026-02-23T06:23:43.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.304+0000 7f3be67fc640 1 -- 10.20.193.58:0/3202090304 shutdown_connections 2026-02-23T06:23:43.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.304+0000 7f3be67fc640 1 --2- 10.20.193.58:0/3202090304 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3bdc07a780 0x7f3bdc09ac30 unknown :-1 s=CLOSED pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:43.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.304+0000 7f3be67fc640 1 --2- 10.20.193.58:0/3202090304 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c0c161e70 0x7f3c0c0b09b0 unknown :-1 s=CLOSED pgs=258 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:43.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.304+0000 7f3be67fc640 1 --2- 10.20.193.58:0/3202090304 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3c0c1648a0 0x7f3c0c161930 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:43.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.304+0000 7f3be67fc640 1 --2- 10.20.193.58:0/3202090304 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3bf0003ad0 0x7f3c0c164360 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:43.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.304+0000 7f3be67fc640 1 -- 10.20.193.58:0/3202090304 >> 10.20.193.58:0/3202090304 conn(0x7f3c0c0b3c20 msgr2=0x7f3c0c15ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:43.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.304+0000 7f3be67fc640 1 -- 10.20.193.58:0/3202090304 shutdown_connections 2026-02-23T06:23:43.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:43.304+0000 7f3be67fc640 1 -- 10.20.193.58:0/3202090304 wait complete. 2026-02-23T06:23:46.312 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:23:46.441 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.446+0000 7f6176104640 1 -- 10.20.193.58:0/3334378804 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f617015d870 msgr2=0x7f61700587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:46.442 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.446+0000 7f6176104640 1 --2- 10.20.193.58:0/3334378804 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f617015d870 0x7f61700587b0 secure :-1 s=READY pgs=260 gs=3 cs=0 l=1 c_cookie=10656958302642583713 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6164004740 tx=0x7f616402f230 comp rx=0 tx=0).stop 2026-02-23T06:23:46.442 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.446+0000 7f6176104640 1 -- 10.20.193.58:0/3334378804 shutdown_connections 2026-02-23T06:23:46.442 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.446+0000 7f6176104640 1 --2- 10.20.193.58:0/3334378804 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f617015d870 0x7f61700587b0 unknown :-1 s=CLOSED pgs=260 gs=3 cs=0 l=1 c_cookie=10656958302642583713 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:46.442 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.446+0000 7f6176104640 1 -- 10.20.193.58:0/3334378804 >> 10.20.193.58:0/3334378804 conn(0x7f61700b3c20 msgr2=0x7f61700b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:46.442 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.446+0000 7f6176104640 1 -- 10.20.193.58:0/3334378804 shutdown_connections 2026-02-23T06:23:46.442 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.446+0000 7f6176104640 1 -- 10.20.193.58:0/3334378804 wait complete. 2026-02-23T06:23:46.446 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.447+0000 7f6176104640 1 Processor -- start 2026-02-23T06:23:46.446 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.448+0000 7f6176104640 1 -- start start 2026-02-23T06:23:46.446 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.448+0000 7f6176104640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61700b6690 0x7f617013e550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:46.446 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.448+0000 7f6176104640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f617015d4a0 0x7f617014d8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:46.446 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.448+0000 7f6176104640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f617015d870 0x7f617014de10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:46.446 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.448+0000 7f6176104640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f617011e8e0 con 0x7f61700b6690 2026-02-23T06:23:46.447 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.448+0000 7f6176104640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f6170057550 con 0x7f617015d4a0 2026-02-23T06:23:46.447 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.448+0000 7f6176104640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f617014d440 con 0x7f617015d870 2026-02-23T06:23:46.447 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.448+0000 7f6175102640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61700b6690 0x7f617013e550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:46.447 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.448+0000 7f6175102640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61700b6690 0x7f617013e550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:52282/0 (socket says 10.20.193.58:52282) 2026-02-23T06:23:46.447 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.448+0000 7f6175102640 1 -- 10.20.193.58:0/488493031 learned_addr learned my addr 10.20.193.58:0/488493031 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:23:46.447 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.448+0000 7f6174901640 1 --2- 10.20.193.58:0/488493031 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f617015d4a0 0x7f617014d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:46.447 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.448+0000 7f6175102640 1 -- 10.20.193.58:0/488493031 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f617015d870 msgr2=0x7f617014de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:46.447 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.448+0000 7f6175102640 1 --2- 10.20.193.58:0/488493031 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f617015d870 0x7f617014de10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:46.447 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.448+0000 7f6175102640 1 -- 10.20.193.58:0/488493031 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f617015d4a0 msgr2=0x7f617014d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:46.447 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.448+0000 7f6175102640 1 --2- 10.20.193.58:0/488493031 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f617015d4a0 0x7f617014d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:46.447 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.448+0000 7f6175102640 1 -- 10.20.193.58:0/488493031 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61640094b0 con 0x7f61700b6690 2026-02-23T06:23:46.448 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.449+0000 7f6175102640 1 --2- 10.20.193.58:0/488493031 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61700b6690 0x7f617013e550 secure :-1 s=READY pgs=261 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6160007fd0 tx=0x7f616000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:46.448 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.449+0000 7f615dffb640 1 -- 10.20.193.58:0/488493031 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f616000a800 con 0x7f61700b6690 2026-02-23T06:23:46.448 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.449+0000 7f615dffb640 1 -- 10.20.193.58:0/488493031 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f616000aa50 con 0x7f61700b6690 2026-02-23T06:23:46.448 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.449+0000 7f615dffb640 1 -- 10.20.193.58:0/488493031 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f616000ae40 con 0x7f61700b6690 2026-02-23T06:23:46.448 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.449+0000 7f6176104640 1 -- 10.20.193.58:0/488493031 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f617011eb10 con 0x7f61700b6690 2026-02-23T06:23:46.449 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.449+0000 7f6176104640 1 -- 10.20.193.58:0/488493031 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6170057af0 con 0x7f61700b6690 2026-02-23T06:23:46.449 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.449+0000 7f6176104640 1 -- 10.20.193.58:0/488493031 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61700b6d50 con 0x7f61700b6690 2026-02-23T06:23:46.449 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.451+0000 7f615dffb640 1 -- 10.20.193.58:0/488493031 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f616001b400 con 0x7f61700b6690 2026-02-23T06:23:46.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.452+0000 7f615dffb640 1 --2- 10.20.193.58:0/488493031 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f614007a6c0 0x7f614009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:46.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.452+0000 7f615dffb640 1 -- 10.20.193.58:0/488493031 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f616009d7c0 con 0x7f61700b6690 2026-02-23T06:23:46.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.452+0000 7f6174901640 1 --2- 10.20.193.58:0/488493031 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f614007a6c0 0x7f614009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:46.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.453+0000 7f6174901640 1 --2- 10.20.193.58:0/488493031 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f614007a6c0 0x7f614009ab70 secure :-1 s=READY pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61640097e0 tx=0x7f6164031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:46.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.454+0000 7f615dffb640 1 -- 10.20.193.58:0/488493031 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f61600608d0 con 0x7f61700b6690 2026-02-23T06:23:46.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.609+0000 7f6176104640 1 -- 10.20.193.58:0/488493031 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f61700b06c0 con 0x7f61700b6690 2026-02-23T06:23:46.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.610+0000 7f615dffb640 1 -- 10.20.193.58:0/488493031 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1754 (secure 0 0 0) 0x7f61700b06c0 con 0x7f61700b6690 2026-02-23T06:23:46.605 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:23:46.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.612+0000 7f6176104640 1 -- 10.20.193.58:0/488493031 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f614007a6c0 msgr2=0x7f614009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:46.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.612+0000 7f6176104640 1 --2- 10.20.193.58:0/488493031 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f614007a6c0 0x7f614009ab70 secure :-1 s=READY pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61640097e0 tx=0x7f6164031040 comp rx=0 tx=0).stop 2026-02-23T06:23:46.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.612+0000 7f6176104640 1 -- 10.20.193.58:0/488493031 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61700b6690 msgr2=0x7f617013e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:46.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.612+0000 7f6176104640 1 --2- 10.20.193.58:0/488493031 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61700b6690 0x7f617013e550 secure :-1 s=READY pgs=261 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6160007fd0 tx=0x7f616000cba0 comp rx=0 tx=0).stop 2026-02-23T06:23:46.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.612+0000 7f6176104640 1 -- 10.20.193.58:0/488493031 shutdown_connections 2026-02-23T06:23:46.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.612+0000 7f6176104640 1 --2- 10.20.193.58:0/488493031 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f614007a6c0 0x7f614009ab70 unknown :-1 s=CLOSED pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:46.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.612+0000 7f6176104640 1 --2- 10.20.193.58:0/488493031 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f617015d870 0x7f617014de10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:46.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.612+0000 7f6176104640 1 --2- 10.20.193.58:0/488493031 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f617015d4a0 0x7f617014d8d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:46.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.612+0000 7f6176104640 1 --2- 10.20.193.58:0/488493031 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61700b6690 0x7f617013e550 unknown :-1 s=CLOSED pgs=261 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:46.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.612+0000 7f6176104640 1 -- 10.20.193.58:0/488493031 >> 10.20.193.58:0/488493031 conn(0x7f61700b3c20 msgr2=0x7f617005d100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:46.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.612+0000 7f6176104640 1 -- 10.20.193.58:0/488493031 shutdown_connections 2026-02-23T06:23:46.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.612+0000 7f6176104640 1 -- 10.20.193.58:0/488493031 wait complete. 2026-02-23T06:23:46.619 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:23:46.619 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:23:46.619 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:23:46.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.746+0000 7f6c63fff640 1 -- 10.20.193.58:0/3152019626 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c68004420 con 0x7f6c7415d870 2026-02-23T06:23:46.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.746+0000 7f6c7a483640 1 -- 10.20.193.58:0/3152019626 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6c7415d870 msgr2=0x7f6c740587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:46.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.746+0000 7f6c7a483640 1 --2- 10.20.193.58:0/3152019626 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6c7415d870 0x7f6c740587b0 secure :-1 s=READY pgs=9 gs=3 cs=0 l=1 c_cookie=14875614457539108569 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c68009890 tx=0x7f6c6802f200 comp rx=0 tx=0).stop 2026-02-23T06:23:46.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.746+0000 7f6c7a483640 1 -- 10.20.193.58:0/3152019626 shutdown_connections 2026-02-23T06:23:46.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.747+0000 7f6c7a483640 1 --2- 10.20.193.58:0/3152019626 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6c7415d870 0x7f6c740587b0 unknown :-1 s=CLOSED pgs=9 gs=3 cs=0 l=1 c_cookie=14875614457539108569 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:46.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.747+0000 7f6c7a483640 1 -- 10.20.193.58:0/3152019626 >> 10.20.193.58:0/3152019626 conn(0x7f6c740b3c20 msgr2=0x7f6c740b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:46.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.747+0000 7f6c7a483640 1 -- 10.20.193.58:0/3152019626 shutdown_connections 2026-02-23T06:23:46.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.747+0000 7f6c7a483640 1 -- 10.20.193.58:0/3152019626 wait complete. 2026-02-23T06:23:46.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.748+0000 7f6c7a483640 1 Processor -- start 2026-02-23T06:23:46.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.748+0000 7f6c7a483640 1 -- start start 2026-02-23T06:23:46.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.748+0000 7f6c7a483640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6c740b6690 0x7f6c74056f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:46.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.748+0000 7f6c7a483640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6c7415d4a0 0x7f6c74166d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:46.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.748+0000 7f6c7a483640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6c7415d870 0x7f6c74057bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:46.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.748+0000 7f6c7a483640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f6c74056cd0 con 0x7f6c7415d4a0 2026-02-23T06:23:46.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.748+0000 7f6c7a483640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f6c74057900 con 0x7f6c740b6690 2026-02-23T06:23:46.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.748+0000 7f6c7a483640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f6c7411b540 con 0x7f6c7415d870 2026-02-23T06:23:46.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.749+0000 7f6c79481640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6c740b6690 0x7f6c74056f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:46.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.749+0000 7f6c79481640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6c740b6690 0x7f6c74056f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:47946/0 (socket says 10.20.193.58:47946) 2026-02-23T06:23:46.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.749+0000 7f6c79481640 1 -- 10.20.193.58:0/3725279183 learned_addr learned my addr 10.20.193.58:0/3725279183 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:23:46.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.749+0000 7f6c78c80640 1 --2- 10.20.193.58:0/3725279183 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6c7415d4a0 0x7f6c74166d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:46.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.749+0000 7f6c79c82640 1 --2- 10.20.193.58:0/3725279183 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6c7415d870 0x7f6c74057bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:46.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.749+0000 7f6c79481640 1 -- 10.20.193.58:0/3725279183 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6c7415d870 msgr2=0x7f6c74057bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:46.748 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.749+0000 7f6c79481640 1 --2- 10.20.193.58:0/3725279183 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6c7415d870 0x7f6c74057bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:46.748 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.749+0000 7f6c79481640 1 -- 10.20.193.58:0/3725279183 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6c7415d4a0 msgr2=0x7f6c74166d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:46.748 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.749+0000 7f6c79481640 1 --2- 10.20.193.58:0/3725279183 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6c7415d4a0 0x7f6c74166d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:46.748 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.749+0000 7f6c79481640 1 -- 10.20.193.58:0/3725279183 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c680094b0 con 0x7f6c740b6690 2026-02-23T06:23:46.748 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.749+0000 7f6c79481640 1 --2- 10.20.193.58:0/3725279183 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6c740b6690 0x7f6c74056f00 secure :-1 s=READY pgs=244 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c64007fd0 tx=0x7f6c6400c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:46.748 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.749+0000 7f6c61ffb640 1 -- 10.20.193.58:0/3725279183 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c64006b70 con 0x7f6c740b6690 2026-02-23T06:23:46.748 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.749+0000 7f6c61ffb640 1 -- 10.20.193.58:0/3725279183 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c64006dc0 con 0x7f6c740b6690 2026-02-23T06:23:46.748 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.749+0000 7f6c61ffb640 1 -- 10.20.193.58:0/3725279183 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c640072a0 con 0x7f6c740b6690 2026-02-23T06:23:46.748 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.749+0000 7f6c7a483640 1 -- 10.20.193.58:0/3725279183 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c7411b9d0 con 0x7f6c740b6690 2026-02-23T06:23:46.748 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.750+0000 7f6c7a483640 1 -- 10.20.193.58:0/3725279183 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c7411aba0 con 0x7f6c740b6690 2026-02-23T06:23:46.748 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.750+0000 7f6c7a483640 1 --2- 10.20.193.58:0/3725279183 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6c740561f0 0x7f6c7411ad90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:46.749 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.750+0000 7f6c7a483640 1 -- 10.20.193.58:0/3725279183 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f6c740565c0 con 0x7f6c740561f0 2026-02-23T06:23:46.749 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.750+0000 7f6c78c80640 1 --2- 10.20.193.58:0/3725279183 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6c740561f0 0x7f6c7411ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:46.749 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.750+0000 7f6c78c80640 1 -- 10.20.193.58:0/3725279183 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6c740b5e10 con 0x7f6c740561f0 2026-02-23T06:23:46.749 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.751+0000 7f6c78c80640 1 --2- 10.20.193.58:0/3725279183 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6c740561f0 0x7f6c7411ad90 secure :-1 s=READY pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c68009230 tx=0x7f6c68005df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:46.749 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.751+0000 7f6c61ffb640 1 -- 10.20.193.58:0/3725279183 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c68047070 con 0x7f6c740561f0 2026-02-23T06:23:46.749 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.751+0000 7f6c61ffb640 1 -- 10.20.193.58:0/3725279183 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f6c6803e040 con 0x7f6c740561f0 2026-02-23T06:23:46.749 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.751+0000 7f6c61ffb640 1 -- 10.20.193.58:0/3725279183 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6c740561f0 msgr2=0x7f6c7411ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:46.749 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.751+0000 7f6c61ffb640 1 --2- 10.20.193.58:0/3725279183 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6c740561f0 0x7f6c7411ad90 secure :-1 s=READY pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c68009230 tx=0x7f6c68005df0 comp rx=0 tx=0).stop 2026-02-23T06:23:46.749 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.751+0000 7f6c61ffb640 1 -- 10.20.193.58:0/3725279183 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6c740561f0 msgr2=0x7f6c7411ad90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:23:46.749 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.751+0000 7f6c61ffb640 1 --2- 10.20.193.58:0/3725279183 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6c740561f0 0x7f6c7411ad90 unknown :-1 s=CLOSED pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:46.749 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.751+0000 7f6c61ffb640 1 -- 10.20.193.58:0/3725279183 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f6c64007400 con 0x7f6c740b6690 2026-02-23T06:23:46.751 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.752+0000 7f6c61ffb640 1 --2- 10.20.193.58:0/3725279183 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6c4407a3c0 0x7f6c4409a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:46.751 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.752+0000 7f6c61ffb640 1 -- 10.20.193.58:0/3725279183 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f6c6409d6a0 con 0x7f6c740b6690 2026-02-23T06:23:46.751 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.754+0000 7f6c78c80640 1 --2- 10.20.193.58:0/3725279183 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6c4407a3c0 0x7f6c4409a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:46.751 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.754+0000 7f6c78c80640 1 --2- 10.20.193.58:0/3725279183 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6c4407a3c0 0x7f6c4409a870 secure :-1 s=READY pgs=144 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c68009230 tx=0x7f6c68042000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:46.751 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.755+0000 7f6c7a483640 1 --2- 10.20.193.58:0/3725279183 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6c7411e810 0x7f6c7411ebe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:46.752 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.755+0000 7f6c7a483640 1 -- 10.20.193.58:0/3725279183 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f6c740b6330 con 0x7f6c7411e810 2026-02-23T06:23:46.752 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.755+0000 7f6c79c82640 1 --2- 10.20.193.58:0/3725279183 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6c7411e810 0x7f6c7411ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:46.752 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.756+0000 7f6c79c82640 1 -- 10.20.193.58:0/3725279183 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6c7411b680 con 0x7f6c7411e810 2026-02-23T06:23:46.752 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.756+0000 7f6c79c82640 1 --2- 10.20.193.58:0/3725279183 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6c7411e810 0x7f6c7411ebe0 secure :-1 s=READY pgs=264 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c70003780 tx=0x7f6c7000ff10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:46.752 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.756+0000 7f6c61ffb640 1 -- 10.20.193.58:0/3725279183 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c70019070 con 0x7f6c7411e810 2026-02-23T06:23:46.752 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.756+0000 7f6c61ffb640 1 -- 10.20.193.58:0/3725279183 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5247 (secure 0 0 0) 0x7f6c7000db50 con 0x7f6c7411e810 2026-02-23T06:23:46.752 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.756+0000 7f6c61ffb640 1 -- 10.20.193.58:0/3725279183 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6c7411e810 msgr2=0x7f6c7411ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:46.752 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.756+0000 7f6c61ffb640 1 --2- 10.20.193.58:0/3725279183 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6c7411e810 0x7f6c7411ebe0 secure :-1 s=READY pgs=264 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c70003780 tx=0x7f6c7000ff10 comp rx=0 tx=0).stop 2026-02-23T06:23:46.752 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.756+0000 7f6c61ffb640 1 -- 10.20.193.58:0/3725279183 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6c7411e810 msgr2=0x7f6c7411ebe0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:23:46.752 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.756+0000 7f6c61ffb640 1 --2- 10.20.193.58:0/3725279183 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6c7411e810 0x7f6c7411ebe0 unknown :-1 s=CLOSED pgs=264 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:46.753 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:23:46.753 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:23:46.753 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:23:46.753 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:23:46.753 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 20, 2026-02-23T06:23:46.753 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 164766, 2026-02-23T06:23:46.753 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:23:46.753 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:23:46.754 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:23:46.754 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:23:46.754 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:46.754 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 1, 2026-02-23T06:23:46.754 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:23:46.754 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:23:46.754 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:23:46.754 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:23:46.754 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:23:46.754 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:23:46.754 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:23:46.755 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:23:46.755 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:23:46.755 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:23:46.755 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:23:46.755 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:23:46.755 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:23:46.755 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:23:46.755 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:23:46.755 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:23:46.756 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:46.756 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:23:46.756 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:23:46.756 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:23:46.756 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:23:46.756 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:23:46.756 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:23:46.756 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:23:46.756 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:23:46.756 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:23:46.757 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:23:46.757 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:23:46.757 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:23:46.757 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:23:46.757 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:23:46.757 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:23:46.757 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:46.757 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:46.757 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:23:46.757 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:23:46.758 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:23:46.758 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:23:46.758 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:23:46.758 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:23:46.758 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:23:46.758 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:23:46.758 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:23:46.758 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:23:46.758 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:23:46.758 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:23:46.759 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:23:46.759 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:23:46.759 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:23:46.759 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:23:46.759 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:23:46.759 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:23:46.759 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:23:46.759 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:23:46.759 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:23:46.759 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:23:46.760 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:23:46.760 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:23:46.760 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:23:46.760 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:23:46.760 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:23:46.760 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:23:46.760 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:23:46.760 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:23:46.760 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:46.760 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:23:46.761 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:46.761 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:23:46.761 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:46.761 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:23:46.761 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:23:46.761 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:23:46.761 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:23:46.761 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:46.761 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:23:46.761 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:23:46.761 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:46.762 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:46.762 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:46.762 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:23:46.762 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:23:46.762 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:46.762 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:46.762 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:46.762 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:46.762 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:23:46.762 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:23:46.763 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:23:46.763 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:23:46.763 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:23:46.763 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:23:46.763 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:46.763 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:46.763 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:23:46.763 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:23:46.763 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:23:46.763 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:23:46.763 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:46.764 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:23:46.764 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:23:46.764 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:46.764 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:46.764 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:46.764 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:23:46.764 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:23:46.764 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:46.764 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:46.764 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:46.764 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:46.764 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:23:46.764 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:23:46.765 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:23:46.765 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:23:46.765 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:23:46.765 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:23:46.765 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:46.765 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:46.765 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:23:46.765 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:23:46.765 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:23:46.766 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:23:46.766 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:46.766 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:23:46.766 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:23:46.766 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:46.766 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:46.766 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:46.766 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:23:46.766 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:23:46.766 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:46.767 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:46.767 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:46.767 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:46.767 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:23:46.767 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:23:46.767 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:23:46.767 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:23:46.767 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:23:46.767 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:23:46.767 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:46.767 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:46.768 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:46.768 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:23:46.768 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:23:46.768 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:46.768 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:46.768 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:46.768 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:23:46.768 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:46.768 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:46.768 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:23:46.769 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:46.769 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:46.769 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:46.769 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:23:46.769 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:46.769 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:46.769 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:23:46.769 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:46.769 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:46.769 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:46.770 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:23:46.770 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:46.770 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:46.770 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:23:46.770 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:46.770 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:46.770 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:46.770 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:23:46.770 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:46.770 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:46.770 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:46.771 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:23:46.771 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:23:46.773 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.756+0000 7f6c7a483640 1 -- 10.20.193.58:0/3725279183 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6c4407a3c0 msgr2=0x7f6c4409a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:46.773 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.756+0000 7f6c7a483640 1 --2- 10.20.193.58:0/3725279183 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6c4407a3c0 0x7f6c4409a870 secure :-1 s=READY pgs=144 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c68009230 tx=0x7f6c68042000 comp rx=0 tx=0).stop 2026-02-23T06:23:46.773 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.756+0000 7f6c79c82640 1 -- 10.20.193.58:0/3725279183 reap_dead start 2026-02-23T06:23:46.773 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.756+0000 7f6c7a483640 1 -- 10.20.193.58:0/3725279183 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6c740b6690 msgr2=0x7f6c74056f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:46.773 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.756+0000 7f6c7a483640 1 --2- 10.20.193.58:0/3725279183 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6c740b6690 0x7f6c74056f00 secure :-1 s=READY pgs=244 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c64007fd0 tx=0x7f6c6400c990 comp rx=0 tx=0).stop 2026-02-23T06:23:46.773 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.756+0000 7f6c79c82640 1 -- 10.20.193.58:0/3725279183 reap_dead start 2026-02-23T06:23:46.773 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.756+0000 7f6c7a483640 1 -- 10.20.193.58:0/3725279183 shutdown_connections 2026-02-23T06:23:46.774 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.756+0000 7f6c7a483640 1 -- 10.20.193.58:0/3725279183 >> 10.20.193.58:0/3725279183 conn(0x7f6c740b3c20 msgr2=0x7f6c7413c400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:46.774 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.756+0000 7f6c7a483640 1 -- 10.20.193.58:0/3725279183 shutdown_connections 2026-02-23T06:23:46.774 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.756+0000 7f6c7a483640 1 -- 10.20.193.58:0/3725279183 wait complete. 2026-02-23T06:23:46.775 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:23:46.775 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:23:46.775 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:23:46.897 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.901+0000 7f3b29744640 1 -- 10.20.193.58:0/447241001 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3b2415d870 msgr2=0x7f3b240587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:46.897 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.901+0000 7f3b29744640 1 --2- 10.20.193.58:0/447241001 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3b2415d870 0x7f3b240587b0 secure :-1 s=READY pgs=266 gs=3 cs=0 l=1 c_cookie=7992252038625963773 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b14004740 tx=0x7f3b1402f230 comp rx=0 tx=0).stop 2026-02-23T06:23:46.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.901+0000 7f3b29744640 1 -- 10.20.193.58:0/447241001 shutdown_connections 2026-02-23T06:23:46.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.901+0000 7f3b29744640 1 --2- 10.20.193.58:0/447241001 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3b2415d870 0x7f3b240587b0 unknown :-1 s=CLOSED pgs=266 gs=3 cs=0 l=1 c_cookie=7992252038625963773 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:46.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.901+0000 7f3b29744640 1 -- 10.20.193.58:0/447241001 >> 10.20.193.58:0/447241001 conn(0x7f3b240b3c20 msgr2=0x7f3b240b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:46.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.902+0000 7f3b29744640 1 -- 10.20.193.58:0/447241001 shutdown_connections 2026-02-23T06:23:46.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.902+0000 7f3b29744640 1 -- 10.20.193.58:0/447241001 wait complete. 2026-02-23T06:23:46.901 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.903+0000 7f3b29744640 1 Processor -- start 2026-02-23T06:23:46.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.903+0000 7f3b29744640 1 -- start start 2026-02-23T06:23:46.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.904+0000 7f3b29744640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3b240b6690 0x7f3b24162340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:46.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.904+0000 7f3b29744640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3b2415d4a0 0x7f3b2415fe30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:46.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.904+0000 7f3b29744640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3b2415d870 0x7f3b24160370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:46.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.904+0000 7f3b29744640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f3b24140340 con 0x7f3b2415d870 2026-02-23T06:23:46.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.904+0000 7f3b29744640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f3b240aea30 con 0x7f3b2415d4a0 2026-02-23T06:23:46.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.904+0000 7f3b29744640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f3b240ae790 con 0x7f3b240b6690 2026-02-23T06:23:46.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.904+0000 7f3b28f43640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3b2415d870 0x7f3b24160370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:46.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.904+0000 7f3b28f43640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3b2415d870 0x7f3b24160370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:52324/0 (socket says 10.20.193.58:52324) 2026-02-23T06:23:46.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.904+0000 7f3b28f43640 1 -- 10.20.193.58:0/222008925 learned_addr learned my addr 10.20.193.58:0/222008925 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:23:46.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.904+0000 7f3b23fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3b240b6690 0x7f3b24162340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:46.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.904+0000 7f3b237fe640 1 --2- 10.20.193.58:0/222008925 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3b2415d4a0 0x7f3b2415fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:46.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.904+0000 7f3b28f43640 1 -- 10.20.193.58:0/222008925 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3b240b6690 msgr2=0x7f3b24162340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:46.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.904+0000 7f3b28f43640 1 --2- 10.20.193.58:0/222008925 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3b240b6690 0x7f3b24162340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:46.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.904+0000 7f3b28f43640 1 -- 10.20.193.58:0/222008925 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3b2415d4a0 msgr2=0x7f3b2415fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:46.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.904+0000 7f3b28f43640 1 --2- 10.20.193.58:0/222008925 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3b2415d4a0 0x7f3b2415fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:46.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.904+0000 7f3b28f43640 1 -- 10.20.193.58:0/222008925 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b140094b0 con 0x7f3b2415d870 2026-02-23T06:23:46.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.904+0000 7f3b237fe640 1 --2- 10.20.193.58:0/222008925 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3b2415d4a0 0x7f3b2415fe30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:23:46.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.904+0000 7f3b28f43640 1 --2- 10.20.193.58:0/222008925 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3b2415d870 0x7f3b24160370 secure :-1 s=READY pgs=267 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b1800d730 tx=0x7f3b1800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:46.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.905+0000 7f3b20ff9640 1 -- 10.20.193.58:0/222008925 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b18007b90 con 0x7f3b2415d870 2026-02-23T06:23:46.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.905+0000 7f3b20ff9640 1 -- 10.20.193.58:0/222008925 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b18007de0 con 0x7f3b2415d870 2026-02-23T06:23:46.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.905+0000 7f3b29744640 1 -- 10.20.193.58:0/222008925 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b2413b7e0 con 0x7f3b2415d870 2026-02-23T06:23:46.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.905+0000 7f3b20ff9640 1 -- 10.20.193.58:0/222008925 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b18006280 con 0x7f3b2415d870 2026-02-23T06:23:46.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.905+0000 7f3b29744640 1 -- 10.20.193.58:0/222008925 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b2415f910 con 0x7f3b2415d870 2026-02-23T06:23:46.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.905+0000 7f3afe7fc640 1 --2- 10.20.193.58:0/222008925 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3b24201fb0 0x7f3b24160f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:46.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.905+0000 7f3afe7fc640 1 -- 10.20.193.58:0/222008925 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2415f790 con 0x7f3b24201fb0 2026-02-23T06:23:46.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.905+0000 7f3b23fff640 1 --2- 10.20.193.58:0/222008925 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3b24201fb0 0x7f3b24160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:46.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.906+0000 7f3b23fff640 1 -- 10.20.193.58:0/222008925 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b240b5e10 con 0x7f3b24201fb0 2026-02-23T06:23:46.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.906+0000 7f3b23fff640 1 --2- 10.20.193.58:0/222008925 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3b24201fb0 0x7f3b24160f90 secure :-1 s=READY pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b10007fd0 tx=0x7f3b1000fc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:46.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.906+0000 7f3b20ff9640 1 -- 10.20.193.58:0/222008925 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b1000db00 con 0x7f3b24201fb0 2026-02-23T06:23:46.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.906+0000 7f3b20ff9640 1 -- 10.20.193.58:0/222008925 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f3b1000fe10 con 0x7f3b24201fb0 2026-02-23T06:23:46.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.906+0000 7f3b20ff9640 1 -- 10.20.193.58:0/222008925 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3b24201fb0 msgr2=0x7f3b24160f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:46.905 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.906+0000 7f3b20ff9640 1 --2- 10.20.193.58:0/222008925 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3b24201fb0 0x7f3b24160f90 secure :-1 s=READY pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b10007fd0 tx=0x7f3b1000fc10 comp rx=0 tx=0).stop 2026-02-23T06:23:46.905 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.906+0000 7f3b20ff9640 1 -- 10.20.193.58:0/222008925 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3b24201fb0 msgr2=0x7f3b24160f90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:23:46.905 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.906+0000 7f3b20ff9640 1 --2- 10.20.193.58:0/222008925 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3b24201fb0 0x7f3b24160f90 unknown :-1 s=CLOSED pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:46.905 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.906+0000 7f3b20ff9640 1 -- 10.20.193.58:0/222008925 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f3b1801a030 con 0x7f3b2415d870 2026-02-23T06:23:46.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.907+0000 7f3b20ff9640 1 --2- 10.20.193.58:0/222008925 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3af407a3c0 0x7f3af409a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:46.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.907+0000 7f3b20ff9640 1 -- 10.20.193.58:0/222008925 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f3b1809da20 con 0x7f3b2415d870 2026-02-23T06:23:46.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.908+0000 7f3b23fff640 1 --2- 10.20.193.58:0/222008925 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3af407a3c0 0x7f3af409a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:46.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.908+0000 7f3b23fff640 1 --2- 10.20.193.58:0/222008925 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3af407a3c0 0x7f3af409a870 secure :-1 s=READY pgs=145 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b10007fd0 tx=0x7f3b10009030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:46.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.910+0000 7f3afe7fc640 1 --2- 10.20.193.58:0/222008925 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3b24202380 0x7f3b241614d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:46.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.910+0000 7f3afe7fc640 1 -- 10.20.193.58:0/222008925 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f3b240b6330 con 0x7f3b24202380 2026-02-23T06:23:46.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.910+0000 7f3b237fe640 1 --2- 10.20.193.58:0/222008925 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3b24202380 0x7f3b241614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:46.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.910+0000 7f3b237fe640 1 -- 10.20.193.58:0/222008925 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3b240b6d50 con 0x7f3b24202380 2026-02-23T06:23:46.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.910+0000 7f3b237fe640 1 --2- 10.20.193.58:0/222008925 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3b24202380 0x7f3b241614d0 secure :-1 s=READY pgs=247 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b14004740 tx=0x7f3b140028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:46.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.911+0000 7f3b20ff9640 1 -- 10.20.193.58:0/222008925 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b14046070 con 0x7f3b24202380 2026-02-23T06:23:46.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.911+0000 7f3b20ff9640 1 -- 10.20.193.58:0/222008925 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5555 (secure 0 0 0) 0x7f3b1403e040 con 0x7f3b24202380 2026-02-23T06:23:46.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.911+0000 7f3b20ff9640 1 -- 10.20.193.58:0/222008925 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3b24202380 msgr2=0x7f3b241614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:46.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.911+0000 7f3b20ff9640 1 --2- 10.20.193.58:0/222008925 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3b24202380 0x7f3b241614d0 secure :-1 s=READY pgs=247 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b14004740 tx=0x7f3b140028d0 comp rx=0 tx=0).stop 2026-02-23T06:23:46.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.911+0000 7f3b20ff9640 1 -- 10.20.193.58:0/222008925 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3b24202380 msgr2=0x7f3b241614d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:23:46.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.911+0000 7f3b20ff9640 1 --2- 10.20.193.58:0/222008925 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3b24202380 0x7f3b241614d0 unknown :-1 s=CLOSED pgs=247 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:46.909 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:23:46.909 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:23:46.909 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:23:46.910 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:23:46.910 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 20, 2026-02-23T06:23:46.910 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 164958, 2026-02-23T06:23:46.910 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:23:46.910 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:23:46.910 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:23:46.910 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:23:46.910 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:46.910 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 1, 2026-02-23T06:23:46.910 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:23:46.910 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:23:46.911 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:23:46.911 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:23:46.911 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:23:46.911 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:23:46.911 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:23:46.911 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:23:46.911 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:23:46.911 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:23:46.911 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:23:46.911 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:23:46.911 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:23:46.912 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:23:46.912 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:23:46.912 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:23:46.912 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:46.912 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:23:46.912 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:23:46.912 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:23:46.912 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:23:46.912 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:23:46.912 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:23:46.912 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:23:46.913 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:23:46.913 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:23:46.913 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:23:46.913 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:23:46.913 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:23:46.913 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:23:46.913 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:23:46.913 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:23:46.913 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:46.913 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:46.913 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:23:46.913 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:23:46.914 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:23:46.914 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:23:46.914 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:23:46.914 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:23:46.914 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:23:46.914 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:23:46.914 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:23:46.914 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:23:46.914 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:23:46.914 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:23:46.914 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:23:46.915 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:23:46.915 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:23:46.915 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:23:46.915 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:23:46.915 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:23:46.915 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:23:46.915 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:23:46.915 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:23:46.915 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:23:46.915 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:23:46.915 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:23:46.915 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:23:46.916 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:23:46.916 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:23:46.916 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:23:46.916 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:23:46.916 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:23:46.916 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:46.916 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:23:46.916 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:46.916 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:23:46.916 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:46.916 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:23:46.916 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:23:46.917 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:23:46.917 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:23:46.917 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:46.917 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:23:46.917 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:23:46.917 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:46.917 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:46.917 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:46.917 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:23:46.917 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:23:46.918 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:46.918 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:46.918 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:46.918 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:46.918 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:23:46.918 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:23:46.918 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:23:46.918 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:23:46.918 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:23:46.918 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:23:46.919 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:46.919 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:46.919 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:23:46.919 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:23:46.919 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:23:46.919 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:23:46.919 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:46.919 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:23:46.919 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:23:46.919 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:46.919 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:46.920 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:46.920 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:23:46.920 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:23:46.920 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:46.920 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:46.920 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:46.920 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:46.920 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:23:46.920 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:23:46.920 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:23:46.921 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:23:46.921 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:23:46.921 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:23:46.921 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:46.921 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:46.921 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:23:46.921 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:23:46.922 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:23:46.922 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:23:46.922 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:46.922 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:23:46.922 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:23:46.922 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:46.922 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:46.922 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:46.922 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:23:46.923 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:23:46.923 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:46.923 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:46.923 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:46.923 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:46.923 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:23:46.923 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:23:46.923 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:23:46.923 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:23:46.923 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:23:46.924 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:23:46.924 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:46.924 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:46.924 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:46.924 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:23:46.924 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:23:46.924 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:46.924 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:46.924 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:46.924 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:23:46.925 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:46.925 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:46.925 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:23:46.925 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:46.925 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:46.925 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:46.925 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:23:46.925 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:46.925 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:46.925 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:23:46.926 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:46.926 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:46.926 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:46.926 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:23:46.926 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:46.926 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:46.926 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:23:46.926 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:46.926 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:23:46.926 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:23:46.926 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:23:46.927 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:46.927 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:46.927 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:46.927 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:46.927 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:23:46.927 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:46.927 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:46.927 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:23:46.927 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:46.928 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:46.928 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:46.928 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:23:46.928 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:46.928 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:46.928 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:46.928 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:23:46.928 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:23:46.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.911+0000 7f3afe7fc640 1 -- 10.20.193.58:0/222008925 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3af407a3c0 msgr2=0x7f3af409a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:46.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.911+0000 7f3afe7fc640 1 --2- 10.20.193.58:0/222008925 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3af407a3c0 0x7f3af409a870 secure :-1 s=READY pgs=145 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b10007fd0 tx=0x7f3b10009030 comp rx=0 tx=0).stop 2026-02-23T06:23:46.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.911+0000 7f3afe7fc640 1 -- 10.20.193.58:0/222008925 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3b2415d870 msgr2=0x7f3b24160370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:46.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.911+0000 7f3afe7fc640 1 --2- 10.20.193.58:0/222008925 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3b2415d870 0x7f3b24160370 secure :-1 s=READY pgs=267 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b1800d730 tx=0x7f3b1800dc00 comp rx=0 tx=0).stop 2026-02-23T06:23:46.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.911+0000 7f3b28f43640 1 -- 10.20.193.58:0/222008925 reap_dead start 2026-02-23T06:23:46.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.911+0000 7f3b28f43640 1 -- 10.20.193.58:0/222008925 reap_dead start 2026-02-23T06:23:46.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.911+0000 7f3afe7fc640 1 -- 10.20.193.58:0/222008925 shutdown_connections 2026-02-23T06:23:46.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.911+0000 7f3afe7fc640 1 -- 10.20.193.58:0/222008925 >> 10.20.193.58:0/222008925 conn(0x7f3b240b3c20 msgr2=0x7f3b240585b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:46.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.911+0000 7f3afe7fc640 1 -- 10.20.193.58:0/222008925 shutdown_connections 2026-02-23T06:23:46.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:46.911+0000 7f3afe7fc640 1 -- 10.20.193.58:0/222008925 wait complete. 2026-02-23T06:23:46.932 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:23:46.932 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:23:46.932 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:23:47.053 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.058+0000 7fcf11483640 1 -- 10.20.193.58:0/435591366 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcf0c0b5d90 msgr2=0x7fcf0c15bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:47.054 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.058+0000 7fcf11483640 1 --2- 10.20.193.58:0/435591366 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcf0c0b5d90 0x7fcf0c15bea0 secure :-1 s=READY pgs=10 gs=3 cs=0 l=1 c_cookie=9659623170968216572 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf0000a970 tx=0x7fcf00030260 comp rx=0 tx=0).stop 2026-02-23T06:23:47.054 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.058+0000 7fcf11483640 1 -- 10.20.193.58:0/435591366 shutdown_connections 2026-02-23T06:23:47.054 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.058+0000 7fcf11483640 1 --2- 10.20.193.58:0/435591366 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcf0c0b5d90 0x7fcf0c15bea0 unknown :-1 s=CLOSED pgs=10 gs=3 cs=0 l=1 c_cookie=9659623170968216572 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:47.054 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.058+0000 7fcf11483640 1 -- 10.20.193.58:0/435591366 >> 10.20.193.58:0/435591366 conn(0x7fcf0c0b3c20 msgr2=0x7fcf0c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:47.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.058+0000 7fcf11483640 1 -- 10.20.193.58:0/435591366 shutdown_connections 2026-02-23T06:23:47.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.058+0000 7fcf11483640 1 -- 10.20.193.58:0/435591366 wait complete. 2026-02-23T06:23:47.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.059+0000 7fcf11483640 1 Processor -- start 2026-02-23T06:23:47.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.059+0000 7fcf11483640 1 -- start start 2026-02-23T06:23:47.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.060+0000 7fcf11483640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcf0c05d080 0x7fcf0c154680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:47.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.060+0000 7fcf11483640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcf0c05d450 0x7fcf0c154bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:47.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.060+0000 7fcf11483640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcf0c0b5d90 0x7fcf0c161550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:47.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.060+0000 7fcf11483640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fcf0c131530 con 0x7fcf0c05d450 2026-02-23T06:23:47.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.060+0000 7fcf11483640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fcf0c1324f0 con 0x7fcf0c05d080 2026-02-23T06:23:47.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.060+0000 7fcf11483640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fcf0c1327d0 con 0x7fcf0c0b5d90 2026-02-23T06:23:47.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.060+0000 7fcf0bfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcf0c05d080 0x7fcf0c154680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:47.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.060+0000 7fcf0bfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcf0c05d080 0x7fcf0c154680 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:47990/0 (socket says 10.20.193.58:47990) 2026-02-23T06:23:47.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.060+0000 7fcf0bfff640 1 -- 10.20.193.58:0/3498112260 learned_addr learned my addr 10.20.193.58:0/3498112260 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:23:47.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.060+0000 7fcf0b7fe640 1 --2- 10.20.193.58:0/3498112260 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcf0c05d450 0x7fcf0c154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:47.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.060+0000 7fcf10c82640 1 --2- 10.20.193.58:0/3498112260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcf0c0b5d90 0x7fcf0c161550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:47.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.060+0000 7fcf0b7fe640 1 -- 10.20.193.58:0/3498112260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcf0c0b5d90 msgr2=0x7fcf0c161550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:47.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.060+0000 7fcf0b7fe640 1 --2- 10.20.193.58:0/3498112260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcf0c0b5d90 0x7fcf0c161550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:47.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.060+0000 7fcf0b7fe640 1 -- 10.20.193.58:0/3498112260 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcf0c05d080 msgr2=0x7fcf0c154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:47.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.060+0000 7fcf0b7fe640 1 --2- 10.20.193.58:0/3498112260 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcf0c05d080 0x7fcf0c154680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:47.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.060+0000 7fcf0b7fe640 1 -- 10.20.193.58:0/3498112260 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf0000a590 con 0x7fcf0c05d450 2026-02-23T06:23:47.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.061+0000 7fcf0b7fe640 1 --2- 10.20.193.58:0/3498112260 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcf0c05d450 0x7fcf0c154bc0 secure :-1 s=READY pgs=269 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcefc0029a0 tx=0x7fcefc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:47.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.061+0000 7fcf08ff9640 1 -- 10.20.193.58:0/3498112260 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcefc005500 con 0x7fcf0c05d450 2026-02-23T06:23:47.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.061+0000 7fcf08ff9640 1 -- 10.20.193.58:0/3498112260 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcefc0036b0 con 0x7fcf0c05d450 2026-02-23T06:23:47.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.061+0000 7fcf08ff9640 1 -- 10.20.193.58:0/3498112260 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcefc003ae0 con 0x7fcf0c05d450 2026-02-23T06:23:47.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.061+0000 7fcf11483640 1 -- 10.20.193.58:0/3498112260 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf0c132ab0 con 0x7fcf0c05d450 2026-02-23T06:23:47.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.061+0000 7fcf11483640 1 -- 10.20.193.58:0/3498112260 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf0c131780 con 0x7fcf0c05d450 2026-02-23T06:23:47.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.062+0000 7fcf11483640 1 --2- 10.20.193.58:0/3498112260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcf0c161a90 0x7fcf0c153490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:47.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.062+0000 7fcf11483640 1 -- 10.20.193.58:0/3498112260 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fcf0c132660 con 0x7fcf0c161a90 2026-02-23T06:23:47.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.062+0000 7fcf0bfff640 1 --2- 10.20.193.58:0/3498112260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcf0c161a90 0x7fcf0c153490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:47.062 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.062+0000 7fcf0bfff640 1 -- 10.20.193.58:0/3498112260 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcf0c132cf0 con 0x7fcf0c161a90 2026-02-23T06:23:47.062 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.062+0000 7fcf0bfff640 1 --2- 10.20.193.58:0/3498112260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcf0c161a90 0x7fcf0c153490 secure :-1 s=READY pgs=11 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcef800f770 tx=0x7fcef800fc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:47.062 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.062+0000 7fcf08ff9640 1 -- 10.20.193.58:0/3498112260 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcef800fea0 con 0x7fcf0c161a90 2026-02-23T06:23:47.062 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.063+0000 7fcf08ff9640 1 -- 10.20.193.58:0/3498112260 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fcef800dae0 con 0x7fcf0c161a90 2026-02-23T06:23:47.062 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.063+0000 7fcf08ff9640 1 -- 10.20.193.58:0/3498112260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcf0c161a90 msgr2=0x7fcf0c153490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:47.062 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.063+0000 7fcf08ff9640 1 --2- 10.20.193.58:0/3498112260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcf0c161a90 0x7fcf0c153490 secure :-1 s=READY pgs=11 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcef800f770 tx=0x7fcef800fc40 comp rx=0 tx=0).stop 2026-02-23T06:23:47.062 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.063+0000 7fcf08ff9640 1 -- 10.20.193.58:0/3498112260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcf0c161a90 msgr2=0x7fcf0c153490 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:23:47.062 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.063+0000 7fcf08ff9640 1 --2- 10.20.193.58:0/3498112260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcf0c161a90 0x7fcf0c153490 unknown :-1 s=CLOSED pgs=11 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:47.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.063+0000 7fcf08ff9640 1 -- 10.20.193.58:0/3498112260 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fcefc003c40 con 0x7fcf0c05d450 2026-02-23T06:23:47.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.064+0000 7fcf08ff9640 1 --2- 10.20.193.58:0/3498112260 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcedc07a3c0 0x7fcedc09a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:47.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.064+0000 7fcf08ff9640 1 -- 10.20.193.58:0/3498112260 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fcefc09cad0 con 0x7fcf0c05d450 2026-02-23T06:23:47.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.064+0000 7fcf0bfff640 1 --2- 10.20.193.58:0/3498112260 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcedc07a3c0 0x7fcedc09a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:47.065 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.065+0000 7fcf0bfff640 1 --2- 10.20.193.58:0/3498112260 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcedc07a3c0 0x7fcedc09a870 secure :-1 s=READY pgs=146 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcef800f770 tx=0x7fcef8009030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:47.065 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.066+0000 7fcf11483640 1 --2- 10.20.193.58:0/3498112260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcf0c1539d0 0x7fcf0c151e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:47.065 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.066+0000 7fcf11483640 1 -- 10.20.193.58:0/3498112260 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fcf0c165880 con 0x7fcf0c1539d0 2026-02-23T06:23:47.065 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.067+0000 7fcf10c82640 1 --2- 10.20.193.58:0/3498112260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcf0c1539d0 0x7fcf0c151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:47.066 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.067+0000 7fcf10c82640 1 -- 10.20.193.58:0/3498112260 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcf0c133930 con 0x7fcf0c1539d0 2026-02-23T06:23:47.066 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.068+0000 7fcf10c82640 1 --2- 10.20.193.58:0/3498112260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcf0c1539d0 0x7fcf0c151e20 secure :-1 s=READY pgs=12 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf00030790 tx=0x7fcf00003780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:47.066 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.068+0000 7fcf08ff9640 1 -- 10.20.193.58:0/3498112260 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcf0003e050 con 0x7fcf0c1539d0 2026-02-23T06:23:47.066 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.068+0000 7fcf08ff9640 1 -- 10.20.193.58:0/3498112260 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4910 (secure 0 0 0) 0x7fcf0003f040 con 0x7fcf0c1539d0 2026-02-23T06:23:47.066 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.068+0000 7fcf08ff9640 1 -- 10.20.193.58:0/3498112260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcf0c1539d0 msgr2=0x7fcf0c151e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:47.066 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.068+0000 7fcf08ff9640 1 --2- 10.20.193.58:0/3498112260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcf0c1539d0 0x7fcf0c151e20 secure :-1 s=READY pgs=12 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf00030790 tx=0x7fcf00003780 comp rx=0 tx=0).stop 2026-02-23T06:23:47.066 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.068+0000 7fcf08ff9640 1 -- 10.20.193.58:0/3498112260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcf0c1539d0 msgr2=0x7fcf0c151e20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:23:47.066 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.068+0000 7fcf08ff9640 1 --2- 10.20.193.58:0/3498112260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcf0c1539d0 0x7fcf0c151e20 unknown :-1 s=CLOSED pgs=12 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:47.067 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:23:47.067 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:23:47.067 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:23:47.067 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:23:47.068 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 20, 2026-02-23T06:23:47.068 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 25610, 2026-02-23T06:23:47.068 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:23:47.068 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:23:47.068 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:23:47.068 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:23:47.068 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:47.068 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 1, 2026-02-23T06:23:47.068 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:23:47.068 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:23:47.069 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:23:47.069 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:23:47.069 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:23:47.069 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:23:47.069 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:23:47.069 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:23:47.069 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:23:47.069 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:23:47.069 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:23:47.069 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:23:47.070 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:23:47.070 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:23:47.070 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:23:47.070 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:23:47.070 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:47.070 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:23:47.070 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:23:47.070 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:23:47.070 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:23:47.070 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:23:47.071 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:23:47.071 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:23:47.071 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:23:47.071 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:23:47.071 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:23:47.071 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:23:47.071 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:23:47.071 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:23:47.071 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:23:47.071 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:23:47.072 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:47.072 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:47.072 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:23:47.072 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:23:47.072 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:23:47.072 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:23:47.072 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:23:47.072 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:23:47.072 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:23:47.073 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:23:47.073 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:23:47.073 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:23:47.073 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:23:47.073 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:23:47.073 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:23:47.073 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:23:47.073 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:23:47.073 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:23:47.074 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:23:47.074 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:23:47.074 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:23:47.074 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:23:47.074 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:23:47.074 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:23:47.074 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:23:47.074 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:23:47.074 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:23:47.074 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:23:47.075 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:23:47.075 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:23:47.075 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:23:47.075 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:23:47.075 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:47.075 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:23:47.075 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:47.075 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:23:47.075 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:47.076 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:23:47.076 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:23:47.076 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:23:47.076 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:23:47.076 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:47.076 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:23:47.076 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:23:47.076 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:47.076 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:47.077 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:47.077 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:23:47.077 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:23:47.077 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:47.077 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:47.077 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:47.077 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:47.077 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:23:47.078 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:23:47.078 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:23:47.078 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:23:47.078 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:23:47.078 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:23:47.078 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:47.078 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:47.078 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:23:47.078 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:23:47.078 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:23:47.079 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:23:47.079 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:47.079 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:23:47.079 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:23:47.079 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:47.079 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:47.079 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:47.079 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:23:47.079 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:23:47.079 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:47.079 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:47.080 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:47.080 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:47.080 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:23:47.080 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:23:47.080 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:23:47.080 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:23:47.080 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:23:47.080 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:23:47.080 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:47.081 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:47.081 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:23:47.081 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:23:47.081 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:23:47.081 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:23:47.081 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:47.081 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:23:47.081 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:23:47.081 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:47.081 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:47.081 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:47.082 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:23:47.082 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:23:47.082 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:47.082 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:47.082 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:47.082 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:47.082 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:23:47.082 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:23:47.082 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:23:47.082 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:23:47.083 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:23:47.083 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:23:47.083 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:47.083 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:47.083 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:47.083 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:23:47.083 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:23:47.083 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:47.083 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:47.083 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:47.084 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:23:47.084 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:47.084 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:47.084 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:23:47.084 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:47.084 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:47.084 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:47.084 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:23:47.084 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:47.084 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:47.085 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:47.085 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:23:47.085 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:23:47.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.069+0000 7fcf11483640 1 -- 10.20.193.58:0/3498112260 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcedc07a3c0 msgr2=0x7fcedc09a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:47.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.069+0000 7fcf11483640 1 --2- 10.20.193.58:0/3498112260 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcedc07a3c0 0x7fcedc09a870 secure :-1 s=READY pgs=146 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcef800f770 tx=0x7fcef8009030 comp rx=0 tx=0).stop 2026-02-23T06:23:47.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.069+0000 7fcf11483640 1 -- 10.20.193.58:0/3498112260 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcf0c05d450 msgr2=0x7fcf0c154bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:47.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.069+0000 7fcf11483640 1 --2- 10.20.193.58:0/3498112260 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcf0c05d450 0x7fcf0c154bc0 secure :-1 s=READY pgs=269 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcefc0029a0 tx=0x7fcefc00c8f0 comp rx=0 tx=0).stop 2026-02-23T06:23:47.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.069+0000 7fcf10c82640 1 -- 10.20.193.58:0/3498112260 reap_dead start 2026-02-23T06:23:47.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.070+0000 7fcf11483640 1 -- 10.20.193.58:0/3498112260 shutdown_connections 2026-02-23T06:23:47.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.070+0000 7fcf11483640 1 -- 10.20.193.58:0/3498112260 >> 10.20.193.58:0/3498112260 conn(0x7fcf0c0b3c20 msgr2=0x7fcf0c1635c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:47.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.070+0000 7fcf11483640 1 -- 10.20.193.58:0/3498112260 shutdown_connections 2026-02-23T06:23:47.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.070+0000 7fcf11483640 1 -- 10.20.193.58:0/3498112260 wait complete. 2026-02-23T06:23:47.088 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:23:47.088 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:23:47.088 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:23:47.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.218+0000 7f060883e640 1 -- 10.20.193.58:0/1816705875 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f05f0005320 msgr2=0x7f05f0065a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:47.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.218+0000 7f060883e640 1 --2- 10.20.193.58:0/1816705875 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f05f0005320 0x7f05f0065a10 secure :-1 s=READY pgs=271 gs=3 cs=0 l=1 c_cookie=9269753532596615071 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05f400a950 tx=0x7f05f40300c0 comp rx=0 tx=0).stop 2026-02-23T06:23:47.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.218+0000 7f060883e640 1 -- 10.20.193.58:0/1816705875 shutdown_connections 2026-02-23T06:23:47.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.218+0000 7f060883e640 1 --2- 10.20.193.58:0/1816705875 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f05f0005320 0x7f05f0065a10 unknown :-1 s=CLOSED pgs=271 gs=3 cs=0 l=1 c_cookie=9269753532596615071 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:47.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.218+0000 7f060883e640 1 -- 10.20.193.58:0/1816705875 >> 10.20.193.58:0/1816705875 conn(0x7f0600058e50 msgr2=0x7f0600059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:47.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.218+0000 7f060883e640 1 -- 10.20.193.58:0/1816705875 shutdown_connections 2026-02-23T06:23:47.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.218+0000 7f060883e640 1 -- 10.20.193.58:0/1816705875 wait complete. 2026-02-23T06:23:47.217 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.219+0000 7f060883e640 1 Processor -- start 2026-02-23T06:23:47.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.219+0000 7f060883e640 1 -- start start 2026-02-23T06:23:47.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.220+0000 7f060883e640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f05f0005320 0x7f06001fecc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:47.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.220+0000 7f060883e640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f06000ae570 0x7f06001588b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:47.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.220+0000 7f060883e640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0600134570 0x7f060005dc00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:47.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.220+0000 7f060883e640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f06001fe8a0 con 0x7f06000ae570 2026-02-23T06:23:47.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.220+0000 7f060883e640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f0600136b10 con 0x7f0600134570 2026-02-23T06:23:47.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.220+0000 7f060883e640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f0600130a00 con 0x7f05f0005320 2026-02-23T06:23:47.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.220+0000 7f0605db2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f06000ae570 0x7f06001588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:47.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.220+0000 7f0605db2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f06000ae570 0x7f06001588b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:52358/0 (socket says 10.20.193.58:52358) 2026-02-23T06:23:47.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.220+0000 7f0605db2640 1 -- 10.20.193.58:0/933103667 learned_addr learned my addr 10.20.193.58:0/933103667 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:23:47.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.220+0000 7f0606db4640 1 --2- 10.20.193.58:0/933103667 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0600134570 0x7f060005dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:47.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.220+0000 7f06065b3640 1 --2- 10.20.193.58:0/933103667 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f05f0005320 0x7f06001fecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:47.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.221+0000 7f0605db2640 1 -- 10.20.193.58:0/933103667 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f05f0005320 msgr2=0x7f06001fecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:47.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.221+0000 7f0605db2640 1 --2- 10.20.193.58:0/933103667 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f05f0005320 0x7f06001fecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:47.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.221+0000 7f0605db2640 1 -- 10.20.193.58:0/933103667 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0600134570 msgr2=0x7f060005dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:47.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.221+0000 7f0605db2640 1 --2- 10.20.193.58:0/933103667 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0600134570 0x7f060005dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:47.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.221+0000 7f0605db2640 1 -- 10.20.193.58:0/933103667 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0600134b10 con 0x7f06000ae570 2026-02-23T06:23:47.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.221+0000 7f0605db2640 1 --2- 10.20.193.58:0/933103667 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f06000ae570 0x7f06001588b0 secure :-1 s=READY pgs=272 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05ec002fe0 tx=0x7f05ec007630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:47.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.221+0000 7f05eaffd640 1 -- 10.20.193.58:0/933103667 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f05ec00e450 con 0x7f06000ae570 2026-02-23T06:23:47.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.221+0000 7f05eaffd640 1 -- 10.20.193.58:0/933103667 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05ec00e5b0 con 0x7f06000ae570 2026-02-23T06:23:47.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.221+0000 7f05eaffd640 1 -- 10.20.193.58:0/933103667 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f05ec00e9c0 con 0x7f06000ae570 2026-02-23T06:23:47.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.221+0000 7f060883e640 1 -- 10.20.193.58:0/933103667 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0600130ca0 con 0x7f06000ae570 2026-02-23T06:23:47.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.221+0000 7f060883e640 1 -- 10.20.193.58:0/933103667 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06001fe4c0 con 0x7f06000ae570 2026-02-23T06:23:47.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.222+0000 7f060883e640 1 -- 10.20.193.58:0/933103667 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06001fe9e0 con 0x7f06000ae570 2026-02-23T06:23:47.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.223+0000 7f05eaffd640 1 -- 10.20.193.58:0/933103667 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f05ec01d060 con 0x7f06000ae570 2026-02-23T06:23:47.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.224+0000 7f05eaffd640 1 --2- 10.20.193.58:0/933103667 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f05d007a6b0 0x7f05d009ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:47.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.224+0000 7f05eaffd640 1 -- 10.20.193.58:0/933103667 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f05ec09dff0 con 0x7f06000ae570 2026-02-23T06:23:47.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.224+0000 7f06065b3640 1 --2- 10.20.193.58:0/933103667 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f05d007a6b0 0x7f05d009ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:47.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.226+0000 7f06065b3640 1 --2- 10.20.193.58:0/933103667 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f05d007a6b0 0x7f05d009ab60 secure :-1 s=READY pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05f8004760 tx=0x7f05f80090e0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:47.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.227+0000 7f05eaffd640 1 -- 10.20.193.58:0/933103667 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f05ec0612c0 con 0x7f06000ae570 2026-02-23T06:23:47.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.385+0000 7f060883e640 1 -- 10.20.193.58:0/933103667 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f06001fe9e0 con 0x7f06000ae570 2026-02-23T06:23:47.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.385+0000 7f05eaffd640 1 -- 10.20.193.58:0/933103667 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f06001fe9e0 con 0x7f06000ae570 2026-02-23T06:23:47.382 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.387+0000 7f060883e640 1 -- 10.20.193.58:0/933103667 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f05d007a6b0 msgr2=0x7f05d009ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:47.382 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.387+0000 7f060883e640 1 --2- 10.20.193.58:0/933103667 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f05d007a6b0 0x7f05d009ab60 secure :-1 s=READY pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05f8004760 tx=0x7f05f80090e0 comp rx=0 tx=0).stop 2026-02-23T06:23:47.382 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.387+0000 7f060883e640 1 -- 10.20.193.58:0/933103667 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f06000ae570 msgr2=0x7f06001588b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:47.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.387+0000 7f060883e640 1 --2- 10.20.193.58:0/933103667 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f06000ae570 0x7f06001588b0 secure :-1 s=READY pgs=272 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05ec002fe0 tx=0x7f05ec007630 comp rx=0 tx=0).stop 2026-02-23T06:23:47.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.387+0000 7f060883e640 1 -- 10.20.193.58:0/933103667 shutdown_connections 2026-02-23T06:23:47.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.387+0000 7f060883e640 1 --2- 10.20.193.58:0/933103667 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f05d007a6b0 0x7f05d009ab60 unknown :-1 s=CLOSED pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:47.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.387+0000 7f060883e640 1 --2- 10.20.193.58:0/933103667 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0600134570 0x7f060005dc00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:47.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.387+0000 7f060883e640 1 --2- 10.20.193.58:0/933103667 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f06000ae570 0x7f06001588b0 unknown :-1 s=CLOSED pgs=272 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:47.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.387+0000 7f060883e640 1 --2- 10.20.193.58:0/933103667 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f05f0005320 0x7f06001fecc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:47.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.387+0000 7f060883e640 1 -- 10.20.193.58:0/933103667 >> 10.20.193.58:0/933103667 conn(0x7f0600058e50 msgr2=0x7f0600135730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:47.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.387+0000 7f060883e640 1 -- 10.20.193.58:0/933103667 shutdown_connections 2026-02-23T06:23:47.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:47.387+0000 7f060883e640 1 -- 10.20.193.58:0/933103667 wait complete. 2026-02-23T06:23:47.394 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:23:57.395 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:23:57.395 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:23:57.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.522+0000 7f4702db5640 1 -- 10.20.193.58:0/1790601703 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f46fc0b6690 msgr2=0x7f46fc058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:57.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.522+0000 7f4702db5640 1 --2- 10.20.193.58:0/1790601703 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f46fc0b6690 0x7f46fc058cf0 secure :-1 s=READY pgs=273 gs=2 cs=0 l=1 c_cookie=10409615743884781798 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46fc0b5230 tx=0x7f46f8030340 comp rx=0 tx=0).stop 2026-02-23T06:23:57.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.522+0000 7f4702db5640 1 -- 10.20.193.58:0/1790601703 shutdown_connections 2026-02-23T06:23:57.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.522+0000 7f4702db5640 1 --2- 10.20.193.58:0/1790601703 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f46fc0b6690 0x7f46fc058cf0 unknown :-1 s=CLOSED pgs=273 gs=2 cs=0 l=1 c_cookie=10409615743884781798 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:57.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.522+0000 7f4702db5640 1 --2- 10.20.193.58:0/1790601703 >> v2:10.20.193.93:3300/0 conn(0x7f46fc15d870 0x7f46fc0587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:57.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.522+0000 7f4702db5640 1 --2- 10.20.193.58:0/1790601703 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f46fc15d4a0 0x7f46fc0affb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:57.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.522+0000 7f4702db5640 1 -- 10.20.193.58:0/1790601703 >> 10.20.193.58:0/1790601703 conn(0x7f46fc0b3c20 msgr2=0x7f46fc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:57.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.522+0000 7f4702db5640 1 -- 10.20.193.58:0/1790601703 shutdown_connections 2026-02-23T06:23:57.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.522+0000 7f4702db5640 1 -- 10.20.193.58:0/1790601703 wait complete. 2026-02-23T06:23:57.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.523+0000 7f4702db5640 1 Processor -- start 2026-02-23T06:23:57.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.523+0000 7f4702db5640 1 -- start start 2026-02-23T06:23:57.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.524+0000 7f4702db5640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f46fc0b6690 0x7f46fc13e2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:57.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.524+0000 7f4702db5640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f46fc15d4a0 0x7f46fc15a270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:57.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.524+0000 7f4702db5640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f46fc15d870 0x7f46fc15a7b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:57.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.524+0000 7f4702db5640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f46fc202030 con 0x7f46fc15d870 2026-02-23T06:23:57.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.524+0000 7f4702db5640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f46fc15e050 con 0x7f46fc0b6690 2026-02-23T06:23:57.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.524+0000 7f4702db5640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f46fc1600c0 con 0x7f46fc15d4a0 2026-02-23T06:23:57.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.524+0000 7f47025b4640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f46fc15d870 0x7f46fc15a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:57.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.524+0000 7f4701db3640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f46fc0b6690 0x7f46fc13e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:57.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.524+0000 7f47025b4640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f46fc15d870 0x7f46fc15a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:45416/0 (socket says 10.20.193.58:45416) 2026-02-23T06:23:57.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.524+0000 7f47025b4640 1 -- 10.20.193.58:0/444699957 learned_addr learned my addr 10.20.193.58:0/444699957 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:23:57.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.524+0000 7f47015b2640 1 --2- 10.20.193.58:0/444699957 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f46fc15d4a0 0x7f46fc15a270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:57.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.524+0000 7f47025b4640 1 -- 10.20.193.58:0/444699957 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f46fc15d4a0 msgr2=0x7f46fc15a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:57.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.524+0000 7f47025b4640 1 --2- 10.20.193.58:0/444699957 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f46fc15d4a0 0x7f46fc15a270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:57.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.524+0000 7f47025b4640 1 -- 10.20.193.58:0/444699957 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f46fc0b6690 msgr2=0x7f46fc13e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:57.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.524+0000 7f47025b4640 1 --2- 10.20.193.58:0/444699957 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f46fc0b6690 0x7f46fc13e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:57.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.524+0000 7f47025b4640 1 -- 10.20.193.58:0/444699957 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f800a650 con 0x7f46fc15d870 2026-02-23T06:23:57.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.524+0000 7f47025b4640 1 --2- 10.20.193.58:0/444699957 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f46fc15d870 0x7f46fc15a7b0 secure :-1 s=READY pgs=274 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46f800a230 tx=0x7f46f8006fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:57.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.525+0000 7f46ea7fc640 1 -- 10.20.193.58:0/444699957 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f46f8003df0 con 0x7f46fc15d870 2026-02-23T06:23:57.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.525+0000 7f46ea7fc640 1 -- 10.20.193.58:0/444699957 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46f8039560 con 0x7f46fc15d870 2026-02-23T06:23:57.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.525+0000 7f46ea7fc640 1 -- 10.20.193.58:0/444699957 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f46f8039910 con 0x7f46fc15d870 2026-02-23T06:23:57.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.525+0000 7f4702db5640 1 -- 10.20.193.58:0/444699957 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46fc1603a0 con 0x7f46fc15d870 2026-02-23T06:23:57.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.525+0000 7f4702db5640 1 -- 10.20.193.58:0/444699957 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46fc15dce0 con 0x7f46fc15d870 2026-02-23T06:23:57.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.525+0000 7f4702db5640 1 -- 10.20.193.58:0/444699957 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46fc15e190 con 0x7f46fc15d870 2026-02-23T06:23:57.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.526+0000 7f46ea7fc640 1 -- 10.20.193.58:0/444699957 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f46f8039a70 con 0x7f46fc15d870 2026-02-23T06:23:57.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.527+0000 7f46ea7fc640 1 --2- 10.20.193.58:0/444699957 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f46cc07a640 0x7f46cc09aaf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:57.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.527+0000 7f46ea7fc640 1 -- 10.20.193.58:0/444699957 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f46f80c3cd0 con 0x7f46fc15d870 2026-02-23T06:23:57.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.528+0000 7f4701db3640 1 --2- 10.20.193.58:0/444699957 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f46cc07a640 0x7f46cc09aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:57.523 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.528+0000 7f4701db3640 1 --2- 10.20.193.58:0/444699957 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f46cc07a640 0x7f46cc09aaf0 secure :-1 s=READY pgs=148 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46ec004740 tx=0x7f46ec005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:57.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.529+0000 7f46ea7fc640 1 -- 10.20.193.58:0/444699957 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f46f80c9020 con 0x7f46fc15d870 2026-02-23T06:23:57.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.688+0000 7f4702db5640 1 -- 10.20.193.58:0/444699957 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f46fc05c7b0 con 0x7f46fc15d870 2026-02-23T06:23:57.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.688+0000 7f46ea7fc640 1 -- 10.20.193.58:0/444699957 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f46f8086f20 con 0x7f46fc15d870 2026-02-23T06:23:57.683 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:23:57.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.690+0000 7f4702db5640 1 -- 10.20.193.58:0/444699957 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f46cc07a640 msgr2=0x7f46cc09aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:57.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.690+0000 7f4702db5640 1 --2- 10.20.193.58:0/444699957 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f46cc07a640 0x7f46cc09aaf0 secure :-1 s=READY pgs=148 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46ec004740 tx=0x7f46ec005f90 comp rx=0 tx=0).stop 2026-02-23T06:23:57.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.690+0000 7f4702db5640 1 -- 10.20.193.58:0/444699957 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f46fc15d870 msgr2=0x7f46fc15a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:57.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.690+0000 7f4702db5640 1 --2- 10.20.193.58:0/444699957 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f46fc15d870 0x7f46fc15a7b0 secure :-1 s=READY pgs=274 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46f800a230 tx=0x7f46f8006fa0 comp rx=0 tx=0).stop 2026-02-23T06:23:57.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.690+0000 7f4702db5640 1 -- 10.20.193.58:0/444699957 shutdown_connections 2026-02-23T06:23:57.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.690+0000 7f4702db5640 1 --2- 10.20.193.58:0/444699957 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f46cc07a640 0x7f46cc09aaf0 unknown :-1 s=CLOSED pgs=148 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:57.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.690+0000 7f4702db5640 1 --2- 10.20.193.58:0/444699957 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f46fc15d870 0x7f46fc15a7b0 unknown :-1 s=CLOSED pgs=274 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:57.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.690+0000 7f4702db5640 1 --2- 10.20.193.58:0/444699957 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f46fc15d4a0 0x7f46fc15a270 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:57.688 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.690+0000 7f4702db5640 1 --2- 10.20.193.58:0/444699957 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f46fc0b6690 0x7f46fc13e2d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:57.688 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.690+0000 7f4702db5640 1 -- 10.20.193.58:0/444699957 >> 10.20.193.58:0/444699957 conn(0x7f46fc0b3c20 msgr2=0x7f46fc0b7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:57.688 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.690+0000 7f4702db5640 1 -- 10.20.193.58:0/444699957 shutdown_connections 2026-02-23T06:23:57.688 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.690+0000 7f4702db5640 1 -- 10.20.193.58:0/444699957 wait complete. 2026-02-23T06:23:57.696 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:23:57.696 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:23:57.696 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:23:57.696 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:23:57.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.839+0000 7f1083fff640 1 -- 10.20.193.58:0/2667846063 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f108415d4a0 msgr2=0x7f10840affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:57.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.839+0000 7f1083fff640 1 --2- 10.20.193.58:0/2667846063 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f108415d4a0 0x7f10840affb0 secure :-1 s=READY pgs=276 gs=2 cs=0 l=1 c_cookie=7206667572741873012 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10840afed0 tx=0x7f107802f190 comp rx=0 tx=0).stop 2026-02-23T06:23:57.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.839+0000 7f1083fff640 1 -- 10.20.193.58:0/2667846063 shutdown_connections 2026-02-23T06:23:57.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.839+0000 7f1083fff640 1 --2- 10.20.193.58:0/2667846063 >> v2:10.20.193.93:3300/0 conn(0x7f10840b6690 0x7f1084058ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:57.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.839+0000 7f1083fff640 1 --2- 10.20.193.58:0/2667846063 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f108415d4a0 0x7f10840affb0 unknown :-1 s=CLOSED pgs=276 gs=2 cs=0 l=1 c_cookie=7206667572741873012 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:57.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.839+0000 7f1083fff640 1 -- 10.20.193.58:0/2667846063 >> 10.20.193.58:0/2667846063 conn(0x7f10840b3c20 msgr2=0x7f10840b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:57.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.839+0000 7f1083fff640 1 -- 10.20.193.58:0/2667846063 shutdown_connections 2026-02-23T06:23:57.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.839+0000 7f1083fff640 1 -- 10.20.193.58:0/2667846063 wait complete. 2026-02-23T06:23:57.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.840+0000 7f1083fff640 1 Processor -- start 2026-02-23T06:23:57.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.840+0000 7f1083fff640 1 -- start start 2026-02-23T06:23:57.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.840+0000 7f1083fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f10840b6690 0x7f108411dfe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:57.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.841+0000 7f1083fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f108415d4a0 0x7f108414a930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:57.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.841+0000 7f1083fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f108415d870 0x7f108413cf90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:57.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.841+0000 7f1083fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f1084056d40 con 0x7f108415d4a0 2026-02-23T06:23:57.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.841+0000 7f1083fff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f10840561f0 con 0x7f108415d870 2026-02-23T06:23:57.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.841+0000 7f1083fff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f1084056420 con 0x7f10840b6690 2026-02-23T06:23:57.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.841+0000 7f1082ffd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f10840b6690 0x7f108411dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:57.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.841+0000 7f10827fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f108415d4a0 0x7f108414a930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:57.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.841+0000 7f10837fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f108415d870 0x7f108413cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:57.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.841+0000 7f1082ffd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f10840b6690 0x7f108411dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:55748/0 (socket says 10.20.193.58:55748) 2026-02-23T06:23:57.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.841+0000 7f1082ffd640 1 -- 10.20.193.58:0/3673547072 learned_addr learned my addr 10.20.193.58:0/3673547072 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:23:57.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.841+0000 7f1082ffd640 1 -- 10.20.193.58:0/3673547072 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f108415d870 msgr2=0x7f108413cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:57.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.841+0000 7f1082ffd640 1 --2- 10.20.193.58:0/3673547072 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f108415d870 0x7f108413cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:57.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.841+0000 7f1082ffd640 1 -- 10.20.193.58:0/3673547072 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f108415d4a0 msgr2=0x7f108414a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:57.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.841+0000 7f1082ffd640 1 --2- 10.20.193.58:0/3673547072 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f108415d4a0 0x7f108414a930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:57.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.841+0000 7f1082ffd640 1 -- 10.20.193.58:0/3673547072 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10780094b0 con 0x7f10840b6690 2026-02-23T06:23:57.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.841+0000 7f1082ffd640 1 --2- 10.20.193.58:0/3673547072 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f10840b6690 0x7f108411dfe0 secure :-1 s=READY pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10780023d0 tx=0x7f1078002950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:57.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.842+0000 7f10637fe640 1 -- 10.20.193.58:0/3673547072 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1078038470 con 0x7f10840b6690 2026-02-23T06:23:57.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.842+0000 7f1083fff640 1 -- 10.20.193.58:0/3673547072 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1084057bc0 con 0x7f10840b6690 2026-02-23T06:23:57.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.842+0000 7f10637fe640 1 -- 10.20.193.58:0/3673547072 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10780386c0 con 0x7f10840b6690 2026-02-23T06:23:57.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.842+0000 7f10637fe640 1 -- 10.20.193.58:0/3673547072 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1078038ab0 con 0x7f10840b6690 2026-02-23T06:23:57.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.842+0000 7f1083fff640 1 -- 10.20.193.58:0/3673547072 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1084057e80 con 0x7f10840b6690 2026-02-23T06:23:57.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.842+0000 7f1083fff640 1 --2- 10.20.193.58:0/3673547072 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1084058070 0x7f108413d4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:57.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.842+0000 7f1083fff640 1 -- 10.20.193.58:0/3673547072 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f10840b6330 con 0x7f1084058070 2026-02-23T06:23:57.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.842+0000 7f10827fc640 1 --2- 10.20.193.58:0/3673547072 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1084058070 0x7f108413d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:57.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.843+0000 7f10827fc640 1 -- 10.20.193.58:0/3673547072 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f10840b5e10 con 0x7f1084058070 2026-02-23T06:23:57.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.843+0000 7f10827fc640 1 --2- 10.20.193.58:0/3673547072 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1084058070 0x7f108413d4d0 secure :-1 s=READY pgs=277 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1084121830 tx=0x7f106c00fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:57.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.843+0000 7f10637fe640 1 -- 10.20.193.58:0/3673547072 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f106c00dab0 con 0x7f1084058070 2026-02-23T06:23:57.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.844+0000 7f10637fe640 1 -- 10.20.193.58:0/3673547072 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f1078038c10 con 0x7f10840b6690 2026-02-23T06:23:57.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.845+0000 7f10637fe640 1 --2- 10.20.193.58:0/3673547072 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f105007a660 0x7f105009ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:57.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.845+0000 7f10637fe640 1 -- 10.20.193.58:0/3673547072 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f10780c2a40 con 0x7f10840b6690 2026-02-23T06:23:57.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.845+0000 7f10637fe640 1 -- 10.20.193.58:0/3673547072 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f106c00fe10 con 0x7f1084058070 2026-02-23T06:23:57.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.845+0000 7f10637fe640 1 -- 10.20.193.58:0/3673547072 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1084058070 msgr2=0x7f108413d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:57.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.845+0000 7f10637fe640 1 --2- 10.20.193.58:0/3673547072 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1084058070 0x7f108413d4d0 secure :-1 s=READY pgs=277 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1084121830 tx=0x7f106c00fc10 comp rx=0 tx=0).stop 2026-02-23T06:23:57.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.845+0000 7f10637fe640 1 -- 10.20.193.58:0/3673547072 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1084058070 msgr2=0x7f108413d4d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:23:57.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.845+0000 7f10637fe640 1 --2- 10.20.193.58:0/3673547072 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1084058070 0x7f108413d4d0 secure :-1 s=CLOSED pgs=277 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1084121830 tx=0x7f106c00fc10 comp rx=0 tx=0).stop 2026-02-23T06:23:57.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.846+0000 7f10837fe640 1 --2- 10.20.193.58:0/3673547072 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f105007a660 0x7f105009ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:57.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.846+0000 7f10837fe640 1 --2- 10.20.193.58:0/3673547072 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f105007a660 0x7f105009ab10 secure :-1 s=READY pgs=149 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1084057b20 tx=0x7f107400a310 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:57.843 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.846+0000 7f1083fff640 1 --2- 10.20.193.58:0/3673547072 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1084121ff0 0x7f1084149de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:57.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.846+0000 7f1083fff640 1 -- 10.20.193.58:0/3673547072 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f10840b6d50 con 0x7f1084121ff0 2026-02-23T06:23:57.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.846+0000 7f10827fc640 1 --2- 10.20.193.58:0/3673547072 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1084121ff0 0x7f1084149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:57.845 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.846+0000 7f10827fc640 1 -- 10.20.193.58:0/3673547072 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f108405b0e0 con 0x7f1084121ff0 2026-02-23T06:23:57.845 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.851+0000 7f10827fc640 1 --2- 10.20.193.58:0/3673547072 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1084121ff0 0x7f1084149de0 secure :-1 s=READY pgs=278 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f106c0023d0 tx=0x7f106c0046e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:57.845 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.851+0000 7f10637fe640 1 -- 10.20.193.58:0/3673547072 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f106c014a30 con 0x7f1084121ff0 2026-02-23T06:23:57.845 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.851+0000 7f10637fe640 1 -- 10.20.193.58:0/3673547072 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5248 (secure 0 0 0) 0x7f106c014b90 con 0x7f1084121ff0 2026-02-23T06:23:57.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.851+0000 7f10637fe640 1 -- 10.20.193.58:0/3673547072 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1084121ff0 msgr2=0x7f1084149de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:57.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.851+0000 7f10637fe640 1 --2- 10.20.193.58:0/3673547072 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1084121ff0 0x7f1084149de0 secure :-1 s=READY pgs=278 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f106c0023d0 tx=0x7f106c0046e0 comp rx=0 tx=0).stop 2026-02-23T06:23:57.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.851+0000 7f10637fe640 1 -- 10.20.193.58:0/3673547072 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1084121ff0 msgr2=0x7f1084149de0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:23:57.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.851+0000 7f10637fe640 1 --2- 10.20.193.58:0/3673547072 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1084121ff0 0x7f1084149de0 secure :-1 s=CLOSED pgs=278 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f106c0023d0 tx=0x7f106c0046e0 comp rx=0 tx=0).stop 2026-02-23T06:23:57.846 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:23:57.846 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:23:57.846 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:23:57.846 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:23:57.846 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 20, 2026-02-23T06:23:57.846 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 175861, 2026-02-23T06:23:57.846 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:23:57.846 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:23:57.847 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:23:57.847 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:23:57.847 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:57.847 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 12, 2026-02-23T06:23:57.847 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:23:57.847 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:23:57.847 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:23:57.847 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:23:57.847 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:23:57.847 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:23:57.847 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:23:57.847 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:23:57.847 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:23:57.847 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:23:57.847 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:23:57.847 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:23:57.847 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:23:57.848 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:23:57.848 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:23:57.848 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:23:57.848 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:57.848 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:23:57.848 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:23:57.848 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:23:57.848 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:23:57.848 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:23:57.848 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:23:57.848 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:23:57.848 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:23:57.848 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:23:57.848 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:23:57.848 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:23:57.848 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:23:57.848 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:23:57.849 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:23:57.849 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:23:57.849 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:57.849 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:57.849 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:23:57.849 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:23:57.849 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:23:57.849 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:23:57.849 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:23:57.849 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:23:57.849 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:23:57.849 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:23:57.849 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:23:57.849 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:23:57.849 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:23:57.849 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:23:57.849 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:23:57.849 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:23:57.850 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:23:57.850 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:23:57.850 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:23:57.850 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:23:57.850 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:23:57.850 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:23:57.850 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:23:57.850 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:23:57.850 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:23:57.850 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:23:57.850 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:23:57.850 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:23:57.850 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:23:57.850 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:23:57.850 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:23:57.850 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:23:57.850 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:57.850 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:23:57.850 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:57.850 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:23:57.850 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:57.851 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:23:57.851 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:23:57.851 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:23:57.851 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:23:57.851 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:57.851 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:23:57.851 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:23:57.851 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:57.851 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:57.851 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:57.851 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:23:57.851 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:23:57.851 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:57.851 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:57.851 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:57.851 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:57.851 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:23:57.851 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:23:57.851 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:23:57.851 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:23:57.851 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:23:57.851 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:23:57.852 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:57.852 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:57.852 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:23:57.852 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:23:57.852 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:23:57.852 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:23:57.852 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:57.852 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:23:57.852 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:23:57.852 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:57.852 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:57.852 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:57.852 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:23:57.852 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:23:57.852 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:57.852 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:57.852 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:57.852 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:57.852 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:23:57.852 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:23:57.852 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:23:57.852 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:23:57.852 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:23:57.853 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:23:57.853 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:57.853 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:57.853 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:23:57.853 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:23:57.853 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:23:57.853 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:23:57.853 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:57.853 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:23:57.853 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:23:57.853 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:57.853 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:57.853 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:57.853 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:23:57.853 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:23:57.853 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:57.853 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:57.853 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:57.853 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:57.853 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:23:57.853 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:23:57.853 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:23:57.854 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:23:57.854 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:23:57.854 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:23:57.854 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:57.854 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:57.854 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:57.854 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:23:57.854 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:23:57.854 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:57.854 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:57.854 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:57.854 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:23:57.854 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:57.854 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:57.854 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:23:57.854 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:57.854 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:57.854 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:57.854 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:23:57.854 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:57.854 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:57.854 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:23:57.855 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:57.855 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:57.855 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:57.855 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:23:57.855 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:57.855 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:57.855 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:23:57.855 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:57.855 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:57.855 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:57.855 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:23:57.855 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:57.855 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:57.855 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:57.855 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:23:57.855 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:23:57.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.851+0000 7f1083fff640 1 -- 10.20.193.58:0/3673547072 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f105007a660 msgr2=0x7f105009ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:57.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.851+0000 7f1083fff640 1 --2- 10.20.193.58:0/3673547072 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f105007a660 0x7f105009ab10 secure :-1 s=READY pgs=149 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1084057b20 tx=0x7f107400a310 comp rx=0 tx=0).stop 2026-02-23T06:23:57.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.851+0000 7f1083fff640 1 -- 10.20.193.58:0/3673547072 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f10840b6690 msgr2=0x7f108411dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:57.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.851+0000 7f1083fff640 1 --2- 10.20.193.58:0/3673547072 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f10840b6690 0x7f108411dfe0 secure :-1 s=READY pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10780023d0 tx=0x7f1078002950 comp rx=0 tx=0).stop 2026-02-23T06:23:57.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.851+0000 7f10837fe640 1 -- 10.20.193.58:0/3673547072 reap_dead start 2026-02-23T06:23:57.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.851+0000 7f10837fe640 1 -- 10.20.193.58:0/3673547072 reap_dead start 2026-02-23T06:23:57.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.851+0000 7f1083fff640 1 -- 10.20.193.58:0/3673547072 shutdown_connections 2026-02-23T06:23:57.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.851+0000 7f1083fff640 1 -- 10.20.193.58:0/3673547072 >> 10.20.193.58:0/3673547072 conn(0x7f10840b3c20 msgr2=0x7f108415ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:57.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.851+0000 7f1083fff640 1 -- 10.20.193.58:0/3673547072 shutdown_connections 2026-02-23T06:23:57.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.851+0000 7f1083fff640 1 -- 10.20.193.58:0/3673547072 wait complete. 2026-02-23T06:23:57.857 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:23:57.857 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:23:57.857 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:23:57.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.984+0000 7f2e22403640 1 -- 10.20.193.58:0/2200943529 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2e1c15c040 msgr2=0x7f2e1c05b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:57.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.984+0000 7f2e22403640 1 --2- 10.20.193.58:0/2200943529 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2e1c15c040 0x7f2e1c05b0e0 secure :-1 s=READY pgs=279 gs=2 cs=0 l=1 c_cookie=8445947615275110380 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e1c05df80 tx=0x7f2e0c02f250 comp rx=0 tx=0).stop 2026-02-23T06:23:57.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.984+0000 7f2e22403640 1 -- 10.20.193.58:0/2200943529 shutdown_connections 2026-02-23T06:23:57.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.984+0000 7f2e22403640 1 --2- 10.20.193.58:0/2200943529 >> v2:10.20.193.93:3300/0 conn(0x7f2e1c05d370 0x7f2e1c0b5680 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:57.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.984+0000 7f2e22403640 1 --2- 10.20.193.58:0/2200943529 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2e1c056550 0x7f2e1c05ce30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:57.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.984+0000 7f2e22403640 1 --2- 10.20.193.58:0/2200943529 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2e1c15c040 0x7f2e1c05b0e0 unknown :-1 s=CLOSED pgs=279 gs=2 cs=0 l=1 c_cookie=8445947615275110380 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:57.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.984+0000 7f2e22403640 1 -- 10.20.193.58:0/2200943529 >> 10.20.193.58:0/2200943529 conn(0x7f2e1c0b3c20 msgr2=0x7f2e1c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:57.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.984+0000 7f2e22403640 1 -- 10.20.193.58:0/2200943529 shutdown_connections 2026-02-23T06:23:57.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.984+0000 7f2e22403640 1 -- 10.20.193.58:0/2200943529 wait complete. 2026-02-23T06:23:57.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.985+0000 7f2e22403640 1 Processor -- start 2026-02-23T06:23:57.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.986+0000 7f2e22403640 1 -- start start 2026-02-23T06:23:57.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.986+0000 7f2e22403640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2e1c056550 0x7f2e1c15e8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:57.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.986+0000 7f2e22403640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e1c05d370 0x7f2e1c0585e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:57.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.986+0000 7f2e22403640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2e1c15c040 0x7f2e1c058b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:57.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.986+0000 7f2e22403640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c157dc0 con 0x7f2e1c15c040 2026-02-23T06:23:57.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.986+0000 7f2e22403640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c15c6c0 con 0x7f2e1c05d370 2026-02-23T06:23:57.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.986+0000 7f2e22403640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f2e1c158010 con 0x7f2e1c056550 2026-02-23T06:23:57.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.986+0000 7f2e21c02640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2e1c15c040 0x7f2e1c058b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:57.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.986+0000 7f2e20c00640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e1c05d370 0x7f2e1c0585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:57.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.986+0000 7f2e20c00640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e1c05d370 0x7f2e1c0585e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:55946/0 (socket says 10.20.193.58:55946) 2026-02-23T06:23:57.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.986+0000 7f2e20c00640 1 -- 10.20.193.58:0/2354291681 learned_addr learned my addr 10.20.193.58:0/2354291681 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:23:57.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.986+0000 7f2e21401640 1 --2- 10.20.193.58:0/2354291681 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2e1c056550 0x7f2e1c15e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:57.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.987+0000 7f2e20c00640 1 -- 10.20.193.58:0/2354291681 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2e1c056550 msgr2=0x7f2e1c15e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:57.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.987+0000 7f2e20c00640 1 --2- 10.20.193.58:0/2354291681 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2e1c056550 0x7f2e1c15e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:57.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.987+0000 7f2e20c00640 1 -- 10.20.193.58:0/2354291681 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2e1c15c040 msgr2=0x7f2e1c058b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:57.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.987+0000 7f2e20c00640 1 --2- 10.20.193.58:0/2354291681 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2e1c15c040 0x7f2e1c058b20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:57.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.987+0000 7f2e20c00640 1 -- 10.20.193.58:0/2354291681 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0c009570 con 0x7f2e1c05d370 2026-02-23T06:23:57.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.987+0000 7f2e21c02640 1 --2- 10.20.193.58:0/2354291681 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2e1c15c040 0x7f2e1c058b20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:23:57.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.987+0000 7f2e20c00640 1 --2- 10.20.193.58:0/2354291681 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e1c05d370 0x7f2e1c0585e0 secure :-1 s=READY pgs=249 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e1000d950 tx=0x7f2e1000de20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:57.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.987+0000 7f2e09ffb640 1 -- 10.20.193.58:0/2354291681 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e10004500 con 0x7f2e1c05d370 2026-02-23T06:23:57.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.987+0000 7f2e22403640 1 -- 10.20.193.58:0/2354291681 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e1c156ab0 con 0x7f2e1c05d370 2026-02-23T06:23:57.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.987+0000 7f2e09ffb640 1 -- 10.20.193.58:0/2354291681 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e10009820 con 0x7f2e1c05d370 2026-02-23T06:23:57.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.987+0000 7f2e09ffb640 1 -- 10.20.193.58:0/2354291681 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e10009c50 con 0x7f2e1c05d370 2026-02-23T06:23:57.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.987+0000 7f2e22403640 1 -- 10.20.193.58:0/2354291681 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e1c157070 con 0x7f2e1c05d370 2026-02-23T06:23:57.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.988+0000 7f2deb7fe640 1 --2- 10.20.193.58:0/2354291681 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e1c15d2f0 0x7f2e1c126b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:57.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.988+0000 7f2deb7fe640 1 -- 10.20.193.58:0/2354291681 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c05b620 con 0x7f2e1c15d2f0 2026-02-23T06:23:57.985 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.988+0000 7f2e21401640 1 --2- 10.20.193.58:0/2354291681 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e1c15d2f0 0x7f2e1c126b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:57.985 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.988+0000 7f2e21401640 1 -- 10.20.193.58:0/2354291681 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2e1c05d9c0 con 0x7f2e1c15d2f0 2026-02-23T06:23:57.985 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.988+0000 7f2e21401640 1 --2- 10.20.193.58:0/2354291681 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e1c15d2f0 0x7f2e1c126b10 secure :-1 s=READY pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e0c004740 tx=0x7f2e0c0028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:57.985 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.989+0000 7f2e09ffb640 1 -- 10.20.193.58:0/2354291681 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e0c03d050 con 0x7f2e1c15d2f0 2026-02-23T06:23:57.985 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.989+0000 7f2e09ffb640 1 -- 10.20.193.58:0/2354291681 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f2e0c03e040 con 0x7f2e1c15d2f0 2026-02-23T06:23:57.985 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.989+0000 7f2e09ffb640 1 -- 10.20.193.58:0/2354291681 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e1c15d2f0 msgr2=0x7f2e1c126b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:57.985 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.989+0000 7f2e09ffb640 1 --2- 10.20.193.58:0/2354291681 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e1c15d2f0 0x7f2e1c126b10 secure :-1 s=READY pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e0c004740 tx=0x7f2e0c0028d0 comp rx=0 tx=0).stop 2026-02-23T06:23:57.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.989+0000 7f2e09ffb640 1 -- 10.20.193.58:0/2354291681 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e1c15d2f0 msgr2=0x7f2e1c126b10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:23:57.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.989+0000 7f2e09ffb640 1 --2- 10.20.193.58:0/2354291681 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e1c15d2f0 0x7f2e1c126b10 unknown :-1 s=CLOSED pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:57.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.989+0000 7f2e09ffb640 1 -- 10.20.193.58:0/2354291681 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f2e100026a0 con 0x7f2e1c05d370 2026-02-23T06:23:57.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.990+0000 7f2e09ffb640 1 --2- 10.20.193.58:0/2354291681 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2dec07a3c0 0x7f2dec09a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:57.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.990+0000 7f2e09ffb640 1 -- 10.20.193.58:0/2354291681 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f2e1009d9b0 con 0x7f2e1c05d370 2026-02-23T06:23:57.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.990+0000 7f2e21401640 1 --2- 10.20.193.58:0/2354291681 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2dec07a3c0 0x7f2dec09a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:57.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.991+0000 7f2e21401640 1 --2- 10.20.193.58:0/2354291681 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2dec07a3c0 0x7f2dec09a870 secure :-1 s=READY pgs=150 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e0c0098a0 tx=0x7f2e0c031030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:57.987 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.992+0000 7f2deb7fe640 1 --2- 10.20.193.58:0/2354291681 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e1c15f500 0x7f2e1c127050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:57.987 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.992+0000 7f2deb7fe640 1 -- 10.20.193.58:0/2354291681 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c129ad0 con 0x7f2e1c15f500 2026-02-23T06:23:57.987 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.993+0000 7f2e21c02640 1 --2- 10.20.193.58:0/2354291681 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e1c15f500 0x7f2e1c127050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:57.987 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.993+0000 7f2e21c02640 1 -- 10.20.193.58:0/2354291681 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2e1c056330 con 0x7f2e1c15f500 2026-02-23T06:23:57.988 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.994+0000 7f2e21c02640 1 --2- 10.20.193.58:0/2354291681 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e1c15f500 0x7f2e1c127050 secure :-1 s=READY pgs=251 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e18003a80 tx=0x7f2e18003f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:57.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.994+0000 7f2e09ffb640 1 -- 10.20.193.58:0/2354291681 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e18012e80 con 0x7f2e1c15f500 2026-02-23T06:23:57.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.994+0000 7f2e09ffb640 1 -- 10.20.193.58:0/2354291681 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5556 (secure 0 0 0) 0x7f2e1801a430 con 0x7f2e1c15f500 2026-02-23T06:23:57.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.994+0000 7f2e09ffb640 1 -- 10.20.193.58:0/2354291681 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e1c15f500 msgr2=0x7f2e1c127050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:57.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.994+0000 7f2e09ffb640 1 --2- 10.20.193.58:0/2354291681 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e1c15f500 0x7f2e1c127050 secure :-1 s=READY pgs=251 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e18003a80 tx=0x7f2e18003f50 comp rx=0 tx=0).stop 2026-02-23T06:23:57.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.994+0000 7f2e09ffb640 1 -- 10.20.193.58:0/2354291681 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e1c15f500 msgr2=0x7f2e1c127050 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:23:57.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.994+0000 7f2e09ffb640 1 --2- 10.20.193.58:0/2354291681 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e1c15f500 0x7f2e1c127050 secure :-1 s=CLOSED pgs=251 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e18003a80 tx=0x7f2e18003f50 comp rx=0 tx=0).stop 2026-02-23T06:23:57.989 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:23:57.989 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:23:57.990 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:23:57.990 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:23:57.990 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 20, 2026-02-23T06:23:57.990 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 176040, 2026-02-23T06:23:57.990 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:23:57.990 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:23:57.990 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:23:57.990 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:23:57.990 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:57.990 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 12, 2026-02-23T06:23:57.990 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:23:57.990 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:23:57.991 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:23:57.991 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:23:57.991 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:23:57.991 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:23:57.991 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:23:57.991 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:23:57.991 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:23:57.991 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:23:57.991 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:23:57.991 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:23:57.991 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:23:57.991 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:23:57.992 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:23:57.992 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:23:57.992 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:57.992 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:23:57.992 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:23:57.992 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:23:57.992 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:23:57.992 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:23:57.992 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:23:57.992 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:23:57.992 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:23:57.992 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:23:57.992 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:23:57.993 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:23:57.993 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:23:57.993 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:23:57.993 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:23:57.993 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:23:57.993 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:57.993 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:57.993 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:23:57.993 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:23:57.993 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:23:57.993 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:23:57.993 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:23:57.993 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:23:57.994 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:23:57.994 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:23:57.994 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:23:57.994 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:23:57.994 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:23:57.994 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:23:57.994 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:23:57.994 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:23:57.994 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:23:57.994 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:23:57.994 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:23:57.994 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:23:57.994 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:23:57.995 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:23:57.995 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:23:57.995 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:23:57.995 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:23:57.995 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:23:57.995 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:23:57.995 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:23:57.995 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:23:57.995 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:23:57.995 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:23:57.995 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:23:57.995 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:57.995 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:23:57.996 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:57.996 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:23:57.996 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:57.996 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:23:57.996 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:23:57.996 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:23:57.996 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:23:57.996 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:57.996 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:23:57.996 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:23:57.996 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:57.996 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:57.996 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:57.997 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:23:57.997 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:23:57.997 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:57.997 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:57.997 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:57.997 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:57.997 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:23:57.997 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:23:57.997 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:23:57.997 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:23:57.997 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:23:57.997 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:23:57.997 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:57.998 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:57.998 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:23:57.998 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:23:57.998 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:23:57.998 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:23:57.998 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:57.998 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:23:57.998 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:23:57.998 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:57.998 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:57.998 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:57.998 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:23:57.998 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:23:57.999 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:57.999 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:57.999 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:57.999 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:57.999 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:23:57.999 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:23:57.999 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:23:57.999 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:23:57.999 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:23:57.999 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:23:57.999 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:57.999 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:57.999 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:23:58.000 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:23:58.000 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:23:58.000 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:23:58.000 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:58.000 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:23:58.000 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:23:58.000 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:58.000 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:58.000 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:58.000 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:23:58.000 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:23:58.000 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:58.000 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:58.001 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:58.001 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:58.001 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:23:58.001 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:23:58.001 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:23:58.001 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:23:58.001 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:23:58.001 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:23:58.001 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:58.001 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:58.001 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:58.001 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:23:58.001 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:23:58.001 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:58.002 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:58.002 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:58.002 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:23:58.002 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:58.002 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:58.002 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:23:58.002 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:58.002 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:58.002 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:58.002 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:23:58.002 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:58.002 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:58.002 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:23:58.003 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:58.003 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:58.003 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:58.003 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:23:58.003 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:58.003 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:58.003 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:23:58.003 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:58.003 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:23:58.003 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:23:58.003 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:23:58.003 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:58.003 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:58.004 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:58.004 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:58.004 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:23:58.004 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:58.004 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:58.004 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:23:58.004 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:58.004 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:58.004 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:58.004 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:23:58.004 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:58.004 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:58.004 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:58.004 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:23:58.005 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:23:58.006 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.994+0000 7f2deb7fe640 1 -- 10.20.193.58:0/2354291681 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2dec07a3c0 msgr2=0x7f2dec09a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:58.006 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.994+0000 7f2deb7fe640 1 --2- 10.20.193.58:0/2354291681 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2dec07a3c0 0x7f2dec09a870 secure :-1 s=READY pgs=150 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e0c0098a0 tx=0x7f2e0c031030 comp rx=0 tx=0).stop 2026-02-23T06:23:58.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.994+0000 7f2deb7fe640 1 -- 10.20.193.58:0/2354291681 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e1c05d370 msgr2=0x7f2e1c0585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:58.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.994+0000 7f2deb7fe640 1 --2- 10.20.193.58:0/2354291681 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e1c05d370 0x7f2e1c0585e0 secure :-1 s=READY pgs=249 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e1000d950 tx=0x7f2e1000de20 comp rx=0 tx=0).stop 2026-02-23T06:23:58.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.994+0000 7f2e21c02640 1 -- 10.20.193.58:0/2354291681 reap_dead start 2026-02-23T06:23:58.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.994+0000 7f2deb7fe640 1 -- 10.20.193.58:0/2354291681 shutdown_connections 2026-02-23T06:23:58.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.994+0000 7f2deb7fe640 1 -- 10.20.193.58:0/2354291681 >> 10.20.193.58:0/2354291681 conn(0x7f2e1c0b3c20 msgr2=0x7f2e1c15a460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:58.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.994+0000 7f2deb7fe640 1 -- 10.20.193.58:0/2354291681 shutdown_connections 2026-02-23T06:23:58.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:57.994+0000 7f2deb7fe640 1 -- 10.20.193.58:0/2354291681 wait complete. 2026-02-23T06:23:58.007 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:23:58.008 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:23:58.008 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:23:58.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.137+0000 7f113d94b640 1 -- 10.20.193.58:0/3950755543 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f11380b6440 msgr2=0x7f11380ba2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:58.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.137+0000 7f113d94b640 1 --2- 10.20.193.58:0/3950755543 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f11380b6440 0x7f11380ba2d0 secure :-1 s=READY pgs=280 gs=2 cs=0 l=1 c_cookie=12880544202903465347 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1120005e70 tx=0x7f112002f290 comp rx=0 tx=0).stop 2026-02-23T06:23:58.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.137+0000 7f113d94b640 1 -- 10.20.193.58:0/3950755543 shutdown_connections 2026-02-23T06:23:58.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.137+0000 7f113d94b640 1 --2- 10.20.193.58:0/3950755543 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11380bb0b0 0x7f113815b620 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:58.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.137+0000 7f113d94b640 1 --2- 10.20.193.58:0/3950755543 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f11380b6440 0x7f11380ba2d0 unknown :-1 s=CLOSED pgs=280 gs=2 cs=0 l=1 c_cookie=12880544202903465347 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:58.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.137+0000 7f113d94b640 1 -- 10.20.193.58:0/3950755543 >> 10.20.193.58:0/3950755543 conn(0x7f1138054e40 msgr2=0x7f1138057b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:58.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.137+0000 7f113d94b640 1 -- 10.20.193.58:0/3950755543 shutdown_connections 2026-02-23T06:23:58.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.137+0000 7f113d94b640 1 -- 10.20.193.58:0/3950755543 wait complete. 2026-02-23T06:23:58.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.138+0000 7f113d94b640 1 Processor -- start 2026-02-23T06:23:58.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.139+0000 7f113d94b640 1 -- start start 2026-02-23T06:23:58.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.139+0000 7f113d94b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f11380b6440 0x7f113813d4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:58.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.139+0000 7f113d94b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f11380bb0b0 0x7f113813a240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:58.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.139+0000 7f113d94b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11381688d0 0x7f113813a780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:58.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.139+0000 7f113d94b640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f113813da00 con 0x7f11380b6440 2026-02-23T06:23:58.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.139+0000 7f113d94b640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f113813bc10 con 0x7f11380bb0b0 2026-02-23T06:23:58.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.139+0000 7f113d94b640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f113812c010 con 0x7f11381688d0 2026-02-23T06:23:58.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.139+0000 7f113c949640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f11380b6440 0x7f113813d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:58.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.139+0000 7f113c949640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f11380b6440 0x7f113813d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:45464/0 (socket says 10.20.193.58:45464) 2026-02-23T06:23:58.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.139+0000 7f113c949640 1 -- 10.20.193.58:0/1965086242 learned_addr learned my addr 10.20.193.58:0/1965086242 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:23:58.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.139+0000 7f112ffff640 1 --2- 10.20.193.58:0/1965086242 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f11380bb0b0 0x7f113813a240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:58.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.139+0000 7f113d14a640 1 --2- 10.20.193.58:0/1965086242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11381688d0 0x7f113813a780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:58.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.140+0000 7f113c949640 1 -- 10.20.193.58:0/1965086242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11381688d0 msgr2=0x7f113813a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:58.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.140+0000 7f113c949640 1 --2- 10.20.193.58:0/1965086242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11381688d0 0x7f113813a780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:58.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.140+0000 7f113c949640 1 -- 10.20.193.58:0/1965086242 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f11380bb0b0 msgr2=0x7f113813a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:58.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.140+0000 7f113c949640 1 --2- 10.20.193.58:0/1965086242 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f11380bb0b0 0x7f113813a240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:58.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.140+0000 7f113c949640 1 -- 10.20.193.58:0/1965086242 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1120009570 con 0x7f11380b6440 2026-02-23T06:23:58.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.140+0000 7f113c949640 1 --2- 10.20.193.58:0/1965086242 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f11380b6440 0x7f113813d4c0 secure :-1 s=READY pgs=281 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f112800c500 tx=0x7f112800c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:58.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.140+0000 7f112d7fa640 1 -- 10.20.193.58:0/1965086242 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1128004250 con 0x7f11380b6440 2026-02-23T06:23:58.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.140+0000 7f113d94b640 1 -- 10.20.193.58:0/1965086242 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f113813e300 con 0x7f11380b6440 2026-02-23T06:23:58.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.140+0000 7f112d7fa640 1 -- 10.20.193.58:0/1965086242 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11280044a0 con 0x7f11380b6440 2026-02-23T06:23:58.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.140+0000 7f112d7fa640 1 -- 10.20.193.58:0/1965086242 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1128006b10 con 0x7f11380b6440 2026-02-23T06:23:58.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.140+0000 7f113d94b640 1 -- 10.20.193.58:0/1965086242 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f113813e040 con 0x7f11380b6440 2026-02-23T06:23:58.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.141+0000 7f113d94b640 1 --2- 10.20.193.58:0/1965086242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f113813b2c0 0x7f113813c080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:58.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.141+0000 7f113d94b640 1 -- 10.20.193.58:0/1965086242 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f11380b9ad0 con 0x7f113813b2c0 2026-02-23T06:23:58.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.141+0000 7f112ffff640 1 --2- 10.20.193.58:0/1965086242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f113813b2c0 0x7f113813c080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:58.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.142+0000 7f112ffff640 1 -- 10.20.193.58:0/1965086242 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f11380b15f0 con 0x7f113813b2c0 2026-02-23T06:23:58.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.142+0000 7f112ffff640 1 --2- 10.20.193.58:0/1965086242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f113813b2c0 0x7f113813c080 secure :-1 s=READY pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1120004740 tx=0x7f11200028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:58.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.142+0000 7f112d7fa640 1 -- 10.20.193.58:0/1965086242 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f1128003670 con 0x7f11380b6440 2026-02-23T06:23:58.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.143+0000 7f112d7fa640 1 --2- 10.20.193.58:0/1965086242 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f110807a5f0 0x7f110809aaa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:58.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.143+0000 7f112d7fa640 1 -- 10.20.193.58:0/1965086242 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f112809ca70 con 0x7f11380b6440 2026-02-23T06:23:58.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.143+0000 7f112d7fa640 1 -- 10.20.193.58:0/1965086242 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f112003d050 con 0x7f113813b2c0 2026-02-23T06:23:58.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.143+0000 7f112d7fa640 1 -- 10.20.193.58:0/1965086242 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f112003e040 con 0x7f113813b2c0 2026-02-23T06:23:58.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.143+0000 7f112d7fa640 1 -- 10.20.193.58:0/1965086242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f113813b2c0 msgr2=0x7f113813c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:58.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.143+0000 7f112d7fa640 1 --2- 10.20.193.58:0/1965086242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f113813b2c0 0x7f113813c080 secure :-1 s=READY pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1120004740 tx=0x7f11200028d0 comp rx=0 tx=0).stop 2026-02-23T06:23:58.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.143+0000 7f112d7fa640 1 -- 10.20.193.58:0/1965086242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f113813b2c0 msgr2=0x7f113813c080 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:23:58.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.143+0000 7f112d7fa640 1 --2- 10.20.193.58:0/1965086242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f113813b2c0 0x7f113813c080 secure :-1 s=CLOSED pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1120004740 tx=0x7f11200028d0 comp rx=0 tx=0).stop 2026-02-23T06:23:58.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.144+0000 7f113d14a640 1 --2- 10.20.193.58:0/1965086242 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f110807a5f0 0x7f110809aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:58.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.144+0000 7f113d14a640 1 --2- 10.20.193.58:0/1965086242 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f110807a5f0 0x7f110809aaa0 secure :-1 s=READY pgs=151 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1134005820 tx=0x7f113400a310 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:58.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.147+0000 7f113d94b640 1 --2- 10.20.193.58:0/1965086242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f113813b800 0x7f113813c5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:58.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.147+0000 7f113d94b640 1 -- 10.20.193.58:0/1965086242 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f113813bd50 con 0x7f113813b800 2026-02-23T06:23:58.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.148+0000 7f112ffff640 1 --2- 10.20.193.58:0/1965086242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f113813b800 0x7f113813c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:58.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.148+0000 7f112ffff640 1 -- 10.20.193.58:0/1965086242 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f113813cb00 con 0x7f113813b800 2026-02-23T06:23:58.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.149+0000 7f112ffff640 1 --2- 10.20.193.58:0/1965086242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f113813b800 0x7f113813c5c0 secure :-1 s=READY pgs=15 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f112002ff80 tx=0x7f1120009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:58.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.149+0000 7f112d7fa640 1 -- 10.20.193.58:0/1965086242 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1120052070 con 0x7f113813b800 2026-02-23T06:23:58.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.149+0000 7f112d7fa640 1 -- 10.20.193.58:0/1965086242 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4911 (secure 0 0 0) 0x7f1120038c10 con 0x7f113813b800 2026-02-23T06:23:58.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.149+0000 7f112d7fa640 1 -- 10.20.193.58:0/1965086242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f113813b800 msgr2=0x7f113813c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:58.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.149+0000 7f112d7fa640 1 --2- 10.20.193.58:0/1965086242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f113813b800 0x7f113813c5c0 secure :-1 s=READY pgs=15 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f112002ff80 tx=0x7f1120009310 comp rx=0 tx=0).stop 2026-02-23T06:23:58.145 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:23:58.145 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:23:58.145 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:23:58.145 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:23:58.145 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 20, 2026-02-23T06:23:58.145 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 36691, 2026-02-23T06:23:58.145 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:23:58.145 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:23:58.145 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:23:58.145 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:23:58.146 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:58.146 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 12, 2026-02-23T06:23:58.146 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:23:58.146 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:23:58.146 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:23:58.146 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:23:58.146 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:23:58.146 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:23:58.146 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:23:58.146 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:23:58.146 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:23:58.146 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:23:58.147 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:23:58.147 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:23:58.147 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:23:58.147 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:23:58.147 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:23:58.147 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:23:58.147 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:58.147 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:23:58.147 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:23:58.147 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:23:58.147 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:23:58.147 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:23:58.148 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:23:58.148 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:23:58.148 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:23:58.148 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:23:58.148 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:23:58.148 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:23:58.148 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:23:58.148 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:23:58.148 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:23:58.148 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:23:58.148 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:58.148 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:58.149 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:23:58.149 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:23:58.149 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:23:58.149 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:23:58.149 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:23:58.149 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:23:58.149 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:23:58.149 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:23:58.149 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:23:58.149 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:23:58.149 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:23:58.149 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:23:58.150 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:23:58.150 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:23:58.150 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:23:58.150 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:23:58.150 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:23:58.150 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:23:58.150 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:23:58.150 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:23:58.150 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:23:58.150 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:23:58.150 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:23:58.150 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:23:58.150 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:23:58.151 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:23:58.151 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:23:58.151 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:23:58.151 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:23:58.151 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:23:58.151 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:58.151 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:23:58.151 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:58.151 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:23:58.151 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:58.151 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:23:58.151 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:23:58.152 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:23:58.152 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:23:58.152 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:58.152 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:23:58.152 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:23:58.152 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:58.152 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:58.152 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:58.152 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:23:58.152 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:23:58.152 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:58.152 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:58.152 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:58.153 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:58.153 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:23:58.153 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:23:58.153 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:23:58.153 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:23:58.153 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:23:58.153 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:23:58.153 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:58.153 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:58.153 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:23:58.153 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:23:58.154 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:23:58.154 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:23:58.154 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:58.154 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:23:58.154 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:23:58.154 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:58.154 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:58.154 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:58.154 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:23:58.154 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:23:58.154 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:58.154 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:58.154 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:58.155 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:58.155 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:23:58.155 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:23:58.155 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:23:58.155 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:23:58.155 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:23:58.155 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:23:58.155 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:58.155 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:58.155 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:23:58.155 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:23:58.155 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:23:58.155 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:23:58.156 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:58.156 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:23:58.156 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:23:58.156 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:58.156 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:58.156 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:58.156 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:23:58.156 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:23:58.156 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:23:58.156 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:58.156 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:58.156 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:58.157 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:23:58.157 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:23:58.157 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:23:58.157 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:23:58.157 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:23:58.157 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:23:58.157 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:58.157 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:58.157 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:58.157 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:23:58.157 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:23:58.158 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:58.158 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:58.158 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:58.158 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:23:58.158 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:58.158 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:23:58.158 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:23:58.158 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:23:58.158 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:23:58.158 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:23:58.159 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:23:58.159 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:23:58.159 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:23:58.159 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:23:58.159 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:23:58.159 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:23:58.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.149+0000 7f112d7fa640 1 -- 10.20.193.58:0/1965086242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f113813b800 msgr2=0x7f113813c5c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:23:58.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.149+0000 7f112d7fa640 1 --2- 10.20.193.58:0/1965086242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f113813b800 0x7f113813c5c0 secure :-1 s=CLOSED pgs=15 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f112002ff80 tx=0x7f1120009310 comp rx=0 tx=0).stop 2026-02-23T06:23:58.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.149+0000 7f113d94b640 1 -- 10.20.193.58:0/1965086242 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f110807a5f0 msgr2=0x7f110809aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:58.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.149+0000 7f113d94b640 1 --2- 10.20.193.58:0/1965086242 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f110807a5f0 0x7f110809aaa0 secure :-1 s=READY pgs=151 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1134005820 tx=0x7f113400a310 comp rx=0 tx=0).stop 2026-02-23T06:23:58.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.149+0000 7f113d94b640 1 -- 10.20.193.58:0/1965086242 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f11380b6440 msgr2=0x7f113813d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:58.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.149+0000 7f113d94b640 1 --2- 10.20.193.58:0/1965086242 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f11380b6440 0x7f113813d4c0 secure :-1 s=READY pgs=281 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f112800c500 tx=0x7f112800c9d0 comp rx=0 tx=0).stop 2026-02-23T06:23:58.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.149+0000 7f113d14a640 1 -- 10.20.193.58:0/1965086242 reap_dead start 2026-02-23T06:23:58.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.149+0000 7f113d14a640 1 -- 10.20.193.58:0/1965086242 reap_dead start 2026-02-23T06:23:58.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.149+0000 7f113d94b640 1 -- 10.20.193.58:0/1965086242 shutdown_connections 2026-02-23T06:23:58.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.149+0000 7f113d94b640 1 -- 10.20.193.58:0/1965086242 >> 10.20.193.58:0/1965086242 conn(0x7f1138054e40 msgr2=0x7f1138166740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:58.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.150+0000 7f113d94b640 1 -- 10.20.193.58:0/1965086242 shutdown_connections 2026-02-23T06:23:58.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.150+0000 7f113d94b640 1 -- 10.20.193.58:0/1965086242 wait complete. 2026-02-23T06:23:58.163 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:23:58.163 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-23T06:23:58.163 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-23T06:23:58.163 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-23T06:23:58.163 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-23T06:23:58.164 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-23T06:23:58.164 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:23:58.181 INFO:tasks.ceph.mon.a:Stopped 2026-02-23T06:23:58.181 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:23:58.181 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:23:58.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.345+0000 7f88c3fff640 1 -- 10.20.193.58:0/340787532 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f88c415c040 msgr2=0x7f88c405b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:58.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.345+0000 7f88c3fff640 1 --2- 10.20.193.58:0/340787532 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f88c415c040 0x7f88c405b0e0 secure :-1 s=READY pgs=255 gs=3 cs=0 l=1 c_cookie=15179022641709485219 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88b8004740 tx=0x7f88b802f1e0 comp rx=0 tx=0).stop 2026-02-23T06:23:58.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.345+0000 7f88c3fff640 1 -- 10.20.193.58:0/340787532 shutdown_connections 2026-02-23T06:23:58.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.345+0000 7f88c3fff640 1 --2- 10.20.193.58:0/340787532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88c4056550 0x7f88c405ce30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:58.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.345+0000 7f88c3fff640 1 --2- 10.20.193.58:0/340787532 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f88c415c040 0x7f88c405b0e0 unknown :-1 s=CLOSED pgs=255 gs=3 cs=0 l=1 c_cookie=15179022641709485219 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:58.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.345+0000 7f88c3fff640 1 -- 10.20.193.58:0/340787532 >> 10.20.193.58:0/340787532 conn(0x7f88c40b3c20 msgr2=0x7f88c40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:58.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.345+0000 7f88c3fff640 1 -- 10.20.193.58:0/340787532 shutdown_connections 2026-02-23T06:23:58.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.345+0000 7f88c3fff640 1 -- 10.20.193.58:0/340787532 wait complete. 2026-02-23T06:23:58.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.347+0000 7f88c3fff640 1 Processor -- start 2026-02-23T06:23:58.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.347+0000 7f88c3fff640 1 -- start start 2026-02-23T06:23:58.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.347+0000 7f88c3fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f88c4056550 0x7f88c4155110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:58.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.347+0000 7f88c3fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f88c405d370 0x7f88c415f1a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:58.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.347+0000 7f88c3fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88c415c040 0x7f88c4058810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:58.345 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.347+0000 7f88c3fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f88c415dda0 con 0x7f88c405d370 2026-02-23T06:23:58.345 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.347+0000 7f88c3fff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f88c415ea10 con 0x7f88c4056550 2026-02-23T06:23:58.345 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.347+0000 7f88c3fff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f88c415dfd0 con 0x7f88c415c040 2026-02-23T06:23:58.345 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.347+0000 7f88c27fc640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f88c405d370 msgr2=0x7f88c415f1a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:23:58.345 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.347+0000 7f88c27fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f88c405d370 0x7f88c415f1a0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:23:58.345 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.347+0000 7f88c2ffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f88c4056550 0x7f88c4155110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:58.345 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.348+0000 7f88c2ffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f88c4056550 0x7f88c4155110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:56026/0 (socket says 10.20.193.58:56026) 2026-02-23T06:23:58.345 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.348+0000 7f88c37fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88c415c040 0x7f88c4058810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:58.345 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.348+0000 7f88c2ffd640 1 -- 10.20.193.58:0/2349435176 learned_addr learned my addr 10.20.193.58:0/2349435176 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:23:58.346 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.348+0000 7f88c2ffd640 1 -- 10.20.193.58:0/2349435176 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88c415c040 msgr2=0x7f88c4058810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:58.346 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.348+0000 7f88c2ffd640 1 --2- 10.20.193.58:0/2349435176 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88c415c040 0x7f88c4058810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:58.346 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.348+0000 7f88c2ffd640 1 -- 10.20.193.58:0/2349435176 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f88c405d370 msgr2=0x7f88c415f1a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:23:58.346 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.348+0000 7f88c2ffd640 1 --2- 10.20.193.58:0/2349435176 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f88c405d370 0x7f88c415f1a0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:58.346 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.348+0000 7f88c2ffd640 1 -- 10.20.193.58:0/2349435176 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b80094b0 con 0x7f88c4056550 2026-02-23T06:23:58.346 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.348+0000 7f88c2ffd640 1 --2- 10.20.193.58:0/2349435176 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f88c4056550 0x7f88c4155110 secure :-1 s=READY pgs=256 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88b8009230 tx=0x7f88b80028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:58.346 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.348+0000 7f88a37fe640 1 -- 10.20.193.58:0/2349435176 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f88b8038470 con 0x7f88c4056550 2026-02-23T06:23:58.346 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.348+0000 7f88c3fff640 1 -- 10.20.193.58:0/2349435176 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88c4201ba0 con 0x7f88c4056550 2026-02-23T06:23:58.346 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.348+0000 7f88a37fe640 1 -- 10.20.193.58:0/2349435176 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f88b80386c0 con 0x7f88c4056550 2026-02-23T06:23:58.346 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.348+0000 7f88a37fe640 1 -- 10.20.193.58:0/2349435176 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f88b8038a70 con 0x7f88c4056550 2026-02-23T06:23:58.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.348+0000 7f88c3fff640 1 -- 10.20.193.58:0/2349435176 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88c4162780 con 0x7f88c4056550 2026-02-23T06:23:58.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.349+0000 7f88c3fff640 1 -- 10.20.193.58:0/2349435176 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88c4201970 con 0x7f88c4056550 2026-02-23T06:23:58.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.350+0000 7f88a37fe640 1 -- 10.20.193.58:0/2349435176 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f88b8038bd0 con 0x7f88c4056550 2026-02-23T06:23:58.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.351+0000 7f88a37fe640 1 --2- 10.20.193.58:0/2349435176 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f889007a5b0 0x7f889009aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:23:58.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.351+0000 7f88a37fe640 1 -- 10.20.193.58:0/2349435176 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f88b80c3660 con 0x7f88c4056550 2026-02-23T06:23:58.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.352+0000 7f88a37fe640 1 -- 10.20.193.58:0/2349435176 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f88b8086910 con 0x7f88c4056550 2026-02-23T06:23:58.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.352+0000 7f88c27fc640 1 --2- 10.20.193.58:0/2349435176 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f889007a5b0 0x7f889009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:23:58.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.352+0000 7f88c27fc640 1 --2- 10.20.193.58:0/2349435176 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f889007a5b0 0x7f889009aa60 secure :-1 s=READY pgs=152 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88ac005b30 tx=0x7f88ac009310 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:23:58.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.507+0000 7f88c3fff640 1 -- 10.20.193.58:0/2349435176 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f88c405d9a0 con 0x7f88c4056550 2026-02-23T06:23:58.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.508+0000 7f88a37fe640 1 -- 10.20.193.58:0/2349435176 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f88c405d9a0 con 0x7f88c4056550 2026-02-23T06:23:58.503 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:23:58.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.509+0000 7f88c3fff640 1 -- 10.20.193.58:0/2349435176 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f889007a5b0 msgr2=0x7f889009aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:58.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.509+0000 7f88c3fff640 1 --2- 10.20.193.58:0/2349435176 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f889007a5b0 0x7f889009aa60 secure :-1 s=READY pgs=152 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88ac005b30 tx=0x7f88ac009310 comp rx=0 tx=0).stop 2026-02-23T06:23:58.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.509+0000 7f88c3fff640 1 -- 10.20.193.58:0/2349435176 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f88c4056550 msgr2=0x7f88c4155110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:23:58.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.509+0000 7f88c3fff640 1 --2- 10.20.193.58:0/2349435176 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f88c4056550 0x7f88c4155110 secure :-1 s=READY pgs=256 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88b8009230 tx=0x7f88b80028d0 comp rx=0 tx=0).stop 2026-02-23T06:23:58.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.509+0000 7f88c3fff640 1 -- 10.20.193.58:0/2349435176 shutdown_connections 2026-02-23T06:23:58.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.509+0000 7f88c3fff640 1 --2- 10.20.193.58:0/2349435176 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f889007a5b0 0x7f889009aa60 unknown :-1 s=CLOSED pgs=152 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:58.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.509+0000 7f88c3fff640 1 --2- 10.20.193.58:0/2349435176 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88c415c040 0x7f88c4058810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:58.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.509+0000 7f88c3fff640 1 --2- 10.20.193.58:0/2349435176 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f88c405d370 0x7f88c415f1a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:58.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.509+0000 7f88c3fff640 1 --2- 10.20.193.58:0/2349435176 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f88c4056550 0x7f88c4155110 unknown :-1 s=CLOSED pgs=256 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:23:58.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.509+0000 7f88c3fff640 1 -- 10.20.193.58:0/2349435176 >> 10.20.193.58:0/2349435176 conn(0x7f88c40b3c20 msgr2=0x7f88c40b5810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:23:58.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.509+0000 7f88c3fff640 1 -- 10.20.193.58:0/2349435176 shutdown_connections 2026-02-23T06:23:58.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:23:58.509+0000 7f88c3fff640 1 -- 10.20.193.58:0/2349435176 wait complete. 2026-02-23T06:24:01.516 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:24:01.638 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.643+0000 7f4140fd2640 1 -- 10.20.193.58:0/2499351707 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f413c056550 msgr2=0x7f413c05ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:01.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.643+0000 7f4140fd2640 1 --2- 10.20.193.58:0/2499351707 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f413c056550 0x7f413c05ce30 secure :-1 s=READY pgs=25 gs=4 cs=0 l=1 c_cookie=13364619944472957888 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f412c005e70 tx=0x7f412c02f290 comp rx=0 tx=0).stop 2026-02-23T06:24:01.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.643+0000 7f4140fd2640 1 -- 10.20.193.58:0/2499351707 shutdown_connections 2026-02-23T06:24:01.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.643+0000 7f4140fd2640 1 --2- 10.20.193.58:0/2499351707 >> v2:10.20.193.93:3300/0 conn(0x7f413c05d370 0x7f413c0b5680 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:01.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.643+0000 7f4140fd2640 1 --2- 10.20.193.58:0/2499351707 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f413c056550 0x7f413c05ce30 unknown :-1 s=CLOSED pgs=25 gs=4 cs=0 l=1 c_cookie=13364619944472957888 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:01.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.643+0000 7f4140fd2640 1 -- 10.20.193.58:0/2499351707 >> 10.20.193.58:0/2499351707 conn(0x7f413c0b3c20 msgr2=0x7f413c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:24:01.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.643+0000 7f4140fd2640 1 -- 10.20.193.58:0/2499351707 shutdown_connections 2026-02-23T06:24:01.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.643+0000 7f4140fd2640 1 -- 10.20.193.58:0/2499351707 wait complete. 2026-02-23T06:24:01.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.644+0000 7f4140fd2640 1 Processor -- start 2026-02-23T06:24:01.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.644+0000 7f4140fd2640 1 -- start start 2026-02-23T06:24:01.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.645+0000 7f4140fd2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f413c056550 0x7f413c15f140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:01.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.645+0000 7f4140fd2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f413c05d370 0x7f413c058810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:01.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.645+0000 7f4140fd2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f413c15c040 0x7f413c1514f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:01.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.645+0000 7f4140fd2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f413c162670 con 0x7f413c05d370 2026-02-23T06:24:01.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.645+0000 7f4140fd2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f413c161940 con 0x7f413c15c040 2026-02-23T06:24:01.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.645+0000 7f4140fd2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f413c15c8f0 con 0x7f413c056550 2026-02-23T06:24:01.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.645+0000 7f413affd640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f413c05d370 msgr2=0x7f413c058810 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:24:01.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.645+0000 7f413affd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f413c05d370 0x7f413c058810 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:24:01.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.645+0000 7f413b7fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f413c056550 0x7f413c15f140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:01.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.645+0000 7f413bfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f413c15c040 0x7f413c1514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:01.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.645+0000 7f413b7fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f413c056550 0x7f413c15f140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:33242/0 (socket says 10.20.193.58:33242) 2026-02-23T06:24:01.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.645+0000 7f413b7fe640 1 -- 10.20.193.58:0/1100287846 learned_addr learned my addr 10.20.193.58:0/1100287846 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:24:01.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.646+0000 7f413bfff640 1 -- 10.20.193.58:0/1100287846 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f413c056550 msgr2=0x7f413c15f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:01.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.646+0000 7f413bfff640 1 --2- 10.20.193.58:0/1100287846 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f413c056550 0x7f413c15f140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:01.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.646+0000 7f413bfff640 1 -- 10.20.193.58:0/1100287846 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f413c05d370 msgr2=0x7f413c058810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:24:01.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.646+0000 7f413bfff640 1 --2- 10.20.193.58:0/1100287846 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f413c05d370 0x7f413c058810 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:01.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.646+0000 7f413bfff640 1 -- 10.20.193.58:0/1100287846 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f413000a590 con 0x7f413c15c040 2026-02-23T06:24:01.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.646+0000 7f413b7fe640 1 --2- 10.20.193.58:0/1100287846 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f413c056550 0x7f413c15f140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:24:01.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.646+0000 7f413bfff640 1 --2- 10.20.193.58:0/1100287846 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f413c15c040 0x7f413c1514f0 secure :-1 s=READY pgs=261 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f413000aef0 tx=0x7f4130003b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:01.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.646+0000 7f4117fff640 1 -- 10.20.193.58:0/1100287846 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f413000fb50 con 0x7f413c15c040 2026-02-23T06:24:01.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.646+0000 7f4117fff640 1 -- 10.20.193.58:0/1100287846 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f413000fcb0 con 0x7f413c15c040 2026-02-23T06:24:01.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.646+0000 7f4117fff640 1 -- 10.20.193.58:0/1100287846 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4130011690 con 0x7f413c15c040 2026-02-23T06:24:01.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.646+0000 7f4140fd2640 1 -- 10.20.193.58:0/1100287846 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f412c009570 con 0x7f413c15c040 2026-02-23T06:24:01.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.647+0000 7f4140fd2640 1 -- 10.20.193.58:0/1100287846 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f413c161ec0 con 0x7f413c15c040 2026-02-23T06:24:01.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.647+0000 7f4140fd2640 1 -- 10.20.193.58:0/1100287846 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f413c1623e0 con 0x7f413c15c040 2026-02-23T06:24:01.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.649+0000 7f4117fff640 1 -- 10.20.193.58:0/1100287846 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f4130020060 con 0x7f413c15c040 2026-02-23T06:24:01.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.650+0000 7f4117fff640 1 --2- 10.20.193.58:0/1100287846 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f410c07a5b0 0x7f410c09aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:01.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.650+0000 7f4117fff640 1 -- 10.20.193.58:0/1100287846 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f413009ed90 con 0x7f413c15c040 2026-02-23T06:24:01.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.650+0000 7f4117fff640 1 -- 10.20.193.58:0/1100287846 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f41300d8680 con 0x7f413c15c040 2026-02-23T06:24:01.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.650+0000 7f413b7fe640 1 --2- 10.20.193.58:0/1100287846 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f410c07a5b0 0x7f410c09aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:01.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.651+0000 7f413b7fe640 1 --2- 10.20.193.58:0/1100287846 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f410c07a5b0 0x7f410c09aa60 secure :-1 s=READY pgs=153 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4128006f50 tx=0x7f4128009210 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:01.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.811+0000 7f4140fd2640 1 -- 10.20.193.58:0/1100287846 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f413c1623e0 con 0x7f413c15c040 2026-02-23T06:24:01.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.811+0000 7f4117fff640 1 -- 10.20.193.58:0/1100287846 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f413c1623e0 con 0x7f413c15c040 2026-02-23T06:24:01.806 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:24:01.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.818+0000 7f4140fd2640 1 -- 10.20.193.58:0/1100287846 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f410c07a5b0 msgr2=0x7f410c09aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:01.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.818+0000 7f4140fd2640 1 --2- 10.20.193.58:0/1100287846 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f410c07a5b0 0x7f410c09aa60 secure :-1 s=READY pgs=153 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4128006f50 tx=0x7f4128009210 comp rx=0 tx=0).stop 2026-02-23T06:24:01.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.818+0000 7f4140fd2640 1 -- 10.20.193.58:0/1100287846 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f413c15c040 msgr2=0x7f413c1514f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:01.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.818+0000 7f4140fd2640 1 --2- 10.20.193.58:0/1100287846 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f413c15c040 0x7f413c1514f0 secure :-1 s=READY pgs=261 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f413000aef0 tx=0x7f4130003b50 comp rx=0 tx=0).stop 2026-02-23T06:24:01.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.818+0000 7f4140fd2640 1 -- 10.20.193.58:0/1100287846 shutdown_connections 2026-02-23T06:24:01.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.818+0000 7f4140fd2640 1 --2- 10.20.193.58:0/1100287846 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f410c07a5b0 0x7f410c09aa60 unknown :-1 s=CLOSED pgs=153 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:01.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.818+0000 7f4140fd2640 1 --2- 10.20.193.58:0/1100287846 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f413c15c040 0x7f413c1514f0 unknown :-1 s=CLOSED pgs=261 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:01.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.818+0000 7f4140fd2640 1 --2- 10.20.193.58:0/1100287846 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f413c05d370 0x7f413c058810 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:01.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.818+0000 7f4140fd2640 1 --2- 10.20.193.58:0/1100287846 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f413c056550 0x7f413c15f140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:01.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.818+0000 7f4140fd2640 1 -- 10.20.193.58:0/1100287846 >> 10.20.193.58:0/1100287846 conn(0x7f413c0b3c20 msgr2=0x7f413c164960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:24:01.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.818+0000 7f4140fd2640 1 -- 10.20.193.58:0/1100287846 shutdown_connections 2026-02-23T06:24:01.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:01.818+0000 7f4140fd2640 1 -- 10.20.193.58:0/1100287846 wait complete. 2026-02-23T06:24:04.828 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:24:04.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.957+0000 7f32faa47640 1 -- 10.20.193.58:0/2335096510 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f32f40b10e0 msgr2=0x7f32f405b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:04.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.957+0000 7f32faa47640 1 --2- 10.20.193.58:0/2335096510 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f32f40b10e0 0x7f32f405b230 secure :-1 s=READY pgs=264 gs=3 cs=0 l=1 c_cookie=11553072499413910634 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32f40b5260 tx=0x7f32e002f240 comp rx=0 tx=0).stop 2026-02-23T06:24:04.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.957+0000 7f32faa47640 1 -- 10.20.193.58:0/2335096510 shutdown_connections 2026-02-23T06:24:04.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.957+0000 7f32faa47640 1 --2- 10.20.193.58:0/2335096510 >> v2:10.20.193.58:3300/0 conn(0x7f32f40b6020 0x7f32f415ce30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:04.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.957+0000 7f32faa47640 1 --2- 10.20.193.58:0/2335096510 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f32f40b10e0 0x7f32f405b230 unknown :-1 s=CLOSED pgs=264 gs=3 cs=0 l=1 c_cookie=11553072499413910634 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:04.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.957+0000 7f32faa47640 1 -- 10.20.193.58:0/2335096510 >> 10.20.193.58:0/2335096510 conn(0x7f32f40561f0 msgr2=0x7f32f40565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:24:04.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.957+0000 7f32faa47640 1 -- 10.20.193.58:0/2335096510 shutdown_connections 2026-02-23T06:24:04.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.957+0000 7f32faa47640 1 -- 10.20.193.58:0/2335096510 wait complete. 2026-02-23T06:24:04.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.958+0000 7f32faa47640 1 Processor -- start 2026-02-23T06:24:04.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.959+0000 7f32faa47640 1 -- start start 2026-02-23T06:24:04.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.959+0000 7f32faa47640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f32f40b10e0 0x7f32f40b0920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:04.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.959+0000 7f32faa47640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f32f40b6020 0x7f32f4164400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:04.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.959+0000 7f32faa47640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f32f4163c70 0x7f32f4165b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:04.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.959+0000 7f32f3fff640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f32f40b10e0 msgr2=0x7f32f40b0920 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:24:04.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.959+0000 7f32faa47640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f32f41659a0 con 0x7f32f40b10e0 2026-02-23T06:24:04.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.959+0000 7f32faa47640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f32f40aff10 con 0x7f32f4163c70 2026-02-23T06:24:04.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.959+0000 7f32faa47640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f32f413f920 con 0x7f32f40b6020 2026-02-23T06:24:04.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.959+0000 7f32f3fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f32f40b10e0 0x7f32f40b0920 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:24:04.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.960+0000 7f32f37fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f32f40b6020 0x7f32f4164400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:04.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.960+0000 7f32f37fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f32f40b6020 0x7f32f4164400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:33250/0 (socket says 10.20.193.58:33250) 2026-02-23T06:24:04.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.960+0000 7f32f37fe640 1 -- 10.20.193.58:0/1086219510 learned_addr learned my addr 10.20.193.58:0/1086219510 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:24:04.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.960+0000 7f32f8fbd640 1 --2- 10.20.193.58:0/1086219510 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f32f4163c70 0x7f32f4165b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:04.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.960+0000 7f32f37fe640 1 -- 10.20.193.58:0/1086219510 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f32f4163c70 msgr2=0x7f32f4165b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:04.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.960+0000 7f32f37fe640 1 --2- 10.20.193.58:0/1086219510 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f32f4163c70 0x7f32f4165b60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:04.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.960+0000 7f32f37fe640 1 -- 10.20.193.58:0/1086219510 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f32f40b10e0 msgr2=0x7f32f40b0920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:24:04.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.960+0000 7f32f37fe640 1 --2- 10.20.193.58:0/1086219510 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f32f40b10e0 0x7f32f40b0920 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:04.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.960+0000 7f32f37fe640 1 -- 10.20.193.58:0/1086219510 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e00094b0 con 0x7f32f40b6020 2026-02-23T06:24:04.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.960+0000 7f32f37fe640 1 --2- 10.20.193.58:0/1086219510 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f32f40b6020 0x7f32f4164400 secure :-1 s=READY pgs=27 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32e400c490 tx=0x7f32e400c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:04.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.961+0000 7f32f0ff9640 1 -- 10.20.193.58:0/1086219510 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f32e4004250 con 0x7f32f40b6020 2026-02-23T06:24:04.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.961+0000 7f32f0ff9640 1 -- 10.20.193.58:0/1086219510 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32e40044a0 con 0x7f32f40b6020 2026-02-23T06:24:04.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.961+0000 7f32f0ff9640 1 -- 10.20.193.58:0/1086219510 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f32e4003930 con 0x7f32f40b6020 2026-02-23T06:24:04.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.961+0000 7f32faa47640 1 -- 10.20.193.58:0/1086219510 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32f4143550 con 0x7f32f40b6020 2026-02-23T06:24:04.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.961+0000 7f32faa47640 1 -- 10.20.193.58:0/1086219510 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f32f40b0120 con 0x7f32f40b6020 2026-02-23T06:24:04.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.961+0000 7f32faa47640 1 -- 10.20.193.58:0/1086219510 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32f4058640 con 0x7f32f40b6020 2026-02-23T06:24:04.959 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.963+0000 7f32f0ff9640 1 -- 10.20.193.58:0/1086219510 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f32e4019070 con 0x7f32f40b6020 2026-02-23T06:24:04.959 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.964+0000 7f32f0ff9640 1 --2- 10.20.193.58:0/1086219510 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f32c407a5a0 0x7f32c409aa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:04.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.964+0000 7f32f0ff9640 1 -- 10.20.193.58:0/1086219510 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f32e409d920 con 0x7f32f40b6020 2026-02-23T06:24:04.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.965+0000 7f32f3fff640 1 --2- 10.20.193.58:0/1086219510 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f32c407a5a0 0x7f32c409aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:04.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.965+0000 7f32f0ff9640 1 -- 10.20.193.58:0/1086219510 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f32e4060b40 con 0x7f32f40b6020 2026-02-23T06:24:04.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:04.966+0000 7f32f3fff640 1 --2- 10.20.193.58:0/1086219510 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f32c407a5a0 0x7f32c409aa50 secure :-1 s=READY pgs=154 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32e0009230 tx=0x7f32e0031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:05.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:05.135+0000 7f32faa47640 1 -- 10.20.193.58:0/1086219510 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f32f40b73d0 con 0x7f32f40b6020 2026-02-23T06:24:05.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:05.136+0000 7f32f0ff9640 1 -- 10.20.193.58:0/1086219510 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f32e4063c60 con 0x7f32f40b6020 2026-02-23T06:24:05.131 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:24:05.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:05.141+0000 7f32faa47640 1 -- 10.20.193.58:0/1086219510 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f32c407a5a0 msgr2=0x7f32c409aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:05.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:05.141+0000 7f32faa47640 1 --2- 10.20.193.58:0/1086219510 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f32c407a5a0 0x7f32c409aa50 secure :-1 s=READY pgs=154 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32e0009230 tx=0x7f32e0031040 comp rx=0 tx=0).stop 2026-02-23T06:24:05.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:05.141+0000 7f32faa47640 1 -- 10.20.193.58:0/1086219510 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f32f40b6020 msgr2=0x7f32f4164400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:05.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:05.141+0000 7f32faa47640 1 --2- 10.20.193.58:0/1086219510 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f32f40b6020 0x7f32f4164400 secure :-1 s=READY pgs=27 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32e400c490 tx=0x7f32e400c960 comp rx=0 tx=0).stop 2026-02-23T06:24:05.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:05.141+0000 7f32faa47640 1 -- 10.20.193.58:0/1086219510 shutdown_connections 2026-02-23T06:24:05.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:05.141+0000 7f32faa47640 1 --2- 10.20.193.58:0/1086219510 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f32c407a5a0 0x7f32c409aa50 unknown :-1 s=CLOSED pgs=154 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:05.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:05.141+0000 7f32faa47640 1 --2- 10.20.193.58:0/1086219510 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f32f4163c70 0x7f32f4165b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:05.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:05.141+0000 7f32faa47640 1 --2- 10.20.193.58:0/1086219510 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f32f40b6020 0x7f32f4164400 unknown :-1 s=CLOSED pgs=27 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:05.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:05.141+0000 7f32faa47640 1 --2- 10.20.193.58:0/1086219510 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f32f40b10e0 0x7f32f40b0920 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:05.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:05.141+0000 7f32faa47640 1 -- 10.20.193.58:0/1086219510 >> 10.20.193.58:0/1086219510 conn(0x7f32f40561f0 msgr2=0x7f32f415be20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:24:05.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:05.141+0000 7f32faa47640 1 -- 10.20.193.58:0/1086219510 shutdown_connections 2026-02-23T06:24:05.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:05.142+0000 7f32faa47640 1 -- 10.20.193.58:0/1086219510 wait complete. 2026-02-23T06:24:08.151 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:24:12.137 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:24:12.141 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:24:12.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.560+0000 7f0b775b5640 1 -- 10.20.193.58:0/2902438653 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b60003a30 msgr2=0x7f0b60003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:12.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.560+0000 7f0b775b5640 1 --2- 10.20.193.58:0/2902438653 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b60003a30 0x7f0b60003e20 secure :-1 s=READY pgs=29 gs=27 cs=0 l=1 c_cookie=11514022510089205704 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b68002a20 tx=0x7f0b68030630 comp rx=0 tx=0).stop 2026-02-23T06:24:12.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.561+0000 7f0b775b5640 1 -- 10.20.193.58:0/2902438653 shutdown_connections 2026-02-23T06:24:12.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.561+0000 7f0b775b5640 1 --2- 10.20.193.58:0/2902438653 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0b60005400 0x7f0b60065a10 unknown :-1 s=CLOSED pgs=0 gs=28 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:12.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.561+0000 7f0b775b5640 1 --2- 10.20.193.58:0/2902438653 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b60004850 0x7f0b60004cc0 unknown :-1 s=CLOSED pgs=0 gs=26 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:12.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.561+0000 7f0b775b5640 1 --2- 10.20.193.58:0/2902438653 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b60003a30 0x7f0b60003e20 unknown :-1 s=CLOSED pgs=29 gs=27 cs=0 l=1 c_cookie=11514022510089205704 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:12.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.561+0000 7f0b775b5640 1 -- 10.20.193.58:0/2902438653 >> 10.20.193.58:0/2902438653 conn(0x7f0b700b3c20 msgr2=0x7f0b700b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:24:12.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.561+0000 7f0b775b5640 1 -- 10.20.193.58:0/2902438653 shutdown_connections 2026-02-23T06:24:12.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.561+0000 7f0b775b5640 1 -- 10.20.193.58:0/2902438653 wait complete. 2026-02-23T06:24:12.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.562+0000 7f0b775b5640 1 Processor -- start 2026-02-23T06:24:12.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.562+0000 7f0b775b5640 1 -- start start 2026-02-23T06:24:12.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.563+0000 7f0b775b5640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b60003a30 0x7f0b701606c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:12.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.563+0000 7f0b775b5640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b60004850 0x7f0b701624f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:12.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.563+0000 7f0b775b5640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0b60005400 0x7f0b70159b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:12.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.563+0000 7f0b775b5640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f0b70056fa0 con 0x7f0b60004850 2026-02-23T06:24:12.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.563+0000 7f0b775b5640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f0b701fe310 con 0x7f0b60005400 2026-02-23T06:24:12.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.563+0000 7f0b775b5640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f0b70056320 con 0x7f0b60003a30 2026-02-23T06:24:12.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.563+0000 7f0b75db2640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b60004850 msgr2=0x7f0b701624f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:24:12.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.563+0000 7f0b75db2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b60004850 0x7f0b701624f0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:24:12.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.563+0000 7f0b765b3640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b60003a30 0x7f0b701606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:12.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.563+0000 7f0b765b3640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b60003a30 0x7f0b701606c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:60172/0 (socket says 10.20.193.58:60172) 2026-02-23T06:24:12.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.563+0000 7f0b765b3640 1 -- 10.20.193.58:0/2832114166 learned_addr learned my addr 10.20.193.58:0/2832114166 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:24:12.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.563+0000 7f0b76db4640 1 --2- 10.20.193.58:0/2832114166 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0b60005400 0x7f0b70159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:12.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.563+0000 7f0b765b3640 1 -- 10.20.193.58:0/2832114166 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0b60005400 msgr2=0x7f0b70159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:12.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.563+0000 7f0b765b3640 1 --2- 10.20.193.58:0/2832114166 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0b60005400 0x7f0b70159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:12.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.563+0000 7f0b765b3640 1 -- 10.20.193.58:0/2832114166 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b60004850 msgr2=0x7f0b701624f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:24:12.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.563+0000 7f0b765b3640 1 --2- 10.20.193.58:0/2832114166 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b60004850 0x7f0b701624f0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:12.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.563+0000 7f0b765b3640 1 -- 10.20.193.58:0/2832114166 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b70056600 con 0x7f0b60003a30 2026-02-23T06:24:12.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.563+0000 7f0b76db4640 1 --2- 10.20.193.58:0/2832114166 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0b60005400 0x7f0b70159b20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:24:12.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.563+0000 7f0b765b3640 1 --2- 10.20.193.58:0/2832114166 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b60003a30 0x7f0b701606c0 secure :-1 s=READY pgs=30 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b68039c60 tx=0x7f0b68039c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:12.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.564+0000 7f0b5affd640 1 -- 10.20.193.58:0/2832114166 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b68044870 con 0x7f0b60003a30 2026-02-23T06:24:12.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.564+0000 7f0b5affd640 1 -- 10.20.193.58:0/2832114166 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b68044ac0 con 0x7f0b60003a30 2026-02-23T06:24:12.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.564+0000 7f0b5affd640 1 -- 10.20.193.58:0/2832114166 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b68042410 con 0x7f0b60003a30 2026-02-23T06:24:12.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.564+0000 7f0b775b5640 1 -- 10.20.193.58:0/2832114166 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b700568e0 con 0x7f0b60003a30 2026-02-23T06:24:12.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.564+0000 7f0b775b5640 1 -- 10.20.193.58:0/2832114166 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b70162a30 con 0x7f0b60003a30 2026-02-23T06:24:12.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.564+0000 7f0b775b5640 1 -- 10.20.193.58:0/2832114166 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b700b6d50 con 0x7f0b60003a30 2026-02-23T06:24:12.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.566+0000 7f0b5affd640 1 -- 10.20.193.58:0/2832114166 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f0b68042570 con 0x7f0b60003a30 2026-02-23T06:24:12.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.566+0000 7f0b5affd640 1 --2- 10.20.193.58:0/2832114166 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0b4007a5b0 0x7f0b4009aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:12.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.566+0000 7f0b5affd640 1 -- 10.20.193.58:0/2832114166 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f0b680c4200 con 0x7f0b60003a30 2026-02-23T06:24:12.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.567+0000 7f0b75db2640 1 --2- 10.20.193.58:0/2832114166 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0b4007a5b0 0x7f0b4009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:12.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.567+0000 7f0b75db2640 1 --2- 10.20.193.58:0/2832114166 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0b4007a5b0 0x7f0b4009aa60 secure :-1 s=READY pgs=155 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b5c005e70 tx=0x7f0b5c005900 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:12.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.568+0000 7f0b5affd640 1 -- 10.20.193.58:0/2832114166 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f0b68087520 con 0x7f0b60003a30 2026-02-23T06:24:12.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.722+0000 7f0b775b5640 1 -- 10.20.193.58:0/2832114166 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0b70056d60 con 0x7f0b60003a30 2026-02-23T06:24:12.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.723+0000 7f0b5affd640 1 -- 10.20.193.58:0/2832114166 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1748 (secure 0 0 0) 0x7f0b6808a640 con 0x7f0b60003a30 2026-02-23T06:24:12.718 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":22,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:24:12.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.724+0000 7f0b775b5640 1 -- 10.20.193.58:0/2832114166 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0b4007a5b0 msgr2=0x7f0b4009aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:12.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.724+0000 7f0b775b5640 1 --2- 10.20.193.58:0/2832114166 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0b4007a5b0 0x7f0b4009aa60 secure :-1 s=READY pgs=155 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b5c005e70 tx=0x7f0b5c005900 comp rx=0 tx=0).stop 2026-02-23T06:24:12.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.724+0000 7f0b775b5640 1 -- 10.20.193.58:0/2832114166 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b60003a30 msgr2=0x7f0b701606c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:12.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.724+0000 7f0b775b5640 1 --2- 10.20.193.58:0/2832114166 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b60003a30 0x7f0b701606c0 secure :-1 s=READY pgs=30 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b68039c60 tx=0x7f0b68039c90 comp rx=0 tx=0).stop 2026-02-23T06:24:12.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.724+0000 7f0b775b5640 1 -- 10.20.193.58:0/2832114166 shutdown_connections 2026-02-23T06:24:12.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.724+0000 7f0b775b5640 1 --2- 10.20.193.58:0/2832114166 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0b4007a5b0 0x7f0b4009aa60 unknown :-1 s=CLOSED pgs=155 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:12.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.724+0000 7f0b775b5640 1 --2- 10.20.193.58:0/2832114166 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0b60005400 0x7f0b70159b20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:12.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.724+0000 7f0b775b5640 1 --2- 10.20.193.58:0/2832114166 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b60004850 0x7f0b701624f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:12.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.724+0000 7f0b775b5640 1 --2- 10.20.193.58:0/2832114166 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b60003a30 0x7f0b701606c0 unknown :-1 s=CLOSED pgs=30 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:12.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.724+0000 7f0b775b5640 1 -- 10.20.193.58:0/2832114166 >> 10.20.193.58:0/2832114166 conn(0x7f0b700b3c20 msgr2=0x7f0b7015b580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:24:12.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.724+0000 7f0b775b5640 1 -- 10.20.193.58:0/2832114166 shutdown_connections 2026-02-23T06:24:12.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.724+0000 7f0b775b5640 1 -- 10.20.193.58:0/2832114166 wait complete. 2026-02-23T06:24:12.731 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:24:12.731 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-23T06:24:12.731 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:24:12.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.858+0000 7f7acd243640 1 -- 10.20.193.58:0/1773108663 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7aac003a30 msgr2=0x7f7aac003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:12.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.858+0000 7f7acd243640 1 --2- 10.20.193.58:0/1773108663 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7aac003a30 0x7f7aac003e20 secure :-1 s=READY pgs=268 gs=5 cs=0 l=1 c_cookie=8186422436771714905 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ab4009980 tx=0x7f7ab402f0f0 comp rx=0 tx=0).stop 2026-02-23T06:24:12.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.858+0000 7f7acd243640 1 -- 10.20.193.58:0/1773108663 shutdown_connections 2026-02-23T06:24:12.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.858+0000 7f7acd243640 1 --2- 10.20.193.58:0/1773108663 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7aac003a30 0x7f7aac003e20 unknown :-1 s=CLOSED pgs=268 gs=5 cs=0 l=1 c_cookie=8186422436771714905 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:12.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.858+0000 7f7acd243640 1 -- 10.20.193.58:0/1773108663 >> 10.20.193.58:0/1773108663 conn(0x7f7ac80b3c20 msgr2=0x7f7ac80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:24:12.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.859+0000 7f7acd243640 1 -- 10.20.193.58:0/1773108663 shutdown_connections 2026-02-23T06:24:12.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.859+0000 7f7acd243640 1 -- 10.20.193.58:0/1773108663 wait complete. 2026-02-23T06:24:12.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.860+0000 7f7acd243640 1 Processor -- start 2026-02-23T06:24:12.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.860+0000 7f7acd243640 1 -- start start 2026-02-23T06:24:12.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.860+0000 7f7acd243640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7aac003a30 0x7f7ac81626d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:12.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.860+0000 7f7acd243640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7ac81609e0 0x7f7ac82013c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:12.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.860+0000 7f7acd243640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7ac8160e30 0x7f7ac8201900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:12.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.860+0000 7f7acd243640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac8160160 con 0x7f7ac81609e0 2026-02-23T06:24:12.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.860+0000 7f7acd243640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac80b15c0 con 0x7f7ac8160e30 2026-02-23T06:24:12.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.860+0000 7f7acd243640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f7ac8162c10 con 0x7f7aac003a30 2026-02-23T06:24:12.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.860+0000 7f7ac77fe640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7ac81609e0 msgr2=0x7f7ac82013c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:24:12.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.860+0000 7f7ac77fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7ac81609e0 0x7f7ac82013c0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:24:12.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.861+0000 7f7acca42640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7ac8160e30 0x7f7ac8201900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:12.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.861+0000 7f7ac7fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7aac003a30 0x7f7ac81626d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:12.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.861+0000 7f7ac7fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7aac003a30 0x7f7ac81626d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:60198/0 (socket says 10.20.193.58:60198) 2026-02-23T06:24:12.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.861+0000 7f7ac7fff640 1 -- 10.20.193.58:0/2751487160 learned_addr learned my addr 10.20.193.58:0/2751487160 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:24:12.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.861+0000 7f7acca42640 1 -- 10.20.193.58:0/2751487160 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7aac003a30 msgr2=0x7f7ac81626d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:12.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.861+0000 7f7acca42640 1 --2- 10.20.193.58:0/2751487160 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7aac003a30 0x7f7ac81626d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:12.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.861+0000 7f7acca42640 1 -- 10.20.193.58:0/2751487160 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7ac81609e0 msgr2=0x7f7ac82013c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:24:12.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.861+0000 7f7acca42640 1 --2- 10.20.193.58:0/2751487160 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7ac81609e0 0x7f7ac82013c0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:12.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.861+0000 7f7acca42640 1 -- 10.20.193.58:0/2751487160 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac8058ff0 con 0x7f7ac8160e30 2026-02-23T06:24:12.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.861+0000 7f7acca42640 1 --2- 10.20.193.58:0/2751487160 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7ac8160e30 0x7f7ac8201900 secure :-1 s=READY pgs=269 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ac80b6900 tx=0x7f7abc00db20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:12.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.861+0000 7f7ac4ff9640 1 -- 10.20.193.58:0/2751487160 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7abc0095c0 con 0x7f7ac8160e30 2026-02-23T06:24:12.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.861+0000 7f7ac4ff9640 1 -- 10.20.193.58:0/2751487160 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7abc009810 con 0x7f7ac8160e30 2026-02-23T06:24:12.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.861+0000 7f7ac4ff9640 1 -- 10.20.193.58:0/2751487160 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7abc009c40 con 0x7f7ac8160e30 2026-02-23T06:24:12.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.861+0000 7f7acd243640 1 -- 10.20.193.58:0/2751487160 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ac8160350 con 0x7f7ac8160e30 2026-02-23T06:24:12.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.861+0000 7f7acd243640 1 -- 10.20.193.58:0/2751487160 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ac8159b80 con 0x7f7ac8160e30 2026-02-23T06:24:12.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.862+0000 7f7acd243640 1 --2- 10.20.193.58:0/2751487160 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7ac8125500 0x7f7ac81fdc20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:12.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.862+0000 7f7acd243640 1 -- 10.20.193.58:0/2751487160 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac80609c0 con 0x7f7ac8125500 2026-02-23T06:24:12.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.862+0000 7f7ac7fff640 1 --2- 10.20.193.58:0/2751487160 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7ac8125500 0x7f7ac81fdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:12.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.862+0000 7f7ac7fff640 1 -- 10.20.193.58:0/2751487160 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ac805d9c0 con 0x7f7ac8125500 2026-02-23T06:24:12.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.863+0000 7f7ac7fff640 1 --2- 10.20.193.58:0/2751487160 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7ac8125500 0x7f7ac81fdc20 secure :-1 s=READY pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ab4009a80 tx=0x7f7ab4002af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:12.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.863+0000 7f7ac4ff9640 1 -- 10.20.193.58:0/2751487160 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7ab4002ea0 con 0x7f7ac8125500 2026-02-23T06:24:12.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.863+0000 7f7ac4ff9640 1 -- 10.20.193.58:0/2751487160 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f7ab4004050 con 0x7f7ac8125500 2026-02-23T06:24:12.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.863+0000 7f7ac4ff9640 1 -- 10.20.193.58:0/2751487160 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7ac8125500 msgr2=0x7f7ac81fdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:12.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.863+0000 7f7ac4ff9640 1 --2- 10.20.193.58:0/2751487160 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7ac8125500 0x7f7ac81fdc20 secure :-1 s=READY pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ab4009a80 tx=0x7f7ab4002af0 comp rx=0 tx=0).stop 2026-02-23T06:24:12.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.863+0000 7f7ac4ff9640 1 -- 10.20.193.58:0/2751487160 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7ac8125500 msgr2=0x7f7ac81fdc20 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:24:12.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.863+0000 7f7ac4ff9640 1 --2- 10.20.193.58:0/2751487160 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7ac8125500 0x7f7ac81fdc20 secure :-1 s=CLOSED pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ab4009a80 tx=0x7f7ab4002af0 comp rx=0 tx=0).stop 2026-02-23T06:24:12.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.863+0000 7f7ac4ff9640 1 -- 10.20.193.58:0/2751487160 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f7abc016440 con 0x7f7ac8160e30 2026-02-23T06:24:12.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.864+0000 7f7ac4ff9640 1 --2- 10.20.193.58:0/2751487160 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7a9807a430 0x7f7a9809a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:12.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.864+0000 7f7ac4ff9640 1 -- 10.20.193.58:0/2751487160 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f7abc005070 con 0x7f7ac8160e30 2026-02-23T06:24:12.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.864+0000 7f7ac7fff640 1 --2- 10.20.193.58:0/2751487160 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7a9807a430 0x7f7a9809a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:12.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.865+0000 7f7ac7fff640 1 --2- 10.20.193.58:0/2751487160 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7a9807a430 0x7f7a9809a8e0 secure :-1 s=READY pgs=156 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ab40098d0 tx=0x7f7ab4031030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:12.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.866+0000 7f7acd243640 1 --2- 10.20.193.58:0/2751487160 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7ac81fe160 0x7f7ac81fe530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:12.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.866+0000 7f7acd243640 1 -- 10.20.193.58:0/2751487160 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac805ce30 con 0x7f7ac81fe160 2026-02-23T06:24:12.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.867+0000 7f7ac77fe640 1 --2- 10.20.193.58:0/2751487160 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7ac81fe160 0x7f7ac81fe530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:12.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.867+0000 7f7ac77fe640 1 -- 10.20.193.58:0/2751487160 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7ac8165880 con 0x7f7ac81fe160 2026-02-23T06:24:12.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.867+0000 7f7ac77fe640 1 --2- 10.20.193.58:0/2751487160 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7ac81fe160 0x7f7ac81fe530 secure :-1 s=READY pgs=271 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ac8058dc0 tx=0x7f7ab8004800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:12.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.867+0000 7f7ac4ff9640 1 -- 10.20.193.58:0/2751487160 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7ab8010430 con 0x7f7ac81fe160 2026-02-23T06:24:12.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.867+0000 7f7ac4ff9640 1 -- 10.20.193.58:0/2751487160 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5546 (secure 0 0 0) 0x7f7ab8010590 con 0x7f7ac81fe160 2026-02-23T06:24:12.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.867+0000 7f7ac4ff9640 1 -- 10.20.193.58:0/2751487160 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7ac81fe160 msgr2=0x7f7ac81fe530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:12.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.867+0000 7f7ac4ff9640 1 --2- 10.20.193.58:0/2751487160 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7ac81fe160 0x7f7ac81fe530 secure :-1 s=READY pgs=271 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ac8058dc0 tx=0x7f7ab8004800 comp rx=0 tx=0).stop 2026-02-23T06:24:12.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.867+0000 7f7ac4ff9640 1 -- 10.20.193.58:0/2751487160 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7ac81fe160 msgr2=0x7f7ac81fe530 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:24:12.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.867+0000 7f7ac4ff9640 1 --2- 10.20.193.58:0/2751487160 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7ac81fe160 0x7f7ac81fe530 unknown :-1 s=CLOSED pgs=271 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:12.864 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:24:12.865 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:24:12.865 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:24:12.865 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:24:12.865 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 22, 2026-02-23T06:24:12.865 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 190914, 2026-02-23T06:24:12.865 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:24:12.865 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:24:12.865 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:24:12.865 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:12.865 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:24:12.866 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:24:12.866 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:24:12.866 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:24:12.866 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:24:12.866 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:24:12.866 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:24:12.866 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:24:12.866 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:24:12.866 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:24:12.867 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:24:12.867 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:24:12.867 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:24:12.867 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:24:12.867 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:24:12.867 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:24:12.867 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:24:12.867 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:12.867 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:24:12.867 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:24:12.867 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:24:12.867 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:24:12.868 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:24:12.868 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:24:12.868 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:24:12.868 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:24:12.868 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:24:12.868 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:24:12.868 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:24:12.868 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:24:12.868 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:24:12.868 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:24:12.868 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:24:12.868 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:12.869 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:12.869 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:24:12.869 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:24:12.869 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:24:12.869 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:24:12.869 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:24:12.869 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:24:12.869 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:24:12.869 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:24:12.869 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:24:12.869 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:24:12.869 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:24:12.870 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:24:12.870 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:24:12.870 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:24:12.870 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:24:12.870 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:24:12.870 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:24:12.870 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:24:12.870 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:24:12.870 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:24:12.870 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:24:12.870 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:24:12.870 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:24:12.871 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:24:12.871 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:24:12.871 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:24:12.871 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:24:12.871 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:24:12.871 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:24:12.871 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:24:12.871 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:12.871 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:24:12.871 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:12.871 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:24:12.871 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:12.872 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:24:12.872 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:24:12.872 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:24:12.872 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:24:12.872 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:12.872 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:24:12.872 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:24:12.872 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:12.872 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:12.872 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:12.872 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:24:12.873 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:24:12.873 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:12.873 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:12.873 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:12.873 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:12.873 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:24:12.873 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:24:12.873 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:24:12.873 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:24:12.873 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:24:12.874 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:24:12.874 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:12.874 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:12.874 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:24:12.874 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:24:12.874 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:24:12.874 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:24:12.874 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:12.874 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:24:12.874 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:24:12.875 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:12.875 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:12.875 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:12.875 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:24:12.875 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:24:12.875 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:12.875 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:12.875 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:12.875 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:12.875 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:24:12.876 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:24:12.876 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:24:12.876 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:24:12.876 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:24:12.876 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:24:12.876 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:12.876 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:12.876 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:24:12.876 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:24:12.877 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:24:12.877 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:24:12.877 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:12.877 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:24:12.877 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:24:12.877 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:12.877 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:12.877 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:12.877 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:24:12.877 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:24:12.877 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:12.877 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:12.878 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:12.878 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:12.878 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:24:12.878 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:24:12.878 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:24:12.878 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:24:12.878 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:24:12.878 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:24:12.878 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:12.878 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:12.878 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:12.878 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:24:12.879 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:24:12.879 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:12.879 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:12.879 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:12.879 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:24:12.879 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:12.879 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:12.879 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:24:12.879 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:12.879 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:12.879 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:12.879 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:24:12.879 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:12.880 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:12.880 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:24:12.880 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:12.880 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:12.880 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:12.880 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:24:12.880 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:12.880 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:12.880 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:24:12.880 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:12.880 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:24:12.880 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:24:12.881 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:24:12.881 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:12.881 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:12.881 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:12.881 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:12.881 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:24:12.881 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:12.881 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:12.881 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:24:12.881 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:12.881 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:12.881 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:12.882 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:24:12.882 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:12.882 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:12.882 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:12.882 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:24:12.882 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:24:12.884 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.868+0000 7f7acd243640 1 -- 10.20.193.58:0/2751487160 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7a9807a430 msgr2=0x7f7a9809a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:12.884 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.868+0000 7f7acd243640 1 --2- 10.20.193.58:0/2751487160 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7a9807a430 0x7f7a9809a8e0 secure :-1 s=READY pgs=156 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ab40098d0 tx=0x7f7ab4031030 comp rx=0 tx=0).stop 2026-02-23T06:24:12.884 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.868+0000 7f7acd243640 1 -- 10.20.193.58:0/2751487160 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7ac8160e30 msgr2=0x7f7ac8201900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:12.884 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.868+0000 7f7acd243640 1 --2- 10.20.193.58:0/2751487160 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7ac8160e30 0x7f7ac8201900 secure :-1 s=READY pgs=269 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ac80b6900 tx=0x7f7abc00db20 comp rx=0 tx=0).stop 2026-02-23T06:24:12.884 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.868+0000 7f7acca42640 1 -- 10.20.193.58:0/2751487160 reap_dead start 2026-02-23T06:24:12.884 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.868+0000 7f7acca42640 1 -- 10.20.193.58:0/2751487160 reap_dead start 2026-02-23T06:24:12.884 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.868+0000 7f7acd243640 1 -- 10.20.193.58:0/2751487160 shutdown_connections 2026-02-23T06:24:12.884 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.868+0000 7f7acd243640 1 -- 10.20.193.58:0/2751487160 >> 10.20.193.58:0/2751487160 conn(0x7f7ac80b3c20 msgr2=0x7f7ac80b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:24:12.885 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.868+0000 7f7acd243640 1 -- 10.20.193.58:0/2751487160 shutdown_connections 2026-02-23T06:24:12.885 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:12.868+0000 7f7acd243640 1 -- 10.20.193.58:0/2751487160 wait complete. 2026-02-23T06:24:12.885 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:24:12.885 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-23T06:24:12.886 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:24:13.006 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.011+0000 7f00315d2640 1 -- 10.20.193.58:0/259639418 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f002c15c040 msgr2=0x7f002c05b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:13.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.011+0000 7f00315d2640 1 --2- 10.20.193.58:0/259639418 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f002c15c040 0x7f002c05b0e0 secure :-1 s=READY pgs=31 gs=2 cs=0 l=1 c_cookie=5991749670856635473 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f002c05df80 tx=0x7f001802f1d0 comp rx=0 tx=0).stop 2026-02-23T06:24:13.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.011+0000 7f00315d2640 1 -- 10.20.193.58:0/259639418 shutdown_connections 2026-02-23T06:24:13.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.011+0000 7f00315d2640 1 --2- 10.20.193.58:0/259639418 >> v2:10.20.193.58:3300/0 conn(0x7f002c0b5680 0x7f002c0b5b20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:13.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.011+0000 7f00315d2640 1 --2- 10.20.193.58:0/259639418 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f002c15c040 0x7f002c05b0e0 unknown :-1 s=CLOSED pgs=31 gs=2 cs=0 l=1 c_cookie=5991749670856635473 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:13.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.011+0000 7f00315d2640 1 -- 10.20.193.58:0/259639418 >> 10.20.193.58:0/259639418 conn(0x7f002c0b3c20 msgr2=0x7f002c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:24:13.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.011+0000 7f00315d2640 1 -- 10.20.193.58:0/259639418 shutdown_connections 2026-02-23T06:24:13.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.011+0000 7f00315d2640 1 -- 10.20.193.58:0/259639418 wait complete. 2026-02-23T06:24:13.011 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.012+0000 7f00315d2640 1 Processor -- start 2026-02-23T06:24:13.011 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.012+0000 7f00315d2640 1 -- start start 2026-02-23T06:24:13.011 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.013+0000 7f00315d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f002c056550 0x7f002c1621c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:13.011 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.013+0000 7f00315d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f002c0b5680 0x7f002c125230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:13.011 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.013+0000 7f00315d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f002c15c040 0x7f002c157150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:13.011 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.013+0000 7f00315d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f002c162f90 con 0x7f002c0b5680 2026-02-23T06:24:13.011 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.013+0000 7f00315d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f002c2019b0 con 0x7f002c056550 2026-02-23T06:24:13.011 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.013+0000 7f00315d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f002c201c70 con 0x7f002c15c040 2026-02-23T06:24:13.011 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.013+0000 7f002b7fe640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f002c0b5680 msgr2=0x7f002c125230 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:24:13.012 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.013+0000 7f002b7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f002c0b5680 0x7f002c125230 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:24:13.012 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.013+0000 7f002bfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f002c056550 0x7f002c1621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:13.012 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.013+0000 7f002bfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f002c056550 0x7f002c1621c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:51226/0 (socket says 10.20.193.58:51226) 2026-02-23T06:24:13.012 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.013+0000 7f002bfff640 1 -- 10.20.193.58:0/2774490925 learned_addr learned my addr 10.20.193.58:0/2774490925 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:24:13.012 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.013+0000 7f0030dd1640 1 --2- 10.20.193.58:0/2774490925 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f002c15c040 0x7f002c157150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:13.012 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.013+0000 7f002bfff640 1 -- 10.20.193.58:0/2774490925 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f002c15c040 msgr2=0x7f002c157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:13.012 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.013+0000 7f002bfff640 1 --2- 10.20.193.58:0/2774490925 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f002c15c040 0x7f002c157150 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:13.012 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.013+0000 7f002bfff640 1 -- 10.20.193.58:0/2774490925 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f002c0b5680 msgr2=0x7f002c125230 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:24:13.012 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.013+0000 7f002bfff640 1 --2- 10.20.193.58:0/2774490925 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f002c0b5680 0x7f002c125230 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:13.012 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.013+0000 7f002bfff640 1 -- 10.20.193.58:0/2774490925 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00180094b0 con 0x7f002c056550 2026-02-23T06:24:13.012 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.014+0000 7f002bfff640 1 --2- 10.20.193.58:0/2774490925 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f002c056550 0x7f002c1621c0 secure :-1 s=READY pgs=273 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0018009230 tx=0x7f00180026a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:13.012 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.014+0000 7f0028ff9640 1 -- 10.20.193.58:0/2774490925 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0018044070 con 0x7f002c056550 2026-02-23T06:24:13.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.014+0000 7f0028ff9640 1 -- 10.20.193.58:0/2774490925 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0018002e70 con 0x7f002c056550 2026-02-23T06:24:13.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.014+0000 7f0028ff9640 1 -- 10.20.193.58:0/2774490925 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0018004a90 con 0x7f002c056550 2026-02-23T06:24:13.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.014+0000 7f00315d2640 1 -- 10.20.193.58:0/2774490925 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f002c1629d0 con 0x7f002c056550 2026-02-23T06:24:13.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.014+0000 7f00315d2640 1 -- 10.20.193.58:0/2774490925 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f002c154440 con 0x7f002c056550 2026-02-23T06:24:13.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.014+0000 7f00315d2640 1 --2- 10.20.193.58:0/2774490925 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f002c155990 0x7f002c157690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:13.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.014+0000 7f00315d2640 1 -- 10.20.193.58:0/2774490925 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f002c155d60 con 0x7f002c155990 2026-02-23T06:24:13.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.015+0000 7f002b7fe640 1 --2- 10.20.193.58:0/2774490925 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f002c155990 0x7f002c157690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:13.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.015+0000 7f002b7fe640 1 -- 10.20.193.58:0/2774490925 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f002c0b1e40 con 0x7f002c155990 2026-02-23T06:24:13.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.015+0000 7f002b7fe640 1 --2- 10.20.193.58:0/2774490925 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f002c155990 0x7f002c157690 secure :-1 s=READY pgs=32 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f001c002b30 tx=0x7f001c00cb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:13.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.015+0000 7f0028ff9640 1 -- 10.20.193.58:0/2774490925 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f001c005b60 con 0x7f002c155990 2026-02-23T06:24:13.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.016+0000 7f0028ff9640 1 -- 10.20.193.58:0/2774490925 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f0018038470 con 0x7f002c056550 2026-02-23T06:24:13.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.017+0000 7f0028ff9640 1 --2- 10.20.193.58:0/2774490925 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efffc07a660 0x7efffc09ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:13.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.017+0000 7f0028ff9640 1 -- 10.20.193.58:0/2774490925 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f00180c2450 con 0x7f002c056550 2026-02-23T06:24:13.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.017+0000 7f0028ff9640 1 -- 10.20.193.58:0/2774490925 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f001c005cc0 con 0x7f002c155990 2026-02-23T06:24:13.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.017+0000 7f0028ff9640 1 -- 10.20.193.58:0/2774490925 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f002c155990 msgr2=0x7f002c157690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:13.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.017+0000 7f0028ff9640 1 --2- 10.20.193.58:0/2774490925 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f002c155990 0x7f002c157690 secure :-1 s=READY pgs=32 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f001c002b30 tx=0x7f001c00cb20 comp rx=0 tx=0).stop 2026-02-23T06:24:13.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.017+0000 7f0028ff9640 1 -- 10.20.193.58:0/2774490925 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f002c155990 msgr2=0x7f002c157690 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:24:13.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.017+0000 7f0028ff9640 1 --2- 10.20.193.58:0/2774490925 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f002c155990 0x7f002c157690 secure :-1 s=CLOSED pgs=32 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f001c002b30 tx=0x7f001c00cb20 comp rx=0 tx=0).stop 2026-02-23T06:24:13.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.017+0000 7f0030dd1640 1 --2- 10.20.193.58:0/2774490925 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efffc07a660 0x7efffc09ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:13.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.018+0000 7f0030dd1640 1 --2- 10.20.193.58:0/2774490925 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efffc07a660 0x7efffc09ab10 secure :-1 s=READY pgs=157 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0020003950 tx=0x7f0020009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:13.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.021+0000 7f00315d2640 1 --2- 10.20.193.58:0/2774490925 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f002c154960 0x7f002c154d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:13.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.021+0000 7f00315d2640 1 -- 10.20.193.58:0/2774490925 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f002c162b60 con 0x7f002c154960 2026-02-23T06:24:13.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.021+0000 7f002b7fe640 1 --2- 10.20.193.58:0/2774490925 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f002c154960 0x7f002c154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:13.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.021+0000 7f002b7fe640 1 -- 10.20.193.58:0/2774490925 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f002c05b620 con 0x7f002c154960 2026-02-23T06:24:13.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.022+0000 7f002b7fe640 1 --2- 10.20.193.58:0/2774490925 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f002c154960 0x7f002c154d30 secure :-1 s=READY pgs=33 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f001c00a450 tx=0x7f001c0029f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:13.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.022+0000 7f0028ff9640 1 -- 10.20.193.58:0/2774490925 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f001c020070 con 0x7f002c154960 2026-02-23T06:24:13.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.022+0000 7f0028ff9640 1 -- 10.20.193.58:0/2774490925 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5233 (secure 0 0 0) 0x7f001c00a7f0 con 0x7f002c154960 2026-02-23T06:24:13.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.022+0000 7f0028ff9640 1 -- 10.20.193.58:0/2774490925 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f002c154960 msgr2=0x7f002c154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:13.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.022+0000 7f0028ff9640 1 --2- 10.20.193.58:0/2774490925 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f002c154960 0x7f002c154d30 secure :-1 s=READY pgs=33 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f001c00a450 tx=0x7f001c0029f0 comp rx=0 tx=0).stop 2026-02-23T06:24:13.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.022+0000 7f0028ff9640 1 -- 10.20.193.58:0/2774490925 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f002c154960 msgr2=0x7f002c154d30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:24:13.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.022+0000 7f0028ff9640 1 --2- 10.20.193.58:0/2774490925 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f002c154960 0x7f002c154d30 unknown :-1 s=CLOSED pgs=33 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:13.018 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:24:13.018 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:24:13.018 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:24:13.018 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:24:13.019 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 22, 2026-02-23T06:24:13.019 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 51563, 2026-02-23T06:24:13.019 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:24:13.019 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:24:13.019 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:24:13.019 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:13.019 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:24:13.019 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:24:13.019 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:24:13.019 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:24:13.019 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:24:13.020 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:24:13.020 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:24:13.020 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:24:13.020 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:24:13.020 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:24:13.020 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:24:13.020 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:24:13.020 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:24:13.020 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:24:13.020 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:24:13.020 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:24:13.021 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:24:13.021 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:13.021 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:24:13.021 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:24:13.021 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:24:13.021 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:24:13.021 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:24:13.021 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:24:13.021 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:24:13.021 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:24:13.021 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:24:13.022 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:24:13.022 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:24:13.022 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:24:13.022 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:24:13.022 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:24:13.022 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:24:13.022 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:13.022 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:13.022 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:24:13.022 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:24:13.022 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:24:13.022 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:24:13.023 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:24:13.023 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:24:13.023 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:24:13.023 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:24:13.023 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:24:13.023 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:24:13.023 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:24:13.023 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:24:13.023 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:24:13.023 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:24:13.023 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:24:13.024 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:24:13.024 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:24:13.024 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:24:13.024 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:24:13.024 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:24:13.024 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:24:13.024 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:24:13.024 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:24:13.024 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:24:13.024 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:24:13.024 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:24:13.024 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:24:13.025 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:24:13.025 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:24:13.025 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:24:13.025 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:13.025 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:24:13.025 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:13.025 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:24:13.025 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:13.025 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:24:13.025 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:24:13.025 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:24:13.025 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:24:13.026 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:13.026 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:24:13.026 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:24:13.026 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:13.026 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:13.026 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:13.026 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:24:13.026 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:24:13.026 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:13.026 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:13.026 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:13.027 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:13.027 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:24:13.027 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:24:13.027 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:24:13.027 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:24:13.027 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:24:13.027 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:24:13.027 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:13.027 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:13.027 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:24:13.027 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:24:13.027 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:24:13.028 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:24:13.028 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:13.028 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:24:13.028 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:24:13.028 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:13.028 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:13.028 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:13.028 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:24:13.028 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:24:13.028 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:13.028 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:13.028 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:13.029 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:13.029 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:24:13.029 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:24:13.029 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:24:13.029 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:24:13.029 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:24:13.029 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:24:13.029 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:13.029 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:13.029 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:24:13.029 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:24:13.029 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:24:13.030 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:24:13.030 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:13.030 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:24:13.030 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:24:13.030 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:13.030 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:13.030 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:13.030 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:24:13.030 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:24:13.030 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:13.030 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:13.030 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:13.030 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:13.031 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:24:13.031 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:24:13.031 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:24:13.031 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:24:13.031 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:24:13.031 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:24:13.031 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:13.031 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:13.031 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:13.031 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:24:13.031 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:24:13.031 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:13.032 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:13.032 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:13.032 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:24:13.032 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:13.032 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:13.032 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:24:13.032 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:13.032 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:13.032 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:13.032 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:24:13.032 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:13.032 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:13.033 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:24:13.033 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:13.033 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:13.033 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:13.033 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:24:13.033 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:13.033 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:13.033 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:24:13.033 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:13.033 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:13.033 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:13.033 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:24:13.034 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:13.034 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:13.034 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:13.034 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:24:13.034 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:24:13.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.022+0000 7f00315d2640 1 -- 10.20.193.58:0/2774490925 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efffc07a660 msgr2=0x7efffc09ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:13.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.022+0000 7f00315d2640 1 --2- 10.20.193.58:0/2774490925 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efffc07a660 0x7efffc09ab10 secure :-1 s=READY pgs=157 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0020003950 tx=0x7f0020009040 comp rx=0 tx=0).stop 2026-02-23T06:24:13.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.022+0000 7f00315d2640 1 -- 10.20.193.58:0/2774490925 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f002c056550 msgr2=0x7f002c1621c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:13.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.022+0000 7f00315d2640 1 --2- 10.20.193.58:0/2774490925 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f002c056550 0x7f002c1621c0 secure :-1 s=READY pgs=273 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0018009230 tx=0x7f00180026a0 comp rx=0 tx=0).stop 2026-02-23T06:24:13.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.022+0000 7f0030dd1640 1 -- 10.20.193.58:0/2774490925 reap_dead start 2026-02-23T06:24:13.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.022+0000 7f0030dd1640 1 -- 10.20.193.58:0/2774490925 reap_dead start 2026-02-23T06:24:13.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.022+0000 7f00315d2640 1 -- 10.20.193.58:0/2774490925 shutdown_connections 2026-02-23T06:24:13.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.022+0000 7f00315d2640 1 -- 10.20.193.58:0/2774490925 >> 10.20.193.58:0/2774490925 conn(0x7f002c0b3c20 msgr2=0x7f002c15b260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:24:13.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.022+0000 7f00315d2640 1 -- 10.20.193.58:0/2774490925 shutdown_connections 2026-02-23T06:24:13.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:13.022+0000 7f00315d2640 1 -- 10.20.193.58:0/2774490925 wait complete. 2026-02-23T06:24:13.037 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:24:13.037 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:24:33.038 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-23T06:24:33.038 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-23T06:24:33.038 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-23T06:24:33.038 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-23T06:24:33.043 INFO:tasks.ceph.mon.a:Started 2026-02-23T06:24:33.043 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:24:33.043 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:24:33.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.166+0000 7f2ef5ec3640 1 -- 10.20.193.58:0/1351998638 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2ef0056550 msgr2=0x7f2ef005ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.166+0000 7f2ef5ec3640 1 --2- 10.20.193.58:0/1351998638 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2ef0056550 0x7f2ef005ce30 secure :-1 s=READY pgs=276 gs=3 cs=0 l=1 c_cookie=8157010871865755503 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ed8004740 tx=0x7f2ed802f1d0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.166+0000 7f2ef5ec3640 1 -- 10.20.193.58:0/1351998638 shutdown_connections 2026-02-23T06:24:33.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.166+0000 7f2ef5ec3640 1 --2- 10.20.193.58:0/1351998638 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2ef0056550 0x7f2ef005ce30 unknown :-1 s=CLOSED pgs=276 gs=3 cs=0 l=1 c_cookie=8157010871865755503 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.166+0000 7f2ef5ec3640 1 -- 10.20.193.58:0/1351998638 >> 10.20.193.58:0/1351998638 conn(0x7f2ef00b3c20 msgr2=0x7f2ef00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:24:33.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.166+0000 7f2ef5ec3640 1 -- 10.20.193.58:0/1351998638 shutdown_connections 2026-02-23T06:24:33.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.166+0000 7f2ef5ec3640 1 -- 10.20.193.58:0/1351998638 wait complete. 2026-02-23T06:24:33.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.168+0000 7f2ef5ec3640 1 Processor -- start 2026-02-23T06:24:33.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.168+0000 7f2ef5ec3640 1 -- start start 2026-02-23T06:24:33.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.168+0000 7f2ef5ec3640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2ef0056550 0x7f2ef0205ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:33.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.168+0000 7f2ef5ec3640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2ef005d370 0x7f2ef00b1450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:33.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.168+0000 7f2ef5ec3640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2ef015c040 0x7f2ef00585e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:33.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.168+0000 7f2ef5ec3640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef0152dc0 con 0x7f2ef005d370 2026-02-23T06:24:33.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.168+0000 7f2ef5ec3640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef0202a40 con 0x7f2ef0056550 2026-02-23T06:24:33.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.168+0000 7f2ef5ec3640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f2ef00b01d0 con 0x7f2ef015c040 2026-02-23T06:24:33.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.169+0000 7f2ef4ec1640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2ef0056550 0x7f2ef0205ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:33.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.169+0000 7f2ef4ec1640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2ef0056550 0x7f2ef0205ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:41510/0 (socket says 10.20.193.58:41510) 2026-02-23T06:24:33.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.169+0000 7f2ef4ec1640 1 -- 10.20.193.58:0/1921485878 learned_addr learned my addr 10.20.193.58:0/1921485878 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:24:33.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.169+0000 7f2ef56c2640 1 --2- 10.20.193.58:0/1921485878 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2ef015c040 0x7f2ef00585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:33.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.169+0000 7f2ef4ec1640 1 -- 10.20.193.58:0/1921485878 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2ef015c040 msgr2=0x7f2ef00585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.169+0000 7f2ef4ec1640 1 --2- 10.20.193.58:0/1921485878 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2ef015c040 0x7f2ef00585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.169+0000 7f2ef4ec1640 1 -- 10.20.193.58:0/1921485878 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2ef005d370 msgr2=0x7f2ef00b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.169+0000 7f2ef4ec1640 1 --2- 10.20.193.58:0/1921485878 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2ef005d370 0x7f2ef00b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.169+0000 7f2ef4ec1640 1 -- 10.20.193.58:0/1921485878 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ed80094b0 con 0x7f2ef0056550 2026-02-23T06:24:33.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.169+0000 7f2ef56c2640 1 --2- 10.20.193.58:0/1921485878 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2ef015c040 0x7f2ef00585e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:24:33.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.170+0000 7f2ef4ec1640 1 --2- 10.20.193.58:0/1921485878 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2ef0056550 0x7f2ef0205ea0 secure :-1 s=READY pgs=277 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ee000c4b0 tx=0x7f2ee000c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:33.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.170+0000 7f2ee57fa640 1 -- 10.20.193.58:0/1921485878 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ee00054a0 con 0x7f2ef0056550 2026-02-23T06:24:33.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.170+0000 7f2ee57fa640 1 -- 10.20.193.58:0/1921485878 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ee00036b0 con 0x7f2ef0056550 2026-02-23T06:24:33.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.170+0000 7f2ee57fa640 1 -- 10.20.193.58:0/1921485878 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ee0003ac0 con 0x7f2ef0056550 2026-02-23T06:24:33.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.170+0000 7f2ef5ec3640 1 -- 10.20.193.58:0/1921485878 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ef0202ce0 con 0x7f2ef0056550 2026-02-23T06:24:33.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.170+0000 7f2ef5ec3640 1 -- 10.20.193.58:0/1921485878 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ef00b04b0 con 0x7f2ef0056550 2026-02-23T06:24:33.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.171+0000 7f2ef5ec3640 1 -- 10.20.193.58:0/1921485878 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eb0005300 con 0x7f2ef0056550 2026-02-23T06:24:33.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.173+0000 7f2ee57fa640 1 -- 10.20.193.58:0/1921485878 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f2ee0003c20 con 0x7f2ef0056550 2026-02-23T06:24:33.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.174+0000 7f2ee57fa640 1 --2- 10.20.193.58:0/1921485878 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2ec007a740 0x7f2ec009abf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:33.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.174+0000 7f2ee57fa640 1 -- 10.20.193.58:0/1921485878 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f2ee009d3a0 con 0x7f2ef0056550 2026-02-23T06:24:33.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.174+0000 7f2ee7fff640 1 --2- 10.20.193.58:0/1921485878 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2ec007a740 0x7f2ec009abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:33.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.174+0000 7f2ee57fa640 1 -- 10.20.193.58:0/1921485878 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f2ee0060650 con 0x7f2ef0056550 2026-02-23T06:24:33.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.175+0000 7f2ee7fff640 1 --2- 10.20.193.58:0/1921485878 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2ec007a740 0x7f2ec009abf0 secure :-1 s=READY pgs=159 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ed8009230 tx=0x7f2ed803a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:33.329 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.334+0000 7f2ef5ec3640 1 -- 10.20.193.58:0/1921485878 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2eb0005950 con 0x7f2ef0056550 2026-02-23T06:24:33.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.334+0000 7f2ee57fa640 1 -- 10.20.193.58:0/1921485878 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1754 (secure 0 0 0) 0x7f2ee0063770 con 0x7f2ef0056550 2026-02-23T06:24:33.330 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:24:33.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.335+0000 7f2ef5ec3640 1 -- 10.20.193.58:0/1921485878 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2ec007a740 msgr2=0x7f2ec009abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.336+0000 7f2ef5ec3640 1 --2- 10.20.193.58:0/1921485878 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2ec007a740 0x7f2ec009abf0 secure :-1 s=READY pgs=159 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ed8009230 tx=0x7f2ed803a040 comp rx=0 tx=0).stop 2026-02-23T06:24:33.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.336+0000 7f2ef5ec3640 1 -- 10.20.193.58:0/1921485878 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2ef0056550 msgr2=0x7f2ef0205ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.336+0000 7f2ef5ec3640 1 --2- 10.20.193.58:0/1921485878 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2ef0056550 0x7f2ef0205ea0 secure :-1 s=READY pgs=277 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ee000c4b0 tx=0x7f2ee000c980 comp rx=0 tx=0).stop 2026-02-23T06:24:33.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.336+0000 7f2ef5ec3640 1 -- 10.20.193.58:0/1921485878 shutdown_connections 2026-02-23T06:24:33.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.336+0000 7f2ef5ec3640 1 --2- 10.20.193.58:0/1921485878 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2ec007a740 0x7f2ec009abf0 unknown :-1 s=CLOSED pgs=159 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.336+0000 7f2ef5ec3640 1 --2- 10.20.193.58:0/1921485878 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2ef015c040 0x7f2ef00585e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.336+0000 7f2ef5ec3640 1 --2- 10.20.193.58:0/1921485878 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2ef005d370 0x7f2ef00b1450 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.336+0000 7f2ef5ec3640 1 --2- 10.20.193.58:0/1921485878 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2ef0056550 0x7f2ef0205ea0 unknown :-1 s=CLOSED pgs=277 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.336+0000 7f2ef5ec3640 1 -- 10.20.193.58:0/1921485878 >> 10.20.193.58:0/1921485878 conn(0x7f2ef00b3c20 msgr2=0x7f2ef00b40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:24:33.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.336+0000 7f2ef5ec3640 1 -- 10.20.193.58:0/1921485878 shutdown_connections 2026-02-23T06:24:33.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.336+0000 7f2ef5ec3640 1 -- 10.20.193.58:0/1921485878 wait complete. 2026-02-23T06:24:33.344 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:24:33.344 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:24:33.344 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:24:33.468 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.472+0000 7f6858e43640 1 -- 10.20.193.58:0/1602952602 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f685415c040 msgr2=0x7f685405b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.468 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.472+0000 7f6858e43640 1 --2- 10.20.193.58:0/1602952602 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f685415c040 0x7f685405b0e0 secure :-1 s=READY pgs=36 gs=3 cs=0 l=1 c_cookie=7342123781626185577 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6840009890 tx=0x7f684002f200 comp rx=0 tx=0).stop 2026-02-23T06:24:33.468 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.473+0000 7f6858e43640 1 -- 10.20.193.58:0/1602952602 shutdown_connections 2026-02-23T06:24:33.468 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.473+0000 7f6858e43640 1 --2- 10.20.193.58:0/1602952602 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f685415c040 0x7f685405b0e0 unknown :-1 s=CLOSED pgs=36 gs=3 cs=0 l=1 c_cookie=7342123781626185577 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.469 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.473+0000 7f6858e43640 1 -- 10.20.193.58:0/1602952602 >> 10.20.193.58:0/1602952602 conn(0x7f68540b3c20 msgr2=0x7f68540b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:24:33.469 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.473+0000 7f6858e43640 1 -- 10.20.193.58:0/1602952602 shutdown_connections 2026-02-23T06:24:33.469 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.473+0000 7f6858e43640 1 -- 10.20.193.58:0/1602952602 wait complete. 2026-02-23T06:24:33.471 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.474+0000 7f6858e43640 1 Processor -- start 2026-02-23T06:24:33.471 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.474+0000 7f6858e43640 1 -- start start 2026-02-23T06:24:33.471 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.475+0000 7f6858e43640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6854056550 0x7f68540b1820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:33.471 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.475+0000 7f6858e43640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f68540b5680 0x7f6854058660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:33.471 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.475+0000 7f6858e43640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f685415c040 0x7f6854161970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:33.471 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.475+0000 7f6858e43640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f68540b1d60 con 0x7f6854056550 2026-02-23T06:24:33.471 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.475+0000 7f6858e43640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f6854162f90 con 0x7f68540b5680 2026-02-23T06:24:33.471 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.475+0000 7f6858e43640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f6854162cd0 con 0x7f685415c040 2026-02-23T06:24:33.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.475+0000 7f68537fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6854056550 0x7f68540b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:33.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.475+0000 7f6852ffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f68540b5680 0x7f6854058660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:33.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.475+0000 7f68537fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6854056550 0x7f68540b1820 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:39994/0 (socket says 10.20.193.58:39994) 2026-02-23T06:24:33.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.475+0000 7f68537fe640 1 -- 10.20.193.58:0/1688708601 learned_addr learned my addr 10.20.193.58:0/1688708601 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:24:33.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.475+0000 7f6853fff640 1 --2- 10.20.193.58:0/1688708601 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f685415c040 0x7f6854161970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:33.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.475+0000 7f68537fe640 1 -- 10.20.193.58:0/1688708601 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f685415c040 msgr2=0x7f6854161970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.475+0000 7f68537fe640 1 --2- 10.20.193.58:0/1688708601 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f685415c040 0x7f6854161970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.475+0000 7f68537fe640 1 -- 10.20.193.58:0/1688708601 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f68540b5680 msgr2=0x7f6854058660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.475+0000 7f68537fe640 1 --2- 10.20.193.58:0/1688708601 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f68540b5680 0x7f6854058660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.475+0000 7f68537fe640 1 -- 10.20.193.58:0/1688708601 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68400094b0 con 0x7f6854056550 2026-02-23T06:24:33.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.475+0000 7f68537fe640 1 --2- 10.20.193.58:0/1688708601 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6854056550 0x7f68540b1820 secure :-1 s=READY pgs=4 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68400023d0 tx=0x7f6840002950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:33.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.476+0000 7f682ffff640 1 -- 10.20.193.58:0/1688708601 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6840038470 con 0x7f6854056550 2026-02-23T06:24:33.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.476+0000 7f682ffff640 1 -- 10.20.193.58:0/1688708601 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68400386c0 con 0x7f6854056550 2026-02-23T06:24:33.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.476+0000 7f682ffff640 1 -- 10.20.193.58:0/1688708601 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6840038ab0 con 0x7f6854056550 2026-02-23T06:24:33.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.476+0000 7f6858e43640 1 -- 10.20.193.58:0/1688708601 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68541fd960 con 0x7f6854056550 2026-02-23T06:24:33.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.476+0000 7f6858e43640 1 -- 10.20.193.58:0/1688708601 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6854161450 con 0x7f6854056550 2026-02-23T06:24:33.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.476+0000 7f6858e43640 1 --2- 10.20.193.58:0/1688708601 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6854161eb0 0x7f6854154a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:33.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.476+0000 7f6858e43640 1 -- 10.20.193.58:0/1688708601 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f685415c410 con 0x7f6854161eb0 2026-02-23T06:24:33.474 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.476+0000 7f6852ffd640 1 --2- 10.20.193.58:0/1688708601 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6854161eb0 0x7f6854154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:33.474 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.477+0000 7f6852ffd640 1 -- 10.20.193.58:0/1688708601 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f685405b620 con 0x7f6854161eb0 2026-02-23T06:24:33.474 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.477+0000 7f6852ffd640 1 --2- 10.20.193.58:0/1688708601 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6854161eb0 0x7f6854154a50 secure :-1 s=READY pgs=5 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6854059aa0 tx=0x7f684400fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:33.475 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.477+0000 7f682ffff640 1 -- 10.20.193.58:0/1688708601 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6844002cb0 con 0x7f6854161eb0 2026-02-23T06:24:33.475 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.477+0000 7f682ffff640 1 -- 10.20.193.58:0/1688708601 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f6844002e10 con 0x7f6854161eb0 2026-02-23T06:24:33.475 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.477+0000 7f682ffff640 1 -- 10.20.193.58:0/1688708601 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6854161eb0 msgr2=0x7f6854154a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.475 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.477+0000 7f682ffff640 1 --2- 10.20.193.58:0/1688708601 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6854161eb0 0x7f6854154a50 secure :-1 s=READY pgs=5 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6854059aa0 tx=0x7f684400fc10 comp rx=0 tx=0).stop 2026-02-23T06:24:33.475 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.477+0000 7f682ffff640 1 -- 10.20.193.58:0/1688708601 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6854161eb0 msgr2=0x7f6854154a50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:24:33.475 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.477+0000 7f682ffff640 1 --2- 10.20.193.58:0/1688708601 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6854161eb0 0x7f6854154a50 secure :-1 s=CLOSED pgs=5 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6854059aa0 tx=0x7f684400fc10 comp rx=0 tx=0).stop 2026-02-23T06:24:33.475 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.479+0000 7f682ffff640 1 -- 10.20.193.58:0/1688708601 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f6840038c10 con 0x7f6854056550 2026-02-23T06:24:33.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.480+0000 7f682ffff640 1 --2- 10.20.193.58:0/1688708601 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f682407a430 0x7f682409a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:33.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.480+0000 7f682ffff640 1 -- 10.20.193.58:0/1688708601 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f68400c29d0 con 0x7f6854056550 2026-02-23T06:24:33.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.480+0000 7f6852ffd640 1 --2- 10.20.193.58:0/1688708601 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f682407a430 0x7f682409a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:33.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.481+0000 7f6858e43640 1 --2- 10.20.193.58:0/1688708601 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6854154f90 0x7f6854200d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:33.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.481+0000 7f6858e43640 1 -- 10.20.193.58:0/1688708601 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f6854160fb0 con 0x7f6854154f90 2026-02-23T06:24:33.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.481+0000 7f6853fff640 1 --2- 10.20.193.58:0/1688708601 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6854154f90 0x7f6854200d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:33.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.481+0000 7f6852ffd640 1 --2- 10.20.193.58:0/1688708601 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f682407a430 0x7f682409a8e0 secure :-1 s=READY pgs=160 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6854059aa0 tx=0x7f6844009030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:33.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.481+0000 7f6853fff640 1 -- 10.20.193.58:0/1688708601 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6854161670 con 0x7f6854154f90 2026-02-23T06:24:33.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.481+0000 7f6853fff640 1 --2- 10.20.193.58:0/1688708601 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6854154f90 0x7f6854200d50 secure :-1 s=READY pgs=6 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6848003810 tx=0x7f684800fba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:33.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.482+0000 7f682ffff640 1 -- 10.20.193.58:0/1688708601 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6848018070 con 0x7f6854154f90 2026-02-23T06:24:33.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.482+0000 7f682ffff640 1 -- 10.20.193.58:0/1688708601 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4910 (secure 0 0 0) 0x7f6848003cc0 con 0x7f6854154f90 2026-02-23T06:24:33.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.482+0000 7f682ffff640 1 -- 10.20.193.58:0/1688708601 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6854154f90 msgr2=0x7f6854200d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.482+0000 7f682ffff640 1 --2- 10.20.193.58:0/1688708601 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6854154f90 0x7f6854200d50 secure :-1 s=READY pgs=6 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6848003810 tx=0x7f684800fba0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.482+0000 7f682ffff640 1 -- 10.20.193.58:0/1688708601 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6854154f90 msgr2=0x7f6854200d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:24:33.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.482+0000 7f682ffff640 1 --2- 10.20.193.58:0/1688708601 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6854154f90 0x7f6854200d50 unknown :-1 s=CLOSED pgs=6 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.478 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:24:33.479 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:24:33.479 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:24:33.479 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:24:33.479 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 26, 2026-02-23T06:24:33.479 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 315, 2026-02-23T06:24:33.479 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:24:33.479 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:24:33.479 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:24:33.479 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:24:33.479 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:33.480 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:24:33.480 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:24:33.480 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:24:33.480 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:24:33.480 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:24:33.480 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:24:33.480 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:24:33.480 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:24:33.480 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:24:33.480 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:24:33.480 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:24:33.480 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:24:33.481 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:24:33.481 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:24:33.481 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:24:33.481 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:24:33.481 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:24:33.481 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:33.481 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:24:33.481 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:24:33.481 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:24:33.481 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:24:33.481 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:24:33.481 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:24:33.482 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:24:33.482 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:24:33.482 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:24:33.482 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:24:33.482 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:24:33.482 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:24:33.482 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:24:33.482 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:24:33.482 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:24:33.482 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:33.482 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.483 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:24:33.483 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:24:33.483 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:24:33.483 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:24:33.483 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:24:33.483 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:24:33.483 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:24:33.483 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:24:33.483 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:24:33.483 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:24:33.483 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:24:33.483 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:24:33.484 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:24:33.484 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:24:33.484 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:24:33.484 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:24:33.484 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:24:33.484 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:24:33.484 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:24:33.484 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:24:33.484 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:24:33.484 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:24:33.484 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:24:33.484 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:24:33.484 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:24:33.485 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:24:33.485 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:24:33.485 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:24:33.485 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:24:33.485 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:24:33.485 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:33.485 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:24:33.485 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.485 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:24:33.485 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.485 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:24:33.485 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:24:33.486 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:24:33.486 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:24:33.486 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.486 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:24:33.486 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:24:33.486 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:33.486 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.486 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.486 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:24:33.486 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:24:33.486 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:33.486 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:33.487 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:33.487 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.487 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:24:33.487 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:24:33.487 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:24:33.487 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:24:33.487 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:24:33.487 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:24:33.487 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.487 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.487 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:24:33.487 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:24:33.488 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:24:33.488 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:24:33.488 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.488 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:24:33.488 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:24:33.488 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:33.488 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.488 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.488 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:24:33.488 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:24:33.488 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:33.488 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:33.489 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:33.489 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.489 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:24:33.489 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:24:33.489 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:24:33.489 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:24:33.489 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:24:33.489 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:24:33.489 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.489 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.489 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:24:33.489 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:24:33.489 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:24:33.490 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:24:33.490 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.490 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:24:33.490 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:24:33.490 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:33.490 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.490 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.490 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:24:33.490 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:24:33.490 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:33.490 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:33.490 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:33.491 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.491 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:24:33.491 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:24:33.491 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:24:33.491 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:24:33.491 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:24:33.491 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:24:33.491 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:33.491 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:33.491 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.491 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:24:33.491 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:24:33.491 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.492 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:33.492 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:33.492 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:24:33.492 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:33.492 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:33.492 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:24:33.492 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.492 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:33.492 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:33.493 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:24:33.493 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:33.493 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:33.493 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.493 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:24:33.493 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:24:33.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.482+0000 7f6858e43640 1 -- 10.20.193.58:0/1688708601 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f682407a430 msgr2=0x7f682409a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.482+0000 7f6858e43640 1 --2- 10.20.193.58:0/1688708601 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f682407a430 0x7f682409a8e0 secure :-1 s=READY pgs=160 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6854059aa0 tx=0x7f6844009030 comp rx=0 tx=0).stop 2026-02-23T06:24:33.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.482+0000 7f6858e43640 1 -- 10.20.193.58:0/1688708601 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6854056550 msgr2=0x7f68540b1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.482+0000 7f6858e43640 1 --2- 10.20.193.58:0/1688708601 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6854056550 0x7f68540b1820 secure :-1 s=READY pgs=4 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68400023d0 tx=0x7f6840002950 comp rx=0 tx=0).stop 2026-02-23T06:24:33.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.482+0000 7f6853fff640 1 -- 10.20.193.58:0/1688708601 reap_dead start 2026-02-23T06:24:33.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.482+0000 7f6853fff640 1 -- 10.20.193.58:0/1688708601 reap_dead start 2026-02-23T06:24:33.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.482+0000 7f6858e43640 1 -- 10.20.193.58:0/1688708601 shutdown_connections 2026-02-23T06:24:33.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.482+0000 7f6858e43640 1 -- 10.20.193.58:0/1688708601 >> 10.20.193.58:0/1688708601 conn(0x7f68540b3c20 msgr2=0x7f6854163200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:24:33.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.482+0000 7f6858e43640 1 -- 10.20.193.58:0/1688708601 shutdown_connections 2026-02-23T06:24:33.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.482+0000 7f6858e43640 1 -- 10.20.193.58:0/1688708601 wait complete. 2026-02-23T06:24:33.496 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:24:33.496 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:24:33.496 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:24:33.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.623+0000 7f52c2e83640 1 -- 10.20.193.58:0/3520047592 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f52bc15c4b0 msgr2=0x7f52bc058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.623+0000 7f52c2e83640 1 --2- 10.20.193.58:0/3520047592 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f52bc15c4b0 0x7f52bc058200 secure :-1 s=READY pgs=37 gs=3 cs=0 l=1 c_cookie=12624538882870277547 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52ac005e70 tx=0x7f52ac02f230 comp rx=0 tx=0).stop 2026-02-23T06:24:33.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.623+0000 7f52c2e83640 1 -- 10.20.193.58:0/3520047592 shutdown_connections 2026-02-23T06:24:33.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.623+0000 7f52c2e83640 1 --2- 10.20.193.58:0/3520047592 >> v2:10.20.193.93:3300/0 conn(0x7f52bc162ca0 0x7f52bc056fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.623+0000 7f52c2e83640 1 --2- 10.20.193.58:0/3520047592 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f52bc15c4b0 0x7f52bc058200 unknown :-1 s=CLOSED pgs=37 gs=3 cs=0 l=1 c_cookie=12624538882870277547 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.623+0000 7f52c2e83640 1 -- 10.20.193.58:0/3520047592 >> 10.20.193.58:0/3520047592 conn(0x7f52bc0b3c20 msgr2=0x7f52bc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:24:33.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.623+0000 7f52c2e83640 1 -- 10.20.193.58:0/3520047592 shutdown_connections 2026-02-23T06:24:33.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.623+0000 7f52c2e83640 1 -- 10.20.193.58:0/3520047592 wait complete. 2026-02-23T06:24:33.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.624+0000 7f52c2e83640 1 Processor -- start 2026-02-23T06:24:33.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.625+0000 7f52c2e83640 1 -- start start 2026-02-23T06:24:33.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.625+0000 7f52c2e83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f52bc056960 0x7f52bc11ea30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:33.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.625+0000 7f52c2e83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f52bc15c4b0 0x7f52bc13b540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:33.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.625+0000 7f52c2e83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52bc162ca0 0x7f52bc11bfb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:33.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.625+0000 7f52c2e83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc11f200 con 0x7f52bc056960 2026-02-23T06:24:33.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.625+0000 7f52c2e83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc13ec90 con 0x7f52bc162ca0 2026-02-23T06:24:33.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.625+0000 7f52c2e83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f52bc14e6b0 con 0x7f52bc15c4b0 2026-02-23T06:24:33.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.625+0000 7f52c2682640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52bc162ca0 0x7f52bc11bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:33.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.625+0000 7f52c1680640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f52bc15c4b0 0x7f52bc13b540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:33.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.625+0000 7f52c2682640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52bc162ca0 0x7f52bc11bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:41556/0 (socket says 10.20.193.58:41556) 2026-02-23T06:24:33.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.625+0000 7f52c2682640 1 -- 10.20.193.58:0/2707608849 learned_addr learned my addr 10.20.193.58:0/2707608849 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:24:33.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.625+0000 7f52c1e81640 1 --2- 10.20.193.58:0/2707608849 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f52bc056960 0x7f52bc11ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:33.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.626+0000 7f52c2682640 1 -- 10.20.193.58:0/2707608849 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f52bc15c4b0 msgr2=0x7f52bc13b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.626+0000 7f52c2682640 1 --2- 10.20.193.58:0/2707608849 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f52bc15c4b0 0x7f52bc13b540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.626+0000 7f52c2682640 1 -- 10.20.193.58:0/2707608849 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f52bc056960 msgr2=0x7f52bc11ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.626+0000 7f52c2682640 1 --2- 10.20.193.58:0/2707608849 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f52bc056960 0x7f52bc11ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.626+0000 7f52c2682640 1 -- 10.20.193.58:0/2707608849 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52ac009570 con 0x7f52bc162ca0 2026-02-23T06:24:33.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.626+0000 7f52c1e81640 1 --2- 10.20.193.58:0/2707608849 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f52bc056960 0x7f52bc11ea30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:24:33.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.626+0000 7f52c2682640 1 --2- 10.20.193.58:0/2707608849 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52bc162ca0 0x7f52bc11bfb0 secure :-1 s=READY pgs=281 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52b800f900 tx=0x7f52b800fdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:33.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.626+0000 7f52aa7fc640 1 -- 10.20.193.58:0/2707608849 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f52b800dda0 con 0x7f52bc162ca0 2026-02-23T06:24:33.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.626+0000 7f52aa7fc640 1 -- 10.20.193.58:0/2707608849 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52b8005930 con 0x7f52bc162ca0 2026-02-23T06:24:33.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.626+0000 7f52aa7fc640 1 -- 10.20.193.58:0/2707608849 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f52b8005d60 con 0x7f52bc162ca0 2026-02-23T06:24:33.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.626+0000 7f52c2e83640 1 -- 10.20.193.58:0/2707608849 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52bc14d890 con 0x7f52bc162ca0 2026-02-23T06:24:33.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.626+0000 7f52c2e83640 1 -- 10.20.193.58:0/2707608849 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52bc14de10 con 0x7f52bc162ca0 2026-02-23T06:24:33.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.627+0000 7f52c2e83640 1 --2- 10.20.193.58:0/2707608849 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52bc11d6c0 0x7f52bc11c4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:33.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.627+0000 7f52c2e83640 1 -- 10.20.193.58:0/2707608849 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc11da90 con 0x7f52bc11d6c0 2026-02-23T06:24:33.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.627+0000 7f52c1e81640 1 --2- 10.20.193.58:0/2707608849 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52bc11d6c0 0x7f52bc11c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:33.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.627+0000 7f52c1e81640 1 -- 10.20.193.58:0/2707608849 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f52bc059690 con 0x7f52bc11d6c0 2026-02-23T06:24:33.626 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.628+0000 7f52c1e81640 1 --2- 10.20.193.58:0/2707608849 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52bc11d6c0 0x7f52bc11c4f0 secure :-1 s=READY pgs=282 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52ac004740 tx=0x7f52ac002bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:33.626 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.628+0000 7f52aa7fc640 1 -- 10.20.193.58:0/2707608849 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f52ac03d050 con 0x7f52bc11d6c0 2026-02-23T06:24:33.626 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.628+0000 7f52aa7fc640 1 -- 10.20.193.58:0/2707608849 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f52ac03e040 con 0x7f52bc11d6c0 2026-02-23T06:24:33.626 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.628+0000 7f52aa7fc640 1 -- 10.20.193.58:0/2707608849 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52bc11d6c0 msgr2=0x7f52bc11c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.626 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.628+0000 7f52aa7fc640 1 --2- 10.20.193.58:0/2707608849 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52bc11d6c0 0x7f52bc11c4f0 secure :-1 s=READY pgs=282 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52ac004740 tx=0x7f52ac002bd0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.626 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.628+0000 7f52aa7fc640 1 -- 10.20.193.58:0/2707608849 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52bc11d6c0 msgr2=0x7f52bc11c4f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:24:33.626 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.628+0000 7f52aa7fc640 1 --2- 10.20.193.58:0/2707608849 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52bc11d6c0 0x7f52bc11c4f0 secure :-1 s=CLOSED pgs=282 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52ac004740 tx=0x7f52ac002bd0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.628+0000 7f52aa7fc640 1 -- 10.20.193.58:0/2707608849 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f52b8020060 con 0x7f52bc162ca0 2026-02-23T06:24:33.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.630+0000 7f52aa7fc640 1 --2- 10.20.193.58:0/2707608849 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f528c07a3c0 0x7f528c09a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:33.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.630+0000 7f52aa7fc640 1 -- 10.20.193.58:0/2707608849 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f52b8015070 con 0x7f52bc162ca0 2026-02-23T06:24:33.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.630+0000 7f52c1e81640 1 --2- 10.20.193.58:0/2707608849 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f528c07a3c0 0x7f528c09a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:33.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.631+0000 7f52c1e81640 1 --2- 10.20.193.58:0/2707608849 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f528c07a3c0 0x7f528c09a870 secure :-1 s=READY pgs=161 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52ac004740 tx=0x7f52ac031030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:33.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.632+0000 7f52c2e83640 1 --2- 10.20.193.58:0/2707608849 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52bc14e030 0x7f52bc14a550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:33.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.632+0000 7f52c2e83640 1 -- 10.20.193.58:0/2707608849 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc15c880 con 0x7f52bc14e030 2026-02-23T06:24:33.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.632+0000 7f52c1680640 1 --2- 10.20.193.58:0/2707608849 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52bc14e030 0x7f52bc14a550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:33.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.632+0000 7f52c1680640 1 -- 10.20.193.58:0/2707608849 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f52bc05c260 con 0x7f52bc14e030 2026-02-23T06:24:33.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.633+0000 7f52c1680640 1 --2- 10.20.193.58:0/2707608849 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52bc14e030 0x7f52bc14a550 secure :-1 s=READY pgs=283 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52bc11dda0 tx=0x7f52b000eba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:33.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.633+0000 7f52aa7fc640 1 -- 10.20.193.58:0/2707608849 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f52b0019070 con 0x7f52bc14e030 2026-02-23T06:24:33.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.633+0000 7f52aa7fc640 1 -- 10.20.193.58:0/2707608849 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5555 (secure 0 0 0) 0x7f52b0006ab0 con 0x7f52bc14e030 2026-02-23T06:24:33.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.633+0000 7f52aa7fc640 1 -- 10.20.193.58:0/2707608849 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52bc14e030 msgr2=0x7f52bc14a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.629 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:24:33.629 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:24:33.629 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:24:33.629 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:24:33.630 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 26, 2026-02-23T06:24:33.630 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 211680, 2026-02-23T06:24:33.630 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:24:33.630 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:24:33.630 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:24:33.630 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:24:33.630 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:33.630 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:24:33.630 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:24:33.630 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:24:33.630 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:24:33.631 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:24:33.631 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:24:33.631 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:24:33.631 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:24:33.631 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:24:33.631 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:24:33.631 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:24:33.631 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:24:33.631 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:24:33.631 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:24:33.631 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:24:33.631 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:24:33.631 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:24:33.632 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:33.632 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:24:33.632 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:24:33.632 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:24:33.632 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:24:33.632 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:24:33.632 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:24:33.632 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:24:33.632 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:24:33.632 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:24:33.632 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:24:33.632 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:24:33.633 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:24:33.633 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:24:33.633 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:24:33.633 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:24:33.633 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:33.633 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.633 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:24:33.633 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:24:33.633 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:24:33.633 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:24:33.633 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:24:33.633 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:24:33.634 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:24:33.634 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:24:33.634 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:24:33.634 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:24:33.634 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:24:33.634 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:24:33.634 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:24:33.634 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:24:33.634 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:24:33.634 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:24:33.634 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:24:33.634 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:24:33.635 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:24:33.635 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:24:33.635 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:24:33.635 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:24:33.635 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:24:33.635 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:24:33.635 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:24:33.635 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:24:33.635 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:24:33.635 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:24:33.635 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:24:33.635 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:24:33.635 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:33.636 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:24:33.636 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.636 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:24:33.636 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.636 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:24:33.636 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:24:33.636 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:24:33.636 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:24:33.636 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.636 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:24:33.636 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:24:33.636 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:33.637 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.637 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.637 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:24:33.637 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:24:33.637 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:33.637 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:33.637 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:33.637 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.637 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:24:33.637 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:24:33.637 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:24:33.637 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:24:33.638 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:24:33.638 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:24:33.638 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.638 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.638 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:24:33.638 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:24:33.638 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:24:33.638 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:24:33.638 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.638 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:24:33.638 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:24:33.638 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:33.638 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.639 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.639 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:24:33.639 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:24:33.639 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:33.639 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:33.639 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:33.639 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.639 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:24:33.639 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:24:33.639 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:24:33.639 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:24:33.639 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:24:33.640 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:24:33.640 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.640 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.640 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:24:33.640 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:24:33.640 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:24:33.640 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:24:33.640 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.640 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:24:33.640 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:24:33.640 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:33.640 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.640 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.641 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:24:33.641 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:24:33.641 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:33.641 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:33.641 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:33.641 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.641 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:24:33.641 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:24:33.641 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:24:33.641 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:24:33.641 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:24:33.641 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:24:33.641 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:33.642 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:33.642 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.642 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:24:33.642 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:24:33.642 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.642 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:33.642 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:33.642 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:24:33.642 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:33.642 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:33.642 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:24:33.642 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.643 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:33.643 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:33.643 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:24:33.643 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:33.643 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:33.643 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:24:33.643 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.643 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:33.643 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:33.643 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:24:33.643 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:33.643 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:33.643 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:24:33.644 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.644 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:24:33.644 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:24:33.644 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:24:33.644 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.644 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.644 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:33.644 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:33.644 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:24:33.644 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:33.644 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:33.644 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:24:33.645 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.645 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:33.645 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:33.645 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:24:33.645 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:33.645 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:33.645 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.645 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:24:33.645 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:24:33.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.633+0000 7f52aa7fc640 1 --2- 10.20.193.58:0/2707608849 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52bc14e030 0x7f52bc14a550 secure :-1 s=READY pgs=283 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52bc11dda0 tx=0x7f52b000eba0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.633+0000 7f52aa7fc640 1 -- 10.20.193.58:0/2707608849 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52bc14e030 msgr2=0x7f52bc14a550 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:24:33.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.633+0000 7f52aa7fc640 1 --2- 10.20.193.58:0/2707608849 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52bc14e030 0x7f52bc14a550 secure :-1 s=CLOSED pgs=283 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52bc11dda0 tx=0x7f52b000eba0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.633+0000 7f52c2e83640 1 -- 10.20.193.58:0/2707608849 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f528c07a3c0 msgr2=0x7f528c09a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.633+0000 7f52c2e83640 1 --2- 10.20.193.58:0/2707608849 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f528c07a3c0 0x7f528c09a870 secure :-1 s=READY pgs=161 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52ac004740 tx=0x7f52ac031030 comp rx=0 tx=0).stop 2026-02-23T06:24:33.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.633+0000 7f52c2e83640 1 -- 10.20.193.58:0/2707608849 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52bc162ca0 msgr2=0x7f52bc11bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.633+0000 7f52c2e83640 1 --2- 10.20.193.58:0/2707608849 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52bc162ca0 0x7f52bc11bfb0 secure :-1 s=READY pgs=281 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52b800f900 tx=0x7f52b800fdd0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.633+0000 7f52c2682640 1 -- 10.20.193.58:0/2707608849 reap_dead start 2026-02-23T06:24:33.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.633+0000 7f52c2682640 1 -- 10.20.193.58:0/2707608849 reap_dead start 2026-02-23T06:24:33.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.633+0000 7f52c2e83640 1 -- 10.20.193.58:0/2707608849 shutdown_connections 2026-02-23T06:24:33.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.633+0000 7f52c2e83640 1 -- 10.20.193.58:0/2707608849 >> 10.20.193.58:0/2707608849 conn(0x7f52bc0b3c20 msgr2=0x7f52bc0b7680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:24:33.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.633+0000 7f52c2e83640 1 -- 10.20.193.58:0/2707608849 shutdown_connections 2026-02-23T06:24:33.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.633+0000 7f52c2e83640 1 -- 10.20.193.58:0/2707608849 wait complete. 2026-02-23T06:24:33.648 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:24:33.649 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:24:33.649 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:24:33.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.785+0000 7f3c77fff640 1 -- 10.20.193.58:0/2666650567 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3c78159c90 msgr2=0x7f3c781633c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.785+0000 7f3c77fff640 1 --2- 10.20.193.58:0/2666650567 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3c78159c90 0x7f3c781633c0 secure :-1 s=READY pgs=285 gs=2 cs=0 l=1 c_cookie=11892363217115654998 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c78057290 tx=0x7f3c6c02f250 comp rx=0 tx=0).stop 2026-02-23T06:24:33.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.785+0000 7f3c77fff640 1 -- 10.20.193.58:0/2666650567 shutdown_connections 2026-02-23T06:24:33.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.785+0000 7f3c77fff640 1 --2- 10.20.193.58:0/2666650567 >> v2:10.20.193.58:3300/0 conn(0x7f3c7815a060 0x7f3c781669b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.785+0000 7f3c77fff640 1 --2- 10.20.193.58:0/2666650567 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3c78159c90 0x7f3c781633c0 unknown :-1 s=CLOSED pgs=285 gs=2 cs=0 l=1 c_cookie=11892363217115654998 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.785+0000 7f3c77fff640 1 -- 10.20.193.58:0/2666650567 >> 10.20.193.58:0/2666650567 conn(0x7f3c78059db0 msgr2=0x7f3c7805a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:24:33.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.785+0000 7f3c77fff640 1 -- 10.20.193.58:0/2666650567 shutdown_connections 2026-02-23T06:24:33.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.785+0000 7f3c77fff640 1 -- 10.20.193.58:0/2666650567 wait complete. 2026-02-23T06:24:33.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.786+0000 7f3c77fff640 1 Processor -- start 2026-02-23T06:24:33.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.787+0000 7f3c77fff640 1 -- start start 2026-02-23T06:24:33.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.787+0000 7f3c77fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c780b6620 0x7f3c781623b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:33.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.787+0000 7f3c77fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c78159c90 0x7f3c78201190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:33.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.787+0000 7f3c77fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3c7815a060 0x7f3c782016d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:33.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.787+0000 7f3c77fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7815e9d0 con 0x7f3c78159c90 2026-02-23T06:24:33.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.787+0000 7f3c77fff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7815ec80 con 0x7f3c7815a060 2026-02-23T06:24:33.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.787+0000 7f3c77fff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f3c7805d6a0 con 0x7f3c780b6620 2026-02-23T06:24:33.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.788+0000 7f3c767fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c78159c90 0x7f3c78201190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:33.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.788+0000 7f3c76ffd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c780b6620 0x7f3c781623b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:33.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.788+0000 7f3c76ffd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c780b6620 0x7f3c781623b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:53112/0 (socket says 10.20.193.58:53112) 2026-02-23T06:24:33.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.788+0000 7f3c76ffd640 1 -- 10.20.193.58:0/748166974 learned_addr learned my addr 10.20.193.58:0/748166974 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:24:33.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.788+0000 7f3c777fe640 1 --2- 10.20.193.58:0/748166974 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3c7815a060 0x7f3c782016d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:33.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.788+0000 7f3c767fc640 1 -- 10.20.193.58:0/748166974 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c780b6620 msgr2=0x7f3c781623b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.788+0000 7f3c767fc640 1 --2- 10.20.193.58:0/748166974 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c780b6620 0x7f3c781623b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.788+0000 7f3c767fc640 1 -- 10.20.193.58:0/748166974 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3c7815a060 msgr2=0x7f3c782016d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.788+0000 7f3c767fc640 1 --2- 10.20.193.58:0/748166974 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3c7815a060 0x7f3c782016d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.788+0000 7f3c767fc640 1 -- 10.20.193.58:0/748166974 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c6c009570 con 0x7f3c78159c90 2026-02-23T06:24:33.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.788+0000 7f3c767fc640 1 --2- 10.20.193.58:0/748166974 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c78159c90 0x7f3c78201190 secure :-1 s=READY pgs=7 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c6000e9f0 tx=0x7f3c6000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:33.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.788+0000 7f3c577fe640 1 -- 10.20.193.58:0/748166974 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3c6000cce0 con 0x7f3c78159c90 2026-02-23T06:24:33.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.788+0000 7f3c77fff640 1 -- 10.20.193.58:0/748166974 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c7815e6f0 con 0x7f3c78159c90 2026-02-23T06:24:33.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.788+0000 7f3c577fe640 1 -- 10.20.193.58:0/748166974 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c6000ce40 con 0x7f3c78159c90 2026-02-23T06:24:33.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.788+0000 7f3c577fe640 1 -- 10.20.193.58:0/748166974 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3c6000cce0 con 0x7f3c78159c90 2026-02-23T06:24:33.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.788+0000 7f3c77fff640 1 -- 10.20.193.58:0/748166974 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c78200c70 con 0x7f3c78159c90 2026-02-23T06:24:33.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.789+0000 7f3c77fff640 1 --2- 10.20.193.58:0/748166974 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c400041f0 0x7f3c400246a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:33.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.789+0000 7f3c77fff640 1 -- 10.20.193.58:0/748166974 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f3c40025f20 con 0x7f3c400041f0 2026-02-23T06:24:33.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.789+0000 7f3c76ffd640 1 --2- 10.20.193.58:0/748166974 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c400041f0 0x7f3c400246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:33.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.789+0000 7f3c76ffd640 1 -- 10.20.193.58:0/748166974 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3c400260e0 con 0x7f3c400041f0 2026-02-23T06:24:33.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.790+0000 7f3c76ffd640 1 --2- 10.20.193.58:0/748166974 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c400041f0 0x7f3c400246a0 secure :-1 s=READY pgs=38 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c6c0098a0 tx=0x7f3c6c0028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:33.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.790+0000 7f3c577fe640 1 -- 10.20.193.58:0/748166974 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3c6c03d050 con 0x7f3c400041f0 2026-02-23T06:24:33.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.790+0000 7f3c577fe640 1 -- 10.20.193.58:0/748166974 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f3c6c03e040 con 0x7f3c400041f0 2026-02-23T06:24:33.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.790+0000 7f3c577fe640 1 -- 10.20.193.58:0/748166974 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c400041f0 msgr2=0x7f3c400246a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.790+0000 7f3c577fe640 1 --2- 10.20.193.58:0/748166974 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c400041f0 0x7f3c400246a0 secure :-1 s=READY pgs=38 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c6c0098a0 tx=0x7f3c6c0028d0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.790+0000 7f3c577fe640 1 -- 10.20.193.58:0/748166974 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c400041f0 msgr2=0x7f3c400246a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:24:33.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.790+0000 7f3c577fe640 1 --2- 10.20.193.58:0/748166974 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c400041f0 0x7f3c400246a0 secure :-1 s=CLOSED pgs=38 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c6c0098a0 tx=0x7f3c6c0028d0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.790+0000 7f3c577fe640 1 -- 10.20.193.58:0/748166974 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f3c6001f060 con 0x7f3c78159c90 2026-02-23T06:24:33.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.791+0000 7f3c577fe640 1 --2- 10.20.193.58:0/748166974 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3c4407a430 0x7f3c4409a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:33.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.791+0000 7f3c577fe640 1 -- 10.20.193.58:0/748166974 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f3c60014070 con 0x7f3c78159c90 2026-02-23T06:24:33.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.794+0000 7f3c76ffd640 1 --2- 10.20.193.58:0/748166974 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3c4407a430 0x7f3c4409a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:33.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.794+0000 7f3c76ffd640 1 --2- 10.20.193.58:0/748166974 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3c4407a430 0x7f3c4409a8e0 secure :-1 s=READY pgs=162 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c6c02f7d0 tx=0x7f3c6c031030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:33.790 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.795+0000 7f3c77fff640 1 --2- 10.20.193.58:0/748166974 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c40024fb0 0x7f3c40025430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:33.790 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.795+0000 7f3c77fff640 1 -- 10.20.193.58:0/748166974 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f3c40025a90 con 0x7f3c40024fb0 2026-02-23T06:24:33.790 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.795+0000 7f3c777fe640 1 --2- 10.20.193.58:0/748166974 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c40024fb0 0x7f3c40025430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:33.791 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.796+0000 7f3c777fe640 1 -- 10.20.193.58:0/748166974 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3c40025c50 con 0x7f3c40024fb0 2026-02-23T06:24:33.791 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.796+0000 7f3c777fe640 1 --2- 10.20.193.58:0/748166974 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c40024fb0 0x7f3c40025430 secure :-1 s=READY pgs=39 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c68008fd0 tx=0x7f3c6800fba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:33.791 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.796+0000 7f3c577fe640 1 -- 10.20.193.58:0/748166974 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3c6801a070 con 0x7f3c40024fb0 2026-02-23T06:24:33.791 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.796+0000 7f3c577fe640 1 -- 10.20.193.58:0/748166974 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5244 (secure 0 0 0) 0x7f3c68007b90 con 0x7f3c40024fb0 2026-02-23T06:24:33.792 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:24:33.792 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:24:33.792 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:24:33.792 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:24:33.792 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 26, 2026-02-23T06:24:33.792 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 72338, 2026-02-23T06:24:33.792 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:24:33.792 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:24:33.792 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:24:33.793 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:24:33.793 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:33.793 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:24:33.793 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:24:33.793 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:24:33.793 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:24:33.793 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:24:33.793 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:24:33.793 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:24:33.793 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:24:33.793 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:24:33.794 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:24:33.794 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:24:33.794 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:24:33.794 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:24:33.794 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:24:33.794 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:24:33.794 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:24:33.794 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:24:33.794 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:33.794 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:24:33.794 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:24:33.795 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:24:33.795 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:24:33.795 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:24:33.795 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:24:33.795 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:24:33.795 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:24:33.795 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:24:33.795 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:24:33.795 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:24:33.795 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:24:33.796 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:24:33.796 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:24:33.796 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:24:33.796 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:33.796 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.796 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:24:33.796 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:24:33.796 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:24:33.796 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:24:33.796 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:24:33.796 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:24:33.796 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:24:33.797 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:24:33.797 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:24:33.797 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:24:33.797 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:24:33.797 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:24:33.797 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:24:33.797 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:24:33.797 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:24:33.797 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:24:33.797 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:24:33.797 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:24:33.797 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:24:33.798 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:24:33.798 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:24:33.798 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:24:33.798 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:24:33.798 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:24:33.798 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:24:33.798 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:24:33.798 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:24:33.798 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:24:33.798 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:24:33.798 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:24:33.798 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:33.798 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:24:33.799 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.799 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:24:33.799 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.799 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:24:33.799 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:24:33.799 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:24:33.799 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:24:33.799 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.799 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:24:33.799 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:24:33.799 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:33.799 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.800 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.800 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:24:33.800 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:24:33.800 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:33.800 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:33.800 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:33.800 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.800 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:24:33.800 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:24:33.800 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:24:33.800 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:24:33.800 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:24:33.801 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:24:33.801 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.801 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.801 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:24:33.801 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:24:33.801 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:24:33.801 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:24:33.801 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.801 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:24:33.801 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:24:33.801 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:33.801 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.801 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.802 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:24:33.802 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:24:33.802 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:33.802 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:33.802 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:33.802 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.802 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:24:33.802 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:24:33.802 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:24:33.802 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:24:33.802 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:24:33.802 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:24:33.803 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.803 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.803 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:24:33.803 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:24:33.803 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:24:33.803 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:24:33.803 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.803 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:24:33.803 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:24:33.803 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:33.803 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.803 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.804 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:24:33.804 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:24:33.804 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:33.804 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:33.804 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:33.804 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.804 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:24:33.804 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:24:33.804 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:24:33.804 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:24:33.804 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:24:33.804 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:24:33.804 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:33.805 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:33.805 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.805 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:24:33.805 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:24:33.805 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.805 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:33.805 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:33.805 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:24:33.805 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:33.805 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:33.805 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:24:33.805 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.806 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:33.806 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:33.806 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:24:33.806 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:33.806 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:33.806 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:24:33.806 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.806 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:33.806 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:33.806 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:24:33.806 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:33.806 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:33.806 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:24:33.807 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:33.807 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:33.807 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:33.807 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:24:33.807 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:33.807 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:33.807 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:33.807 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:24:33.807 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:24:33.809 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.796+0000 7f3c577fe640 1 -- 10.20.193.58:0/748166974 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c40024fb0 msgr2=0x7f3c40025430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.809 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.796+0000 7f3c577fe640 1 --2- 10.20.193.58:0/748166974 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c40024fb0 0x7f3c40025430 secure :-1 s=READY pgs=39 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c68008fd0 tx=0x7f3c6800fba0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.809 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.796+0000 7f3c577fe640 1 -- 10.20.193.58:0/748166974 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c40024fb0 msgr2=0x7f3c40025430 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:24:33.809 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.796+0000 7f3c577fe640 1 --2- 10.20.193.58:0/748166974 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c40024fb0 0x7f3c40025430 unknown :-1 s=CLOSED pgs=39 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.809 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.796+0000 7f3c77fff640 1 -- 10.20.193.58:0/748166974 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3c4407a430 msgr2=0x7f3c4409a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.809 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.796+0000 7f3c77fff640 1 --2- 10.20.193.58:0/748166974 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3c4407a430 0x7f3c4409a8e0 secure :-1 s=READY pgs=162 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c6c02f7d0 tx=0x7f3c6c031030 comp rx=0 tx=0).stop 2026-02-23T06:24:33.810 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.796+0000 7f3c77fff640 1 -- 10.20.193.58:0/748166974 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c78159c90 msgr2=0x7f3c78201190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.810 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.796+0000 7f3c77fff640 1 --2- 10.20.193.58:0/748166974 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c78159c90 0x7f3c78201190 secure :-1 s=READY pgs=7 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c6000e9f0 tx=0x7f3c6000eec0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.810 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.796+0000 7f3c777fe640 1 -- 10.20.193.58:0/748166974 reap_dead start 2026-02-23T06:24:33.810 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.797+0000 7f3c77fff640 1 -- 10.20.193.58:0/748166974 shutdown_connections 2026-02-23T06:24:33.810 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.797+0000 7f3c77fff640 1 -- 10.20.193.58:0/748166974 >> 10.20.193.58:0/748166974 conn(0x7f3c78059db0 msgr2=0x7f3c78163680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:24:33.810 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.797+0000 7f3c77fff640 1 -- 10.20.193.58:0/748166974 shutdown_connections 2026-02-23T06:24:33.810 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.797+0000 7f3c77fff640 1 -- 10.20.193.58:0/748166974 wait complete. 2026-02-23T06:24:33.810 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:24:33.811 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:24:33.811 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:24:33.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.937+0000 7fa493577640 1 -- 10.20.193.58:0/3546833344 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa494162ca0 msgr2=0x7fa494056fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.937+0000 7fa493577640 1 --2- 10.20.193.58:0/3546833344 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa494162ca0 0x7fa494056fc0 secure :-1 s=READY pgs=8 gs=3 cs=0 l=1 c_cookie=10051770057475355487 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa484005820 tx=0x7fa4840302b0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.937+0000 7fa493577640 1 -- 10.20.193.58:0/3546833344 shutdown_connections 2026-02-23T06:24:33.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.937+0000 7fa493577640 1 --2- 10.20.193.58:0/3546833344 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa494162ca0 0x7fa494056fc0 unknown :-1 s=CLOSED pgs=8 gs=3 cs=0 l=1 c_cookie=10051770057475355487 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.937+0000 7fa493577640 1 --2- 10.20.193.58:0/3546833344 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa49415c4b0 0x7fa494058200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.937+0000 7fa493577640 1 -- 10.20.193.58:0/3546833344 >> 10.20.193.58:0/3546833344 conn(0x7fa4940b3c20 msgr2=0x7fa4940b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:24:33.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.938+0000 7fa493577640 1 -- 10.20.193.58:0/3546833344 shutdown_connections 2026-02-23T06:24:33.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.938+0000 7fa493577640 1 -- 10.20.193.58:0/3546833344 wait complete. 2026-02-23T06:24:33.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.939+0000 7fa493577640 1 Processor -- start 2026-02-23T06:24:33.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.939+0000 7fa493577640 1 -- start start 2026-02-23T06:24:33.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.939+0000 7fa493577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa494056960 0x7fa4940b7890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:33.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.940+0000 7fa493577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa49415c4b0 0x7fa49415f4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:33.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.940+0000 7fa493577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa494162ca0 0x7fa49415e7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:33.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.940+0000 7fa493577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa494163c40 con 0x7fa494162ca0 2026-02-23T06:24:33.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.940+0000 7fa493577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fa49413d340 con 0x7fa494056960 2026-02-23T06:24:33.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.940+0000 7fa493577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa49413dc50 con 0x7fa49415c4b0 2026-02-23T06:24:33.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.940+0000 7fa492575640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa494056960 0x7fa4940b7890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:33.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.940+0000 7fa492d76640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa494162ca0 0x7fa49415e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:33.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.940+0000 7fa492575640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa494056960 0x7fa4940b7890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:41602/0 (socket says 10.20.193.58:41602) 2026-02-23T06:24:33.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.940+0000 7fa492575640 1 -- 10.20.193.58:0/2906723446 learned_addr learned my addr 10.20.193.58:0/2906723446 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:24:33.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.940+0000 7fa491d74640 1 --2- 10.20.193.58:0/2906723446 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa49415c4b0 0x7fa49415f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:33.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.940+0000 7fa492d76640 1 -- 10.20.193.58:0/2906723446 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa49415c4b0 msgr2=0x7fa49415f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.940+0000 7fa492d76640 1 --2- 10.20.193.58:0/2906723446 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa49415c4b0 0x7fa49415f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.940+0000 7fa492d76640 1 -- 10.20.193.58:0/2906723446 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa494056960 msgr2=0x7fa4940b7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:33.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.940+0000 7fa492d76640 1 --2- 10.20.193.58:0/2906723446 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa494056960 0x7fa4940b7890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:33.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.940+0000 7fa492d76640 1 -- 10.20.193.58:0/2906723446 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa48400a590 con 0x7fa494162ca0 2026-02-23T06:24:33.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.940+0000 7fa492d76640 1 --2- 10.20.193.58:0/2906723446 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa494162ca0 0x7fa49415e7a0 secure :-1 s=READY pgs=9 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4940b5270 tx=0x7fa484003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:33.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.940+0000 7fa47affd640 1 -- 10.20.193.58:0/2906723446 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa48403e070 con 0x7fa494162ca0 2026-02-23T06:24:33.938 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.940+0000 7fa47affd640 1 -- 10.20.193.58:0/2906723446 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4840398a0 con 0x7fa494162ca0 2026-02-23T06:24:33.938 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.940+0000 7fa47affd640 1 -- 10.20.193.58:0/2906723446 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa484039c30 con 0x7fa494162ca0 2026-02-23T06:24:33.938 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.940+0000 7fa493577640 1 -- 10.20.193.58:0/2906723446 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa49413d690 con 0x7fa494162ca0 2026-02-23T06:24:33.938 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.941+0000 7fa493577640 1 -- 10.20.193.58:0/2906723446 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa49415dfa0 con 0x7fa494162ca0 2026-02-23T06:24:33.938 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.941+0000 7fa493577640 1 -- 10.20.193.58:0/2906723446 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4940b09a0 con 0x7fa494162ca0 2026-02-23T06:24:33.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.942+0000 7fa47affd640 1 -- 10.20.193.58:0/2906723446 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fa484049020 con 0x7fa494162ca0 2026-02-23T06:24:33.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.943+0000 7fa47affd640 1 --2- 10.20.193.58:0/2906723446 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa46007a6c0 0x7fa46009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:33.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.943+0000 7fa47affd640 1 -- 10.20.193.58:0/2906723446 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fa4840c3cb0 con 0x7fa494162ca0 2026-02-23T06:24:33.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.944+0000 7fa492575640 1 --2- 10.20.193.58:0/2906723446 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa46007a6c0 0x7fa46009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:33.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.944+0000 7fa492575640 1 --2- 10.20.193.58:0/2906723446 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa46007a6c0 0x7fa46009ab70 secure :-1 s=READY pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa48800b2c0 tx=0x7fa48800b4a0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:33.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:33.945+0000 7fa47affd640 1 -- 10.20.193.58:0/2906723446 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fa484087000 con 0x7fa494162ca0 2026-02-23T06:24:34.094 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:34.100+0000 7fa493577640 1 -- 10.20.193.58:0/2906723446 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fa4940b1470 con 0x7fa494162ca0 2026-02-23T06:24:34.095 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:34.100+0000 7fa47affd640 1 -- 10.20.193.58:0/2906723446 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fa48408a120 con 0x7fa494162ca0 2026-02-23T06:24:34.096 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:34.101+0000 7fa493577640 1 -- 10.20.193.58:0/2906723446 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa46007a6c0 msgr2=0x7fa46009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:34.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:34.101+0000 7fa493577640 1 --2- 10.20.193.58:0/2906723446 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa46007a6c0 0x7fa46009ab70 secure :-1 s=READY pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa48800b2c0 tx=0x7fa48800b4a0 comp rx=0 tx=0).stop 2026-02-23T06:24:34.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:34.101+0000 7fa493577640 1 -- 10.20.193.58:0/2906723446 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa494162ca0 msgr2=0x7fa49415e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:34.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:34.101+0000 7fa493577640 1 --2- 10.20.193.58:0/2906723446 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa494162ca0 0x7fa49415e7a0 secure :-1 s=READY pgs=9 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4940b5270 tx=0x7fa484003d00 comp rx=0 tx=0).stop 2026-02-23T06:24:34.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:34.101+0000 7fa493577640 1 -- 10.20.193.58:0/2906723446 shutdown_connections 2026-02-23T06:24:34.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:34.101+0000 7fa493577640 1 --2- 10.20.193.58:0/2906723446 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa46007a6c0 0x7fa46009ab70 unknown :-1 s=CLOSED pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:34.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:34.101+0000 7fa493577640 1 --2- 10.20.193.58:0/2906723446 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa494162ca0 0x7fa49415e7a0 unknown :-1 s=CLOSED pgs=9 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:34.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:34.101+0000 7fa493577640 1 --2- 10.20.193.58:0/2906723446 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa49415c4b0 0x7fa49415f4d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:34.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:34.101+0000 7fa493577640 1 --2- 10.20.193.58:0/2906723446 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa494056960 0x7fa4940b7890 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:34.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:34.101+0000 7fa493577640 1 -- 10.20.193.58:0/2906723446 >> 10.20.193.58:0/2906723446 conn(0x7fa4940b3c20 msgr2=0x7fa4940b6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:24:34.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:34.101+0000 7fa493577640 1 -- 10.20.193.58:0/2906723446 shutdown_connections 2026-02-23T06:24:34.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:34.101+0000 7fa493577640 1 -- 10.20.193.58:0/2906723446 wait complete. 2026-02-23T06:24:34.108 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:24:42.200 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:24:42.204 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:24:44.109 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:24:44.109 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:24:44.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.245+0000 7f66c05fe640 1 -- 10.20.193.58:0/4140330374 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f66a0005200 msgr2=0x7f66a0065a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:44.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.245+0000 7f66c05fe640 1 --2- 10.20.193.58:0/4140330374 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f66a0005200 0x7f66a0065a10 secure :-1 s=READY pgs=11 gs=4 cs=0 l=1 c_cookie=4236145772251894456 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66b400ac20 tx=0x7f66b4030d10 comp rx=0 tx=0).stop 2026-02-23T06:24:44.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.245+0000 7f66c05fe640 1 -- 10.20.193.58:0/4140330374 shutdown_connections 2026-02-23T06:24:44.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.245+0000 7f66c05fe640 1 --2- 10.20.193.58:0/4140330374 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f66a0005200 0x7f66a0065a10 unknown :-1 s=CLOSED pgs=11 gs=4 cs=0 l=1 c_cookie=4236145772251894456 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.245+0000 7f66c05fe640 1 -- 10.20.193.58:0/4140330374 >> 10.20.193.58:0/4140330374 conn(0x7f66b8058e50 msgr2=0x7f66b8059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:24:44.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.246+0000 7f66c05fe640 1 -- 10.20.193.58:0/4140330374 shutdown_connections 2026-02-23T06:24:44.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.246+0000 7f66c05fe640 1 -- 10.20.193.58:0/4140330374 wait complete. 2026-02-23T06:24:44.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.247+0000 7f66c05fe640 1 Processor -- start 2026-02-23T06:24:44.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.247+0000 7f66c05fe640 1 -- start start 2026-02-23T06:24:44.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.247+0000 7f66c05fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f66a0005200 0x7f66b8137680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:44.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.247+0000 7f66c05fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f66b8158130 0x7f66b81fd600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:44.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.247+0000 7f66c05fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f66b805cb30 0x7f66b81fdb40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:44.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.247+0000 7f66c05fe640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f66b81384b0 con 0x7f66b805cb30 2026-02-23T06:24:44.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.247+0000 7f66c05fe640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f66b81575f0 con 0x7f66a0005200 2026-02-23T06:24:44.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.247+0000 7f66c05fe640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f66b8158750 con 0x7f66b8158130 2026-02-23T06:24:44.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.248+0000 7f66beb74640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f66b805cb30 0x7f66b81fdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:44.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.248+0000 7f66beb74640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f66b805cb30 0x7f66b81fdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:35806/0 (socket says 10.20.193.58:35806) 2026-02-23T06:24:44.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.248+0000 7f66beb74640 1 -- 10.20.193.58:0/1570608713 learned_addr learned my addr 10.20.193.58:0/1570608713 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:24:44.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.248+0000 7f66be373640 1 --2- 10.20.193.58:0/1570608713 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f66a0005200 0x7f66b8137680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:44.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.248+0000 7f66bdb72640 1 --2- 10.20.193.58:0/1570608713 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f66b8158130 0x7f66b81fd600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:44.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.248+0000 7f66beb74640 1 -- 10.20.193.58:0/1570608713 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f66b8158130 msgr2=0x7f66b81fd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:44.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.248+0000 7f66beb74640 1 --2- 10.20.193.58:0/1570608713 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f66b8158130 0x7f66b81fd600 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.248+0000 7f66beb74640 1 -- 10.20.193.58:0/1570608713 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f66a0005200 msgr2=0x7f66b8137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:44.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.248+0000 7f66beb74640 1 --2- 10.20.193.58:0/1570608713 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f66a0005200 0x7f66b8137680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.248+0000 7f66beb74640 1 -- 10.20.193.58:0/1570608713 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66b8158fd0 con 0x7f66b805cb30 2026-02-23T06:24:44.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.248+0000 7f66beb74640 1 --2- 10.20.193.58:0/1570608713 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f66b805cb30 0x7f66b81fdb40 secure :-1 s=READY pgs=12 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66b4006ad0 tx=0x7f66b40057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:44.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.248+0000 7f669effd640 1 -- 10.20.193.58:0/1570608713 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66b4040070 con 0x7f66b805cb30 2026-02-23T06:24:44.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.248+0000 7f66c05fe640 1 -- 10.20.193.58:0/1570608713 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66b8137f70 con 0x7f66b805cb30 2026-02-23T06:24:44.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.248+0000 7f669effd640 1 -- 10.20.193.58:0/1570608713 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66b40039a0 con 0x7f66b805cb30 2026-02-23T06:24:44.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.248+0000 7f669effd640 1 -- 10.20.193.58:0/1570608713 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66b4003d70 con 0x7f66b805cb30 2026-02-23T06:24:44.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.248+0000 7f66c05fe640 1 -- 10.20.193.58:0/1570608713 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66b8158980 con 0x7f66b805cb30 2026-02-23T06:24:44.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.249+0000 7f66c05fe640 1 -- 10.20.193.58:0/1570608713 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66b8159180 con 0x7f66b805cb30 2026-02-23T06:24:44.249 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.250+0000 7f669effd640 1 -- 10.20.193.58:0/1570608713 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f66b4031630 con 0x7f66b805cb30 2026-02-23T06:24:44.249 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.251+0000 7f669effd640 1 --2- 10.20.193.58:0/1570608713 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f668807a6c0 0x7f668809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:44.249 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.251+0000 7f669effd640 1 -- 10.20.193.58:0/1570608713 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f66b40c31b0 con 0x7f66b805cb30 2026-02-23T06:24:44.249 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.252+0000 7f66be373640 1 --2- 10.20.193.58:0/1570608713 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f668807a6c0 0x7f668809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:44.249 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.253+0000 7f66be373640 1 --2- 10.20.193.58:0/1570608713 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f668807a6c0 0x7f668809ab70 secure :-1 s=READY pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66a8002b30 tx=0x7f66a8002720 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:44.249 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.253+0000 7f669effd640 1 -- 10.20.193.58:0/1570608713 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f66b4086340 con 0x7f66b805cb30 2026-02-23T06:24:44.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.408+0000 7f66c05fe640 1 -- 10.20.193.58:0/1570608713 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f66b8159180 con 0x7f66b805cb30 2026-02-23T06:24:44.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.408+0000 7f669effd640 1 -- 10.20.193.58:0/1570608713 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f66b8159180 con 0x7f66b805cb30 2026-02-23T06:24:44.403 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:24:44.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.409+0000 7f66c05fe640 1 -- 10.20.193.58:0/1570608713 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f668807a6c0 msgr2=0x7f668809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:44.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.409+0000 7f66c05fe640 1 --2- 10.20.193.58:0/1570608713 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f668807a6c0 0x7f668809ab70 secure :-1 s=READY pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66a8002b30 tx=0x7f66a8002720 comp rx=0 tx=0).stop 2026-02-23T06:24:44.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.409+0000 7f66c05fe640 1 -- 10.20.193.58:0/1570608713 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f66b805cb30 msgr2=0x7f66b81fdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:44.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.409+0000 7f66c05fe640 1 --2- 10.20.193.58:0/1570608713 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f66b805cb30 0x7f66b81fdb40 secure :-1 s=READY pgs=12 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66b4006ad0 tx=0x7f66b40057b0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.409+0000 7f66c05fe640 1 -- 10.20.193.58:0/1570608713 shutdown_connections 2026-02-23T06:24:44.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.409+0000 7f66c05fe640 1 --2- 10.20.193.58:0/1570608713 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f668807a6c0 0x7f668809ab70 unknown :-1 s=CLOSED pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.409+0000 7f66c05fe640 1 --2- 10.20.193.58:0/1570608713 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f66b805cb30 0x7f66b81fdb40 unknown :-1 s=CLOSED pgs=12 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.409+0000 7f66c05fe640 1 --2- 10.20.193.58:0/1570608713 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f66b8158130 0x7f66b81fd600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.406 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.409+0000 7f66c05fe640 1 --2- 10.20.193.58:0/1570608713 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f66a0005200 0x7f66b8137680 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.406 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.409+0000 7f66c05fe640 1 -- 10.20.193.58:0/1570608713 >> 10.20.193.58:0/1570608713 conn(0x7f66b8058e50 msgr2=0x7f66b815bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:24:44.406 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.409+0000 7f66c05fe640 1 -- 10.20.193.58:0/1570608713 shutdown_connections 2026-02-23T06:24:44.406 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.409+0000 7f66c05fe640 1 -- 10.20.193.58:0/1570608713 wait complete. 2026-02-23T06:24:44.417 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:24:44.417 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:24:44.417 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:24:44.418 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:24:44.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.546+0000 7f218cfd2640 1 -- 10.20.193.58:0/919581655 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f218815d4a0 msgr2=0x7f21880affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:44.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.546+0000 7f218cfd2640 1 --2- 10.20.193.58:0/919581655 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f218815d4a0 0x7f21880affb0 secure :-1 s=READY pgs=40 gs=3 cs=0 l=1 c_cookie=4675584750527855576 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2174009890 tx=0x7f217402f200 comp rx=0 tx=0).stop 2026-02-23T06:24:44.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.548+0000 7f218cfd2640 1 -- 10.20.193.58:0/919581655 shutdown_connections 2026-02-23T06:24:44.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.548+0000 7f218cfd2640 1 --2- 10.20.193.58:0/919581655 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f218815d4a0 0x7f21880affb0 unknown :-1 s=CLOSED pgs=40 gs=3 cs=0 l=1 c_cookie=4675584750527855576 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.548+0000 7f218cfd2640 1 -- 10.20.193.58:0/919581655 >> 10.20.193.58:0/919581655 conn(0x7f21880b3c20 msgr2=0x7f21880b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:24:44.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.548+0000 7f218cfd2640 1 -- 10.20.193.58:0/919581655 shutdown_connections 2026-02-23T06:24:44.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.548+0000 7f218cfd2640 1 -- 10.20.193.58:0/919581655 wait complete. 2026-02-23T06:24:44.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.549+0000 7f218cfd2640 1 Processor -- start 2026-02-23T06:24:44.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.550+0000 7f218cfd2640 1 -- start start 2026-02-23T06:24:44.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.550+0000 7f218cfd2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f21880b6690 0x7f218815afc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:44.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.550+0000 7f218cfd2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f218815d4a0 0x7f2188205510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:44.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.550+0000 7f218cfd2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f218815d870 0x7f2188205a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:44.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.550+0000 7f218cfd2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f218813f0b0 con 0x7f218815d870 2026-02-23T06:24:44.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.550+0000 7f218cfd2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f21880ae570 con 0x7f21880b6690 2026-02-23T06:24:44.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.550+0000 7f218cfd2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f218813b890 con 0x7f218815d4a0 2026-02-23T06:24:44.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.550+0000 7f21877fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f21880b6690 0x7f218815afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:44.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.550+0000 7f21877fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f21880b6690 0x7f218815afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:43850/0 (socket says 10.20.193.58:43850) 2026-02-23T06:24:44.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.550+0000 7f21877fe640 1 -- 10.20.193.58:0/1907067919 learned_addr learned my addr 10.20.193.58:0/1907067919 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:24:44.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.551+0000 7f2187fff640 1 --2- 10.20.193.58:0/1907067919 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f218815d870 0x7f2188205a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:44.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.551+0000 7f21877fe640 1 -- 10.20.193.58:0/1907067919 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f218815d4a0 msgr2=0x7f2188205510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:44.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.551+0000 7f2186ffd640 1 --2- 10.20.193.58:0/1907067919 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f218815d4a0 0x7f2188205510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:44.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.551+0000 7f21877fe640 1 --2- 10.20.193.58:0/1907067919 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f218815d4a0 0x7f2188205510 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.551+0000 7f21877fe640 1 -- 10.20.193.58:0/1907067919 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f218815d870 msgr2=0x7f2188205a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:44.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.551+0000 7f21877fe640 1 --2- 10.20.193.58:0/1907067919 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f218815d870 0x7f2188205a50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.551+0000 7f21877fe640 1 -- 10.20.193.58:0/1907067919 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21740094b0 con 0x7f21880b6690 2026-02-23T06:24:44.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.551+0000 7f2187fff640 1 --2- 10.20.193.58:0/1907067919 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f218815d870 0x7f2188205a50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:24:44.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.551+0000 7f21877fe640 1 --2- 10.20.193.58:0/1907067919 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f21880b6690 0x7f218815afc0 secure :-1 s=READY pgs=289 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21740023d0 tx=0x7f21740028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:44.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.551+0000 7f2163fff640 1 -- 10.20.193.58:0/1907067919 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f217403c040 con 0x7f21880b6690 2026-02-23T06:24:44.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.551+0000 7f218cfd2640 1 -- 10.20.193.58:0/1907067919 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f218813d790 con 0x7f21880b6690 2026-02-23T06:24:44.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.551+0000 7f2163fff640 1 -- 10.20.193.58:0/1907067919 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2174038470 con 0x7f21880b6690 2026-02-23T06:24:44.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.551+0000 7f2163fff640 1 -- 10.20.193.58:0/1907067919 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2174038860 con 0x7f21880b6690 2026-02-23T06:24:44.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.551+0000 7f218cfd2640 1 -- 10.20.193.58:0/1907067919 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f218813b5b0 con 0x7f21880b6690 2026-02-23T06:24:44.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.552+0000 7f2161ffb640 1 --2- 10.20.193.58:0/1907067919 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f218813fc00 0x7f21881622c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:44.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.552+0000 7f2161ffb640 1 -- 10.20.193.58:0/1907067919 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f2188164250 con 0x7f218813fc00 2026-02-23T06:24:44.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.552+0000 7f2186ffd640 1 --2- 10.20.193.58:0/1907067919 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f218813fc00 0x7f21881622c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:44.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.552+0000 7f2186ffd640 1 -- 10.20.193.58:0/1907067919 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f21880b6330 con 0x7f218813fc00 2026-02-23T06:24:44.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.553+0000 7f2186ffd640 1 --2- 10.20.193.58:0/1907067919 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f218813fc00 0x7f21881622c0 secure :-1 s=READY pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21881ff8f0 tx=0x7f217800d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:44.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.553+0000 7f2163fff640 1 -- 10.20.193.58:0/1907067919 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2178012820 con 0x7f218813fc00 2026-02-23T06:24:44.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.553+0000 7f2163fff640 1 -- 10.20.193.58:0/1907067919 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f21740389c0 con 0x7f21880b6690 2026-02-23T06:24:44.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.554+0000 7f2163fff640 1 --2- 10.20.193.58:0/1907067919 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f215807a660 0x7f215809ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:44.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.554+0000 7f2163fff640 1 -- 10.20.193.58:0/1907067919 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f2178012980 con 0x7f218813fc00 2026-02-23T06:24:44.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.554+0000 7f2163fff640 1 -- 10.20.193.58:0/1907067919 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f218813fc00 msgr2=0x7f21881622c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:44.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.554+0000 7f2163fff640 1 --2- 10.20.193.58:0/1907067919 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f218813fc00 0x7f21881622c0 secure :-1 s=READY pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21881ff8f0 tx=0x7f217800d890 comp rx=0 tx=0).stop 2026-02-23T06:24:44.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.554+0000 7f2163fff640 1 -- 10.20.193.58:0/1907067919 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f218813fc00 msgr2=0x7f21881622c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:24:44.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.554+0000 7f2163fff640 1 --2- 10.20.193.58:0/1907067919 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f218813fc00 0x7f21881622c0 secure :-1 s=CLOSED pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21881ff8f0 tx=0x7f217800d890 comp rx=0 tx=0).stop 2026-02-23T06:24:44.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.554+0000 7f2163fff640 1 -- 10.20.193.58:0/1907067919 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f21740c2b80 con 0x7f21880b6690 2026-02-23T06:24:44.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.554+0000 7f2187fff640 1 --2- 10.20.193.58:0/1907067919 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f215807a660 0x7f215809ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:44.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.555+0000 7f2187fff640 1 --2- 10.20.193.58:0/1907067919 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f215807a660 0x7f215809ab10 secure :-1 s=READY pgs=165 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f217c0038b0 tx=0x7f217c00a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:44.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.558+0000 7f2161ffb640 1 --2- 10.20.193.58:0/1907067919 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2188058040 0x7f2188159950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:44.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.558+0000 7f2161ffb640 1 -- 10.20.193.58:0/1907067919 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f218813b410 con 0x7f2188058040 2026-02-23T06:24:44.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.558+0000 7f2186ffd640 1 --2- 10.20.193.58:0/1907067919 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2188058040 0x7f2188159950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:44.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.558+0000 7f2186ffd640 1 -- 10.20.193.58:0/1907067919 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f218815c420 con 0x7f2188058040 2026-02-23T06:24:44.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.559+0000 7f2186ffd640 1 --2- 10.20.193.58:0/1907067919 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2188058040 0x7f2188159950 secure :-1 s=READY pgs=15 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21780029a0 tx=0x7f21780026a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:44.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.559+0000 7f2163fff640 1 -- 10.20.193.58:0/1907067919 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f217801cbd0 con 0x7f2188058040 2026-02-23T06:24:44.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.559+0000 7f2163fff640 1 -- 10.20.193.58:0/1907067919 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4913 (secure 0 0 0) 0x7f217801cd30 con 0x7f2188058040 2026-02-23T06:24:44.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.559+0000 7f2163fff640 1 -- 10.20.193.58:0/1907067919 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2188058040 msgr2=0x7f2188159950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:44.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.559+0000 7f2163fff640 1 --2- 10.20.193.58:0/1907067919 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2188058040 0x7f2188159950 secure :-1 s=READY pgs=15 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21780029a0 tx=0x7f21780026a0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.559+0000 7f2163fff640 1 -- 10.20.193.58:0/1907067919 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2188058040 msgr2=0x7f2188159950 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:24:44.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.559+0000 7f2163fff640 1 --2- 10.20.193.58:0/1907067919 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2188058040 0x7f2188159950 unknown :-1 s=CLOSED pgs=15 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.555 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:24:44.555 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:24:44.555 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:24:44.555 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:24:44.556 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 26, 2026-02-23T06:24:44.556 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 11392, 2026-02-23T06:24:44.556 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:24:44.556 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:24:44.556 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:24:44.556 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:24:44.556 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:44.556 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:24:44.556 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:24:44.556 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:24:44.556 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:24:44.557 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:24:44.557 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:24:44.557 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:24:44.557 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:24:44.557 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:24:44.557 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:24:44.557 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:24:44.557 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:24:44.557 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:24:44.557 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:24:44.557 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:24:44.557 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:24:44.558 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:24:44.558 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:44.558 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:24:44.558 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:24:44.558 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:24:44.558 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:24:44.558 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:24:44.558 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:24:44.558 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:24:44.559 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:24:44.559 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:24:44.559 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:24:44.559 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:24:44.559 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:24:44.559 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:24:44.559 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:24:44.559 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:24:44.559 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:44.559 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.559 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:24:44.559 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:24:44.560 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:24:44.560 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:24:44.560 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:24:44.560 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:24:44.560 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:24:44.560 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:24:44.560 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:24:44.560 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:24:44.560 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:24:44.560 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:24:44.560 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:24:44.560 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:24:44.561 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:24:44.561 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:24:44.561 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:24:44.561 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:24:44.561 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:24:44.561 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:24:44.561 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:24:44.561 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:24:44.561 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:24:44.561 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:24:44.561 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:24:44.561 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:24:44.562 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:24:44.562 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:24:44.562 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:24:44.562 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:24:44.562 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:44.562 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:24:44.562 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.562 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:24:44.562 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.562 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:24:44.562 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:24:44.562 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:24:44.563 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:24:44.563 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.563 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:24:44.563 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:24:44.563 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:44.563 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.563 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.563 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:24:44.563 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:24:44.563 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:44.563 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:44.563 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:44.563 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.564 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:24:44.564 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:24:44.564 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:24:44.564 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:24:44.564 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:24:44.564 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:24:44.564 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.564 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.564 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:24:44.564 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:24:44.564 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:24:44.564 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:24:44.564 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.565 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:24:44.565 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:24:44.565 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:44.565 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.565 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.565 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:24:44.565 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:24:44.565 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:44.565 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:44.565 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:44.566 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.566 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:24:44.566 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:24:44.566 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:24:44.566 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:24:44.566 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:24:44.566 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:24:44.566 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.566 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.566 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:24:44.567 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:24:44.567 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:24:44.567 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:24:44.567 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.567 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:24:44.567 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:24:44.567 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:44.567 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.567 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.567 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:24:44.567 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:24:44.567 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:44.568 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:44.568 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:44.568 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.568 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:24:44.568 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:24:44.568 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:24:44.568 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:24:44.568 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:24:44.568 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:24:44.568 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:44.568 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:44.568 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.569 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:24:44.569 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:24:44.569 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.569 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:44.569 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:44.569 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:24:44.569 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:44.569 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:44.569 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:24:44.569 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.569 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:44.569 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:44.569 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:24:44.570 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:44.570 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:44.570 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.570 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:24:44.570 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:24:44.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.559+0000 7f2161ffb640 1 -- 10.20.193.58:0/1907067919 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f215807a660 msgr2=0x7f215809ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:44.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.559+0000 7f2161ffb640 1 --2- 10.20.193.58:0/1907067919 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f215807a660 0x7f215809ab10 secure :-1 s=READY pgs=165 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f217c0038b0 tx=0x7f217c00a040 comp rx=0 tx=0).stop 2026-02-23T06:24:44.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.559+0000 7f2161ffb640 1 -- 10.20.193.58:0/1907067919 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f21880b6690 msgr2=0x7f218815afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:44.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.559+0000 7f2161ffb640 1 --2- 10.20.193.58:0/1907067919 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f21880b6690 0x7f218815afc0 secure :-1 s=READY pgs=289 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21740023d0 tx=0x7f21740028d0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.559+0000 7f2187fff640 1 -- 10.20.193.58:0/1907067919 reap_dead start 2026-02-23T06:24:44.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.559+0000 7f2187fff640 1 -- 10.20.193.58:0/1907067919 reap_dead start 2026-02-23T06:24:44.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.559+0000 7f2161ffb640 1 -- 10.20.193.58:0/1907067919 shutdown_connections 2026-02-23T06:24:44.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.559+0000 7f2161ffb640 1 -- 10.20.193.58:0/1907067919 >> 10.20.193.58:0/1907067919 conn(0x7f21880b3c20 msgr2=0x7f218815a600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:24:44.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.559+0000 7f2161ffb640 1 -- 10.20.193.58:0/1907067919 shutdown_connections 2026-02-23T06:24:44.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.559+0000 7f2161ffb640 1 -- 10.20.193.58:0/1907067919 wait complete. 2026-02-23T06:24:44.573 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:24:44.573 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:24:44.573 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:24:44.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.702+0000 7fe1c0dd2640 1 -- 10.20.193.58:0/1023235768 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe1bc15d4a0 msgr2=0x7fe1bc0affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:44.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.702+0000 7fe1c0dd2640 1 --2- 10.20.193.58:0/1023235768 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe1bc15d4a0 0x7fe1bc0affb0 secure :-1 s=READY pgs=17 gs=3 cs=0 l=1 c_cookie=16751888908443325164 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1a8004740 tx=0x7fe1a802f230 comp rx=0 tx=0).stop 2026-02-23T06:24:44.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.702+0000 7fe1c0dd2640 1 -- 10.20.193.58:0/1023235768 shutdown_connections 2026-02-23T06:24:44.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.702+0000 7fe1c0dd2640 1 --2- 10.20.193.58:0/1023235768 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe1bc15d4a0 0x7fe1bc0affb0 unknown :-1 s=CLOSED pgs=17 gs=3 cs=0 l=1 c_cookie=16751888908443325164 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.702+0000 7fe1c0dd2640 1 -- 10.20.193.58:0/1023235768 >> 10.20.193.58:0/1023235768 conn(0x7fe1bc0b3c20 msgr2=0x7fe1bc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:24:44.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.702+0000 7fe1c0dd2640 1 -- 10.20.193.58:0/1023235768 shutdown_connections 2026-02-23T06:24:44.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.702+0000 7fe1c0dd2640 1 -- 10.20.193.58:0/1023235768 wait complete. 2026-02-23T06:24:44.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.703+0000 7fe1c0dd2640 1 Processor -- start 2026-02-23T06:24:44.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.703+0000 7fe1c0dd2640 1 -- start start 2026-02-23T06:24:44.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.704+0000 7fe1c0dd2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe1bc0b6690 0x7fe1bc13e5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:44.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.704+0000 7fe1c0dd2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe1bc15d4a0 0x7fe1bc11fbb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:44.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.704+0000 7fe1c0dd2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe1bc15d870 0x7fe1bc1200f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:44.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.704+0000 7fe1c0dd2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc124e60 con 0x7fe1bc15d870 2026-02-23T06:24:44.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.704+0000 7fe1c0dd2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc1250e0 con 0x7fe1bc0b6690 2026-02-23T06:24:44.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.704+0000 7fe1c0dd2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe1bc1253c0 con 0x7fe1bc15d4a0 2026-02-23T06:24:44.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.704+0000 7fe1bbfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe1bc15d870 0x7fe1bc1200f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:44.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.704+0000 7fe1bb7fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe1bc0b6690 0x7fe1bc13e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:44.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.704+0000 7fe1bbfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe1bc15d870 0x7fe1bc1200f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:35846/0 (socket says 10.20.193.58:35846) 2026-02-23T06:24:44.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.704+0000 7fe1bbfff640 1 -- 10.20.193.58:0/3971693110 learned_addr learned my addr 10.20.193.58:0/3971693110 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:24:44.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.704+0000 7fe1baffd640 1 --2- 10.20.193.58:0/3971693110 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe1bc15d4a0 0x7fe1bc11fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:44.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.704+0000 7fe1bbfff640 1 -- 10.20.193.58:0/3971693110 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe1bc15d4a0 msgr2=0x7fe1bc11fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:44.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.704+0000 7fe1bbfff640 1 --2- 10.20.193.58:0/3971693110 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe1bc15d4a0 0x7fe1bc11fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.704+0000 7fe1bbfff640 1 -- 10.20.193.58:0/3971693110 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe1bc0b6690 msgr2=0x7fe1bc13e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:44.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.704+0000 7fe1bbfff640 1 --2- 10.20.193.58:0/3971693110 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe1bc0b6690 0x7fe1bc13e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.704+0000 7fe1bbfff640 1 -- 10.20.193.58:0/3971693110 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a80094b0 con 0x7fe1bc15d870 2026-02-23T06:24:44.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.704+0000 7fe1bbfff640 1 --2- 10.20.193.58:0/3971693110 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe1bc15d870 0x7fe1bc1200f0 secure :-1 s=READY pgs=18 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1b0008d80 tx=0x7fe1b000dba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:44.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.704+0000 7fe197fff640 1 -- 10.20.193.58:0/3971693110 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe1b00062f0 con 0x7fe1bc15d870 2026-02-23T06:24:44.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.704+0000 7fe197fff640 1 -- 10.20.193.58:0/3971693110 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1b0006470 con 0x7fe1bc15d870 2026-02-23T06:24:44.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.704+0000 7fe197fff640 1 -- 10.20.193.58:0/3971693110 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe1b0004a30 con 0x7fe1bc15d870 2026-02-23T06:24:44.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.704+0000 7fe1c0dd2640 1 -- 10.20.193.58:0/3971693110 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1bc1256a0 con 0x7fe1bc15d870 2026-02-23T06:24:44.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.705+0000 7fe1c0dd2640 1 -- 10.20.193.58:0/3971693110 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1bc125c60 con 0x7fe1bc15d870 2026-02-23T06:24:44.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.705+0000 7fe1c0dd2640 1 --2- 10.20.193.58:0/3971693110 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe1bc120ff0 0x7fe1bc150790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:44.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.705+0000 7fe1c0dd2640 1 -- 10.20.193.58:0/3971693110 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc164250 con 0x7fe1bc120ff0 2026-02-23T06:24:44.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.705+0000 7fe1bb7fe640 1 --2- 10.20.193.58:0/3971693110 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe1bc120ff0 0x7fe1bc150790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:44.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.706+0000 7fe1bb7fe640 1 -- 10.20.193.58:0/3971693110 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe1bc0b6330 con 0x7fe1bc120ff0 2026-02-23T06:24:44.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.706+0000 7fe1bb7fe640 1 --2- 10.20.193.58:0/3971693110 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe1bc120ff0 0x7fe1bc150790 secure :-1 s=READY pgs=291 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1a8004740 tx=0x7fe1a80026a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:44.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.706+0000 7fe197fff640 1 -- 10.20.193.58:0/3971693110 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe1a803d050 con 0x7fe1bc120ff0 2026-02-23T06:24:44.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.706+0000 7fe197fff640 1 -- 10.20.193.58:0/3971693110 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fe1b001a020 con 0x7fe1bc15d870 2026-02-23T06:24:44.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.707+0000 7fe197fff640 1 --2- 10.20.193.58:0/3971693110 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe18c07a660 0x7fe18c09ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:44.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.707+0000 7fe197fff640 1 -- 10.20.193.58:0/3971693110 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fe1b009df30 con 0x7fe1bc15d870 2026-02-23T06:24:44.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.707+0000 7fe197fff640 1 -- 10.20.193.58:0/3971693110 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fe1a803e040 con 0x7fe1bc120ff0 2026-02-23T06:24:44.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.707+0000 7fe197fff640 1 -- 10.20.193.58:0/3971693110 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe1bc120ff0 msgr2=0x7fe1bc150790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:44.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.707+0000 7fe197fff640 1 --2- 10.20.193.58:0/3971693110 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe1bc120ff0 0x7fe1bc150790 secure :-1 s=READY pgs=291 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1a8004740 tx=0x7fe1a80026a0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.707+0000 7fe197fff640 1 -- 10.20.193.58:0/3971693110 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe1bc120ff0 msgr2=0x7fe1bc150790 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:24:44.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.707+0000 7fe197fff640 1 --2- 10.20.193.58:0/3971693110 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe1bc120ff0 0x7fe1bc150790 secure :-1 s=CLOSED pgs=291 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1a8004740 tx=0x7fe1a80026a0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.707+0000 7fe1baffd640 1 --2- 10.20.193.58:0/3971693110 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe18c07a660 0x7fe18c09ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:44.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.708+0000 7fe1baffd640 1 --2- 10.20.193.58:0/3971693110 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe18c07a660 0x7fe18c09ab10 secure :-1 s=READY pgs=166 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1ac0023d0 tx=0x7fe1ac009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:44.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.710+0000 7fe1c0dd2640 1 --2- 10.20.193.58:0/3971693110 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe1bc13c830 0x7fe1bc150cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:44.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.710+0000 7fe1c0dd2640 1 -- 10.20.193.58:0/3971693110 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc125e80 con 0x7fe1bc13c830 2026-02-23T06:24:44.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.711+0000 7fe1bb7fe640 1 --2- 10.20.193.58:0/3971693110 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe1bc13c830 0x7fe1bc150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:44.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.711+0000 7fe1bb7fe640 1 -- 10.20.193.58:0/3971693110 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe1bc0b7260 con 0x7fe1bc13c830 2026-02-23T06:24:44.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.711+0000 7fe1bb7fe640 1 --2- 10.20.193.58:0/3971693110 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe1bc13c830 0x7fe1bc150cd0 secure :-1 s=READY pgs=292 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1a80097e0 tx=0x7fe1a8005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:44.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.712+0000 7fe197fff640 1 -- 10.20.193.58:0/3971693110 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe1a8043680 con 0x7fe1bc13c830 2026-02-23T06:24:44.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.712+0000 7fe197fff640 1 -- 10.20.193.58:0/3971693110 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5556 (secure 0 0 0) 0x7fe1a8038e60 con 0x7fe1bc13c830 2026-02-23T06:24:44.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.712+0000 7fe197fff640 1 -- 10.20.193.58:0/3971693110 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe1bc13c830 msgr2=0x7fe1bc150cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:44.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.712+0000 7fe197fff640 1 --2- 10.20.193.58:0/3971693110 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe1bc13c830 0x7fe1bc150cd0 secure :-1 s=READY pgs=292 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1a80097e0 tx=0x7fe1a8005f90 comp rx=0 tx=0).stop 2026-02-23T06:24:44.707 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:24:44.708 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:24:44.708 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:24:44.708 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:24:44.708 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 26, 2026-02-23T06:24:44.708 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 222758, 2026-02-23T06:24:44.708 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:24:44.708 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:24:44.708 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:24:44.708 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:24:44.708 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:44.708 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:24:44.709 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:24:44.709 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:24:44.709 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:24:44.709 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:24:44.709 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:24:44.709 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:24:44.709 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:24:44.709 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:24:44.709 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:24:44.709 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:24:44.709 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:24:44.710 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:24:44.710 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:24:44.710 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:24:44.710 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:24:44.710 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:24:44.710 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:44.710 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:24:44.710 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:24:44.710 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:24:44.710 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:24:44.710 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:24:44.710 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:24:44.711 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:24:44.711 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:24:44.711 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:24:44.711 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:24:44.711 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:24:44.711 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:24:44.711 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:24:44.711 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:24:44.711 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:24:44.711 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:44.711 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.711 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:24:44.711 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:24:44.712 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:24:44.712 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:24:44.712 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:24:44.712 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:24:44.712 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:24:44.712 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:24:44.712 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:24:44.712 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:24:44.712 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:24:44.712 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:24:44.712 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:24:44.712 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:24:44.713 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:24:44.713 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:24:44.713 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:24:44.713 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:24:44.713 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:24:44.713 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:24:44.713 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:24:44.713 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:24:44.713 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:24:44.713 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:24:44.713 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:24:44.713 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:24:44.714 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:24:44.714 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:24:44.714 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:24:44.714 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:24:44.714 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:44.714 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:24:44.714 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.714 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:24:44.714 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.714 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:24:44.714 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:24:44.714 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:24:44.715 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:24:44.715 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.715 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:24:44.715 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:24:44.715 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:44.715 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.715 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.715 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:24:44.715 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:24:44.715 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:44.715 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:44.715 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:44.716 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.716 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:24:44.716 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:24:44.716 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:24:44.716 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:24:44.716 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:24:44.716 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:24:44.716 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.716 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.716 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:24:44.716 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:24:44.716 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:24:44.716 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:24:44.717 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.717 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:24:44.717 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:24:44.717 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:44.717 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.717 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.717 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:24:44.717 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:24:44.717 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:44.717 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:44.717 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:44.717 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.717 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:24:44.718 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:24:44.718 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:24:44.718 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:24:44.718 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:24:44.718 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:24:44.718 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.718 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.718 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:24:44.718 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:24:44.718 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:24:44.718 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:24:44.718 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.719 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:24:44.719 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:24:44.719 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:44.719 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.719 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.719 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:24:44.719 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:24:44.719 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:44.719 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:44.719 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:44.719 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.719 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:24:44.720 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:24:44.720 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:24:44.720 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:24:44.720 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:24:44.720 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:24:44.720 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:44.720 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:44.720 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.720 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:24:44.720 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:24:44.720 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.720 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:44.721 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:44.721 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:24:44.721 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:44.721 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:44.721 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:24:44.721 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.721 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:44.721 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:44.721 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:24:44.721 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:44.721 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:44.721 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:24:44.721 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.722 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:44.722 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:44.722 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:24:44.722 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:44.722 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:44.722 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:24:44.722 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.722 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:24:44.722 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:24:44.722 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:24:44.722 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.722 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.722 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:44.723 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:44.723 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:24:44.723 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:44.723 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:44.723 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:24:44.723 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.723 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:44.723 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:44.723 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:24:44.723 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:44.723 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:44.724 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.724 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:24:44.724 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:24:44.725 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.712+0000 7fe197fff640 1 -- 10.20.193.58:0/3971693110 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe1bc13c830 msgr2=0x7fe1bc150cd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:24:44.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.712+0000 7fe197fff640 1 --2- 10.20.193.58:0/3971693110 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe1bc13c830 0x7fe1bc150cd0 unknown :-1 s=CLOSED pgs=292 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.712+0000 7fe1c0dd2640 1 -- 10.20.193.58:0/3971693110 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe18c07a660 msgr2=0x7fe18c09ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:44.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.712+0000 7fe1c0dd2640 1 --2- 10.20.193.58:0/3971693110 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe18c07a660 0x7fe18c09ab10 secure :-1 s=READY pgs=166 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1ac0023d0 tx=0x7fe1ac009040 comp rx=0 tx=0).stop 2026-02-23T06:24:44.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.712+0000 7fe1c0dd2640 1 -- 10.20.193.58:0/3971693110 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe1bc15d870 msgr2=0x7fe1bc1200f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:44.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.712+0000 7fe1c0dd2640 1 --2- 10.20.193.58:0/3971693110 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe1bc15d870 0x7fe1bc1200f0 secure :-1 s=READY pgs=18 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1b0008d80 tx=0x7fe1b000dba0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.712+0000 7fe1bbfff640 1 -- 10.20.193.58:0/3971693110 reap_dead start 2026-02-23T06:24:44.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.712+0000 7fe1bbfff640 1 -- 10.20.193.58:0/3971693110 reap_dead start 2026-02-23T06:24:44.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.712+0000 7fe1c0dd2640 1 -- 10.20.193.58:0/3971693110 shutdown_connections 2026-02-23T06:24:44.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.712+0000 7fe1c0dd2640 1 -- 10.20.193.58:0/3971693110 >> 10.20.193.58:0/3971693110 conn(0x7fe1bc0b3c20 msgr2=0x7fe1bc0b7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:24:44.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.712+0000 7fe1c0dd2640 1 -- 10.20.193.58:0/3971693110 shutdown_connections 2026-02-23T06:24:44.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.712+0000 7fe1c0dd2640 1 -- 10.20.193.58:0/3971693110 wait complete. 2026-02-23T06:24:44.727 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:24:44.727 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:24:44.727 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:24:44.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.856+0000 7fb5a7fff640 1 -- 10.20.193.58:0/468074566 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5a81688d0 msgr2=0x7fb5a8168ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:44.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.856+0000 7fb5a5ffb640 1 -- 10.20.193.58:0/468074566 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb59c004480 con 0x7fb5a81688d0 2026-02-23T06:24:44.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.856+0000 7fb5a7fff640 1 --2- 10.20.193.58:0/468074566 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5a81688d0 0x7fb5a8168ca0 secure :-1 s=READY pgs=41 gs=2 cs=0 l=1 c_cookie=14432901616969847731 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb59c005e70 tx=0x7fb59c02f290 comp rx=0 tx=0).stop 2026-02-23T06:24:44.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.856+0000 7fb5a7fff640 1 -- 10.20.193.58:0/468074566 shutdown_connections 2026-02-23T06:24:44.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.856+0000 7fb5a7fff640 1 --2- 10.20.193.58:0/468074566 >> v2:10.20.193.58:3300/0 conn(0x7fb5a80b6440 0x7fb5a80ba2d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.856+0000 7fb5a7fff640 1 --2- 10.20.193.58:0/468074566 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5a81688d0 0x7fb5a8168ca0 unknown :-1 s=CLOSED pgs=41 gs=2 cs=0 l=1 c_cookie=14432901616969847731 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.856+0000 7fb5a7fff640 1 -- 10.20.193.58:0/468074566 >> 10.20.193.58:0/468074566 conn(0x7fb5a8054e40 msgr2=0x7fb5a8057b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:24:44.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.856+0000 7fb5a7fff640 1 -- 10.20.193.58:0/468074566 shutdown_connections 2026-02-23T06:24:44.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.856+0000 7fb5a7fff640 1 -- 10.20.193.58:0/468074566 wait complete. 2026-02-23T06:24:44.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.858+0000 7fb5a7fff640 1 Processor -- start 2026-02-23T06:24:44.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.858+0000 7fb5a7fff640 1 -- start start 2026-02-23T06:24:44.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.858+0000 7fb5a7fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5a80b6440 0x7fb5a813d280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:44.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.858+0000 7fb5a7fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5a80bb0b0 0x7fb5a8157690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:44.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.858+0000 7fb5a7fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb5a81688d0 0x7fb5a80a12a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:44.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.858+0000 7fb5a7fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a80b4a70 con 0x7fb5a81688d0 2026-02-23T06:24:44.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.858+0000 7fb5a7fff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a813dbd0 con 0x7fb5a80bb0b0 2026-02-23T06:24:44.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.858+0000 7fb5a7fff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb5a805a7d0 con 0x7fb5a80b6440 2026-02-23T06:24:44.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.859+0000 7fb5a77fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb5a81688d0 0x7fb5a80a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:44.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.859+0000 7fb5a67fc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5a80bb0b0 0x7fb5a8157690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:44.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.859+0000 7fb5a67fc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5a80bb0b0 0x7fb5a8157690 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:43880/0 (socket says 10.20.193.58:43880) 2026-02-23T06:24:44.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.859+0000 7fb5a67fc640 1 -- 10.20.193.58:0/973416653 learned_addr learned my addr 10.20.193.58:0/973416653 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:24:44.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.859+0000 7fb5a6ffd640 1 --2- 10.20.193.58:0/973416653 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5a80b6440 0x7fb5a813d280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:44.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.859+0000 7fb5a67fc640 1 -- 10.20.193.58:0/973416653 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5a80b6440 msgr2=0x7fb5a813d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:44.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.859+0000 7fb5a67fc640 1 --2- 10.20.193.58:0/973416653 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5a80b6440 0x7fb5a813d280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.859+0000 7fb5a67fc640 1 -- 10.20.193.58:0/973416653 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb5a81688d0 msgr2=0x7fb5a80a12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:44.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.859+0000 7fb5a67fc640 1 --2- 10.20.193.58:0/973416653 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb5a81688d0 0x7fb5a80a12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.859+0000 7fb5a67fc640 1 -- 10.20.193.58:0/973416653 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5900094b0 con 0x7fb5a80bb0b0 2026-02-23T06:24:44.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.859+0000 7fb5a77fe640 1 --2- 10.20.193.58:0/973416653 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb5a81688d0 0x7fb5a80a12a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:24:44.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.860+0000 7fb5a67fc640 1 --2- 10.20.193.58:0/973416653 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5a80bb0b0 0x7fb5a8157690 secure :-1 s=READY pgs=293 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb590002720 tx=0x7fb590002bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:44.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.860+0000 7fb5877fe640 1 -- 10.20.193.58:0/973416653 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb59000ed60 con 0x7fb5a80bb0b0 2026-02-23T06:24:44.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.860+0000 7fb5a7fff640 1 -- 10.20.193.58:0/973416653 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb59c009570 con 0x7fb5a80bb0b0 2026-02-23T06:24:44.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.860+0000 7fb5a7fff640 1 -- 10.20.193.58:0/973416653 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a80b44b0 con 0x7fb5a80bb0b0 2026-02-23T06:24:44.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.860+0000 7fb5877fe640 1 -- 10.20.193.58:0/973416653 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb590002e50 con 0x7fb5a80bb0b0 2026-02-23T06:24:44.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.860+0000 7fb5877fe640 1 -- 10.20.193.58:0/973416653 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb590010690 con 0x7fb5a80bb0b0 2026-02-23T06:24:44.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.860+0000 7fb5857fa640 1 --2- 10.20.193.58:0/973416653 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5a813de90 0x7fb5a80a17e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:44.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.860+0000 7fb5857fa640 1 -- 10.20.193.58:0/973416653 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb5a805a940 con 0x7fb5a813de90 2026-02-23T06:24:44.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.861+0000 7fb5a6ffd640 1 --2- 10.20.193.58:0/973416653 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5a813de90 0x7fb5a80a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:44.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.862+0000 7fb5a6ffd640 1 -- 10.20.193.58:0/973416653 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb5a80b9ad0 con 0x7fb5a813de90 2026-02-23T06:24:44.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.862+0000 7fb5a6ffd640 1 --2- 10.20.193.58:0/973416653 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5a813de90 0x7fb5a80a17e0 secure :-1 s=READY pgs=42 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb59c004740 tx=0x7fb59c0028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:44.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.862+0000 7fb5877fe640 1 -- 10.20.193.58:0/973416653 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb59c03d050 con 0x7fb5a813de90 2026-02-23T06:24:44.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.862+0000 7fb5877fe640 1 -- 10.20.193.58:0/973416653 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fb590016020 con 0x7fb5a80bb0b0 2026-02-23T06:24:44.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.863+0000 7fb5877fe640 1 --2- 10.20.193.58:0/973416653 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb57c07a660 0x7fb57c09ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:44.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.863+0000 7fb5877fe640 1 -- 10.20.193.58:0/973416653 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fb59009dd10 con 0x7fb5a80bb0b0 2026-02-23T06:24:44.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.863+0000 7fb5877fe640 1 -- 10.20.193.58:0/973416653 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fb59c03e040 con 0x7fb5a813de90 2026-02-23T06:24:44.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.863+0000 7fb5877fe640 1 -- 10.20.193.58:0/973416653 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5a813de90 msgr2=0x7fb5a80a17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:44.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.863+0000 7fb5877fe640 1 --2- 10.20.193.58:0/973416653 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5a813de90 0x7fb5a80a17e0 secure :-1 s=READY pgs=42 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb59c004740 tx=0x7fb59c0028d0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.863+0000 7fb5877fe640 1 -- 10.20.193.58:0/973416653 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5a813de90 msgr2=0x7fb5a80a17e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:24:44.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.863+0000 7fb5877fe640 1 --2- 10.20.193.58:0/973416653 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5a813de90 0x7fb5a80a17e0 secure :-1 s=CLOSED pgs=42 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb59c004740 tx=0x7fb59c0028d0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.866+0000 7fb5a77fe640 1 --2- 10.20.193.58:0/973416653 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb57c07a660 0x7fb57c09ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:44.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.867+0000 7fb5857fa640 1 --2- 10.20.193.58:0/973416653 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5a805b420 0x7fb5a805a0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:24:44.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.867+0000 7fb5857fa640 1 -- 10.20.193.58:0/973416653 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb5a805d980 con 0x7fb5a805b420 2026-02-23T06:24:44.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.867+0000 7fb5a6ffd640 1 --2- 10.20.193.58:0/973416653 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5a805b420 0x7fb5a805a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:24:44.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.869+0000 7fb5a6ffd640 1 -- 10.20.193.58:0/973416653 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb5a80b15f0 con 0x7fb5a805b420 2026-02-23T06:24:44.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.870+0000 7fb5a77fe640 1 --2- 10.20.193.58:0/973416653 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb57c07a660 0x7fb57c09ab10 secure :-1 s=READY pgs=167 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5a813cb00 tx=0x7fb59800a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:44.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.872+0000 7fb5a6ffd640 1 --2- 10.20.193.58:0/973416653 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5a805b420 0x7fb5a805a0a0 secure :-1 s=READY pgs=43 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb59c0098a0 tx=0x7fb59c0047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:24:44.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.873+0000 7fb5877fe640 1 -- 10.20.193.58:0/973416653 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb59c052070 con 0x7fb5a805b420 2026-02-23T06:24:44.868 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:24:44.868 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:24:44.868 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:24:44.869 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:24:44.869 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 26, 2026-02-23T06:24:44.869 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 83415, 2026-02-23T06:24:44.869 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:24:44.869 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:24:44.869 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:24:44.869 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:24:44.869 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:44.869 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:24:44.869 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:24:44.870 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:24:44.870 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:24:44.870 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:24:44.870 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:24:44.870 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:24:44.870 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:24:44.870 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:24:44.870 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:24:44.870 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:24:44.870 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:24:44.870 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:24:44.870 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:24:44.871 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:24:44.871 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:24:44.871 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:24:44.871 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:44.871 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:24:44.871 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:24:44.871 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:24:44.871 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:24:44.871 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:24:44.871 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:24:44.871 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:24:44.872 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:24:44.872 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:24:44.872 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:24:44.872 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:24:44.872 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:24:44.872 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:24:44.872 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:24:44.872 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:24:44.872 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:44.872 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.872 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:24:44.872 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:24:44.872 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:24:44.873 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:24:44.873 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:24:44.873 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:24:44.873 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:24:44.873 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:24:44.873 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:24:44.873 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:24:44.873 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:24:44.873 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:24:44.873 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:24:44.873 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:24:44.873 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:24:44.874 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:24:44.874 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:24:44.874 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:24:44.874 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:24:44.874 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:24:44.874 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:24:44.874 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:24:44.874 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:24:44.874 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:24:44.874 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:24:44.874 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:24:44.874 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:24:44.875 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:24:44.875 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:24:44.875 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:24:44.875 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:44.875 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:24:44.875 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.875 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:24:44.875 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.875 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:24:44.875 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:24:44.875 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:24:44.875 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:24:44.876 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.876 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:24:44.876 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:24:44.876 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:44.876 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.876 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.876 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:24:44.876 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:24:44.876 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:44.876 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:44.876 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:44.877 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.877 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:24:44.877 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:24:44.877 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:24:44.877 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:24:44.877 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:24:44.877 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:24:44.877 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.877 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.877 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:24:44.877 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:24:44.877 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:24:44.878 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:24:44.878 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.878 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:24:44.878 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:24:44.878 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:44.878 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.878 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.878 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:24:44.878 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:24:44.878 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:44.878 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:44.878 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:44.878 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.879 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:24:44.879 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:24:44.879 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:24:44.879 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:24:44.879 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:24:44.879 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:24:44.879 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.879 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.879 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:24:44.879 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:24:44.879 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:24:44.879 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:24:44.880 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.880 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:24:44.880 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:24:44.880 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:44.880 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.880 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.880 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:24:44.880 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:24:44.880 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:24:44.880 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:44.880 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:44.880 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.881 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:24:44.881 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:24:44.881 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:24:44.881 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:24:44.881 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:24:44.881 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:24:44.881 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:44.881 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:44.881 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.881 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:24:44.881 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:24:44.881 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.882 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:44.882 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:44.882 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:24:44.882 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:44.882 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:44.882 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:24:44.882 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.882 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:44.882 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:44.882 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:24:44.882 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:44.882 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:44.883 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:24:44.883 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.883 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:44.883 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:44.883 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:24:44.883 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:44.883 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:24:44.883 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:24:44.883 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:24:44.883 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:24:44.883 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:24:44.883 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:24:44.884 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:24:44.884 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:24:44.884 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:24:44.884 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:24:44.884 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:24:44.886 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.873+0000 7fb5877fe640 1 -- 10.20.193.58:0/973416653 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5245 (secure 0 0 0) 0x7fb59c002e40 con 0x7fb5a805b420 2026-02-23T06:24:44.886 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.873+0000 7fb5877fe640 1 -- 10.20.193.58:0/973416653 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5a805b420 msgr2=0x7fb5a805a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:44.886 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.873+0000 7fb5877fe640 1 --2- 10.20.193.58:0/973416653 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5a805b420 0x7fb5a805a0a0 secure :-1 s=READY pgs=43 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb59c0098a0 tx=0x7fb59c0047e0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.886 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.873+0000 7fb5877fe640 1 -- 10.20.193.58:0/973416653 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5a805b420 msgr2=0x7fb5a805a0a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:24:44.886 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.873+0000 7fb5877fe640 1 --2- 10.20.193.58:0/973416653 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5a805b420 0x7fb5a805a0a0 secure :-1 s=CLOSED pgs=43 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb59c0098a0 tx=0x7fb59c0047e0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.886 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.873+0000 7fb5857fa640 1 -- 10.20.193.58:0/973416653 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb57c07a660 msgr2=0x7fb57c09ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:44.886 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.873+0000 7fb5857fa640 1 --2- 10.20.193.58:0/973416653 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb57c07a660 0x7fb57c09ab10 secure :-1 s=READY pgs=167 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5a813cb00 tx=0x7fb59800a040 comp rx=0 tx=0).stop 2026-02-23T06:24:44.886 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.873+0000 7fb5857fa640 1 -- 10.20.193.58:0/973416653 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5a80bb0b0 msgr2=0x7fb5a8157690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:24:44.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.873+0000 7fb5857fa640 1 --2- 10.20.193.58:0/973416653 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5a80bb0b0 0x7fb5a8157690 secure :-1 s=READY pgs=293 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb590002720 tx=0x7fb590002bf0 comp rx=0 tx=0).stop 2026-02-23T06:24:44.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.873+0000 7fb5a77fe640 1 -- 10.20.193.58:0/973416653 reap_dead start 2026-02-23T06:24:44.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.873+0000 7fb5a77fe640 1 -- 10.20.193.58:0/973416653 reap_dead start 2026-02-23T06:24:44.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.873+0000 7fb5857fa640 1 -- 10.20.193.58:0/973416653 shutdown_connections 2026-02-23T06:24:44.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.873+0000 7fb5857fa640 1 -- 10.20.193.58:0/973416653 >> 10.20.193.58:0/973416653 conn(0x7fb5a8054e40 msgr2=0x7fb5a80b79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:24:44.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.873+0000 7fb5857fa640 1 -- 10.20.193.58:0/973416653 shutdown_connections 2026-02-23T06:24:44.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:24:44.873+0000 7fb5857fa640 1 -- 10.20.193.58:0/973416653 wait complete. 2026-02-23T06:24:44.887 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:24:44.888 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-23T06:24:44.888 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2026-02-23T06:24:44.888 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-23T06:24:44.888 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-23T06:24:44.888 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-23T06:24:44.888 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:24:44.898 INFO:tasks.ceph.mon.c:Stopped 2026-02-23T06:24:44.898 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.a 2026-02-23T06:24:44.898 INFO:tasks.mon_thrash:Sending STOP to mon a 2026-02-23T06:24:44.898 INFO:tasks.ceph.mon.a:Sent signal 19 2026-02-23T06:24:44.898 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-23T06:24:59.899 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.a 2026-02-23T06:24:59.899 INFO:tasks.mon_thrash:Sending CONT to mon a 2026-02-23T06:24:59.899 INFO:tasks.ceph.mon.a:Sent signal 18 2026-02-23T06:24:59.899 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:24:59.900 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:25:04.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.928+0000 7f933ce83640 1 -- 10.20.193.58:0/2588590271 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f931c004d90 msgr2=0x7f931c005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:04.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.928+0000 7f933ce83640 1 --2- 10.20.193.58:0/2588590271 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f931c004d90 0x7f931c005200 secure :-1 s=READY pgs=297 gs=24 cs=0 l=1 c_cookie=13726069669222849021 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93380b1d70 tx=0x7f932c02fc50 comp rx=0 tx=0).stop 2026-02-23T06:25:04.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.928+0000 7f933ce83640 1 -- 10.20.193.58:0/2588590271 shutdown_connections 2026-02-23T06:25:04.924 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.928+0000 7f933ce83640 1 --2- 10.20.193.58:0/2588590271 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f931c004d90 0x7f931c005200 unknown :-1 s=CLOSED pgs=297 gs=24 cs=0 l=1 c_cookie=13726069669222849021 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:04.924 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.928+0000 7f933ce83640 1 --2- 10.20.193.58:0/2588590271 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9338162ca0 0x7f931c004850 unknown :-1 s=CLOSED pgs=0 gs=25 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:04.924 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.928+0000 7f933ce83640 1 --2- 10.20.193.58:0/2588590271 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f931c003a30 0x7f931c003e20 unknown :-1 s=CLOSED pgs=0 gs=23 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:04.924 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.928+0000 7f933ce83640 1 -- 10.20.193.58:0/2588590271 >> 10.20.193.58:0/2588590271 conn(0x7f93380b3c20 msgr2=0x7f93380b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:25:04.924 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.928+0000 7f933ce83640 1 -- 10.20.193.58:0/2588590271 shutdown_connections 2026-02-23T06:25:04.924 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.928+0000 7f933ce83640 1 -- 10.20.193.58:0/2588590271 wait complete. 2026-02-23T06:25:04.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.929+0000 7f933ce83640 1 Processor -- start 2026-02-23T06:25:04.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.929+0000 7f933ce83640 1 -- start start 2026-02-23T06:25:04.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.930+0000 7f933ce83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f931c003a30 0x7f933815e360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:04.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.930+0000 7f933ce83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f931c004d90 0x7f93381613c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:04.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.930+0000 7f933ce83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9338162ca0 0x7f9338161900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:04.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.930+0000 7f933ce83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f933815d950 con 0x7f931c003a30 2026-02-23T06:25:04.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.930+0000 7f933ce83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f933813c2d0 con 0x7f9338162ca0 2026-02-23T06:25:04.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.930+0000 7f933ce83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f933813c570 con 0x7f931c004d90 2026-02-23T06:25:04.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.930+0000 7f9336ffd640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f931c004d90 msgr2=0x7f93381613c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:25:04.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.930+0000 7f9336ffd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f931c004d90 0x7f93381613c0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:25:04.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.930+0000 7f9337fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9338162ca0 0x7f9338161900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:04.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.930+0000 7f9337fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9338162ca0 0x7f9338161900 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:58576/0 (socket says 10.20.193.58:58576) 2026-02-23T06:25:04.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.930+0000 7f9337fff640 1 -- 10.20.193.58:0/2611880089 learned_addr learned my addr 10.20.193.58:0/2611880089 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:25:04.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.931+0000 7f9337fff640 1 -- 10.20.193.58:0/2611880089 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f931c004d90 msgr2=0x7f93381613c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:25:04.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.931+0000 7f9337fff640 1 --2- 10.20.193.58:0/2611880089 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f931c004d90 0x7f93381613c0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:04.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.931+0000 7f9337fff640 1 -- 10.20.193.58:0/2611880089 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f931c003a30 msgr2=0x7f933815e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:04.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.931+0000 7f9337fff640 1 --2- 10.20.193.58:0/2611880089 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f931c003a30 0x7f933815e360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:04.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.931+0000 7f9337fff640 1 -- 10.20.193.58:0/2611880089 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9338136ef0 con 0x7f9338162ca0 2026-02-23T06:25:04.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.931+0000 7f9337fff640 1 --2- 10.20.193.58:0/2611880089 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9338162ca0 0x7f9338161900 secure :-1 s=READY pgs=298 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f932c00d090 tx=0x7f932c037660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:04.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.932+0000 7f9313fff640 1 -- 10.20.193.58:0/2611880089 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f932c037a00 con 0x7f9338162ca0 2026-02-23T06:25:04.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.932+0000 7f9313fff640 1 -- 10.20.193.58:0/2611880089 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f932c037b60 con 0x7f9338162ca0 2026-02-23T06:25:04.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.932+0000 7f9313fff640 1 -- 10.20.193.58:0/2611880089 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f932c042420 con 0x7f9338162ca0 2026-02-23T06:25:04.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.932+0000 7f933ce83640 1 -- 10.20.193.58:0/2611880089 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93380b01b0 con 0x7f9338162ca0 2026-02-23T06:25:04.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.932+0000 7f933ce83640 1 -- 10.20.193.58:0/2611880089 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f933815de40 con 0x7f9338162ca0 2026-02-23T06:25:04.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.933+0000 7f933ce83640 1 -- 10.20.193.58:0/2611880089 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f933815e060 con 0x7f9338162ca0 2026-02-23T06:25:04.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.934+0000 7f9313fff640 1 -- 10.20.193.58:0/2611880089 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f932c042580 con 0x7f9338162ca0 2026-02-23T06:25:04.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.935+0000 7f9313fff640 1 --2- 10.20.193.58:0/2611880089 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f930807a5b0 0x7f930809aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:04.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.935+0000 7f9313fff640 1 -- 10.20.193.58:0/2611880089 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f932c0c3870 con 0x7f9338162ca0 2026-02-23T06:25:04.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.935+0000 7f93377fe640 1 --2- 10.20.193.58:0/2611880089 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f930807a5b0 0x7f930809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:04.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.936+0000 7f9313fff640 1 -- 10.20.193.58:0/2611880089 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f932c08a460 con 0x7f9338162ca0 2026-02-23T06:25:04.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:04.936+0000 7f93377fe640 1 --2- 10.20.193.58:0/2611880089 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f930807a5b0 0x7f930809aa60 secure :-1 s=READY pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9324003090 tx=0x7f9324002e10 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:05.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.091+0000 7f933ce83640 1 -- 10.20.193.58:0/2611880089 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f93380b7350 con 0x7f9338162ca0 2026-02-23T06:25:05.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.092+0000 7f9313fff640 1 -- 10.20.193.58:0/2611880089 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1748 (secure 0 0 0) 0x7f932c089bb0 con 0x7f9338162ca0 2026-02-23T06:25:05.087 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":30,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:25:05.088 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.093+0000 7f933ce83640 1 -- 10.20.193.58:0/2611880089 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f930807a5b0 msgr2=0x7f930809aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:05.088 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.093+0000 7f933ce83640 1 --2- 10.20.193.58:0/2611880089 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f930807a5b0 0x7f930809aa60 secure :-1 s=READY pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9324003090 tx=0x7f9324002e10 comp rx=0 tx=0).stop 2026-02-23T06:25:05.088 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.093+0000 7f933ce83640 1 -- 10.20.193.58:0/2611880089 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9338162ca0 msgr2=0x7f9338161900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:05.088 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.093+0000 7f933ce83640 1 --2- 10.20.193.58:0/2611880089 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9338162ca0 0x7f9338161900 secure :-1 s=READY pgs=298 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f932c00d090 tx=0x7f932c037660 comp rx=0 tx=0).stop 2026-02-23T06:25:05.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.095+0000 7f933ce83640 1 -- 10.20.193.58:0/2611880089 shutdown_connections 2026-02-23T06:25:05.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.095+0000 7f933ce83640 1 --2- 10.20.193.58:0/2611880089 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f930807a5b0 0x7f930809aa60 unknown :-1 s=CLOSED pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:05.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.095+0000 7f933ce83640 1 --2- 10.20.193.58:0/2611880089 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9338162ca0 0x7f9338161900 unknown :-1 s=CLOSED pgs=298 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:05.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.095+0000 7f933ce83640 1 --2- 10.20.193.58:0/2611880089 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f931c004d90 0x7f93381613c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:05.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.095+0000 7f933ce83640 1 --2- 10.20.193.58:0/2611880089 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f931c003a30 0x7f933815e360 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:05.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.095+0000 7f933ce83640 1 -- 10.20.193.58:0/2611880089 >> 10.20.193.58:0/2611880089 conn(0x7f93380b3c20 msgr2=0x7f933805bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:25:05.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.095+0000 7f933ce83640 1 -- 10.20.193.58:0/2611880089 shutdown_connections 2026-02-23T06:25:05.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.095+0000 7f933ce83640 1 -- 10.20.193.58:0/2611880089 wait complete. 2026-02-23T06:25:05.103 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:25:05.103 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-23T06:25:05.104 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:25:05.235 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.240+0000 7f7872e83640 1 -- 10.20.193.58:0/1739127402 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f786c15d870 msgr2=0x7f786c0587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:05.235 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.240+0000 7f7872e83640 1 --2- 10.20.193.58:0/1739127402 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f786c15d870 0x7f786c0587b0 secure :-1 s=READY pgs=300 gs=2 cs=0 l=1 c_cookie=3678046360083095631 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7860004740 tx=0x7f786002f220 comp rx=0 tx=0).stop 2026-02-23T06:25:05.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.240+0000 7f7872e83640 1 -- 10.20.193.58:0/1739127402 shutdown_connections 2026-02-23T06:25:05.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.240+0000 7f7872e83640 1 --2- 10.20.193.58:0/1739127402 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f786c0b6690 0x7f786c058cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:05.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.240+0000 7f7872e83640 1 --2- 10.20.193.58:0/1739127402 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f786c15d870 0x7f786c0587b0 unknown :-1 s=CLOSED pgs=300 gs=2 cs=0 l=1 c_cookie=3678046360083095631 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:05.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.240+0000 7f7872e83640 1 -- 10.20.193.58:0/1739127402 >> 10.20.193.58:0/1739127402 conn(0x7f786c0b3c20 msgr2=0x7f786c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:25:05.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.240+0000 7f7872e83640 1 -- 10.20.193.58:0/1739127402 shutdown_connections 2026-02-23T06:25:05.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.240+0000 7f7872e83640 1 -- 10.20.193.58:0/1739127402 wait complete. 2026-02-23T06:25:05.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.241+0000 7f7872e83640 1 Processor -- start 2026-02-23T06:25:05.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.241+0000 7f7872e83640 1 -- start start 2026-02-23T06:25:05.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.242+0000 7f7872e83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f786c0b6690 0x7f786c1624f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:05.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.242+0000 7f7872e83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f786c15d4a0 0x7f786c15e750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:05.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.242+0000 7f7872e83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f786c15d870 0x7f786c15ec90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:05.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.242+0000 7f7872e83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f786c15dc40 con 0x7f786c0b6690 2026-02-23T06:25:05.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.242+0000 7f7872e83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f786c126110 con 0x7f786c15d870 2026-02-23T06:25:05.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.242+0000 7f7872e83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f786c15de90 con 0x7f786c15d4a0 2026-02-23T06:25:05.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.242+0000 7f7872682640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f786c15d870 0x7f786c15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:05.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.242+0000 7f7872682640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f786c15d870 0x7f786c15ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:58586/0 (socket says 10.20.193.58:58586) 2026-02-23T06:25:05.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.242+0000 7f7872682640 1 -- 10.20.193.58:0/843508270 learned_addr learned my addr 10.20.193.58:0/843508270 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:25:05.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.242+0000 7f7871680640 1 -- 10.20.193.58:0/843508270 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f786c15d4a0 msgr2=0x7f786c15e750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:25:05.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.242+0000 7f7871680640 1 --2- 10.20.193.58:0/843508270 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f786c15d4a0 0x7f786c15e750 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:25:05.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.242+0000 7f7871e81640 1 --2- 10.20.193.58:0/843508270 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f786c0b6690 0x7f786c1624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:05.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.242+0000 7f7872682640 1 -- 10.20.193.58:0/843508270 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f786c15d4a0 msgr2=0x7f786c15e750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:25:05.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.242+0000 7f7872682640 1 --2- 10.20.193.58:0/843508270 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f786c15d4a0 0x7f786c15e750 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:05.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.242+0000 7f7872682640 1 -- 10.20.193.58:0/843508270 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f786c0b6690 msgr2=0x7f786c1624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:05.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.242+0000 7f7872682640 1 --2- 10.20.193.58:0/843508270 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f786c0b6690 0x7f786c1624f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:05.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.242+0000 7f7872682640 1 -- 10.20.193.58:0/843508270 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78600094b0 con 0x7f786c15d870 2026-02-23T06:25:05.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.242+0000 7f7871e81640 1 --2- 10.20.193.58:0/843508270 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f786c0b6690 0x7f786c1624f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:25:05.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.243+0000 7f7872682640 1 --2- 10.20.193.58:0/843508270 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f786c15d870 0x7f786c15ec90 secure :-1 s=READY pgs=301 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f786800c520 tx=0x7f786800c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:05.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.243+0000 7f785a7fc640 1 -- 10.20.193.58:0/843508270 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7868003d60 con 0x7f786c15d870 2026-02-23T06:25:05.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.243+0000 7f785a7fc640 1 -- 10.20.193.58:0/843508270 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7868005070 con 0x7f786c15d870 2026-02-23T06:25:05.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.243+0000 7f785a7fc640 1 -- 10.20.193.58:0/843508270 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7868005460 con 0x7f786c15d870 2026-02-23T06:25:05.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.243+0000 7f7872e83640 1 -- 10.20.193.58:0/843508270 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f786c13df40 con 0x7f786c15d870 2026-02-23T06:25:05.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.243+0000 7f7872e83640 1 -- 10.20.193.58:0/843508270 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f786c14f3b0 con 0x7f786c15d870 2026-02-23T06:25:05.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.243+0000 7f7872e83640 1 --2- 10.20.193.58:0/843508270 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f786c126280 0x7f786c15a180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:05.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.243+0000 7f7872e83640 1 -- 10.20.193.58:0/843508270 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f786c14f5a0 con 0x7f786c126280 2026-02-23T06:25:05.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.244+0000 7f7871e81640 1 --2- 10.20.193.58:0/843508270 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f786c126280 0x7f786c15a180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:05.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.244+0000 7f7871e81640 1 -- 10.20.193.58:0/843508270 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f786c0b6330 con 0x7f786c126280 2026-02-23T06:25:05.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.244+0000 7f7871e81640 1 --2- 10.20.193.58:0/843508270 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f786c126280 0x7f786c15a180 secure :-1 s=READY pgs=30 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f785c002730 tx=0x7f785c00eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:05.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.244+0000 7f785a7fc640 1 -- 10.20.193.58:0/843508270 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f785c005250 con 0x7f786c126280 2026-02-23T06:25:05.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.245+0000 7f785a7fc640 1 -- 10.20.193.58:0/843508270 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f785c0053b0 con 0x7f786c126280 2026-02-23T06:25:05.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.245+0000 7f785a7fc640 1 -- 10.20.193.58:0/843508270 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f786c126280 msgr2=0x7f786c15a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:05.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.245+0000 7f785a7fc640 1 --2- 10.20.193.58:0/843508270 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f786c126280 0x7f786c15a180 secure :-1 s=READY pgs=30 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f785c002730 tx=0x7f785c00eba0 comp rx=0 tx=0).stop 2026-02-23T06:25:05.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.245+0000 7f785a7fc640 1 -- 10.20.193.58:0/843508270 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f786c126280 msgr2=0x7f786c15a180 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:25:05.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.245+0000 7f785a7fc640 1 --2- 10.20.193.58:0/843508270 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f786c126280 0x7f786c15a180 secure :-1 s=CLOSED pgs=30 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f785c002730 tx=0x7f785c00eba0 comp rx=0 tx=0).stop 2026-02-23T06:25:05.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.245+0000 7f785a7fc640 1 -- 10.20.193.58:0/843508270 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f786800e040 con 0x7f786c15d870 2026-02-23T06:25:05.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.246+0000 7f785a7fc640 1 --2- 10.20.193.58:0/843508270 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f783c07a430 0x7f783c09a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:05.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.246+0000 7f785a7fc640 1 -- 10.20.193.58:0/843508270 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f786809e4e0 con 0x7f786c15d870 2026-02-23T06:25:05.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.246+0000 7f7871e81640 1 --2- 10.20.193.58:0/843508270 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f783c07a430 0x7f783c09a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:05.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.247+0000 7f7871e81640 1 --2- 10.20.193.58:0/843508270 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f783c07a430 0x7f783c09a8e0 secure :-1 s=READY pgs=169 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f785c002730 tx=0x7f785c013000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:05.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.248+0000 7f7872e83640 1 --2- 10.20.193.58:0/843508270 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f786c126650 0x7f786c15a6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:05.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.248+0000 7f7872e83640 1 -- 10.20.193.58:0/843508270 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f786c15ac00 con 0x7f786c126650 2026-02-23T06:25:05.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.248+0000 7f7871680640 1 --2- 10.20.193.58:0/843508270 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f786c126650 0x7f786c15a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:05.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.248+0000 7f7871680640 1 -- 10.20.193.58:0/843508270 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f786c164250 con 0x7f786c126650 2026-02-23T06:25:05.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.249+0000 7f7871680640 1 --2- 10.20.193.58:0/843508270 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f786c126650 0x7f786c15a6c0 secure :-1 s=READY pgs=31 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f786c15e600 tx=0x7f78600028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:05.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.249+0000 7f785a7fc640 1 -- 10.20.193.58:0/843508270 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f786003e070 con 0x7f786c126650 2026-02-23T06:25:05.246 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:25:05.246 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:25:05.246 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:25:05.246 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:25:05.246 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 30, 2026-02-23T06:25:05.247 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 32082, 2026-02-23T06:25:05.247 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:25:05.247 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:25:05.247 INFO:teuthology.orchestra.run.trial058.stdout: 1 2026-02-23T06:25:05.247 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:05.247 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:25:05.247 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:25:05.247 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:25:05.247 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:25:05.247 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:25:05.247 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:25:05.248 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:25:05.248 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:25:05.248 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:25:05.248 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:25:05.248 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:25:05.248 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:25:05.248 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:25:05.248 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:25:05.248 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:25:05.248 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:25:05.248 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:25:05.248 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:05.249 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:25:05.249 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:25:05.249 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:25:05.249 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:25:05.249 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:25:05.249 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:25:05.249 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:25:05.249 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:25:05.249 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:25:05.249 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:25:05.249 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:25:05.249 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:25:05.250 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:25:05.250 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:25:05.250 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:25:05.250 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:05.250 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:05.250 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:25:05.250 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:25:05.250 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:25:05.250 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:25:05.250 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:25:05.250 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:25:05.250 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:25:05.251 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:25:05.251 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:25:05.251 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:25:05.251 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:25:05.251 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:25:05.251 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:25:05.251 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:25:05.251 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:25:05.251 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:25:05.251 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:25:05.251 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:25:05.251 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:25:05.252 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:25:05.252 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:25:05.252 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:25:05.252 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:25:05.252 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:25:05.252 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:25:05.252 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:25:05.252 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:25:05.252 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:25:05.252 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:25:05.252 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:25:05.252 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:05.253 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:25:05.253 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:05.253 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:25:05.253 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:05.253 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:25:05.253 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:25:05.253 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:25:05.253 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:25:05.253 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:05.253 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:25:05.253 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:25:05.253 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:05.253 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:05.254 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:05.254 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:25:05.254 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:25:05.254 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:05.254 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:05.254 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:05.254 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:05.254 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:25:05.254 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:25:05.254 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:25:05.254 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:25:05.254 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:25:05.255 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:25:05.255 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:05.255 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:05.255 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:25:05.255 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:25:05.255 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:25:05.255 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:25:05.255 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:05.255 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:25:05.255 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:25:05.255 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:05.255 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:05.256 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:05.256 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:25:05.256 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:25:05.256 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:05.256 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:05.256 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:05.256 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:05.256 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:25:05.256 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:25:05.256 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:25:05.256 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:25:05.256 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:25:05.256 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:25:05.257 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:05.257 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:05.257 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:25:05.257 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:25:05.257 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:25:05.257 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:25:05.257 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:05.257 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:25:05.257 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:25:05.257 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:05.257 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:05.257 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:05.257 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:25:05.258 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:25:05.258 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:05.258 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:05.258 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:05.258 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:05.258 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:25:05.258 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:25:05.258 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:25:05.258 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:25:05.258 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:25:05.258 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:25:05.258 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:05.258 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:05.259 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:05.259 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:25:05.259 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:25:05.259 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:05.259 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:25:05.259 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:25:05.259 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:25:05.259 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:05.259 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:05.259 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:25:05.259 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:05.259 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:25:05.260 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:25:05.260 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:25:05.260 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:05.260 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:05.260 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:25:05.260 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:05.260 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:25:05.260 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:25:05.260 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:25:05.260 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:05.260 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:05.260 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:25:05.261 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:05.261 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:25:05.261 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:25:05.261 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:25:05.261 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:05.261 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:05.261 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:05.261 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:25:05.261 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:25:05.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.249+0000 7f785a7fc640 1 -- 10.20.193.58:0/843508270 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5235 (secure 0 0 0) 0x7f7860038470 con 0x7f786c126650 2026-02-23T06:25:05.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.249+0000 7f785a7fc640 1 -- 10.20.193.58:0/843508270 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f786c126650 msgr2=0x7f786c15a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:05.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.249+0000 7f785a7fc640 1 --2- 10.20.193.58:0/843508270 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f786c126650 0x7f786c15a6c0 secure :-1 s=READY pgs=31 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f786c15e600 tx=0x7f78600028d0 comp rx=0 tx=0).stop 2026-02-23T06:25:05.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.249+0000 7f785a7fc640 1 -- 10.20.193.58:0/843508270 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f786c126650 msgr2=0x7f786c15a6c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:25:05.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.249+0000 7f785a7fc640 1 --2- 10.20.193.58:0/843508270 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f786c126650 0x7f786c15a6c0 unknown :-1 s=CLOSED pgs=31 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:05.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.249+0000 7f7872e83640 1 -- 10.20.193.58:0/843508270 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f783c07a430 msgr2=0x7f783c09a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:05.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.249+0000 7f7872e83640 1 --2- 10.20.193.58:0/843508270 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f783c07a430 0x7f783c09a8e0 secure :-1 s=READY pgs=169 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f785c002730 tx=0x7f785c013000 comp rx=0 tx=0).stop 2026-02-23T06:25:05.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.249+0000 7f7872e83640 1 -- 10.20.193.58:0/843508270 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f786c15d870 msgr2=0x7f786c15ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:05.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.249+0000 7f7872e83640 1 --2- 10.20.193.58:0/843508270 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f786c15d870 0x7f786c15ec90 secure :-1 s=READY pgs=301 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f786800c520 tx=0x7f786800c9f0 comp rx=0 tx=0).stop 2026-02-23T06:25:05.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.249+0000 7f7872682640 1 -- 10.20.193.58:0/843508270 reap_dead start 2026-02-23T06:25:05.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.249+0000 7f7872682640 1 -- 10.20.193.58:0/843508270 reap_dead start 2026-02-23T06:25:05.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.249+0000 7f7872e83640 1 -- 10.20.193.58:0/843508270 shutdown_connections 2026-02-23T06:25:05.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.249+0000 7f7872e83640 1 -- 10.20.193.58:0/843508270 >> 10.20.193.58:0/843508270 conn(0x7f786c0b3c20 msgr2=0x7f786c058b70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:25:05.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.250+0000 7f7872e83640 1 -- 10.20.193.58:0/843508270 shutdown_connections 2026-02-23T06:25:05.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.250+0000 7f7872e83640 1 -- 10.20.193.58:0/843508270 wait complete. 2026-02-23T06:25:05.265 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:25:05.265 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-23T06:25:05.265 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:25:05.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.393+0000 7f2302325640 1 -- 10.20.193.58:0/3830495223 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f22fc0b6690 msgr2=0x7f22fc058ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:05.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.393+0000 7f2302325640 1 --2- 10.20.193.58:0/3830495223 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f22fc0b6690 0x7f22fc058ec0 secure :-1 s=READY pgs=303 gs=3 cs=0 l=1 c_cookie=15732667914598446036 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22f8005820 tx=0x7f22f80302f0 comp rx=0 tx=0).stop 2026-02-23T06:25:05.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.393+0000 7f2302325640 1 -- 10.20.193.58:0/3830495223 shutdown_connections 2026-02-23T06:25:05.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.393+0000 7f2302325640 1 --2- 10.20.193.58:0/3830495223 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f22fc0b6690 0x7f22fc058ec0 unknown :-1 s=CLOSED pgs=303 gs=3 cs=0 l=1 c_cookie=15732667914598446036 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:05.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.393+0000 7f2302325640 1 -- 10.20.193.58:0/3830495223 >> 10.20.193.58:0/3830495223 conn(0x7f22fc0b3c20 msgr2=0x7f22fc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:25:05.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.393+0000 7f2302325640 1 -- 10.20.193.58:0/3830495223 shutdown_connections 2026-02-23T06:25:05.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.393+0000 7f2302325640 1 -- 10.20.193.58:0/3830495223 wait complete. 2026-02-23T06:25:05.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.394+0000 7f2302325640 1 Processor -- start 2026-02-23T06:25:05.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.394+0000 7f2302325640 1 -- start start 2026-02-23T06:25:05.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.395+0000 7f2302325640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f22fc0b6690 0x7f22fc13d3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:05.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.395+0000 7f2302325640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f22fc15d4a0 0x7f22fc15fbb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:05.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.395+0000 7f2302325640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f22fc15d870 0x7f22fc1600f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:05.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.395+0000 7f2302325640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f22fc161680 con 0x7f22fc0b6690 2026-02-23T06:25:05.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.395+0000 7f2302325640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f22fc163100 con 0x7f22fc15d4a0 2026-02-23T06:25:05.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.395+0000 7f2302325640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f22fc160aa0 con 0x7f22fc15d870 2026-02-23T06:25:05.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.395+0000 7f2301323640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f22fc0b6690 0x7f22fc13d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:05.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.395+0000 7f2301323640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f22fc0b6690 0x7f22fc13d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:35872/0 (socket says 10.20.193.58:35872) 2026-02-23T06:25:05.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.395+0000 7f2301323640 1 -- 10.20.193.58:0/111165566 learned_addr learned my addr 10.20.193.58:0/111165566 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:25:05.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.395+0000 7f2300b22640 1 --2- 10.20.193.58:0/111165566 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f22fc15d4a0 0x7f22fc15fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:05.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.395+0000 7f2301b24640 1 -- 10.20.193.58:0/111165566 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f22fc15d870 msgr2=0x7f22fc1600f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:25:05.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.395+0000 7f2301b24640 1 --2- 10.20.193.58:0/111165566 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f22fc15d870 0x7f22fc1600f0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:25:05.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.395+0000 7f2301323640 1 -- 10.20.193.58:0/111165566 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f22fc15d870 msgr2=0x7f22fc1600f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:25:05.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.395+0000 7f2301323640 1 --2- 10.20.193.58:0/111165566 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f22fc15d870 0x7f22fc1600f0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:05.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.395+0000 7f2301323640 1 -- 10.20.193.58:0/111165566 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f22fc15d4a0 msgr2=0x7f22fc15fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:05.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.395+0000 7f2301323640 1 --2- 10.20.193.58:0/111165566 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f22fc15d4a0 0x7f22fc15fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:05.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.395+0000 7f2301323640 1 -- 10.20.193.58:0/111165566 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f800a590 con 0x7f22fc0b6690 2026-02-23T06:25:05.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.396+0000 7f2301323640 1 --2- 10.20.193.58:0/111165566 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f22fc0b6690 0x7f22fc13d3f0 secure :-1 s=READY pgs=33 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22ec007fd0 tx=0x7f22ec00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:05.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.396+0000 7f22e9ffb640 1 -- 10.20.193.58:0/111165566 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22ec00a860 con 0x7f22fc0b6690 2026-02-23T06:25:05.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.396+0000 7f22e9ffb640 1 -- 10.20.193.58:0/111165566 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f22ec00aab0 con 0x7f22fc0b6690 2026-02-23T06:25:05.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.396+0000 7f22e9ffb640 1 -- 10.20.193.58:0/111165566 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22ec00aea0 con 0x7f22fc0b6690 2026-02-23T06:25:05.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.396+0000 7f2302325640 1 -- 10.20.193.58:0/111165566 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22fc15f0b0 con 0x7f22fc0b6690 2026-02-23T06:25:05.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.396+0000 7f2302325640 1 -- 10.20.193.58:0/111165566 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22fc161310 con 0x7f22fc0b6690 2026-02-23T06:25:05.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.396+0000 7f2302325640 1 --2- 10.20.193.58:0/111165566 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f22fc057f30 0x7f22fc161af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:05.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.396+0000 7f2302325640 1 -- 10.20.193.58:0/111165566 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f22fc0609c0 con 0x7f22fc057f30 2026-02-23T06:25:05.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.397+0000 7f2300b22640 1 --2- 10.20.193.58:0/111165566 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f22fc057f30 0x7f22fc161af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:05.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.397+0000 7f2300b22640 1 -- 10.20.193.58:0/111165566 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f22fc0b5e10 con 0x7f22fc057f30 2026-02-23T06:25:05.396 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.397+0000 7f22e9ffb640 1 -- 10.20.193.58:0/111165566 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f22ec01b400 con 0x7f22fc0b6690 2026-02-23T06:25:05.396 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.398+0000 7f2300b22640 1 --2- 10.20.193.58:0/111165566 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f22fc057f30 0x7f22fc161af0 secure :-1 s=READY pgs=304 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22fc05ca50 tx=0x7f22f000eba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:05.396 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.398+0000 7f22e9ffb640 1 --2- 10.20.193.58:0/111165566 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f22cc07a5b0 0x7f22cc09aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:05.396 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.398+0000 7f22e9ffb640 1 -- 10.20.193.58:0/111165566 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f22ec09d990 con 0x7f22fc0b6690 2026-02-23T06:25:05.396 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.398+0000 7f22e9ffb640 1 -- 10.20.193.58:0/111165566 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22f000c880 con 0x7f22fc057f30 2026-02-23T06:25:05.396 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.398+0000 7f22e9ffb640 1 -- 10.20.193.58:0/111165566 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f22f000c9e0 con 0x7f22fc057f30 2026-02-23T06:25:05.396 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.398+0000 7f22e9ffb640 1 -- 10.20.193.58:0/111165566 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f22fc057f30 msgr2=0x7f22fc161af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:05.396 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.398+0000 7f22e9ffb640 1 --2- 10.20.193.58:0/111165566 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f22fc057f30 0x7f22fc161af0 secure :-1 s=READY pgs=304 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22fc05ca50 tx=0x7f22f000eba0 comp rx=0 tx=0).stop 2026-02-23T06:25:05.396 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.398+0000 7f22e9ffb640 1 -- 10.20.193.58:0/111165566 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f22fc057f30 msgr2=0x7f22fc161af0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:25:05.397 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.398+0000 7f22e9ffb640 1 --2- 10.20.193.58:0/111165566 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f22fc057f30 0x7f22fc161af0 unknown :-1 s=CLOSED pgs=304 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:05.397 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.399+0000 7f2301b24640 1 --2- 10.20.193.58:0/111165566 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f22cc07a5b0 0x7f22cc09aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:05.397 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.399+0000 7f2301b24640 1 --2- 10.20.193.58:0/111165566 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f22cc07a5b0 0x7f22cc09aa60 secure :-1 s=READY pgs=170 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22f80182c0 tx=0x7f22f8032040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:05.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.402+0000 7f2302325640 1 --2- 10.20.193.58:0/111165566 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f22fc162030 0x7f22fc14c8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:05.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.402+0000 7f2302325640 1 -- 10.20.193.58:0/111165566 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f22fc0b6330 con 0x7f22fc162030 2026-02-23T06:25:05.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.403+0000 7f2300b22640 1 --2- 10.20.193.58:0/111165566 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f22fc162030 0x7f22fc14c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:05.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.403+0000 7f2300b22640 1 -- 10.20.193.58:0/111165566 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f22fc1617c0 con 0x7f22fc162030 2026-02-23T06:25:05.399 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.403+0000 7f2300b22640 1 --2- 10.20.193.58:0/111165566 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f22fc162030 0x7f22fc14c8b0 secure :-1 s=READY pgs=305 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22f0017040 tx=0x7f22f00026a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:05.399 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.404+0000 7f22e9ffb640 1 -- 10.20.193.58:0/111165566 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22f0015430 con 0x7f22fc162030 2026-02-23T06:25:05.399 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.404+0000 7f22e9ffb640 1 -- 10.20.193.58:0/111165566 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5544 (secure 0 0 0) 0x7f22f0023070 con 0x7f22fc162030 2026-02-23T06:25:05.399 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:25:05.399 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:25:05.400 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:25:05.400 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:25:05.400 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 30, 2026-02-23T06:25:05.400 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 243450, 2026-02-23T06:25:05.400 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:25:05.400 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:25:05.400 INFO:teuthology.orchestra.run.trial058.stdout: 1 2026-02-23T06:25:05.400 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:05.400 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:25:05.400 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:25:05.400 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:25:05.401 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:25:05.401 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:25:05.401 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:25:05.401 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:25:05.401 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:25:05.401 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:25:05.401 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:25:05.401 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:25:05.401 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:25:05.401 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:25:05.401 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:25:05.401 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:25:05.402 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:25:05.402 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:25:05.402 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:05.402 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:25:05.402 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:25:05.402 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:25:05.402 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:25:05.402 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:25:05.402 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:25:05.402 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:25:05.402 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:25:05.402 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:25:05.403 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:25:05.403 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:25:05.403 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:25:05.403 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:25:05.403 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:25:05.403 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:25:05.403 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:05.403 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:05.403 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:25:05.403 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:25:05.403 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:25:05.403 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:25:05.403 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:25:05.404 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:25:05.404 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:25:05.404 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:25:05.404 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:25:05.404 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:25:05.404 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:25:05.404 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:25:05.404 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:25:05.404 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:25:05.404 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:25:05.404 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:25:05.405 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:25:05.405 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:25:05.405 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:25:05.405 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:25:05.405 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:25:05.405 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:25:05.405 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:25:05.405 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:25:05.405 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:25:05.405 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:25:05.405 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:25:05.405 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:25:05.406 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:25:05.406 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:25:05.406 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:05.406 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:25:05.406 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:05.406 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:25:05.406 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:05.406 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:25:05.406 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:25:05.406 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:25:05.406 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:25:05.406 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:05.407 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:25:05.407 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:25:05.407 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:05.407 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:05.407 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:05.407 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:25:05.407 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:25:05.407 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:05.407 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:05.407 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:05.407 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:05.407 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:25:05.408 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:25:05.408 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:25:05.408 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:25:05.408 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:25:05.408 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:25:05.408 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:05.408 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:05.408 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:25:05.408 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:25:05.408 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:25:05.408 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:25:05.408 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:05.409 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:25:05.409 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:25:05.409 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:05.409 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:05.409 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:05.409 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:25:05.409 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:25:05.409 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:05.409 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:05.409 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:05.409 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:05.409 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:25:05.410 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:25:05.410 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:25:05.410 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:25:05.410 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:25:05.410 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:25:05.410 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:05.410 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:05.410 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:25:05.410 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:25:05.410 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:25:05.410 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:25:05.410 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:05.410 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:25:05.411 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:25:05.411 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:05.411 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:05.411 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:05.411 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:25:05.411 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:25:05.411 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:05.411 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:05.411 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:05.411 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:05.411 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:25:05.411 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:25:05.411 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:25:05.412 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:25:05.412 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:25:05.412 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:25:05.412 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:05.412 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:05.412 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:05.412 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:25:05.412 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:25:05.412 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:05.412 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:25:05.412 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:25:05.412 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:25:05.413 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:05.413 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:05.413 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:25:05.413 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:05.413 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:25:05.413 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:25:05.413 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:25:05.413 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:05.413 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:05.413 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:25:05.413 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:05.413 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:25:05.414 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:25:05.414 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:25:05.414 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:05.414 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:05.414 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:25:05.414 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:05.414 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:25:05.414 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:25:05.414 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:25:05.414 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:05.414 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:05.414 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:25:05.414 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:25:05.415 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:25:05.415 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:05.415 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:05.415 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:25:05.415 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:05.415 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:25:05.415 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:25:05.415 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:25:05.415 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:05.415 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:05.415 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:05.415 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:25:05.416 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:25:05.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.404+0000 7f22e9ffb640 1 -- 10.20.193.58:0/111165566 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f22fc162030 msgr2=0x7f22fc14c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:05.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.404+0000 7f22e9ffb640 1 --2- 10.20.193.58:0/111165566 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f22fc162030 0x7f22fc14c8b0 secure :-1 s=READY pgs=305 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22f0017040 tx=0x7f22f00026a0 comp rx=0 tx=0).stop 2026-02-23T06:25:05.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.404+0000 7f22e9ffb640 1 -- 10.20.193.58:0/111165566 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f22fc162030 msgr2=0x7f22fc14c8b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:25:05.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.404+0000 7f22e9ffb640 1 --2- 10.20.193.58:0/111165566 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f22fc162030 0x7f22fc14c8b0 unknown :-1 s=CLOSED pgs=305 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:05.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.404+0000 7f2302325640 1 -- 10.20.193.58:0/111165566 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f22cc07a5b0 msgr2=0x7f22cc09aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:05.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.404+0000 7f2302325640 1 --2- 10.20.193.58:0/111165566 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f22cc07a5b0 0x7f22cc09aa60 secure :-1 s=READY pgs=170 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22f80182c0 tx=0x7f22f8032040 comp rx=0 tx=0).stop 2026-02-23T06:25:05.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.404+0000 7f2302325640 1 -- 10.20.193.58:0/111165566 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f22fc0b6690 msgr2=0x7f22fc13d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:05.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.404+0000 7f2302325640 1 --2- 10.20.193.58:0/111165566 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f22fc0b6690 0x7f22fc13d3f0 secure :-1 s=READY pgs=33 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22ec007fd0 tx=0x7f22ec00cba0 comp rx=0 tx=0).stop 2026-02-23T06:25:05.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.404+0000 7f2301b24640 1 -- 10.20.193.58:0/111165566 reap_dead start 2026-02-23T06:25:05.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.404+0000 7f2301b24640 1 -- 10.20.193.58:0/111165566 reap_dead start 2026-02-23T06:25:05.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.404+0000 7f2302325640 1 -- 10.20.193.58:0/111165566 shutdown_connections 2026-02-23T06:25:05.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.404+0000 7f2302325640 1 -- 10.20.193.58:0/111165566 >> 10.20.193.58:0/111165566 conn(0x7f22fc0b3c20 msgr2=0x7f22fc1633c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:25:05.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.404+0000 7f2302325640 1 -- 10.20.193.58:0/111165566 shutdown_connections 2026-02-23T06:25:05.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:05.404+0000 7f2302325640 1 -- 10.20.193.58:0/111165566 wait complete. 2026-02-23T06:25:05.419 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:25:05.420 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:25:12.264 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:25:12.269 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:25:25.420 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-23T06:25:25.421 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-23T06:25:25.421 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-23T06:25:25.421 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-23T06:25:25.424 INFO:tasks.ceph.mon.c:Started 2026-02-23T06:25:25.424 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.a 2026-02-23T06:25:25.424 INFO:tasks.mon_thrash:Sending STOP to mon a 2026-02-23T06:25:25.425 INFO:tasks.ceph.mon.a:Sent signal 19 2026-02-23T06:25:25.425 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-23T06:25:40.425 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.a 2026-02-23T06:25:40.425 INFO:tasks.mon_thrash:Sending CONT to mon a 2026-02-23T06:25:40.426 INFO:tasks.ceph.mon.a:Sent signal 18 2026-02-23T06:25:40.426 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:25:40.426 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:25:42.322 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:25:42.333 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:25:43.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.558+0000 7f04fb577640 1 -- 10.20.193.58:0/4273490025 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f04d8003730 msgr2=0x7f04d8023b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:43.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.558+0000 7f04fb577640 1 --2- 10.20.193.58:0/4273490025 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f04d8003730 0x7f04d8023b70 secure :-1 s=READY pgs=5 gs=19 cs=0 l=1 c_cookie=12679558054934543141 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04f0006fd0 tx=0x7f04f002f280 comp rx=0 tx=0).stop 2026-02-23T06:25:43.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.558+0000 7f04fad76640 1 -- 10.20.193.58:0/4273490025 reap_dead start 2026-02-23T06:25:43.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.558+0000 7f04fb577640 1 -- 10.20.193.58:0/4273490025 shutdown_connections 2026-02-23T06:25:43.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.558+0000 7f04fb577640 1 -- 10.20.193.58:0/4273490025 >> 10.20.193.58:0/4273490025 conn(0x7f04fc0b3c20 msgr2=0x7f04fc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:25:43.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.558+0000 7f04fb577640 1 -- 10.20.193.58:0/4273490025 shutdown_connections 2026-02-23T06:25:43.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.558+0000 7f04fb577640 1 -- 10.20.193.58:0/4273490025 wait complete. 2026-02-23T06:25:43.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.559+0000 7f04fb577640 1 Processor -- start 2026-02-23T06:25:43.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.560+0000 7f04fb577640 1 -- start start 2026-02-23T06:25:43.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.560+0000 7f04fb577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f04d8003730 0x7f04fc15a5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:43.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.560+0000 7f04fb577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f04fc0b7f60 0x7f04fc057520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:43.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.560+0000 7f04fb577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f04fc15e300 0x7f04fc057a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:43.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.560+0000 7f04fb577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc160100 con 0x7f04d8003730 2026-02-23T06:25:43.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.560+0000 7f04fb577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc0a9b50 con 0x7f04fc0b7f60 2026-02-23T06:25:43.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.560+0000 7f04fb577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f04fc1fe730 con 0x7f04fc15e300 2026-02-23T06:25:43.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.560+0000 7f04fa575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f04d8003730 0x7f04fc15a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:43.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.560+0000 7f04fa575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f04d8003730 0x7f04fc15a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:46394/0 (socket says 10.20.193.58:46394) 2026-02-23T06:25:43.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.560+0000 7f04fa575640 1 -- 10.20.193.58:0/2560966644 learned_addr learned my addr 10.20.193.58:0/2560966644 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:25:43.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.560+0000 7f04fad76640 1 --2- 10.20.193.58:0/2560966644 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f04fc15e300 0x7f04fc057a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:43.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.560+0000 7f04fa575640 1 -- 10.20.193.58:0/2560966644 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f04d8003730 msgr2=0x7f04fc15a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-23T06:25:43.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.560+0000 7f04fa575640 1 -- 10.20.193.58:0/2560966644 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f04d8003730 msgr2=0x7f04fc15a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:25:43.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.560+0000 7f04fa575640 1 --2- 10.20.193.58:0/2560966644 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f04d8003730 0x7f04fc15a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:25:43.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.561+0000 7f04f9d74640 1 --2- 10.20.193.58:0/2560966644 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f04fc0b7f60 0x7f04fc057520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:43.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.561+0000 7f04fa575640 1 --2- 10.20.193.58:0/2560966644 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f04d8003730 0x7f04fc15a5d0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:25:43.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.561+0000 7f04f9d74640 1 -- 10.20.193.58:0/2560966644 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f04fc0b7f60 msgr2=0x7f04fc057520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-23T06:25:43.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.561+0000 7f04f9d74640 1 -- 10.20.193.58:0/2560966644 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f04fc0b7f60 msgr2=0x7f04fc057520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:25:43.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.561+0000 7f04f9d74640 1 --2- 10.20.193.58:0/2560966644 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f04fc0b7f60 0x7f04fc057520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:25:43.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.561+0000 7f04f9d74640 1 --2- 10.20.193.58:0/2560966644 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f04fc0b7f60 0x7f04fc057520 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:25:43.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.561+0000 7f04fad76640 1 -- 10.20.193.58:0/2560966644 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f04fc0b7f60 msgr2=0x7f04fc057520 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:25:43.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.561+0000 7f04fad76640 1 --2- 10.20.193.58:0/2560966644 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f04fc0b7f60 0x7f04fc057520 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:43.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.561+0000 7f04fad76640 1 -- 10.20.193.58:0/2560966644 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f04d8003730 msgr2=0x7f04fc15a5d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:25:43.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.561+0000 7f04fad76640 1 --2- 10.20.193.58:0/2560966644 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f04d8003730 0x7f04fc15a5d0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:43.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.561+0000 7f04fad76640 1 -- 10.20.193.58:0/2560966644 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f0002bc0 con 0x7f04fc15e300 2026-02-23T06:25:43.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.561+0000 7f04fad76640 1 --2- 10.20.193.58:0/2560966644 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f04fc15e300 0x7f04fc057a60 secure :-1 s=READY pgs=6 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04fc0b1b90 tx=0x7f04ec0145b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:43.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.561+0000 7f04e2ffd640 1 -- 10.20.193.58:0/2560966644 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04ec014b40 con 0x7f04fc15e300 2026-02-23T06:25:43.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.561+0000 7f04fb577640 1 -- 10.20.193.58:0/2560966644 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04fc058220 con 0x7f04fc15e300 2026-02-23T06:25:43.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.561+0000 7f04e2ffd640 1 -- 10.20.193.58:0/2560966644 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f04ec014ce0 con 0x7f04fc15e300 2026-02-23T06:25:43.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.561+0000 7f04e2ffd640 1 -- 10.20.193.58:0/2560966644 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04ec005bb0 con 0x7f04fc15e300 2026-02-23T06:25:43.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.561+0000 7f04fb577640 1 -- 10.20.193.58:0/2560966644 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f04fc15f860 con 0x7f04fc15e300 2026-02-23T06:25:43.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.562+0000 7f04fb577640 1 -- 10.20.193.58:0/2560966644 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04fc0b6d50 con 0x7f04fc15e300 2026-02-23T06:25:43.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.563+0000 7f04e2ffd640 1 -- 10.20.193.58:0/2560966644 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f04ec005d10 con 0x7f04fc15e300 2026-02-23T06:25:43.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.564+0000 7f04e2ffd640 1 --2- 10.20.193.58:0/2560966644 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f04c807a6c0 0x7f04c809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:43.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.564+0000 7f04e2ffd640 1 -- 10.20.193.58:0/2560966644 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f04ec09ed60 con 0x7f04fc15e300 2026-02-23T06:25:43.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.565+0000 7f04fa575640 1 --2- 10.20.193.58:0/2560966644 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f04c807a6c0 0x7f04c809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:43.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.565+0000 7f04fa575640 1 --2- 10.20.193.58:0/2560966644 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f04c807a6c0 0x7f04c809ab70 secure :-1 s=READY pgs=174 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04f0002fc0 tx=0x7f04f0031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:43.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.567+0000 7f04e2ffd640 1 -- 10.20.193.58:0/2560966644 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f04ec061de0 con 0x7f04fc15e300 2026-02-23T06:25:43.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.726+0000 7f04fb577640 1 -- 10.20.193.58:0/2560966644 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f04fc0b1570 con 0x7f04fc15e300 2026-02-23T06:25:43.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.726+0000 7f04e2ffd640 1 -- 10.20.193.58:0/2560966644 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1749 (secure 0 0 0) 0x7f04ec064f90 con 0x7f04fc15e300 2026-02-23T06:25:43.722 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":32,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":13,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:25:43.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.729+0000 7f04fb577640 1 -- 10.20.193.58:0/2560966644 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f04c807a6c0 msgr2=0x7f04c809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:43.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.729+0000 7f04fb577640 1 --2- 10.20.193.58:0/2560966644 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f04c807a6c0 0x7f04c809ab70 secure :-1 s=READY pgs=174 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04f0002fc0 tx=0x7f04f0031040 comp rx=0 tx=0).stop 2026-02-23T06:25:43.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.729+0000 7f04fb577640 1 -- 10.20.193.58:0/2560966644 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f04fc15e300 msgr2=0x7f04fc057a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:43.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.729+0000 7f04fb577640 1 --2- 10.20.193.58:0/2560966644 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f04fc15e300 0x7f04fc057a60 secure :-1 s=READY pgs=6 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04fc0b1b90 tx=0x7f04ec0145b0 comp rx=0 tx=0).stop 2026-02-23T06:25:43.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.729+0000 7f04fb577640 1 -- 10.20.193.58:0/2560966644 shutdown_connections 2026-02-23T06:25:43.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.729+0000 7f04fb577640 1 --2- 10.20.193.58:0/2560966644 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f04c807a6c0 0x7f04c809ab70 unknown :-1 s=CLOSED pgs=174 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:43.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.729+0000 7f04fb577640 1 --2- 10.20.193.58:0/2560966644 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f04fc15e300 0x7f04fc057a60 unknown :-1 s=CLOSED pgs=6 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:43.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.729+0000 7f04fb577640 1 --2- 10.20.193.58:0/2560966644 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f04fc0b7f60 0x7f04fc057520 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:43.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.729+0000 7f04fb577640 1 --2- 10.20.193.58:0/2560966644 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f04d8003730 0x7f04fc15a5d0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:43.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.729+0000 7f04fb577640 1 -- 10.20.193.58:0/2560966644 >> 10.20.193.58:0/2560966644 conn(0x7f04fc0b3c20 msgr2=0x7f04fc15b880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:25:43.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.729+0000 7f04fb577640 1 -- 10.20.193.58:0/2560966644 shutdown_connections 2026-02-23T06:25:43.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:43.729+0000 7f04fb577640 1 -- 10.20.193.58:0/2560966644 wait complete. 2026-02-23T06:25:46.737 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:25:46.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.865+0000 7f5f663be640 1 -- 10.20.193.58:0/2589263323 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5f6015d870 msgr2=0x7f5f600587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:46.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.865+0000 7f5f663be640 1 --2- 10.20.193.58:0/2589263323 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5f6015d870 0x7f5f600587b0 secure :-1 s=READY pgs=41 gs=2 cs=0 l=1 c_cookie=13392454161706086142 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f54004740 tx=0x7f5f5402f1e0 comp rx=0 tx=0).stop 2026-02-23T06:25:46.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.865+0000 7f5f663be640 1 -- 10.20.193.58:0/2589263323 shutdown_connections 2026-02-23T06:25:46.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.865+0000 7f5f663be640 1 --2- 10.20.193.58:0/2589263323 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5f600b6690 0x7f5f60058cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:46.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.865+0000 7f5f663be640 1 --2- 10.20.193.58:0/2589263323 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5f6015d870 0x7f5f600587b0 unknown :-1 s=CLOSED pgs=41 gs=2 cs=0 l=1 c_cookie=13392454161706086142 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:46.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.865+0000 7f5f663be640 1 -- 10.20.193.58:0/2589263323 >> 10.20.193.58:0/2589263323 conn(0x7f5f600b3c20 msgr2=0x7f5f600b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:25:46.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.865+0000 7f5f663be640 1 -- 10.20.193.58:0/2589263323 shutdown_connections 2026-02-23T06:25:46.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.865+0000 7f5f663be640 1 -- 10.20.193.58:0/2589263323 wait complete. 2026-02-23T06:25:46.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.866+0000 7f5f663be640 1 Processor -- start 2026-02-23T06:25:46.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.866+0000 7f5f663be640 1 -- start start 2026-02-23T06:25:46.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.867+0000 7f5f663be640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5f600b6690 0x7f5f6013e6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:46.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.867+0000 7f5f663be640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5f6015d4a0 0x7f5f6013ba00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:46.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.867+0000 7f5f663be640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5f6015d870 0x7f5f6013bf40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:46.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.867+0000 7f5f663be640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f5f60139ad0 con 0x7f5f6015d870 2026-02-23T06:25:46.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.867+0000 7f5f663be640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6013b500 con 0x7f5f6015d4a0 2026-02-23T06:25:46.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.867+0000 7f5f663be640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f5f60139d20 con 0x7f5f600b6690 2026-02-23T06:25:46.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.867+0000 7f5f65bbd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5f6015d870 0x7f5f6013bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:46.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.867+0000 7f5f65bbd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5f6015d870 0x7f5f6013bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:46408/0 (socket says 10.20.193.58:46408) 2026-02-23T06:25:46.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.867+0000 7f5f65bbd640 1 -- 10.20.193.58:0/764361426 learned_addr learned my addr 10.20.193.58:0/764361426 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:25:46.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.867+0000 7f5f64bbb640 1 --2- 10.20.193.58:0/764361426 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5f6015d4a0 0x7f5f6013ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:46.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.867+0000 7f5f653bc640 1 --2- 10.20.193.58:0/764361426 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5f600b6690 0x7f5f6013e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:46.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.867+0000 7f5f65bbd640 1 -- 10.20.193.58:0/764361426 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5f600b6690 msgr2=0x7f5f6013e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:46.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.867+0000 7f5f65bbd640 1 --2- 10.20.193.58:0/764361426 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5f600b6690 0x7f5f6013e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:46.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.867+0000 7f5f65bbd640 1 -- 10.20.193.58:0/764361426 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5f6015d4a0 msgr2=0x7f5f6013ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:46.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.867+0000 7f5f65bbd640 1 --2- 10.20.193.58:0/764361426 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5f6015d4a0 0x7f5f6013ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:46.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.867+0000 7f5f65bbd640 1 -- 10.20.193.58:0/764361426 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f540094b0 con 0x7f5f6015d870 2026-02-23T06:25:46.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.867+0000 7f5f65bbd640 1 --2- 10.20.193.58:0/764361426 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5f6015d870 0x7f5f6013bf40 secure :-1 s=READY pgs=42 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f5c00e570 tx=0x7f5f5c00ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:46.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.868+0000 7f5f4dffb640 1 -- 10.20.193.58:0/764361426 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5f5c00a930 con 0x7f5f6015d870 2026-02-23T06:25:46.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.868+0000 7f5f4dffb640 1 -- 10.20.193.58:0/764361426 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f5c00ab80 con 0x7f5f6015d870 2026-02-23T06:25:46.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.868+0000 7f5f4dffb640 1 -- 10.20.193.58:0/764361426 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5f5c011460 con 0x7f5f6015d870 2026-02-23T06:25:46.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.868+0000 7f5f663be640 1 -- 10.20.193.58:0/764361426 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f6013a000 con 0x7f5f6015d870 2026-02-23T06:25:46.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.868+0000 7f5f663be640 1 -- 10.20.193.58:0/764361426 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f6013a5c0 con 0x7f5f6015d870 2026-02-23T06:25:46.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.868+0000 7f5f663be640 1 -- 10.20.193.58:0/764361426 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f600b6d50 con 0x7f5f6015d870 2026-02-23T06:25:46.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.870+0000 7f5f4dffb640 1 -- 10.20.193.58:0/764361426 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f5f5c0115c0 con 0x7f5f6015d870 2026-02-23T06:25:46.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.871+0000 7f5f4dffb640 1 --2- 10.20.193.58:0/764361426 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5f3007a790 0x7f5f3009ac40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:46.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.871+0000 7f5f4dffb640 1 -- 10.20.193.58:0/764361426 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f5f5c09ec80 con 0x7f5f6015d870 2026-02-23T06:25:46.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.871+0000 7f5f653bc640 1 --2- 10.20.193.58:0/764361426 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5f3007a790 0x7f5f3009ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:46.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.872+0000 7f5f653bc640 1 --2- 10.20.193.58:0/764361426 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5f3007a790 0x7f5f3009ac40 secure :-1 s=READY pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f500026a0 tx=0x7f5f50009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:46.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:46.872+0000 7f5f4dffb640 1 -- 10.20.193.58:0/764361426 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f5f5c0a5080 con 0x7f5f6015d870 2026-02-23T06:25:47.021 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:47.026+0000 7f5f663be640 1 -- 10.20.193.58:0/764361426 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5f6005b0e0 con 0x7f5f6015d870 2026-02-23T06:25:47.021 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:47.026+0000 7f5f4dffb640 1 -- 10.20.193.58:0/764361426 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1748 (secure 0 0 0) 0x7f5f5c061ea0 con 0x7f5f6015d870 2026-02-23T06:25:47.021 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":34,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:25:47.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:47.027+0000 7f5f663be640 1 -- 10.20.193.58:0/764361426 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5f3007a790 msgr2=0x7f5f3009ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:47.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:47.027+0000 7f5f663be640 1 --2- 10.20.193.58:0/764361426 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5f3007a790 0x7f5f3009ac40 secure :-1 s=READY pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f500026a0 tx=0x7f5f50009040 comp rx=0 tx=0).stop 2026-02-23T06:25:47.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:47.027+0000 7f5f663be640 1 -- 10.20.193.58:0/764361426 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5f6015d870 msgr2=0x7f5f6013bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:47.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:47.027+0000 7f5f663be640 1 --2- 10.20.193.58:0/764361426 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5f6015d870 0x7f5f6013bf40 secure :-1 s=READY pgs=42 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f5c00e570 tx=0x7f5f5c00ea40 comp rx=0 tx=0).stop 2026-02-23T06:25:47.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:47.028+0000 7f5f663be640 1 -- 10.20.193.58:0/764361426 shutdown_connections 2026-02-23T06:25:47.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:47.028+0000 7f5f663be640 1 --2- 10.20.193.58:0/764361426 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5f3007a790 0x7f5f3009ac40 unknown :-1 s=CLOSED pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:47.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:47.028+0000 7f5f663be640 1 --2- 10.20.193.58:0/764361426 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5f6015d870 0x7f5f6013bf40 unknown :-1 s=CLOSED pgs=42 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:47.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:47.028+0000 7f5f663be640 1 --2- 10.20.193.58:0/764361426 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5f6015d4a0 0x7f5f6013ba00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:47.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:47.028+0000 7f5f663be640 1 --2- 10.20.193.58:0/764361426 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5f600b6690 0x7f5f6013e6c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:47.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:47.028+0000 7f5f663be640 1 -- 10.20.193.58:0/764361426 >> 10.20.193.58:0/764361426 conn(0x7f5f600b3c20 msgr2=0x7f5f6015bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:25:47.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:47.028+0000 7f5f663be640 1 -- 10.20.193.58:0/764361426 shutdown_connections 2026-02-23T06:25:47.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:47.028+0000 7f5f663be640 1 -- 10.20.193.58:0/764361426 wait complete. 2026-02-23T06:25:50.035 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:25:50.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.164+0000 7fa45503a640 1 -- 10.20.193.58:0/393733477 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa434003fb0 msgr2=0x7fa434004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.164+0000 7fa45503a640 1 --2- 10.20.193.58:0/393733477 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa434003fb0 0x7fa434004850 secure :-1 s=READY pgs=44 gs=5 cs=0 l=1 c_cookie=16984429472432843669 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa440009b40 tx=0x7fa44002fc80 comp rx=0 tx=0).stop 2026-02-23T06:25:50.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.164+0000 7fa454839640 1 -- 10.20.193.58:0/393733477 reap_dead start 2026-02-23T06:25:50.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.164+0000 7fa45503a640 1 -- 10.20.193.58:0/393733477 shutdown_connections 2026-02-23T06:25:50.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.164+0000 7fa45503a640 1 -- 10.20.193.58:0/393733477 >> 10.20.193.58:0/393733477 conn(0x7fa4500b3c20 msgr2=0x7fa4500b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:25:50.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.164+0000 7fa45503a640 1 -- 10.20.193.58:0/393733477 shutdown_connections 2026-02-23T06:25:50.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.164+0000 7fa45503a640 1 -- 10.20.193.58:0/393733477 wait complete. 2026-02-23T06:25:50.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.165+0000 7fa45503a640 1 Processor -- start 2026-02-23T06:25:50.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.166+0000 7fa45503a640 1 -- start start 2026-02-23T06:25:50.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.166+0000 7fa45503a640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa434003fb0 0x7fa450155940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:50.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.166+0000 7fa45503a640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa45015dad0 0x7fa450160740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:50.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.166+0000 7fa45503a640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa450160c80 0x7fa450201340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:50.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.166+0000 7fa45503a640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa4500b19e0 con 0x7fa434003fb0 2026-02-23T06:25:50.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.166+0000 7fa45503a640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fa4500b13b0 con 0x7fa45015dad0 2026-02-23T06:25:50.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.166+0000 7fa45503a640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa450155e80 con 0x7fa450160c80 2026-02-23T06:25:50.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.166+0000 7fa44ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa434003fb0 0x7fa450155940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:50.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.166+0000 7fa44ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa434003fb0 0x7fa450155940 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:38402/0 (socket says 10.20.193.58:38402) 2026-02-23T06:25:50.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.166+0000 7fa44ffff640 1 -- 10.20.193.58:0/507547159 learned_addr learned my addr 10.20.193.58:0/507547159 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:25:50.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.166+0000 7fa44f7fe640 1 --2- 10.20.193.58:0/507547159 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa45015dad0 0x7fa450160740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:50.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.167+0000 7fa454839640 1 --2- 10.20.193.58:0/507547159 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa450160c80 0x7fa450201340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:50.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.167+0000 7fa44ffff640 1 -- 10.20.193.58:0/507547159 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa450160c80 msgr2=0x7fa450201340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.167+0000 7fa44ffff640 1 --2- 10.20.193.58:0/507547159 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa450160c80 0x7fa450201340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.167+0000 7fa44ffff640 1 -- 10.20.193.58:0/507547159 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa45015dad0 msgr2=0x7fa450160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.167+0000 7fa44ffff640 1 --2- 10.20.193.58:0/507547159 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa45015dad0 0x7fa450160740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.167+0000 7fa44ffff640 1 -- 10.20.193.58:0/507547159 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa45015d2f0 con 0x7fa434003fb0 2026-02-23T06:25:50.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.167+0000 7fa44ffff640 1 --2- 10.20.193.58:0/507547159 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa434003fb0 0x7fa450155940 secure :-1 s=READY pgs=45 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa43c0033f0 tx=0x7fa43c003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:50.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.167+0000 7fa44cff9640 1 -- 10.20.193.58:0/507547159 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa43c00f980 con 0x7fa434003fb0 2026-02-23T06:25:50.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.167+0000 7fa44cff9640 1 -- 10.20.193.58:0/507547159 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa43c00fae0 con 0x7fa434003fb0 2026-02-23T06:25:50.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.167+0000 7fa44cff9640 1 -- 10.20.193.58:0/507547159 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa43c011430 con 0x7fa434003fb0 2026-02-23T06:25:50.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.167+0000 7fa45503a640 1 -- 10.20.193.58:0/507547159 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4501fe740 con 0x7fa434003fb0 2026-02-23T06:25:50.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.167+0000 7fa45503a640 1 -- 10.20.193.58:0/507547159 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4500b1670 con 0x7fa434003fb0 2026-02-23T06:25:50.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.168+0000 7fa45503a640 1 -- 10.20.193.58:0/507547159 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4501febc0 con 0x7fa434003fb0 2026-02-23T06:25:50.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.169+0000 7fa44cff9640 1 -- 10.20.193.58:0/507547159 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fa43c011590 con 0x7fa434003fb0 2026-02-23T06:25:50.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.170+0000 7fa44cff9640 1 --2- 10.20.193.58:0/507547159 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa42007a730 0x7fa42009abe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:50.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.170+0000 7fa44cff9640 1 -- 10.20.193.58:0/507547159 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fa43c09e200 con 0x7fa434003fb0 2026-02-23T06:25:50.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.170+0000 7fa44f7fe640 1 --2- 10.20.193.58:0/507547159 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa42007a730 0x7fa42009abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:50.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.171+0000 7fa44f7fe640 1 --2- 10.20.193.58:0/507547159 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa42007a730 0x7fa42009abe0 secure :-1 s=READY pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4400023d0 tx=0x7fa440004770 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:50.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.171+0000 7fa44cff9640 1 -- 10.20.193.58:0/507547159 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fa43c061440 con 0x7fa434003fb0 2026-02-23T06:25:50.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.326+0000 7fa45503a640 1 -- 10.20.193.58:0/507547159 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa450156100 con 0x7fa434003fb0 2026-02-23T06:25:50.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.327+0000 7fa44cff9640 1 -- 10.20.193.58:0/507547159 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1754 (secure 0 0 0) 0x7fa43c064560 con 0x7fa434003fb0 2026-02-23T06:25:50.322 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":36,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:25:50.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.328+0000 7fa45503a640 1 -- 10.20.193.58:0/507547159 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa42007a730 msgr2=0x7fa42009abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.328+0000 7fa45503a640 1 --2- 10.20.193.58:0/507547159 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa42007a730 0x7fa42009abe0 secure :-1 s=READY pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4400023d0 tx=0x7fa440004770 comp rx=0 tx=0).stop 2026-02-23T06:25:50.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.328+0000 7fa45503a640 1 -- 10.20.193.58:0/507547159 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa434003fb0 msgr2=0x7fa450155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.328+0000 7fa45503a640 1 --2- 10.20.193.58:0/507547159 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa434003fb0 0x7fa450155940 secure :-1 s=READY pgs=45 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa43c0033f0 tx=0x7fa43c003a80 comp rx=0 tx=0).stop 2026-02-23T06:25:50.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.328+0000 7fa45503a640 1 -- 10.20.193.58:0/507547159 shutdown_connections 2026-02-23T06:25:50.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.328+0000 7fa45503a640 1 --2- 10.20.193.58:0/507547159 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa42007a730 0x7fa42009abe0 unknown :-1 s=CLOSED pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.328+0000 7fa45503a640 1 --2- 10.20.193.58:0/507547159 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa450160c80 0x7fa450201340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.328+0000 7fa45503a640 1 --2- 10.20.193.58:0/507547159 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa45015dad0 0x7fa450160740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.328+0000 7fa45503a640 1 --2- 10.20.193.58:0/507547159 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa434003fb0 0x7fa450155940 unknown :-1 s=CLOSED pgs=45 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.328+0000 7fa45503a640 1 -- 10.20.193.58:0/507547159 >> 10.20.193.58:0/507547159 conn(0x7fa4500b3c20 msgr2=0x7fa4500b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:25:50.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.328+0000 7fa45503a640 1 -- 10.20.193.58:0/507547159 shutdown_connections 2026-02-23T06:25:50.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.328+0000 7fa45503a640 1 -- 10.20.193.58:0/507547159 wait complete. 2026-02-23T06:25:50.335 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:25:50.335 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:25:50.336 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:25:50.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.461+0000 7f5beffff640 1 -- 10.20.193.58:0/204533679 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5bdc004210 msgr2=0x7f5bdc004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.461+0000 7f5beffff640 1 --2- 10.20.193.58:0/204533679 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5bdc004210 0x7f5bdc004850 secure :-1 s=READY pgs=47 gs=4 cs=0 l=1 c_cookie=8100430318794526816 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5bf0059aa0 tx=0x7f5bd802f1f0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.461+0000 7f5bef7fe640 1 -- 10.20.193.58:0/204533679 reap_dead start 2026-02-23T06:25:50.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.462+0000 7f5beffff640 1 -- 10.20.193.58:0/204533679 shutdown_connections 2026-02-23T06:25:50.458 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.462+0000 7f5beffff640 1 -- 10.20.193.58:0/204533679 >> 10.20.193.58:0/204533679 conn(0x7f5bf00b3c20 msgr2=0x7f5bf00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:25:50.458 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.462+0000 7f5beffff640 1 -- 10.20.193.58:0/204533679 shutdown_connections 2026-02-23T06:25:50.458 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.462+0000 7f5beffff640 1 -- 10.20.193.58:0/204533679 wait complete. 2026-02-23T06:25:50.461 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.463+0000 7f5beffff640 1 Processor -- start 2026-02-23T06:25:50.461 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.463+0000 7f5beffff640 1 -- start start 2026-02-23T06:25:50.461 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.463+0000 7f5beffff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5bdc004210 0x7f5bf00b13d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:50.461 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.463+0000 7f5beffff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5bf00585d0 0x7f5bf01fe590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:50.461 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.463+0000 7f5beffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5bf0058a40 0x7f5bf01fead0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:50.461 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.463+0000 7f5beffff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf0155430 con 0x7f5bf0058a40 2026-02-23T06:25:50.461 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.463+0000 7f5beffff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf01fe180 con 0x7f5bf00585d0 2026-02-23T06:25:50.461 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.463+0000 7f5beffff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f5bf01530f0 con 0x7f5bdc004210 2026-02-23T06:25:50.462 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.464+0000 7f5bef7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5bf0058a40 0x7f5bf01fead0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:50.462 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.464+0000 7f5bef7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5bf0058a40 0x7f5bf01fead0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:38430/0 (socket says 10.20.193.58:38430) 2026-02-23T06:25:50.462 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.464+0000 7f5bef7fe640 1 -- 10.20.193.58:0/1808301477 learned_addr learned my addr 10.20.193.58:0/1808301477 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:25:50.462 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.464+0000 7f5beeffd640 1 --2- 10.20.193.58:0/1808301477 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5bdc004210 0x7f5bf00b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:50.462 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.464+0000 7f5bee7fc640 1 --2- 10.20.193.58:0/1808301477 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5bf00585d0 0x7f5bf01fe590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:50.462 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.464+0000 7f5bef7fe640 1 -- 10.20.193.58:0/1808301477 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5bdc004210 msgr2=0x7f5bf00b13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.462 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.464+0000 7f5bef7fe640 1 --2- 10.20.193.58:0/1808301477 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5bdc004210 0x7f5bf00b13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.462 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.464+0000 7f5bef7fe640 1 -- 10.20.193.58:0/1808301477 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5bf00585d0 msgr2=0x7f5bf01fe590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.462 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.464+0000 7f5bef7fe640 1 --2- 10.20.193.58:0/1808301477 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5bf00585d0 0x7f5bf01fe590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.462 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.464+0000 7f5bef7fe640 1 -- 10.20.193.58:0/1808301477 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf0153390 con 0x7f5bf0058a40 2026-02-23T06:25:50.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.464+0000 7f5bee7fc640 1 --2- 10.20.193.58:0/1808301477 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5bf00585d0 0x7f5bf01fe590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:25:50.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.464+0000 7f5bef7fe640 1 --2- 10.20.193.58:0/1808301477 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5bf0058a40 0x7f5bf01fead0 secure :-1 s=READY pgs=48 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5be0003aa0 tx=0x7f5be000f660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:50.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.464+0000 7f5bc7fff640 1 -- 10.20.193.58:0/1808301477 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5be000fe10 con 0x7f5bf0058a40 2026-02-23T06:25:50.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.464+0000 7f5bc7fff640 1 -- 10.20.193.58:0/1808301477 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5be0012570 con 0x7f5bf0058a40 2026-02-23T06:25:50.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.464+0000 7f5beffff640 1 -- 10.20.193.58:0/1808301477 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bf0153670 con 0x7f5bf0058a40 2026-02-23T06:25:50.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.464+0000 7f5bc7fff640 1 -- 10.20.193.58:0/1808301477 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5be00129a0 con 0x7f5bf0058a40 2026-02-23T06:25:50.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.464+0000 7f5beffff640 1 -- 10.20.193.58:0/1808301477 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bf015aa80 con 0x7f5bf0058a40 2026-02-23T06:25:50.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.465+0000 7f5beffff640 1 --2- 10.20.193.58:0/1808301477 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5bf0151340 0x7f5bf0151710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:50.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.465+0000 7f5beffff640 1 -- 10.20.193.58:0/1808301477 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf005d9c0 con 0x7f5bf0151340 2026-02-23T06:25:50.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.465+0000 7f5beeffd640 1 --2- 10.20.193.58:0/1808301477 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5bf0151340 0x7f5bf0151710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:50.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.465+0000 7f5beeffd640 1 -- 10.20.193.58:0/1808301477 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5bf015c410 con 0x7f5bf0151340 2026-02-23T06:25:50.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.466+0000 7f5beeffd640 1 --2- 10.20.193.58:0/1808301477 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5bf0151340 0x7f5bf0151710 secure :-1 s=READY pgs=49 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5be4009e80 tx=0x7f5be4002a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:50.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.466+0000 7f5bc7fff640 1 -- 10.20.193.58:0/1808301477 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5be4016070 con 0x7f5bf0151340 2026-02-23T06:25:50.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.466+0000 7f5bc7fff640 1 -- 10.20.193.58:0/1808301477 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f5be4011b80 con 0x7f5bf0151340 2026-02-23T06:25:50.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.466+0000 7f5bc7fff640 1 -- 10.20.193.58:0/1808301477 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5bf0151340 msgr2=0x7f5bf0151710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.466+0000 7f5bc7fff640 1 --2- 10.20.193.58:0/1808301477 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5bf0151340 0x7f5bf0151710 secure :-1 s=READY pgs=49 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5be4009e80 tx=0x7f5be4002a70 comp rx=0 tx=0).stop 2026-02-23T06:25:50.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.466+0000 7f5bc7fff640 1 -- 10.20.193.58:0/1808301477 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5bf0151340 msgr2=0x7f5bf0151710 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:25:50.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.466+0000 7f5bc7fff640 1 --2- 10.20.193.58:0/1808301477 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5bf0151340 0x7f5bf0151710 secure :-1 s=CLOSED pgs=49 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5be4009e80 tx=0x7f5be4002a70 comp rx=0 tx=0).stop 2026-02-23T06:25:50.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.466+0000 7f5bc7fff640 1 -- 10.20.193.58:0/1808301477 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f5be0012b00 con 0x7f5bf0058a40 2026-02-23T06:25:50.466 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.467+0000 7f5bc7fff640 1 --2- 10.20.193.58:0/1808301477 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5bc007a370 0x7f5bc009a820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:50.466 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.467+0000 7f5bc7fff640 1 -- 10.20.193.58:0/1808301477 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f5be009e290 con 0x7f5bf0058a40 2026-02-23T06:25:50.466 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.467+0000 7f5beeffd640 1 --2- 10.20.193.58:0/1808301477 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5bc007a370 0x7f5bc009a820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:50.466 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.468+0000 7f5beeffd640 1 --2- 10.20.193.58:0/1808301477 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5bc007a370 0x7f5bc009a820 secure :-1 s=READY pgs=178 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5be40023d0 tx=0x7f5be4012000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:50.466 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.469+0000 7f5beffff640 1 --2- 10.20.193.58:0/1808301477 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5bf02016f0 0x7f5bf0201ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:50.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.469+0000 7f5beffff640 1 -- 10.20.193.58:0/1808301477 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf01fe2d0 con 0x7f5bf02016f0 2026-02-23T06:25:50.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.469+0000 7f5bee7fc640 1 --2- 10.20.193.58:0/1808301477 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5bf02016f0 0x7f5bf0201ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:50.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.470+0000 7f5bee7fc640 1 -- 10.20.193.58:0/1808301477 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5bf005ce30 con 0x7f5bf02016f0 2026-02-23T06:25:50.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.470+0000 7f5bee7fc640 1 --2- 10.20.193.58:0/1808301477 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5bf02016f0 0x7f5bf0201ac0 secure :-1 s=READY pgs=50 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5bd80028e0 tx=0x7f5bd802fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:50.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.470+0000 7f5bc7fff640 1 -- 10.20.193.58:0/1808301477 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5bd8006540 con 0x7f5bf02016f0 2026-02-23T06:25:50.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.470+0000 7f5bc7fff640 1 -- 10.20.193.58:0/1808301477 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5246 (secure 0 0 0) 0x7f5bd80036b0 con 0x7f5bf02016f0 2026-02-23T06:25:50.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.470+0000 7f5bc7fff640 1 -- 10.20.193.58:0/1808301477 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5bf02016f0 msgr2=0x7f5bf0201ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.470+0000 7f5bc7fff640 1 --2- 10.20.193.58:0/1808301477 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5bf02016f0 0x7f5bf0201ac0 secure :-1 s=READY pgs=50 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5bd80028e0 tx=0x7f5bd802fc80 comp rx=0 tx=0).stop 2026-02-23T06:25:50.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.470+0000 7f5bc7fff640 1 -- 10.20.193.58:0/1808301477 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5bf02016f0 msgr2=0x7f5bf0201ac0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:25:50.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.470+0000 7f5bc7fff640 1 --2- 10.20.193.58:0/1808301477 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5bf02016f0 0x7f5bf0201ac0 secure :-1 s=CLOSED pgs=50 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5bd80028e0 tx=0x7f5bd802fc80 comp rx=0 tx=0).stop 2026-02-23T06:25:50.468 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:25:50.468 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:25:50.468 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:25:50.468 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:25:50.468 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 36, 2026-02-23T06:25:50.468 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 77303, 2026-02-23T06:25:50.469 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:25:50.469 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:25:50.469 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:25:50.469 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:25:50.469 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:50.469 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:25:50.469 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:25:50.469 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:25:50.469 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:25:50.469 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:25:50.470 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:25:50.470 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:25:50.470 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:25:50.470 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:25:50.470 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:25:50.470 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:25:50.470 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:25:50.470 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:25:50.470 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:25:50.470 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:25:50.470 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:25:50.471 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:25:50.471 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:50.471 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:25:50.471 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:25:50.471 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:25:50.471 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:25:50.471 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:25:50.471 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:25:50.471 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:25:50.471 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:25:50.471 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:25:50.472 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:25:50.472 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:25:50.472 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:25:50.472 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:25:50.472 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:25:50.472 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:25:50.472 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:50.472 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.472 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:25:50.472 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:25:50.472 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:25:50.473 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:25:50.473 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:25:50.473 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:25:50.473 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:25:50.473 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:25:50.473 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:25:50.473 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:25:50.473 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:25:50.473 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:25:50.473 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:25:50.473 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:25:50.474 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:25:50.474 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:25:50.474 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:25:50.474 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:25:50.474 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:25:50.474 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:25:50.474 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:25:50.474 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:25:50.474 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:25:50.474 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:25:50.474 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:25:50.475 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:25:50.475 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:25:50.475 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:25:50.475 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:25:50.475 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:25:50.475 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:50.475 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:25:50.475 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.475 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:25:50.475 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.475 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:25:50.476 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:25:50.476 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:25:50.476 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:25:50.476 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.476 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:25:50.476 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:25:50.476 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:50.476 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.476 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.476 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:25:50.476 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:25:50.477 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:50.477 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:50.477 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:50.477 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.477 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:25:50.477 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:25:50.477 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:25:50.477 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:25:50.477 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:25:50.477 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:25:50.477 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.478 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.478 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:25:50.478 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:25:50.478 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:25:50.478 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:25:50.478 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.478 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:25:50.478 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:25:50.478 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:50.478 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.478 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.478 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:25:50.479 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:25:50.479 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:50.479 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:50.479 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:50.479 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.479 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:25:50.479 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:25:50.479 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:25:50.479 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:25:50.479 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:25:50.479 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:25:50.480 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.480 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.480 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:25:50.480 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:25:50.480 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:25:50.480 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:25:50.480 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.480 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:25:50.480 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:25:50.480 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:50.480 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.480 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.481 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:25:50.481 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:25:50.481 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:50.481 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:50.481 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:50.481 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.481 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:25:50.481 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:25:50.481 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:25:50.481 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:25:50.481 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:25:50.482 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:25:50.482 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:50.482 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:50.482 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.482 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:25:50.482 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:25:50.482 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.482 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:25:50.482 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:25:50.482 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:25:50.482 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:50.483 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:50.483 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:25:50.483 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.483 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:25:50.483 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:25:50.483 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:25:50.483 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:50.483 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:50.483 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:25:50.483 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.483 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:25:50.483 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:25:50.484 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:25:50.484 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:50.484 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:50.484 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:25:50.484 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.484 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:25:50.484 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:25:50.484 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:25:50.484 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:50.484 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:50.484 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.484 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:25:50.485 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:25:50.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.470+0000 7f5beffff640 1 -- 10.20.193.58:0/1808301477 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5bc007a370 msgr2=0x7f5bc009a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.470+0000 7f5beffff640 1 --2- 10.20.193.58:0/1808301477 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5bc007a370 0x7f5bc009a820 secure :-1 s=READY pgs=178 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5be40023d0 tx=0x7f5be4012000 comp rx=0 tx=0).stop 2026-02-23T06:25:50.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.470+0000 7f5beffff640 1 -- 10.20.193.58:0/1808301477 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5bf0058a40 msgr2=0x7f5bf01fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.470+0000 7f5beffff640 1 --2- 10.20.193.58:0/1808301477 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5bf0058a40 0x7f5bf01fead0 secure :-1 s=READY pgs=48 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5be0003aa0 tx=0x7f5be000f660 comp rx=0 tx=0).stop 2026-02-23T06:25:50.487 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.470+0000 7f5bef7fe640 1 -- 10.20.193.58:0/1808301477 reap_dead start 2026-02-23T06:25:50.487 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.470+0000 7f5bef7fe640 1 -- 10.20.193.58:0/1808301477 reap_dead start 2026-02-23T06:25:50.487 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.471+0000 7f5beffff640 1 -- 10.20.193.58:0/1808301477 shutdown_connections 2026-02-23T06:25:50.487 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.471+0000 7f5beffff640 1 -- 10.20.193.58:0/1808301477 >> 10.20.193.58:0/1808301477 conn(0x7f5bf00b3c20 msgr2=0x7f5bf00b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:25:50.487 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.471+0000 7f5beffff640 1 -- 10.20.193.58:0/1808301477 shutdown_connections 2026-02-23T06:25:50.487 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.471+0000 7f5beffff640 1 -- 10.20.193.58:0/1808301477 wait complete. 2026-02-23T06:25:50.487 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:25:50.488 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:25:50.488 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:25:50.613 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.618+0000 7feee885a640 1 -- 10.20.193.58:0/1591969966 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feee40b6690 msgr2=0x7feee4058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.618+0000 7feee885a640 1 --2- 10.20.193.58:0/1591969966 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feee40b6690 0x7feee4058cf0 secure :-1 s=READY pgs=310 gs=2 cs=0 l=1 c_cookie=9736350482360504779 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feed4005820 tx=0x7feed40302b0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.618+0000 7feee885a640 1 -- 10.20.193.58:0/1591969966 shutdown_connections 2026-02-23T06:25:50.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.618+0000 7feee885a640 1 --2- 10.20.193.58:0/1591969966 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feee40b6690 0x7feee4058cf0 unknown :-1 s=CLOSED pgs=310 gs=2 cs=0 l=1 c_cookie=9736350482360504779 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.618+0000 7feee885a640 1 --2- 10.20.193.58:0/1591969966 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feee415d870 0x7feee40587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.618+0000 7feee885a640 1 -- 10.20.193.58:0/1591969966 >> 10.20.193.58:0/1591969966 conn(0x7feee40b3c20 msgr2=0x7feee40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:25:50.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.618+0000 7feee885a640 1 -- 10.20.193.58:0/1591969966 shutdown_connections 2026-02-23T06:25:50.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.618+0000 7feee885a640 1 -- 10.20.193.58:0/1591969966 wait complete. 2026-02-23T06:25:50.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.619+0000 7feee885a640 1 Processor -- start 2026-02-23T06:25:50.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.619+0000 7feee885a640 1 -- start start 2026-02-23T06:25:50.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.620+0000 7feee885a640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feee40b6690 0x7feee413d2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:50.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.620+0000 7feee885a640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feee415d4a0 0x7feee413b150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:50.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.620+0000 7feee885a640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feee415d870 0x7feee415a280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:50.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.620+0000 7feee885a640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7feee4057770 con 0x7feee40b6690 2026-02-23T06:25:50.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.620+0000 7feee885a640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7feee41402d0 con 0x7feee415d870 2026-02-23T06:25:50.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.620+0000 7feee885a640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7feee413a990 con 0x7feee415d4a0 2026-02-23T06:25:50.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.620+0000 7feee3577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feee415d870 0x7feee415a280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:50.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.620+0000 7feee3577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feee415d870 0x7feee415a280 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:42876/0 (socket says 10.20.193.58:42876) 2026-02-23T06:25:50.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.620+0000 7feee3577640 1 -- 10.20.193.58:0/2756935626 learned_addr learned my addr 10.20.193.58:0/2756935626 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:25:50.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.620+0000 7feee2d76640 1 --2- 10.20.193.58:0/2756935626 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feee40b6690 0x7feee413d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:50.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.620+0000 7feee2575640 1 --2- 10.20.193.58:0/2756935626 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feee415d4a0 0x7feee413b150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:50.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.620+0000 7feee3577640 1 -- 10.20.193.58:0/2756935626 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feee415d4a0 msgr2=0x7feee413b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.620+0000 7feee3577640 1 --2- 10.20.193.58:0/2756935626 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feee415d4a0 0x7feee413b150 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.620+0000 7feee3577640 1 -- 10.20.193.58:0/2756935626 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feee40b6690 msgr2=0x7feee413d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.620+0000 7feee3577640 1 --2- 10.20.193.58:0/2756935626 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feee40b6690 0x7feee413d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.620+0000 7feee3577640 1 -- 10.20.193.58:0/2756935626 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feed400a590 con 0x7feee415d870 2026-02-23T06:25:50.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.620+0000 7feee2d76640 1 --2- 10.20.193.58:0/2756935626 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feee40b6690 0x7feee413d2f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:25:50.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.621+0000 7feee3577640 1 --2- 10.20.193.58:0/2756935626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feee415d870 0x7feee415a280 secure :-1 s=READY pgs=311 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feed40057b0 tx=0x7feed4003d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:50.620 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.621+0000 7feec37fe640 1 -- 10.20.193.58:0/2756935626 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feed403e070 con 0x7feee415d870 2026-02-23T06:25:50.620 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.621+0000 7feec37fe640 1 -- 10.20.193.58:0/2756935626 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feed40398a0 con 0x7feee415d870 2026-02-23T06:25:50.620 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.621+0000 7feec37fe640 1 -- 10.20.193.58:0/2756935626 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feed4039cb0 con 0x7feee415d870 2026-02-23T06:25:50.620 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.621+0000 7feee885a640 1 -- 10.20.193.58:0/2756935626 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee413ed70 con 0x7feee415d870 2026-02-23T06:25:50.620 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.621+0000 7feee885a640 1 -- 10.20.193.58:0/2756935626 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee413ac30 con 0x7feee415d870 2026-02-23T06:25:50.620 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.622+0000 7feee885a640 1 --2- 10.20.193.58:0/2756935626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feee413b690 0x7feee415a7c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:50.620 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.622+0000 7feee885a640 1 -- 10.20.193.58:0/2756935626 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7feee413fd30 con 0x7feee413b690 2026-02-23T06:25:50.620 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.622+0000 7feee2d76640 1 --2- 10.20.193.58:0/2756935626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feee413b690 0x7feee415a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:50.620 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.622+0000 7feee2d76640 1 -- 10.20.193.58:0/2756935626 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feee40b6330 con 0x7feee413b690 2026-02-23T06:25:50.620 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.622+0000 7feee2d76640 1 --2- 10.20.193.58:0/2756935626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feee413b690 0x7feee415a7c0 secure :-1 s=READY pgs=312 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feed800e700 tx=0x7feed800ebd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:50.620 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.622+0000 7feec37fe640 1 -- 10.20.193.58:0/2756935626 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feed8019070 con 0x7feee413b690 2026-02-23T06:25:50.621 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.623+0000 7feec37fe640 1 -- 10.20.193.58:0/2756935626 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7feed404c440 con 0x7feee415d870 2026-02-23T06:25:50.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.623+0000 7feec37fe640 1 --2- 10.20.193.58:0/2756935626 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7feeb007a6b0 0x7feeb009ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:50.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.623+0000 7feec37fe640 1 -- 10.20.193.58:0/2756935626 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7feed40c3a60 con 0x7feee415d870 2026-02-23T06:25:50.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.624+0000 7feec37fe640 1 -- 10.20.193.58:0/2756935626 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7feed8005240 con 0x7feee413b690 2026-02-23T06:25:50.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.624+0000 7feec37fe640 1 -- 10.20.193.58:0/2756935626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feee413b690 msgr2=0x7feee415a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.624+0000 7feec37fe640 1 --2- 10.20.193.58:0/2756935626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feee413b690 0x7feee415a7c0 secure :-1 s=READY pgs=312 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feed800e700 tx=0x7feed800ebd0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.624+0000 7feec37fe640 1 -- 10.20.193.58:0/2756935626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feee413b690 msgr2=0x7feee415a7c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:25:50.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.624+0000 7feec37fe640 1 --2- 10.20.193.58:0/2756935626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feee413b690 0x7feee415a7c0 secure :-1 s=CLOSED pgs=312 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feed800e700 tx=0x7feed800ebd0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.627+0000 7feee2575640 1 --2- 10.20.193.58:0/2756935626 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7feeb007a6b0 0x7feeb009ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:50.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.627+0000 7feee2575640 1 --2- 10.20.193.58:0/2756935626 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7feeb007a6b0 0x7feeb009ab60 secure :-1 s=READY pgs=179 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feee413a7c0 tx=0x7feecc005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:50.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.627+0000 7feee885a640 1 --2- 10.20.193.58:0/2756935626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feee413e560 0x7feee4160f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:50.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.627+0000 7feee885a640 1 -- 10.20.193.58:0/2756935626 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7feee4164250 con 0x7feee413e560 2026-02-23T06:25:50.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.628+0000 7feee2d76640 1 --2- 10.20.193.58:0/2756935626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feee413e560 0x7feee4160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:50.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.628+0000 7feee2d76640 1 -- 10.20.193.58:0/2756935626 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7feee40b6d50 con 0x7feee413e560 2026-02-23T06:25:50.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.628+0000 7feee2d76640 1 --2- 10.20.193.58:0/2756935626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feee413e560 0x7feee4160f70 secure :-1 s=READY pgs=313 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feed80023d0 tx=0x7feed80046e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:50.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.628+0000 7feec37fe640 1 -- 10.20.193.58:0/2756935626 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feed801e890 con 0x7feee413e560 2026-02-23T06:25:50.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.628+0000 7feec37fe640 1 -- 10.20.193.58:0/2756935626 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5555 (secure 0 0 0) 0x7feed800c640 con 0x7feee413e560 2026-02-23T06:25:50.625 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:25:50.625 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:25:50.625 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:25:50.625 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:25:50.625 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 36, 2026-02-23T06:25:50.626 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 288675, 2026-02-23T06:25:50.626 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:25:50.626 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:25:50.626 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:25:50.626 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:25:50.626 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:50.626 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 1, 2026-02-23T06:25:50.626 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:25:50.626 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:25:50.626 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:25:50.626 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:25:50.627 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:25:50.627 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:25:50.627 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:25:50.627 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:25:50.627 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:25:50.627 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:25:50.627 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:25:50.627 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:25:50.627 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:25:50.627 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:25:50.627 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:25:50.628 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:25:50.628 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:50.628 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:25:50.628 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:25:50.628 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:25:50.628 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:25:50.628 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:25:50.628 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:25:50.628 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:25:50.628 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:25:50.628 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:25:50.629 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:25:50.629 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:25:50.629 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:25:50.629 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:25:50.629 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:25:50.629 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:25:50.629 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:50.629 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.629 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:25:50.629 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:25:50.629 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:25:50.630 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:25:50.630 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:25:50.630 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:25:50.630 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:25:50.630 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:25:50.630 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:25:50.630 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:25:50.630 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:25:50.630 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:25:50.630 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:25:50.630 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:25:50.631 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:25:50.631 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:25:50.631 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:25:50.631 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:25:50.631 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:25:50.631 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:25:50.631 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:25:50.631 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:25:50.631 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:25:50.631 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:25:50.631 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:25:50.631 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:25:50.632 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:25:50.632 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:25:50.632 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:25:50.632 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:25:50.632 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:50.632 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:25:50.632 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.632 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:25:50.632 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.632 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:25:50.632 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:25:50.633 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:25:50.633 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:25:50.633 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.633 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:25:50.633 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:25:50.633 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:50.633 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.633 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.633 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:25:50.633 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:25:50.633 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:50.633 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:50.634 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:50.634 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.634 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:25:50.634 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:25:50.634 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:25:50.634 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:25:50.634 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:25:50.634 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:25:50.634 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.634 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.635 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:25:50.635 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:25:50.635 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:25:50.635 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:25:50.635 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.635 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:25:50.635 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:25:50.635 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:50.635 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.635 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.635 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:25:50.635 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:25:50.635 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:50.636 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:50.636 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:50.636 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.636 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:25:50.636 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:25:50.636 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:25:50.636 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:25:50.636 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:25:50.636 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:25:50.636 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.636 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.636 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:25:50.637 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:25:50.637 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:25:50.637 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:25:50.637 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.637 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:25:50.637 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:25:50.637 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:50.637 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.637 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.637 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:25:50.637 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:25:50.638 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:50.638 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:50.638 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:50.638 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.638 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:25:50.638 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:25:50.638 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:25:50.638 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:25:50.638 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:25:50.638 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:25:50.638 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:50.639 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:50.639 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.639 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:25:50.639 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:25:50.639 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.639 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:25:50.639 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:25:50.639 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:25:50.639 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:50.639 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:50.639 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:25:50.639 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.640 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:25:50.640 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:25:50.640 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:25:50.640 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:50.640 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:50.640 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:25:50.640 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.640 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:25:50.640 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:25:50.640 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:25:50.640 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:50.641 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:50.641 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:25:50.641 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.641 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:25:50.641 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:25:50.641 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:25:50.641 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.641 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.641 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:25:50.641 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:25:50.641 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:25:50.642 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:50.642 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:50.642 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:25:50.642 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.642 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:25:50.642 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:25:50.642 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:25:50.642 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:50.642 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:50.642 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.642 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:25:50.643 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:25:50.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.628+0000 7feec37fe640 1 -- 10.20.193.58:0/2756935626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feee413e560 msgr2=0x7feee4160f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.628+0000 7feec37fe640 1 --2- 10.20.193.58:0/2756935626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feee413e560 0x7feee4160f70 secure :-1 s=READY pgs=313 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feed80023d0 tx=0x7feed80046e0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.628+0000 7feec37fe640 1 -- 10.20.193.58:0/2756935626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feee413e560 msgr2=0x7feee4160f70 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:25:50.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.628+0000 7feec37fe640 1 --2- 10.20.193.58:0/2756935626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feee413e560 0x7feee4160f70 secure :-1 s=CLOSED pgs=313 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feed80023d0 tx=0x7feed80046e0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.629+0000 7feee885a640 1 -- 10.20.193.58:0/2756935626 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7feeb007a6b0 msgr2=0x7feeb009ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.629+0000 7feee885a640 1 --2- 10.20.193.58:0/2756935626 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7feeb007a6b0 0x7feeb009ab60 secure :-1 s=READY pgs=179 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feee413a7c0 tx=0x7feecc005f90 comp rx=0 tx=0).stop 2026-02-23T06:25:50.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.629+0000 7feee885a640 1 -- 10.20.193.58:0/2756935626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feee415d870 msgr2=0x7feee415a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.629+0000 7feee885a640 1 --2- 10.20.193.58:0/2756935626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feee415d870 0x7feee415a280 secure :-1 s=READY pgs=311 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feed40057b0 tx=0x7feed4003d20 comp rx=0 tx=0).stop 2026-02-23T06:25:50.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.629+0000 7feee3577640 1 -- 10.20.193.58:0/2756935626 reap_dead start 2026-02-23T06:25:50.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.629+0000 7feee3577640 1 -- 10.20.193.58:0/2756935626 reap_dead start 2026-02-23T06:25:50.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.629+0000 7feee885a640 1 -- 10.20.193.58:0/2756935626 shutdown_connections 2026-02-23T06:25:50.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.629+0000 7feee885a640 1 -- 10.20.193.58:0/2756935626 >> 10.20.193.58:0/2756935626 conn(0x7feee40b3c20 msgr2=0x7feee415be00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:25:50.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.629+0000 7feee885a640 1 -- 10.20.193.58:0/2756935626 shutdown_connections 2026-02-23T06:25:50.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.629+0000 7feee885a640 1 -- 10.20.193.58:0/2756935626 wait complete. 2026-02-23T06:25:50.646 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:25:50.646 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:25:50.646 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:25:50.769 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.774+0000 7f635ca5a640 1 -- 10.20.193.58:0/1296818982 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f635815c4b0 msgr2=0x7f6358058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.770 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.774+0000 7f635ca5a640 1 --2- 10.20.193.58:0/1296818982 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f635815c4b0 0x7f6358058200 secure :-1 s=READY pgs=52 gs=1 cs=0 l=1 c_cookie=2486408952260141822 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6358062070 tx=0x7f634c02f1f0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.770 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.774+0000 7f635ca5a640 1 -- 10.20.193.58:0/1296818982 shutdown_connections 2026-02-23T06:25:50.770 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.774+0000 7f635ca5a640 1 --2- 10.20.193.58:0/1296818982 >> v2:10.20.193.93:3300/0 conn(0x7f6358162ca0 0x7f63580b6c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.770 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.774+0000 7f635ca5a640 1 --2- 10.20.193.58:0/1296818982 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6358056960 0x7f63580b6720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.770 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.774+0000 7f635ca5a640 1 --2- 10.20.193.58:0/1296818982 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f635815c4b0 0x7f6358058200 unknown :-1 s=CLOSED pgs=52 gs=1 cs=0 l=1 c_cookie=2486408952260141822 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.770 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.774+0000 7f635ca5a640 1 -- 10.20.193.58:0/1296818982 >> 10.20.193.58:0/1296818982 conn(0x7f63580b3c20 msgr2=0x7f63580b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:25:50.770 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.774+0000 7f635ca5a640 1 -- 10.20.193.58:0/1296818982 shutdown_connections 2026-02-23T06:25:50.770 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.774+0000 7f635ca5a640 1 -- 10.20.193.58:0/1296818982 wait complete. 2026-02-23T06:25:50.773 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.775+0000 7f635ca5a640 1 Processor -- start 2026-02-23T06:25:50.773 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.775+0000 7f635ca5a640 1 -- start start 2026-02-23T06:25:50.773 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.776+0000 7f635ca5a640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6358056960 0x7f63581217f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:50.773 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.776+0000 7f635ca5a640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f635815c4b0 0x7f63580b0470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:50.773 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.776+0000 7f635ca5a640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6358162ca0 0x7f635811fed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:50.774 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.776+0000 7f635ca5a640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f63580af3b0 con 0x7f6358056960 2026-02-23T06:25:50.774 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.776+0000 7f635ca5a640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f63580b1070 con 0x7f6358162ca0 2026-02-23T06:25:50.774 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.776+0000 7f635ca5a640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f6358120860 con 0x7f635815c4b0 2026-02-23T06:25:50.774 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.776+0000 7f6356d76640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6358056960 0x7f63581217f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:50.774 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.776+0000 7f6356d76640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6358056960 0x7f63581217f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:38474/0 (socket says 10.20.193.58:38474) 2026-02-23T06:25:50.774 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.776+0000 7f6356d76640 1 -- 10.20.193.58:0/2553600871 learned_addr learned my addr 10.20.193.58:0/2553600871 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:25:50.774 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.776+0000 7f6356575640 1 --2- 10.20.193.58:0/2553600871 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f635815c4b0 0x7f63580b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:50.774 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.776+0000 7f6357577640 1 --2- 10.20.193.58:0/2553600871 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6358162ca0 0x7f635811fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:50.774 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.776+0000 7f6356d76640 1 -- 10.20.193.58:0/2553600871 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f635815c4b0 msgr2=0x7f63580b0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.774 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.776+0000 7f6356d76640 1 --2- 10.20.193.58:0/2553600871 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f635815c4b0 0x7f63580b0470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.774 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.776+0000 7f6356d76640 1 -- 10.20.193.58:0/2553600871 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6358162ca0 msgr2=0x7f635811fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.776+0000 7f6356d76640 1 --2- 10.20.193.58:0/2553600871 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6358162ca0 0x7f635811fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.776+0000 7f6356d76640 1 -- 10.20.193.58:0/2553600871 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f634c009570 con 0x7f6358056960 2026-02-23T06:25:50.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.776+0000 7f6356d76640 1 --2- 10.20.193.58:0/2553600871 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6358056960 0x7f63581217f0 secure :-1 s=READY pgs=53 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f634c004740 tx=0x7f634c0028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:50.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.777+0000 7f63377fe640 1 -- 10.20.193.58:0/2553600871 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f634c03d070 con 0x7f6358056960 2026-02-23T06:25:50.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.777+0000 7f63377fe640 1 -- 10.20.193.58:0/2553600871 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f634c038470 con 0x7f6358056960 2026-02-23T06:25:50.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.777+0000 7f63377fe640 1 -- 10.20.193.58:0/2553600871 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f634c0388a0 con 0x7f6358056960 2026-02-23T06:25:50.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.777+0000 7f635ca5a640 1 -- 10.20.193.58:0/2553600871 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6358149fe0 con 0x7f6358056960 2026-02-23T06:25:50.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.777+0000 7f635ca5a640 1 -- 10.20.193.58:0/2553600871 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f635814a5a0 con 0x7f6358056960 2026-02-23T06:25:50.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.777+0000 7f635ca5a640 1 --2- 10.20.193.58:0/2553600871 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f635814a7b0 0x7f6358123bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:50.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.777+0000 7f635ca5a640 1 -- 10.20.193.58:0/2553600871 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f6358059690 con 0x7f635814a7b0 2026-02-23T06:25:50.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.778+0000 7f6356575640 1 --2- 10.20.193.58:0/2553600871 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f635814a7b0 0x7f6358123bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:50.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.778+0000 7f6356575640 1 -- 10.20.193.58:0/2553600871 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63580593b0 con 0x7f635814a7b0 2026-02-23T06:25:50.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.778+0000 7f6356575640 1 --2- 10.20.193.58:0/2553600871 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f635814a7b0 0x7f6358123bf0 secure :-1 s=READY pgs=7 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6358159d30 tx=0x7f63400099f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:50.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.778+0000 7f63377fe640 1 -- 10.20.193.58:0/2553600871 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f634c038a00 con 0x7f6358056960 2026-02-23T06:25:50.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.779+0000 7f63377fe640 1 --2- 10.20.193.58:0/2553600871 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f632407a600 0x7f632409aab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:50.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.779+0000 7f63377fe640 1 -- 10.20.193.58:0/2553600871 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f634c0c2310 con 0x7f6358056960 2026-02-23T06:25:50.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.780+0000 7f63377fe640 1 -- 10.20.193.58:0/2553600871 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f63400109f0 con 0x7f635814a7b0 2026-02-23T06:25:50.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.780+0000 7f63377fe640 1 -- 10.20.193.58:0/2553600871 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f6340010b50 con 0x7f635814a7b0 2026-02-23T06:25:50.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.780+0000 7f6357577640 1 --2- 10.20.193.58:0/2553600871 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f632407a600 0x7f632409aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:50.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.780+0000 7f63377fe640 1 -- 10.20.193.58:0/2553600871 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f635814a7b0 msgr2=0x7f6358123bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.780+0000 7f63377fe640 1 --2- 10.20.193.58:0/2553600871 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f635814a7b0 0x7f6358123bf0 secure :-1 s=READY pgs=7 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6358159d30 tx=0x7f63400099f0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.780+0000 7f63377fe640 1 -- 10.20.193.58:0/2553600871 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f635814a7b0 msgr2=0x7f6358123bf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:25:50.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.780+0000 7f63377fe640 1 --2- 10.20.193.58:0/2553600871 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f635814a7b0 0x7f6358123bf0 secure :-1 s=CLOSED pgs=7 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6358159d30 tx=0x7f63400099f0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.780+0000 7f6357577640 1 --2- 10.20.193.58:0/2553600871 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f632407a600 0x7f632409aab0 secure :-1 s=READY pgs=180 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6348005820 tx=0x7f634800a310 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:50.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.783+0000 7f635ca5a640 1 --2- 10.20.193.58:0/2553600871 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6358124130 0x7f635814d280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:50.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.783+0000 7f635ca5a640 1 -- 10.20.193.58:0/2553600871 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f635814ab80 con 0x7f6358124130 2026-02-23T06:25:50.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.784+0000 7f6356575640 1 --2- 10.20.193.58:0/2553600871 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6358124130 0x7f635814d280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:50.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.784+0000 7f6356575640 1 -- 10.20.193.58:0/2553600871 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f63580b71c0 con 0x7f6358124130 2026-02-23T06:25:50.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.784+0000 7f6356575640 1 --2- 10.20.193.58:0/2553600871 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6358124130 0x7f635814d280 secure :-1 s=READY pgs=8 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6358159d30 tx=0x7f6340004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:50.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.784+0000 7f63377fe640 1 -- 10.20.193.58:0/2553600871 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6340010e50 con 0x7f6358124130 2026-02-23T06:25:50.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.784+0000 7f63377fe640 1 -- 10.20.193.58:0/2553600871 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4910 (secure 0 0 0) 0x7f6340004fa0 con 0x7f6358124130 2026-02-23T06:25:50.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.784+0000 7f63377fe640 1 -- 10.20.193.58:0/2553600871 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6358124130 msgr2=0x7f635814d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.784+0000 7f63377fe640 1 --2- 10.20.193.58:0/2553600871 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6358124130 0x7f635814d280 secure :-1 s=READY pgs=8 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6358159d30 tx=0x7f6340004770 comp rx=0 tx=0).stop 2026-02-23T06:25:50.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.784+0000 7f63377fe640 1 -- 10.20.193.58:0/2553600871 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6358124130 msgr2=0x7f635814d280 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:25:50.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.784+0000 7f63377fe640 1 --2- 10.20.193.58:0/2553600871 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6358124130 0x7f635814d280 unknown :-1 s=CLOSED pgs=8 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.782 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:25:50.782 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:25:50.782 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:25:50.783 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:25:50.783 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 36, 2026-02-23T06:25:50.783 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 25296, 2026-02-23T06:25:50.783 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:25:50.783 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:25:50.783 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:25:50.784 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:25:50.784 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:50.784 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 1, 2026-02-23T06:25:50.784 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:25:50.784 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:25:50.784 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:25:50.785 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:25:50.785 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:25:50.785 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:25:50.785 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:25:50.785 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:25:50.785 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:25:50.785 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:25:50.785 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:25:50.785 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:25:50.786 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:25:50.786 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:25:50.786 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:25:50.786 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:25:50.786 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:50.786 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:25:50.786 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:25:50.786 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:25:50.786 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:25:50.786 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:25:50.786 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:25:50.786 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:25:50.787 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:25:50.787 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:25:50.787 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:25:50.787 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:25:50.787 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:25:50.787 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:25:50.787 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:25:50.787 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:25:50.787 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:50.787 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.787 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:25:50.788 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:25:50.788 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:25:50.788 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:25:50.788 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:25:50.788 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:25:50.788 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:25:50.789 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:25:50.789 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:25:50.789 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:25:50.789 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:25:50.789 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:25:50.789 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:25:50.789 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:25:50.790 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:25:50.790 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:25:50.790 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:25:50.790 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:25:50.790 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:25:50.790 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:25:50.790 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:25:50.790 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:25:50.790 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:25:50.790 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:25:50.790 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:25:50.790 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:25:50.791 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:25:50.791 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:25:50.791 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:25:50.791 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:25:50.791 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:50.791 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:25:50.791 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.791 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:25:50.791 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.791 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:25:50.791 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:25:50.792 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:25:50.792 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:25:50.792 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.792 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:25:50.792 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:25:50.792 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:50.792 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.792 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.792 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:25:50.792 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:25:50.792 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:50.792 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:50.793 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:50.793 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.793 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:25:50.793 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:25:50.793 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:25:50.793 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:25:50.793 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:25:50.793 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:25:50.793 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.793 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.793 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:25:50.793 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:25:50.793 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:25:50.794 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:25:50.794 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.794 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:25:50.794 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:25:50.794 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:50.794 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.794 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.794 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:25:50.794 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:25:50.794 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:50.794 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:50.794 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:50.795 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.795 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:25:50.795 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:25:50.795 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:25:50.795 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:25:50.795 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:25:50.795 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:25:50.795 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.795 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.795 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:25:50.795 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:25:50.795 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:25:50.795 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:25:50.796 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.796 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:25:50.796 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:25:50.796 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:50.796 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.796 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.796 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:25:50.796 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:25:50.796 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:25:50.796 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:50.796 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:50.796 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.797 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:25:50.797 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:25:50.797 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:25:50.797 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:25:50.797 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:25:50.797 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:25:50.797 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:50.797 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:50.797 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.797 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:25:50.797 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:25:50.797 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.797 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:25:50.798 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:25:50.798 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:25:50.798 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:50.798 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:25:50.798 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:25:50.798 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:25:50.798 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:25:50.798 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:25:50.798 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:25:50.798 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:25:50.798 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:25:50.798 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:25:50.798 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:25:50.799 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:25:50.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.785+0000 7f635ca5a640 1 -- 10.20.193.58:0/2553600871 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f632407a600 msgr2=0x7f632409aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.785+0000 7f635ca5a640 1 --2- 10.20.193.58:0/2553600871 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f632407a600 0x7f632409aab0 secure :-1 s=READY pgs=180 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6348005820 tx=0x7f634800a310 comp rx=0 tx=0).stop 2026-02-23T06:25:50.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.785+0000 7f635ca5a640 1 -- 10.20.193.58:0/2553600871 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6358056960 msgr2=0x7f63581217f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.785+0000 7f635ca5a640 1 --2- 10.20.193.58:0/2553600871 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6358056960 0x7f63581217f0 secure :-1 s=READY pgs=53 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f634c004740 tx=0x7f634c0028d0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.785+0000 7f6357577640 1 -- 10.20.193.58:0/2553600871 reap_dead start 2026-02-23T06:25:50.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.785+0000 7f6357577640 1 -- 10.20.193.58:0/2553600871 reap_dead start 2026-02-23T06:25:50.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.785+0000 7f635ca5a640 1 -- 10.20.193.58:0/2553600871 shutdown_connections 2026-02-23T06:25:50.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.785+0000 7f635ca5a640 1 -- 10.20.193.58:0/2553600871 >> 10.20.193.58:0/2553600871 conn(0x7f63580b3c20 msgr2=0x7f635815a340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:25:50.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.785+0000 7f635ca5a640 1 -- 10.20.193.58:0/2553600871 shutdown_connections 2026-02-23T06:25:50.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.785+0000 7f635ca5a640 1 -- 10.20.193.58:0/2553600871 wait complete. 2026-02-23T06:25:50.802 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:25:50.802 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:25:50.802 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:25:50.925 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.929+0000 7f81e1bbe640 1 -- 10.20.193.58:0/2535893331 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f81c8003ad0 msgr2=0x7f81c8003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.925 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.929+0000 7f81e1bbe640 1 --2- 10.20.193.58:0/2535893331 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f81c8003ad0 0x7f81c8003ee0 secure :-1 s=READY pgs=54 gs=6 cs=0 l=1 c_cookie=1040514641962934147 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f81cc0046a0 tx=0x7f81cc02fb30 comp rx=0 tx=0).stop 2026-02-23T06:25:50.925 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.929+0000 7f81e13bd640 1 -- 10.20.193.58:0/2535893331 reap_dead start 2026-02-23T06:25:50.925 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.929+0000 7f81e1bbe640 1 -- 10.20.193.58:0/2535893331 shutdown_connections 2026-02-23T06:25:50.925 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.929+0000 7f81e1bbe640 1 -- 10.20.193.58:0/2535893331 >> 10.20.193.58:0/2535893331 conn(0x7f81dc0b3c20 msgr2=0x7f81dc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:25:50.925 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.929+0000 7f81e1bbe640 1 -- 10.20.193.58:0/2535893331 shutdown_connections 2026-02-23T06:25:50.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.929+0000 7f81e1bbe640 1 -- 10.20.193.58:0/2535893331 wait complete. 2026-02-23T06:25:50.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.931+0000 7f81e1bbe640 1 Processor -- start 2026-02-23T06:25:50.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.931+0000 7f81e1bbe640 1 -- start start 2026-02-23T06:25:50.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.931+0000 7f81e1bbe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f81c8003ad0 0x7f81dc057750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:50.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.931+0000 7f81e1bbe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f81dc13c080 0x7f81dc13c4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:50.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.931+0000 7f81e1bbe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f81dc11e270 0x7f81dc11e6e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:50.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.931+0000 7f81e1bbe640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f81dc1416d0 con 0x7f81dc13c080 2026-02-23T06:25:50.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.931+0000 7f81e1bbe640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f81dc162a40 con 0x7f81dc11e270 2026-02-23T06:25:50.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.931+0000 7f81e1bbe640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f81dc13e020 con 0x7f81c8003ad0 2026-02-23T06:25:50.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.932+0000 7f81e0bbc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f81c8003ad0 0x7f81dc057750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:50.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.932+0000 7f81e13bd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f81dc11e270 0x7f81dc11e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:50.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.932+0000 7f81e0bbc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f81c8003ad0 0x7f81dc057750 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:54756/0 (socket says 10.20.193.58:54756) 2026-02-23T06:25:50.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.932+0000 7f81e0bbc640 1 -- 10.20.193.58:0/4056294063 learned_addr learned my addr 10.20.193.58:0/4056294063 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:25:50.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.932+0000 7f81d3fff640 1 --2- 10.20.193.58:0/4056294063 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f81dc13c080 0x7f81dc13c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:50.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.932+0000 7f81e0bbc640 1 -- 10.20.193.58:0/4056294063 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f81dc11e270 msgr2=0x7f81dc11e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.932+0000 7f81e0bbc640 1 --2- 10.20.193.58:0/4056294063 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f81dc11e270 0x7f81dc11e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.932+0000 7f81e0bbc640 1 -- 10.20.193.58:0/4056294063 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f81dc13c080 msgr2=0x7f81dc13c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:50.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.932+0000 7f81e0bbc640 1 --2- 10.20.193.58:0/4056294063 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f81dc13c080 0x7f81dc13c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:50.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.932+0000 7f81e0bbc640 1 -- 10.20.193.58:0/4056294063 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81dc0b14b0 con 0x7f81c8003ad0 2026-02-23T06:25:50.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.932+0000 7f81e13bd640 1 --2- 10.20.193.58:0/4056294063 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f81dc11e270 0x7f81dc11e6e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:25:50.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.932+0000 7f81e0bbc640 1 --2- 10.20.193.58:0/4056294063 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f81c8003ad0 0x7f81dc057750 secure :-1 s=READY pgs=9 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f81cc0055a0 tx=0x7f81cc0055d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:50.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.933+0000 7f81d17fa640 1 -- 10.20.193.58:0/4056294063 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f81cc042070 con 0x7f81c8003ad0 2026-02-23T06:25:50.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.933+0000 7f81d17fa640 1 -- 10.20.193.58:0/4056294063 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81cc004a60 con 0x7f81c8003ad0 2026-02-23T06:25:50.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.933+0000 7f81d17fa640 1 -- 10.20.193.58:0/4056294063 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f81cc0348c0 con 0x7f81c8003ad0 2026-02-23T06:25:50.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.933+0000 7f81e1bbe640 1 -- 10.20.193.58:0/4056294063 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81dc13e020 con 0x7f81c8003ad0 2026-02-23T06:25:50.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.933+0000 7f81e1bbe640 1 -- 10.20.193.58:0/4056294063 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f81dc162380 con 0x7f81c8003ad0 2026-02-23T06:25:50.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.933+0000 7f81e1bbe640 1 -- 10.20.193.58:0/4056294063 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81dc0b6d50 con 0x7f81c8003ad0 2026-02-23T06:25:50.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.935+0000 7f81d17fa640 1 -- 10.20.193.58:0/4056294063 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f81cc06db80 con 0x7f81c8003ad0 2026-02-23T06:25:50.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.936+0000 7f81d17fa640 1 --2- 10.20.193.58:0/4056294063 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f81ac07a6c0 0x7f81ac09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:25:50.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.936+0000 7f81d17fa640 1 -- 10.20.193.58:0/4056294063 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f81cc0c2f10 con 0x7f81c8003ad0 2026-02-23T06:25:50.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.936+0000 7f81d3fff640 1 --2- 10.20.193.58:0/4056294063 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f81ac07a6c0 0x7f81ac09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:25:50.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.936+0000 7f81d17fa640 1 -- 10.20.193.58:0/4056294063 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f81cc086310 con 0x7f81c8003ad0 2026-02-23T06:25:50.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:50.936+0000 7f81d3fff640 1 --2- 10.20.193.58:0/4056294063 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f81ac07a6c0 0x7f81ac09ab70 secure :-1 s=READY pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f81c4002b30 tx=0x7f81c4006040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:25:51.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:51.095+0000 7f81e1bbe640 1 -- 10.20.193.58:0/4056294063 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f81dc1621d0 con 0x7f81c8003ad0 2026-02-23T06:25:51.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:51.096+0000 7f81d17fa640 1 -- 10.20.193.58:0/4056294063 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f81cc08b080 con 0x7f81c8003ad0 2026-02-23T06:25:51.092 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:51.097+0000 7f81e1bbe640 1 -- 10.20.193.58:0/4056294063 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f81ac07a6c0 msgr2=0x7f81ac09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:51.092 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:51.097+0000 7f81e1bbe640 1 --2- 10.20.193.58:0/4056294063 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f81ac07a6c0 0x7f81ac09ab70 secure :-1 s=READY pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f81c4002b30 tx=0x7f81c4006040 comp rx=0 tx=0).stop 2026-02-23T06:25:51.093 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:51.097+0000 7f81e1bbe640 1 -- 10.20.193.58:0/4056294063 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f81c8003ad0 msgr2=0x7f81dc057750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:25:51.093 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:51.097+0000 7f81e1bbe640 1 --2- 10.20.193.58:0/4056294063 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f81c8003ad0 0x7f81dc057750 secure :-1 s=READY pgs=9 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f81cc0055a0 tx=0x7f81cc0055d0 comp rx=0 tx=0).stop 2026-02-23T06:25:51.093 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:51.097+0000 7f81e1bbe640 1 -- 10.20.193.58:0/4056294063 shutdown_connections 2026-02-23T06:25:51.093 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:51.097+0000 7f81e1bbe640 1 --2- 10.20.193.58:0/4056294063 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f81ac07a6c0 0x7f81ac09ab70 unknown :-1 s=CLOSED pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:51.093 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:51.097+0000 7f81e1bbe640 1 --2- 10.20.193.58:0/4056294063 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f81dc11e270 0x7f81dc11e6e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:51.093 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:51.097+0000 7f81e1bbe640 1 --2- 10.20.193.58:0/4056294063 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f81dc13c080 0x7f81dc13c4d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:51.093 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:51.097+0000 7f81e1bbe640 1 --2- 10.20.193.58:0/4056294063 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f81c8003ad0 0x7f81dc057750 unknown :-1 s=CLOSED pgs=9 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:25:51.093 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:51.097+0000 7f81e1bbe640 1 -- 10.20.193.58:0/4056294063 >> 10.20.193.58:0/4056294063 conn(0x7f81dc0b3c20 msgr2=0x7f81dc0b7480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:25:51.093 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:51.097+0000 7f81e1bbe640 1 -- 10.20.193.58:0/4056294063 shutdown_connections 2026-02-23T06:25:51.093 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:25:51.097+0000 7f81e1bbe640 1 -- 10.20.193.58:0/4056294063 wait complete. 2026-02-23T06:25:51.105 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:26:01.106 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:26:01.107 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:26:01.233 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.238+0000 7f996bfff640 1 -- 10.20.193.58:0/2848620074 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f996c15d4a0 msgr2=0x7f996c0affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:01.233 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.238+0000 7f996bfff640 1 --2- 10.20.193.58:0/2848620074 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f996c15d4a0 0x7f996c0affb0 secure :-1 s=READY pgs=316 gs=3 cs=0 l=1 c_cookie=12494042888927572870 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f996c059740 tx=0x7f996002f170 comp rx=0 tx=0).stop 2026-02-23T06:26:01.233 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.238+0000 7f996bfff640 1 -- 10.20.193.58:0/2848620074 shutdown_connections 2026-02-23T06:26:01.234 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.238+0000 7f996bfff640 1 --2- 10.20.193.58:0/2848620074 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f996c15d4a0 0x7f996c0affb0 unknown :-1 s=CLOSED pgs=316 gs=3 cs=0 l=1 c_cookie=12494042888927572870 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.234 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.238+0000 7f996bfff640 1 -- 10.20.193.58:0/2848620074 >> 10.20.193.58:0/2848620074 conn(0x7f996c0b3c20 msgr2=0x7f996c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:01.234 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.238+0000 7f996bfff640 1 -- 10.20.193.58:0/2848620074 shutdown_connections 2026-02-23T06:26:01.234 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.238+0000 7f996bfff640 1 -- 10.20.193.58:0/2848620074 wait complete. 2026-02-23T06:26:01.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.239+0000 7f996bfff640 1 Processor -- start 2026-02-23T06:26:01.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.239+0000 7f996bfff640 1 -- start start 2026-02-23T06:26:01.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.239+0000 7f996bfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f996c0b6690 0x7f996c0b7480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:01.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.239+0000 7f996bfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f996c15d4a0 0x7f996c0b79c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:01.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.239+0000 7f996bfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f996c15d870 0x7f996c13f460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:01.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.239+0000 7f996bfff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f996c144760 con 0x7f996c15d870 2026-02-23T06:26:01.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.239+0000 7f996bfff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f996c1444a0 con 0x7f996c0b6690 2026-02-23T06:26:01.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.239+0000 7f996bfff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f996c144060 con 0x7f996c15d4a0 2026-02-23T06:26:01.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.240+0000 7f996b7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f996c15d870 0x7f996c13f460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:01.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.240+0000 7f996affd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f996c0b6690 0x7f996c0b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:01.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.240+0000 7f996b7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f996c15d870 0x7f996c13f460 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:54470/0 (socket says 10.20.193.58:54470) 2026-02-23T06:26:01.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.240+0000 7f996b7fe640 1 -- 10.20.193.58:0/1104560049 learned_addr learned my addr 10.20.193.58:0/1104560049 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:26:01.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.240+0000 7f996a7fc640 1 --2- 10.20.193.58:0/1104560049 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f996c15d4a0 0x7f996c0b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:01.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.240+0000 7f996b7fe640 1 -- 10.20.193.58:0/1104560049 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f996c15d4a0 msgr2=0x7f996c0b79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:01.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.240+0000 7f996b7fe640 1 --2- 10.20.193.58:0/1104560049 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f996c15d4a0 0x7f996c0b79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.240+0000 7f996b7fe640 1 -- 10.20.193.58:0/1104560049 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f996c0b6690 msgr2=0x7f996c0b7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:01.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.240+0000 7f996b7fe640 1 --2- 10.20.193.58:0/1104560049 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f996c0b6690 0x7f996c0b7480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.240+0000 7f996b7fe640 1 -- 10.20.193.58:0/1104560049 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99600094b0 con 0x7f996c15d870 2026-02-23T06:26:01.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.240+0000 7f996b7fe640 1 --2- 10.20.193.58:0/1104560049 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f996c15d870 0x7f996c13f460 secure :-1 s=READY pgs=56 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f995c005850 tx=0x7f995c00d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:01.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.240+0000 7f9943fff640 1 -- 10.20.193.58:0/1104560049 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f995c013850 con 0x7f996c15d870 2026-02-23T06:26:01.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.240+0000 7f9943fff640 1 -- 10.20.193.58:0/1104560049 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f995c013ac0 con 0x7f996c15d870 2026-02-23T06:26:01.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.240+0000 7f9943fff640 1 -- 10.20.193.58:0/1104560049 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f995c012380 con 0x7f996c15d870 2026-02-23T06:26:01.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.240+0000 7f996bfff640 1 -- 10.20.193.58:0/1104560049 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f996c140930 con 0x7f996c15d870 2026-02-23T06:26:01.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.240+0000 7f996bfff640 1 -- 10.20.193.58:0/1104560049 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f996c144960 con 0x7f996c15d870 2026-02-23T06:26:01.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.241+0000 7f996bfff640 1 -- 10.20.193.58:0/1104560049 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f996c13f180 con 0x7f996c15d870 2026-02-23T06:26:01.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.242+0000 7f9943fff640 1 -- 10.20.193.58:0/1104560049 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f995c0124e0 con 0x7f996c15d870 2026-02-23T06:26:01.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.243+0000 7f9943fff640 1 --2- 10.20.193.58:0/1104560049 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f993c07a6c0 0x7f993c09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:01.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.243+0000 7f9943fff640 1 -- 10.20.193.58:0/1104560049 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f995c09ea60 con 0x7f996c15d870 2026-02-23T06:26:01.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.243+0000 7f996affd640 1 --2- 10.20.193.58:0/1104560049 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f993c07a6c0 0x7f993c09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:01.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.244+0000 7f996affd640 1 --2- 10.20.193.58:0/1104560049 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f993c07a6c0 0x7f993c09ab70 secure :-1 s=READY pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99600023d0 tx=0x7f996003a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:01.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.245+0000 7f9943fff640 1 -- 10.20.193.58:0/1104560049 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f996c13f180 con 0x7f996c15d870 2026-02-23T06:26:01.395 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.400+0000 7f996bfff640 1 -- 10.20.193.58:0/1104560049 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f996c13f180 con 0x7f996c15d870 2026-02-23T06:26:01.395 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.400+0000 7f9943fff640 1 -- 10.20.193.58:0/1104560049 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f996c13f180 con 0x7f996c15d870 2026-02-23T06:26:01.395 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":36,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:26:01.397 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.401+0000 7f996bfff640 1 -- 10.20.193.58:0/1104560049 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f993c07a6c0 msgr2=0x7f993c09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:01.397 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.401+0000 7f996bfff640 1 --2- 10.20.193.58:0/1104560049 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f993c07a6c0 0x7f993c09ab70 secure :-1 s=READY pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99600023d0 tx=0x7f996003a040 comp rx=0 tx=0).stop 2026-02-23T06:26:01.397 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.401+0000 7f996bfff640 1 -- 10.20.193.58:0/1104560049 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f996c15d870 msgr2=0x7f996c13f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:01.397 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.401+0000 7f996bfff640 1 --2- 10.20.193.58:0/1104560049 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f996c15d870 0x7f996c13f460 secure :-1 s=READY pgs=56 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f995c005850 tx=0x7f995c00d9f0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.397 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.401+0000 7f996bfff640 1 -- 10.20.193.58:0/1104560049 shutdown_connections 2026-02-23T06:26:01.397 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.401+0000 7f996bfff640 1 --2- 10.20.193.58:0/1104560049 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f993c07a6c0 0x7f993c09ab70 unknown :-1 s=CLOSED pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.397 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.401+0000 7f996bfff640 1 --2- 10.20.193.58:0/1104560049 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f996c15d870 0x7f996c13f460 unknown :-1 s=CLOSED pgs=56 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.397 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.401+0000 7f996bfff640 1 --2- 10.20.193.58:0/1104560049 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f996c15d4a0 0x7f996c0b79c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.397 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.401+0000 7f996bfff640 1 --2- 10.20.193.58:0/1104560049 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f996c0b6690 0x7f996c0b7480 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.397 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.401+0000 7f996bfff640 1 -- 10.20.193.58:0/1104560049 >> 10.20.193.58:0/1104560049 conn(0x7f996c0b3c20 msgr2=0x7f996c15bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:01.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.401+0000 7f996bfff640 1 -- 10.20.193.58:0/1104560049 shutdown_connections 2026-02-23T06:26:01.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.401+0000 7f996bfff640 1 -- 10.20.193.58:0/1104560049 wait complete. 2026-02-23T06:26:01.408 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:26:01.408 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:26:01.408 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:26:01.408 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:26:01.532 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.537+0000 7f208c54c640 1 -- 10.20.193.58:0/145434714 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2084163c70 msgr2=0x7f208405b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:01.532 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.537+0000 7f208c54c640 1 --2- 10.20.193.58:0/145434714 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2084163c70 0x7f208405b230 secure :-1 s=READY pgs=58 gs=3 cs=0 l=1 c_cookie=9847835874571881340 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2078004740 tx=0x7f207802f2b0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.533 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.537+0000 7f208c54c640 1 -- 10.20.193.58:0/145434714 shutdown_connections 2026-02-23T06:26:01.533 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.537+0000 7f208c54c640 1 --2- 10.20.193.58:0/145434714 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2084163c70 0x7f208405b230 unknown :-1 s=CLOSED pgs=58 gs=3 cs=0 l=1 c_cookie=9847835874571881340 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.533 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.537+0000 7f208c54c640 1 -- 10.20.193.58:0/145434714 >> 10.20.193.58:0/145434714 conn(0x7f20840561f0 msgr2=0x7f20840565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:01.533 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.537+0000 7f208c54c640 1 -- 10.20.193.58:0/145434714 shutdown_connections 2026-02-23T06:26:01.533 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.537+0000 7f208c54c640 1 -- 10.20.193.58:0/145434714 wait complete. 2026-02-23T06:26:01.536 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.538+0000 7f208c54c640 1 Processor -- start 2026-02-23T06:26:01.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.538+0000 7f208c54c640 1 -- start start 2026-02-23T06:26:01.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.539+0000 7f208c54c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f20840b10e0 0x7f20840b0760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:01.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.539+0000 7f208c54c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20840b6020 0x7f2084201420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:01.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.539+0000 7f208c54c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2084163c70 0x7f208413e040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:01.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.539+0000 7f208c54c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f2084140250 con 0x7f20840b10e0 2026-02-23T06:26:01.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.539+0000 7f208c54c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f208413d780 con 0x7f20840b6020 2026-02-23T06:26:01.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.539+0000 7f208c54c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f2084200f90 con 0x7f2084163c70 2026-02-23T06:26:01.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.539+0000 7f208a2c1640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f20840b10e0 0x7f20840b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:01.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.539+0000 7f2089ac0640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20840b6020 0x7f2084201420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:01.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.539+0000 7f2089ac0640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20840b6020 0x7f2084201420 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:33194/0 (socket says 10.20.193.58:33194) 2026-02-23T06:26:01.538 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.539+0000 7f2089ac0640 1 -- 10.20.193.58:0/2378216424 learned_addr learned my addr 10.20.193.58:0/2378216424 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:26:01.538 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.539+0000 7f208aac2640 1 --2- 10.20.193.58:0/2378216424 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2084163c70 0x7f208413e040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:01.538 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.539+0000 7f208a2c1640 1 -- 10.20.193.58:0/2378216424 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2084163c70 msgr2=0x7f208413e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:01.538 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.539+0000 7f208a2c1640 1 --2- 10.20.193.58:0/2378216424 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2084163c70 0x7f208413e040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.538 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.539+0000 7f208a2c1640 1 -- 10.20.193.58:0/2378216424 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20840b6020 msgr2=0x7f2084201420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:01.538 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.539+0000 7f208a2c1640 1 --2- 10.20.193.58:0/2378216424 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20840b6020 0x7f2084201420 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.538 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.539+0000 7f208a2c1640 1 -- 10.20.193.58:0/2378216424 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20780094b0 con 0x7f20840b10e0 2026-02-23T06:26:01.538 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.540+0000 7f208a2c1640 1 --2- 10.20.193.58:0/2378216424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f20840b10e0 0x7f20840b0760 secure :-1 s=READY pgs=59 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2074002730 tx=0x7f207400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:01.538 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.540+0000 7f206affd640 1 -- 10.20.193.58:0/2378216424 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2074004250 con 0x7f20840b10e0 2026-02-23T06:26:01.538 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.540+0000 7f206affd640 1 -- 10.20.193.58:0/2378216424 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20740044a0 con 0x7f20840b10e0 2026-02-23T06:26:01.538 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.540+0000 7f206affd640 1 -- 10.20.193.58:0/2378216424 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2074012950 con 0x7f20840b10e0 2026-02-23T06:26:01.538 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.540+0000 7f208c54c640 1 -- 10.20.193.58:0/2378216424 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f208413d510 con 0x7f20840b10e0 2026-02-23T06:26:01.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.540+0000 7f208c54c640 1 -- 10.20.193.58:0/2378216424 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2084161550 con 0x7f20840b10e0 2026-02-23T06:26:01.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.540+0000 7f208c54c640 1 --2- 10.20.193.58:0/2378216424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f20840aedb0 0x7f20840af440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:01.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.540+0000 7f208c54c640 1 -- 10.20.193.58:0/2378216424 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f2084166a80 con 0x7f20840aedb0 2026-02-23T06:26:01.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.541+0000 7f2089ac0640 1 --2- 10.20.193.58:0/2378216424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f20840aedb0 0x7f20840af440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:01.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.541+0000 7f2089ac0640 1 -- 10.20.193.58:0/2378216424 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f20840b6ae0 con 0x7f20840aedb0 2026-02-23T06:26:01.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.541+0000 7f2089ac0640 1 --2- 10.20.193.58:0/2378216424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f20840aedb0 0x7f20840af440 secure :-1 s=READY pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20780097e0 tx=0x7f2078002c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:01.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.541+0000 7f206affd640 1 -- 10.20.193.58:0/2378216424 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f207803d040 con 0x7f20840aedb0 2026-02-23T06:26:01.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.541+0000 7f206affd640 1 -- 10.20.193.58:0/2378216424 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f2078038690 con 0x7f20840aedb0 2026-02-23T06:26:01.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.541+0000 7f206affd640 1 -- 10.20.193.58:0/2378216424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f20840aedb0 msgr2=0x7f20840af440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:01.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.541+0000 7f206affd640 1 --2- 10.20.193.58:0/2378216424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f20840aedb0 0x7f20840af440 secure :-1 s=READY pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20780097e0 tx=0x7f2078002c40 comp rx=0 tx=0).stop 2026-02-23T06:26:01.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.541+0000 7f206affd640 1 -- 10.20.193.58:0/2378216424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f20840aedb0 msgr2=0x7f20840af440 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:26:01.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.541+0000 7f206affd640 1 --2- 10.20.193.58:0/2378216424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f20840aedb0 0x7f20840af440 secure :-1 s=CLOSED pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20780097e0 tx=0x7f2078002c40 comp rx=0 tx=0).stop 2026-02-23T06:26:01.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.542+0000 7f206affd640 1 -- 10.20.193.58:0/2378216424 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f2074019070 con 0x7f20840b10e0 2026-02-23T06:26:01.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.543+0000 7f206affd640 1 --2- 10.20.193.58:0/2378216424 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f205407a370 0x7f205409a820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:01.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.543+0000 7f206affd640 1 -- 10.20.193.58:0/2378216424 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f207409d480 con 0x7f20840b10e0 2026-02-23T06:26:01.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.543+0000 7f2089ac0640 1 --2- 10.20.193.58:0/2378216424 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f205407a370 0x7f205409a820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:01.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.544+0000 7f2089ac0640 1 --2- 10.20.193.58:0/2378216424 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f205407a370 0x7f205409a820 secure :-1 s=READY pgs=183 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20780097e0 tx=0x7f2078031030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:01.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.545+0000 7f208c54c640 1 --2- 10.20.193.58:0/2378216424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2084200b80 0x7f20840af980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:01.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.545+0000 7f208c54c640 1 -- 10.20.193.58:0/2378216424 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f20842010d0 con 0x7f2084200b80 2026-02-23T06:26:01.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.545+0000 7f208aac2640 1 --2- 10.20.193.58:0/2378216424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2084200b80 0x7f20840af980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:01.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.545+0000 7f208aac2640 1 -- 10.20.193.58:0/2378216424 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f20840afec0 con 0x7f2084200b80 2026-02-23T06:26:01.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.545+0000 7f208aac2640 1 --2- 10.20.193.58:0/2378216424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2084200b80 0x7f20840af980 secure :-1 s=READY pgs=61 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2080008fd0 tx=0x7f208000ff80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:01.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.546+0000 7f206affd640 1 -- 10.20.193.58:0/2378216424 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f208001a070 con 0x7f2084200b80 2026-02-23T06:26:01.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.546+0000 7f206affd640 1 -- 10.20.193.58:0/2378216424 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5247 (secure 0 0 0) 0x7f208000dbd0 con 0x7f2084200b80 2026-02-23T06:26:01.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.546+0000 7f206affd640 1 -- 10.20.193.58:0/2378216424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2084200b80 msgr2=0x7f20840af980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:01.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.546+0000 7f206affd640 1 --2- 10.20.193.58:0/2378216424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2084200b80 0x7f20840af980 secure :-1 s=READY pgs=61 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2080008fd0 tx=0x7f208000ff80 comp rx=0 tx=0).stop 2026-02-23T06:26:01.543 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:26:01.543 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:26:01.543 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:26:01.543 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:26:01.543 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 36, 2026-02-23T06:26:01.543 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 88379, 2026-02-23T06:26:01.543 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:26:01.544 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:26:01.544 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:26:01.544 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:26:01.544 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:01.544 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:26:01.544 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:26:01.544 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:26:01.544 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:26:01.544 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:01.544 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:01.544 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:01.545 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:01.545 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:01.545 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:01.545 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:01.545 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:01.545 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:01.545 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:01.545 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:01.545 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:01.545 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:01.545 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:01.546 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:26:01.546 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:26:01.546 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:01.546 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:01.546 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:01.546 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:01.546 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:01.546 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:01.546 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:01.546 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:01.546 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:01.546 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:01.547 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:01.547 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:01.547 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:01.547 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:01.547 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.547 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:26:01.547 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:26:01.547 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:26:01.547 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:26:01.547 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:26:01.547 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:26:01.547 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:26:01.548 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:26:01.548 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:26:01.548 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:26:01.548 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:26:01.548 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:26:01.548 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:26:01.548 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:26:01.548 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:26:01.548 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:26:01.548 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:26:01.548 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:01.548 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:01.549 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:01.549 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:01.549 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:01.549 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:01.549 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:01.549 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:01.549 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:01.549 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:01.549 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:01.549 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:01.549 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:01.549 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:01.550 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:26:01.550 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.550 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:26:01.550 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.550 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:26:01.550 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:26:01.550 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:01.550 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:01.550 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.550 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:01.550 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:26:01.551 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:01.551 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.551 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.551 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:01.551 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:26:01.551 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:01.551 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:01.551 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:01.551 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.551 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:26:01.551 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:26:01.551 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:01.552 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:01.552 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:26:01.552 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:01.552 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.552 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.552 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:26:01.552 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:26:01.552 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:01.552 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:01.552 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.552 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:01.552 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:26:01.553 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:01.553 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.553 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.553 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:01.553 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:26:01.553 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:01.553 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:01.553 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:01.553 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.553 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:26:01.553 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:26:01.553 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:01.553 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:01.554 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:26:01.554 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:01.554 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.554 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.554 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:26:01.554 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:26:01.554 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:01.554 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:01.554 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.554 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:01.554 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:26:01.554 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:01.555 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.555 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.555 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:01.555 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:26:01.555 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:01.555 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:01.555 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:01.555 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.555 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:26:01.555 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:26:01.555 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:01.555 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:01.556 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:26:01.556 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:01.556 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:01.556 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:01.556 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.556 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:26:01.556 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:26:01.556 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.556 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:01.556 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:01.556 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:26:01.556 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:01.557 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:01.557 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:26:01.557 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.557 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:01.557 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:01.557 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:26:01.557 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:01.557 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:01.557 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:26:01.557 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.557 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:01.557 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:01.557 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:26:01.558 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:01.558 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:01.558 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:26:01.558 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.558 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:01.558 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:01.558 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:26:01.558 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:01.558 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:01.558 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.558 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:26:01.558 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:26:01.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.546+0000 7f206affd640 1 -- 10.20.193.58:0/2378216424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2084200b80 msgr2=0x7f20840af980 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:26:01.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.546+0000 7f206affd640 1 --2- 10.20.193.58:0/2378216424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2084200b80 0x7f20840af980 unknown :-1 s=CLOSED pgs=61 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.546+0000 7f208c54c640 1 -- 10.20.193.58:0/2378216424 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f205407a370 msgr2=0x7f205409a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:01.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.546+0000 7f208c54c640 1 --2- 10.20.193.58:0/2378216424 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f205407a370 0x7f205409a820 secure :-1 s=READY pgs=183 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20780097e0 tx=0x7f2078031030 comp rx=0 tx=0).stop 2026-02-23T06:26:01.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.546+0000 7f208c54c640 1 -- 10.20.193.58:0/2378216424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f20840b10e0 msgr2=0x7f20840b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:01.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.546+0000 7f208c54c640 1 --2- 10.20.193.58:0/2378216424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f20840b10e0 0x7f20840b0760 secure :-1 s=READY pgs=59 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2074002730 tx=0x7f207400c970 comp rx=0 tx=0).stop 2026-02-23T06:26:01.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.546+0000 7f208aac2640 1 -- 10.20.193.58:0/2378216424 reap_dead start 2026-02-23T06:26:01.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.546+0000 7f208c54c640 1 -- 10.20.193.58:0/2378216424 shutdown_connections 2026-02-23T06:26:01.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.546+0000 7f208c54c640 1 -- 10.20.193.58:0/2378216424 >> 10.20.193.58:0/2378216424 conn(0x7f20840561f0 msgr2=0x7f2084061540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:01.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.546+0000 7f208c54c640 1 -- 10.20.193.58:0/2378216424 shutdown_connections 2026-02-23T06:26:01.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.546+0000 7f208c54c640 1 -- 10.20.193.58:0/2378216424 wait complete. 2026-02-23T06:26:01.562 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:26:01.562 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:26:01.562 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:26:01.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.690+0000 7f308cc43640 1 -- 10.20.193.58:0/3429382409 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f308815d870 msgr2=0x7f30880587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:01.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.690+0000 7f308cc43640 1 --2- 10.20.193.58:0/3429382409 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f308815d870 0x7f30880587b0 secure :-1 s=READY pgs=63 gs=2 cs=0 l=1 c_cookie=5548565782505493638 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3078004740 tx=0x7f307802f1e0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.690+0000 7f308cc43640 1 -- 10.20.193.58:0/3429382409 shutdown_connections 2026-02-23T06:26:01.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.690+0000 7f308cc43640 1 --2- 10.20.193.58:0/3429382409 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f30880b6690 0x7f3088058cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.690+0000 7f308cc43640 1 --2- 10.20.193.58:0/3429382409 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f308815d870 0x7f30880587b0 unknown :-1 s=CLOSED pgs=63 gs=2 cs=0 l=1 c_cookie=5548565782505493638 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.690+0000 7f308cc43640 1 -- 10.20.193.58:0/3429382409 >> 10.20.193.58:0/3429382409 conn(0x7f30880b3c20 msgr2=0x7f30880b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:01.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.690+0000 7f308cc43640 1 -- 10.20.193.58:0/3429382409 shutdown_connections 2026-02-23T06:26:01.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.690+0000 7f308cc43640 1 -- 10.20.193.58:0/3429382409 wait complete. 2026-02-23T06:26:01.688 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.692+0000 7f308cc43640 1 Processor -- start 2026-02-23T06:26:01.688 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.692+0000 7f308cc43640 1 -- start start 2026-02-23T06:26:01.688 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.692+0000 7f308cc43640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f30880b6690 0x7f3088123c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:01.689 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.692+0000 7f308cc43640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f308815d4a0 0x7f308813d200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:01.689 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.692+0000 7f308cc43640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f308815d870 0x7f3088161e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:01.689 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.692+0000 7f308cc43640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f3088161a00 con 0x7f308815d870 2026-02-23T06:26:01.689 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.692+0000 7f308cc43640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f308814b1c0 con 0x7f30880b6690 2026-02-23T06:26:01.689 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.692+0000 7f308cc43640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f308814a3a0 con 0x7f308815d4a0 2026-02-23T06:26:01.689 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.692+0000 7f3087fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f308815d870 0x7f3088161e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:01.689 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.692+0000 7f30877fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f30880b6690 0x7f3088123c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:01.689 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.692+0000 7f3087fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f308815d870 0x7f3088161e40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:54524/0 (socket says 10.20.193.58:54524) 2026-02-23T06:26:01.689 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.692+0000 7f3087fff640 1 -- 10.20.193.58:0/3850839687 learned_addr learned my addr 10.20.193.58:0/3850839687 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:26:01.689 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.693+0000 7f3086ffd640 1 --2- 10.20.193.58:0/3850839687 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f308815d4a0 0x7f308813d200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:01.689 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.693+0000 7f3087fff640 1 -- 10.20.193.58:0/3850839687 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f308815d4a0 msgr2=0x7f308813d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:01.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.693+0000 7f3087fff640 1 --2- 10.20.193.58:0/3850839687 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f308815d4a0 0x7f308813d200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.693+0000 7f3087fff640 1 -- 10.20.193.58:0/3850839687 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f30880b6690 msgr2=0x7f3088123c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:01.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.693+0000 7f3087fff640 1 --2- 10.20.193.58:0/3850839687 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f30880b6690 0x7f3088123c70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.693+0000 7f3087fff640 1 -- 10.20.193.58:0/3850839687 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30780094b0 con 0x7f308815d870 2026-02-23T06:26:01.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.693+0000 7f3087fff640 1 --2- 10.20.193.58:0/3850839687 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f308815d870 0x7f3088161e40 secure :-1 s=READY pgs=64 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f307c00f8d0 tx=0x7f307c00fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:01.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.693+0000 7f3063fff640 1 -- 10.20.193.58:0/3850839687 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f307c00dce0 con 0x7f308815d870 2026-02-23T06:26:01.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.693+0000 7f3063fff640 1 -- 10.20.193.58:0/3850839687 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f307c00de60 con 0x7f308815d870 2026-02-23T06:26:01.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.693+0000 7f3063fff640 1 -- 10.20.193.58:0/3850839687 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f307c005b90 con 0x7f308815d870 2026-02-23T06:26:01.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.693+0000 7f308cc43640 1 -- 10.20.193.58:0/3850839687 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f308814a640 con 0x7f308815d870 2026-02-23T06:26:01.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.693+0000 7f308cc43640 1 -- 10.20.193.58:0/3850839687 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f308814ac00 con 0x7f308815d870 2026-02-23T06:26:01.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.694+0000 7f308cc43640 1 --2- 10.20.193.58:0/3850839687 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f308814adf0 0x7f3088162380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:01.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.694+0000 7f308cc43640 1 -- 10.20.193.58:0/3850839687 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f30880609c0 con 0x7f308814adf0 2026-02-23T06:26:01.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.694+0000 7f30877fe640 1 --2- 10.20.193.58:0/3850839687 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f308814adf0 0x7f3088162380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:01.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.694+0000 7f30877fe640 1 -- 10.20.193.58:0/3850839687 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f30880b6330 con 0x7f308814adf0 2026-02-23T06:26:01.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.695+0000 7f30877fe640 1 --2- 10.20.193.58:0/3850839687 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f308814adf0 0x7f3088162380 secure :-1 s=READY pgs=318 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f307400f770 tx=0x7f307400fc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:01.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.695+0000 7f3063fff640 1 -- 10.20.193.58:0/3850839687 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3074006d80 con 0x7f308814adf0 2026-02-23T06:26:01.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.695+0000 7f3063fff640 1 -- 10.20.193.58:0/3850839687 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f307c020060 con 0x7f308815d870 2026-02-23T06:26:01.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.696+0000 7f3063fff640 1 --2- 10.20.193.58:0/3850839687 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f305807a660 0x7f305809ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:01.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.696+0000 7f3063fff640 1 -- 10.20.193.58:0/3850839687 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f307c015070 con 0x7f308815d870 2026-02-23T06:26:01.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.696+0000 7f3063fff640 1 -- 10.20.193.58:0/3850839687 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f307400d6b0 con 0x7f308814adf0 2026-02-23T06:26:01.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.696+0000 7f3063fff640 1 -- 10.20.193.58:0/3850839687 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f308814adf0 msgr2=0x7f3088162380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:01.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.696+0000 7f3063fff640 1 --2- 10.20.193.58:0/3850839687 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f308814adf0 0x7f3088162380 secure :-1 s=READY pgs=318 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f307400f770 tx=0x7f307400fc40 comp rx=0 tx=0).stop 2026-02-23T06:26:01.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.696+0000 7f3063fff640 1 -- 10.20.193.58:0/3850839687 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f308814adf0 msgr2=0x7f3088162380 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:26:01.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.696+0000 7f3063fff640 1 --2- 10.20.193.58:0/3850839687 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f308814adf0 0x7f3088162380 secure :-1 s=CLOSED pgs=318 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f307400f770 tx=0x7f307400fc40 comp rx=0 tx=0).stop 2026-02-23T06:26:01.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.696+0000 7f3086ffd640 1 --2- 10.20.193.58:0/3850839687 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f305807a660 0x7f305809ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:01.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.697+0000 7f3086ffd640 1 --2- 10.20.193.58:0/3850839687 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f305807a660 0x7f305809ab10 secure :-1 s=READY pgs=184 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30780023d0 tx=0x7f3078031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:01.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.699+0000 7f308cc43640 1 --2- 10.20.193.58:0/3850839687 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3088161320 0x7f308814d7f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:01.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.699+0000 7f308cc43640 1 -- 10.20.193.58:0/3850839687 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f3088164250 con 0x7f3088161320 2026-02-23T06:26:01.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.700+0000 7f30877fe640 1 --2- 10.20.193.58:0/3850839687 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3088161320 0x7f308814d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:01.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.700+0000 7f30877fe640 1 -- 10.20.193.58:0/3850839687 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f30880b6d50 con 0x7f3088161320 2026-02-23T06:26:01.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.701+0000 7f30877fe640 1 --2- 10.20.193.58:0/3850839687 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3088161320 0x7f308814d7f0 secure :-1 s=READY pgs=319 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f307400f770 tx=0x7f30740046e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:01.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.701+0000 7f3063fff640 1 -- 10.20.193.58:0/3850839687 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3074022070 con 0x7f3088161320 2026-02-23T06:26:01.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.701+0000 7f3063fff640 1 -- 10.20.193.58:0/3850839687 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5556 (secure 0 0 0) 0x7f3074007480 con 0x7f3088161320 2026-02-23T06:26:01.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.701+0000 7f3063fff640 1 -- 10.20.193.58:0/3850839687 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3088161320 msgr2=0x7f308814d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:01.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.701+0000 7f3063fff640 1 --2- 10.20.193.58:0/3850839687 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3088161320 0x7f308814d7f0 secure :-1 s=READY pgs=319 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f307400f770 tx=0x7f30740046e0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.701+0000 7f3063fff640 1 -- 10.20.193.58:0/3850839687 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3088161320 msgr2=0x7f308814d7f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:26:01.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.701+0000 7f3063fff640 1 --2- 10.20.193.58:0/3850839687 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3088161320 0x7f308814d7f0 unknown :-1 s=CLOSED pgs=319 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.697 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:26:01.697 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:26:01.697 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:26:01.697 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:26:01.697 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 36, 2026-02-23T06:26:01.697 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 299748, 2026-02-23T06:26:01.697 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:26:01.698 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:26:01.698 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:26:01.698 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:26:01.698 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:01.698 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 12, 2026-02-23T06:26:01.698 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:26:01.698 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:26:01.698 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:26:01.698 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:01.698 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:01.698 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:01.698 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:01.699 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:01.699 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:01.699 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:01.699 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:01.699 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:01.699 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:01.699 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:01.699 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:01.699 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:01.699 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:01.699 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:26:01.699 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:26:01.700 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:01.700 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:01.700 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:01.700 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:01.700 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:01.700 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:01.700 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:01.700 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:01.700 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:01.700 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:01.700 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:01.700 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:01.701 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:01.701 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:01.701 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.701 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:26:01.701 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:26:01.701 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:26:01.701 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:26:01.701 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:26:01.701 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:26:01.701 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:26:01.701 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:26:01.701 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:26:01.702 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:26:01.702 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:26:01.702 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:26:01.702 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:26:01.702 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:26:01.702 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:26:01.702 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:26:01.702 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:26:01.702 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:01.702 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:01.702 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:01.702 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:01.703 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:01.703 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:01.703 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:01.703 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:01.703 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:01.703 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:01.703 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:01.703 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:01.703 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:01.703 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:01.703 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:26:01.703 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.704 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:26:01.704 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.704 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:26:01.704 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:26:01.704 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:01.704 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:01.704 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.704 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:01.704 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:26:01.704 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:01.704 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.704 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.705 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:01.705 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:26:01.705 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:01.705 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:01.705 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:01.705 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.705 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:26:01.705 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:26:01.705 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:01.705 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:01.705 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:26:01.705 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:01.705 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.706 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.706 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:26:01.706 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:26:01.706 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:01.706 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:01.706 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.706 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:01.706 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:26:01.706 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:01.706 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.706 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.706 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:01.707 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:26:01.707 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:01.707 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:01.707 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:01.707 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.707 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:26:01.707 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:26:01.707 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:01.707 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:01.707 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:26:01.707 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:01.707 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.707 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.708 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:26:01.708 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:26:01.708 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:01.708 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:01.708 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.708 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:01.708 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:26:01.708 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:01.708 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.708 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.708 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:01.708 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:26:01.709 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:01.709 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:01.709 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:01.709 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.709 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:26:01.709 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:26:01.709 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:01.709 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:01.709 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:26:01.709 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:01.709 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:01.709 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:01.710 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.710 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:26:01.710 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:26:01.710 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.710 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:01.710 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:01.710 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:26:01.710 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:01.710 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:01.710 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:26:01.710 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.710 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:01.711 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:01.711 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:26:01.711 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:01.711 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:01.711 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:26:01.711 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.711 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:01.711 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:01.711 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:26:01.711 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:01.711 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:01.711 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:26:01.712 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.712 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:26:01.712 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:26:01.712 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:26:01.712 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.712 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.712 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:01.712 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:01.712 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:26:01.712 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:01.712 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:01.713 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:26:01.713 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.713 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:01.713 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:01.713 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:26:01.713 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:01.713 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:01.713 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.713 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:26:01.713 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:26:01.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.701+0000 7f308cc43640 1 -- 10.20.193.58:0/3850839687 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f305807a660 msgr2=0x7f305809ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:01.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.701+0000 7f308cc43640 1 --2- 10.20.193.58:0/3850839687 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f305807a660 0x7f305809ab10 secure :-1 s=READY pgs=184 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30780023d0 tx=0x7f3078031040 comp rx=0 tx=0).stop 2026-02-23T06:26:01.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.701+0000 7f308cc43640 1 -- 10.20.193.58:0/3850839687 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f308815d870 msgr2=0x7f3088161e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:01.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.701+0000 7f308cc43640 1 --2- 10.20.193.58:0/3850839687 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f308815d870 0x7f3088161e40 secure :-1 s=READY pgs=64 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f307c00f8d0 tx=0x7f307c00fda0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.701+0000 7f3087fff640 1 -- 10.20.193.58:0/3850839687 reap_dead start 2026-02-23T06:26:01.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.701+0000 7f3087fff640 1 -- 10.20.193.58:0/3850839687 reap_dead start 2026-02-23T06:26:01.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.701+0000 7f308cc43640 1 -- 10.20.193.58:0/3850839687 shutdown_connections 2026-02-23T06:26:01.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.701+0000 7f308cc43640 1 -- 10.20.193.58:0/3850839687 >> 10.20.193.58:0/3850839687 conn(0x7f30880b3c20 msgr2=0x7f30880b7480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:01.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.701+0000 7f308cc43640 1 -- 10.20.193.58:0/3850839687 shutdown_connections 2026-02-23T06:26:01.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.701+0000 7f308cc43640 1 -- 10.20.193.58:0/3850839687 wait complete. 2026-02-23T06:26:01.716 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:26:01.717 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:26:01.717 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:26:01.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.844+0000 7efc95e83640 1 -- 10.20.193.58:0/1055731643 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc9015c040 msgr2=0x7efc9005b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:01.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.844+0000 7efc95e83640 1 --2- 10.20.193.58:0/1055731643 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc9015c040 0x7efc9005b0e0 secure :-1 s=READY pgs=66 gs=3 cs=0 l=1 c_cookie=16503290957428123120 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc80004740 tx=0x7efc8002f1e0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.845+0000 7efc95e83640 1 -- 10.20.193.58:0/1055731643 shutdown_connections 2026-02-23T06:26:01.848 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.845+0000 7efc95e83640 1 --2- 10.20.193.58:0/1055731643 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc90056550 0x7efc9005ce30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.848 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.845+0000 7efc95e83640 1 --2- 10.20.193.58:0/1055731643 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc9015c040 0x7efc9005b0e0 unknown :-1 s=CLOSED pgs=66 gs=3 cs=0 l=1 c_cookie=16503290957428123120 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.848 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.845+0000 7efc95e83640 1 -- 10.20.193.58:0/1055731643 >> 10.20.193.58:0/1055731643 conn(0x7efc900b3c20 msgr2=0x7efc900b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:01.848 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.845+0000 7efc95e83640 1 -- 10.20.193.58:0/1055731643 shutdown_connections 2026-02-23T06:26:01.848 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.845+0000 7efc95e83640 1 -- 10.20.193.58:0/1055731643 wait complete. 2026-02-23T06:26:01.848 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.846+0000 7efc95e83640 1 Processor -- start 2026-02-23T06:26:01.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.846+0000 7efc95e83640 1 -- start start 2026-02-23T06:26:01.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.847+0000 7efc95e83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc90056550 0x7efc901fd6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:01.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.847+0000 7efc95e83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc9005d370 0x7efc900b1160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:01.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.847+0000 7efc95e83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc9015c040 0x7efc9015f4e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:01.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.847+0000 7efc95e83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7efc902010f0 con 0x7efc9015c040 2026-02-23T06:26:01.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.847+0000 7efc95e83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7efc901fdd30 con 0x7efc90056550 2026-02-23T06:26:01.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.847+0000 7efc95e83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7efc901fe010 con 0x7efc9005d370 2026-02-23T06:26:01.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.847+0000 7efc95682640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc9015c040 0x7efc9015f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:01.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.847+0000 7efc95682640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc9015c040 0x7efc9015f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:54540/0 (socket says 10.20.193.58:54540) 2026-02-23T06:26:01.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.847+0000 7efc95682640 1 -- 10.20.193.58:0/2037636109 learned_addr learned my addr 10.20.193.58:0/2037636109 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:26:01.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.847+0000 7efc87fff640 1 --2- 10.20.193.58:0/2037636109 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc9005d370 0x7efc900b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:01.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.847+0000 7efc94e81640 1 --2- 10.20.193.58:0/2037636109 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc90056550 0x7efc901fd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:01.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.847+0000 7efc95682640 1 -- 10.20.193.58:0/2037636109 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc9005d370 msgr2=0x7efc900b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:01.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.847+0000 7efc95682640 1 --2- 10.20.193.58:0/2037636109 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc9005d370 0x7efc900b1160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.847+0000 7efc95682640 1 -- 10.20.193.58:0/2037636109 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc90056550 msgr2=0x7efc901fd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:01.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.847+0000 7efc95682640 1 --2- 10.20.193.58:0/2037636109 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc90056550 0x7efc901fd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.847+0000 7efc95682640 1 -- 10.20.193.58:0/2037636109 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc800094b0 con 0x7efc9015c040 2026-02-23T06:26:01.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.847+0000 7efc95682640 1 --2- 10.20.193.58:0/2037636109 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc9015c040 0x7efc9015f4e0 secure :-1 s=READY pgs=67 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc8c00d700 tx=0x7efc8c00dbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:01.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.847+0000 7efc857fa640 1 -- 10.20.193.58:0/2037636109 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc8c005250 con 0x7efc9015c040 2026-02-23T06:26:01.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.847+0000 7efc857fa640 1 -- 10.20.193.58:0/2037636109 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc8c0054a0 con 0x7efc9015c040 2026-02-23T06:26:01.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.847+0000 7efc857fa640 1 -- 10.20.193.58:0/2037636109 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc8c004930 con 0x7efc9015c040 2026-02-23T06:26:01.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.847+0000 7efc95e83640 1 -- 10.20.193.58:0/2037636109 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc901fe2f0 con 0x7efc9015c040 2026-02-23T06:26:01.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.848+0000 7efc95e83640 1 -- 10.20.193.58:0/2037636109 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc901febe0 con 0x7efc9015c040 2026-02-23T06:26:01.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.848+0000 7efc95e83640 1 --2- 10.20.193.58:0/2037636109 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc90161da0 0x7efc90156320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:01.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.848+0000 7efc95e83640 1 -- 10.20.193.58:0/2037636109 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7efc90162170 con 0x7efc90161da0 2026-02-23T06:26:01.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.848+0000 7efc94e81640 1 --2- 10.20.193.58:0/2037636109 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc90161da0 0x7efc90156320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:01.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.849+0000 7efc94e81640 1 -- 10.20.193.58:0/2037636109 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efc9005b620 con 0x7efc90161da0 2026-02-23T06:26:01.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.849+0000 7efc94e81640 1 --2- 10.20.193.58:0/2037636109 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc90161da0 0x7efc90156320 secure :-1 s=READY pgs=10 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc80004740 tx=0x7efc800028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:01.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.849+0000 7efc857fa640 1 -- 10.20.193.58:0/2037636109 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7efc8c01a070 con 0x7efc9015c040 2026-02-23T06:26:01.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.850+0000 7efc857fa640 1 --2- 10.20.193.58:0/2037636109 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efc6007a600 0x7efc6009aab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:01.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.850+0000 7efc857fa640 1 -- 10.20.193.58:0/2037636109 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7efc8c09e530 con 0x7efc9015c040 2026-02-23T06:26:01.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.850+0000 7efc857fa640 1 -- 10.20.193.58:0/2037636109 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc8003d050 con 0x7efc90161da0 2026-02-23T06:26:01.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.850+0000 7efc857fa640 1 -- 10.20.193.58:0/2037636109 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7efc8003e040 con 0x7efc90161da0 2026-02-23T06:26:01.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.850+0000 7efc857fa640 1 -- 10.20.193.58:0/2037636109 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc90161da0 msgr2=0x7efc90156320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:01.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.850+0000 7efc857fa640 1 --2- 10.20.193.58:0/2037636109 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc90161da0 0x7efc90156320 secure :-1 s=READY pgs=10 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc80004740 tx=0x7efc800028d0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.850+0000 7efc857fa640 1 -- 10.20.193.58:0/2037636109 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc90161da0 msgr2=0x7efc90156320 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:26:01.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.850+0000 7efc857fa640 1 --2- 10.20.193.58:0/2037636109 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc90161da0 0x7efc90156320 secure :-1 s=CLOSED pgs=10 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc80004740 tx=0x7efc800028d0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.851+0000 7efc87fff640 1 --2- 10.20.193.58:0/2037636109 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efc6007a600 0x7efc6009aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:01.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.851+0000 7efc87fff640 1 --2- 10.20.193.58:0/2037636109 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efc6007a600 0x7efc6009aab0 secure :-1 s=READY pgs=185 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc90159cf0 tx=0x7efc78005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:01.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.854+0000 7efc95e83640 1 --2- 10.20.193.58:0/2037636109 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc901fe480 0x7efc90156860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:01.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.854+0000 7efc95e83640 1 -- 10.20.193.58:0/2037636109 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7efc90200f20 con 0x7efc901fe480 2026-02-23T06:26:01.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.854+0000 7efc94e81640 1 --2- 10.20.193.58:0/2037636109 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc901fe480 0x7efc90156860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:01.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.855+0000 7efc94e81640 1 -- 10.20.193.58:0/2037636109 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efc9015c410 con 0x7efc901fe480 2026-02-23T06:26:01.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.855+0000 7efc94e81640 1 --2- 10.20.193.58:0/2037636109 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc901fe480 0x7efc90156860 secure :-1 s=READY pgs=11 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc8002fed0 tx=0x7efc80005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:01.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.855+0000 7efc857fa640 1 -- 10.20.193.58:0/2037636109 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc80038e00 con 0x7efc901fe480 2026-02-23T06:26:01.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.855+0000 7efc857fa640 1 -- 10.20.193.58:0/2037636109 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4911 (secure 0 0 0) 0x7efc80043460 con 0x7efc901fe480 2026-02-23T06:26:01.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.855+0000 7efc857fa640 1 -- 10.20.193.58:0/2037636109 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc901fe480 msgr2=0x7efc90156860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:01.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.855+0000 7efc857fa640 1 --2- 10.20.193.58:0/2037636109 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc901fe480 0x7efc90156860 secure :-1 s=READY pgs=11 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc8002fed0 tx=0x7efc80005f90 comp rx=0 tx=0).stop 2026-02-23T06:26:01.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.855+0000 7efc857fa640 1 -- 10.20.193.58:0/2037636109 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc901fe480 msgr2=0x7efc90156860 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:26:01.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.855+0000 7efc857fa640 1 --2- 10.20.193.58:0/2037636109 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc901fe480 0x7efc90156860 secure :-1 s=CLOSED pgs=11 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc8002fed0 tx=0x7efc80005f90 comp rx=0 tx=0).stop 2026-02-23T06:26:01.860 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:26:01.860 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:26:01.861 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:26:01.861 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:26:01.861 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 36, 2026-02-23T06:26:01.861 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 36368, 2026-02-23T06:26:01.861 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:26:01.861 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:26:01.862 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:26:01.862 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:26:01.862 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:01.862 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 12, 2026-02-23T06:26:01.862 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:26:01.862 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:26:01.863 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:26:01.863 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:01.863 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:01.863 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:01.863 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:01.863 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:01.864 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:01.864 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:01.864 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:01.864 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:01.864 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:01.864 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:01.865 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:01.865 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:01.865 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:01.865 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:26:01.865 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:26:01.865 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:01.865 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:01.866 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:01.866 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:01.866 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:01.866 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:01.866 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:01.866 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:01.866 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:01.867 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:01.867 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:01.867 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:01.867 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:01.867 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:01.867 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.867 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:26:01.867 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:26:01.867 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:26:01.868 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:26:01.868 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:26:01.868 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:26:01.868 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:26:01.868 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:26:01.868 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:26:01.868 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:26:01.868 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:26:01.869 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:26:01.869 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:26:01.869 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:26:01.869 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:26:01.869 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:26:01.869 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:26:01.869 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:01.869 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:01.869 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:01.870 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:01.870 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:01.870 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:01.870 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:01.870 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:01.870 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:01.870 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:01.870 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:01.870 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:01.870 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:01.870 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:01.870 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:26:01.870 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.870 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:26:01.871 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.871 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:26:01.871 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:26:01.871 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:01.871 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:01.871 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.871 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:01.871 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:26:01.871 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:01.871 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.871 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.871 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:01.871 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:26:01.871 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:01.872 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:01.872 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:01.872 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.872 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:26:01.872 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:26:01.872 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:01.872 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:01.872 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:26:01.872 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:01.872 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.872 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.872 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:26:01.872 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:26:01.872 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:01.873 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:01.873 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.873 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:01.873 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:26:01.873 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:01.873 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.873 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.873 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:01.874 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:26:01.874 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:01.874 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:01.874 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:01.874 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.874 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:26:01.874 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:26:01.874 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:01.874 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:01.874 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:26:01.874 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:01.874 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.874 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.874 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:26:01.875 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:26:01.875 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:01.875 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:01.875 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.875 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:01.875 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:26:01.875 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:01.875 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.875 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.875 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:01.875 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:26:01.875 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:01.875 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:01.875 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:01.875 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.875 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:26:01.876 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:26:01.876 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:01.876 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:01.876 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:26:01.876 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:01.876 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:01.876 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:01.876 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.876 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:26:01.876 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:26:01.876 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.876 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:01.876 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:01.876 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:26:01.876 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:01.876 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:01.876 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:26:01.877 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:01.877 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:01.877 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:01.877 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:26:01.877 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:01.877 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:01.877 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:01.877 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:26:01.877 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:26:01.878 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.855+0000 7efc95e83640 1 -- 10.20.193.58:0/2037636109 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efc6007a600 msgr2=0x7efc6009aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:01.878 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.855+0000 7efc95e83640 1 --2- 10.20.193.58:0/2037636109 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efc6007a600 0x7efc6009aab0 secure :-1 s=READY pgs=185 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc90159cf0 tx=0x7efc78005f90 comp rx=0 tx=0).stop 2026-02-23T06:26:01.878 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.855+0000 7efc95e83640 1 -- 10.20.193.58:0/2037636109 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc9015c040 msgr2=0x7efc9015f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:01.878 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.855+0000 7efc95e83640 1 --2- 10.20.193.58:0/2037636109 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc9015c040 0x7efc9015f4e0 secure :-1 s=READY pgs=67 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc8c00d700 tx=0x7efc8c00dbd0 comp rx=0 tx=0).stop 2026-02-23T06:26:01.879 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.855+0000 7efc95682640 1 -- 10.20.193.58:0/2037636109 reap_dead start 2026-02-23T06:26:01.879 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.855+0000 7efc95682640 1 -- 10.20.193.58:0/2037636109 reap_dead start 2026-02-23T06:26:01.879 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.856+0000 7efc95e83640 1 -- 10.20.193.58:0/2037636109 shutdown_connections 2026-02-23T06:26:01.879 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.856+0000 7efc95e83640 1 -- 10.20.193.58:0/2037636109 >> 10.20.193.58:0/2037636109 conn(0x7efc900b3c20 msgr2=0x7efc900b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:01.879 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.856+0000 7efc95e83640 1 -- 10.20.193.58:0/2037636109 shutdown_connections 2026-02-23T06:26:01.879 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:01.856+0000 7efc95e83640 1 -- 10.20.193.58:0/2037636109 wait complete. 2026-02-23T06:26:01.879 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:26:01.879 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-23T06:26:01.879 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-23T06:26:01.880 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-23T06:26:01.880 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-23T06:26:01.880 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-23T06:26:01.880 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:26:01.890 INFO:tasks.ceph.mon.b:Stopped 2026-02-23T06:26:01.890 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:26:01.890 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:26:02.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.019+0000 7f6bde7fc640 1 -- 10.20.193.58:0/1611246633 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6bcc005290 con 0x7f6be00b7050 2026-02-23T06:26:02.016 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.020+0000 7f6bdffff640 1 -- 10.20.193.58:0/1611246633 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6be00b7050 msgr2=0x7f6be015b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:02.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.020+0000 7f6bdffff640 1 --2- 10.20.193.58:0/1611246633 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6be00b7050 0x7f6be015b230 secure :-1 s=READY pgs=68 gs=2 cs=0 l=1 c_cookie=8124383985528845162 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6be00b6d00 tx=0x7f6bcc038e70 comp rx=0 tx=0).stop 2026-02-23T06:26:02.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.020+0000 7f6bdffff640 1 -- 10.20.193.58:0/1611246633 shutdown_connections 2026-02-23T06:26:02.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.020+0000 7f6bdffff640 1 --2- 10.20.193.58:0/1611246633 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6be00b7050 0x7f6be015b230 unknown :-1 s=CLOSED pgs=68 gs=2 cs=0 l=1 c_cookie=8124383985528845162 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:02.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.020+0000 7f6bdffff640 1 --2- 10.20.193.58:0/1611246633 >> v2:10.20.193.93:3300/0 conn(0x7f6be00b4ad0 0x7f6be00561f0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:02.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.020+0000 7f6bdffff640 1 -- 10.20.193.58:0/1611246633 >> 10.20.193.58:0/1611246633 conn(0x7f6be00b3c20 msgr2=0x7f6be00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:02.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.020+0000 7f6bdffff640 1 -- 10.20.193.58:0/1611246633 shutdown_connections 2026-02-23T06:26:02.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.020+0000 7f6bdffff640 1 -- 10.20.193.58:0/1611246633 wait complete. 2026-02-23T06:26:02.019 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.021+0000 7f6bdffff640 1 Processor -- start 2026-02-23T06:26:02.020 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.021+0000 7f6bdffff640 1 -- start start 2026-02-23T06:26:02.020 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.022+0000 7f6bdffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6be00b4ad0 0x7f6be0160520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:02.020 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.022+0000 7f6bdffff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6be00b7050 0x7f6be0156f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:02.020 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.022+0000 7f6bdffff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6be015b770 0x7f6be015f220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:02.020 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.022+0000 7f6bdffff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f6be0119e20 con 0x7f6be00b4ad0 2026-02-23T06:26:02.020 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.022+0000 7f6bdffff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f6be0160a60 con 0x7f6be015b770 2026-02-23T06:26:02.020 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.022+0000 7f6bdffff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f6be0161330 con 0x7f6be00b7050 2026-02-23T06:26:02.020 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.022+0000 7f6bdeffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6be00b4ad0 0x7f6be0160520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:02.020 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.022+0000 7f6bdeffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6be00b4ad0 0x7f6be0160520 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:54584/0 (socket says 10.20.193.58:54584) 2026-02-23T06:26:02.020 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.022+0000 7f6bdeffd640 1 -- 10.20.193.58:0/1471354757 learned_addr learned my addr 10.20.193.58:0/1471354757 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:26:02.021 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.023+0000 7f6bdf7fe640 1 -- 10.20.193.58:0/1471354757 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6be015b770 msgr2=0x7f6be015f220 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:26:02.021 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.023+0000 7f6bdf7fe640 1 --2- 10.20.193.58:0/1471354757 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6be015b770 0x7f6be015f220 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:26:02.021 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.023+0000 7f6bdeffd640 1 -- 10.20.193.58:0/1471354757 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6be00b7050 msgr2=0x7f6be0156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:02.021 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.023+0000 7f6bdeffd640 1 --2- 10.20.193.58:0/1471354757 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6be00b7050 0x7f6be0156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:02.021 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.023+0000 7f6bdeffd640 1 -- 10.20.193.58:0/1471354757 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6be015b770 msgr2=0x7f6be015f220 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:26:02.021 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.023+0000 7f6bdeffd640 1 --2- 10.20.193.58:0/1471354757 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6be015b770 0x7f6be015f220 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:02.021 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.023+0000 7f6bdeffd640 1 -- 10.20.193.58:0/1471354757 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bcc00a650 con 0x7f6be00b4ad0 2026-02-23T06:26:02.021 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.023+0000 7f6bdeffd640 1 --2- 10.20.193.58:0/1471354757 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6be00b4ad0 0x7f6be0160520 secure :-1 s=READY pgs=69 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6bc400b450 tx=0x7f6bc400b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:02.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.023+0000 7f6bd77fe640 1 -- 10.20.193.58:0/1471354757 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6bc40044a0 con 0x7f6be00b4ad0 2026-02-23T06:26:02.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.023+0000 7f6bd77fe640 1 -- 10.20.193.58:0/1471354757 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6bc4002790 con 0x7f6be00b4ad0 2026-02-23T06:26:02.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.023+0000 7f6bd77fe640 1 -- 10.20.193.58:0/1471354757 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6bc4002ba0 con 0x7f6be00b4ad0 2026-02-23T06:26:02.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.023+0000 7f6bdffff640 1 -- 10.20.193.58:0/1471354757 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6be01192e0 con 0x7f6be00b4ad0 2026-02-23T06:26:02.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.024+0000 7f6bdffff640 1 -- 10.20.193.58:0/1471354757 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6be0160fc0 con 0x7f6be00b4ad0 2026-02-23T06:26:02.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.024+0000 7f6bdffff640 1 -- 10.20.193.58:0/1471354757 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6be015b230 con 0x7f6be00b4ad0 2026-02-23T06:26:02.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.025+0000 7f6bd77fe640 1 -- 10.20.193.58:0/1471354757 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f6bc4002d00 con 0x7f6be00b4ad0 2026-02-23T06:26:02.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.026+0000 7f6bd77fe640 1 --2- 10.20.193.58:0/1471354757 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6bac07a5b0 0x7f6bac09aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:02.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.026+0000 7f6bd77fe640 1 -- 10.20.193.58:0/1471354757 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f6bc409d330 con 0x7f6be00b4ad0 2026-02-23T06:26:02.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.027+0000 7f6bd7fff640 1 --2- 10.20.193.58:0/1471354757 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6bac07a5b0 0x7f6bac09aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:02.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.027+0000 7f6bd7fff640 1 --2- 10.20.193.58:0/1471354757 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6bac07a5b0 0x7f6bac09aa60 secure :-1 s=READY pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6bcc0034b0 tx=0x7f6bcc005850 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:02.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.027+0000 7f6bd77fe640 1 -- 10.20.193.58:0/1471354757 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f6bc4060440 con 0x7f6be00b4ad0 2026-02-23T06:26:02.179 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.184+0000 7f6bdffff640 1 -- 10.20.193.58:0/1471354757 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6be0160e00 con 0x7f6be00b4ad0 2026-02-23T06:26:02.179 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.184+0000 7f6bd77fe640 1 -- 10.20.193.58:0/1471354757 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f6bc4063560 con 0x7f6be00b4ad0 2026-02-23T06:26:02.180 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":36,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:26:02.181 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.185+0000 7f6bdffff640 1 -- 10.20.193.58:0/1471354757 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6bac07a5b0 msgr2=0x7f6bac09aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:02.181 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.185+0000 7f6bdffff640 1 --2- 10.20.193.58:0/1471354757 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6bac07a5b0 0x7f6bac09aa60 secure :-1 s=READY pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6bcc0034b0 tx=0x7f6bcc005850 comp rx=0 tx=0).stop 2026-02-23T06:26:02.181 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.185+0000 7f6bdffff640 1 -- 10.20.193.58:0/1471354757 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6be00b4ad0 msgr2=0x7f6be0160520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:02.181 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.185+0000 7f6bdffff640 1 --2- 10.20.193.58:0/1471354757 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6be00b4ad0 0x7f6be0160520 secure :-1 s=READY pgs=69 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6bc400b450 tx=0x7f6bc400b920 comp rx=0 tx=0).stop 2026-02-23T06:26:02.181 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.185+0000 7f6bdffff640 1 -- 10.20.193.58:0/1471354757 shutdown_connections 2026-02-23T06:26:02.182 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.185+0000 7f6bdffff640 1 --2- 10.20.193.58:0/1471354757 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6bac07a5b0 0x7f6bac09aa60 unknown :-1 s=CLOSED pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:02.182 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.185+0000 7f6bdffff640 1 --2- 10.20.193.58:0/1471354757 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6be015b770 0x7f6be015f220 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:02.182 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.185+0000 7f6bdffff640 1 --2- 10.20.193.58:0/1471354757 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6be00b7050 0x7f6be0156f40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:02.182 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.185+0000 7f6bdffff640 1 --2- 10.20.193.58:0/1471354757 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6be00b4ad0 0x7f6be0160520 unknown :-1 s=CLOSED pgs=69 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:02.182 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.185+0000 7f6bdffff640 1 -- 10.20.193.58:0/1471354757 >> 10.20.193.58:0/1471354757 conn(0x7f6be00b3c20 msgr2=0x7f6be00b5fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:02.182 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.185+0000 7f6bdffff640 1 -- 10.20.193.58:0/1471354757 shutdown_connections 2026-02-23T06:26:02.182 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:02.185+0000 7f6bdffff640 1 -- 10.20.193.58:0/1471354757 wait complete. 2026-02-23T06:26:05.195 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:26:05.318 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.322+0000 7f463b344640 1 -- 10.20.193.58:0/3551440466 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f463415d4a0 msgr2=0x7f46340affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:05.318 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.322+0000 7f463b344640 1 --2- 10.20.193.58:0/3551440466 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f463415d4a0 0x7f46340affb0 secure :-1 s=READY pgs=75 gs=3 cs=0 l=1 c_cookie=6850059140801003986 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4624004740 tx=0x7f462402f1f0 comp rx=0 tx=0).stop 2026-02-23T06:26:05.318 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.322+0000 7f463b344640 1 -- 10.20.193.58:0/3551440466 shutdown_connections 2026-02-23T06:26:05.318 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.322+0000 7f463b344640 1 --2- 10.20.193.58:0/3551440466 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f463415d4a0 0x7f46340affb0 unknown :-1 s=CLOSED pgs=75 gs=3 cs=0 l=1 c_cookie=6850059140801003986 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:05.318 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.322+0000 7f463b344640 1 -- 10.20.193.58:0/3551440466 >> 10.20.193.58:0/3551440466 conn(0x7f46340b3c20 msgr2=0x7f46340b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:05.318 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.322+0000 7f463b344640 1 -- 10.20.193.58:0/3551440466 shutdown_connections 2026-02-23T06:26:05.318 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.322+0000 7f463b344640 1 -- 10.20.193.58:0/3551440466 wait complete. 2026-02-23T06:26:05.321 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.324+0000 7f463b344640 1 Processor -- start 2026-02-23T06:26:05.321 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.324+0000 7f463b344640 1 -- start start 2026-02-23T06:26:05.321 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.324+0000 7f463b344640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f46340b6690 0x7f4634161420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:05.321 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.324+0000 7f463b344640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f463415d4a0 0x7f463411afa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:05.321 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.324+0000 7f463b344640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f463415d870 0x7f463414b770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:05.321 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.324+0000 7f463b344640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f4634148e80 con 0x7f463415d870 2026-02-23T06:26:05.321 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.324+0000 7f463b344640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f4634161960 con 0x7f463415d4a0 2026-02-23T06:26:05.321 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.324+0000 7f463b344640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f4634147f40 con 0x7f46340b6690 2026-02-23T06:26:05.321 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.324+0000 7f4639b41640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f463415d4a0 msgr2=0x7f463411afa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:26:05.321 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.324+0000 7f4639b41640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f463415d4a0 0x7f463411afa0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:26:05.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.324+0000 7f463ab43640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f463415d870 0x7f463414b770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:05.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.324+0000 7f463ab43640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f463415d870 0x7f463414b770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:54594/0 (socket says 10.20.193.58:54594) 2026-02-23T06:26:05.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.324+0000 7f463ab43640 1 -- 10.20.193.58:0/1124350232 learned_addr learned my addr 10.20.193.58:0/1124350232 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:26:05.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.325+0000 7f463a342640 1 --2- 10.20.193.58:0/1124350232 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f46340b6690 0x7f4634161420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:05.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.325+0000 7f463ab43640 1 -- 10.20.193.58:0/1124350232 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f46340b6690 msgr2=0x7f4634161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:05.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.325+0000 7f463ab43640 1 --2- 10.20.193.58:0/1124350232 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f46340b6690 0x7f4634161420 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:05.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.325+0000 7f463ab43640 1 -- 10.20.193.58:0/1124350232 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f463415d4a0 msgr2=0x7f463411afa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:26:05.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.325+0000 7f463ab43640 1 --2- 10.20.193.58:0/1124350232 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f463415d4a0 0x7f463411afa0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:05.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.325+0000 7f463ab43640 1 -- 10.20.193.58:0/1124350232 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46240094b0 con 0x7f463415d870 2026-02-23T06:26:05.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.325+0000 7f463ab43640 1 --2- 10.20.193.58:0/1124350232 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f463415d870 0x7f463414b770 secure :-1 s=READY pgs=76 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4630008ce0 tx=0x7f463000dba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:05.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.325+0000 7f461affd640 1 -- 10.20.193.58:0/1124350232 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f463000b860 con 0x7f463415d870 2026-02-23T06:26:05.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.325+0000 7f463b344640 1 -- 10.20.193.58:0/1124350232 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4634148200 con 0x7f463415d870 2026-02-23T06:26:05.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.325+0000 7f463b344640 1 -- 10.20.193.58:0/1124350232 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46341487c0 con 0x7f463415d870 2026-02-23T06:26:05.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.325+0000 7f461affd640 1 -- 10.20.193.58:0/1124350232 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f463000bab0 con 0x7f463415d870 2026-02-23T06:26:05.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.325+0000 7f461affd640 1 -- 10.20.193.58:0/1124350232 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f463000bea0 con 0x7f463415d870 2026-02-23T06:26:05.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.326+0000 7f463b344640 1 -- 10.20.193.58:0/1124350232 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46340b7f70 con 0x7f463415d870 2026-02-23T06:26:05.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.327+0000 7f461affd640 1 -- 10.20.193.58:0/1124350232 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f4630023020 con 0x7f463415d870 2026-02-23T06:26:05.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.328+0000 7f461affd640 1 --2- 10.20.193.58:0/1124350232 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f460407a5b0 0x7f460409aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:05.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.328+0000 7f461affd640 1 -- 10.20.193.58:0/1124350232 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f463009e440 con 0x7f463415d870 2026-02-23T06:26:05.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.328+0000 7f463a342640 1 --2- 10.20.193.58:0/1124350232 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f460407a5b0 0x7f460409aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:05.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.329+0000 7f463a342640 1 --2- 10.20.193.58:0/1124350232 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f460407a5b0 0x7f460409aa60 secure :-1 s=READY pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46240023d0 tx=0x7f4624031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:05.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.330+0000 7f461affd640 1 -- 10.20.193.58:0/1124350232 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f4630061550 con 0x7f463415d870 2026-02-23T06:26:05.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.486+0000 7f463b344640 1 -- 10.20.193.58:0/1124350232 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f463415b110 con 0x7f463415d870 2026-02-23T06:26:05.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.487+0000 7f461affd640 1 -- 10.20.193.58:0/1124350232 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f4630064670 con 0x7f463415d870 2026-02-23T06:26:05.484 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":36,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:26:05.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.489+0000 7f463b344640 1 -- 10.20.193.58:0/1124350232 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f460407a5b0 msgr2=0x7f460409aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:05.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.489+0000 7f463b344640 1 --2- 10.20.193.58:0/1124350232 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f460407a5b0 0x7f460409aa60 secure :-1 s=READY pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46240023d0 tx=0x7f4624031040 comp rx=0 tx=0).stop 2026-02-23T06:26:05.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.489+0000 7f463b344640 1 -- 10.20.193.58:0/1124350232 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f463415d870 msgr2=0x7f463414b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:05.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.489+0000 7f463b344640 1 --2- 10.20.193.58:0/1124350232 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f463415d870 0x7f463414b770 secure :-1 s=READY pgs=76 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4630008ce0 tx=0x7f463000dba0 comp rx=0 tx=0).stop 2026-02-23T06:26:05.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.490+0000 7f463b344640 1 -- 10.20.193.58:0/1124350232 shutdown_connections 2026-02-23T06:26:05.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.490+0000 7f463b344640 1 --2- 10.20.193.58:0/1124350232 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f460407a5b0 0x7f460409aa60 unknown :-1 s=CLOSED pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:05.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.490+0000 7f463b344640 1 --2- 10.20.193.58:0/1124350232 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f463415d870 0x7f463414b770 unknown :-1 s=CLOSED pgs=76 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:05.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.490+0000 7f463b344640 1 --2- 10.20.193.58:0/1124350232 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f463415d4a0 0x7f463411afa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:05.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.490+0000 7f463b344640 1 --2- 10.20.193.58:0/1124350232 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f46340b6690 0x7f4634161420 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:05.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.490+0000 7f463b344640 1 -- 10.20.193.58:0/1124350232 >> 10.20.193.58:0/1124350232 conn(0x7f46340b3c20 msgr2=0x7f46340b1100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:05.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.490+0000 7f463b344640 1 -- 10.20.193.58:0/1124350232 shutdown_connections 2026-02-23T06:26:05.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:05.490+0000 7f463b344640 1 -- 10.20.193.58:0/1124350232 wait complete. 2026-02-23T06:26:08.499 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:26:08.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.626+0000 7fae2e95c640 1 -- 10.20.193.58:0/2135774499 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fae280b6690 msgr2=0x7fae28058ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:08.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.626+0000 7fae2e95c640 1 --2- 10.20.193.58:0/2135774499 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fae280b6690 0x7fae28058ec0 secure :-1 s=READY pgs=79 gs=4 cs=0 l=1 c_cookie=13595980411865976156 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae24005820 tx=0x7fae240302b0 comp rx=0 tx=0).stop 2026-02-23T06:26:08.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.626+0000 7fae2e95c640 1 -- 10.20.193.58:0/2135774499 shutdown_connections 2026-02-23T06:26:08.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.626+0000 7fae2e95c640 1 --2- 10.20.193.58:0/2135774499 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fae280b6690 0x7fae28058ec0 unknown :-1 s=CLOSED pgs=79 gs=4 cs=0 l=1 c_cookie=13595980411865976156 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:08.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.626+0000 7fae2e95c640 1 -- 10.20.193.58:0/2135774499 >> 10.20.193.58:0/2135774499 conn(0x7fae280b3c20 msgr2=0x7fae280b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:08.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.626+0000 7fae2e95c640 1 -- 10.20.193.58:0/2135774499 shutdown_connections 2026-02-23T06:26:08.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.626+0000 7fae2e95c640 1 -- 10.20.193.58:0/2135774499 wait complete. 2026-02-23T06:26:08.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.627+0000 7fae2e95c640 1 Processor -- start 2026-02-23T06:26:08.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.627+0000 7fae2e95c640 1 -- start start 2026-02-23T06:26:08.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.627+0000 7fae2e95c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fae280b6690 0x7fae2811edd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:08.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.627+0000 7fae2e95c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fae2815d4a0 0x7fae2813b1a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:08.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.627+0000 7fae2e95c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fae2815d870 0x7fae2813b6e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:08.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.627+0000 7fae2e95c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fae281610e0 con 0x7fae2815d4a0 2026-02-23T06:26:08.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.627+0000 7fae2e95c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fae2811e9b0 con 0x7fae280b6690 2026-02-23T06:26:08.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.627+0000 7fae2e95c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fae28147ec0 con 0x7fae2815d870 2026-02-23T06:26:08.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.627+0000 7fae2d159640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fae2815d4a0 0x7fae2813b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:08.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.627+0000 7fae2d159640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fae2815d4a0 0x7fae2813b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:54606/0 (socket says 10.20.193.58:54606) 2026-02-23T06:26:08.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.627+0000 7fae2d159640 1 -- 10.20.193.58:0/2498797846 learned_addr learned my addr 10.20.193.58:0/2498797846 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:26:08.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.627+0000 7fae2d159640 1 -- 10.20.193.58:0/2498797846 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fae2815d870 msgr2=0x7fae2813b6e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-23T06:26:08.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.627+0000 7fae2d159640 1 --2- 10.20.193.58:0/2498797846 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fae2815d870 0x7fae2813b6e0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:08.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.627+0000 7fae2d159640 1 -- 10.20.193.58:0/2498797846 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fae280b6690 msgr2=0x7fae2811edd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-23T06:26:08.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.627+0000 7fae2d159640 1 --2- 10.20.193.58:0/2498797846 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fae280b6690 0x7fae2811edd0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:08.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.627+0000 7fae2d159640 1 -- 10.20.193.58:0/2498797846 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2400a590 con 0x7fae2815d4a0 2026-02-23T06:26:08.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.627+0000 7fae2d159640 1 --2- 10.20.193.58:0/2498797846 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fae2815d4a0 0x7fae2813b1a0 secure :-1 s=READY pgs=80 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae1c00c4d0 tx=0x7fae1c00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:08.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.627+0000 7fae167fc640 1 -- 10.20.193.58:0/2498797846 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fae1c012850 con 0x7fae2815d4a0 2026-02-23T06:26:08.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.627+0000 7fae167fc640 1 -- 10.20.193.58:0/2498797846 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae1c012aa0 con 0x7fae2815d4a0 2026-02-23T06:26:08.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.627+0000 7fae2e95c640 1 -- 10.20.193.58:0/2498797846 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae2811de30 con 0x7fae2815d4a0 2026-02-23T06:26:08.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.627+0000 7fae167fc640 1 -- 10.20.193.58:0/2498797846 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fae1c012e30 con 0x7fae2815d4a0 2026-02-23T06:26:08.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.627+0000 7fae2e95c640 1 -- 10.20.193.58:0/2498797846 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae2811e3f0 con 0x7fae2815d4a0 2026-02-23T06:26:08.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.627+0000 7fae2e95c640 1 -- 10.20.193.58:0/2498797846 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae280b6d50 con 0x7fae2815d4a0 2026-02-23T06:26:08.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.627+0000 7fae167fc640 1 -- 10.20.193.58:0/2498797846 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fae1c01b400 con 0x7fae2815d4a0 2026-02-23T06:26:08.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.627+0000 7fae167fc640 1 --2- 10.20.193.58:0/2498797846 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fadf807a790 0x7fadf809ac40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:08.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.627+0000 7fae167fc640 1 -- 10.20.193.58:0/2498797846 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fae1c09d9c0 con 0x7fae2815d4a0 2026-02-23T06:26:08.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.632+0000 7fae167fc640 1 -- 10.20.193.58:0/2498797846 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fae1c060ac0 con 0x7fae2815d4a0 2026-02-23T06:26:08.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.635+0000 7fae2d95a640 1 --2- 10.20.193.58:0/2498797846 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fadf807a790 0x7fadf809ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:08.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.635+0000 7fae2d95a640 1 --2- 10.20.193.58:0/2498797846 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fadf807a790 0x7fadf809ac40 secure :-1 s=READY pgs=188 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae18002820 tx=0x7fae18006cf0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:08.786 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.791+0000 7fae2e95c640 1 -- 10.20.193.58:0/2498797846 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fae28164250 con 0x7fae2815d4a0 2026-02-23T06:26:08.786 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.791+0000 7fae167fc640 1 -- 10.20.193.58:0/2498797846 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7fae1c063c70 con 0x7fae2815d4a0 2026-02-23T06:26:08.786 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":36,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:26:08.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.792+0000 7fae2e95c640 1 -- 10.20.193.58:0/2498797846 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fadf807a790 msgr2=0x7fadf809ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:08.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.792+0000 7fae2e95c640 1 --2- 10.20.193.58:0/2498797846 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fadf807a790 0x7fadf809ac40 secure :-1 s=READY pgs=188 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae18002820 tx=0x7fae18006cf0 comp rx=0 tx=0).stop 2026-02-23T06:26:08.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.792+0000 7fae2e95c640 1 -- 10.20.193.58:0/2498797846 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fae2815d4a0 msgr2=0x7fae2813b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:08.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.792+0000 7fae2e95c640 1 --2- 10.20.193.58:0/2498797846 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fae2815d4a0 0x7fae2813b1a0 secure :-1 s=READY pgs=80 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae1c00c4d0 tx=0x7fae1c00c9a0 comp rx=0 tx=0).stop 2026-02-23T06:26:08.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.792+0000 7fae2e95c640 1 -- 10.20.193.58:0/2498797846 shutdown_connections 2026-02-23T06:26:08.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.792+0000 7fae2e95c640 1 --2- 10.20.193.58:0/2498797846 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fadf807a790 0x7fadf809ac40 unknown :-1 s=CLOSED pgs=188 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:08.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.792+0000 7fae2e95c640 1 --2- 10.20.193.58:0/2498797846 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fae2815d870 0x7fae2813b6e0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:08.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.792+0000 7fae2e95c640 1 --2- 10.20.193.58:0/2498797846 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fae2815d4a0 0x7fae2813b1a0 unknown :-1 s=CLOSED pgs=80 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:08.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.792+0000 7fae2e95c640 1 --2- 10.20.193.58:0/2498797846 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fae280b6690 0x7fae2811edd0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:08.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.792+0000 7fae2e95c640 1 -- 10.20.193.58:0/2498797846 >> 10.20.193.58:0/2498797846 conn(0x7fae280b3c20 msgr2=0x7fae2805c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:08.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.792+0000 7fae2e95c640 1 -- 10.20.193.58:0/2498797846 shutdown_connections 2026-02-23T06:26:08.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:08.792+0000 7fae2e95c640 1 -- 10.20.193.58:0/2498797846 wait complete. 2026-02-23T06:26:11.801 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:26:12.389 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:26:12.394 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:26:17.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.928+0000 7fd3f3577640 1 -- 10.20.193.58:0/1387754640 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd3d0023cd0 msgr2=0x7fd3d00683e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:17.924 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.928+0000 7fd3f3577640 1 --2- 10.20.193.58:0/1387754640 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd3d0023cd0 0x7fd3d00683e0 secure :-1 s=READY pgs=85 gs=30 cs=0 l=1 c_cookie=14985146483338318688 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3f4160f40 tx=0x7fd3e4030df0 comp rx=0 tx=0).stop 2026-02-23T06:26:17.924 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.928+0000 7fd3f3577640 1 -- 10.20.193.58:0/1387754640 shutdown_connections 2026-02-23T06:26:17.924 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.928+0000 7fd3f3577640 1 --2- 10.20.193.58:0/1387754640 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd3d0023cd0 0x7fd3d00683e0 unknown :-1 s=CLOSED pgs=85 gs=30 cs=0 l=1 c_cookie=14985146483338318688 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:17.924 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.928+0000 7fd3f3577640 1 -- 10.20.193.58:0/1387754640 >> 10.20.193.58:0/1387754640 conn(0x7fd3f40b3c20 msgr2=0x7fd3f40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:17.924 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.928+0000 7fd3f3577640 1 -- 10.20.193.58:0/1387754640 shutdown_connections 2026-02-23T06:26:17.924 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.928+0000 7fd3f3577640 1 -- 10.20.193.58:0/1387754640 wait complete. 2026-02-23T06:26:17.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.929+0000 7fd3f3577640 1 Processor -- start 2026-02-23T06:26:17.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.929+0000 7fd3f3577640 1 -- start start 2026-02-23T06:26:17.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.930+0000 7fd3f3577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd3d0023cd0 0x7fd3f42017c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:17.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.930+0000 7fd3f3577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd3d0045f30 0x7fd3f41405c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:17.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.930+0000 7fd3f3577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd3d0046b30 0x7fd3f413b260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:17.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.930+0000 7fd3f3577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f413fd90 con 0x7fd3d0045f30 2026-02-23T06:26:17.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.930+0000 7fd3f3577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f4201330 con 0x7fd3d0023cd0 2026-02-23T06:26:17.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.930+0000 7fd3f3577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fd3f4138b10 con 0x7fd3d0046b30 2026-02-23T06:26:17.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.930+0000 7fd3f2575640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd3d0023cd0 msgr2=0x7fd3f42017c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:26:17.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.930+0000 7fd3f1d74640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd3d0045f30 0x7fd3f41405c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:17.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.930+0000 7fd3f2575640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd3d0023cd0 0x7fd3f42017c0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:26:17.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.930+0000 7fd3f1d74640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd3d0045f30 0x7fd3f41405c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:51740/0 (socket says 10.20.193.58:51740) 2026-02-23T06:26:17.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.930+0000 7fd3f1d74640 1 -- 10.20.193.58:0/3330258626 learned_addr learned my addr 10.20.193.58:0/3330258626 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:26:17.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.930+0000 7fd3f2d76640 1 --2- 10.20.193.58:0/3330258626 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd3d0046b30 0x7fd3f413b260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:17.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.930+0000 7fd3f1d74640 1 -- 10.20.193.58:0/3330258626 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd3d0046b30 msgr2=0x7fd3f413b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:17.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.930+0000 7fd3f1d74640 1 --2- 10.20.193.58:0/3330258626 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd3d0046b30 0x7fd3f413b260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:17.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.930+0000 7fd3f1d74640 1 -- 10.20.193.58:0/3330258626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd3d0023cd0 msgr2=0x7fd3f42017c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:26:17.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.930+0000 7fd3f1d74640 1 --2- 10.20.193.58:0/3330258626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd3d0023cd0 0x7fd3f42017c0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:17.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.930+0000 7fd3f1d74640 1 -- 10.20.193.58:0/3330258626 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e4005500 con 0x7fd3d0045f30 2026-02-23T06:26:17.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.930+0000 7fd3f1d74640 1 --2- 10.20.193.58:0/3330258626 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd3d0045f30 0x7fd3f41405c0 secure :-1 s=READY pgs=86 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3dc00c4b0 tx=0x7fd3dc00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:17.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.930+0000 7fd3daffd640 1 -- 10.20.193.58:0/3330258626 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd3dc012850 con 0x7fd3d0045f30 2026-02-23T06:26:17.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.931+0000 7fd3f3577640 1 -- 10.20.193.58:0/3330258626 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3f4160f90 con 0x7fd3d0045f30 2026-02-23T06:26:17.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.931+0000 7fd3daffd640 1 -- 10.20.193.58:0/3330258626 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3dc012aa0 con 0x7fd3d0045f30 2026-02-23T06:26:17.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.931+0000 7fd3daffd640 1 -- 10.20.193.58:0/3330258626 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd3dc012e70 con 0x7fd3d0045f30 2026-02-23T06:26:17.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.931+0000 7fd3f3577640 1 -- 10.20.193.58:0/3330258626 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3f413ffc0 con 0x7fd3d0045f30 2026-02-23T06:26:17.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.931+0000 7fd3f3577640 1 -- 10.20.193.58:0/3330258626 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3f40b6d50 con 0x7fd3d0045f30 2026-02-23T06:26:17.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.932+0000 7fd3daffd640 1 -- 10.20.193.58:0/3330258626 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fd3dc01b400 con 0x7fd3d0045f30 2026-02-23T06:26:17.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.933+0000 7fd3daffd640 1 --2- 10.20.193.58:0/3330258626 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd3c007a5b0 0x7fd3c009aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:17.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.933+0000 7fd3daffd640 1 -- 10.20.193.58:0/3330258626 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fd3dc09d930 con 0x7fd3d0045f30 2026-02-23T06:26:17.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.933+0000 7fd3f2575640 1 --2- 10.20.193.58:0/3330258626 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd3c007a5b0 0x7fd3c009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:17.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.934+0000 7fd3f2575640 1 --2- 10.20.193.58:0/3330258626 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd3c007a5b0 0x7fd3c009aa60 secure :-1 s=READY pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3e8002820 tx=0x7fd3e80090e0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:17.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:17.935+0000 7fd3daffd640 1 -- 10.20.193.58:0/3330258626 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fd3dc060ad0 con 0x7fd3d0045f30 2026-02-23T06:26:18.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.090+0000 7fd3f3577640 1 -- 10.20.193.58:0/3330258626 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd3f405b0e0 con 0x7fd3d0045f30 2026-02-23T06:26:18.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.091+0000 7fd3daffd640 1 -- 10.20.193.58:0/3330258626 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1748 (secure 0 0 0) 0x7fd3dc063bf0 con 0x7fd3d0045f30 2026-02-23T06:26:18.086 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":40,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:26:18.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.092+0000 7fd3f3577640 1 -- 10.20.193.58:0/3330258626 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd3c007a5b0 msgr2=0x7fd3c009aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:18.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.092+0000 7fd3f3577640 1 --2- 10.20.193.58:0/3330258626 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd3c007a5b0 0x7fd3c009aa60 secure :-1 s=READY pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3e8002820 tx=0x7fd3e80090e0 comp rx=0 tx=0).stop 2026-02-23T06:26:18.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.092+0000 7fd3f3577640 1 -- 10.20.193.58:0/3330258626 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd3d0045f30 msgr2=0x7fd3f41405c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:18.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.092+0000 7fd3f3577640 1 --2- 10.20.193.58:0/3330258626 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd3d0045f30 0x7fd3f41405c0 secure :-1 s=READY pgs=86 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3dc00c4b0 tx=0x7fd3dc00c980 comp rx=0 tx=0).stop 2026-02-23T06:26:18.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.092+0000 7fd3f3577640 1 -- 10.20.193.58:0/3330258626 shutdown_connections 2026-02-23T06:26:18.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.092+0000 7fd3f3577640 1 --2- 10.20.193.58:0/3330258626 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd3c007a5b0 0x7fd3c009aa60 unknown :-1 s=CLOSED pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:18.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.092+0000 7fd3f3577640 1 --2- 10.20.193.58:0/3330258626 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd3d0046b30 0x7fd3f413b260 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:18.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.092+0000 7fd3f3577640 1 --2- 10.20.193.58:0/3330258626 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd3d0045f30 0x7fd3f41405c0 unknown :-1 s=CLOSED pgs=86 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:18.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.092+0000 7fd3f3577640 1 --2- 10.20.193.58:0/3330258626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd3d0023cd0 0x7fd3f42017c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:18.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.092+0000 7fd3f3577640 1 -- 10.20.193.58:0/3330258626 >> 10.20.193.58:0/3330258626 conn(0x7fd3f40b3c20 msgr2=0x7fd3f415ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:18.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.092+0000 7fd3f3577640 1 -- 10.20.193.58:0/3330258626 shutdown_connections 2026-02-23T06:26:18.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.092+0000 7fd3f3577640 1 -- 10.20.193.58:0/3330258626 wait complete. 2026-02-23T06:26:18.099 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:26:18.099 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-23T06:26:18.099 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:26:18.226 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.230+0000 7f8fd450c640 1 -- 10.20.193.58:0/3834179467 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8fcc161d50 msgr2=0x7f8fcc157670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:18.226 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.230+0000 7f8fd450c640 1 --2- 10.20.193.58:0/3834179467 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8fcc161d50 0x7f8fcc157670 secure :-1 s=READY pgs=87 gs=2 cs=0 l=1 c_cookie=12550300900315746869 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fcc0b4d10 tx=0x7f8fc002ffe0 comp rx=0 tx=0).stop 2026-02-23T06:26:18.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.230+0000 7f8fd450c640 1 -- 10.20.193.58:0/3834179467 shutdown_connections 2026-02-23T06:26:18.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.231+0000 7f8fd450c640 1 --2- 10.20.193.58:0/3834179467 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8fcc0b1910 0x7f8fcc157bb0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:18.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.231+0000 7f8fd450c640 1 --2- 10.20.193.58:0/3834179467 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8fcc161d50 0x7f8fcc157670 unknown :-1 s=CLOSED pgs=87 gs=2 cs=0 l=1 c_cookie=12550300900315746869 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:18.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.231+0000 7f8fd450c640 1 -- 10.20.193.58:0/3834179467 >> 10.20.193.58:0/3834179467 conn(0x7f8fcc058e50 msgr2=0x7f8fcc059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:18.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.231+0000 7f8fd450c640 1 -- 10.20.193.58:0/3834179467 shutdown_connections 2026-02-23T06:26:18.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.231+0000 7f8fd450c640 1 -- 10.20.193.58:0/3834179467 wait complete. 2026-02-23T06:26:18.230 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.232+0000 7f8fd450c640 1 Processor -- start 2026-02-23T06:26:18.230 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.232+0000 7f8fd450c640 1 -- start start 2026-02-23T06:26:18.230 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.233+0000 7f8fd450c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8fcc0b1540 0x7f8fcc160100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:18.230 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.233+0000 7f8fd450c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8fcc0b1910 0x7f8fcc2052a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:18.230 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.233+0000 7f8fd450c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8fcc161d50 0x7f8fcc1fb9d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:18.230 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.233+0000 7f8fd450c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f8fcc160ea0 con 0x7f8fcc0b1910 2026-02-23T06:26:18.230 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.233+0000 7f8fd450c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f8fcc15f990 con 0x7f8fcc0b1540 2026-02-23T06:26:18.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.233+0000 7f8fd450c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f8fcc15fc70 con 0x7f8fcc161d50 2026-02-23T06:26:18.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.233+0000 7f8fd2281640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8fcc0b1540 msgr2=0x7f8fcc160100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:26:18.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.233+0000 7f8fd2281640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8fcc0b1540 0x7f8fcc160100 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:26:18.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.233+0000 7f8fd2a82640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8fcc161d50 0x7f8fcc1fb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:18.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.233+0000 7f8fd2a82640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8fcc161d50 0x7f8fcc1fb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:33426/0 (socket says 10.20.193.58:33426) 2026-02-23T06:26:18.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.233+0000 7f8fd2a82640 1 -- 10.20.193.58:0/3063236424 learned_addr learned my addr 10.20.193.58:0/3063236424 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:26:18.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.233+0000 7f8fd1a80640 1 --2- 10.20.193.58:0/3063236424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8fcc0b1910 0x7f8fcc2052a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:18.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.233+0000 7f8fd2a82640 1 -- 10.20.193.58:0/3063236424 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8fcc0b1540 msgr2=0x7f8fcc160100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:26:18.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.233+0000 7f8fd2a82640 1 --2- 10.20.193.58:0/3063236424 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8fcc0b1540 0x7f8fcc160100 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:18.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.233+0000 7f8fd2a82640 1 -- 10.20.193.58:0/3063236424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8fcc0b1910 msgr2=0x7f8fcc2052a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:18.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.233+0000 7f8fd2a82640 1 --2- 10.20.193.58:0/3063236424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8fcc0b1910 0x7f8fcc2052a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:18.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.233+0000 7f8fd2a82640 1 -- 10.20.193.58:0/3063236424 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc00071c0 con 0x7f8fcc161d50 2026-02-23T06:26:18.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.233+0000 7f8fd1a80640 1 --2- 10.20.193.58:0/3063236424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8fcc0b1910 0x7f8fcc2052a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:26:18.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.234+0000 7f8fd2a82640 1 --2- 10.20.193.58:0/3063236424 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8fcc161d50 0x7f8fcc1fb9d0 secure :-1 s=READY pgs=37 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fc800e980 tx=0x7f8fc800ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:18.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.234+0000 7f8fb2ffd640 1 -- 10.20.193.58:0/3063236424 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fc8005500 con 0x7f8fcc161d50 2026-02-23T06:26:18.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.234+0000 7f8fd450c640 1 -- 10.20.193.58:0/3063236424 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fcc0b5ad0 con 0x7f8fcc161d50 2026-02-23T06:26:18.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.234+0000 7f8fb2ffd640 1 -- 10.20.193.58:0/3063236424 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8fc800c840 con 0x7f8fcc161d50 2026-02-23T06:26:18.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.234+0000 7f8fb2ffd640 1 -- 10.20.193.58:0/3063236424 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fc800cc70 con 0x7f8fcc161d50 2026-02-23T06:26:18.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.234+0000 7f8fd450c640 1 -- 10.20.193.58:0/3063236424 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fcc160bc0 con 0x7f8fcc161d50 2026-02-23T06:26:18.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.235+0000 7f8fd450c640 1 --2- 10.20.193.58:0/3063236424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8fcc160640 0x7f8fcc1fbf10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:18.233 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.235+0000 7f8fd450c640 1 -- 10.20.193.58:0/3063236424 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f8fcc059800 con 0x7f8fcc160640 2026-02-23T06:26:18.233 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.235+0000 7f8fd2281640 1 --2- 10.20.193.58:0/3063236424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8fcc160640 0x7f8fcc1fbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:18.234 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.236+0000 7f8fd2281640 1 -- 10.20.193.58:0/3063236424 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8fcc0b7540 con 0x7f8fcc160640 2026-02-23T06:26:18.234 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.236+0000 7f8fb2ffd640 1 -- 10.20.193.58:0/3063236424 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f8fc8003780 con 0x7f8fcc161d50 2026-02-23T06:26:18.235 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.236+0000 7f8fd2281640 1 --2- 10.20.193.58:0/3063236424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8fcc160640 0x7f8fcc1fbf10 secure :-1 s=READY pgs=88 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fbc002730 tx=0x7f8fbc00bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:18.235 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.237+0000 7f8fb2ffd640 1 --2- 10.20.193.58:0/3063236424 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8f9407a5b0 0x7f8f9409aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:18.235 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.237+0000 7f8fb2ffd640 1 -- 10.20.193.58:0/3063236424 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f8fc809ed10 con 0x7f8fcc161d50 2026-02-23T06:26:18.235 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.237+0000 7f8fb2ffd640 1 -- 10.20.193.58:0/3063236424 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fbc003c70 con 0x7f8fcc160640 2026-02-23T06:26:18.235 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.237+0000 7f8fb2ffd640 1 -- 10.20.193.58:0/3063236424 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f8fbc003dd0 con 0x7f8fcc160640 2026-02-23T06:26:18.235 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.237+0000 7f8fb2ffd640 1 -- 10.20.193.58:0/3063236424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8fcc160640 msgr2=0x7f8fcc1fbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:18.235 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.237+0000 7f8fb2ffd640 1 --2- 10.20.193.58:0/3063236424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8fcc160640 0x7f8fcc1fbf10 secure :-1 s=READY pgs=88 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fbc002730 tx=0x7f8fbc00bb90 comp rx=0 tx=0).stop 2026-02-23T06:26:18.235 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.237+0000 7f8fb2ffd640 1 -- 10.20.193.58:0/3063236424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8fcc160640 msgr2=0x7f8fcc1fbf10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:26:18.235 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.237+0000 7f8fb2ffd640 1 --2- 10.20.193.58:0/3063236424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8fcc160640 0x7f8fcc1fbf10 unknown :-1 s=CLOSED pgs=88 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:18.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.237+0000 7f8fd1a80640 1 --2- 10.20.193.58:0/3063236424 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8f9407a5b0 0x7f8f9409aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:18.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.238+0000 7f8fd1a80640 1 --2- 10.20.193.58:0/3063236424 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8f9407a5b0 0x7f8f9409aa60 secure :-1 s=READY pgs=190 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fc0005b30 tx=0x7f8fc00047e0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:18.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.241+0000 7f8fd450c640 1 --2- 10.20.193.58:0/3063236424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8fcc15c2f0 0x7f8fcc2057e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:18.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.241+0000 7f8fd450c640 1 -- 10.20.193.58:0/3063236424 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f8fcc0aecb0 con 0x7f8fcc15c2f0 2026-02-23T06:26:18.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.241+0000 7f8fd2281640 1 --2- 10.20.193.58:0/3063236424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8fcc15c2f0 0x7f8fcc2057e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:18.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.241+0000 7f8fd2281640 1 -- 10.20.193.58:0/3063236424 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8fcc05b2d0 con 0x7f8fcc15c2f0 2026-02-23T06:26:18.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.242+0000 7f8fd2281640 1 --2- 10.20.193.58:0/3063236424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8fcc15c2f0 0x7f8fcc2057e0 secure :-1 s=READY pgs=89 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fbc011000 tx=0x7f8fbc005a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:18.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.242+0000 7f8fb2ffd640 1 -- 10.20.193.58:0/3063236424 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fbc019030 con 0x7f8fcc15c2f0 2026-02-23T06:26:18.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.242+0000 7f8fb2ffd640 1 -- 10.20.193.58:0/3063236424 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5236 (secure 0 0 0) 0x7f8fbc0054c0 con 0x7f8fcc15c2f0 2026-02-23T06:26:18.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.242+0000 7f8fb2ffd640 1 -- 10.20.193.58:0/3063236424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8fcc15c2f0 msgr2=0x7f8fcc2057e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:18.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.242+0000 7f8fb2ffd640 1 --2- 10.20.193.58:0/3063236424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8fcc15c2f0 0x7f8fcc2057e0 secure :-1 s=READY pgs=89 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fbc011000 tx=0x7f8fbc005a70 comp rx=0 tx=0).stop 2026-02-23T06:26:18.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.242+0000 7f8fb2ffd640 1 -- 10.20.193.58:0/3063236424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8fcc15c2f0 msgr2=0x7f8fcc2057e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:26:18.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.242+0000 7f8fb2ffd640 1 --2- 10.20.193.58:0/3063236424 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8fcc15c2f0 0x7f8fcc2057e0 secure :-1 s=CLOSED pgs=89 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fbc011000 tx=0x7f8fbc005a70 comp rx=0 tx=0).stop 2026-02-23T06:26:18.239 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:26:18.239 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:26:18.239 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:26:18.239 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:26:18.239 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 40, 2026-02-23T06:26:18.239 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 105075, 2026-02-23T06:26:18.239 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:26:18.240 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:26:18.240 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:26:18.240 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:18.240 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 1, 2026-02-23T06:26:18.240 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:26:18.240 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:26:18.240 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:26:18.240 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:18.240 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:18.240 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:18.241 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:18.241 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:18.241 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:18.241 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:18.241 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:18.241 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:18.241 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:18.241 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:18.241 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:18.241 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:18.241 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:18.242 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:26:18.242 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:26:18.242 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:18.242 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:18.242 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:18.242 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:18.242 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:18.242 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:18.242 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:18.242 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:18.242 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:18.243 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:18.243 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:18.243 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:18.243 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:18.243 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:18.243 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:18.243 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:26:18.243 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:26:18.243 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:26:18.243 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:26:18.244 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:26:18.244 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:26:18.244 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:26:18.244 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:26:18.244 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:26:18.244 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:26:18.244 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:26:18.244 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:26:18.244 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:26:18.244 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:26:18.244 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:26:18.244 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:26:18.245 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:26:18.245 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:18.245 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:18.245 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:18.245 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:18.245 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:18.245 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:18.245 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:18.245 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:18.245 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:18.246 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:18.246 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:18.246 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:18.246 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:18.246 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:18.246 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:26:18.246 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:18.246 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:26:18.246 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:18.246 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:26:18.246 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:26:18.247 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:18.247 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:18.247 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:18.247 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:18.247 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:26:18.247 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:18.247 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:18.247 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:18.247 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:18.247 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:26:18.247 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:18.248 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:18.248 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:18.248 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:18.248 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:26:18.248 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:26:18.248 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:18.248 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:18.248 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:26:18.248 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:18.249 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:18.249 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:18.249 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:26:18.249 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:26:18.249 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:18.249 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:18.249 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:18.249 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:18.249 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:26:18.249 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:18.249 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:18.250 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:18.250 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:18.250 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:26:18.250 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:18.250 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:18.250 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:18.250 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:18.250 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:26:18.250 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:26:18.250 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:18.251 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:18.251 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:26:18.251 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:18.251 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:18.251 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:18.251 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:26:18.251 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:26:18.251 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:18.251 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:18.251 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:18.251 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:18.252 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:26:18.252 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:18.252 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:18.252 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:18.252 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:18.252 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:26:18.252 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:18.252 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:18.252 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:18.252 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:18.252 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:26:18.253 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:26:18.253 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:18.253 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:18.253 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:26:18.253 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:18.253 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:18.253 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:18.253 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:18.253 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:26:18.253 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:26:18.254 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:18.254 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:18.254 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:18.254 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:26:18.254 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:18.254 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:18.254 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:26:18.254 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:18.254 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:18.254 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:18.254 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:26:18.255 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:18.255 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:18.255 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:26:18.255 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:18.255 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:18.255 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:18.255 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:26:18.255 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:18.255 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:18.255 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:26:18.255 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:18.256 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:18.256 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:18.256 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:26:18.256 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:18.256 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:18.256 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:18.256 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:26:18.256 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:26:18.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.242+0000 7f8fd450c640 1 -- 10.20.193.58:0/3063236424 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8f9407a5b0 msgr2=0x7f8f9409aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:18.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.242+0000 7f8fd450c640 1 --2- 10.20.193.58:0/3063236424 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8f9407a5b0 0x7f8f9409aa60 secure :-1 s=READY pgs=190 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fc0005b30 tx=0x7f8fc00047e0 comp rx=0 tx=0).stop 2026-02-23T06:26:18.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.242+0000 7f8fd450c640 1 -- 10.20.193.58:0/3063236424 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8fcc161d50 msgr2=0x7f8fcc1fb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:18.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.242+0000 7f8fd450c640 1 --2- 10.20.193.58:0/3063236424 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8fcc161d50 0x7f8fcc1fb9d0 secure :-1 s=READY pgs=37 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fc800e980 tx=0x7f8fc800ee50 comp rx=0 tx=0).stop 2026-02-23T06:26:18.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.242+0000 7f8fd2a82640 1 -- 10.20.193.58:0/3063236424 reap_dead start 2026-02-23T06:26:18.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.243+0000 7f8fd2a82640 1 -- 10.20.193.58:0/3063236424 reap_dead start 2026-02-23T06:26:18.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.243+0000 7f8fd450c640 1 -- 10.20.193.58:0/3063236424 shutdown_connections 2026-02-23T06:26:18.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.243+0000 7f8fd450c640 1 -- 10.20.193.58:0/3063236424 >> 10.20.193.58:0/3063236424 conn(0x7f8fcc058e50 msgr2=0x7f8fcc0b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:18.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.243+0000 7f8fd450c640 1 -- 10.20.193.58:0/3063236424 shutdown_connections 2026-02-23T06:26:18.259 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.243+0000 7f8fd450c640 1 -- 10.20.193.58:0/3063236424 wait complete. 2026-02-23T06:26:18.259 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:26:18.259 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-23T06:26:18.260 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:26:18.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.385+0000 7f200a3d2640 1 -- 10.20.193.58:0/3966719633 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2004056550 msgr2=0x7f200405ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:18.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.385+0000 7f200a3d2640 1 --2- 10.20.193.58:0/3966719633 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2004056550 0x7f200405ce30 secure :-1 s=READY pgs=38 gs=2 cs=0 l=1 c_cookie=5642120703435971976 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ff8005e70 tx=0x7f1ff802f2b0 comp rx=0 tx=0).stop 2026-02-23T06:26:18.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.385+0000 7f200a3d2640 1 -- 10.20.193.58:0/3966719633 shutdown_connections 2026-02-23T06:26:18.382 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.385+0000 7f200a3d2640 1 --2- 10.20.193.58:0/3966719633 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2004056550 0x7f200405ce30 unknown :-1 s=CLOSED pgs=38 gs=2 cs=0 l=1 c_cookie=5642120703435971976 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:18.382 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.385+0000 7f200a3d2640 1 --2- 10.20.193.58:0/3966719633 >> v2:10.20.193.93:3300/0 conn(0x7f200415c040 0x7f200405b0e0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:18.382 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.385+0000 7f200a3d2640 1 -- 10.20.193.58:0/3966719633 >> 10.20.193.58:0/3966719633 conn(0x7f20040b3c20 msgr2=0x7f20040b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:18.382 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.386+0000 7f200a3d2640 1 -- 10.20.193.58:0/3966719633 shutdown_connections 2026-02-23T06:26:18.382 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.386+0000 7f200a3d2640 1 -- 10.20.193.58:0/3966719633 wait complete. 2026-02-23T06:26:18.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.387+0000 7f200a3d2640 1 Processor -- start 2026-02-23T06:26:18.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.387+0000 7f200a3d2640 1 -- start start 2026-02-23T06:26:18.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.387+0000 7f200a3d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2004056550 0x7f2004058660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:18.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.387+0000 7f200a3d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f200405d370 0x7f200415cc60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:18.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.387+0000 7f200a3d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f200415c040 0x7f20040b04a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:18.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.387+0000 7f200a3d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f20040b1aa0 con 0x7f200415c040 2026-02-23T06:26:18.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.387+0000 7f200a3d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f2004162f30 con 0x7f200405d370 2026-02-23T06:26:18.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.387+0000 7f200a3d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f20040b17e0 con 0x7f2004056550 2026-02-23T06:26:18.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.387+0000 7f2009bd1640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f200415c040 0x7f20040b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:18.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.387+0000 7f2008bcf640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f200405d370 msgr2=0x7f200415cc60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:26:18.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.388+0000 7f2009bd1640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f200415c040 0x7f20040b04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:51790/0 (socket says 10.20.193.58:51790) 2026-02-23T06:26:18.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.388+0000 7f2009bd1640 1 -- 10.20.193.58:0/2755361316 learned_addr learned my addr 10.20.193.58:0/2755361316 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:26:18.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.388+0000 7f2008bcf640 1 --2- 10.20.193.58:0/2755361316 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f200405d370 0x7f200415cc60 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:26:18.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.388+0000 7f20093d0640 1 --2- 10.20.193.58:0/2755361316 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2004056550 0x7f2004058660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:18.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.388+0000 7f2009bd1640 1 -- 10.20.193.58:0/2755361316 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2004056550 msgr2=0x7f2004058660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:18.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.388+0000 7f2009bd1640 1 --2- 10.20.193.58:0/2755361316 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2004056550 0x7f2004058660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:18.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.388+0000 7f2009bd1640 1 -- 10.20.193.58:0/2755361316 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f200405d370 msgr2=0x7f200415cc60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:26:18.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.388+0000 7f2009bd1640 1 --2- 10.20.193.58:0/2755361316 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f200405d370 0x7f200415cc60 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:18.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.388+0000 7f2009bd1640 1 -- 10.20.193.58:0/2755361316 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff8009570 con 0x7f200415c040 2026-02-23T06:26:18.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.388+0000 7f2009bd1640 1 --2- 10.20.193.58:0/2755361316 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f200415c040 0x7f20040b04a0 secure :-1 s=READY pgs=90 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f200000c550 tx=0x7f200000ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:18.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.388+0000 7f1ff1ffb640 1 -- 10.20.193.58:0/2755361316 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2000003d60 con 0x7f200415c040 2026-02-23T06:26:18.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.388+0000 7f1ff1ffb640 1 -- 10.20.193.58:0/2755361316 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2000005070 con 0x7f200415c040 2026-02-23T06:26:18.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.388+0000 7f1ff1ffb640 1 -- 10.20.193.58:0/2755361316 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2000005440 con 0x7f200415c040 2026-02-23T06:26:18.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.388+0000 7f200a3d2640 1 -- 10.20.193.58:0/2755361316 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2004162970 con 0x7f200415c040 2026-02-23T06:26:18.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.388+0000 7f200a3d2640 1 -- 10.20.193.58:0/2755361316 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20040aff80 con 0x7f200415c040 2026-02-23T06:26:18.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.389+0000 7f200a3d2640 1 --2- 10.20.193.58:0/2755361316 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f200415d1a0 0x7f20040b09e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:18.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.389+0000 7f200a3d2640 1 -- 10.20.193.58:0/2755361316 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f200415c410 con 0x7f200415d1a0 2026-02-23T06:26:18.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.389+0000 7f20093d0640 1 --2- 10.20.193.58:0/2755361316 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f200415d1a0 0x7f20040b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:18.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.390+0000 7f20093d0640 1 -- 10.20.193.58:0/2755361316 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f200405b620 con 0x7f200415d1a0 2026-02-23T06:26:18.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.390+0000 7f20093d0640 1 --2- 10.20.193.58:0/2755361316 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f200415d1a0 0x7f20040b09e0 secure :-1 s=READY pgs=39 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ff4002820 tx=0x7f1ff4009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:18.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.390+0000 7f1ff1ffb640 1 -- 10.20.193.58:0/2755361316 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f200000e040 con 0x7f200415c040 2026-02-23T06:26:18.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.391+0000 7f1ff1ffb640 1 --2- 10.20.193.58:0/2755361316 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1fd407a570 0x7f1fd409aa20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:18.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.391+0000 7f1ff1ffb640 1 -- 10.20.193.58:0/2755361316 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f200009e3b0 con 0x7f200415c040 2026-02-23T06:26:18.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.391+0000 7f1ff1ffb640 1 -- 10.20.193.58:0/2755361316 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ff400e8d0 con 0x7f200415d1a0 2026-02-23T06:26:18.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.391+0000 7f1ff1ffb640 1 -- 10.20.193.58:0/2755361316 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f1ff400ea30 con 0x7f200415d1a0 2026-02-23T06:26:18.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.391+0000 7f1ff1ffb640 1 -- 10.20.193.58:0/2755361316 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f200415d1a0 msgr2=0x7f20040b09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:18.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.391+0000 7f1ff1ffb640 1 --2- 10.20.193.58:0/2755361316 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f200415d1a0 0x7f20040b09e0 secure :-1 s=READY pgs=39 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ff4002820 tx=0x7f1ff4009a20 comp rx=0 tx=0).stop 2026-02-23T06:26:18.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.391+0000 7f1ff1ffb640 1 -- 10.20.193.58:0/2755361316 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f200415d1a0 msgr2=0x7f20040b09e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:26:18.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.391+0000 7f1ff1ffb640 1 --2- 10.20.193.58:0/2755361316 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f200415d1a0 0x7f20040b09e0 secure :-1 s=CLOSED pgs=39 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ff4002820 tx=0x7f1ff4009a20 comp rx=0 tx=0).stop 2026-02-23T06:26:18.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.391+0000 7f2008bcf640 1 --2- 10.20.193.58:0/2755361316 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1fd407a570 0x7f1fd409aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:18.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.392+0000 7f2008bcf640 1 --2- 10.20.193.58:0/2755361316 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1fd407a570 0x7f1fd409aa20 secure :-1 s=READY pgs=191 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ff8004740 tx=0x7f1ff8031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:18.391 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.394+0000 7f200a3d2640 1 --2- 10.20.193.58:0/2755361316 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f20041618e0 0x7f2004151650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:18.391 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.394+0000 7f200a3d2640 1 -- 10.20.193.58:0/2755361316 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f20040afde0 con 0x7f20041618e0 2026-02-23T06:26:18.391 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.395+0000 7f20093d0640 1 --2- 10.20.193.58:0/2755361316 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f20041618e0 0x7f2004151650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:18.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.395+0000 7f20093d0640 1 -- 10.20.193.58:0/2755361316 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f20040b01a0 con 0x7f20041618e0 2026-02-23T06:26:18.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.395+0000 7f20093d0640 1 --2- 10.20.193.58:0/2755361316 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f20041618e0 0x7f2004151650 secure :-1 s=READY pgs=40 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ff4002820 tx=0x7f1ff40048c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:18.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.396+0000 7f1ff1ffb640 1 -- 10.20.193.58:0/2755361316 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ff4005cd0 con 0x7f20041618e0 2026-02-23T06:26:18.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.396+0000 7f1ff1ffb640 1 -- 10.20.193.58:0/2755361316 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5543 (secure 0 0 0) 0x7f1ff400ee90 con 0x7f20041618e0 2026-02-23T06:26:18.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.396+0000 7f1ff1ffb640 1 -- 10.20.193.58:0/2755361316 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f20041618e0 msgr2=0x7f2004151650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:18.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.396+0000 7f1ff1ffb640 1 --2- 10.20.193.58:0/2755361316 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f20041618e0 0x7f2004151650 secure :-1 s=READY pgs=40 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ff4002820 tx=0x7f1ff40048c0 comp rx=0 tx=0).stop 2026-02-23T06:26:18.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.396+0000 7f1ff1ffb640 1 -- 10.20.193.58:0/2755361316 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f20041618e0 msgr2=0x7f2004151650 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:26:18.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.396+0000 7f1ff1ffb640 1 --2- 10.20.193.58:0/2755361316 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f20041618e0 0x7f2004151650 secure :-1 s=CLOSED pgs=40 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ff4002820 tx=0x7f1ff40048c0 comp rx=0 tx=0).stop 2026-02-23T06:26:18.393 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:26:18.393 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:26:18.393 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:26:18.393 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:26:18.393 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 40, 2026-02-23T06:26:18.393 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 52907, 2026-02-23T06:26:18.393 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:26:18.394 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:26:18.394 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:26:18.394 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:18.394 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 1, 2026-02-23T06:26:18.394 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:26:18.394 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:26:18.394 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:26:18.394 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:18.394 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:18.394 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:18.394 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:18.395 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:18.395 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:18.395 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:18.395 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:18.395 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:18.395 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:18.395 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:18.395 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:18.395 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:18.395 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:18.396 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:26:18.396 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:26:18.396 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:18.396 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:18.396 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:18.396 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:18.396 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:18.396 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:18.396 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:18.396 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:18.397 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:18.397 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:18.397 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:18.397 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:18.397 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:18.397 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:18.397 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:18.397 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:26:18.397 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:26:18.397 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:26:18.398 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:26:18.398 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:26:18.398 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:26:18.398 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:26:18.398 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:26:18.398 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:26:18.398 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:26:18.398 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:26:18.398 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:26:18.398 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:26:18.398 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:26:18.399 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:26:18.399 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:26:18.399 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:26:18.399 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:18.399 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:18.399 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:18.399 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:18.399 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:18.399 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:18.399 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:18.399 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:18.400 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:18.400 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:18.400 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:18.400 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:18.400 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:18.400 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:18.400 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:26:18.400 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:18.400 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:26:18.400 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:18.400 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:26:18.401 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:26:18.401 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:18.401 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:18.401 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:18.401 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:18.401 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:26:18.401 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:18.401 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:18.401 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:18.402 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:18.402 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:26:18.402 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:18.402 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:18.402 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:18.402 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:18.402 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:26:18.402 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:26:18.402 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:18.402 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:18.402 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:26:18.402 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:18.403 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:18.403 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:18.403 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:26:18.403 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:26:18.403 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:18.403 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:18.403 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:18.403 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:18.403 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:26:18.403 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:18.403 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:18.404 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:18.404 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:18.404 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:26:18.404 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:18.404 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:18.404 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:18.404 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:18.404 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:26:18.404 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:26:18.404 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:18.405 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:18.405 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:26:18.405 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:18.405 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:18.405 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:18.405 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:26:18.405 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:26:18.405 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:18.405 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:18.405 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:18.406 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:18.406 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:26:18.406 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:18.406 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:18.406 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:18.406 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:18.406 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:26:18.406 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:18.406 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:18.406 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:18.406 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:18.407 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:26:18.407 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:26:18.407 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:18.407 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:18.407 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:26:18.407 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:18.407 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:18.407 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:18.407 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:18.407 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:26:18.408 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:26:18.408 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:18.408 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:18.408 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:18.408 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:26:18.408 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:18.408 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:18.408 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:26:18.408 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:18.408 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:18.408 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:18.409 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:26:18.409 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:18.409 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:18.409 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:26:18.409 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:18.409 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:18.409 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:18.409 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:26:18.409 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:18.409 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:18.409 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:26:18.410 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:18.410 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:26:18.410 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:26:18.410 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:26:18.410 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:18.410 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:18.410 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:18.410 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:18.410 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:26:18.410 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:18.411 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:18.411 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:26:18.411 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:18.411 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:18.411 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:18.411 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:26:18.411 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:18.411 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:18.411 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:18.411 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:26:18.412 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:26:18.413 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.396+0000 7f200a3d2640 1 -- 10.20.193.58:0/2755361316 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1fd407a570 msgr2=0x7f1fd409aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:18.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.396+0000 7f200a3d2640 1 --2- 10.20.193.58:0/2755361316 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1fd407a570 0x7f1fd409aa20 secure :-1 s=READY pgs=191 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ff8004740 tx=0x7f1ff8031040 comp rx=0 tx=0).stop 2026-02-23T06:26:18.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.396+0000 7f200a3d2640 1 -- 10.20.193.58:0/2755361316 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f200415c040 msgr2=0x7f20040b04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:18.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.396+0000 7f200a3d2640 1 --2- 10.20.193.58:0/2755361316 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f200415c040 0x7f20040b04a0 secure :-1 s=READY pgs=90 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f200000c550 tx=0x7f200000ca20 comp rx=0 tx=0).stop 2026-02-23T06:26:18.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.396+0000 7f2009bd1640 1 -- 10.20.193.58:0/2755361316 reap_dead start 2026-02-23T06:26:18.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.396+0000 7f2009bd1640 1 -- 10.20.193.58:0/2755361316 reap_dead start 2026-02-23T06:26:18.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.396+0000 7f200a3d2640 1 -- 10.20.193.58:0/2755361316 shutdown_connections 2026-02-23T06:26:18.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.396+0000 7f200a3d2640 1 -- 10.20.193.58:0/2755361316 >> 10.20.193.58:0/2755361316 conn(0x7f20040b3c20 msgr2=0x7f2004164ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:18.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.396+0000 7f200a3d2640 1 -- 10.20.193.58:0/2755361316 shutdown_connections 2026-02-23T06:26:18.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:18.396+0000 7f200a3d2640 1 -- 10.20.193.58:0/2755361316 wait complete. 2026-02-23T06:26:18.415 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:26:18.415 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:26:38.416 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-23T06:26:38.416 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-23T06:26:38.416 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-23T06:26:38.416 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-23T06:26:38.419 INFO:tasks.ceph.mon.b:Started 2026-02-23T06:26:38.420 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:26:38.420 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:26:38.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.546+0000 7f9ae48cb640 1 -- 10.20.193.58:0/3800894397 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9ae00b5680 msgr2=0x7f9ae00b5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:38.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.546+0000 7f9ae48cb640 1 --2- 10.20.193.58:0/3800894397 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9ae00b5680 0x7f9ae00b5ac0 secure :-1 s=READY pgs=94 gs=3 cs=0 l=1 c_cookie=16476841575189683217 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ae00b5010 tx=0x7f9ad0030260 comp rx=0 tx=0).stop 2026-02-23T06:26:38.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.548+0000 7f9ae48cb640 1 -- 10.20.193.58:0/3800894397 shutdown_connections 2026-02-23T06:26:38.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.548+0000 7f9ae48cb640 1 --2- 10.20.193.58:0/3800894397 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9ae00b5680 0x7f9ae00b5ac0 unknown :-1 s=CLOSED pgs=94 gs=3 cs=0 l=1 c_cookie=16476841575189683217 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:38.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.548+0000 7f9ae48cb640 1 -- 10.20.193.58:0/3800894397 >> 10.20.193.58:0/3800894397 conn(0x7f9ae00b3c20 msgr2=0x7f9ae00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:38.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.548+0000 7f9ae48cb640 1 -- 10.20.193.58:0/3800894397 shutdown_connections 2026-02-23T06:26:38.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.548+0000 7f9ae48cb640 1 -- 10.20.193.58:0/3800894397 wait complete. 2026-02-23T06:26:38.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.548+0000 7f9ae48cb640 1 Processor -- start 2026-02-23T06:26:38.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.548+0000 7f9ae48cb640 1 -- start start 2026-02-23T06:26:38.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.548+0000 7f9ae48cb640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9ae0056550 0x7f9ae01618b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:38.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.548+0000 7f9ae48cb640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9ae00b5680 0x7f9ae0058780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:38.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.548+0000 7f9ae48cb640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9ae015c040 0x7f9ae0160620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:38.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.548+0000 7f9ae48cb640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae015feb0 con 0x7f9ae00b5680 2026-02-23T06:26:38.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.548+0000 7f9ae48cb640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae0162430 con 0x7f9ae015c040 2026-02-23T06:26:38.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.548+0000 7f9ae48cb640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f9ae01626f0 con 0x7f9ae0056550 2026-02-23T06:26:38.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.548+0000 7f9ade575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9ae00b5680 0x7f9ae0058780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:38.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.548+0000 7f9ade575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9ae00b5680 0x7f9ae0058780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:33766/0 (socket says 10.20.193.58:33766) 2026-02-23T06:26:38.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.548+0000 7f9ade575640 1 -- 10.20.193.58:0/2448994007 learned_addr learned my addr 10.20.193.58:0/2448994007 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:26:38.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.548+0000 7f9ade575640 1 -- 10.20.193.58:0/2448994007 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9ae0056550 msgr2=0x7f9ae01618b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-23T06:26:38.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.548+0000 7f9ade575640 1 --2- 10.20.193.58:0/2448994007 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9ae0056550 0x7f9ae01618b0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:38.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.548+0000 7f9ade575640 1 -- 10.20.193.58:0/2448994007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9ae015c040 msgr2=0x7f9ae0160620 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-23T06:26:38.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.548+0000 7f9ade575640 1 --2- 10.20.193.58:0/2448994007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9ae015c040 0x7f9ae0160620 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:38.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.548+0000 7f9ade575640 1 -- 10.20.193.58:0/2448994007 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad000a590 con 0x7f9ae00b5680 2026-02-23T06:26:38.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.550+0000 7f9ade575640 1 --2- 10.20.193.58:0/2448994007 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9ae00b5680 0x7f9ae0058780 secure :-1 s=READY pgs=95 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ac800c4d0 tx=0x7f9ac800c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:38.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.550+0000 7f9abf7fe640 1 -- 10.20.193.58:0/2448994007 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ac8012850 con 0x7f9ae00b5680 2026-02-23T06:26:38.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.550+0000 7f9ae48cb640 1 -- 10.20.193.58:0/2448994007 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ae01629d0 con 0x7f9ae00b5680 2026-02-23T06:26:38.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.550+0000 7f9abf7fe640 1 -- 10.20.193.58:0/2448994007 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ac8012aa0 con 0x7f9ae00b5680 2026-02-23T06:26:38.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.550+0000 7f9abf7fe640 1 -- 10.20.193.58:0/2448994007 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ac8012850 con 0x7f9ae00b5680 2026-02-23T06:26:38.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.550+0000 7f9ae48cb640 1 -- 10.20.193.58:0/2448994007 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ae0160100 con 0x7f9ae00b5680 2026-02-23T06:26:38.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.551+0000 7f9abd7fa640 1 -- 10.20.193.58:0/2448994007 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ae0160320 con 0x7f9ae00b5680 2026-02-23T06:26:38.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.551+0000 7f9abf7fe640 1 -- 10.20.193.58:0/2448994007 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f9ac8023060 con 0x7f9ae00b5680 2026-02-23T06:26:38.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.553+0000 7f9abf7fe640 1 --2- 10.20.193.58:0/2448994007 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9aac07a780 0x7f9aac09ac30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:38.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.553+0000 7f9abf7fe640 1 -- 10.20.193.58:0/2448994007 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f9ac809db50 con 0x7f9ae00b5680 2026-02-23T06:26:38.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.553+0000 7f9aded76640 1 --2- 10.20.193.58:0/2448994007 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9aac07a780 0x7f9aac09ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:38.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.553+0000 7f9abf7fe640 1 -- 10.20.193.58:0/2448994007 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f9ac8060d10 con 0x7f9ae00b5680 2026-02-23T06:26:38.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.554+0000 7f9aded76640 1 --2- 10.20.193.58:0/2448994007 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9aac07a780 0x7f9aac09ac30 secure :-1 s=READY pgs=193 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ad4003770 tx=0x7f9ad4007a70 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:38.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.710+0000 7f9abd7fa640 1 -- 10.20.193.58:0/2448994007 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9ae0157610 con 0x7f9ae00b5680 2026-02-23T06:26:38.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.710+0000 7f9abf7fe640 1 -- 10.20.193.58:0/2448994007 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1754 (secure 0 0 0) 0x7f9ac8060d10 con 0x7f9ae00b5680 2026-02-23T06:26:38.705 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:26:38.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.711+0000 7f9abd7fa640 1 -- 10.20.193.58:0/2448994007 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9aac07a780 msgr2=0x7f9aac09ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:38.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.711+0000 7f9abd7fa640 1 --2- 10.20.193.58:0/2448994007 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9aac07a780 0x7f9aac09ac30 secure :-1 s=READY pgs=193 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ad4003770 tx=0x7f9ad4007a70 comp rx=0 tx=0).stop 2026-02-23T06:26:38.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.711+0000 7f9abd7fa640 1 -- 10.20.193.58:0/2448994007 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9ae00b5680 msgr2=0x7f9ae0058780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:38.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.711+0000 7f9abd7fa640 1 --2- 10.20.193.58:0/2448994007 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9ae00b5680 0x7f9ae0058780 secure :-1 s=READY pgs=95 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ac800c4d0 tx=0x7f9ac800c9a0 comp rx=0 tx=0).stop 2026-02-23T06:26:38.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.711+0000 7f9abd7fa640 1 -- 10.20.193.58:0/2448994007 shutdown_connections 2026-02-23T06:26:38.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.711+0000 7f9abd7fa640 1 --2- 10.20.193.58:0/2448994007 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9aac07a780 0x7f9aac09ac30 unknown :-1 s=CLOSED pgs=193 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:38.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.711+0000 7f9abd7fa640 1 --2- 10.20.193.58:0/2448994007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9ae015c040 0x7f9ae0160620 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:38.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.711+0000 7f9abd7fa640 1 --2- 10.20.193.58:0/2448994007 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9ae00b5680 0x7f9ae0058780 unknown :-1 s=CLOSED pgs=95 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:38.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.711+0000 7f9abd7fa640 1 --2- 10.20.193.58:0/2448994007 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9ae0056550 0x7f9ae01618b0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:38.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.711+0000 7f9abd7fa640 1 -- 10.20.193.58:0/2448994007 >> 10.20.193.58:0/2448994007 conn(0x7f9ae00b3c20 msgr2=0x7f9ae005cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:38.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.711+0000 7f9abd7fa640 1 -- 10.20.193.58:0/2448994007 shutdown_connections 2026-02-23T06:26:38.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.711+0000 7f9abd7fa640 1 -- 10.20.193.58:0/2448994007 wait complete. 2026-02-23T06:26:38.717 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:26:38.717 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:26:38.718 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:26:38.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.844+0000 7ff258e5b640 1 -- 10.20.193.58:0/1043695616 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff25415baa0 msgr2=0x7ff2540b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:38.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.844+0000 7ff258e5b640 1 --2- 10.20.193.58:0/1043695616 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff25415baa0 0x7ff2540b5610 secure :-1 s=READY pgs=97 gs=2 cs=0 l=1 c_cookie=616377463415720364 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2540b0690 tx=0x7ff24802f110 comp rx=0 tx=0).stop 2026-02-23T06:26:38.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.844+0000 7ff258e5b640 1 -- 10.20.193.58:0/1043695616 shutdown_connections 2026-02-23T06:26:38.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.844+0000 7ff258e5b640 1 --2- 10.20.193.58:0/1043695616 >> v2:10.20.193.93:3300/0 conn(0x7ff2540b39f0 0x7ff2540b6a20 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:38.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.844+0000 7ff258e5b640 1 --2- 10.20.193.58:0/1043695616 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff25415baa0 0x7ff2540b5610 unknown :-1 s=CLOSED pgs=97 gs=2 cs=0 l=1 c_cookie=616377463415720364 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:38.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.844+0000 7ff258e5b640 1 -- 10.20.193.58:0/1043695616 >> 10.20.193.58:0/1043695616 conn(0x7ff254058e50 msgr2=0x7ff254059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:38.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.844+0000 7ff258e5b640 1 -- 10.20.193.58:0/1043695616 shutdown_connections 2026-02-23T06:26:38.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.844+0000 7ff258e5b640 1 -- 10.20.193.58:0/1043695616 wait complete. 2026-02-23T06:26:38.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.845+0000 7ff258e5b640 1 Processor -- start 2026-02-23T06:26:38.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.846+0000 7ff258e5b640 1 -- start start 2026-02-23T06:26:38.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.846+0000 7ff258e5b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff2540b39f0 0x7ff254161dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:38.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.846+0000 7ff258e5b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff25415baa0 0x7ff2541f7a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:38.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.846+0000 7ff258e5b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff25415be70 0x7ff2541fd720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:38.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.846+0000 7ff258e5b640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff254157dc0 con 0x7ff2540b39f0 2026-02-23T06:26:38.845 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.846+0000 7ff258e5b640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff254200cc0 con 0x7ff25415baa0 2026-02-23T06:26:38.845 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.846+0000 7ff258e5b640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7ff254162470 con 0x7ff25415be70 2026-02-23T06:26:38.845 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.846+0000 7ff252575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff2540b39f0 0x7ff254161dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:38.845 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.846+0000 7ff252575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff2540b39f0 0x7ff254161dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:43102/0 (socket says 10.20.193.58:43102) 2026-02-23T06:26:38.845 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.846+0000 7ff252575640 1 -- 10.20.193.58:0/3532976650 learned_addr learned my addr 10.20.193.58:0/3532976650 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:26:38.845 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.846+0000 7ff251d74640 1 --2- 10.20.193.58:0/3532976650 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff25415baa0 0x7ff2541f7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:38.845 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.846+0000 7ff252d76640 1 --2- 10.20.193.58:0/3532976650 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff25415be70 0x7ff2541fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:38.845 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.847+0000 7ff251d74640 1 -- 10.20.193.58:0/3532976650 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff25415baa0 msgr2=0x7ff2541f7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-23T06:26:38.845 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.847+0000 7ff251d74640 1 -- 10.20.193.58:0/3532976650 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff25415baa0 msgr2=0x7ff2541f7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:26:38.845 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.847+0000 7ff251d74640 1 --2- 10.20.193.58:0/3532976650 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff25415baa0 0x7ff2541f7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:26:38.845 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.847+0000 7ff251d74640 1 --2- 10.20.193.58:0/3532976650 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff25415baa0 0x7ff2541f7a20 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:26:38.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.847+0000 7ff252575640 1 -- 10.20.193.58:0/3532976650 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff25415be70 msgr2=0x7ff2541fd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:38.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.847+0000 7ff252575640 1 --2- 10.20.193.58:0/3532976650 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff25415be70 0x7ff2541fd720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:38.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.847+0000 7ff252575640 1 -- 10.20.193.58:0/3532976650 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff25415baa0 msgr2=0x7ff2541f7a20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:26:38.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.847+0000 7ff252575640 1 --2- 10.20.193.58:0/3532976650 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff25415baa0 0x7ff2541f7a20 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:38.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.847+0000 7ff252575640 1 -- 10.20.193.58:0/3532976650 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2480094b0 con 0x7ff2540b39f0 2026-02-23T06:26:38.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.847+0000 7ff252575640 1 --2- 10.20.193.58:0/3532976650 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff2540b39f0 0x7ff254161dc0 secure :-1 s=READY pgs=98 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2480023d0 tx=0x7ff2480028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:38.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.847+0000 7ff23affd640 1 -- 10.20.193.58:0/3532976650 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff24803d070 con 0x7ff2540b39f0 2026-02-23T06:26:38.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.847+0000 7ff23affd640 1 -- 10.20.193.58:0/3532976650 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff248002e70 con 0x7ff2540b39f0 2026-02-23T06:26:38.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.847+0000 7ff23affd640 1 -- 10.20.193.58:0/3532976650 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2480386d0 con 0x7ff2540b39f0 2026-02-23T06:26:38.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.847+0000 7ff258e5b640 1 -- 10.20.193.58:0/3532976650 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff254162750 con 0x7ff2540b39f0 2026-02-23T06:26:38.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.847+0000 7ff258e5b640 1 -- 10.20.193.58:0/3532976650 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff254201240 con 0x7ff2540b39f0 2026-02-23T06:26:38.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.848+0000 7ff258e5b640 1 --2- 10.20.193.58:0/3532976650 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff254201a40 0x7ff254201450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:38.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.848+0000 7ff258e5b640 1 -- 10.20.193.58:0/3532976650 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff254160fb0 con 0x7ff254201a40 2026-02-23T06:26:38.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.848+0000 7ff251d74640 1 --2- 10.20.193.58:0/3532976650 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff254201a40 0x7ff254201450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:38.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.848+0000 7ff251d74640 1 -- 10.20.193.58:0/3532976650 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff254165d30 con 0x7ff254201a40 2026-02-23T06:26:38.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.849+0000 7ff251d74640 1 --2- 10.20.193.58:0/3532976650 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff254201a40 0x7ff254201450 secure :-1 s=READY pgs=99 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2541fe8b0 tx=0x7ff23c00e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:38.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.849+0000 7ff23affd640 1 -- 10.20.193.58:0/3532976650 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff23c018070 con 0x7ff254201a40 2026-02-23T06:26:38.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.849+0000 7ff23affd640 1 -- 10.20.193.58:0/3532976650 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7ff23c005240 con 0x7ff254201a40 2026-02-23T06:26:38.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.849+0000 7ff23affd640 1 -- 10.20.193.58:0/3532976650 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff254201a40 msgr2=0x7ff254201450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:38.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.849+0000 7ff23affd640 1 --2- 10.20.193.58:0/3532976650 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff254201a40 0x7ff254201450 secure :-1 s=READY pgs=99 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2541fe8b0 tx=0x7ff23c00e970 comp rx=0 tx=0).stop 2026-02-23T06:26:38.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.849+0000 7ff23affd640 1 -- 10.20.193.58:0/3532976650 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff254201a40 msgr2=0x7ff254201450 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:26:38.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.849+0000 7ff23affd640 1 --2- 10.20.193.58:0/3532976650 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff254201a40 0x7ff254201450 secure :-1 s=CLOSED pgs=99 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2541fe8b0 tx=0x7ff23c00e970 comp rx=0 tx=0).stop 2026-02-23T06:26:38.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.849+0000 7ff23affd640 1 -- 10.20.193.58:0/3532976650 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7ff248038830 con 0x7ff2540b39f0 2026-02-23T06:26:38.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.850+0000 7ff23affd640 1 --2- 10.20.193.58:0/3532976650 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff22007a430 0x7ff22009a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:38.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.850+0000 7ff23affd640 1 -- 10.20.193.58:0/3532976650 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7ff2480c1e60 con 0x7ff2540b39f0 2026-02-23T06:26:38.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.850+0000 7ff251d74640 1 --2- 10.20.193.58:0/3532976650 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff22007a430 0x7ff22009a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:38.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.851+0000 7ff251d74640 1 --2- 10.20.193.58:0/3532976650 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff22007a430 0x7ff22009a8e0 secure :-1 s=READY pgs=194 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff23c00e9b0 tx=0x7ff23c013000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:38.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.853+0000 7ff258e5b640 1 --2- 10.20.193.58:0/3532976650 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff254161470 0x7ff25413c3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:38.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.853+0000 7ff258e5b640 1 -- 10.20.193.58:0/3532976650 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff254166010 con 0x7ff254161470 2026-02-23T06:26:38.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.853+0000 7ff252d76640 1 --2- 10.20.193.58:0/3532976650 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff254161470 0x7ff25413c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:38.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.853+0000 7ff252d76640 1 -- 10.20.193.58:0/3532976650 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff25415f790 con 0x7ff254161470 2026-02-23T06:26:38.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.854+0000 7ff252d76640 1 --2- 10.20.193.58:0/3532976650 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff254161470 0x7ff25413c3f0 secure :-1 s=READY pgs=100 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff244011970 tx=0x7ff244011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:38.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.854+0000 7ff23affd640 1 -- 10.20.193.58:0/3532976650 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2440055c0 con 0x7ff254161470 2026-02-23T06:26:38.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.854+0000 7ff23affd640 1 -- 10.20.193.58:0/3532976650 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5247 (secure 0 0 0) 0x7ff244005930 con 0x7ff254161470 2026-02-23T06:26:38.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.854+0000 7ff23affd640 1 -- 10.20.193.58:0/3532976650 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff254161470 msgr2=0x7ff25413c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:38.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.854+0000 7ff23affd640 1 --2- 10.20.193.58:0/3532976650 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff254161470 0x7ff25413c3f0 secure :-1 s=READY pgs=100 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff244011970 tx=0x7ff244011e40 comp rx=0 tx=0).stop 2026-02-23T06:26:38.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.854+0000 7ff23affd640 1 -- 10.20.193.58:0/3532976650 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff254161470 msgr2=0x7ff25413c3f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:26:38.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.854+0000 7ff23affd640 1 --2- 10.20.193.58:0/3532976650 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff254161470 0x7ff25413c3f0 unknown :-1 s=CLOSED pgs=100 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:38.851 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:26:38.851 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:26:38.851 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:26:38.852 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:26:38.852 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 46, 2026-02-23T06:26:38.852 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 125687, 2026-02-23T06:26:38.852 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:26:38.852 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:26:38.852 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:26:38.852 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:26:38.852 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:38.852 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:26:38.852 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:26:38.853 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:26:38.853 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:26:38.853 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:38.853 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:38.853 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:38.853 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:38.853 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:38.853 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:38.853 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:38.853 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:38.853 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:38.853 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:38.854 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:38.854 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:38.854 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:38.854 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:38.854 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:26:38.854 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:26:38.854 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:38.854 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:38.854 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:38.855 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:38.855 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:38.855 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:38.855 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:38.855 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:38.855 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:38.856 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:38.856 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:38.856 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:38.856 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:38.856 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:38.856 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:38.857 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:26:38.857 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:26:38.857 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:26:38.857 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:26:38.857 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:26:38.857 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:26:38.858 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:26:38.858 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:26:38.858 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:26:38.858 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:26:38.858 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:26:38.858 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:26:38.859 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:26:38.859 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:26:38.859 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:26:38.859 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:26:38.859 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:26:38.859 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:38.860 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:38.860 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:38.860 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:38.860 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:38.860 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:38.860 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:38.861 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:38.861 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:38.861 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:38.861 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:38.861 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:38.861 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:38.862 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:38.862 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:26:38.862 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:38.862 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:26:38.862 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:38.862 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:26:38.863 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:26:38.863 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:38.863 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:38.863 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:38.863 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:38.864 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:26:38.864 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:38.864 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:38.864 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:38.864 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:38.864 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:26:38.865 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:38.865 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:38.865 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:38.865 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:38.865 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:26:38.865 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:26:38.866 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:38.866 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:38.866 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:26:38.866 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:38.866 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:38.866 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:38.867 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:26:38.867 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:26:38.867 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:38.867 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:38.867 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:38.867 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:38.868 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:26:38.868 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:38.868 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:38.868 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:38.868 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:38.868 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:26:38.868 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:38.868 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:38.868 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:38.868 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:38.868 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:26:38.868 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:26:38.869 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:38.869 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:38.869 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:26:38.869 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:38.869 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:38.869 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:38.869 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:26:38.869 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:26:38.869 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:38.869 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:38.869 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:38.869 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:38.870 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:26:38.870 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:38.870 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:38.870 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:38.870 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:38.870 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:26:38.870 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:38.870 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:38.870 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:38.870 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:38.870 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:26:38.870 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:26:38.870 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:38.871 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:38.871 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:26:38.871 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:38.871 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:38.871 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:38.871 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:38.871 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:26:38.871 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:26:38.871 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:38.871 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:38.871 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:38.871 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:26:38.871 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:38.872 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:38.872 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:26:38.872 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:38.872 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:38.872 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:38.872 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:26:38.872 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:38.872 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:38.872 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:26:38.872 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:38.872 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:38.872 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:38.873 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:26:38.873 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:38.873 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:38.873 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:26:38.873 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:38.873 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:38.873 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:38.873 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:26:38.873 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:38.873 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:38.873 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:38.873 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:26:38.873 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:26:38.875 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.854+0000 7ff258e5b640 1 -- 10.20.193.58:0/3532976650 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff22007a430 msgr2=0x7ff22009a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:38.875 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.854+0000 7ff258e5b640 1 --2- 10.20.193.58:0/3532976650 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff22007a430 0x7ff22009a8e0 secure :-1 s=READY pgs=194 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff23c00e9b0 tx=0x7ff23c013000 comp rx=0 tx=0).stop 2026-02-23T06:26:38.875 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.854+0000 7ff258e5b640 1 -- 10.20.193.58:0/3532976650 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff2540b39f0 msgr2=0x7ff254161dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:38.876 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.854+0000 7ff258e5b640 1 --2- 10.20.193.58:0/3532976650 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff2540b39f0 0x7ff254161dc0 secure :-1 s=READY pgs=98 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2480023d0 tx=0x7ff2480028d0 comp rx=0 tx=0).stop 2026-02-23T06:26:38.876 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.854+0000 7ff252d76640 1 -- 10.20.193.58:0/3532976650 reap_dead start 2026-02-23T06:26:38.876 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.854+0000 7ff252d76640 1 -- 10.20.193.58:0/3532976650 reap_dead start 2026-02-23T06:26:38.876 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.854+0000 7ff258e5b640 1 -- 10.20.193.58:0/3532976650 shutdown_connections 2026-02-23T06:26:38.876 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.854+0000 7ff258e5b640 1 -- 10.20.193.58:0/3532976650 >> 10.20.193.58:0/3532976650 conn(0x7ff254058e50 msgr2=0x7ff254059220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:38.876 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.854+0000 7ff258e5b640 1 -- 10.20.193.58:0/3532976650 shutdown_connections 2026-02-23T06:26:38.876 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:38.854+0000 7ff258e5b640 1 -- 10.20.193.58:0/3532976650 wait complete. 2026-02-23T06:26:38.877 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:26:38.877 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:26:38.877 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:26:38.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.003+0000 7f901a483640 1 -- 10.20.193.58:0/1779511915 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f901405d370 msgr2=0x7f90140b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:38.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.003+0000 7f901a483640 1 --2- 10.20.193.58:0/1779511915 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f901405d370 0x7f90140b5680 secure :-1 s=READY pgs=43 gs=3 cs=0 l=1 c_cookie=17368243702844246853 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9010005820 tx=0x7f90100302b0 comp rx=0 tx=0).stop 2026-02-23T06:26:38.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.003+0000 7f901a483640 1 -- 10.20.193.58:0/1779511915 shutdown_connections 2026-02-23T06:26:38.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.003+0000 7f901a483640 1 --2- 10.20.193.58:0/1779511915 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f901405d370 0x7f90140b5680 unknown :-1 s=CLOSED pgs=43 gs=3 cs=0 l=1 c_cookie=17368243702844246853 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:39.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.003+0000 7f901a483640 1 --2- 10.20.193.58:0/1779511915 >> v2:10.20.193.93:3300/0 conn(0x7f9014056550 0x7f901405ce30 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:39.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.003+0000 7f901a483640 1 -- 10.20.193.58:0/1779511915 >> 10.20.193.58:0/1779511915 conn(0x7f90140b3c20 msgr2=0x7f90140b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:39.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.003+0000 7f901a483640 1 -- 10.20.193.58:0/1779511915 shutdown_connections 2026-02-23T06:26:39.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.004+0000 7f901a483640 1 -- 10.20.193.58:0/1779511915 wait complete. 2026-02-23T06:26:39.005 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.005+0000 7f901a483640 1 Processor -- start 2026-02-23T06:26:39.005 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.005+0000 7f901a483640 1 -- start start 2026-02-23T06:26:39.005 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.005+0000 7f901a483640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9014056550 0x7f9014162820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:39.005 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.005+0000 7f901a483640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f901405d370 0x7f90141606a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:39.006 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.005+0000 7f901a483640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f901415c040 0x7f90140585e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:39.006 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.005+0000 7f901a483640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f90141619e0 con 0x7f9014056550 2026-02-23T06:26:39.006 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.005+0000 7f901a483640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f90141558f0 con 0x7f901415c040 2026-02-23T06:26:39.006 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.005+0000 7f901a483640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f90141fe060 con 0x7f901405d370 2026-02-23T06:26:39.006 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.005+0000 7f9019481640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9014056550 0x7f9014162820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:39.006 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.006+0000 7f9019c82640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f901415c040 0x7f90140585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:39.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.006+0000 7f9019c82640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f901415c040 0x7f90140585e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:46906/0 (socket says 10.20.193.58:46906) 2026-02-23T06:26:39.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.006+0000 7f9019c82640 1 -- 10.20.193.58:0/3375451386 learned_addr learned my addr 10.20.193.58:0/3375451386 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:26:39.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.006+0000 7f9019481640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9014056550 0x7f9014162820 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:43134/0 (socket says 10.20.193.58:43134) 2026-02-23T06:26:39.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.006+0000 7f9018c80640 1 --2- 10.20.193.58:0/3375451386 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f901405d370 0x7f90141606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:39.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.006+0000 7f9019481640 1 -- 10.20.193.58:0/3375451386 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f901405d370 msgr2=0x7f90141606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:39.008 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.006+0000 7f9019481640 1 --2- 10.20.193.58:0/3375451386 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f901405d370 0x7f90141606a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:39.008 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.006+0000 7f9019481640 1 -- 10.20.193.58:0/3375451386 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f901415c040 msgr2=0x7f90140585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:39.008 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.006+0000 7f9019481640 1 --2- 10.20.193.58:0/3375451386 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f901415c040 0x7f90140585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:39.008 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.006+0000 7f9019481640 1 -- 10.20.193.58:0/3375451386 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f901000a590 con 0x7f9014056550 2026-02-23T06:26:39.008 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.006+0000 7f9019481640 1 --2- 10.20.193.58:0/3375451386 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9014056550 0x7f9014162820 secure :-1 s=READY pgs=101 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9004007fd0 tx=0x7f900400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:39.008 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.006+0000 7f9001ffb640 1 -- 10.20.193.58:0/3375451386 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9004004250 con 0x7f9014056550 2026-02-23T06:26:39.008 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.006+0000 7f9001ffb640 1 -- 10.20.193.58:0/3375451386 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90040044a0 con 0x7f9014056550 2026-02-23T06:26:39.008 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.006+0000 7f9001ffb640 1 -- 10.20.193.58:0/3375451386 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90040038b0 con 0x7f9014056550 2026-02-23T06:26:39.008 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.006+0000 7f901a483640 1 -- 10.20.193.58:0/3375451386 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9014161420 con 0x7f9014056550 2026-02-23T06:26:39.008 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.006+0000 7f901a483640 1 -- 10.20.193.58:0/3375451386 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9014162020 con 0x7f9014056550 2026-02-23T06:26:39.008 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.007+0000 7f901a483640 1 --2- 10.20.193.58:0/3375451386 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9014162240 0x7f9014058b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:39.009 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.007+0000 7f901a483640 1 -- 10.20.193.58:0/3375451386 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f90141fde70 con 0x7f9014162240 2026-02-23T06:26:39.009 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.007+0000 7f9018c80640 1 --2- 10.20.193.58:0/3375451386 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9014162240 0x7f9014058b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:39.009 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.008+0000 7f9018c80640 1 -- 10.20.193.58:0/3375451386 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f901405d9c0 con 0x7f9014162240 2026-02-23T06:26:39.009 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.008+0000 7f9018c80640 1 --2- 10.20.193.58:0/3375451386 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9014162240 0x7f9014058b20 secure :-1 s=READY pgs=5 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90141fb090 tx=0x7f900800fda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:39.009 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.008+0000 7f9001ffb640 1 -- 10.20.193.58:0/3375451386 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f900800db20 con 0x7f9014162240 2026-02-23T06:26:39.009 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.008+0000 7f9001ffb640 1 -- 10.20.193.58:0/3375451386 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f900800dc80 con 0x7f9014162240 2026-02-23T06:26:39.009 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.008+0000 7f9001ffb640 1 -- 10.20.193.58:0/3375451386 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9014162240 msgr2=0x7f9014058b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:39.009 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.008+0000 7f9001ffb640 1 --2- 10.20.193.58:0/3375451386 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9014162240 0x7f9014058b20 secure :-1 s=READY pgs=5 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90141fb090 tx=0x7f900800fda0 comp rx=0 tx=0).stop 2026-02-23T06:26:39.009 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.008+0000 7f9001ffb640 1 -- 10.20.193.58:0/3375451386 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9014162240 msgr2=0x7f9014058b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:26:39.009 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.008+0000 7f9001ffb640 1 --2- 10.20.193.58:0/3375451386 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9014162240 0x7f9014058b20 unknown :-1 s=CLOSED pgs=5 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:39.009 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.008+0000 7f9001ffb640 1 -- 10.20.193.58:0/3375451386 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f9004003a10 con 0x7f9014056550 2026-02-23T06:26:39.009 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.009+0000 7f9001ffb640 1 --2- 10.20.193.58:0/3375451386 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8fe407a2d0 0x7f8fe409a780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:39.010 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.009+0000 7f9001ffb640 1 -- 10.20.193.58:0/3375451386 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f900409cc60 con 0x7f9014056550 2026-02-23T06:26:39.010 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.009+0000 7f9018c80640 1 --2- 10.20.193.58:0/3375451386 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8fe407a2d0 0x7f8fe409a780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:39.012 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.010+0000 7f9018c80640 1 --2- 10.20.193.58:0/3375451386 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8fe407a2d0 0x7f8fe409a780 secure :-1 s=READY pgs=195 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90080023d0 tx=0x7f9008014000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:39.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.012+0000 7f901a483640 1 --2- 10.20.193.58:0/3375451386 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9014160be0 0x7f90142009d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:39.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.012+0000 7f901a483640 1 -- 10.20.193.58:0/3375451386 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f90140b5bc0 con 0x7f9014160be0 2026-02-23T06:26:39.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.013+0000 7f9019c82640 1 --2- 10.20.193.58:0/3375451386 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9014160be0 0x7f90142009d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:39.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.013+0000 7f9019c82640 1 -- 10.20.193.58:0/3375451386 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f901405ce30 con 0x7f9014160be0 2026-02-23T06:26:39.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.013+0000 7f9019c82640 1 --2- 10.20.193.58:0/3375451386 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9014160be0 0x7f90142009d0 secure :-1 s=READY pgs=6 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f901000aa40 tx=0x7f9010003d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:39.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.013+0000 7f9001ffb640 1 -- 10.20.193.58:0/3375451386 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f901003e050 con 0x7f9014160be0 2026-02-23T06:26:39.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.013+0000 7f9001ffb640 1 -- 10.20.193.58:0/3375451386 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4908 (secure 0 0 0) 0x7f901003f040 con 0x7f9014160be0 2026-02-23T06:26:39.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.013+0000 7f9001ffb640 1 -- 10.20.193.58:0/3375451386 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9014160be0 msgr2=0x7f90142009d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:39.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.013+0000 7f9001ffb640 1 --2- 10.20.193.58:0/3375451386 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9014160be0 0x7f90142009d0 secure :-1 s=READY pgs=6 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f901000aa40 tx=0x7f9010003d20 comp rx=0 tx=0).stop 2026-02-23T06:26:39.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.014+0000 7f9001ffb640 1 -- 10.20.193.58:0/3375451386 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9014160be0 msgr2=0x7f90142009d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:26:39.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.014+0000 7f9001ffb640 1 --2- 10.20.193.58:0/3375451386 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9014160be0 0x7f90142009d0 secure :-1 s=CLOSED pgs=6 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f901000aa40 tx=0x7f9010003d20 comp rx=0 tx=0).stop 2026-02-23T06:26:39.015 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:26:39.015 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:26:39.015 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:26:39.015 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:26:39.015 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 46, 2026-02-23T06:26:39.015 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 525, 2026-02-23T06:26:39.015 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:26:39.015 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:26:39.015 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:26:39.016 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:26:39.016 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:39.016 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:26:39.016 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:26:39.016 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:26:39.016 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:26:39.016 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:39.016 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:39.016 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:39.016 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:39.017 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:39.017 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:39.017 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:39.017 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:39.017 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:39.017 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:39.017 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:39.017 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:39.017 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:39.017 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:39.017 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:26:39.017 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:26:39.018 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:39.018 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:39.018 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:39.018 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:39.018 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:39.018 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:39.018 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:39.018 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:39.018 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:39.019 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:39.019 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:39.019 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:39.019 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:39.019 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:39.019 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:39.019 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:26:39.019 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:26:39.020 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:26:39.020 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:26:39.020 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:26:39.020 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:26:39.020 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:26:39.020 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:26:39.020 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:26:39.020 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:26:39.021 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:26:39.021 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:26:39.021 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:26:39.021 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:26:39.021 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:26:39.021 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:26:39.021 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:26:39.021 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:39.022 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:39.022 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:39.022 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:39.022 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:39.022 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:39.022 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:39.022 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:39.022 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:39.023 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:39.023 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:39.023 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:39.023 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:39.023 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:39.023 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:26:39.023 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:39.023 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:26:39.024 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:39.024 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:26:39.024 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:26:39.024 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:39.024 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:39.024 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:39.024 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:39.024 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:26:39.025 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:39.025 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:39.025 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:39.025 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:39.025 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:26:39.025 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:39.025 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:39.025 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:39.026 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:39.026 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:26:39.026 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:26:39.026 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:39.026 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:39.026 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:26:39.026 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:39.026 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:39.026 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:39.027 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:26:39.027 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:26:39.027 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:39.027 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:39.027 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:39.027 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:39.027 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:26:39.027 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:39.028 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:39.028 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:39.028 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:39.028 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:26:39.028 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:39.028 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:39.028 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:39.028 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:39.029 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:26:39.029 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:26:39.029 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:39.029 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:39.029 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:26:39.029 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:39.029 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:39.029 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:39.030 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:26:39.030 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:26:39.030 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:39.030 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:39.030 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:39.030 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:39.030 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:26:39.030 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:39.030 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:39.031 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:39.031 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:39.031 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:26:39.031 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:39.031 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:39.031 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:39.031 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:39.031 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:26:39.032 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:26:39.032 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:39.032 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:39.032 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:26:39.032 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:39.032 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:39.032 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:39.032 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:39.032 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:26:39.033 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:26:39.033 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:39.033 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:39.033 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:39.033 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:26:39.033 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:39.033 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:39.033 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:26:39.033 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:39.034 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:39.034 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:39.034 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:26:39.034 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:39.034 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:39.034 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:39.034 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:26:39.034 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:26:39.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.014+0000 7f901a483640 1 -- 10.20.193.58:0/3375451386 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8fe407a2d0 msgr2=0x7f8fe409a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:39.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.014+0000 7f901a483640 1 --2- 10.20.193.58:0/3375451386 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8fe407a2d0 0x7f8fe409a780 secure :-1 s=READY pgs=195 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90080023d0 tx=0x7f9008014000 comp rx=0 tx=0).stop 2026-02-23T06:26:39.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.014+0000 7f901a483640 1 -- 10.20.193.58:0/3375451386 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9014056550 msgr2=0x7f9014162820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:39.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.014+0000 7f901a483640 1 --2- 10.20.193.58:0/3375451386 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9014056550 0x7f9014162820 secure :-1 s=READY pgs=101 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9004007fd0 tx=0x7f900400c970 comp rx=0 tx=0).stop 2026-02-23T06:26:39.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.014+0000 7f9019c82640 1 -- 10.20.193.58:0/3375451386 reap_dead start 2026-02-23T06:26:39.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.014+0000 7f901a483640 1 -- 10.20.193.58:0/3375451386 shutdown_connections 2026-02-23T06:26:39.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.014+0000 7f901a483640 1 --2- 10.20.193.58:0/3375451386 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9014056550 0x7f9014162820 unknown :-1 s=CLOSED pgs=101 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:39.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.014+0000 7f901a483640 1 -- 10.20.193.58:0/3375451386 >> 10.20.193.58:0/3375451386 conn(0x7f90140b3c20 msgr2=0x7f901415b380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:39.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.014+0000 7f901a483640 1 -- 10.20.193.58:0/3375451386 shutdown_connections 2026-02-23T06:26:39.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.014+0000 7f901a483640 1 -- 10.20.193.58:0/3375451386 wait complete. 2026-02-23T06:26:39.038 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:26:39.038 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:26:39.038 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:26:39.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.166+0000 7efdb98c3640 1 -- 10.20.193.58:0/1691401990 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efdb40b6690 msgr2=0x7efdb4058ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:39.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.166+0000 7efdb98c3640 1 --2- 10.20.193.58:0/1691401990 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efdb40b6690 0x7efdb4058ec0 secure :-1 s=READY pgs=8 gs=3 cs=0 l=1 c_cookie=12481116967735151526 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdb0005820 tx=0x7efdb0030300 comp rx=0 tx=0).stop 2026-02-23T06:26:39.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.166+0000 7efdb98c3640 1 -- 10.20.193.58:0/1691401990 shutdown_connections 2026-02-23T06:26:39.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.166+0000 7efdb98c3640 1 --2- 10.20.193.58:0/1691401990 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efdb40b6690 0x7efdb4058ec0 unknown :-1 s=CLOSED pgs=8 gs=3 cs=0 l=1 c_cookie=12481116967735151526 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:39.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.166+0000 7efdb98c3640 1 -- 10.20.193.58:0/1691401990 >> 10.20.193.58:0/1691401990 conn(0x7efdb40b3c20 msgr2=0x7efdb40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:39.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.166+0000 7efdb98c3640 1 -- 10.20.193.58:0/1691401990 shutdown_connections 2026-02-23T06:26:39.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.166+0000 7efdb98c3640 1 -- 10.20.193.58:0/1691401990 wait complete. 2026-02-23T06:26:39.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.167+0000 7efdb98c3640 1 Processor -- start 2026-02-23T06:26:39.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.167+0000 7efdb98c3640 1 -- start start 2026-02-23T06:26:39.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.168+0000 7efdb98c3640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efdb40b6690 0x7efdb415a5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:39.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.168+0000 7efdb98c3640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efdb415d4a0 0x7efdb415f9b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:39.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.168+0000 7efdb98c3640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efdb415d870 0x7efdb415fef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:39.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.168+0000 7efdb98c3640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7efdb41fc200 con 0x7efdb40b6690 2026-02-23T06:26:39.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.168+0000 7efdb98c3640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7efdb415ab00 con 0x7efdb415d870 2026-02-23T06:26:39.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.168+0000 7efdb98c3640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7efdb4167200 con 0x7efdb415d4a0 2026-02-23T06:26:39.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.168+0000 7efdb88c1640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efdb40b6690 0x7efdb415a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:39.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.168+0000 7efdabfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efdb415d4a0 0x7efdb415f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:39.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.168+0000 7efdb90c2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efdb415d870 0x7efdb415fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:39.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.168+0000 7efdb90c2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efdb415d870 0x7efdb415fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:46948/0 (socket says 10.20.193.58:46948) 2026-02-23T06:26:39.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.168+0000 7efdb90c2640 1 -- 10.20.193.58:0/2799485077 learned_addr learned my addr 10.20.193.58:0/2799485077 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:26:39.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.168+0000 7efdabfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efdb415d4a0 0x7efdb415f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:44242/0 (socket says 10.20.193.58:44242) 2026-02-23T06:26:39.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.168+0000 7efdb88c1640 1 -- 10.20.193.58:0/2799485077 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efdb415d4a0 msgr2=0x7efdb415f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:39.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.168+0000 7efdb88c1640 1 --2- 10.20.193.58:0/2799485077 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efdb415d4a0 0x7efdb415f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:39.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.168+0000 7efdb88c1640 1 -- 10.20.193.58:0/2799485077 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efdb415d870 msgr2=0x7efdb415fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:39.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.168+0000 7efdb88c1640 1 --2- 10.20.193.58:0/2799485077 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efdb415d870 0x7efdb415fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:39.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.168+0000 7efdb88c1640 1 -- 10.20.193.58:0/2799485077 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb000a590 con 0x7efdb40b6690 2026-02-23T06:26:39.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.169+0000 7efdb88c1640 1 --2- 10.20.193.58:0/2799485077 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efdb40b6690 0x7efdb415a5c0 secure :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efda40029a0 tx=0x7efda400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:39.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.169+0000 7efda97fa640 1 -- 10.20.193.58:0/2799485077 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efda40117b0 con 0x7efdb40b6690 2026-02-23T06:26:39.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.169+0000 7efda97fa640 1 -- 10.20.193.58:0/2799485077 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efda4011a00 con 0x7efdb40b6690 2026-02-23T06:26:39.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.169+0000 7efda97fa640 1 -- 10.20.193.58:0/2799485077 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efda4011e30 con 0x7efdb40b6690 2026-02-23T06:26:39.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.169+0000 7efdb98c3640 1 -- 10.20.193.58:0/2799485077 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdb4166e50 con 0x7efdb40b6690 2026-02-23T06:26:39.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.169+0000 7efdb98c3640 1 -- 10.20.193.58:0/2799485077 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdb415f250 con 0x7efdb40b6690 2026-02-23T06:26:39.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.169+0000 7efdb98c3640 1 --2- 10.20.193.58:0/2799485077 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efdb41fbd10 0x7efdb4164d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:39.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.169+0000 7efdb98c3640 1 -- 10.20.193.58:0/2799485077 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7efdb40b5e10 con 0x7efdb41fbd10 2026-02-23T06:26:39.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.170+0000 7efdabfff640 1 --2- 10.20.193.58:0/2799485077 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efdb41fbd10 0x7efdb4164d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:39.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.170+0000 7efdabfff640 1 -- 10.20.193.58:0/2799485077 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efdb40b5b30 con 0x7efdb41fbd10 2026-02-23T06:26:39.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.170+0000 7efdabfff640 1 --2- 10.20.193.58:0/2799485077 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efdb41fbd10 0x7efdb4164d30 secure :-1 s=READY pgs=44 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd9c007fd0 tx=0x7efd9c00eb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:39.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.171+0000 7efda97fa640 1 -- 10.20.193.58:0/2799485077 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7efda401c460 con 0x7efdb40b6690 2026-02-23T06:26:39.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.172+0000 7efda97fa640 1 --2- 10.20.193.58:0/2799485077 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efd8407a600 0x7efd8409aab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:39.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.172+0000 7efda97fa640 1 -- 10.20.193.58:0/2799485077 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd9c019070 con 0x7efdb41fbd10 2026-02-23T06:26:39.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.172+0000 7efda97fa640 1 -- 10.20.193.58:0/2799485077 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7efda409d340 con 0x7efdb40b6690 2026-02-23T06:26:39.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.172+0000 7efda97fa640 1 -- 10.20.193.58:0/2799485077 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7efd9c006ab0 con 0x7efdb41fbd10 2026-02-23T06:26:39.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.172+0000 7efda97fa640 1 -- 10.20.193.58:0/2799485077 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efdb41fbd10 msgr2=0x7efdb4164d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:39.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.172+0000 7efda97fa640 1 --2- 10.20.193.58:0/2799485077 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efdb41fbd10 0x7efdb4164d30 secure :-1 s=READY pgs=44 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd9c007fd0 tx=0x7efd9c00eb30 comp rx=0 tx=0).stop 2026-02-23T06:26:39.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.172+0000 7efda97fa640 1 -- 10.20.193.58:0/2799485077 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efdb41fbd10 msgr2=0x7efdb4164d30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:26:39.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.172+0000 7efda97fa640 1 --2- 10.20.193.58:0/2799485077 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efdb41fbd10 0x7efdb4164d30 unknown :-1 s=CLOSED pgs=44 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:39.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.172+0000 7efdb90c2640 1 --2- 10.20.193.58:0/2799485077 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efd8407a600 0x7efd8409aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:39.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.173+0000 7efdb90c2640 1 --2- 10.20.193.58:0/2799485077 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efd8407a600 0x7efd8409aab0 secure :-1 s=READY pgs=196 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdb41f5890 tx=0x7efdb003b040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:39.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.175+0000 7efdb98c3640 1 --2- 10.20.193.58:0/2799485077 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efdb415ebc0 0x7efdb4165270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:39.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.175+0000 7efdb98c3640 1 -- 10.20.193.58:0/2799485077 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7efdb41657b0 con 0x7efdb415ebc0 2026-02-23T06:26:39.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.176+0000 7efdabfff640 1 --2- 10.20.193.58:0/2799485077 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efdb415ebc0 0x7efdb4165270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:39.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.176+0000 7efdabfff640 1 -- 10.20.193.58:0/2799485077 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efdb40b6d50 con 0x7efdb415ebc0 2026-02-23T06:26:39.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.176+0000 7efdabfff640 1 --2- 10.20.193.58:0/2799485077 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efdb415ebc0 0x7efdb4165270 secure :-1 s=READY pgs=45 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd9c017040 tx=0x7efd9c0028f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:39.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.176+0000 7efda97fa640 1 -- 10.20.193.58:0/2799485077 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd9c002a20 con 0x7efdb415ebc0 2026-02-23T06:26:39.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.177+0000 7efda97fa640 1 -- 10.20.193.58:0/2799485077 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5554 (secure 0 0 0) 0x7efd9c00c5e0 con 0x7efdb415ebc0 2026-02-23T06:26:39.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.177+0000 7efda97fa640 1 -- 10.20.193.58:0/2799485077 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efdb415ebc0 msgr2=0x7efdb4165270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:39.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.177+0000 7efda97fa640 1 --2- 10.20.193.58:0/2799485077 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efdb415ebc0 0x7efdb4165270 secure :-1 s=READY pgs=45 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd9c017040 tx=0x7efd9c0028f0 comp rx=0 tx=0).stop 2026-02-23T06:26:39.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.177+0000 7efda97fa640 1 -- 10.20.193.58:0/2799485077 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efdb415ebc0 msgr2=0x7efdb4165270 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:26:39.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.177+0000 7efda97fa640 1 --2- 10.20.193.58:0/2799485077 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efdb415ebc0 0x7efdb4165270 unknown :-1 s=CLOSED pgs=45 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:39.173 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:26:39.173 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:26:39.173 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:26:39.173 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:26:39.173 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 46, 2026-02-23T06:26:39.173 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 73689, 2026-02-23T06:26:39.173 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:26:39.173 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:26:39.173 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:26:39.174 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:26:39.174 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:39.174 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:26:39.174 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:26:39.174 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:26:39.174 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:26:39.174 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:39.174 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:39.174 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:39.174 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:39.174 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:39.175 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:39.175 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:39.175 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:39.175 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:39.175 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:39.175 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:39.175 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:39.175 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:39.175 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:39.175 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:26:39.175 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:26:39.175 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:39.175 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:39.176 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:39.176 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:39.176 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:39.176 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:39.176 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:39.176 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:39.176 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:39.176 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:39.176 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:39.176 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:39.176 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:39.177 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:39.177 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:39.177 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:26:39.177 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:26:39.177 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:26:39.177 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:26:39.177 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:26:39.177 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:26:39.177 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:26:39.177 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:26:39.177 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:26:39.177 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:26:39.178 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:26:39.178 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:26:39.178 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:26:39.178 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:26:39.178 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:26:39.178 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:26:39.178 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:26:39.178 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:39.178 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:39.178 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:39.178 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:39.178 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:39.179 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:39.179 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:39.179 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:39.179 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:39.179 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:39.179 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:39.179 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:39.179 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:39.179 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:39.179 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:26:39.179 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:39.179 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:26:39.180 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:39.180 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:26:39.180 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:26:39.180 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:39.180 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:39.180 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:39.180 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:39.180 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:26:39.180 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:39.180 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:39.180 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:39.180 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:39.181 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:26:39.181 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:39.181 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:39.181 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:39.181 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:39.181 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:26:39.181 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:26:39.181 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:39.181 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:39.181 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:26:39.181 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:39.181 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:39.181 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:39.182 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:26:39.182 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:26:39.182 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:39.182 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:39.182 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:39.182 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:39.182 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:26:39.182 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:39.182 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:39.182 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:39.182 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:39.182 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:26:39.182 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:39.183 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:39.183 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:39.183 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:39.183 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:26:39.183 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:26:39.183 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:39.183 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:39.183 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:26:39.183 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:39.183 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:39.183 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:39.183 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:26:39.184 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:26:39.184 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:39.184 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:39.184 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:39.184 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:39.184 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:26:39.184 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:39.184 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:39.184 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:39.184 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:39.184 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:26:39.184 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:39.184 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:39.185 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:39.185 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:39.185 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:26:39.185 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:26:39.185 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:39.185 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:39.185 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:26:39.185 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:39.185 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:39.186 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:39.186 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:39.186 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:26:39.186 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:26:39.186 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:39.186 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:39.186 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:39.186 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:26:39.186 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:39.186 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:39.186 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:26:39.186 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:39.187 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:39.187 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:39.187 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:26:39.187 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:39.187 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:39.187 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:26:39.187 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:39.187 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:39.187 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:39.187 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:26:39.187 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:39.187 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:39.187 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:26:39.188 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:39.188 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:26:39.188 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:26:39.188 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:26:39.188 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:39.188 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:39.188 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:39.188 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:39.188 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:26:39.188 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:39.188 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:39.188 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:26:39.189 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:39.189 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:39.189 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:39.189 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:26:39.189 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:39.189 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:39.189 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:39.189 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:26:39.189 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:26:39.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.177+0000 7efdb98c3640 1 -- 10.20.193.58:0/2799485077 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efd8407a600 msgr2=0x7efd8409aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:39.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.177+0000 7efdb98c3640 1 --2- 10.20.193.58:0/2799485077 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efd8407a600 0x7efd8409aab0 secure :-1 s=READY pgs=196 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdb41f5890 tx=0x7efdb003b040 comp rx=0 tx=0).stop 2026-02-23T06:26:39.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.177+0000 7efdb98c3640 1 -- 10.20.193.58:0/2799485077 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efdb40b6690 msgr2=0x7efdb415a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:39.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.177+0000 7efdb98c3640 1 --2- 10.20.193.58:0/2799485077 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efdb40b6690 0x7efdb415a5c0 secure :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efda40029a0 tx=0x7efda400c970 comp rx=0 tx=0).stop 2026-02-23T06:26:39.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.177+0000 7efdb90c2640 1 -- 10.20.193.58:0/2799485077 reap_dead start 2026-02-23T06:26:39.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.177+0000 7efdb90c2640 1 -- 10.20.193.58:0/2799485077 reap_dead start 2026-02-23T06:26:39.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.177+0000 7efdb98c3640 1 -- 10.20.193.58:0/2799485077 shutdown_connections 2026-02-23T06:26:39.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.177+0000 7efdb98c3640 1 -- 10.20.193.58:0/2799485077 >> 10.20.193.58:0/2799485077 conn(0x7efdb40b3c20 msgr2=0x7efdb40affa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:39.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.177+0000 7efdb98c3640 1 -- 10.20.193.58:0/2799485077 shutdown_connections 2026-02-23T06:26:39.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.177+0000 7efdb98c3640 1 -- 10.20.193.58:0/2799485077 wait complete. 2026-02-23T06:26:39.193 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:26:39.193 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:26:39.193 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:26:39.314 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.319+0000 7fd158e8c640 1 -- 10.20.193.58:0/4107465671 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd154158740 msgr2=0x7fd1540b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:39.315 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.319+0000 7fd158e8c640 1 --2- 10.20.193.58:0/4107465671 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd154158740 0x7fd1540b72c0 secure :-1 s=READY pgs=104 gs=2 cs=0 l=1 c_cookie=6780264978786651457 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd148005e70 tx=0x7fd14802f290 comp rx=0 tx=0).stop 2026-02-23T06:26:39.315 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.319+0000 7fd158e8c640 1 -- 10.20.193.58:0/4107465671 shutdown_connections 2026-02-23T06:26:39.315 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.319+0000 7fd158e8c640 1 --2- 10.20.193.58:0/4107465671 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd1540b6a20 0x7fd1540b3300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:39.315 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.319+0000 7fd158e8c640 1 --2- 10.20.193.58:0/4107465671 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd154158740 0x7fd1540b72c0 unknown :-1 s=CLOSED pgs=104 gs=2 cs=0 l=1 c_cookie=6780264978786651457 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:39.315 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.319+0000 7fd158e8c640 1 -- 10.20.193.58:0/4107465671 >> 10.20.193.58:0/4107465671 conn(0x7fd154058e50 msgr2=0x7fd154059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:39.315 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.319+0000 7fd158e8c640 1 -- 10.20.193.58:0/4107465671 shutdown_connections 2026-02-23T06:26:39.315 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.319+0000 7fd158e8c640 1 -- 10.20.193.58:0/4107465671 wait complete. 2026-02-23T06:26:39.318 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.320+0000 7fd158e8c640 1 Processor -- start 2026-02-23T06:26:39.318 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.320+0000 7fd158e8c640 1 -- start start 2026-02-23T06:26:39.318 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.321+0000 7fd158e8c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd1540b6a20 0x7fd154138570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:39.318 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.321+0000 7fd158e8c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd154158740 0x7fd15415df40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:39.318 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.321+0000 7fd152575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd1540b6a20 0x7fd154138570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:39.318 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.321+0000 7fd152575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd1540b6a20 0x7fd154138570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:44274/0 (socket says 10.20.193.58:44274) 2026-02-23T06:26:39.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.321+0000 7fd158e8c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd154161ee0 0x7fd15415e480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:39.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.321+0000 7fd152575640 1 -- 10.20.193.58:0/2818536624 learned_addr learned my addr 10.20.193.58:0/2818536624 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:26:39.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.321+0000 7fd151d74640 1 --2- 10.20.193.58:0/2818536624 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd154158740 0x7fd15415df40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:39.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.321+0000 7fd158e8c640 1 -- 10.20.193.58:0/2818536624 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fd1540b0990 con 0x7fd154158740 2026-02-23T06:26:39.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.322+0000 7fd158e8c640 1 -- 10.20.193.58:0/2818536624 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fd1540b0370 con 0x7fd154161ee0 2026-02-23T06:26:39.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.322+0000 7fd158e8c640 1 -- 10.20.193.58:0/2818536624 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fd154161a10 con 0x7fd1540b6a20 2026-02-23T06:26:39.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.322+0000 7fd152d76640 1 --2- 10.20.193.58:0/2818536624 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd154161ee0 0x7fd15415e480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:39.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.322+0000 7fd152575640 1 -- 10.20.193.58:0/2818536624 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd154161ee0 msgr2=0x7fd15415e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:39.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.322+0000 7fd152575640 1 --2- 10.20.193.58:0/2818536624 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd154161ee0 0x7fd15415e480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:39.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.322+0000 7fd152575640 1 -- 10.20.193.58:0/2818536624 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd154158740 msgr2=0x7fd15415df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:39.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.322+0000 7fd152575640 1 --2- 10.20.193.58:0/2818536624 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd154158740 0x7fd15415df40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:39.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.322+0000 7fd152575640 1 -- 10.20.193.58:0/2818536624 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd148009570 con 0x7fd1540b6a20 2026-02-23T06:26:39.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.322+0000 7fd152d76640 1 --2- 10.20.193.58:0/2818536624 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd154161ee0 0x7fd15415e480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:26:39.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.322+0000 7fd151d74640 1 --2- 10.20.193.58:0/2818536624 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd154158740 0x7fd15415df40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:26:39.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.322+0000 7fd152575640 1 --2- 10.20.193.58:0/2818536624 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd1540b6a20 0x7fd154138570 secure :-1 s=READY pgs=46 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd148004740 tx=0x7fd1480028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:39.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.322+0000 7fd13affd640 1 -- 10.20.193.58:0/2818536624 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd14803d070 con 0x7fd1540b6a20 2026-02-23T06:26:39.321 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.323+0000 7fd158e8c640 1 -- 10.20.193.58:0/2818536624 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1540ae0c0 con 0x7fd1540b6a20 2026-02-23T06:26:39.321 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.323+0000 7fd158e8c640 1 -- 10.20.193.58:0/2818536624 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd154138ab0 con 0x7fd1540b6a20 2026-02-23T06:26:39.321 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.323+0000 7fd13affd640 1 -- 10.20.193.58:0/2818536624 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd148038470 con 0x7fd1540b6a20 2026-02-23T06:26:39.321 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.323+0000 7fd13affd640 1 -- 10.20.193.58:0/2818536624 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd1480388a0 con 0x7fd1540b6a20 2026-02-23T06:26:39.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.323+0000 7fd158e8c640 1 -- 10.20.193.58:0/2818536624 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd154161870 con 0x7fd1540b6a20 2026-02-23T06:26:39.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.324+0000 7fd13affd640 1 -- 10.20.193.58:0/2818536624 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fd148038a00 con 0x7fd1540b6a20 2026-02-23T06:26:39.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.325+0000 7fd13affd640 1 --2- 10.20.193.58:0/2818536624 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd12007a6c0 0x7fd12009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:39.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.325+0000 7fd13affd640 1 -- 10.20.193.58:0/2818536624 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fd1480c2130 con 0x7fd1540b6a20 2026-02-23T06:26:39.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.326+0000 7fd151d74640 1 --2- 10.20.193.58:0/2818536624 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd12007a6c0 0x7fd12009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:39.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.326+0000 7fd151d74640 1 --2- 10.20.193.58:0/2818536624 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd12007a6c0 0x7fd12009ab70 secure :-1 s=READY pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd154139910 tx=0x7fd13c007ee0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:39.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.327+0000 7fd13affd640 1 -- 10.20.193.58:0/2818536624 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fd154161870 con 0x7fd1540b6a20 2026-02-23T06:26:39.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.482+0000 7fd158e8c640 1 -- 10.20.193.58:0/2818536624 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fd154161870 con 0x7fd1540b6a20 2026-02-23T06:26:39.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.483+0000 7fd13affd640 1 -- 10.20.193.58:0/2818536624 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fd154161870 con 0x7fd1540b6a20 2026-02-23T06:26:39.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.484+0000 7fd158e8c640 1 -- 10.20.193.58:0/2818536624 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd12007a6c0 msgr2=0x7fd12009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:39.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.484+0000 7fd158e8c640 1 --2- 10.20.193.58:0/2818536624 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd12007a6c0 0x7fd12009ab70 secure :-1 s=READY pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd154139910 tx=0x7fd13c007ee0 comp rx=0 tx=0).stop 2026-02-23T06:26:39.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.484+0000 7fd158e8c640 1 -- 10.20.193.58:0/2818536624 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd1540b6a20 msgr2=0x7fd154138570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:39.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.484+0000 7fd158e8c640 1 --2- 10.20.193.58:0/2818536624 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd1540b6a20 0x7fd154138570 secure :-1 s=READY pgs=46 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd148004740 tx=0x7fd1480028d0 comp rx=0 tx=0).stop 2026-02-23T06:26:39.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.484+0000 7fd158e8c640 1 -- 10.20.193.58:0/2818536624 shutdown_connections 2026-02-23T06:26:39.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.484+0000 7fd158e8c640 1 --2- 10.20.193.58:0/2818536624 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd12007a6c0 0x7fd12009ab70 unknown :-1 s=CLOSED pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:39.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.484+0000 7fd158e8c640 1 --2- 10.20.193.58:0/2818536624 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd154161ee0 0x7fd15415e480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:39.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.484+0000 7fd158e8c640 1 --2- 10.20.193.58:0/2818536624 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd154158740 0x7fd15415df40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:39.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.485+0000 7fd158e8c640 1 --2- 10.20.193.58:0/2818536624 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd1540b6a20 0x7fd154138570 unknown :-1 s=CLOSED pgs=46 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:39.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.485+0000 7fd158e8c640 1 -- 10.20.193.58:0/2818536624 >> 10.20.193.58:0/2818536624 conn(0x7fd154058e50 msgr2=0x7fd1540b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:39.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.485+0000 7fd158e8c640 1 -- 10.20.193.58:0/2818536624 shutdown_connections 2026-02-23T06:26:39.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:39.485+0000 7fd158e8c640 1 -- 10.20.193.58:0/2818536624 wait complete. 2026-02-23T06:26:39.492 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:26:42.449 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:26:42.454 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:26:49.493 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:26:49.493 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:26:49.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.621+0000 7f2446b3f640 1 -- 10.20.193.58:0/509925366 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f242c004850 msgr2=0x7f242c004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:49.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.621+0000 7f2446b3f640 1 --2- 10.20.193.58:0/509925366 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f242c004850 0x7f242c004cc0 secure :-1 s=READY pgs=107 gs=4 cs=0 l=1 c_cookie=10720982042891853743 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2430009b40 tx=0x7f243002fc50 comp rx=0 tx=0).stop 2026-02-23T06:26:49.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.622+0000 7f2446b3f640 1 -- 10.20.193.58:0/509925366 shutdown_connections 2026-02-23T06:26:49.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.622+0000 7f2446b3f640 1 --2- 10.20.193.58:0/509925366 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f242c004850 0x7f242c004cc0 unknown :-1 s=CLOSED pgs=107 gs=4 cs=0 l=1 c_cookie=10720982042891853743 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:49.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.622+0000 7f2446b3f640 1 -- 10.20.193.58:0/509925366 >> 10.20.193.58:0/509925366 conn(0x7f24400b3c20 msgr2=0x7f24400b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:49.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.622+0000 7f2446b3f640 1 -- 10.20.193.58:0/509925366 shutdown_connections 2026-02-23T06:26:49.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.622+0000 7f2446b3f640 1 -- 10.20.193.58:0/509925366 wait complete. 2026-02-23T06:26:49.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.623+0000 7f2446b3f640 1 Processor -- start 2026-02-23T06:26:49.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.623+0000 7f2446b3f640 1 -- start start 2026-02-23T06:26:49.621 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.624+0000 7f2446b3f640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f242c004850 0x7f24400572b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:49.621 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.624+0000 7f2446b3f640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f24400b15a0 0x7f244015d4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:49.621 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.624+0000 7f2446b3f640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f24401481f0 0x7f244020afd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:49.621 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.624+0000 7f2446b3f640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f24401644e0 con 0x7f242c004850 2026-02-23T06:26:49.621 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.625+0000 7f2446b3f640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f244015c910 con 0x7f24401481f0 2026-02-23T06:26:49.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.625+0000 7f244633e640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f24401481f0 0x7f244020afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:49.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.625+0000 7f244633e640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f24401481f0 0x7f244020afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:43568/0 (socket says 10.20.193.58:43568) 2026-02-23T06:26:49.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.625+0000 7f244633e640 1 -- 10.20.193.58:0/2443343353 learned_addr learned my addr 10.20.193.58:0/2443343353 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:26:49.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.625+0000 7f2446b3f640 1 -- 10.20.193.58:0/2443343353 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f24400577f0 con 0x7f24400b15a0 2026-02-23T06:26:49.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.625+0000 7f244533c640 1 --2- 10.20.193.58:0/2443343353 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f24400b15a0 0x7f244015d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:49.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.625+0000 7f2445b3d640 1 --2- 10.20.193.58:0/2443343353 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f242c004850 0x7f24400572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:49.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.625+0000 7f244533c640 1 -- 10.20.193.58:0/2443343353 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f24401481f0 msgr2=0x7f244020afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:49.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.625+0000 7f244533c640 1 --2- 10.20.193.58:0/2443343353 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f24401481f0 0x7f244020afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:49.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.625+0000 7f244533c640 1 -- 10.20.193.58:0/2443343353 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f242c004850 msgr2=0x7f24400572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:49.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.625+0000 7f244533c640 1 --2- 10.20.193.58:0/2443343353 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f242c004850 0x7f24400572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:49.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.625+0000 7f244533c640 1 -- 10.20.193.58:0/2443343353 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24401464f0 con 0x7f24400b15a0 2026-02-23T06:26:49.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.625+0000 7f2445b3d640 1 --2- 10.20.193.58:0/2443343353 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f242c004850 0x7f24400572b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:26:49.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.626+0000 7f244533c640 1 --2- 10.20.193.58:0/2443343353 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f24400b15a0 0x7f244015d4c0 secure :-1 s=READY pgs=48 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2430009b40 tx=0x7f2430004a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:49.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.626+0000 7f24367fc640 1 -- 10.20.193.58:0/2443343353 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2430042070 con 0x7f24400b15a0 2026-02-23T06:26:49.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.626+0000 7f24367fc640 1 -- 10.20.193.58:0/2443343353 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2430004460 con 0x7f24400b15a0 2026-02-23T06:26:49.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.626+0000 7f2446b3f640 1 -- 10.20.193.58:0/2443343353 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f244015da00 con 0x7f24400b15a0 2026-02-23T06:26:49.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.626+0000 7f2446b3f640 1 -- 10.20.193.58:0/2443343353 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2440164730 con 0x7f24400b15a0 2026-02-23T06:26:49.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.626+0000 7f24367fc640 1 -- 10.20.193.58:0/2443343353 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2430042070 con 0x7f24400b15a0 2026-02-23T06:26:49.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.627+0000 7f240bfff640 1 -- 10.20.193.58:0/2443343353 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2440059160 con 0x7f24400b15a0 2026-02-23T06:26:49.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.628+0000 7f24367fc640 1 -- 10.20.193.58:0/2443343353 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f2430039030 con 0x7f24400b15a0 2026-02-23T06:26:49.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.629+0000 7f24367fc640 1 --2- 10.20.193.58:0/2443343353 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f241807a5d0 0x7f241809aa80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:49.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.629+0000 7f24367fc640 1 -- 10.20.193.58:0/2443343353 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f24300c27b0 con 0x7f24400b15a0 2026-02-23T06:26:49.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.629+0000 7f2445b3d640 1 --2- 10.20.193.58:0/2443343353 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f241807a5d0 0x7f241809aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:49.625 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.629+0000 7f24367fc640 1 -- 10.20.193.58:0/2443343353 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f2430085a00 con 0x7f24400b15a0 2026-02-23T06:26:49.625 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.630+0000 7f2445b3d640 1 --2- 10.20.193.58:0/2443343353 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f241807a5d0 0x7f241809aa80 secure :-1 s=READY pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24280028e0 tx=0x7f2428006cc0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:49.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.802+0000 7f240bfff640 1 -- 10.20.193.58:0/2443343353 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f244005ce30 con 0x7f24400b15a0 2026-02-23T06:26:49.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.802+0000 7f24367fc640 1 -- 10.20.193.58:0/2443343353 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f24300045d0 con 0x7f24400b15a0 2026-02-23T06:26:49.797 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:26:49.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.804+0000 7f240bfff640 1 -- 10.20.193.58:0/2443343353 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f241807a5d0 msgr2=0x7f241809aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:49.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.804+0000 7f240bfff640 1 --2- 10.20.193.58:0/2443343353 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f241807a5d0 0x7f241809aa80 secure :-1 s=READY pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24280028e0 tx=0x7f2428006cc0 comp rx=0 tx=0).stop 2026-02-23T06:26:49.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.804+0000 7f240bfff640 1 -- 10.20.193.58:0/2443343353 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f24400b15a0 msgr2=0x7f244015d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:49.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.804+0000 7f240bfff640 1 --2- 10.20.193.58:0/2443343353 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f24400b15a0 0x7f244015d4c0 secure :-1 s=READY pgs=48 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2430009b40 tx=0x7f2430004a80 comp rx=0 tx=0).stop 2026-02-23T06:26:49.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.804+0000 7f240bfff640 1 -- 10.20.193.58:0/2443343353 shutdown_connections 2026-02-23T06:26:49.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.804+0000 7f240bfff640 1 --2- 10.20.193.58:0/2443343353 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f241807a5d0 0x7f241809aa80 unknown :-1 s=CLOSED pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:49.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.804+0000 7f240bfff640 1 --2- 10.20.193.58:0/2443343353 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f24401481f0 0x7f244020afd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:49.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.804+0000 7f240bfff640 1 --2- 10.20.193.58:0/2443343353 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f24400b15a0 0x7f244015d4c0 unknown :-1 s=CLOSED pgs=48 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:49.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.804+0000 7f240bfff640 1 --2- 10.20.193.58:0/2443343353 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f242c004850 0x7f24400572b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:49.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.804+0000 7f240bfff640 1 -- 10.20.193.58:0/2443343353 >> 10.20.193.58:0/2443343353 conn(0x7f24400b3c20 msgr2=0x7f2440157d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:49.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.804+0000 7f240bfff640 1 -- 10.20.193.58:0/2443343353 shutdown_connections 2026-02-23T06:26:49.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.804+0000 7f240bfff640 1 -- 10.20.193.58:0/2443343353 wait complete. 2026-02-23T06:26:49.811 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:26:49.811 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:26:49.811 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:26:49.812 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:26:49.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.939+0000 7fa36897e640 1 -- 10.20.193.58:0/1529215407 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa36405d370 msgr2=0x7fa3640b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:49.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.939+0000 7fa36897e640 1 --2- 10.20.193.58:0/1529215407 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa36405d370 0x7fa3640b5680 secure :-1 s=READY pgs=108 gs=3 cs=0 l=1 c_cookie=3486992326547404392 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa364059aa0 tx=0x7fa358030270 comp rx=0 tx=0).stop 2026-02-23T06:26:49.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.939+0000 7fa36897e640 1 -- 10.20.193.58:0/1529215407 shutdown_connections 2026-02-23T06:26:49.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.939+0000 7fa36897e640 1 --2- 10.20.193.58:0/1529215407 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa36405d370 0x7fa3640b5680 unknown :-1 s=CLOSED pgs=108 gs=3 cs=0 l=1 c_cookie=3486992326547404392 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:49.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.939+0000 7fa36897e640 1 --2- 10.20.193.58:0/1529215407 >> v2:10.20.193.93:3300/0 conn(0x7fa364056550 0x7fa36405ce30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:49.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.939+0000 7fa36897e640 1 -- 10.20.193.58:0/1529215407 >> 10.20.193.58:0/1529215407 conn(0x7fa3640b3c20 msgr2=0x7fa3640b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:49.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.939+0000 7fa36897e640 1 -- 10.20.193.58:0/1529215407 shutdown_connections 2026-02-23T06:26:49.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.939+0000 7fa36897e640 1 -- 10.20.193.58:0/1529215407 wait complete. 2026-02-23T06:26:49.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.940+0000 7fa36897e640 1 Processor -- start 2026-02-23T06:26:49.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.940+0000 7fa36897e640 1 -- start start 2026-02-23T06:26:49.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.940+0000 7fa36897e640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa364056550 0x7fa364200ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:49.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.940+0000 7fa36897e640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa36405d370 0x7fa36415e5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:49.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.940+0000 7fa36897e640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa36415c040 0x7fa36415eb10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:49.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.940+0000 7fa36897e640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa364059420 con 0x7fa364056550 2026-02-23T06:26:49.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.940+0000 7fa36897e640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fa36415f050 con 0x7fa36415c040 2026-02-23T06:26:49.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.940+0000 7fa36897e640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa364058f40 con 0x7fa36405d370 2026-02-23T06:26:49.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.941+0000 7fa362ffd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa36405d370 0x7fa36415e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:49.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.941+0000 7fa3637fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa364056550 0x7fa364200ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:49.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.941+0000 7fa362ffd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa36405d370 0x7fa36415e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:59136/0 (socket says 10.20.193.58:59136) 2026-02-23T06:26:49.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.941+0000 7fa362ffd640 1 -- 10.20.193.58:0/3866830409 learned_addr learned my addr 10.20.193.58:0/3866830409 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:26:49.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.941+0000 7fa363fff640 1 --2- 10.20.193.58:0/3866830409 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa36415c040 0x7fa36415eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:49.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.941+0000 7fa3637fe640 1 -- 10.20.193.58:0/3866830409 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa36405d370 msgr2=0x7fa36415e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:49.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.941+0000 7fa3637fe640 1 --2- 10.20.193.58:0/3866830409 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa36405d370 0x7fa36415e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:49.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.941+0000 7fa3637fe640 1 -- 10.20.193.58:0/3866830409 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa36415c040 msgr2=0x7fa36415eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:49.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.941+0000 7fa3637fe640 1 --2- 10.20.193.58:0/3866830409 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa36415c040 0x7fa36415eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:49.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.941+0000 7fa3637fe640 1 -- 10.20.193.58:0/3866830409 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa35800a590 con 0x7fa364056550 2026-02-23T06:26:49.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.941+0000 7fa362ffd640 1 --2- 10.20.193.58:0/3866830409 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa36405d370 0x7fa36415e5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:26:49.941 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.941+0000 7fa3637fe640 1 --2- 10.20.193.58:0/3866830409 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa364056550 0x7fa364200ef0 secure :-1 s=READY pgs=109 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa350002730 tx=0x7fa35000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:49.941 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.941+0000 7fa33ffff640 1 -- 10.20.193.58:0/3866830409 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa350006ab0 con 0x7fa364056550 2026-02-23T06:26:49.941 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.941+0000 7fa33ffff640 1 -- 10.20.193.58:0/3866830409 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa350006d00 con 0x7fa364056550 2026-02-23T06:26:49.941 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.941+0000 7fa36897e640 1 -- 10.20.193.58:0/3866830409 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa364059140 con 0x7fa364056550 2026-02-23T06:26:49.941 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.941+0000 7fa33ffff640 1 -- 10.20.193.58:0/3866830409 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa3500072b0 con 0x7fa364056550 2026-02-23T06:26:49.941 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.941+0000 7fa36897e640 1 -- 10.20.193.58:0/3866830409 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa364201bd0 con 0x7fa364056550 2026-02-23T06:26:49.941 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.942+0000 7fa36897e640 1 --2- 10.20.193.58:0/3866830409 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa3240041f0 0x7fa3240246a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:49.941 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.942+0000 7fa36897e640 1 -- 10.20.193.58:0/3866830409 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa324025f20 con 0x7fa3240041f0 2026-02-23T06:26:49.941 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.942+0000 7fa362ffd640 1 --2- 10.20.193.58:0/3866830409 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa3240041f0 0x7fa3240246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:49.941 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.942+0000 7fa362ffd640 1 -- 10.20.193.58:0/3866830409 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa3240260e0 con 0x7fa3240041f0 2026-02-23T06:26:49.941 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.943+0000 7fa362ffd640 1 --2- 10.20.193.58:0/3866830409 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa3240041f0 0x7fa3240246a0 secure :-1 s=READY pgs=110 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa364157020 tx=0x7fa354002ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:49.941 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.943+0000 7fa33ffff640 1 -- 10.20.193.58:0/3866830409 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa354004850 con 0x7fa3240041f0 2026-02-23T06:26:49.941 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.943+0000 7fa33ffff640 1 -- 10.20.193.58:0/3866830409 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fa3540049b0 con 0x7fa3240041f0 2026-02-23T06:26:49.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.943+0000 7fa33ffff640 1 -- 10.20.193.58:0/3866830409 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa3240041f0 msgr2=0x7fa3240246a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:49.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.943+0000 7fa33ffff640 1 --2- 10.20.193.58:0/3866830409 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa3240041f0 0x7fa3240246a0 secure :-1 s=READY pgs=110 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa364157020 tx=0x7fa354002ed0 comp rx=0 tx=0).stop 2026-02-23T06:26:49.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.943+0000 7fa33ffff640 1 -- 10.20.193.58:0/3866830409 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa3240041f0 msgr2=0x7fa3240246a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:26:49.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.943+0000 7fa33ffff640 1 --2- 10.20.193.58:0/3866830409 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa3240041f0 0x7fa3240246a0 unknown :-1 s=CLOSED pgs=110 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:49.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.943+0000 7fa33ffff640 1 -- 10.20.193.58:0/3866830409 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fa350007410 con 0x7fa364056550 2026-02-23T06:26:49.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.944+0000 7fa33ffff640 1 --2- 10.20.193.58:0/3866830409 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa33407a3c0 0x7fa33409a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:49.944 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.944+0000 7fa33ffff640 1 -- 10.20.193.58:0/3866830409 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fa35009cc30 con 0x7fa364056550 2026-02-23T06:26:49.944 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.944+0000 7fa362ffd640 1 --2- 10.20.193.58:0/3866830409 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa33407a3c0 0x7fa33409a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:49.944 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.945+0000 7fa362ffd640 1 --2- 10.20.193.58:0/3866830409 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa33407a3c0 0x7fa33409a870 secure :-1 s=READY pgs=199 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa364157020 tx=0x7fa35400e000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:49.944 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.946+0000 7fa36897e640 1 --2- 10.20.193.58:0/3866830409 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa324025030 0x7fa3240254b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:49.944 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.946+0000 7fa36897e640 1 -- 10.20.193.58:0/3866830409 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa324025a90 con 0x7fa324025030 2026-02-23T06:26:49.944 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.947+0000 7fa363fff640 1 --2- 10.20.193.58:0/3866830409 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa324025030 0x7fa3240254b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:49.944 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.947+0000 7fa363fff640 1 -- 10.20.193.58:0/3866830409 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa324025c50 con 0x7fa324025030 2026-02-23T06:26:49.944 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.947+0000 7fa363fff640 1 --2- 10.20.193.58:0/3866830409 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa324025030 0x7fa3240254b0 secure :-1 s=READY pgs=111 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3580307a0 tx=0x7fa358003d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:49.944 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.947+0000 7fa33ffff640 1 -- 10.20.193.58:0/3866830409 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa35803e050 con 0x7fa324025030 2026-02-23T06:26:49.944 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.947+0000 7fa33ffff640 1 -- 10.20.193.58:0/3866830409 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5248 (secure 0 0 0) 0x7fa35803f040 con 0x7fa324025030 2026-02-23T06:26:49.945 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.947+0000 7fa33ffff640 1 -- 10.20.193.58:0/3866830409 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa324025030 msgr2=0x7fa3240254b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:49.945 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.947+0000 7fa33ffff640 1 --2- 10.20.193.58:0/3866830409 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa324025030 0x7fa3240254b0 secure :-1 s=READY pgs=111 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3580307a0 tx=0x7fa358003d20 comp rx=0 tx=0).stop 2026-02-23T06:26:49.945 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.947+0000 7fa33ffff640 1 -- 10.20.193.58:0/3866830409 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa324025030 msgr2=0x7fa3240254b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:26:49.945 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.947+0000 7fa33ffff640 1 --2- 10.20.193.58:0/3866830409 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa324025030 0x7fa3240254b0 unknown :-1 s=CLOSED pgs=111 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:49.945 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:26:49.945 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:26:49.945 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:26:49.946 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:26:49.946 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 46, 2026-02-23T06:26:49.946 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 136780, 2026-02-23T06:26:49.946 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:26:49.946 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:26:49.946 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:26:49.946 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:26:49.946 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:49.946 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:26:49.946 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:26:49.946 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:26:49.947 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:26:49.947 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:49.947 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:49.947 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:49.947 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:49.947 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:49.947 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:49.947 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:49.948 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:49.948 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:49.948 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:49.948 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:49.948 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:49.948 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:49.948 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:49.949 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:26:49.949 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:26:49.949 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:49.949 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:49.949 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:49.949 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:49.950 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:49.950 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:49.950 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:49.950 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:49.950 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:49.950 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:49.950 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:49.951 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:49.951 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:49.951 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:49.951 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:49.951 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:26:49.951 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:26:49.952 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:26:49.952 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:26:49.952 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:26:49.952 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:26:49.952 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:26:49.952 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:26:49.953 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:26:49.953 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:26:49.953 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:26:49.953 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:26:49.953 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:26:49.953 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:26:49.953 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:26:49.954 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:26:49.954 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:26:49.954 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:49.954 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:49.954 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:49.954 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:49.954 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:49.955 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:49.955 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:49.955 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:49.955 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:49.955 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:49.955 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:49.956 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:49.956 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:49.956 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:49.956 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:26:49.956 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:49.956 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:26:49.957 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:49.957 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:26:49.957 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:26:49.957 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:49.957 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:49.957 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:49.958 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:49.958 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:26:49.958 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:49.958 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:49.958 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:49.958 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:49.959 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:26:49.959 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:49.959 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:49.959 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:49.959 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:49.959 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:26:49.959 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:26:49.960 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:49.960 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:49.960 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:26:49.960 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:49.960 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:49.960 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:49.960 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:26:49.961 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:26:49.961 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:49.961 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:49.961 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:49.961 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:49.961 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:26:49.962 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:49.962 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:49.962 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:49.962 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:49.962 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:26:49.962 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:49.962 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:49.963 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:49.963 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:49.963 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:26:49.963 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:26:49.963 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:49.963 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:49.963 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:26:49.964 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:49.964 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:49.964 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:49.964 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:26:49.964 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:26:49.964 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:49.964 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:49.964 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:49.965 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:49.965 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:26:49.965 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:49.965 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:49.965 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:49.965 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:49.965 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:26:49.965 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:49.966 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:49.966 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:49.966 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:49.966 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:26:49.966 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:26:49.966 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:49.966 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:49.967 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:26:49.967 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:49.967 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:49.967 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:49.967 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:49.967 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:26:49.967 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:26:49.968 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:49.968 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:49.968 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:49.968 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:26:49.968 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:49.968 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:49.968 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:26:49.968 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:49.969 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:49.969 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:49.969 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:26:49.969 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:49.969 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:49.969 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:26:49.969 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:49.969 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:49.970 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:49.970 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:26:49.970 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:49.970 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:49.970 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:26:49.970 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:49.970 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:49.970 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:49.971 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:26:49.971 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:49.971 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:49.971 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:49.971 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:26:49.971 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:26:49.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.948+0000 7fa36897e640 1 -- 10.20.193.58:0/3866830409 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa33407a3c0 msgr2=0x7fa33409a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:49.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.948+0000 7fa36897e640 1 --2- 10.20.193.58:0/3866830409 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa33407a3c0 0x7fa33409a870 secure :-1 s=READY pgs=199 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa364157020 tx=0x7fa35400e000 comp rx=0 tx=0).stop 2026-02-23T06:26:49.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.948+0000 7fa36897e640 1 -- 10.20.193.58:0/3866830409 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa364056550 msgr2=0x7fa364200ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:49.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.948+0000 7fa36897e640 1 --2- 10.20.193.58:0/3866830409 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa364056550 0x7fa364200ef0 secure :-1 s=READY pgs=109 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa350002730 tx=0x7fa35000c8b0 comp rx=0 tx=0).stop 2026-02-23T06:26:49.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.948+0000 7fa363fff640 1 -- 10.20.193.58:0/3866830409 reap_dead start 2026-02-23T06:26:49.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.948+0000 7fa36897e640 1 -- 10.20.193.58:0/3866830409 shutdown_connections 2026-02-23T06:26:49.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.948+0000 7fa36897e640 1 -- 10.20.193.58:0/3866830409 >> 10.20.193.58:0/3866830409 conn(0x7fa3640b3c20 msgr2=0x7fa3640b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:49.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.948+0000 7fa36897e640 1 -- 10.20.193.58:0/3866830409 shutdown_connections 2026-02-23T06:26:49.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:49.948+0000 7fa36897e640 1 -- 10.20.193.58:0/3866830409 wait complete. 2026-02-23T06:26:49.974 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:26:49.974 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:26:49.975 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:26:50.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.101+0000 7f1751643640 1 -- 10.20.193.58:0/1278307456 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f174c15d4a0 msgr2=0x7f174c0affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:50.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.101+0000 7f1751643640 1 --2- 10.20.193.58:0/1278307456 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f174c15d4a0 0x7f174c0affb0 secure :-1 s=READY pgs=49 gs=2 cs=0 l=1 c_cookie=11033203334844347614 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1738005e70 tx=0x7f173802f290 comp rx=0 tx=0).stop 2026-02-23T06:26:50.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.102+0000 7f1751643640 1 -- 10.20.193.58:0/1278307456 shutdown_connections 2026-02-23T06:26:50.098 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.102+0000 7f1751643640 1 --2- 10.20.193.58:0/1278307456 >> v2:10.20.193.58:3300/0 conn(0x7f174c15d870 0x7f174c0587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:50.098 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.102+0000 7f1751643640 1 --2- 10.20.193.58:0/1278307456 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f174c15d4a0 0x7f174c0affb0 unknown :-1 s=CLOSED pgs=49 gs=2 cs=0 l=1 c_cookie=11033203334844347614 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:50.098 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.102+0000 7f1751643640 1 -- 10.20.193.58:0/1278307456 >> 10.20.193.58:0/1278307456 conn(0x7f174c0b3c20 msgr2=0x7f174c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:50.098 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.102+0000 7f1751643640 1 -- 10.20.193.58:0/1278307456 shutdown_connections 2026-02-23T06:26:50.098 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.102+0000 7f1751643640 1 -- 10.20.193.58:0/1278307456 wait complete. 2026-02-23T06:26:50.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.103+0000 7f1751643640 1 Processor -- start 2026-02-23T06:26:50.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.103+0000 7f1751643640 1 -- start start 2026-02-23T06:26:50.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.104+0000 7f1751643640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f174c0b6690 0x7f174c1427e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:50.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.104+0000 7f1751643640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f174c15d4a0 0x7f174c1406f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:50.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.104+0000 7f1751643640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f174c15d870 0x7f174c200a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:50.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.104+0000 7f1751643640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1fe3c0 con 0x7f174c0b6690 2026-02-23T06:26:50.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.104+0000 7f1751643640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f174c058160 con 0x7f174c15d870 2026-02-23T06:26:50.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.104+0000 7f1751643640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f174c1fdf30 con 0x7f174c15d4a0 2026-02-23T06:26:50.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.104+0000 7f174bfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f174c0b6690 0x7f174c1427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:50.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.104+0000 7f174b7fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f174c15d4a0 0x7f174c1406f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:50.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.104+0000 7f174bfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f174c0b6690 0x7f174c1427e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:34908/0 (socket says 10.20.193.58:34908) 2026-02-23T06:26:50.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.104+0000 7f174bfff640 1 -- 10.20.193.58:0/1238494087 learned_addr learned my addr 10.20.193.58:0/1238494087 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:26:50.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.104+0000 7f1750e42640 1 --2- 10.20.193.58:0/1238494087 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f174c15d870 0x7f174c200a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:50.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.104+0000 7f174bfff640 1 -- 10.20.193.58:0/1238494087 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f174c15d4a0 msgr2=0x7f174c1406f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:50.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.104+0000 7f174bfff640 1 --2- 10.20.193.58:0/1238494087 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f174c15d4a0 0x7f174c1406f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:50.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.104+0000 7f174bfff640 1 -- 10.20.193.58:0/1238494087 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f174c15d870 msgr2=0x7f174c200a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:50.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.104+0000 7f174bfff640 1 --2- 10.20.193.58:0/1238494087 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f174c15d870 0x7f174c200a50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:50.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.104+0000 7f174bfff640 1 -- 10.20.193.58:0/1238494087 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1738009570 con 0x7f174c0b6690 2026-02-23T06:26:50.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.104+0000 7f1750e42640 1 --2- 10.20.193.58:0/1238494087 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f174c15d870 0x7f174c200a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:26:50.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.104+0000 7f174bfff640 1 --2- 10.20.193.58:0/1238494087 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f174c0b6690 0x7f174c1427e0 secure :-1 s=READY pgs=113 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1738004740 tx=0x7f17380028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:50.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.105+0000 7f1748ff9640 1 -- 10.20.193.58:0/1238494087 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f173803d070 con 0x7f174c0b6690 2026-02-23T06:26:50.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.105+0000 7f1748ff9640 1 -- 10.20.193.58:0/1238494087 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1738038470 con 0x7f174c0b6690 2026-02-23T06:26:50.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.105+0000 7f1751643640 1 -- 10.20.193.58:0/1238494087 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f174c057ef0 con 0x7f174c0b6690 2026-02-23T06:26:50.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.105+0000 7f1748ff9640 1 -- 10.20.193.58:0/1238494087 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f17380388a0 con 0x7f174c0b6690 2026-02-23T06:26:50.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.105+0000 7f1751643640 1 -- 10.20.193.58:0/1238494087 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f174c1fd8e0 con 0x7f174c0b6690 2026-02-23T06:26:50.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.105+0000 7f1751643640 1 --2- 10.20.193.58:0/1238494087 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f170c0041f0 0x7f170c0246a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:50.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.105+0000 7f1751643640 1 -- 10.20.193.58:0/1238494087 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f170c025f20 con 0x7f170c0041f0 2026-02-23T06:26:50.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.105+0000 7f174b7fe640 1 --2- 10.20.193.58:0/1238494087 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f170c0041f0 0x7f170c0246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:50.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.106+0000 7f174b7fe640 1 -- 10.20.193.58:0/1238494087 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f170c0260e0 con 0x7f170c0041f0 2026-02-23T06:26:50.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.106+0000 7f174b7fe640 1 --2- 10.20.193.58:0/1238494087 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f170c0041f0 0x7f170c0246a0 secure :-1 s=READY pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f174c1fb090 tx=0x7f173c009ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:50.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.106+0000 7f1748ff9640 1 -- 10.20.193.58:0/1238494087 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f173c011920 con 0x7f170c0041f0 2026-02-23T06:26:50.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.106+0000 7f1748ff9640 1 -- 10.20.193.58:0/1238494087 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f1738038a00 con 0x7f174c0b6690 2026-02-23T06:26:50.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.107+0000 7f1748ff9640 1 --2- 10.20.193.58:0/1238494087 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f171c07a660 0x7f171c09ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:50.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.107+0000 7f1748ff9640 1 -- 10.20.193.58:0/1238494087 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f17380c2140 con 0x7f174c0b6690 2026-02-23T06:26:50.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.107+0000 7f1748ff9640 1 -- 10.20.193.58:0/1238494087 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f173c011a80 con 0x7f170c0041f0 2026-02-23T06:26:50.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.107+0000 7f1750e42640 1 --2- 10.20.193.58:0/1238494087 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f171c07a660 0x7f171c09ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:50.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.107+0000 7f1748ff9640 1 -- 10.20.193.58:0/1238494087 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f170c0041f0 msgr2=0x7f170c0246a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:50.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.107+0000 7f1748ff9640 1 --2- 10.20.193.58:0/1238494087 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f170c0041f0 0x7f170c0246a0 secure :-1 s=READY pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f174c1fb090 tx=0x7f173c009ae0 comp rx=0 tx=0).stop 2026-02-23T06:26:50.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.107+0000 7f1748ff9640 1 -- 10.20.193.58:0/1238494087 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f170c0041f0 msgr2=0x7f170c0246a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:26:50.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.107+0000 7f1748ff9640 1 --2- 10.20.193.58:0/1238494087 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f170c0041f0 0x7f170c0246a0 secure :-1 s=CLOSED pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f174c1fb090 tx=0x7f173c009ae0 comp rx=0 tx=0).stop 2026-02-23T06:26:50.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.108+0000 7f1750e42640 1 --2- 10.20.193.58:0/1238494087 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f171c07a660 0x7f171c09ab10 secure :-1 s=READY pgs=200 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17400038b0 tx=0x7f174000a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:50.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.111+0000 7f1751643640 1 --2- 10.20.193.58:0/1238494087 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f170c025000 0x7f170c025450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:50.107 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.111+0000 7f1751643640 1 -- 10.20.193.58:0/1238494087 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f170c025b50 con 0x7f170c025000 2026-02-23T06:26:50.107 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.112+0000 7f174b7fe640 1 --2- 10.20.193.58:0/1238494087 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f170c025000 0x7f170c025450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:50.108 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.112+0000 7f174b7fe640 1 -- 10.20.193.58:0/1238494087 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f170c025d10 con 0x7f170c025000 2026-02-23T06:26:50.108 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.112+0000 7f174b7fe640 1 --2- 10.20.193.58:0/1238494087 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f170c025000 0x7f170c025450 secure :-1 s=READY pgs=13 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f174c1fb090 tx=0x7f173c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:50.108 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.113+0000 7f1748ff9640 1 -- 10.20.193.58:0/1238494087 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f173c025070 con 0x7f170c025000 2026-02-23T06:26:50.108 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.113+0000 7f1748ff9640 1 -- 10.20.193.58:0/1238494087 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4911 (secure 0 0 0) 0x7f173c01f880 con 0x7f170c025000 2026-02-23T06:26:50.108 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.113+0000 7f1748ff9640 1 -- 10.20.193.58:0/1238494087 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f170c025000 msgr2=0x7f170c025450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:50.108 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.113+0000 7f1748ff9640 1 --2- 10.20.193.58:0/1238494087 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f170c025000 0x7f170c025450 secure :-1 s=READY pgs=13 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f174c1fb090 tx=0x7f173c004770 comp rx=0 tx=0).stop 2026-02-23T06:26:50.108 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.113+0000 7f1748ff9640 1 -- 10.20.193.58:0/1238494087 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f170c025000 msgr2=0x7f170c025450 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:26:50.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.113+0000 7f1748ff9640 1 --2- 10.20.193.58:0/1238494087 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f170c025000 0x7f170c025450 secure :-1 s=CLOSED pgs=13 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f174c1fb090 tx=0x7f173c004770 comp rx=0 tx=0).stop 2026-02-23T06:26:50.109 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:26:50.109 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:26:50.109 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:26:50.109 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:26:50.109 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 46, 2026-02-23T06:26:50.109 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 11624, 2026-02-23T06:26:50.109 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:26:50.110 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:26:50.110 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:26:50.110 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:26:50.110 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:50.110 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:26:50.110 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:26:50.110 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:26:50.110 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:26:50.110 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:50.110 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:50.110 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:50.110 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:50.111 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:50.111 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:50.111 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:50.111 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:50.111 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:50.111 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:50.111 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:50.111 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:50.111 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:50.111 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:50.112 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:26:50.112 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:26:50.112 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:50.112 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:50.112 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:50.112 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:50.112 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:50.112 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:50.112 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:50.112 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:50.112 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:50.112 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:50.112 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:50.112 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:50.112 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:50.112 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:50.112 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:50.112 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:26:50.112 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:26:50.112 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:26:50.112 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:26:50.112 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:26:50.112 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:26:50.112 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:26:50.112 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:26:50.112 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:50.113 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:26:50.114 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:26:50.115 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:26:50.116 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.113+0000 7f1751643640 1 -- 10.20.193.58:0/1238494087 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f171c07a660 msgr2=0x7f171c09ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:50.116 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.113+0000 7f1751643640 1 --2- 10.20.193.58:0/1238494087 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f171c07a660 0x7f171c09ab10 secure :-1 s=READY pgs=200 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17400038b0 tx=0x7f174000a040 comp rx=0 tx=0).stop 2026-02-23T06:26:50.116 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.113+0000 7f1751643640 1 -- 10.20.193.58:0/1238494087 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f174c0b6690 msgr2=0x7f174c1427e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:50.116 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.113+0000 7f1751643640 1 --2- 10.20.193.58:0/1238494087 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f174c0b6690 0x7f174c1427e0 secure :-1 s=READY pgs=113 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1738004740 tx=0x7f17380028d0 comp rx=0 tx=0).stop 2026-02-23T06:26:50.116 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.113+0000 7f1750e42640 1 -- 10.20.193.58:0/1238494087 reap_dead start 2026-02-23T06:26:50.116 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.113+0000 7f1750e42640 1 -- 10.20.193.58:0/1238494087 reap_dead start 2026-02-23T06:26:50.116 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.113+0000 7f1751643640 1 -- 10.20.193.58:0/1238494087 shutdown_connections 2026-02-23T06:26:50.116 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.113+0000 7f1751643640 1 -- 10.20.193.58:0/1238494087 >> 10.20.193.58:0/1238494087 conn(0x7f174c0b3c20 msgr2=0x7f174c05d100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:50.116 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.113+0000 7f1751643640 1 -- 10.20.193.58:0/1238494087 shutdown_connections 2026-02-23T06:26:50.116 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.113+0000 7f1751643640 1 -- 10.20.193.58:0/1238494087 wait complete. 2026-02-23T06:26:50.116 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:26:50.116 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:26:50.117 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:26:50.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.242+0000 7f2f0a14b640 1 -- 10.20.193.58:0/4075653176 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f0415c040 msgr2=0x7f2f0405b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:50.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.242+0000 7f2f0a14b640 1 --2- 10.20.193.58:0/4075653176 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f0415c040 0x7f2f0405b0e0 secure :-1 s=READY pgs=50 gs=3 cs=0 l=1 c_cookie=5187449270368408150 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ef4009890 tx=0x7f2ef402f200 comp rx=0 tx=0).stop 2026-02-23T06:26:50.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.242+0000 7f2f0a14b640 1 -- 10.20.193.58:0/4075653176 shutdown_connections 2026-02-23T06:26:50.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.242+0000 7f2f0a14b640 1 --2- 10.20.193.58:0/4075653176 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f0415c040 0x7f2f0405b0e0 unknown :-1 s=CLOSED pgs=50 gs=3 cs=0 l=1 c_cookie=5187449270368408150 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:50.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.242+0000 7f2f0a14b640 1 -- 10.20.193.58:0/4075653176 >> 10.20.193.58:0/4075653176 conn(0x7f2f040b3c20 msgr2=0x7f2f040b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:50.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.242+0000 7f2f0a14b640 1 -- 10.20.193.58:0/4075653176 shutdown_connections 2026-02-23T06:26:50.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.242+0000 7f2f0a14b640 1 -- 10.20.193.58:0/4075653176 wait complete. 2026-02-23T06:26:50.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.243+0000 7f2f0a14b640 1 Processor -- start 2026-02-23T06:26:50.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.243+0000 7f2f0a14b640 1 -- start start 2026-02-23T06:26:50.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.244+0000 7f2f0a14b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2f04056550 0x7f2f040584d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:50.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.244+0000 7f2f0a14b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2f040b5680 0x7f2f040ac510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:50.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.244+0000 7f2f0a14b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f0415c040 0x7f2f040adab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:50.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.244+0000 7f2f0a14b640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f2f040ad690 con 0x7f2f040b5680 2026-02-23T06:26:50.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.244+0000 7f2f0a14b640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f2f040ad110 con 0x7f2f04056550 2026-02-23T06:26:50.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.244+0000 7f2f0a14b640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f2f040abe70 con 0x7f2f0415c040 2026-02-23T06:26:50.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.244+0000 7f2f08948640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2f040b5680 0x7f2f040ac510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:50.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.244+0000 7f2f09149640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2f04056550 0x7f2f040584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:50.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.244+0000 7f2f0994a640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f0415c040 0x7f2f040adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:50.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.244+0000 7f2f08948640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2f040b5680 0x7f2f040ac510 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:34918/0 (socket says 10.20.193.58:34918) 2026-02-23T06:26:50.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.244+0000 7f2f08948640 1 -- 10.20.193.58:0/1970215764 learned_addr learned my addr 10.20.193.58:0/1970215764 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:26:50.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.244+0000 7f2f08948640 1 -- 10.20.193.58:0/1970215764 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f0415c040 msgr2=0x7f2f040adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:50.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.244+0000 7f2f08948640 1 --2- 10.20.193.58:0/1970215764 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f0415c040 0x7f2f040adab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:50.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.244+0000 7f2f08948640 1 -- 10.20.193.58:0/1970215764 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2f04056550 msgr2=0x7f2f040584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:50.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.244+0000 7f2f08948640 1 --2- 10.20.193.58:0/1970215764 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2f04056550 0x7f2f040584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:50.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.244+0000 7f2f08948640 1 -- 10.20.193.58:0/1970215764 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef40094b0 con 0x7f2f040b5680 2026-02-23T06:26:50.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.244+0000 7f2f0994a640 1 --2- 10.20.193.58:0/1970215764 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f0415c040 0x7f2f040adab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:26:50.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.245+0000 7f2f08948640 1 --2- 10.20.193.58:0/1970215764 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2f040b5680 0x7f2f040ac510 secure :-1 s=READY pgs=115 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ef8007fd0 tx=0x7f2ef800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:50.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.245+0000 7f2ef1ffb640 1 -- 10.20.193.58:0/1970215764 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ef8012850 con 0x7f2f040b5680 2026-02-23T06:26:50.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.245+0000 7f2ef1ffb640 1 -- 10.20.193.58:0/1970215764 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ef8012aa0 con 0x7f2f040b5680 2026-02-23T06:26:50.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.245+0000 7f2f0a14b640 1 -- 10.20.193.58:0/1970215764 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f040abb90 con 0x7f2f040b5680 2026-02-23T06:26:50.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.245+0000 7f2ef1ffb640 1 -- 10.20.193.58:0/1970215764 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ef8012e70 con 0x7f2f040b5680 2026-02-23T06:26:50.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.245+0000 7f2f0a14b640 1 -- 10.20.193.58:0/1970215764 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f040aa2c0 con 0x7f2f040b5680 2026-02-23T06:26:50.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.245+0000 7f2f0a14b640 1 --2- 10.20.193.58:0/1970215764 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f040ab720 0x7f2f040adff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:50.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.245+0000 7f2f0a14b640 1 -- 10.20.193.58:0/1970215764 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f2f040609c0 con 0x7f2f040ab720 2026-02-23T06:26:50.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.246+0000 7f2f09149640 1 --2- 10.20.193.58:0/1970215764 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f040ab720 0x7f2f040adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:50.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.246+0000 7f2f09149640 1 -- 10.20.193.58:0/1970215764 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2f0415c410 con 0x7f2f040ab720 2026-02-23T06:26:50.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.246+0000 7f2f09149640 1 --2- 10.20.193.58:0/1970215764 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f040ab720 0x7f2f040adff0 secure :-1 s=READY pgs=51 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ef4009230 tx=0x7f2ef40028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:50.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.246+0000 7f2ef1ffb640 1 -- 10.20.193.58:0/1970215764 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ef4047070 con 0x7f2f040ab720 2026-02-23T06:26:50.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.247+0000 7f2ef1ffb640 1 -- 10.20.193.58:0/1970215764 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f2ef403e040 con 0x7f2f040ab720 2026-02-23T06:26:50.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.247+0000 7f2ef1ffb640 1 -- 10.20.193.58:0/1970215764 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f040ab720 msgr2=0x7f2f040adff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:50.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.247+0000 7f2ef1ffb640 1 --2- 10.20.193.58:0/1970215764 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f040ab720 0x7f2f040adff0 secure :-1 s=READY pgs=51 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ef4009230 tx=0x7f2ef40028d0 comp rx=0 tx=0).stop 2026-02-23T06:26:50.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.247+0000 7f2ef1ffb640 1 -- 10.20.193.58:0/1970215764 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f040ab720 msgr2=0x7f2f040adff0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:26:50.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.247+0000 7f2ef1ffb640 1 --2- 10.20.193.58:0/1970215764 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f040ab720 0x7f2f040adff0 unknown :-1 s=CLOSED pgs=51 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:50.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.247+0000 7f2ef1ffb640 1 -- 10.20.193.58:0/1970215764 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f2ef801b400 con 0x7f2f040b5680 2026-02-23T06:26:50.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.248+0000 7f2ef1ffb640 1 --2- 10.20.193.58:0/1970215764 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2ed407a3c0 0x7f2ed409a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:50.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.248+0000 7f2ef1ffb640 1 -- 10.20.193.58:0/1970215764 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f2ef809d730 con 0x7f2f040b5680 2026-02-23T06:26:50.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.248+0000 7f2f09149640 1 --2- 10.20.193.58:0/1970215764 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2ed407a3c0 0x7f2ed409a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:50.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.248+0000 7f2f09149640 1 --2- 10.20.193.58:0/1970215764 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2ed407a3c0 0x7f2ed409a870 secure :-1 s=READY pgs=201 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ef4009230 tx=0x7f2ef4042000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:50.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.250+0000 7f2f0a14b640 1 --2- 10.20.193.58:0/1970215764 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f040aca50 0x7f2f04155640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:50.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.250+0000 7f2f0a14b640 1 -- 10.20.193.58:0/1970215764 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f2f0405d9c0 con 0x7f2f040aca50 2026-02-23T06:26:50.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.251+0000 7f2f0994a640 1 --2- 10.20.193.58:0/1970215764 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f040aca50 0x7f2f04155640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:50.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.251+0000 7f2f0994a640 1 -- 10.20.193.58:0/1970215764 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2f040ad7d0 con 0x7f2f040aca50 2026-02-23T06:26:50.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.251+0000 7f2f0994a640 1 --2- 10.20.193.58:0/1970215764 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f040aca50 0x7f2f04155640 secure :-1 s=READY pgs=52 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f00003470 tx=0x7f2f0000ff60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:50.249 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.251+0000 7f2ef1ffb640 1 -- 10.20.193.58:0/1970215764 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f0000dc20 con 0x7f2f040aca50 2026-02-23T06:26:50.249 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.252+0000 7f2ef1ffb640 1 -- 10.20.193.58:0/1970215764 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5555 (secure 0 0 0) 0x7f2f0000dd80 con 0x7f2f040aca50 2026-02-23T06:26:50.249 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.252+0000 7f2ef1ffb640 1 -- 10.20.193.58:0/1970215764 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f040aca50 msgr2=0x7f2f04155640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:50.249 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.252+0000 7f2ef1ffb640 1 --2- 10.20.193.58:0/1970215764 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f040aca50 0x7f2f04155640 secure :-1 s=READY pgs=52 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f00003470 tx=0x7f2f0000ff60 comp rx=0 tx=0).stop 2026-02-23T06:26:50.249 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.252+0000 7f2ef1ffb640 1 -- 10.20.193.58:0/1970215764 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f040aca50 msgr2=0x7f2f04155640 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:26:50.249 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.252+0000 7f2ef1ffb640 1 --2- 10.20.193.58:0/1970215764 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f040aca50 0x7f2f04155640 unknown :-1 s=CLOSED pgs=52 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:50.249 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:26:50.250 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:26:50.250 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:26:50.250 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:26:50.250 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 46, 2026-02-23T06:26:50.250 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 84764, 2026-02-23T06:26:50.250 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:26:50.250 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:26:50.250 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:26:50.250 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:26:50.250 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:50.250 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:26:50.251 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:26:50.251 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:26:50.251 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:26:50.251 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:50.251 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:50.251 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:50.251 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:50.251 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:50.251 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:50.251 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:50.251 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:50.251 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:50.252 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:50.252 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:50.252 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:50.252 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:50.252 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:50.252 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:26:50.252 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:26:50.252 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:50.252 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:50.252 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:50.252 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:50.253 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:50.253 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:50.253 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:50.253 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:50.253 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:50.253 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:50.253 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:50.253 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:50.253 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:50.253 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:50.253 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:50.254 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:26:50.254 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:26:50.254 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:26:50.254 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:26:50.254 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:26:50.254 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:26:50.254 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:26:50.254 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:26:50.254 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:26:50.254 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:26:50.254 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:26:50.255 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:26:50.255 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:26:50.255 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:26:50.255 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:26:50.255 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:26:50.255 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:26:50.255 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:26:50.255 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:26:50.255 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:26:50.255 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:26:50.255 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:26:50.255 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:26:50.256 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:26:50.256 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:26:50.256 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:26:50.256 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:26:50.256 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:26:50.256 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:26:50.256 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:26:50.256 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:50.256 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:26:50.256 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:50.256 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:26:50.257 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:50.257 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:26:50.257 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:26:50.257 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:50.257 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:50.257 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:50.257 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:50.257 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:26:50.257 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:50.257 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:50.257 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:50.258 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:50.258 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:26:50.258 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:50.258 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:50.258 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:50.258 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:50.258 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:26:50.258 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:26:50.258 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:50.258 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:50.258 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:26:50.259 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:50.259 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:50.259 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:50.259 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:26:50.259 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:26:50.259 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:50.259 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:50.259 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:50.259 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:50.259 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:26:50.259 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:50.259 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:50.260 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:50.260 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:50.260 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:26:50.260 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:50.260 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:50.260 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:50.260 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:50.260 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:26:50.260 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:26:50.260 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:50.260 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:50.261 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:26:50.261 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:50.261 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:50.261 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:50.261 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:26:50.261 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:26:50.261 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:26:50.261 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:26:50.261 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:50.261 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:26:50.261 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:26:50.261 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:50.262 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:50.262 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:50.262 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:26:50.262 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:26:50.262 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:26:50.262 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:50.262 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:50.262 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:50.262 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:26:50.262 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:26:50.262 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:26:50.263 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:26:50.263 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:26:50.263 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:26:50.263 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:50.263 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:50.263 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:50.263 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:26:50.263 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:26:50.263 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:50.263 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:50.263 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:50.264 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:26:50.264 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:50.264 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:50.264 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:26:50.264 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:50.264 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:50.264 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:50.264 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:26:50.264 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:50.264 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:50.264 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:26:50.265 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:50.265 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:50.265 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:50.265 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:26:50.265 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:50.265 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:50.265 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:26:50.265 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:50.265 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:26:50.265 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:26:50.265 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:26:50.266 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:50.266 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:50.266 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:50.266 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:50.266 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:26:50.266 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:50.266 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:26:50.266 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:26:50.266 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:26:50.266 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:26:50.266 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:26:50.266 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:26:50.267 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:26:50.267 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:26:50.267 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:26:50.267 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:26:50.267 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:26:50.268 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.252+0000 7f2f0a14b640 1 -- 10.20.193.58:0/1970215764 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2ed407a3c0 msgr2=0x7f2ed409a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:50.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.252+0000 7f2f0a14b640 1 --2- 10.20.193.58:0/1970215764 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2ed407a3c0 0x7f2ed409a870 secure :-1 s=READY pgs=201 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ef4009230 tx=0x7f2ef4042000 comp rx=0 tx=0).stop 2026-02-23T06:26:50.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.252+0000 7f2f0a14b640 1 -- 10.20.193.58:0/1970215764 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2f040b5680 msgr2=0x7f2f040ac510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:50.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.252+0000 7f2f0a14b640 1 --2- 10.20.193.58:0/1970215764 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2f040b5680 0x7f2f040ac510 secure :-1 s=READY pgs=115 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ef8007fd0 tx=0x7f2ef800c970 comp rx=0 tx=0).stop 2026-02-23T06:26:50.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.252+0000 7f2f0994a640 1 -- 10.20.193.58:0/1970215764 reap_dead start 2026-02-23T06:26:50.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.252+0000 7f2f0994a640 1 -- 10.20.193.58:0/1970215764 reap_dead start 2026-02-23T06:26:50.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.252+0000 7f2f0a14b640 1 -- 10.20.193.58:0/1970215764 shutdown_connections 2026-02-23T06:26:50.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.252+0000 7f2f0a14b640 1 -- 10.20.193.58:0/1970215764 >> 10.20.193.58:0/1970215764 conn(0x7f2f040b3c20 msgr2=0x7f2f040b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:50.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.252+0000 7f2f0a14b640 1 -- 10.20.193.58:0/1970215764 shutdown_connections 2026-02-23T06:26:50.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.252+0000 7f2f0a14b640 1 -- 10.20.193.58:0/1970215764 wait complete. 2026-02-23T06:26:50.270 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:26:50.270 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-23T06:26:50.270 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-23T06:26:50.270 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-23T06:26:50.270 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-23T06:26:50.271 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-23T06:26:50.271 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:26:50.289 INFO:tasks.ceph.mon.a:Stopped 2026-02-23T06:26:50.289 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:26:50.289 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:26:50.458 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.463+0000 7f673cc7f640 1 -- 10.20.193.58:0/1111198617 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f672802fcc0 con 0x7f673815c4b0 2026-02-23T06:26:50.458 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.463+0000 7f673ec83640 1 -- 10.20.193.58:0/1111198617 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f673815c4b0 msgr2=0x7f6738058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:50.458 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.463+0000 7f673ec83640 1 --2- 10.20.193.58:0/1111198617 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f673815c4b0 0x7f6738058200 secure :-1 s=READY pgs=58 gs=2 cs=0 l=1 c_cookie=4614878471126082071 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6728004740 tx=0x7f672802f1f0 comp rx=0 tx=0).stop 2026-02-23T06:26:50.459 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.465+0000 7f673ec83640 1 -- 10.20.193.58:0/1111198617 shutdown_connections 2026-02-23T06:26:50.459 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.465+0000 7f673ec83640 1 --2- 10.20.193.58:0/1111198617 >> v2:10.20.193.58:3300/0 conn(0x7f6738162ca0 0x7f6738056fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:50.459 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.465+0000 7f673ec83640 1 --2- 10.20.193.58:0/1111198617 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f673815c4b0 0x7f6738058200 unknown :-1 s=CLOSED pgs=58 gs=2 cs=0 l=1 c_cookie=4614878471126082071 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:50.459 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.465+0000 7f673ec83640 1 -- 10.20.193.58:0/1111198617 >> 10.20.193.58:0/1111198617 conn(0x7f67380b3c20 msgr2=0x7f67380b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:50.460 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.465+0000 7f673ec83640 1 -- 10.20.193.58:0/1111198617 shutdown_connections 2026-02-23T06:26:50.460 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.465+0000 7f673ec83640 1 -- 10.20.193.58:0/1111198617 wait complete. 2026-02-23T06:26:50.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.468+0000 7f673ec83640 1 Processor -- start 2026-02-23T06:26:50.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.469+0000 7f673ec83640 1 -- start start 2026-02-23T06:26:50.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.469+0000 7f673ec83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6738056960 0x7f67381613c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:50.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.469+0000 7f673ec83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f673815c4b0 0x7f673813ad80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:50.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.469+0000 7f673ec83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6738162ca0 0x7f6738151630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:50.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.469+0000 7f673e482640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6738162ca0 msgr2=0x7f6738151630 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:26:50.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.469+0000 7f673e482640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6738162ca0 0x7f6738151630 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:26:50.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.469+0000 7f673ec83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f673815a4f0 con 0x7f6738162ca0 2026-02-23T06:26:50.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.469+0000 7f673ec83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f673815f850 con 0x7f673815c4b0 2026-02-23T06:26:50.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.469+0000 7f673ec83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f67380b0f20 con 0x7f6738056960 2026-02-23T06:26:50.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.469+0000 7f673dc81640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6738056960 0x7f67381613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:50.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.470+0000 7f673d480640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f673815c4b0 0x7f673813ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:50.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.470+0000 7f673dc81640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6738056960 0x7f67381613c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:59264/0 (socket says 10.20.193.58:59264) 2026-02-23T06:26:50.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.470+0000 7f673dc81640 1 -- 10.20.193.58:0/413530323 learned_addr learned my addr 10.20.193.58:0/413530323 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:26:50.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.470+0000 7f673dc81640 1 -- 10.20.193.58:0/413530323 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f673815c4b0 msgr2=0x7f673813ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:50.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.470+0000 7f673dc81640 1 --2- 10.20.193.58:0/413530323 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f673815c4b0 0x7f673813ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:50.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.470+0000 7f673dc81640 1 -- 10.20.193.58:0/413530323 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6738162ca0 msgr2=0x7f6738151630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:26:50.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.470+0000 7f673dc81640 1 --2- 10.20.193.58:0/413530323 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6738162ca0 0x7f6738151630 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:50.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.470+0000 7f673dc81640 1 -- 10.20.193.58:0/413530323 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67280094b0 con 0x7f6738056960 2026-02-23T06:26:50.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.471+0000 7f673dc81640 1 --2- 10.20.193.58:0/413530323 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6738056960 0x7f67381613c0 secure :-1 s=READY pgs=59 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6728002d90 tx=0x7f6728002dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:50.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.471+0000 7f67267fc640 1 -- 10.20.193.58:0/413530323 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f672802fcc0 con 0x7f6738056960 2026-02-23T06:26:50.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.471+0000 7f673ec83640 1 -- 10.20.193.58:0/413530323 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f673813cf60 con 0x7f6738056960 2026-02-23T06:26:50.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.471+0000 7f67267fc640 1 -- 10.20.193.58:0/413530323 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6728004940 con 0x7f6738056960 2026-02-23T06:26:50.466 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.471+0000 7f67267fc640 1 -- 10.20.193.58:0/413530323 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6728004d10 con 0x7f6738056960 2026-02-23T06:26:50.466 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.471+0000 7f673ec83640 1 -- 10.20.193.58:0/413530323 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f67380b0a00 con 0x7f6738056960 2026-02-23T06:26:50.466 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.471+0000 7f673ec83640 1 -- 10.20.193.58:0/413530323 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6738058070 con 0x7f6738056960 2026-02-23T06:26:50.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.473+0000 7f67267fc640 1 -- 10.20.193.58:0/413530323 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f6728065a30 con 0x7f6738056960 2026-02-23T06:26:50.468 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.473+0000 7f67267fc640 1 --2- 10.20.193.58:0/413530323 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f670807a5b0 0x7f670809aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:50.468 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.473+0000 7f67267fc640 1 -- 10.20.193.58:0/413530323 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f672803f070 con 0x7f6738056960 2026-02-23T06:26:50.468 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.474+0000 7f673d480640 1 --2- 10.20.193.58:0/413530323 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f670807a5b0 0x7f670809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:50.469 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.474+0000 7f67267fc640 1 -- 10.20.193.58:0/413530323 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f6728085b90 con 0x7f6738056960 2026-02-23T06:26:50.469 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.474+0000 7f673d480640 1 --2- 10.20.193.58:0/413530323 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f670807a5b0 0x7f670809aa60 secure :-1 s=READY pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f67381620d0 tx=0x7f672c009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:50.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.633+0000 7f673ec83640 1 -- 10.20.193.58:0/413530323 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f67380b0c20 con 0x7f6738056960 2026-02-23T06:26:50.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.633+0000 7f67267fc640 1 -- 10.20.193.58:0/413530323 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f6728088d40 con 0x7f6738056960 2026-02-23T06:26:50.629 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:26:50.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.634+0000 7f673ec83640 1 -- 10.20.193.58:0/413530323 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f670807a5b0 msgr2=0x7f670809aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:50.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.634+0000 7f673ec83640 1 --2- 10.20.193.58:0/413530323 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f670807a5b0 0x7f670809aa60 secure :-1 s=READY pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f67381620d0 tx=0x7f672c009040 comp rx=0 tx=0).stop 2026-02-23T06:26:50.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.634+0000 7f673ec83640 1 -- 10.20.193.58:0/413530323 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6738056960 msgr2=0x7f67381613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:50.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.634+0000 7f673ec83640 1 --2- 10.20.193.58:0/413530323 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6738056960 0x7f67381613c0 secure :-1 s=READY pgs=59 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6728002d90 tx=0x7f6728002dc0 comp rx=0 tx=0).stop 2026-02-23T06:26:50.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.634+0000 7f673ec83640 1 -- 10.20.193.58:0/413530323 shutdown_connections 2026-02-23T06:26:50.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.634+0000 7f673ec83640 1 --2- 10.20.193.58:0/413530323 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f670807a5b0 0x7f670809aa60 unknown :-1 s=CLOSED pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:50.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.634+0000 7f673ec83640 1 --2- 10.20.193.58:0/413530323 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6738162ca0 0x7f6738151630 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:50.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.634+0000 7f673ec83640 1 --2- 10.20.193.58:0/413530323 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f673815c4b0 0x7f673813ad80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:50.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.634+0000 7f673ec83640 1 --2- 10.20.193.58:0/413530323 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6738056960 0x7f67381613c0 unknown :-1 s=CLOSED pgs=59 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:50.631 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.634+0000 7f673ec83640 1 -- 10.20.193.58:0/413530323 >> 10.20.193.58:0/413530323 conn(0x7f67380b3c20 msgr2=0x7f67380b66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:50.631 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.634+0000 7f673ec83640 1 -- 10.20.193.58:0/413530323 shutdown_connections 2026-02-23T06:26:50.631 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:50.634+0000 7f673ec83640 1 -- 10.20.193.58:0/413530323 wait complete. 2026-02-23T06:26:53.642 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:26:53.767 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.771+0000 7f1b63577640 1 -- 10.20.193.58:0/148484071 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1b6415d4a0 msgr2=0x7f1b640affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:53.767 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.771+0000 7f1b63577640 1 --2- 10.20.193.58:0/148484071 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1b6415d4a0 0x7f1b640affb0 secure :-1 s=READY pgs=23 gs=3 cs=0 l=1 c_cookie=16055785383330083411 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b640b5040 tx=0x7f1b5802f1b0 comp rx=0 tx=0).stop 2026-02-23T06:26:53.767 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.771+0000 7f1b63577640 1 -- 10.20.193.58:0/148484071 shutdown_connections 2026-02-23T06:26:53.767 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.771+0000 7f1b63577640 1 --2- 10.20.193.58:0/148484071 >> v2:10.20.193.58:3300/0 conn(0x7f1b6415d870 0x7f1b640587b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:53.768 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.771+0000 7f1b63577640 1 --2- 10.20.193.58:0/148484071 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1b6415d4a0 0x7f1b640affb0 unknown :-1 s=CLOSED pgs=23 gs=3 cs=0 l=1 c_cookie=16055785383330083411 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:53.768 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.771+0000 7f1b63577640 1 -- 10.20.193.58:0/148484071 >> 10.20.193.58:0/148484071 conn(0x7f1b640b3c20 msgr2=0x7f1b640b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:53.768 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.772+0000 7f1b63577640 1 -- 10.20.193.58:0/148484071 shutdown_connections 2026-02-23T06:26:53.768 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.772+0000 7f1b63577640 1 -- 10.20.193.58:0/148484071 wait complete. 2026-02-23T06:26:53.770 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.773+0000 7f1b63577640 1 Processor -- start 2026-02-23T06:26:53.770 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.773+0000 7f1b63577640 1 -- start start 2026-02-23T06:26:53.770 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.773+0000 7f1b63577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1b640b6690 0x7f1b6413e620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:53.770 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.773+0000 7f1b63577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1b6415d4a0 0x7f1b6414a200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:53.770 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.773+0000 7f1b63577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1b6415d870 0x7f1b641601e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:53.770 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.773+0000 7f1b63577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f1b64143630 con 0x7f1b6415d4a0 2026-02-23T06:26:53.770 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.773+0000 7f1b63577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6413c810 con 0x7f1b640b6690 2026-02-23T06:26:53.770 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.773+0000 7f1b63577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f1b6414d890 con 0x7f1b6415d870 2026-02-23T06:26:53.770 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.773+0000 7f1b61d74640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1b6415d4a0 msgr2=0x7f1b6414a200 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:26:53.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.773+0000 7f1b61d74640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1b6415d4a0 0x7f1b6414a200 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:26:53.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.773+0000 7f1b62575640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1b640b6690 0x7f1b6413e620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:53.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.773+0000 7f1b62575640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1b640b6690 0x7f1b6413e620 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:43702/0 (socket says 10.20.193.58:43702) 2026-02-23T06:26:53.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.773+0000 7f1b62575640 1 -- 10.20.193.58:0/3527341123 learned_addr learned my addr 10.20.193.58:0/3527341123 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:26:53.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.773+0000 7f1b62d76640 1 --2- 10.20.193.58:0/3527341123 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1b6415d870 0x7f1b641601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:53.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.774+0000 7f1b62575640 1 -- 10.20.193.58:0/3527341123 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1b6415d870 msgr2=0x7f1b641601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:53.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.774+0000 7f1b62575640 1 --2- 10.20.193.58:0/3527341123 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1b6415d870 0x7f1b641601e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:53.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.774+0000 7f1b62575640 1 -- 10.20.193.58:0/3527341123 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1b6415d4a0 msgr2=0x7f1b6414a200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:26:53.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.774+0000 7f1b62575640 1 --2- 10.20.193.58:0/3527341123 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1b6415d4a0 0x7f1b6414a200 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:53.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.774+0000 7f1b62575640 1 -- 10.20.193.58:0/3527341123 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b580094b0 con 0x7f1b640b6690 2026-02-23T06:26:53.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.782+0000 7f1b62575640 1 --2- 10.20.193.58:0/3527341123 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1b640b6690 0x7f1b6413e620 secure :-1 s=READY pgs=24 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b580023d0 tx=0x7f1b58002a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:53.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.782+0000 7f1b4affd640 1 -- 10.20.193.58:0/3527341123 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b58044070 con 0x7f1b640b6690 2026-02-23T06:26:53.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.782+0000 7f1b63577640 1 -- 10.20.193.58:0/3527341123 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b6414db70 con 0x7f1b640b6690 2026-02-23T06:26:53.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.782+0000 7f1b63577640 1 -- 10.20.193.58:0/3527341123 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b6414e130 con 0x7f1b640b6690 2026-02-23T06:26:53.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.782+0000 7f1b4affd640 1 -- 10.20.193.58:0/3527341123 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b58002e50 con 0x7f1b640b6690 2026-02-23T06:26:53.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.782+0000 7f1b4affd640 1 -- 10.20.193.58:0/3527341123 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b58004cd0 con 0x7f1b640b6690 2026-02-23T06:26:53.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.782+0000 7f1b63577640 1 -- 10.20.193.58:0/3527341123 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b640b6d50 con 0x7f1b640b6690 2026-02-23T06:26:53.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.784+0000 7f1b4affd640 1 -- 10.20.193.58:0/3527341123 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f1b58067bd0 con 0x7f1b640b6690 2026-02-23T06:26:53.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.784+0000 7f1b4affd640 1 --2- 10.20.193.58:0/3527341123 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1b3007a5b0 0x7f1b3009aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:53.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.785+0000 7f1b4affd640 1 -- 10.20.193.58:0/3527341123 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f1b580c2950 con 0x7f1b640b6690 2026-02-23T06:26:53.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.785+0000 7f1b61d74640 1 --2- 10.20.193.58:0/3527341123 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1b3007a5b0 0x7f1b3009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:53.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.785+0000 7f1b4affd640 1 -- 10.20.193.58:0/3527341123 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f1b58085a80 con 0x7f1b640b6690 2026-02-23T06:26:53.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.786+0000 7f1b61d74640 1 --2- 10.20.193.58:0/3527341123 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1b3007a5b0 0x7f1b3009aa60 secure :-1 s=READY pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b64144aa0 tx=0x7f1b4c006e10 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:53.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.941+0000 7f1b63577640 1 -- 10.20.193.58:0/3527341123 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1b6405b0e0 con 0x7f1b640b6690 2026-02-23T06:26:53.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.942+0000 7f1b4affd640 1 -- 10.20.193.58:0/3527341123 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f1b58004e30 con 0x7f1b640b6690 2026-02-23T06:26:53.937 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:26:53.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.944+0000 7f1b63577640 1 -- 10.20.193.58:0/3527341123 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1b3007a5b0 msgr2=0x7f1b3009aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:53.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.944+0000 7f1b63577640 1 --2- 10.20.193.58:0/3527341123 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1b3007a5b0 0x7f1b3009aa60 secure :-1 s=READY pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b64144aa0 tx=0x7f1b4c006e10 comp rx=0 tx=0).stop 2026-02-23T06:26:53.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.944+0000 7f1b63577640 1 -- 10.20.193.58:0/3527341123 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1b640b6690 msgr2=0x7f1b6413e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:53.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.944+0000 7f1b63577640 1 --2- 10.20.193.58:0/3527341123 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1b640b6690 0x7f1b6413e620 secure :-1 s=READY pgs=24 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b580023d0 tx=0x7f1b58002a10 comp rx=0 tx=0).stop 2026-02-23T06:26:53.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.944+0000 7f1b63577640 1 -- 10.20.193.58:0/3527341123 shutdown_connections 2026-02-23T06:26:53.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.944+0000 7f1b63577640 1 --2- 10.20.193.58:0/3527341123 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1b3007a5b0 0x7f1b3009aa60 unknown :-1 s=CLOSED pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:53.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.944+0000 7f1b63577640 1 --2- 10.20.193.58:0/3527341123 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1b6415d870 0x7f1b641601e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:53.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.944+0000 7f1b63577640 1 --2- 10.20.193.58:0/3527341123 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1b6415d4a0 0x7f1b6414a200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:53.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.944+0000 7f1b63577640 1 --2- 10.20.193.58:0/3527341123 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1b640b6690 0x7f1b6413e620 unknown :-1 s=CLOSED pgs=24 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:53.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.944+0000 7f1b63577640 1 -- 10.20.193.58:0/3527341123 >> 10.20.193.58:0/3527341123 conn(0x7f1b640b3c20 msgr2=0x7f1b640b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:53.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.944+0000 7f1b63577640 1 -- 10.20.193.58:0/3527341123 shutdown_connections 2026-02-23T06:26:53.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:53.944+0000 7f1b63577640 1 -- 10.20.193.58:0/3527341123 wait complete. 2026-02-23T06:26:56.952 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:26:57.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.081+0000 7f2212cc3640 1 -- 10.20.193.58:0/3930773611 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f220c15d4a0 msgr2=0x7f220c0affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:57.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.081+0000 7f2212cc3640 1 --2- 10.20.193.58:0/3930773611 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f220c15d4a0 0x7f220c0affb0 secure :-1 s=READY pgs=65 gs=4 cs=0 l=1 c_cookie=8710582163364110470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21fc009950 tx=0x7f21fc02f2b0 comp rx=0 tx=0).stop 2026-02-23T06:26:57.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.081+0000 7f2212cc3640 1 -- 10.20.193.58:0/3930773611 shutdown_connections 2026-02-23T06:26:57.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.081+0000 7f2212cc3640 1 --2- 10.20.193.58:0/3930773611 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f220c15d4a0 0x7f220c0affb0 unknown :-1 s=CLOSED pgs=65 gs=4 cs=0 l=1 c_cookie=8710582163364110470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:57.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.081+0000 7f2212cc3640 1 -- 10.20.193.58:0/3930773611 >> 10.20.193.58:0/3930773611 conn(0x7f220c0b3c20 msgr2=0x7f220c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:57.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.081+0000 7f2212cc3640 1 -- 10.20.193.58:0/3930773611 shutdown_connections 2026-02-23T06:26:57.077 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.081+0000 7f2212cc3640 1 -- 10.20.193.58:0/3930773611 wait complete. 2026-02-23T06:26:57.077 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.083+0000 7f2212cc3640 1 Processor -- start 2026-02-23T06:26:57.077 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.083+0000 7f2212cc3640 1 -- start start 2026-02-23T06:26:57.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.083+0000 7f2212cc3640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f220c0b6690 0x7f220c119f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:57.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.083+0000 7f2212cc3640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f220c15d4a0 0x7f220c11ea00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:57.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.083+0000 7f2212cc3640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f220c15d870 0x7f220c11bc00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:57.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.083+0000 7f2212cc3640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f220c11ad10 con 0x7f220c15d870 2026-02-23T06:26:57.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.083+0000 7f2212cc3640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f220c13a850 con 0x7f220c0b6690 2026-02-23T06:26:57.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.083+0000 7f2212cc3640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f220c11b7b0 con 0x7f220c15d4a0 2026-02-23T06:26:57.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.083+0000 7f22124c2640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f220c15d870 msgr2=0x7f220c11bc00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:26:57.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.083+0000 7f22124c2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f220c15d870 0x7f220c11bc00 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:26:57.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.083+0000 7f2211cc1640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f220c0b6690 0x7f220c119f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:57.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.083+0000 7f2211cc1640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f220c0b6690 0x7f220c119f20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:43712/0 (socket says 10.20.193.58:43712) 2026-02-23T06:26:57.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.083+0000 7f2211cc1640 1 -- 10.20.193.58:0/3802219935 learned_addr learned my addr 10.20.193.58:0/3802219935 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:26:57.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.083+0000 7f22114c0640 1 --2- 10.20.193.58:0/3802219935 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f220c15d4a0 0x7f220c11ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:57.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.084+0000 7f2211cc1640 1 -- 10.20.193.58:0/3802219935 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f220c15d4a0 msgr2=0x7f220c11ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:57.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.084+0000 7f2211cc1640 1 --2- 10.20.193.58:0/3802219935 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f220c15d4a0 0x7f220c11ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:57.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.084+0000 7f2211cc1640 1 -- 10.20.193.58:0/3802219935 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f220c15d870 msgr2=0x7f220c11bc00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:26:57.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.084+0000 7f2211cc1640 1 --2- 10.20.193.58:0/3802219935 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f220c15d870 0x7f220c11bc00 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:57.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.084+0000 7f2211cc1640 1 -- 10.20.193.58:0/3802219935 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21fc009570 con 0x7f220c0b6690 2026-02-23T06:26:57.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.084+0000 7f2211cc1640 1 --2- 10.20.193.58:0/3802219935 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f220c0b6690 0x7f220c119f20 secure :-1 s=READY pgs=27 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21fc009a50 tx=0x7f21fc002940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:57.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.084+0000 7f21fa7fc640 1 -- 10.20.193.58:0/3802219935 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f21fc03d070 con 0x7f220c0b6690 2026-02-23T06:26:57.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.084+0000 7f21fa7fc640 1 -- 10.20.193.58:0/3802219935 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21fc038470 con 0x7f220c0b6690 2026-02-23T06:26:57.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.084+0000 7f21fa7fc640 1 -- 10.20.193.58:0/3802219935 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f21fc0388a0 con 0x7f220c0b6690 2026-02-23T06:26:57.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.084+0000 7f2212cc3640 1 -- 10.20.193.58:0/3802219935 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f220c116010 con 0x7f220c0b6690 2026-02-23T06:26:57.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.084+0000 7f2212cc3640 1 -- 10.20.193.58:0/3802219935 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f220c1165d0 con 0x7f220c0b6690 2026-02-23T06:26:57.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.085+0000 7f2212cc3640 1 -- 10.20.193.58:0/3802219935 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f220c059a20 con 0x7f220c0b6690 2026-02-23T06:26:57.081 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.086+0000 7f21fa7fc640 1 -- 10.20.193.58:0/3802219935 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f21fc066b20 con 0x7f220c0b6690 2026-02-23T06:26:57.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.087+0000 7f21fa7fc640 1 --2- 10.20.193.58:0/3802219935 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f21dc07a5b0 0x7f21dc09aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:26:57.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.087+0000 7f21fa7fc640 1 -- 10.20.193.58:0/3802219935 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f21fc0c24e0 con 0x7f220c0b6690 2026-02-23T06:26:57.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.088+0000 7f21fa7fc640 1 -- 10.20.193.58:0/3802219935 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f21fc085690 con 0x7f220c0b6690 2026-02-23T06:26:57.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.088+0000 7f22114c0640 1 --2- 10.20.193.58:0/3802219935 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f21dc07a5b0 0x7f21dc09aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:26:57.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.088+0000 7f22114c0640 1 --2- 10.20.193.58:0/3802219935 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f21dc07a5b0 0x7f21dc09aa60 secure :-1 s=READY pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2200006f30 tx=0x7f2200006ea0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:26:57.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.244+0000 7f2212cc3640 1 -- 10.20.193.58:0/3802219935 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f220c15afe0 con 0x7f220c0b6690 2026-02-23T06:26:57.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.244+0000 7f21fa7fc640 1 -- 10.20.193.58:0/3802219935 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f21fc088840 con 0x7f220c0b6690 2026-02-23T06:26:57.239 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:26:57.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.245+0000 7f2212cc3640 1 -- 10.20.193.58:0/3802219935 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f21dc07a5b0 msgr2=0x7f21dc09aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:57.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.245+0000 7f2212cc3640 1 --2- 10.20.193.58:0/3802219935 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f21dc07a5b0 0x7f21dc09aa60 secure :-1 s=READY pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2200006f30 tx=0x7f2200006ea0 comp rx=0 tx=0).stop 2026-02-23T06:26:57.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.245+0000 7f2212cc3640 1 -- 10.20.193.58:0/3802219935 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f220c0b6690 msgr2=0x7f220c119f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:26:57.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.245+0000 7f2212cc3640 1 --2- 10.20.193.58:0/3802219935 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f220c0b6690 0x7f220c119f20 secure :-1 s=READY pgs=27 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21fc009a50 tx=0x7f21fc002940 comp rx=0 tx=0).stop 2026-02-23T06:26:57.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.245+0000 7f2212cc3640 1 -- 10.20.193.58:0/3802219935 shutdown_connections 2026-02-23T06:26:57.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.245+0000 7f2212cc3640 1 --2- 10.20.193.58:0/3802219935 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f21dc07a5b0 0x7f21dc09aa60 unknown :-1 s=CLOSED pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:57.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.245+0000 7f2212cc3640 1 --2- 10.20.193.58:0/3802219935 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f220c15d870 0x7f220c11bc00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:57.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.245+0000 7f2212cc3640 1 --2- 10.20.193.58:0/3802219935 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f220c15d4a0 0x7f220c11ea00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:57.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.245+0000 7f2212cc3640 1 --2- 10.20.193.58:0/3802219935 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f220c0b6690 0x7f220c119f20 unknown :-1 s=CLOSED pgs=27 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:26:57.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.245+0000 7f2212cc3640 1 -- 10.20.193.58:0/3802219935 >> 10.20.193.58:0/3802219935 conn(0x7f220c0b3c20 msgr2=0x7f220c15bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:26:57.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.245+0000 7f2212cc3640 1 -- 10.20.193.58:0/3802219935 shutdown_connections 2026-02-23T06:26:57.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:26:57.245+0000 7f2212cc3640 1 -- 10.20.193.58:0/3802219935 wait complete. 2026-02-23T06:27:00.253 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:27:04.807 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.811+0000 7f61a6c5b640 1 -- 10.20.193.58:0/603758000 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f61840037b0 msgr2=0x7f6184023c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:04.807 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.811+0000 7f61a6c5b640 1 --2- 10.20.193.58:0/603758000 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f61840037b0 0x7f6184023c00 secure :-1 s=READY pgs=30 gs=25 cs=0 l=1 c_cookie=6804907823513897434 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6184003740 tx=0x7f6188030d70 comp rx=0 tx=0).stop 2026-02-23T06:27:04.808 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.811+0000 7f61a51d1640 1 -- 10.20.193.58:0/603758000 reap_dead start 2026-02-23T06:27:04.808 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.812+0000 7f61a6c5b640 1 -- 10.20.193.58:0/603758000 shutdown_connections 2026-02-23T06:27:04.809 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.812+0000 7f61a6c5b640 1 --2- 10.20.193.58:0/603758000 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f61840037b0 0x7f6184023c00 unknown :-1 s=CLOSED pgs=30 gs=25 cs=0 l=1 c_cookie=6804907823513897434 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:04.809 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.812+0000 7f61a6c5b640 1 -- 10.20.193.58:0/603758000 >> 10.20.193.58:0/603758000 conn(0x7f61a00561f0 msgr2=0x7f61a00565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:04.809 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.812+0000 7f61a6c5b640 1 -- 10.20.193.58:0/603758000 shutdown_connections 2026-02-23T06:27:04.809 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.812+0000 7f61a6c5b640 1 -- 10.20.193.58:0/603758000 wait complete. 2026-02-23T06:27:04.809 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.814+0000 7f61a6c5b640 1 Processor -- start 2026-02-23T06:27:04.810 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.814+0000 7f61a6c5b640 1 -- start start 2026-02-23T06:27:04.810 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.814+0000 7f61a6c5b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61840037b0 0x7f61a0179d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:04.810 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.814+0000 7f61a6c5b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f61a01398b0 0x7f61a0152410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:04.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.814+0000 7f61a6c5b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f61a0156820 0x7f61a01361d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:04.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.814+0000 7f61a6c5b640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f61a0139420 con 0x7f61840037b0 2026-02-23T06:27:04.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.814+0000 7f61a6c5b640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f61a017a2c0 con 0x7f61a0156820 2026-02-23T06:27:04.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.814+0000 7f61a6c5b640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f61a01383c0 con 0x7f61a01398b0 2026-02-23T06:27:04.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.814+0000 7f61a49d0640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61840037b0 msgr2=0x7f61a0179d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:27:04.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.815+0000 7f61a49d0640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61840037b0 0x7f61a0179d80 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:27:04.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.816+0000 7f61a51d1640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f61a0156820 0x7f61a01361d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:04.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.816+0000 7f61a51d1640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f61a0156820 0x7f61a01361d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:52028/0 (socket says 10.20.193.58:52028) 2026-02-23T06:27:04.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.816+0000 7f61a51d1640 1 -- 10.20.193.58:0/3353887674 learned_addr learned my addr 10.20.193.58:0/3353887674 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:27:04.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.816+0000 7f6197fff640 1 --2- 10.20.193.58:0/3353887674 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f61a01398b0 0x7f61a0152410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:04.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.816+0000 7f61a51d1640 1 -- 10.20.193.58:0/3353887674 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f61a01398b0 msgr2=0x7f61a0152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:04.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.816+0000 7f61a51d1640 1 --2- 10.20.193.58:0/3353887674 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f61a01398b0 0x7f61a0152410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:04.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.816+0000 7f61a51d1640 1 -- 10.20.193.58:0/3353887674 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61840037b0 msgr2=0x7f61a0179d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:27:04.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.816+0000 7f61a51d1640 1 --2- 10.20.193.58:0/3353887674 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61840037b0 0x7f61a0179d80 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:04.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.816+0000 7f61a51d1640 1 -- 10.20.193.58:0/3353887674 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61880045b0 con 0x7f61a0156820 2026-02-23T06:27:04.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.816+0000 7f61a51d1640 1 --2- 10.20.193.58:0/3353887674 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f61a0156820 0x7f61a01361d0 secure :-1 s=READY pgs=31 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6184044d60 tx=0x7f619c00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:04.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.817+0000 7f61957fa640 1 -- 10.20.193.58:0/3353887674 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f619c010360 con 0x7f61a0156820 2026-02-23T06:27:04.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.817+0000 7f61957fa640 1 -- 10.20.193.58:0/3353887674 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f619c00d040 con 0x7f61a0156820 2026-02-23T06:27:04.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.817+0000 7f61957fa640 1 -- 10.20.193.58:0/3353887674 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f619c010780 con 0x7f61a0156820 2026-02-23T06:27:04.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.817+0000 7f61a6c5b640 1 -- 10.20.193.58:0/3353887674 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61a01386a0 con 0x7f61a0156820 2026-02-23T06:27:04.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.817+0000 7f61a6c5b640 1 -- 10.20.193.58:0/3353887674 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61a0138dd0 con 0x7f61a0156820 2026-02-23T06:27:04.816 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.818+0000 7f61a6c5b640 1 -- 10.20.193.58:0/3353887674 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61a0138c20 con 0x7f61a0156820 2026-02-23T06:27:04.816 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.819+0000 7f61957fa640 1 -- 10.20.193.58:0/3353887674 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f619c03ab80 con 0x7f61a0156820 2026-02-23T06:27:04.816 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.820+0000 7f61957fa640 1 --2- 10.20.193.58:0/3353887674 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f617007a700 0x7f617009abb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:04.816 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.820+0000 7f61957fa640 1 -- 10.20.193.58:0/3353887674 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f619c007e40 con 0x7f61a0156820 2026-02-23T06:27:04.816 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.820+0000 7f61a49d0640 1 --2- 10.20.193.58:0/3353887674 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f617007a700 0x7f617009abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:04.816 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.821+0000 7f61a49d0640 1 --2- 10.20.193.58:0/3353887674 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f617007a700 0x7f617009abb0 secure :-1 s=READY pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6188002670 tx=0x7f61880047e0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:04.816 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.821+0000 7f61957fa640 1 -- 10.20.193.58:0/3353887674 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f619c060af0 con 0x7f61a0156820 2026-02-23T06:27:04.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.978+0000 7f61a6c5b640 1 -- 10.20.193.58:0/3353887674 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f61a0058640 con 0x7f61a0156820 2026-02-23T06:27:04.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.978+0000 7f61957fa640 1 -- 10.20.193.58:0/3353887674 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1748 (secure 0 0 0) 0x7f619c03ae60 con 0x7f61a0156820 2026-02-23T06:27:04.973 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":48,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:27:04.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.980+0000 7f61a6c5b640 1 -- 10.20.193.58:0/3353887674 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f617007a700 msgr2=0x7f617009abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:04.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.980+0000 7f61a6c5b640 1 --2- 10.20.193.58:0/3353887674 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f617007a700 0x7f617009abb0 secure :-1 s=READY pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6188002670 tx=0x7f61880047e0 comp rx=0 tx=0).stop 2026-02-23T06:27:04.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.980+0000 7f61a6c5b640 1 -- 10.20.193.58:0/3353887674 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f61a0156820 msgr2=0x7f61a01361d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:04.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.980+0000 7f61a6c5b640 1 --2- 10.20.193.58:0/3353887674 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f61a0156820 0x7f61a01361d0 secure :-1 s=READY pgs=31 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6184044d60 tx=0x7f619c00c830 comp rx=0 tx=0).stop 2026-02-23T06:27:04.975 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.980+0000 7f61a6c5b640 1 -- 10.20.193.58:0/3353887674 shutdown_connections 2026-02-23T06:27:04.975 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.980+0000 7f61a6c5b640 1 --2- 10.20.193.58:0/3353887674 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f617007a700 0x7f617009abb0 unknown :-1 s=CLOSED pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:04.975 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.980+0000 7f61a6c5b640 1 --2- 10.20.193.58:0/3353887674 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f61a0156820 0x7f61a01361d0 unknown :-1 s=CLOSED pgs=31 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:04.975 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.980+0000 7f61a6c5b640 1 --2- 10.20.193.58:0/3353887674 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f61a01398b0 0x7f61a0152410 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:04.975 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.980+0000 7f61a6c5b640 1 --2- 10.20.193.58:0/3353887674 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61840037b0 0x7f61a0179d80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:04.975 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.980+0000 7f61a6c5b640 1 -- 10.20.193.58:0/3353887674 >> 10.20.193.58:0/3353887674 conn(0x7f61a00561f0 msgr2=0x7f61a0162250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:04.975 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.980+0000 7f61a6c5b640 1 -- 10.20.193.58:0/3353887674 shutdown_connections 2026-02-23T06:27:04.975 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:04.980+0000 7f61a6c5b640 1 -- 10.20.193.58:0/3353887674 wait complete. 2026-02-23T06:27:04.988 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:27:04.988 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-23T06:27:04.988 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:27:05.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.116+0000 7f9750803640 1 -- 10.20.193.58:0/1298990244 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f974c056550 msgr2=0x7f974c05ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:05.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.116+0000 7f9750803640 1 --2- 10.20.193.58:0/1298990244 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f974c056550 0x7f974c05ce30 secure :-1 s=READY pgs=32 gs=4 cs=0 l=1 c_cookie=1175871745848841215 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f974c059aa0 tx=0x7f973c02f280 comp rx=0 tx=0).stop 2026-02-23T06:27:05.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.116+0000 7f9750803640 1 -- 10.20.193.58:0/1298990244 shutdown_connections 2026-02-23T06:27:05.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.116+0000 7f9750803640 1 --2- 10.20.193.58:0/1298990244 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f974c056550 0x7f974c05ce30 unknown :-1 s=CLOSED pgs=32 gs=4 cs=0 l=1 c_cookie=1175871745848841215 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:05.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.116+0000 7f9750803640 1 --2- 10.20.193.58:0/1298990244 >> v2:10.20.193.58:3300/0 conn(0x7f974c15c040 0x7f974c05b0e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:05.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.116+0000 7f9750803640 1 -- 10.20.193.58:0/1298990244 >> 10.20.193.58:0/1298990244 conn(0x7f974c0b3c20 msgr2=0x7f974c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:05.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.116+0000 7f9750803640 1 -- 10.20.193.58:0/1298990244 shutdown_connections 2026-02-23T06:27:05.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.116+0000 7f9750803640 1 -- 10.20.193.58:0/1298990244 wait complete. 2026-02-23T06:27:05.112 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.117+0000 7f9750803640 1 Processor -- start 2026-02-23T06:27:05.112 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.117+0000 7f9750803640 1 -- start start 2026-02-23T06:27:05.112 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.118+0000 7f9750803640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f974c056550 0x7f974c120540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:05.112 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.118+0000 7f9750803640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f974c05d370 0x7f974c156af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:05.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.118+0000 7f9750803640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f974c15c040 0x7f974c057b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:05.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.118+0000 7f974bfff640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f974c15c040 msgr2=0x7f974c057b50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:27:05.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.118+0000 7f974bfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f974c15c040 0x7f974c057b50 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:27:05.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.118+0000 7f974affd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f974c05d370 0x7f974c156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:05.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.118+0000 7f9750803640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f974c121a60 con 0x7f974c15c040 2026-02-23T06:27:05.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.118+0000 7f9750803640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f974c121de0 con 0x7f974c05d370 2026-02-23T06:27:05.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.118+0000 7f9750803640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f974c122010 con 0x7f974c056550 2026-02-23T06:27:05.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.118+0000 7f974affd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f974c05d370 0x7f974c156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:52056/0 (socket says 10.20.193.58:52056) 2026-02-23T06:27:05.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.118+0000 7f974affd640 1 -- 10.20.193.58:0/193744914 learned_addr learned my addr 10.20.193.58:0/193744914 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:27:05.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.118+0000 7f974b7fe640 1 --2- 10.20.193.58:0/193744914 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f974c056550 0x7f974c120540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:05.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.118+0000 7f974affd640 1 -- 10.20.193.58:0/193744914 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f974c056550 msgr2=0x7f974c120540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:05.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.118+0000 7f974affd640 1 --2- 10.20.193.58:0/193744914 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f974c056550 0x7f974c120540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:05.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.118+0000 7f974affd640 1 -- 10.20.193.58:0/193744914 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f974c15c040 msgr2=0x7f974c057b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:27:05.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.118+0000 7f974affd640 1 --2- 10.20.193.58:0/193744914 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f974c15c040 0x7f974c057b50 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:05.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.118+0000 7f974affd640 1 -- 10.20.193.58:0/193744914 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f973c009570 con 0x7f974c05d370 2026-02-23T06:27:05.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.118+0000 7f974affd640 1 --2- 10.20.193.58:0/193744914 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f974c05d370 0x7f974c156af0 secure :-1 s=READY pgs=33 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f973c004740 tx=0x7f973c0028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:05.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.119+0000 7f9727fff640 1 -- 10.20.193.58:0/193744914 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f973c03d070 con 0x7f974c05d370 2026-02-23T06:27:05.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.119+0000 7f9727fff640 1 -- 10.20.193.58:0/193744914 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f973c004850 con 0x7f974c05d370 2026-02-23T06:27:05.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.119+0000 7f9727fff640 1 -- 10.20.193.58:0/193744914 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f973c004c80 con 0x7f974c05d370 2026-02-23T06:27:05.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.119+0000 7f9750803640 1 -- 10.20.193.58:0/193744914 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f974c121530 con 0x7f974c05d370 2026-02-23T06:27:05.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.119+0000 7f9750803640 1 -- 10.20.193.58:0/193744914 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f974c157630 con 0x7f974c05d370 2026-02-23T06:27:05.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.119+0000 7f9750803640 1 --2- 10.20.193.58:0/193744914 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f974c157030 0x7f974c124610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:05.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.119+0000 7f9750803640 1 -- 10.20.193.58:0/193744914 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f974c15c410 con 0x7f974c157030 2026-02-23T06:27:05.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.119+0000 7f974b7fe640 1 --2- 10.20.193.58:0/193744914 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f974c157030 0x7f974c124610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:05.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.120+0000 7f974b7fe640 1 -- 10.20.193.58:0/193744914 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f974c05b620 con 0x7f974c157030 2026-02-23T06:27:05.115 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.120+0000 7f974b7fe640 1 --2- 10.20.193.58:0/193744914 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f974c157030 0x7f974c124610 secure :-1 s=READY pgs=34 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f973800d4d0 tx=0x7f973800d9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:05.115 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.120+0000 7f9727fff640 1 -- 10.20.193.58:0/193744914 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9738002cd0 con 0x7f974c157030 2026-02-23T06:27:05.115 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.121+0000 7f9727fff640 1 -- 10.20.193.58:0/193744914 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f973c004de0 con 0x7f974c05d370 2026-02-23T06:27:05.116 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.122+0000 7f9727fff640 1 --2- 10.20.193.58:0/193744914 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f971c07a660 0x7f971c09ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:05.116 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.122+0000 7f9727fff640 1 -- 10.20.193.58:0/193744914 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f973c0c2750 con 0x7f974c05d370 2026-02-23T06:27:05.117 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.122+0000 7f974bfff640 1 --2- 10.20.193.58:0/193744914 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f971c07a660 0x7f971c09ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:05.117 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.122+0000 7f9727fff640 1 -- 10.20.193.58:0/193744914 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f9738002e30 con 0x7f974c157030 2026-02-23T06:27:05.117 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.122+0000 7f9727fff640 1 -- 10.20.193.58:0/193744914 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f974c157030 msgr2=0x7f974c124610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:05.117 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.122+0000 7f9727fff640 1 --2- 10.20.193.58:0/193744914 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f974c157030 0x7f974c124610 secure :-1 s=READY pgs=34 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f973800d4d0 tx=0x7f973800d9a0 comp rx=0 tx=0).stop 2026-02-23T06:27:05.117 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.122+0000 7f9727fff640 1 -- 10.20.193.58:0/193744914 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f974c157030 msgr2=0x7f974c124610 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:27:05.117 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.122+0000 7f9727fff640 1 --2- 10.20.193.58:0/193744914 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f974c157030 0x7f974c124610 unknown :-1 s=CLOSED pgs=34 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:05.119 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.124+0000 7f974bfff640 1 --2- 10.20.193.58:0/193744914 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f971c07a660 0x7f971c09ab10 secure :-1 s=READY pgs=206 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f974c163140 tx=0x7f9740007d60 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:05.120 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.125+0000 7f9750803640 1 --2- 10.20.193.58:0/193744914 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f974c058090 0x7f974c124b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:05.120 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.125+0000 7f9750803640 1 -- 10.20.193.58:0/193744914 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f974c1211f0 con 0x7f974c058090 2026-02-23T06:27:05.120 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.126+0000 7f974b7fe640 1 --2- 10.20.193.58:0/193744914 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f974c058090 0x7f974c124b50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:05.120 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.126+0000 7f974b7fe640 1 -- 10.20.193.58:0/193744914 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f974c05ce30 con 0x7f974c058090 2026-02-23T06:27:05.121 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.126+0000 7f974b7fe640 1 --2- 10.20.193.58:0/193744914 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f974c058090 0x7f974c124b50 secure :-1 s=READY pgs=35 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f973800df50 tx=0x7f9738002710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:05.121 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.126+0000 7f9727fff640 1 -- 10.20.193.58:0/193744914 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9738021070 con 0x7f974c058090 2026-02-23T06:27:05.121 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.126+0000 7f9727fff640 1 -- 10.20.193.58:0/193744914 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5068 (secure 0 0 0) 0x7f9738012640 con 0x7f974c058090 2026-02-23T06:27:05.121 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.126+0000 7f9727fff640 1 -- 10.20.193.58:0/193744914 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f974c058090 msgr2=0x7f974c124b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:05.121 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.126+0000 7f9727fff640 1 --2- 10.20.193.58:0/193744914 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f974c058090 0x7f974c124b50 secure :-1 s=READY pgs=35 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f973800df50 tx=0x7f9738002710 comp rx=0 tx=0).stop 2026-02-23T06:27:05.121 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.126+0000 7f9727fff640 1 -- 10.20.193.58:0/193744914 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f974c058090 msgr2=0x7f974c124b50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:27:05.121 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.126+0000 7f9727fff640 1 --2- 10.20.193.58:0/193744914 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f974c058090 0x7f974c124b50 secure :-1 s=CLOSED pgs=35 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f973800df50 tx=0x7f9738002710 comp rx=0 tx=0).stop 2026-02-23T06:27:05.121 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:27:05.121 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:27:05.121 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:27:05.121 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:27:05.121 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 48, 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 26638, 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:05.122 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:05.123 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:05.124 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:05.125 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:27:05.126 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:05.126 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:05.126 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:27:05.126 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:05.126 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:05.126 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:05.126 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:27:05.126 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:05.126 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:05.126 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:05.126 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:27:05.126 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:27:05.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.127+0000 7f9750803640 1 -- 10.20.193.58:0/193744914 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f971c07a660 msgr2=0x7f971c09ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:05.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.127+0000 7f9750803640 1 --2- 10.20.193.58:0/193744914 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f971c07a660 0x7f971c09ab10 secure :-1 s=READY pgs=206 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f974c163140 tx=0x7f9740007d60 comp rx=0 tx=0).stop 2026-02-23T06:27:05.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.127+0000 7f9750803640 1 -- 10.20.193.58:0/193744914 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f974c05d370 msgr2=0x7f974c156af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:05.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.127+0000 7f9750803640 1 --2- 10.20.193.58:0/193744914 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f974c05d370 0x7f974c156af0 secure :-1 s=READY pgs=33 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f973c004740 tx=0x7f973c0028d0 comp rx=0 tx=0).stop 2026-02-23T06:27:05.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.127+0000 7f974bfff640 1 -- 10.20.193.58:0/193744914 reap_dead start 2026-02-23T06:27:05.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.127+0000 7f974bfff640 1 -- 10.20.193.58:0/193744914 reap_dead start 2026-02-23T06:27:05.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.127+0000 7f9750803640 1 -- 10.20.193.58:0/193744914 shutdown_connections 2026-02-23T06:27:05.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.127+0000 7f9750803640 1 -- 10.20.193.58:0/193744914 >> 10.20.193.58:0/193744914 conn(0x7f974c0b3c20 msgr2=0x7f974c15aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:05.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.127+0000 7f9750803640 1 -- 10.20.193.58:0/193744914 shutdown_connections 2026-02-23T06:27:05.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.127+0000 7f9750803640 1 -- 10.20.193.58:0/193744914 wait complete. 2026-02-23T06:27:05.128 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:27:05.128 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-23T06:27:05.128 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:27:05.256 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.260+0000 7f7081843640 1 -- 10.20.193.58:0/538988158 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f707c15d870 msgr2=0x7f707c0587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:05.257 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.260+0000 7f7081843640 1 --2- 10.20.193.58:0/538988158 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f707c15d870 0x7f707c0587b0 secure :-1 s=READY pgs=36 gs=3 cs=0 l=1 c_cookie=2258803166069382226 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7064005e70 tx=0x7f706402f280 comp rx=0 tx=0).stop 2026-02-23T06:27:05.257 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.261+0000 7f7081843640 1 -- 10.20.193.58:0/538988158 shutdown_connections 2026-02-23T06:27:05.257 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.261+0000 7f7081843640 1 --2- 10.20.193.58:0/538988158 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f707c0b6690 0x7f707c058cf0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:05.257 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.261+0000 7f7081843640 1 --2- 10.20.193.58:0/538988158 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f707c15d870 0x7f707c0587b0 unknown :-1 s=CLOSED pgs=36 gs=3 cs=0 l=1 c_cookie=2258803166069382226 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:05.257 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.261+0000 7f7081843640 1 -- 10.20.193.58:0/538988158 >> 10.20.193.58:0/538988158 conn(0x7f707c0b3c20 msgr2=0x7f707c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:05.257 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.261+0000 7f7081843640 1 -- 10.20.193.58:0/538988158 shutdown_connections 2026-02-23T06:27:05.257 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.261+0000 7f7081843640 1 -- 10.20.193.58:0/538988158 wait complete. 2026-02-23T06:27:05.257 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.262+0000 7f7081843640 1 Processor -- start 2026-02-23T06:27:05.257 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.262+0000 7f7081843640 1 -- start start 2026-02-23T06:27:05.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.263+0000 7f7081843640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f707c0b6690 0x7f707c11dc30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:05.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.263+0000 7f7081843640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f707c15d4a0 0x7f707c162690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:05.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.263+0000 7f7081843640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f707c15d870 0x7f707c11b1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:05.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.263+0000 7f7081843640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f707c162320 con 0x7f707c0b6690 2026-02-23T06:27:05.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.263+0000 7f7081843640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f707c162d20 con 0x7f707c15d4a0 2026-02-23T06:27:05.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.263+0000 7f7081843640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f707c161710 con 0x7f707c15d870 2026-02-23T06:27:05.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.263+0000 7f7073fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f707c15d4a0 0x7f707c162690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:05.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.263+0000 7f7080841640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f707c0b6690 msgr2=0x7f707c11dc30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:27:05.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.263+0000 7f7080841640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f707c0b6690 0x7f707c11dc30 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:27:05.259 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.264+0000 7f7073fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f707c15d4a0 0x7f707c162690 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:52080/0 (socket says 10.20.193.58:52080) 2026-02-23T06:27:05.259 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.264+0000 7f7081042640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f707c15d870 0x7f707c11b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:05.259 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.264+0000 7f7081042640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f707c15d870 0x7f707c11b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:49596/0 (socket says 10.20.193.58:49596) 2026-02-23T06:27:05.259 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.264+0000 7f7081042640 1 -- 10.20.193.58:0/2638922944 learned_addr learned my addr 10.20.193.58:0/2638922944 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:27:05.260 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.265+0000 7f7081042640 1 -- 10.20.193.58:0/2638922944 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f707c15d4a0 msgr2=0x7f707c162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:05.260 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.265+0000 7f7081042640 1 --2- 10.20.193.58:0/2638922944 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f707c15d4a0 0x7f707c162690 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:05.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.265+0000 7f7081042640 1 -- 10.20.193.58:0/2638922944 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f707c0b6690 msgr2=0x7f707c11dc30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:27:05.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.265+0000 7f7081042640 1 --2- 10.20.193.58:0/2638922944 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f707c0b6690 0x7f707c11dc30 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:05.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.265+0000 7f7081042640 1 -- 10.20.193.58:0/2638922944 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7064009570 con 0x7f707c15d870 2026-02-23T06:27:05.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.269+0000 7f7081042640 1 --2- 10.20.193.58:0/2638922944 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f707c15d870 0x7f707c11b1d0 secure :-1 s=READY pgs=70 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f707800f8d0 tx=0x7f707800fda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:05.266 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.271+0000 7f70717fa640 1 -- 10.20.193.58:0/2638922944 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f707800dce0 con 0x7f707c15d870 2026-02-23T06:27:05.266 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.271+0000 7f70717fa640 1 -- 10.20.193.58:0/2638922944 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f707800de60 con 0x7f707c15d870 2026-02-23T06:27:05.266 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.271+0000 7f70717fa640 1 -- 10.20.193.58:0/2638922944 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7078005b90 con 0x7f707c15d870 2026-02-23T06:27:05.267 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.271+0000 7f7081843640 1 -- 10.20.193.58:0/2638922944 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f707c1619f0 con 0x7f707c15d870 2026-02-23T06:27:05.267 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.271+0000 7f7081843640 1 -- 10.20.193.58:0/2638922944 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f707c161fb0 con 0x7f707c15d870 2026-02-23T06:27:05.267 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.272+0000 7f7081843640 1 --2- 10.20.193.58:0/2638922944 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f707c13af30 0x7f707c13b300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:05.267 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.272+0000 7f7081843640 1 -- 10.20.193.58:0/2638922944 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f707c161b80 con 0x7f707c13af30 2026-02-23T06:27:05.268 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.273+0000 7f7080841640 1 --2- 10.20.193.58:0/2638922944 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f707c13af30 0x7f707c13b300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:05.268 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.274+0000 7f7080841640 1 -- 10.20.193.58:0/2638922944 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f707c0b6330 con 0x7f707c13af30 2026-02-23T06:27:05.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.274+0000 7f7080841640 1 --2- 10.20.193.58:0/2638922944 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f707c13af30 0x7f707c13b300 secure :-1 s=READY pgs=71 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f706c00b450 tx=0x7f706c00b920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:05.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.274+0000 7f70717fa640 1 -- 10.20.193.58:0/2638922944 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f706c005070 con 0x7f707c13af30 2026-02-23T06:27:05.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.275+0000 7f70717fa640 1 -- 10.20.193.58:0/2638922944 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f7078020060 con 0x7f707c15d870 2026-02-23T06:27:05.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.276+0000 7f70717fa640 1 --2- 10.20.193.58:0/2638922944 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f704c07a660 0x7f704c09ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:05.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.276+0000 7f70717fa640 1 -- 10.20.193.58:0/2638922944 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f7078015070 con 0x7f707c15d870 2026-02-23T06:27:05.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.276+0000 7f70717fa640 1 -- 10.20.193.58:0/2638922944 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f706c0051d0 con 0x7f707c13af30 2026-02-23T06:27:05.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.276+0000 7f7073fff640 1 --2- 10.20.193.58:0/2638922944 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f704c07a660 0x7f704c09ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:05.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.276+0000 7f70717fa640 1 -- 10.20.193.58:0/2638922944 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f707c13af30 msgr2=0x7f707c13b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:05.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.276+0000 7f70717fa640 1 --2- 10.20.193.58:0/2638922944 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f707c13af30 0x7f707c13b300 secure :-1 s=READY pgs=71 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f706c00b450 tx=0x7f706c00b920 comp rx=0 tx=0).stop 2026-02-23T06:27:05.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.276+0000 7f70717fa640 1 -- 10.20.193.58:0/2638922944 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f707c13af30 msgr2=0x7f707c13b300 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:27:05.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.276+0000 7f70717fa640 1 --2- 10.20.193.58:0/2638922944 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f707c13af30 0x7f707c13b300 secure :-1 s=CLOSED pgs=71 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f706c00b450 tx=0x7f706c00b920 comp rx=0 tx=0).stop 2026-02-23T06:27:05.273 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.278+0000 7f7073fff640 1 --2- 10.20.193.58:0/2638922944 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f704c07a660 0x7f704c09ab10 secure :-1 s=READY pgs=207 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70640023d0 tx=0x7f706403e040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:05.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.280+0000 7f7081843640 1 --2- 10.20.193.58:0/2638922944 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f707c11bc90 0x7f707c11c060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:05.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.280+0000 7f7081843640 1 -- 10.20.193.58:0/2638922944 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f707c164250 con 0x7f707c11bc90 2026-02-23T06:27:05.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.280+0000 7f7080841640 1 --2- 10.20.193.58:0/2638922944 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f707c11bc90 0x7f707c11c060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:05.276 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.281+0000 7f7080841640 1 -- 10.20.193.58:0/2638922944 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f707c0b6d50 con 0x7f707c11bc90 2026-02-23T06:27:05.276 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.281+0000 7f7080841640 1 --2- 10.20.193.58:0/2638922944 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f707c11bc90 0x7f707c11c060 secure :-1 s=READY pgs=72 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f706c00bed0 tx=0x7f706c005a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:05.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.281+0000 7f70717fa640 1 -- 10.20.193.58:0/2638922944 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f706c01f070 con 0x7f707c11bc90 2026-02-23T06:27:05.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.281+0000 7f70717fa640 1 -- 10.20.193.58:0/2638922944 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5543 (secure 0 0 0) 0x7f706c010420 con 0x7f707c11bc90 2026-02-23T06:27:05.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.281+0000 7f70717fa640 1 -- 10.20.193.58:0/2638922944 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f707c11bc90 msgr2=0x7f707c11c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:05.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.281+0000 7f70717fa640 1 --2- 10.20.193.58:0/2638922944 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f707c11bc90 0x7f707c11c060 secure :-1 s=READY pgs=72 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f706c00bed0 tx=0x7f706c005a70 comp rx=0 tx=0).stop 2026-02-23T06:27:05.277 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:27:05.277 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:27:05.277 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:27:05.277 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:27:05.277 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 48, 2026-02-23T06:27:05.277 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 99793, 2026-02-23T06:27:05.277 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:27:05.277 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:27:05.277 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:27:05.278 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:05.278 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:27:05.278 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:27:05.278 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:27:05.278 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:27:05.278 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:05.278 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:05.278 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:05.278 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:05.278 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:05.278 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:05.278 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:05.278 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:05.278 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:05.278 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:05.278 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:05.278 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:05.278 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:05.278 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:05.279 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:27:05.279 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:27:05.279 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:05.279 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:05.279 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:05.279 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:05.279 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:05.279 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:05.279 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:05.279 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:05.279 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:05.279 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:05.279 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:05.279 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:05.279 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:05.279 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:05.279 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:05.279 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:27:05.279 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:27:05.279 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:27:05.279 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:27:05.279 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:27:05.280 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:27:05.280 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:27:05.280 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:27:05.280 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:27:05.280 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:27:05.280 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:27:05.280 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:27:05.280 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:27:05.280 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:27:05.280 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:27:05.280 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:27:05.280 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:27:05.280 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:05.280 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:05.280 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:05.280 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:05.280 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:05.280 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:05.280 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:05.280 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:05.280 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:05.281 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:05.281 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:05.281 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:05.281 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:05.281 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:05.281 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:27:05.281 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:05.281 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:27:05.281 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:05.281 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:27:05.281 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:27:05.281 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:05.281 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:05.281 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:05.281 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:05.281 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:27:05.281 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:05.281 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:05.281 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:05.281 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:05.281 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:27:05.282 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:05.282 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:05.282 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:05.282 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:05.282 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:27:05.282 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:27:05.282 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:05.282 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:05.282 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:27:05.282 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:05.282 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:05.282 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:05.282 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:27:05.282 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:27:05.282 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:05.282 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:05.282 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:05.282 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:05.283 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:27:05.283 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:05.283 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:05.283 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:05.283 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:05.283 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:27:05.283 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:05.283 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:05.283 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:05.283 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:05.283 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:27:05.283 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:27:05.283 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:05.283 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:05.283 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:27:05.283 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:05.283 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:05.283 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:05.283 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:27:05.283 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:27:05.284 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:05.284 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:05.284 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:05.284 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:05.284 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:27:05.284 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:05.284 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:05.284 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:05.284 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:05.284 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:27:05.284 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:05.284 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:05.284 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:05.284 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:05.284 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:27:05.284 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:27:05.284 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:05.284 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:05.284 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:27:05.284 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:05.284 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:05.284 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:05.285 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:05.285 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:27:05.285 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:27:05.285 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:05.285 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:05.285 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:05.285 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:27:05.285 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:05.285 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:05.285 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:27:05.285 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:05.285 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:05.285 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:05.285 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:27:05.285 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:05.285 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:05.285 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:27:05.285 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:05.285 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:05.285 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:05.285 INFO:teuthology.orchestra.run.trial058.stdout: "num": 7 2026-02-23T06:27:05.286 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:05.286 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:05.286 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:27:05.286 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:05.286 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:27:05.286 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:27:05.286 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:27:05.286 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:05.286 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:05.286 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:05.286 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:05.286 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:27:05.286 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:05.286 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:05.286 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:27:05.286 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:05.286 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:05.286 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:05.286 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:27:05.286 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:05.286 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:05.286 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:05.287 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:27:05.287 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:27:05.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.281+0000 7f70717fa640 1 -- 10.20.193.58:0/2638922944 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f707c11bc90 msgr2=0x7f707c11c060 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:27:05.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.281+0000 7f70717fa640 1 --2- 10.20.193.58:0/2638922944 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f707c11bc90 0x7f707c11c060 secure :-1 s=CLOSED pgs=72 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f706c00bed0 tx=0x7f706c005a70 comp rx=0 tx=0).stop 2026-02-23T06:27:05.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.282+0000 7f7081843640 1 -- 10.20.193.58:0/2638922944 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f704c07a660 msgr2=0x7f704c09ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:05.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.282+0000 7f7081843640 1 --2- 10.20.193.58:0/2638922944 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f704c07a660 0x7f704c09ab10 secure :-1 s=READY pgs=207 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70640023d0 tx=0x7f706403e040 comp rx=0 tx=0).stop 2026-02-23T06:27:05.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.282+0000 7f7081843640 1 -- 10.20.193.58:0/2638922944 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f707c15d870 msgr2=0x7f707c11b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:05.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.282+0000 7f7081843640 1 --2- 10.20.193.58:0/2638922944 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f707c15d870 0x7f707c11b1d0 secure :-1 s=READY pgs=70 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f707800f8d0 tx=0x7f707800fda0 comp rx=0 tx=0).stop 2026-02-23T06:27:05.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.282+0000 7f7081042640 1 -- 10.20.193.58:0/2638922944 reap_dead start 2026-02-23T06:27:05.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.282+0000 7f7081042640 1 -- 10.20.193.58:0/2638922944 reap_dead start 2026-02-23T06:27:05.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.283+0000 7f7081843640 1 -- 10.20.193.58:0/2638922944 shutdown_connections 2026-02-23T06:27:05.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.283+0000 7f7081843640 1 -- 10.20.193.58:0/2638922944 >> 10.20.193.58:0/2638922944 conn(0x7f707c0b3c20 msgr2=0x7f707c0b7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:05.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.283+0000 7f7081843640 1 -- 10.20.193.58:0/2638922944 shutdown_connections 2026-02-23T06:27:05.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:05.283+0000 7f7081843640 1 -- 10.20.193.58:0/2638922944 wait complete. 2026-02-23T06:27:05.291 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:27:05.292 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:27:12.512 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:27:12.516 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:27:25.292 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-23T06:27:25.292 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-23T06:27:25.292 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-23T06:27:25.292 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-23T06:27:25.296 INFO:tasks.ceph.mon.a:Started 2026-02-23T06:27:25.296 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:27:25.296 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:27:25.413 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.418+0000 7f9268bd2640 1 -- 10.20.193.58:0/3065755761 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f926415d870 msgr2=0x7f92640587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:25.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.418+0000 7f9268bd2640 1 --2- 10.20.193.58:0/3065755761 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f926415d870 0x7f92640587b0 secure :-1 s=READY pgs=74 gs=2 cs=0 l=1 c_cookie=15211459998246415592 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9254004740 tx=0x7f925402f1d0 comp rx=0 tx=0).stop 2026-02-23T06:27:25.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.418+0000 7f9268bd2640 1 -- 10.20.193.58:0/3065755761 shutdown_connections 2026-02-23T06:27:25.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.418+0000 7f9268bd2640 1 --2- 10.20.193.58:0/3065755761 >> v2:10.20.193.93:3300/0 conn(0x7f92640b6690 0x7f9264058cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:25.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.418+0000 7f9268bd2640 1 --2- 10.20.193.58:0/3065755761 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f926415d870 0x7f92640587b0 unknown :-1 s=CLOSED pgs=74 gs=2 cs=0 l=1 c_cookie=15211459998246415592 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:25.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.418+0000 7f9268bd2640 1 -- 10.20.193.58:0/3065755761 >> 10.20.193.58:0/3065755761 conn(0x7f92640b3c20 msgr2=0x7f92640b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:25.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.418+0000 7f9268bd2640 1 -- 10.20.193.58:0/3065755761 shutdown_connections 2026-02-23T06:27:25.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.418+0000 7f9268bd2640 1 -- 10.20.193.58:0/3065755761 wait complete. 2026-02-23T06:27:25.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.419+0000 7f9268bd2640 1 Processor -- start 2026-02-23T06:27:25.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.420+0000 7f9268bd2640 1 -- start start 2026-02-23T06:27:25.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.420+0000 7f9268bd2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92640b6690 0x7f926411bb90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:25.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.420+0000 7f9268bd2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f926415d4a0 0x7f9264148710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:25.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.420+0000 7f9268bd2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f926415d870 0x7f9264120770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:25.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.420+0000 7f9268bd2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f926411c610 con 0x7f926415d870 2026-02-23T06:27:25.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.420+0000 7f9268bd2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f926411cb40 con 0x7f92640b6690 2026-02-23T06:27:25.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.420+0000 7f9268bd2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f926411c860 con 0x7f926415d4a0 2026-02-23T06:27:25.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.420+0000 7f9262ffd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f926415d4a0 0x7f9264148710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:25.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.420+0000 7f9262ffd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f926415d4a0 0x7f9264148710 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:57998/0 (socket says 10.20.193.58:57998) 2026-02-23T06:27:25.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.420+0000 7f9262ffd640 1 -- 10.20.193.58:0/2780708535 learned_addr learned my addr 10.20.193.58:0/2780708535 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:27:25.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.421+0000 7f9263fff640 1 --2- 10.20.193.58:0/2780708535 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f926415d870 0x7f9264120770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:25.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.421+0000 7f92637fe640 1 --2- 10.20.193.58:0/2780708535 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92640b6690 0x7f926411bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:25.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.421+0000 7f9263fff640 1 -- 10.20.193.58:0/2780708535 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f926415d870 msgr2=0x7f9264120770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-23T06:27:25.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.421+0000 7f9263fff640 1 -- 10.20.193.58:0/2780708535 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f926415d870 msgr2=0x7f9264120770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:27:25.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.421+0000 7f9263fff640 1 --2- 10.20.193.58:0/2780708535 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f926415d870 0x7f9264120770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:27:25.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.421+0000 7f9263fff640 1 --2- 10.20.193.58:0/2780708535 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f926415d870 0x7f9264120770 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:27:25.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.421+0000 7f9262ffd640 1 -- 10.20.193.58:0/2780708535 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92640b6690 msgr2=0x7f926411bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:25.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.421+0000 7f9262ffd640 1 --2- 10.20.193.58:0/2780708535 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92640b6690 0x7f926411bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:25.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.421+0000 7f9262ffd640 1 -- 10.20.193.58:0/2780708535 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f926415d870 msgr2=0x7f9264120770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:27:25.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.421+0000 7f9262ffd640 1 --2- 10.20.193.58:0/2780708535 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f926415d870 0x7f9264120770 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:25.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.421+0000 7f9262ffd640 1 -- 10.20.193.58:0/2780708535 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92540094b0 con 0x7f926415d4a0 2026-02-23T06:27:25.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.421+0000 7f9262ffd640 1 --2- 10.20.193.58:0/2780708535 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f926415d4a0 0x7f9264148710 secure :-1 s=READY pgs=75 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9254009960 tx=0x7f9254002950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:25.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.421+0000 7f923ffff640 1 -- 10.20.193.58:0/2780708535 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f925403d770 con 0x7f926415d4a0 2026-02-23T06:27:25.421 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.421+0000 7f923ffff640 1 -- 10.20.193.58:0/2780708535 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f925403d9c0 con 0x7f926415d4a0 2026-02-23T06:27:25.421 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.421+0000 7f9268bd2640 1 -- 10.20.193.58:0/2780708535 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f926411d260 con 0x7f926415d4a0 2026-02-23T06:27:25.421 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.421+0000 7f923ffff640 1 -- 10.20.193.58:0/2780708535 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f925403dd90 con 0x7f926415d4a0 2026-02-23T06:27:25.421 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.422+0000 7f9268bd2640 1 -- 10.20.193.58:0/2780708535 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f926411d820 con 0x7f926415d4a0 2026-02-23T06:27:25.421 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.422+0000 7f9268bd2640 1 -- 10.20.193.58:0/2780708535 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f926411da40 con 0x7f926415d4a0 2026-02-23T06:27:25.421 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.423+0000 7f923ffff640 1 -- 10.20.193.58:0/2780708535 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f925406ab20 con 0x7f926415d4a0 2026-02-23T06:27:25.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.424+0000 7f923ffff640 1 --2- 10.20.193.58:0/2780708535 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f923407a6b0 0x7f923409ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:25.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.424+0000 7f923ffff640 1 -- 10.20.193.58:0/2780708535 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f92540c6d10 con 0x7f926415d4a0 2026-02-23T06:27:25.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.424+0000 7f92637fe640 1 --2- 10.20.193.58:0/2780708535 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f923407a6b0 0x7f923409ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:25.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.425+0000 7f92637fe640 1 --2- 10.20.193.58:0/2780708535 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f923407a6b0 0x7f923409ab60 secure :-1 s=READY pgs=209 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92500027d0 tx=0x7f9250007f40 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:25.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.425+0000 7f923ffff640 1 -- 10.20.193.58:0/2780708535 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f9254089ed0 con 0x7f926415d4a0 2026-02-23T06:27:25.575 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.580+0000 7f9268bd2640 1 -- 10.20.193.58:0/2780708535 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f92640b6d50 con 0x7f926415d4a0 2026-02-23T06:27:25.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.581+0000 7f923ffff640 1 -- 10.20.193.58:0/2780708535 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1754 (secure 0 0 0) 0x7f925408cff0 con 0x7f926415d4a0 2026-02-23T06:27:25.576 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:27:25.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.582+0000 7f9268bd2640 1 -- 10.20.193.58:0/2780708535 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f923407a6b0 msgr2=0x7f923409ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:25.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.582+0000 7f9268bd2640 1 --2- 10.20.193.58:0/2780708535 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f923407a6b0 0x7f923409ab60 secure :-1 s=READY pgs=209 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92500027d0 tx=0x7f9250007f40 comp rx=0 tx=0).stop 2026-02-23T06:27:25.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.582+0000 7f9268bd2640 1 -- 10.20.193.58:0/2780708535 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f926415d4a0 msgr2=0x7f9264148710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:25.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.582+0000 7f9268bd2640 1 --2- 10.20.193.58:0/2780708535 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f926415d4a0 0x7f9264148710 secure :-1 s=READY pgs=75 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9254009960 tx=0x7f9254002950 comp rx=0 tx=0).stop 2026-02-23T06:27:25.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.582+0000 7f9268bd2640 1 -- 10.20.193.58:0/2780708535 shutdown_connections 2026-02-23T06:27:25.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.582+0000 7f9268bd2640 1 --2- 10.20.193.58:0/2780708535 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f923407a6b0 0x7f923409ab60 unknown :-1 s=CLOSED pgs=209 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:25.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.582+0000 7f9268bd2640 1 --2- 10.20.193.58:0/2780708535 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f926415d870 0x7f9264120770 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:25.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.582+0000 7f9268bd2640 1 --2- 10.20.193.58:0/2780708535 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f926415d4a0 0x7f9264148710 unknown :-1 s=CLOSED pgs=75 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:25.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.582+0000 7f9268bd2640 1 --2- 10.20.193.58:0/2780708535 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92640b6690 0x7f926411bb90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:25.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.582+0000 7f9268bd2640 1 -- 10.20.193.58:0/2780708535 >> 10.20.193.58:0/2780708535 conn(0x7f92640b3c20 msgr2=0x7f926415b460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:25.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.582+0000 7f9268bd2640 1 -- 10.20.193.58:0/2780708535 shutdown_connections 2026-02-23T06:27:25.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.582+0000 7f9268bd2640 1 -- 10.20.193.58:0/2780708535 wait complete. 2026-02-23T06:27:25.589 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:27:25.589 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:27:25.589 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:27:25.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.715+0000 7f0a3a8c3640 1 -- 10.20.193.58:0/3849930726 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0a3415d4a0 msgr2=0x7f0a340affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:25.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.715+0000 7f0a3a8c3640 1 --2- 10.20.193.58:0/3849930726 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0a3415d4a0 0x7f0a340affb0 secure :-1 s=READY pgs=3 gs=2 cs=0 l=1 c_cookie=3587486502199589481 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a24005e70 tx=0x7f0a2402f290 comp rx=0 tx=0).stop 2026-02-23T06:27:25.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.715+0000 7f0a3a8c3640 1 -- 10.20.193.58:0/3849930726 shutdown_connections 2026-02-23T06:27:25.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.715+0000 7f0a3a8c3640 1 --2- 10.20.193.58:0/3849930726 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0a340b6690 0x7f0a34058ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:25.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.715+0000 7f0a3a8c3640 1 --2- 10.20.193.58:0/3849930726 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0a3415d4a0 0x7f0a340affb0 unknown :-1 s=CLOSED pgs=3 gs=2 cs=0 l=1 c_cookie=3587486502199589481 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:25.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.715+0000 7f0a3a8c3640 1 -- 10.20.193.58:0/3849930726 >> 10.20.193.58:0/3849930726 conn(0x7f0a340b3c20 msgr2=0x7f0a340b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:25.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.716+0000 7f0a3a8c3640 1 -- 10.20.193.58:0/3849930726 shutdown_connections 2026-02-23T06:27:25.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.716+0000 7f0a3a8c3640 1 -- 10.20.193.58:0/3849930726 wait complete. 2026-02-23T06:27:25.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.717+0000 7f0a3a8c3640 1 Processor -- start 2026-02-23T06:27:25.712 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.717+0000 7f0a3a8c3640 1 -- start start 2026-02-23T06:27:25.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.717+0000 7f0a3a8c3640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0a340b6690 0x7f0a3414de70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:25.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.717+0000 7f0a3a8c3640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0a3415d4a0 0x7f0a3414a8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:25.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.717+0000 7f0a3a8c3640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0a3415d870 0x7f0a34122580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:25.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.717+0000 7f0a3a8c3640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f0a34057900 con 0x7f0a3415d4a0 2026-02-23T06:27:25.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.717+0000 7f0a3a8c3640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3414a460 con 0x7f0a3415d870 2026-02-23T06:27:25.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.717+0000 7f0a3a8c3640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f0a3414ae30 con 0x7f0a340b6690 2026-02-23T06:27:25.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.718+0000 7f0a398c1640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0a340b6690 0x7f0a3414de70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:25.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.718+0000 7f0a390c0640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0a3415d4a0 0x7f0a3414a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:25.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.718+0000 7f0a3a0c2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0a3415d870 0x7f0a34122580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:25.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.718+0000 7f0a398c1640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0a340b6690 0x7f0a3414de70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:58022/0 (socket says 10.20.193.58:58022) 2026-02-23T06:27:25.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.718+0000 7f0a398c1640 1 -- 10.20.193.58:0/115346797 learned_addr learned my addr 10.20.193.58:0/115346797 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:27:25.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.718+0000 7f0a398c1640 1 -- 10.20.193.58:0/115346797 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0a3415d870 msgr2=0x7f0a34122580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:25.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.718+0000 7f0a398c1640 1 --2- 10.20.193.58:0/115346797 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0a3415d870 0x7f0a34122580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:25.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.718+0000 7f0a398c1640 1 -- 10.20.193.58:0/115346797 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0a3415d4a0 msgr2=0x7f0a3414a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:25.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.718+0000 7f0a398c1640 1 --2- 10.20.193.58:0/115346797 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0a3415d4a0 0x7f0a3414a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:25.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.718+0000 7f0a398c1640 1 -- 10.20.193.58:0/115346797 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a24009570 con 0x7f0a340b6690 2026-02-23T06:27:25.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.718+0000 7f0a398c1640 1 --2- 10.20.193.58:0/115346797 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0a340b6690 0x7f0a3414de70 secure :-1 s=READY pgs=77 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a24004740 tx=0x7f0a240028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:25.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.718+0000 7f0a227fc640 1 -- 10.20.193.58:0/115346797 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0a2403d070 con 0x7f0a340b6690 2026-02-23T06:27:25.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.719+0000 7f0a227fc640 1 -- 10.20.193.58:0/115346797 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a24038470 con 0x7f0a340b6690 2026-02-23T06:27:25.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.719+0000 7f0a3a8c3640 1 -- 10.20.193.58:0/115346797 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a34149e70 con 0x7f0a340b6690 2026-02-23T06:27:25.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.719+0000 7f0a227fc640 1 -- 10.20.193.58:0/115346797 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0a240388a0 con 0x7f0a340b6690 2026-02-23T06:27:25.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.719+0000 7f0a3a8c3640 1 -- 10.20.193.58:0/115346797 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a34057e30 con 0x7f0a340b6690 2026-02-23T06:27:25.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.719+0000 7f0a3a8c3640 1 --2- 10.20.193.58:0/115346797 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0a3414a050 0x7f0a34122ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:25.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.719+0000 7f0a3a8c3640 1 -- 10.20.193.58:0/115346797 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f0a340b6330 con 0x7f0a3414a050 2026-02-23T06:27:25.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.720+0000 7f0a390c0640 1 --2- 10.20.193.58:0/115346797 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0a3414a050 0x7f0a34122ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:25.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.720+0000 7f0a227fc640 1 -- 10.20.193.58:0/115346797 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f0a24038a00 con 0x7f0a340b6690 2026-02-23T06:27:25.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.721+0000 7f0a390c0640 1 -- 10.20.193.58:0/115346797 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0a340b5e10 con 0x7f0a3414a050 2026-02-23T06:27:25.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.721+0000 7f0a390c0640 1 --2- 10.20.193.58:0/115346797 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0a3414a050 0x7f0a34122ac0 secure :-1 s=READY pgs=4 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a34142410 tx=0x7f0a2800eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:25.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.721+0000 7f0a227fc640 1 --2- 10.20.193.58:0/115346797 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0a0407a740 0x7f0a0409abf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:25.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.721+0000 7f0a227fc640 1 -- 10.20.193.58:0/115346797 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f0a240c2200 con 0x7f0a340b6690 2026-02-23T06:27:25.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.722+0000 7f0a227fc640 1 -- 10.20.193.58:0/115346797 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0a2800c880 con 0x7f0a3414a050 2026-02-23T06:27:25.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.722+0000 7f0a227fc640 1 -- 10.20.193.58:0/115346797 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f0a2800c9e0 con 0x7f0a3414a050 2026-02-23T06:27:25.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.722+0000 7f0a227fc640 1 -- 10.20.193.58:0/115346797 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0a3414a050 msgr2=0x7f0a34122ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:25.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.722+0000 7f0a227fc640 1 --2- 10.20.193.58:0/115346797 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0a3414a050 0x7f0a34122ac0 secure :-1 s=READY pgs=4 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a34142410 tx=0x7f0a2800eba0 comp rx=0 tx=0).stop 2026-02-23T06:27:25.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.722+0000 7f0a227fc640 1 -- 10.20.193.58:0/115346797 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0a3414a050 msgr2=0x7f0a34122ac0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:27:25.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.722+0000 7f0a227fc640 1 --2- 10.20.193.58:0/115346797 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0a3414a050 0x7f0a34122ac0 secure :-1 s=CLOSED pgs=4 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a34142410 tx=0x7f0a2800eba0 comp rx=0 tx=0).stop 2026-02-23T06:27:25.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.722+0000 7f0a3a0c2640 1 --2- 10.20.193.58:0/115346797 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0a0407a740 0x7f0a0409abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:25.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.722+0000 7f0a3a0c2640 1 --2- 10.20.193.58:0/115346797 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0a0407a740 0x7f0a0409abf0 secure :-1 s=READY pgs=210 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a30005820 tx=0x7f0a3000a310 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:25.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.725+0000 7f0a3a8c3640 1 --2- 10.20.193.58:0/115346797 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0a3413a530 0x7f0a34160f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:25.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.725+0000 7f0a3a8c3640 1 -- 10.20.193.58:0/115346797 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f0a34164250 con 0x7f0a3413a530 2026-02-23T06:27:25.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.725+0000 7f0a390c0640 1 --2- 10.20.193.58:0/115346797 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0a3413a530 0x7f0a34160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:25.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.725+0000 7f0a390c0640 1 -- 10.20.193.58:0/115346797 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0a34058050 con 0x7f0a3413a530 2026-02-23T06:27:25.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.726+0000 7f0a390c0640 1 --2- 10.20.193.58:0/115346797 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0a3413a530 0x7f0a34160f90 secure :-1 s=READY pgs=5 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a28017040 tx=0x7f0a280026a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:25.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.726+0000 7f0a227fc640 1 -- 10.20.193.58:0/115346797 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0a28015430 con 0x7f0a3413a530 2026-02-23T06:27:25.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.726+0000 7f0a227fc640 1 -- 10.20.193.58:0/115346797 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4910 (secure 0 0 0) 0x7f0a28023070 con 0x7f0a3413a530 2026-02-23T06:27:25.721 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:27:25.721 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:27:25.721 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:27:25.721 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:27:25.721 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 52, 2026-02-23T06:27:25.721 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 310, 2026-02-23T06:27:25.722 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:27:25.722 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:27:25.722 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:27:25.722 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:27:25.722 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:25.722 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:27:25.722 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:27:25.722 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:27:25.722 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:27:25.722 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:25.722 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:25.722 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:25.722 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:25.722 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:25.722 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:25.722 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:25.722 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:25.722 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:25.722 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:25.722 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:25.722 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:25.723 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:25.723 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:25.723 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:27:25.723 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:27:25.723 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:25.723 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:25.723 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:25.723 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:25.723 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:25.723 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:25.723 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:25.723 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:25.723 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:25.723 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:25.723 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:25.723 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:25.723 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:25.724 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:25.724 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:25.724 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:27:25.724 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:27:25.724 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:27:25.724 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:27:25.724 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:27:25.724 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:27:25.724 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:27:25.724 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:27:25.724 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:27:25.724 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:27:25.724 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:27:25.724 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:27:25.724 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:27:25.724 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:27:25.724 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:27:25.724 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:27:25.724 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:27:25.724 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:25.724 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:25.725 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:25.725 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:25.725 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:25.725 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:25.725 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:25.725 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:25.725 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:25.725 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:25.725 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:25.725 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:25.725 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:25.725 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:25.725 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:27:25.725 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:25.725 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:27:25.725 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:25.725 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:27:25.725 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:27:25.725 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:25.725 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:25.725 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:25.725 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:25.726 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:27:25.726 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:25.726 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:25.726 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:25.726 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:25.726 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:27:25.726 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:25.726 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:25.726 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:25.726 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:25.726 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:27:25.726 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:27:25.726 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:25.726 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:25.726 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:27:25.726 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:25.726 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:25.726 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:25.726 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:27:25.726 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:27:25.726 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:25.727 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:25.727 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:25.727 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:25.727 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:27:25.727 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:25.727 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:25.727 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:25.727 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:25.727 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:27:25.727 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:25.727 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:25.727 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:25.727 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:25.727 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:27:25.727 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:27:25.727 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:25.727 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:25.727 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:27:25.727 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:25.727 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:25.727 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:25.727 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:27:25.728 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:27:25.728 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:25.728 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:25.728 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:25.728 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:25.728 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:27:25.728 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:25.728 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:25.728 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:25.728 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:25.728 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:27:25.728 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:25.728 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:25.728 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:25.728 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:25.728 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:27:25.728 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:27:25.728 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:25.728 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:25.728 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:27:25.728 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:25.728 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:25.729 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:25.729 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:25.729 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:27:25.729 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:27:25.729 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:25.729 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:25.729 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:25.729 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:27:25.729 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:25.729 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:25.729 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:27:25.729 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:25.729 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:25.729 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:25.729 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:27:25.729 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:25.729 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:25.729 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:25.729 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:27:25.729 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:27:25.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.726+0000 7f0a227fc640 1 -- 10.20.193.58:0/115346797 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0a3413a530 msgr2=0x7f0a34160f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:25.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.726+0000 7f0a227fc640 1 --2- 10.20.193.58:0/115346797 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0a3413a530 0x7f0a34160f90 secure :-1 s=READY pgs=5 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a28017040 tx=0x7f0a280026a0 comp rx=0 tx=0).stop 2026-02-23T06:27:25.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.726+0000 7f0a227fc640 1 -- 10.20.193.58:0/115346797 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0a3413a530 msgr2=0x7f0a34160f90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:27:25.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.726+0000 7f0a227fc640 1 --2- 10.20.193.58:0/115346797 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0a3413a530 0x7f0a34160f90 unknown :-1 s=CLOSED pgs=5 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:25.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.726+0000 7f0a3a8c3640 1 -- 10.20.193.58:0/115346797 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0a0407a740 msgr2=0x7f0a0409abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:25.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.726+0000 7f0a3a8c3640 1 --2- 10.20.193.58:0/115346797 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0a0407a740 0x7f0a0409abf0 secure :-1 s=READY pgs=210 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a30005820 tx=0x7f0a3000a310 comp rx=0 tx=0).stop 2026-02-23T06:27:25.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.726+0000 7f0a3a8c3640 1 -- 10.20.193.58:0/115346797 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0a340b6690 msgr2=0x7f0a3414de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:25.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.726+0000 7f0a3a8c3640 1 --2- 10.20.193.58:0/115346797 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0a340b6690 0x7f0a3414de70 secure :-1 s=READY pgs=77 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a24004740 tx=0x7f0a240028d0 comp rx=0 tx=0).stop 2026-02-23T06:27:25.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.726+0000 7f0a3a0c2640 1 -- 10.20.193.58:0/115346797 reap_dead start 2026-02-23T06:27:25.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.726+0000 7f0a3a0c2640 1 -- 10.20.193.58:0/115346797 reap_dead start 2026-02-23T06:27:25.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.727+0000 7f0a3a8c3640 1 -- 10.20.193.58:0/115346797 shutdown_connections 2026-02-23T06:27:25.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.727+0000 7f0a3a8c3640 1 -- 10.20.193.58:0/115346797 >> 10.20.193.58:0/115346797 conn(0x7f0a340b3c20 msgr2=0x7f0a340b7480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:25.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.727+0000 7f0a3a8c3640 1 -- 10.20.193.58:0/115346797 shutdown_connections 2026-02-23T06:27:25.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.727+0000 7f0a3a8c3640 1 -- 10.20.193.58:0/115346797 wait complete. 2026-02-23T06:27:25.731 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:27:25.731 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:27:25.732 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:27:25.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.858+0000 7f52b6525640 1 -- 10.20.193.58:0/2696952288 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f52b015d4a0 msgr2=0x7f52b00affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:25.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.858+0000 7f52b6525640 1 --2- 10.20.193.58:0/2696952288 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f52b015d4a0 0x7f52b00affb0 secure :-1 s=READY pgs=78 gs=3 cs=0 l=1 c_cookie=12379859559684417554 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52a0009890 tx=0x7f52a002f200 comp rx=0 tx=0).stop 2026-02-23T06:27:25.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.858+0000 7f52b6525640 1 -- 10.20.193.58:0/2696952288 shutdown_connections 2026-02-23T06:27:25.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.858+0000 7f52b6525640 1 --2- 10.20.193.58:0/2696952288 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f52b015d4a0 0x7f52b00affb0 unknown :-1 s=CLOSED pgs=78 gs=3 cs=0 l=1 c_cookie=12379859559684417554 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:25.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.858+0000 7f52b6525640 1 -- 10.20.193.58:0/2696952288 >> 10.20.193.58:0/2696952288 conn(0x7f52b00b3c20 msgr2=0x7f52b00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:25.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.858+0000 7f52b6525640 1 -- 10.20.193.58:0/2696952288 shutdown_connections 2026-02-23T06:27:25.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.858+0000 7f52b6525640 1 -- 10.20.193.58:0/2696952288 wait complete. 2026-02-23T06:27:25.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.860+0000 7f52b6525640 1 Processor -- start 2026-02-23T06:27:25.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.860+0000 7f52b6525640 1 -- start start 2026-02-23T06:27:25.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.860+0000 7f52b6525640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f52b00b6690 0x7f52b013e370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:25.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.860+0000 7f52b6525640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52b015d4a0 0x7f52b011ae30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:25.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.860+0000 7f52b6525640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f52b015d870 0x7f52b011b370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:25.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.860+0000 7f52b6525640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f52b0162db0 con 0x7f52b015d870 2026-02-23T06:27:25.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.860+0000 7f52b6525640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f52b01631d0 con 0x7f52b015d4a0 2026-02-23T06:27:25.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.860+0000 7f52b6525640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f52b013ede0 con 0x7f52b00b6690 2026-02-23T06:27:25.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.861+0000 7f52b5523640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f52b00b6690 0x7f52b013e370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:25.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.861+0000 7f52b5523640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f52b00b6690 0x7f52b013e370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:58042/0 (socket says 10.20.193.58:58042) 2026-02-23T06:27:25.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.861+0000 7f52b5523640 1 -- 10.20.193.58:0/2019488339 learned_addr learned my addr 10.20.193.58:0/2019488339 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:27:25.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.861+0000 7f52b5d24640 1 --2- 10.20.193.58:0/2019488339 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f52b015d870 0x7f52b011b370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:25.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.861+0000 7f52b4d22640 1 --2- 10.20.193.58:0/2019488339 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52b015d4a0 0x7f52b011ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:25.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.861+0000 7f52b5523640 1 -- 10.20.193.58:0/2019488339 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52b015d4a0 msgr2=0x7f52b011ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:25.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.861+0000 7f52b5523640 1 --2- 10.20.193.58:0/2019488339 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52b015d4a0 0x7f52b011ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:25.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.861+0000 7f52b5523640 1 -- 10.20.193.58:0/2019488339 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f52b015d870 msgr2=0x7f52b011b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:25.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.861+0000 7f52b5523640 1 --2- 10.20.193.58:0/2019488339 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f52b015d870 0x7f52b011b370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:25.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.861+0000 7f52b5523640 1 -- 10.20.193.58:0/2019488339 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52a00094b0 con 0x7f52b00b6690 2026-02-23T06:27:25.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.861+0000 7f52b5523640 1 --2- 10.20.193.58:0/2019488339 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f52b00b6690 0x7f52b013e370 secure :-1 s=READY pgs=79 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52a0009990 tx=0x7f52a0002950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:25.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.861+0000 7f529dffb640 1 -- 10.20.193.58:0/2019488339 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f52a0005d40 con 0x7f52b00b6690 2026-02-23T06:27:25.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.861+0000 7f529dffb640 1 -- 10.20.193.58:0/2019488339 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52a0038560 con 0x7f52b00b6690 2026-02-23T06:27:25.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.861+0000 7f529dffb640 1 -- 10.20.193.58:0/2019488339 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f52a0038970 con 0x7f52b00b6690 2026-02-23T06:27:25.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.861+0000 7f52b6525640 1 -- 10.20.193.58:0/2019488339 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b0057ca0 con 0x7f52b00b6690 2026-02-23T06:27:25.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.862+0000 7f52b6525640 1 -- 10.20.193.58:0/2019488339 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b01626f0 con 0x7f52b00b6690 2026-02-23T06:27:25.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.862+0000 7f527f7fe640 1 --2- 10.20.193.58:0/2019488339 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f526c0041f0 0x7f526c0246a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:25.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.862+0000 7f527f7fe640 1 -- 10.20.193.58:0/2019488339 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f526c025f20 con 0x7f526c0041f0 2026-02-23T06:27:25.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.862+0000 7f52b4d22640 1 --2- 10.20.193.58:0/2019488339 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f526c0041f0 0x7f526c0246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:25.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.863+0000 7f52b4d22640 1 -- 10.20.193.58:0/2019488339 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f526c0260e0 con 0x7f526c0041f0 2026-02-23T06:27:25.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.863+0000 7f52b4d22640 1 --2- 10.20.193.58:0/2019488339 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f526c0041f0 0x7f526c0246a0 secure :-1 s=READY pgs=43 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52b013c9f0 tx=0x7f52a400fc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:25.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.863+0000 7f529dffb640 1 -- 10.20.193.58:0/2019488339 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f52a400dab0 con 0x7f526c0041f0 2026-02-23T06:27:25.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.863+0000 7f529dffb640 1 -- 10.20.193.58:0/2019488339 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f52a400fe10 con 0x7f526c0041f0 2026-02-23T06:27:25.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.863+0000 7f529dffb640 1 -- 10.20.193.58:0/2019488339 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f526c0041f0 msgr2=0x7f526c0246a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:25.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.863+0000 7f529dffb640 1 --2- 10.20.193.58:0/2019488339 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f526c0041f0 0x7f526c0246a0 secure :-1 s=READY pgs=43 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52b013c9f0 tx=0x7f52a400fc10 comp rx=0 tx=0).stop 2026-02-23T06:27:25.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.863+0000 7f529dffb640 1 -- 10.20.193.58:0/2019488339 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f526c0041f0 msgr2=0x7f526c0246a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:27:25.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.863+0000 7f529dffb640 1 --2- 10.20.193.58:0/2019488339 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f526c0041f0 0x7f526c0246a0 unknown :-1 s=CLOSED pgs=43 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:25.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.863+0000 7f529dffb640 1 -- 10.20.193.58:0/2019488339 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f52a0038ad0 con 0x7f52b00b6690 2026-02-23T06:27:25.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.864+0000 7f529dffb640 1 --2- 10.20.193.58:0/2019488339 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f528007a3c0 0x7f528009a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:25.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.865+0000 7f529dffb640 1 -- 10.20.193.58:0/2019488339 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f52a00c2890 con 0x7f52b00b6690 2026-02-23T06:27:25.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.865+0000 7f52b4d22640 1 --2- 10.20.193.58:0/2019488339 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f528007a3c0 0x7f528009a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:25.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.865+0000 7f52b4d22640 1 --2- 10.20.193.58:0/2019488339 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f528007a3c0 0x7f528009a870 secure :-1 s=READY pgs=211 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52b013c9f0 tx=0x7f52a4009030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:25.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.867+0000 7f527f7fe640 1 --2- 10.20.193.58:0/2019488339 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f526c025080 0x7f526c025500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:25.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.867+0000 7f527f7fe640 1 -- 10.20.193.58:0/2019488339 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f526c025a70 con 0x7f526c025080 2026-02-23T06:27:25.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.867+0000 7f52b5d24640 1 --2- 10.20.193.58:0/2019488339 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f526c025080 0x7f526c025500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:25.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.867+0000 7f52b5d24640 1 -- 10.20.193.58:0/2019488339 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f526c025c30 con 0x7f526c025080 2026-02-23T06:27:25.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.867+0000 7f52b5d24640 1 --2- 10.20.193.58:0/2019488339 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f526c025080 0x7f526c025500 secure :-1 s=READY pgs=44 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52ac003780 tx=0x7f52ac00ff10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:25.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.867+0000 7f529dffb640 1 -- 10.20.193.58:0/2019488339 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f52ac01a070 con 0x7f526c025080 2026-02-23T06:27:25.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.868+0000 7f529dffb640 1 -- 10.20.193.58:0/2019488339 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5244 (secure 0 0 0) 0x7f52ac00d970 con 0x7f526c025080 2026-02-23T06:27:25.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.868+0000 7f529dffb640 1 -- 10.20.193.58:0/2019488339 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f526c025080 msgr2=0x7f526c025500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:25.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.868+0000 7f529dffb640 1 --2- 10.20.193.58:0/2019488339 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f526c025080 0x7f526c025500 secure :-1 s=READY pgs=44 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52ac003780 tx=0x7f52ac00ff10 comp rx=0 tx=0).stop 2026-02-23T06:27:25.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.868+0000 7f529dffb640 1 -- 10.20.193.58:0/2019488339 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f526c025080 msgr2=0x7f526c025500 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:27:25.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.868+0000 7f529dffb640 1 --2- 10.20.193.58:0/2019488339 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f526c025080 0x7f526c025500 unknown :-1 s=CLOSED pgs=44 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:25.863 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:27:25.864 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:27:25.864 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:27:25.864 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:27:25.864 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 52, 2026-02-23T06:27:25.864 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 47379, 2026-02-23T06:27:25.864 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:27:25.864 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:27:25.864 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:27:25.864 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:27:25.864 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:25.864 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:27:25.865 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:27:25.865 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:27:25.865 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:27:25.865 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:25.865 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:25.865 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:25.865 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:25.865 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:25.865 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:25.865 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:25.865 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:25.865 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:25.865 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:25.866 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:25.866 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:25.866 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:25.866 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:25.866 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:27:25.866 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:27:25.866 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:25.866 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:25.866 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:25.866 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:25.866 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:25.866 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:25.866 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:25.867 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:25.867 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:25.867 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:25.867 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:25.867 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:25.867 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:25.867 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:25.867 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:25.867 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:27:25.867 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:27:25.867 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:27:25.867 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:27:25.867 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:27:25.867 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:27:25.868 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:27:25.868 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:27:25.868 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:27:25.868 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:27:25.868 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:27:25.868 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:27:25.868 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:27:25.868 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:27:25.868 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:27:25.868 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:27:25.868 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:27:25.868 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:25.868 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:25.868 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:25.869 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:25.869 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:25.869 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:25.869 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:25.869 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:25.869 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:25.869 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:25.869 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:25.869 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:25.869 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:25.869 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:25.869 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:27:25.869 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:25.869 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:27:25.870 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:25.870 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:27:25.870 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:27:25.870 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:25.870 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:25.870 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:25.870 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:25.870 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:27:25.870 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:25.870 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:25.870 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:25.870 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:25.870 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:27:25.871 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:25.871 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:25.871 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:25.871 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:25.871 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:27:25.871 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:27:25.871 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:25.871 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:25.871 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:27:25.871 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:25.871 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:25.871 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:25.871 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:27:25.871 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:27:25.871 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:25.871 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:25.872 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:25.872 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:25.872 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:27:25.872 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:25.872 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:25.872 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:25.872 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:25.872 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:27:25.872 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:25.872 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:25.872 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:25.872 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:25.872 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:27:25.872 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:27:25.872 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:25.873 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:25.873 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:27:25.873 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:25.873 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:25.873 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:25.873 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:27:25.873 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:27:25.873 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:25.873 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:25.873 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:25.873 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:25.873 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:27:25.873 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:25.873 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:25.873 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:25.873 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:25.874 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:27:25.874 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:25.874 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:25.874 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:25.874 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:25.874 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:27:25.874 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:27:25.874 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:25.874 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:25.874 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:27:25.874 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:25.874 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:25.874 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:25.874 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:25.874 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:27:25.874 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:27:25.874 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:25.875 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:25.875 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:25.875 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:27:25.875 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:25.875 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:25.875 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:27:25.875 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:25.875 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:25.875 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:25.875 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:27:25.875 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:25.875 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:25.875 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:27:25.875 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:25.875 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:25.875 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:25.875 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:27:25.876 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:25.876 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:25.876 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:27:25.876 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:25.876 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:25.876 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:25.876 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:27:25.876 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:25.876 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:25.876 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:25.876 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:27:25.876 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:27:25.877 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.868+0000 7f527f7fe640 1 -- 10.20.193.58:0/2019488339 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f528007a3c0 msgr2=0x7f528009a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:25.877 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.868+0000 7f527f7fe640 1 --2- 10.20.193.58:0/2019488339 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f528007a3c0 0x7f528009a870 secure :-1 s=READY pgs=211 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52b013c9f0 tx=0x7f52a4009030 comp rx=0 tx=0).stop 2026-02-23T06:27:25.877 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.868+0000 7f527f7fe640 1 -- 10.20.193.58:0/2019488339 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f52b00b6690 msgr2=0x7f52b013e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:25.877 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.868+0000 7f527f7fe640 1 --2- 10.20.193.58:0/2019488339 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f52b00b6690 0x7f52b013e370 secure :-1 s=READY pgs=79 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52a0009990 tx=0x7f52a0002950 comp rx=0 tx=0).stop 2026-02-23T06:27:25.878 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.868+0000 7f52b5d24640 1 -- 10.20.193.58:0/2019488339 reap_dead start 2026-02-23T06:27:25.878 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.868+0000 7f52b5d24640 1 -- 10.20.193.58:0/2019488339 reap_dead start 2026-02-23T06:27:25.878 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.868+0000 7f527f7fe640 1 -- 10.20.193.58:0/2019488339 shutdown_connections 2026-02-23T06:27:25.878 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.868+0000 7f527f7fe640 1 -- 10.20.193.58:0/2019488339 >> 10.20.193.58:0/2019488339 conn(0x7f52b00b3c20 msgr2=0x7f52b00b76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:25.878 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.868+0000 7f527f7fe640 1 -- 10.20.193.58:0/2019488339 shutdown_connections 2026-02-23T06:27:25.878 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:25.868+0000 7f527f7fe640 1 -- 10.20.193.58:0/2019488339 wait complete. 2026-02-23T06:27:25.878 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:27:25.878 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:27:25.878 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:27:26.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.006+0000 7fa5c703a640 1 -- 10.20.193.58:0/3341598623 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5a8003a80 msgr2=0x7fa5a8003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:26.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.006+0000 7fa5c703a640 1 --2- 10.20.193.58:0/3341598623 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5a8003a80 0x7fa5a8003e90 secure :-1 s=READY pgs=8 gs=4 cs=0 l=1 c_cookie=4744154145788785015 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5b0009b70 tx=0x7fa5b002fc30 comp rx=0 tx=0).stop 2026-02-23T06:27:26.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.006+0000 7fa5c6839640 1 -- 10.20.193.58:0/3341598623 reap_dead start 2026-02-23T06:27:26.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.006+0000 7fa5c703a640 1 -- 10.20.193.58:0/3341598623 shutdown_connections 2026-02-23T06:27:26.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.006+0000 7fa5c703a640 1 -- 10.20.193.58:0/3341598623 >> 10.20.193.58:0/3341598623 conn(0x7fa5c00b3c20 msgr2=0x7fa5c00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:26.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.006+0000 7fa5c703a640 1 -- 10.20.193.58:0/3341598623 shutdown_connections 2026-02-23T06:27:26.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.006+0000 7fa5c703a640 1 -- 10.20.193.58:0/3341598623 wait complete. 2026-02-23T06:27:26.005 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.007+0000 7fa5c703a640 1 Processor -- start 2026-02-23T06:27:26.005 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.007+0000 7fa5c703a640 1 -- start start 2026-02-23T06:27:26.005 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.008+0000 7fa5c703a640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa5c01611c0 0x7fa5c0161590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:26.005 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.008+0000 7fa5c703a640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5c0160700 0x7fa5c013cea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:26.005 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.008+0000 7fa5c703a640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5c015e2c0 0x7fa5c015e760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:26.005 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.008+0000 7fa5c703a640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c011f540 con 0x7fa5c015e2c0 2026-02-23T06:27:26.006 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.008+0000 7fa5c703a640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c015f5a0 con 0x7fa5c01611c0 2026-02-23T06:27:26.006 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.008+0000 7fa5c703a640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa5c013ecf0 con 0x7fa5c0160700 2026-02-23T06:27:26.006 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.008+0000 7fa5c6839640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5c015e2c0 0x7fa5c015e760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:26.006 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.008+0000 7fa5c6839640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5c015e2c0 0x7fa5c015e760 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:58932/0 (socket says 10.20.193.58:58932) 2026-02-23T06:27:26.006 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.008+0000 7fa5c6839640 1 -- 10.20.193.58:0/3435801736 learned_addr learned my addr 10.20.193.58:0/3435801736 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:27:26.006 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.008+0000 7fa5c6038640 1 --2- 10.20.193.58:0/3435801736 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa5c01611c0 0x7fa5c0161590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:26.006 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.008+0000 7fa5c5837640 1 --2- 10.20.193.58:0/3435801736 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5c0160700 0x7fa5c013cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:26.006 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.009+0000 7fa5c6839640 1 -- 10.20.193.58:0/3435801736 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5c0160700 msgr2=0x7fa5c013cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:26.006 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.009+0000 7fa5c6839640 1 --2- 10.20.193.58:0/3435801736 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5c0160700 0x7fa5c013cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:26.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.009+0000 7fa5c6839640 1 -- 10.20.193.58:0/3435801736 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa5c01611c0 msgr2=0x7fa5c0161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:26.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.009+0000 7fa5c6839640 1 --2- 10.20.193.58:0/3435801736 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa5c01611c0 0x7fa5c0161590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:26.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.009+0000 7fa5c6839640 1 -- 10.20.193.58:0/3435801736 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c0162ad0 con 0x7fa5c015e2c0 2026-02-23T06:27:26.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.009+0000 7fa5c6839640 1 --2- 10.20.193.58:0/3435801736 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5c015e2c0 0x7fa5c015e760 secure :-1 s=READY pgs=9 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5bc004810 tx=0x7fa5bc00f6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:26.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.009+0000 7fa5a6ffd640 1 -- 10.20.193.58:0/3435801736 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5bc012460 con 0x7fa5c015e2c0 2026-02-23T06:27:26.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.009+0000 7fa5a6ffd640 1 -- 10.20.193.58:0/3435801736 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa5bc0126b0 con 0x7fa5c015e2c0 2026-02-23T06:27:26.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.009+0000 7fa5a6ffd640 1 -- 10.20.193.58:0/3435801736 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5bc012ae0 con 0x7fa5c015e2c0 2026-02-23T06:27:26.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.009+0000 7fa5c703a640 1 -- 10.20.193.58:0/3435801736 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5c0162db0 con 0x7fa5c015e2c0 2026-02-23T06:27:26.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.009+0000 7fa5c703a640 1 -- 10.20.193.58:0/3435801736 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5c011ee80 con 0x7fa5c015e2c0 2026-02-23T06:27:26.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.009+0000 7fa5c703a640 1 --2- 10.20.193.58:0/3435801736 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5c011f070 0x7fa5c015eca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:26.008 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.009+0000 7fa5c703a640 1 -- 10.20.193.58:0/3435801736 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa5c00609c0 con 0x7fa5c011f070 2026-02-23T06:27:26.009 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.011+0000 7fa5c6038640 1 --2- 10.20.193.58:0/3435801736 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5c011f070 0x7fa5c015eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:26.009 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.011+0000 7fa5c6038640 1 -- 10.20.193.58:0/3435801736 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa5c00b6330 con 0x7fa5c011f070 2026-02-23T06:27:26.009 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.011+0000 7fa5a6ffd640 1 -- 10.20.193.58:0/3435801736 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fa5bc01b400 con 0x7fa5c015e2c0 2026-02-23T06:27:26.010 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.012+0000 7fa5c6038640 1 --2- 10.20.193.58:0/3435801736 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5c011f070 0x7fa5c015eca0 secure :-1 s=READY pgs=80 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5c003b390 tx=0x7fa5b0005610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:26.010 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.012+0000 7fa5a6ffd640 1 --2- 10.20.193.58:0/3435801736 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa59007a6b0 0x7fa59009ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:26.010 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.012+0000 7fa5a6ffd640 1 -- 10.20.193.58:0/3435801736 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fa5bc09e7d0 con 0x7fa5c015e2c0 2026-02-23T06:27:26.010 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.013+0000 7fa5a6ffd640 1 -- 10.20.193.58:0/3435801736 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5b0041070 con 0x7fa5c011f070 2026-02-23T06:27:26.010 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.013+0000 7fa5a6ffd640 1 -- 10.20.193.58:0/3435801736 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fa5b0042040 con 0x7fa5c011f070 2026-02-23T06:27:26.010 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.013+0000 7fa5a6ffd640 1 -- 10.20.193.58:0/3435801736 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5c011f070 msgr2=0x7fa5c015eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:26.010 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.013+0000 7fa5a6ffd640 1 --2- 10.20.193.58:0/3435801736 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5c011f070 0x7fa5c015eca0 secure :-1 s=READY pgs=80 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5c003b390 tx=0x7fa5b0005610 comp rx=0 tx=0).stop 2026-02-23T06:27:26.010 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.013+0000 7fa5a6ffd640 1 -- 10.20.193.58:0/3435801736 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5c011f070 msgr2=0x7fa5c015eca0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:27:26.011 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.013+0000 7fa5a6ffd640 1 --2- 10.20.193.58:0/3435801736 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5c011f070 0x7fa5c015eca0 unknown :-1 s=CLOSED pgs=80 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:26.011 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.013+0000 7fa5c5837640 1 --2- 10.20.193.58:0/3435801736 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa59007a6b0 0x7fa59009ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:26.011 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.014+0000 7fa5c5837640 1 --2- 10.20.193.58:0/3435801736 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa59007a6b0 0x7fa59009ab60 secure :-1 s=READY pgs=212 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5b4004820 tx=0x7fa5b4005b20 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:26.012 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.016+0000 7fa5c703a640 1 --2- 10.20.193.58:0/3435801736 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5c01511e0 0x7fa5c01515b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:26.012 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.016+0000 7fa5c703a640 1 -- 10.20.193.58:0/3435801736 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa5c0164250 con 0x7fa5c01511e0 2026-02-23T06:27:26.012 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.016+0000 7fa5c6038640 1 --2- 10.20.193.58:0/3435801736 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5c01511e0 0x7fa5c01515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:26.019 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.025+0000 7fa5c6038640 1 -- 10.20.193.58:0/3435801736 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa5c00b6d50 con 0x7fa5c01511e0 2026-02-23T06:27:26.020 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.025+0000 7fa5c6038640 1 --2- 10.20.193.58:0/3435801736 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5c01511e0 0x7fa5c01515b0 secure :-1 s=READY pgs=81 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5b0009b40 tx=0x7fa5b0005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:26.020 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.025+0000 7fa5a6ffd640 1 -- 10.20.193.58:0/3435801736 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5b0005d80 con 0x7fa5c01511e0 2026-02-23T06:27:26.020 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.025+0000 7fa5a6ffd640 1 -- 10.20.193.58:0/3435801736 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5555 (secure 0 0 0) 0x7fa5b004f8a0 con 0x7fa5c01511e0 2026-02-23T06:27:26.020 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.025+0000 7fa5a6ffd640 1 -- 10.20.193.58:0/3435801736 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5c01511e0 msgr2=0x7fa5c01515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:26.020 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.025+0000 7fa5a6ffd640 1 --2- 10.20.193.58:0/3435801736 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5c01511e0 0x7fa5c01515b0 secure :-1 s=READY pgs=81 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5b0009b40 tx=0x7fa5b0005f90 comp rx=0 tx=0).stop 2026-02-23T06:27:26.020 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.025+0000 7fa5a6ffd640 1 -- 10.20.193.58:0/3435801736 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5c01511e0 msgr2=0x7fa5c01515b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:27:26.020 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.025+0000 7fa5a6ffd640 1 --2- 10.20.193.58:0/3435801736 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5c01511e0 0x7fa5c01515b0 secure :-1 s=CLOSED pgs=81 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5b0009b40 tx=0x7fa5b0005f90 comp rx=0 tx=0).stop 2026-02-23T06:27:26.021 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:27:26.021 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:27:26.021 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:27:26.021 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:27:26.021 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 52, 2026-02-23T06:27:26.022 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 120537, 2026-02-23T06:27:26.022 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:27:26.022 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:27:26.022 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:27:26.022 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:27:26.022 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:26.022 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:27:26.023 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:27:26.023 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:27:26.023 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:27:26.023 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:26.023 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:26.023 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:26.023 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:26.024 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:26.024 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:26.024 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:26.024 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:26.024 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:26.024 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:26.024 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:26.024 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:26.024 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:26.024 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:26.025 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:27:26.025 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:27:26.025 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:26.025 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:26.025 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:26.025 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:26.025 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:26.025 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:26.025 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:26.025 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:26.025 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:26.026 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:26.026 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:26.026 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:26.026 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:26.026 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:26.026 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:26.026 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:27:26.026 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:27:26.026 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:27:26.026 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:27:26.027 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:27:26.027 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:27:26.027 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:27:26.027 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:27:26.027 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:27:26.027 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:27:26.027 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:27:26.027 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:27:26.027 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:27:26.027 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:27:26.028 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:27:26.028 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:27:26.028 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:27:26.028 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:26.028 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:26.028 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:26.028 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:26.028 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:26.028 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:26.028 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:26.028 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:26.029 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:26.029 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:26.029 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:26.029 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:26.029 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:26.029 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:26.029 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:27:26.029 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:26.029 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:27:26.029 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:26.029 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:27:26.029 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:27:26.030 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:26.030 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:26.030 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:26.030 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:26.030 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:27:26.030 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:26.030 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:26.030 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:26.030 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:26.030 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:27:26.030 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:26.031 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:26.031 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:26.031 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:26.031 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:27:26.031 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:27:26.031 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:26.031 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:26.031 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:27:26.031 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:26.031 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:26.032 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:26.032 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:27:26.032 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:27:26.032 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:26.032 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:26.032 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:26.032 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:26.032 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:27:26.032 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:26.032 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:26.032 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:26.033 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:26.033 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:27:26.033 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:26.033 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:26.033 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:26.033 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:26.033 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:27:26.033 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:27:26.033 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:26.033 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:26.033 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:27:26.034 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:26.034 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:26.034 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:26.034 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:27:26.034 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:27:26.034 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:26.034 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:26.034 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:26.034 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:26.034 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:27:26.034 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:26.035 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:26.035 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:26.035 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:26.035 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:27:26.035 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:26.035 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:26.035 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:26.035 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:26.035 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:27:26.035 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:27:26.035 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:26.035 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:26.035 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:27:26.036 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:26.036 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:26.036 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:26.036 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:26.036 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:27:26.036 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:27:26.036 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:26.036 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:26.036 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:26.036 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:27:26.037 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:26.037 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:26.037 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:27:26.037 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:26.037 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:26.037 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:26.037 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:27:26.037 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:26.037 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:26.037 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:27:26.037 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:26.038 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:26.038 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:26.038 INFO:teuthology.orchestra.run.trial058.stdout: "num": 7 2026-02-23T06:27:26.038 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:26.038 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:26.038 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:27:26.038 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:26.038 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:27:26.038 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:27:26.038 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:27:26.038 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:26.039 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:26.039 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:26.039 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:26.039 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:27:26.039 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:26.039 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:26.039 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:27:26.039 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:26.039 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:26.039 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:26.039 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:27:26.040 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:26.040 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:26.040 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:26.040 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:27:26.040 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:27:26.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.025+0000 7fa5c703a640 1 -- 10.20.193.58:0/3435801736 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa59007a6b0 msgr2=0x7fa59009ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:26.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.025+0000 7fa5c703a640 1 --2- 10.20.193.58:0/3435801736 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa59007a6b0 0x7fa59009ab60 secure :-1 s=READY pgs=212 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5b4004820 tx=0x7fa5b4005b20 comp rx=0 tx=0).stop 2026-02-23T06:27:26.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.025+0000 7fa5c703a640 1 -- 10.20.193.58:0/3435801736 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5c015e2c0 msgr2=0x7fa5c015e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:26.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.025+0000 7fa5c703a640 1 --2- 10.20.193.58:0/3435801736 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5c015e2c0 0x7fa5c015e760 secure :-1 s=READY pgs=9 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5bc004810 tx=0x7fa5bc00f6d0 comp rx=0 tx=0).stop 2026-02-23T06:27:26.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.025+0000 7fa5c6839640 1 -- 10.20.193.58:0/3435801736 reap_dead start 2026-02-23T06:27:26.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.025+0000 7fa5c6839640 1 -- 10.20.193.58:0/3435801736 reap_dead start 2026-02-23T06:27:26.043 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.025+0000 7fa5c703a640 1 -- 10.20.193.58:0/3435801736 shutdown_connections 2026-02-23T06:27:26.043 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.025+0000 7fa5c703a640 1 -- 10.20.193.58:0/3435801736 >> 10.20.193.58:0/3435801736 conn(0x7fa5c00b3c20 msgr2=0x7fa5c00b1180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:26.043 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.025+0000 7fa5c703a640 1 -- 10.20.193.58:0/3435801736 shutdown_connections 2026-02-23T06:27:26.043 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.025+0000 7fa5c703a640 1 -- 10.20.193.58:0/3435801736 wait complete. 2026-02-23T06:27:26.043 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:27:26.043 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:27:26.044 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:27:26.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.173+0000 7fee49e83640 1 -- 10.20.193.58:0/1983327120 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fee4415d4a0 msgr2=0x7fee440affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:26.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.173+0000 7fee49e83640 1 --2- 10.20.193.58:0/1983327120 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fee4415d4a0 0x7fee440affb0 secure :-1 s=READY pgs=46 gs=3 cs=0 l=1 c_cookie=11400998401590647012 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee34004740 tx=0x7fee3402f230 comp rx=0 tx=0).stop 2026-02-23T06:27:26.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.173+0000 7fee49e83640 1 -- 10.20.193.58:0/1983327120 shutdown_connections 2026-02-23T06:27:26.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.173+0000 7fee49e83640 1 --2- 10.20.193.58:0/1983327120 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fee4415d4a0 0x7fee440affb0 unknown :-1 s=CLOSED pgs=46 gs=3 cs=0 l=1 c_cookie=11400998401590647012 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:26.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.173+0000 7fee49e83640 1 -- 10.20.193.58:0/1983327120 >> 10.20.193.58:0/1983327120 conn(0x7fee440b3c20 msgr2=0x7fee440b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:26.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.173+0000 7fee49e83640 1 -- 10.20.193.58:0/1983327120 shutdown_connections 2026-02-23T06:27:26.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.173+0000 7fee49e83640 1 -- 10.20.193.58:0/1983327120 wait complete. 2026-02-23T06:27:26.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.174+0000 7fee49e83640 1 Processor -- start 2026-02-23T06:27:26.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.174+0000 7fee49e83640 1 -- start start 2026-02-23T06:27:26.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.175+0000 7fee49e83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fee440b6690 0x7fee44123510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:26.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.175+0000 7fee49e83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fee4415d4a0 0x7fee4413f280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:26.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.175+0000 7fee49e83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fee4415d870 0x7fee4413cf30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:26.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.175+0000 7fee49e83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fee441226a0 con 0x7fee4415d870 2026-02-23T06:27:26.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.175+0000 7fee49e83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fee44123250 con 0x7fee440b6690 2026-02-23T06:27:26.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.175+0000 7fee49e83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fee44123e30 con 0x7fee4415d4a0 2026-02-23T06:27:26.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.175+0000 7fee49682640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fee4415d870 0x7fee4413cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:26.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.175+0000 7fee48e81640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fee440b6690 0x7fee44123510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:26.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.175+0000 7fee48e81640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fee440b6690 0x7fee44123510 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:44006/0 (socket says 10.20.193.58:44006) 2026-02-23T06:27:26.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.175+0000 7fee48e81640 1 -- 10.20.193.58:0/4181736544 learned_addr learned my addr 10.20.193.58:0/4181736544 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:27:26.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.175+0000 7fee3bfff640 1 --2- 10.20.193.58:0/4181736544 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fee4415d4a0 0x7fee4413f280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:26.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.175+0000 7fee48e81640 1 -- 10.20.193.58:0/4181736544 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fee4415d4a0 msgr2=0x7fee4413f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:26.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.175+0000 7fee48e81640 1 --2- 10.20.193.58:0/4181736544 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fee4415d4a0 0x7fee4413f280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:26.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.175+0000 7fee48e81640 1 -- 10.20.193.58:0/4181736544 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fee4415d870 msgr2=0x7fee4413cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:26.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.175+0000 7fee48e81640 1 --2- 10.20.193.58:0/4181736544 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fee4415d870 0x7fee4413cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:26.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.175+0000 7fee48e81640 1 -- 10.20.193.58:0/4181736544 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee340094b0 con 0x7fee440b6690 2026-02-23T06:27:26.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.175+0000 7fee3bfff640 1 --2- 10.20.193.58:0/4181736544 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fee4415d4a0 0x7fee4413f280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:27:26.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.175+0000 7fee49682640 1 --2- 10.20.193.58:0/4181736544 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fee4415d870 0x7fee4413cf30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:27:26.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.176+0000 7fee48e81640 1 --2- 10.20.193.58:0/4181736544 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fee440b6690 0x7fee44123510 secure :-1 s=READY pgs=47 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee34017200 tx=0x7fee34002950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:26.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.176+0000 7fee397fa640 1 -- 10.20.193.58:0/4181736544 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee34038470 con 0x7fee440b6690 2026-02-23T06:27:26.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.176+0000 7fee397fa640 1 -- 10.20.193.58:0/4181736544 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee340386c0 con 0x7fee440b6690 2026-02-23T06:27:26.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.176+0000 7fee397fa640 1 -- 10.20.193.58:0/4181736544 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee34038ab0 con 0x7fee440b6690 2026-02-23T06:27:26.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.176+0000 7fee49e83640 1 -- 10.20.193.58:0/4181736544 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee441267c0 con 0x7fee440b6690 2026-02-23T06:27:26.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.176+0000 7fee49e83640 1 -- 10.20.193.58:0/4181736544 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee44126d20 con 0x7fee440b6690 2026-02-23T06:27:26.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.177+0000 7fee49e83640 1 -- 10.20.193.58:0/4181736544 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee440b7260 con 0x7fee440b6690 2026-02-23T06:27:26.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.178+0000 7fee397fa640 1 -- 10.20.193.58:0/4181736544 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fee34038c10 con 0x7fee440b6690 2026-02-23T06:27:26.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.179+0000 7fee397fa640 1 --2- 10.20.193.58:0/4181736544 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fee1407a6c0 0x7fee1409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:26.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.179+0000 7fee397fa640 1 -- 10.20.193.58:0/4181736544 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fee340c2fd0 con 0x7fee440b6690 2026-02-23T06:27:26.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.179+0000 7fee3bfff640 1 --2- 10.20.193.58:0/4181736544 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fee1407a6c0 0x7fee1409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:26.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.179+0000 7fee397fa640 1 -- 10.20.193.58:0/4181736544 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fee34086280 con 0x7fee440b6690 2026-02-23T06:27:26.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.180+0000 7fee3bfff640 1 --2- 10.20.193.58:0/4181736544 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fee1407a6c0 0x7fee1409ab70 secure :-1 s=READY pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee440aeb80 tx=0x7fee2c009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:26.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.335+0000 7fee49e83640 1 -- 10.20.193.58:0/4181736544 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fee440b75b0 con 0x7fee440b6690 2026-02-23T06:27:26.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.336+0000 7fee397fa640 1 -- 10.20.193.58:0/4181736544 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fee340893a0 con 0x7fee440b6690 2026-02-23T06:27:26.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.338+0000 7fee49e83640 1 -- 10.20.193.58:0/4181736544 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fee1407a6c0 msgr2=0x7fee1409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:26.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.338+0000 7fee49e83640 1 --2- 10.20.193.58:0/4181736544 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fee1407a6c0 0x7fee1409ab70 secure :-1 s=READY pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee440aeb80 tx=0x7fee2c009040 comp rx=0 tx=0).stop 2026-02-23T06:27:26.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.338+0000 7fee49e83640 1 -- 10.20.193.58:0/4181736544 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fee440b6690 msgr2=0x7fee44123510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:26.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.338+0000 7fee49e83640 1 --2- 10.20.193.58:0/4181736544 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fee440b6690 0x7fee44123510 secure :-1 s=READY pgs=47 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee34017200 tx=0x7fee34002950 comp rx=0 tx=0).stop 2026-02-23T06:27:26.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.338+0000 7fee49e83640 1 -- 10.20.193.58:0/4181736544 shutdown_connections 2026-02-23T06:27:26.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.338+0000 7fee49e83640 1 --2- 10.20.193.58:0/4181736544 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fee1407a6c0 0x7fee1409ab70 unknown :-1 s=CLOSED pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:26.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.338+0000 7fee49e83640 1 --2- 10.20.193.58:0/4181736544 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fee4415d870 0x7fee4413cf30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:26.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.338+0000 7fee49e83640 1 --2- 10.20.193.58:0/4181736544 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fee4415d4a0 0x7fee4413f280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:26.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.338+0000 7fee49e83640 1 --2- 10.20.193.58:0/4181736544 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fee440b6690 0x7fee44123510 unknown :-1 s=CLOSED pgs=47 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:26.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.338+0000 7fee49e83640 1 -- 10.20.193.58:0/4181736544 >> 10.20.193.58:0/4181736544 conn(0x7fee440b3c20 msgr2=0x7fee440b7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:26.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.338+0000 7fee49e83640 1 -- 10.20.193.58:0/4181736544 shutdown_connections 2026-02-23T06:27:26.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:26.338+0000 7fee49e83640 1 -- 10.20.193.58:0/4181736544 wait complete. 2026-02-23T06:27:26.344 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:27:36.346 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:27:36.346 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:27:36.469 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.473+0000 7f99aae83640 1 -- 10.20.193.58:0/1262722249 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f998c004850 msgr2=0x7f998c004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:36.469 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.473+0000 7f99aae83640 1 --2- 10.20.193.58:0/1262722249 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f998c004850 0x7f998c004cc0 secure :-1 s=READY pgs=12 gs=4 cs=0 l=1 c_cookie=10296723869874117034 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9998006f90 tx=0x7f999802f8b0 comp rx=0 tx=0).stop 2026-02-23T06:27:36.469 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.473+0000 7f99aae83640 1 -- 10.20.193.58:0/1262722249 shutdown_connections 2026-02-23T06:27:36.469 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.473+0000 7f99aae83640 1 --2- 10.20.193.58:0/1262722249 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f998c004850 0x7f998c004cc0 unknown :-1 s=CLOSED pgs=12 gs=4 cs=0 l=1 c_cookie=10296723869874117034 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:36.470 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.473+0000 7f99aae83640 1 -- 10.20.193.58:0/1262722249 >> 10.20.193.58:0/1262722249 conn(0x7f99a40b3c20 msgr2=0x7f99a40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:36.470 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.473+0000 7f99aae83640 1 -- 10.20.193.58:0/1262722249 shutdown_connections 2026-02-23T06:27:36.470 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.473+0000 7f99aae83640 1 -- 10.20.193.58:0/1262722249 wait complete. 2026-02-23T06:27:36.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.474+0000 7f99aae83640 1 Processor -- start 2026-02-23T06:27:36.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.474+0000 7f99aae83640 1 -- start start 2026-02-23T06:27:36.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.475+0000 7f99aae83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f998c004850 0x7f99a4058810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:36.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.475+0000 7f99aae83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f99a40b0290 0x7f99a4200f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:36.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.475+0000 7f99aae83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f99a42014a0 0x7f99a4151460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:36.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.475+0000 7f99aae83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f99a4155bf0 con 0x7f998c004850 2026-02-23T06:27:36.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.475+0000 7f99aae83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f99a4160470 con 0x7f99a42014a0 2026-02-23T06:27:36.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.475+0000 7f99aae83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f99a4201910 con 0x7f99a40b0290 2026-02-23T06:27:36.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.475+0000 7f99a9e81640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f998c004850 0x7f99a4058810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:36.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.475+0000 7f99a9e81640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f998c004850 0x7f99a4058810 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:51252/0 (socket says 10.20.193.58:51252) 2026-02-23T06:27:36.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.475+0000 7f99a9e81640 1 -- 10.20.193.58:0/520611780 learned_addr learned my addr 10.20.193.58:0/520611780 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:27:36.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.475+0000 7f99a9680640 1 --2- 10.20.193.58:0/520611780 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f99a40b0290 0x7f99a4200f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:36.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.475+0000 7f99aa682640 1 --2- 10.20.193.58:0/520611780 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f99a42014a0 0x7f99a4151460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:36.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.475+0000 7f99a9e81640 1 -- 10.20.193.58:0/520611780 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f99a40b0290 msgr2=0x7f99a4200f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:36.474 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.475+0000 7f99a9e81640 1 --2- 10.20.193.58:0/520611780 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f99a40b0290 0x7f99a4200f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:36.474 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.475+0000 7f99a9e81640 1 -- 10.20.193.58:0/520611780 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f99a42014a0 msgr2=0x7f99a4151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:36.474 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.475+0000 7f99a9e81640 1 --2- 10.20.193.58:0/520611780 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f99a42014a0 0x7f99a4151460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:36.474 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.475+0000 7f99a9e81640 1 -- 10.20.193.58:0/520611780 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a4155e20 con 0x7f998c004850 2026-02-23T06:27:36.474 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.475+0000 7f99aa682640 1 --2- 10.20.193.58:0/520611780 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f99a42014a0 0x7f99a4151460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:27:36.474 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.476+0000 7f99a9e81640 1 --2- 10.20.193.58:0/520611780 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f998c004850 0x7f99a4058810 secure :-1 s=READY pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9994002770 tx=0x7f9994002c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:36.474 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.476+0000 7f99927fc640 1 -- 10.20.193.58:0/520611780 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9994002ea0 con 0x7f998c004850 2026-02-23T06:27:36.474 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.476+0000 7f99927fc640 1 -- 10.20.193.58:0/520611780 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f999401b470 con 0x7f998c004850 2026-02-23T06:27:36.474 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.476+0000 7f99927fc640 1 -- 10.20.193.58:0/520611780 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9994011ee0 con 0x7f998c004850 2026-02-23T06:27:36.474 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.476+0000 7f99aae83640 1 -- 10.20.193.58:0/520611780 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99a415feb0 con 0x7f998c004850 2026-02-23T06:27:36.474 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.476+0000 7f99aae83640 1 -- 10.20.193.58:0/520611780 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99a40b1570 con 0x7f998c004850 2026-02-23T06:27:36.474 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.476+0000 7f996bfff640 1 -- 10.20.193.58:0/520611780 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99a40b13d0 con 0x7f998c004850 2026-02-23T06:27:36.475 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.478+0000 7f99927fc640 1 -- 10.20.193.58:0/520611780 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f999401b8a0 con 0x7f998c004850 2026-02-23T06:27:36.476 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.479+0000 7f99927fc640 1 --2- 10.20.193.58:0/520611780 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f997407a6c0 0x7f997409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:36.476 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.479+0000 7f99927fc640 1 -- 10.20.193.58:0/520611780 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f999409efd0 con 0x7f998c004850 2026-02-23T06:27:36.476 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.479+0000 7f99a9680640 1 --2- 10.20.193.58:0/520611780 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f997407a6c0 0x7f997409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:36.476 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.480+0000 7f99a9680640 1 --2- 10.20.193.58:0/520611780 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f997407a6c0 0x7f997409ab70 secure :-1 s=READY pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99980030b0 tx=0x7f9998003150 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:36.476 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.480+0000 7f99927fc640 1 -- 10.20.193.58:0/520611780 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f99940621f0 con 0x7f998c004850 2026-02-23T06:27:36.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.640+0000 7f996bfff640 1 -- 10.20.193.58:0/520611780 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f99a40b13d0 con 0x7f998c004850 2026-02-23T06:27:36.637 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.641+0000 7f99927fc640 1 -- 10.20.193.58:0/520611780 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f99a40b13d0 con 0x7f998c004850 2026-02-23T06:27:36.637 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:27:36.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.642+0000 7f996bfff640 1 -- 10.20.193.58:0/520611780 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f997407a6c0 msgr2=0x7f997409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:36.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.642+0000 7f996bfff640 1 --2- 10.20.193.58:0/520611780 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f997407a6c0 0x7f997409ab70 secure :-1 s=READY pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99980030b0 tx=0x7f9998003150 comp rx=0 tx=0).stop 2026-02-23T06:27:36.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.642+0000 7f996bfff640 1 -- 10.20.193.58:0/520611780 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f998c004850 msgr2=0x7f99a4058810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:36.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.642+0000 7f996bfff640 1 --2- 10.20.193.58:0/520611780 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f998c004850 0x7f99a4058810 secure :-1 s=READY pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9994002770 tx=0x7f9994002c40 comp rx=0 tx=0).stop 2026-02-23T06:27:36.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.642+0000 7f996bfff640 1 -- 10.20.193.58:0/520611780 shutdown_connections 2026-02-23T06:27:36.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.642+0000 7f996bfff640 1 --2- 10.20.193.58:0/520611780 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f997407a6c0 0x7f997409ab70 unknown :-1 s=CLOSED pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:36.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.642+0000 7f996bfff640 1 --2- 10.20.193.58:0/520611780 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f99a42014a0 0x7f99a4151460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:36.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.642+0000 7f996bfff640 1 --2- 10.20.193.58:0/520611780 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f99a40b0290 0x7f99a4200f60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:36.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.642+0000 7f996bfff640 1 --2- 10.20.193.58:0/520611780 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f998c004850 0x7f99a4058810 unknown :-1 s=CLOSED pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:36.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.642+0000 7f996bfff640 1 -- 10.20.193.58:0/520611780 >> 10.20.193.58:0/520611780 conn(0x7f99a40b3c20 msgr2=0x7f99a4159be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:36.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.642+0000 7f996bfff640 1 -- 10.20.193.58:0/520611780 shutdown_connections 2026-02-23T06:27:36.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.642+0000 7f996bfff640 1 -- 10.20.193.58:0/520611780 wait complete. 2026-02-23T06:27:36.649 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:27:36.650 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:27:36.650 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:27:36.650 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:27:36.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.775+0000 7fa357243640 1 -- 10.20.193.58:0/2707058418 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa35015c040 msgr2=0x7fa35005b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:36.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.775+0000 7fa357243640 1 --2- 10.20.193.58:0/2707058418 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa35015c040 0x7fa35005b0e0 secure :-1 s=READY pgs=15 gs=3 cs=0 l=1 c_cookie=15785780026802830033 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa340004740 tx=0x7fa34002f220 comp rx=0 tx=0).stop 2026-02-23T06:27:36.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.775+0000 7fa357243640 1 -- 10.20.193.58:0/2707058418 shutdown_connections 2026-02-23T06:27:36.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.775+0000 7fa357243640 1 --2- 10.20.193.58:0/2707058418 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa35015c040 0x7fa35005b0e0 unknown :-1 s=CLOSED pgs=15 gs=3 cs=0 l=1 c_cookie=15785780026802830033 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:36.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.775+0000 7fa357243640 1 -- 10.20.193.58:0/2707058418 >> 10.20.193.58:0/2707058418 conn(0x7fa3500b3c20 msgr2=0x7fa3500b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:36.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.775+0000 7fa357243640 1 -- 10.20.193.58:0/2707058418 shutdown_connections 2026-02-23T06:27:36.772 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.775+0000 7fa357243640 1 -- 10.20.193.58:0/2707058418 wait complete. 2026-02-23T06:27:36.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.776+0000 7fa357243640 1 Processor -- start 2026-02-23T06:27:36.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.776+0000 7fa357243640 1 -- start start 2026-02-23T06:27:36.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.777+0000 7fa357243640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa350056550 0x7fa350164760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:36.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.777+0000 7fa357243640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa3500b5680 0x7fa3501fe270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:36.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.777+0000 7fa357243640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa35015c040 0x7fa35015feb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:36.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.777+0000 7fa357243640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa3501fdde0 con 0x7fa3500b5680 2026-02-23T06:27:36.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.777+0000 7fa357243640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fa3500b1d50 con 0x7fa350056550 2026-02-23T06:27:36.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.777+0000 7fa357243640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa3500b1ab0 con 0x7fa35015c040 2026-02-23T06:27:36.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.777+0000 7fa355a40640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa3500b5680 0x7fa3501fe270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:36.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.777+0000 7fa356241640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa350056550 0x7fa350164760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:36.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.777+0000 7fa356241640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa350056550 0x7fa350164760 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:43576/0 (socket says 10.20.193.58:43576) 2026-02-23T06:27:36.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.777+0000 7fa356241640 1 -- 10.20.193.58:0/2733565249 learned_addr learned my addr 10.20.193.58:0/2733565249 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:27:36.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.777+0000 7fa356a42640 1 --2- 10.20.193.58:0/2733565249 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa35015c040 0x7fa35015feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:36.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.777+0000 7fa355a40640 1 -- 10.20.193.58:0/2733565249 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa35015c040 msgr2=0x7fa35015feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:36.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.778+0000 7fa355a40640 1 --2- 10.20.193.58:0/2733565249 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa35015c040 0x7fa35015feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:36.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.778+0000 7fa355a40640 1 -- 10.20.193.58:0/2733565249 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa350056550 msgr2=0x7fa350164760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:36.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.778+0000 7fa355a40640 1 --2- 10.20.193.58:0/2733565249 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa350056550 0x7fa350164760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:36.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.778+0000 7fa355a40640 1 -- 10.20.193.58:0/2733565249 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3400094b0 con 0x7fa3500b5680 2026-02-23T06:27:36.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.778+0000 7fa355a40640 1 --2- 10.20.193.58:0/2733565249 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa3500b5680 0x7fa3501fe270 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa344002730 tx=0x7fa34400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:36.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.778+0000 7fa336ffd640 1 -- 10.20.193.58:0/2733565249 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa344004250 con 0x7fa3500b5680 2026-02-23T06:27:36.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.778+0000 7fa336ffd640 1 -- 10.20.193.58:0/2733565249 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3440044a0 con 0x7fa3500b5680 2026-02-23T06:27:36.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.778+0000 7fa336ffd640 1 -- 10.20.193.58:0/2733565249 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa3440038d0 con 0x7fa3500b5680 2026-02-23T06:27:36.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.778+0000 7fa357243640 1 -- 10.20.193.58:0/2733565249 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa350165230 con 0x7fa3500b5680 2026-02-23T06:27:36.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.778+0000 7fa357243640 1 -- 10.20.193.58:0/2733565249 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa350201d50 con 0x7fa3500b5680 2026-02-23T06:27:36.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.778+0000 7fa357243640 1 --2- 10.20.193.58:0/2733565249 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa350153840 0x7fa3501603f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:36.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.778+0000 7fa357243640 1 -- 10.20.193.58:0/2733565249 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa35015c410 con 0x7fa350153840 2026-02-23T06:27:36.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.779+0000 7fa356241640 1 --2- 10.20.193.58:0/2733565249 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa350153840 0x7fa3501603f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:36.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.779+0000 7fa356241640 1 -- 10.20.193.58:0/2733565249 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa35005b620 con 0x7fa350153840 2026-02-23T06:27:36.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.779+0000 7fa356241640 1 --2- 10.20.193.58:0/2733565249 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa350153840 0x7fa3501603f0 secure :-1 s=READY pgs=17 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3400097e0 tx=0x7fa340004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:36.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.779+0000 7fa336ffd640 1 -- 10.20.193.58:0/2733565249 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa34003d050 con 0x7fa350153840 2026-02-23T06:27:36.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.780+0000 7fa336ffd640 1 -- 10.20.193.58:0/2733565249 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fa34003e040 con 0x7fa350153840 2026-02-23T06:27:36.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.780+0000 7fa336ffd640 1 -- 10.20.193.58:0/2733565249 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa350153840 msgr2=0x7fa3501603f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:36.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.780+0000 7fa336ffd640 1 --2- 10.20.193.58:0/2733565249 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa350153840 0x7fa3501603f0 secure :-1 s=READY pgs=17 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3400097e0 tx=0x7fa340004770 comp rx=0 tx=0).stop 2026-02-23T06:27:36.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.780+0000 7fa336ffd640 1 -- 10.20.193.58:0/2733565249 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa350153840 msgr2=0x7fa3501603f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:27:36.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.780+0000 7fa336ffd640 1 --2- 10.20.193.58:0/2733565249 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa350153840 0x7fa3501603f0 secure :-1 s=CLOSED pgs=17 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3400097e0 tx=0x7fa340004770 comp rx=0 tx=0).stop 2026-02-23T06:27:36.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.781+0000 7fa336ffd640 1 -- 10.20.193.58:0/2733565249 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fa344019070 con 0x7fa3500b5680 2026-02-23T06:27:36.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.781+0000 7fa336ffd640 1 --2- 10.20.193.58:0/2733565249 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa32007a370 0x7fa32009a820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:36.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.781+0000 7fa336ffd640 1 -- 10.20.193.58:0/2733565249 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fa34409d4f0 con 0x7fa3500b5680 2026-02-23T06:27:36.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.782+0000 7fa356241640 1 --2- 10.20.193.58:0/2733565249 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa32007a370 0x7fa32009a820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:36.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.782+0000 7fa356241640 1 --2- 10.20.193.58:0/2733565249 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa32007a370 0x7fa32009a820 secure :-1 s=READY pgs=216 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3400097e0 tx=0x7fa340042000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:36.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.783+0000 7fa357243640 1 --2- 10.20.193.58:0/2733565249 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa3501fd960 0x7fa350160930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:36.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.783+0000 7fa357243640 1 -- 10.20.193.58:0/2733565249 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa35005b0e0 con 0x7fa3501fd960 2026-02-23T06:27:36.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.783+0000 7fa356a42640 1 --2- 10.20.193.58:0/2733565249 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa3501fd960 0x7fa350160930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:36.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.783+0000 7fa356a42640 1 -- 10.20.193.58:0/2733565249 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa35005cf50 con 0x7fa3501fd960 2026-02-23T06:27:36.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.784+0000 7fa356a42640 1 --2- 10.20.193.58:0/2733565249 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa3501fd960 0x7fa350160930 secure :-1 s=READY pgs=18 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa34c003810 tx=0x7fa34c00fba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:36.782 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.784+0000 7fa336ffd640 1 -- 10.20.193.58:0/2733565249 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa34c018070 con 0x7fa3501fd960 2026-02-23T06:27:36.782 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.784+0000 7fa336ffd640 1 -- 10.20.193.58:0/2733565249 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4913 (secure 0 0 0) 0x7fa34c003d70 con 0x7fa3501fd960 2026-02-23T06:27:36.782 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.784+0000 7fa336ffd640 1 -- 10.20.193.58:0/2733565249 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa3501fd960 msgr2=0x7fa350160930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:36.782 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.784+0000 7fa336ffd640 1 --2- 10.20.193.58:0/2733565249 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa3501fd960 0x7fa350160930 secure :-1 s=READY pgs=18 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa34c003810 tx=0x7fa34c00fba0 comp rx=0 tx=0).stop 2026-02-23T06:27:36.782 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.784+0000 7fa336ffd640 1 -- 10.20.193.58:0/2733565249 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa3501fd960 msgr2=0x7fa350160930 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:27:36.782 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.784+0000 7fa336ffd640 1 --2- 10.20.193.58:0/2733565249 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa3501fd960 0x7fa350160930 unknown :-1 s=CLOSED pgs=18 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:36.782 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:27:36.783 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:27:36.783 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:27:36.783 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:27:36.783 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 52, 2026-02-23T06:27:36.783 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 11368, 2026-02-23T06:27:36.783 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:27:36.783 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:27:36.784 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:27:36.784 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:27:36.784 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:36.784 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:27:36.784 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:27:36.784 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:27:36.784 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:27:36.784 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:36.784 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:36.785 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:36.785 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:36.785 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:36.785 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:36.785 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:36.785 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:36.785 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:36.785 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:36.785 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:36.785 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:36.785 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:36.786 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:36.786 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:27:36.786 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:27:36.786 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:36.786 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:36.786 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:36.786 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:36.786 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:36.786 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:36.786 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:36.786 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:36.787 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:36.787 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:36.787 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:36.787 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:36.787 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:36.787 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:36.787 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:36.787 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:27:36.787 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:27:36.787 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:27:36.788 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:27:36.788 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:27:36.788 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:27:36.788 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:27:36.788 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:27:36.788 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:27:36.788 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:27:36.788 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:27:36.788 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:27:36.788 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:27:36.789 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:27:36.789 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:27:36.789 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:27:36.789 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:27:36.789 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:36.789 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:36.789 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:36.789 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:36.789 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:36.789 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:36.789 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:36.790 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:36.790 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:36.790 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:36.790 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:36.790 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:36.790 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:36.790 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:36.790 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:27:36.790 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:36.790 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:27:36.790 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:36.791 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:27:36.791 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:27:36.791 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:36.791 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:36.791 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:36.791 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:36.791 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:27:36.791 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:36.791 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:36.791 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:36.791 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:36.792 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:27:36.792 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:36.792 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:36.792 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:36.792 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:36.792 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:27:36.792 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:27:36.792 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:36.792 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:36.792 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:27:36.793 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:36.793 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:36.793 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:36.793 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:27:36.793 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:27:36.793 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:36.793 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:36.793 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:36.793 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:36.793 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:27:36.793 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:36.794 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:36.794 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:36.794 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:36.794 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:27:36.794 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:36.794 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:36.794 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:36.794 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:36.794 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:27:36.794 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:27:36.794 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:36.795 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:36.795 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:27:36.795 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:36.795 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:36.795 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:36.795 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:27:36.795 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:27:36.795 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:36.795 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:36.795 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:36.796 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:36.796 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:27:36.796 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:36.796 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:36.796 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:36.796 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:36.796 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:27:36.796 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:36.796 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:36.796 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:36.796 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:36.797 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:27:36.797 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:27:36.797 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:36.797 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:36.797 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:27:36.797 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:36.797 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:36.797 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:36.797 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:36.797 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:27:36.797 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:27:36.798 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:36.798 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:36.798 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:36.798 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:27:36.798 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:36.798 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:36.798 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:27:36.798 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:36.798 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:36.798 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:36.799 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:27:36.799 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:36.799 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:36.799 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:36.799 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:27:36.799 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:27:36.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.784+0000 7fa357243640 1 -- 10.20.193.58:0/2733565249 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa32007a370 msgr2=0x7fa32009a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:36.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.784+0000 7fa357243640 1 --2- 10.20.193.58:0/2733565249 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa32007a370 0x7fa32009a820 secure :-1 s=READY pgs=216 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3400097e0 tx=0x7fa340042000 comp rx=0 tx=0).stop 2026-02-23T06:27:36.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.784+0000 7fa357243640 1 -- 10.20.193.58:0/2733565249 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa3500b5680 msgr2=0x7fa3501fe270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:36.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.784+0000 7fa357243640 1 --2- 10.20.193.58:0/2733565249 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa3500b5680 0x7fa3501fe270 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa344002730 tx=0x7fa34400c970 comp rx=0 tx=0).stop 2026-02-23T06:27:36.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.784+0000 7fa356a42640 1 -- 10.20.193.58:0/2733565249 reap_dead start 2026-02-23T06:27:36.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.784+0000 7fa357243640 1 -- 10.20.193.58:0/2733565249 shutdown_connections 2026-02-23T06:27:36.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.784+0000 7fa357243640 1 -- 10.20.193.58:0/2733565249 >> 10.20.193.58:0/2733565249 conn(0x7fa3500b3c20 msgr2=0x7fa35015af20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:36.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.784+0000 7fa357243640 1 -- 10.20.193.58:0/2733565249 shutdown_connections 2026-02-23T06:27:36.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.784+0000 7fa357243640 1 -- 10.20.193.58:0/2733565249 wait complete. 2026-02-23T06:27:36.803 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:27:36.803 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:27:36.803 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:27:36.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.931+0000 7ff9e38cc640 1 -- 10.20.193.58:0/3695966475 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff9dc163820 msgr2=0x7ff9dc1c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:36.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.931+0000 7ff9e38cc640 1 --2- 10.20.193.58:0/3695966475 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff9dc163820 0x7ff9dc1c89a0 secure :-1 s=READY pgs=20 gs=3 cs=0 l=1 c_cookie=6001520160110755948 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9d8005820 tx=0x7ff9d8030300 comp rx=0 tx=0).stop 2026-02-23T06:27:36.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.931+0000 7ff9e38cc640 1 -- 10.20.193.58:0/3695966475 shutdown_connections 2026-02-23T06:27:36.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.931+0000 7ff9e38cc640 1 --2- 10.20.193.58:0/3695966475 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff9dc163820 0x7ff9dc1c89a0 unknown :-1 s=CLOSED pgs=20 gs=3 cs=0 l=1 c_cookie=6001520160110755948 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:36.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.931+0000 7ff9e38cc640 1 -- 10.20.193.58:0/3695966475 >> 10.20.193.58:0/3695966475 conn(0x7ff9dc058e50 msgr2=0x7ff9dc059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:36.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.931+0000 7ff9e38cc640 1 -- 10.20.193.58:0/3695966475 shutdown_connections 2026-02-23T06:27:36.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.931+0000 7ff9e38cc640 1 -- 10.20.193.58:0/3695966475 wait complete. 2026-02-23T06:27:36.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.932+0000 7ff9e38cc640 1 Processor -- start 2026-02-23T06:27:36.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.933+0000 7ff9e38cc640 1 -- start start 2026-02-23T06:27:36.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.933+0000 7ff9e38cc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff9dc0b1170 0x7ff9dc0b6e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:36.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.933+0000 7ff9e38cc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9dc0b1540 0x7ff9dc132f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:36.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.933+0000 7ff9e38cc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff9dc163820 0x7ff9dc200d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:36.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.933+0000 7ff9e38cc640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff9dc157d10 con 0x7ff9dc163820 2026-02-23T06:27:36.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.933+0000 7ff9e38cc640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff9dc1589e0 con 0x7ff9dc0b1540 2026-02-23T06:27:36.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.933+0000 7ff9e38cc640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7ff9dc0b6900 con 0x7ff9dc0b1170 2026-02-23T06:27:36.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.933+0000 7ff9e1e42640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff9dc163820 0x7ff9dc200d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:36.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.934+0000 7ff9e0e40640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9dc0b1540 0x7ff9dc132f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:36.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.934+0000 7ff9e1e42640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff9dc163820 0x7ff9dc200d80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:51304/0 (socket says 10.20.193.58:51304) 2026-02-23T06:27:36.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.934+0000 7ff9e1e42640 1 -- 10.20.193.58:0/61567969 learned_addr learned my addr 10.20.193.58:0/61567969 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:27:36.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.934+0000 7ff9e1641640 1 --2- 10.20.193.58:0/61567969 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff9dc0b1170 0x7ff9dc0b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:36.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.934+0000 7ff9e1e42640 1 -- 10.20.193.58:0/61567969 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff9dc0b1170 msgr2=0x7ff9dc0b6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:36.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.934+0000 7ff9e1e42640 1 --2- 10.20.193.58:0/61567969 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff9dc0b1170 0x7ff9dc0b6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:36.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.934+0000 7ff9e1e42640 1 -- 10.20.193.58:0/61567969 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9dc0b1540 msgr2=0x7ff9dc132f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:36.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.934+0000 7ff9e1e42640 1 --2- 10.20.193.58:0/61567969 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9dc0b1540 0x7ff9dc132f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:36.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.934+0000 7ff9e1e42640 1 -- 10.20.193.58:0/61567969 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d800a590 con 0x7ff9dc163820 2026-02-23T06:27:36.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.934+0000 7ff9e1e42640 1 --2- 10.20.193.58:0/61567969 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff9dc163820 0x7ff9dc200d80 secure :-1 s=READY pgs=21 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9d800aa40 tx=0x7ff9d8003d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:36.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.934+0000 7ff9c9ffb640 1 -- 10.20.193.58:0/61567969 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff9d803e070 con 0x7ff9dc163820 2026-02-23T06:27:36.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.934+0000 7ff9c9ffb640 1 -- 10.20.193.58:0/61567969 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9d80398a0 con 0x7ff9dc163820 2026-02-23T06:27:36.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.934+0000 7ff9e38cc640 1 -- 10.20.193.58:0/61567969 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9dc158550 con 0x7ff9dc163820 2026-02-23T06:27:36.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.934+0000 7ff9c9ffb640 1 -- 10.20.193.58:0/61567969 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff9d8039c30 con 0x7ff9dc163820 2026-02-23T06:27:36.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.934+0000 7ff9e38cc640 1 -- 10.20.193.58:0/61567969 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9dc0b7ef0 con 0x7ff9dc163820 2026-02-23T06:27:36.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.935+0000 7ff9e38cc640 1 --2- 10.20.193.58:0/61567969 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9dc1334a0 0x7ff9dc157e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:36.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.935+0000 7ff9e38cc640 1 -- 10.20.193.58:0/61567969 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff9dc166fe0 con 0x7ff9dc1334a0 2026-02-23T06:27:36.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.935+0000 7ff9e1641640 1 --2- 10.20.193.58:0/61567969 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9dc1334a0 0x7ff9dc157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:36.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.935+0000 7ff9e1641640 1 -- 10.20.193.58:0/61567969 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9dc166d00 con 0x7ff9dc1334a0 2026-02-23T06:27:36.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.936+0000 7ff9e1641640 1 --2- 10.20.193.58:0/61567969 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9dc1334a0 0x7ff9dc157e60 secure :-1 s=READY pgs=51 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9cc002730 tx=0x7ff9cc00eba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:36.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.936+0000 7ff9c9ffb640 1 -- 10.20.193.58:0/61567969 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7ff9d804b3b0 con 0x7ff9dc163820 2026-02-23T06:27:36.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.937+0000 7ff9c9ffb640 1 --2- 10.20.193.58:0/61567969 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff9ac07a600 0x7ff9ac09aab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:36.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.937+0000 7ff9c9ffb640 1 -- 10.20.193.58:0/61567969 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7ff9d80c3b70 con 0x7ff9dc163820 2026-02-23T06:27:36.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.937+0000 7ff9c9ffb640 1 -- 10.20.193.58:0/61567969 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff9cc002be0 con 0x7ff9dc1334a0 2026-02-23T06:27:36.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.937+0000 7ff9c9ffb640 1 -- 10.20.193.58:0/61567969 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7ff9cc002d40 con 0x7ff9dc1334a0 2026-02-23T06:27:36.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.937+0000 7ff9c9ffb640 1 -- 10.20.193.58:0/61567969 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9dc1334a0 msgr2=0x7ff9dc157e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:36.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.937+0000 7ff9c9ffb640 1 --2- 10.20.193.58:0/61567969 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9dc1334a0 0x7ff9dc157e60 secure :-1 s=READY pgs=51 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9cc002730 tx=0x7ff9cc00eba0 comp rx=0 tx=0).stop 2026-02-23T06:27:36.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.937+0000 7ff9c9ffb640 1 -- 10.20.193.58:0/61567969 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9dc1334a0 msgr2=0x7ff9dc157e60 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:27:36.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.937+0000 7ff9c9ffb640 1 --2- 10.20.193.58:0/61567969 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9dc1334a0 0x7ff9dc157e60 secure :-1 s=CLOSED pgs=51 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9cc002730 tx=0x7ff9cc00eba0 comp rx=0 tx=0).stop 2026-02-23T06:27:36.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.937+0000 7ff9e0e40640 1 --2- 10.20.193.58:0/61567969 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff9ac07a600 0x7ff9ac09aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:36.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.938+0000 7ff9e0e40640 1 --2- 10.20.193.58:0/61567969 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff9ac07a600 0x7ff9ac09aab0 secure :-1 s=READY pgs=217 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9dc1570d0 tx=0x7ff9d0009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:36.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.941+0000 7ff9e38cc640 1 --2- 10.20.193.58:0/61567969 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9dc2012c0 0x7ff9dc201690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:36.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.941+0000 7ff9e38cc640 1 -- 10.20.193.58:0/61567969 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff9dc15a8d0 con 0x7ff9dc2012c0 2026-02-23T06:27:36.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.941+0000 7ff9e1641640 1 --2- 10.20.193.58:0/61567969 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9dc2012c0 0x7ff9dc201690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:36.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.942+0000 7ff9e1641640 1 -- 10.20.193.58:0/61567969 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff9dc201bd0 con 0x7ff9dc2012c0 2026-02-23T06:27:36.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.942+0000 7ff9e1641640 1 --2- 10.20.193.58:0/61567969 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9dc2012c0 0x7ff9dc201690 secure :-1 s=READY pgs=52 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9cc002730 tx=0x7ff9cc0028f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:36.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.942+0000 7ff9c9ffb640 1 -- 10.20.193.58:0/61567969 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff9cc022070 con 0x7ff9dc2012c0 2026-02-23T06:27:36.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.942+0000 7ff9c9ffb640 1 -- 10.20.193.58:0/61567969 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5245 (secure 0 0 0) 0x7ff9cc0045c0 con 0x7ff9dc2012c0 2026-02-23T06:27:36.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.942+0000 7ff9c9ffb640 1 -- 10.20.193.58:0/61567969 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9dc2012c0 msgr2=0x7ff9dc201690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:36.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.942+0000 7ff9c9ffb640 1 --2- 10.20.193.58:0/61567969 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9dc2012c0 0x7ff9dc201690 secure :-1 s=READY pgs=52 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9cc002730 tx=0x7ff9cc0028f0 comp rx=0 tx=0).stop 2026-02-23T06:27:36.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.942+0000 7ff9c9ffb640 1 -- 10.20.193.58:0/61567969 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9dc2012c0 msgr2=0x7ff9dc201690 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:27:36.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.942+0000 7ff9c9ffb640 1 --2- 10.20.193.58:0/61567969 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9dc2012c0 0x7ff9dc201690 unknown :-1 s=CLOSED pgs=52 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:36.937 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:27:36.938 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:27:36.938 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:27:36.938 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:27:36.938 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 52, 2026-02-23T06:27:36.938 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 58454, 2026-02-23T06:27:36.938 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:27:36.938 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:27:36.938 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:27:36.938 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:27:36.938 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:36.938 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:27:36.938 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:27:36.938 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:27:36.938 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:27:36.938 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:36.938 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:36.938 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:36.938 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:36.938 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:36.938 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:36.938 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:36.939 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:36.939 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:36.939 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:36.939 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:36.939 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:36.939 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:36.939 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:36.939 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:27:36.939 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:27:36.939 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:36.939 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:36.939 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:36.939 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:36.939 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:36.939 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:36.939 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:36.939 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:36.939 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:36.939 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:36.939 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:36.939 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:36.939 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:36.939 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:36.939 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:36.939 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:27:36.940 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:27:36.940 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:27:36.940 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:27:36.940 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:27:36.940 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:27:36.940 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:27:36.940 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:27:36.940 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:27:36.940 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:27:36.940 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:27:36.940 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:27:36.940 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:27:36.940 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:27:36.940 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:27:36.940 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:27:36.940 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:27:36.940 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:36.940 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:36.940 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:36.940 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:36.940 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:36.940 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:36.941 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:36.941 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:36.941 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:36.941 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:36.941 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:36.941 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:36.941 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:36.941 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:36.941 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:27:36.941 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:36.941 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:27:36.941 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:36.941 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:27:36.941 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:27:36.941 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:36.941 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:36.941 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:36.941 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:36.941 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:27:36.941 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:36.941 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:36.941 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:36.941 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:36.941 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:27:36.942 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:36.942 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:36.942 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:36.942 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:36.942 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:27:36.942 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:27:36.942 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:36.942 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:36.942 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:27:36.942 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:36.942 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:36.942 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:36.942 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:27:36.942 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:27:36.942 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:36.942 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:36.942 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:36.942 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:36.942 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:27:36.942 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:36.942 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:36.942 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:36.942 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:36.942 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:27:36.942 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:36.943 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:36.943 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:36.943 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:36.943 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:27:36.943 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:27:36.943 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:36.943 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:36.943 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:27:36.943 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:36.943 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:36.943 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:36.943 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:27:36.943 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:27:36.943 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:36.943 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:36.943 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:36.943 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:36.943 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:27:36.943 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:36.943 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:36.943 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:36.943 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:36.943 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:27:36.943 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:36.943 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:36.944 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:36.944 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:36.944 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:27:36.944 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:27:36.944 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:36.944 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:36.944 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:27:36.944 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:36.944 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:36.944 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:36.944 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:36.944 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:27:36.944 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:27:36.944 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:36.944 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:36.944 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:36.944 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:27:36.944 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:36.944 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:36.944 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:27:36.944 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:36.944 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:36.944 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:36.945 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:27:36.945 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:36.945 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:36.945 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:27:36.945 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:36.945 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:36.945 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:36.945 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:27:36.945 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:36.945 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:36.945 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:27:36.945 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:36.945 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:36.945 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:36.945 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:27:36.945 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:36.945 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:36.945 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:36.945 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:27:36.945 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:27:36.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.943+0000 7ff9e38cc640 1 -- 10.20.193.58:0/61567969 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff9ac07a600 msgr2=0x7ff9ac09aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:36.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.943+0000 7ff9e38cc640 1 --2- 10.20.193.58:0/61567969 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff9ac07a600 0x7ff9ac09aab0 secure :-1 s=READY pgs=217 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9dc1570d0 tx=0x7ff9d0009040 comp rx=0 tx=0).stop 2026-02-23T06:27:36.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.943+0000 7ff9e38cc640 1 -- 10.20.193.58:0/61567969 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff9dc163820 msgr2=0x7ff9dc200d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:36.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.943+0000 7ff9e38cc640 1 --2- 10.20.193.58:0/61567969 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff9dc163820 0x7ff9dc200d80 secure :-1 s=READY pgs=21 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9d800aa40 tx=0x7ff9d8003d90 comp rx=0 tx=0).stop 2026-02-23T06:27:36.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.943+0000 7ff9e1e42640 1 -- 10.20.193.58:0/61567969 reap_dead start 2026-02-23T06:27:36.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.943+0000 7ff9e1e42640 1 -- 10.20.193.58:0/61567969 reap_dead start 2026-02-23T06:27:36.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.943+0000 7ff9e38cc640 1 -- 10.20.193.58:0/61567969 shutdown_connections 2026-02-23T06:27:36.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.943+0000 7ff9e38cc640 1 -- 10.20.193.58:0/61567969 >> 10.20.193.58:0/61567969 conn(0x7ff9dc058e50 msgr2=0x7ff9dc05dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:36.947 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.943+0000 7ff9e38cc640 1 -- 10.20.193.58:0/61567969 shutdown_connections 2026-02-23T06:27:36.947 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:36.943+0000 7ff9e38cc640 1 -- 10.20.193.58:0/61567969 wait complete. 2026-02-23T06:27:36.947 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:27:36.947 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:27:36.947 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:27:37.068 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.073+0000 7fe99bfff640 1 -- 10.20.193.58:0/2480179763 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe99c056960 msgr2=0x7fe99c0b6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:37.068 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.073+0000 7fe99bfff640 1 --2- 10.20.193.58:0/2480179763 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe99c056960 0x7fe99c0b6720 secure :-1 s=READY pgs=22 gs=3 cs=0 l=1 c_cookie=797884414316933977 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe99c059b80 tx=0x7fe98402f250 comp rx=0 tx=0).stop 2026-02-23T06:27:37.068 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.073+0000 7fe99bfff640 1 -- 10.20.193.58:0/2480179763 shutdown_connections 2026-02-23T06:27:37.068 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.073+0000 7fe99bfff640 1 --2- 10.20.193.58:0/2480179763 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe99c056960 0x7fe99c0b6720 unknown :-1 s=CLOSED pgs=22 gs=3 cs=0 l=1 c_cookie=797884414316933977 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:37.068 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.073+0000 7fe99bfff640 1 --2- 10.20.193.58:0/2480179763 >> v2:10.20.193.93:3300/0 conn(0x7fe99c15c4b0 0x7fe99c058200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:37.068 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.073+0000 7fe99bfff640 1 -- 10.20.193.58:0/2480179763 >> 10.20.193.58:0/2480179763 conn(0x7fe99c0b3c20 msgr2=0x7fe99c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:37.068 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.073+0000 7fe99bfff640 1 -- 10.20.193.58:0/2480179763 shutdown_connections 2026-02-23T06:27:37.068 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.073+0000 7fe99bfff640 1 -- 10.20.193.58:0/2480179763 wait complete. 2026-02-23T06:27:37.069 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.074+0000 7fe99bfff640 1 Processor -- start 2026-02-23T06:27:37.069 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.074+0000 7fe99bfff640 1 -- start start 2026-02-23T06:27:37.069 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.075+0000 7fe99bfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe99c056960 0x7fe99c161320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:37.070 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.075+0000 7fe99bfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe99c15c4b0 0x7fe99c13c850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:37.070 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.075+0000 7fe99bfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe99c162ca0 0x7fe99c0b7890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:37.070 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.075+0000 7fe99bfff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c161860 con 0x7fe99c15c4b0 2026-02-23T06:27:37.070 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.075+0000 7fe99bfff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c0afc50 con 0x7fe99c162ca0 2026-02-23T06:27:37.070 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.075+0000 7fe99bfff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe99c0b10c0 con 0x7fe99c056960 2026-02-23T06:27:37.070 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.075+0000 7fe99a7fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe99c15c4b0 0x7fe99c13c850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:37.070 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.075+0000 7fe99a7fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe99c15c4b0 0x7fe99c13c850 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:51328/0 (socket says 10.20.193.58:51328) 2026-02-23T06:27:37.070 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.075+0000 7fe99a7fc640 1 -- 10.20.193.58:0/836625735 learned_addr learned my addr 10.20.193.58:0/836625735 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:27:37.070 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.075+0000 7fe99b7fe640 1 --2- 10.20.193.58:0/836625735 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe99c162ca0 0x7fe99c0b7890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:37.070 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.075+0000 7fe99affd640 1 --2- 10.20.193.58:0/836625735 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe99c056960 0x7fe99c161320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:37.070 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.075+0000 7fe99a7fc640 1 -- 10.20.193.58:0/836625735 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe99c056960 msgr2=0x7fe99c161320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:37.070 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.075+0000 7fe99a7fc640 1 --2- 10.20.193.58:0/836625735 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe99c056960 0x7fe99c161320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:37.070 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.075+0000 7fe99a7fc640 1 -- 10.20.193.58:0/836625735 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe99c162ca0 msgr2=0x7fe99c0b7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:37.070 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.075+0000 7fe99a7fc640 1 --2- 10.20.193.58:0/836625735 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe99c162ca0 0x7fe99c0b7890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:37.071 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.075+0000 7fe99a7fc640 1 -- 10.20.193.58:0/836625735 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe984009570 con 0x7fe99c15c4b0 2026-02-23T06:27:37.071 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.076+0000 7fe99a7fc640 1 --2- 10.20.193.58:0/836625735 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe99c15c4b0 0x7fe99c13c850 secure :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe98402f800 tx=0x7fe9840028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:37.071 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.076+0000 7fe97b7fe640 1 -- 10.20.193.58:0/836625735 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe98403d070 con 0x7fe99c15c4b0 2026-02-23T06:27:37.071 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.076+0000 7fe97b7fe640 1 -- 10.20.193.58:0/836625735 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe984038470 con 0x7fe99c15c4b0 2026-02-23T06:27:37.071 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.076+0000 7fe99bfff640 1 -- 10.20.193.58:0/836625735 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe99c0afa20 con 0x7fe99c15c4b0 2026-02-23T06:27:37.071 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.076+0000 7fe97b7fe640 1 -- 10.20.193.58:0/836625735 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe984038880 con 0x7fe99c15c4b0 2026-02-23T06:27:37.071 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.076+0000 7fe99bfff640 1 -- 10.20.193.58:0/836625735 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe99c137210 con 0x7fe99c15c4b0 2026-02-23T06:27:37.071 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.076+0000 7fe9797fa640 1 --2- 10.20.193.58:0/836625735 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe99c15fe60 0x7fe99c0b0a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:37.071 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.076+0000 7fe9797fa640 1 -- 10.20.193.58:0/836625735 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe99c161b50 con 0x7fe99c15fe60 2026-02-23T06:27:37.071 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.077+0000 7fe99affd640 1 --2- 10.20.193.58:0/836625735 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe99c15fe60 0x7fe99c0b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:37.072 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.077+0000 7fe97b7fe640 1 -- 10.20.193.58:0/836625735 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fe9840389e0 con 0x7fe99c15c4b0 2026-02-23T06:27:37.072 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.078+0000 7fe99affd640 1 -- 10.20.193.58:0/836625735 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe99c059690 con 0x7fe99c15fe60 2026-02-23T06:27:37.073 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.078+0000 7fe99affd640 1 --2- 10.20.193.58:0/836625735 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe99c15fe60 0x7fe99c0b0a70 secure :-1 s=READY pgs=82 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe990002fa0 tx=0x7fe9900099f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:37.073 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.078+0000 7fe97b7fe640 1 --2- 10.20.193.58:0/836625735 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe96807a6c0 0x7fe96809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:37.073 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.078+0000 7fe97b7fe640 1 -- 10.20.193.58:0/836625735 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fe9840c2150 con 0x7fe99c15c4b0 2026-02-23T06:27:37.073 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.078+0000 7fe97b7fe640 1 -- 10.20.193.58:0/836625735 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe990010a70 con 0x7fe99c15fe60 2026-02-23T06:27:37.073 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.079+0000 7fe99b7fe640 1 --2- 10.20.193.58:0/836625735 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe96807a6c0 0x7fe96809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:37.073 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.079+0000 7fe97b7fe640 1 -- 10.20.193.58:0/836625735 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fe990010bd0 con 0x7fe99c15fe60 2026-02-23T06:27:37.073 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.079+0000 7fe97b7fe640 1 -- 10.20.193.58:0/836625735 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe99c15fe60 msgr2=0x7fe99c0b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:37.073 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.079+0000 7fe97b7fe640 1 --2- 10.20.193.58:0/836625735 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe99c15fe60 0x7fe99c0b0a70 secure :-1 s=READY pgs=82 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe990002fa0 tx=0x7fe9900099f0 comp rx=0 tx=0).stop 2026-02-23T06:27:37.073 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.079+0000 7fe97b7fe640 1 -- 10.20.193.58:0/836625735 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe99c15fe60 msgr2=0x7fe99c0b0a70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:27:37.073 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.079+0000 7fe97b7fe640 1 --2- 10.20.193.58:0/836625735 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe99c15fe60 0x7fe99c0b0a70 unknown :-1 s=CLOSED pgs=82 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:37.074 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.079+0000 7fe99b7fe640 1 --2- 10.20.193.58:0/836625735 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe96807a6c0 0x7fe96809ab70 secure :-1 s=READY pgs=218 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe99c137700 tx=0x7fe98c00a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:37.077 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.082+0000 7fe9797fa640 1 --2- 10.20.193.58:0/836625735 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe99c13b490 0x7fe99c17aa80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:37.077 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.082+0000 7fe9797fa640 1 -- 10.20.193.58:0/836625735 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe99c15c880 con 0x7fe99c13b490 2026-02-23T06:27:37.077 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.083+0000 7fe99affd640 1 --2- 10.20.193.58:0/836625735 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe99c13b490 0x7fe99c17aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:37.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.083+0000 7fe99affd640 1 -- 10.20.193.58:0/836625735 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe99c13c570 con 0x7fe99c13b490 2026-02-23T06:27:37.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.083+0000 7fe99affd640 1 --2- 10.20.193.58:0/836625735 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe99c13b490 0x7fe99c17aa80 secure :-1 s=READY pgs=83 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9900023d0 tx=0x7fe990004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:37.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.083+0000 7fe97b7fe640 1 -- 10.20.193.58:0/836625735 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe990024070 con 0x7fe99c13b490 2026-02-23T06:27:37.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.084+0000 7fe97b7fe640 1 -- 10.20.193.58:0/836625735 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5556 (secure 0 0 0) 0x7fe99001a8a0 con 0x7fe99c13b490 2026-02-23T06:27:37.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.084+0000 7fe97b7fe640 1 -- 10.20.193.58:0/836625735 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe99c13b490 msgr2=0x7fe99c17aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:37.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.084+0000 7fe97b7fe640 1 --2- 10.20.193.58:0/836625735 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe99c13b490 0x7fe99c17aa80 secure :-1 s=READY pgs=83 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9900023d0 tx=0x7fe990004770 comp rx=0 tx=0).stop 2026-02-23T06:27:37.078 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:27:37.078 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:27:37.078 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:27:37.078 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 52, 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 131595, 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:37.079 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:27:37.080 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:37.081 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: "num": 7 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:27:37.082 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:27:37.083 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:27:37.083 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:37.083 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:37.083 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:37.083 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:37.083 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:27:37.083 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:37.083 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:37.083 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:27:37.083 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:37.083 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:37.083 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:37.083 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:27:37.083 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:37.083 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:37.083 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:37.083 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:27:37.083 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:27:37.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.084+0000 7fe97b7fe640 1 -- 10.20.193.58:0/836625735 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe99c13b490 msgr2=0x7fe99c17aa80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:27:37.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.084+0000 7fe97b7fe640 1 --2- 10.20.193.58:0/836625735 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe99c13b490 0x7fe99c17aa80 unknown :-1 s=CLOSED pgs=83 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:37.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.084+0000 7fe9797fa640 1 -- 10.20.193.58:0/836625735 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe96807a6c0 msgr2=0x7fe96809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:37.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.084+0000 7fe9797fa640 1 --2- 10.20.193.58:0/836625735 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe96807a6c0 0x7fe96809ab70 secure :-1 s=READY pgs=218 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe99c137700 tx=0x7fe98c00a040 comp rx=0 tx=0).stop 2026-02-23T06:27:37.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.084+0000 7fe9797fa640 1 -- 10.20.193.58:0/836625735 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe99c15c4b0 msgr2=0x7fe99c13c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:37.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.084+0000 7fe9797fa640 1 --2- 10.20.193.58:0/836625735 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe99c15c4b0 0x7fe99c13c850 secure :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe98402f800 tx=0x7fe9840028d0 comp rx=0 tx=0).stop 2026-02-23T06:27:37.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.084+0000 7fe99b7fe640 1 -- 10.20.193.58:0/836625735 reap_dead start 2026-02-23T06:27:37.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.084+0000 7fe99b7fe640 1 -- 10.20.193.58:0/836625735 reap_dead start 2026-02-23T06:27:37.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.084+0000 7fe9797fa640 1 -- 10.20.193.58:0/836625735 shutdown_connections 2026-02-23T06:27:37.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.084+0000 7fe9797fa640 1 -- 10.20.193.58:0/836625735 >> 10.20.193.58:0/836625735 conn(0x7fe99c0b3c20 msgr2=0x7fe99c0b5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:37.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.084+0000 7fe9797fa640 1 -- 10.20.193.58:0/836625735 shutdown_connections 2026-02-23T06:27:37.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:37.084+0000 7fe9797fa640 1 -- 10.20.193.58:0/836625735 wait complete. 2026-02-23T06:27:37.088 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:27:37.088 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-23T06:27:37.088 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2026-02-23T06:27:37.088 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-23T06:27:37.088 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-23T06:27:37.088 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-23T06:27:37.088 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:27:37.102 INFO:tasks.ceph.mon.a:Stopped 2026-02-23T06:27:37.102 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.b 2026-02-23T06:27:37.102 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-23T06:27:37.102 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-23T06:27:37.102 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-23T06:27:42.572 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:27:42.577 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:27:52.102 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.b 2026-02-23T06:27:52.103 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-23T06:27:52.103 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-23T06:27:52.103 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:27:52.104 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:27:57.115 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.119+0000 7f6f15bfe640 1 -- 10.20.193.58:0/3537548228 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6ef4004850 msgr2=0x7f6ef4004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:57.116 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.119+0000 7f6f15bfe640 1 --2- 10.20.193.58:0/3537548228 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6ef4004850 0x7f6ef4004cc0 secure :-1 s=READY pgs=60 gs=28 cs=0 l=1 c_cookie=249265727018615078 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f00006ef0 tx=0x7f6f0002f6c0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.116 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.119+0000 7f6f15bfe640 1 -- 10.20.193.58:0/3537548228 shutdown_connections 2026-02-23T06:27:57.116 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.119+0000 7f6f15bfe640 1 --2- 10.20.193.58:0/3537548228 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ef4005270 0x7f6ef4065a10 unknown :-1 s=CLOSED pgs=0 gs=29 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.116 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.119+0000 7f6f15bfe640 1 --2- 10.20.193.58:0/3537548228 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6ef4004850 0x7f6ef4004cc0 unknown :-1 s=CLOSED pgs=60 gs=28 cs=0 l=1 c_cookie=249265727018615078 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.116 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.119+0000 7f6f15bfe640 1 --2- 10.20.193.58:0/3537548228 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6ef4003a30 0x7f6ef4003e20 unknown :-1 s=CLOSED pgs=0 gs=27 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.116 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.119+0000 7f6f15bfe640 1 -- 10.20.193.58:0/3537548228 >> 10.20.193.58:0/3537548228 conn(0x7f6f1005b1a0 msgr2=0x7f6f1005b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:57.117 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.119+0000 7f6f15bfe640 1 -- 10.20.193.58:0/3537548228 shutdown_connections 2026-02-23T06:27:57.117 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.119+0000 7f6f15bfe640 1 -- 10.20.193.58:0/3537548228 wait complete. 2026-02-23T06:27:57.119 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.121+0000 7f6f15bfe640 1 Processor -- start 2026-02-23T06:27:57.120 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.121+0000 7f6f15bfe640 1 -- start start 2026-02-23T06:27:57.120 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.121+0000 7f6f15bfe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ef4003a30 0x7f6f1013f980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:57.120 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.121+0000 7f6f15bfe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6ef4004850 0x7f6f1015a9e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:57.120 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.122+0000 7f6f15bfe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6ef4005270 0x7f6f1015af20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:57.120 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.122+0000 7f6f15bfe640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1013f4e0 con 0x7f6ef4003a30 2026-02-23T06:27:57.120 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.122+0000 7f6f15bfe640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1015d2a0 con 0x7f6ef4004850 2026-02-23T06:27:57.120 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.122+0000 7f6f15bfe640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f6f1015d820 con 0x7f6ef4005270 2026-02-23T06:27:57.120 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.122+0000 7f6f0f7fe640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ef4003a30 msgr2=0x7f6f1013f980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:27:57.120 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.122+0000 7f6f0f7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ef4003a30 0x7f6f1013f980 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:27:57.120 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.122+0000 7f6f0ffff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6ef4005270 0x7f6f1015af20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:57.121 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.122+0000 7f6f0effd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6ef4004850 0x7f6f1015a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:57.121 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.122+0000 7f6f0effd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6ef4004850 0x7f6f1015a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:58462/0 (socket says 10.20.193.58:58462) 2026-02-23T06:27:57.121 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.122+0000 7f6f0effd640 1 -- 10.20.193.58:0/3239959497 learned_addr learned my addr 10.20.193.58:0/3239959497 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:27:57.121 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.122+0000 7f6f0ffff640 1 -- 10.20.193.58:0/3239959497 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6ef4004850 msgr2=0x7f6f1015a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:57.121 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.122+0000 7f6f0ffff640 1 --2- 10.20.193.58:0/3239959497 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6ef4004850 0x7f6f1015a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.121 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.122+0000 7f6f0ffff640 1 -- 10.20.193.58:0/3239959497 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ef4003a30 msgr2=0x7f6f1013f980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:27:57.121 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.122+0000 7f6f0ffff640 1 --2- 10.20.193.58:0/3239959497 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ef4003a30 0x7f6f1013f980 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.121 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.122+0000 7f6f0ffff640 1 -- 10.20.193.58:0/3239959497 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f1013ecb0 con 0x7f6ef4005270 2026-02-23T06:27:57.121 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.122+0000 7f6f0ffff640 1 --2- 10.20.193.58:0/3239959497 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6ef4005270 0x7f6f1015af20 secure :-1 s=READY pgs=92 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f10057cc0 tx=0x7f6f0400c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:57.121 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.123+0000 7f6eebfff640 1 -- 10.20.193.58:0/3239959497 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f04010660 con 0x7f6ef4005270 2026-02-23T06:27:57.121 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.123+0000 7f6eebfff640 1 -- 10.20.193.58:0/3239959497 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f040107e0 con 0x7f6ef4005270 2026-02-23T06:27:57.122 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.123+0000 7f6eebfff640 1 -- 10.20.193.58:0/3239959497 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f04010c10 con 0x7f6ef4005270 2026-02-23T06:27:57.122 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.123+0000 7f6f15bfe640 1 -- 10.20.193.58:0/3239959497 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f1013ef20 con 0x7f6ef4005270 2026-02-23T06:27:57.122 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.123+0000 7f6f15bfe640 1 -- 10.20.193.58:0/3239959497 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f1015d4b0 con 0x7f6ef4005270 2026-02-23T06:27:57.122 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.123+0000 7f6f15bfe640 1 -- 10.20.193.58:0/3239959497 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f1005e810 con 0x7f6ef4005270 2026-02-23T06:27:57.122 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.125+0000 7f6eebfff640 1 -- 10.20.193.58:0/3239959497 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f6f04005070 con 0x7f6ef4005270 2026-02-23T06:27:57.123 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.125+0000 7f6eebfff640 1 --2- 10.20.193.58:0/3239959497 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6ee007a5b0 0x7f6ee009aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:57.123 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.126+0000 7f6eebfff640 1 -- 10.20.193.58:0/3239959497 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f6f0409eb50 con 0x7f6ef4005270 2026-02-23T06:27:57.123 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.126+0000 7f6f0f7fe640 1 --2- 10.20.193.58:0/3239959497 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6ee007a5b0 0x7f6ee009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:57.123 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.126+0000 7f6f0f7fe640 1 --2- 10.20.193.58:0/3239959497 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6ee007a5b0 0x7f6ee009aa60 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6efc005d00 tx=0x7f6efc014040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:57.123 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.126+0000 7f6eebfff640 1 -- 10.20.193.58:0/3239959497 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f6f04061cf0 con 0x7f6ef4005270 2026-02-23T06:27:57.276 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.281+0000 7f6f15bfe640 1 -- 10.20.193.58:0/3239959497 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6f100b4320 con 0x7f6ef4005270 2026-02-23T06:27:57.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.281+0000 7f6eebfff640 1 -- 10.20.193.58:0/3239959497 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1748 (secure 0 0 0) 0x7f6f04064e10 con 0x7f6ef4005270 2026-02-23T06:27:57.277 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":54,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:27:57.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.282+0000 7f6f15bfe640 1 -- 10.20.193.58:0/3239959497 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6ee007a5b0 msgr2=0x7f6ee009aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:57.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.282+0000 7f6f15bfe640 1 --2- 10.20.193.58:0/3239959497 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6ee007a5b0 0x7f6ee009aa60 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6efc005d00 tx=0x7f6efc014040 comp rx=0 tx=0).stop 2026-02-23T06:27:57.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.282+0000 7f6f15bfe640 1 -- 10.20.193.58:0/3239959497 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6ef4005270 msgr2=0x7f6f1015af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:57.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.282+0000 7f6f15bfe640 1 --2- 10.20.193.58:0/3239959497 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6ef4005270 0x7f6f1015af20 secure :-1 s=READY pgs=92 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f10057cc0 tx=0x7f6f0400c960 comp rx=0 tx=0).stop 2026-02-23T06:27:57.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.282+0000 7f6f15bfe640 1 -- 10.20.193.58:0/3239959497 shutdown_connections 2026-02-23T06:27:57.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.282+0000 7f6f15bfe640 1 --2- 10.20.193.58:0/3239959497 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6ee007a5b0 0x7f6ee009aa60 unknown :-1 s=CLOSED pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.282+0000 7f6f15bfe640 1 --2- 10.20.193.58:0/3239959497 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6ef4005270 0x7f6f1015af20 unknown :-1 s=CLOSED pgs=92 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.282+0000 7f6f15bfe640 1 --2- 10.20.193.58:0/3239959497 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6ef4004850 0x7f6f1015a9e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.282+0000 7f6f15bfe640 1 --2- 10.20.193.58:0/3239959497 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ef4003a30 0x7f6f1013f980 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.282+0000 7f6f15bfe640 1 -- 10.20.193.58:0/3239959497 >> 10.20.193.58:0/3239959497 conn(0x7f6f1005b1a0 msgr2=0x7f6f100b46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:57.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.282+0000 7f6f15bfe640 1 -- 10.20.193.58:0/3239959497 shutdown_connections 2026-02-23T06:27:57.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.282+0000 7f6f15bfe640 1 -- 10.20.193.58:0/3239959497 wait complete. 2026-02-23T06:27:57.290 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:27:57.290 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-23T06:27:57.290 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:27:57.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.419+0000 7f33d09d2640 1 -- 10.20.193.58:0/1758121954 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f33cc1688d0 msgr2=0x7f33cc168ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:57.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.419+0000 7f33d09d2640 1 --2- 10.20.193.58:0/1758121954 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f33cc1688d0 0x7f33cc168ca0 secure :-1 s=READY pgs=61 gs=2 cs=0 l=1 c_cookie=4114157264564304693 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33cc0bcb70 tx=0x7f33b802f280 comp rx=0 tx=0).stop 2026-02-23T06:27:57.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.419+0000 7f33d09d2640 1 -- 10.20.193.58:0/1758121954 shutdown_connections 2026-02-23T06:27:57.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.419+0000 7f33d09d2640 1 --2- 10.20.193.58:0/1758121954 >> v2:10.20.193.58:3300/0 conn(0x7f33cc0b6440 0x7f33cc0ba2d0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.419+0000 7f33d09d2640 1 --2- 10.20.193.58:0/1758121954 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f33cc1688d0 0x7f33cc168ca0 unknown :-1 s=CLOSED pgs=61 gs=2 cs=0 l=1 c_cookie=4114157264564304693 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.419+0000 7f33d09d2640 1 -- 10.20.193.58:0/1758121954 >> 10.20.193.58:0/1758121954 conn(0x7f33cc054e40 msgr2=0x7f33cc057b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:57.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.419+0000 7f33d09d2640 1 -- 10.20.193.58:0/1758121954 shutdown_connections 2026-02-23T06:27:57.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.419+0000 7f33d09d2640 1 -- 10.20.193.58:0/1758121954 wait complete. 2026-02-23T06:27:57.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.420+0000 7f33d09d2640 1 Processor -- start 2026-02-23T06:27:57.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.420+0000 7f33d09d2640 1 -- start start 2026-02-23T06:27:57.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.421+0000 7f33d09d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f33cc0b6440 0x7f33cc117240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:57.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.421+0000 7f33d09d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33cc0bb0b0 0x7f33cc1465f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:57.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.421+0000 7f33d09d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f33cc1688d0 0x7f33cc119210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:57.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.421+0000 7f33d09d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f33cc117780 con 0x7f33cc1688d0 2026-02-23T06:27:57.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.421+0000 7f33d09d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f33cc146b30 con 0x7f33cc0b6440 2026-02-23T06:27:57.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.421+0000 7f33d09d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f33cc11ada0 con 0x7f33cc0bb0b0 2026-02-23T06:27:57.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.421+0000 7f33cbfff640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f33cc1688d0 msgr2=0x7f33cc119210 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:27:57.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.421+0000 7f33cbfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f33cc1688d0 0x7f33cc119210 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:27:57.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.421+0000 7f33cb7fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f33cc0b6440 0x7f33cc117240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:57.421 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.421+0000 7f33cb7fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f33cc0b6440 0x7f33cc117240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:58468/0 (socket says 10.20.193.58:58468) 2026-02-23T06:27:57.421 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.421+0000 7f33cb7fe640 1 -- 10.20.193.58:0/4196780415 learned_addr learned my addr 10.20.193.58:0/4196780415 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:27:57.421 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.421+0000 7f33caffd640 1 --2- 10.20.193.58:0/4196780415 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33cc0bb0b0 0x7f33cc1465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:57.421 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.421+0000 7f33cb7fe640 1 -- 10.20.193.58:0/4196780415 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33cc0bb0b0 msgr2=0x7f33cc1465f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:57.421 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.421+0000 7f33cb7fe640 1 --2- 10.20.193.58:0/4196780415 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33cc0bb0b0 0x7f33cc1465f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.421 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.421+0000 7f33cb7fe640 1 -- 10.20.193.58:0/4196780415 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f33cc1688d0 msgr2=0x7f33cc119210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:27:57.421 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.421+0000 7f33cb7fe640 1 --2- 10.20.193.58:0/4196780415 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f33cc1688d0 0x7f33cc119210 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.421 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.421+0000 7f33cb7fe640 1 -- 10.20.193.58:0/4196780415 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b8009570 con 0x7f33cc0b6440 2026-02-23T06:27:57.421 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.422+0000 7f33cb7fe640 1 --2- 10.20.193.58:0/4196780415 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f33cc0b6440 0x7f33cc117240 secure :-1 s=READY pgs=62 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33b8004740 tx=0x7f33b80028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:57.421 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.422+0000 7f33a7fff640 1 -- 10.20.193.58:0/4196780415 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f33b803d070 con 0x7f33cc0b6440 2026-02-23T06:27:57.421 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.422+0000 7f33a7fff640 1 -- 10.20.193.58:0/4196780415 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33b8004850 con 0x7f33cc0b6440 2026-02-23T06:27:57.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.422+0000 7f33a7fff640 1 -- 10.20.193.58:0/4196780415 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f33b8004c80 con 0x7f33cc0b6440 2026-02-23T06:27:57.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.422+0000 7f33d09d2640 1 -- 10.20.193.58:0/4196780415 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33cc119eb0 con 0x7f33cc0b6440 2026-02-23T06:27:57.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.422+0000 7f33d09d2640 1 -- 10.20.193.58:0/4196780415 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33cc11a470 con 0x7f33cc0b6440 2026-02-23T06:27:57.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.423+0000 7f33d09d2640 1 --2- 10.20.193.58:0/4196780415 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f33cc11b8f0 0x7f33cc119750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:57.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.423+0000 7f33d09d2640 1 -- 10.20.193.58:0/4196780415 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f33cc0b9ad0 con 0x7f33cc11b8f0 2026-02-23T06:27:57.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.423+0000 7f33caffd640 1 --2- 10.20.193.58:0/4196780415 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f33cc11b8f0 0x7f33cc119750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:57.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.423+0000 7f33caffd640 1 -- 10.20.193.58:0/4196780415 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f33cc0b15f0 con 0x7f33cc11b8f0 2026-02-23T06:27:57.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.423+0000 7f33caffd640 1 --2- 10.20.193.58:0/4196780415 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f33cc11b8f0 0x7f33cc119750 secure :-1 s=READY pgs=63 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33cc11b880 tx=0x7f33bc0099f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:57.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.424+0000 7f33a7fff640 1 -- 10.20.193.58:0/4196780415 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f33bc00e870 con 0x7f33cc11b8f0 2026-02-23T06:27:57.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.424+0000 7f33a7fff640 1 -- 10.20.193.58:0/4196780415 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f33bc00e9d0 con 0x7f33cc11b8f0 2026-02-23T06:27:57.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.424+0000 7f33a7fff640 1 -- 10.20.193.58:0/4196780415 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f33cc11b8f0 msgr2=0x7f33cc119750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:57.423 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.424+0000 7f33a7fff640 1 --2- 10.20.193.58:0/4196780415 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f33cc11b8f0 0x7f33cc119750 secure :-1 s=READY pgs=63 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33cc11b880 tx=0x7f33bc0099f0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.423 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.424+0000 7f33a7fff640 1 -- 10.20.193.58:0/4196780415 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f33cc11b8f0 msgr2=0x7f33cc119750 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:27:57.423 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.424+0000 7f33a7fff640 1 --2- 10.20.193.58:0/4196780415 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f33cc11b8f0 0x7f33cc119750 unknown :-1 s=CLOSED pgs=63 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.423 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.424+0000 7f33a7fff640 1 -- 10.20.193.58:0/4196780415 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f33b8004de0 con 0x7f33cc0b6440 2026-02-23T06:27:57.425 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.425+0000 7f33a7fff640 1 --2- 10.20.193.58:0/4196780415 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f339c07a3c0 0x7f339c09a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:57.425 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.425+0000 7f33a7fff640 1 -- 10.20.193.58:0/4196780415 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f33b80c26b0 con 0x7f33cc0b6440 2026-02-23T06:27:57.425 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.425+0000 7f33caffd640 1 --2- 10.20.193.58:0/4196780415 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f339c07a3c0 0x7f339c09a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:57.425 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.426+0000 7f33caffd640 1 --2- 10.20.193.58:0/4196780415 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f339c07a3c0 0x7f339c09a870 secure :-1 s=READY pgs=220 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33bc004890 tx=0x7f33bc008030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:57.425 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.428+0000 7f33d09d2640 1 --2- 10.20.193.58:0/4196780415 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f33cc11a690 0x7f33cc11c360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:57.425 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.428+0000 7f33d09d2640 1 -- 10.20.193.58:0/4196780415 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f33cc169270 con 0x7f33cc11a690 2026-02-23T06:27:57.426 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.428+0000 7f33cbfff640 1 --2- 10.20.193.58:0/4196780415 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f33cc11a690 0x7f33cc11c360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:57.426 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.428+0000 7f33cbfff640 1 -- 10.20.193.58:0/4196780415 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f33cc0b5e30 con 0x7f33cc11a690 2026-02-23T06:27:57.426 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.429+0000 7f33cbfff640 1 --2- 10.20.193.58:0/4196780415 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f33cc11a690 0x7f33cc11c360 secure :-1 s=READY pgs=64 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33c000c450 tx=0x7f33c000c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:57.426 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.429+0000 7f33a7fff640 1 -- 10.20.193.58:0/4196780415 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f33c00070d0 con 0x7f33cc11a690 2026-02-23T06:27:57.426 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.429+0000 7f33a7fff640 1 -- 10.20.193.58:0/4196780415 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5235 (secure 0 0 0) 0x7f33c0007230 con 0x7f33cc11a690 2026-02-23T06:27:57.426 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.429+0000 7f33a7fff640 1 -- 10.20.193.58:0/4196780415 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f33cc11a690 msgr2=0x7f33cc11c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:57.426 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.429+0000 7f33a7fff640 1 --2- 10.20.193.58:0/4196780415 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f33cc11a690 0x7f33cc11c360 secure :-1 s=READY pgs=64 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33c000c450 tx=0x7f33c000c920 comp rx=0 tx=0).stop 2026-02-23T06:27:57.426 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.429+0000 7f33a7fff640 1 -- 10.20.193.58:0/4196780415 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f33cc11a690 msgr2=0x7f33cc11c360 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:27:57.426 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.429+0000 7f33a7fff640 1 --2- 10.20.193.58:0/4196780415 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f33cc11a690 0x7f33cc11c360 unknown :-1 s=CLOSED pgs=64 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.427 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:27:57.427 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:27:57.427 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:27:57.427 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:27:57.427 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 54, 2026-02-23T06:27:57.427 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 78940, 2026-02-23T06:27:57.428 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:27:57.428 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:27:57.428 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:27:57.428 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:57.428 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:27:57.428 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:27:57.428 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:27:57.428 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:27:57.428 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:57.428 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:57.429 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:57.429 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:57.429 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:57.429 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:57.429 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:57.429 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:57.429 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:57.429 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:57.429 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:57.430 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:57.430 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:57.430 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:57.430 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:27:57.430 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:27:57.430 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:57.430 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:57.430 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:57.430 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:57.430 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:57.431 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:57.431 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:57.431 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:57.431 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:57.431 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:57.431 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:57.431 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:57.431 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:57.431 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:57.431 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:57.432 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:27:57.432 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:27:57.432 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:27:57.432 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:27:57.432 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:27:57.432 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:27:57.432 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:27:57.432 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:27:57.432 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:27:57.432 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:27:57.433 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:27:57.433 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:27:57.433 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:27:57.433 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:27:57.433 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:27:57.433 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:27:57.433 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:27:57.433 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:57.433 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:57.433 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:57.433 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:57.433 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:57.434 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:57.434 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:57.434 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:57.434 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:57.434 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:57.434 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:57.434 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:57.434 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:57.434 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:57.434 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:27:57.434 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:57.434 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:27:57.435 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:57.435 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:27:57.435 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:27:57.435 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:57.435 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:57.435 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:57.435 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:57.435 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:27:57.435 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:57.435 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:57.435 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:57.435 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:57.435 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:27:57.436 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:57.436 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:57.436 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:57.436 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:57.436 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:27:57.436 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:27:57.436 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:57.436 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:57.436 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:27:57.436 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:57.436 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:57.436 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:57.437 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:27:57.437 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:27:57.437 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:57.437 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:57.437 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:57.437 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:57.437 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:27:57.437 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:57.437 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:57.437 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:57.437 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:57.437 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:27:57.437 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:57.437 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:57.438 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:57.438 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:57.438 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:27:57.438 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:27:57.438 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:57.438 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:57.438 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:27:57.438 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:57.438 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:57.438 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:57.438 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:27:57.438 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:27:57.438 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:57.438 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:57.439 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:57.439 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:57.439 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:27:57.439 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:57.439 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:57.439 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:57.439 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:57.439 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:27:57.439 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:57.439 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:57.439 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:57.439 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:57.439 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:27:57.439 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:27:57.440 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:57.440 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:57.440 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:27:57.440 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:57.440 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:57.440 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:57.440 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:57.440 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:27:57.440 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:27:57.440 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:57.440 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:57.440 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:57.440 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:27:57.440 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:57.441 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:57.441 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:27:57.441 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:57.441 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:57.441 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:57.441 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:27:57.441 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:57.441 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:57.441 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:27:57.441 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:57.441 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:57.441 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:57.441 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:27:57.442 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:57.442 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:57.442 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:27:57.442 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:57.442 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:57.442 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:57.442 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:27:57.442 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:57.442 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:57.442 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:57.442 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:27:57.442 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:27:57.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.429+0000 7f33d09d2640 1 -- 10.20.193.58:0/4196780415 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f339c07a3c0 msgr2=0x7f339c09a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:57.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.429+0000 7f33d09d2640 1 --2- 10.20.193.58:0/4196780415 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f339c07a3c0 0x7f339c09a870 secure :-1 s=READY pgs=220 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33bc004890 tx=0x7f33bc008030 comp rx=0 tx=0).stop 2026-02-23T06:27:57.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.429+0000 7f33d09d2640 1 -- 10.20.193.58:0/4196780415 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f33cc0b6440 msgr2=0x7f33cc117240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:57.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.429+0000 7f33d09d2640 1 --2- 10.20.193.58:0/4196780415 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f33cc0b6440 0x7f33cc117240 secure :-1 s=READY pgs=62 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33b8004740 tx=0x7f33b80028d0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.429+0000 7f33cbfff640 1 -- 10.20.193.58:0/4196780415 reap_dead start 2026-02-23T06:27:57.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.429+0000 7f33d09d2640 1 -- 10.20.193.58:0/4196780415 shutdown_connections 2026-02-23T06:27:57.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.429+0000 7f33d09d2640 1 --2- 10.20.193.58:0/4196780415 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f33cc0b6440 0x7f33cc117240 unknown :-1 s=CLOSED pgs=62 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.429+0000 7f33d09d2640 1 -- 10.20.193.58:0/4196780415 >> 10.20.193.58:0/4196780415 conn(0x7f33cc054e40 msgr2=0x7f33cc13d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:57.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.429+0000 7f33d09d2640 1 -- 10.20.193.58:0/4196780415 shutdown_connections 2026-02-23T06:27:57.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.429+0000 7f33d09d2640 1 -- 10.20.193.58:0/4196780415 wait complete. 2026-02-23T06:27:57.445 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:27:57.445 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-23T06:27:57.445 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:27:57.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.571+0000 7fac0a775640 1 -- 10.20.193.58:0/2212258502 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fac0415d4a0 msgr2=0x7fac040affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:57.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.571+0000 7fac0a775640 1 --2- 10.20.193.58:0/2212258502 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fac0415d4a0 0x7fac040affb0 secure :-1 s=READY pgs=65 gs=1 cs=0 l=1 c_cookie=18318183566090510599 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac040b5040 tx=0x7fabf402f270 comp rx=0 tx=0).stop 2026-02-23T06:27:57.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.571+0000 7fac0a775640 1 -- 10.20.193.58:0/2212258502 shutdown_connections 2026-02-23T06:27:57.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.571+0000 7fac0a775640 1 --2- 10.20.193.58:0/2212258502 >> v2:10.20.193.58:3300/0 conn(0x7fac040b6690 0x7fac04058cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.571+0000 7fac0a775640 1 --2- 10.20.193.58:0/2212258502 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac0415d870 0x7fac040587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.571+0000 7fac0a775640 1 --2- 10.20.193.58:0/2212258502 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fac0415d4a0 0x7fac040affb0 unknown :-1 s=CLOSED pgs=65 gs=1 cs=0 l=1 c_cookie=18318183566090510599 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.571+0000 7fac0a775640 1 -- 10.20.193.58:0/2212258502 >> 10.20.193.58:0/2212258502 conn(0x7fac040b3c20 msgr2=0x7fac040b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:57.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.572+0000 7fac0a775640 1 -- 10.20.193.58:0/2212258502 shutdown_connections 2026-02-23T06:27:57.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.572+0000 7fac0a775640 1 -- 10.20.193.58:0/2212258502 wait complete. 2026-02-23T06:27:57.571 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.573+0000 7fac0a775640 1 Processor -- start 2026-02-23T06:27:57.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.573+0000 7fac0a775640 1 -- start start 2026-02-23T06:27:57.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.573+0000 7fac0a775640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac040b6690 0x7fac04141800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:57.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.573+0000 7fac0a775640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fac0415d4a0 0x7fac0413d2e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:57.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.573+0000 7fac0a775640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac0415d870 0x7fac0413d820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:57.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.573+0000 7fac0a775640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fac0414c090 con 0x7fac040b6690 2026-02-23T06:27:57.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.573+0000 7fac0a775640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fac04141370 con 0x7fac0415d4a0 2026-02-23T06:27:57.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.573+0000 7fac0a775640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fac0414af70 con 0x7fac0415d870 2026-02-23T06:27:57.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.573+0000 7fac09773640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac040b6690 msgr2=0x7fac04141800 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:27:57.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.573+0000 7fac09773640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac040b6690 0x7fac04141800 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:27:57.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.573+0000 7fac09f74640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac0415d870 0x7fac0413d820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:57.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.573+0000 7fac09f74640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac0415d870 0x7fac0413d820 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:48728/0 (socket says 10.20.193.58:48728) 2026-02-23T06:27:57.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.573+0000 7fac09f74640 1 -- 10.20.193.58:0/1918077213 learned_addr learned my addr 10.20.193.58:0/1918077213 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:27:57.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.573+0000 7fac08f72640 1 --2- 10.20.193.58:0/1918077213 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fac0415d4a0 0x7fac0413d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:57.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.574+0000 7fac09f74640 1 -- 10.20.193.58:0/1918077213 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fac0415d4a0 msgr2=0x7fac0413d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:57.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.574+0000 7fac09f74640 1 --2- 10.20.193.58:0/1918077213 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fac0415d4a0 0x7fac0413d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.574+0000 7fac09f74640 1 -- 10.20.193.58:0/1918077213 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac040b6690 msgr2=0x7fac04141800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:27:57.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.574+0000 7fac09f74640 1 --2- 10.20.193.58:0/1918077213 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac040b6690 0x7fac04141800 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.574+0000 7fac09f74640 1 -- 10.20.193.58:0/1918077213 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf4009570 con 0x7fac0415d870 2026-02-23T06:27:57.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.574+0000 7fac09f74640 1 --2- 10.20.193.58:0/1918077213 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac0415d870 0x7fac0413d820 secure :-1 s=READY pgs=93 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac0000c4d0 tx=0x7fac0000c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:57.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.574+0000 7fabf1ffb640 1 -- 10.20.193.58:0/1918077213 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac00003db0 con 0x7fac0415d870 2026-02-23T06:27:57.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.574+0000 7fac0a775640 1 -- 10.20.193.58:0/1918077213 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac0414acd0 con 0x7fac0415d870 2026-02-23T06:27:57.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.574+0000 7fac0a775640 1 -- 10.20.193.58:0/1918077213 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fac04140d20 con 0x7fac0415d870 2026-02-23T06:27:57.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.574+0000 7fabf1ffb640 1 -- 10.20.193.58:0/1918077213 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac00006b20 con 0x7fac0415d870 2026-02-23T06:27:57.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.574+0000 7fabf1ffb640 1 -- 10.20.193.58:0/1918077213 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac00005070 con 0x7fac0415d870 2026-02-23T06:27:57.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.575+0000 7fac0a775640 1 --2- 10.20.193.58:0/1918077213 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac04140f30 0x7fac0413f990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:57.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.575+0000 7fac0a775640 1 -- 10.20.193.58:0/1918077213 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fac04164250 con 0x7fac04140f30 2026-02-23T06:27:57.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.575+0000 7fac09773640 1 --2- 10.20.193.58:0/1918077213 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac04140f30 0x7fac0413f990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:57.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.575+0000 7fac09773640 1 -- 10.20.193.58:0/1918077213 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fac040b6330 con 0x7fac04140f30 2026-02-23T06:27:57.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.576+0000 7fac09773640 1 --2- 10.20.193.58:0/1918077213 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac04140f30 0x7fac0413f990 secure :-1 s=READY pgs=94 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac040b5040 tx=0x7fabf40028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:57.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.576+0000 7fabf1ffb640 1 -- 10.20.193.58:0/1918077213 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fabf403f070 con 0x7fac04140f30 2026-02-23T06:27:57.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.576+0000 7fabf1ffb640 1 -- 10.20.193.58:0/1918077213 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fabf402fe40 con 0x7fac04140f30 2026-02-23T06:27:57.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.576+0000 7fabf1ffb640 1 -- 10.20.193.58:0/1918077213 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac04140f30 msgr2=0x7fac0413f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:57.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.576+0000 7fabf1ffb640 1 --2- 10.20.193.58:0/1918077213 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac04140f30 0x7fac0413f990 secure :-1 s=READY pgs=94 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac040b5040 tx=0x7fabf40028d0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.576+0000 7fabf1ffb640 1 -- 10.20.193.58:0/1918077213 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac04140f30 msgr2=0x7fac0413f990 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:27:57.575 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.576+0000 7fabf1ffb640 1 --2- 10.20.193.58:0/1918077213 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac04140f30 0x7fac0413f990 secure :-1 s=CLOSED pgs=94 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac040b5040 tx=0x7fabf40028d0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.575 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.576+0000 7fabf1ffb640 1 -- 10.20.193.58:0/1918077213 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fac000051d0 con 0x7fac0415d870 2026-02-23T06:27:57.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.577+0000 7fabf1ffb640 1 --2- 10.20.193.58:0/1918077213 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fabd407a430 0x7fabd409a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:57.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.577+0000 7fabf1ffb640 1 -- 10.20.193.58:0/1918077213 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fac0009dc00 con 0x7fac0415d870 2026-02-23T06:27:57.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.577+0000 7fac09773640 1 --2- 10.20.193.58:0/1918077213 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fabd407a430 0x7fabd409a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:57.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.578+0000 7fac09773640 1 --2- 10.20.193.58:0/1918077213 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fabd407a430 0x7fabd409a8e0 secure :-1 s=READY pgs=221 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fabf40098a0 tx=0x7fabf4040000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:57.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.579+0000 7fac0a775640 1 --2- 10.20.193.58:0/1918077213 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac040afe20 0x7fac0413fed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:27:57.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.579+0000 7fac0a775640 1 -- 10.20.193.58:0/1918077213 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fac040b8510 con 0x7fac040afe20 2026-02-23T06:27:57.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.580+0000 7fac08f72640 1 --2- 10.20.193.58:0/1918077213 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac040afe20 0x7fac0413fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:27:57.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.580+0000 7fac08f72640 1 -- 10.20.193.58:0/1918077213 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fac040b7260 con 0x7fac040afe20 2026-02-23T06:27:57.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.580+0000 7fac08f72640 1 --2- 10.20.193.58:0/1918077213 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac040afe20 0x7fac0413fed0 secure :-1 s=READY pgs=95 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac04160f10 tx=0x7fabf8009ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:27:57.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.580+0000 7fabf1ffb640 1 -- 10.20.193.58:0/1918077213 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fabf8011970 con 0x7fac040afe20 2026-02-23T06:27:57.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.581+0000 7fabf1ffb640 1 -- 10.20.193.58:0/1918077213 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5544 (secure 0 0 0) 0x7fabf8011ad0 con 0x7fac040afe20 2026-02-23T06:27:57.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.581+0000 7fabf1ffb640 1 -- 10.20.193.58:0/1918077213 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac040afe20 msgr2=0x7fac0413fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:57.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.581+0000 7fabf1ffb640 1 --2- 10.20.193.58:0/1918077213 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac040afe20 0x7fac0413fed0 secure :-1 s=READY pgs=95 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac04160f10 tx=0x7fabf8009ac0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.581+0000 7fabf1ffb640 1 -- 10.20.193.58:0/1918077213 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac040afe20 msgr2=0x7fac0413fed0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:27:57.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.581+0000 7fabf1ffb640 1 --2- 10.20.193.58:0/1918077213 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac040afe20 0x7fac0413fed0 secure :-1 s=CLOSED pgs=95 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac04160f10 tx=0x7fabf8009ac0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.578 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:27:57.579 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:27:57.579 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:27:57.579 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:27:57.579 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 54, 2026-02-23T06:27:57.579 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 152092, 2026-02-23T06:27:57.579 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:27:57.579 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:27:57.579 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:27:57.579 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:57.580 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:27:57.580 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:27:57.580 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:27:57.580 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:27:57.580 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:57.580 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:57.580 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:57.580 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:57.580 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:57.581 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:57.581 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:57.581 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:57.581 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:57.581 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:57.581 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:57.581 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:57.581 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:57.581 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:57.581 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:27:57.582 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:27:57.582 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:57.582 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:57.582 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:57.582 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:57.582 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:57.582 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:57.582 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:57.582 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:57.582 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:57.583 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:57.583 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:57.583 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:57.583 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:57.583 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:57.583 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:57.583 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:27:57.583 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:27:57.583 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:27:57.583 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:27:57.583 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:27:57.584 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:27:57.584 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:27:57.584 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:27:57.584 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:27:57.584 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:27:57.584 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:27:57.584 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:27:57.584 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:27:57.584 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:27:57.584 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:27:57.584 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:27:57.584 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:27:57.585 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:27:57.585 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:27:57.585 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:27:57.585 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:27:57.585 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:27:57.585 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:27:57.585 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:27:57.585 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:27:57.585 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:27:57.585 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:27:57.585 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:27:57.585 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:27:57.586 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:27:57.586 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:57.586 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:27:57.586 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:57.586 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:27:57.586 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:57.586 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:27:57.586 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:27:57.586 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:57.586 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:57.586 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:57.586 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:57.587 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:27:57.587 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:57.587 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:57.587 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:57.587 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:57.587 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:27:57.587 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:57.587 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:57.587 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:57.587 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:57.587 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:27:57.587 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:27:57.587 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:57.588 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:57.588 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:27:57.588 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:57.588 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:57.588 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:57.588 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:27:57.588 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:27:57.588 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:57.588 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:57.588 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:57.588 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:57.588 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:27:57.589 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:57.589 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:57.589 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:57.589 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:57.589 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:27:57.589 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:57.589 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:57.589 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:57.589 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:57.589 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:27:57.589 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:27:57.589 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:57.589 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:57.590 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:27:57.590 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:57.590 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:57.590 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:57.590 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:27:57.590 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:27:57.590 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:27:57.590 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:27:57.590 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:57.590 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:27:57.590 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:27:57.590 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:57.591 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:57.591 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:57.591 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:27:57.591 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:27:57.591 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:27:57.591 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:57.591 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:57.591 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:57.591 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:27:57.591 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:27:57.591 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:27:57.592 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:27:57.592 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:27:57.592 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:27:57.592 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:57.592 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:57.592 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:57.592 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:27:57.592 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:27:57.592 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:57.592 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:57.592 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:57.593 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:27:57.593 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:57.593 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:57.593 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:27:57.593 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:57.593 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:57.593 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:57.593 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:27:57.593 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:57.593 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:57.593 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:27:57.594 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:57.594 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:57.594 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:57.594 INFO:teuthology.orchestra.run.trial058.stdout: "num": 7 2026-02-23T06:27:57.594 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:57.594 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:57.594 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:27:57.594 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:57.594 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:27:57.594 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:27:57.594 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:27:57.595 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:57.595 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:57.595 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:57.595 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:57.595 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:27:57.595 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:57.595 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:27:57.595 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:27:57.595 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:27:57.595 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:27:57.596 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:27:57.596 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:27:57.596 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:27:57.596 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:27:57.596 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:27:57.596 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:27:57.596 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:27:57.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.581+0000 7fac0a775640 1 -- 10.20.193.58:0/1918077213 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fabd407a430 msgr2=0x7fabd409a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:57.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.581+0000 7fac0a775640 1 --2- 10.20.193.58:0/1918077213 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fabd407a430 0x7fabd409a8e0 secure :-1 s=READY pgs=221 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fabf40098a0 tx=0x7fabf4040000 comp rx=0 tx=0).stop 2026-02-23T06:27:57.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.581+0000 7fac09f74640 1 -- 10.20.193.58:0/1918077213 reap_dead start 2026-02-23T06:27:57.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.581+0000 7fac0a775640 1 -- 10.20.193.58:0/1918077213 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac0415d870 msgr2=0x7fac0413d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:27:57.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.581+0000 7fac0a775640 1 --2- 10.20.193.58:0/1918077213 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac0415d870 0x7fac0413d820 secure :-1 s=READY pgs=93 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac0000c4d0 tx=0x7fac0000c9a0 comp rx=0 tx=0).stop 2026-02-23T06:27:57.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.581+0000 7fac09f74640 1 -- 10.20.193.58:0/1918077213 reap_dead start 2026-02-23T06:27:57.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.581+0000 7fac0a775640 1 -- 10.20.193.58:0/1918077213 shutdown_connections 2026-02-23T06:27:57.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.581+0000 7fac0a775640 1 -- 10.20.193.58:0/1918077213 >> 10.20.193.58:0/1918077213 conn(0x7fac040b3c20 msgr2=0x7fac0415b210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:27:57.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.581+0000 7fac0a775640 1 -- 10.20.193.58:0/1918077213 shutdown_connections 2026-02-23T06:27:57.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:27:57.581+0000 7fac0a775640 1 -- 10.20.193.58:0/1918077213 wait complete. 2026-02-23T06:27:57.600 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:27:57.600 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:28:12.633 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:28:12.638 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:28:17.600 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-23T06:28:17.601 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-23T06:28:17.601 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-23T06:28:17.602 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-23T06:28:17.607 INFO:tasks.ceph.mon.a:Started 2026-02-23T06:28:17.607 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.b 2026-02-23T06:28:17.607 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-23T06:28:17.607 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-23T06:28:17.607 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-23T06:28:32.608 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.b 2026-02-23T06:28:32.608 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-23T06:28:32.608 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-23T06:28:32.608 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:28:32.609 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:28:32.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.735+0000 7f92f8a11640 1 -- 10.20.193.58:0/327387170 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92f415d4a0 msgr2=0x7f92f40affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:32.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.735+0000 7f92f8a11640 1 --2- 10.20.193.58:0/327387170 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92f415d4a0 0x7f92f40affb0 secure :-1 s=READY pgs=73 gs=2 cs=0 l=1 c_cookie=4662559047874386040 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92e8005e70 tx=0x7f92e802f290 comp rx=0 tx=0).stop 2026-02-23T06:28:32.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.735+0000 7f92f8a11640 1 -- 10.20.193.58:0/327387170 shutdown_connections 2026-02-23T06:28:32.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.735+0000 7f92f8a11640 1 --2- 10.20.193.58:0/327387170 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f92f40b6690 0x7f92f4058ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:32.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.735+0000 7f92f8a11640 1 --2- 10.20.193.58:0/327387170 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92f415d4a0 0x7f92f40affb0 unknown :-1 s=CLOSED pgs=73 gs=2 cs=0 l=1 c_cookie=4662559047874386040 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:32.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.736+0000 7f92f8a11640 1 -- 10.20.193.58:0/327387170 >> 10.20.193.58:0/327387170 conn(0x7f92f40b3c20 msgr2=0x7f92f40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:28:32.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.736+0000 7f92f8a11640 1 -- 10.20.193.58:0/327387170 shutdown_connections 2026-02-23T06:28:32.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.736+0000 7f92f8a11640 1 -- 10.20.193.58:0/327387170 wait complete. 2026-02-23T06:28:32.735 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.737+0000 7f92f8a11640 1 Processor -- start 2026-02-23T06:28:32.735 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.737+0000 7f92f8a11640 1 -- start start 2026-02-23T06:28:32.735 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.738+0000 7f92f8a11640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f92f40b6690 0x7f92f413f440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:32.735 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.738+0000 7f92f8a11640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92f415d4a0 0x7f92f4201030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:32.735 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.738+0000 7f92f8a11640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f92f415d870 0x7f92f4057750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:32.735 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.738+0000 7f92f8a11640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f92f415ea80 con 0x7f92f415d870 2026-02-23T06:28:32.735 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.738+0000 7f92f8a11640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f92f415e590 con 0x7f92f415d4a0 2026-02-23T06:28:32.736 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.738+0000 7f92f8a11640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f92f415e7a0 con 0x7f92f40b6690 2026-02-23T06:28:32.736 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.738+0000 7f92f2d76640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f92f40b6690 0x7f92f413f440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:32.736 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.738+0000 7f92f2d76640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f92f40b6690 0x7f92f413f440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:46914/0 (socket says 10.20.193.58:46914) 2026-02-23T06:28:32.736 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.738+0000 7f92f2d76640 1 -- 10.20.193.58:0/2775286555 learned_addr learned my addr 10.20.193.58:0/2775286555 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:28:32.736 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.738+0000 7f92f2575640 1 --2- 10.20.193.58:0/2775286555 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92f415d4a0 0x7f92f4201030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:32.736 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.738+0000 7f92f3577640 1 --2- 10.20.193.58:0/2775286555 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f92f415d870 0x7f92f4057750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:32.736 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.738+0000 7f92f2d76640 1 -- 10.20.193.58:0/2775286555 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92f415d4a0 msgr2=0x7f92f4201030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:32.736 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.738+0000 7f92f2d76640 1 --2- 10.20.193.58:0/2775286555 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92f415d4a0 0x7f92f4201030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:32.736 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.738+0000 7f92f2d76640 1 -- 10.20.193.58:0/2775286555 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f92f415d870 msgr2=0x7f92f4057750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:32.736 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.738+0000 7f92f2d76640 1 --2- 10.20.193.58:0/2775286555 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f92f415d870 0x7f92f4057750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:32.736 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.738+0000 7f92f2d76640 1 -- 10.20.193.58:0/2775286555 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e400a590 con 0x7f92f40b6690 2026-02-23T06:28:32.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.738+0000 7f92f2d76640 1 --2- 10.20.193.58:0/2775286555 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f92f40b6690 0x7f92f413f440 secure :-1 s=READY pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92e8004740 tx=0x7f92e80028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:32.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.739+0000 7f92d37fe640 1 -- 10.20.193.58:0/2775286555 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f92e803d070 con 0x7f92f40b6690 2026-02-23T06:28:32.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.739+0000 7f92d37fe640 1 -- 10.20.193.58:0/2775286555 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92e8038470 con 0x7f92f40b6690 2026-02-23T06:28:32.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.739+0000 7f92d37fe640 1 -- 10.20.193.58:0/2775286555 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f92e8038860 con 0x7f92f40b6690 2026-02-23T06:28:32.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.739+0000 7f92f8a11640 1 -- 10.20.193.58:0/2775286555 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92e8009570 con 0x7f92f40b6690 2026-02-23T06:28:32.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.739+0000 7f92f8a11640 1 -- 10.20.193.58:0/2775286555 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f92f41609f0 con 0x7f92f40b6690 2026-02-23T06:28:32.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.739+0000 7f92f8a11640 1 -- 10.20.193.58:0/2775286555 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92f40b6d50 con 0x7f92f40b6690 2026-02-23T06:28:32.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.740+0000 7f92d37fe640 1 -- 10.20.193.58:0/2775286555 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f92e80389c0 con 0x7f92f40b6690 2026-02-23T06:28:32.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.741+0000 7f92d37fe640 1 --2- 10.20.193.58:0/2775286555 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f92c007a6b0 0x7f92c009ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:32.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.741+0000 7f92d37fe640 1 -- 10.20.193.58:0/2775286555 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f92e80c21e0 con 0x7f92f40b6690 2026-02-23T06:28:32.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.742+0000 7f92f2575640 1 --2- 10.20.193.58:0/2775286555 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f92c007a6b0 0x7f92c009ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:32.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.742+0000 7f92f2575640 1 --2- 10.20.193.58:0/2775286555 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f92c007a6b0 0x7f92c009ab60 secure :-1 s=READY pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92f415ba90 tx=0x7f92dc007de0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:32.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.743+0000 7f92d37fe640 1 -- 10.20.193.58:0/2775286555 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f92e80853a0 con 0x7f92f40b6690 2026-02-23T06:28:32.892 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.897+0000 7f92f8a11640 1 -- 10.20.193.58:0/2775286555 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f92f405b0e0 con 0x7f92f40b6690 2026-02-23T06:28:32.892 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.897+0000 7f92d37fe640 1 -- 10.20.193.58:0/2775286555 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1754 (secure 0 0 0) 0x7f92e80884c0 con 0x7f92f40b6690 2026-02-23T06:28:32.893 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":62,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:28:32.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.898+0000 7f92f8a11640 1 -- 10.20.193.58:0/2775286555 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f92c007a6b0 msgr2=0x7f92c009ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:32.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.898+0000 7f92f8a11640 1 --2- 10.20.193.58:0/2775286555 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f92c007a6b0 0x7f92c009ab60 secure :-1 s=READY pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92f415ba90 tx=0x7f92dc007de0 comp rx=0 tx=0).stop 2026-02-23T06:28:32.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.898+0000 7f92f8a11640 1 -- 10.20.193.58:0/2775286555 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f92f40b6690 msgr2=0x7f92f413f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:32.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.898+0000 7f92f8a11640 1 --2- 10.20.193.58:0/2775286555 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f92f40b6690 0x7f92f413f440 secure :-1 s=READY pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92e8004740 tx=0x7f92e80028d0 comp rx=0 tx=0).stop 2026-02-23T06:28:32.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.898+0000 7f92f8a11640 1 -- 10.20.193.58:0/2775286555 shutdown_connections 2026-02-23T06:28:32.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.898+0000 7f92f8a11640 1 --2- 10.20.193.58:0/2775286555 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f92c007a6b0 0x7f92c009ab60 unknown :-1 s=CLOSED pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:32.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.898+0000 7f92f8a11640 1 --2- 10.20.193.58:0/2775286555 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f92f415d870 0x7f92f4057750 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:32.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.898+0000 7f92f8a11640 1 --2- 10.20.193.58:0/2775286555 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f92f415d4a0 0x7f92f4201030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:32.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.898+0000 7f92f8a11640 1 --2- 10.20.193.58:0/2775286555 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f92f40b6690 0x7f92f413f440 unknown :-1 s=CLOSED pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:32.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.898+0000 7f92f8a11640 1 -- 10.20.193.58:0/2775286555 >> 10.20.193.58:0/2775286555 conn(0x7f92f40b3c20 msgr2=0x7f92f405d100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:28:32.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.898+0000 7f92f8a11640 1 -- 10.20.193.58:0/2775286555 shutdown_connections 2026-02-23T06:28:32.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:32.898+0000 7f92f8a11640 1 -- 10.20.193.58:0/2775286555 wait complete. 2026-02-23T06:28:32.905 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:28:32.906 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:28:32.906 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:28:33.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.033+0000 7fa1cda83640 1 -- 10.20.193.58:0/2447754467 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa1c8056550 msgr2=0x7fa1c805ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:33.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.033+0000 7fa1cda83640 1 --2- 10.20.193.58:0/2447754467 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa1c8056550 0x7fa1c805ce30 secure :-1 s=READY pgs=6 gs=3 cs=0 l=1 c_cookie=1125969637864286529 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1b0005e70 tx=0x7fa1b002f290 comp rx=0 tx=0).stop 2026-02-23T06:28:33.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.033+0000 7fa1cda83640 1 -- 10.20.193.58:0/2447754467 shutdown_connections 2026-02-23T06:28:33.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.033+0000 7fa1cda83640 1 --2- 10.20.193.58:0/2447754467 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa1c8056550 0x7fa1c805ce30 unknown :-1 s=CLOSED pgs=6 gs=3 cs=0 l=1 c_cookie=1125969637864286529 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.033+0000 7fa1cda83640 1 -- 10.20.193.58:0/2447754467 >> 10.20.193.58:0/2447754467 conn(0x7fa1c80b3c20 msgr2=0x7fa1c80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:28:33.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.033+0000 7fa1cda83640 1 -- 10.20.193.58:0/2447754467 shutdown_connections 2026-02-23T06:28:33.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.033+0000 7fa1cda83640 1 -- 10.20.193.58:0/2447754467 wait complete. 2026-02-23T06:28:33.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.034+0000 7fa1cda83640 1 Processor -- start 2026-02-23T06:28:33.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.034+0000 7fa1cda83640 1 -- start start 2026-02-23T06:28:33.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.035+0000 7fa1cda83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa1c8056550 0x7fa1c8201da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:33.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.035+0000 7fa1cda83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa1c805d370 0x7fa1c81fdcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:33.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.035+0000 7fa1cda83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa1c815c040 0x7fa1c8156550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:33.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.035+0000 7fa1cda83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c8156f80 con 0x7fa1c805d370 2026-02-23T06:28:33.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.035+0000 7fa1cda83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c80b1a30 con 0x7fa1c815c040 2026-02-23T06:28:33.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.035+0000 7fa1cda83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa1c81fe1f0 con 0x7fa1c8056550 2026-02-23T06:28:33.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.035+0000 7fa1bffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa1c805d370 0x7fa1c81fdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:33.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.035+0000 7fa1bffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa1c805d370 0x7fa1c81fdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:32776/0 (socket says 10.20.193.58:32776) 2026-02-23T06:28:33.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.035+0000 7fa1bffff640 1 -- 10.20.193.58:0/3440658943 learned_addr learned my addr 10.20.193.58:0/3440658943 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:28:33.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.035+0000 7fa1cd282640 1 --2- 10.20.193.58:0/3440658943 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa1c815c040 0x7fa1c8156550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:33.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.036+0000 7fa1cca81640 1 --2- 10.20.193.58:0/3440658943 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa1c8056550 0x7fa1c8201da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:33.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.036+0000 7fa1bffff640 1 -- 10.20.193.58:0/3440658943 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa1c8056550 msgr2=0x7fa1c8201da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:33.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.036+0000 7fa1bffff640 1 --2- 10.20.193.58:0/3440658943 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa1c8056550 0x7fa1c8201da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.036+0000 7fa1bffff640 1 -- 10.20.193.58:0/3440658943 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa1c815c040 msgr2=0x7fa1c8156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:33.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.036+0000 7fa1bffff640 1 --2- 10.20.193.58:0/3440658943 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa1c815c040 0x7fa1c8156550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.036+0000 7fa1bffff640 1 -- 10.20.193.58:0/3440658943 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b0009570 con 0x7fa1c805d370 2026-02-23T06:28:33.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.036+0000 7fa1cca81640 1 --2- 10.20.193.58:0/3440658943 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa1c8056550 0x7fa1c8201da0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:28:33.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.036+0000 7fa1bffff640 1 --2- 10.20.193.58:0/3440658943 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa1c805d370 0x7fa1c81fdcb0 secure :-1 s=READY pgs=7 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1b0004740 tx=0x7fa1b0002a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:33.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.036+0000 7fa1bd7fa640 1 -- 10.20.193.58:0/3440658943 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa1b003d070 con 0x7fa1c805d370 2026-02-23T06:28:33.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.036+0000 7fa1cda83640 1 -- 10.20.193.58:0/3440658943 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1c8201910 con 0x7fa1c805d370 2026-02-23T06:28:33.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.036+0000 7fa1bd7fa640 1 -- 10.20.193.58:0/3440658943 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1b0038690 con 0x7fa1c805d370 2026-02-23T06:28:33.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.036+0000 7fa1bd7fa640 1 -- 10.20.193.58:0/3440658943 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa1b0038aa0 con 0x7fa1c805d370 2026-02-23T06:28:33.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.036+0000 7fa1cda83640 1 -- 10.20.193.58:0/3440658943 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1c82012c0 con 0x7fa1c805d370 2026-02-23T06:28:33.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.037+0000 7fa1cda83640 1 --2- 10.20.193.58:0/3440658943 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa1c80b10a0 0x7fa1c81514e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:33.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.037+0000 7fa1cda83640 1 -- 10.20.193.58:0/3440658943 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c80b1470 con 0x7fa1c80b10a0 2026-02-23T06:28:33.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.037+0000 7fa1cca81640 1 --2- 10.20.193.58:0/3440658943 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa1c80b10a0 0x7fa1c81514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:33.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.037+0000 7fa1cca81640 1 -- 10.20.193.58:0/3440658943 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa1c805d9c0 con 0x7fa1c80b10a0 2026-02-23T06:28:33.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.037+0000 7fa1cca81640 1 --2- 10.20.193.58:0/3440658943 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa1c80b10a0 0x7fa1c81514e0 secure :-1 s=READY pgs=8 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1b8002730 tx=0x7fa1b800d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:33.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.037+0000 7fa1bd7fa640 1 -- 10.20.193.58:0/3440658943 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa1b8005520 con 0x7fa1c80b10a0 2026-02-23T06:28:33.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.037+0000 7fa1bd7fa640 1 -- 10.20.193.58:0/3440658943 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fa1b8003670 con 0x7fa1c80b10a0 2026-02-23T06:28:33.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.037+0000 7fa1bd7fa640 1 -- 10.20.193.58:0/3440658943 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa1c80b10a0 msgr2=0x7fa1c81514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:33.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.037+0000 7fa1bd7fa640 1 --2- 10.20.193.58:0/3440658943 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa1c80b10a0 0x7fa1c81514e0 secure :-1 s=READY pgs=8 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1b8002730 tx=0x7fa1b800d960 comp rx=0 tx=0).stop 2026-02-23T06:28:33.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.037+0000 7fa1bd7fa640 1 -- 10.20.193.58:0/3440658943 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa1c80b10a0 msgr2=0x7fa1c81514e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:28:33.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.037+0000 7fa1bd7fa640 1 --2- 10.20.193.58:0/3440658943 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa1c80b10a0 0x7fa1c81514e0 unknown :-1 s=CLOSED pgs=8 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.038+0000 7fa1bd7fa640 1 -- 10.20.193.58:0/3440658943 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fa1b0038c00 con 0x7fa1c805d370 2026-02-23T06:28:33.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.039+0000 7fa1bd7fa640 1 --2- 10.20.193.58:0/3440658943 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa19807a3c0 0x7fa19809a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:33.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.039+0000 7fa1bd7fa640 1 -- 10.20.193.58:0/3440658943 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fa1b00c23f0 con 0x7fa1c805d370 2026-02-23T06:28:33.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.040+0000 7fa1cca81640 1 --2- 10.20.193.58:0/3440658943 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa19807a3c0 0x7fa19809a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:33.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.040+0000 7fa1cca81640 1 --2- 10.20.193.58:0/3440658943 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa19807a3c0 0x7fa19809a870 secure :-1 s=READY pgs=224 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1b8002780 tx=0x7fa1b8011000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:33.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.041+0000 7fa1cda83640 1 --2- 10.20.193.58:0/3440658943 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa1c8151a20 0x7fa1c8057090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:33.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.041+0000 7fa1cda83640 1 -- 10.20.193.58:0/3440658943 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c80b5d90 con 0x7fa1c8151a20 2026-02-23T06:28:33.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.041+0000 7fa1cd282640 1 --2- 10.20.193.58:0/3440658943 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa1c8151a20 0x7fa1c8057090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:33.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.041+0000 7fa1cd282640 1 -- 10.20.193.58:0/3440658943 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa1c8201aa0 con 0x7fa1c8151a20 2026-02-23T06:28:33.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.042+0000 7fa1cd282640 1 --2- 10.20.193.58:0/3440658943 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa1c8151a20 0x7fa1c8057090 secure :-1 s=READY pgs=9 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1c400e700 tx=0x7fa1c400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:33.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.042+0000 7fa1bd7fa640 1 -- 10.20.193.58:0/3440658943 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa1c40052f0 con 0x7fa1c8151a20 2026-02-23T06:28:33.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.042+0000 7fa1bd7fa640 1 -- 10.20.193.58:0/3440658943 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4912 (secure 0 0 0) 0x7fa1c4005450 con 0x7fa1c8151a20 2026-02-23T06:28:33.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.042+0000 7fa1bd7fa640 1 -- 10.20.193.58:0/3440658943 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa1c8151a20 msgr2=0x7fa1c8057090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:33.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.042+0000 7fa1bd7fa640 1 --2- 10.20.193.58:0/3440658943 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa1c8151a20 0x7fa1c8057090 secure :-1 s=READY pgs=9 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1c400e700 tx=0x7fa1c400ebd0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.042+0000 7fa1bd7fa640 1 -- 10.20.193.58:0/3440658943 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa1c8151a20 msgr2=0x7fa1c8057090 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:28:33.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.042+0000 7fa1bd7fa640 1 --2- 10.20.193.58:0/3440658943 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa1c8151a20 0x7fa1c8057090 unknown :-1 s=CLOSED pgs=9 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.038 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:28:33.038 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:28:33.038 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:28:33.038 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:28:33.038 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 62, 2026-02-23T06:28:33.038 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 15322, 2026-02-23T06:28:33.038 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:28:33.038 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:28:33.039 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:28:33.039 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:28:33.039 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:33.039 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:28:33.039 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:28:33.039 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:28:33.039 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:28:33.039 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:28:33.039 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:28:33.039 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:28:33.039 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:28:33.039 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:28:33.039 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:28:33.039 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:28:33.039 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:28:33.040 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:28:33.040 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:28:33.040 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:28:33.040 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:28:33.040 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:28:33.040 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:33.040 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:28:33.040 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:28:33.040 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:28:33.040 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:28:33.040 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:28:33.040 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:28:33.040 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:28:33.040 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:28:33.040 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:28:33.040 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:28:33.040 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:28:33.040 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:28:33.040 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:28:33.040 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:28:33.041 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:28:33.041 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:33.041 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.041 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:28:33.041 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:28:33.041 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:28:33.041 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:28:33.041 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:28:33.041 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:28:33.041 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:28:33.041 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:28:33.041 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:28:33.041 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:28:33.041 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:28:33.041 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:28:33.041 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:28:33.041 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:28:33.041 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:28:33.041 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:28:33.041 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:28:33.041 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:28:33.041 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:28:33.041 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:28:33.041 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:28:33.041 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:28:33.041 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:28:33.042 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:28:33.042 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:28:33.042 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:28:33.042 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:28:33.042 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:28:33.042 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:28:33.042 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:28:33.042 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:33.042 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:28:33.042 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.042 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:28:33.042 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.042 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:28:33.042 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:28:33.042 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:28:33.042 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:28:33.042 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.042 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:28:33.042 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:28:33.042 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:33.042 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.042 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.042 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:28:33.042 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:28:33.042 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:33.042 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:33.042 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:33.043 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.043 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:28:33.043 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:28:33.043 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:28:33.043 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:28:33.043 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:28:33.043 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:28:33.043 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.043 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.043 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:28:33.043 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:28:33.043 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:28:33.043 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:28:33.043 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.043 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:28:33.043 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:28:33.043 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:33.043 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.043 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.043 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:28:33.043 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:28:33.043 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:33.043 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:33.043 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:33.043 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.043 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:28:33.043 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:28:33.043 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:28:33.044 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:28:33.044 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:28:33.044 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:28:33.044 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.044 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.044 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:28:33.044 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:28:33.044 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:28:33.044 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:28:33.044 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.044 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:28:33.044 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:28:33.044 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:33.044 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.044 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.044 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:28:33.044 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:28:33.044 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:33.044 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:33.044 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:33.044 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.044 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:28:33.044 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:28:33.045 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:28:33.045 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:28:33.045 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:28:33.045 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:28:33.045 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:33.045 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:33.045 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.045 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:28:33.045 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:28:33.045 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.045 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:28:33.045 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:28:33.045 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:28:33.045 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:33.045 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:33.045 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:28:33.045 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.045 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:28:33.045 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:28:33.045 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:28:33.045 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:33.045 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:33.045 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.045 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:28:33.046 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:28:33.046 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.042+0000 7fa1cda83640 1 -- 10.20.193.58:0/3440658943 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa19807a3c0 msgr2=0x7fa19809a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:33.046 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.042+0000 7fa1cda83640 1 --2- 10.20.193.58:0/3440658943 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa19807a3c0 0x7fa19809a870 secure :-1 s=READY pgs=224 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1b8002780 tx=0x7fa1b8011000 comp rx=0 tx=0).stop 2026-02-23T06:28:33.046 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.042+0000 7fa1cda83640 1 -- 10.20.193.58:0/3440658943 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa1c805d370 msgr2=0x7fa1c81fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:33.046 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.042+0000 7fa1cda83640 1 --2- 10.20.193.58:0/3440658943 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa1c805d370 0x7fa1c81fdcb0 secure :-1 s=READY pgs=7 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1b0004740 tx=0x7fa1b0002a10 comp rx=0 tx=0).stop 2026-02-23T06:28:33.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.042+0000 7fa1cd282640 1 -- 10.20.193.58:0/3440658943 reap_dead start 2026-02-23T06:28:33.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.042+0000 7fa1cda83640 1 -- 10.20.193.58:0/3440658943 shutdown_connections 2026-02-23T06:28:33.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.042+0000 7fa1cda83640 1 --2- 10.20.193.58:0/3440658943 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa1c805d370 0x7fa1c81fdcb0 unknown :-1 s=CLOSED pgs=7 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.042+0000 7fa1cda83640 1 -- 10.20.193.58:0/3440658943 >> 10.20.193.58:0/3440658943 conn(0x7fa1c80b3c20 msgr2=0x7fa1c81574f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:28:33.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.042+0000 7fa1cda83640 1 -- 10.20.193.58:0/3440658943 shutdown_connections 2026-02-23T06:28:33.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.042+0000 7fa1cda83640 1 -- 10.20.193.58:0/3440658943 wait complete. 2026-02-23T06:28:33.047 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:28:33.047 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:28:33.047 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:28:33.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.175+0000 7f9a809d2640 1 -- 10.20.193.58:0/1929889177 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9a7c15d2b0 msgr2=0x7f9a7c163d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:33.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.175+0000 7f9a809d2640 1 --2- 10.20.193.58:0/1929889177 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9a7c15d2b0 0x7f9a7c163d80 secure :-1 s=READY pgs=10 gs=2 cs=0 l=1 c_cookie=14477557770044986096 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a7c054f60 tx=0x7f9a6802f220 comp rx=0 tx=0).stop 2026-02-23T06:28:33.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.175+0000 7f9a809d2640 1 -- 10.20.193.58:0/1929889177 shutdown_connections 2026-02-23T06:28:33.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.175+0000 7f9a809d2640 1 --2- 10.20.193.58:0/1929889177 >> v2:10.20.193.93:3300/0 conn(0x7f9a7c0b5340 0x7f9a7c0b57c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.175+0000 7f9a809d2640 1 --2- 10.20.193.58:0/1929889177 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9a7c0b3750 0x7f9a7c0b1020 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.175+0000 7f9a809d2640 1 --2- 10.20.193.58:0/1929889177 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9a7c15d2b0 0x7f9a7c163d80 unknown :-1 s=CLOSED pgs=10 gs=2 cs=0 l=1 c_cookie=14477557770044986096 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.175+0000 7f9a809d2640 1 -- 10.20.193.58:0/1929889177 >> 10.20.193.58:0/1929889177 conn(0x7f9a7c059db0 msgr2=0x7f9a7c05a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:28:33.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.175+0000 7f9a809d2640 1 -- 10.20.193.58:0/1929889177 shutdown_connections 2026-02-23T06:28:33.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.175+0000 7f9a809d2640 1 -- 10.20.193.58:0/1929889177 wait complete. 2026-02-23T06:28:33.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.176+0000 7f9a809d2640 1 Processor -- start 2026-02-23T06:28:33.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.176+0000 7f9a809d2640 1 -- start start 2026-02-23T06:28:33.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.177+0000 7f9a809d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9a7c0b3750 0x7f9a7c15c7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:33.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.177+0000 7f9a809d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9a7c0b5340 0x7f9a7c158760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:33.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.177+0000 7f9a809d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9a7c15d2b0 0x7f9a7c136a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:33.175 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.177+0000 7f9a809d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c159600 con 0x7f9a7c15d2b0 2026-02-23T06:28:33.175 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.177+0000 7f9a809d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c158ca0 con 0x7f9a7c0b3750 2026-02-23T06:28:33.175 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.177+0000 7f9a809d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f9a7c0b7fa0 con 0x7f9a7c0b5340 2026-02-23T06:28:33.175 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.177+0000 7f9a7bfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9a7c15d2b0 0x7f9a7c136a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:33.175 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.177+0000 7f9a7b7fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9a7c0b3750 0x7f9a7c15c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:33.175 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.177+0000 7f9a7b7fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9a7c0b3750 0x7f9a7c15c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:39566/0 (socket says 10.20.193.58:39566) 2026-02-23T06:28:33.175 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.177+0000 7f9a7b7fe640 1 -- 10.20.193.58:0/2310980092 learned_addr learned my addr 10.20.193.58:0/2310980092 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:28:33.175 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.177+0000 7f9a7affd640 1 --2- 10.20.193.58:0/2310980092 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9a7c0b5340 0x7f9a7c158760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:33.175 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.177+0000 7f9a7bfff640 1 -- 10.20.193.58:0/2310980092 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9a7c0b5340 msgr2=0x7f9a7c158760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:33.176 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.177+0000 7f9a7bfff640 1 --2- 10.20.193.58:0/2310980092 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9a7c0b5340 0x7f9a7c158760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.176 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.177+0000 7f9a7bfff640 1 -- 10.20.193.58:0/2310980092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9a7c0b3750 msgr2=0x7f9a7c15c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:33.176 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.177+0000 7f9a7bfff640 1 --2- 10.20.193.58:0/2310980092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9a7c0b3750 0x7f9a7c15c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.176 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.177+0000 7f9a7bfff640 1 -- 10.20.193.58:0/2310980092 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a6c009570 con 0x7f9a7c15d2b0 2026-02-23T06:28:33.176 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.177+0000 7f9a7bfff640 1 --2- 10.20.193.58:0/2310980092 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9a7c15d2b0 0x7f9a7c136a30 secure :-1 s=READY pgs=11 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a7000f970 tx=0x7f9a7000fe40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:33.176 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.178+0000 7f9a57fff640 1 -- 10.20.193.58:0/2310980092 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a7000dc00 con 0x7f9a7c15d2b0 2026-02-23T06:28:33.176 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.178+0000 7f9a809d2640 1 -- 10.20.193.58:0/2310980092 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a680094b0 con 0x7f9a7c15d2b0 2026-02-23T06:28:33.176 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.178+0000 7f9a57fff640 1 -- 10.20.193.58:0/2310980092 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a7000dd60 con 0x7f9a7c15d2b0 2026-02-23T06:28:33.176 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.178+0000 7f9a57fff640 1 -- 10.20.193.58:0/2310980092 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a7000dc00 con 0x7f9a7c15d2b0 2026-02-23T06:28:33.176 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.178+0000 7f9a809d2640 1 -- 10.20.193.58:0/2310980092 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a7c157960 con 0x7f9a7c15d2b0 2026-02-23T06:28:33.176 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.178+0000 7f9a809d2640 1 --2- 10.20.193.58:0/2310980092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9a7c158ff0 0x7f9a7c139ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:33.177 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.178+0000 7f9a809d2640 1 -- 10.20.193.58:0/2310980092 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c166bd0 con 0x7f9a7c158ff0 2026-02-23T06:28:33.177 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.179+0000 7f9a7b7fe640 1 --2- 10.20.193.58:0/2310980092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9a7c158ff0 0x7f9a7c139ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:33.177 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.179+0000 7f9a7b7fe640 1 -- 10.20.193.58:0/2310980092 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9a7c1668f0 con 0x7f9a7c158ff0 2026-02-23T06:28:33.178 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.179+0000 7f9a57fff640 1 -- 10.20.193.58:0/2310980092 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f9a70020060 con 0x7f9a7c15d2b0 2026-02-23T06:28:33.178 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.179+0000 7f9a7b7fe640 1 --2- 10.20.193.58:0/2310980092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9a7c158ff0 0x7f9a7c139ce0 secure :-1 s=READY pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a6802fec0 tx=0x7f9a680026a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:33.178 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.180+0000 7f9a57fff640 1 --2- 10.20.193.58:0/2310980092 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9a4c07a780 0x7f9a4c09ac30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:33.178 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.180+0000 7f9a57fff640 1 -- 10.20.193.58:0/2310980092 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f9a70015070 con 0x7f9a7c15d2b0 2026-02-23T06:28:33.178 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.180+0000 7f9a57fff640 1 -- 10.20.193.58:0/2310980092 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a6803d050 con 0x7f9a7c158ff0 2026-02-23T06:28:33.179 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.180+0000 7f9a57fff640 1 -- 10.20.193.58:0/2310980092 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f9a6803e040 con 0x7f9a7c158ff0 2026-02-23T06:28:33.179 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.180+0000 7f9a57fff640 1 -- 10.20.193.58:0/2310980092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9a7c158ff0 msgr2=0x7f9a7c139ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:33.179 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.180+0000 7f9a57fff640 1 --2- 10.20.193.58:0/2310980092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9a7c158ff0 0x7f9a7c139ce0 secure :-1 s=READY pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a6802fec0 tx=0x7f9a680026a0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.179 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.180+0000 7f9a57fff640 1 -- 10.20.193.58:0/2310980092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9a7c158ff0 msgr2=0x7f9a7c139ce0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:28:33.179 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.180+0000 7f9a57fff640 1 --2- 10.20.193.58:0/2310980092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9a7c158ff0 0x7f9a7c139ce0 secure :-1 s=CLOSED pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a6802fec0 tx=0x7f9a680026a0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.179 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.181+0000 7f9a7affd640 1 --2- 10.20.193.58:0/2310980092 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9a4c07a780 0x7f9a4c09ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:33.179 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.181+0000 7f9a7affd640 1 --2- 10.20.193.58:0/2310980092 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9a4c07a780 0x7f9a4c09ac30 secure :-1 s=READY pgs=225 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a7c15c750 tx=0x7f9a6c009310 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:33.180 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.184+0000 7f9a809d2640 1 --2- 10.20.193.58:0/2310980092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9a7c13a220 0x7f9a7c153220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:33.180 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.184+0000 7f9a809d2640 1 -- 10.20.193.58:0/2310980092 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c13a5f0 con 0x7f9a7c13a220 2026-02-23T06:28:33.180 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.184+0000 7f9a7b7fe640 1 --2- 10.20.193.58:0/2310980092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9a7c13a220 0x7f9a7c153220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:33.180 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.185+0000 7f9a7b7fe640 1 -- 10.20.193.58:0/2310980092 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9a7c0b7d70 con 0x7f9a7c13a220 2026-02-23T06:28:33.181 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.185+0000 7f9a7b7fe640 1 --2- 10.20.193.58:0/2310980092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9a7c13a220 0x7f9a7c153220 secure :-1 s=READY pgs=75 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a680097e0 tx=0x7f9a68005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:33.181 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.186+0000 7f9a57fff640 1 -- 10.20.193.58:0/2310980092 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a68043460 con 0x7f9a7c13a220 2026-02-23T06:28:33.181 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.186+0000 7f9a57fff640 1 -- 10.20.193.58:0/2310980092 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5245 (secure 0 0 0) 0x7f9a680435c0 con 0x7f9a7c13a220 2026-02-23T06:28:33.181 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.186+0000 7f9a57fff640 1 -- 10.20.193.58:0/2310980092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9a7c13a220 msgr2=0x7f9a7c153220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:33.182 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:28:33.182 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:28:33.182 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:28:33.182 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:28:33.182 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 62, 2026-02-23T06:28:33.182 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 114697, 2026-02-23T06:28:33.182 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:28:33.182 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:28:33.182 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:28:33.183 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:28:33.183 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:33.183 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:28:33.183 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:28:33.183 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:28:33.183 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:28:33.183 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:28:33.183 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:28:33.183 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:28:33.183 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:28:33.183 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:28:33.183 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:28:33.184 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:28:33.184 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:28:33.184 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:28:33.184 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:28:33.184 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:28:33.184 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:28:33.184 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:28:33.184 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:33.184 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:28:33.184 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:28:33.184 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:28:33.184 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:28:33.185 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:28:33.185 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:28:33.185 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:28:33.185 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:28:33.185 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:28:33.185 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:28:33.185 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:28:33.185 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:28:33.185 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:28:33.185 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:28:33.186 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:28:33.186 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:33.186 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.186 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:28:33.186 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:28:33.186 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:28:33.186 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:28:33.186 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:28:33.186 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:28:33.186 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:28:33.187 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:28:33.187 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:28:33.187 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:28:33.187 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:28:33.187 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:28:33.187 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:28:33.187 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:28:33.187 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:28:33.187 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:28:33.187 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:28:33.187 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:28:33.187 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:28:33.188 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:28:33.188 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:28:33.188 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:28:33.188 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:28:33.188 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:28:33.188 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:28:33.188 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:28:33.188 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:28:33.188 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:28:33.188 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:28:33.188 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:28:33.188 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:33.188 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:28:33.189 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.189 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:28:33.189 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.189 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:28:33.189 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:28:33.189 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:28:33.189 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:28:33.189 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.189 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:28:33.189 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:28:33.189 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:33.189 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.190 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.190 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:28:33.190 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:28:33.190 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:33.190 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:33.190 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:33.190 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.190 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:28:33.190 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:28:33.190 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:28:33.190 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:28:33.190 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:28:33.191 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:28:33.191 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.191 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.191 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:28:33.191 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:28:33.191 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:28:33.191 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:28:33.191 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.191 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:28:33.191 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:28:33.191 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:33.191 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.191 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.192 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:28:33.192 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:28:33.192 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:33.192 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:33.192 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:33.192 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.192 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:28:33.192 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:28:33.192 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:28:33.192 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:28:33.192 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:28:33.192 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:28:33.192 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.193 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.193 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:28:33.193 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:28:33.193 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:28:33.193 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:28:33.193 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.193 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:28:33.193 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:28:33.193 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:33.193 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.193 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.193 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:28:33.193 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:28:33.194 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:33.194 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:33.194 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:33.194 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.194 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:28:33.194 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:28:33.194 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:28:33.194 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:28:33.194 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:28:33.194 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:28:33.194 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:33.194 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:33.195 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.195 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:28:33.195 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:28:33.195 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.195 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:28:33.195 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:28:33.195 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:28:33.195 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:33.195 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:33.195 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:28:33.195 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.195 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:28:33.196 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:28:33.196 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:28:33.196 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:33.196 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:33.196 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:28:33.196 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.196 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:28:33.196 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:28:33.196 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:28:33.197 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:33.197 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:33.197 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:28:33.197 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.197 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:28:33.197 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:28:33.197 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:28:33.197 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:33.197 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:33.197 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.197 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:28:33.197 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:28:33.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.186+0000 7f9a57fff640 1 --2- 10.20.193.58:0/2310980092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9a7c13a220 0x7f9a7c153220 secure :-1 s=READY pgs=75 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a680097e0 tx=0x7f9a68005f90 comp rx=0 tx=0).stop 2026-02-23T06:28:33.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.186+0000 7f9a57fff640 1 -- 10.20.193.58:0/2310980092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9a7c13a220 msgr2=0x7f9a7c153220 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:28:33.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.186+0000 7f9a57fff640 1 --2- 10.20.193.58:0/2310980092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9a7c13a220 0x7f9a7c153220 secure :-1 s=CLOSED pgs=75 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a680097e0 tx=0x7f9a68005f90 comp rx=0 tx=0).stop 2026-02-23T06:28:33.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.186+0000 7f9a809d2640 1 -- 10.20.193.58:0/2310980092 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9a4c07a780 msgr2=0x7f9a4c09ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:33.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.186+0000 7f9a809d2640 1 --2- 10.20.193.58:0/2310980092 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9a4c07a780 0x7f9a4c09ac30 secure :-1 s=READY pgs=225 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a7c15c750 tx=0x7f9a6c009310 comp rx=0 tx=0).stop 2026-02-23T06:28:33.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.186+0000 7f9a809d2640 1 -- 10.20.193.58:0/2310980092 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9a7c15d2b0 msgr2=0x7f9a7c136a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:33.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.186+0000 7f9a809d2640 1 --2- 10.20.193.58:0/2310980092 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9a7c15d2b0 0x7f9a7c136a30 secure :-1 s=READY pgs=11 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a7000f970 tx=0x7f9a7000fe40 comp rx=0 tx=0).stop 2026-02-23T06:28:33.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.186+0000 7f9a7bfff640 1 -- 10.20.193.58:0/2310980092 reap_dead start 2026-02-23T06:28:33.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.186+0000 7f9a7bfff640 1 -- 10.20.193.58:0/2310980092 reap_dead start 2026-02-23T06:28:33.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.186+0000 7f9a809d2640 1 -- 10.20.193.58:0/2310980092 shutdown_connections 2026-02-23T06:28:33.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.186+0000 7f9a809d2640 1 -- 10.20.193.58:0/2310980092 >> 10.20.193.58:0/2310980092 conn(0x7f9a7c059db0 msgr2=0x7f9a7c0569e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:28:33.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.186+0000 7f9a809d2640 1 -- 10.20.193.58:0/2310980092 shutdown_connections 2026-02-23T06:28:33.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.186+0000 7f9a809d2640 1 -- 10.20.193.58:0/2310980092 wait complete. 2026-02-23T06:28:33.201 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:28:33.201 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:28:33.201 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:28:33.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.328+0000 7f199490b640 1 -- 10.20.193.58:0/2799224035 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f199015d4a0 msgr2=0x7f19900affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:33.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.328+0000 7f199490b640 1 --2- 10.20.193.58:0/2799224035 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f199015d4a0 0x7f19900affb0 secure :-1 s=READY pgs=13 gs=3 cs=0 l=1 c_cookie=265089377947476838 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1984005e70 tx=0x7f198402f2e0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.328+0000 7f199490b640 1 -- 10.20.193.58:0/2799224035 shutdown_connections 2026-02-23T06:28:33.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.328+0000 7f199490b640 1 --2- 10.20.193.58:0/2799224035 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f199015d4a0 0x7f19900affb0 unknown :-1 s=CLOSED pgs=13 gs=3 cs=0 l=1 c_cookie=265089377947476838 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.328+0000 7f199490b640 1 -- 10.20.193.58:0/2799224035 >> 10.20.193.58:0/2799224035 conn(0x7f19900b3c20 msgr2=0x7f19900b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:28:33.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.328+0000 7f199490b640 1 -- 10.20.193.58:0/2799224035 shutdown_connections 2026-02-23T06:28:33.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.328+0000 7f199490b640 1 -- 10.20.193.58:0/2799224035 wait complete. 2026-02-23T06:28:33.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.329+0000 7f199490b640 1 Processor -- start 2026-02-23T06:28:33.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.329+0000 7f199490b640 1 -- start start 2026-02-23T06:28:33.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.330+0000 7f199490b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f19900b6690 0x7f199015a660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:33.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.330+0000 7f199490b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f199015d4a0 0x7f199013b400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:33.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.330+0000 7f199490b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f199015d870 0x7f19901622c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:33.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.330+0000 7f199490b640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f199013bc90 con 0x7f199015d870 2026-02-23T06:28:33.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.330+0000 7f199490b640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f199015aba0 con 0x7f19900b6690 2026-02-23T06:28:33.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.330+0000 7f199490b640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f199005c5d0 con 0x7f199015d4a0 2026-02-23T06:28:33.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.330+0000 7f198ed76640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f19900b6690 0x7f199015a660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:33.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.330+0000 7f198e575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f199015d4a0 0x7f199013b400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:33.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.330+0000 7f198e575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f199015d4a0 0x7f199013b400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:46936/0 (socket says 10.20.193.58:46936) 2026-02-23T06:28:33.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.330+0000 7f198ed76640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f19900b6690 0x7f199015a660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:39604/0 (socket says 10.20.193.58:39604) 2026-02-23T06:28:33.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.330+0000 7f198e575640 1 -- 10.20.193.58:0/3281733273 learned_addr learned my addr 10.20.193.58:0/3281733273 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:28:33.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.330+0000 7f198f577640 1 --2- 10.20.193.58:0/3281733273 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f199015d870 0x7f19901622c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:33.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.330+0000 7f198e575640 1 -- 10.20.193.58:0/3281733273 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f19900b6690 msgr2=0x7f199015a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:33.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.330+0000 7f198e575640 1 --2- 10.20.193.58:0/3281733273 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f19900b6690 0x7f199015a660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.330+0000 7f198e575640 1 -- 10.20.193.58:0/3281733273 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f199015d870 msgr2=0x7f19901622c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:33.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.330+0000 7f198e575640 1 --2- 10.20.193.58:0/3281733273 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f199015d870 0x7f19901622c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.330+0000 7f198e575640 1 -- 10.20.193.58:0/3281733273 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1984009570 con 0x7f199015d4a0 2026-02-23T06:28:33.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.331+0000 7f198e575640 1 --2- 10.20.193.58:0/3281733273 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f199015d4a0 0x7f199013b400 secure :-1 s=READY pgs=100 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1978007fd0 tx=0x7f197800c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:33.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.331+0000 7f196f7fe640 1 -- 10.20.193.58:0/3281733273 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19780054a0 con 0x7f199015d4a0 2026-02-23T06:28:33.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.331+0000 7f196f7fe640 1 -- 10.20.193.58:0/3281733273 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19780036b0 con 0x7f199015d4a0 2026-02-23T06:28:33.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.331+0000 7f196f7fe640 1 -- 10.20.193.58:0/3281733273 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1978003ac0 con 0x7f199015d4a0 2026-02-23T06:28:33.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.331+0000 7f199490b640 1 -- 10.20.193.58:0/3281733273 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f199013aeb0 con 0x7f199015d4a0 2026-02-23T06:28:33.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.331+0000 7f199490b640 1 -- 10.20.193.58:0/3281733273 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f19901fe6b0 con 0x7f199015d4a0 2026-02-23T06:28:33.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.331+0000 7f199490b640 1 --2- 10.20.193.58:0/3281733273 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f199013d520 0x7f1990162800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:33.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.331+0000 7f199490b640 1 -- 10.20.193.58:0/3281733273 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f19900609c0 con 0x7f199013d520 2026-02-23T06:28:33.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.332+0000 7f198ed76640 1 --2- 10.20.193.58:0/3281733273 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f199013d520 0x7f1990162800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:33.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.332+0000 7f198ed76640 1 -- 10.20.193.58:0/3281733273 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1990164250 con 0x7f199013d520 2026-02-23T06:28:33.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.333+0000 7f196f7fe640 1 -- 10.20.193.58:0/3281733273 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f1978003c20 con 0x7f199015d4a0 2026-02-23T06:28:33.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.333+0000 7f198ed76640 1 --2- 10.20.193.58:0/3281733273 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f199013d520 0x7f1990162800 secure :-1 s=READY pgs=101 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1984004740 tx=0x7f19840029a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:33.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.333+0000 7f196f7fe640 1 --2- 10.20.193.58:0/3281733273 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f195c07a6c0 0x7f195c09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:33.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.334+0000 7f196f7fe640 1 -- 10.20.193.58:0/3281733273 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f197809c950 con 0x7f199015d4a0 2026-02-23T06:28:33.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.334+0000 7f196f7fe640 1 -- 10.20.193.58:0/3281733273 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f198403d050 con 0x7f199013d520 2026-02-23T06:28:33.329 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.334+0000 7f196f7fe640 1 -- 10.20.193.58:0/3281733273 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f198403e040 con 0x7f199013d520 2026-02-23T06:28:33.329 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.334+0000 7f196f7fe640 1 -- 10.20.193.58:0/3281733273 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f199013d520 msgr2=0x7f1990162800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:33.329 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.334+0000 7f196f7fe640 1 --2- 10.20.193.58:0/3281733273 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f199013d520 0x7f1990162800 secure :-1 s=READY pgs=101 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1984004740 tx=0x7f19840029a0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.329 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.334+0000 7f196f7fe640 1 -- 10.20.193.58:0/3281733273 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f199013d520 msgr2=0x7f1990162800 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:28:33.329 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.334+0000 7f196f7fe640 1 --2- 10.20.193.58:0/3281733273 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f199013d520 0x7f1990162800 unknown :-1 s=CLOSED pgs=101 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.329 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.334+0000 7f198f577640 1 --2- 10.20.193.58:0/3281733273 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f195c07a6c0 0x7f195c09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:33.329 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.334+0000 7f198f577640 1 --2- 10.20.193.58:0/3281733273 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f195c07a6c0 0x7f195c09ab70 secure :-1 s=READY pgs=226 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1980008fd0 tx=0x7f1980008f20 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:33.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.337+0000 7f199490b640 1 --2- 10.20.193.58:0/3281733273 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1990162d40 0x7f1990200e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:33.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.337+0000 7f199490b640 1 -- 10.20.193.58:0/3281733273 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f19900b6330 con 0x7f1990162d40 2026-02-23T06:28:33.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.338+0000 7f198ed76640 1 --2- 10.20.193.58:0/3281733273 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1990162d40 0x7f1990200e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:33.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.338+0000 7f198ed76640 1 -- 10.20.193.58:0/3281733273 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f199005b0e0 con 0x7f1990162d40 2026-02-23T06:28:33.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.338+0000 7f198ed76640 1 --2- 10.20.193.58:0/3281733273 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1990162d40 0x7f1990200e20 secure :-1 s=READY pgs=102 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1984004740 tx=0x7f1984009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:33.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.338+0000 7f196f7fe640 1 -- 10.20.193.58:0/3281733273 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1984052070 con 0x7f1990162d40 2026-02-23T06:28:33.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.339+0000 7f196f7fe640 1 -- 10.20.193.58:0/3281733273 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5555 (secure 0 0 0) 0x7f198404b420 con 0x7f1990162d40 2026-02-23T06:28:33.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.339+0000 7f196f7fe640 1 -- 10.20.193.58:0/3281733273 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1990162d40 msgr2=0x7f1990200e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:33.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.339+0000 7f196f7fe640 1 --2- 10.20.193.58:0/3281733273 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1990162d40 0x7f1990200e20 secure :-1 s=READY pgs=102 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1984004740 tx=0x7f1984009310 comp rx=0 tx=0).stop 2026-02-23T06:28:33.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.339+0000 7f196f7fe640 1 -- 10.20.193.58:0/3281733273 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1990162d40 msgr2=0x7f1990200e20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:28:33.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.339+0000 7f196f7fe640 1 --2- 10.20.193.58:0/3281733273 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1990162d40 0x7f1990200e20 unknown :-1 s=CLOSED pgs=102 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.334 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:28:33.334 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:28:33.335 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:28:33.335 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:28:33.335 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 62, 2026-02-23T06:28:33.335 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 187850, 2026-02-23T06:28:33.335 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:28:33.335 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:28:33.335 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:28:33.335 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:28:33.335 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:33.335 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:28:33.336 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:28:33.336 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:28:33.336 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:28:33.336 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:28:33.336 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:28:33.336 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:28:33.336 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:28:33.336 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:28:33.336 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:28:33.336 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:28:33.336 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:28:33.337 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:28:33.337 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:28:33.337 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:28:33.337 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:28:33.337 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:28:33.337 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:33.337 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:28:33.337 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:28:33.337 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:28:33.337 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:28:33.337 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:28:33.337 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:28:33.338 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:28:33.338 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:28:33.338 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:28:33.338 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:28:33.338 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:28:33.338 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:28:33.338 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:28:33.338 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:28:33.338 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:28:33.338 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:33.338 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.338 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:28:33.339 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:28:33.339 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:28:33.339 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:28:33.339 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:28:33.339 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:28:33.339 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:28:33.339 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:28:33.339 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:28:33.339 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:28:33.339 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:28:33.339 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:28:33.340 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:28:33.340 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:28:33.340 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:28:33.340 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:28:33.340 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:28:33.340 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:28:33.340 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:28:33.340 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:28:33.340 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:28:33.340 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:28:33.340 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:28:33.340 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:28:33.340 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:28:33.341 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:28:33.341 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:28:33.341 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:28:33.341 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:28:33.341 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:28:33.341 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:33.341 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:28:33.341 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.341 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:28:33.341 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.341 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:28:33.341 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:28:33.342 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:28:33.342 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:28:33.342 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.342 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:28:33.342 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:28:33.342 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:33.342 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.342 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.342 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:28:33.342 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:28:33.342 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:33.342 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:33.343 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:33.343 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.343 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:28:33.343 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:28:33.343 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:28:33.343 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:28:33.343 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:28:33.343 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:28:33.343 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.343 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.343 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:28:33.344 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:28:33.344 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:28:33.344 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:28:33.344 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.344 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:28:33.344 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:28:33.344 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:33.344 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.344 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.344 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:28:33.345 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:28:33.345 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:33.345 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:33.345 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:33.345 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.345 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:28:33.345 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:28:33.345 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:28:33.346 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:28:33.346 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:28:33.346 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:28:33.346 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.346 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.346 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:28:33.346 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:28:33.346 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:28:33.346 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:28:33.346 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.347 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:28:33.347 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:28:33.347 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:33.347 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.347 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.347 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:28:33.347 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:28:33.347 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:33.347 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:33.347 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:33.347 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.347 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:28:33.348 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:28:33.348 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:28:33.348 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:28:33.348 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:28:33.348 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:28:33.348 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:33.348 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:33.348 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.348 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:28:33.348 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:28:33.348 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.349 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:28:33.349 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:28:33.349 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:28:33.349 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:33.349 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:33.349 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:28:33.349 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.349 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:28:33.349 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:28:33.349 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:28:33.349 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:33.349 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:33.349 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:28:33.350 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.350 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:28:33.350 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:28:33.350 INFO:teuthology.orchestra.run.trial058.stdout: "num": 7 2026-02-23T06:28:33.350 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:33.350 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:33.350 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:28:33.350 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.350 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:28:33.350 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:28:33.350 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:28:33.350 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.351 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.351 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:28:33.351 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:28:33.351 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:28:33.351 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:33.351 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:33.351 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:28:33.351 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:33.351 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:28:33.351 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:28:33.351 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:28:33.351 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:33.351 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:33.352 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:33.352 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:28:33.352 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:28:33.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.339+0000 7f199490b640 1 -- 10.20.193.58:0/3281733273 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f195c07a6c0 msgr2=0x7f195c09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:33.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.339+0000 7f199490b640 1 --2- 10.20.193.58:0/3281733273 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f195c07a6c0 0x7f195c09ab70 secure :-1 s=READY pgs=226 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1980008fd0 tx=0x7f1980008f20 comp rx=0 tx=0).stop 2026-02-23T06:28:33.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.339+0000 7f199490b640 1 -- 10.20.193.58:0/3281733273 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f199015d4a0 msgr2=0x7f199013b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:33.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.339+0000 7f199490b640 1 --2- 10.20.193.58:0/3281733273 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f199015d4a0 0x7f199013b400 secure :-1 s=READY pgs=100 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1978007fd0 tx=0x7f197800c950 comp rx=0 tx=0).stop 2026-02-23T06:28:33.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.339+0000 7f198f577640 1 -- 10.20.193.58:0/3281733273 reap_dead start 2026-02-23T06:28:33.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.339+0000 7f198f577640 1 -- 10.20.193.58:0/3281733273 reap_dead start 2026-02-23T06:28:33.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.339+0000 7f199490b640 1 -- 10.20.193.58:0/3281733273 shutdown_connections 2026-02-23T06:28:33.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.339+0000 7f199490b640 1 -- 10.20.193.58:0/3281733273 >> 10.20.193.58:0/3281733273 conn(0x7f19900b3c20 msgr2=0x7f19900b0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:28:33.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.339+0000 7f199490b640 1 -- 10.20.193.58:0/3281733273 shutdown_connections 2026-02-23T06:28:33.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.339+0000 7f199490b640 1 -- 10.20.193.58:0/3281733273 wait complete. 2026-02-23T06:28:33.355 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:28:33.355 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:28:33.355 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:28:33.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.481+0000 7fa73f483640 1 -- 10.20.193.58:0/2436448019 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa73815c4b0 msgr2=0x7fa738058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:33.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.481+0000 7fa73f483640 1 --2- 10.20.193.58:0/2436448019 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa73815c4b0 0x7fa738058200 secure :-1 s=READY pgs=77 gs=3 cs=0 l=1 c_cookie=4446858832395728055 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa738059b80 tx=0x7fa72802f190 comp rx=0 tx=0).stop 2026-02-23T06:28:33.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.481+0000 7fa73f483640 1 -- 10.20.193.58:0/2436448019 shutdown_connections 2026-02-23T06:28:33.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.481+0000 7fa73f483640 1 --2- 10.20.193.58:0/2436448019 >> v2:10.20.193.58:3300/0 conn(0x7fa738162ca0 0x7fa7380b6c60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.481+0000 7fa73f483640 1 --2- 10.20.193.58:0/2436448019 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa738056960 0x7fa7380b6720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.481+0000 7fa73f483640 1 --2- 10.20.193.58:0/2436448019 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa73815c4b0 0x7fa738058200 unknown :-1 s=CLOSED pgs=77 gs=3 cs=0 l=1 c_cookie=4446858832395728055 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.481+0000 7fa73f483640 1 -- 10.20.193.58:0/2436448019 >> 10.20.193.58:0/2436448019 conn(0x7fa7380b3c20 msgr2=0x7fa7380b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:28:33.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.481+0000 7fa73f483640 1 -- 10.20.193.58:0/2436448019 shutdown_connections 2026-02-23T06:28:33.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.481+0000 7fa73f483640 1 -- 10.20.193.58:0/2436448019 wait complete. 2026-02-23T06:28:33.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.482+0000 7fa73f483640 1 Processor -- start 2026-02-23T06:28:33.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.483+0000 7fa73f483640 1 -- start start 2026-02-23T06:28:33.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.483+0000 7fa73f483640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa738056960 0x7fa73813bc30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:33.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.483+0000 7fa73f483640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa73815c4b0 0x7fa7380b03d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:33.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.483+0000 7fa73f483640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa738162ca0 0x7fa7381770e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:33.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.483+0000 7fa73f483640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa73815fb00 con 0x7fa73815c4b0 2026-02-23T06:28:33.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.483+0000 7fa73f483640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fa73805d8f0 con 0x7fa738162ca0 2026-02-23T06:28:33.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.483+0000 7fa73f483640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa73815f820 con 0x7fa738056960 2026-02-23T06:28:33.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.483+0000 7fa73dc80640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa73815c4b0 0x7fa7380b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:33.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.483+0000 7fa73e481640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa738056960 0x7fa73813bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:33.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.483+0000 7fa73dc80640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa73815c4b0 0x7fa7380b03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:32850/0 (socket says 10.20.193.58:32850) 2026-02-23T06:28:33.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.483+0000 7fa73dc80640 1 -- 10.20.193.58:0/2402407543 learned_addr learned my addr 10.20.193.58:0/2402407543 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:28:33.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.483+0000 7fa73e481640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa738056960 0x7fa73813bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:46968/0 (socket says 10.20.193.58:46968) 2026-02-23T06:28:33.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.483+0000 7fa73ec82640 1 --2- 10.20.193.58:0/2402407543 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa738162ca0 0x7fa7381770e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:33.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.484+0000 7fa73dc80640 1 -- 10.20.193.58:0/2402407543 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa738056960 msgr2=0x7fa73813bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:33.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.484+0000 7fa73dc80640 1 --2- 10.20.193.58:0/2402407543 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa738056960 0x7fa73813bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.484+0000 7fa73dc80640 1 -- 10.20.193.58:0/2402407543 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa738162ca0 msgr2=0x7fa7381770e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:33.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.484+0000 7fa73dc80640 1 --2- 10.20.193.58:0/2402407543 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa738162ca0 0x7fa7381770e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.484+0000 7fa73dc80640 1 -- 10.20.193.58:0/2402407543 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa73400a650 con 0x7fa73815c4b0 2026-02-23T06:28:33.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.484+0000 7fa73ec82640 1 --2- 10.20.193.58:0/2402407543 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa738162ca0 0x7fa7381770e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:28:33.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.484+0000 7fa73dc80640 1 --2- 10.20.193.58:0/2402407543 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa73815c4b0 0x7fa7380b03d0 secure :-1 s=READY pgs=14 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa72c009480 tx=0x7fa72c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:33.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.484+0000 7fa71effd640 1 -- 10.20.193.58:0/2402407543 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa72c00cc80 con 0x7fa73815c4b0 2026-02-23T06:28:33.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.484+0000 7fa71effd640 1 -- 10.20.193.58:0/2402407543 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa72c00cde0 con 0x7fa73815c4b0 2026-02-23T06:28:33.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.484+0000 7fa71effd640 1 -- 10.20.193.58:0/2402407543 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa72c004ad0 con 0x7fa73815c4b0 2026-02-23T06:28:33.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.484+0000 7fa73f483640 1 -- 10.20.193.58:0/2402407543 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7280094b0 con 0x7fa73815c4b0 2026-02-23T06:28:33.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.484+0000 7fa73f483640 1 -- 10.20.193.58:0/2402407543 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa73813d9f0 con 0x7fa73815c4b0 2026-02-23T06:28:33.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.485+0000 7fa73f483640 1 -- 10.20.193.58:0/2402407543 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa73815a880 con 0x7fa73815c4b0 2026-02-23T06:28:33.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.486+0000 7fa71effd640 1 -- 10.20.193.58:0/2402407543 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fa72c01f060 con 0x7fa73815c4b0 2026-02-23T06:28:33.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.487+0000 7fa71effd640 1 --2- 10.20.193.58:0/2402407543 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa70807a6b0 0x7fa70809ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:33.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.487+0000 7fa71effd640 1 -- 10.20.193.58:0/2402407543 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fa72c014070 con 0x7fa73815c4b0 2026-02-23T06:28:33.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.487+0000 7fa73e481640 1 --2- 10.20.193.58:0/2402407543 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa70807a6b0 0x7fa70809ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:33.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.488+0000 7fa73e481640 1 --2- 10.20.193.58:0/2402407543 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa70807a6b0 0x7fa70809ab60 secure :-1 s=READY pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa728032040 tx=0x7fa72803a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:33.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.489+0000 7fa71effd640 1 -- 10.20.193.58:0/2402407543 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fa72c060d30 con 0x7fa73815c4b0 2026-02-23T06:28:33.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.644+0000 7fa73f483640 1 -- 10.20.193.58:0/2402407543 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fa73815a5a0 con 0x7fa73815c4b0 2026-02-23T06:28:33.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.645+0000 7fa71effd640 1 -- 10.20.193.58:0/2402407543 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fa72c063ee0 con 0x7fa73815c4b0 2026-02-23T06:28:33.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.646+0000 7fa73f483640 1 -- 10.20.193.58:0/2402407543 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa70807a6b0 msgr2=0x7fa70809ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:33.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.646+0000 7fa73f483640 1 --2- 10.20.193.58:0/2402407543 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa70807a6b0 0x7fa70809ab60 secure :-1 s=READY pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa728032040 tx=0x7fa72803a040 comp rx=0 tx=0).stop 2026-02-23T06:28:33.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.646+0000 7fa73f483640 1 -- 10.20.193.58:0/2402407543 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa73815c4b0 msgr2=0x7fa7380b03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:33.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.646+0000 7fa73f483640 1 --2- 10.20.193.58:0/2402407543 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa73815c4b0 0x7fa7380b03d0 secure :-1 s=READY pgs=14 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa72c009480 tx=0x7fa72c00ee60 comp rx=0 tx=0).stop 2026-02-23T06:28:33.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.646+0000 7fa73f483640 1 -- 10.20.193.58:0/2402407543 shutdown_connections 2026-02-23T06:28:33.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.646+0000 7fa73f483640 1 --2- 10.20.193.58:0/2402407543 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa70807a6b0 0x7fa70809ab60 unknown :-1 s=CLOSED pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.646+0000 7fa73f483640 1 --2- 10.20.193.58:0/2402407543 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa738162ca0 0x7fa7381770e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.646+0000 7fa73f483640 1 --2- 10.20.193.58:0/2402407543 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa73815c4b0 0x7fa7380b03d0 unknown :-1 s=CLOSED pgs=14 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.646+0000 7fa73f483640 1 --2- 10.20.193.58:0/2402407543 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa738056960 0x7fa73813bc30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:33.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.646+0000 7fa73f483640 1 -- 10.20.193.58:0/2402407543 >> 10.20.193.58:0/2402407543 conn(0x7fa7380b3c20 msgr2=0x7fa7380b6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:28:33.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.646+0000 7fa73f483640 1 -- 10.20.193.58:0/2402407543 shutdown_connections 2026-02-23T06:28:33.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:33.646+0000 7fa73f483640 1 -- 10.20.193.58:0/2402407543 wait complete. 2026-02-23T06:28:33.652 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:28:42.700 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:28:42.704 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:28:43.653 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:28:43.654 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:28:43.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.780+0000 7fa4fcf0c640 1 -- 10.20.193.58:0/328768201 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa4e4004d90 msgr2=0x7fa4e4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:43.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.780+0000 7fa4fcf0c640 1 --2- 10.20.193.58:0/328768201 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa4e4004d90 0x7fa4e4005200 secure :-1 s=READY pgs=16 gs=5 cs=0 l=1 c_cookie=11581515848708081397 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4f8055250 tx=0x7fa4e8030c60 comp rx=0 tx=0).stop 2026-02-23T06:28:43.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.780+0000 7fa4f6d76640 1 -- 10.20.193.58:0/328768201 reap_dead start 2026-02-23T06:28:43.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.780+0000 7fa4fcf0c640 1 -- 10.20.193.58:0/328768201 shutdown_connections 2026-02-23T06:28:43.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.780+0000 7fa4fcf0c640 1 -- 10.20.193.58:0/328768201 >> 10.20.193.58:0/328768201 conn(0x7fa4f80561f0 msgr2=0x7fa4f80565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:28:43.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.780+0000 7fa4fcf0c640 1 -- 10.20.193.58:0/328768201 shutdown_connections 2026-02-23T06:28:43.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.780+0000 7fa4fcf0c640 1 -- 10.20.193.58:0/328768201 wait complete. 2026-02-23T06:28:43.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.781+0000 7fa4fcf0c640 1 Processor -- start 2026-02-23T06:28:43.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.782+0000 7fa4fcf0c640 1 -- start start 2026-02-23T06:28:43.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.782+0000 7fa4fcf0c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa4e4004d90 0x7fa4f815c2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:43.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.782+0000 7fa4fcf0c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa4f813fbd0 0x7fa4f813cd60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:43.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.782+0000 7fa4fcf0c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa4f813d2a0 0x7fa4f81383b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:43.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.782+0000 7fa4fcf0c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f81412b0 con 0x7fa4f813fbd0 2026-02-23T06:28:43.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.782+0000 7fa4fcf0c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f81651f0 con 0x7fa4f813d2a0 2026-02-23T06:28:43.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.782+0000 7fa4fcf0c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa4f8165840 con 0x7fa4e4004d90 2026-02-23T06:28:43.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.782+0000 7fa4f5d74640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa4f813fbd0 0x7fa4f813cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:43.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.782+0000 7fa4f5d74640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa4f813fbd0 0x7fa4f813cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:47900/0 (socket says 10.20.193.58:47900) 2026-02-23T06:28:43.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.782+0000 7fa4f5d74640 1 -- 10.20.193.58:0/1582689969 learned_addr learned my addr 10.20.193.58:0/1582689969 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:28:43.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.782+0000 7fa4f6575640 1 --2- 10.20.193.58:0/1582689969 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa4e4004d90 0x7fa4f815c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:43.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.783+0000 7fa4f6d76640 1 --2- 10.20.193.58:0/1582689969 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa4f813d2a0 0x7fa4f81383b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:43.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.783+0000 7fa4f5d74640 1 -- 10.20.193.58:0/1582689969 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa4e4004d90 msgr2=0x7fa4f815c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:43.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.783+0000 7fa4f5d74640 1 --2- 10.20.193.58:0/1582689969 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa4e4004d90 0x7fa4f815c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:43.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.783+0000 7fa4f5d74640 1 -- 10.20.193.58:0/1582689969 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa4f813d2a0 msgr2=0x7fa4f81383b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:43.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.783+0000 7fa4f5d74640 1 --2- 10.20.193.58:0/1582689969 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa4f813d2a0 0x7fa4f81383b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:43.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.783+0000 7fa4f5d74640 1 -- 10.20.193.58:0/1582689969 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f8164f80 con 0x7fa4f813fbd0 2026-02-23T06:28:43.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.783+0000 7fa4f6d76640 1 --2- 10.20.193.58:0/1582689969 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa4f813d2a0 0x7fa4f81383b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:28:43.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.783+0000 7fa4f5d74640 1 --2- 10.20.193.58:0/1582689969 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa4f813fbd0 0x7fa4f813cd60 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4e0002920 tx=0x7fa4e000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:43.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.783+0000 7fa4deffd640 1 -- 10.20.193.58:0/1582689969 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa4e000b9e0 con 0x7fa4f813fbd0 2026-02-23T06:28:43.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.783+0000 7fa4deffd640 1 -- 10.20.193.58:0/1582689969 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4e000bc30 con 0x7fa4f813fbd0 2026-02-23T06:28:43.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.783+0000 7fa4deffd640 1 -- 10.20.193.58:0/1582689969 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa4e0010450 con 0x7fa4f813fbd0 2026-02-23T06:28:43.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.783+0000 7fa4fcf0c640 1 -- 10.20.193.58:0/1582689969 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4f815c7f0 con 0x7fa4f813fbd0 2026-02-23T06:28:43.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.783+0000 7fa4fcf0c640 1 -- 10.20.193.58:0/1582689969 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4f81660d0 con 0x7fa4f813fbd0 2026-02-23T06:28:43.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.784+0000 7fa4fcf0c640 1 -- 10.20.193.58:0/1582689969 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4f80b7130 con 0x7fa4f813fbd0 2026-02-23T06:28:43.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.785+0000 7fa4deffd640 1 -- 10.20.193.58:0/1582689969 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fa4e00105d0 con 0x7fa4f813fbd0 2026-02-23T06:28:43.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.786+0000 7fa4deffd640 1 --2- 10.20.193.58:0/1582689969 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa4c407a6b0 0x7fa4c409ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:43.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.786+0000 7fa4deffd640 1 -- 10.20.193.58:0/1582689969 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fa4e009de20 con 0x7fa4f813fbd0 2026-02-23T06:28:43.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.786+0000 7fa4f6575640 1 --2- 10.20.193.58:0/1582689969 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa4c407a6b0 0x7fa4c409ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:43.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.787+0000 7fa4deffd640 1 -- 10.20.193.58:0/1582689969 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fa4e0061040 con 0x7fa4f813fbd0 2026-02-23T06:28:43.782 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.787+0000 7fa4f6575640 1 --2- 10.20.193.58:0/1582689969 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa4c407a6b0 0x7fa4c409ab60 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4ec002bb0 tx=0x7fa4ec0026a0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:43.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.941+0000 7fa4fcf0c640 1 -- 10.20.193.58:0/1582689969 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa4f80b7130 con 0x7fa4f813fbd0 2026-02-23T06:28:43.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.941+0000 7fa4deffd640 1 -- 10.20.193.58:0/1582689969 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7fa4f80b7130 con 0x7fa4f813fbd0 2026-02-23T06:28:43.936 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":62,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:28:43.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.942+0000 7fa4fcf0c640 1 -- 10.20.193.58:0/1582689969 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa4c407a6b0 msgr2=0x7fa4c409ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:43.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.942+0000 7fa4fcf0c640 1 --2- 10.20.193.58:0/1582689969 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa4c407a6b0 0x7fa4c409ab60 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4ec002bb0 tx=0x7fa4ec0026a0 comp rx=0 tx=0).stop 2026-02-23T06:28:43.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.942+0000 7fa4fcf0c640 1 -- 10.20.193.58:0/1582689969 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa4f813fbd0 msgr2=0x7fa4f813cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:43.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.942+0000 7fa4fcf0c640 1 --2- 10.20.193.58:0/1582689969 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa4f813fbd0 0x7fa4f813cd60 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4e0002920 tx=0x7fa4e000da90 comp rx=0 tx=0).stop 2026-02-23T06:28:43.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.942+0000 7fa4fcf0c640 1 -- 10.20.193.58:0/1582689969 shutdown_connections 2026-02-23T06:28:43.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.942+0000 7fa4fcf0c640 1 --2- 10.20.193.58:0/1582689969 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa4c407a6b0 0x7fa4c409ab60 unknown :-1 s=CLOSED pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:43.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.942+0000 7fa4fcf0c640 1 --2- 10.20.193.58:0/1582689969 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa4f813d2a0 0x7fa4f81383b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:43.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.942+0000 7fa4fcf0c640 1 --2- 10.20.193.58:0/1582689969 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa4f813fbd0 0x7fa4f813cd60 unknown :-1 s=CLOSED pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:43.938 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.942+0000 7fa4fcf0c640 1 --2- 10.20.193.58:0/1582689969 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa4e4004d90 0x7fa4f815c2b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:43.938 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.942+0000 7fa4fcf0c640 1 -- 10.20.193.58:0/1582689969 >> 10.20.193.58:0/1582689969 conn(0x7fa4f80561f0 msgr2=0x7fa4f81629b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:28:43.938 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.942+0000 7fa4fcf0c640 1 -- 10.20.193.58:0/1582689969 shutdown_connections 2026-02-23T06:28:43.938 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:43.943+0000 7fa4fcf0c640 1 -- 10.20.193.58:0/1582689969 wait complete. 2026-02-23T06:28:43.949 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:28:43.949 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:28:43.949 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:28:43.949 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:28:44.071 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.075+0000 7f0b61bbe640 1 -- 10.20.193.58:0/101022391 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b5c15d4a0 msgr2=0x7f0b5c0affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:44.071 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.075+0000 7f0b61bbe640 1 --2- 10.20.193.58:0/101022391 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b5c15d4a0 0x7f0b5c0affb0 secure :-1 s=READY pgs=103 gs=3 cs=0 l=1 c_cookie=17313906342846338294 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b4c004740 tx=0x7f0b4c02f1e0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.071 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.075+0000 7f0b61bbe640 1 -- 10.20.193.58:0/101022391 shutdown_connections 2026-02-23T06:28:44.071 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.075+0000 7f0b61bbe640 1 --2- 10.20.193.58:0/101022391 >> v2:10.20.193.93:3300/0 conn(0x7f0b5c15d870 0x7f0b5c0587b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.071 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.075+0000 7f0b61bbe640 1 --2- 10.20.193.58:0/101022391 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b5c15d4a0 0x7f0b5c0affb0 unknown :-1 s=CLOSED pgs=103 gs=3 cs=0 l=1 c_cookie=17313906342846338294 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.071 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.075+0000 7f0b61bbe640 1 -- 10.20.193.58:0/101022391 >> 10.20.193.58:0/101022391 conn(0x7f0b5c0b3c20 msgr2=0x7f0b5c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:28:44.072 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.075+0000 7f0b61bbe640 1 -- 10.20.193.58:0/101022391 shutdown_connections 2026-02-23T06:28:44.072 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.075+0000 7f0b61bbe640 1 -- 10.20.193.58:0/101022391 wait complete. 2026-02-23T06:28:44.075 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.076+0000 7f0b61bbe640 1 Processor -- start 2026-02-23T06:28:44.075 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.076+0000 7f0b61bbe640 1 -- start start 2026-02-23T06:28:44.075 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.077+0000 7f0b61bbe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0b5c0b6690 0x7f0b5c15e860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:44.075 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.077+0000 7f0b61bbe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b5c15d4a0 0x7f0b5c1605a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:44.075 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.077+0000 7f0b61bbe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b5c15d870 0x7f0b5c11c8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:44.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.077+0000 7f0b61bbe640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c11b4b0 con 0x7f0b5c15d4a0 2026-02-23T06:28:44.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.077+0000 7f0b61bbe640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c11b790 con 0x7f0b5c0b6690 2026-02-23T06:28:44.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.077+0000 7f0b61bbe640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f0b5c11ba70 con 0x7f0b5c15d870 2026-02-23T06:28:44.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.077+0000 7f0b60bbc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0b5c0b6690 0x7f0b5c15e860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:44.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.077+0000 7f0b53fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b5c15d4a0 0x7f0b5c1605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:44.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.077+0000 7f0b60bbc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0b5c0b6690 0x7f0b5c15e860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:49912/0 (socket says 10.20.193.58:49912) 2026-02-23T06:28:44.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.077+0000 7f0b60bbc640 1 -- 10.20.193.58:0/1025634838 learned_addr learned my addr 10.20.193.58:0/1025634838 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:28:44.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.077+0000 7f0b613bd640 1 --2- 10.20.193.58:0/1025634838 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b5c15d870 0x7f0b5c11c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:44.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.077+0000 7f0b53fff640 1 -- 10.20.193.58:0/1025634838 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b5c15d870 msgr2=0x7f0b5c11c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:44.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.077+0000 7f0b53fff640 1 --2- 10.20.193.58:0/1025634838 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0b5c15d870 0x7f0b5c11c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.077+0000 7f0b53fff640 1 -- 10.20.193.58:0/1025634838 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0b5c0b6690 msgr2=0x7f0b5c15e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:44.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.077+0000 7f0b53fff640 1 --2- 10.20.193.58:0/1025634838 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0b5c0b6690 0x7f0b5c15e860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.077+0000 7f0b53fff640 1 -- 10.20.193.58:0/1025634838 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b440094b0 con 0x7f0b5c15d4a0 2026-02-23T06:28:44.077 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.077+0000 7f0b60bbc640 1 --2- 10.20.193.58:0/1025634838 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0b5c0b6690 0x7f0b5c15e860 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:28:44.077 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.078+0000 7f0b53fff640 1 --2- 10.20.193.58:0/1025634838 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b5c15d4a0 0x7f0b5c1605a0 secure :-1 s=READY pgs=19 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b5c0b1d30 tx=0x7f0b44002b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:44.077 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.078+0000 7f0b517fa640 1 -- 10.20.193.58:0/1025634838 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b4400eac0 con 0x7f0b5c15d4a0 2026-02-23T06:28:44.077 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.078+0000 7f0b517fa640 1 -- 10.20.193.58:0/1025634838 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b4400ec20 con 0x7f0b5c15d4a0 2026-02-23T06:28:44.077 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.078+0000 7f0b517fa640 1 -- 10.20.193.58:0/1025634838 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b44010430 con 0x7f0b5c15d4a0 2026-02-23T06:28:44.077 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.078+0000 7f0b61bbe640 1 -- 10.20.193.58:0/1025634838 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b4c0094b0 con 0x7f0b5c15d4a0 2026-02-23T06:28:44.077 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.078+0000 7f0b61bbe640 1 -- 10.20.193.58:0/1025634838 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b5c11c030 con 0x7f0b5c15d4a0 2026-02-23T06:28:44.077 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.078+0000 7f0b61bbe640 1 --2- 10.20.193.58:0/1025634838 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b5c15ff80 0x7f0b5c11cde0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:44.077 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.078+0000 7f0b61bbe640 1 -- 10.20.193.58:0/1025634838 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c0b6330 con 0x7f0b5c15ff80 2026-02-23T06:28:44.077 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.079+0000 7f0b60bbc640 1 --2- 10.20.193.58:0/1025634838 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b5c15ff80 0x7f0b5c11cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:44.077 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.079+0000 7f0b60bbc640 1 -- 10.20.193.58:0/1025634838 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0b5c0b5e10 con 0x7f0b5c15ff80 2026-02-23T06:28:44.077 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.079+0000 7f0b60bbc640 1 --2- 10.20.193.58:0/1025634838 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b5c15ff80 0x7f0b5c11cde0 secure :-1 s=READY pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b4c0023d0 tx=0x7f0b4c002bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:44.077 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.079+0000 7f0b517fa640 1 -- 10.20.193.58:0/1025634838 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b4c03d050 con 0x7f0b5c15ff80 2026-02-23T06:28:44.077 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.079+0000 7f0b517fa640 1 -- 10.20.193.58:0/1025634838 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f0b4c03e040 con 0x7f0b5c15ff80 2026-02-23T06:28:44.077 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.079+0000 7f0b517fa640 1 -- 10.20.193.58:0/1025634838 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b5c15ff80 msgr2=0x7f0b5c11cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:44.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.079+0000 7f0b517fa640 1 --2- 10.20.193.58:0/1025634838 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b5c15ff80 0x7f0b5c11cde0 secure :-1 s=READY pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b4c0023d0 tx=0x7f0b4c002bd0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.079+0000 7f0b517fa640 1 -- 10.20.193.58:0/1025634838 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b5c15ff80 msgr2=0x7f0b5c11cde0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:28:44.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.079+0000 7f0b517fa640 1 --2- 10.20.193.58:0/1025634838 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b5c15ff80 0x7f0b5c11cde0 unknown :-1 s=CLOSED pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.080+0000 7f0b517fa640 1 -- 10.20.193.58:0/1025634838 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f0b4401f060 con 0x7f0b5c15d4a0 2026-02-23T06:28:44.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.080+0000 7f0b517fa640 1 --2- 10.20.193.58:0/1025634838 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0b2c07a3c0 0x7f0b2c09a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:44.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.080+0000 7f0b517fa640 1 -- 10.20.193.58:0/1025634838 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f0b4409de50 con 0x7f0b5c15d4a0 2026-02-23T06:28:44.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.081+0000 7f0b60bbc640 1 --2- 10.20.193.58:0/1025634838 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0b2c07a3c0 0x7f0b2c09a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:44.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.081+0000 7f0b60bbc640 1 --2- 10.20.193.58:0/1025634838 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0b2c07a3c0 0x7f0b2c09a870 secure :-1 s=READY pgs=229 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b4c0097e0 tx=0x7f0b4c042000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:44.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.083+0000 7f0b61bbe640 1 --2- 10.20.193.58:0/1025634838 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b5c11e750 0x7f0b5c11eb20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:44.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.083+0000 7f0b61bbe640 1 -- 10.20.193.58:0/1025634838 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c0b6d50 con 0x7f0b5c11e750 2026-02-23T06:28:44.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.083+0000 7f0b613bd640 1 --2- 10.20.193.58:0/1025634838 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b5c11e750 0x7f0b5c11eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:44.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.084+0000 7f0b613bd640 1 -- 10.20.193.58:0/1025634838 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0b5c05b0e0 con 0x7f0b5c11e750 2026-02-23T06:28:44.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.084+0000 7f0b613bd640 1 --2- 10.20.193.58:0/1025634838 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b5c11e750 0x7f0b5c11eb20 secure :-1 s=READY pgs=21 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b58003a80 tx=0x7f0b58010c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:44.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.084+0000 7f0b517fa640 1 -- 10.20.193.58:0/1025634838 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b58005a80 con 0x7f0b5c11e750 2026-02-23T06:28:44.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.084+0000 7f0b517fa640 1 -- 10.20.193.58:0/1025634838 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4913 (secure 0 0 0) 0x7f0b58010e70 con 0x7f0b5c11e750 2026-02-23T06:28:44.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.084+0000 7f0b517fa640 1 -- 10.20.193.58:0/1025634838 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b5c11e750 msgr2=0x7f0b5c11eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:44.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.084+0000 7f0b517fa640 1 --2- 10.20.193.58:0/1025634838 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b5c11e750 0x7f0b5c11eb20 secure :-1 s=READY pgs=21 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b58003a80 tx=0x7f0b58010c10 comp rx=0 tx=0).stop 2026-02-23T06:28:44.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.084+0000 7f0b517fa640 1 -- 10.20.193.58:0/1025634838 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b5c11e750 msgr2=0x7f0b5c11eb20 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:28:44.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.084+0000 7f0b517fa640 1 --2- 10.20.193.58:0/1025634838 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b5c11e750 0x7f0b5c11eb20 secure :-1 s=CLOSED pgs=21 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b58003a80 tx=0x7f0b58010c10 comp rx=0 tx=0).stop 2026-02-23T06:28:44.081 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:28:44.081 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:28:44.081 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:28:44.081 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:28:44.081 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 62, 2026-02-23T06:28:44.081 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 26364, 2026-02-23T06:28:44.081 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:28:44.081 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:28:44.082 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:28:44.082 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:28:44.082 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:44.082 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:28:44.082 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:28:44.082 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:28:44.082 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:28:44.082 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:28:44.082 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:28:44.082 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:28:44.082 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:28:44.082 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:28:44.082 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:28:44.082 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:28:44.083 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:28:44.083 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:28:44.083 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:28:44.083 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:28:44.083 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:28:44.083 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:28:44.083 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:44.083 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:28:44.083 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:28:44.083 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:28:44.083 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:28:44.083 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:28:44.083 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:28:44.083 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:28:44.083 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:28:44.083 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:28:44.083 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:28:44.083 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:28:44.083 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:28:44.084 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:28:44.084 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:28:44.084 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:28:44.084 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:44.084 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.084 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:28:44.084 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:28:44.084 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:28:44.084 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:28:44.084 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:28:44.084 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:28:44.085 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:28:44.085 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:28:44.085 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:28:44.085 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:28:44.085 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:28:44.085 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:28:44.085 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:28:44.085 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:28:44.085 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:28:44.085 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:28:44.085 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:28:44.085 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:28:44.086 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:28:44.086 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:28:44.086 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:28:44.086 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:28:44.086 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:28:44.086 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:28:44.086 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:28:44.086 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:28:44.086 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:28:44.086 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:28:44.086 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:28:44.086 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:28:44.087 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:44.087 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:28:44.087 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.087 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:28:44.087 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.087 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:28:44.087 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:28:44.087 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:28:44.087 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:28:44.087 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.087 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:28:44.087 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:28:44.088 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:44.088 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.088 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.088 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:28:44.088 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:28:44.088 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:44.088 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:44.088 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:44.088 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.088 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:28:44.088 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:28:44.088 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:28:44.089 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:28:44.089 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:28:44.089 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:28:44.089 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.089 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.089 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:28:44.089 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:28:44.089 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:28:44.089 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:28:44.089 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.089 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:28:44.089 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:28:44.090 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:44.090 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.090 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.090 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:28:44.090 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:28:44.090 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:44.090 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:44.090 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:44.090 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.090 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:28:44.090 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:28:44.090 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:28:44.090 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:28:44.091 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:28:44.091 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:28:44.091 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.091 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.091 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:28:44.091 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:28:44.091 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:28:44.091 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:28:44.091 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.091 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:28:44.091 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:28:44.091 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:44.091 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.092 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.092 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:28:44.092 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:28:44.092 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:44.092 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:44.092 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:44.092 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.092 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:28:44.092 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:28:44.092 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:28:44.092 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:28:44.092 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:28:44.092 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:28:44.092 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:44.093 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:44.093 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.093 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:28:44.093 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:28:44.093 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.093 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:28:44.093 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:28:44.093 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:28:44.093 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:44.093 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:44.093 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:28:44.093 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.093 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:28:44.093 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:28:44.094 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:28:44.094 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:44.094 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:44.094 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.094 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:28:44.094 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:28:44.095 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.084+0000 7f0b61bbe640 1 -- 10.20.193.58:0/1025634838 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0b2c07a3c0 msgr2=0x7f0b2c09a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:44.095 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.084+0000 7f0b61bbe640 1 --2- 10.20.193.58:0/1025634838 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0b2c07a3c0 0x7f0b2c09a870 secure :-1 s=READY pgs=229 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b4c0097e0 tx=0x7f0b4c042000 comp rx=0 tx=0).stop 2026-02-23T06:28:44.095 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.084+0000 7f0b61bbe640 1 -- 10.20.193.58:0/1025634838 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b5c15d4a0 msgr2=0x7f0b5c1605a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:44.095 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.084+0000 7f0b61bbe640 1 --2- 10.20.193.58:0/1025634838 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0b5c15d4a0 0x7f0b5c1605a0 secure :-1 s=READY pgs=19 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b5c0b1d30 tx=0x7f0b44002b40 comp rx=0 tx=0).stop 2026-02-23T06:28:44.095 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.084+0000 7f0b613bd640 1 -- 10.20.193.58:0/1025634838 reap_dead start 2026-02-23T06:28:44.095 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.084+0000 7f0b613bd640 1 -- 10.20.193.58:0/1025634838 reap_dead start 2026-02-23T06:28:44.095 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.084+0000 7f0b61bbe640 1 -- 10.20.193.58:0/1025634838 shutdown_connections 2026-02-23T06:28:44.095 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.084+0000 7f0b61bbe640 1 -- 10.20.193.58:0/1025634838 >> 10.20.193.58:0/1025634838 conn(0x7f0b5c0b3c20 msgr2=0x7f0b5c15ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:28:44.095 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.084+0000 7f0b61bbe640 1 -- 10.20.193.58:0/1025634838 shutdown_connections 2026-02-23T06:28:44.095 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.084+0000 7f0b61bbe640 1 -- 10.20.193.58:0/1025634838 wait complete. 2026-02-23T06:28:44.096 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:28:44.096 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:28:44.096 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:28:44.217 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.222+0000 7f97ab577640 1 -- 10.20.193.58:0/430583532 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97ac15c040 msgr2=0x7f97ac05b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:44.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.222+0000 7f97ab577640 1 --2- 10.20.193.58:0/430583532 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97ac15c040 0x7f97ac05b0e0 secure :-1 s=READY pgs=22 gs=3 cs=0 l=1 c_cookie=17342858252460303058 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97a0005e70 tx=0x7f97a002f290 comp rx=0 tx=0).stop 2026-02-23T06:28:44.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.222+0000 7f97ab577640 1 -- 10.20.193.58:0/430583532 shutdown_connections 2026-02-23T06:28:44.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.222+0000 7f97ab577640 1 --2- 10.20.193.58:0/430583532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f97ac056550 0x7f97ac05ce30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.222+0000 7f97ab577640 1 --2- 10.20.193.58:0/430583532 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97ac15c040 0x7f97ac05b0e0 unknown :-1 s=CLOSED pgs=22 gs=3 cs=0 l=1 c_cookie=17342858252460303058 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.222+0000 7f97ab577640 1 -- 10.20.193.58:0/430583532 >> 10.20.193.58:0/430583532 conn(0x7f97ac0b3c20 msgr2=0x7f97ac0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:28:44.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.222+0000 7f97ab577640 1 -- 10.20.193.58:0/430583532 shutdown_connections 2026-02-23T06:28:44.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.222+0000 7f97ab577640 1 -- 10.20.193.58:0/430583532 wait complete. 2026-02-23T06:28:44.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.223+0000 7f97ab577640 1 Processor -- start 2026-02-23T06:28:44.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.223+0000 7f97ab577640 1 -- start start 2026-02-23T06:28:44.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.224+0000 7f97ab577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f97ac056550 0x7f97ac153d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:44.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.224+0000 7f97ab577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97ac05d370 0x7f97ac201980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:44.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.224+0000 7f97ab577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f97ac15c040 0x7f97ac1fe3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:44.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.224+0000 7f97ab577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac1fe8f0 con 0x7f97ac05d370 2026-02-23T06:28:44.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.224+0000 7f97ab577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac152d50 con 0x7f97ac056550 2026-02-23T06:28:44.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.224+0000 7f97ab577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f97ac200f30 con 0x7f97ac15c040 2026-02-23T06:28:44.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.224+0000 7f97a9d74640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97ac05d370 0x7f97ac201980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:44.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.224+0000 7f97a9d74640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97ac05d370 0x7f97ac201980 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:47954/0 (socket says 10.20.193.58:47954) 2026-02-23T06:28:44.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.224+0000 7f97a9d74640 1 -- 10.20.193.58:0/1970369418 learned_addr learned my addr 10.20.193.58:0/1970369418 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:28:44.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.224+0000 7f97aa575640 1 --2- 10.20.193.58:0/1970369418 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f97ac056550 0x7f97ac153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:44.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.224+0000 7f97aad76640 1 --2- 10.20.193.58:0/1970369418 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f97ac15c040 0x7f97ac1fe3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:44.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.225+0000 7f97a9d74640 1 -- 10.20.193.58:0/1970369418 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f97ac15c040 msgr2=0x7f97ac1fe3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:44.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.225+0000 7f97a9d74640 1 --2- 10.20.193.58:0/1970369418 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f97ac15c040 0x7f97ac1fe3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.225+0000 7f97a9d74640 1 -- 10.20.193.58:0/1970369418 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f97ac056550 msgr2=0x7f97ac153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:44.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.225+0000 7f97a9d74640 1 --2- 10.20.193.58:0/1970369418 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f97ac056550 0x7f97ac153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.225+0000 7f97a9d74640 1 -- 10.20.193.58:0/1970369418 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97940094b0 con 0x7f97ac05d370 2026-02-23T06:28:44.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.225+0000 7f97a9d74640 1 --2- 10.20.193.58:0/1970369418 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97ac05d370 0x7f97ac201980 secure :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9794002750 tx=0x7f9794002c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:44.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.225+0000 7f9792ffd640 1 -- 10.20.193.58:0/1970369418 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f979400ed60 con 0x7f97ac05d370 2026-02-23T06:28:44.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.225+0000 7f9792ffd640 1 -- 10.20.193.58:0/1970369418 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9794002e80 con 0x7f97ac05d370 2026-02-23T06:28:44.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.225+0000 7f9792ffd640 1 -- 10.20.193.58:0/1970369418 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97940106b0 con 0x7f97ac05d370 2026-02-23T06:28:44.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.225+0000 7f97ab577640 1 -- 10.20.193.58:0/1970369418 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97a0009570 con 0x7f97ac05d370 2026-02-23T06:28:44.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.225+0000 7f97ab577640 1 -- 10.20.193.58:0/1970369418 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97ac152fa0 con 0x7f97ac05d370 2026-02-23T06:28:44.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.226+0000 7f97ab577640 1 --2- 10.20.193.58:0/1970369418 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f97ac201070 0x7f97ac151ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:44.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.226+0000 7f97ab577640 1 -- 10.20.193.58:0/1970369418 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac15c410 con 0x7f97ac201070 2026-02-23T06:28:44.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.226+0000 7f97aa575640 1 --2- 10.20.193.58:0/1970369418 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f97ac201070 0x7f97ac151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:44.223 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.226+0000 7f97aa575640 1 -- 10.20.193.58:0/1970369418 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f97ac05b620 con 0x7f97ac201070 2026-02-23T06:28:44.223 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.226+0000 7f97aa575640 1 --2- 10.20.193.58:0/1970369418 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f97ac201070 0x7f97ac151ad0 secure :-1 s=READY pgs=80 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97a0004740 tx=0x7f97a00028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:44.223 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.227+0000 7f9792ffd640 1 -- 10.20.193.58:0/1970369418 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97a003d050 con 0x7f97ac201070 2026-02-23T06:28:44.223 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.227+0000 7f9792ffd640 1 -- 10.20.193.58:0/1970369418 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f9794016020 con 0x7f97ac05d370 2026-02-23T06:28:44.223 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.228+0000 7f9792ffd640 1 --2- 10.20.193.58:0/1970369418 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f977807a660 0x7f977809ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:44.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.228+0000 7f9792ffd640 1 -- 10.20.193.58:0/1970369418 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f979409dd20 con 0x7f97ac05d370 2026-02-23T06:28:44.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.228+0000 7f9792ffd640 1 -- 10.20.193.58:0/1970369418 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f97a003e040 con 0x7f97ac201070 2026-02-23T06:28:44.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.228+0000 7f9792ffd640 1 -- 10.20.193.58:0/1970369418 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f97ac201070 msgr2=0x7f97ac151ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:44.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.228+0000 7f9792ffd640 1 --2- 10.20.193.58:0/1970369418 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f97ac201070 0x7f97ac151ad0 secure :-1 s=READY pgs=80 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97a0004740 tx=0x7f97a00028d0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.228+0000 7f9792ffd640 1 -- 10.20.193.58:0/1970369418 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f97ac201070 msgr2=0x7f97ac151ad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:28:44.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.228+0000 7f9792ffd640 1 --2- 10.20.193.58:0/1970369418 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f97ac201070 0x7f97ac151ad0 secure :-1 s=CLOSED pgs=80 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97a0004740 tx=0x7f97a00028d0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.228+0000 7f97aad76640 1 --2- 10.20.193.58:0/1970369418 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f977807a660 0x7f977809ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:44.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.229+0000 7f97aad76640 1 --2- 10.20.193.58:0/1970369418 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f977807a660 0x7f977809ab10 secure :-1 s=READY pgs=230 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f979c0038b0 tx=0x7f979c00a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:44.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.232+0000 7f97ab577640 1 --2- 10.20.193.58:0/1970369418 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f97ac156ec0 0x7f97ac1572c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:44.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.232+0000 7f97ab577640 1 -- 10.20.193.58:0/1970369418 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac157800 con 0x7f97ac156ec0 2026-02-23T06:28:44.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.232+0000 7f97aa575640 1 --2- 10.20.193.58:0/1970369418 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f97ac156ec0 0x7f97ac1572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:44.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.233+0000 7f97aa575640 1 -- 10.20.193.58:0/1970369418 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f97ac2016a0 con 0x7f97ac156ec0 2026-02-23T06:28:44.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.233+0000 7f97aa575640 1 --2- 10.20.193.58:0/1970369418 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f97ac156ec0 0x7f97ac1572c0 secure :-1 s=READY pgs=81 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97a002ff80 tx=0x7f97a0009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:44.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.233+0000 7f9792ffd640 1 -- 10.20.193.58:0/1970369418 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97a0052070 con 0x7f97ac156ec0 2026-02-23T06:28:44.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.233+0000 7f9792ffd640 1 -- 10.20.193.58:0/1970369418 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5246 (secure 0 0 0) 0x7f97a0038c60 con 0x7f97ac156ec0 2026-02-23T06:28:44.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.233+0000 7f9792ffd640 1 -- 10.20.193.58:0/1970369418 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f97ac156ec0 msgr2=0x7f97ac1572c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:44.229 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.233+0000 7f9792ffd640 1 --2- 10.20.193.58:0/1970369418 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f97ac156ec0 0x7f97ac1572c0 secure :-1 s=READY pgs=81 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97a002ff80 tx=0x7f97a0009310 comp rx=0 tx=0).stop 2026-02-23T06:28:44.229 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.233+0000 7f9792ffd640 1 -- 10.20.193.58:0/1970369418 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f97ac156ec0 msgr2=0x7f97ac1572c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:28:44.229 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.233+0000 7f9792ffd640 1 --2- 10.20.193.58:0/1970369418 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f97ac156ec0 0x7f97ac1572c0 secure :-1 s=CLOSED pgs=81 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97a002ff80 tx=0x7f97a0009310 comp rx=0 tx=0).stop 2026-02-23T06:28:44.229 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:28:44.229 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:28:44.229 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:28:44.229 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:28:44.229 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 62, 2026-02-23T06:28:44.229 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 125745, 2026-02-23T06:28:44.229 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:28:44.230 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:28:44.230 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:28:44.230 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:28:44.230 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:44.230 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:28:44.230 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:28:44.230 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:28:44.230 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:28:44.230 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:28:44.230 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:28:44.230 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:28:44.230 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:28:44.230 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:28:44.230 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:28:44.230 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:28:44.230 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:28:44.231 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:28:44.231 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:28:44.231 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:28:44.231 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:28:44.231 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:28:44.231 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:44.231 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:28:44.231 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:28:44.231 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:28:44.231 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:28:44.231 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:28:44.231 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:28:44.231 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:28:44.231 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:28:44.231 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:28:44.231 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:28:44.232 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:28:44.232 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:28:44.232 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:28:44.232 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:28:44.232 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:28:44.232 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:44.232 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.232 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:28:44.232 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:28:44.232 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:28:44.232 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:28:44.232 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:28:44.232 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:28:44.232 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:28:44.232 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:28:44.232 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:28:44.233 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:28:44.233 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:28:44.233 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:28:44.233 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:28:44.233 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:28:44.233 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:28:44.233 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:28:44.233 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:28:44.233 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:28:44.233 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:28:44.233 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:28:44.233 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:28:44.233 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:28:44.233 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:28:44.233 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:28:44.233 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:28:44.234 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:28:44.234 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:28:44.234 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:28:44.234 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:28:44.234 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:28:44.234 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:44.234 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:28:44.234 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.234 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:28:44.234 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.234 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:28:44.234 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:28:44.234 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:28:44.234 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:28:44.234 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.234 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:28:44.234 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:28:44.235 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:44.235 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.235 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.235 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:28:44.235 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:28:44.235 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:44.235 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:44.235 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:44.235 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.235 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:28:44.235 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:28:44.235 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:28:44.235 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:28:44.235 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:28:44.235 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:28:44.236 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.236 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.236 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:28:44.236 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:28:44.236 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:28:44.236 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:28:44.236 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.236 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:28:44.236 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:28:44.236 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:44.236 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.236 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.236 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:28:44.236 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:28:44.236 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:44.236 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:44.236 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:44.237 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.237 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:28:44.237 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:28:44.237 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:28:44.237 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:28:44.237 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:28:44.237 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:28:44.237 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.237 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.237 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:28:44.237 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:28:44.237 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:28:44.237 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:28:44.237 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.237 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:28:44.237 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:28:44.237 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:44.238 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.238 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.238 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:28:44.238 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:28:44.238 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:44.238 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:44.238 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:44.238 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.238 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:28:44.238 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:28:44.238 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:28:44.238 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:28:44.238 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:28:44.238 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:28:44.238 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:44.238 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:44.239 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.239 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:28:44.239 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:28:44.239 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.239 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:28:44.239 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:28:44.239 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:28:44.239 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:44.239 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:44.239 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:28:44.239 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.239 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:28:44.239 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:28:44.239 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:28:44.239 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:44.239 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:44.239 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:28:44.239 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.240 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:28:44.240 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:28:44.240 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:28:44.240 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:44.240 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:44.240 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:28:44.240 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.240 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:28:44.240 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:28:44.240 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:28:44.240 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:44.240 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:44.240 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.240 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:28:44.240 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:28:44.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.233+0000 7f97ab577640 1 -- 10.20.193.58:0/1970369418 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f977807a660 msgr2=0x7f977809ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:44.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.233+0000 7f97ab577640 1 --2- 10.20.193.58:0/1970369418 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f977807a660 0x7f977809ab10 secure :-1 s=READY pgs=230 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f979c0038b0 tx=0x7f979c00a040 comp rx=0 tx=0).stop 2026-02-23T06:28:44.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.234+0000 7f97ab577640 1 -- 10.20.193.58:0/1970369418 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97ac05d370 msgr2=0x7f97ac201980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:44.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.234+0000 7f97ab577640 1 --2- 10.20.193.58:0/1970369418 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97ac05d370 0x7f97ac201980 secure :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9794002750 tx=0x7f9794002c20 comp rx=0 tx=0).stop 2026-02-23T06:28:44.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.234+0000 7f97aad76640 1 -- 10.20.193.58:0/1970369418 reap_dead start 2026-02-23T06:28:44.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.234+0000 7f97aad76640 1 -- 10.20.193.58:0/1970369418 reap_dead start 2026-02-23T06:28:44.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.234+0000 7f97ab577640 1 -- 10.20.193.58:0/1970369418 shutdown_connections 2026-02-23T06:28:44.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.234+0000 7f97ab577640 1 -- 10.20.193.58:0/1970369418 >> 10.20.193.58:0/1970369418 conn(0x7f97ac0b3c20 msgr2=0x7f97ac156320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:28:44.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.234+0000 7f97ab577640 1 -- 10.20.193.58:0/1970369418 shutdown_connections 2026-02-23T06:28:44.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.234+0000 7f97ab577640 1 -- 10.20.193.58:0/1970369418 wait complete. 2026-02-23T06:28:44.243 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:28:44.243 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:28:44.243 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:28:44.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.369+0000 7f7dbe483640 1 -- 10.20.193.58:0/2239107484 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7db81688d0 msgr2=0x7f7db8168ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:44.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.369+0000 7f7dbe483640 1 --2- 10.20.193.58:0/2239107484 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7db81688d0 0x7f7db8168ca0 secure :-1 s=READY pgs=24 gs=2 cs=0 l=1 c_cookie=2386495310405449835 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7db80bb6c0 tx=0x7f7da802f250 comp rx=0 tx=0).stop 2026-02-23T06:28:44.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.369+0000 7f7dbe483640 1 -- 10.20.193.58:0/2239107484 shutdown_connections 2026-02-23T06:28:44.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.369+0000 7f7dbe483640 1 --2- 10.20.193.58:0/2239107484 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7db80bb0b0 0x7f7db815b620 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.369+0000 7f7dbe483640 1 --2- 10.20.193.58:0/2239107484 >> v2:10.20.193.93:3300/0 conn(0x7f7db80b6440 0x7f7db80ba2d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.369+0000 7f7dbe483640 1 --2- 10.20.193.58:0/2239107484 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7db81688d0 0x7f7db8168ca0 unknown :-1 s=CLOSED pgs=24 gs=2 cs=0 l=1 c_cookie=2386495310405449835 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.369+0000 7f7dbe483640 1 -- 10.20.193.58:0/2239107484 >> 10.20.193.58:0/2239107484 conn(0x7f7db8054e40 msgr2=0x7f7db8057b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:28:44.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.369+0000 7f7dbe483640 1 -- 10.20.193.58:0/2239107484 shutdown_connections 2026-02-23T06:28:44.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.369+0000 7f7dbe483640 1 -- 10.20.193.58:0/2239107484 wait complete. 2026-02-23T06:28:44.365 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.370+0000 7f7dbe483640 1 Processor -- start 2026-02-23T06:28:44.365 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.370+0000 7f7dbe483640 1 -- start start 2026-02-23T06:28:44.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.370+0000 7f7dbe483640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7db80b6440 0x7f7db8139280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:44.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.370+0000 7f7dbe483640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7db80bb0b0 0x7f7db813bad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:44.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.370+0000 7f7dbe483640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7db81688d0 0x7f7db8162bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:44.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.370+0000 7f7dbe483640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f7db80b5e70 con 0x7f7db80b6440 2026-02-23T06:28:44.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.370+0000 7f7dbe483640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f7db80b34c0 con 0x7f7db81688d0 2026-02-23T06:28:44.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.370+0000 7f7dbe483640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f7db81644f0 con 0x7f7db80bb0b0 2026-02-23T06:28:44.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.371+0000 7f7dbd481640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7db80b6440 0x7f7db8139280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:44.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.371+0000 7f7dbd481640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7db80b6440 0x7f7db8139280 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:47976/0 (socket says 10.20.193.58:47976) 2026-02-23T06:28:44.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.371+0000 7f7dbd481640 1 -- 10.20.193.58:0/1166191808 learned_addr learned my addr 10.20.193.58:0/1166191808 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:28:44.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.371+0000 7f7dbcc80640 1 --2- 10.20.193.58:0/1166191808 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7db80bb0b0 0x7f7db813bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:44.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.371+0000 7f7dbdc82640 1 --2- 10.20.193.58:0/1166191808 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7db81688d0 0x7f7db8162bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:44.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.371+0000 7f7dbd481640 1 -- 10.20.193.58:0/1166191808 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7db80bb0b0 msgr2=0x7f7db813bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:44.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.371+0000 7f7dbd481640 1 --2- 10.20.193.58:0/1166191808 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7db80bb0b0 0x7f7db813bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.371+0000 7f7dbd481640 1 -- 10.20.193.58:0/1166191808 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7db81688d0 msgr2=0x7f7db8162bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:44.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.371+0000 7f7dbd481640 1 --2- 10.20.193.58:0/1166191808 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7db81688d0 0x7f7db8162bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.371+0000 7f7dbd481640 1 -- 10.20.193.58:0/1166191808 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da8009570 con 0x7f7db80b6440 2026-02-23T06:28:44.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.371+0000 7f7dbd481640 1 --2- 10.20.193.58:0/1166191808 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7db80b6440 0x7f7db8139280 secure :-1 s=READY pgs=25 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7da8004740 tx=0x7f7da80028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:44.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.371+0000 7f7da5ffb640 1 -- 10.20.193.58:0/1166191808 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7da803d070 con 0x7f7db80b6440 2026-02-23T06:28:44.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.371+0000 7f7da5ffb640 1 -- 10.20.193.58:0/1166191808 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7da8038470 con 0x7f7db80b6440 2026-02-23T06:28:44.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.371+0000 7f7da5ffb640 1 -- 10.20.193.58:0/1166191808 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7da80388a0 con 0x7f7db80b6440 2026-02-23T06:28:44.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.371+0000 7f7dbe483640 1 -- 10.20.193.58:0/1166191808 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7db81647d0 con 0x7f7db80b6440 2026-02-23T06:28:44.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.371+0000 7f7dbe483640 1 -- 10.20.193.58:0/1166191808 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7db80b30e0 con 0x7f7db80b6440 2026-02-23T06:28:44.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.372+0000 7f7dbe483640 1 --2- 10.20.193.58:0/1166191808 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7db813dfe0 0x7f7db8163130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:44.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.372+0000 7f7dbe483640 1 -- 10.20.193.58:0/1166191808 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f7db80b4640 con 0x7f7db813dfe0 2026-02-23T06:28:44.368 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.372+0000 7f7dbcc80640 1 --2- 10.20.193.58:0/1166191808 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7db813dfe0 0x7f7db8163130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:44.368 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.372+0000 7f7dbcc80640 1 -- 10.20.193.58:0/1166191808 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7db80b9ad0 con 0x7f7db813dfe0 2026-02-23T06:28:44.368 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.373+0000 7f7dbcc80640 1 --2- 10.20.193.58:0/1166191808 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7db813dfe0 0x7f7db8163130 secure :-1 s=READY pgs=104 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7db813a340 tx=0x7f7dac0099d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:44.368 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.373+0000 7f7da5ffb640 1 -- 10.20.193.58:0/1166191808 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7dac0118d0 con 0x7f7db813dfe0 2026-02-23T06:28:44.368 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.373+0000 7f7da5ffb640 1 -- 10.20.193.58:0/1166191808 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f7da8038a00 con 0x7f7db80b6440 2026-02-23T06:28:44.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.374+0000 7f7da5ffb640 1 --2- 10.20.193.58:0/1166191808 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7d8807a660 0x7f7d8809ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:44.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.374+0000 7f7da5ffb640 1 -- 10.20.193.58:0/1166191808 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f7da80c21e0 con 0x7f7db80b6440 2026-02-23T06:28:44.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.374+0000 7f7da5ffb640 1 -- 10.20.193.58:0/1166191808 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f7dac011a30 con 0x7f7db813dfe0 2026-02-23T06:28:44.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.374+0000 7f7da5ffb640 1 -- 10.20.193.58:0/1166191808 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7db813dfe0 msgr2=0x7f7db8163130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:44.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.374+0000 7f7da5ffb640 1 --2- 10.20.193.58:0/1166191808 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7db813dfe0 0x7f7db8163130 secure :-1 s=READY pgs=104 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7db813a340 tx=0x7f7dac0099d0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.374+0000 7f7da5ffb640 1 -- 10.20.193.58:0/1166191808 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7db813dfe0 msgr2=0x7f7db8163130 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:28:44.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.374+0000 7f7da5ffb640 1 --2- 10.20.193.58:0/1166191808 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7db813dfe0 0x7f7db8163130 secure :-1 s=CLOSED pgs=104 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7db813a340 tx=0x7f7dac0099d0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.374+0000 7f7dbdc82640 1 --2- 10.20.193.58:0/1166191808 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7d8807a660 0x7f7d8809ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:44.370 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.375+0000 7f7dbdc82640 1 --2- 10.20.193.58:0/1166191808 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7d8807a660 0x7f7d8809ab10 secure :-1 s=READY pgs=231 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7db4006a50 tx=0x7f7db40069e0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:44.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.378+0000 7f7dbe483640 1 --2- 10.20.193.58:0/1166191808 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7db80a1a40 0x7f7db8163670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:44.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.378+0000 7f7dbe483640 1 -- 10.20.193.58:0/1166191808 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f7db80b15f0 con 0x7f7db80a1a40 2026-02-23T06:28:44.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.378+0000 7f7dbcc80640 1 --2- 10.20.193.58:0/1166191808 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7db80a1a40 0x7f7db8163670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:44.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.379+0000 7f7dbcc80640 1 -- 10.20.193.58:0/1166191808 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7db80bb7d0 con 0x7f7db80a1a40 2026-02-23T06:28:44.374 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.379+0000 7f7dbcc80640 1 --2- 10.20.193.58:0/1166191808 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7db80a1a40 0x7f7db8163670 secure :-1 s=READY pgs=105 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7db813a340 tx=0x7f7dac004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:44.374 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.379+0000 7f7da5ffb640 1 -- 10.20.193.58:0/1166191808 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7dac025070 con 0x7f7db80a1a40 2026-02-23T06:28:44.374 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.379+0000 7f7da5ffb640 1 -- 10.20.193.58:0/1166191808 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5556 (secure 0 0 0) 0x7f7dac004cb0 con 0x7f7db80a1a40 2026-02-23T06:28:44.374 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.379+0000 7f7da5ffb640 1 -- 10.20.193.58:0/1166191808 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7db80a1a40 msgr2=0x7f7db8163670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:44.374 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.379+0000 7f7da5ffb640 1 --2- 10.20.193.58:0/1166191808 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7db80a1a40 0x7f7db8163670 secure :-1 s=READY pgs=105 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7db813a340 tx=0x7f7dac004770 comp rx=0 tx=0).stop 2026-02-23T06:28:44.374 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.379+0000 7f7da5ffb640 1 -- 10.20.193.58:0/1166191808 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7db80a1a40 msgr2=0x7f7db8163670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:28:44.374 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.379+0000 7f7da5ffb640 1 --2- 10.20.193.58:0/1166191808 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7db80a1a40 0x7f7db8163670 unknown :-1 s=CLOSED pgs=105 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.374 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:28:44.374 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:28:44.375 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:28:44.375 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:28:44.375 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 62, 2026-02-23T06:28:44.375 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 198891, 2026-02-23T06:28:44.375 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:28:44.375 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:28:44.375 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:28:44.375 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:28:44.375 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:44.375 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:28:44.375 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:28:44.375 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:28:44.375 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:28:44.375 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:28:44.375 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:28:44.375 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:28:44.375 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:28:44.375 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:28:44.375 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:28:44.375 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:28:44.375 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:28:44.375 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:28:44.375 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:28:44.375 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:28:44.376 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:28:44.376 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:28:44.376 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:44.376 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:28:44.376 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:28:44.376 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:28:44.376 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:28:44.376 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:28:44.376 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:28:44.376 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:28:44.376 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:28:44.376 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:28:44.376 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:28:44.376 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:28:44.376 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:28:44.376 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:28:44.376 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:28:44.376 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:28:44.376 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:44.376 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.376 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:28:44.376 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:28:44.376 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:28:44.376 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:28:44.377 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:28:44.377 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:28:44.377 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:28:44.377 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:28:44.377 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:28:44.377 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:28:44.377 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:28:44.377 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:28:44.377 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:28:44.377 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:28:44.377 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:28:44.377 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:28:44.377 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:28:44.377 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:28:44.377 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:28:44.377 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:28:44.377 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:28:44.377 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:28:44.377 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:28:44.377 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:28:44.377 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:28:44.377 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:28:44.378 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:28:44.378 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:28:44.378 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:28:44.378 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:28:44.378 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:44.378 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:28:44.378 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.378 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:28:44.378 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.378 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:28:44.378 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:28:44.378 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:28:44.378 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:28:44.378 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.378 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:28:44.378 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:28:44.378 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:44.378 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.378 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.378 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:28:44.378 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:28:44.378 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:44.378 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:44.378 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:44.379 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.379 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:28:44.379 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:28:44.379 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:28:44.379 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:28:44.379 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:28:44.379 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:28:44.379 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.379 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.379 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:28:44.379 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:28:44.379 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:28:44.379 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:28:44.379 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.379 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:28:44.379 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:28:44.379 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:44.379 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.379 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.379 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:28:44.379 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:28:44.379 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:44.379 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:44.379 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:44.379 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.379 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:28:44.379 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:28:44.379 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:28:44.380 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:28:44.380 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:28:44.380 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:28:44.380 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.380 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.380 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:28:44.380 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:28:44.380 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:28:44.380 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:28:44.380 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.380 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:28:44.380 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:28:44.380 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:44.380 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.380 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.380 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:28:44.380 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:28:44.380 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:28:44.380 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:44.380 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:44.380 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.380 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:28:44.380 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:28:44.380 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:28:44.380 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:28:44.380 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:28:44.380 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:28:44.380 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: "num": 7 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:28:44.381 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.382 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.382 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:28:44.382 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:28:44.382 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:28:44.382 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:44.382 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:28:44.382 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:28:44.382 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:28:44.382 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:28:44.382 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:28:44.382 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:28:44.382 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:28:44.382 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:28:44.382 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:28:44.382 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:28:44.382 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:28:44.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.379+0000 7f7dbe483640 1 -- 10.20.193.58:0/1166191808 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7d8807a660 msgr2=0x7f7d8809ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:44.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.379+0000 7f7dbe483640 1 --2- 10.20.193.58:0/1166191808 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7d8807a660 0x7f7d8809ab10 secure :-1 s=READY pgs=231 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7db4006a50 tx=0x7f7db40069e0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.379+0000 7f7dbe483640 1 -- 10.20.193.58:0/1166191808 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7db80b6440 msgr2=0x7f7db8139280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:44.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.379+0000 7f7dbe483640 1 --2- 10.20.193.58:0/1166191808 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7db80b6440 0x7f7db8139280 secure :-1 s=READY pgs=25 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7da8004740 tx=0x7f7da80028d0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.379+0000 7f7dbdc82640 1 -- 10.20.193.58:0/1166191808 reap_dead start 2026-02-23T06:28:44.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.379+0000 7f7dbdc82640 1 -- 10.20.193.58:0/1166191808 reap_dead start 2026-02-23T06:28:44.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.379+0000 7f7dbe483640 1 -- 10.20.193.58:0/1166191808 shutdown_connections 2026-02-23T06:28:44.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.379+0000 7f7dbe483640 1 -- 10.20.193.58:0/1166191808 >> 10.20.193.58:0/1166191808 conn(0x7f7db8054e40 msgr2=0x7f7db813a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:28:44.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.380+0000 7f7dbe483640 1 -- 10.20.193.58:0/1166191808 shutdown_connections 2026-02-23T06:28:44.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.380+0000 7f7dbe483640 1 -- 10.20.193.58:0/1166191808 wait complete. 2026-02-23T06:28:44.383 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:28:44.384 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-23T06:28:44.384 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-23T06:28:44.384 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-23T06:28:44.384 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-23T06:28:44.384 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-23T06:28:44.384 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:28:44.400 INFO:tasks.ceph.mon.a:Stopped 2026-02-23T06:28:44.400 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:28:44.400 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:28:44.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.565+0000 7fc8c1930640 1 -- 10.20.193.58:0/2748854360 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc8bc15d870 msgr2=0x7fc8bc0587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:44.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.565+0000 7fc8c1930640 1 --2- 10.20.193.58:0/2748854360 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc8bc15d870 0x7fc8bc0587b0 secure :-1 s=READY pgs=107 gs=2 cs=0 l=1 c_cookie=16246220928145275226 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8a4005e70 tx=0x7fc8a402f2b0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.565+0000 7fc8c1930640 1 -- 10.20.193.58:0/2748854360 shutdown_connections 2026-02-23T06:28:44.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.565+0000 7fc8c1930640 1 --2- 10.20.193.58:0/2748854360 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc8bc15d870 0x7fc8bc0587b0 unknown :-1 s=CLOSED pgs=107 gs=2 cs=0 l=1 c_cookie=16246220928145275226 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.565+0000 7fc8c1930640 1 --2- 10.20.193.58:0/2748854360 >> v2:10.20.193.58:3300/0 conn(0x7fc8bc15d4a0 0x7fc8bc0affb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.565+0000 7fc8c1930640 1 -- 10.20.193.58:0/2748854360 >> 10.20.193.58:0/2748854360 conn(0x7fc8bc0b3c20 msgr2=0x7fc8bc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:28:44.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.565+0000 7fc8c1930640 1 -- 10.20.193.58:0/2748854360 shutdown_connections 2026-02-23T06:28:44.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.565+0000 7fc8c1930640 1 -- 10.20.193.58:0/2748854360 wait complete. 2026-02-23T06:28:44.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.566+0000 7fc8c1930640 1 Processor -- start 2026-02-23T06:28:44.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.566+0000 7fc8c1930640 1 -- start start 2026-02-23T06:28:44.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.567+0000 7fc8c1930640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc8bc0b6690 0x7fc8bc13e690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:44.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.567+0000 7fc8c1930640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc8bc15d4a0 0x7fc8bc1f77e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:44.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.567+0000 7fc8c1930640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc8bc15d870 0x7fc8bc162110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:44.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.567+0000 7fc8c1930640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc13d0c0 con 0x7fc8bc15d870 2026-02-23T06:28:44.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.567+0000 7fc8c1930640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc057e30 con 0x7fc8bc15d4a0 2026-02-23T06:28:44.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.567+0000 7fc8c1930640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc8bc0580f0 con 0x7fc8bc0b6690 2026-02-23T06:28:44.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.567+0000 7fc8c112f640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc8bc15d870 msgr2=0x7fc8bc162110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:28:44.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.567+0000 7fc8c112f640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc8bc15d870 0x7fc8bc162110 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:28:44.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.567+0000 7fc8c092e640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc8bc0b6690 0x7fc8bc13e690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:44.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.567+0000 7fc8c092e640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc8bc0b6690 0x7fc8bc13e690 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:41484/0 (socket says 10.20.193.58:41484) 2026-02-23T06:28:44.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.567+0000 7fc8c092e640 1 -- 10.20.193.58:0/2192456304 learned_addr learned my addr 10.20.193.58:0/2192456304 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:28:44.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.567+0000 7fc8b3fff640 1 --2- 10.20.193.58:0/2192456304 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc8bc15d4a0 0x7fc8bc1f77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:44.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.567+0000 7fc8c092e640 1 -- 10.20.193.58:0/2192456304 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc8bc15d4a0 msgr2=0x7fc8bc1f77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:44.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.567+0000 7fc8c092e640 1 --2- 10.20.193.58:0/2192456304 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc8bc15d4a0 0x7fc8bc1f77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.567+0000 7fc8c092e640 1 -- 10.20.193.58:0/2192456304 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc8bc15d870 msgr2=0x7fc8bc162110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:28:44.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.567+0000 7fc8c092e640 1 --2- 10.20.193.58:0/2192456304 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc8bc15d870 0x7fc8bc162110 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.567+0000 7fc8c092e640 1 -- 10.20.193.58:0/2192456304 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a4009570 con 0x7fc8bc0b6690 2026-02-23T06:28:44.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.567+0000 7fc8c092e640 1 --2- 10.20.193.58:0/2192456304 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc8bc0b6690 0x7fc8bc13e690 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8ac00b750 tx=0x7fc8ac00bc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:44.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.568+0000 7fc8b17fa640 1 -- 10.20.193.58:0/2192456304 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8ac002cd0 con 0x7fc8bc0b6690 2026-02-23T06:28:44.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.568+0000 7fc8c1930640 1 -- 10.20.193.58:0/2192456304 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8bc13d2d0 con 0x7fc8bc0b6690 2026-02-23T06:28:44.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.568+0000 7fc8c1930640 1 -- 10.20.193.58:0/2192456304 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8bc13d890 con 0x7fc8bc0b6690 2026-02-23T06:28:44.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.568+0000 7fc8b17fa640 1 -- 10.20.193.58:0/2192456304 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8ac004070 con 0x7fc8bc0b6690 2026-02-23T06:28:44.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.568+0000 7fc8b17fa640 1 -- 10.20.193.58:0/2192456304 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8ac0044a0 con 0x7fc8bc0b6690 2026-02-23T06:28:44.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.568+0000 7fc8c1930640 1 -- 10.20.193.58:0/2192456304 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8bc0b6d50 con 0x7fc8bc0b6690 2026-02-23T06:28:44.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.569+0000 7fc8b17fa640 1 -- 10.20.193.58:0/2192456304 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fc8ac00c520 con 0x7fc8bc0b6690 2026-02-23T06:28:44.565 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.570+0000 7fc8b17fa640 1 --2- 10.20.193.58:0/2192456304 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc88c07a5a0 0x7fc88c09aa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:44.565 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.571+0000 7fc8b17fa640 1 -- 10.20.193.58:0/2192456304 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fc8ac09d140 con 0x7fc8bc0b6690 2026-02-23T06:28:44.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.571+0000 7fc8b3fff640 1 --2- 10.20.193.58:0/2192456304 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc88c07a5a0 0x7fc88c09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:44.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.571+0000 7fc8b3fff640 1 --2- 10.20.193.58:0/2192456304 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc88c07a5a0 0x7fc88c09aa50 secure :-1 s=READY pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8a4004740 tx=0x7fc8a403a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:44.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.572+0000 7fc8b17fa640 1 -- 10.20.193.58:0/2192456304 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fc8ac060250 con 0x7fc8bc0b6690 2026-02-23T06:28:44.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.726+0000 7fc8c1930640 1 -- 10.20.193.58:0/2192456304 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc8bc05b0e0 con 0x7fc8bc0b6690 2026-02-23T06:28:44.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.726+0000 7fc8b17fa640 1 -- 10.20.193.58:0/2192456304 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7fc8ac006e60 con 0x7fc8bc0b6690 2026-02-23T06:28:44.722 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":62,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:28:44.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.728+0000 7fc8c1930640 1 -- 10.20.193.58:0/2192456304 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc88c07a5a0 msgr2=0x7fc88c09aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:44.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.728+0000 7fc8c1930640 1 --2- 10.20.193.58:0/2192456304 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc88c07a5a0 0x7fc88c09aa50 secure :-1 s=READY pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8a4004740 tx=0x7fc8a403a040 comp rx=0 tx=0).stop 2026-02-23T06:28:44.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.728+0000 7fc8c1930640 1 -- 10.20.193.58:0/2192456304 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc8bc0b6690 msgr2=0x7fc8bc13e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:44.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.728+0000 7fc8c1930640 1 --2- 10.20.193.58:0/2192456304 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc8bc0b6690 0x7fc8bc13e690 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8ac00b750 tx=0x7fc8ac00bc20 comp rx=0 tx=0).stop 2026-02-23T06:28:44.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.728+0000 7fc8c1930640 1 -- 10.20.193.58:0/2192456304 shutdown_connections 2026-02-23T06:28:44.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.728+0000 7fc8c1930640 1 --2- 10.20.193.58:0/2192456304 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc88c07a5a0 0x7fc88c09aa50 unknown :-1 s=CLOSED pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.728+0000 7fc8c1930640 1 --2- 10.20.193.58:0/2192456304 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc8bc15d870 0x7fc8bc162110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.728+0000 7fc8c1930640 1 --2- 10.20.193.58:0/2192456304 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc8bc15d4a0 0x7fc8bc1f77e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.728+0000 7fc8c1930640 1 --2- 10.20.193.58:0/2192456304 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc8bc0b6690 0x7fc8bc13e690 unknown :-1 s=CLOSED pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:44.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.728+0000 7fc8c1930640 1 -- 10.20.193.58:0/2192456304 >> 10.20.193.58:0/2192456304 conn(0x7fc8bc0b3c20 msgr2=0x7fc8bc15bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:28:44.725 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.728+0000 7fc8c1930640 1 -- 10.20.193.58:0/2192456304 shutdown_connections 2026-02-23T06:28:44.725 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:44.728+0000 7fc8c1930640 1 -- 10.20.193.58:0/2192456304 wait complete. 2026-02-23T06:28:47.737 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:28:47.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.865+0000 7f935ed54640 1 -- 10.20.193.58:0/2914003688 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9340004850 msgr2=0x7f9340004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:47.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.865+0000 7f935ed54640 1 --2- 10.20.193.58:0/2914003688 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9340004850 0x7f9340004cc0 secure :-1 s=READY pgs=85 gs=6 cs=0 l=1 c_cookie=1886107501141533867 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f934c0098b0 tx=0x7f934c02f030 comp rx=0 tx=0).stop 2026-02-23T06:28:47.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.865+0000 7f935ed54640 1 -- 10.20.193.58:0/2914003688 shutdown_connections 2026-02-23T06:28:47.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.865+0000 7f935ed54640 1 --2- 10.20.193.58:0/2914003688 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9340004850 0x7f9340004cc0 unknown :-1 s=CLOSED pgs=85 gs=6 cs=0 l=1 c_cookie=1886107501141533867 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:47.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.865+0000 7f935ed54640 1 -- 10.20.193.58:0/2914003688 >> 10.20.193.58:0/2914003688 conn(0x7f93580b3c20 msgr2=0x7f93580b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:28:47.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.865+0000 7f935ed54640 1 -- 10.20.193.58:0/2914003688 shutdown_connections 2026-02-23T06:28:47.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.865+0000 7f935ed54640 1 -- 10.20.193.58:0/2914003688 wait complete. 2026-02-23T06:28:47.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.867+0000 7f935ed54640 1 Processor -- start 2026-02-23T06:28:47.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.867+0000 7f935ed54640 1 -- start start 2026-02-23T06:28:47.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.867+0000 7f935ed54640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9340004850 0x7f935815e9a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:47.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.867+0000 7f935ed54640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9358162320 0x7f935815a540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:47.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.867+0000 7f935ed54640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f935815de80 0x7f935813adc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:47.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.867+0000 7f935ed54640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f935813ff40 con 0x7f9358162320 2026-02-23T06:28:47.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.867+0000 7f935ed54640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f93581fe910 con 0x7f9340004850 2026-02-23T06:28:47.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.867+0000 7f935ed54640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f935815eee0 con 0x7f935815de80 2026-02-23T06:28:47.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.868+0000 7f935d551640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9358162320 msgr2=0x7f935815a540 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:28:47.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.868+0000 7f935d551640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9358162320 0x7f935815a540 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:28:47.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.868+0000 7f935dd52640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9340004850 0x7f935815e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:47.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.868+0000 7f935e553640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f935815de80 0x7f935813adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:47.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.868+0000 7f935dd52640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9340004850 0x7f935815e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:49990/0 (socket says 10.20.193.58:49990) 2026-02-23T06:28:47.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.868+0000 7f935e553640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f935815de80 0x7f935813adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:41496/0 (socket says 10.20.193.58:41496) 2026-02-23T06:28:47.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.868+0000 7f935dd52640 1 -- 10.20.193.58:0/32476723 learned_addr learned my addr 10.20.193.58:0/32476723 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:28:47.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.868+0000 7f935dd52640 1 -- 10.20.193.58:0/32476723 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f935815de80 msgr2=0x7f935813adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:47.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.868+0000 7f935dd52640 1 --2- 10.20.193.58:0/32476723 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f935815de80 0x7f935813adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:47.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.868+0000 7f935dd52640 1 -- 10.20.193.58:0/32476723 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9358162320 msgr2=0x7f935815a540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:28:47.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.868+0000 7f935dd52640 1 --2- 10.20.193.58:0/32476723 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9358162320 0x7f935815a540 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:47.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.868+0000 7f935dd52640 1 -- 10.20.193.58:0/32476723 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93581fee00 con 0x7f9340004850 2026-02-23T06:28:47.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.868+0000 7f935dd52640 1 --2- 10.20.193.58:0/32476723 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9340004850 0x7f935815e9a0 secure :-1 s=READY pgs=86 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f934800b550 tx=0x7f934800ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:47.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.868+0000 7f93467fc640 1 -- 10.20.193.58:0/32476723 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9348002cd0 con 0x7f9340004850 2026-02-23T06:28:47.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.868+0000 7f935ed54640 1 -- 10.20.193.58:0/32476723 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9358162b30 con 0x7f9340004850 2026-02-23T06:28:47.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.869+0000 7f93467fc640 1 -- 10.20.193.58:0/32476723 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9348004070 con 0x7f9340004850 2026-02-23T06:28:47.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.869+0000 7f93467fc640 1 -- 10.20.193.58:0/32476723 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9348004480 con 0x7f9340004850 2026-02-23T06:28:47.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.869+0000 7f935ed54640 1 -- 10.20.193.58:0/32476723 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9358058050 con 0x7f9340004850 2026-02-23T06:28:47.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.869+0000 7f935ed54640 1 -- 10.20.193.58:0/32476723 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f935815b2d0 con 0x7f9340004850 2026-02-23T06:28:47.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.871+0000 7f93467fc640 1 -- 10.20.193.58:0/32476723 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f934801f020 con 0x7f9340004850 2026-02-23T06:28:47.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.872+0000 7f93467fc640 1 --2- 10.20.193.58:0/32476723 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f932807a5b0 0x7f932809aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:47.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.872+0000 7f93467fc640 1 -- 10.20.193.58:0/32476723 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f934809d4d0 con 0x7f9340004850 2026-02-23T06:28:47.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.872+0000 7f935d551640 1 --2- 10.20.193.58:0/32476723 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f932807a5b0 0x7f932809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:47.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.872+0000 7f93467fc640 1 -- 10.20.193.58:0/32476723 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f9348060660 con 0x7f9340004850 2026-02-23T06:28:47.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:47.872+0000 7f935d551640 1 --2- 10.20.193.58:0/32476723 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f932807a5b0 0x7f932809aa60 secure :-1 s=READY pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f934c009800 tx=0x7f934c004860 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:48.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:48.027+0000 7f935ed54640 1 -- 10.20.193.58:0/32476723 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f935815dc40 con 0x7f9340004850 2026-02-23T06:28:48.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:48.028+0000 7f93467fc640 1 -- 10.20.193.58:0/32476723 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f9348063780 con 0x7f9340004850 2026-02-23T06:28:48.023 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":62,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:28:48.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:48.029+0000 7f935ed54640 1 -- 10.20.193.58:0/32476723 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f932807a5b0 msgr2=0x7f932809aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:48.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:48.029+0000 7f935ed54640 1 --2- 10.20.193.58:0/32476723 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f932807a5b0 0x7f932809aa60 secure :-1 s=READY pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f934c009800 tx=0x7f934c004860 comp rx=0 tx=0).stop 2026-02-23T06:28:48.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:48.029+0000 7f935ed54640 1 -- 10.20.193.58:0/32476723 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9340004850 msgr2=0x7f935815e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:48.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:48.029+0000 7f935ed54640 1 --2- 10.20.193.58:0/32476723 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9340004850 0x7f935815e9a0 secure :-1 s=READY pgs=86 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f934800b550 tx=0x7f934800ba20 comp rx=0 tx=0).stop 2026-02-23T06:28:48.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:48.029+0000 7f935ed54640 1 -- 10.20.193.58:0/32476723 shutdown_connections 2026-02-23T06:28:48.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:48.029+0000 7f935ed54640 1 --2- 10.20.193.58:0/32476723 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f932807a5b0 0x7f932809aa60 unknown :-1 s=CLOSED pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:48.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:48.029+0000 7f935ed54640 1 --2- 10.20.193.58:0/32476723 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f935815de80 0x7f935813adc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:48.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:48.029+0000 7f935ed54640 1 --2- 10.20.193.58:0/32476723 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9358162320 0x7f935815a540 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:48.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:48.029+0000 7f935ed54640 1 --2- 10.20.193.58:0/32476723 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9340004850 0x7f935815e9a0 unknown :-1 s=CLOSED pgs=86 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:48.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:48.029+0000 7f935ed54640 1 -- 10.20.193.58:0/32476723 >> 10.20.193.58:0/32476723 conn(0x7f93580b3c20 msgr2=0x7f93580ae0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:28:48.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:48.029+0000 7f935ed54640 1 -- 10.20.193.58:0/32476723 shutdown_connections 2026-02-23T06:28:48.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:48.029+0000 7f935ed54640 1 -- 10.20.193.58:0/32476723 wait complete. 2026-02-23T06:28:51.037 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:28:51.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.164+0000 7f82ab243640 1 -- 10.20.193.58:0/672642684 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f82a415d4a0 msgr2=0x7f82a40affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:51.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.164+0000 7f82ab243640 1 --2- 10.20.193.58:0/672642684 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f82a415d4a0 0x7f82a40affb0 secure :-1 s=READY pgs=88 gs=3 cs=0 l=1 c_cookie=6296456268161004007 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82a40b5040 tx=0x7f829402f1b0 comp rx=0 tx=0).stop 2026-02-23T06:28:51.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.164+0000 7f82ab243640 1 -- 10.20.193.58:0/672642684 shutdown_connections 2026-02-23T06:28:51.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.164+0000 7f82ab243640 1 --2- 10.20.193.58:0/672642684 >> v2:10.20.193.58:3300/0 conn(0x7f82a415d870 0x7f82a40587b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:51.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.164+0000 7f82ab243640 1 --2- 10.20.193.58:0/672642684 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f82a415d4a0 0x7f82a40affb0 unknown :-1 s=CLOSED pgs=88 gs=3 cs=0 l=1 c_cookie=6296456268161004007 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:51.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.164+0000 7f82ab243640 1 -- 10.20.193.58:0/672642684 >> 10.20.193.58:0/672642684 conn(0x7f82a40b3c20 msgr2=0x7f82a40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:28:51.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.164+0000 7f82ab243640 1 -- 10.20.193.58:0/672642684 shutdown_connections 2026-02-23T06:28:51.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.164+0000 7f82ab243640 1 -- 10.20.193.58:0/672642684 wait complete. 2026-02-23T06:28:51.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.166+0000 7f82ab243640 1 Processor -- start 2026-02-23T06:28:51.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.166+0000 7f82ab243640 1 -- start start 2026-02-23T06:28:51.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.166+0000 7f82ab243640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f82a40b6690 0x7f82a4141ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:51.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.166+0000 7f82ab243640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f82a415d4a0 0x7f82a413e620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:51.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.166+0000 7f82ab243640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f82a415d870 0x7f82a414fc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:51.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.166+0000 7f82ab243640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f82a4143470 con 0x7f82a415d870 2026-02-23T06:28:51.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.166+0000 7f82ab243640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f82a4142410 con 0x7f82a415d4a0 2026-02-23T06:28:51.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.166+0000 7f82ab243640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f82a4142780 con 0x7f82a40b6690 2026-02-23T06:28:51.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.166+0000 7f82aaa42640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f82a415d870 msgr2=0x7f82a414fc70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:28:51.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.166+0000 7f82aaa42640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f82a415d870 0x7f82a414fc70 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:28:51.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.166+0000 7f82aa241640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f82a40b6690 0x7f82a4141ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:51.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.166+0000 7f82aa241640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f82a40b6690 0x7f82a4141ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:40274/0 (socket says 10.20.193.58:40274) 2026-02-23T06:28:51.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.166+0000 7f82aa241640 1 -- 10.20.193.58:0/2120467192 learned_addr learned my addr 10.20.193.58:0/2120467192 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:28:51.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.166+0000 7f82a9a40640 1 --2- 10.20.193.58:0/2120467192 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f82a415d4a0 0x7f82a413e620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:51.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.167+0000 7f82aa241640 1 -- 10.20.193.58:0/2120467192 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f82a415d4a0 msgr2=0x7f82a413e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:51.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.167+0000 7f82aa241640 1 --2- 10.20.193.58:0/2120467192 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f82a415d4a0 0x7f82a413e620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:51.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.167+0000 7f82aa241640 1 -- 10.20.193.58:0/2120467192 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f82a415d870 msgr2=0x7f82a414fc70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:28:51.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.167+0000 7f82aa241640 1 --2- 10.20.193.58:0/2120467192 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f82a415d870 0x7f82a414fc70 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:51.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.167+0000 7f82aa241640 1 -- 10.20.193.58:0/2120467192 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82940094b0 con 0x7f82a40b6690 2026-02-23T06:28:51.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.167+0000 7f82aa241640 1 --2- 10.20.193.58:0/2120467192 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f82a40b6690 0x7f82a4141ed0 secure :-1 s=READY pgs=114 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82940023d0 tx=0x7f8294002a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:51.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.167+0000 7f828affd640 1 -- 10.20.193.58:0/2120467192 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8294044070 con 0x7f82a40b6690 2026-02-23T06:28:51.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.167+0000 7f82ab243640 1 -- 10.20.193.58:0/2120467192 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82a40adfa0 con 0x7f82a40b6690 2026-02-23T06:28:51.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.167+0000 7f82ab243640 1 -- 10.20.193.58:0/2120467192 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f82a4143090 con 0x7f82a40b6690 2026-02-23T06:28:51.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.167+0000 7f828affd640 1 -- 10.20.193.58:0/2120467192 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8294004b60 con 0x7f82a40b6690 2026-02-23T06:28:51.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.167+0000 7f828affd640 1 -- 10.20.193.58:0/2120467192 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8294005020 con 0x7f82a40b6690 2026-02-23T06:28:51.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.167+0000 7f8288ff9640 1 -- 10.20.193.58:0/2120467192 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82a40b6d50 con 0x7f82a40b6690 2026-02-23T06:28:51.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.176+0000 7f828affd640 1 -- 10.20.193.58:0/2120467192 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f8294005180 con 0x7f82a40b6690 2026-02-23T06:28:51.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.177+0000 7f828affd640 1 --2- 10.20.193.58:0/2120467192 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f827407a5b0 0x7f827409aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:28:51.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.177+0000 7f828affd640 1 -- 10.20.193.58:0/2120467192 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f82940c2fc0 con 0x7f82a40b6690 2026-02-23T06:28:51.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.177+0000 7f828affd640 1 -- 10.20.193.58:0/2120467192 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f82940c3440 con 0x7f82a40b6690 2026-02-23T06:28:51.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.177+0000 7f82a9a40640 1 --2- 10.20.193.58:0/2120467192 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f827407a5b0 0x7f827409aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:28:51.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.178+0000 7f82a9a40640 1 --2- 10.20.193.58:0/2120467192 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f827407a5b0 0x7f827409aa60 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8298006fd0 tx=0x7f8298008040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:28:51.329 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.334+0000 7f8288ff9640 1 -- 10.20.193.58:0/2120467192 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f82a41435b0 con 0x7f82a40b6690 2026-02-23T06:28:51.329 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.334+0000 7f828affd640 1 -- 10.20.193.58:0/2120467192 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f829404e6f0 con 0x7f82a40b6690 2026-02-23T06:28:51.329 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":62,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:28:51.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.336+0000 7f8288ff9640 1 -- 10.20.193.58:0/2120467192 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f827407a5b0 msgr2=0x7f827409aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:51.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.336+0000 7f8288ff9640 1 --2- 10.20.193.58:0/2120467192 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f827407a5b0 0x7f827409aa60 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8298006fd0 tx=0x7f8298008040 comp rx=0 tx=0).stop 2026-02-23T06:28:51.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.336+0000 7f8288ff9640 1 -- 10.20.193.58:0/2120467192 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f82a40b6690 msgr2=0x7f82a4141ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:28:51.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.336+0000 7f8288ff9640 1 --2- 10.20.193.58:0/2120467192 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f82a40b6690 0x7f82a4141ed0 secure :-1 s=READY pgs=114 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82940023d0 tx=0x7f8294002a10 comp rx=0 tx=0).stop 2026-02-23T06:28:51.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.336+0000 7f8288ff9640 1 -- 10.20.193.58:0/2120467192 shutdown_connections 2026-02-23T06:28:51.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.336+0000 7f8288ff9640 1 --2- 10.20.193.58:0/2120467192 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f827407a5b0 0x7f827409aa60 unknown :-1 s=CLOSED pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:51.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.336+0000 7f8288ff9640 1 --2- 10.20.193.58:0/2120467192 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f82a415d870 0x7f82a414fc70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:51.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.336+0000 7f8288ff9640 1 --2- 10.20.193.58:0/2120467192 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f82a415d4a0 0x7f82a413e620 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:51.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.336+0000 7f8288ff9640 1 --2- 10.20.193.58:0/2120467192 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f82a40b6690 0x7f82a4141ed0 unknown :-1 s=CLOSED pgs=114 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:28:51.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.336+0000 7f8288ff9640 1 -- 10.20.193.58:0/2120467192 >> 10.20.193.58:0/2120467192 conn(0x7f82a40b3c20 msgr2=0x7f82a40b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:28:51.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.336+0000 7f8288ff9640 1 -- 10.20.193.58:0/2120467192 shutdown_connections 2026-02-23T06:28:51.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:28:51.336+0000 7f8288ff9640 1 -- 10.20.193.58:0/2120467192 wait complete. 2026-02-23T06:28:54.345 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:29:03.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.841+0000 7f271171c640 1 -- 10.20.193.58:0/1926342636 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f26f0005320 msgr2=0x7f26f0065a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:03.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.841+0000 7f271171c640 1 --2- 10.20.193.58:0/1926342636 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f26f0005320 0x7f26f0065a10 secure :-1 s=READY pgs=116 gs=51 cs=0 l=1 c_cookie=3470810652933003478 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f270c0b50c0 tx=0x7f27000316a0 comp rx=0 tx=0).stop 2026-02-23T06:29:03.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.842+0000 7f271171c640 1 -- 10.20.193.58:0/1926342636 shutdown_connections 2026-02-23T06:29:03.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.842+0000 7f271171c640 1 --2- 10.20.193.58:0/1926342636 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f26f0005320 0x7f26f0065a10 unknown :-1 s=CLOSED pgs=116 gs=51 cs=0 l=1 c_cookie=3470810652933003478 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:03.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.842+0000 7f271171c640 1 --2- 10.20.193.58:0/1926342636 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f26f0004850 0x7f26f0004cc0 unknown :-1 s=CLOSED pgs=0 gs=50 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:03.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.842+0000 7f271171c640 1 --2- 10.20.193.58:0/1926342636 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f26f0003a30 0x7f26f0003e20 unknown :-1 s=CLOSED pgs=0 gs=49 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:03.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.842+0000 7f271171c640 1 -- 10.20.193.58:0/1926342636 >> 10.20.193.58:0/1926342636 conn(0x7f270c0b3c20 msgr2=0x7f270c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:03.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.842+0000 7f271171c640 1 -- 10.20.193.58:0/1926342636 shutdown_connections 2026-02-23T06:29:03.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.842+0000 7f271171c640 1 -- 10.20.193.58:0/1926342636 wait complete. 2026-02-23T06:29:03.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.843+0000 7f271171c640 1 Processor -- start 2026-02-23T06:29:03.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.843+0000 7f271171c640 1 -- start start 2026-02-23T06:29:03.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.844+0000 7f271171c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f26f0003a30 0x7f270c155810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:03.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.844+0000 7f271171c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f26f0004850 0x7f270c138af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:03.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.844+0000 7f271171c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f26f0005320 0x7f270c1645c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:03.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.844+0000 7f271171c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f270c1378b0 con 0x7f26f0005320 2026-02-23T06:29:03.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.844+0000 7f271171c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f270c1362f0 con 0x7f26f0004850 2026-02-23T06:29:03.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.844+0000 7f271171c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f270c201820 con 0x7f26f0003a30 2026-02-23T06:29:03.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.844+0000 7f2710f1b640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f26f0005320 msgr2=0x7f270c1645c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:29:03.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.844+0000 7f2710f1b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f26f0005320 0x7f270c1645c0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:29:03.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.844+0000 7f270bfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f26f0003a30 0x7f270c155810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:03.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.844+0000 7f270b7fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f26f0004850 0x7f270c138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:03.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.844+0000 7f270bfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f26f0003a30 0x7f270c155810 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:39506/0 (socket says 10.20.193.58:39506) 2026-02-23T06:29:03.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.844+0000 7f270b7fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f26f0004850 0x7f270c138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:40338/0 (socket says 10.20.193.58:40338) 2026-02-23T06:29:03.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.844+0000 7f270bfff640 1 -- 10.20.193.58:0/1190425573 learned_addr learned my addr 10.20.193.58:0/1190425573 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:29:03.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.845+0000 7f270b7fe640 1 -- 10.20.193.58:0/1190425573 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f26f0003a30 msgr2=0x7f270c155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:03.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.845+0000 7f270b7fe640 1 --2- 10.20.193.58:0/1190425573 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f26f0003a30 0x7f270c155810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:03.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.845+0000 7f270b7fe640 1 -- 10.20.193.58:0/1190425573 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f26f0005320 msgr2=0x7f270c1645c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:29:03.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.845+0000 7f270b7fe640 1 --2- 10.20.193.58:0/1190425573 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f26f0005320 0x7f270c1645c0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:03.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.845+0000 7f270b7fe640 1 -- 10.20.193.58:0/1190425573 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f270c138390 con 0x7f26f0004850 2026-02-23T06:29:03.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.845+0000 7f270b7fe640 1 --2- 10.20.193.58:0/1190425573 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f26f0004850 0x7f270c138af0 secure :-1 s=READY pgs=92 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26e8045e20 tx=0x7f26fc007950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:03.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.845+0000 7f2708ff9640 1 -- 10.20.193.58:0/1190425573 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26fc004680 con 0x7f26f0004850 2026-02-23T06:29:03.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.845+0000 7f2708ff9640 1 -- 10.20.193.58:0/1190425573 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26fc00f040 con 0x7f26f0004850 2026-02-23T06:29:03.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.845+0000 7f2708ff9640 1 -- 10.20.193.58:0/1190425573 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26fc004a40 con 0x7f26f0004850 2026-02-23T06:29:03.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.845+0000 7f271171c640 1 -- 10.20.193.58:0/1190425573 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f270c138890 con 0x7f26f0004850 2026-02-23T06:29:03.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.845+0000 7f271171c640 1 -- 10.20.193.58:0/1190425573 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f270c201ae0 con 0x7f26f0004850 2026-02-23T06:29:03.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.846+0000 7f271171c640 1 -- 10.20.193.58:0/1190425573 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f270c056330 con 0x7f26f0004850 2026-02-23T06:29:03.842 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.847+0000 7f2708ff9640 1 -- 10.20.193.58:0/1190425573 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f26fc025020 con 0x7f26f0004850 2026-02-23T06:29:03.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.849+0000 7f2708ff9640 1 --2- 10.20.193.58:0/1190425573 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f26dc07a5b0 0x7f26dc09aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:03.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.849+0000 7f2708ff9640 1 -- 10.20.193.58:0/1190425573 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f26fc09ddd0 con 0x7f26f0004850 2026-02-23T06:29:03.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.849+0000 7f270bfff640 1 --2- 10.20.193.58:0/1190425573 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f26dc07a5b0 0x7f26dc09aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:03.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.849+0000 7f2708ff9640 1 -- 10.20.193.58:0/1190425573 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f26fc060ff0 con 0x7f26f0004850 2026-02-23T06:29:03.845 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:03.850+0000 7f270bfff640 1 --2- 10.20.193.58:0/1190425573 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f26dc07a5b0 0x7f26dc09aa60 secure :-1 s=READY pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26f8005c40 tx=0x7f26f8015040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:04.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.004+0000 7f271171c640 1 -- 10.20.193.58:0/1190425573 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f270c138520 con 0x7f26f0004850 2026-02-23T06:29:04.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.005+0000 7f2708ff9640 1 -- 10.20.193.58:0/1190425573 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1748 (secure 0 0 0) 0x7f270c138520 con 0x7f26f0004850 2026-02-23T06:29:04.000 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":66,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:29:04.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.006+0000 7f271171c640 1 -- 10.20.193.58:0/1190425573 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f26dc07a5b0 msgr2=0x7f26dc09aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:04.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.006+0000 7f271171c640 1 --2- 10.20.193.58:0/1190425573 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f26dc07a5b0 0x7f26dc09aa60 secure :-1 s=READY pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26f8005c40 tx=0x7f26f8015040 comp rx=0 tx=0).stop 2026-02-23T06:29:04.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.006+0000 7f271171c640 1 -- 10.20.193.58:0/1190425573 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f26f0004850 msgr2=0x7f270c138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:04.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.006+0000 7f271171c640 1 --2- 10.20.193.58:0/1190425573 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f26f0004850 0x7f270c138af0 secure :-1 s=READY pgs=92 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26e8045e20 tx=0x7f26fc007950 comp rx=0 tx=0).stop 2026-02-23T06:29:04.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.006+0000 7f271171c640 1 -- 10.20.193.58:0/1190425573 shutdown_connections 2026-02-23T06:29:04.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.006+0000 7f271171c640 1 --2- 10.20.193.58:0/1190425573 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f26dc07a5b0 0x7f26dc09aa60 unknown :-1 s=CLOSED pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:04.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.006+0000 7f271171c640 1 --2- 10.20.193.58:0/1190425573 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f26f0005320 0x7f270c1645c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:04.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.006+0000 7f271171c640 1 --2- 10.20.193.58:0/1190425573 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f26f0004850 0x7f270c138af0 unknown :-1 s=CLOSED pgs=92 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:04.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.006+0000 7f271171c640 1 --2- 10.20.193.58:0/1190425573 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f26f0003a30 0x7f270c155810 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:04.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.006+0000 7f271171c640 1 -- 10.20.193.58:0/1190425573 >> 10.20.193.58:0/1190425573 conn(0x7f270c0b3c20 msgr2=0x7f270c15a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:04.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.006+0000 7f271171c640 1 -- 10.20.193.58:0/1190425573 shutdown_connections 2026-02-23T06:29:04.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.006+0000 7f271171c640 1 -- 10.20.193.58:0/1190425573 wait complete. 2026-02-23T06:29:04.014 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:29:04.014 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-23T06:29:04.014 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:29:04.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.143+0000 7fdfaf577640 1 -- 10.20.193.58:0/2591701252 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdfb015d4a0 msgr2=0x7fdfb00affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:04.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.143+0000 7fdfaf577640 1 --2- 10.20.193.58:0/2591701252 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdfb015d4a0 0x7fdfb00affb0 secure :-1 s=READY pgs=93 gs=3 cs=0 l=1 c_cookie=5601425015794017814 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfb00b5040 tx=0x7fdfa402f280 comp rx=0 tx=0).stop 2026-02-23T06:29:04.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.143+0000 7fdfaf577640 1 -- 10.20.193.58:0/2591701252 shutdown_connections 2026-02-23T06:29:04.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.143+0000 7fdfaf577640 1 --2- 10.20.193.58:0/2591701252 >> v2:10.20.193.58:3300/0 conn(0x7fdfb00b6690 0x7fdfb0058ec0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:04.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.143+0000 7fdfaf577640 1 --2- 10.20.193.58:0/2591701252 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdfb015d4a0 0x7fdfb00affb0 unknown :-1 s=CLOSED pgs=93 gs=3 cs=0 l=1 c_cookie=5601425015794017814 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:04.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.143+0000 7fdfaf577640 1 -- 10.20.193.58:0/2591701252 >> 10.20.193.58:0/2591701252 conn(0x7fdfb00b3c20 msgr2=0x7fdfb00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:04.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.143+0000 7fdfaf577640 1 -- 10.20.193.58:0/2591701252 shutdown_connections 2026-02-23T06:29:04.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.143+0000 7fdfaf577640 1 -- 10.20.193.58:0/2591701252 wait complete. 2026-02-23T06:29:04.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.144+0000 7fdfaf577640 1 Processor -- start 2026-02-23T06:29:04.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.144+0000 7fdfaf577640 1 -- start start 2026-02-23T06:29:04.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.145+0000 7fdfaf577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdfb00b6690 0x7fdfb011b1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:04.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.145+0000 7fdfaf577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdfb015d4a0 0x7fdfb01485d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:04.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.145+0000 7fdfaf577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdfb015d870 0x7fdfb011bcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:04.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.145+0000 7fdfaf577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb013b750 con 0x7fdfb00b6690 2026-02-23T06:29:04.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.145+0000 7fdfaf577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb0147ea0 con 0x7fdfb015d870 2026-02-23T06:29:04.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.145+0000 7fdfaf577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fdfb013abd0 con 0x7fdfb015d4a0 2026-02-23T06:29:04.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.145+0000 7fdfae575640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdfb00b6690 msgr2=0x7fdfb011b1d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:29:04.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.145+0000 7fdfae575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdfb00b6690 0x7fdfb011b1d0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:29:04.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.145+0000 7fdfadd74640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdfb015d4a0 0x7fdfb01485d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:04.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.145+0000 7fdfaed76640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdfb015d870 0x7fdfb011bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:04.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.145+0000 7fdfadd74640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdfb015d4a0 0x7fdfb01485d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:39508/0 (socket says 10.20.193.58:39508) 2026-02-23T06:29:04.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.145+0000 7fdfadd74640 1 -- 10.20.193.58:0/2087904933 learned_addr learned my addr 10.20.193.58:0/2087904933 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:29:04.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.145+0000 7fdfadd74640 1 -- 10.20.193.58:0/2087904933 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdfb015d870 msgr2=0x7fdfb011bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:04.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.145+0000 7fdfadd74640 1 --2- 10.20.193.58:0/2087904933 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdfb015d870 0x7fdfb011bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:04.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.145+0000 7fdfadd74640 1 -- 10.20.193.58:0/2087904933 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdfb00b6690 msgr2=0x7fdfb011b1d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:29:04.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.145+0000 7fdfadd74640 1 --2- 10.20.193.58:0/2087904933 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdfb00b6690 0x7fdfb011b1d0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:04.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.145+0000 7fdfadd74640 1 -- 10.20.193.58:0/2087904933 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa4009570 con 0x7fdfb015d4a0 2026-02-23T06:29:04.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.146+0000 7fdfadd74640 1 --2- 10.20.193.58:0/2087904933 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdfb015d4a0 0x7fdfb01485d0 secure :-1 s=READY pgs=117 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf9800b780 tx=0x7fdf9800bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:04.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.146+0000 7fdf96ffd640 1 -- 10.20.193.58:0/2087904933 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdf98002cd0 con 0x7fdfb015d4a0 2026-02-23T06:29:04.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.146+0000 7fdfaf577640 1 -- 10.20.193.58:0/2087904933 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfb013aeb0 con 0x7fdfb015d4a0 2026-02-23T06:29:04.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.146+0000 7fdf96ffd640 1 -- 10.20.193.58:0/2087904933 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf98002e30 con 0x7fdfb015d4a0 2026-02-23T06:29:04.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.146+0000 7fdf96ffd640 1 -- 10.20.193.58:0/2087904933 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdf980042d0 con 0x7fdfb015d4a0 2026-02-23T06:29:04.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.146+0000 7fdfaf577640 1 -- 10.20.193.58:0/2087904933 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfb013b470 con 0x7fdfb015d4a0 2026-02-23T06:29:04.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.146+0000 7fdfaf577640 1 --2- 10.20.193.58:0/2087904933 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdfb0148010 0x7fdfb011c210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:04.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.146+0000 7fdfaf577640 1 -- 10.20.193.58:0/2087904933 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb00609c0 con 0x7fdfb0148010 2026-02-23T06:29:04.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.147+0000 7fdfae575640 1 --2- 10.20.193.58:0/2087904933 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdfb0148010 0x7fdfb011c210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:04.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.147+0000 7fdfae575640 1 -- 10.20.193.58:0/2087904933 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdfb00b6330 con 0x7fdfb0148010 2026-02-23T06:29:04.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.147+0000 7fdfae575640 1 --2- 10.20.193.58:0/2087904933 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdfb0148010 0x7fdfb011c210 secure :-1 s=READY pgs=94 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfb00b5040 tx=0x7fdfa40028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:04.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.148+0000 7fdf96ffd640 1 -- 10.20.193.58:0/2087904933 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfa403f070 con 0x7fdfb0148010 2026-02-23T06:29:04.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.148+0000 7fdf96ffd640 1 -- 10.20.193.58:0/2087904933 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fdf98004430 con 0x7fdfb015d4a0 2026-02-23T06:29:04.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.148+0000 7fdf96ffd640 1 --2- 10.20.193.58:0/2087904933 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdf7c07a660 0x7fdf7c09ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:04.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.148+0000 7fdf96ffd640 1 -- 10.20.193.58:0/2087904933 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fdf9809d070 con 0x7fdfb015d4a0 2026-02-23T06:29:04.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.149+0000 7fdf96ffd640 1 -- 10.20.193.58:0/2087904933 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fdfa4004850 con 0x7fdfb0148010 2026-02-23T06:29:04.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.149+0000 7fdf96ffd640 1 -- 10.20.193.58:0/2087904933 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdfb0148010 msgr2=0x7fdfb011c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:04.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.149+0000 7fdf96ffd640 1 --2- 10.20.193.58:0/2087904933 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdfb0148010 0x7fdfb011c210 secure :-1 s=READY pgs=94 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfb00b5040 tx=0x7fdfa40028d0 comp rx=0 tx=0).stop 2026-02-23T06:29:04.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.149+0000 7fdf96ffd640 1 -- 10.20.193.58:0/2087904933 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdfb0148010 msgr2=0x7fdfb011c210 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:29:04.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.149+0000 7fdf96ffd640 1 --2- 10.20.193.58:0/2087904933 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdfb0148010 0x7fdfb011c210 secure :-1 s=CLOSED pgs=94 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfb00b5040 tx=0x7fdfa40028d0 comp rx=0 tx=0).stop 2026-02-23T06:29:04.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.149+0000 7fdfaed76640 1 --2- 10.20.193.58:0/2087904933 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdf7c07a660 0x7fdf7c09ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:04.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.149+0000 7fdfaed76640 1 --2- 10.20.193.58:0/2087904933 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdf7c07a660 0x7fdf7c09ab10 secure :-1 s=READY pgs=236 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfb0162820 tx=0x7fdfa000a110 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:04.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.152+0000 7fdfaf577640 1 --2- 10.20.193.58:0/2087904933 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdfb0148b10 0x7fdfb011c750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:04.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.152+0000 7fdfaf577640 1 -- 10.20.193.58:0/2087904933 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb0164250 con 0x7fdfb0148b10 2026-02-23T06:29:04.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.153+0000 7fdfae575640 1 --2- 10.20.193.58:0/2087904933 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdfb0148b10 0x7fdfb011c750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:04.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.153+0000 7fdfae575640 1 -- 10.20.193.58:0/2087904933 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdfb00b6d50 con 0x7fdfb0148b10 2026-02-23T06:29:04.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.154+0000 7fdfae575640 1 --2- 10.20.193.58:0/2087904933 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdfb0148b10 0x7fdfb011c750 secure :-1 s=READY pgs=95 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfa40023d0 tx=0x7fdfa402f280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:04.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.154+0000 7fdf96ffd640 1 -- 10.20.193.58:0/2087904933 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfa404f070 con 0x7fdfb0148b10 2026-02-23T06:29:04.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.154+0000 7fdf96ffd640 1 -- 10.20.193.58:0/2087904933 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5236 (secure 0 0 0) 0x7fdfa4002e90 con 0x7fdfb0148b10 2026-02-23T06:29:04.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.154+0000 7fdf96ffd640 1 -- 10.20.193.58:0/2087904933 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdfb0148b10 msgr2=0x7fdfb011c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:04.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.154+0000 7fdf96ffd640 1 --2- 10.20.193.58:0/2087904933 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdfb0148b10 0x7fdfb011c750 secure :-1 s=READY pgs=95 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfa40023d0 tx=0x7fdfa402f280 comp rx=0 tx=0).stop 2026-02-23T06:29:04.150 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:29:04.150 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:29:04.150 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:29:04.150 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:29:04.150 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 66, 2026-02-23T06:29:04.150 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 145665, 2026-02-23T06:29:04.150 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:29:04.150 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:29:04.150 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:29:04.150 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:04.151 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:29:04.151 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:29:04.151 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:29:04.151 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:29:04.151 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:04.151 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:04.151 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:04.151 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:04.152 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:04.152 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:04.152 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:04.152 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:04.152 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:04.152 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:04.152 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:04.152 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:04.152 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:04.152 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:04.152 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:29:04.152 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:29:04.152 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:04.152 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:04.152 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:04.153 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:04.153 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:04.153 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:04.153 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:04.153 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:04.153 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:04.153 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:04.153 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:04.153 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:04.153 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:04.153 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:04.153 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:04.153 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:29:04.153 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:29:04.153 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:29:04.153 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:29:04.154 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:29:04.154 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:29:04.154 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:29:04.154 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:29:04.154 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:29:04.154 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:29:04.154 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:29:04.154 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:29:04.154 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:29:04.154 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:29:04.154 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:29:04.154 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:29:04.154 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:29:04.154 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:04.154 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:04.154 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:04.155 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:04.155 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:04.155 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:04.155 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:04.155 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:04.155 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:04.155 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:04.155 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:04.155 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:04.155 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:04.155 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:04.155 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:29:04.155 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:04.155 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:29:04.155 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:04.155 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:29:04.156 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:29:04.156 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:04.156 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:04.156 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:04.156 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:04.156 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:29:04.156 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:04.156 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:04.156 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:04.156 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:04.156 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:29:04.156 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:04.156 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:04.156 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:04.156 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:04.156 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:29:04.156 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:29:04.157 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:04.157 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:04.157 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:29:04.157 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:04.157 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:04.157 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:04.157 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:29:04.157 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:29:04.157 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:04.157 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:04.157 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:04.157 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:04.157 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:29:04.157 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:04.157 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:04.157 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:04.157 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:04.158 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:29:04.158 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:04.158 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:04.158 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:04.158 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:04.158 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:29:04.158 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:29:04.158 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:04.158 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:04.158 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:29:04.158 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:04.158 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:04.158 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:04.158 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:29:04.158 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:29:04.158 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:04.158 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:04.159 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:04.159 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:04.159 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:29:04.159 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:04.159 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:04.159 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:04.159 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:04.159 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:29:04.159 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:04.159 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:04.159 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:04.159 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:04.159 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:29:04.159 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:29:04.159 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:04.159 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:04.160 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:29:04.160 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:04.160 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:04.160 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:04.160 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:04.160 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:29:04.160 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:29:04.160 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:04.160 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:04.160 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:04.160 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:29:04.160 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:04.160 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:04.160 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:29:04.160 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:04.160 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:04.161 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:04.161 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:29:04.161 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:04.161 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:04.161 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:29:04.161 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:04.161 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:04.161 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:04.161 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:29:04.161 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:04.161 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:04.161 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:29:04.161 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:04.161 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:04.161 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:04.161 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:29:04.162 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:04.162 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:04.162 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:04.162 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:29:04.162 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:29:04.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.154+0000 7fdf96ffd640 1 -- 10.20.193.58:0/2087904933 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdfb0148b10 msgr2=0x7fdfb011c750 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:29:04.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.154+0000 7fdf96ffd640 1 --2- 10.20.193.58:0/2087904933 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdfb0148b10 0x7fdfb011c750 unknown :-1 s=CLOSED pgs=95 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:04.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.154+0000 7fdfaf577640 1 -- 10.20.193.58:0/2087904933 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdf7c07a660 msgr2=0x7fdf7c09ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:04.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.154+0000 7fdfaf577640 1 --2- 10.20.193.58:0/2087904933 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdf7c07a660 0x7fdf7c09ab10 secure :-1 s=READY pgs=236 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfb0162820 tx=0x7fdfa000a110 comp rx=0 tx=0).stop 2026-02-23T06:29:04.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.154+0000 7fdfaf577640 1 -- 10.20.193.58:0/2087904933 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdfb015d4a0 msgr2=0x7fdfb01485d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:04.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.154+0000 7fdfaf577640 1 --2- 10.20.193.58:0/2087904933 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdfb015d4a0 0x7fdfb01485d0 secure :-1 s=READY pgs=117 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf9800b780 tx=0x7fdf9800bc50 comp rx=0 tx=0).stop 2026-02-23T06:29:04.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.154+0000 7fdfaed76640 1 -- 10.20.193.58:0/2087904933 reap_dead start 2026-02-23T06:29:04.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.154+0000 7fdfaed76640 1 -- 10.20.193.58:0/2087904933 reap_dead start 2026-02-23T06:29:04.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.154+0000 7fdfaf577640 1 -- 10.20.193.58:0/2087904933 shutdown_connections 2026-02-23T06:29:04.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.154+0000 7fdfaf577640 1 -- 10.20.193.58:0/2087904933 >> 10.20.193.58:0/2087904933 conn(0x7fdfb00b3c20 msgr2=0x7fdfb0163510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:04.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.154+0000 7fdfaf577640 1 -- 10.20.193.58:0/2087904933 shutdown_connections 2026-02-23T06:29:04.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.154+0000 7fdfaf577640 1 -- 10.20.193.58:0/2087904933 wait complete. 2026-02-23T06:29:04.166 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:29:04.167 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-23T06:29:04.167 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:29:04.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.297+0000 7fa8df577640 1 -- 10.20.193.58:0/3441006742 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa8e015d870 msgr2=0x7fa8e00587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:04.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.297+0000 7fa8df577640 1 --2- 10.20.193.58:0/3441006742 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa8e015d870 0x7fa8e00587b0 secure :-1 s=READY pgs=96 gs=4 cs=0 l=1 c_cookie=12314360935451430365 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8e0059740 tx=0x7fa8c802f280 comp rx=0 tx=0).stop 2026-02-23T06:29:04.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.297+0000 7fa8df577640 1 -- 10.20.193.58:0/3441006742 shutdown_connections 2026-02-23T06:29:04.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.297+0000 7fa8df577640 1 --2- 10.20.193.58:0/3441006742 >> v2:10.20.193.58:3300/0 conn(0x7fa8e00b6690 0x7fa8e0058cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:04.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.297+0000 7fa8df577640 1 --2- 10.20.193.58:0/3441006742 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa8e015d870 0x7fa8e00587b0 unknown :-1 s=CLOSED pgs=96 gs=4 cs=0 l=1 c_cookie=12314360935451430365 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:04.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.297+0000 7fa8df577640 1 -- 10.20.193.58:0/3441006742 >> 10.20.193.58:0/3441006742 conn(0x7fa8e00b3c20 msgr2=0x7fa8e00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:04.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.297+0000 7fa8df577640 1 -- 10.20.193.58:0/3441006742 shutdown_connections 2026-02-23T06:29:04.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.297+0000 7fa8df577640 1 -- 10.20.193.58:0/3441006742 wait complete. 2026-02-23T06:29:04.293 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.298+0000 7fa8df577640 1 Processor -- start 2026-02-23T06:29:04.293 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.299+0000 7fa8df577640 1 -- start start 2026-02-23T06:29:04.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.299+0000 7fa8df577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa8e00b6690 0x7fa8e015a640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:04.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.299+0000 7fa8df577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa8e015d4a0 0x7fa8e0120d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:04.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.299+0000 7fa8de575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa8e00b6690 0x7fa8e015a640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:04.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.299+0000 7fa8ddd74640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa8e015d4a0 0x7fa8e0120d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:04.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.299+0000 7fa8de575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa8e00b6690 0x7fa8e015a640 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:39516/0 (socket says 10.20.193.58:39516) 2026-02-23T06:29:04.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.299+0000 7fa8ddd74640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa8e015d4a0 0x7fa8e0120d30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:40384/0 (socket says 10.20.193.58:40384) 2026-02-23T06:29:04.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.299+0000 7fa8df577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa8e015d870 0x7fa8e0161a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:04.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.299+0000 7fa8df577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e013cff0 con 0x7fa8e015d870 2026-02-23T06:29:04.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.299+0000 7fa8df577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e013cae0 con 0x7fa8e015d4a0 2026-02-23T06:29:04.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.299+0000 7fa8de575640 1 -- 10.20.193.58:0/2975804734 learned_addr learned my addr 10.20.193.58:0/2975804734 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:29:04.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.299+0000 7fa8df577640 1 -- 10.20.193.58:0/2975804734 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa8e01205c0 con 0x7fa8e00b6690 2026-02-23T06:29:04.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.300+0000 7fa8ded76640 1 -- 10.20.193.58:0/2975804734 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa8e015d870 msgr2=0x7fa8e0161a80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:29:04.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.300+0000 7fa8ded76640 1 --2- 10.20.193.58:0/2975804734 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa8e015d870 0x7fa8e0161a80 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:29:04.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.300+0000 7fa8ddd74640 1 -- 10.20.193.58:0/2975804734 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa8e00b6690 msgr2=0x7fa8e015a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:04.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.300+0000 7fa8ddd74640 1 --2- 10.20.193.58:0/2975804734 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa8e00b6690 0x7fa8e015a640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:04.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.300+0000 7fa8ddd74640 1 -- 10.20.193.58:0/2975804734 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa8e015d870 msgr2=0x7fa8e0161a80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:29:04.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.300+0000 7fa8ddd74640 1 --2- 10.20.193.58:0/2975804734 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa8e015d870 0x7fa8e0161a80 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:04.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.300+0000 7fa8ddd74640 1 -- 10.20.193.58:0/2975804734 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c8009570 con 0x7fa8e015d4a0 2026-02-23T06:29:04.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.300+0000 7fa8ddd74640 1 --2- 10.20.193.58:0/2975804734 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa8e015d4a0 0x7fa8e0120d30 secure :-1 s=READY pgs=97 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8e0059740 tx=0x7fa8c80028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:04.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.300+0000 7fa8c6ffd640 1 -- 10.20.193.58:0/2975804734 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa8c803d070 con 0x7fa8e015d4a0 2026-02-23T06:29:04.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.300+0000 7fa8df577640 1 -- 10.20.193.58:0/2975804734 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8e01208a0 con 0x7fa8e015d4a0 2026-02-23T06:29:04.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.300+0000 7fa8c6ffd640 1 -- 10.20.193.58:0/2975804734 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8c8004850 con 0x7fa8e015d4a0 2026-02-23T06:29:04.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.300+0000 7fa8c6ffd640 1 -- 10.20.193.58:0/2975804734 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa8c8004c20 con 0x7fa8e015d4a0 2026-02-23T06:29:04.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.300+0000 7fa8df577640 1 -- 10.20.193.58:0/2975804734 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8e013a8e0 con 0x7fa8e015d4a0 2026-02-23T06:29:04.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.301+0000 7fa8df577640 1 --2- 10.20.193.58:0/2975804734 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa8e0121270 0x7fa8e01614c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:04.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.301+0000 7fa8df577640 1 -- 10.20.193.58:0/2975804734 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa8e00b6330 con 0x7fa8e0121270 2026-02-23T06:29:04.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.301+0000 7fa8de575640 1 --2- 10.20.193.58:0/2975804734 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa8e0121270 0x7fa8e01614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:04.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.302+0000 7fa8de575640 1 -- 10.20.193.58:0/2975804734 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa8e00b5e10 con 0x7fa8e0121270 2026-02-23T06:29:04.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.302+0000 7fa8de575640 1 --2- 10.20.193.58:0/2975804734 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa8e0121270 0x7fa8e01614c0 secure :-1 s=READY pgs=118 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8d4009740 tx=0x7fa8d4009c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:04.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.302+0000 7fa8c6ffd640 1 -- 10.20.193.58:0/2975804734 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa8d400eb80 con 0x7fa8e0121270 2026-02-23T06:29:04.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.302+0000 7fa8c6ffd640 1 -- 10.20.193.58:0/2975804734 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fa8c8004d80 con 0x7fa8e015d4a0 2026-02-23T06:29:04.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.303+0000 7fa8c6ffd640 1 --2- 10.20.193.58:0/2975804734 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa8ac07a660 0x7fa8ac09ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:04.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.303+0000 7fa8c6ffd640 1 -- 10.20.193.58:0/2975804734 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fa8d4009e70 con 0x7fa8e0121270 2026-02-23T06:29:04.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.303+0000 7fa8c6ffd640 1 -- 10.20.193.58:0/2975804734 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa8e0121270 msgr2=0x7fa8e01614c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:04.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.303+0000 7fa8c6ffd640 1 --2- 10.20.193.58:0/2975804734 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa8e0121270 0x7fa8e01614c0 secure :-1 s=READY pgs=118 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8d4009740 tx=0x7fa8d4009c10 comp rx=0 tx=0).stop 2026-02-23T06:29:04.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.303+0000 7fa8c6ffd640 1 -- 10.20.193.58:0/2975804734 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa8e0121270 msgr2=0x7fa8e01614c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:29:04.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.303+0000 7fa8c6ffd640 1 --2- 10.20.193.58:0/2975804734 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa8e0121270 0x7fa8e01614c0 secure :-1 s=CLOSED pgs=118 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8d4009740 tx=0x7fa8d4009c10 comp rx=0 tx=0).stop 2026-02-23T06:29:04.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.303+0000 7fa8c6ffd640 1 -- 10.20.193.58:0/2975804734 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fa8c8089880 con 0x7fa8e015d4a0 2026-02-23T06:29:04.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.303+0000 7fa8ded76640 1 --2- 10.20.193.58:0/2975804734 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa8ac07a660 0x7fa8ac09ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:04.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.304+0000 7fa8ded76640 1 --2- 10.20.193.58:0/2975804734 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa8ac07a660 0x7fa8ac09ab10 secure :-1 s=READY pgs=237 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8e0161080 tx=0x7fa8d0007d00 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:04.302 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.307+0000 7fa8df577640 1 --2- 10.20.193.58:0/2975804734 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa8e01626f0 0x7fa8e0161fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:04.302 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.307+0000 7fa8df577640 1 -- 10.20.193.58:0/2975804734 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa8e0162ac0 con 0x7fa8e01626f0 2026-02-23T06:29:04.302 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.307+0000 7fa8de575640 1 --2- 10.20.193.58:0/2975804734 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa8e01626f0 0x7fa8e0161fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:04.303 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.307+0000 7fa8de575640 1 -- 10.20.193.58:0/2975804734 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa8e00b6d50 con 0x7fa8e01626f0 2026-02-23T06:29:04.303 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.308+0000 7fa8de575640 1 --2- 10.20.193.58:0/2975804734 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa8e01626f0 0x7fa8e0161fc0 secure :-1 s=READY pgs=119 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8d4015000 tx=0x7fa8d40048c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:04.303 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.308+0000 7fa8c6ffd640 1 -- 10.20.193.58:0/2975804734 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa8d400eb80 con 0x7fa8e01626f0 2026-02-23T06:29:04.303 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.308+0000 7fa8c6ffd640 1 -- 10.20.193.58:0/2975804734 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5544 (secure 0 0 0) 0x7fa8d4012600 con 0x7fa8e01626f0 2026-02-23T06:29:04.304 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:29:04.304 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:29:04.304 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:29:04.304 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:29:04.304 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 66, 2026-02-23T06:29:04.304 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 218820, 2026-02-23T06:29:04.304 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:29:04.305 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:29:04.305 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:29:04.305 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:04.305 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:29:04.305 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:29:04.305 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:29:04.305 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:29:04.305 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:04.305 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:04.306 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:04.306 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:04.306 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:04.306 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:04.306 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:04.306 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:04.306 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:04.306 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:04.306 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:04.306 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:04.306 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:04.307 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:04.307 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:29:04.307 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:29:04.307 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:04.307 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:04.307 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:04.307 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:04.307 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:04.307 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:04.307 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:04.307 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:04.307 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:04.308 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:04.308 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:04.308 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:04.308 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:04.308 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:04.308 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:04.308 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:29:04.308 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:29:04.308 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:29:04.308 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:29:04.308 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:29:04.308 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:29:04.309 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:29:04.309 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:29:04.309 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:29:04.309 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:29:04.309 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:29:04.309 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:29:04.309 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:29:04.309 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:29:04.309 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:29:04.309 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:29:04.309 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:29:04.310 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:04.310 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:04.310 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:04.310 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:04.310 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:04.310 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:04.310 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:04.310 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:04.310 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:04.310 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:04.310 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:04.310 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:04.311 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:04.311 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:04.311 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:29:04.311 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:04.311 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:29:04.311 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:04.311 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:29:04.311 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:29:04.311 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:04.311 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:04.311 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:04.312 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:04.312 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:29:04.312 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:04.312 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:04.312 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:04.312 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:04.312 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:29:04.312 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:04.312 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:04.312 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:04.312 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:04.312 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:29:04.313 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:29:04.313 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:04.313 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:04.313 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:29:04.313 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:04.313 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:04.313 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:04.313 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:29:04.313 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:29:04.313 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:04.313 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:04.313 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:04.314 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:04.314 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:29:04.314 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:04.314 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:04.314 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:04.314 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:04.314 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:29:04.314 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:04.314 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:04.314 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:04.314 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:04.315 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:29:04.315 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:29:04.315 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:04.315 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:04.315 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:29:04.315 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:04.315 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:04.316 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:04.316 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:29:04.316 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:29:04.316 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:04.316 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:04.316 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:04.316 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:04.316 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:29:04.316 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:04.316 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:04.317 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:04.317 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:04.317 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:29:04.317 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:04.317 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:04.317 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:04.317 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:04.317 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:29:04.317 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:29:04.317 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:04.317 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:04.317 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:29:04.317 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:04.318 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:04.318 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:04.318 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:04.318 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:29:04.318 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:29:04.318 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:04.318 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:04.318 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:04.318 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:29:04.318 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:04.318 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:04.318 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:29:04.318 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:04.318 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:04.319 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:04.319 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:29:04.319 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:04.319 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:04.319 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:29:04.319 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:04.319 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:04.319 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:04.319 INFO:teuthology.orchestra.run.trial058.stdout: "num": 7 2026-02-23T06:29:04.319 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:04.319 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:04.319 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:29:04.319 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:04.320 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:29:04.320 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:29:04.320 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:29:04.320 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:04.320 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:04.320 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:04.320 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:04.320 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:29:04.320 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:04.320 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:04.320 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:29:04.320 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:04.320 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:04.320 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:04.321 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:29:04.321 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:04.321 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:04.321 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:04.321 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:29:04.321 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:29:04.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.308+0000 7fa8c6ffd640 1 -- 10.20.193.58:0/2975804734 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa8e01626f0 msgr2=0x7fa8e0161fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:04.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.308+0000 7fa8c6ffd640 1 --2- 10.20.193.58:0/2975804734 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa8e01626f0 0x7fa8e0161fc0 secure :-1 s=READY pgs=119 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8d4015000 tx=0x7fa8d40048c0 comp rx=0 tx=0).stop 2026-02-23T06:29:04.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.308+0000 7fa8c6ffd640 1 -- 10.20.193.58:0/2975804734 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa8e01626f0 msgr2=0x7fa8e0161fc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:29:04.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.308+0000 7fa8c6ffd640 1 --2- 10.20.193.58:0/2975804734 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa8e01626f0 0x7fa8e0161fc0 unknown :-1 s=CLOSED pgs=119 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:04.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.308+0000 7fa8df577640 1 -- 10.20.193.58:0/2975804734 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa8ac07a660 msgr2=0x7fa8ac09ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:04.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.308+0000 7fa8df577640 1 --2- 10.20.193.58:0/2975804734 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa8ac07a660 0x7fa8ac09ab10 secure :-1 s=READY pgs=237 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8e0161080 tx=0x7fa8d0007d00 comp rx=0 tx=0).stop 2026-02-23T06:29:04.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.308+0000 7fa8df577640 1 -- 10.20.193.58:0/2975804734 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa8e015d4a0 msgr2=0x7fa8e0120d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:04.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.308+0000 7fa8df577640 1 --2- 10.20.193.58:0/2975804734 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa8e015d4a0 0x7fa8e0120d30 secure :-1 s=READY pgs=97 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8e0059740 tx=0x7fa8c80028d0 comp rx=0 tx=0).stop 2026-02-23T06:29:04.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.308+0000 7fa8ded76640 1 -- 10.20.193.58:0/2975804734 reap_dead start 2026-02-23T06:29:04.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.308+0000 7fa8ded76640 1 -- 10.20.193.58:0/2975804734 reap_dead start 2026-02-23T06:29:04.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.308+0000 7fa8df577640 1 -- 10.20.193.58:0/2975804734 shutdown_connections 2026-02-23T06:29:04.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.308+0000 7fa8df577640 1 -- 10.20.193.58:0/2975804734 >> 10.20.193.58:0/2975804734 conn(0x7fa8e00b3c20 msgr2=0x7fa8e00b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:04.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.308+0000 7fa8df577640 1 -- 10.20.193.58:0/2975804734 shutdown_connections 2026-02-23T06:29:04.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:04.308+0000 7fa8df577640 1 -- 10.20.193.58:0/2975804734 wait complete. 2026-02-23T06:29:04.324 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:29:04.324 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:29:12.763 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:29:12.768 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:29:24.325 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-23T06:29:24.325 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-23T06:29:24.325 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-23T06:29:24.326 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-23T06:29:24.330 INFO:tasks.ceph.mon.a:Started 2026-02-23T06:29:24.330 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:29:24.330 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:29:24.450 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.454+0000 7fe9bdf0c640 1 -- 10.20.193.58:0/4185342849 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe9b8161d50 msgr2=0x7fe9b8157670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:24.451 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.454+0000 7fe9bdf0c640 1 --2- 10.20.193.58:0/4185342849 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe9b8161d50 0x7fe9b8157670 secure :-1 s=READY pgs=122 gs=3 cs=0 l=1 c_cookie=8789931287192102682 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9a8007520 tx=0x7fe9a802ff50 comp rx=0 tx=0).stop 2026-02-23T06:29:24.451 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.454+0000 7fe9bdf0c640 1 -- 10.20.193.58:0/4185342849 shutdown_connections 2026-02-23T06:29:24.451 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.454+0000 7fe9bdf0c640 1 --2- 10.20.193.58:0/4185342849 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe9b8161d50 0x7fe9b8157670 unknown :-1 s=CLOSED pgs=122 gs=3 cs=0 l=1 c_cookie=8789931287192102682 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:24.451 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.454+0000 7fe9bdf0c640 1 -- 10.20.193.58:0/4185342849 >> 10.20.193.58:0/4185342849 conn(0x7fe9b8058e50 msgr2=0x7fe9b8059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:24.451 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.455+0000 7fe9bdf0c640 1 -- 10.20.193.58:0/4185342849 shutdown_connections 2026-02-23T06:29:24.451 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.455+0000 7fe9bdf0c640 1 -- 10.20.193.58:0/4185342849 wait complete. 2026-02-23T06:29:24.453 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.456+0000 7fe9bdf0c640 1 Processor -- start 2026-02-23T06:29:24.453 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.456+0000 7fe9bdf0c640 1 -- start start 2026-02-23T06:29:24.453 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.456+0000 7fe9bdf0c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe9b80b1540 0x7fe9b813a250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:24.454 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.456+0000 7fe9bdf0c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe9b80b1910 0x7fe9b8200f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:24.454 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.456+0000 7fe9bdf0c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe9b8161d50 0x7fe9b82014d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:24.454 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.456+0000 7fe9bdf0c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b8156aa0 con 0x7fe9b80b1540 2026-02-23T06:29:24.454 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.456+0000 7fe9bdf0c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b8155900 con 0x7fe9b8161d50 2026-02-23T06:29:24.454 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.456+0000 7fe9bdf0c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe9b813b500 con 0x7fe9b80b1910 2026-02-23T06:29:24.454 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.457+0000 7fe9b7fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe9b8161d50 0x7fe9b82014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:24.454 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.457+0000 7fe9b7fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe9b8161d50 0x7fe9b82014d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:37622/0 (socket says 10.20.193.58:37622) 2026-02-23T06:29:24.454 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.457+0000 7fe9b7fff640 1 -- 10.20.193.58:0/2476990884 learned_addr learned my addr 10.20.193.58:0/2476990884 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:29:24.454 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.457+0000 7fe9b77fe640 1 --2- 10.20.193.58:0/2476990884 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe9b80b1540 0x7fe9b813a250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:24.454 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.457+0000 7fe9b6ffd640 1 --2- 10.20.193.58:0/2476990884 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe9b80b1910 0x7fe9b8200f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:24.454 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.457+0000 7fe9b77fe640 1 -- 10.20.193.58:0/2476990884 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe9b80b1540 msgr2=0x7fe9b813a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-23T06:29:24.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.457+0000 7fe9b77fe640 1 -- 10.20.193.58:0/2476990884 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe9b80b1540 msgr2=0x7fe9b813a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:29:24.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.457+0000 7fe9b77fe640 1 --2- 10.20.193.58:0/2476990884 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe9b80b1540 0x7fe9b813a250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:29:24.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.457+0000 7fe9b7fff640 1 -- 10.20.193.58:0/2476990884 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe9b80b1910 msgr2=0x7fe9b8200f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:24.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.457+0000 7fe9b7fff640 1 --2- 10.20.193.58:0/2476990884 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe9b80b1910 0x7fe9b8200f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:24.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.457+0000 7fe9b7fff640 1 -- 10.20.193.58:0/2476990884 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe9b80b1540 msgr2=0x7fe9b813a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:24.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.457+0000 7fe9b77fe640 1 --2- 10.20.193.58:0/2476990884 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe9b80b1540 0x7fe9b813a250 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:29:24.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.457+0000 7fe9b7fff640 1 --2- 10.20.193.58:0/2476990884 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe9b80b1540 0x7fe9b813a250 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:24.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.457+0000 7fe9b7fff640 1 -- 10.20.193.58:0/2476990884 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a80071c0 con 0x7fe9b8161d50 2026-02-23T06:29:24.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.457+0000 7fe9b7fff640 1 --2- 10.20.193.58:0/2476990884 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe9b8161d50 0x7fe9b82014d0 secure :-1 s=READY pgs=102 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9ac008ce0 tx=0x7fe9ac00dba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:24.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.458+0000 7fe993fff640 1 -- 10.20.193.58:0/2476990884 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9ac00b860 con 0x7fe9b8161d50 2026-02-23T06:29:24.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.458+0000 7fe993fff640 1 -- 10.20.193.58:0/2476990884 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9ac00bab0 con 0x7fe9b8161d50 2026-02-23T06:29:24.456 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.458+0000 7fe993fff640 1 -- 10.20.193.58:0/2476990884 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9ac00bea0 con 0x7fe9b8161d50 2026-02-23T06:29:24.456 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.458+0000 7fe9bdf0c640 1 -- 10.20.193.58:0/2476990884 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9b8156cb0 con 0x7fe9b8161d50 2026-02-23T06:29:24.456 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.458+0000 7fe9bdf0c640 1 -- 10.20.193.58:0/2476990884 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9b815c490 con 0x7fe9b8161d50 2026-02-23T06:29:24.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.459+0000 7fe9bdf0c640 1 -- 10.20.193.58:0/2476990884 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9b805b3b0 con 0x7fe9b8161d50 2026-02-23T06:29:24.458 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.460+0000 7fe993fff640 1 -- 10.20.193.58:0/2476990884 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fe9ac024060 con 0x7fe9b8161d50 2026-02-23T06:29:24.458 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.461+0000 7fe993fff640 1 --2- 10.20.193.58:0/2476990884 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe98807a6b0 0x7fe98809ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:24.458 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.461+0000 7fe993fff640 1 -- 10.20.193.58:0/2476990884 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fe9ac09e7b0 con 0x7fe9b8161d50 2026-02-23T06:29:24.458 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.461+0000 7fe9b77fe640 1 --2- 10.20.193.58:0/2476990884 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe98807a6b0 0x7fe98809ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:24.458 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.461+0000 7fe993fff640 1 -- 10.20.193.58:0/2476990884 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fe9ac061940 con 0x7fe9b8161d50 2026-02-23T06:29:24.458 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.462+0000 7fe9b77fe640 1 --2- 10.20.193.58:0/2476990884 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe98807a6b0 0x7fe98809ab60 secure :-1 s=READY pgs=239 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9a4007940 tx=0x7fe9a4009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:24.613 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.617+0000 7fe9bdf0c640 1 -- 10.20.193.58:0/2476990884 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe9b8156e40 con 0x7fe9b8161d50 2026-02-23T06:29:24.613 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.617+0000 7fe993fff640 1 -- 10.20.193.58:0/2476990884 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1754 (secure 0 0 0) 0x7fe9ac064a60 con 0x7fe9b8161d50 2026-02-23T06:29:24.613 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":70,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:29:24.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.619+0000 7fe9bdf0c640 1 -- 10.20.193.58:0/2476990884 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe98807a6b0 msgr2=0x7fe98809ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:24.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.619+0000 7fe9bdf0c640 1 --2- 10.20.193.58:0/2476990884 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe98807a6b0 0x7fe98809ab60 secure :-1 s=READY pgs=239 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9a4007940 tx=0x7fe9a4009040 comp rx=0 tx=0).stop 2026-02-23T06:29:24.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.619+0000 7fe9bdf0c640 1 -- 10.20.193.58:0/2476990884 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe9b8161d50 msgr2=0x7fe9b82014d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:24.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.619+0000 7fe9bdf0c640 1 --2- 10.20.193.58:0/2476990884 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe9b8161d50 0x7fe9b82014d0 secure :-1 s=READY pgs=102 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9ac008ce0 tx=0x7fe9ac00dba0 comp rx=0 tx=0).stop 2026-02-23T06:29:24.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.619+0000 7fe9bdf0c640 1 -- 10.20.193.58:0/2476990884 shutdown_connections 2026-02-23T06:29:24.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.619+0000 7fe9bdf0c640 1 --2- 10.20.193.58:0/2476990884 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe98807a6b0 0x7fe98809ab60 unknown :-1 s=CLOSED pgs=239 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:24.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.619+0000 7fe9bdf0c640 1 --2- 10.20.193.58:0/2476990884 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe9b8161d50 0x7fe9b82014d0 unknown :-1 s=CLOSED pgs=102 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:24.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.619+0000 7fe9bdf0c640 1 --2- 10.20.193.58:0/2476990884 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe9b80b1910 0x7fe9b8200f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:24.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.619+0000 7fe9bdf0c640 1 --2- 10.20.193.58:0/2476990884 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe9b80b1540 0x7fe9b813a250 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:24.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.619+0000 7fe9bdf0c640 1 -- 10.20.193.58:0/2476990884 >> 10.20.193.58:0/2476990884 conn(0x7fe9b8058e50 msgr2=0x7fe9b8152090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:24.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.619+0000 7fe9bdf0c640 1 -- 10.20.193.58:0/2476990884 shutdown_connections 2026-02-23T06:29:24.616 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.619+0000 7fe9bdf0c640 1 -- 10.20.193.58:0/2476990884 wait complete. 2026-02-23T06:29:24.626 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:29:24.626 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:29:24.626 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:29:24.750 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.754+0000 7fe059c83640 1 -- 10.20.193.58:0/1038309872 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe0540b6690 msgr2=0x7fe054058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:24.750 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.754+0000 7fe059c83640 1 --2- 10.20.193.58:0/1038309872 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe0540b6690 0x7fe054058cf0 secure :-1 s=READY pgs=5 gs=2 cs=0 l=1 c_cookie=10848960826998419592 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe050006f50 tx=0x7fe050030360 comp rx=0 tx=0).stop 2026-02-23T06:29:24.750 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.754+0000 7fe059c83640 1 -- 10.20.193.58:0/1038309872 shutdown_connections 2026-02-23T06:29:24.750 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.754+0000 7fe059c83640 1 --2- 10.20.193.58:0/1038309872 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe0540b6690 0x7fe054058cf0 unknown :-1 s=CLOSED pgs=5 gs=2 cs=0 l=1 c_cookie=10848960826998419592 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:24.750 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.754+0000 7fe059c83640 1 --2- 10.20.193.58:0/1038309872 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe05415d870 0x7fe0540587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:24.750 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.754+0000 7fe059c83640 1 -- 10.20.193.58:0/1038309872 >> 10.20.193.58:0/1038309872 conn(0x7fe0540b3c20 msgr2=0x7fe0540b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:24.750 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.754+0000 7fe059c83640 1 -- 10.20.193.58:0/1038309872 shutdown_connections 2026-02-23T06:29:24.750 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.754+0000 7fe059c83640 1 -- 10.20.193.58:0/1038309872 wait complete. 2026-02-23T06:29:24.753 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.755+0000 7fe059c83640 1 Processor -- start 2026-02-23T06:29:24.753 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.755+0000 7fe059c83640 1 -- start start 2026-02-23T06:29:24.754 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.756+0000 7fe059c83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe0540b6690 0x7fe05415dc40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:24.754 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.756+0000 7fe059c83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe05415d4a0 0x7fe05415ebf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:24.754 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.756+0000 7fe059c83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe05415d870 0x7fe054175a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:24.754 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.756+0000 7fe059c83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe05413ec70 con 0x7fe05415d870 2026-02-23T06:29:24.754 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.756+0000 7fe059c83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe05413e200 con 0x7fe0540b6690 2026-02-23T06:29:24.754 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.756+0000 7fe059c83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe05415f130 con 0x7fe05415d4a0 2026-02-23T06:29:24.754 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.756+0000 7fe059482640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe05415d870 0x7fe054175a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:24.754 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.756+0000 7fe059482640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe05415d870 0x7fe054175a30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:38798/0 (socket says 10.20.193.58:38798) 2026-02-23T06:29:24.754 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.756+0000 7fe059482640 1 -- 10.20.193.58:0/1321214376 learned_addr learned my addr 10.20.193.58:0/1321214376 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:29:24.754 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.756+0000 7fe04bfff640 1 --2- 10.20.193.58:0/1321214376 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe05415d4a0 0x7fe05415ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:24.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.756+0000 7fe058c81640 1 --2- 10.20.193.58:0/1321214376 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe0540b6690 0x7fe05415dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:24.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.756+0000 7fe059482640 1 -- 10.20.193.58:0/1321214376 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe05415d4a0 msgr2=0x7fe05415ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:24.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.756+0000 7fe059482640 1 --2- 10.20.193.58:0/1321214376 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe05415d4a0 0x7fe05415ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:24.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.756+0000 7fe059482640 1 -- 10.20.193.58:0/1321214376 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe0540b6690 msgr2=0x7fe05415dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:24.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.756+0000 7fe059482640 1 --2- 10.20.193.58:0/1321214376 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe0540b6690 0x7fe05415dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:24.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.756+0000 7fe059482640 1 -- 10.20.193.58:0/1321214376 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe05000a650 con 0x7fe05415d870 2026-02-23T06:29:24.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.756+0000 7fe058c81640 1 --2- 10.20.193.58:0/1321214376 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe0540b6690 0x7fe05415dc40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:29:24.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.756+0000 7fe059482640 1 --2- 10.20.193.58:0/1321214376 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe05415d870 0x7fe054175a30 secure :-1 s=READY pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe050005820 tx=0x7fe050003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:24.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.757+0000 7fe0497fa640 1 -- 10.20.193.58:0/1321214376 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0500398a0 con 0x7fe05415d870 2026-02-23T06:29:24.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.757+0000 7fe0497fa640 1 -- 10.20.193.58:0/1321214376 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe050039af0 con 0x7fe05415d870 2026-02-23T06:29:24.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.757+0000 7fe0497fa640 1 -- 10.20.193.58:0/1321214376 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe050039ea0 con 0x7fe05415d870 2026-02-23T06:29:24.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.757+0000 7fe059c83640 1 -- 10.20.193.58:0/1321214376 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe05413e430 con 0x7fe05415d870 2026-02-23T06:29:24.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.757+0000 7fe059c83640 1 -- 10.20.193.58:0/1321214376 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe05413e990 con 0x7fe05415d870 2026-02-23T06:29:24.756 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.757+0000 7fe022ffd640 1 --2- 10.20.193.58:0/1321214376 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe0180041f0 0x7fe0180246a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:24.756 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.757+0000 7fe022ffd640 1 -- 10.20.193.58:0/1321214376 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe018025f20 con 0x7fe0180041f0 2026-02-23T06:29:24.756 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.758+0000 7fe058c81640 1 --2- 10.20.193.58:0/1321214376 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe0180041f0 0x7fe0180246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:24.756 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.758+0000 7fe058c81640 1 -- 10.20.193.58:0/1321214376 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe0180260e0 con 0x7fe0180041f0 2026-02-23T06:29:24.756 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.758+0000 7fe058c81640 1 --2- 10.20.193.58:0/1321214376 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe0180041f0 0x7fe0180246a0 secure :-1 s=READY pgs=7 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe044002730 tx=0x7fe04400eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:24.758 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.758+0000 7fe0497fa640 1 -- 10.20.193.58:0/1321214376 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe044002b70 con 0x7fe0180041f0 2026-02-23T06:29:24.759 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.758+0000 7fe0497fa640 1 -- 10.20.193.58:0/1321214376 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fe044002cd0 con 0x7fe0180041f0 2026-02-23T06:29:24.759 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.759+0000 7fe0497fa640 1 -- 10.20.193.58:0/1321214376 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe0180041f0 msgr2=0x7fe0180246a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:24.759 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.759+0000 7fe0497fa640 1 --2- 10.20.193.58:0/1321214376 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe0180041f0 0x7fe0180246a0 secure :-1 s=READY pgs=7 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe044002730 tx=0x7fe04400eba0 comp rx=0 tx=0).stop 2026-02-23T06:29:24.759 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.759+0000 7fe0497fa640 1 -- 10.20.193.58:0/1321214376 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe0180041f0 msgr2=0x7fe0180246a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:29:24.759 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.759+0000 7fe0497fa640 1 --2- 10.20.193.58:0/1321214376 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe0180041f0 0x7fe0180246a0 secure :-1 s=CLOSED pgs=7 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe044002730 tx=0x7fe04400eba0 comp rx=0 tx=0).stop 2026-02-23T06:29:24.759 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.759+0000 7fe0497fa640 1 -- 10.20.193.58:0/1321214376 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fe05004b460 con 0x7fe05415d870 2026-02-23T06:29:24.759 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.760+0000 7fe0497fa640 1 --2- 10.20.193.58:0/1321214376 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe02407a430 0x7fe02409a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:24.759 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.760+0000 7fe0497fa640 1 -- 10.20.193.58:0/1321214376 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fe0500c4500 con 0x7fe05415d870 2026-02-23T06:29:24.759 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.760+0000 7fe058c81640 1 --2- 10.20.193.58:0/1321214376 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe02407a430 0x7fe02409a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:24.759 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.761+0000 7fe058c81640 1 --2- 10.20.193.58:0/1321214376 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe02407a430 0x7fe02409a8e0 secure :-1 s=READY pgs=240 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe044002730 tx=0x7fe044004000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:24.759 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.762+0000 7fe022ffd640 1 --2- 10.20.193.58:0/1321214376 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe018024fb0 0x7fe018025430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:24.760 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.762+0000 7fe022ffd640 1 -- 10.20.193.58:0/1321214376 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe018025a90 con 0x7fe018024fb0 2026-02-23T06:29:24.760 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.762+0000 7fe04bfff640 1 --2- 10.20.193.58:0/1321214376 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe018024fb0 0x7fe018025430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:24.760 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.763+0000 7fe04bfff640 1 -- 10.20.193.58:0/1321214376 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe018025c50 con 0x7fe018024fb0 2026-02-23T06:29:24.760 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.763+0000 7fe04bfff640 1 --2- 10.20.193.58:0/1321214376 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe018024fb0 0x7fe018025430 secure :-1 s=READY pgs=8 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0541632a0 tx=0x7fe03c00fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:24.760 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.763+0000 7fe0497fa640 1 -- 10.20.193.58:0/1321214376 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe03c00db20 con 0x7fe018024fb0 2026-02-23T06:29:24.760 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.763+0000 7fe0497fa640 1 -- 10.20.193.58:0/1321214376 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4910 (secure 0 0 0) 0x7fe03c00dc80 con 0x7fe018024fb0 2026-02-23T06:29:24.760 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.763+0000 7fe0497fa640 1 -- 10.20.193.58:0/1321214376 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe018024fb0 msgr2=0x7fe018025430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:24.760 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.763+0000 7fe0497fa640 1 --2- 10.20.193.58:0/1321214376 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe018024fb0 0x7fe018025430 secure :-1 s=READY pgs=8 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0541632a0 tx=0x7fe03c00fda0 comp rx=0 tx=0).stop 2026-02-23T06:29:24.760 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.763+0000 7fe0497fa640 1 -- 10.20.193.58:0/1321214376 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe018024fb0 msgr2=0x7fe018025430 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:29:24.760 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.763+0000 7fe0497fa640 1 --2- 10.20.193.58:0/1321214376 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe018024fb0 0x7fe018025430 secure :-1 s=CLOSED pgs=8 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0541632a0 tx=0x7fe03c00fda0 comp rx=0 tx=0).stop 2026-02-23T06:29:24.761 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:29:24.761 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:29:24.761 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:29:24.761 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:29:24.761 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 70, 2026-02-23T06:29:24.761 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 320, 2026-02-23T06:29:24.761 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:29:24.761 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:29:24.762 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:29:24.762 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:29:24.762 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:24.762 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:29:24.762 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:29:24.762 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:29:24.762 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:29:24.762 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:24.762 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:24.762 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:24.762 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:24.763 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:24.763 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:24.763 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:24.763 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:24.763 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:24.763 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:24.763 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:24.763 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:24.763 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:24.763 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:24.763 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:29:24.763 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:29:24.763 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:24.764 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:24.764 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:24.764 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:24.764 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:24.764 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:24.764 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:24.764 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:24.764 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:24.764 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:24.764 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:24.764 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:24.764 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:24.765 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:24.765 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:24.765 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:29:24.765 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:29:24.765 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:29:24.765 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:29:24.765 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:29:24.765 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:29:24.765 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:29:24.765 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:29:24.765 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:29:24.765 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:29:24.766 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:29:24.766 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:29:24.766 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:29:24.766 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:29:24.766 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:29:24.766 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:29:24.766 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:29:24.766 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:24.766 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:24.766 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:24.766 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:24.766 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:24.766 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:24.767 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:24.767 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:24.767 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:24.767 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:24.767 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:24.767 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:24.767 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:24.767 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:24.767 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:29:24.767 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:24.767 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:29:24.767 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:24.768 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:29:24.768 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:29:24.768 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:24.768 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:24.768 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:24.768 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:24.768 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:29:24.768 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:24.768 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:24.768 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:24.768 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:24.768 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:29:24.768 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:24.769 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:24.769 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:24.769 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:24.769 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:29:24.769 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:29:24.769 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:24.769 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:24.769 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:29:24.769 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:24.769 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:24.769 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:24.769 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:29:24.770 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:29:24.770 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:24.770 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:24.770 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:24.770 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:24.770 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:29:24.770 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:24.770 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:24.770 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:24.770 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:24.770 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:29:24.770 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:24.770 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:24.771 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:24.771 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:24.771 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:29:24.771 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:29:24.771 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:24.771 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:24.771 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:29:24.771 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:24.771 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:24.771 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:24.771 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:29:24.771 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:29:24.771 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:24.772 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:24.772 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:24.772 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:24.772 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:29:24.772 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:24.772 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:24.772 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:24.772 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:24.772 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:29:24.772 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:24.772 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:24.772 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:24.773 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:24.773 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:29:24.773 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:29:24.773 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:24.773 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:24.773 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:29:24.773 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:24.773 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:24.773 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:24.773 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:24.773 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:29:24.773 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:29:24.774 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:24.774 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:24.774 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:24.774 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:29:24.774 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:24.774 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:24.774 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:29:24.774 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:24.774 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:24.774 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:24.774 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:29:24.774 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:24.774 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:24.775 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:24.775 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:29:24.775 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:29:24.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.763+0000 7fe022ffd640 1 -- 10.20.193.58:0/1321214376 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe02407a430 msgr2=0x7fe02409a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:24.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.763+0000 7fe022ffd640 1 --2- 10.20.193.58:0/1321214376 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe02407a430 0x7fe02409a8e0 secure :-1 s=READY pgs=240 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe044002730 tx=0x7fe044004000 comp rx=0 tx=0).stop 2026-02-23T06:29:24.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.763+0000 7fe022ffd640 1 -- 10.20.193.58:0/1321214376 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe05415d870 msgr2=0x7fe054175a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:24.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.763+0000 7fe022ffd640 1 --2- 10.20.193.58:0/1321214376 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe05415d870 0x7fe054175a30 secure :-1 s=READY pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe050005820 tx=0x7fe050003d00 comp rx=0 tx=0).stop 2026-02-23T06:29:24.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.763+0000 7fe059482640 1 -- 10.20.193.58:0/1321214376 reap_dead start 2026-02-23T06:29:24.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.763+0000 7fe059482640 1 -- 10.20.193.58:0/1321214376 reap_dead start 2026-02-23T06:29:24.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.763+0000 7fe022ffd640 1 -- 10.20.193.58:0/1321214376 shutdown_connections 2026-02-23T06:29:24.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.763+0000 7fe022ffd640 1 -- 10.20.193.58:0/1321214376 >> 10.20.193.58:0/1321214376 conn(0x7fe0540b3c20 msgr2=0x7fe0541633c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:24.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.764+0000 7fe022ffd640 1 -- 10.20.193.58:0/1321214376 shutdown_connections 2026-02-23T06:29:24.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.764+0000 7fe022ffd640 1 -- 10.20.193.58:0/1321214376 wait complete. 2026-02-23T06:29:24.778 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:29:24.778 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:29:24.778 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:29:24.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.905+0000 7f9d2b683640 1 -- 10.20.193.58:0/2225872413 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9d2415d4a0 msgr2=0x7f9d240affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:24.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.905+0000 7f9d2b683640 1 --2- 10.20.193.58:0/2225872413 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9d2415d4a0 0x7f9d240affb0 secure :-1 s=READY pgs=123 gs=3 cs=0 l=1 c_cookie=1679681137519717413 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d1c005e70 tx=0x7f9d1c02f290 comp rx=0 tx=0).stop 2026-02-23T06:29:24.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.905+0000 7f9d2b683640 1 -- 10.20.193.58:0/2225872413 shutdown_connections 2026-02-23T06:29:24.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.905+0000 7f9d2b683640 1 --2- 10.20.193.58:0/2225872413 >> v2:10.20.193.58:3300/0 conn(0x7f9d2415d870 0x7f9d240587b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:24.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.905+0000 7f9d2b683640 1 --2- 10.20.193.58:0/2225872413 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9d2415d4a0 0x7f9d240affb0 unknown :-1 s=CLOSED pgs=123 gs=3 cs=0 l=1 c_cookie=1679681137519717413 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:24.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.905+0000 7f9d2b683640 1 -- 10.20.193.58:0/2225872413 >> 10.20.193.58:0/2225872413 conn(0x7f9d240b3c20 msgr2=0x7f9d240b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:24.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.905+0000 7f9d2b683640 1 -- 10.20.193.58:0/2225872413 shutdown_connections 2026-02-23T06:29:24.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.905+0000 7f9d2b683640 1 -- 10.20.193.58:0/2225872413 wait complete. 2026-02-23T06:29:24.901 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.906+0000 7f9d2b683640 1 Processor -- start 2026-02-23T06:29:24.901 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.906+0000 7f9d2b683640 1 -- start start 2026-02-23T06:29:24.901 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.907+0000 7f9d2b683640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9d240b6690 0x7f9d24140b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:24.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.907+0000 7f9d2b683640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9d2415d4a0 0x7f9d24161960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:24.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.907+0000 7f9d2b683640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9d2415d870 0x7f9d24057750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:24.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.907+0000 7f9d2b683640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f9d24161ea0 con 0x7f9d240b6690 2026-02-23T06:29:24.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.907+0000 7f9d2b683640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9d24141200 con 0x7f9d2415d4a0 2026-02-23T06:29:24.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.907+0000 7f9d2b683640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f9d2411d000 con 0x7f9d2415d870 2026-02-23T06:29:24.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.907+0000 7f9d2a681640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9d240b6690 0x7f9d24140b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:24.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.907+0000 7f9d29e80640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9d2415d4a0 0x7f9d24161960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:24.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.907+0000 7f9d2a681640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9d240b6690 0x7f9d24140b70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:38822/0 (socket says 10.20.193.58:38822) 2026-02-23T06:29:24.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.907+0000 7f9d2a681640 1 -- 10.20.193.58:0/2697817434 learned_addr learned my addr 10.20.193.58:0/2697817434 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:29:24.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.907+0000 7f9d2ae82640 1 --2- 10.20.193.58:0/2697817434 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9d2415d870 0x7f9d24057750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:24.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.907+0000 7f9d2a681640 1 -- 10.20.193.58:0/2697817434 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9d2415d870 msgr2=0x7f9d24057750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:24.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.907+0000 7f9d2a681640 1 --2- 10.20.193.58:0/2697817434 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9d2415d870 0x7f9d24057750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:24.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.907+0000 7f9d2a681640 1 -- 10.20.193.58:0/2697817434 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9d2415d4a0 msgr2=0x7f9d24161960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:24.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.907+0000 7f9d2a681640 1 --2- 10.20.193.58:0/2697817434 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9d2415d4a0 0x7f9d24161960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:24.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.907+0000 7f9d2a681640 1 -- 10.20.193.58:0/2697817434 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d1c009570 con 0x7f9d240b6690 2026-02-23T06:29:24.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.907+0000 7f9d2a681640 1 --2- 10.20.193.58:0/2697817434 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9d240b6690 0x7f9d24140b70 secure :-1 s=READY pgs=10 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d1c009a20 tx=0x7f9d1c0028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:24.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.907+0000 7f9d0effd640 1 -- 10.20.193.58:0/2697817434 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9d1c03d070 con 0x7f9d240b6690 2026-02-23T06:29:24.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.907+0000 7f9d0effd640 1 -- 10.20.193.58:0/2697817434 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d1c038470 con 0x7f9d240b6690 2026-02-23T06:29:24.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.907+0000 7f9d0effd640 1 -- 10.20.193.58:0/2697817434 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9d1c0388a0 con 0x7f9d240b6690 2026-02-23T06:29:24.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.907+0000 7f9d2b683640 1 -- 10.20.193.58:0/2697817434 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d2411c3f0 con 0x7f9d240b6690 2026-02-23T06:29:24.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.908+0000 7f9d2b683640 1 -- 10.20.193.58:0/2697817434 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d2411c9b0 con 0x7f9d240b6690 2026-02-23T06:29:24.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.908+0000 7f9d2b683640 1 --2- 10.20.193.58:0/2697817434 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9d2412a4c0 0x7f9d2411f940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:24.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.908+0000 7f9d2b683640 1 -- 10.20.193.58:0/2697817434 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9d240b6330 con 0x7f9d2412a4c0 2026-02-23T06:29:24.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.908+0000 7f9d29e80640 1 --2- 10.20.193.58:0/2697817434 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9d2412a4c0 0x7f9d2411f940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:24.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.909+0000 7f9d29e80640 1 -- 10.20.193.58:0/2697817434 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9d240b5e10 con 0x7f9d2412a4c0 2026-02-23T06:29:24.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.909+0000 7f9d29e80640 1 --2- 10.20.193.58:0/2697817434 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9d2412a4c0 0x7f9d2411f940 secure :-1 s=READY pgs=103 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d241459d0 tx=0x7f9d10010e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:24.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.909+0000 7f9d0effd640 1 -- 10.20.193.58:0/2697817434 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9d10004500 con 0x7f9d2412a4c0 2026-02-23T06:29:24.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.909+0000 7f9d0effd640 1 -- 10.20.193.58:0/2697817434 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f9d1000e9d0 con 0x7f9d2412a4c0 2026-02-23T06:29:24.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.909+0000 7f9d0effd640 1 -- 10.20.193.58:0/2697817434 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9d2412a4c0 msgr2=0x7f9d2411f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:24.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.909+0000 7f9d0effd640 1 --2- 10.20.193.58:0/2697817434 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9d2412a4c0 0x7f9d2411f940 secure :-1 s=READY pgs=103 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d241459d0 tx=0x7f9d10010e10 comp rx=0 tx=0).stop 2026-02-23T06:29:24.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.909+0000 7f9d0effd640 1 -- 10.20.193.58:0/2697817434 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9d2412a4c0 msgr2=0x7f9d2411f940 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:29:24.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.909+0000 7f9d0effd640 1 --2- 10.20.193.58:0/2697817434 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9d2412a4c0 0x7f9d2411f940 secure :-1 s=CLOSED pgs=103 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d241459d0 tx=0x7f9d10010e10 comp rx=0 tx=0).stop 2026-02-23T06:29:24.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.909+0000 7f9d0effd640 1 -- 10.20.193.58:0/2697817434 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f9d1c038a00 con 0x7f9d240b6690 2026-02-23T06:29:24.905 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.910+0000 7f9d0effd640 1 --2- 10.20.193.58:0/2697817434 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9cf407a430 0x7f9cf409a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:24.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.910+0000 7f9d0effd640 1 -- 10.20.193.58:0/2697817434 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f9d1c0c2220 con 0x7f9d240b6690 2026-02-23T06:29:24.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.910+0000 7f9d2b683640 1 --2- 10.20.193.58:0/2697817434 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9d2411fe80 0x7f9d24150360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:24.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.910+0000 7f9d2b683640 1 -- 10.20.193.58:0/2697817434 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2411d140 con 0x7f9d2411fe80 2026-02-23T06:29:24.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.918+0000 7f9d2ae82640 1 --2- 10.20.193.58:0/2697817434 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9d2411fe80 0x7f9d24150360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:24.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.918+0000 7f9d29e80640 1 --2- 10.20.193.58:0/2697817434 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9cf407a430 0x7f9cf409a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:24.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.918+0000 7f9d2ae82640 1 -- 10.20.193.58:0/2697817434 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9d240b6d50 con 0x7f9d2411fe80 2026-02-23T06:29:24.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.918+0000 7f9d29e80640 1 --2- 10.20.193.58:0/2697817434 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9cf407a430 0x7f9cf409a8e0 secure :-1 s=READY pgs=241 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d241459d0 tx=0x7f9d10014000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:24.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.918+0000 7f9d2ae82640 1 --2- 10.20.193.58:0/2697817434 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9d2411fe80 0x7f9d24150360 secure :-1 s=READY pgs=104 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d180038b0 tx=0x7f9d1800ff10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:24.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.918+0000 7f9d0effd640 1 -- 10.20.193.58:0/2697817434 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9d1801a070 con 0x7f9d2411fe80 2026-02-23T06:29:24.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.918+0000 7f9d0effd640 1 -- 10.20.193.58:0/2697817434 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5245 (secure 0 0 0) 0x7f9d18007b90 con 0x7f9d2411fe80 2026-02-23T06:29:24.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.918+0000 7f9d0effd640 1 -- 10.20.193.58:0/2697817434 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9d2411fe80 msgr2=0x7f9d24150360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:24.915 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.918+0000 7f9d0effd640 1 --2- 10.20.193.58:0/2697817434 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9d2411fe80 0x7f9d24150360 secure :-1 s=READY pgs=104 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d180038b0 tx=0x7f9d1800ff10 comp rx=0 tx=0).stop 2026-02-23T06:29:24.915 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.918+0000 7f9d0effd640 1 -- 10.20.193.58:0/2697817434 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9d2411fe80 msgr2=0x7f9d24150360 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:29:24.915 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.918+0000 7f9d0effd640 1 --2- 10.20.193.58:0/2697817434 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9d2411fe80 0x7f9d24150360 unknown :-1 s=CLOSED pgs=104 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:24.915 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:29:24.915 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:29:24.915 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:29:24.916 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:29:24.916 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 70, 2026-02-23T06:29:24.916 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 166430, 2026-02-23T06:29:24.916 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:29:24.916 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:29:24.916 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:29:24.916 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:29:24.916 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:24.916 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:29:24.916 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:29:24.916 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:29:24.917 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:29:24.917 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:24.917 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:24.917 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:24.917 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:24.917 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:24.917 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:24.917 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:24.917 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:24.918 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:24.918 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:24.918 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:24.918 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:24.918 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:24.918 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:24.918 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:29:24.918 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:29:24.918 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:24.918 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:24.918 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:24.918 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:24.919 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:24.919 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:24.919 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:24.919 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:24.919 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:24.919 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:24.919 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:24.919 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:24.919 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:24.919 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:24.919 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:24.919 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:29:24.920 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:29:24.920 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:29:24.920 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:29:24.920 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:29:24.920 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:29:24.920 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:29:24.920 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:29:24.920 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:29:24.920 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:29:24.920 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:29:24.920 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:29:24.921 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:29:24.921 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:29:24.921 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:29:24.921 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:29:24.921 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:29:24.921 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:24.921 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:24.921 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:24.921 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:24.921 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:24.921 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:24.921 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:24.921 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:24.922 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:24.922 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:24.922 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:24.922 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:24.922 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:24.922 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:24.922 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:29:24.922 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:24.922 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:29:24.922 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:24.922 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:29:24.922 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:29:24.922 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:24.923 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:24.923 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:24.923 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:24.923 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:29:24.923 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:24.923 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:24.923 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:24.923 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:24.923 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:29:24.923 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:24.923 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:24.923 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:24.924 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:24.924 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:29:24.924 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:29:24.924 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:24.924 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:24.924 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:29:24.924 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:24.924 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:24.924 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:24.924 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:29:24.924 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:29:24.924 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:24.924 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:24.925 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:24.925 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:24.925 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:29:24.925 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:24.925 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:24.925 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:24.925 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:24.925 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:29:24.925 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:24.925 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:24.925 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:24.925 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:24.926 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:29:24.926 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:29:24.926 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:24.926 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:24.926 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:29:24.926 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:24.926 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:24.926 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:24.926 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:29:24.926 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:29:24.926 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:24.926 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:24.926 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:24.927 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:24.927 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:29:24.927 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:24.927 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:24.927 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:24.927 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:24.927 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:29:24.927 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:24.927 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:24.927 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:24.927 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:24.927 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:29:24.927 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:29:24.928 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:24.928 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:24.928 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:29:24.928 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:24.928 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:24.928 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:24.928 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:24.928 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:29:24.928 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:29:24.928 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:24.928 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:24.928 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:24.929 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:29:24.929 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:24.929 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:24.929 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:29:24.929 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:24.929 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:24.929 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:24.929 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:29:24.929 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:24.929 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:24.929 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:29:24.929 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:24.930 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:24.930 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:24.930 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:29:24.930 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:24.930 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:24.930 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:29:24.930 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:24.930 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:24.930 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:24.930 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:29:24.930 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:24.930 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:24.930 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:24.931 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:29:24.931 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:29:24.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.918+0000 7f9d2b683640 1 -- 10.20.193.58:0/2697817434 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9cf407a430 msgr2=0x7f9cf409a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:24.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.918+0000 7f9d2b683640 1 --2- 10.20.193.58:0/2697817434 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9cf407a430 0x7f9cf409a8e0 secure :-1 s=READY pgs=241 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d241459d0 tx=0x7f9d10014000 comp rx=0 tx=0).stop 2026-02-23T06:29:24.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.918+0000 7f9d2b683640 1 -- 10.20.193.58:0/2697817434 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9d240b6690 msgr2=0x7f9d24140b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:24.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.918+0000 7f9d2b683640 1 --2- 10.20.193.58:0/2697817434 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9d240b6690 0x7f9d24140b70 secure :-1 s=READY pgs=10 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d1c009a20 tx=0x7f9d1c0028d0 comp rx=0 tx=0).stop 2026-02-23T06:29:24.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.918+0000 7f9d2ae82640 1 -- 10.20.193.58:0/2697817434 reap_dead start 2026-02-23T06:29:24.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.918+0000 7f9d2ae82640 1 -- 10.20.193.58:0/2697817434 reap_dead start 2026-02-23T06:29:24.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.919+0000 7f9d2b683640 1 -- 10.20.193.58:0/2697817434 shutdown_connections 2026-02-23T06:29:24.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.919+0000 7f9d2b683640 1 -- 10.20.193.58:0/2697817434 >> 10.20.193.58:0/2697817434 conn(0x7f9d240b3c20 msgr2=0x7f9d241633c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:24.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.919+0000 7f9d2b683640 1 -- 10.20.193.58:0/2697817434 shutdown_connections 2026-02-23T06:29:24.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:24.919+0000 7f9d2b683640 1 -- 10.20.193.58:0/2697817434 wait complete. 2026-02-23T06:29:24.934 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:29:24.934 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:29:24.934 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:29:25.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.059+0000 7fa534883640 1 -- 10.20.193.58:0/2566926720 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa53015d4a0 msgr2=0x7fa5300affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:25.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.059+0000 7fa534883640 1 --2- 10.20.193.58:0/2566926720 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa53015d4a0 0x7fa5300affb0 secure :-1 s=READY pgs=12 gs=2 cs=0 l=1 c_cookie=2496048025224024156 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5300afed0 tx=0x7fa51c02f250 comp rx=0 tx=0).stop 2026-02-23T06:29:25.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.060+0000 7fa534883640 1 -- 10.20.193.58:0/2566926720 shutdown_connections 2026-02-23T06:29:25.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.060+0000 7fa534883640 1 --2- 10.20.193.58:0/2566926720 >> v2:10.20.193.93:3300/0 conn(0x7fa5300b6690 0x7fa530058ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:25.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.060+0000 7fa534883640 1 --2- 10.20.193.58:0/2566926720 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa53015d4a0 0x7fa5300affb0 unknown :-1 s=CLOSED pgs=12 gs=2 cs=0 l=1 c_cookie=2496048025224024156 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:25.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.060+0000 7fa534883640 1 -- 10.20.193.58:0/2566926720 >> 10.20.193.58:0/2566926720 conn(0x7fa5300b3c20 msgr2=0x7fa5300b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:25.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.060+0000 7fa534883640 1 -- 10.20.193.58:0/2566926720 shutdown_connections 2026-02-23T06:29:25.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.060+0000 7fa534883640 1 -- 10.20.193.58:0/2566926720 wait complete. 2026-02-23T06:29:25.058 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.061+0000 7fa534883640 1 Processor -- start 2026-02-23T06:29:25.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.061+0000 7fa534883640 1 -- start start 2026-02-23T06:29:25.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.062+0000 7fa534883640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5300b6690 0x7fa530124010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:25.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.062+0000 7fa534883640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa53015d4a0 0x7fa530160f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:25.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.062+0000 7fa534883640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa53015d870 0x7fa53013e3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:25.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.062+0000 7fa534883640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa530162450 con 0x7fa53015d870 2026-02-23T06:29:25.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.062+0000 7fa534883640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fa530125350 con 0x7fa53015d4a0 2026-02-23T06:29:25.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.062+0000 7fa534883640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa530123b80 con 0x7fa5300b6690 2026-02-23T06:29:25.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.062+0000 7fa52f7fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5300b6690 0x7fa530124010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:25.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.062+0000 7fa52ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa53015d870 0x7fa53013e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:25.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.062+0000 7fa52f7fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5300b6690 0x7fa530124010 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:54422/0 (socket says 10.20.193.58:54422) 2026-02-23T06:29:25.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.062+0000 7fa52f7fe640 1 -- 10.20.193.58:0/3828980342 learned_addr learned my addr 10.20.193.58:0/3828980342 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:29:25.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.062+0000 7fa52effd640 1 --2- 10.20.193.58:0/3828980342 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa53015d4a0 0x7fa530160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:25.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.062+0000 7fa52ffff640 1 -- 10.20.193.58:0/3828980342 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5300b6690 msgr2=0x7fa530124010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:25.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.062+0000 7fa52ffff640 1 --2- 10.20.193.58:0/3828980342 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5300b6690 0x7fa530124010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:25.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.062+0000 7fa52ffff640 1 -- 10.20.193.58:0/3828980342 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa53015d4a0 msgr2=0x7fa530160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:25.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.062+0000 7fa52ffff640 1 --2- 10.20.193.58:0/3828980342 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa53015d4a0 0x7fa530160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:25.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.062+0000 7fa52ffff640 1 -- 10.20.193.58:0/3828980342 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51c009570 con 0x7fa53015d870 2026-02-23T06:29:25.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.062+0000 7fa52ffff640 1 --2- 10.20.193.58:0/3828980342 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa53015d870 0x7fa53013e3e0 secure :-1 s=READY pgs=13 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa52400e720 tx=0x7fa52400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:25.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.062+0000 7fa50bfff640 1 -- 10.20.193.58:0/3828980342 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa524005500 con 0x7fa53015d870 2026-02-23T06:29:25.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.062+0000 7fa50bfff640 1 -- 10.20.193.58:0/3828980342 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa52400ee50 con 0x7fa53015d870 2026-02-23T06:29:25.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.062+0000 7fa50bfff640 1 -- 10.20.193.58:0/3828980342 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa52400ca40 con 0x7fa53015d870 2026-02-23T06:29:25.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.062+0000 7fa534883640 1 -- 10.20.193.58:0/3828980342 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa53005ce90 con 0x7fa53015d870 2026-02-23T06:29:25.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.063+0000 7fa534883640 1 -- 10.20.193.58:0/3828980342 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa53014df30 con 0x7fa53015d870 2026-02-23T06:29:25.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.063+0000 7fa534883640 1 --2- 10.20.193.58:0/3828980342 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa530056520 0x7fa530123490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:25.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.063+0000 7fa534883640 1 -- 10.20.193.58:0/3828980342 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa530163200 con 0x7fa530056520 2026-02-23T06:29:25.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.063+0000 7fa52f7fe640 1 --2- 10.20.193.58:0/3828980342 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa530056520 0x7fa530123490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:25.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.064+0000 7fa52f7fe640 1 -- 10.20.193.58:0/3828980342 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa5300b6330 con 0x7fa530056520 2026-02-23T06:29:25.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.064+0000 7fa52f7fe640 1 --2- 10.20.193.58:0/3828980342 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa530056520 0x7fa530123490 secure :-1 s=READY pgs=124 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa51c005d00 tx=0x7fa51c0028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:25.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.064+0000 7fa50bfff640 1 -- 10.20.193.58:0/3828980342 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa51c03d050 con 0x7fa530056520 2026-02-23T06:29:25.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.064+0000 7fa50bfff640 1 -- 10.20.193.58:0/3828980342 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fa51c03e040 con 0x7fa530056520 2026-02-23T06:29:25.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.064+0000 7fa50bfff640 1 -- 10.20.193.58:0/3828980342 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa530056520 msgr2=0x7fa530123490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:25.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.064+0000 7fa50bfff640 1 --2- 10.20.193.58:0/3828980342 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa530056520 0x7fa530123490 secure :-1 s=READY pgs=124 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa51c005d00 tx=0x7fa51c0028d0 comp rx=0 tx=0).stop 2026-02-23T06:29:25.064 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.064+0000 7fa50bfff640 1 -- 10.20.193.58:0/3828980342 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa530056520 msgr2=0x7fa530123490 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:29:25.064 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.064+0000 7fa50bfff640 1 --2- 10.20.193.58:0/3828980342 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa530056520 0x7fa530123490 unknown :-1 s=CLOSED pgs=124 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:25.064 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.064+0000 7fa50bfff640 1 -- 10.20.193.58:0/3828980342 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fa52400cba0 con 0x7fa53015d870 2026-02-23T06:29:25.064 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.065+0000 7fa50bfff640 1 --2- 10.20.193.58:0/3828980342 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa50007a3c0 0x7fa50009a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:25.064 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.065+0000 7fa50bfff640 1 -- 10.20.193.58:0/3828980342 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fa52409ec00 con 0x7fa53015d870 2026-02-23T06:29:25.064 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.065+0000 7fa52f7fe640 1 --2- 10.20.193.58:0/3828980342 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa50007a3c0 0x7fa50009a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:25.064 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.066+0000 7fa52f7fe640 1 --2- 10.20.193.58:0/3828980342 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa50007a3c0 0x7fa50009a870 secure :-1 s=READY pgs=242 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa51c02f7d0 tx=0x7fa51c031030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:25.064 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.067+0000 7fa534883640 1 --2- 10.20.193.58:0/3828980342 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa53011f030 0x7fa53011f400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:25.064 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.067+0000 7fa534883640 1 -- 10.20.193.58:0/3828980342 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa530164250 con 0x7fa53011f030 2026-02-23T06:29:25.064 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.068+0000 7fa52effd640 1 --2- 10.20.193.58:0/3828980342 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa53011f030 0x7fa53011f400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:25.064 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.068+0000 7fa52effd640 1 -- 10.20.193.58:0/3828980342 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa5300b6d50 con 0x7fa53011f030 2026-02-23T06:29:25.065 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.068+0000 7fa52effd640 1 --2- 10.20.193.58:0/3828980342 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa53011f030 0x7fa53011f400 secure :-1 s=READY pgs=125 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5200027d0 tx=0x7fa52000eba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:25.065 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.068+0000 7fa50bfff640 1 -- 10.20.193.58:0/3828980342 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa520019070 con 0x7fa53011f030 2026-02-23T06:29:25.066 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.068+0000 7fa50bfff640 1 -- 10.20.193.58:0/3828980342 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5555 (secure 0 0 0) 0x7fa52000c880 con 0x7fa53011f030 2026-02-23T06:29:25.066 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:29:25.066 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:29:25.066 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:29:25.066 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:29:25.066 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 70, 2026-02-23T06:29:25.067 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 239580, 2026-02-23T06:29:25.067 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:29:25.067 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:29:25.067 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:29:25.067 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:29:25.067 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:25.067 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:29:25.067 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:29:25.067 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:29:25.067 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:29:25.067 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:25.067 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:25.068 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:25.068 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:25.068 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:25.068 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:25.068 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:25.068 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:25.068 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:25.068 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:25.068 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:25.068 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:25.068 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:25.068 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:25.069 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:29:25.069 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:29:25.069 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:25.069 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:25.069 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:25.069 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:25.069 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:25.069 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:25.069 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:25.069 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:25.069 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:25.069 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:25.069 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:25.070 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:25.070 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:25.070 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:25.070 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:25.070 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:29:25.070 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:29:25.070 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:29:25.070 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:29:25.070 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:29:25.070 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:29:25.070 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:29:25.071 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:29:25.071 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:29:25.071 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:29:25.071 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:29:25.071 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:29:25.071 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:29:25.071 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:29:25.071 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:29:25.071 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:29:25.071 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:29:25.071 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:25.071 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:25.072 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:25.072 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:25.072 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:25.072 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:25.072 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:25.072 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:25.072 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:25.072 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:25.072 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:25.072 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:25.072 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:25.072 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:25.072 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:29:25.073 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:25.073 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:29:25.073 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:25.073 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:29:25.073 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:29:25.073 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:25.073 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:25.073 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:25.073 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:25.073 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:29:25.073 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:25.073 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:25.074 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:25.074 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:25.074 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:29:25.074 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:25.074 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:25.074 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:25.074 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:25.074 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:29:25.074 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:29:25.074 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:25.074 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:25.074 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:29:25.074 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:25.075 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:25.075 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:25.075 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:29:25.075 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:29:25.075 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:25.075 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:25.076 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:25.076 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:25.076 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:29:25.076 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:25.076 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:25.076 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:25.076 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:25.076 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:29:25.076 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:25.076 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:25.076 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:25.077 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:25.077 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:29:25.077 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:29:25.077 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:25.077 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:25.077 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:29:25.077 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:25.077 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:25.077 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:25.077 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:29:25.077 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:29:25.077 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:25.078 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:25.078 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:25.078 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:25.078 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:29:25.078 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:25.078 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:25.078 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:25.078 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:25.078 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:29:25.078 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:25.078 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:25.078 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:25.079 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:25.079 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:29:25.079 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:29:25.079 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:25.079 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:25.079 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:29:25.079 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:25.079 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:25.079 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:25.079 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:25.079 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:29:25.079 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:29:25.080 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:25.080 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:25.080 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:25.080 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:29:25.080 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:25.080 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:25.080 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:29:25.080 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:25.080 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:25.080 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:25.080 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:29:25.080 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:25.081 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:25.081 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:29:25.081 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:25.081 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:25.081 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:25.081 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:29:25.081 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:25.081 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:25.081 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:29:25.081 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:25.081 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:29:25.081 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:29:25.081 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:29:25.082 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:25.082 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:25.082 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:25.082 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:25.082 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:29:25.082 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:25.082 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:25.082 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:29:25.082 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:25.082 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:25.082 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:25.082 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:29:25.083 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:25.083 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:25.083 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:25.083 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:29:25.083 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:29:25.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.068+0000 7fa50bfff640 1 -- 10.20.193.58:0/3828980342 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa53011f030 msgr2=0x7fa53011f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:25.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.068+0000 7fa50bfff640 1 --2- 10.20.193.58:0/3828980342 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa53011f030 0x7fa53011f400 secure :-1 s=READY pgs=125 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5200027d0 tx=0x7fa52000eba0 comp rx=0 tx=0).stop 2026-02-23T06:29:25.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.069+0000 7fa50bfff640 1 -- 10.20.193.58:0/3828980342 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa53011f030 msgr2=0x7fa53011f400 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:29:25.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.069+0000 7fa50bfff640 1 --2- 10.20.193.58:0/3828980342 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa53011f030 0x7fa53011f400 secure :-1 s=CLOSED pgs=125 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5200027d0 tx=0x7fa52000eba0 comp rx=0 tx=0).stop 2026-02-23T06:29:25.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.069+0000 7fa534883640 1 -- 10.20.193.58:0/3828980342 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa50007a3c0 msgr2=0x7fa50009a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:25.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.069+0000 7fa534883640 1 --2- 10.20.193.58:0/3828980342 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa50007a3c0 0x7fa50009a870 secure :-1 s=READY pgs=242 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa51c02f7d0 tx=0x7fa51c031030 comp rx=0 tx=0).stop 2026-02-23T06:29:25.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.069+0000 7fa534883640 1 -- 10.20.193.58:0/3828980342 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa53015d870 msgr2=0x7fa53013e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:25.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.069+0000 7fa534883640 1 --2- 10.20.193.58:0/3828980342 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa53015d870 0x7fa53013e3e0 secure :-1 s=READY pgs=13 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa52400e720 tx=0x7fa52400ebf0 comp rx=0 tx=0).stop 2026-02-23T06:29:25.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.069+0000 7fa52ffff640 1 -- 10.20.193.58:0/3828980342 reap_dead start 2026-02-23T06:29:25.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.069+0000 7fa52ffff640 1 -- 10.20.193.58:0/3828980342 reap_dead start 2026-02-23T06:29:25.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.069+0000 7fa534883640 1 -- 10.20.193.58:0/3828980342 shutdown_connections 2026-02-23T06:29:25.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.069+0000 7fa534883640 1 -- 10.20.193.58:0/3828980342 >> 10.20.193.58:0/3828980342 conn(0x7fa5300b3c20 msgr2=0x7fa5300b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:25.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.069+0000 7fa534883640 1 -- 10.20.193.58:0/3828980342 shutdown_connections 2026-02-23T06:29:25.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.069+0000 7fa534883640 1 -- 10.20.193.58:0/3828980342 wait complete. 2026-02-23T06:29:25.086 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:29:25.086 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:29:25.086 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:29:25.209 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.214+0000 7ff43a55c640 1 -- 10.20.193.58:0/3180968816 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff43415d870 msgr2=0x7ff4340587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:25.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.214+0000 7ff43a55c640 1 --2- 10.20.193.58:0/3180968816 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff43415d870 0x7ff4340587b0 secure :-1 s=READY pgs=106 gs=3 cs=0 l=1 c_cookie=13421785480962618293 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff428005e70 tx=0x7ff42802f2e0 comp rx=0 tx=0).stop 2026-02-23T06:29:25.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.214+0000 7ff43a55c640 1 -- 10.20.193.58:0/3180968816 shutdown_connections 2026-02-23T06:29:25.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.214+0000 7ff43a55c640 1 --2- 10.20.193.58:0/3180968816 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff43415d870 0x7ff4340587b0 unknown :-1 s=CLOSED pgs=106 gs=3 cs=0 l=1 c_cookie=13421785480962618293 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:25.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.214+0000 7ff43a55c640 1 -- 10.20.193.58:0/3180968816 >> 10.20.193.58:0/3180968816 conn(0x7ff4340b3c20 msgr2=0x7ff4340b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:25.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.214+0000 7ff43a55c640 1 -- 10.20.193.58:0/3180968816 shutdown_connections 2026-02-23T06:29:25.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.214+0000 7ff43a55c640 1 -- 10.20.193.58:0/3180968816 wait complete. 2026-02-23T06:29:25.212 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.215+0000 7ff43a55c640 1 Processor -- start 2026-02-23T06:29:25.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.215+0000 7ff43a55c640 1 -- start start 2026-02-23T06:29:25.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.216+0000 7ff43a55c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff4340b6690 0x7ff4340587e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:25.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.216+0000 7ff43a55c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff43415d4a0 0x7ff43413ecc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:25.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.216+0000 7ff43a55c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff43415d870 0x7ff43413f200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:25.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.216+0000 7ff43a55c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff434163160 con 0x7ff43415d4a0 2026-02-23T06:29:25.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.216+0000 7ff43a55c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff4341624d0 con 0x7ff43415d870 2026-02-23T06:29:25.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.216+0000 7ff43a55c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7ff43413f9a0 con 0x7ff4340b6690 2026-02-23T06:29:25.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.216+0000 7ff438d59640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff43415d4a0 0x7ff43413ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:25.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.216+0000 7ff43955a640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff4340b6690 0x7ff4340587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:25.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.216+0000 7ff43955a640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff4340b6690 0x7ff4340587e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:54456/0 (socket says 10.20.193.58:54456) 2026-02-23T06:29:25.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.216+0000 7ff438d59640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff43415d4a0 0x7ff43413ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:38850/0 (socket says 10.20.193.58:38850) 2026-02-23T06:29:25.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.216+0000 7ff43955a640 1 -- 10.20.193.58:0/4189289357 learned_addr learned my addr 10.20.193.58:0/4189289357 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:29:25.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.216+0000 7ff439d5b640 1 --2- 10.20.193.58:0/4189289357 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff43415d870 0x7ff43413f200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:25.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.216+0000 7ff438d59640 1 -- 10.20.193.58:0/4189289357 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff4340b6690 msgr2=0x7ff4340587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:25.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.216+0000 7ff438d59640 1 --2- 10.20.193.58:0/4189289357 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff4340b6690 0x7ff4340587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:25.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.216+0000 7ff438d59640 1 -- 10.20.193.58:0/4189289357 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff43415d870 msgr2=0x7ff43413f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:25.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.216+0000 7ff438d59640 1 --2- 10.20.193.58:0/4189289357 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff43415d870 0x7ff43413f200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:25.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.216+0000 7ff438d59640 1 -- 10.20.193.58:0/4189289357 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff428009570 con 0x7ff43415d4a0 2026-02-23T06:29:25.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.216+0000 7ff438d59640 1 --2- 10.20.193.58:0/4189289357 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff43415d4a0 0x7ff43413ecc0 secure :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff428005e70 tx=0x7ff428002a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:25.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.217+0000 7ff421ffb640 1 -- 10.20.193.58:0/4189289357 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff42803d070 con 0x7ff43415d4a0 2026-02-23T06:29:25.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.217+0000 7ff421ffb640 1 -- 10.20.193.58:0/4189289357 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff428038690 con 0x7ff43415d4a0 2026-02-23T06:29:25.214 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.217+0000 7ff421ffb640 1 -- 10.20.193.58:0/4189289357 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff428038a60 con 0x7ff43415d4a0 2026-02-23T06:29:25.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.217+0000 7ff43a55c640 1 -- 10.20.193.58:0/4189289357 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff434162700 con 0x7ff43415d4a0 2026-02-23T06:29:25.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.217+0000 7ff43a55c640 1 -- 10.20.193.58:0/4189289357 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff43413fe20 con 0x7ff43415d4a0 2026-02-23T06:29:25.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.217+0000 7ff43a55c640 1 -- 10.20.193.58:0/4189289357 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4340b6d50 con 0x7ff43415d4a0 2026-02-23T06:29:25.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.219+0000 7ff421ffb640 1 -- 10.20.193.58:0/4189289357 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7ff428048060 con 0x7ff43415d4a0 2026-02-23T06:29:25.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.219+0000 7ff421ffb640 1 --2- 10.20.193.58:0/4189289357 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff40407a6c0 0x7ff40409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:25.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.219+0000 7ff421ffb640 1 -- 10.20.193.58:0/4189289357 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7ff4280c1e10 con 0x7ff43415d4a0 2026-02-23T06:29:25.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.220+0000 7ff43955a640 1 --2- 10.20.193.58:0/4189289357 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff40407a6c0 0x7ff40409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:25.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.220+0000 7ff43955a640 1 --2- 10.20.193.58:0/4189289357 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff40407a6c0 0x7ff40409ab70 secure :-1 s=READY pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff424007cf0 tx=0x7ff424007f50 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:25.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.223+0000 7ff421ffb640 1 -- 10.20.193.58:0/4189289357 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7ff428085060 con 0x7ff43415d4a0 2026-02-23T06:29:25.376 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.381+0000 7ff43a55c640 1 -- 10.20.193.58:0/4189289357 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7ff434164250 con 0x7ff43415d4a0 2026-02-23T06:29:25.376 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.381+0000 7ff421ffb640 1 -- 10.20.193.58:0/4189289357 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7ff428005bf0 con 0x7ff43415d4a0 2026-02-23T06:29:25.378 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.382+0000 7ff43a55c640 1 -- 10.20.193.58:0/4189289357 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff40407a6c0 msgr2=0x7ff40409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:25.378 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.382+0000 7ff43a55c640 1 --2- 10.20.193.58:0/4189289357 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff40407a6c0 0x7ff40409ab70 secure :-1 s=READY pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff424007cf0 tx=0x7ff424007f50 comp rx=0 tx=0).stop 2026-02-23T06:29:25.378 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.382+0000 7ff43a55c640 1 -- 10.20.193.58:0/4189289357 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff43415d4a0 msgr2=0x7ff43413ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:25.378 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.382+0000 7ff43a55c640 1 --2- 10.20.193.58:0/4189289357 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff43415d4a0 0x7ff43413ecc0 secure :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff428005e70 tx=0x7ff428002a10 comp rx=0 tx=0).stop 2026-02-23T06:29:25.378 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.382+0000 7ff43a55c640 1 -- 10.20.193.58:0/4189289357 shutdown_connections 2026-02-23T06:29:25.378 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.382+0000 7ff43a55c640 1 --2- 10.20.193.58:0/4189289357 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff40407a6c0 0x7ff40409ab70 unknown :-1 s=CLOSED pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:25.378 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.382+0000 7ff43a55c640 1 --2- 10.20.193.58:0/4189289357 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff43415d870 0x7ff43413f200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:25.378 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.382+0000 7ff43a55c640 1 --2- 10.20.193.58:0/4189289357 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff43415d4a0 0x7ff43413ecc0 unknown :-1 s=CLOSED pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:25.378 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.382+0000 7ff43a55c640 1 --2- 10.20.193.58:0/4189289357 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff4340b6690 0x7ff4340587e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:25.378 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.382+0000 7ff43a55c640 1 -- 10.20.193.58:0/4189289357 >> 10.20.193.58:0/4189289357 conn(0x7ff4340b3c20 msgr2=0x7ff4340ae250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:25.379 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.382+0000 7ff43a55c640 1 -- 10.20.193.58:0/4189289357 shutdown_connections 2026-02-23T06:29:25.379 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:25.382+0000 7ff43a55c640 1 -- 10.20.193.58:0/4189289357 wait complete. 2026-02-23T06:29:25.389 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:29:35.390 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:29:35.390 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:29:35.513 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.517+0000 7f33770cc640 1 -- 10.20.193.58:0/323828952 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33700aecd0 msgr2=0x7f33700af0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:35.513 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.517+0000 7f33770cc640 1 --2- 10.20.193.58:0/323828952 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33700aecd0 0x7f33700af0c0 secure :-1 s=READY pgs=126 gs=3 cs=0 l=1 c_cookie=6201853278961875872 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3358004740 tx=0x7f335802f250 comp rx=0 tx=0).stop 2026-02-23T06:29:35.513 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.517+0000 7f33770cc640 1 -- 10.20.193.58:0/323828952 shutdown_connections 2026-02-23T06:29:35.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.517+0000 7f33770cc640 1 --2- 10.20.193.58:0/323828952 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33700aecd0 0x7f33700af0c0 unknown :-1 s=CLOSED pgs=126 gs=3 cs=0 l=1 c_cookie=6201853278961875872 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:35.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.517+0000 7f33770cc640 1 --2- 10.20.193.58:0/323828952 >> v2:10.20.193.93:3300/0 conn(0x7f3370168cb0 0x7f33700b2120 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:35.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.517+0000 7f33770cc640 1 -- 10.20.193.58:0/323828952 >> 10.20.193.58:0/323828952 conn(0x7f33700561f0 msgr2=0x7f33700565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:35.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.517+0000 7f33770cc640 1 -- 10.20.193.58:0/323828952 shutdown_connections 2026-02-23T06:29:35.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.517+0000 7f33770cc640 1 -- 10.20.193.58:0/323828952 wait complete. 2026-02-23T06:29:35.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.518+0000 7f33770cc640 1 Processor -- start 2026-02-23T06:29:35.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.519+0000 7f33770cc640 1 -- start start 2026-02-23T06:29:35.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.519+0000 7f33770cc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33700aecd0 0x7f337014cdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:35.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.519+0000 7f33770cc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3370168cb0 0x7f33701232c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:35.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.519+0000 7f33770cc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3370169080 0x7f3370123800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:35.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.519+0000 7f33770cc640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f33701219e0 con 0x7f3370168cb0 2026-02-23T06:29:35.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.519+0000 7f33770cc640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f33701206e0 con 0x7f3370169080 2026-02-23T06:29:35.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.519+0000 7f33770cc640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f3370120400 con 0x7f33700aecd0 2026-02-23T06:29:35.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.519+0000 7f3367fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3370168cb0 0x7f33701232c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:35.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.519+0000 7f3367fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3370168cb0 0x7f33701232c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:57082/0 (socket says 10.20.193.58:57082) 2026-02-23T06:29:35.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.519+0000 7f3367fff640 1 -- 10.20.193.58:0/3475381695 learned_addr learned my addr 10.20.193.58:0/3475381695 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:29:35.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.519+0000 7f3374e41640 1 --2- 10.20.193.58:0/3475381695 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33700aecd0 0x7f337014cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:35.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.519+0000 7f3375642640 1 --2- 10.20.193.58:0/3475381695 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3370169080 0x7f3370123800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:35.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.520+0000 7f3367fff640 1 -- 10.20.193.58:0/3475381695 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33700aecd0 msgr2=0x7f337014cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:35.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.520+0000 7f3367fff640 1 --2- 10.20.193.58:0/3475381695 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33700aecd0 0x7f337014cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:35.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.520+0000 7f3367fff640 1 -- 10.20.193.58:0/3475381695 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3370169080 msgr2=0x7f3370123800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:35.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.520+0000 7f3367fff640 1 --2- 10.20.193.58:0/3475381695 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3370169080 0x7f3370123800 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:35.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.520+0000 7f3367fff640 1 -- 10.20.193.58:0/3475381695 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33580094b0 con 0x7f3370168cb0 2026-02-23T06:29:35.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.520+0000 7f3367fff640 1 --2- 10.20.193.58:0/3475381695 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3370168cb0 0x7f33701232c0 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3358009960 tx=0x7f33580028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:35.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.520+0000 7f33657fa640 1 -- 10.20.193.58:0/3475381695 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f335803c040 con 0x7f3370168cb0 2026-02-23T06:29:35.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.520+0000 7f33657fa640 1 -- 10.20.193.58:0/3475381695 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3358038470 con 0x7f3370168cb0 2026-02-23T06:29:35.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.520+0000 7f33657fa640 1 -- 10.20.193.58:0/3475381695 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3358038840 con 0x7f3370168cb0 2026-02-23T06:29:35.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.520+0000 7f33770cc640 1 -- 10.20.193.58:0/3475381695 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3370149910 con 0x7f3370168cb0 2026-02-23T06:29:35.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.520+0000 7f33770cc640 1 -- 10.20.193.58:0/3475381695 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f337014a1b0 con 0x7f3370168cb0 2026-02-23T06:29:35.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.521+0000 7f333effd640 1 -- 10.20.193.58:0/3475381695 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3370149d10 con 0x7f3370168cb0 2026-02-23T06:29:35.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.522+0000 7f33657fa640 1 -- 10.20.193.58:0/3475381695 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f33580389a0 con 0x7f3370168cb0 2026-02-23T06:29:35.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.523+0000 7f33657fa640 1 --2- 10.20.193.58:0/3475381695 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f334007a6c0 0x7f334009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:35.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.523+0000 7f33657fa640 1 -- 10.20.193.58:0/3475381695 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f33580c3230 con 0x7f3370168cb0 2026-02-23T06:29:35.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.523+0000 7f3374e41640 1 --2- 10.20.193.58:0/3475381695 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f334007a6c0 0x7f334009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:35.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.524+0000 7f3374e41640 1 --2- 10.20.193.58:0/3475381695 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f334007a6c0 0x7f334009ab70 secure :-1 s=READY pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3360004740 tx=0x7f3360005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:35.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.524+0000 7f33657fa640 1 -- 10.20.193.58:0/3475381695 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f3358086450 con 0x7f3370168cb0 2026-02-23T06:29:35.673 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.678+0000 7f333effd640 1 -- 10.20.193.58:0/3475381695 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3370058640 con 0x7f3370168cb0 2026-02-23T06:29:35.673 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.678+0000 7f33657fa640 1 -- 10.20.193.58:0/3475381695 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f3358089570 con 0x7f3370168cb0 2026-02-23T06:29:35.673 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":70,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:29:35.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.679+0000 7f333effd640 1 -- 10.20.193.58:0/3475381695 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f334007a6c0 msgr2=0x7f334009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:35.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.679+0000 7f333effd640 1 --2- 10.20.193.58:0/3475381695 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f334007a6c0 0x7f334009ab70 secure :-1 s=READY pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3360004740 tx=0x7f3360005f90 comp rx=0 tx=0).stop 2026-02-23T06:29:35.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.679+0000 7f333effd640 1 -- 10.20.193.58:0/3475381695 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3370168cb0 msgr2=0x7f33701232c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:35.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.679+0000 7f333effd640 1 --2- 10.20.193.58:0/3475381695 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3370168cb0 0x7f33701232c0 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3358009960 tx=0x7f33580028d0 comp rx=0 tx=0).stop 2026-02-23T06:29:35.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.679+0000 7f333effd640 1 -- 10.20.193.58:0/3475381695 shutdown_connections 2026-02-23T06:29:35.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.679+0000 7f333effd640 1 --2- 10.20.193.58:0/3475381695 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f334007a6c0 0x7f334009ab70 unknown :-1 s=CLOSED pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:35.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.679+0000 7f333effd640 1 --2- 10.20.193.58:0/3475381695 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3370169080 0x7f3370123800 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:35.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.679+0000 7f333effd640 1 --2- 10.20.193.58:0/3475381695 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3370168cb0 0x7f33701232c0 unknown :-1 s=CLOSED pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:35.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.679+0000 7f333effd640 1 --2- 10.20.193.58:0/3475381695 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33700aecd0 0x7f337014cdf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:35.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.679+0000 7f333effd640 1 -- 10.20.193.58:0/3475381695 >> 10.20.193.58:0/3475381695 conn(0x7f33700561f0 msgr2=0x7f337015cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:35.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.680+0000 7f333effd640 1 -- 10.20.193.58:0/3475381695 shutdown_connections 2026-02-23T06:29:35.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.680+0000 7f333effd640 1 -- 10.20.193.58:0/3475381695 wait complete. 2026-02-23T06:29:35.686 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:29:35.686 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:29:35.686 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:29:35.686 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:29:35.810 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.815+0000 7fda4f325640 1 -- 10.20.193.58:0/3643205984 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fda4815c040 msgr2=0x7fda4805b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:35.810 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.815+0000 7fda4f325640 1 --2- 10.20.193.58:0/3643205984 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fda4815c040 0x7fda4805b0e0 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=15749815246151612872 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda4805df80 tx=0x7fda3802f250 comp rx=0 tx=0).stop 2026-02-23T06:29:35.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.815+0000 7fda4f325640 1 -- 10.20.193.58:0/3643205984 shutdown_connections 2026-02-23T06:29:35.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.815+0000 7fda4f325640 1 --2- 10.20.193.58:0/3643205984 >> v2:10.20.193.93:3300/0 conn(0x7fda4805d370 0x7fda480b5680 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:35.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.815+0000 7fda4f325640 1 --2- 10.20.193.58:0/3643205984 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fda48056550 0x7fda4805ce30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:35.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.815+0000 7fda4f325640 1 --2- 10.20.193.58:0/3643205984 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fda4815c040 0x7fda4805b0e0 unknown :-1 s=CLOSED pgs=18 gs=2 cs=0 l=1 c_cookie=15749815246151612872 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:35.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.815+0000 7fda4f325640 1 -- 10.20.193.58:0/3643205984 >> 10.20.193.58:0/3643205984 conn(0x7fda480b3c20 msgr2=0x7fda480b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:35.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.815+0000 7fda4f325640 1 -- 10.20.193.58:0/3643205984 shutdown_connections 2026-02-23T06:29:35.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.815+0000 7fda4f325640 1 -- 10.20.193.58:0/3643205984 wait complete. 2026-02-23T06:29:35.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.817+0000 7fda4f325640 1 Processor -- start 2026-02-23T06:29:35.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.817+0000 7fda4f325640 1 -- start start 2026-02-23T06:29:35.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.817+0000 7fda4f325640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fda48056550 0x7fda4815eba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:35.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.817+0000 7fda4f325640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fda4805d370 0x7fda48058810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:35.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.817+0000 7fda4f325640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fda4815c040 0x7fda48151340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:35.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.817+0000 7fda4f325640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fda481fe9d0 con 0x7fda48056550 2026-02-23T06:29:35.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.817+0000 7fda4f325640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fda481fdad0 con 0x7fda4805d370 2026-02-23T06:29:35.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.817+0000 7fda4f325640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fda481fdd50 con 0x7fda4815c040 2026-02-23T06:29:35.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.818+0000 7fda4e323640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fda48056550 0x7fda4815eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:35.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.818+0000 7fda4e323640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fda48056550 0x7fda4815eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:57106/0 (socket says 10.20.193.58:57106) 2026-02-23T06:29:35.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.818+0000 7fda4e323640 1 -- 10.20.193.58:0/3628802668 learned_addr learned my addr 10.20.193.58:0/3628802668 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:29:35.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.818+0000 7fda4db22640 1 --2- 10.20.193.58:0/3628802668 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fda4805d370 0x7fda48058810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:35.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.818+0000 7fda4eb24640 1 --2- 10.20.193.58:0/3628802668 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fda4815c040 0x7fda48151340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:35.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.818+0000 7fda4e323640 1 -- 10.20.193.58:0/3628802668 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fda4815c040 msgr2=0x7fda48151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:35.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.818+0000 7fda4e323640 1 --2- 10.20.193.58:0/3628802668 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fda4815c040 0x7fda48151340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:35.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.818+0000 7fda4e323640 1 -- 10.20.193.58:0/3628802668 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fda4805d370 msgr2=0x7fda48058810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:35.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.818+0000 7fda4e323640 1 --2- 10.20.193.58:0/3628802668 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fda4805d370 0x7fda48058810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:35.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.818+0000 7fda4e323640 1 -- 10.20.193.58:0/3628802668 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda38009570 con 0x7fda48056550 2026-02-23T06:29:35.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.818+0000 7fda4e323640 1 --2- 10.20.193.58:0/3628802668 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fda48056550 0x7fda4815eba0 secure :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda38005e70 tx=0x7fda380028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:35.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.818+0000 7fda2effd640 1 -- 10.20.193.58:0/3628802668 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fda3803d070 con 0x7fda48056550 2026-02-23T06:29:35.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.818+0000 7fda4f325640 1 -- 10.20.193.58:0/3628802668 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda481fe030 con 0x7fda48056550 2026-02-23T06:29:35.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.818+0000 7fda4f325640 1 -- 10.20.193.58:0/3628802668 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda481fe5f0 con 0x7fda48056550 2026-02-23T06:29:35.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.818+0000 7fda2effd640 1 -- 10.20.193.58:0/3628802668 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda38038470 con 0x7fda48056550 2026-02-23T06:29:35.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.818+0000 7fda2effd640 1 -- 10.20.193.58:0/3628802668 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fda380388a0 con 0x7fda48056550 2026-02-23T06:29:35.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.819+0000 7fda4f325640 1 --2- 10.20.193.58:0/3628802668 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fda48151880 0x7fda48201300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:35.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.819+0000 7fda4f325640 1 -- 10.20.193.58:0/3628802668 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fda480609c0 con 0x7fda48151880 2026-02-23T06:29:35.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.819+0000 7fda4db22640 1 --2- 10.20.193.58:0/3628802668 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fda48151880 0x7fda48201300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:35.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.819+0000 7fda4db22640 1 -- 10.20.193.58:0/3628802668 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fda4815c410 con 0x7fda48151880 2026-02-23T06:29:35.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.819+0000 7fda4db22640 1 --2- 10.20.193.58:0/3628802668 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fda48151880 0x7fda48201300 secure :-1 s=READY pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda48059aa0 tx=0x7fda3c012de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:35.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.819+0000 7fda2effd640 1 -- 10.20.193.58:0/3628802668 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fda3c010d80 con 0x7fda48151880 2026-02-23T06:29:35.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.820+0000 7fda2effd640 1 -- 10.20.193.58:0/3628802668 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fda3c0040d0 con 0x7fda48151880 2026-02-23T06:29:35.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.820+0000 7fda2effd640 1 -- 10.20.193.58:0/3628802668 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fda48151880 msgr2=0x7fda48201300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:35.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.820+0000 7fda2effd640 1 --2- 10.20.193.58:0/3628802668 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fda48151880 0x7fda48201300 secure :-1 s=READY pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda48059aa0 tx=0x7fda3c012de0 comp rx=0 tx=0).stop 2026-02-23T06:29:35.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.820+0000 7fda2effd640 1 -- 10.20.193.58:0/3628802668 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fda48151880 msgr2=0x7fda48201300 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:29:35.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.820+0000 7fda2effd640 1 --2- 10.20.193.58:0/3628802668 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fda48151880 0x7fda48201300 unknown :-1 s=CLOSED pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:35.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.820+0000 7fda2effd640 1 -- 10.20.193.58:0/3628802668 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fda38038a00 con 0x7fda48056550 2026-02-23T06:29:35.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.821+0000 7fda2effd640 1 --2- 10.20.193.58:0/3628802668 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fda1807a3c0 0x7fda1809a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:35.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.821+0000 7fda2effd640 1 -- 10.20.193.58:0/3628802668 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fda380c2220 con 0x7fda48056550 2026-02-23T06:29:35.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.821+0000 7fda4db22640 1 --2- 10.20.193.58:0/3628802668 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fda1807a3c0 0x7fda1809a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:35.816 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.821+0000 7fda4db22640 1 --2- 10.20.193.58:0/3628802668 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fda1807a3c0 0x7fda1809a870 secure :-1 s=READY pgs=245 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda3c010810 tx=0x7fda3c00e000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:35.818 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.823+0000 7fda4f325640 1 --2- 10.20.193.58:0/3628802668 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fda48201840 0x7fda48152ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:35.818 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.823+0000 7fda4f325640 1 -- 10.20.193.58:0/3628802668 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fda4805d9c0 con 0x7fda48201840 2026-02-23T06:29:35.818 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.823+0000 7fda4eb24640 1 --2- 10.20.193.58:0/3628802668 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fda48201840 0x7fda48152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:35.818 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.824+0000 7fda4eb24640 1 -- 10.20.193.58:0/3628802668 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fda4805ce30 con 0x7fda48201840 2026-02-23T06:29:35.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.824+0000 7fda4eb24640 1 --2- 10.20.193.58:0/3628802668 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fda48201840 0x7fda48152ad0 secure :-1 s=READY pgs=21 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda440057b0 tx=0x7fda4400aad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:35.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.824+0000 7fda2effd640 1 -- 10.20.193.58:0/3628802668 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fda44011af0 con 0x7fda48201840 2026-02-23T06:29:35.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.824+0000 7fda2effd640 1 -- 10.20.193.58:0/3628802668 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4913 (secure 0 0 0) 0x7fda44011c50 con 0x7fda48201840 2026-02-23T06:29:35.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.824+0000 7fda2effd640 1 -- 10.20.193.58:0/3628802668 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fda48201840 msgr2=0x7fda48152ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:35.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.824+0000 7fda2effd640 1 --2- 10.20.193.58:0/3628802668 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fda48201840 0x7fda48152ad0 secure :-1 s=READY pgs=21 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda440057b0 tx=0x7fda4400aad0 comp rx=0 tx=0).stop 2026-02-23T06:29:35.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.824+0000 7fda2effd640 1 -- 10.20.193.58:0/3628802668 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fda48201840 msgr2=0x7fda48152ad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:29:35.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.824+0000 7fda2effd640 1 --2- 10.20.193.58:0/3628802668 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fda48201840 0x7fda48152ad0 secure :-1 s=CLOSED pgs=21 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda440057b0 tx=0x7fda4400aad0 comp rx=0 tx=0).stop 2026-02-23T06:29:35.819 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:29:35.819 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:29:35.819 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:29:35.819 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:29:35.819 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 70, 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 11381, 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:35.820 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:35.821 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:29:35.822 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:35.823 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:29:35.824 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:35.824 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:35.824 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:35.824 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:29:35.824 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:35.824 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:35.824 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:35.824 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:29:35.824 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:29:35.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.824+0000 7fda4f325640 1 -- 10.20.193.58:0/3628802668 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fda1807a3c0 msgr2=0x7fda1809a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:35.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.824+0000 7fda4f325640 1 --2- 10.20.193.58:0/3628802668 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fda1807a3c0 0x7fda1809a870 secure :-1 s=READY pgs=245 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda3c010810 tx=0x7fda3c00e000 comp rx=0 tx=0).stop 2026-02-23T06:29:35.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.824+0000 7fda4f325640 1 -- 10.20.193.58:0/3628802668 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fda48056550 msgr2=0x7fda4815eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:35.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.824+0000 7fda4f325640 1 --2- 10.20.193.58:0/3628802668 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fda48056550 0x7fda4815eba0 secure :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda38005e70 tx=0x7fda380028d0 comp rx=0 tx=0).stop 2026-02-23T06:29:35.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.824+0000 7fda4eb24640 1 -- 10.20.193.58:0/3628802668 reap_dead start 2026-02-23T06:29:35.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.825+0000 7fda4f325640 1 -- 10.20.193.58:0/3628802668 shutdown_connections 2026-02-23T06:29:35.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.825+0000 7fda4f325640 1 --2- 10.20.193.58:0/3628802668 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fda48056550 0x7fda4815eba0 unknown :-1 s=CLOSED pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:35.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.825+0000 7fda4f325640 1 -- 10.20.193.58:0/3628802668 >> 10.20.193.58:0/3628802668 conn(0x7fda480b3c20 msgr2=0x7fda4815a700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:35.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.825+0000 7fda4f325640 1 -- 10.20.193.58:0/3628802668 shutdown_connections 2026-02-23T06:29:35.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.825+0000 7fda4f325640 1 -- 10.20.193.58:0/3628802668 wait complete. 2026-02-23T06:29:35.826 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:29:35.826 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:29:35.826 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:29:35.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.953+0000 7f042f577640 1 -- 10.20.193.58:0/1072960655 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f043015d4a0 msgr2=0x7f04300affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:35.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.953+0000 7f042f577640 1 --2- 10.20.193.58:0/1072960655 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f043015d4a0 0x7f04300affb0 secure :-1 s=READY pgs=22 gs=2 cs=0 l=1 c_cookie=2306501947179009470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0424004740 tx=0x7f042402f1e0 comp rx=0 tx=0).stop 2026-02-23T06:29:35.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.953+0000 7f042f577640 1 -- 10.20.193.58:0/1072960655 shutdown_connections 2026-02-23T06:29:35.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.953+0000 7f042f577640 1 --2- 10.20.193.58:0/1072960655 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f04300b6690 0x7f0430058ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:35.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.953+0000 7f042f577640 1 --2- 10.20.193.58:0/1072960655 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f043015d4a0 0x7f04300affb0 unknown :-1 s=CLOSED pgs=22 gs=2 cs=0 l=1 c_cookie=2306501947179009470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:35.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.953+0000 7f042f577640 1 -- 10.20.193.58:0/1072960655 >> 10.20.193.58:0/1072960655 conn(0x7f04300b3c20 msgr2=0x7f04300b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:35.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.953+0000 7f042f577640 1 -- 10.20.193.58:0/1072960655 shutdown_connections 2026-02-23T06:29:35.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.953+0000 7f042f577640 1 -- 10.20.193.58:0/1072960655 wait complete. 2026-02-23T06:29:35.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.954+0000 7f042f577640 1 Processor -- start 2026-02-23T06:29:35.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.955+0000 7f042f577640 1 -- start start 2026-02-23T06:29:35.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.955+0000 7f042f577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f04300b6690 0x7f0430167040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:35.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.955+0000 7f042f577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f043015d4a0 0x7f0430166510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:35.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.955+0000 7f042f577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f043015d870 0x7f0430057750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:35.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.955+0000 7f042f577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f0430201f20 con 0x7f043015d4a0 2026-02-23T06:29:35.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.955+0000 7f042f577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f0430164b10 con 0x7f043015d870 2026-02-23T06:29:35.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.955+0000 7f042f577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f04301fda50 con 0x7f04300b6690 2026-02-23T06:29:35.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.955+0000 7f042dd74640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f043015d4a0 0x7f0430166510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:35.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.955+0000 7f042e575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f04300b6690 0x7f0430167040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:35.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.955+0000 7f042dd74640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f043015d4a0 0x7f0430166510 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:57138/0 (socket says 10.20.193.58:57138) 2026-02-23T06:29:35.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.955+0000 7f042dd74640 1 -- 10.20.193.58:0/1435085092 learned_addr learned my addr 10.20.193.58:0/1435085092 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:29:35.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.955+0000 7f042ed76640 1 --2- 10.20.193.58:0/1435085092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f043015d870 0x7f0430057750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:35.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.956+0000 7f042dd74640 1 -- 10.20.193.58:0/1435085092 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f04300b6690 msgr2=0x7f0430167040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:35.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.956+0000 7f042dd74640 1 --2- 10.20.193.58:0/1435085092 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f04300b6690 0x7f0430167040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:35.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.956+0000 7f042dd74640 1 -- 10.20.193.58:0/1435085092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f043015d870 msgr2=0x7f0430057750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:35.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.956+0000 7f042dd74640 1 --2- 10.20.193.58:0/1435085092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f043015d870 0x7f0430057750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:35.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.956+0000 7f042dd74640 1 -- 10.20.193.58:0/1435085092 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04240094b0 con 0x7f043015d4a0 2026-02-23T06:29:35.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.956+0000 7f042dd74640 1 --2- 10.20.193.58:0/1435085092 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f043015d4a0 0x7f0430166510 secure :-1 s=READY pgs=23 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0418007fd0 tx=0x7f041800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:35.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.956+0000 7f0416ffd640 1 -- 10.20.193.58:0/1435085092 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0418012850 con 0x7f043015d4a0 2026-02-23T06:29:35.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.956+0000 7f0416ffd640 1 -- 10.20.193.58:0/1435085092 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0418012aa0 con 0x7f043015d4a0 2026-02-23T06:29:35.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.956+0000 7f042f577640 1 -- 10.20.193.58:0/1435085092 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04302013c0 con 0x7f043015d4a0 2026-02-23T06:29:35.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.956+0000 7f0416ffd640 1 -- 10.20.193.58:0/1435085092 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0418012e50 con 0x7f043015d4a0 2026-02-23T06:29:35.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.956+0000 7f042f577640 1 -- 10.20.193.58:0/1435085092 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0430201960 con 0x7f043015d4a0 2026-02-23T06:29:35.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.957+0000 7f042f577640 1 --2- 10.20.193.58:0/1435085092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0430200f50 0x7f04301fe160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:35.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.957+0000 7f042f577640 1 -- 10.20.193.58:0/1435085092 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f04300b6330 con 0x7f0430200f50 2026-02-23T06:29:35.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.958+0000 7f0416ffd640 1 -- 10.20.193.58:0/1435085092 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f041801b400 con 0x7f043015d4a0 2026-02-23T06:29:35.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.958+0000 7f042e575640 1 --2- 10.20.193.58:0/1435085092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0430200f50 0x7f04301fe160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:35.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.959+0000 7f042e575640 1 -- 10.20.193.58:0/1435085092 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f04300b5e10 con 0x7f0430200f50 2026-02-23T06:29:35.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.959+0000 7f0416ffd640 1 --2- 10.20.193.58:0/1435085092 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f03fc07a780 0x7f03fc09ac30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:35.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.959+0000 7f0416ffd640 1 -- 10.20.193.58:0/1435085092 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f041809d8d0 con 0x7f043015d4a0 2026-02-23T06:29:35.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.959+0000 7f042e575640 1 --2- 10.20.193.58:0/1435085092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0430200f50 0x7f04301fe160 secure :-1 s=READY pgs=108 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0424004740 tx=0x7f04240029a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:35.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.960+0000 7f0416ffd640 1 -- 10.20.193.58:0/1435085092 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f042403d050 con 0x7f0430200f50 2026-02-23T06:29:35.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.960+0000 7f042ed76640 1 --2- 10.20.193.58:0/1435085092 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f03fc07a780 0x7f03fc09ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:35.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.960+0000 7f0416ffd640 1 -- 10.20.193.58:0/1435085092 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f042403e040 con 0x7f0430200f50 2026-02-23T06:29:35.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.960+0000 7f0416ffd640 1 -- 10.20.193.58:0/1435085092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0430200f50 msgr2=0x7f04301fe160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:35.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.960+0000 7f0416ffd640 1 --2- 10.20.193.58:0/1435085092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0430200f50 0x7f04301fe160 secure :-1 s=READY pgs=108 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0424004740 tx=0x7f04240029a0 comp rx=0 tx=0).stop 2026-02-23T06:29:35.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.960+0000 7f0416ffd640 1 -- 10.20.193.58:0/1435085092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0430200f50 msgr2=0x7f04301fe160 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:29:35.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.960+0000 7f0416ffd640 1 --2- 10.20.193.58:0/1435085092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0430200f50 0x7f04301fe160 secure :-1 s=CLOSED pgs=108 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0424004740 tx=0x7f04240029a0 comp rx=0 tx=0).stop 2026-02-23T06:29:35.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.961+0000 7f042ed76640 1 --2- 10.20.193.58:0/1435085092 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f03fc07a780 0x7f03fc09ac30 secure :-1 s=READY pgs=246 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0420006a50 tx=0x7f04200069e0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:35.959 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.963+0000 7f042f577640 1 --2- 10.20.193.58:0/1435085092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f04301fdba0 0x7f043015a100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:35.959 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.963+0000 7f042f577640 1 -- 10.20.193.58:0/1435085092 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f04300b6d50 con 0x7f04301fdba0 2026-02-23T06:29:35.959 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.964+0000 7f042e575640 1 --2- 10.20.193.58:0/1435085092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f04301fdba0 0x7f043015a100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:35.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.964+0000 7f042e575640 1 -- 10.20.193.58:0/1435085092 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f043005b0e0 con 0x7f04301fdba0 2026-02-23T06:29:35.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.964+0000 7f042e575640 1 --2- 10.20.193.58:0/1435085092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f04301fdba0 0x7f043015a100 secure :-1 s=READY pgs=109 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0424009230 tx=0x7f0424005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:35.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.965+0000 7f0416ffd640 1 -- 10.20.193.58:0/1435085092 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0424043680 con 0x7f04301fdba0 2026-02-23T06:29:35.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.965+0000 7f0416ffd640 1 -- 10.20.193.58:0/1435085092 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5246 (secure 0 0 0) 0x7f04240437e0 con 0x7f04301fdba0 2026-02-23T06:29:35.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.965+0000 7f0416ffd640 1 -- 10.20.193.58:0/1435085092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f04301fdba0 msgr2=0x7f043015a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:35.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.965+0000 7f0416ffd640 1 --2- 10.20.193.58:0/1435085092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f04301fdba0 0x7f043015a100 secure :-1 s=READY pgs=109 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0424009230 tx=0x7f0424005f90 comp rx=0 tx=0).stop 2026-02-23T06:29:35.961 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.965+0000 7f0416ffd640 1 -- 10.20.193.58:0/1435085092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f04301fdba0 msgr2=0x7f043015a100 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:29:35.961 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:29:35.961 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:29:35.961 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:29:35.961 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:29:35.961 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 70, 2026-02-23T06:29:35.961 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 177476, 2026-02-23T06:29:35.962 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:29:35.962 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:29:35.962 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:29:35.962 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:29:35.962 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:35.962 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:29:35.962 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:29:35.962 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:29:35.962 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:29:35.962 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:35.962 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:35.962 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:35.963 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:35.963 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:35.963 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:35.963 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:35.963 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:35.963 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:35.963 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:35.963 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:35.963 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:35.963 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:35.963 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:35.963 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:29:35.964 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:29:35.964 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:35.964 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:35.964 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:35.964 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:35.964 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:35.964 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:35.964 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:35.964 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:35.964 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:35.964 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:35.964 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:35.964 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:35.965 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:35.965 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:35.965 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:35.965 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:29:35.965 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:29:35.965 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:29:35.965 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:29:35.965 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:29:35.965 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:29:35.965 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:29:35.965 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:29:35.966 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:29:35.966 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:29:35.966 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:29:35.966 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:29:35.966 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:29:35.966 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:29:35.966 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:29:35.966 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:29:35.966 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:29:35.966 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:35.966 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:35.966 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:35.967 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:35.967 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:35.967 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:35.967 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:35.967 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:35.967 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:35.967 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:35.967 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:35.967 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:35.967 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:35.967 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:35.967 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:29:35.968 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:35.968 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:29:35.968 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:35.968 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:29:35.968 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:29:35.968 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:35.968 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:35.968 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:35.968 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:35.969 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:29:35.969 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:35.969 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:35.969 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:35.969 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:35.969 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:29:35.969 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:35.969 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:35.969 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:35.969 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:35.969 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:29:35.969 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:29:35.970 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:35.970 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:35.970 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:29:35.970 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:35.970 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:35.970 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:35.970 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:29:35.970 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:29:35.970 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:35.970 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:35.970 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:35.970 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:35.970 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:29:35.971 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:35.971 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:35.971 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:35.971 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:35.971 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:29:35.971 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:35.971 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:35.971 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:35.971 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:35.971 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:29:35.971 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:29:35.971 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:35.972 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:35.972 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:29:35.972 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:35.972 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:35.972 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:35.972 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:29:35.972 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:29:35.972 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:35.972 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:35.972 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:35.972 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:35.972 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:29:35.972 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:35.973 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:35.973 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:35.973 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:35.973 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:29:35.973 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:35.973 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:35.973 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:35.973 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:35.973 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:29:35.973 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:29:35.973 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:35.973 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:35.973 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:29:35.974 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:35.974 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:35.974 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:35.974 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:35.974 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:29:35.974 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:29:35.974 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:35.974 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:35.974 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:35.974 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:29:35.974 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:35.974 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:35.974 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:29:35.974 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:35.975 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:35.975 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:35.975 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:29:35.975 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:35.975 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:35.975 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:29:35.975 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:35.975 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:35.975 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:35.975 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:29:35.975 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:35.975 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:35.975 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:29:35.975 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:35.976 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:35.976 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:35.976 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:29:35.976 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:35.976 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:35.976 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:35.976 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:29:35.976 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:29:35.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.965+0000 7f0416ffd640 1 --2- 10.20.193.58:0/1435085092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f04301fdba0 0x7f043015a100 secure :-1 s=CLOSED pgs=109 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0424009230 tx=0x7f0424005f90 comp rx=0 tx=0).stop 2026-02-23T06:29:35.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.965+0000 7f042f577640 1 -- 10.20.193.58:0/1435085092 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f03fc07a780 msgr2=0x7f03fc09ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:35.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.965+0000 7f042f577640 1 --2- 10.20.193.58:0/1435085092 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f03fc07a780 0x7f03fc09ac30 secure :-1 s=READY pgs=246 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0420006a50 tx=0x7f04200069e0 comp rx=0 tx=0).stop 2026-02-23T06:29:35.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.965+0000 7f042f577640 1 -- 10.20.193.58:0/1435085092 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f043015d4a0 msgr2=0x7f0430166510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:35.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.965+0000 7f042f577640 1 --2- 10.20.193.58:0/1435085092 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f043015d4a0 0x7f0430166510 secure :-1 s=READY pgs=23 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0418007fd0 tx=0x7f041800c970 comp rx=0 tx=0).stop 2026-02-23T06:29:35.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.965+0000 7f042ed76640 1 -- 10.20.193.58:0/1435085092 reap_dead start 2026-02-23T06:29:35.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.965+0000 7f042ed76640 1 -- 10.20.193.58:0/1435085092 reap_dead start 2026-02-23T06:29:35.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.965+0000 7f042f577640 1 -- 10.20.193.58:0/1435085092 shutdown_connections 2026-02-23T06:29:35.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.965+0000 7f042f577640 1 -- 10.20.193.58:0/1435085092 >> 10.20.193.58:0/1435085092 conn(0x7f04300b3c20 msgr2=0x7f043013c750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:35.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.965+0000 7f042f577640 1 -- 10.20.193.58:0/1435085092 shutdown_connections 2026-02-23T06:29:35.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:35.965+0000 7f042f577640 1 -- 10.20.193.58:0/1435085092 wait complete. 2026-02-23T06:29:35.979 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:29:35.979 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:29:35.979 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:29:36.099 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.104+0000 7fc54e3d2640 1 -- 10.20.193.58:0/475853389 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc54815d870 msgr2=0x7fc5480587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:36.099 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.104+0000 7fc54e3d2640 1 --2- 10.20.193.58:0/475853389 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc54815d870 0x7fc5480587b0 secure :-1 s=READY pgs=25 gs=3 cs=0 l=1 c_cookie=1411205956670344585 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc53c005e70 tx=0x7fc53c02f2e0 comp rx=0 tx=0).stop 2026-02-23T06:29:36.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.104+0000 7fc54e3d2640 1 -- 10.20.193.58:0/475853389 shutdown_connections 2026-02-23T06:29:36.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.104+0000 7fc54e3d2640 1 --2- 10.20.193.58:0/475853389 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc54815d870 0x7fc5480587b0 unknown :-1 s=CLOSED pgs=25 gs=3 cs=0 l=1 c_cookie=1411205956670344585 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:36.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.104+0000 7fc54e3d2640 1 -- 10.20.193.58:0/475853389 >> 10.20.193.58:0/475853389 conn(0x7fc5480b3c20 msgr2=0x7fc5480b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:36.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.104+0000 7fc54e3d2640 1 -- 10.20.193.58:0/475853389 shutdown_connections 2026-02-23T06:29:36.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.104+0000 7fc54e3d2640 1 -- 10.20.193.58:0/475853389 wait complete. 2026-02-23T06:29:36.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.106+0000 7fc54e3d2640 1 Processor -- start 2026-02-23T06:29:36.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.106+0000 7fc54e3d2640 1 -- start start 2026-02-23T06:29:36.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.106+0000 7fc54e3d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc5480b6690 0x7fc548056f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:36.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.106+0000 7fc54e3d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc54815d4a0 0x7fc5480587e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:36.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.106+0000 7fc54e3d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc54815d870 0x7fc54814df80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:36.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.106+0000 7fc54e3d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc54811ef00 con 0x7fc5480b6690 2026-02-23T06:29:36.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.106+0000 7fc54e3d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc5480582d0 con 0x7fc54815d4a0 2026-02-23T06:29:36.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.106+0000 7fc54e3d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc54813de90 con 0x7fc54815d870 2026-02-23T06:29:36.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.106+0000 7fc54d3d0640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc5480b6690 0x7fc548056f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:36.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.106+0000 7fc54d3d0640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc5480b6690 0x7fc548056f60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:57152/0 (socket says 10.20.193.58:57152) 2026-02-23T06:29:36.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.106+0000 7fc54d3d0640 1 -- 10.20.193.58:0/3017673750 learned_addr learned my addr 10.20.193.58:0/3017673750 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:29:36.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.107+0000 7fc54cbcf640 1 --2- 10.20.193.58:0/3017673750 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc54815d4a0 0x7fc5480587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:36.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.107+0000 7fc54dbd1640 1 --2- 10.20.193.58:0/3017673750 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc54815d870 0x7fc54814df80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:36.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.107+0000 7fc54d3d0640 1 -- 10.20.193.58:0/3017673750 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc54815d870 msgr2=0x7fc54814df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:36.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.107+0000 7fc54d3d0640 1 --2- 10.20.193.58:0/3017673750 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc54815d870 0x7fc54814df80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:36.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.107+0000 7fc54d3d0640 1 -- 10.20.193.58:0/3017673750 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc54815d4a0 msgr2=0x7fc5480587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:36.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.107+0000 7fc54d3d0640 1 --2- 10.20.193.58:0/3017673750 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc54815d4a0 0x7fc5480587e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:36.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.107+0000 7fc54d3d0640 1 -- 10.20.193.58:0/3017673750 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc53c009570 con 0x7fc5480b6690 2026-02-23T06:29:36.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.107+0000 7fc54d3d0640 1 --2- 10.20.193.58:0/3017673750 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc5480b6690 0x7fc548056f60 secure :-1 s=READY pgs=26 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc53800c500 tx=0x7fc53800c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:36.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.107+0000 7fc535ffb640 1 -- 10.20.193.58:0/3017673750 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc538004250 con 0x7fc5480b6690 2026-02-23T06:29:36.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.107+0000 7fc535ffb640 1 -- 10.20.193.58:0/3017673750 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5380044a0 con 0x7fc5480b6690 2026-02-23T06:29:36.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.107+0000 7fc54e3d2640 1 -- 10.20.193.58:0/3017673750 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc548057a70 con 0x7fc5480b6690 2026-02-23T06:29:36.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.107+0000 7fc535ffb640 1 -- 10.20.193.58:0/3017673750 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc538006b10 con 0x7fc5480b6690 2026-02-23T06:29:36.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.107+0000 7fc54e3d2640 1 -- 10.20.193.58:0/3017673750 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc548057dc0 con 0x7fc5480b6690 2026-02-23T06:29:36.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.108+0000 7fc54e3d2640 1 --2- 10.20.193.58:0/3017673750 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc5480561f0 0x7fc54814e4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:36.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.108+0000 7fc54e3d2640 1 -- 10.20.193.58:0/3017673750 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc5480b5e10 con 0x7fc5480561f0 2026-02-23T06:29:36.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.108+0000 7fc54cbcf640 1 --2- 10.20.193.58:0/3017673750 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc5480561f0 0x7fc54814e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:36.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.108+0000 7fc54cbcf640 1 -- 10.20.193.58:0/3017673750 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc5480b5b30 con 0x7fc5480561f0 2026-02-23T06:29:36.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.109+0000 7fc54cbcf640 1 --2- 10.20.193.58:0/3017673750 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc5480561f0 0x7fc54814e4c0 secure :-1 s=READY pgs=127 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc54813b890 tx=0x7fc53c0028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:36.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.109+0000 7fc535ffb640 1 -- 10.20.193.58:0/3017673750 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc53c03f070 con 0x7fc5480561f0 2026-02-23T06:29:36.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.109+0000 7fc535ffb640 1 -- 10.20.193.58:0/3017673750 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fc538003670 con 0x7fc5480b6690 2026-02-23T06:29:36.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.110+0000 7fc535ffb640 1 --2- 10.20.193.58:0/3017673750 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc51807a660 0x7fc51809ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:36.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.110+0000 7fc535ffb640 1 -- 10.20.193.58:0/3017673750 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fc53809c790 con 0x7fc5480b6690 2026-02-23T06:29:36.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.110+0000 7fc54dbd1640 1 --2- 10.20.193.58:0/3017673750 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc51807a660 0x7fc51809ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:36.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.110+0000 7fc535ffb640 1 -- 10.20.193.58:0/3017673750 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fc53c038470 con 0x7fc5480561f0 2026-02-23T06:29:36.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.110+0000 7fc535ffb640 1 -- 10.20.193.58:0/3017673750 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc5480561f0 msgr2=0x7fc54814e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:36.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.110+0000 7fc535ffb640 1 --2- 10.20.193.58:0/3017673750 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc5480561f0 0x7fc54814e4c0 secure :-1 s=READY pgs=127 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc54813b890 tx=0x7fc53c0028d0 comp rx=0 tx=0).stop 2026-02-23T06:29:36.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.110+0000 7fc535ffb640 1 -- 10.20.193.58:0/3017673750 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc5480561f0 msgr2=0x7fc54814e4c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:29:36.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.110+0000 7fc535ffb640 1 --2- 10.20.193.58:0/3017673750 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc5480561f0 0x7fc54814e4c0 secure :-1 s=CLOSED pgs=127 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc54813b890 tx=0x7fc53c0028d0 comp rx=0 tx=0).stop 2026-02-23T06:29:36.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.110+0000 7fc54dbd1640 1 --2- 10.20.193.58:0/3017673750 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc51807a660 0x7fc51809ab10 secure :-1 s=READY pgs=247 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc548057880 tx=0x7fc54400a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:36.108 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.114+0000 7fc54e3d2640 1 --2- 10.20.193.58:0/3017673750 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc54814db20 0x7fc54811de60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:36.108 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.114+0000 7fc54e3d2640 1 -- 10.20.193.58:0/3017673750 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc5480b6d50 con 0x7fc54814db20 2026-02-23T06:29:36.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.114+0000 7fc54cbcf640 1 --2- 10.20.193.58:0/3017673750 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc54814db20 0x7fc54811de60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:36.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.114+0000 7fc54cbcf640 1 -- 10.20.193.58:0/3017673750 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc5480b06c0 con 0x7fc54814db20 2026-02-23T06:29:36.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.115+0000 7fc54cbcf640 1 --2- 10.20.193.58:0/3017673750 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc54814db20 0x7fc54811de60 secure :-1 s=READY pgs=128 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc53c0098a0 tx=0x7fc53c009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:36.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.115+0000 7fc535ffb640 1 -- 10.20.193.58:0/3017673750 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc53c04e070 con 0x7fc54814db20 2026-02-23T06:29:36.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.115+0000 7fc535ffb640 1 -- 10.20.193.58:0/3017673750 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5556 (secure 0 0 0) 0x7fc53c052450 con 0x7fc54814db20 2026-02-23T06:29:36.110 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:29:36.110 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:29:36.110 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:29:36.110 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:29:36.110 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 70, 2026-02-23T06:29:36.110 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 250628, 2026-02-23T06:29:36.110 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:36.111 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:36.112 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:36.113 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:36.114 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:36.115 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:29:36.116 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:29:36.117 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.115+0000 7fc535ffb640 1 -- 10.20.193.58:0/3017673750 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc54814db20 msgr2=0x7fc54811de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:36.117 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.115+0000 7fc535ffb640 1 --2- 10.20.193.58:0/3017673750 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc54814db20 0x7fc54811de60 secure :-1 s=READY pgs=128 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc53c0098a0 tx=0x7fc53c009310 comp rx=0 tx=0).stop 2026-02-23T06:29:36.117 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.115+0000 7fc535ffb640 1 -- 10.20.193.58:0/3017673750 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc54814db20 msgr2=0x7fc54811de60 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:29:36.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.115+0000 7fc535ffb640 1 --2- 10.20.193.58:0/3017673750 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc54814db20 0x7fc54811de60 secure :-1 s=CLOSED pgs=128 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc53c0098a0 tx=0x7fc53c009310 comp rx=0 tx=0).stop 2026-02-23T06:29:36.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.116+0000 7fc54e3d2640 1 -- 10.20.193.58:0/3017673750 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc51807a660 msgr2=0x7fc51809ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:36.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.116+0000 7fc54e3d2640 1 --2- 10.20.193.58:0/3017673750 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc51807a660 0x7fc51809ab10 secure :-1 s=READY pgs=247 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc548057880 tx=0x7fc54400a040 comp rx=0 tx=0).stop 2026-02-23T06:29:36.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.116+0000 7fc54e3d2640 1 -- 10.20.193.58:0/3017673750 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc5480b6690 msgr2=0x7fc548056f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:36.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.116+0000 7fc54e3d2640 1 --2- 10.20.193.58:0/3017673750 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc5480b6690 0x7fc548056f60 secure :-1 s=READY pgs=26 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc53800c500 tx=0x7fc53800c9d0 comp rx=0 tx=0).stop 2026-02-23T06:29:36.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.116+0000 7fc54dbd1640 1 -- 10.20.193.58:0/3017673750 reap_dead start 2026-02-23T06:29:36.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.116+0000 7fc54dbd1640 1 -- 10.20.193.58:0/3017673750 reap_dead start 2026-02-23T06:29:36.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.116+0000 7fc54e3d2640 1 -- 10.20.193.58:0/3017673750 shutdown_connections 2026-02-23T06:29:36.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.116+0000 7fc54e3d2640 1 -- 10.20.193.58:0/3017673750 >> 10.20.193.58:0/3017673750 conn(0x7fc5480b3c20 msgr2=0x7fc54805b250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:36.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.116+0000 7fc54e3d2640 1 -- 10.20.193.58:0/3017673750 shutdown_connections 2026-02-23T06:29:36.118 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.116+0000 7fc54e3d2640 1 -- 10.20.193.58:0/3017673750 wait complete. 2026-02-23T06:29:36.118 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:29:36.118 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-23T06:29:36.118 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-23T06:29:36.118 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-23T06:29:36.118 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-23T06:29:36.118 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-23T06:29:36.118 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:29:36.133 INFO:tasks.ceph.mon.a:Stopped 2026-02-23T06:29:36.133 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:29:36.133 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:29:36.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.299+0000 7f064f48c640 1 -- 10.20.193.58:0/2155539800 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0648163c70 msgr2=0x7f064805b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:36.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.299+0000 7f064f48c640 1 --2- 10.20.193.58:0/2155539800 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0648163c70 0x7f064805b230 secure :-1 s=READY pgs=129 gs=3 cs=0 l=1 c_cookie=12367041196052184715 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f063c005e70 tx=0x7f063c02f340 comp rx=0 tx=0).stop 2026-02-23T06:29:36.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.299+0000 7f064f48c640 1 -- 10.20.193.58:0/2155539800 shutdown_connections 2026-02-23T06:29:36.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.299+0000 7f064f48c640 1 --2- 10.20.193.58:0/2155539800 >> v2:10.20.193.93:3300/0 conn(0x7f06480b6020 0x7f064815ce30 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:36.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.299+0000 7f064f48c640 1 --2- 10.20.193.58:0/2155539800 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0648163c70 0x7f064805b230 unknown :-1 s=CLOSED pgs=129 gs=3 cs=0 l=1 c_cookie=12367041196052184715 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:36.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.299+0000 7f064f48c640 1 -- 10.20.193.58:0/2155539800 >> 10.20.193.58:0/2155539800 conn(0x7f06480561f0 msgr2=0x7f06480565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:36.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.299+0000 7f064f48c640 1 -- 10.20.193.58:0/2155539800 shutdown_connections 2026-02-23T06:29:36.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.299+0000 7f064f48c640 1 -- 10.20.193.58:0/2155539800 wait complete. 2026-02-23T06:29:36.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.300+0000 7f064f48c640 1 Processor -- start 2026-02-23T06:29:36.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.300+0000 7f064f48c640 1 -- start start 2026-02-23T06:29:36.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.301+0000 7f064f48c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f06480b10e0 0x7f06480aec20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:36.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.301+0000 7f064f48c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f06480b6020 0x7f064813eef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:36.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.301+0000 7f064f48c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0648163c70 0x7f06480b43e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:36.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.301+0000 7f064f48c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f06480b0560 con 0x7f06480b6020 2026-02-23T06:29:36.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.301+0000 7f064f48c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f064813f430 con 0x7f0648163c70 2026-02-23T06:29:36.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.301+0000 7f064f48c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f064813f660 con 0x7f06480b10e0 2026-02-23T06:29:36.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.301+0000 7f064ca00640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f06480b6020 msgr2=0x7f064813eef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:29:36.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.301+0000 7f064ca00640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f06480b6020 0x7f064813eef0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:29:36.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.301+0000 7f064d201640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f06480b10e0 0x7f06480aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:36.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.301+0000 7f064d201640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f06480b10e0 0x7f06480aec20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:46844/0 (socket says 10.20.193.58:46844) 2026-02-23T06:29:36.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.301+0000 7f064d201640 1 -- 10.20.193.58:0/2255517941 learned_addr learned my addr 10.20.193.58:0/2255517941 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:29:36.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.301+0000 7f064da02640 1 --2- 10.20.193.58:0/2255517941 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0648163c70 0x7f06480b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:36.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.302+0000 7f064da02640 1 -- 10.20.193.58:0/2255517941 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f06480b10e0 msgr2=0x7f06480aec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:36.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.302+0000 7f064da02640 1 --2- 10.20.193.58:0/2255517941 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f06480b10e0 0x7f06480aec20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:36.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.302+0000 7f064da02640 1 -- 10.20.193.58:0/2255517941 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f06480b6020 msgr2=0x7f064813eef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:29:36.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.302+0000 7f064da02640 1 --2- 10.20.193.58:0/2255517941 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f06480b6020 0x7f064813eef0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:36.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.302+0000 7f064da02640 1 -- 10.20.193.58:0/2255517941 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f063c009570 con 0x7f0648163c70 2026-02-23T06:29:36.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.302+0000 7f064da02640 1 --2- 10.20.193.58:0/2255517941 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0648163c70 0x7f06480b43e0 secure :-1 s=READY pgs=111 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06480b6420 tx=0x7f064400fde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:36.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.302+0000 7f0635ffb640 1 -- 10.20.193.58:0/2255517941 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f064400dc50 con 0x7f0648163c70 2026-02-23T06:29:36.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.302+0000 7f064f48c640 1 -- 10.20.193.58:0/2255517941 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06480b0d00 con 0x7f0648163c70 2026-02-23T06:29:36.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.302+0000 7f0635ffb640 1 -- 10.20.193.58:0/2255517941 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f064400ddd0 con 0x7f0648163c70 2026-02-23T06:29:36.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.302+0000 7f0635ffb640 1 -- 10.20.193.58:0/2255517941 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0644005bb0 con 0x7f0648163c70 2026-02-23T06:29:36.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.302+0000 7f064f48c640 1 -- 10.20.193.58:0/2255517941 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06480b0a20 con 0x7f0648163c70 2026-02-23T06:29:36.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.303+0000 7f06177fe640 1 -- 10.20.193.58:0/2255517941 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06480b14b0 con 0x7f0648163c70 2026-02-23T06:29:36.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.304+0000 7f0635ffb640 1 -- 10.20.193.58:0/2255517941 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f0644020060 con 0x7f0648163c70 2026-02-23T06:29:36.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.305+0000 7f0635ffb640 1 --2- 10.20.193.58:0/2255517941 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f061807a5a0 0x7f061809aa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:36.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.305+0000 7f0635ffb640 1 -- 10.20.193.58:0/2255517941 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f0644015070 con 0x7f0648163c70 2026-02-23T06:29:36.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.305+0000 7f064d201640 1 --2- 10.20.193.58:0/2255517941 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f061807a5a0 0x7f061809aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:36.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.306+0000 7f0635ffb640 1 -- 10.20.193.58:0/2255517941 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f0644065800 con 0x7f0648163c70 2026-02-23T06:29:36.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.306+0000 7f064d201640 1 --2- 10.20.193.58:0/2255517941 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f061807a5a0 0x7f061809aa50 secure :-1 s=READY pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0638006f50 tx=0x7f0638009210 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:36.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.460+0000 7f06177fe640 1 -- 10.20.193.58:0/2255517941 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f064815d3e0 con 0x7f0648163c70 2026-02-23T06:29:36.456 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.460+0000 7f0635ffb640 1 -- 10.20.193.58:0/2255517941 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f0644067760 con 0x7f0648163c70 2026-02-23T06:29:36.456 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":70,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:29:36.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.462+0000 7f06177fe640 1 -- 10.20.193.58:0/2255517941 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f061807a5a0 msgr2=0x7f061809aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:36.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.462+0000 7f06177fe640 1 --2- 10.20.193.58:0/2255517941 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f061807a5a0 0x7f061809aa50 secure :-1 s=READY pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0638006f50 tx=0x7f0638009210 comp rx=0 tx=0).stop 2026-02-23T06:29:36.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.462+0000 7f06177fe640 1 -- 10.20.193.58:0/2255517941 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0648163c70 msgr2=0x7f06480b43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:36.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.462+0000 7f06177fe640 1 --2- 10.20.193.58:0/2255517941 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0648163c70 0x7f06480b43e0 secure :-1 s=READY pgs=111 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06480b6420 tx=0x7f064400fde0 comp rx=0 tx=0).stop 2026-02-23T06:29:36.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.462+0000 7f06177fe640 1 -- 10.20.193.58:0/2255517941 shutdown_connections 2026-02-23T06:29:36.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.462+0000 7f06177fe640 1 --2- 10.20.193.58:0/2255517941 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f061807a5a0 0x7f061809aa50 unknown :-1 s=CLOSED pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:36.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.462+0000 7f06177fe640 1 --2- 10.20.193.58:0/2255517941 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0648163c70 0x7f06480b43e0 unknown :-1 s=CLOSED pgs=111 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:36.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.462+0000 7f06177fe640 1 --2- 10.20.193.58:0/2255517941 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f06480b6020 0x7f064813eef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:36.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.462+0000 7f06177fe640 1 --2- 10.20.193.58:0/2255517941 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f06480b10e0 0x7f06480aec20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:36.458 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.462+0000 7f06177fe640 1 -- 10.20.193.58:0/2255517941 >> 10.20.193.58:0/2255517941 conn(0x7f06480561f0 msgr2=0x7f064805cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:36.458 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.462+0000 7f06177fe640 1 -- 10.20.193.58:0/2255517941 shutdown_connections 2026-02-23T06:29:36.458 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:36.462+0000 7f06177fe640 1 -- 10.20.193.58:0/2255517941 wait complete. 2026-02-23T06:29:39.470 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:29:39.594 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.598+0000 7fdac97b5640 1 -- 10.20.193.58:0/630112548 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdac415f850 msgr2=0x7fdac40ad260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:39.594 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.598+0000 7fdac97b5640 1 --2- 10.20.193.58:0/630112548 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdac415f850 0x7fdac40ad260 secure :-1 s=READY pgs=118 gs=2 cs=0 l=1 c_cookie=4203649288584991634 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdab0004740 tx=0x7fdab002f130 comp rx=0 tx=0).stop 2026-02-23T06:29:39.594 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.598+0000 7fdac97b5640 1 -- 10.20.193.58:0/630112548 shutdown_connections 2026-02-23T06:29:39.594 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.598+0000 7fdac97b5640 1 --2- 10.20.193.58:0/630112548 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdac405a1c0 0x7fdac40b3760 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:39.594 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.598+0000 7fdac97b5640 1 --2- 10.20.193.58:0/630112548 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdac415f850 0x7fdac40ad260 unknown :-1 s=CLOSED pgs=118 gs=2 cs=0 l=1 c_cookie=4203649288584991634 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:39.594 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.598+0000 7fdac97b5640 1 -- 10.20.193.58:0/630112548 >> 10.20.193.58:0/630112548 conn(0x7fdac4057d10 msgr2=0x7fdac4058110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:39.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.598+0000 7fdac97b5640 1 -- 10.20.193.58:0/630112548 shutdown_connections 2026-02-23T06:29:39.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.598+0000 7fdac97b5640 1 -- 10.20.193.58:0/630112548 wait complete. 2026-02-23T06:29:39.597 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.599+0000 7fdac97b5640 1 Processor -- start 2026-02-23T06:29:39.597 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.599+0000 7fdac97b5640 1 -- start start 2026-02-23T06:29:39.597 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.600+0000 7fdac97b5640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdac405a1c0 0x7fdac409cc30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:39.597 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.600+0000 7fdac97b5640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdac415f850 0x7fdac42002d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:39.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.600+0000 7fdac97b5640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdac41655e0 0x7fdac409d630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:39.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.600+0000 7fdac97b5640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fdac415f550 con 0x7fdac415f850 2026-02-23T06:29:39.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.600+0000 7fdac97b5640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fdac42018c0 con 0x7fdac41655e0 2026-02-23T06:29:39.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.600+0000 7fdac97b5640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fdac41ffe40 con 0x7fdac405a1c0 2026-02-23T06:29:39.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.600+0000 7fdac37fe640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdac415f850 msgr2=0x7fdac42002d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:29:39.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.600+0000 7fdac37fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdac415f850 0x7fdac42002d0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:29:39.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.600+0000 7fdac3fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdac405a1c0 0x7fdac409cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:39.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.600+0000 7fdac3fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdac405a1c0 0x7fdac409cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:39576/0 (socket says 10.20.193.58:39576) 2026-02-23T06:29:39.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.600+0000 7fdac3fff640 1 -- 10.20.193.58:0/59708970 learned_addr learned my addr 10.20.193.58:0/59708970 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:29:39.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.600+0000 7fdac8fb4640 1 --2- 10.20.193.58:0/59708970 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdac41655e0 0x7fdac409d630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:39.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.600+0000 7fdac3fff640 1 -- 10.20.193.58:0/59708970 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdac41655e0 msgr2=0x7fdac409d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:39.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.600+0000 7fdac3fff640 1 --2- 10.20.193.58:0/59708970 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdac41655e0 0x7fdac409d630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:39.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.600+0000 7fdac3fff640 1 -- 10.20.193.58:0/59708970 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdac415f850 msgr2=0x7fdac42002d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:29:39.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.600+0000 7fdac3fff640 1 --2- 10.20.193.58:0/59708970 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdac415f850 0x7fdac42002d0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:39.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.601+0000 7fdac3fff640 1 -- 10.20.193.58:0/59708970 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab00094b0 con 0x7fdac405a1c0 2026-02-23T06:29:39.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.601+0000 7fdac8fb4640 1 --2- 10.20.193.58:0/59708970 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdac41655e0 0x7fdac409d630 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:29:39.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.601+0000 7fdac3fff640 1 --2- 10.20.193.58:0/59708970 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdac405a1c0 0x7fdac409cc30 secure :-1 s=READY pgs=131 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdab0009960 tx=0x7fdab00028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:39.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.601+0000 7fdac0ff9640 1 -- 10.20.193.58:0/59708970 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdab003d070 con 0x7fdac405a1c0 2026-02-23T06:29:39.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.601+0000 7fdac0ff9640 1 -- 10.20.193.58:0/59708970 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdab0002e70 con 0x7fdac405a1c0 2026-02-23T06:29:39.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.601+0000 7fdac97b5640 1 -- 10.20.193.58:0/59708970 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdac4201600 con 0x7fdac405a1c0 2026-02-23T06:29:39.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.601+0000 7fdac97b5640 1 -- 10.20.193.58:0/59708970 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdac41ff7f0 con 0x7fdac405a1c0 2026-02-23T06:29:39.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.601+0000 7fdac0ff9640 1 -- 10.20.193.58:0/59708970 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdab00386d0 con 0x7fdac405a1c0 2026-02-23T06:29:39.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.602+0000 7fdac97b5640 1 -- 10.20.193.58:0/59708970 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdac415fcb0 con 0x7fdac405a1c0 2026-02-23T06:29:39.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.603+0000 7fdac0ff9640 1 -- 10.20.193.58:0/59708970 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fdab0038830 con 0x7fdac405a1c0 2026-02-23T06:29:39.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.604+0000 7fdac0ff9640 1 --2- 10.20.193.58:0/59708970 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fda9407a5b0 0x7fda9409aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:39.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.604+0000 7fdac0ff9640 1 -- 10.20.193.58:0/59708970 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fdab00c2940 con 0x7fdac405a1c0 2026-02-23T06:29:39.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.605+0000 7fdac0ff9640 1 -- 10.20.193.58:0/59708970 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fdab0085ae0 con 0x7fdac405a1c0 2026-02-23T06:29:39.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.605+0000 7fdac37fe640 1 --2- 10.20.193.58:0/59708970 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fda9407a5b0 0x7fda9409aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:39.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.605+0000 7fdac37fe640 1 --2- 10.20.193.58:0/59708970 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fda9407a5b0 0x7fda9409aa60 secure :-1 s=READY pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdac4143360 tx=0x7fdab4005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:39.756 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.761+0000 7fdac97b5640 1 -- 10.20.193.58:0/59708970 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fdac41475c0 con 0x7fdac405a1c0 2026-02-23T06:29:39.756 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.761+0000 7fdac0ff9640 1 -- 10.20.193.58:0/59708970 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7fdab0088c00 con 0x7fdac405a1c0 2026-02-23T06:29:39.756 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":70,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:29:39.757 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.762+0000 7fdac97b5640 1 -- 10.20.193.58:0/59708970 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fda9407a5b0 msgr2=0x7fda9409aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:39.757 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.762+0000 7fdac97b5640 1 --2- 10.20.193.58:0/59708970 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fda9407a5b0 0x7fda9409aa60 secure :-1 s=READY pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdac4143360 tx=0x7fdab4005f90 comp rx=0 tx=0).stop 2026-02-23T06:29:39.757 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.762+0000 7fdac97b5640 1 -- 10.20.193.58:0/59708970 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdac405a1c0 msgr2=0x7fdac409cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:39.757 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.762+0000 7fdac97b5640 1 --2- 10.20.193.58:0/59708970 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdac405a1c0 0x7fdac409cc30 secure :-1 s=READY pgs=131 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdab0009960 tx=0x7fdab00028d0 comp rx=0 tx=0).stop 2026-02-23T06:29:39.757 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.762+0000 7fdac97b5640 1 -- 10.20.193.58:0/59708970 shutdown_connections 2026-02-23T06:29:39.757 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.762+0000 7fdac97b5640 1 --2- 10.20.193.58:0/59708970 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fda9407a5b0 0x7fda9409aa60 unknown :-1 s=CLOSED pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:39.757 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.762+0000 7fdac97b5640 1 --2- 10.20.193.58:0/59708970 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdac41655e0 0x7fdac409d630 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:39.757 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.762+0000 7fdac97b5640 1 --2- 10.20.193.58:0/59708970 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdac415f850 0x7fdac42002d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:39.758 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.762+0000 7fdac97b5640 1 --2- 10.20.193.58:0/59708970 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdac405a1c0 0x7fdac409cc30 unknown :-1 s=CLOSED pgs=131 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:39.758 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.762+0000 7fdac97b5640 1 -- 10.20.193.58:0/59708970 >> 10.20.193.58:0/59708970 conn(0x7fdac4057d10 msgr2=0x7fdac4147800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:39.758 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.762+0000 7fdac97b5640 1 -- 10.20.193.58:0/59708970 shutdown_connections 2026-02-23T06:29:39.758 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:39.762+0000 7fdac97b5640 1 -- 10.20.193.58:0/59708970 wait complete. 2026-02-23T06:29:42.770 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:29:42.819 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:29:42.823 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:29:42.893 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.897+0000 7f47609ad640 1 -- 10.20.193.58:0/2758057730 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f475c0b9ea0 msgr2=0x7f475c163c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:42.893 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.897+0000 7f47609ad640 1 --2- 10.20.193.58:0/2758057730 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f475c0b9ea0 0x7f475c163c30 secure :-1 s=READY pgs=132 gs=4 cs=0 l=1 c_cookie=17300817183701966255 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f475c0b1fa0 tx=0x7f475002f320 comp rx=0 tx=0).stop 2026-02-23T06:29:42.893 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.897+0000 7f47609ad640 1 -- 10.20.193.58:0/2758057730 shutdown_connections 2026-02-23T06:29:42.893 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.897+0000 7f47609ad640 1 --2- 10.20.193.58:0/2758057730 >> v2:10.20.193.58:3300/0 conn(0x7f475c0ba270 0x7f475c0b9020 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:42.893 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.897+0000 7f47609ad640 1 --2- 10.20.193.58:0/2758057730 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f475c0b9ea0 0x7f475c163c30 unknown :-1 s=CLOSED pgs=132 gs=4 cs=0 l=1 c_cookie=17300817183701966255 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:42.893 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.897+0000 7f47609ad640 1 -- 10.20.193.58:0/2758057730 >> 10.20.193.58:0/2758057730 conn(0x7f475c0b65c0 msgr2=0x7f475c0b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:42.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.897+0000 7f47609ad640 1 -- 10.20.193.58:0/2758057730 shutdown_connections 2026-02-23T06:29:42.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.897+0000 7f47609ad640 1 -- 10.20.193.58:0/2758057730 wait complete. 2026-02-23T06:29:42.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.898+0000 7f47609ad640 1 Processor -- start 2026-02-23T06:29:42.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.899+0000 7f47609ad640 1 -- start start 2026-02-23T06:29:42.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.899+0000 7f47609ad640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f475c0b2080 0x7f475c1212e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:42.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.899+0000 7f47609ad640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f475c0b9ea0 0x7f475c13d210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:42.897 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.899+0000 7f47609ad640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f475c0ba270 0x7f475c1254d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:42.897 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.899+0000 7f47609ad640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f475c121820 con 0x7f475c0b2080 2026-02-23T06:29:42.897 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.899+0000 7f47609ad640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f475c120720 con 0x7f475c0ba270 2026-02-23T06:29:42.897 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.899+0000 7f47609ad640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f475c121e40 con 0x7f475c0b9ea0 2026-02-23T06:29:42.897 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.899+0000 7f475ad76640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f475c0b2080 msgr2=0x7f475c1212e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:29:42.897 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.899+0000 7f475ad76640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f475c0b2080 0x7f475c1212e0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:29:42.897 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.899+0000 7f475a575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f475c0b9ea0 0x7f475c13d210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:42.897 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.899+0000 7f475a575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f475c0b9ea0 0x7f475c13d210 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:39586/0 (socket says 10.20.193.58:39586) 2026-02-23T06:29:42.897 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.899+0000 7f475a575640 1 -- 10.20.193.58:0/2800983477 learned_addr learned my addr 10.20.193.58:0/2800983477 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:29:42.897 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.899+0000 7f475b577640 1 --2- 10.20.193.58:0/2800983477 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f475c0ba270 0x7f475c1254d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:42.897 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.900+0000 7f475a575640 1 -- 10.20.193.58:0/2800983477 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f475c0ba270 msgr2=0x7f475c1254d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:42.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.900+0000 7f475a575640 1 --2- 10.20.193.58:0/2800983477 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f475c0ba270 0x7f475c1254d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:42.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.900+0000 7f475a575640 1 -- 10.20.193.58:0/2800983477 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f475c0b2080 msgr2=0x7f475c1212e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:29:42.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.900+0000 7f475a575640 1 --2- 10.20.193.58:0/2800983477 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f475c0b2080 0x7f475c1212e0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:42.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.900+0000 7f475a575640 1 -- 10.20.193.58:0/2800983477 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4750009570 con 0x7f475c0b9ea0 2026-02-23T06:29:42.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.900+0000 7f475a575640 1 --2- 10.20.193.58:0/2800983477 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f475c0b9ea0 0x7f475c13d210 secure :-1 s=READY pgs=133 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f474400b520 tx=0x7f474400b9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:42.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.900+0000 7f473b7fe640 1 -- 10.20.193.58:0/2800983477 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4744002ca0 con 0x7f475c0b9ea0 2026-02-23T06:29:42.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.900+0000 7f473b7fe640 1 -- 10.20.193.58:0/2800983477 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4744004070 con 0x7f475c0b9ea0 2026-02-23T06:29:42.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.900+0000 7f473b7fe640 1 -- 10.20.193.58:0/2800983477 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4744004480 con 0x7f475c0b9ea0 2026-02-23T06:29:42.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.900+0000 7f47609ad640 1 -- 10.20.193.58:0/2800983477 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f475c0b8490 con 0x7f475c0b9ea0 2026-02-23T06:29:42.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.900+0000 7f47609ad640 1 -- 10.20.193.58:0/2800983477 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f475c13d750 con 0x7f475c0b9ea0 2026-02-23T06:29:42.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.901+0000 7f47609ad640 1 -- 10.20.193.58:0/2800983477 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f475c163c30 con 0x7f475c0b9ea0 2026-02-23T06:29:42.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.902+0000 7f473b7fe640 1 -- 10.20.193.58:0/2800983477 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f474400d040 con 0x7f475c0b9ea0 2026-02-23T06:29:42.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.903+0000 7f473b7fe640 1 --2- 10.20.193.58:0/2800983477 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f472807a5b0 0x7f472809aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:42.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.903+0000 7f473b7fe640 1 -- 10.20.193.58:0/2800983477 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f474409d330 con 0x7f475c0b9ea0 2026-02-23T06:29:42.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.904+0000 7f475ad76640 1 --2- 10.20.193.58:0/2800983477 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f472807a5b0 0x7f472809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:42.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.905+0000 7f475ad76640 1 --2- 10.20.193.58:0/2800983477 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f472807a5b0 0x7f472809aa60 secure :-1 s=READY pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47500098a0 tx=0x7f4750031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:42.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:42.905+0000 7f473b7fe640 1 -- 10.20.193.58:0/2800983477 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f4744060560 con 0x7f475c0b9ea0 2026-02-23T06:29:43.054 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:43.059+0000 7f47609ad640 1 -- 10.20.193.58:0/2800983477 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f475c121b80 con 0x7f475c0b9ea0 2026-02-23T06:29:43.054 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:43.059+0000 7f473b7fe640 1 -- 10.20.193.58:0/2800983477 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f4744063680 con 0x7f475c0b9ea0 2026-02-23T06:29:43.054 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":70,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:29:43.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:43.060+0000 7f47609ad640 1 -- 10.20.193.58:0/2800983477 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f472807a5b0 msgr2=0x7f472809aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:43.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:43.060+0000 7f47609ad640 1 --2- 10.20.193.58:0/2800983477 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f472807a5b0 0x7f472809aa60 secure :-1 s=READY pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47500098a0 tx=0x7f4750031040 comp rx=0 tx=0).stop 2026-02-23T06:29:43.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:43.060+0000 7f47609ad640 1 -- 10.20.193.58:0/2800983477 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f475c0b9ea0 msgr2=0x7f475c13d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:43.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:43.060+0000 7f47609ad640 1 --2- 10.20.193.58:0/2800983477 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f475c0b9ea0 0x7f475c13d210 secure :-1 s=READY pgs=133 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f474400b520 tx=0x7f474400b9f0 comp rx=0 tx=0).stop 2026-02-23T06:29:43.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:43.060+0000 7f47609ad640 1 -- 10.20.193.58:0/2800983477 shutdown_connections 2026-02-23T06:29:43.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:43.060+0000 7f47609ad640 1 --2- 10.20.193.58:0/2800983477 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f472807a5b0 0x7f472809aa60 unknown :-1 s=CLOSED pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:43.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:43.060+0000 7f47609ad640 1 --2- 10.20.193.58:0/2800983477 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f475c0ba270 0x7f475c1254d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:43.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:43.060+0000 7f47609ad640 1 --2- 10.20.193.58:0/2800983477 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f475c0b9ea0 0x7f475c13d210 unknown :-1 s=CLOSED pgs=133 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:43.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:43.060+0000 7f47609ad640 1 --2- 10.20.193.58:0/2800983477 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f475c0b2080 0x7f475c1212e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:43.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:43.060+0000 7f47609ad640 1 -- 10.20.193.58:0/2800983477 >> 10.20.193.58:0/2800983477 conn(0x7f475c0b65c0 msgr2=0x7f475c143000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:43.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:43.060+0000 7f47609ad640 1 -- 10.20.193.58:0/2800983477 shutdown_connections 2026-02-23T06:29:43.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:43.060+0000 7f47609ad640 1 -- 10.20.193.58:0/2800983477 wait complete. 2026-02-23T06:29:46.068 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:29:50.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.604+0000 7f59911d2640 1 -- 10.20.193.58:0/595491092 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5968003760 msgr2=0x7f5968023ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:50.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.604+0000 7f59911d2640 1 --2- 10.20.193.58:0/595491092 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5968003760 0x7f5968023ba0 secure :-1 s=READY pgs=134 gs=25 cs=0 l=1 c_cookie=10753474562272920327 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5978002870 tx=0x7f597802fa00 comp rx=0 tx=0).stop 2026-02-23T06:29:50.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.604+0000 7f59909d1640 1 -- 10.20.193.58:0/595491092 reap_dead start 2026-02-23T06:29:50.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.604+0000 7f59911d2640 1 -- 10.20.193.58:0/595491092 shutdown_connections 2026-02-23T06:29:50.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.604+0000 7f59911d2640 1 -- 10.20.193.58:0/595491092 >> 10.20.193.58:0/595491092 conn(0x7f598c0b3c20 msgr2=0x7f598c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:50.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.604+0000 7f59911d2640 1 -- 10.20.193.58:0/595491092 shutdown_connections 2026-02-23T06:29:50.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.604+0000 7f59911d2640 1 -- 10.20.193.58:0/595491092 wait complete. 2026-02-23T06:29:50.603 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.605+0000 7f59911d2640 1 Processor -- start 2026-02-23T06:29:50.603 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.605+0000 7f59911d2640 1 -- start start 2026-02-23T06:29:50.603 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.606+0000 7f59911d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5968003760 0x7f598c2012f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:50.603 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.606+0000 7f59911d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f598c15f220 0x7f598c1624f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:50.603 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.606+0000 7f59911d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f598c159db0 0x7f598c15a220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:50.603 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.606+0000 7f59911d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f598c0b7f10 con 0x7f598c15f220 2026-02-23T06:29:50.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.606+0000 7f59911d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f598c200ed0 con 0x7f598c159db0 2026-02-23T06:29:50.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.606+0000 7f59911d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f598c15a760 con 0x7f5968003760 2026-02-23T06:29:50.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.606+0000 7f598b7fe640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f598c15f220 msgr2=0x7f598c1624f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:29:50.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.606+0000 7f598b7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f598c15f220 0x7f598c1624f0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:29:50.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.606+0000 7f598bfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5968003760 0x7f598c2012f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:50.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.606+0000 7f598bfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5968003760 0x7f598c2012f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:38384/0 (socket says 10.20.193.58:38384) 2026-02-23T06:29:50.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.606+0000 7f598bfff640 1 -- 10.20.193.58:0/1362544616 learned_addr learned my addr 10.20.193.58:0/1362544616 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:29:50.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.606+0000 7f59909d1640 1 --2- 10.20.193.58:0/1362544616 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f598c159db0 0x7f598c15a220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:50.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.606+0000 7f598bfff640 1 -- 10.20.193.58:0/1362544616 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f598c159db0 msgr2=0x7f598c15a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:50.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.606+0000 7f598bfff640 1 --2- 10.20.193.58:0/1362544616 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f598c159db0 0x7f598c15a220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:50.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.606+0000 7f598bfff640 1 -- 10.20.193.58:0/1362544616 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f598c15f220 msgr2=0x7f598c1624f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:29:50.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.606+0000 7f598bfff640 1 --2- 10.20.193.58:0/1362544616 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f598c15f220 0x7f598c1624f0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:50.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.606+0000 7f598bfff640 1 -- 10.20.193.58:0/1362544616 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5978009150 con 0x7f5968003760 2026-02-23T06:29:50.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.606+0000 7f598bfff640 1 --2- 10.20.193.58:0/1362544616 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5968003760 0x7f598c2012f0 secure :-1 s=READY pgs=135 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59780386d0 tx=0x7f5978038700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:50.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.607+0000 7f5988ff9640 1 -- 10.20.193.58:0/1362544616 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f597803b040 con 0x7f5968003760 2026-02-23T06:29:50.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.607+0000 7f59911d2640 1 -- 10.20.193.58:0/1362544616 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f598c201830 con 0x7f5968003760 2026-02-23T06:29:50.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.607+0000 7f5988ff9640 1 -- 10.20.193.58:0/1362544616 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5978038e40 con 0x7f5968003760 2026-02-23T06:29:50.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.607+0000 7f5988ff9640 1 -- 10.20.193.58:0/1362544616 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5978002650 con 0x7f5968003760 2026-02-23T06:29:50.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.607+0000 7f59911d2640 1 -- 10.20.193.58:0/1362544616 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f598c15aa80 con 0x7f5968003760 2026-02-23T06:29:50.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.607+0000 7f59911d2640 1 -- 10.20.193.58:0/1362544616 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f598c0b6d50 con 0x7f5968003760 2026-02-23T06:29:50.606 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.608+0000 7f5988ff9640 1 -- 10.20.193.58:0/1362544616 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f59780426e0 con 0x7f5968003760 2026-02-23T06:29:50.606 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.609+0000 7f5988ff9640 1 --2- 10.20.193.58:0/1362544616 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f595c07a5b0 0x7f595c09aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:50.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.610+0000 7f5988ff9640 1 -- 10.20.193.58:0/1362544616 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f59780c3c50 con 0x7f5968003760 2026-02-23T06:29:50.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.610+0000 7f598b7fe640 1 --2- 10.20.193.58:0/1362544616 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f595c07a5b0 0x7f595c09aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:50.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.610+0000 7f598b7fe640 1 --2- 10.20.193.58:0/1362544616 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f595c07a5b0 0x7f595c09aa60 secure :-1 s=READY pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f598c0aea70 tx=0x7f597c005ab0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:50.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.611+0000 7f5988ff9640 1 -- 10.20.193.58:0/1362544616 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f5978086df0 con 0x7f5968003760 2026-02-23T06:29:50.762 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.767+0000 7f59911d2640 1 -- 10.20.193.58:0/1362544616 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f598c164250 con 0x7f5968003760 2026-02-23T06:29:50.769 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.775+0000 7f5988ff9640 1 -- 10.20.193.58:0/1362544616 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1748 (secure 0 0 0) 0x7f5978089f10 con 0x7f5968003760 2026-02-23T06:29:50.769 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":72,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:29:50.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.775+0000 7f59911d2640 1 -- 10.20.193.58:0/1362544616 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f595c07a5b0 msgr2=0x7f595c09aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:50.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.775+0000 7f59911d2640 1 --2- 10.20.193.58:0/1362544616 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f595c07a5b0 0x7f595c09aa60 secure :-1 s=READY pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f598c0aea70 tx=0x7f597c005ab0 comp rx=0 tx=0).stop 2026-02-23T06:29:50.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.775+0000 7f59911d2640 1 -- 10.20.193.58:0/1362544616 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5968003760 msgr2=0x7f598c2012f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:50.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.775+0000 7f59911d2640 1 --2- 10.20.193.58:0/1362544616 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5968003760 0x7f598c2012f0 secure :-1 s=READY pgs=135 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59780386d0 tx=0x7f5978038700 comp rx=0 tx=0).stop 2026-02-23T06:29:50.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.775+0000 7f59911d2640 1 -- 10.20.193.58:0/1362544616 shutdown_connections 2026-02-23T06:29:50.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.775+0000 7f59911d2640 1 --2- 10.20.193.58:0/1362544616 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f595c07a5b0 0x7f595c09aa60 unknown :-1 s=CLOSED pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:50.772 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.775+0000 7f59911d2640 1 --2- 10.20.193.58:0/1362544616 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f598c159db0 0x7f598c15a220 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:50.772 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.775+0000 7f59911d2640 1 --2- 10.20.193.58:0/1362544616 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f598c15f220 0x7f598c1624f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:50.772 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.775+0000 7f59911d2640 1 --2- 10.20.193.58:0/1362544616 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5968003760 0x7f598c2012f0 unknown :-1 s=CLOSED pgs=135 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:50.772 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.775+0000 7f59911d2640 1 -- 10.20.193.58:0/1362544616 >> 10.20.193.58:0/1362544616 conn(0x7f598c0b3c20 msgr2=0x7f598c0b7480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:50.772 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.775+0000 7f59911d2640 1 -- 10.20.193.58:0/1362544616 shutdown_connections 2026-02-23T06:29:50.772 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.775+0000 7f59911d2640 1 -- 10.20.193.58:0/1362544616 wait complete. 2026-02-23T06:29:50.783 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:29:50.783 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-23T06:29:50.783 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:29:50.906 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.911+0000 7fa23e883640 1 -- 10.20.193.58:0/4181969361 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa23815c040 msgr2=0x7fa23805b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:50.906 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.911+0000 7fa23e883640 1 --2- 10.20.193.58:0/4181969361 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa23815c040 0x7fa23805b0e0 secure :-1 s=READY pgs=136 gs=2 cs=0 l=1 c_cookie=15961063244363321477 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa228005e70 tx=0x7fa22802f2b0 comp rx=0 tx=0).stop 2026-02-23T06:29:50.906 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.911+0000 7fa23e883640 1 -- 10.20.193.58:0/4181969361 shutdown_connections 2026-02-23T06:29:50.906 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.911+0000 7fa23e883640 1 --2- 10.20.193.58:0/4181969361 >> v2:10.20.193.58:3300/0 conn(0x7fa238056550 0x7fa23805ce30 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:50.906 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.911+0000 7fa23e883640 1 --2- 10.20.193.58:0/4181969361 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa23815c040 0x7fa23805b0e0 unknown :-1 s=CLOSED pgs=136 gs=2 cs=0 l=1 c_cookie=15961063244363321477 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:50.906 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.911+0000 7fa23e883640 1 -- 10.20.193.58:0/4181969361 >> 10.20.193.58:0/4181969361 conn(0x7fa2380b3c20 msgr2=0x7fa2380b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:50.906 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.911+0000 7fa23e883640 1 -- 10.20.193.58:0/4181969361 shutdown_connections 2026-02-23T06:29:50.906 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.911+0000 7fa23e883640 1 -- 10.20.193.58:0/4181969361 wait complete. 2026-02-23T06:29:50.906 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.912+0000 7fa23e883640 1 Processor -- start 2026-02-23T06:29:50.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.912+0000 7fa23e883640 1 -- start start 2026-02-23T06:29:50.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.912+0000 7fa23e883640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa238056550 0x7fa238058e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:50.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.912+0000 7fa23e883640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa23805d370 0x7fa2381feed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:50.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.913+0000 7fa23e883640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa23815c040 0x7fa238151550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:50.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.913+0000 7fa23e883640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa238155440 con 0x7fa23805d370 2026-02-23T06:29:50.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.913+0000 7fa23e883640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fa238155a00 con 0x7fa238056550 2026-02-23T06:29:50.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.913+0000 7fa23e883640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa238155700 con 0x7fa23815c040 2026-02-23T06:29:50.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.913+0000 7fa23d080640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa23805d370 msgr2=0x7fa2381feed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:29:50.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.913+0000 7fa23d080640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa23805d370 0x7fa2381feed0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:29:50.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.913+0000 7fa23d881640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa238056550 0x7fa238058e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:50.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.913+0000 7fa23e082640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa23815c040 0x7fa238151550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:50.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.913+0000 7fa23d881640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa238056550 0x7fa238058e10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:47562/0 (socket says 10.20.193.58:47562) 2026-02-23T06:29:50.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.913+0000 7fa23d881640 1 -- 10.20.193.58:0/250189753 learned_addr learned my addr 10.20.193.58:0/250189753 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:29:50.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.913+0000 7fa23d881640 1 -- 10.20.193.58:0/250189753 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa23815c040 msgr2=0x7fa238151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:50.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.913+0000 7fa23d881640 1 --2- 10.20.193.58:0/250189753 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa23815c040 0x7fa238151550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:50.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.913+0000 7fa23d881640 1 -- 10.20.193.58:0/250189753 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa23805d370 msgr2=0x7fa2381feed0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:29:50.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.913+0000 7fa23d881640 1 --2- 10.20.193.58:0/250189753 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa23805d370 0x7fa2381feed0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:50.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.913+0000 7fa23d881640 1 -- 10.20.193.58:0/250189753 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa228009570 con 0x7fa238056550 2026-02-23T06:29:50.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.913+0000 7fa23e082640 1 --2- 10.20.193.58:0/250189753 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa23815c040 0x7fa238151550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:29:50.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.913+0000 7fa23d881640 1 --2- 10.20.193.58:0/250189753 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa238056550 0x7fa238058e10 secure :-1 s=READY pgs=122 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa228009a20 tx=0x7fa228002a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:50.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.914+0000 7fa2267fc640 1 -- 10.20.193.58:0/250189753 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa22803d070 con 0x7fa238056550 2026-02-23T06:29:50.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.914+0000 7fa2267fc640 1 -- 10.20.193.58:0/250189753 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa228004a70 con 0x7fa238056550 2026-02-23T06:29:50.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.914+0000 7fa2267fc640 1 -- 10.20.193.58:0/250189753 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa228004e80 con 0x7fa238056550 2026-02-23T06:29:50.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.914+0000 7fa23e883640 1 -- 10.20.193.58:0/250189753 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2381539d0 con 0x7fa238056550 2026-02-23T06:29:50.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.914+0000 7fa23e883640 1 -- 10.20.193.58:0/250189753 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa238153c50 con 0x7fa238056550 2026-02-23T06:29:50.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.914+0000 7fa23e883640 1 --2- 10.20.193.58:0/250189753 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa2381ff410 0x7fa238151a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:50.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.914+0000 7fa23e883640 1 -- 10.20.193.58:0/250189753 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fa23815c410 con 0x7fa2381ff410 2026-02-23T06:29:50.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.914+0000 7fa23d080640 1 --2- 10.20.193.58:0/250189753 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa2381ff410 0x7fa238151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:50.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.915+0000 7fa23d080640 1 -- 10.20.193.58:0/250189753 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa23805b620 con 0x7fa2381ff410 2026-02-23T06:29:50.910 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.915+0000 7fa23d080640 1 --2- 10.20.193.58:0/250189753 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa2381ff410 0x7fa238151a90 secure :-1 s=READY pgs=123 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa238059aa0 tx=0x7fa22c00b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:50.910 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.915+0000 7fa2267fc640 1 -- 10.20.193.58:0/250189753 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa22c003e70 con 0x7fa2381ff410 2026-02-23T06:29:50.910 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.915+0000 7fa2267fc640 1 -- 10.20.193.58:0/250189753 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fa22c005070 con 0x7fa2381ff410 2026-02-23T06:29:50.910 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.915+0000 7fa2267fc640 1 -- 10.20.193.58:0/250189753 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa2381ff410 msgr2=0x7fa238151a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:50.910 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.915+0000 7fa2267fc640 1 --2- 10.20.193.58:0/250189753 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa2381ff410 0x7fa238151a90 secure :-1 s=READY pgs=123 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa238059aa0 tx=0x7fa22c00b8f0 comp rx=0 tx=0).stop 2026-02-23T06:29:50.910 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.915+0000 7fa2267fc640 1 -- 10.20.193.58:0/250189753 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa2381ff410 msgr2=0x7fa238151a90 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:29:50.910 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.915+0000 7fa2267fc640 1 --2- 10.20.193.58:0/250189753 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa2381ff410 0x7fa238151a90 secure :-1 s=CLOSED pgs=123 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa238059aa0 tx=0x7fa22c00b8f0 comp rx=0 tx=0).stop 2026-02-23T06:29:50.910 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.915+0000 7fa2267fc640 1 -- 10.20.193.58:0/250189753 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fa228004fe0 con 0x7fa238056550 2026-02-23T06:29:50.911 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.917+0000 7fa2267fc640 1 --2- 10.20.193.58:0/250189753 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa20807a430 0x7fa20809a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:50.911 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.917+0000 7fa2267fc640 1 -- 10.20.193.58:0/250189753 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fa2280c2750 con 0x7fa238056550 2026-02-23T06:29:50.912 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.917+0000 7fa23d080640 1 --2- 10.20.193.58:0/250189753 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa20807a430 0x7fa20809a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:50.912 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.917+0000 7fa23d080640 1 --2- 10.20.193.58:0/250189753 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa20807a430 0x7fa20809a8e0 secure :-1 s=READY pgs=252 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa22c0026c0 tx=0x7fa22c008030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:50.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.919+0000 7fa23e883640 1 --2- 10.20.193.58:0/250189753 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa238200fd0 0x7fa2382013a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:50.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.919+0000 7fa23e883640 1 -- 10.20.193.58:0/250189753 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fa238155b40 con 0x7fa238200fd0 2026-02-23T06:29:50.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.919+0000 7fa23e082640 1 --2- 10.20.193.58:0/250189753 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa238200fd0 0x7fa2382013a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:50.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.919+0000 7fa23e082640 1 -- 10.20.193.58:0/250189753 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa238151fd0 con 0x7fa238200fd0 2026-02-23T06:29:50.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.920+0000 7fa23e082640 1 --2- 10.20.193.58:0/250189753 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa238200fd0 0x7fa2382013a0 secure :-1 s=READY pgs=124 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa234005280 tx=0x7fa234005750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:50.915 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.920+0000 7fa2267fc640 1 -- 10.20.193.58:0/250189753 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa234006d40 con 0x7fa238200fd0 2026-02-23T06:29:50.915 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.920+0000 7fa2267fc640 1 -- 10.20.193.58:0/250189753 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5236 (secure 0 0 0) 0x7fa23400fa90 con 0x7fa238200fd0 2026-02-23T06:29:50.915 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:29:50.915 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:29:50.915 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:29:50.915 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:29:50.915 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 72, 2026-02-23T06:29:50.915 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 192431, 2026-02-23T06:29:50.915 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:29:50.915 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:29:50.915 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:29:50.915 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:50.915 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:29:50.915 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:29:50.915 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:29:50.915 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:29:50.915 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:50.916 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:50.916 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:50.916 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:50.916 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:50.916 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:50.916 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:50.916 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:50.916 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:50.916 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:50.916 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:50.916 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:50.916 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:50.916 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:50.916 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:29:50.916 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:29:50.916 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:50.916 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:50.916 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:50.916 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:50.916 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:50.916 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:50.916 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:50.916 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:50.916 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:50.916 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:50.917 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:50.917 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:50.917 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:50.917 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:50.917 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:50.917 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:29:50.917 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:29:50.917 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:29:50.917 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:29:50.917 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:29:50.917 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:29:50.917 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:29:50.917 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:29:50.917 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:29:50.917 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:29:50.917 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:29:50.917 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:29:50.917 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:29:50.917 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:29:50.917 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:29:50.917 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:29:50.917 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:29:50.917 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:50.917 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:50.917 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:50.918 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:50.918 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:50.918 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:50.918 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:50.918 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:50.918 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:50.918 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:50.918 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:50.918 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:50.918 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:50.918 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:50.918 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:29:50.918 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:50.918 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:29:50.918 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:50.918 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:29:50.918 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:29:50.918 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:50.918 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:50.918 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:50.918 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:50.918 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:29:50.918 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:50.918 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:50.918 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:50.919 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:50.919 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:29:50.919 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:50.919 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:50.919 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:50.919 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:50.919 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:29:50.919 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:29:50.919 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:50.919 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:50.919 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:29:50.919 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:50.919 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:50.919 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:50.919 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:29:50.919 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:29:50.919 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:50.919 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:50.919 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:50.919 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:50.919 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:29:50.919 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:50.919 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:50.919 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:50.919 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:50.920 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:29:50.920 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:50.920 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:50.920 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:50.920 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:50.920 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:29:50.920 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:29:50.920 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:50.920 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:50.920 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:29:50.920 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:50.920 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:50.920 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:50.920 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:29:50.920 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:29:50.920 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:50.920 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:50.920 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:50.920 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:50.920 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:29:50.920 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:50.920 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:50.920 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:50.920 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:50.920 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:29:50.920 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:50.921 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:50.921 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:50.921 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:50.921 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:29:50.921 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:29:50.921 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:50.921 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:50.921 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:29:50.921 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:50.921 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:50.921 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:50.921 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:50.921 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:29:50.921 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:29:50.921 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:50.921 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:50.921 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:50.921 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:29:50.921 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:50.921 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:50.921 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:29:50.921 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:50.921 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:50.921 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:50.921 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:29:50.922 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:50.922 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:50.922 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:29:50.922 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:50.922 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:50.922 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:50.922 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:29:50.922 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:50.922 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:50.922 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:29:50.922 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:50.922 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:50.922 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:50.922 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:29:50.922 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:50.922 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:50.922 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:50.922 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:29:50.922 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:29:50.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.920+0000 7fa2267fc640 1 -- 10.20.193.58:0/250189753 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa238200fd0 msgr2=0x7fa2382013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:50.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.920+0000 7fa2267fc640 1 --2- 10.20.193.58:0/250189753 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa238200fd0 0x7fa2382013a0 secure :-1 s=READY pgs=124 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa234005280 tx=0x7fa234005750 comp rx=0 tx=0).stop 2026-02-23T06:29:50.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.920+0000 7fa2267fc640 1 -- 10.20.193.58:0/250189753 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa238200fd0 msgr2=0x7fa2382013a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:29:50.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.920+0000 7fa2267fc640 1 --2- 10.20.193.58:0/250189753 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa238200fd0 0x7fa2382013a0 secure :-1 s=CLOSED pgs=124 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa234005280 tx=0x7fa234005750 comp rx=0 tx=0).stop 2026-02-23T06:29:50.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.920+0000 7fa23e883640 1 -- 10.20.193.58:0/250189753 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa20807a430 msgr2=0x7fa20809a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:50.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.920+0000 7fa23e883640 1 --2- 10.20.193.58:0/250189753 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa20807a430 0x7fa20809a8e0 secure :-1 s=READY pgs=252 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa22c0026c0 tx=0x7fa22c008030 comp rx=0 tx=0).stop 2026-02-23T06:29:50.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.920+0000 7fa23e883640 1 -- 10.20.193.58:0/250189753 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa238056550 msgr2=0x7fa238058e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:50.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.920+0000 7fa23e883640 1 --2- 10.20.193.58:0/250189753 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa238056550 0x7fa238058e10 secure :-1 s=READY pgs=122 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa228009a20 tx=0x7fa228002a10 comp rx=0 tx=0).stop 2026-02-23T06:29:50.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.920+0000 7fa23e082640 1 -- 10.20.193.58:0/250189753 reap_dead start 2026-02-23T06:29:50.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.920+0000 7fa23e883640 1 -- 10.20.193.58:0/250189753 shutdown_connections 2026-02-23T06:29:50.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.920+0000 7fa23e883640 1 --2- 10.20.193.58:0/250189753 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa238056550 0x7fa238058e10 unknown :-1 s=CLOSED pgs=122 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:50.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.920+0000 7fa23e883640 1 -- 10.20.193.58:0/250189753 >> 10.20.193.58:0/250189753 conn(0x7fa2380b3c20 msgr2=0x7fa238164bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:50.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.920+0000 7fa23e883640 1 -- 10.20.193.58:0/250189753 shutdown_connections 2026-02-23T06:29:50.924 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:50.920+0000 7fa23e883640 1 -- 10.20.193.58:0/250189753 wait complete. 2026-02-23T06:29:50.924 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:29:50.924 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-23T06:29:50.924 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:29:51.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.051+0000 7f33835d2640 1 -- 10.20.193.58:0/2286933069 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f337c15c040 msgr2=0x7f337c05b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:51.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.051+0000 7f33835d2640 1 --2- 10.20.193.58:0/2286933069 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f337c15c040 0x7f337c05b0e0 secure :-1 s=READY pgs=137 gs=3 cs=0 l=1 c_cookie=4097085726892142845 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3374009890 tx=0x7f337402f200 comp rx=0 tx=0).stop 2026-02-23T06:29:51.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.051+0000 7f33835d2640 1 -- 10.20.193.58:0/2286933069 shutdown_connections 2026-02-23T06:29:51.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.051+0000 7f33835d2640 1 --2- 10.20.193.58:0/2286933069 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f337c15c040 0x7f337c05b0e0 unknown :-1 s=CLOSED pgs=137 gs=3 cs=0 l=1 c_cookie=4097085726892142845 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:51.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.051+0000 7f33835d2640 1 -- 10.20.193.58:0/2286933069 >> 10.20.193.58:0/2286933069 conn(0x7f337c0b3c20 msgr2=0x7f337c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:51.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.052+0000 7f33835d2640 1 -- 10.20.193.58:0/2286933069 shutdown_connections 2026-02-23T06:29:51.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.052+0000 7f33835d2640 1 -- 10.20.193.58:0/2286933069 wait complete. 2026-02-23T06:29:51.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.053+0000 7f33835d2640 1 Processor -- start 2026-02-23T06:29:51.048 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.053+0000 7f33835d2640 1 -- start start 2026-02-23T06:29:51.049 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.053+0000 7f33835d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f337c056550 0x7f337c0b0c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:51.049 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.053+0000 7f33835d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f337c0b5680 0x7f337c058810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:51.049 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.054+0000 7f33835d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f337c15c040 0x7f337c058d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:51.049 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.054+0000 7f33835d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f337c059290 con 0x7f337c15c040 2026-02-23T06:29:51.049 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.054+0000 7f33835d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f337c201a50 con 0x7f337c0b5680 2026-02-23T06:29:51.049 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.054+0000 7f33835d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f337c162760 con 0x7f337c056550 2026-02-23T06:29:51.049 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.054+0000 7f3382dd1640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f337c15c040 msgr2=0x7f337c058d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:29:51.049 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.054+0000 7f3382dd1640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f337c15c040 0x7f337c058d50 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:29:51.049 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.054+0000 7f33825d0640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f337c056550 0x7f337c0b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:51.049 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.054+0000 7f3381dcf640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f337c0b5680 0x7f337c058810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:51.049 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.054+0000 7f3381dcf640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f337c0b5680 0x7f337c058810 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:47578/0 (socket says 10.20.193.58:47578) 2026-02-23T06:29:51.049 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.054+0000 7f3381dcf640 1 -- 10.20.193.58:0/4142518541 learned_addr learned my addr 10.20.193.58:0/4142518541 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:29:51.050 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.054+0000 7f33825d0640 1 -- 10.20.193.58:0/4142518541 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f337c0b5680 msgr2=0x7f337c058810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:51.050 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.054+0000 7f33825d0640 1 --2- 10.20.193.58:0/4142518541 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f337c0b5680 0x7f337c058810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:51.050 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.054+0000 7f33825d0640 1 -- 10.20.193.58:0/4142518541 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f337c15c040 msgr2=0x7f337c058d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:29:51.050 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.054+0000 7f33825d0640 1 --2- 10.20.193.58:0/4142518541 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f337c15c040 0x7f337c058d50 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:51.050 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.054+0000 7f33825d0640 1 -- 10.20.193.58:0/4142518541 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33740094b0 con 0x7f337c056550 2026-02-23T06:29:51.050 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.054+0000 7f33825d0640 1 --2- 10.20.193.58:0/4142518541 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f337c056550 0x7f337c0b0c10 secure :-1 s=READY pgs=138 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3374004740 tx=0x7f3374002950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:51.050 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.055+0000 7f3366ffd640 1 -- 10.20.193.58:0/4142518541 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3374038690 con 0x7f337c056550 2026-02-23T06:29:51.050 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.055+0000 7f3366ffd640 1 -- 10.20.193.58:0/4142518541 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33740388e0 con 0x7f337c056550 2026-02-23T06:29:51.050 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.055+0000 7f3366ffd640 1 -- 10.20.193.58:0/4142518541 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3374038cb0 con 0x7f337c056550 2026-02-23T06:29:51.050 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.055+0000 7f33835d2640 1 -- 10.20.193.58:0/4142518541 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f337c0afe70 con 0x7f337c056550 2026-02-23T06:29:51.050 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.055+0000 7f33835d2640 1 -- 10.20.193.58:0/4142518541 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f337c0b0430 con 0x7f337c056550 2026-02-23T06:29:51.050 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.055+0000 7f33835d2640 1 --2- 10.20.193.58:0/4142518541 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f337c0b05f0 0x7f337c0aeab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:51.050 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.055+0000 7f33835d2640 1 -- 10.20.193.58:0/4142518541 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f337c0609c0 con 0x7f337c0b05f0 2026-02-23T06:29:51.051 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.055+0000 7f3381dcf640 1 --2- 10.20.193.58:0/4142518541 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f337c0b05f0 0x7f337c0aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:51.051 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.056+0000 7f3381dcf640 1 -- 10.20.193.58:0/4142518541 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f337c15c410 con 0x7f337c0b05f0 2026-02-23T06:29:51.051 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.056+0000 7f3381dcf640 1 --2- 10.20.193.58:0/4142518541 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f337c0b05f0 0x7f337c0aeab0 secure :-1 s=READY pgs=139 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f337c163160 tx=0x7f336800fc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:51.051 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.056+0000 7f3366ffd640 1 -- 10.20.193.58:0/4142518541 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f336800da80 con 0x7f337c0b05f0 2026-02-23T06:29:51.051 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.056+0000 7f3366ffd640 1 -- 10.20.193.58:0/4142518541 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f336800fe70 con 0x7f337c0b05f0 2026-02-23T06:29:51.051 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.056+0000 7f3366ffd640 1 -- 10.20.193.58:0/4142518541 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f337c0b05f0 msgr2=0x7f337c0aeab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:51.051 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.056+0000 7f3366ffd640 1 --2- 10.20.193.58:0/4142518541 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f337c0b05f0 0x7f337c0aeab0 secure :-1 s=READY pgs=139 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f337c163160 tx=0x7f336800fc10 comp rx=0 tx=0).stop 2026-02-23T06:29:51.051 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.056+0000 7f3366ffd640 1 -- 10.20.193.58:0/4142518541 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f337c0b05f0 msgr2=0x7f337c0aeab0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:29:51.051 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.056+0000 7f3366ffd640 1 --2- 10.20.193.58:0/4142518541 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f337c0b05f0 0x7f337c0aeab0 secure :-1 s=CLOSED pgs=139 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f337c163160 tx=0x7f336800fc10 comp rx=0 tx=0).stop 2026-02-23T06:29:51.051 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.056+0000 7f3366ffd640 1 -- 10.20.193.58:0/4142518541 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f3374040420 con 0x7f337c056550 2026-02-23T06:29:51.052 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.057+0000 7f3366ffd640 1 --2- 10.20.193.58:0/4142518541 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f334c07a430 0x7f334c09a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:51.052 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.057+0000 7f3366ffd640 1 -- 10.20.193.58:0/4142518541 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f33740c2c30 con 0x7f337c056550 2026-02-23T06:29:51.052 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.057+0000 7f3381dcf640 1 --2- 10.20.193.58:0/4142518541 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f334c07a430 0x7f334c09a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:51.053 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.058+0000 7f3381dcf640 1 --2- 10.20.193.58:0/4142518541 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f334c07a430 0x7f334c09a8e0 secure :-1 s=READY pgs=253 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f336800fc50 tx=0x7f3368009030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:51.054 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.059+0000 7f33835d2640 1 --2- 10.20.193.58:0/4142518541 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f337c162a80 0x7f337c0aeff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:29:51.054 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.060+0000 7f33835d2640 1 -- 10.20.193.58:0/4142518541 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f337c162e50 con 0x7f337c162a80 2026-02-23T06:29:51.054 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.060+0000 7f3382dd1640 1 --2- 10.20.193.58:0/4142518541 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f337c162a80 0x7f337c0aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:29:51.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.060+0000 7f3382dd1640 1 -- 10.20.193.58:0/4142518541 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f337c05d9c0 con 0x7f337c162a80 2026-02-23T06:29:51.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.060+0000 7f3382dd1640 1 --2- 10.20.193.58:0/4142518541 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f337c162a80 0x7f337c0aeff0 secure :-1 s=READY pgs=140 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3370003950 tx=0x7f337000c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:29:51.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.060+0000 7f3366ffd640 1 -- 10.20.193.58:0/4142518541 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f33700070d0 con 0x7f337c162a80 2026-02-23T06:29:51.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.061+0000 7f3366ffd640 1 -- 10.20.193.58:0/4142518541 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5544 (secure 0 0 0) 0x7f3370007230 con 0x7f337c162a80 2026-02-23T06:29:51.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.061+0000 7f3366ffd640 1 -- 10.20.193.58:0/4142518541 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f337c162a80 msgr2=0x7f337c0aeff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:51.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.061+0000 7f3366ffd640 1 --2- 10.20.193.58:0/4142518541 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f337c162a80 0x7f337c0aeff0 secure :-1 s=READY pgs=140 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3370003950 tx=0x7f337000c820 comp rx=0 tx=0).stop 2026-02-23T06:29:51.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.061+0000 7f3366ffd640 1 -- 10.20.193.58:0/4142518541 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f337c162a80 msgr2=0x7f337c0aeff0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:29:51.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.061+0000 7f3366ffd640 1 --2- 10.20.193.58:0/4142518541 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f337c162a80 0x7f337c0aeff0 unknown :-1 s=CLOSED pgs=140 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:51.056 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:29:51.056 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:29:51.056 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:29:51.056 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:29:51.056 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 72, 2026-02-23T06:29:51.056 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 265572, 2026-02-23T06:29:51.056 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:29:51.056 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:29:51.056 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:29:51.056 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:51.056 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:29:51.056 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:29:51.056 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:29:51.056 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:29:51.056 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:51.056 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:51.056 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:51.056 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:51.056 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:51.056 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:51.056 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:51.056 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:51.056 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:51.056 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:51.056 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:51.056 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:29:51.057 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:29:51.058 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:29:51.059 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:51.060 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:29:51.061 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:29:51.062 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:29:51.062 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:29:51.062 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:29:51.062 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.061+0000 7f33835d2640 1 -- 10.20.193.58:0/4142518541 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f334c07a430 msgr2=0x7f334c09a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:51.062 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.061+0000 7f33835d2640 1 --2- 10.20.193.58:0/4142518541 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f334c07a430 0x7f334c09a8e0 secure :-1 s=READY pgs=253 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f336800fc50 tx=0x7f3368009030 comp rx=0 tx=0).stop 2026-02-23T06:29:51.062 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.061+0000 7f33835d2640 1 -- 10.20.193.58:0/4142518541 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f337c056550 msgr2=0x7f337c0b0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:29:51.062 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.061+0000 7f33835d2640 1 --2- 10.20.193.58:0/4142518541 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f337c056550 0x7f337c0b0c10 secure :-1 s=READY pgs=138 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3374004740 tx=0x7f3374002950 comp rx=0 tx=0).stop 2026-02-23T06:29:51.062 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.061+0000 7f3382dd1640 1 -- 10.20.193.58:0/4142518541 reap_dead start 2026-02-23T06:29:51.062 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.061+0000 7f33835d2640 1 -- 10.20.193.58:0/4142518541 shutdown_connections 2026-02-23T06:29:51.062 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.061+0000 7f33835d2640 1 --2- 10.20.193.58:0/4142518541 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f337c056550 0x7f337c0b0c10 unknown :-1 s=CLOSED pgs=138 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:29:51.062 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.061+0000 7f33835d2640 1 -- 10.20.193.58:0/4142518541 >> 10.20.193.58:0/4142518541 conn(0x7f337c0b3c20 msgr2=0x7f337c0b5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:29:51.062 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.061+0000 7f33835d2640 1 -- 10.20.193.58:0/4142518541 shutdown_connections 2026-02-23T06:29:51.062 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:29:51.061+0000 7f33835d2640 1 -- 10.20.193.58:0/4142518541 wait complete. 2026-02-23T06:29:51.063 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:29:51.063 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:30:11.063 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-23T06:30:11.063 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-23T06:30:11.064 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-23T06:30:11.064 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-23T06:30:11.070 INFO:tasks.ceph.mon.a:Started 2026-02-23T06:30:11.070 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:30:11.070 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:30:11.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.194+0000 7f286399d640 1 -- 10.20.193.58:0/1093088375 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f285c163c70 msgr2=0x7f285c05b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:11.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.194+0000 7f286399d640 1 --2- 10.20.193.58:0/1093088375 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f285c163c70 0x7f285c05b230 secure :-1 s=READY pgs=144 gs=2 cs=0 l=1 c_cookie=17945344145334837967 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2850004740 tx=0x7f285002f250 comp rx=0 tx=0).stop 2026-02-23T06:30:11.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.195+0000 7f286399d640 1 -- 10.20.193.58:0/1093088375 shutdown_connections 2026-02-23T06:30:11.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.195+0000 7f286399d640 1 --2- 10.20.193.58:0/1093088375 >> v2:10.20.193.93:3300/0 conn(0x7f285c0b6020 0x7f285c15ce30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.195+0000 7f286399d640 1 --2- 10.20.193.58:0/1093088375 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f285c163c70 0x7f285c05b230 unknown :-1 s=CLOSED pgs=144 gs=2 cs=0 l=1 c_cookie=17945344145334837967 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.195+0000 7f286399d640 1 -- 10.20.193.58:0/1093088375 >> 10.20.193.58:0/1093088375 conn(0x7f285c0561f0 msgr2=0x7f285c0565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:30:11.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.195+0000 7f286399d640 1 -- 10.20.193.58:0/1093088375 shutdown_connections 2026-02-23T06:30:11.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.195+0000 7f286399d640 1 -- 10.20.193.58:0/1093088375 wait complete. 2026-02-23T06:30:11.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.196+0000 7f286399d640 1 Processor -- start 2026-02-23T06:30:11.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.196+0000 7f286399d640 1 -- start start 2026-02-23T06:30:11.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.197+0000 7f286399d640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f285c0b10e0 0x7f285c0af380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:11.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.197+0000 7f286399d640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f285c0b6020 0x7f285c162810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:11.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.197+0000 7f286399d640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f285c163c70 0x7f285c15bdc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:11.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.197+0000 7f286399d640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f285c0af8c0 con 0x7f285c0b6020 2026-02-23T06:30:11.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.197+0000 7f286399d640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f285c0b06e0 con 0x7f285c163c70 2026-02-23T06:30:11.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.197+0000 7f286399d640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f285c0b0c60 con 0x7f285c0b10e0 2026-02-23T06:30:11.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.197+0000 7f2861712640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f285c0b10e0 0x7f285c0af380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:11.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.197+0000 7f2860f11640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f285c0b6020 0x7f285c162810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:11.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.197+0000 7f2861712640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f285c0b10e0 0x7f285c0af380 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:47114/0 (socket says 10.20.193.58:47114) 2026-02-23T06:30:11.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.197+0000 7f2861712640 1 -- 10.20.193.58:0/2627375554 learned_addr learned my addr 10.20.193.58:0/2627375554 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:30:11.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.197+0000 7f2860f11640 1 -- 10.20.193.58:0/2627375554 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f285c0b6020 msgr2=0x7f285c162810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-23T06:30:11.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.197+0000 7f2860f11640 1 -- 10.20.193.58:0/2627375554 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f285c0b6020 msgr2=0x7f285c162810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:30:11.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.197+0000 7f2860f11640 1 --2- 10.20.193.58:0/2627375554 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f285c0b6020 0x7f285c162810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:30:11.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.197+0000 7f2861f13640 1 --2- 10.20.193.58:0/2627375554 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f285c163c70 0x7f285c15bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:11.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.197+0000 7f2860f11640 1 --2- 10.20.193.58:0/2627375554 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f285c0b6020 0x7f285c162810 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:30:11.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.197+0000 7f2861712640 1 -- 10.20.193.58:0/2627375554 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f285c163c70 msgr2=0x7f285c15bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:11.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.197+0000 7f2861712640 1 --2- 10.20.193.58:0/2627375554 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f285c163c70 0x7f285c15bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.197+0000 7f2861712640 1 -- 10.20.193.58:0/2627375554 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f285c0b6020 msgr2=0x7f285c162810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:30:11.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.197+0000 7f2861712640 1 --2- 10.20.193.58:0/2627375554 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f285c0b6020 0x7f285c162810 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.197+0000 7f2861712640 1 -- 10.20.193.58:0/2627375554 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28500094b0 con 0x7f285c0b10e0 2026-02-23T06:30:11.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.197+0000 7f2861f13640 1 --2- 10.20.193.58:0/2627375554 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f285c163c70 0x7f285c15bdc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:30:11.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.198+0000 7f2861712640 1 --2- 10.20.193.58:0/2627375554 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f285c0b10e0 0x7f285c0af380 secure :-1 s=READY pgs=145 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f284c00c4d0 tx=0x7f284c00c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:11.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.198+0000 7f2849ffb640 1 -- 10.20.193.58:0/2627375554 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f284c012850 con 0x7f285c0b10e0 2026-02-23T06:30:11.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.198+0000 7f2849ffb640 1 -- 10.20.193.58:0/2627375554 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f284c012aa0 con 0x7f285c0b10e0 2026-02-23T06:30:11.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.198+0000 7f2849ffb640 1 -- 10.20.193.58:0/2627375554 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f284c012e30 con 0x7f285c0b10e0 2026-02-23T06:30:11.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.198+0000 7f286399d640 1 -- 10.20.193.58:0/2627375554 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f285c13c570 con 0x7f285c0b10e0 2026-02-23T06:30:11.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.198+0000 7f286399d640 1 -- 10.20.193.58:0/2627375554 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f285c13cba0 con 0x7f285c0b10e0 2026-02-23T06:30:11.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.198+0000 7f286399d640 1 -- 10.20.193.58:0/2627375554 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f285c0b14b0 con 0x7f285c0b10e0 2026-02-23T06:30:11.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.200+0000 7f2849ffb640 1 -- 10.20.193.58:0/2627375554 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f284c01b400 con 0x7f285c0b10e0 2026-02-23T06:30:11.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.201+0000 7f2849ffb640 1 --2- 10.20.193.58:0/2627375554 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f282c07a6c0 0x7f282c09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:11.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.201+0000 7f2849ffb640 1 -- 10.20.193.58:0/2627375554 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f284c09daf0 con 0x7f285c0b10e0 2026-02-23T06:30:11.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.201+0000 7f2860f11640 1 --2- 10.20.193.58:0/2627375554 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f282c07a6c0 0x7f282c09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:11.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.202+0000 7f2860f11640 1 --2- 10.20.193.58:0/2627375554 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f282c07a6c0 0x7f282c09ab70 secure :-1 s=READY pgs=255 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28500023d0 tx=0x7f2850031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:11.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.202+0000 7f2849ffb640 1 -- 10.20.193.58:0/2627375554 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f284c060b70 con 0x7f285c0b10e0 2026-02-23T06:30:11.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.360+0000 7f286399d640 1 -- 10.20.193.58:0/2627375554 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f285c141d10 con 0x7f285c0b10e0 2026-02-23T06:30:11.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.360+0000 7f2849ffb640 1 -- 10.20.193.58:0/2627375554 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1754 (secure 0 0 0) 0x7f284c063d20 con 0x7f285c0b10e0 2026-02-23T06:30:11.356 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":76,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:30:11.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.361+0000 7f286399d640 1 -- 10.20.193.58:0/2627375554 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f282c07a6c0 msgr2=0x7f282c09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:11.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.361+0000 7f286399d640 1 --2- 10.20.193.58:0/2627375554 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f282c07a6c0 0x7f282c09ab70 secure :-1 s=READY pgs=255 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28500023d0 tx=0x7f2850031040 comp rx=0 tx=0).stop 2026-02-23T06:30:11.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.361+0000 7f286399d640 1 -- 10.20.193.58:0/2627375554 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f285c0b10e0 msgr2=0x7f285c0af380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:11.358 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.361+0000 7f286399d640 1 --2- 10.20.193.58:0/2627375554 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f285c0b10e0 0x7f285c0af380 secure :-1 s=READY pgs=145 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f284c00c4d0 tx=0x7f284c00c9a0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.358 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.361+0000 7f286399d640 1 -- 10.20.193.58:0/2627375554 shutdown_connections 2026-02-23T06:30:11.358 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.361+0000 7f286399d640 1 --2- 10.20.193.58:0/2627375554 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f282c07a6c0 0x7f282c09ab70 unknown :-1 s=CLOSED pgs=255 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.358 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.361+0000 7f286399d640 1 --2- 10.20.193.58:0/2627375554 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f285c163c70 0x7f285c15bdc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.358 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.361+0000 7f286399d640 1 --2- 10.20.193.58:0/2627375554 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f285c0b6020 0x7f285c162810 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.358 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.361+0000 7f286399d640 1 --2- 10.20.193.58:0/2627375554 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f285c0b10e0 0x7f285c0af380 unknown :-1 s=CLOSED pgs=145 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.358 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.361+0000 7f286399d640 1 -- 10.20.193.58:0/2627375554 >> 10.20.193.58:0/2627375554 conn(0x7f285c0561f0 msgr2=0x7f285c061540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:30:11.358 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.361+0000 7f286399d640 1 -- 10.20.193.58:0/2627375554 shutdown_connections 2026-02-23T06:30:11.358 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.361+0000 7f286399d640 1 -- 10.20.193.58:0/2627375554 wait complete. 2026-02-23T06:30:11.369 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:30:11.369 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:30:11.370 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:30:11.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.495+0000 7fbd96530640 1 -- 10.20.193.58:0/3599151828 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd900b6690 msgr2=0x7fbd90058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:11.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.495+0000 7fbd96530640 1 --2- 10.20.193.58:0/3599151828 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd900b6690 0x7fbd90058cf0 secure :-1 s=READY pgs=3 gs=1 cs=0 l=1 c_cookie=17260379891904535671 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd900b5040 tx=0x7fbd8c030270 comp rx=0 tx=0).stop 2026-02-23T06:30:11.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.495+0000 7fbd96530640 1 -- 10.20.193.58:0/3599151828 shutdown_connections 2026-02-23T06:30:11.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.495+0000 7fbd96530640 1 --2- 10.20.193.58:0/3599151828 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd900b6690 0x7fbd90058cf0 unknown :-1 s=CLOSED pgs=3 gs=1 cs=0 l=1 c_cookie=17260379891904535671 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.495+0000 7fbd96530640 1 --2- 10.20.193.58:0/3599151828 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd9015d870 0x7fbd900587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.495+0000 7fbd96530640 1 --2- 10.20.193.58:0/3599151828 >> v2:10.20.193.93:3300/0 conn(0x7fbd9015d4a0 0x7fbd900affb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.495+0000 7fbd96530640 1 -- 10.20.193.58:0/3599151828 >> 10.20.193.58:0/3599151828 conn(0x7fbd900b3c20 msgr2=0x7fbd900b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:30:11.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.495+0000 7fbd96530640 1 -- 10.20.193.58:0/3599151828 shutdown_connections 2026-02-23T06:30:11.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.495+0000 7fbd96530640 1 -- 10.20.193.58:0/3599151828 wait complete. 2026-02-23T06:30:11.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.496+0000 7fbd96530640 1 Processor -- start 2026-02-23T06:30:11.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.496+0000 7fbd96530640 1 -- start start 2026-02-23T06:30:11.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.497+0000 7fbd96530640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd900b6690 0x7fbd9013f160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:11.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.497+0000 7fbd96530640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd9015d4a0 0x7fbd9013b220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:11.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.497+0000 7fbd96530640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd9015d870 0x7fbd90159d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:11.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.497+0000 7fbd96530640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9013f6a0 con 0x7fbd9015d4a0 2026-02-23T06:30:11.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.497+0000 7fbd96530640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fbd90162380 con 0x7fbd900b6690 2026-02-23T06:30:11.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.497+0000 7fbd96530640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fbd90162580 con 0x7fbd9015d870 2026-02-23T06:30:11.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.497+0000 7fbd94d2d640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd9015d4a0 0x7fbd9013b220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:11.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.497+0000 7fbd9552e640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd900b6690 0x7fbd9013f160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:11.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.497+0000 7fbd9552e640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd900b6690 0x7fbd9013f160 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:52506/0 (socket says 10.20.193.58:52506) 2026-02-23T06:30:11.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.497+0000 7fbd9552e640 1 -- 10.20.193.58:0/1224235833 learned_addr learned my addr 10.20.193.58:0/1224235833 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:30:11.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.497+0000 7fbd95d2f640 1 --2- 10.20.193.58:0/1224235833 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd9015d870 0x7fbd90159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:11.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.497+0000 7fbd9552e640 1 -- 10.20.193.58:0/1224235833 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd9015d870 msgr2=0x7fbd90159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:11.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.498+0000 7fbd9552e640 1 --2- 10.20.193.58:0/1224235833 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd9015d870 0x7fbd90159d50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.498+0000 7fbd9552e640 1 -- 10.20.193.58:0/1224235833 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd9015d4a0 msgr2=0x7fbd9013b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:11.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.498+0000 7fbd9552e640 1 --2- 10.20.193.58:0/1224235833 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd9015d4a0 0x7fbd9013b220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.498+0000 7fbd9552e640 1 -- 10.20.193.58:0/1224235833 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8c00a590 con 0x7fbd900b6690 2026-02-23T06:30:11.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.498+0000 7fbd94d2d640 1 --2- 10.20.193.58:0/1224235833 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd9015d4a0 0x7fbd9013b220 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:30:11.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.498+0000 7fbd9552e640 1 --2- 10.20.193.58:0/1224235833 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd900b6690 0x7fbd9013f160 secure :-1 s=READY pgs=129 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd80005b30 tx=0x7fbd8000ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:11.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.498+0000 7fbd7dffb640 1 -- 10.20.193.58:0/1224235833 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd8000cc50 con 0x7fbd900b6690 2026-02-23T06:30:11.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.498+0000 7fbd7dffb640 1 -- 10.20.193.58:0/1224235833 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd8000cdb0 con 0x7fbd900b6690 2026-02-23T06:30:11.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.498+0000 7fbd7dffb640 1 -- 10.20.193.58:0/1224235833 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd80004ad0 con 0x7fbd900b6690 2026-02-23T06:30:11.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.498+0000 7fbd96530640 1 -- 10.20.193.58:0/1224235833 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd90162860 con 0x7fbd900b6690 2026-02-23T06:30:11.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.498+0000 7fbd96530640 1 -- 10.20.193.58:0/1224235833 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd901620a0 con 0x7fbd900b6690 2026-02-23T06:30:11.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.499+0000 7fbd96530640 1 --2- 10.20.193.58:0/1224235833 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd90058000 0x7fbd9015a290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:11.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.499+0000 7fbd96530640 1 -- 10.20.193.58:0/1224235833 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fbd90164250 con 0x7fbd90058000 2026-02-23T06:30:11.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.499+0000 7fbd94d2d640 1 --2- 10.20.193.58:0/1224235833 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd90058000 0x7fbd9015a290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:11.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.499+0000 7fbd94d2d640 1 -- 10.20.193.58:0/1224235833 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd900b6330 con 0x7fbd90058000 2026-02-23T06:30:11.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.499+0000 7fbd94d2d640 1 --2- 10.20.193.58:0/1224235833 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd90058000 0x7fbd9015a290 secure :-1 s=READY pgs=4 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd90162f80 tx=0x7fbd84002e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:11.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.499+0000 7fbd7dffb640 1 -- 10.20.193.58:0/1224235833 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd84011df0 con 0x7fbd90058000 2026-02-23T06:30:11.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.500+0000 7fbd7dffb640 1 -- 10.20.193.58:0/1224235833 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fbd8401a440 con 0x7fbd90058000 2026-02-23T06:30:11.498 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.500+0000 7fbd7dffb640 1 -- 10.20.193.58:0/1224235833 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd90058000 msgr2=0x7fbd9015a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:11.498 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.500+0000 7fbd7dffb640 1 --2- 10.20.193.58:0/1224235833 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd90058000 0x7fbd9015a290 secure :-1 s=READY pgs=4 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd90162f80 tx=0x7fbd84002e00 comp rx=0 tx=0).stop 2026-02-23T06:30:11.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.500+0000 7fbd7dffb640 1 -- 10.20.193.58:0/1224235833 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd90058000 msgr2=0x7fbd9015a290 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:30:11.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.500+0000 7fbd7dffb640 1 --2- 10.20.193.58:0/1224235833 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd90058000 0x7fbd9015a290 unknown :-1 s=CLOSED pgs=4 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.500+0000 7fbd7dffb640 1 -- 10.20.193.58:0/1224235833 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fbd8001f060 con 0x7fbd900b6690 2026-02-23T06:30:11.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.501+0000 7fbd7dffb640 1 --2- 10.20.193.58:0/1224235833 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbd6007a300 0x7fbd6009a7b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:11.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.501+0000 7fbd7dffb640 1 -- 10.20.193.58:0/1224235833 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fbd80014070 con 0x7fbd900b6690 2026-02-23T06:30:11.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.501+0000 7fbd94d2d640 1 --2- 10.20.193.58:0/1224235833 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbd6007a300 0x7fbd6009a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:11.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.502+0000 7fbd94d2d640 1 --2- 10.20.193.58:0/1224235833 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbd6007a300 0x7fbd6009a7b0 secure :-1 s=READY pgs=256 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd84011fd0 tx=0x7fbd8400e000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:11.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.503+0000 7fbd96530640 1 --2- 10.20.193.58:0/1224235833 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd9013fe50 0x7fbd901fd7b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:11.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.503+0000 7fbd96530640 1 -- 10.20.193.58:0/1224235833 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fbd900b7260 con 0x7fbd9013fe50 2026-02-23T06:30:11.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.503+0000 7fbd95d2f640 1 --2- 10.20.193.58:0/1224235833 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd9013fe50 0x7fbd901fd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:11.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.504+0000 7fbd95d2f640 1 -- 10.20.193.58:0/1224235833 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbd9005b4f0 con 0x7fbd9013fe50 2026-02-23T06:30:11.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.504+0000 7fbd95d2f640 1 --2- 10.20.193.58:0/1224235833 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd9013fe50 0x7fbd901fd7b0 secure :-1 s=READY pgs=5 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd8c00a8c0 tx=0x7fbd8c005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:11.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.504+0000 7fbd7dffb640 1 -- 10.20.193.58:0/1224235833 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd8c03e050 con 0x7fbd9013fe50 2026-02-23T06:30:11.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.504+0000 7fbd7dffb640 1 -- 10.20.193.58:0/1224235833 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4910 (secure 0 0 0) 0x7fbd8c03f040 con 0x7fbd9013fe50 2026-02-23T06:30:11.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.504+0000 7fbd7dffb640 1 -- 10.20.193.58:0/1224235833 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd9013fe50 msgr2=0x7fbd901fd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:11.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.504+0000 7fbd7dffb640 1 --2- 10.20.193.58:0/1224235833 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd9013fe50 0x7fbd901fd7b0 secure :-1 s=READY pgs=5 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd8c00a8c0 tx=0x7fbd8c005780 comp rx=0 tx=0).stop 2026-02-23T06:30:11.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.504+0000 7fbd7dffb640 1 -- 10.20.193.58:0/1224235833 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd9013fe50 msgr2=0x7fbd901fd7b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:30:11.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.504+0000 7fbd7dffb640 1 --2- 10.20.193.58:0/1224235833 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd9013fe50 0x7fbd901fd7b0 secure :-1 s=CLOSED pgs=5 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd8c00a8c0 tx=0x7fbd8c005780 comp rx=0 tx=0).stop 2026-02-23T06:30:11.502 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:30:11.502 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:30:11.502 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:30:11.502 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:30:11.502 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 76, 2026-02-23T06:30:11.502 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 321, 2026-02-23T06:30:11.503 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:30:11.503 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:30:11.503 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:30:11.503 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:30:11.503 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:11.503 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:30:11.503 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:30:11.503 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:30:11.503 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:30:11.503 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:30:11.503 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:30:11.504 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:30:11.504 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:30:11.504 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:30:11.504 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:30:11.504 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:30:11.504 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:30:11.504 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:30:11.504 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:30:11.504 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:30:11.504 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:30:11.504 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:30:11.504 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:11.505 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:30:11.505 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:30:11.505 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:30:11.505 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:30:11.505 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:30:11.505 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:30:11.505 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:30:11.505 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:30:11.505 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:30:11.505 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:30:11.505 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:30:11.505 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:30:11.506 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:30:11.506 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:30:11.506 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:30:11.506 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:11.506 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.506 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:30:11.506 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:30:11.506 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:30:11.506 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:30:11.506 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:30:11.506 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:30:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:30:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:30:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:30:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:30:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:30:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:30:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:30:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:30:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:30:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:30:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:30:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:30:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:30:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:30:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:30:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:30:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:30:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:30:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:30:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:30:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:30:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:30:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:30:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:30:11.509 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:11.509 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:30:11.509 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.509 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:30:11.509 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.509 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:30:11.509 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:30:11.509 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:30:11.509 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:30:11.509 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.509 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:30:11.509 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:30:11.510 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:11.510 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.510 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.510 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:30:11.510 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:30:11.510 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:11.510 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:11.510 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:11.510 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.510 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:30:11.510 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:30:11.510 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:30:11.510 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:30:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:30:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:30:11.511 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.511 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:30:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:30:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:30:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:30:11.511 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:30:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:30:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:11.512 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.512 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.512 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:30:11.512 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:30:11.512 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:11.512 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:11.512 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:11.512 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.512 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:30:11.512 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:30:11.512 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:30:11.512 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:30:11.513 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:30:11.513 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:30:11.513 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.513 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.513 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:30:11.513 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:30:11.513 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:30:11.513 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:30:11.513 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.513 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:30:11.513 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:30:11.513 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:11.514 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.514 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.514 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:30:11.514 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:30:11.514 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:11.514 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:11.514 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:11.514 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.514 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:30:11.514 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:30:11.514 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:30:11.514 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:30:11.514 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:30:11.515 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:30:11.515 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:11.515 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:11.515 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.515 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:30:11.515 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:30:11.515 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.515 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:11.515 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:11.515 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:30:11.515 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:11.515 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:11.516 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:30:11.516 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.516 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:11.516 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:11.516 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:30:11.516 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:11.516 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:11.516 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.516 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:30:11.516 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:30:11.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.504+0000 7fbd96530640 1 -- 10.20.193.58:0/1224235833 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbd6007a300 msgr2=0x7fbd6009a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:11.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.504+0000 7fbd96530640 1 --2- 10.20.193.58:0/1224235833 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbd6007a300 0x7fbd6009a7b0 secure :-1 s=READY pgs=256 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd84011fd0 tx=0x7fbd8400e000 comp rx=0 tx=0).stop 2026-02-23T06:30:11.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.504+0000 7fbd96530640 1 -- 10.20.193.58:0/1224235833 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd900b6690 msgr2=0x7fbd9013f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:11.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.504+0000 7fbd96530640 1 --2- 10.20.193.58:0/1224235833 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd900b6690 0x7fbd9013f160 secure :-1 s=READY pgs=129 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd80005b30 tx=0x7fbd8000ee60 comp rx=0 tx=0).stop 2026-02-23T06:30:11.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.504+0000 7fbd95d2f640 1 -- 10.20.193.58:0/1224235833 reap_dead start 2026-02-23T06:30:11.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.504+0000 7fbd96530640 1 -- 10.20.193.58:0/1224235833 shutdown_connections 2026-02-23T06:30:11.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.504+0000 7fbd96530640 1 -- 10.20.193.58:0/1224235833 >> 10.20.193.58:0/1224235833 conn(0x7fbd900b3c20 msgr2=0x7fbd9005d100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:30:11.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.504+0000 7fbd96530640 1 -- 10.20.193.58:0/1224235833 shutdown_connections 2026-02-23T06:30:11.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.504+0000 7fbd96530640 1 -- 10.20.193.58:0/1224235833 wait complete. 2026-02-23T06:30:11.519 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:30:11.519 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:30:11.520 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:30:11.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.645+0000 7fc24b577640 1 -- 10.20.193.58:0/3945537867 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc24c15c040 msgr2=0x7fc24c05b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:11.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.645+0000 7fc24b577640 1 --2- 10.20.193.58:0/3945537867 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc24c15c040 0x7fc24c05b0e0 secure :-1 s=READY pgs=7 gs=2 cs=0 l=1 c_cookie=3816092007833800032 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc240005e70 tx=0x7fc24002f290 comp rx=0 tx=0).stop 2026-02-23T06:30:11.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.645+0000 7fc24b577640 1 -- 10.20.193.58:0/3945537867 shutdown_connections 2026-02-23T06:30:11.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.645+0000 7fc24b577640 1 --2- 10.20.193.58:0/3945537867 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc24c056550 0x7fc24c05ce30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.645+0000 7fc24b577640 1 --2- 10.20.193.58:0/3945537867 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc24c15c040 0x7fc24c05b0e0 unknown :-1 s=CLOSED pgs=7 gs=2 cs=0 l=1 c_cookie=3816092007833800032 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.645+0000 7fc24b577640 1 -- 10.20.193.58:0/3945537867 >> 10.20.193.58:0/3945537867 conn(0x7fc24c0b3c20 msgr2=0x7fc24c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:30:11.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.645+0000 7fc24b577640 1 -- 10.20.193.58:0/3945537867 shutdown_connections 2026-02-23T06:30:11.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.645+0000 7fc24b577640 1 -- 10.20.193.58:0/3945537867 wait complete. 2026-02-23T06:30:11.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.646+0000 7fc24b577640 1 Processor -- start 2026-02-23T06:30:11.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.647+0000 7fc24b577640 1 -- start start 2026-02-23T06:30:11.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.647+0000 7fc24b577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc24c056550 0x7fc24c1fd6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:11.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.647+0000 7fc24b577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc24c05d370 0x7fc24c0b1160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:11.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.647+0000 7fc24b577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc24c15c040 0x7fc24c15f4e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:11.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.647+0000 7fc24b577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc24c2010f0 con 0x7fc24c05d370 2026-02-23T06:30:11.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.647+0000 7fc24b577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc24c1fdd30 con 0x7fc24c15c040 2026-02-23T06:30:11.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.647+0000 7fc24b577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc24c1fe010 con 0x7fc24c056550 2026-02-23T06:30:11.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.647+0000 7fc249d74640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc24c05d370 0x7fc24c0b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:11.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.647+0000 7fc249d74640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc24c05d370 0x7fc24c0b1160 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:33154/0 (socket says 10.20.193.58:33154) 2026-02-23T06:30:11.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.647+0000 7fc249d74640 1 -- 10.20.193.58:0/391693678 learned_addr learned my addr 10.20.193.58:0/391693678 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:30:11.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.647+0000 7fc24a575640 1 --2- 10.20.193.58:0/391693678 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc24c056550 0x7fc24c1fd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:11.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.648+0000 7fc24ad76640 1 --2- 10.20.193.58:0/391693678 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc24c15c040 0x7fc24c15f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:11.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.648+0000 7fc249d74640 1 -- 10.20.193.58:0/391693678 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc24c056550 msgr2=0x7fc24c1fd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:11.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.648+0000 7fc249d74640 1 --2- 10.20.193.58:0/391693678 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc24c056550 0x7fc24c1fd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.648+0000 7fc249d74640 1 -- 10.20.193.58:0/391693678 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc24c15c040 msgr2=0x7fc24c15f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:11.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.648+0000 7fc249d74640 1 --2- 10.20.193.58:0/391693678 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc24c15c040 0x7fc24c15f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.648+0000 7fc249d74640 1 -- 10.20.193.58:0/391693678 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc240009570 con 0x7fc24c05d370 2026-02-23T06:30:11.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.648+0000 7fc249d74640 1 --2- 10.20.193.58:0/391693678 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc24c05d370 0x7fc24c0b1160 secure :-1 s=READY pgs=8 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc234005db0 tx=0x7fc23400ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:11.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.648+0000 7fc232ffd640 1 -- 10.20.193.58:0/391693678 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc234004540 con 0x7fc24c05d370 2026-02-23T06:30:11.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.648+0000 7fc232ffd640 1 -- 10.20.193.58:0/391693678 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc234009910 con 0x7fc24c05d370 2026-02-23T06:30:11.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.648+0000 7fc24b577640 1 -- 10.20.193.58:0/391693678 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc24c1fe2f0 con 0x7fc24c05d370 2026-02-23T06:30:11.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.648+0000 7fc232ffd640 1 -- 10.20.193.58:0/391693678 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc234009d20 con 0x7fc24c05d370 2026-02-23T06:30:11.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.648+0000 7fc24b577640 1 -- 10.20.193.58:0/391693678 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc24c1febe0 con 0x7fc24c05d370 2026-02-23T06:30:11.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.649+0000 7fc24b577640 1 --2- 10.20.193.58:0/391693678 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc24c161da0 0x7fc24c156320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:11.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.649+0000 7fc24b577640 1 -- 10.20.193.58:0/391693678 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc24c162170 con 0x7fc24c161da0 2026-02-23T06:30:11.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.649+0000 7fc24a575640 1 --2- 10.20.193.58:0/391693678 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc24c161da0 0x7fc24c156320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:11.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.649+0000 7fc24a575640 1 -- 10.20.193.58:0/391693678 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc24c05b620 con 0x7fc24c161da0 2026-02-23T06:30:11.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.650+0000 7fc24a575640 1 --2- 10.20.193.58:0/391693678 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc24c161da0 0x7fc24c156320 secure :-1 s=READY pgs=130 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc240004740 tx=0x7fc240005ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:11.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.650+0000 7fc232ffd640 1 -- 10.20.193.58:0/391693678 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc240002e00 con 0x7fc24c161da0 2026-02-23T06:30:11.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.650+0000 7fc232ffd640 1 -- 10.20.193.58:0/391693678 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fc240038470 con 0x7fc24c161da0 2026-02-23T06:30:11.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.650+0000 7fc232ffd640 1 -- 10.20.193.58:0/391693678 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc24c161da0 msgr2=0x7fc24c156320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:11.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.650+0000 7fc232ffd640 1 --2- 10.20.193.58:0/391693678 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc24c161da0 0x7fc24c156320 secure :-1 s=READY pgs=130 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc240004740 tx=0x7fc240005ca0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.650+0000 7fc232ffd640 1 -- 10.20.193.58:0/391693678 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc24c161da0 msgr2=0x7fc24c156320 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:30:11.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.650+0000 7fc232ffd640 1 --2- 10.20.193.58:0/391693678 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc24c161da0 0x7fc24c156320 secure :-1 s=CLOSED pgs=130 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc240004740 tx=0x7fc240005ca0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.650+0000 7fc232ffd640 1 -- 10.20.193.58:0/391693678 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fc2340026a0 con 0x7fc24c05d370 2026-02-23T06:30:11.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.651+0000 7fc232ffd640 1 --2- 10.20.193.58:0/391693678 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc21807a430 0x7fc21809a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:11.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.651+0000 7fc232ffd640 1 -- 10.20.193.58:0/391693678 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fc23409dfa0 con 0x7fc24c05d370 2026-02-23T06:30:11.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.652+0000 7fc24a575640 1 --2- 10.20.193.58:0/391693678 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc21807a430 0x7fc21809a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:11.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.653+0000 7fc24a575640 1 --2- 10.20.193.58:0/391693678 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc21807a430 0x7fc21809a8e0 secure :-1 s=READY pgs=257 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc240004740 tx=0x7fc24003a030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:11.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.654+0000 7fc24b577640 1 --2- 10.20.193.58:0/391693678 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc24c156860 0x7fc24c156c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:11.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.654+0000 7fc24b577640 1 -- 10.20.193.58:0/391693678 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc24c200f20 con 0x7fc24c156860 2026-02-23T06:30:11.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.654+0000 7fc24ad76640 1 --2- 10.20.193.58:0/391693678 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc24c156860 0x7fc24c156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:11.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.654+0000 7fc24ad76640 1 -- 10.20.193.58:0/391693678 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc24c201260 con 0x7fc24c156860 2026-02-23T06:30:11.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.655+0000 7fc24ad76640 1 --2- 10.20.193.58:0/391693678 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc24c156860 0x7fc24c156c30 secure :-1 s=READY pgs=131 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc23c003810 tx=0x7fc23c00fba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:11.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.655+0000 7fc232ffd640 1 -- 10.20.193.58:0/391693678 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc23c018070 con 0x7fc24c156860 2026-02-23T06:30:11.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.655+0000 7fc232ffd640 1 -- 10.20.193.58:0/391693678 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5245 (secure 0 0 0) 0x7fc23c003cc0 con 0x7fc24c156860 2026-02-23T06:30:11.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.655+0000 7fc232ffd640 1 -- 10.20.193.58:0/391693678 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc24c156860 msgr2=0x7fc24c156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:11.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.655+0000 7fc232ffd640 1 --2- 10.20.193.58:0/391693678 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc24c156860 0x7fc24c156c30 secure :-1 s=READY pgs=131 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc23c003810 tx=0x7fc23c00fba0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.655+0000 7fc232ffd640 1 -- 10.20.193.58:0/391693678 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc24c156860 msgr2=0x7fc24c156c30 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:30:11.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.655+0000 7fc232ffd640 1 --2- 10.20.193.58:0/391693678 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc24c156860 0x7fc24c156c30 secure :-1 s=CLOSED pgs=131 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc23c003810 tx=0x7fc23c00fba0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.650 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:30:11.650 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:30:11.650 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:30:11.650 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:30:11.650 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 76, 2026-02-23T06:30:11.650 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 213167, 2026-02-23T06:30:11.650 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:30:11.650 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:30:11.650 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:30:11.650 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:30:11.650 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:11.650 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:30:11.650 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:30:11.650 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:30:11.650 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:30:11.650 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:30:11.650 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:30:11.650 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:30:11.650 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:30:11.650 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:30:11.651 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:30:11.652 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:11.653 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:30:11.654 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:30:11.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.655+0000 7fc24b577640 1 -- 10.20.193.58:0/391693678 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc21807a430 msgr2=0x7fc21809a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:11.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.655+0000 7fc24b577640 1 --2- 10.20.193.58:0/391693678 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc21807a430 0x7fc21809a8e0 secure :-1 s=READY pgs=257 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc240004740 tx=0x7fc24003a030 comp rx=0 tx=0).stop 2026-02-23T06:30:11.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.655+0000 7fc24b577640 1 -- 10.20.193.58:0/391693678 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc24c05d370 msgr2=0x7fc24c0b1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:11.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.655+0000 7fc24b577640 1 --2- 10.20.193.58:0/391693678 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc24c05d370 0x7fc24c0b1160 secure :-1 s=READY pgs=8 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc234005db0 tx=0x7fc23400ddf0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.655+0000 7fc24ad76640 1 -- 10.20.193.58:0/391693678 reap_dead start 2026-02-23T06:30:11.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.655+0000 7fc24b577640 1 -- 10.20.193.58:0/391693678 shutdown_connections 2026-02-23T06:30:11.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.655+0000 7fc24b577640 1 -- 10.20.193.58:0/391693678 >> 10.20.193.58:0/391693678 conn(0x7fc24c0b3c20 msgr2=0x7fc24c0b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:30:11.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.655+0000 7fc24b577640 1 -- 10.20.193.58:0/391693678 shutdown_connections 2026-02-23T06:30:11.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.655+0000 7fc24b577640 1 -- 10.20.193.58:0/391693678 wait complete. 2026-02-23T06:30:11.657 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:30:11.657 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:30:11.657 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:30:11.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.783+0000 7efe08f64640 1 -- 10.20.193.58:0/3871842114 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efe040b5680 msgr2=0x7efe040b5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:11.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.783+0000 7efe08f64640 1 --2- 10.20.193.58:0/3871842114 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efe040b5680 0x7efe040b5ac0 secure :-1 s=READY pgs=10 gs=3 cs=0 l=1 c_cookie=7100299107170178367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe040b5010 tx=0x7efdf8030270 comp rx=0 tx=0).stop 2026-02-23T06:30:11.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.783+0000 7efe08f64640 1 -- 10.20.193.58:0/3871842114 shutdown_connections 2026-02-23T06:30:11.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.783+0000 7efe08f64640 1 --2- 10.20.193.58:0/3871842114 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efe040b5680 0x7efe040b5ac0 unknown :-1 s=CLOSED pgs=10 gs=3 cs=0 l=1 c_cookie=7100299107170178367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.783+0000 7efe08f64640 1 --2- 10.20.193.58:0/3871842114 >> v2:10.20.193.93:3300/0 conn(0x7efe0415c040 0x7efe0405b0e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.783+0000 7efe08f64640 1 -- 10.20.193.58:0/3871842114 >> 10.20.193.58:0/3871842114 conn(0x7efe040b3c20 msgr2=0x7efe040b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:30:11.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.783+0000 7efe08f64640 1 -- 10.20.193.58:0/3871842114 shutdown_connections 2026-02-23T06:30:11.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.783+0000 7efe08f64640 1 -- 10.20.193.58:0/3871842114 wait complete. 2026-02-23T06:30:11.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.784+0000 7efe08f64640 1 Processor -- start 2026-02-23T06:30:11.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.785+0000 7efe08f64640 1 -- start start 2026-02-23T06:30:11.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.785+0000 7efe08f64640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efe04056550 0x7efe041576b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:11.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.785+0000 7efe08f64640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efe040b5680 0x7efe04201600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:11.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.785+0000 7efe08f64640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efe0415c040 0x7efe04201b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:11.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.785+0000 7efe08f64640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7efe04153550 con 0x7efe0415c040 2026-02-23T06:30:11.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.785+0000 7efe08f64640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7efe0405c3a0 con 0x7efe04056550 2026-02-23T06:30:11.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.785+0000 7efe08f64640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7efe04153000 con 0x7efe040b5680 2026-02-23T06:30:11.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.785+0000 7efe037fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efe04056550 0x7efe041576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:11.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.785+0000 7efe03fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efe0415c040 0x7efe04201b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:11.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.785+0000 7efe037fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efe04056550 0x7efe041576b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:52552/0 (socket says 10.20.193.58:52552) 2026-02-23T06:30:11.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.785+0000 7efe037fe640 1 -- 10.20.193.58:0/3802018026 learned_addr learned my addr 10.20.193.58:0/3802018026 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:30:11.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.785+0000 7efe02ffd640 1 --2- 10.20.193.58:0/3802018026 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efe040b5680 0x7efe04201600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:11.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.786+0000 7efe037fe640 1 -- 10.20.193.58:0/3802018026 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efe040b5680 msgr2=0x7efe04201600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:11.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.786+0000 7efe037fe640 1 --2- 10.20.193.58:0/3802018026 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efe040b5680 0x7efe04201600 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.786+0000 7efe037fe640 1 -- 10.20.193.58:0/3802018026 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efe0415c040 msgr2=0x7efe04201b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:11.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.786+0000 7efe037fe640 1 --2- 10.20.193.58:0/3802018026 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efe0415c040 0x7efe04201b40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.786+0000 7efe037fe640 1 -- 10.20.193.58:0/3802018026 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf800a590 con 0x7efe04056550 2026-02-23T06:30:11.782 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.786+0000 7efe037fe640 1 --2- 10.20.193.58:0/3802018026 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efe04056550 0x7efe041576b0 secure :-1 s=READY pgs=132 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdf000e9f0 tx=0x7efdf000eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:11.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.786+0000 7efddffff640 1 -- 10.20.193.58:0/3802018026 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efdf000cda0 con 0x7efe04056550 2026-02-23T06:30:11.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.786+0000 7efe08f64640 1 -- 10.20.193.58:0/3802018026 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe04153740 con 0x7efe04056550 2026-02-23T06:30:11.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.786+0000 7efddffff640 1 -- 10.20.193.58:0/3802018026 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efdf0004850 con 0x7efe04056550 2026-02-23T06:30:11.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.786+0000 7efddffff640 1 -- 10.20.193.58:0/3802018026 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efdf0004c60 con 0x7efe04056550 2026-02-23T06:30:11.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.786+0000 7efe08f64640 1 -- 10.20.193.58:0/3802018026 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe04161ca0 con 0x7efe04056550 2026-02-23T06:30:11.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.787+0000 7efe08f64640 1 --2- 10.20.193.58:0/3802018026 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efe0415f820 0x7efe04161ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:11.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.787+0000 7efe08f64640 1 -- 10.20.193.58:0/3802018026 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7efe040594c0 con 0x7efe0415f820 2026-02-23T06:30:11.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.787+0000 7efe02ffd640 1 --2- 10.20.193.58:0/3802018026 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efe0415f820 0x7efe04161ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:11.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.787+0000 7efe02ffd640 1 -- 10.20.193.58:0/3802018026 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efe0405b620 con 0x7efe0415f820 2026-02-23T06:30:11.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.787+0000 7efe02ffd640 1 --2- 10.20.193.58:0/3802018026 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efe0415f820 0x7efe04161ec0 secure :-1 s=READY pgs=146 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdf40027d0 tx=0x7efdf400eba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:11.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.788+0000 7efddffff640 1 -- 10.20.193.58:0/3802018026 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efdf400c880 con 0x7efe0415f820 2026-02-23T06:30:11.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.788+0000 7efddffff640 1 -- 10.20.193.58:0/3802018026 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7efdf400c9e0 con 0x7efe0415f820 2026-02-23T06:30:11.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.788+0000 7efddffff640 1 -- 10.20.193.58:0/3802018026 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efe0415f820 msgr2=0x7efe04161ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:11.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.788+0000 7efddffff640 1 --2- 10.20.193.58:0/3802018026 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efe0415f820 0x7efe04161ec0 secure :-1 s=READY pgs=146 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdf40027d0 tx=0x7efdf400eba0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.788+0000 7efddffff640 1 -- 10.20.193.58:0/3802018026 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efe0415f820 msgr2=0x7efe04161ec0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:30:11.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.788+0000 7efddffff640 1 --2- 10.20.193.58:0/3802018026 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efe0415f820 0x7efe04161ec0 unknown :-1 s=CLOSED pgs=146 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.788+0000 7efddffff640 1 -- 10.20.193.58:0/3802018026 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7efdf001f060 con 0x7efe04056550 2026-02-23T06:30:11.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.789+0000 7efddffff640 1 --2- 10.20.193.58:0/3802018026 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efdd407a3c0 0x7efdd409a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:11.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.789+0000 7efddffff640 1 -- 10.20.193.58:0/3802018026 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7efdf0014070 con 0x7efe04056550 2026-02-23T06:30:11.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.789+0000 7efe02ffd640 1 --2- 10.20.193.58:0/3802018026 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efdd407a3c0 0x7efdd409a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:11.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.790+0000 7efe02ffd640 1 --2- 10.20.193.58:0/3802018026 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efdd407a3c0 0x7efdd409a870 secure :-1 s=READY pgs=258 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdf40027d0 tx=0x7efdf4014000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:11.786 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.791+0000 7efe08f64640 1 --2- 10.20.193.58:0/3802018026 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efe041617a0 0x7efe04124e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:11.786 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.791+0000 7efe08f64640 1 -- 10.20.193.58:0/3802018026 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7efe04166120 con 0x7efe041617a0 2026-02-23T06:30:11.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.792+0000 7efe03fff640 1 --2- 10.20.193.58:0/3802018026 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efe041617a0 0x7efe04124e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:11.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.792+0000 7efe03fff640 1 -- 10.20.193.58:0/3802018026 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efe0415c410 con 0x7efe041617a0 2026-02-23T06:30:11.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.792+0000 7efe03fff640 1 --2- 10.20.193.58:0/3802018026 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efe041617a0 0x7efe04124e40 secure :-1 s=READY pgs=147 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdf80307a0 tx=0x7efdf8003d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:11.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.792+0000 7efddffff640 1 -- 10.20.193.58:0/3802018026 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efdf803e050 con 0x7efe041617a0 2026-02-23T06:30:11.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.793+0000 7efddffff640 1 -- 10.20.193.58:0/3802018026 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5555 (secure 0 0 0) 0x7efdf803f040 con 0x7efe041617a0 2026-02-23T06:30:11.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.793+0000 7efddffff640 1 -- 10.20.193.58:0/3802018026 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efe041617a0 msgr2=0x7efe04124e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:11.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.793+0000 7efddffff640 1 --2- 10.20.193.58:0/3802018026 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efe041617a0 0x7efe04124e40 secure :-1 s=READY pgs=147 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdf80307a0 tx=0x7efdf8003d20 comp rx=0 tx=0).stop 2026-02-23T06:30:11.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.793+0000 7efddffff640 1 -- 10.20.193.58:0/3802018026 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efe041617a0 msgr2=0x7efe04124e40 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:30:11.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.793+0000 7efddffff640 1 --2- 10.20.193.58:0/3802018026 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efe041617a0 0x7efe04124e40 secure :-1 s=CLOSED pgs=147 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdf80307a0 tx=0x7efdf8003d20 comp rx=0 tx=0).stop 2026-02-23T06:30:11.788 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:30:11.788 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:30:11.788 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:30:11.788 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:30:11.788 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 76, 2026-02-23T06:30:11.788 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 286304, 2026-02-23T06:30:11.788 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:30:11.789 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:30:11.789 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:30:11.789 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:30:11.789 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:11.789 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:30:11.789 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:30:11.789 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:30:11.789 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:30:11.789 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:30:11.789 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:30:11.789 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:30:11.789 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:30:11.789 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:30:11.789 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:30:11.789 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:30:11.789 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:30:11.789 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:30:11.789 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:30:11.789 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:30:11.789 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:30:11.790 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:30:11.790 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:11.790 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:30:11.790 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:30:11.790 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:30:11.790 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:30:11.790 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:30:11.790 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:30:11.790 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:30:11.790 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:30:11.790 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:30:11.790 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:30:11.790 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:30:11.790 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:30:11.790 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:30:11.790 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:30:11.790 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:30:11.790 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:11.790 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.790 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:30:11.790 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:30:11.791 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:30:11.791 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:30:11.791 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:30:11.791 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:30:11.791 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:30:11.791 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:30:11.791 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:30:11.791 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:30:11.791 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:30:11.791 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:30:11.791 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:30:11.791 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:30:11.791 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:30:11.791 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:30:11.791 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:30:11.791 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:30:11.791 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:30:11.791 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:30:11.791 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:30:11.791 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:30:11.791 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:30:11.792 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:30:11.792 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:30:11.792 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:30:11.792 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:30:11.792 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:30:11.792 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:30:11.792 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:30:11.792 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:11.792 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:30:11.792 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.792 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:30:11.792 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.792 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:30:11.792 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:30:11.792 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:30:11.792 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:30:11.792 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.792 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:30:11.792 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:30:11.792 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:11.792 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.792 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.792 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:30:11.793 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:30:11.793 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:11.793 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:11.793 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:11.793 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.793 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:30:11.793 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:30:11.793 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:30:11.793 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:30:11.793 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:30:11.793 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:30:11.793 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.793 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.793 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:30:11.793 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:30:11.793 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:30:11.793 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:30:11.793 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.793 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:30:11.793 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:30:11.793 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:11.793 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.794 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.794 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:30:11.794 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:30:11.794 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:11.794 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:11.794 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:11.794 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.794 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:30:11.794 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:30:11.794 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:30:11.794 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:30:11.794 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:30:11.794 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:30:11.794 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.794 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.794 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:30:11.794 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:30:11.794 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:30:11.794 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:30:11.794 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.794 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:30:11.794 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:30:11.794 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:11.794 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.795 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.795 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:30:11.795 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:30:11.795 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:11.795 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:11.795 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:11.795 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.795 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:30:11.795 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:30:11.795 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:30:11.795 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:30:11.795 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:30:11.795 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:30:11.795 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:11.795 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:11.795 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.795 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:30:11.795 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:30:11.795 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.795 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:11.795 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:11.795 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:30:11.795 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:11.795 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:11.796 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:30:11.796 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.796 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:11.796 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:11.796 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:30:11.796 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:11.796 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:11.796 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:30:11.796 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.796 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:11.796 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:11.796 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:30:11.796 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:11.796 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:11.796 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:30:11.796 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.796 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:30:11.796 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:30:11.796 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:30:11.796 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.796 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.796 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:11.796 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:11.796 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:30:11.797 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:11.797 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:11.797 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:30:11.797 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:11.797 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:11.797 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:11.797 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:30:11.797 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:11.797 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:11.797 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:11.797 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:30:11.797 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:30:11.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.793+0000 7efe08f64640 1 -- 10.20.193.58:0/3802018026 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efdd407a3c0 msgr2=0x7efdd409a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:11.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.793+0000 7efe08f64640 1 --2- 10.20.193.58:0/3802018026 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efdd407a3c0 0x7efdd409a870 secure :-1 s=READY pgs=258 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdf40027d0 tx=0x7efdf4014000 comp rx=0 tx=0).stop 2026-02-23T06:30:11.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.793+0000 7efe08f64640 1 -- 10.20.193.58:0/3802018026 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efe04056550 msgr2=0x7efe041576b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:11.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.793+0000 7efe08f64640 1 --2- 10.20.193.58:0/3802018026 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efe04056550 0x7efe041576b0 secure :-1 s=READY pgs=132 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdf000e9f0 tx=0x7efdf000eec0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.793+0000 7efe03fff640 1 -- 10.20.193.58:0/3802018026 reap_dead start 2026-02-23T06:30:11.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.793+0000 7efe08f64640 1 -- 10.20.193.58:0/3802018026 shutdown_connections 2026-02-23T06:30:11.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.793+0000 7efe08f64640 1 --2- 10.20.193.58:0/3802018026 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efe04056550 0x7efe041576b0 unknown :-1 s=CLOSED pgs=132 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.793+0000 7efe08f64640 1 -- 10.20.193.58:0/3802018026 >> 10.20.193.58:0/3802018026 conn(0x7efe040b3c20 msgr2=0x7efe0415a930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:30:11.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.793+0000 7efe08f64640 1 -- 10.20.193.58:0/3802018026 shutdown_connections 2026-02-23T06:30:11.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.793+0000 7efe08f64640 1 -- 10.20.193.58:0/3802018026 wait complete. 2026-02-23T06:30:11.799 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:30:11.799 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:30:11.799 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:30:11.925 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.930+0000 7fe501c43640 1 -- 10.20.193.58:0/9781979 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe4fc15d870 msgr2=0x7fe4fc0587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:11.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.930+0000 7fe501c43640 1 --2- 10.20.193.58:0/9781979 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe4fc15d870 0x7fe4fc0587b0 secure :-1 s=READY pgs=11 gs=2 cs=0 l=1 c_cookie=2494601490393803856 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4fc0b5040 tx=0x7fe4e402f190 comp rx=0 tx=0).stop 2026-02-23T06:30:11.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.930+0000 7fe501c43640 1 -- 10.20.193.58:0/9781979 shutdown_connections 2026-02-23T06:30:11.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.930+0000 7fe501c43640 1 --2- 10.20.193.58:0/9781979 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe4fc15d870 0x7fe4fc0587b0 unknown :-1 s=CLOSED pgs=11 gs=2 cs=0 l=1 c_cookie=2494601490393803856 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.930+0000 7fe501c43640 1 --2- 10.20.193.58:0/9781979 >> v2:10.20.193.93:3300/0 conn(0x7fe4fc15d4a0 0x7fe4fc0affb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.930+0000 7fe501c43640 1 -- 10.20.193.58:0/9781979 >> 10.20.193.58:0/9781979 conn(0x7fe4fc0b3c20 msgr2=0x7fe4fc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:30:11.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.930+0000 7fe501c43640 1 -- 10.20.193.58:0/9781979 shutdown_connections 2026-02-23T06:30:11.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.930+0000 7fe501c43640 1 -- 10.20.193.58:0/9781979 wait complete. 2026-02-23T06:30:11.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.931+0000 7fe501c43640 1 Processor -- start 2026-02-23T06:30:11.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.931+0000 7fe501c43640 1 -- start start 2026-02-23T06:30:11.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.932+0000 7fe501c43640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe4fc0b6690 0x7fe4fc13e400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:11.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.932+0000 7fe501c43640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe4fc15d4a0 0x7fe4fc160f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:11.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.932+0000 7fe501c43640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe4fc15d870 0x7fe4fc127890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:11.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.932+0000 7fe501c43640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe4fc162eb0 con 0x7fe4fc15d4a0 2026-02-23T06:30:11.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.932+0000 7fe501c43640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe4fc124e20 con 0x7fe4fc0b6690 2026-02-23T06:30:11.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.932+0000 7fe501c43640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe4fc058fc0 con 0x7fe4fc15d870 2026-02-23T06:30:11.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.932+0000 7fe500c41640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe4fc0b6690 0x7fe4fc13e400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:11.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.932+0000 7fe4f3fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe4fc15d4a0 0x7fe4fc160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:11.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.932+0000 7fe500c41640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe4fc0b6690 0x7fe4fc13e400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:52570/0 (socket says 10.20.193.58:52570) 2026-02-23T06:30:11.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.932+0000 7fe500c41640 1 -- 10.20.193.58:0/1322792895 learned_addr learned my addr 10.20.193.58:0/1322792895 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:30:11.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.932+0000 7fe4f3fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe4fc15d4a0 0x7fe4fc160f90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:33182/0 (socket says 10.20.193.58:33182) 2026-02-23T06:30:11.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.932+0000 7fe501442640 1 --2- 10.20.193.58:0/1322792895 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe4fc15d870 0x7fe4fc127890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:11.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.932+0000 7fe4f3fff640 1 -- 10.20.193.58:0/1322792895 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe4fc15d870 msgr2=0x7fe4fc127890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:11.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.932+0000 7fe4f3fff640 1 --2- 10.20.193.58:0/1322792895 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe4fc15d870 0x7fe4fc127890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.932+0000 7fe4f3fff640 1 -- 10.20.193.58:0/1322792895 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe4fc0b6690 msgr2=0x7fe4fc13e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:11.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.932+0000 7fe4f3fff640 1 --2- 10.20.193.58:0/1322792895 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe4fc0b6690 0x7fe4fc13e400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:11.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.932+0000 7fe4f3fff640 1 -- 10.20.193.58:0/1322792895 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e40094b0 con 0x7fe4fc15d4a0 2026-02-23T06:30:11.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.932+0000 7fe4f3fff640 1 --2- 10.20.193.58:0/1322792895 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe4fc15d4a0 0x7fe4fc160f90 secure :-1 s=READY pgs=12 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4e4009230 tx=0x7fe4e4002950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:11.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.933+0000 7fe4f17fa640 1 -- 10.20.193.58:0/1322792895 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4e4038470 con 0x7fe4fc15d4a0 2026-02-23T06:30:11.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.933+0000 7fe4f17fa640 1 -- 10.20.193.58:0/1322792895 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4e40386c0 con 0x7fe4fc15d4a0 2026-02-23T06:30:11.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.933+0000 7fe4f17fa640 1 -- 10.20.193.58:0/1322792895 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4e4038a90 con 0x7fe4fc15d4a0 2026-02-23T06:30:11.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.933+0000 7fe501c43640 1 -- 10.20.193.58:0/1322792895 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4fc1252b0 con 0x7fe4fc15d4a0 2026-02-23T06:30:11.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.933+0000 7fe501c43640 1 -- 10.20.193.58:0/1322792895 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4fc162bd0 con 0x7fe4fc15d4a0 2026-02-23T06:30:11.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.933+0000 7fe501c43640 1 -- 10.20.193.58:0/1322792895 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4fc0b6d50 con 0x7fe4fc15d4a0 2026-02-23T06:30:11.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.934+0000 7fe4f17fa640 1 -- 10.20.193.58:0/1322792895 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fe4e4038bf0 con 0x7fe4fc15d4a0 2026-02-23T06:30:11.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.935+0000 7fe4f17fa640 1 --2- 10.20.193.58:0/1322792895 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe4cc07a6c0 0x7fe4cc09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:11.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.935+0000 7fe4f17fa640 1 -- 10.20.193.58:0/1322792895 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fe4e40c28d0 con 0x7fe4fc15d4a0 2026-02-23T06:30:11.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.936+0000 7fe500c41640 1 --2- 10.20.193.58:0/1322792895 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe4cc07a6c0 0x7fe4cc09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:11.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.936+0000 7fe500c41640 1 --2- 10.20.193.58:0/1322792895 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe4cc07a6c0 0x7fe4cc09ab70 secure :-1 s=READY pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4ec0097c0 tx=0x7fe4ec009310 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:11.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:11.938+0000 7fe4f17fa640 1 -- 10.20.193.58:0/1322792895 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fe4e4085b90 con 0x7fe4fc15d4a0 2026-02-23T06:30:12.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:12.092+0000 7fe501c43640 1 -- 10.20.193.58:0/1322792895 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fe4fc05b0e0 con 0x7fe4fc15d4a0 2026-02-23T06:30:12.088 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:12.092+0000 7fe4f17fa640 1 -- 10.20.193.58:0/1322792895 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fe4e4088cb0 con 0x7fe4fc15d4a0 2026-02-23T06:30:12.089 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:12.094+0000 7fe501c43640 1 -- 10.20.193.58:0/1322792895 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe4cc07a6c0 msgr2=0x7fe4cc09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:12.089 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:12.094+0000 7fe501c43640 1 --2- 10.20.193.58:0/1322792895 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe4cc07a6c0 0x7fe4cc09ab70 secure :-1 s=READY pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4ec0097c0 tx=0x7fe4ec009310 comp rx=0 tx=0).stop 2026-02-23T06:30:12.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:12.094+0000 7fe501c43640 1 -- 10.20.193.58:0/1322792895 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe4fc15d4a0 msgr2=0x7fe4fc160f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:12.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:12.094+0000 7fe501c43640 1 --2- 10.20.193.58:0/1322792895 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe4fc15d4a0 0x7fe4fc160f90 secure :-1 s=READY pgs=12 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4e4009230 tx=0x7fe4e4002950 comp rx=0 tx=0).stop 2026-02-23T06:30:12.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:12.094+0000 7fe501c43640 1 -- 10.20.193.58:0/1322792895 shutdown_connections 2026-02-23T06:30:12.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:12.094+0000 7fe501c43640 1 --2- 10.20.193.58:0/1322792895 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe4cc07a6c0 0x7fe4cc09ab70 unknown :-1 s=CLOSED pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:12.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:12.094+0000 7fe501c43640 1 --2- 10.20.193.58:0/1322792895 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe4fc15d870 0x7fe4fc127890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:12.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:12.094+0000 7fe501c43640 1 --2- 10.20.193.58:0/1322792895 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe4fc15d4a0 0x7fe4fc160f90 unknown :-1 s=CLOSED pgs=12 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:12.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:12.094+0000 7fe501c43640 1 --2- 10.20.193.58:0/1322792895 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe4fc0b6690 0x7fe4fc13e400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:12.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:12.094+0000 7fe501c43640 1 -- 10.20.193.58:0/1322792895 >> 10.20.193.58:0/1322792895 conn(0x7fe4fc0b3c20 msgr2=0x7fe4fc13ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:30:12.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:12.094+0000 7fe501c43640 1 -- 10.20.193.58:0/1322792895 shutdown_connections 2026-02-23T06:30:12.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:12.094+0000 7fe501c43640 1 -- 10.20.193.58:0/1322792895 wait complete. 2026-02-23T06:30:12.101 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:30:12.881 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:30:12.887 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:30:22.102 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:30:22.103 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:30:22.225 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.230+0000 7faa9edd2640 1 -- 10.20.193.58:0/1241127202 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa980576d0 msgr2=0x7faa98058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:22.225 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.230+0000 7faa9edd2640 1 --2- 10.20.193.58:0/1241127202 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa980576d0 0x7faa98058200 secure :-1 s=READY pgs=14 gs=3 cs=0 l=1 c_cookie=720682161724443484 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa94005820 tx=0x7faa94030300 comp rx=0 tx=0).stop 2026-02-23T06:30:22.225 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.230+0000 7faa9edd2640 1 -- 10.20.193.58:0/1241127202 shutdown_connections 2026-02-23T06:30:22.225 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.230+0000 7faa9edd2640 1 --2- 10.20.193.58:0/1241127202 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa980576d0 0x7faa98058200 unknown :-1 s=CLOSED pgs=14 gs=3 cs=0 l=1 c_cookie=720682161724443484 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.226 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.230+0000 7faa9edd2640 1 -- 10.20.193.58:0/1241127202 >> 10.20.193.58:0/1241127202 conn(0x7faa980b3c20 msgr2=0x7faa980b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:30:22.226 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.230+0000 7faa9edd2640 1 -- 10.20.193.58:0/1241127202 shutdown_connections 2026-02-23T06:30:22.226 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.230+0000 7faa9edd2640 1 -- 10.20.193.58:0/1241127202 wait complete. 2026-02-23T06:30:22.226 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.231+0000 7faa9edd2640 1 Processor -- start 2026-02-23T06:30:22.226 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.231+0000 7faa9edd2640 1 -- start start 2026-02-23T06:30:22.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.232+0000 7faa9edd2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa98056960 0x7faa9815ef40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:22.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.232+0000 7faa9edd2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa980576d0 0x7faa98159540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:22.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.232+0000 7faa9edd2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa9815c4b0 0x7faa981fe9a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:22.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.232+0000 7faa9edd2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7faa9815fee0 con 0x7faa980576d0 2026-02-23T06:30:22.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.232+0000 7faa9edd2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7faa9815f480 con 0x7faa98056960 2026-02-23T06:30:22.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.232+0000 7faa9edd2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7faa981fb3b0 con 0x7faa9815c4b0 2026-02-23T06:30:22.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.232+0000 7faa9d5cf640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa980576d0 0x7faa98159540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:22.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.232+0000 7faa9d5cf640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa980576d0 0x7faa98159540 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:33994/0 (socket says 10.20.193.58:33994) 2026-02-23T06:30:22.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.232+0000 7faa9ddd0640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa98056960 0x7faa9815ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:22.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.232+0000 7faa9d5cf640 1 -- 10.20.193.58:0/1661627455 learned_addr learned my addr 10.20.193.58:0/1661627455 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:30:22.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.232+0000 7faa9e5d1640 1 --2- 10.20.193.58:0/1661627455 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa9815c4b0 0x7faa981fe9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:22.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.232+0000 7faa9d5cf640 1 -- 10.20.193.58:0/1661627455 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa9815c4b0 msgr2=0x7faa981fe9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:22.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.232+0000 7faa9d5cf640 1 --2- 10.20.193.58:0/1661627455 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa9815c4b0 0x7faa981fe9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.232+0000 7faa9d5cf640 1 -- 10.20.193.58:0/1661627455 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa98056960 msgr2=0x7faa9815ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:22.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.232+0000 7faa9d5cf640 1 --2- 10.20.193.58:0/1661627455 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa98056960 0x7faa9815ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.232+0000 7faa9d5cf640 1 -- 10.20.193.58:0/1661627455 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa9400a590 con 0x7faa980576d0 2026-02-23T06:30:22.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.233+0000 7faa9d5cf640 1 --2- 10.20.193.58:0/1661627455 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa980576d0 0x7faa98159540 secure :-1 s=READY pgs=15 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa8c00c4b0 tx=0x7faa8c00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:22.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.233+0000 7faa867fc640 1 -- 10.20.193.58:0/1661627455 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa8c006ab0 con 0x7faa980576d0 2026-02-23T06:30:22.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.233+0000 7faa867fc640 1 -- 10.20.193.58:0/1661627455 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa8c006d00 con 0x7faa980576d0 2026-02-23T06:30:22.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.233+0000 7faa9edd2640 1 -- 10.20.193.58:0/1661627455 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa981fbef0 con 0x7faa980576d0 2026-02-23T06:30:22.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.233+0000 7faa867fc640 1 -- 10.20.193.58:0/1661627455 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa8c0072b0 con 0x7faa980576d0 2026-02-23T06:30:22.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.233+0000 7faa9edd2640 1 -- 10.20.193.58:0/1661627455 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa98160910 con 0x7faa980576d0 2026-02-23T06:30:22.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.234+0000 7faa9edd2640 1 -- 10.20.193.58:0/1661627455 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa64005300 con 0x7faa980576d0 2026-02-23T06:30:22.230 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.235+0000 7faa867fc640 1 -- 10.20.193.58:0/1661627455 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7faa8c019070 con 0x7faa980576d0 2026-02-23T06:30:22.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.236+0000 7faa867fc640 1 --2- 10.20.193.58:0/1661627455 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa6807a640 0x7faa6809aaf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:22.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.236+0000 7faa867fc640 1 -- 10.20.193.58:0/1661627455 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7faa8c09d380 con 0x7faa980576d0 2026-02-23T06:30:22.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.236+0000 7faa9ddd0640 1 --2- 10.20.193.58:0/1661627455 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa6807a640 0x7faa6809aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:22.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.237+0000 7faa9ddd0640 1 --2- 10.20.193.58:0/1661627455 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa6807a640 0x7faa6809aaf0 secure :-1 s=READY pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa88004770 tx=0x7faa88007db0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:22.233 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.238+0000 7faa867fc640 1 -- 10.20.193.58:0/1661627455 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7faa8c060520 con 0x7faa980576d0 2026-02-23T06:30:22.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.392+0000 7faa9edd2640 1 -- 10.20.193.58:0/1661627455 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7faa64005b30 con 0x7faa980576d0 2026-02-23T06:30:22.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.392+0000 7faa867fc640 1 -- 10.20.193.58:0/1661627455 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7faa8c063640 con 0x7faa980576d0 2026-02-23T06:30:22.387 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":76,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:30:22.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.393+0000 7faa9edd2640 1 -- 10.20.193.58:0/1661627455 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa6807a640 msgr2=0x7faa6809aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:22.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.393+0000 7faa9edd2640 1 --2- 10.20.193.58:0/1661627455 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa6807a640 0x7faa6809aaf0 secure :-1 s=READY pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa88004770 tx=0x7faa88007db0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.393+0000 7faa9edd2640 1 -- 10.20.193.58:0/1661627455 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa980576d0 msgr2=0x7faa98159540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:22.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.393+0000 7faa9edd2640 1 --2- 10.20.193.58:0/1661627455 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa980576d0 0x7faa98159540 secure :-1 s=READY pgs=15 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa8c00c4b0 tx=0x7faa8c00c980 comp rx=0 tx=0).stop 2026-02-23T06:30:22.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.393+0000 7faa9edd2640 1 -- 10.20.193.58:0/1661627455 shutdown_connections 2026-02-23T06:30:22.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.393+0000 7faa9edd2640 1 --2- 10.20.193.58:0/1661627455 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa6807a640 0x7faa6809aaf0 unknown :-1 s=CLOSED pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.393+0000 7faa9edd2640 1 --2- 10.20.193.58:0/1661627455 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa9815c4b0 0x7faa981fe9a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.393+0000 7faa9edd2640 1 --2- 10.20.193.58:0/1661627455 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa980576d0 0x7faa98159540 unknown :-1 s=CLOSED pgs=15 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.393+0000 7faa9edd2640 1 --2- 10.20.193.58:0/1661627455 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa98056960 0x7faa9815ef40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.393+0000 7faa9edd2640 1 -- 10.20.193.58:0/1661627455 >> 10.20.193.58:0/1661627455 conn(0x7faa980b3c20 msgr2=0x7faa980b5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:30:22.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.393+0000 7faa9edd2640 1 -- 10.20.193.58:0/1661627455 shutdown_connections 2026-02-23T06:30:22.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.394+0000 7faa9edd2640 1 -- 10.20.193.58:0/1661627455 wait complete. 2026-02-23T06:30:22.400 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:30:22.400 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:30:22.400 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:30:22.400 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:30:22.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.527+0000 7fc4a6b75640 1 -- 10.20.193.58:0/2402181193 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc4a0162ca0 msgr2=0x7fc4a0056fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:22.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.527+0000 7fc4a6b75640 1 --2- 10.20.193.58:0/2402181193 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc4a0162ca0 0x7fc4a0056fc0 secure :-1 s=READY pgs=16 gs=3 cs=0 l=1 c_cookie=9319672867829786917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4a0059b80 tx=0x7fc49c030270 comp rx=0 tx=0).stop 2026-02-23T06:30:22.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.527+0000 7fc4a6b75640 1 -- 10.20.193.58:0/2402181193 shutdown_connections 2026-02-23T06:30:22.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.527+0000 7fc4a6b75640 1 --2- 10.20.193.58:0/2402181193 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc4a0162ca0 0x7fc4a0056fc0 unknown :-1 s=CLOSED pgs=16 gs=3 cs=0 l=1 c_cookie=9319672867829786917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.527+0000 7fc4a6b75640 1 --2- 10.20.193.58:0/2402181193 >> v2:10.20.193.93:3300/0 conn(0x7fc4a015c4b0 0x7fc4a0058200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.527+0000 7fc4a6b75640 1 -- 10.20.193.58:0/2402181193 >> 10.20.193.58:0/2402181193 conn(0x7fc4a00b3c20 msgr2=0x7fc4a00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:30:22.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.527+0000 7fc4a6b75640 1 -- 10.20.193.58:0/2402181193 shutdown_connections 2026-02-23T06:30:22.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.527+0000 7fc4a6b75640 1 -- 10.20.193.58:0/2402181193 wait complete. 2026-02-23T06:30:22.523 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.528+0000 7fc4a6b75640 1 Processor -- start 2026-02-23T06:30:22.523 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.528+0000 7fc4a6b75640 1 -- start start 2026-02-23T06:30:22.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.529+0000 7fc4a6b75640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc4a0056960 0x7fc4a01f92f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:22.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.529+0000 7fc4a6b75640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc4a015c4b0 0x7fc4a01fd100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:22.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.529+0000 7fc4a6b75640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc4a0162ca0 0x7fc4a01593a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:22.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.529+0000 7fc4a6b75640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a0166360 con 0x7fc4a015c4b0 2026-02-23T06:30:22.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.529+0000 7fc4a6b75640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a01fcce0 con 0x7fc4a0056960 2026-02-23T06:30:22.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.529+0000 7fc4a6b75640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc4a015fe80 con 0x7fc4a0162ca0 2026-02-23T06:30:22.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.529+0000 7fc4a5372640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc4a015c4b0 0x7fc4a01fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:22.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.529+0000 7fc4a5b73640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc4a0056960 0x7fc4a01f92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:22.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.529+0000 7fc4a5372640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc4a015c4b0 0x7fc4a01fd100 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:34004/0 (socket says 10.20.193.58:34004) 2026-02-23T06:30:22.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.529+0000 7fc4a5372640 1 -- 10.20.193.58:0/1613965132 learned_addr learned my addr 10.20.193.58:0/1613965132 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:30:22.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.529+0000 7fc4a6374640 1 --2- 10.20.193.58:0/1613965132 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc4a0162ca0 0x7fc4a01593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:22.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.529+0000 7fc4a5372640 1 -- 10.20.193.58:0/1613965132 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc4a0162ca0 msgr2=0x7fc4a01593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:22.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.529+0000 7fc4a5372640 1 --2- 10.20.193.58:0/1613965132 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc4a0162ca0 0x7fc4a01593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.529+0000 7fc4a5372640 1 -- 10.20.193.58:0/1613965132 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc4a0056960 msgr2=0x7fc4a01f92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:22.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.529+0000 7fc4a5372640 1 --2- 10.20.193.58:0/1613965132 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc4a0056960 0x7fc4a01f92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.529+0000 7fc4a5372640 1 -- 10.20.193.58:0/1613965132 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4900094b0 con 0x7fc4a015c4b0 2026-02-23T06:30:22.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.530+0000 7fc4a5372640 1 --2- 10.20.193.58:0/1613965132 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc4a015c4b0 0x7fc4a01fd100 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc49400c460 tx=0x7fc49400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:22.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.530+0000 7fc48e7fc640 1 -- 10.20.193.58:0/1613965132 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc494004250 con 0x7fc4a015c4b0 2026-02-23T06:30:22.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.530+0000 7fc48e7fc640 1 -- 10.20.193.58:0/1613965132 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4940044a0 con 0x7fc4a015c4b0 2026-02-23T06:30:22.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.530+0000 7fc48e7fc640 1 -- 10.20.193.58:0/1613965132 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc494003930 con 0x7fc4a015c4b0 2026-02-23T06:30:22.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.530+0000 7fc4a6b75640 1 -- 10.20.193.58:0/1613965132 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc49c00a590 con 0x7fc4a015c4b0 2026-02-23T06:30:22.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.530+0000 7fc4a6b75640 1 -- 10.20.193.58:0/1613965132 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4a01fa200 con 0x7fc4a015c4b0 2026-02-23T06:30:22.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.530+0000 7fc4a6b75640 1 --2- 10.20.193.58:0/1613965132 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc4a00b01e0 0x7fc4a013c1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:22.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.530+0000 7fc4a6b75640 1 -- 10.20.193.58:0/1613965132 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a0059690 con 0x7fc4a00b01e0 2026-02-23T06:30:22.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.530+0000 7fc4a5b73640 1 --2- 10.20.193.58:0/1613965132 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc4a00b01e0 0x7fc4a013c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:22.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.531+0000 7fc4a5b73640 1 -- 10.20.193.58:0/1613965132 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc4a00593b0 con 0x7fc4a00b01e0 2026-02-23T06:30:22.526 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.531+0000 7fc4a5b73640 1 --2- 10.20.193.58:0/1613965132 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc4a00b01e0 0x7fc4a013c1d0 secure :-1 s=READY pgs=18 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4900028d0 tx=0x7fc490002da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:22.526 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.531+0000 7fc48e7fc640 1 -- 10.20.193.58:0/1613965132 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc490009e70 con 0x7fc4a00b01e0 2026-02-23T06:30:22.526 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.531+0000 7fc48e7fc640 1 -- 10.20.193.58:0/1613965132 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fc490011c50 con 0x7fc4a00b01e0 2026-02-23T06:30:22.526 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.531+0000 7fc48e7fc640 1 -- 10.20.193.58:0/1613965132 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc4a00b01e0 msgr2=0x7fc4a013c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:22.526 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.531+0000 7fc48e7fc640 1 --2- 10.20.193.58:0/1613965132 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc4a00b01e0 0x7fc4a013c1d0 secure :-1 s=READY pgs=18 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4900028d0 tx=0x7fc490002da0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.526 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.531+0000 7fc48e7fc640 1 -- 10.20.193.58:0/1613965132 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc4a00b01e0 msgr2=0x7fc4a013c1d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:30:22.526 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.531+0000 7fc48e7fc640 1 --2- 10.20.193.58:0/1613965132 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc4a00b01e0 0x7fc4a013c1d0 secure :-1 s=CLOSED pgs=18 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4900028d0 tx=0x7fc490002da0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.527 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.532+0000 7fc48e7fc640 1 -- 10.20.193.58:0/1613965132 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fc494019070 con 0x7fc4a015c4b0 2026-02-23T06:30:22.528 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.533+0000 7fc48e7fc640 1 --2- 10.20.193.58:0/1613965132 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc47007a430 0x7fc47009a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:22.528 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.533+0000 7fc48e7fc640 1 -- 10.20.193.58:0/1613965132 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fc49409d240 con 0x7fc4a015c4b0 2026-02-23T06:30:22.528 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.534+0000 7fc4a5b73640 1 --2- 10.20.193.58:0/1613965132 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc47007a430 0x7fc47009a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:22.529 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.534+0000 7fc4a5b73640 1 --2- 10.20.193.58:0/1613965132 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc47007a430 0x7fc47009a8e0 secure :-1 s=READY pgs=261 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc490004740 tx=0x7fc49000e000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:22.531 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.535+0000 7fc4a6b75640 1 --2- 10.20.193.58:0/1613965132 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc4a013c710 0x7fc4a00aef20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:22.531 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.535+0000 7fc4a6b75640 1 -- 10.20.193.58:0/1613965132 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a01fce20 con 0x7fc4a013c710 2026-02-23T06:30:22.531 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.535+0000 7fc4a6374640 1 --2- 10.20.193.58:0/1613965132 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc4a013c710 0x7fc4a00aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:22.531 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.535+0000 7fc4a6374640 1 -- 10.20.193.58:0/1613965132 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc4a01f9ca0 con 0x7fc4a013c710 2026-02-23T06:30:22.531 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.535+0000 7fc4a6374640 1 --2- 10.20.193.58:0/1613965132 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc4a013c710 0x7fc4a00aef20 secure :-1 s=READY pgs=19 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4a0163520 tx=0x7fc49c003af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:22.532 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.536+0000 7fc48e7fc640 1 -- 10.20.193.58:0/1613965132 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc49c039690 con 0x7fc4a013c710 2026-02-23T06:30:22.532 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.536+0000 7fc48e7fc640 1 -- 10.20.193.58:0/1613965132 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4913 (secure 0 0 0) 0x7fc49c003e40 con 0x7fc4a013c710 2026-02-23T06:30:22.532 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.536+0000 7fc48e7fc640 1 -- 10.20.193.58:0/1613965132 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc4a013c710 msgr2=0x7fc4a00aef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:22.532 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.536+0000 7fc48e7fc640 1 --2- 10.20.193.58:0/1613965132 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc4a013c710 0x7fc4a00aef20 secure :-1 s=READY pgs=19 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4a0163520 tx=0x7fc49c003af0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.532 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.536+0000 7fc48e7fc640 1 -- 10.20.193.58:0/1613965132 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc4a013c710 msgr2=0x7fc4a00aef20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:30:22.532 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.536+0000 7fc48e7fc640 1 --2- 10.20.193.58:0/1613965132 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc4a013c710 0x7fc4a00aef20 unknown :-1 s=CLOSED pgs=19 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.532 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:30:22.533 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:30:22.533 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:30:22.533 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:30:22.533 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 76, 2026-02-23T06:30:22.533 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 11353, 2026-02-23T06:30:22.533 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:30:22.533 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:30:22.533 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:30:22.533 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:30:22.533 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:22.534 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:30:22.534 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:30:22.534 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:30:22.534 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:30:22.534 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:30:22.534 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:30:22.534 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:30:22.534 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:30:22.534 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:30:22.534 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:30:22.534 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:30:22.534 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:30:22.535 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:30:22.535 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:30:22.535 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:30:22.535 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:30:22.535 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:30:22.535 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:22.535 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:30:22.535 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:30:22.535 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:30:22.535 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:30:22.535 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:30:22.535 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:30:22.536 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:30:22.536 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:30:22.536 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:30:22.536 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:30:22.536 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:30:22.536 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:30:22.536 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:30:22.536 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:30:22.536 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:30:22.536 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:22.536 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.536 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:30:22.537 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:30:22.537 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:30:22.537 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:30:22.537 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:30:22.537 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:30:22.537 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:30:22.537 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:30:22.537 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:30:22.537 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:30:22.537 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:30:22.537 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:30:22.537 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:30:22.538 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:30:22.538 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:30:22.538 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:30:22.538 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:30:22.538 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:30:22.538 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:30:22.538 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:30:22.538 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:30:22.538 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:30:22.538 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:30:22.538 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:30:22.538 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:30:22.539 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:30:22.539 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:30:22.539 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:30:22.539 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:30:22.539 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:30:22.539 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:22.539 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:30:22.539 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.539 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:30:22.539 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.539 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:30:22.539 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:30:22.539 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:30:22.540 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:30:22.540 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.540 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:30:22.540 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:30:22.540 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:22.540 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.540 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.540 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:30:22.540 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:30:22.540 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:22.540 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:22.540 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:22.540 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.541 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:30:22.541 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:30:22.541 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:30:22.541 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:30:22.541 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:30:22.541 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:30:22.541 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.541 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.541 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:30:22.541 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:30:22.541 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:30:22.541 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:30:22.541 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.542 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:30:22.542 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:30:22.542 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:22.542 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.542 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.542 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:30:22.542 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:30:22.542 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:22.542 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:22.542 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:22.542 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.542 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:30:22.542 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:30:22.543 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:30:22.543 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:30:22.543 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:30:22.543 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:30:22.543 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.543 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.543 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:30:22.543 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:30:22.543 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:30:22.543 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:30:22.543 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.543 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:30:22.543 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:30:22.544 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:22.544 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.544 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.544 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:30:22.544 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:30:22.544 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:22.544 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:22.544 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:22.544 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.544 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:30:22.544 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:30:22.544 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:30:22.545 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:30:22.545 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:30:22.545 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:30:22.545 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:22.545 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:22.545 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.545 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:30:22.545 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:30:22.545 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.545 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:22.545 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:22.545 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:30:22.545 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:22.546 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:22.546 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:30:22.546 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.546 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:22.546 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:22.546 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:30:22.546 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:22.546 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:22.546 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.546 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:30:22.546 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:30:22.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.536+0000 7fc4a6b75640 1 -- 10.20.193.58:0/1613965132 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc47007a430 msgr2=0x7fc47009a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:22.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.536+0000 7fc4a6b75640 1 --2- 10.20.193.58:0/1613965132 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc47007a430 0x7fc47009a8e0 secure :-1 s=READY pgs=261 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc490004740 tx=0x7fc49000e000 comp rx=0 tx=0).stop 2026-02-23T06:30:22.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.536+0000 7fc4a6b75640 1 -- 10.20.193.58:0/1613965132 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc4a015c4b0 msgr2=0x7fc4a01fd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:22.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.536+0000 7fc4a6b75640 1 --2- 10.20.193.58:0/1613965132 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc4a015c4b0 0x7fc4a01fd100 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc49400c460 tx=0x7fc49400c930 comp rx=0 tx=0).stop 2026-02-23T06:30:22.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.536+0000 7fc4a6374640 1 -- 10.20.193.58:0/1613965132 reap_dead start 2026-02-23T06:30:22.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.536+0000 7fc4a6374640 1 -- 10.20.193.58:0/1613965132 reap_dead start 2026-02-23T06:30:22.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.536+0000 7fc4a6b75640 1 -- 10.20.193.58:0/1613965132 shutdown_connections 2026-02-23T06:30:22.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.536+0000 7fc4a6b75640 1 -- 10.20.193.58:0/1613965132 >> 10.20.193.58:0/1613965132 conn(0x7fc4a00b3c20 msgr2=0x7fc4a013da60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:30:22.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.536+0000 7fc4a6b75640 1 -- 10.20.193.58:0/1613965132 shutdown_connections 2026-02-23T06:30:22.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.536+0000 7fc4a6b75640 1 -- 10.20.193.58:0/1613965132 wait complete. 2026-02-23T06:30:22.549 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:30:22.549 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:30:22.550 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:30:22.673 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.677+0000 7ff5008c2640 1 -- 10.20.193.58:0/3112044183 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff4fc15d4a0 msgr2=0x7ff4fc0affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:22.673 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.677+0000 7ff5008c2640 1 --2- 10.20.193.58:0/3112044183 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff4fc15d4a0 0x7ff4fc0affb0 secure :-1 s=READY pgs=20 gs=1 cs=0 l=1 c_cookie=10541427298752561952 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4fc059740 tx=0x7ff4f002f250 comp rx=0 tx=0).stop 2026-02-23T06:30:22.673 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.677+0000 7ff5008c2640 1 -- 10.20.193.58:0/3112044183 shutdown_connections 2026-02-23T06:30:22.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.677+0000 7ff5008c2640 1 --2- 10.20.193.58:0/3112044183 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff4fc0b6690 0x7ff4fc058cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.677+0000 7ff5008c2640 1 --2- 10.20.193.58:0/3112044183 >> v2:10.20.193.93:3300/0 conn(0x7ff4fc15d870 0x7ff4fc0587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.677+0000 7ff5008c2640 1 --2- 10.20.193.58:0/3112044183 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff4fc15d4a0 0x7ff4fc0affb0 unknown :-1 s=CLOSED pgs=20 gs=1 cs=0 l=1 c_cookie=10541427298752561952 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.677+0000 7ff5008c2640 1 -- 10.20.193.58:0/3112044183 >> 10.20.193.58:0/3112044183 conn(0x7ff4fc0b3c20 msgr2=0x7ff4fc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:30:22.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.677+0000 7ff5008c2640 1 -- 10.20.193.58:0/3112044183 shutdown_connections 2026-02-23T06:30:22.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.677+0000 7ff5008c2640 1 -- 10.20.193.58:0/3112044183 wait complete. 2026-02-23T06:30:22.677 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.679+0000 7ff5008c2640 1 Processor -- start 2026-02-23T06:30:22.677 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.679+0000 7ff5008c2640 1 -- start start 2026-02-23T06:30:22.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.679+0000 7ff5008c2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff4fc0b6690 0x7ff4fc14a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:22.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.679+0000 7ff5008c2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff4fc15d4a0 0x7ff4fc05c4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:22.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.679+0000 7ff5008c2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff4fc15d870 0x7ff4fc161aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:22.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.679+0000 7ff5008c2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc161610 con 0x7ff4fc15d870 2026-02-23T06:30:22.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.679+0000 7ff5008c2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc14ae20 con 0x7ff4fc15d4a0 2026-02-23T06:30:22.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.679+0000 7ff5008c2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7ff4fc13ec80 con 0x7ff4fc0b6690 2026-02-23T06:30:22.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.679+0000 7ff4fad76640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff4fc0b6690 0x7ff4fc14a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:22.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.680+0000 7ff4fad76640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff4fc0b6690 0x7ff4fc14a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:59994/0 (socket says 10.20.193.58:59994) 2026-02-23T06:30:22.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.680+0000 7ff4fad76640 1 -- 10.20.193.58:0/2773811637 learned_addr learned my addr 10.20.193.58:0/2773811637 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:30:22.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.680+0000 7ff4fb577640 1 --2- 10.20.193.58:0/2773811637 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff4fc15d870 0x7ff4fc161aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:22.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.680+0000 7ff4fa575640 1 --2- 10.20.193.58:0/2773811637 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff4fc15d4a0 0x7ff4fc05c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:22.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.680+0000 7ff4fb577640 1 -- 10.20.193.58:0/2773811637 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff4fc0b6690 msgr2=0x7ff4fc14a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:22.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.680+0000 7ff4fb577640 1 --2- 10.20.193.58:0/2773811637 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff4fc0b6690 0x7ff4fc14a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.680+0000 7ff4fb577640 1 -- 10.20.193.58:0/2773811637 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff4fc15d4a0 msgr2=0x7ff4fc05c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:22.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.680+0000 7ff4fb577640 1 --2- 10.20.193.58:0/2773811637 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff4fc15d4a0 0x7ff4fc05c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.680+0000 7ff4fb577640 1 -- 10.20.193.58:0/2773811637 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4e40094b0 con 0x7ff4fc15d870 2026-02-23T06:30:22.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.680+0000 7ff4fad76640 1 --2- 10.20.193.58:0/2773811637 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff4fc0b6690 0x7ff4fc14a8e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:30:22.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.680+0000 7ff4fb577640 1 --2- 10.20.193.58:0/2773811637 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff4fc15d870 0x7ff4fc161aa0 secure :-1 s=READY pgs=21 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4ec00f940 tx=0x7ff4ec00fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:22.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.680+0000 7ff4db7fe640 1 -- 10.20.193.58:0/2773811637 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4ec00dce0 con 0x7ff4fc15d870 2026-02-23T06:30:22.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.680+0000 7ff4db7fe640 1 -- 10.20.193.58:0/2773811637 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4ec00de60 con 0x7ff4fc15d870 2026-02-23T06:30:22.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.680+0000 7ff4db7fe640 1 -- 10.20.193.58:0/2773811637 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4ec005b90 con 0x7ff4fc15d870 2026-02-23T06:30:22.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.680+0000 7ff5008c2640 1 -- 10.20.193.58:0/2773811637 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4f0009570 con 0x7ff4fc15d870 2026-02-23T06:30:22.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.680+0000 7ff5008c2640 1 -- 10.20.193.58:0/2773811637 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4fc162bc0 con 0x7ff4fc15d870 2026-02-23T06:30:22.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.681+0000 7ff5008c2640 1 --2- 10.20.193.58:0/2773811637 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff4fc057d70 0x7ff4fc161fe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:22.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.681+0000 7ff5008c2640 1 -- 10.20.193.58:0/2773811637 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc164250 con 0x7ff4fc057d70 2026-02-23T06:30:22.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.681+0000 7ff4fad76640 1 --2- 10.20.193.58:0/2773811637 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff4fc057d70 0x7ff4fc161fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:22.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.681+0000 7ff4fad76640 1 -- 10.20.193.58:0/2773811637 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff4fc0b6330 con 0x7ff4fc057d70 2026-02-23T06:30:22.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.682+0000 7ff4fad76640 1 --2- 10.20.193.58:0/2773811637 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff4fc057d70 0x7ff4fc161fe0 secure :-1 s=READY pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4f00098a0 tx=0x7ff4f0002c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:22.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.682+0000 7ff4db7fe640 1 -- 10.20.193.58:0/2773811637 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4f003d050 con 0x7ff4fc057d70 2026-02-23T06:30:22.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.682+0000 7ff4db7fe640 1 -- 10.20.193.58:0/2773811637 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7ff4ec020060 con 0x7ff4fc15d870 2026-02-23T06:30:22.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.683+0000 7ff4db7fe640 1 --2- 10.20.193.58:0/2773811637 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff4c807a660 0x7ff4c809ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:22.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.683+0000 7ff4db7fe640 1 -- 10.20.193.58:0/2773811637 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7ff4ec015070 con 0x7ff4fc15d870 2026-02-23T06:30:22.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.683+0000 7ff4db7fe640 1 -- 10.20.193.58:0/2773811637 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7ff4f003e040 con 0x7ff4fc057d70 2026-02-23T06:30:22.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.683+0000 7ff4db7fe640 1 -- 10.20.193.58:0/2773811637 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff4fc057d70 msgr2=0x7ff4fc161fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:22.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.683+0000 7ff4db7fe640 1 --2- 10.20.193.58:0/2773811637 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff4fc057d70 0x7ff4fc161fe0 secure :-1 s=READY pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4f00098a0 tx=0x7ff4f0002c40 comp rx=0 tx=0).stop 2026-02-23T06:30:22.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.683+0000 7ff4db7fe640 1 -- 10.20.193.58:0/2773811637 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff4fc057d70 msgr2=0x7ff4fc161fe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:30:22.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.683+0000 7ff4db7fe640 1 --2- 10.20.193.58:0/2773811637 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff4fc057d70 0x7ff4fc161fe0 secure :-1 s=CLOSED pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4f00098a0 tx=0x7ff4f0002c40 comp rx=0 tx=0).stop 2026-02-23T06:30:22.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.683+0000 7ff4fa575640 1 --2- 10.20.193.58:0/2773811637 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff4c807a660 0x7ff4c809ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:22.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.684+0000 7ff4fa575640 1 --2- 10.20.193.58:0/2773811637 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff4c807a660 0x7ff4c809ab10 secure :-1 s=READY pgs=262 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4fc144740 tx=0x7ff4e4005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:22.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.687+0000 7ff5008c2640 1 --2- 10.20.193.58:0/2773811637 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff4fc14d450 0x7ff4fc14d850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:22.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.687+0000 7ff5008c2640 1 -- 10.20.193.58:0/2773811637 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc161750 con 0x7ff4fc14d450 2026-02-23T06:30:22.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.687+0000 7ff4fad76640 1 --2- 10.20.193.58:0/2773811637 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff4fc14d450 0x7ff4fc14d850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:22.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.687+0000 7ff4fad76640 1 -- 10.20.193.58:0/2773811637 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff4fc15a940 con 0x7ff4fc14d450 2026-02-23T06:30:22.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.688+0000 7ff4fad76640 1 --2- 10.20.193.58:0/2773811637 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff4fc14d450 0x7ff4fc14d850 secure :-1 s=READY pgs=137 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4f0044000 tx=0x7ff4f0009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:22.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.688+0000 7ff4db7fe640 1 -- 10.20.193.58:0/2773811637 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4f0052070 con 0x7ff4fc14d450 2026-02-23T06:30:22.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.688+0000 7ff4db7fe640 1 -- 10.20.193.58:0/2773811637 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5246 (secure 0 0 0) 0x7ff4f0038c40 con 0x7ff4fc14d450 2026-02-23T06:30:22.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.688+0000 7ff4db7fe640 1 -- 10.20.193.58:0/2773811637 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff4fc14d450 msgr2=0x7ff4fc14d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:22.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.688+0000 7ff4db7fe640 1 --2- 10.20.193.58:0/2773811637 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff4fc14d450 0x7ff4fc14d850 secure :-1 s=READY pgs=137 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4f0044000 tx=0x7ff4f0009310 comp rx=0 tx=0).stop 2026-02-23T06:30:22.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.688+0000 7ff4db7fe640 1 -- 10.20.193.58:0/2773811637 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff4fc14d450 msgr2=0x7ff4fc14d850 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:30:22.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.688+0000 7ff4db7fe640 1 --2- 10.20.193.58:0/2773811637 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff4fc14d450 0x7ff4fc14d850 secure :-1 s=CLOSED pgs=137 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4f0044000 tx=0x7ff4f0009310 comp rx=0 tx=0).stop 2026-02-23T06:30:22.685 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:30:22.685 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:30:22.685 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:30:22.685 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:30:22.685 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 76, 2026-02-23T06:30:22.686 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 224200, 2026-02-23T06:30:22.686 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:30:22.686 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:30:22.686 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:30:22.686 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:30:22.686 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:22.686 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:30:22.686 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:30:22.686 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:30:22.686 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:30:22.686 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:30:22.687 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:30:22.687 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:30:22.687 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:30:22.687 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:30:22.687 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:30:22.687 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:30:22.687 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:30:22.687 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:30:22.687 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:30:22.687 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:30:22.687 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:30:22.688 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:30:22.688 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:22.688 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:30:22.688 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:30:22.688 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:30:22.688 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:30:22.688 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:30:22.688 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:30:22.688 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:30:22.688 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:30:22.688 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:30:22.688 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:30:22.689 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:30:22.689 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:30:22.689 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:30:22.689 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:30:22.689 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:30:22.689 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:22.689 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.689 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:30:22.689 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:30:22.689 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:30:22.689 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:30:22.689 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:30:22.690 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:30:22.690 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:30:22.690 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:30:22.690 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:30:22.690 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:30:22.690 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:30:22.690 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:30:22.690 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:30:22.690 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:30:22.690 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:30:22.690 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:30:22.690 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:30:22.691 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:30:22.691 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:30:22.691 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:30:22.691 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:30:22.691 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:30:22.691 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:30:22.691 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:30:22.691 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:30:22.691 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:30:22.691 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:30:22.691 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:30:22.691 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:30:22.692 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:30:22.692 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:22.692 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:30:22.692 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.692 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:30:22.692 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.692 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:30:22.692 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:30:22.692 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:30:22.692 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:30:22.692 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.692 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:30:22.693 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:30:22.693 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:22.693 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.693 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.693 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:30:22.693 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:30:22.693 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:22.693 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:22.693 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:22.693 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.693 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:30:22.693 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:30:22.694 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:30:22.694 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:30:22.694 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:30:22.694 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:30:22.694 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.694 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.694 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:30:22.694 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:30:22.694 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:30:22.694 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:30:22.694 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.694 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:30:22.695 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:30:22.695 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:22.695 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.695 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.695 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:30:22.695 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:30:22.695 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:22.695 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:22.695 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:22.695 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.695 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:30:22.695 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:30:22.695 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:30:22.696 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:30:22.696 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:30:22.696 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:30:22.696 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.696 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.696 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:30:22.696 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:30:22.696 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:30:22.696 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:30:22.696 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.697 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:30:22.697 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:30:22.697 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:22.697 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.697 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.697 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:30:22.697 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:30:22.697 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:22.697 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:22.697 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:22.697 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.697 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:30:22.698 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:30:22.698 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:30:22.698 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:30:22.698 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:30:22.698 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:30:22.698 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:22.698 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:22.698 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.698 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:30:22.698 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:30:22.698 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.699 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:22.699 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:22.699 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:30:22.699 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:22.699 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:22.699 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:30:22.699 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.699 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:22.699 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:22.699 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:30:22.699 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:22.699 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:22.699 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:30:22.700 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.700 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:22.700 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:22.700 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:30:22.700 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:22.700 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:22.700 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:30:22.700 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.700 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:22.700 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:22.700 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:30:22.700 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:22.701 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:22.701 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.701 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:30:22.701 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:30:22.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.688+0000 7ff5008c2640 1 -- 10.20.193.58:0/2773811637 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff4c807a660 msgr2=0x7ff4c809ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:22.703 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.688+0000 7ff5008c2640 1 --2- 10.20.193.58:0/2773811637 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff4c807a660 0x7ff4c809ab10 secure :-1 s=READY pgs=262 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4fc144740 tx=0x7ff4e4005f90 comp rx=0 tx=0).stop 2026-02-23T06:30:22.703 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.688+0000 7ff5008c2640 1 -- 10.20.193.58:0/2773811637 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff4fc15d870 msgr2=0x7ff4fc161aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:22.703 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.688+0000 7ff5008c2640 1 --2- 10.20.193.58:0/2773811637 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff4fc15d870 0x7ff4fc161aa0 secure :-1 s=READY pgs=21 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4ec00f940 tx=0x7ff4ec00fe10 comp rx=0 tx=0).stop 2026-02-23T06:30:22.703 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.688+0000 7ff4fb577640 1 -- 10.20.193.58:0/2773811637 reap_dead start 2026-02-23T06:30:22.703 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.688+0000 7ff4fb577640 1 -- 10.20.193.58:0/2773811637 reap_dead start 2026-02-23T06:30:22.703 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.689+0000 7ff5008c2640 1 -- 10.20.193.58:0/2773811637 shutdown_connections 2026-02-23T06:30:22.703 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.689+0000 7ff5008c2640 1 -- 10.20.193.58:0/2773811637 >> 10.20.193.58:0/2773811637 conn(0x7ff4fc0b3c20 msgr2=0x7ff4fc15ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:30:22.703 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.689+0000 7ff5008c2640 1 -- 10.20.193.58:0/2773811637 shutdown_connections 2026-02-23T06:30:22.703 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.689+0000 7ff5008c2640 1 -- 10.20.193.58:0/2773811637 wait complete. 2026-02-23T06:30:22.704 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:30:22.704 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:30:22.704 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:30:22.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.831+0000 7f19f21d4640 1 -- 10.20.193.58:0/3316837632 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f19ec163820 msgr2=0x7f19ec15d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:22.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.831+0000 7f19f21d4640 1 --2- 10.20.193.58:0/3316837632 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f19ec163820 0x7f19ec15d380 secure :-1 s=READY pgs=148 gs=3 cs=0 l=1 c_cookie=10569879631041127614 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19e0005820 tx=0x7f19e0030250 comp rx=0 tx=0).stop 2026-02-23T06:30:22.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.831+0000 7f19f21d4640 1 -- 10.20.193.58:0/3316837632 shutdown_connections 2026-02-23T06:30:22.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.831+0000 7f19f21d4640 1 --2- 10.20.193.58:0/3316837632 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f19ec163820 0x7f19ec15d380 unknown :-1 s=CLOSED pgs=148 gs=3 cs=0 l=1 c_cookie=10569879631041127614 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.831+0000 7f19f21d4640 1 --2- 10.20.193.58:0/3316837632 >> v2:10.20.193.93:3300/0 conn(0x7f19ec0b1170 0x7f19ec15ce40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.831+0000 7f19f21d4640 1 -- 10.20.193.58:0/3316837632 >> 10.20.193.58:0/3316837632 conn(0x7f19ec058e50 msgr2=0x7f19ec059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:30:22.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.832+0000 7f19f21d4640 1 -- 10.20.193.58:0/3316837632 shutdown_connections 2026-02-23T06:30:22.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.832+0000 7f19f21d4640 1 -- 10.20.193.58:0/3316837632 wait complete. 2026-02-23T06:30:22.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.833+0000 7f19f21d4640 1 Processor -- start 2026-02-23T06:30:22.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.833+0000 7f19f21d4640 1 -- start start 2026-02-23T06:30:22.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.833+0000 7f19f21d4640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f19ec0b1170 0x7f19ec13a7f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:22.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.833+0000 7f19f21d4640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f19ec0b1540 0x7f19ec165960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:22.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.833+0000 7f19f21d4640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f19ec163820 0x7f19ec155e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:22.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.833+0000 7f19f21d4640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f19ec15c1a0 con 0x7f19ec163820 2026-02-23T06:30:22.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.833+0000 7f19f21d4640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f19ec15c940 con 0x7f19ec0b1540 2026-02-23T06:30:22.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.833+0000 7f19f21d4640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f19ec156f10 con 0x7f19ec0b1170 2026-02-23T06:30:22.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.834+0000 7f19ebfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f19ec163820 0x7f19ec155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:22.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.834+0000 7f19ebfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f19ec163820 0x7f19ec155e40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:34054/0 (socket says 10.20.193.58:34054) 2026-02-23T06:30:22.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.834+0000 7f19ebfff640 1 -- 10.20.193.58:0/133872242 learned_addr learned my addr 10.20.193.58:0/133872242 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:30:22.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.834+0000 7f19eb7fe640 1 --2- 10.20.193.58:0/133872242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f19ec0b1170 0x7f19ec13a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:22.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.834+0000 7f19eaffd640 1 --2- 10.20.193.58:0/133872242 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f19ec0b1540 0x7f19ec165960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:22.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.834+0000 7f19ebfff640 1 -- 10.20.193.58:0/133872242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f19ec0b1170 msgr2=0x7f19ec13a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:22.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.834+0000 7f19ebfff640 1 --2- 10.20.193.58:0/133872242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f19ec0b1170 0x7f19ec13a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.834+0000 7f19ebfff640 1 -- 10.20.193.58:0/133872242 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f19ec0b1540 msgr2=0x7f19ec165960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:22.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.834+0000 7f19ebfff640 1 --2- 10.20.193.58:0/133872242 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f19ec0b1540 0x7f19ec165960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.834+0000 7f19ebfff640 1 -- 10.20.193.58:0/133872242 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e000a590 con 0x7f19ec163820 2026-02-23T06:30:22.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.834+0000 7f19ebfff640 1 --2- 10.20.193.58:0/133872242 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f19ec163820 0x7f19ec155e40 secure :-1 s=READY pgs=23 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19e0003af0 tx=0x7f19e0003b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:22.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.834+0000 7f19c7fff640 1 -- 10.20.193.58:0/133872242 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19e003e070 con 0x7f19ec163820 2026-02-23T06:30:22.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.834+0000 7f19c7fff640 1 -- 10.20.193.58:0/133872242 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19e0039690 con 0x7f19ec163820 2026-02-23T06:30:22.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.834+0000 7f19c7fff640 1 -- 10.20.193.58:0/133872242 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19e0039ac0 con 0x7f19ec163820 2026-02-23T06:30:22.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.834+0000 7f19f21d4640 1 -- 10.20.193.58:0/133872242 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19ec0b6bf0 con 0x7f19ec163820 2026-02-23T06:30:22.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.834+0000 7f19f21d4640 1 -- 10.20.193.58:0/133872242 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19ec156c30 con 0x7f19ec163820 2026-02-23T06:30:22.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.835+0000 7f19f21d4640 1 --2- 10.20.193.58:0/133872242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f19ec165ea0 0x7f19ec156380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:22.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.835+0000 7f19f21d4640 1 -- 10.20.193.58:0/133872242 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f19ec166fe0 con 0x7f19ec165ea0 2026-02-23T06:30:22.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.835+0000 7f19eb7fe640 1 --2- 10.20.193.58:0/133872242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f19ec165ea0 0x7f19ec156380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:22.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.836+0000 7f19eb7fe640 1 -- 10.20.193.58:0/133872242 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f19ec166d00 con 0x7f19ec165ea0 2026-02-23T06:30:22.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.836+0000 7f19eb7fe640 1 --2- 10.20.193.58:0/133872242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f19ec165ea0 0x7f19ec156380 secure :-1 s=READY pgs=149 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19d8002fc0 tx=0x7f19d8009ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:22.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.836+0000 7f19c7fff640 1 -- 10.20.193.58:0/133872242 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19d8011030 con 0x7f19ec165ea0 2026-02-23T06:30:22.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.836+0000 7f19c7fff640 1 -- 10.20.193.58:0/133872242 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f19d8011190 con 0x7f19ec165ea0 2026-02-23T06:30:22.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.836+0000 7f19c7fff640 1 -- 10.20.193.58:0/133872242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f19ec165ea0 msgr2=0x7f19ec156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:22.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.836+0000 7f19c7fff640 1 --2- 10.20.193.58:0/133872242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f19ec165ea0 0x7f19ec156380 secure :-1 s=READY pgs=149 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19d8002fc0 tx=0x7f19d8009ae0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.836+0000 7f19c7fff640 1 -- 10.20.193.58:0/133872242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f19ec165ea0 msgr2=0x7f19ec156380 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:30:22.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.836+0000 7f19c7fff640 1 --2- 10.20.193.58:0/133872242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f19ec165ea0 0x7f19ec156380 secure :-1 s=CLOSED pgs=149 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19d8002fc0 tx=0x7f19d8009ae0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.836+0000 7f19c7fff640 1 -- 10.20.193.58:0/133872242 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f19e0039c20 con 0x7f19ec163820 2026-02-23T06:30:22.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.837+0000 7f19c7fff640 1 --2- 10.20.193.58:0/133872242 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f19bc07a430 0x7f19bc09a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:22.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.837+0000 7f19c7fff640 1 -- 10.20.193.58:0/133872242 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f19e00c36e0 con 0x7f19ec163820 2026-02-23T06:30:22.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.837+0000 7f19eb7fe640 1 --2- 10.20.193.58:0/133872242 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f19bc07a430 0x7f19bc09a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:22.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.838+0000 7f19eb7fe640 1 --2- 10.20.193.58:0/133872242 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f19bc07a430 0x7f19bc09a8e0 secure :-1 s=READY pgs=263 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19d8011000 tx=0x7f19d801d040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:22.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.840+0000 7f19f21d4640 1 --2- 10.20.193.58:0/133872242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f19ec13b4d0 0x7f19ec0b41c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:22.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.840+0000 7f19f21d4640 1 -- 10.20.193.58:0/133872242 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f19ec05b2d0 con 0x7f19ec13b4d0 2026-02-23T06:30:22.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.840+0000 7f19eaffd640 1 --2- 10.20.193.58:0/133872242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f19ec13b4d0 0x7f19ec0b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:22.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.840+0000 7f19eaffd640 1 -- 10.20.193.58:0/133872242 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f19ec15c720 con 0x7f19ec13b4d0 2026-02-23T06:30:22.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.841+0000 7f19eaffd640 1 --2- 10.20.193.58:0/133872242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f19ec13b4d0 0x7f19ec0b41c0 secure :-1 s=READY pgs=150 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19dc007fd0 tx=0x7f19dc00eba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:22.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.841+0000 7f19c7fff640 1 -- 10.20.193.58:0/133872242 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19dc019070 con 0x7f19ec13b4d0 2026-02-23T06:30:22.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.841+0000 7f19c7fff640 1 -- 10.20.193.58:0/133872242 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5556 (secure 0 0 0) 0x7f19dc005240 con 0x7f19ec13b4d0 2026-02-23T06:30:22.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.841+0000 7f19c7fff640 1 -- 10.20.193.58:0/133872242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f19ec13b4d0 msgr2=0x7f19ec0b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:22.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.841+0000 7f19c7fff640 1 --2- 10.20.193.58:0/133872242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f19ec13b4d0 0x7f19ec0b41c0 secure :-1 s=READY pgs=150 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19dc007fd0 tx=0x7f19dc00eba0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.841+0000 7f19c7fff640 1 -- 10.20.193.58:0/133872242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f19ec13b4d0 msgr2=0x7f19ec0b41c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:30:22.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.841+0000 7f19c7fff640 1 --2- 10.20.193.58:0/133872242 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f19ec13b4d0 0x7f19ec0b41c0 unknown :-1 s=CLOSED pgs=150 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:22.838 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:30:22.839 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:30:22.839 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:30:22.839 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:30:22.839 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 76, 2026-02-23T06:30:22.839 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 297353, 2026-02-23T06:30:22.839 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:30:22.840 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:30:22.840 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:30:22.840 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:30:22.840 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:22.840 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:30:22.840 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:30:22.840 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:30:22.840 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:30:22.840 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:30:22.840 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:30:22.840 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:30:22.840 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:30:22.841 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:30:22.841 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:30:22.841 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:30:22.841 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:30:22.841 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:30:22.841 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:30:22.841 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:30:22.841 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:30:22.841 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:30:22.841 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:22.841 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:30:22.841 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:30:22.842 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:30:22.842 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:30:22.842 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:30:22.842 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:30:22.842 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:30:22.842 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:30:22.842 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:30:22.842 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:30:22.842 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:30:22.842 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:30:22.842 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:30:22.842 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:30:22.842 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:30:22.843 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:22.843 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.843 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:30:22.843 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:30:22.843 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:30:22.843 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:30:22.843 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:30:22.843 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:30:22.843 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:30:22.843 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:30:22.843 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:30:22.844 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:30:22.844 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:30:22.844 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:30:22.844 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:30:22.844 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:30:22.844 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:30:22.844 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:30:22.844 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:30:22.844 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:30:22.844 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:30:22.844 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:30:22.844 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:30:22.844 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:30:22.844 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:30:22.845 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:30:22.845 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:30:22.845 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:30:22.845 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:30:22.845 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:30:22.845 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:30:22.845 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:30:22.845 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:22.845 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:30:22.845 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.845 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:30:22.845 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.845 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:30:22.846 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:30:22.846 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:30:22.846 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:30:22.846 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.846 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:30:22.846 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:30:22.846 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:22.846 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.846 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.846 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:30:22.846 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:30:22.846 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:22.846 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:22.846 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:22.847 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.847 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:30:22.847 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:30:22.847 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:30:22.847 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:30:22.847 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:30:22.847 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:30:22.847 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.847 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.847 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:30:22.847 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:30:22.847 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:30:22.847 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:30:22.847 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.847 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:30:22.848 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:30:22.848 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:22.848 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.848 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.848 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:30:22.848 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:30:22.848 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:22.848 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:22.848 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:22.848 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.848 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:30:22.848 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:30:22.848 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:30:22.848 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:30:22.848 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:30:22.849 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:30:22.849 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.849 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.849 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:30:22.849 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:30:22.849 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:30:22.849 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:30:22.849 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.849 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:30:22.849 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:30:22.849 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:22.849 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.849 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.849 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:30:22.849 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:30:22.849 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:22.850 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:22.850 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:22.850 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.850 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:30:22.850 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:30:22.850 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:30:22.850 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:30:22.850 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:30:22.850 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:30:22.850 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:22.850 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:22.850 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.850 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:30:22.850 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:30:22.850 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.851 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:22.851 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:22.851 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:30:22.851 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:22.851 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:22.851 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:30:22.851 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.851 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:22.851 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:22.851 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:30:22.851 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:22.851 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:22.851 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:30:22.851 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.851 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:22.851 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:22.851 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:30:22.852 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:22.852 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:22.852 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:30:22.852 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.852 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:30:22.852 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:30:22.852 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:30:22.852 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.852 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.852 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:22.852 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:22.852 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:30:22.852 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:22.852 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:22.852 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:30:22.852 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:22.852 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:22.852 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:22.853 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:30:22.853 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:22.853 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:22.853 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:22.853 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:30:22.853 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:30:22.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.841+0000 7f19f21d4640 1 -- 10.20.193.58:0/133872242 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f19bc07a430 msgr2=0x7f19bc09a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:22.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.841+0000 7f19f21d4640 1 --2- 10.20.193.58:0/133872242 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f19bc07a430 0x7f19bc09a8e0 secure :-1 s=READY pgs=263 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19d8011000 tx=0x7f19d801d040 comp rx=0 tx=0).stop 2026-02-23T06:30:22.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.841+0000 7f19f21d4640 1 -- 10.20.193.58:0/133872242 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f19ec163820 msgr2=0x7f19ec155e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:22.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.841+0000 7f19f21d4640 1 --2- 10.20.193.58:0/133872242 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f19ec163820 0x7f19ec155e40 secure :-1 s=READY pgs=23 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19e0003af0 tx=0x7f19e0003b20 comp rx=0 tx=0).stop 2026-02-23T06:30:22.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.841+0000 7f19ebfff640 1 -- 10.20.193.58:0/133872242 reap_dead start 2026-02-23T06:30:22.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.841+0000 7f19ebfff640 1 -- 10.20.193.58:0/133872242 reap_dead start 2026-02-23T06:30:22.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.841+0000 7f19f21d4640 1 -- 10.20.193.58:0/133872242 shutdown_connections 2026-02-23T06:30:22.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.841+0000 7f19f21d4640 1 -- 10.20.193.58:0/133872242 >> 10.20.193.58:0/133872242 conn(0x7f19ec058e50 msgr2=0x7f19ec0ae090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:30:22.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.842+0000 7f19f21d4640 1 -- 10.20.193.58:0/133872242 shutdown_connections 2026-02-23T06:30:22.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:22.842+0000 7f19f21d4640 1 -- 10.20.193.58:0/133872242 wait complete. 2026-02-23T06:30:22.855 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:30:22.855 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-23T06:30:22.855 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['c'] 2026-02-23T06:30:22.855 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-23T06:30:22.855 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-23T06:30:22.856 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-23T06:30:22.856 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:30:22.865 INFO:tasks.ceph.mon.b:Stopped 2026-02-23T06:30:22.865 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.c 2026-02-23T06:30:22.866 INFO:tasks.mon_thrash:Sending STOP to mon c 2026-02-23T06:30:22.866 INFO:tasks.ceph.mon.c:Sent signal 19 2026-02-23T06:30:22.866 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-23T06:30:37.867 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.c 2026-02-23T06:30:37.867 INFO:tasks.mon_thrash:Sending CONT to mon c 2026-02-23T06:30:37.867 INFO:tasks.ceph.mon.c:Sent signal 18 2026-02-23T06:30:37.867 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:30:37.867 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:30:42.880 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.884+0000 7f1371f92640 1 -- 10.20.193.58:0/3261998099 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1358004040 msgr2=0x7f1358004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:42.880 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.884+0000 7f1371f92640 1 --2- 10.20.193.58:0/3261998099 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1358004040 0x7f1358004850 secure :-1 s=READY pgs=32 gs=27 cs=0 l=1 c_cookie=1376143862802093221 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13540094b0 tx=0x7f135402fd00 comp rx=0 tx=0).stop 2026-02-23T06:30:42.880 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.884+0000 7f1371f92640 1 -- 10.20.193.58:0/3261998099 shutdown_connections 2026-02-23T06:30:42.880 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.884+0000 7f1371f92640 1 --2- 10.20.193.58:0/3261998099 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1358004d90 0x7f1358005200 unknown :-1 s=CLOSED pgs=0 gs=28 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:42.881 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.884+0000 7f1371f92640 1 --2- 10.20.193.58:0/3261998099 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1358004040 0x7f1358004850 unknown :-1 s=CLOSED pgs=32 gs=27 cs=0 l=1 c_cookie=1376143862802093221 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:42.881 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.884+0000 7f1371f92640 1 --2- 10.20.193.58:0/3261998099 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1350025370 0x7f1358003a30 unknown :-1 s=CLOSED pgs=0 gs=29 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:42.881 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.884+0000 7f1371f92640 1 -- 10.20.193.58:0/3261998099 >> 10.20.193.58:0/3261998099 conn(0x7f136c0b3c20 msgr2=0x7f136c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:30:42.881 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.884+0000 7f1371f92640 1 -- 10.20.193.58:0/3261998099 shutdown_connections 2026-02-23T06:30:42.883 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.884+0000 7f1371f92640 1 -- 10.20.193.58:0/3261998099 wait complete. 2026-02-23T06:30:42.883 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.886+0000 7f1371f92640 1 Processor -- start 2026-02-23T06:30:42.884 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.886+0000 7f1371f92640 1 -- start start 2026-02-23T06:30:42.884 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.886+0000 7f1371f92640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1350025370 0x7f136c1387e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:42.884 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.886+0000 7f1371f92640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1358004040 0x7f136c13cbf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:42.884 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.886+0000 7f1371f92640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1358004d90 0x7f136c139880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:42.884 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.886+0000 7f1371f92640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f136c139430 con 0x7f1350025370 2026-02-23T06:30:42.884 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.886+0000 7f1371f92640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f136c0b6f90 con 0x7f1358004040 2026-02-23T06:30:42.884 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.886+0000 7f1371f92640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f136c1ff0f0 con 0x7f1358004d90 2026-02-23T06:30:42.884 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.886+0000 7f1363fff640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1358004040 msgr2=0x7f136c13cbf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:30:42.884 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.886+0000 7f1363fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1358004040 0x7f136c13cbf0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:30:42.884 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.886+0000 7f1370f90640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1350025370 0x7f136c1387e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:42.884 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.887+0000 7f1370f90640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1350025370 0x7f136c1387e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:54550/0 (socket says 10.20.193.58:54550) 2026-02-23T06:30:42.885 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.887+0000 7f1370f90640 1 -- 10.20.193.58:0/3279673608 learned_addr learned my addr 10.20.193.58:0/3279673608 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:30:42.885 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.887+0000 7f1371791640 1 --2- 10.20.193.58:0/3279673608 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1358004d90 0x7f136c139880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:42.885 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.887+0000 7f1370f90640 1 -- 10.20.193.58:0/3279673608 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1358004d90 msgr2=0x7f136c139880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:42.885 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.887+0000 7f1370f90640 1 --2- 10.20.193.58:0/3279673608 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1358004d90 0x7f136c139880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:42.885 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.887+0000 7f1370f90640 1 -- 10.20.193.58:0/3279673608 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1358004040 msgr2=0x7f136c13cbf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:30:42.885 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.887+0000 7f1370f90640 1 --2- 10.20.193.58:0/3279673608 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1358004040 0x7f136c13cbf0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:42.885 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.887+0000 7f1370f90640 1 -- 10.20.193.58:0/3279673608 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f136c0b7230 con 0x7f1350025370 2026-02-23T06:30:42.885 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.887+0000 7f1370f90640 1 --2- 10.20.193.58:0/3279673608 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1350025370 0x7f136c1387e0 secure :-1 s=READY pgs=33 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f135c002730 tx=0x7f135c006c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:42.885 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.887+0000 7f13617fa640 1 -- 10.20.193.58:0/3279673608 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f135c00f040 con 0x7f1350025370 2026-02-23T06:30:42.885 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.887+0000 7f13617fa640 1 -- 10.20.193.58:0/3279673608 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f135c00a300 con 0x7f1350025370 2026-02-23T06:30:42.885 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.887+0000 7f13617fa640 1 -- 10.20.193.58:0/3279673608 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f135c00d8f0 con 0x7f1350025370 2026-02-23T06:30:42.885 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.887+0000 7f1371f92640 1 -- 10.20.193.58:0/3279673608 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f136c1ff3d0 con 0x7f1350025370 2026-02-23T06:30:42.886 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.887+0000 7f1371f92640 1 -- 10.20.193.58:0/3279673608 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f136c13d130 con 0x7f1350025370 2026-02-23T06:30:42.886 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.888+0000 7f1371f92640 1 -- 10.20.193.58:0/3279673608 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f132c005300 con 0x7f1350025370 2026-02-23T06:30:42.886 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.891+0000 7f13617fa640 1 -- 10.20.193.58:0/3279673608 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f135c00da50 con 0x7f1350025370 2026-02-23T06:30:42.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.892+0000 7f13617fa640 1 --2- 10.20.193.58:0/3279673608 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f133c07a5a0 0x7f133c09aa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:42.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.892+0000 7f13617fa640 1 -- 10.20.193.58:0/3279673608 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f135c09d610 con 0x7f1350025370 2026-02-23T06:30:42.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.892+0000 7f1363fff640 1 --2- 10.20.193.58:0/3279673608 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f133c07a5a0 0x7f133c09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:42.888 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.893+0000 7f1363fff640 1 --2- 10.20.193.58:0/3279673608 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f133c07a5a0 0x7f133c09aa50 secure :-1 s=READY pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1354009380 tx=0x7f1354032040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:42.888 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:42.893+0000 7f13617fa640 1 -- 10.20.193.58:0/3279673608 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f135c0607a0 con 0x7f1350025370 2026-02-23T06:30:42.943 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:30:42.948 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:30:43.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.049+0000 7f1371f92640 1 -- 10.20.193.58:0/3279673608 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f132c005950 con 0x7f1350025370 2026-02-23T06:30:43.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.050+0000 7f13617fa640 1 -- 10.20.193.58:0/3279673608 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1748 (secure 0 0 0) 0x7f135c00dd30 con 0x7f1350025370 2026-02-23T06:30:43.046 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":78,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:30:43.048 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.052+0000 7f1371f92640 1 -- 10.20.193.58:0/3279673608 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f133c07a5a0 msgr2=0x7f133c09aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:43.048 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.052+0000 7f1371f92640 1 --2- 10.20.193.58:0/3279673608 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f133c07a5a0 0x7f133c09aa50 secure :-1 s=READY pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1354009380 tx=0x7f1354032040 comp rx=0 tx=0).stop 2026-02-23T06:30:43.048 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.052+0000 7f1371f92640 1 -- 10.20.193.58:0/3279673608 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1350025370 msgr2=0x7f136c1387e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:43.048 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.052+0000 7f1371f92640 1 --2- 10.20.193.58:0/3279673608 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1350025370 0x7f136c1387e0 secure :-1 s=READY pgs=33 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f135c002730 tx=0x7f135c006c60 comp rx=0 tx=0).stop 2026-02-23T06:30:43.048 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.052+0000 7f1371f92640 1 -- 10.20.193.58:0/3279673608 shutdown_connections 2026-02-23T06:30:43.048 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.052+0000 7f1371f92640 1 --2- 10.20.193.58:0/3279673608 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f133c07a5a0 0x7f133c09aa50 unknown :-1 s=CLOSED pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:43.048 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.052+0000 7f1371f92640 1 --2- 10.20.193.58:0/3279673608 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1358004d90 0x7f136c139880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:43.049 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.052+0000 7f1371f92640 1 --2- 10.20.193.58:0/3279673608 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1358004040 0x7f136c13cbf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:43.049 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.052+0000 7f1371f92640 1 --2- 10.20.193.58:0/3279673608 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1350025370 0x7f136c1387e0 unknown :-1 s=CLOSED pgs=33 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:43.049 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.052+0000 7f1371f92640 1 -- 10.20.193.58:0/3279673608 >> 10.20.193.58:0/3279673608 conn(0x7f136c0b3c20 msgr2=0x7f136c0b1260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:30:43.049 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.052+0000 7f1371f92640 1 -- 10.20.193.58:0/3279673608 shutdown_connections 2026-02-23T06:30:43.049 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.052+0000 7f1371f92640 1 -- 10.20.193.58:0/3279673608 wait complete. 2026-02-23T06:30:43.061 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:30:43.061 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-23T06:30:43.061 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:30:43.181 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.186+0000 7f6183fff640 1 -- 10.20.193.58:0/3103796866 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61840b6690 msgr2=0x7f6184058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:43.181 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.186+0000 7f6183fff640 1 --2- 10.20.193.58:0/3103796866 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61840b6690 0x7f6184058cf0 secure :-1 s=READY pgs=34 gs=2 cs=0 l=1 c_cookie=18235530944462967268 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6184059740 tx=0x7f6174030360 comp rx=0 tx=0).stop 2026-02-23T06:30:43.181 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.186+0000 7f6183fff640 1 -- 10.20.193.58:0/3103796866 shutdown_connections 2026-02-23T06:30:43.181 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.186+0000 7f6183fff640 1 --2- 10.20.193.58:0/3103796866 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61840b6690 0x7f6184058cf0 unknown :-1 s=CLOSED pgs=34 gs=2 cs=0 l=1 c_cookie=18235530944462967268 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:43.181 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.186+0000 7f6183fff640 1 --2- 10.20.193.58:0/3103796866 >> v2:10.20.193.93:3300/0 conn(0x7f618415d870 0x7f61840587b0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:43.181 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.186+0000 7f6183fff640 1 -- 10.20.193.58:0/3103796866 >> 10.20.193.58:0/3103796866 conn(0x7f61840b3c20 msgr2=0x7f61840b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:30:43.181 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.187+0000 7f6183fff640 1 -- 10.20.193.58:0/3103796866 shutdown_connections 2026-02-23T06:30:43.182 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.187+0000 7f6183fff640 1 -- 10.20.193.58:0/3103796866 wait complete. 2026-02-23T06:30:43.183 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.188+0000 7f6183fff640 1 Processor -- start 2026-02-23T06:30:43.183 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.188+0000 7f6183fff640 1 -- start start 2026-02-23T06:30:43.183 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.189+0000 7f6183fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61840b6690 0x7f61841628a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:43.183 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.189+0000 7f6183fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f618415d4a0 0x7f618414df90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:43.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.189+0000 7f6183fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f618415d870 0x7f618414b460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:43.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.189+0000 7f6183fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f6184162de0 con 0x7f61840b6690 2026-02-23T06:30:43.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.189+0000 7f6183fff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f618414afa0 con 0x7f618415d870 2026-02-23T06:30:43.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.189+0000 7f6183fff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f6184149f90 con 0x7f618415d4a0 2026-02-23T06:30:43.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.189+0000 7f61837fe640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f618415d870 msgr2=0x7f618414b460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:30:43.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.189+0000 7f61837fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f618415d870 0x7f618414b460 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:30:43.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.189+0000 7f6182ffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61840b6690 0x7f61841628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:43.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.189+0000 7f6182ffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61840b6690 0x7f61841628a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:54574/0 (socket says 10.20.193.58:54574) 2026-02-23T06:30:43.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.189+0000 7f6182ffd640 1 -- 10.20.193.58:0/3591939390 learned_addr learned my addr 10.20.193.58:0/3591939390 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:30:43.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.189+0000 7f61827fc640 1 --2- 10.20.193.58:0/3591939390 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f618415d4a0 0x7f618414df90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:43.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.189+0000 7f6182ffd640 1 -- 10.20.193.58:0/3591939390 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f618415d4a0 msgr2=0x7f618414df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:43.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.189+0000 7f6182ffd640 1 --2- 10.20.193.58:0/3591939390 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f618415d4a0 0x7f618414df90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:43.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.189+0000 7f6182ffd640 1 -- 10.20.193.58:0/3591939390 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f618415d870 msgr2=0x7f618414b460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:30:43.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.189+0000 7f6182ffd640 1 --2- 10.20.193.58:0/3591939390 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f618415d870 0x7f618414b460 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:43.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.189+0000 7f6182ffd640 1 -- 10.20.193.58:0/3591939390 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f617400a650 con 0x7f61840b6690 2026-02-23T06:30:43.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.189+0000 7f6182ffd640 1 --2- 10.20.193.58:0/3591939390 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61840b6690 0x7f61841628a0 secure :-1 s=READY pgs=35 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f617800b550 tx=0x7f617800ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:43.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.189+0000 7f61637fe640 1 -- 10.20.193.58:0/3591939390 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61780044a0 con 0x7f61840b6690 2026-02-23T06:30:43.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.189+0000 7f61637fe640 1 -- 10.20.193.58:0/3591939390 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6178002740 con 0x7f61840b6690 2026-02-23T06:30:43.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.189+0000 7f61637fe640 1 -- 10.20.193.58:0/3591939390 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6178002b70 con 0x7f61840b6690 2026-02-23T06:30:43.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.189+0000 7f6183fff640 1 -- 10.20.193.58:0/3591939390 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f618414ab10 con 0x7f61840b6690 2026-02-23T06:30:43.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.190+0000 7f6183fff640 1 -- 10.20.193.58:0/3591939390 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6184057e40 con 0x7f61840b6690 2026-02-23T06:30:43.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.190+0000 7f6183fff640 1 --2- 10.20.193.58:0/3591939390 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6184057970 0x7f618414a1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:43.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.190+0000 7f6183fff640 1 -- 10.20.193.58:0/3591939390 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f61840b6330 con 0x7f6184057970 2026-02-23T06:30:43.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.190+0000 7f61827fc640 1 --2- 10.20.193.58:0/3591939390 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6184057970 0x7f618414a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:43.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.190+0000 7f61827fc640 1 -- 10.20.193.58:0/3591939390 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f61840b5e10 con 0x7f6184057970 2026-02-23T06:30:43.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.190+0000 7f61827fc640 1 --2- 10.20.193.58:0/3591939390 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6184057970 0x7f618414a1e0 secure :-1 s=READY pgs=36 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61840b1780 tx=0x7f616c00dba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:43.186 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.190+0000 7f61637fe640 1 -- 10.20.193.58:0/3591939390 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f616c0042f0 con 0x7f6184057970 2026-02-23T06:30:43.186 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.190+0000 7f61637fe640 1 -- 10.20.193.58:0/3591939390 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f616c004450 con 0x7f6184057970 2026-02-23T06:30:43.186 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.190+0000 7f61637fe640 1 -- 10.20.193.58:0/3591939390 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6184057970 msgr2=0x7f618414a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:43.186 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.190+0000 7f61637fe640 1 --2- 10.20.193.58:0/3591939390 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6184057970 0x7f618414a1e0 secure :-1 s=READY pgs=36 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61840b1780 tx=0x7f616c00dba0 comp rx=0 tx=0).stop 2026-02-23T06:30:43.186 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.190+0000 7f61637fe640 1 -- 10.20.193.58:0/3591939390 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6184057970 msgr2=0x7f618414a1e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:30:43.186 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.190+0000 7f61637fe640 1 --2- 10.20.193.58:0/3591939390 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6184057970 0x7f618414a1e0 secure :-1 s=CLOSED pgs=36 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61840b1780 tx=0x7f616c00dba0 comp rx=0 tx=0).stop 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.190+0000 7f61637fe640 1 -- 10.20.193.58:0/3591939390 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f617801f020 con 0x7f61840b6690 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.190+0000 7f61637fe640 1 --2- 10.20.193.58:0/3591939390 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f615007a430 0x7f615009a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.190+0000 7f61637fe640 1 -- 10.20.193.58:0/3591939390 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f617809d180 con 0x7f61840b6690 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.190+0000 7f6183fff640 1 --2- 10.20.193.58:0/3591939390 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f618414a720 0x7f61841228b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.190+0000 7f6183fff640 1 -- 10.20.193.58:0/3591939390 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f61840b6d50 con 0x7f618414a720 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.195+0000 7f61837fe640 1 --2- 10.20.193.58:0/3591939390 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f618414a720 0x7f61841228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.195+0000 7f61837fe640 1 -- 10.20.193.58:0/3591939390 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f618405b0e0 con 0x7f618414a720 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.195+0000 7f61837fe640 1 --2- 10.20.193.58:0/3591939390 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f618414a720 0x7f61841228b0 secure :-1 s=READY pgs=37 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f617400a980 tx=0x7f61740039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.195+0000 7f61637fe640 1 -- 10.20.193.58:0/3591939390 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6174045070 con 0x7f618414a720 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.195+0000 7f61637fe640 1 -- 10.20.193.58:0/3591939390 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4901 (secure 0 0 0) 0x7f6174005930 con 0x7f618414a720 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.195+0000 7f61637fe640 1 -- 10.20.193.58:0/3591939390 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f618414a720 msgr2=0x7f61841228b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.195+0000 7f61637fe640 1 --2- 10.20.193.58:0/3591939390 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f618414a720 0x7f61841228b0 secure :-1 s=READY pgs=37 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f617400a980 tx=0x7f61740039b0 comp rx=0 tx=0).stop 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.195+0000 7f61637fe640 1 -- 10.20.193.58:0/3591939390 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f618414a720 msgr2=0x7f61841228b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.195+0000 7f61637fe640 1 --2- 10.20.193.58:0/3591939390 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f618414a720 0x7f61841228b0 secure :-1 s=CLOSED pgs=37 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f617400a980 tx=0x7f61740039b0 comp rx=0 tx=0).stop 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 78, 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 32012, 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:30:43.191 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:30:43.192 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:43.193 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:30:43.194 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:30:43.195 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:30:43.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.195+0000 7f6183fff640 1 -- 10.20.193.58:0/3591939390 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f615007a430 msgr2=0x7f615009a8e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-23T06:30:43.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.195+0000 7f6183fff640 1 --2- 10.20.193.58:0/3591939390 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f615007a430 0x7f615009a8e0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:43.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.195+0000 7f6183fff640 1 -- 10.20.193.58:0/3591939390 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61840b6690 msgr2=0x7f61841628a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:43.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.195+0000 7f6183fff640 1 --2- 10.20.193.58:0/3591939390 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61840b6690 0x7f61841628a0 secure :-1 s=READY pgs=35 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f617800b550 tx=0x7f617800ba20 comp rx=0 tx=0).stop 2026-02-23T06:30:43.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.195+0000 7f61837fe640 1 -- 10.20.193.58:0/3591939390 reap_dead start 2026-02-23T06:30:43.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.195+0000 7f6183fff640 1 -- 10.20.193.58:0/3591939390 shutdown_connections 2026-02-23T06:30:43.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.195+0000 7f6183fff640 1 -- 10.20.193.58:0/3591939390 >> 10.20.193.58:0/3591939390 conn(0x7f61840b3c20 msgr2=0x7f61840aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:30:43.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.195+0000 7f6183fff640 1 -- 10.20.193.58:0/3591939390 shutdown_connections 2026-02-23T06:30:43.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.195+0000 7f6183fff640 1 -- 10.20.193.58:0/3591939390 wait complete. 2026-02-23T06:30:43.197 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:30:43.197 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-23T06:30:43.198 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:30:43.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.324+0000 7f6f95803640 1 -- 10.20.193.58:0/803806645 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6f9015d4a0 msgr2=0x7f6f900affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:43.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.324+0000 7f6f95803640 1 --2- 10.20.193.58:0/803806645 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6f9015d4a0 0x7f6f900affb0 secure :-1 s=READY pgs=160 gs=2 cs=0 l=1 c_cookie=5249017313784515084 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f80005e70 tx=0x7f6f8002f2b0 comp rx=0 tx=0).stop 2026-02-23T06:30:43.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.324+0000 7f6f95803640 1 -- 10.20.193.58:0/803806645 shutdown_connections 2026-02-23T06:30:43.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.324+0000 7f6f95803640 1 --2- 10.20.193.58:0/803806645 >> v2:10.20.193.93:3300/0 conn(0x7f6f9015d870 0x7f6f900587b0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:43.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.324+0000 7f6f95803640 1 --2- 10.20.193.58:0/803806645 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6f9015d4a0 0x7f6f900affb0 unknown :-1 s=CLOSED pgs=160 gs=2 cs=0 l=1 c_cookie=5249017313784515084 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:43.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.324+0000 7f6f95803640 1 -- 10.20.193.58:0/803806645 >> 10.20.193.58:0/803806645 conn(0x7f6f900b3c20 msgr2=0x7f6f900b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:30:43.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.324+0000 7f6f95803640 1 -- 10.20.193.58:0/803806645 shutdown_connections 2026-02-23T06:30:43.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.324+0000 7f6f95803640 1 -- 10.20.193.58:0/803806645 wait complete. 2026-02-23T06:30:43.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.325+0000 7f6f95803640 1 Processor -- start 2026-02-23T06:30:43.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.325+0000 7f6f95803640 1 -- start start 2026-02-23T06:30:43.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.326+0000 7f6f95803640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6f900b6690 0x7f6f901624f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:43.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.326+0000 7f6f95803640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6f9015d4a0 0x7f6f90056740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:43.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.326+0000 7f6f95803640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6f9015d870 0x7f6f90056c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:43.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.326+0000 7f6f95803640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f6f90058350 con 0x7f6f9015d870 2026-02-23T06:30:43.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.326+0000 7f6f95803640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f6f90056320 con 0x7f6f9015d4a0 2026-02-23T06:30:43.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.326+0000 7f6f95803640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f6f901609f0 con 0x7f6f900b6690 2026-02-23T06:30:43.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.326+0000 7f6f87fff640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6f9015d4a0 msgr2=0x7f6f90056740 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:30:43.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.326+0000 7f6f87fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6f9015d4a0 0x7f6f90056740 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:30:43.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.326+0000 7f6f94801640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6f900b6690 0x7f6f901624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:43.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.326+0000 7f6f94801640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6f900b6690 0x7f6f901624f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:36268/0 (socket says 10.20.193.58:36268) 2026-02-23T06:30:43.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.326+0000 7f6f94801640 1 -- 10.20.193.58:0/2161137436 learned_addr learned my addr 10.20.193.58:0/2161137436 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:30:43.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.326+0000 7f6f95002640 1 --2- 10.20.193.58:0/2161137436 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6f9015d870 0x7f6f90056c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:43.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.326+0000 7f6f94801640 1 -- 10.20.193.58:0/2161137436 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6f9015d4a0 msgr2=0x7f6f90056740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:30:43.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.326+0000 7f6f94801640 1 --2- 10.20.193.58:0/2161137436 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6f9015d4a0 0x7f6f90056740 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:43.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.326+0000 7f6f94801640 1 -- 10.20.193.58:0/2161137436 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6f9015d870 msgr2=0x7f6f90056c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:43.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.326+0000 7f6f94801640 1 --2- 10.20.193.58:0/2161137436 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6f9015d870 0x7f6f90056c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:43.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.326+0000 7f6f94801640 1 -- 10.20.193.58:0/2161137436 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f80009570 con 0x7f6f900b6690 2026-02-23T06:30:43.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.326+0000 7f6f94801640 1 --2- 10.20.193.58:0/2161137436 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6f900b6690 0x7f6f901624f0 secure :-1 s=READY pgs=161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f80009a20 tx=0x7f6f800028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:43.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.326+0000 7f6f857fa640 1 -- 10.20.193.58:0/2161137436 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f8003d070 con 0x7f6f900b6690 2026-02-23T06:30:43.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.327+0000 7f6f857fa640 1 -- 10.20.193.58:0/2161137436 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f80038470 con 0x7f6f900b6690 2026-02-23T06:30:43.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.327+0000 7f6f857fa640 1 -- 10.20.193.58:0/2161137436 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f80038880 con 0x7f6f900b6690 2026-02-23T06:30:43.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.327+0000 7f6f95803640 1 -- 10.20.193.58:0/2161137436 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f90058120 con 0x7f6f900b6690 2026-02-23T06:30:43.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.327+0000 7f6f95803640 1 -- 10.20.193.58:0/2161137436 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f9015df20 con 0x7f6f900b6690 2026-02-23T06:30:43.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.327+0000 7f6f95803640 1 --2- 10.20.193.58:0/2161137436 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6f90167630 0x7f6f9015e130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:43.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.327+0000 7f6f95803640 1 -- 10.20.193.58:0/2161137436 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f6f900b6330 con 0x7f6f90167630 2026-02-23T06:30:43.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.327+0000 7f6f87fff640 1 --2- 10.20.193.58:0/2161137436 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6f90167630 0x7f6f9015e130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:43.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.328+0000 7f6f87fff640 1 -- 10.20.193.58:0/2161137436 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f900b5e10 con 0x7f6f90167630 2026-02-23T06:30:43.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.328+0000 7f6f87fff640 1 --2- 10.20.193.58:0/2161137436 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6f90167630 0x7f6f9015e130 secure :-1 s=READY pgs=162 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f9013ac20 tx=0x7f6f7800bb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:43.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.328+0000 7f6f857fa640 1 -- 10.20.193.58:0/2161137436 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f78003e80 con 0x7f6f90167630 2026-02-23T06:30:43.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.328+0000 7f6f857fa640 1 -- 10.20.193.58:0/2161137436 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f6f800389e0 con 0x7f6f900b6690 2026-02-23T06:30:43.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.329+0000 7f6f857fa640 1 --2- 10.20.193.58:0/2161137436 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6f6007a660 0x7f6f6009ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:43.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.329+0000 7f6f857fa640 1 -- 10.20.193.58:0/2161137436 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f6f800c2270 con 0x7f6f900b6690 2026-02-23T06:30:43.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.329+0000 7f6f857fa640 1 -- 10.20.193.58:0/2161137436 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f6f78005070 con 0x7f6f90167630 2026-02-23T06:30:43.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.329+0000 7f6f857fa640 1 -- 10.20.193.58:0/2161137436 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6f90167630 msgr2=0x7f6f9015e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:43.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.329+0000 7f6f857fa640 1 --2- 10.20.193.58:0/2161137436 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6f90167630 0x7f6f9015e130 secure :-1 s=READY pgs=162 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f9013ac20 tx=0x7f6f7800bb20 comp rx=0 tx=0).stop 2026-02-23T06:30:43.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.329+0000 7f6f857fa640 1 -- 10.20.193.58:0/2161137436 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6f90167630 msgr2=0x7f6f9015e130 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:30:43.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.329+0000 7f6f857fa640 1 --2- 10.20.193.58:0/2161137436 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6f90167630 0x7f6f9015e130 unknown :-1 s=CLOSED pgs=162 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:30:43.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.329+0000 7f6f95002640 1 --2- 10.20.193.58:0/2161137436 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6f6007a660 0x7f6f6009ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:43.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.330+0000 7f6f95002640 1 --2- 10.20.193.58:0/2161137436 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6f6007a660 0x7f6f6009ab10 secure :-1 s=READY pgs=265 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f8c003810 tx=0x7f6f8c009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:43.329 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.333+0000 7f6f95803640 1 --2- 10.20.193.58:0/2161137436 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6f9015a190 0x7f6f9015a560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:30:43.329 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.333+0000 7f6f95803640 1 -- 10.20.193.58:0/2161137436 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f6f900b6d50 con 0x7f6f9015a190 2026-02-23T06:30:43.329 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.333+0000 7f6f87fff640 1 --2- 10.20.193.58:0/2161137436 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6f9015a190 0x7f6f9015a560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:30:43.329 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.334+0000 7f6f87fff640 1 -- 10.20.193.58:0/2161137436 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6f90056590 con 0x7f6f9015a190 2026-02-23T06:30:43.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.334+0000 7f6f87fff640 1 --2- 10.20.193.58:0/2161137436 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6f9015a190 0x7f6f9015a560 secure :-1 s=READY pgs=163 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f900513d0 tx=0x7f6f78005a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:30:43.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.335+0000 7f6f857fa640 1 -- 10.20.193.58:0/2161137436 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f7801a6c0 con 0x7f6f9015a190 2026-02-23T06:30:43.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.335+0000 7f6f857fa640 1 -- 10.20.193.58:0/2161137436 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5544 (secure 0 0 0) 0x7f6f7801a820 con 0x7f6f9015a190 2026-02-23T06:30:43.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.335+0000 7f6f857fa640 1 -- 10.20.193.58:0/2161137436 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6f9015a190 msgr2=0x7f6f9015a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:43.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.335+0000 7f6f857fa640 1 --2- 10.20.193.58:0/2161137436 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6f9015a190 0x7f6f9015a560 secure :-1 s=READY pgs=163 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f900513d0 tx=0x7f6f78005a70 comp rx=0 tx=0).stop 2026-02-23T06:30:43.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.335+0000 7f6f857fa640 1 -- 10.20.193.58:0/2161137436 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6f9015a190 msgr2=0x7f6f9015a560 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:30:43.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.335+0000 7f6f857fa640 1 --2- 10.20.193.58:0/2161137436 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6f9015a190 0x7f6f9015a560 secure :-1 s=CLOSED pgs=163 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f900513d0 tx=0x7f6f78005a70 comp rx=0 tx=0).stop 2026-02-23T06:30:43.331 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:30:43.331 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:30:43.331 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:30:43.332 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:30:43.332 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 78, 2026-02-23T06:30:43.332 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 317846, 2026-02-23T06:30:43.332 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:30:43.332 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:30:43.332 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:30:43.332 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:43.332 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:30:43.332 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:30:43.332 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:30:43.332 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:30:43.332 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:30:43.333 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:30:43.333 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:30:43.333 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:30:43.333 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:30:43.333 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:30:43.333 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:30:43.333 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:30:43.333 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:30:43.333 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:30:43.333 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:30:43.333 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:30:43.334 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:30:43.334 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:43.334 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:30:43.334 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:30:43.334 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:30:43.334 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:30:43.334 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:30:43.334 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:30:43.334 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:30:43.334 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:30:43.334 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:30:43.334 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:30:43.335 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:30:43.335 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:30:43.335 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:30:43.335 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:30:43.335 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:30:43.335 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:43.335 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:43.335 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:30:43.335 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:30:43.335 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:30:43.335 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:30:43.335 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:30:43.336 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:30:43.336 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:30:43.336 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:30:43.336 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:30:43.336 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:30:43.336 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:30:43.336 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:30:43.336 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:30:43.336 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:30:43.336 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:30:43.336 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:30:43.337 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:30:43.337 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:30:43.337 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:30:43.337 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:30:43.337 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:30:43.337 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:30:43.337 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:30:43.337 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:30:43.337 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:30:43.337 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:30:43.337 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:30:43.337 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:30:43.338 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:30:43.338 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:30:43.338 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:43.338 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:30:43.338 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:43.338 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:30:43.338 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:43.338 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:30:43.338 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:30:43.338 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:30:43.338 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:30:43.338 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:43.338 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:30:43.339 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:30:43.339 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:43.339 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:43.339 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:43.339 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:30:43.339 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:30:43.339 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:43.339 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:43.339 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:43.339 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:43.339 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:30:43.340 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:30:43.340 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:30:43.340 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:30:43.340 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:30:43.340 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:30:43.340 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:43.340 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:43.340 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:30:43.340 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:30:43.340 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:30:43.340 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:30:43.340 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:43.341 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:30:43.341 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:30:43.341 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:43.341 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:43.341 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:43.341 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:30:43.341 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:30:43.341 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:43.341 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:43.341 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:43.341 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:43.341 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:30:43.342 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:30:43.342 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:30:43.342 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:30:43.342 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:30:43.342 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:30:43.342 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:43.342 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:43.342 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:30:43.342 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:30:43.342 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:30:43.342 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:30:43.342 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:43.343 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:30:43.343 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:30:43.343 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:43.343 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:43.343 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:43.343 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:30:43.343 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:30:43.343 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:30:43.343 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:43.343 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:43.343 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:43.343 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:30:43.344 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:30:43.344 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:30:43.344 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:30:43.344 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:30:43.344 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:30:43.344 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:43.344 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:43.344 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:43.344 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:30:43.344 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:30:43.344 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:43.344 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:43.345 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:43.345 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:30:43.345 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:43.345 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:43.345 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:30:43.345 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:43.345 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:43.345 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:43.345 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:30:43.345 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:43.345 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:43.345 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:30:43.345 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:43.346 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:43.346 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:43.346 INFO:teuthology.orchestra.run.trial058.stdout: "num": 8 2026-02-23T06:30:43.346 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:43.346 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:43.346 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:30:43.346 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:43.346 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:30:43.346 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:30:43.346 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:30:43.346 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:43.346 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:43.347 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:43.347 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:43.347 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:30:43.347 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:43.347 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:30:43.347 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:30:43.347 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:30:43.347 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:30:43.347 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:30:43.347 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:30:43.347 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:30:43.347 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:30:43.348 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:30:43.348 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:30:43.348 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:30:43.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.335+0000 7f6f95803640 1 -- 10.20.193.58:0/2161137436 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6f6007a660 msgr2=0x7f6f6009ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:43.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.335+0000 7f6f95803640 1 --2- 10.20.193.58:0/2161137436 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6f6007a660 0x7f6f6009ab10 secure :-1 s=READY pgs=265 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f8c003810 tx=0x7f6f8c009040 comp rx=0 tx=0).stop 2026-02-23T06:30:43.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.335+0000 7f6f95803640 1 -- 10.20.193.58:0/2161137436 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6f900b6690 msgr2=0x7f6f901624f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:30:43.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.335+0000 7f6f95803640 1 --2- 10.20.193.58:0/2161137436 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6f900b6690 0x7f6f901624f0 secure :-1 s=READY pgs=161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f80009a20 tx=0x7f6f800028d0 comp rx=0 tx=0).stop 2026-02-23T06:30:43.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.335+0000 7f6f95002640 1 -- 10.20.193.58:0/2161137436 reap_dead start 2026-02-23T06:30:43.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.335+0000 7f6f95002640 1 -- 10.20.193.58:0/2161137436 reap_dead start 2026-02-23T06:30:43.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.335+0000 7f6f95803640 1 -- 10.20.193.58:0/2161137436 shutdown_connections 2026-02-23T06:30:43.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.335+0000 7f6f95803640 1 -- 10.20.193.58:0/2161137436 >> 10.20.193.58:0/2161137436 conn(0x7f6f900b3c20 msgr2=0x7f6f9005d100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:30:43.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.335+0000 7f6f95803640 1 -- 10.20.193.58:0/2161137436 shutdown_connections 2026-02-23T06:30:43.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:30:43.335+0000 7f6f95803640 1 -- 10.20.193.58:0/2161137436 wait complete. 2026-02-23T06:30:43.351 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:30:43.351 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:31:03.352 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-23T06:31:03.352 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-23T06:31:03.352 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-23T06:31:03.353 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-23T06:31:03.355 INFO:tasks.ceph.mon.b:Started 2026-02-23T06:31:03.355 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.c 2026-02-23T06:31:03.355 INFO:tasks.mon_thrash:Sending STOP to mon c 2026-02-23T06:31:03.356 INFO:tasks.ceph.mon.c:Sent signal 19 2026-02-23T06:31:03.356 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-23T06:31:13.006 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:31:13.012 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:31:18.357 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.c 2026-02-23T06:31:18.357 INFO:tasks.mon_thrash:Sending CONT to mon c 2026-02-23T06:31:18.357 INFO:tasks.ceph.mon.c:Sent signal 18 2026-02-23T06:31:18.357 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:31:18.357 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:31:18.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.483+0000 7facfc5cd640 1 -- 10.20.193.58:0/1737295159 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7facdc0040a0 msgr2=0x7facdc004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:18.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.483+0000 7facfc5cd640 1 --2- 10.20.193.58:0/1737295159 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7facdc0040a0 0x7facdc004850 secure :-1 s=READY pgs=41 gs=4 cs=0 l=1 c_cookie=3405380463096952040 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7face8003180 tx=0x7face802f8b0 comp rx=0 tx=0).stop 2026-02-23T06:31:18.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.483+0000 7facfab43640 1 -- 10.20.193.58:0/1737295159 reap_dead start 2026-02-23T06:31:18.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.483+0000 7facfc5cd640 1 -- 10.20.193.58:0/1737295159 shutdown_connections 2026-02-23T06:31:18.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.483+0000 7facfc5cd640 1 -- 10.20.193.58:0/1737295159 >> 10.20.193.58:0/1737295159 conn(0x7facf40561f0 msgr2=0x7facf40565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:31:18.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.483+0000 7facfc5cd640 1 -- 10.20.193.58:0/1737295159 shutdown_connections 2026-02-23T06:31:18.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.483+0000 7facfc5cd640 1 -- 10.20.193.58:0/1737295159 wait complete. 2026-02-23T06:31:18.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.485+0000 7facfc5cd640 1 Processor -- start 2026-02-23T06:31:18.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.485+0000 7facfc5cd640 1 -- start start 2026-02-23T06:31:18.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.485+0000 7facfc5cd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7facdc0040a0 0x7facf41654c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:18.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.485+0000 7facfc5cd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7facf405c750 0x7facf405bb70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:18.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.485+0000 7facfc5cd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7facf405c0b0 0x7facf415bd40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:18.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.485+0000 7facfc5cd640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7facf4162ad0 con 0x7facf405c0b0 2026-02-23T06:31:18.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.485+0000 7facfc5cd640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7facf4161f60 con 0x7facf405c750 2026-02-23T06:31:18.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.485+0000 7facfc5cd640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7facf41611a0 con 0x7facdc0040a0 2026-02-23T06:31:18.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.486+0000 7facfa342640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7facdc0040a0 0x7facf41654c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:18.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.486+0000 7facf9b41640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7facf405c750 0x7facf405bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:18.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.486+0000 7facfa342640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7facdc0040a0 0x7facf41654c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:39628/0 (socket says 10.20.193.58:39628) 2026-02-23T06:31:18.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.486+0000 7facfa342640 1 -- 10.20.193.58:0/208843899 learned_addr learned my addr 10.20.193.58:0/208843899 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:31:18.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.486+0000 7facfab43640 1 --2- 10.20.193.58:0/208843899 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7facf405c0b0 0x7facf415bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:18.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.486+0000 7facfa342640 1 -- 10.20.193.58:0/208843899 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7facf405c750 msgr2=0x7facf405bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:18.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.486+0000 7facfa342640 1 --2- 10.20.193.58:0/208843899 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7facf405c750 0x7facf405bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:18.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.486+0000 7facfa342640 1 -- 10.20.193.58:0/208843899 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7facf405c0b0 msgr2=0x7facf415bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:18.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.486+0000 7facfa342640 1 --2- 10.20.193.58:0/208843899 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7facf405c0b0 0x7facf415bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:18.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.486+0000 7facfa342640 1 -- 10.20.193.58:0/208843899 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facf4161480 con 0x7facdc0040a0 2026-02-23T06:31:18.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.486+0000 7facfa342640 1 --2- 10.20.193.58:0/208843899 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7facdc0040a0 0x7facf41654c0 secure :-1 s=READY pgs=169 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7face40040d0 tx=0x7face40099f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:18.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.486+0000 7facdaffd640 1 -- 10.20.193.58:0/208843899 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7face4010a00 con 0x7facdc0040a0 2026-02-23T06:31:18.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.486+0000 7facdaffd640 1 -- 10.20.193.58:0/208843899 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7face4010c50 con 0x7facdc0040a0 2026-02-23T06:31:18.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.486+0000 7facdaffd640 1 -- 10.20.193.58:0/208843899 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7face401a470 con 0x7facdc0040a0 2026-02-23T06:31:18.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.486+0000 7facfc5cd640 1 -- 10.20.193.58:0/208843899 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facf4161760 con 0x7facdc0040a0 2026-02-23T06:31:18.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.486+0000 7facfc5cd640 1 -- 10.20.193.58:0/208843899 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7facf41660d0 con 0x7facdc0040a0 2026-02-23T06:31:18.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.487+0000 7facfc5cd640 1 -- 10.20.193.58:0/208843899 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facf4161be0 con 0x7facdc0040a0 2026-02-23T06:31:18.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.488+0000 7facdaffd640 1 -- 10.20.193.58:0/208843899 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7face401a5d0 con 0x7facdc0040a0 2026-02-23T06:31:18.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.489+0000 7facdaffd640 1 --2- 10.20.193.58:0/208843899 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7facc407a640 0x7facc409aaf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:18.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.489+0000 7facdaffd640 1 -- 10.20.193.58:0/208843899 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7face409e420 con 0x7facdc0040a0 2026-02-23T06:31:18.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.489+0000 7facf9b41640 1 --2- 10.20.193.58:0/208843899 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7facc407a640 0x7facc409aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:18.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.490+0000 7facf9b41640 1 --2- 10.20.193.58:0/208843899 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7facc407a640 0x7facc409aaf0 secure :-1 s=READY pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7face8002b30 tx=0x7face80030b0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:18.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.491+0000 7facdaffd640 1 -- 10.20.193.58:0/208843899 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7face40650d0 con 0x7facdc0040a0 2026-02-23T06:31:18.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.645+0000 7facfc5cd640 1 -- 10.20.193.58:0/208843899 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7facf4058640 con 0x7facdc0040a0 2026-02-23T06:31:18.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.651+0000 7facdaffd640 1 -- 10.20.193.58:0/208843899 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1754 (secure 0 0 0) 0x7face4064820 con 0x7facdc0040a0 2026-02-23T06:31:18.647 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":82,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:31:18.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.652+0000 7facfc5cd640 1 -- 10.20.193.58:0/208843899 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7facc407a640 msgr2=0x7facc409aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:18.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.652+0000 7facfc5cd640 1 --2- 10.20.193.58:0/208843899 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7facc407a640 0x7facc409aaf0 secure :-1 s=READY pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7face8002b30 tx=0x7face80030b0 comp rx=0 tx=0).stop 2026-02-23T06:31:18.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.652+0000 7facfc5cd640 1 -- 10.20.193.58:0/208843899 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7facdc0040a0 msgr2=0x7facf41654c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:18.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.652+0000 7facfc5cd640 1 --2- 10.20.193.58:0/208843899 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7facdc0040a0 0x7facf41654c0 secure :-1 s=READY pgs=169 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7face40040d0 tx=0x7face40099f0 comp rx=0 tx=0).stop 2026-02-23T06:31:18.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.652+0000 7facfc5cd640 1 -- 10.20.193.58:0/208843899 shutdown_connections 2026-02-23T06:31:18.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.652+0000 7facfc5cd640 1 --2- 10.20.193.58:0/208843899 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7facc407a640 0x7facc409aaf0 unknown :-1 s=CLOSED pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:18.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.652+0000 7facfc5cd640 1 --2- 10.20.193.58:0/208843899 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7facf405c0b0 0x7facf415bd40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:18.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.652+0000 7facfc5cd640 1 --2- 10.20.193.58:0/208843899 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7facf405c750 0x7facf405bb70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:18.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.652+0000 7facfc5cd640 1 --2- 10.20.193.58:0/208843899 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7facdc0040a0 0x7facf41654c0 unknown :-1 s=CLOSED pgs=169 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:18.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.652+0000 7facfc5cd640 1 -- 10.20.193.58:0/208843899 >> 10.20.193.58:0/208843899 conn(0x7facf40561f0 msgr2=0x7facf415cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:31:18.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.652+0000 7facfc5cd640 1 -- 10.20.193.58:0/208843899 shutdown_connections 2026-02-23T06:31:18.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.652+0000 7facfc5cd640 1 -- 10.20.193.58:0/208843899 wait complete. 2026-02-23T06:31:18.660 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:31:18.660 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:31:18.660 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:31:18.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.788+0000 7f956b577640 1 -- 10.20.193.58:0/1841715280 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9558003ad0 msgr2=0x7f9558003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:18.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.788+0000 7f956b577640 1 --2- 10.20.193.58:0/1841715280 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9558003ad0 0x7f9558003ee0 secure :-1 s=READY pgs=43 gs=4 cs=0 l=1 c_cookie=5865415629429634077 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9560009b40 tx=0x7f956002fc20 comp rx=0 tx=0).stop 2026-02-23T06:31:18.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.788+0000 7f956ad76640 1 -- 10.20.193.58:0/1841715280 reap_dead start 2026-02-23T06:31:18.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.788+0000 7f956b577640 1 -- 10.20.193.58:0/1841715280 shutdown_connections 2026-02-23T06:31:18.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.788+0000 7f956b577640 1 -- 10.20.193.58:0/1841715280 >> 10.20.193.58:0/1841715280 conn(0x7f956c0b3c20 msgr2=0x7f956c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:31:18.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.788+0000 7f956b577640 1 -- 10.20.193.58:0/1841715280 shutdown_connections 2026-02-23T06:31:18.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.788+0000 7f956b577640 1 -- 10.20.193.58:0/1841715280 wait complete. 2026-02-23T06:31:18.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.789+0000 7f956b577640 1 Processor -- start 2026-02-23T06:31:18.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.789+0000 7f956b577640 1 -- start start 2026-02-23T06:31:18.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.789+0000 7f956b577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9558003ad0 0x7f956c0b55b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:18.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.789+0000 7f956b577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f956c121a60 0x7f956c0b00a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:18.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.789+0000 7f956b577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f956c121090 0x7f956c0b05e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:18.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.789+0000 7f956b577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f956c14e4a0 con 0x7f956c121a60 2026-02-23T06:31:18.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.789+0000 7f956b577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f956c159bf0 con 0x7f9558003ad0 2026-02-23T06:31:18.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.789+0000 7f956b577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f956c0b5af0 con 0x7f956c121090 2026-02-23T06:31:18.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.790+0000 7f9569d74640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f956c121a60 0x7f956c0b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:18.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.790+0000 7f9569d74640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f956c121a60 0x7f956c0b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:59760/0 (socket says 10.20.193.58:59760) 2026-02-23T06:31:18.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.790+0000 7f9569d74640 1 -- 10.20.193.58:0/433439523 learned_addr learned my addr 10.20.193.58:0/433439523 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:31:18.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.790+0000 7f956ad76640 1 --2- 10.20.193.58:0/433439523 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f956c121090 0x7f956c0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:18.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.790+0000 7f956a575640 1 --2- 10.20.193.58:0/433439523 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9558003ad0 0x7f956c0b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:18.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.790+0000 7f9569d74640 1 -- 10.20.193.58:0/433439523 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f956c121090 msgr2=0x7f956c0b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:18.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.790+0000 7f9569d74640 1 --2- 10.20.193.58:0/433439523 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f956c121090 0x7f956c0b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:18.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.790+0000 7f9569d74640 1 -- 10.20.193.58:0/433439523 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9558003ad0 msgr2=0x7f956c0b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:18.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.790+0000 7f9569d74640 1 --2- 10.20.193.58:0/433439523 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9558003ad0 0x7f956c0b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:18.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.790+0000 7f9569d74640 1 -- 10.20.193.58:0/433439523 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f956c13ebe0 con 0x7f956c121a60 2026-02-23T06:31:18.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.790+0000 7f9569d74640 1 --2- 10.20.193.58:0/433439523 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f956c121a60 0x7f956c0b00a0 secure :-1 s=READY pgs=44 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f955400e620 tx=0x7f955400eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:18.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.790+0000 7f9552ffd640 1 -- 10.20.193.58:0/433439523 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f955400ca80 con 0x7f956c121a60 2026-02-23T06:31:18.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.790+0000 7f9552ffd640 1 -- 10.20.193.58:0/433439523 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f955400ccf0 con 0x7f956c121a60 2026-02-23T06:31:18.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.790+0000 7f9552ffd640 1 -- 10.20.193.58:0/433439523 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f955400cea0 con 0x7f956c121a60 2026-02-23T06:31:18.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.790+0000 7f956b577640 1 -- 10.20.193.58:0/433439523 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f956c13eec0 con 0x7f956c121a60 2026-02-23T06:31:18.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.790+0000 7f956b577640 1 -- 10.20.193.58:0/433439523 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f956c14e0c0 con 0x7f956c121a60 2026-02-23T06:31:18.786 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.791+0000 7f956b577640 1 --2- 10.20.193.58:0/433439523 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f956c14e7c0 0x7f956c1242f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:18.786 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.791+0000 7f956b577640 1 -- 10.20.193.58:0/433439523 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f956c059690 con 0x7f956c14e7c0 2026-02-23T06:31:18.786 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.791+0000 7f956a575640 1 --2- 10.20.193.58:0/433439523 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f956c14e7c0 0x7f956c1242f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:18.786 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.791+0000 7f956a575640 1 -- 10.20.193.58:0/433439523 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f956c0593b0 con 0x7f956c14e7c0 2026-02-23T06:31:18.786 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.792+0000 7f956a575640 1 --2- 10.20.193.58:0/433439523 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f956c14e7c0 0x7f956c1242f0 secure :-1 s=READY pgs=45 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9560004740 tx=0x7f9560005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:18.786 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.792+0000 7f9552ffd640 1 -- 10.20.193.58:0/433439523 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9560042050 con 0x7f956c14e7c0 2026-02-23T06:31:18.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.792+0000 7f9552ffd640 1 -- 10.20.193.58:0/433439523 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f95540116e0 con 0x7f956c121a60 2026-02-23T06:31:18.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.793+0000 7f9552ffd640 1 --2- 10.20.193.58:0/433439523 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f953807a6b0 0x7f953809ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:18.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.793+0000 7f9552ffd640 1 -- 10.20.193.58:0/433439523 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f9560043040 con 0x7f956c14e7c0 2026-02-23T06:31:18.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.793+0000 7f9552ffd640 1 -- 10.20.193.58:0/433439523 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f956c14e7c0 msgr2=0x7f956c1242f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:18.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.793+0000 7f9552ffd640 1 --2- 10.20.193.58:0/433439523 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f956c14e7c0 0x7f956c1242f0 secure :-1 s=READY pgs=45 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9560004740 tx=0x7f9560005620 comp rx=0 tx=0).stop 2026-02-23T06:31:18.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.793+0000 7f9552ffd640 1 -- 10.20.193.58:0/433439523 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f956c14e7c0 msgr2=0x7f956c1242f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:31:18.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.793+0000 7f9552ffd640 1 --2- 10.20.193.58:0/433439523 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f956c14e7c0 0x7f956c1242f0 unknown :-1 s=CLOSED pgs=45 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:18.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.793+0000 7f9552ffd640 1 -- 10.20.193.58:0/433439523 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f955409db90 con 0x7f956c121a60 2026-02-23T06:31:18.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.793+0000 7f956ad76640 1 --2- 10.20.193.58:0/433439523 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f953807a6b0 0x7f953809ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:18.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.794+0000 7f956ad76640 1 --2- 10.20.193.58:0/433439523 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f953807a6b0 0x7f953809ab60 secure :-1 s=READY pgs=268 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f956c059b50 tx=0x7f955c003910 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:18.791 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.797+0000 7f956b577640 1 --2- 10.20.193.58:0/433439523 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f956c124830 0x7f956c124c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:18.791 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.797+0000 7f956b577640 1 -- 10.20.193.58:0/433439523 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f956c14dc40 con 0x7f956c124830 2026-02-23T06:31:18.792 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.797+0000 7f956a575640 1 --2- 10.20.193.58:0/433439523 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f956c124830 0x7f956c124c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:18.792 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.797+0000 7f956a575640 1 -- 10.20.193.58:0/433439523 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f956c125140 con 0x7f956c124830 2026-02-23T06:31:18.792 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.797+0000 7f956a575640 1 --2- 10.20.193.58:0/433439523 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f956c124830 0x7f956c124c00 secure :-1 s=READY pgs=46 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9560004740 tx=0x7f9560005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:18.792 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.798+0000 7f9552ffd640 1 -- 10.20.193.58:0/433439523 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9560054070 con 0x7f956c124830 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.798+0000 7f9552ffd640 1 -- 10.20.193.58:0/433439523 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4912 (secure 0 0 0) 0x7f9560004a60 con 0x7f956c124830 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.798+0000 7f9552ffd640 1 -- 10.20.193.58:0/433439523 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f956c124830 msgr2=0x7f956c124c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.798+0000 7f9552ffd640 1 --2- 10.20.193.58:0/433439523 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f956c124830 0x7f956c124c00 secure :-1 s=READY pgs=46 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9560004740 tx=0x7f9560005f90 comp rx=0 tx=0).stop 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.798+0000 7f9552ffd640 1 -- 10.20.193.58:0/433439523 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f956c124830 msgr2=0x7f956c124c00 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.798+0000 7f9552ffd640 1 --2- 10.20.193.58:0/433439523 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f956c124830 0x7f956c124c00 secure :-1 s=CLOSED pgs=46 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9560004740 tx=0x7f9560005f90 comp rx=0 tx=0).stop 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 82, 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 67615, 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:31:18.793 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:31:18.794 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:31:18.795 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:31:18.796 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:31:18.797 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:31:18.797 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:18.797 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:18.797 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:18.797 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:31:18.797 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:31:18.797 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:18.797 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:31:18.797 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:31:18.797 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:31:18.797 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:18.797 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:18.797 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:31:18.797 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:18.797 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:31:18.797 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:31:18.797 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:31:18.797 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:18.797 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:18.797 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:18.797 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:31:18.797 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:31:18.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.798+0000 7f956b577640 1 -- 10.20.193.58:0/433439523 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f953807a6b0 msgr2=0x7f953809ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:18.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.798+0000 7f956b577640 1 --2- 10.20.193.58:0/433439523 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f953807a6b0 0x7f953809ab60 secure :-1 s=READY pgs=268 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f956c059b50 tx=0x7f955c003910 comp rx=0 tx=0).stop 2026-02-23T06:31:18.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.798+0000 7f956b577640 1 -- 10.20.193.58:0/433439523 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f956c121a60 msgr2=0x7f956c0b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:18.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.798+0000 7f956b577640 1 --2- 10.20.193.58:0/433439523 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f956c121a60 0x7f956c0b00a0 secure :-1 s=READY pgs=44 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f955400e620 tx=0x7f955400eaf0 comp rx=0 tx=0).stop 2026-02-23T06:31:18.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.798+0000 7f956ad76640 1 -- 10.20.193.58:0/433439523 reap_dead start 2026-02-23T06:31:18.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.798+0000 7f956ad76640 1 -- 10.20.193.58:0/433439523 reap_dead start 2026-02-23T06:31:18.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.798+0000 7f956b577640 1 -- 10.20.193.58:0/433439523 shutdown_connections 2026-02-23T06:31:18.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.798+0000 7f956b577640 1 -- 10.20.193.58:0/433439523 >> 10.20.193.58:0/433439523 conn(0x7f956c0b3c20 msgr2=0x7f956c159e10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:31:18.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.798+0000 7f956b577640 1 -- 10.20.193.58:0/433439523 shutdown_connections 2026-02-23T06:31:18.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.798+0000 7f956b577640 1 -- 10.20.193.58:0/433439523 wait complete. 2026-02-23T06:31:18.799 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:31:18.799 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:31:18.799 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:31:18.922 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.927+0000 7f20e890b640 1 -- 10.20.193.58:0/2566212713 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f20e4162ca0 msgr2=0x7f20e4056fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:18.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.927+0000 7f20e890b640 1 --2- 10.20.193.58:0/2566212713 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f20e4162ca0 0x7f20e4056fc0 secure :-1 s=READY pgs=47 gs=2 cs=0 l=1 c_cookie=2753434014101038293 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20d4005820 tx=0x7f20d40302b0 comp rx=0 tx=0).stop 2026-02-23T06:31:18.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.927+0000 7f20e890b640 1 -- 10.20.193.58:0/2566212713 shutdown_connections 2026-02-23T06:31:18.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.927+0000 7f20e890b640 1 --2- 10.20.193.58:0/2566212713 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f20e4162ca0 0x7f20e4056fc0 unknown :-1 s=CLOSED pgs=47 gs=2 cs=0 l=1 c_cookie=2753434014101038293 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:18.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.927+0000 7f20e890b640 1 --2- 10.20.193.58:0/2566212713 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f20e4056960 0x7f20e4058200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:18.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.927+0000 7f20e890b640 1 -- 10.20.193.58:0/2566212713 >> 10.20.193.58:0/2566212713 conn(0x7f20e40b3c20 msgr2=0x7f20e40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:31:18.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.927+0000 7f20e890b640 1 -- 10.20.193.58:0/2566212713 shutdown_connections 2026-02-23T06:31:18.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.927+0000 7f20e890b640 1 -- 10.20.193.58:0/2566212713 wait complete. 2026-02-23T06:31:18.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.928+0000 7f20e890b640 1 Processor -- start 2026-02-23T06:31:18.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.928+0000 7f20e890b640 1 -- start start 2026-02-23T06:31:18.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.928+0000 7f20e890b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f20e4056960 0x7f20e413ad40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:18.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.928+0000 7f20e890b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f20e415c4b0 0x7f20e40b6a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:18.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.928+0000 7f20e890b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20e4162ca0 0x7f20e4159d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:18.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.929+0000 7f20e890b640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f20e417a720 con 0x7f20e415c4b0 2026-02-23T06:31:18.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.929+0000 7f20e890b640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f20e413a580 con 0x7f20e4162ca0 2026-02-23T06:31:18.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.929+0000 7f20e890b640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f20e413cd30 con 0x7f20e4056960 2026-02-23T06:31:18.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.929+0000 7f20e2d76640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f20e4056960 0x7f20e413ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:18.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.929+0000 7f20e2575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f20e415c4b0 0x7f20e40b6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:18.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.929+0000 7f20e2575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f20e415c4b0 0x7f20e40b6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:59782/0 (socket says 10.20.193.58:59782) 2026-02-23T06:31:18.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.929+0000 7f20e2575640 1 -- 10.20.193.58:0/678915550 learned_addr learned my addr 10.20.193.58:0/678915550 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:31:18.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.929+0000 7f20e3577640 1 --2- 10.20.193.58:0/678915550 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20e4162ca0 0x7f20e4159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:18.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.929+0000 7f20e2575640 1 -- 10.20.193.58:0/678915550 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f20e4056960 msgr2=0x7f20e413ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:18.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.929+0000 7f20e2575640 1 --2- 10.20.193.58:0/678915550 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f20e4056960 0x7f20e413ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:18.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.929+0000 7f20e2575640 1 -- 10.20.193.58:0/678915550 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20e4162ca0 msgr2=0x7f20e4159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:18.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.929+0000 7f20e2575640 1 --2- 10.20.193.58:0/678915550 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20e4162ca0 0x7f20e4159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:18.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.929+0000 7f20e2575640 1 -- 10.20.193.58:0/678915550 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d400a590 con 0x7f20e415c4b0 2026-02-23T06:31:18.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.929+0000 7f20e2d76640 1 --2- 10.20.193.58:0/678915550 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f20e4056960 0x7f20e413ad40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:31:18.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.929+0000 7f20e2575640 1 --2- 10.20.193.58:0/678915550 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f20e415c4b0 0x7f20e40b6a30 secure :-1 s=READY pgs=48 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20cc00e9c0 tx=0x7f20cc00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:18.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.929+0000 7f20c37fe640 1 -- 10.20.193.58:0/678915550 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f20cc00ccb0 con 0x7f20e415c4b0 2026-02-23T06:31:18.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.929+0000 7f20c37fe640 1 -- 10.20.193.58:0/678915550 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20cc00ce10 con 0x7f20e415c4b0 2026-02-23T06:31:18.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.929+0000 7f20c37fe640 1 -- 10.20.193.58:0/678915550 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f20cc004ad0 con 0x7f20e415c4b0 2026-02-23T06:31:18.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.929+0000 7f20e890b640 1 -- 10.20.193.58:0/678915550 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20e4138c70 con 0x7f20e415c4b0 2026-02-23T06:31:18.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.929+0000 7f20e890b640 1 -- 10.20.193.58:0/678915550 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20e417a970 con 0x7f20e415c4b0 2026-02-23T06:31:18.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.930+0000 7f20e890b640 1 --2- 10.20.193.58:0/678915550 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20e4133b00 0x7f20e415a2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:18.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.930+0000 7f20e890b640 1 -- 10.20.193.58:0/678915550 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f20e4139150 con 0x7f20e4133b00 2026-02-23T06:31:18.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.930+0000 7f20e2d76640 1 --2- 10.20.193.58:0/678915550 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20e4133b00 0x7f20e415a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:18.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.930+0000 7f20e2d76640 1 -- 10.20.193.58:0/678915550 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f20e4059690 con 0x7f20e4133b00 2026-02-23T06:31:18.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.931+0000 7f20e2d76640 1 --2- 10.20.193.58:0/678915550 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20e4133b00 0x7f20e415a2c0 secure :-1 s=READY pgs=6 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20d80029a0 tx=0x7f20d800eba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:18.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.931+0000 7f20c37fe640 1 -- 10.20.193.58:0/678915550 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f20d8002c90 con 0x7f20e4133b00 2026-02-23T06:31:18.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.931+0000 7f20c37fe640 1 -- 10.20.193.58:0/678915550 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f20d8002df0 con 0x7f20e4133b00 2026-02-23T06:31:18.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.931+0000 7f20c37fe640 1 -- 10.20.193.58:0/678915550 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20e4133b00 msgr2=0x7f20e415a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:18.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.931+0000 7f20c37fe640 1 --2- 10.20.193.58:0/678915550 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20e4133b00 0x7f20e415a2c0 secure :-1 s=READY pgs=6 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20d80029a0 tx=0x7f20d800eba0 comp rx=0 tx=0).stop 2026-02-23T06:31:18.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.931+0000 7f20c37fe640 1 -- 10.20.193.58:0/678915550 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20e4133b00 msgr2=0x7f20e415a2c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:31:18.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.931+0000 7f20c37fe640 1 --2- 10.20.193.58:0/678915550 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20e4133b00 0x7f20e415a2c0 unknown :-1 s=CLOSED pgs=6 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:18.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.931+0000 7f20c37fe640 1 -- 10.20.193.58:0/678915550 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f20cc01f060 con 0x7f20e415c4b0 2026-02-23T06:31:18.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.932+0000 7f20c37fe640 1 --2- 10.20.193.58:0/678915550 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f20b007a3c0 0x7f20b009a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:18.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.932+0000 7f20c37fe640 1 -- 10.20.193.58:0/678915550 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f20cc014070 con 0x7f20e415c4b0 2026-02-23T06:31:18.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.932+0000 7f20e2d76640 1 --2- 10.20.193.58:0/678915550 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f20b007a3c0 0x7f20b009a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:18.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.933+0000 7f20e2d76640 1 --2- 10.20.193.58:0/678915550 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f20b007a3c0 0x7f20b009a870 secure :-1 s=READY pgs=269 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20d8015040 tx=0x7f20d8012000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:18.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.935+0000 7f20e890b640 1 --2- 10.20.193.58:0/678915550 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20e4139970 0x7f20e415a800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:18.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.935+0000 7f20e890b640 1 -- 10.20.193.58:0/678915550 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f20e40593b0 con 0x7f20e4139970 2026-02-23T06:31:18.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.935+0000 7f20e3577640 1 --2- 10.20.193.58:0/678915550 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20e4139970 0x7f20e415a800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:18.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.935+0000 7f20e3577640 1 -- 10.20.193.58:0/678915550 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f20e415c880 con 0x7f20e4139970 2026-02-23T06:31:18.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.936+0000 7f20e3577640 1 --2- 10.20.193.58:0/678915550 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20e4139970 0x7f20e415a800 secure :-1 s=READY pgs=7 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20d4005820 tx=0x7f20d4003af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:18.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.936+0000 7f20c37fe640 1 -- 10.20.193.58:0/678915550 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f20d4039690 con 0x7f20e4139970 2026-02-23T06:31:18.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.936+0000 7f20c37fe640 1 -- 10.20.193.58:0/678915550 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4910 (secure 0 0 0) 0x7f20d4003e10 con 0x7f20e4139970 2026-02-23T06:31:18.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.936+0000 7f20c37fe640 1 -- 10.20.193.58:0/678915550 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20e4139970 msgr2=0x7f20e415a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:18.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.936+0000 7f20c37fe640 1 --2- 10.20.193.58:0/678915550 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20e4139970 0x7f20e415a800 secure :-1 s=READY pgs=7 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20d4005820 tx=0x7f20d4003af0 comp rx=0 tx=0).stop 2026-02-23T06:31:18.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.936+0000 7f20c37fe640 1 -- 10.20.193.58:0/678915550 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20e4139970 msgr2=0x7f20e415a800 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:31:18.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.936+0000 7f20c37fe640 1 --2- 10.20.193.58:0/678915550 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20e4139970 0x7f20e415a800 unknown :-1 s=CLOSED pgs=7 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:18.933 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:31:18.933 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:31:18.933 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:31:18.934 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:31:18.934 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 82, 2026-02-23T06:31:18.934 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 15513, 2026-02-23T06:31:18.934 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:31:18.934 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:31:18.934 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:31:18.934 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:31:18.934 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:18.934 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:31:18.934 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:31:18.934 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:31:18.934 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:31:18.935 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:31:18.935 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:31:18.935 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:31:18.935 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:31:18.935 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:31:18.935 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:31:18.935 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:31:18.935 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:31:18.935 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:31:18.935 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:31:18.935 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:31:18.935 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:31:18.936 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:31:18.936 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:18.936 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:31:18.936 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:31:18.936 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:31:18.936 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:31:18.936 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:31:18.936 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:31:18.936 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:31:18.936 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:31:18.936 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:31:18.936 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:31:18.937 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:31:18.937 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:31:18.937 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:31:18.937 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:31:18.937 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:31:18.937 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:18.937 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:18.937 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:31:18.937 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:31:18.937 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:31:18.937 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:31:18.937 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:31:18.938 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:31:18.938 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:31:18.938 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:31:18.938 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:31:18.938 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:31:18.938 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:31:18.938 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:31:18.938 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:31:18.938 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:31:18.938 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:31:18.938 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:31:18.938 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:31:18.939 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:31:18.939 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:31:18.939 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:31:18.939 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:31:18.939 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:31:18.939 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:31:18.939 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:31:18.939 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:31:18.939 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:31:18.939 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:31:18.939 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:31:18.939 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:31:18.940 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:31:18.940 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:18.940 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:31:18.940 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:18.940 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:31:18.940 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:18.940 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:31:18.940 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:31:18.940 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:31:18.940 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:31:18.940 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:18.940 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:31:18.941 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:31:18.941 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:18.941 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:18.941 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:18.941 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:31:18.941 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:31:18.941 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:18.941 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:18.941 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:18.941 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:18.941 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:31:18.941 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:31:18.942 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:31:18.942 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:31:18.942 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:31:18.942 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:31:18.942 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:18.942 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:18.942 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:31:18.942 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:31:18.942 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:31:18.942 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:31:18.942 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:18.942 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:31:18.943 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:31:18.943 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:18.943 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:18.943 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:18.943 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:31:18.943 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:31:18.943 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:18.943 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:18.943 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:18.943 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:18.943 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:31:18.943 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:31:18.944 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:31:18.944 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:31:18.944 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:31:18.944 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:31:18.944 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:18.944 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:18.944 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:31:18.944 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:31:18.944 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:31:18.944 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:31:18.944 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:18.944 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:31:18.944 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:31:18.945 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:18.945 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:18.945 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:18.945 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:31:18.945 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:31:18.945 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:18.945 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:18.945 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:18.945 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:18.945 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:31:18.945 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:31:18.945 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:31:18.946 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:31:18.946 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:31:18.946 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:31:18.946 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:18.946 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:18.946 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:18.946 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:31:18.946 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:31:18.946 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:18.946 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:31:18.946 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:31:18.946 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:31:18.947 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:18.947 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:18.947 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:31:18.947 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:18.947 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:31:18.947 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:31:18.947 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:31:18.947 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:18.947 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:18.947 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:18.947 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:31:18.947 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:31:18.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.936+0000 7f20e890b640 1 -- 10.20.193.58:0/678915550 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f20b007a3c0 msgr2=0x7f20b009a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:18.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.936+0000 7f20e890b640 1 --2- 10.20.193.58:0/678915550 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f20b007a3c0 0x7f20b009a870 secure :-1 s=READY pgs=269 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20d8015040 tx=0x7f20d8012000 comp rx=0 tx=0).stop 2026-02-23T06:31:18.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.937+0000 7f20e3577640 1 -- 10.20.193.58:0/678915550 reap_dead start 2026-02-23T06:31:18.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.937+0000 7f20e890b640 1 -- 10.20.193.58:0/678915550 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f20e415c4b0 msgr2=0x7f20e40b6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:18.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.937+0000 7f20e890b640 1 --2- 10.20.193.58:0/678915550 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f20e415c4b0 0x7f20e40b6a30 secure :-1 s=READY pgs=48 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20cc00e9c0 tx=0x7f20cc00ee90 comp rx=0 tx=0).stop 2026-02-23T06:31:18.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.937+0000 7f20e890b640 1 -- 10.20.193.58:0/678915550 shutdown_connections 2026-02-23T06:31:18.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.937+0000 7f20e890b640 1 --2- 10.20.193.58:0/678915550 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f20e415c4b0 0x7f20e40b6a30 unknown :-1 s=CLOSED pgs=48 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:18.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.937+0000 7f20e890b640 1 -- 10.20.193.58:0/678915550 >> 10.20.193.58:0/678915550 conn(0x7f20e40b3c20 msgr2=0x7f20e40b1260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:31:18.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.937+0000 7f20e890b640 1 -- 10.20.193.58:0/678915550 shutdown_connections 2026-02-23T06:31:18.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:18.937+0000 7f20e890b640 1 -- 10.20.193.58:0/678915550 wait complete. 2026-02-23T06:31:18.950 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:31:18.951 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:31:18.951 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:31:19.074 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.078+0000 7f948133f640 1 -- 10.20.193.58:0/373745385 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f947c15d870 msgr2=0x7f947c0587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:19.074 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.078+0000 7f948133f640 1 --2- 10.20.193.58:0/373745385 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f947c15d870 0x7f947c0587b0 secure :-1 s=READY pgs=50 gs=2 cs=0 l=1 c_cookie=6974847394221848328 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f947c0afed0 tx=0x7f946c02f190 comp rx=0 tx=0).stop 2026-02-23T06:31:19.074 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.078+0000 7f948133f640 1 -- 10.20.193.58:0/373745385 shutdown_connections 2026-02-23T06:31:19.074 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.078+0000 7f948133f640 1 --2- 10.20.193.58:0/373745385 >> v2:10.20.193.93:3300/0 conn(0x7f947c0b6690 0x7f947c058cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:19.074 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.078+0000 7f948133f640 1 --2- 10.20.193.58:0/373745385 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f947c15d870 0x7f947c0587b0 unknown :-1 s=CLOSED pgs=50 gs=2 cs=0 l=1 c_cookie=6974847394221848328 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:19.074 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.078+0000 7f948133f640 1 -- 10.20.193.58:0/373745385 >> 10.20.193.58:0/373745385 conn(0x7f947c0b3c20 msgr2=0x7f947c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:31:19.074 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.078+0000 7f948133f640 1 -- 10.20.193.58:0/373745385 shutdown_connections 2026-02-23T06:31:19.075 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.078+0000 7f948133f640 1 -- 10.20.193.58:0/373745385 wait complete. 2026-02-23T06:31:19.077 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.079+0000 7f948133f640 1 Processor -- start 2026-02-23T06:31:19.077 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.080+0000 7f948133f640 1 -- start start 2026-02-23T06:31:19.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.080+0000 7f948133f640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f947c0b6690 0x7f947c14d0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:19.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.080+0000 7f948133f640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f947c15d4a0 0x7f947c14a660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:19.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.080+0000 7f948133f640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f947c15d870 0x7f947c11f280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:19.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.080+0000 7f948133f640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f947c14a240 con 0x7f947c15d4a0 2026-02-23T06:31:19.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.080+0000 7f948133f640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f947c11f7c0 con 0x7f947c0b6690 2026-02-23T06:31:19.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.080+0000 7f948133f640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f947c149bc0 con 0x7f947c15d870 2026-02-23T06:31:19.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.080+0000 7f947b7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f947c15d4a0 0x7f947c14a660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:19.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.080+0000 7f947b7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f947c15d4a0 0x7f947c14a660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:59796/0 (socket says 10.20.193.58:59796) 2026-02-23T06:31:19.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.080+0000 7f947b7fe640 1 -- 10.20.193.58:0/3713493914 learned_addr learned my addr 10.20.193.58:0/3713493914 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:31:19.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.080+0000 7f947bfff640 1 --2- 10.20.193.58:0/3713493914 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f947c0b6690 0x7f947c14d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:19.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.080+0000 7f9480b3e640 1 --2- 10.20.193.58:0/3713493914 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f947c15d870 0x7f947c11f280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:19.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.081+0000 7f947b7fe640 1 -- 10.20.193.58:0/3713493914 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f947c15d870 msgr2=0x7f947c11f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:19.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.081+0000 7f947b7fe640 1 --2- 10.20.193.58:0/3713493914 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f947c15d870 0x7f947c11f280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:19.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.081+0000 7f947b7fe640 1 -- 10.20.193.58:0/3713493914 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f947c0b6690 msgr2=0x7f947c14d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:19.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.081+0000 7f947b7fe640 1 --2- 10.20.193.58:0/3713493914 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f947c0b6690 0x7f947c14d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:19.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.081+0000 7f947b7fe640 1 -- 10.20.193.58:0/3713493914 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f946c0094b0 con 0x7f947c15d4a0 2026-02-23T06:31:19.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.081+0000 7f947bfff640 1 --2- 10.20.193.58:0/3713493914 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f947c0b6690 0x7f947c14d0a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:31:19.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.081+0000 7f947b7fe640 1 --2- 10.20.193.58:0/3713493914 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f947c15d4a0 0x7f947c14a660 secure :-1 s=READY pgs=51 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f946c004740 tx=0x7f946c002950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:19.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.081+0000 7f9478ff9640 1 -- 10.20.193.58:0/3713493914 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f946c038470 con 0x7f947c15d4a0 2026-02-23T06:31:19.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.081+0000 7f9478ff9640 1 -- 10.20.193.58:0/3713493914 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f946c0386c0 con 0x7f947c15d4a0 2026-02-23T06:31:19.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.081+0000 7f948133f640 1 -- 10.20.193.58:0/3713493914 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f947c056c30 con 0x7f947c15d4a0 2026-02-23T06:31:19.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.081+0000 7f9478ff9640 1 -- 10.20.193.58:0/3713493914 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f946c038ab0 con 0x7f947c15d4a0 2026-02-23T06:31:19.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.081+0000 7f948133f640 1 -- 10.20.193.58:0/3713493914 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f947c11e230 con 0x7f947c15d4a0 2026-02-23T06:31:19.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.082+0000 7f948133f640 1 --2- 10.20.193.58:0/3713493914 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f947c149d80 0x7f947c1228b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:19.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.082+0000 7f948133f640 1 -- 10.20.193.58:0/3713493914 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f947c0b6330 con 0x7f947c149d80 2026-02-23T06:31:19.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.082+0000 7f947bfff640 1 --2- 10.20.193.58:0/3713493914 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f947c149d80 0x7f947c1228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:19.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.082+0000 7f947bfff640 1 -- 10.20.193.58:0/3713493914 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f947c0b5e10 con 0x7f947c149d80 2026-02-23T06:31:19.081 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.083+0000 7f947bfff640 1 --2- 10.20.193.58:0/3713493914 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f947c149d80 0x7f947c1228b0 secure :-1 s=READY pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9468007fd0 tx=0x7f946800eba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:19.081 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.083+0000 7f9478ff9640 1 -- 10.20.193.58:0/3713493914 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f946800cae0 con 0x7f947c149d80 2026-02-23T06:31:19.081 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.083+0000 7f9478ff9640 1 -- 10.20.193.58:0/3713493914 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f946c038c10 con 0x7f947c15d4a0 2026-02-23T06:31:19.081 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.084+0000 7f9478ff9640 1 --2- 10.20.193.58:0/3713493914 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f944c07a660 0x7f944c09ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:19.081 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.084+0000 7f9478ff9640 1 -- 10.20.193.58:0/3713493914 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f946c0c29b0 con 0x7f947c15d4a0 2026-02-23T06:31:19.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.084+0000 7f9478ff9640 1 -- 10.20.193.58:0/3713493914 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f946800ee60 con 0x7f947c149d80 2026-02-23T06:31:19.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.084+0000 7f9478ff9640 1 -- 10.20.193.58:0/3713493914 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f947c149d80 msgr2=0x7f947c1228b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:19.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.084+0000 7f9478ff9640 1 --2- 10.20.193.58:0/3713493914 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f947c149d80 0x7f947c1228b0 secure :-1 s=READY pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9468007fd0 tx=0x7f946800eba0 comp rx=0 tx=0).stop 2026-02-23T06:31:19.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.084+0000 7f9478ff9640 1 -- 10.20.193.58:0/3713493914 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f947c149d80 msgr2=0x7f947c1228b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:31:19.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.084+0000 7f9478ff9640 1 --2- 10.20.193.58:0/3713493914 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f947c149d80 0x7f947c1228b0 secure :-1 s=CLOSED pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9468007fd0 tx=0x7f946800eba0 comp rx=0 tx=0).stop 2026-02-23T06:31:19.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.084+0000 7f9480b3e640 1 --2- 10.20.193.58:0/3713493914 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f944c07a660 0x7f944c09ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:19.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.085+0000 7f9480b3e640 1 --2- 10.20.193.58:0/3713493914 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f944c07a660 0x7f944c09ab10 secure :-1 s=READY pgs=270 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9470005820 tx=0x7f947000a310 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:19.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.087+0000 7f948133f640 1 --2- 10.20.193.58:0/3713493914 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f947c13c1b0 0x7f947c13c5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:19.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.087+0000 7f948133f640 1 -- 10.20.193.58:0/3713493914 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f947c164250 con 0x7f947c13c1b0 2026-02-23T06:31:19.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.088+0000 7f947bfff640 1 --2- 10.20.193.58:0/3713493914 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f947c13c1b0 0x7f947c13c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:19.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.088+0000 7f947bfff640 1 -- 10.20.193.58:0/3713493914 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f947c0b6d50 con 0x7f947c13c1b0 2026-02-23T06:31:19.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.088+0000 7f947bfff640 1 --2- 10.20.193.58:0/3713493914 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f947c13c1b0 0x7f947c13c5b0 secure :-1 s=READY pgs=171 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9468007cd0 tx=0x7f9468002850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:19.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.088+0000 7f9478ff9640 1 -- 10.20.193.58:0/3713493914 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9468022070 con 0x7f947c13c1b0 2026-02-23T06:31:19.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.089+0000 7f9478ff9640 1 -- 10.20.193.58:0/3713493914 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5555 (secure 0 0 0) 0x7f9468013850 con 0x7f947c13c1b0 2026-02-23T06:31:19.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.089+0000 7f9478ff9640 1 -- 10.20.193.58:0/3713493914 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f947c13c1b0 msgr2=0x7f947c13c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:19.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.089+0000 7f9478ff9640 1 --2- 10.20.193.58:0/3713493914 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f947c13c1b0 0x7f947c13c5b0 secure :-1 s=READY pgs=171 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9468007cd0 tx=0x7f9468002850 comp rx=0 tx=0).stop 2026-02-23T06:31:19.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.089+0000 7f9478ff9640 1 -- 10.20.193.58:0/3713493914 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f947c13c1b0 msgr2=0x7f947c13c5b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:31:19.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.089+0000 7f9478ff9640 1 --2- 10.20.193.58:0/3713493914 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f947c13c1b0 0x7f947c13c5b0 secure :-1 s=CLOSED pgs=171 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9468007cd0 tx=0x7f9468002850 comp rx=0 tx=0).stop 2026-02-23T06:31:19.085 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:31:19.085 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:31:19.085 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:31:19.086 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:31:19.086 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 82, 2026-02-23T06:31:19.086 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 353600, 2026-02-23T06:31:19.086 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:31:19.086 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:31:19.086 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:31:19.086 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:31:19.086 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:19.086 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:31:19.086 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:31:19.086 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:31:19.087 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:31:19.087 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:31:19.087 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:31:19.087 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:31:19.087 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:31:19.087 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:31:19.087 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:31:19.087 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:31:19.087 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:31:19.087 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:31:19.087 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:31:19.087 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:31:19.087 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:31:19.088 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:31:19.088 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:19.088 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:31:19.088 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:31:19.088 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:31:19.088 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:31:19.088 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:31:19.088 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:31:19.088 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:31:19.088 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:31:19.088 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:31:19.089 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:31:19.089 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:31:19.089 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:31:19.089 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:31:19.089 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:31:19.089 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:31:19.089 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:19.089 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:19.089 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:31:19.089 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:31:19.089 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:31:19.089 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:31:19.090 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:31:19.090 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:31:19.090 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:31:19.090 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:31:19.090 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:31:19.090 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:31:19.090 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:31:19.090 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:31:19.090 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:31:19.090 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:31:19.090 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:31:19.090 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:31:19.091 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:31:19.091 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:31:19.091 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:31:19.091 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:31:19.091 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:31:19.091 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:31:19.091 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:31:19.091 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:31:19.091 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:31:19.091 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:31:19.091 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:31:19.091 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:31:19.091 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:31:19.092 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:31:19.092 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:19.092 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:31:19.092 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:19.092 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:31:19.092 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:19.092 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:31:19.092 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:31:19.092 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:31:19.092 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:31:19.092 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:19.092 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:31:19.092 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:31:19.093 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:19.093 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:19.093 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:19.093 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:31:19.093 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:31:19.093 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:19.093 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:19.093 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:19.093 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:19.093 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:31:19.093 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:31:19.093 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:31:19.093 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:31:19.093 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:31:19.094 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:31:19.094 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:19.094 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:19.094 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:31:19.094 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:31:19.094 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:31:19.094 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:31:19.094 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:19.094 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:31:19.094 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:31:19.094 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:19.094 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:19.094 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:19.094 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:31:19.094 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:31:19.095 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:19.095 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:19.095 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:19.095 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:19.095 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:31:19.095 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:31:19.095 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:31:19.095 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:31:19.095 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:31:19.095 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:31:19.095 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:19.095 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:19.095 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:31:19.095 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:31:19.095 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:31:19.096 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:31:19.096 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:19.096 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:31:19.096 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:31:19.096 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:19.096 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:19.096 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:19.096 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:31:19.096 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:31:19.096 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:19.096 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:19.096 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:19.096 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:19.096 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:31:19.096 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:31:19.097 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:31:19.097 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:31:19.097 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:31:19.097 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:31:19.097 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:19.097 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:19.097 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:19.097 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:31:19.097 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:31:19.097 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:19.097 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:31:19.097 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:31:19.097 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:31:19.097 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:19.097 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:19.097 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:31:19.098 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:19.098 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:31:19.098 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:31:19.098 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:31:19.098 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:19.098 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:19.098 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:31:19.098 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:19.098 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:31:19.098 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:31:19.098 INFO:teuthology.orchestra.run.trial058.stdout: "num": 8 2026-02-23T06:31:19.098 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:19.098 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:19.098 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:31:19.098 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:19.098 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:31:19.099 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:31:19.099 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:31:19.099 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:19.099 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:19.099 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:31:19.099 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:31:19.099 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:31:19.099 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:19.099 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:19.099 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:31:19.099 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:19.099 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:31:19.099 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:31:19.099 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:31:19.099 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:19.099 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:19.100 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:19.100 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:31:19.100 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:31:19.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.089+0000 7f948133f640 1 -- 10.20.193.58:0/3713493914 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f944c07a660 msgr2=0x7f944c09ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:19.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.089+0000 7f948133f640 1 --2- 10.20.193.58:0/3713493914 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f944c07a660 0x7f944c09ab10 secure :-1 s=READY pgs=270 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9470005820 tx=0x7f947000a310 comp rx=0 tx=0).stop 2026-02-23T06:31:19.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.089+0000 7f948133f640 1 -- 10.20.193.58:0/3713493914 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f947c15d4a0 msgr2=0x7f947c14a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:19.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.089+0000 7f948133f640 1 --2- 10.20.193.58:0/3713493914 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f947c15d4a0 0x7f947c14a660 secure :-1 s=READY pgs=51 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f946c004740 tx=0x7f946c002950 comp rx=0 tx=0).stop 2026-02-23T06:31:19.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.089+0000 7f9480b3e640 1 -- 10.20.193.58:0/3713493914 reap_dead start 2026-02-23T06:31:19.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.089+0000 7f9480b3e640 1 -- 10.20.193.58:0/3713493914 reap_dead start 2026-02-23T06:31:19.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.089+0000 7f948133f640 1 -- 10.20.193.58:0/3713493914 shutdown_connections 2026-02-23T06:31:19.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.089+0000 7f948133f640 1 -- 10.20.193.58:0/3713493914 >> 10.20.193.58:0/3713493914 conn(0x7f947c0b3c20 msgr2=0x7f947c15ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:31:19.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.089+0000 7f948133f640 1 -- 10.20.193.58:0/3713493914 shutdown_connections 2026-02-23T06:31:19.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.089+0000 7f948133f640 1 -- 10.20.193.58:0/3713493914 wait complete. 2026-02-23T06:31:19.102 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:31:19.102 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:31:19.102 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:31:19.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.229+0000 7ff25cd75640 1 -- 10.20.193.58:0/3496646903 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff25815d4a0 msgr2=0x7ff2580affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:19.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.229+0000 7ff25cd75640 1 --2- 10.20.193.58:0/3496646903 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff25815d4a0 0x7ff2580affb0 secure :-1 s=READY pgs=8 gs=3 cs=0 l=1 c_cookie=13681420626521727345 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2580b5040 tx=0x7ff24402f1b0 comp rx=0 tx=0).stop 2026-02-23T06:31:19.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.229+0000 7ff25cd75640 1 -- 10.20.193.58:0/3496646903 shutdown_connections 2026-02-23T06:31:19.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.229+0000 7ff25cd75640 1 --2- 10.20.193.58:0/3496646903 >> v2:10.20.193.58:3300/0 conn(0x7ff2580b6690 0x7ff258058cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:19.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.229+0000 7ff25cd75640 1 --2- 10.20.193.58:0/3496646903 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff25815d870 0x7ff2580587b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:19.225 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.229+0000 7ff25cd75640 1 --2- 10.20.193.58:0/3496646903 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff25815d4a0 0x7ff2580affb0 unknown :-1 s=CLOSED pgs=8 gs=3 cs=0 l=1 c_cookie=13681420626521727345 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:19.225 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.229+0000 7ff25cd75640 1 -- 10.20.193.58:0/3496646903 >> 10.20.193.58:0/3496646903 conn(0x7ff2580b3c20 msgr2=0x7ff2580b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:31:19.225 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.229+0000 7ff25cd75640 1 -- 10.20.193.58:0/3496646903 shutdown_connections 2026-02-23T06:31:19.225 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.229+0000 7ff25cd75640 1 -- 10.20.193.58:0/3496646903 wait complete. 2026-02-23T06:31:19.225 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.230+0000 7ff25cd75640 1 Processor -- start 2026-02-23T06:31:19.225 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.230+0000 7ff25cd75640 1 -- start start 2026-02-23T06:31:19.226 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.231+0000 7ff25cd75640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff2580b6690 0x7ff2581240a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:19.226 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.231+0000 7ff25cd75640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff25815d4a0 0x7ff25811f7e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:19.226 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.231+0000 7ff25cd75640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff25815d870 0x7ff25814daf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:19.226 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.231+0000 7ff25cd75640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff258120480 con 0x7ff25815d870 2026-02-23T06:31:19.226 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.231+0000 7ff25cd75640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff25811e430 con 0x7ff2580b6690 2026-02-23T06:31:19.226 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.231+0000 7ff25cd75640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7ff2581247e0 con 0x7ff25815d4a0 2026-02-23T06:31:19.226 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.231+0000 7ff2577fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff2580b6690 0x7ff2581240a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:19.226 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.231+0000 7ff256ffd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff25815d4a0 0x7ff25811f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:19.226 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.231+0000 7ff256ffd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff25815d4a0 0x7ff25811f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:34998/0 (socket says 10.20.193.58:34998) 2026-02-23T06:31:19.226 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.231+0000 7ff2577fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff2580b6690 0x7ff2581240a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:55644/0 (socket says 10.20.193.58:55644) 2026-02-23T06:31:19.226 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.231+0000 7ff256ffd640 1 -- 10.20.193.58:0/1258550597 learned_addr learned my addr 10.20.193.58:0/1258550597 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:31:19.226 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.231+0000 7ff257fff640 1 --2- 10.20.193.58:0/1258550597 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff25815d870 0x7ff25814daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:19.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.232+0000 7ff2577fe640 1 -- 10.20.193.58:0/1258550597 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff25815d4a0 msgr2=0x7ff25811f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:19.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.232+0000 7ff2577fe640 1 --2- 10.20.193.58:0/1258550597 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff25815d4a0 0x7ff25811f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:19.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.232+0000 7ff2577fe640 1 -- 10.20.193.58:0/1258550597 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff25815d870 msgr2=0x7ff25814daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:19.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.232+0000 7ff2577fe640 1 --2- 10.20.193.58:0/1258550597 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff25815d870 0x7ff25814daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:19.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.232+0000 7ff2577fe640 1 -- 10.20.193.58:0/1258550597 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff24c00a590 con 0x7ff2580b6690 2026-02-23T06:31:19.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.232+0000 7ff2577fe640 1 --2- 10.20.193.58:0/1258550597 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff2580b6690 0x7ff2581240a0 secure :-1 s=READY pgs=9 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2580b56b0 tx=0x7ff2440028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:19.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.232+0000 7ff233fff640 1 -- 10.20.193.58:0/1258550597 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff24403d070 con 0x7ff2580b6690 2026-02-23T06:31:19.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.232+0000 7ff233fff640 1 -- 10.20.193.58:0/1258550597 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff244002e70 con 0x7ff2580b6690 2026-02-23T06:31:19.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.232+0000 7ff25cd75640 1 -- 10.20.193.58:0/1258550597 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2440094b0 con 0x7ff2580b6690 2026-02-23T06:31:19.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.232+0000 7ff233fff640 1 -- 10.20.193.58:0/1258550597 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff244004ab0 con 0x7ff2580b6690 2026-02-23T06:31:19.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.232+0000 7ff25cd75640 1 -- 10.20.193.58:0/1258550597 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff258120940 con 0x7ff2580b6690 2026-02-23T06:31:19.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.233+0000 7ff25cd75640 1 -- 10.20.193.58:0/1258550597 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff258163130 con 0x7ff2580b6690 2026-02-23T06:31:19.229 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.234+0000 7ff233fff640 1 -- 10.20.193.58:0/1258550597 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7ff244065a80 con 0x7ff2580b6690 2026-02-23T06:31:19.230 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.235+0000 7ff233fff640 1 --2- 10.20.193.58:0/1258550597 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff22807a6c0 0x7ff22809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:19.230 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.235+0000 7ff233fff640 1 -- 10.20.193.58:0/1258550597 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7ff2440c20e0 con 0x7ff2580b6690 2026-02-23T06:31:19.230 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.235+0000 7ff256ffd640 1 --2- 10.20.193.58:0/1258550597 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff22807a6c0 0x7ff22809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:19.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.236+0000 7ff233fff640 1 -- 10.20.193.58:0/1258550597 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7ff2440853b0 con 0x7ff2580b6690 2026-02-23T06:31:19.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.236+0000 7ff256ffd640 1 --2- 10.20.193.58:0/1258550597 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff22807a6c0 0x7ff22809ab70 secure :-1 s=READY pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff248005970 tx=0x7ff248009310 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:19.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.391+0000 7ff25cd75640 1 -- 10.20.193.58:0/1258550597 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7ff25813bb30 con 0x7ff2580b6690 2026-02-23T06:31:19.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.392+0000 7ff233fff640 1 -- 10.20.193.58:0/1258550597 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7ff244005d40 con 0x7ff2580b6690 2026-02-23T06:31:19.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.393+0000 7ff25cd75640 1 -- 10.20.193.58:0/1258550597 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff22807a6c0 msgr2=0x7ff22809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:19.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.393+0000 7ff25cd75640 1 --2- 10.20.193.58:0/1258550597 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff22807a6c0 0x7ff22809ab70 secure :-1 s=READY pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff248005970 tx=0x7ff248009310 comp rx=0 tx=0).stop 2026-02-23T06:31:19.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.393+0000 7ff25cd75640 1 -- 10.20.193.58:0/1258550597 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff2580b6690 msgr2=0x7ff2581240a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:19.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.393+0000 7ff25cd75640 1 --2- 10.20.193.58:0/1258550597 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff2580b6690 0x7ff2581240a0 secure :-1 s=READY pgs=9 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2580b56b0 tx=0x7ff2440028d0 comp rx=0 tx=0).stop 2026-02-23T06:31:19.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.393+0000 7ff25cd75640 1 -- 10.20.193.58:0/1258550597 shutdown_connections 2026-02-23T06:31:19.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.393+0000 7ff25cd75640 1 --2- 10.20.193.58:0/1258550597 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff22807a6c0 0x7ff22809ab70 unknown :-1 s=CLOSED pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:19.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.393+0000 7ff25cd75640 1 --2- 10.20.193.58:0/1258550597 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff25815d870 0x7ff25814daf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:19.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.393+0000 7ff25cd75640 1 --2- 10.20.193.58:0/1258550597 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff25815d4a0 0x7ff25811f7e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:19.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.393+0000 7ff25cd75640 1 --2- 10.20.193.58:0/1258550597 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff2580b6690 0x7ff2581240a0 unknown :-1 s=CLOSED pgs=9 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:19.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.393+0000 7ff25cd75640 1 -- 10.20.193.58:0/1258550597 >> 10.20.193.58:0/1258550597 conn(0x7ff2580b3c20 msgr2=0x7ff25805d100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:31:19.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.393+0000 7ff25cd75640 1 -- 10.20.193.58:0/1258550597 shutdown_connections 2026-02-23T06:31:19.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:19.394+0000 7ff25cd75640 1 -- 10.20.193.58:0/1258550597 wait complete. 2026-02-23T06:31:19.401 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:31:29.402 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:31:29.402 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:31:29.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.528+0000 7fe19f483640 1 -- 10.20.193.58:0/2004467021 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe19815c4b0 msgr2=0x7fe198058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:29.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.528+0000 7fe19f483640 1 --2- 10.20.193.58:0/2004467021 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe19815c4b0 0x7fe198058200 secure :-1 s=READY pgs=172 gs=2 cs=0 l=1 c_cookie=13294612866378675415 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe188004740 tx=0x7fe18802f170 comp rx=0 tx=0).stop 2026-02-23T06:31:29.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.528+0000 7fe19f483640 1 -- 10.20.193.58:0/2004467021 shutdown_connections 2026-02-23T06:31:29.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.528+0000 7fe19f483640 1 --2- 10.20.193.58:0/2004467021 >> v2:10.20.193.93:3300/0 conn(0x7fe198162ca0 0x7fe198056fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:29.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.528+0000 7fe19f483640 1 --2- 10.20.193.58:0/2004467021 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe19815c4b0 0x7fe198058200 unknown :-1 s=CLOSED pgs=172 gs=2 cs=0 l=1 c_cookie=13294612866378675415 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:29.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.528+0000 7fe19f483640 1 -- 10.20.193.58:0/2004467021 >> 10.20.193.58:0/2004467021 conn(0x7fe1980b3c20 msgr2=0x7fe1980b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:31:29.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.529+0000 7fe19f483640 1 -- 10.20.193.58:0/2004467021 shutdown_connections 2026-02-23T06:31:29.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.529+0000 7fe19f483640 1 -- 10.20.193.58:0/2004467021 wait complete. 2026-02-23T06:31:29.527 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.530+0000 7fe19f483640 1 Processor -- start 2026-02-23T06:31:29.527 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.530+0000 7fe19f483640 1 -- start start 2026-02-23T06:31:29.528 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.530+0000 7fe19f483640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe198056960 0x7fe19813f180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:29.528 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.530+0000 7fe19f483640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe19815c4b0 0x7fe198164390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:29.528 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.530+0000 7fe19f483640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe198162ca0 0x7fe19805b370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:29.528 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.530+0000 7fe19f483640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe198141a00 con 0x7fe19815c4b0 2026-02-23T06:31:29.528 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.530+0000 7fe19f483640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe198164d90 con 0x7fe198056960 2026-02-23T06:31:29.528 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.530+0000 7fe19f483640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe1981664d0 con 0x7fe198162ca0 2026-02-23T06:31:29.528 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.530+0000 7fe19dc80640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe19815c4b0 0x7fe198164390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:29.528 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.531+0000 7fe19dc80640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe19815c4b0 0x7fe198164390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:56484/0 (socket says 10.20.193.58:56484) 2026-02-23T06:31:29.528 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.531+0000 7fe19dc80640 1 -- 10.20.193.58:0/2072767254 learned_addr learned my addr 10.20.193.58:0/2072767254 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:31:29.528 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.531+0000 7fe19e481640 1 --2- 10.20.193.58:0/2072767254 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe198056960 0x7fe19813f180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:29.529 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.531+0000 7fe19ec82640 1 --2- 10.20.193.58:0/2072767254 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe198162ca0 0x7fe19805b370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:29.529 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.531+0000 7fe19dc80640 1 -- 10.20.193.58:0/2072767254 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe198162ca0 msgr2=0x7fe19805b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:29.529 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.531+0000 7fe19dc80640 1 --2- 10.20.193.58:0/2072767254 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe198162ca0 0x7fe19805b370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:29.529 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.531+0000 7fe19dc80640 1 -- 10.20.193.58:0/2072767254 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe198056960 msgr2=0x7fe19813f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:29.529 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.531+0000 7fe19dc80640 1 --2- 10.20.193.58:0/2072767254 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe198056960 0x7fe19813f180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:29.529 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.531+0000 7fe19dc80640 1 -- 10.20.193.58:0/2072767254 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1880094b0 con 0x7fe19815c4b0 2026-02-23T06:31:29.529 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.531+0000 7fe19e481640 1 --2- 10.20.193.58:0/2072767254 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe198056960 0x7fe19813f180 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:31:29.529 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.531+0000 7fe19dc80640 1 --2- 10.20.193.58:0/2072767254 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe19815c4b0 0x7fe198164390 secure :-1 s=READY pgs=53 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe18c00c450 tx=0x7fe18c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:29.529 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.531+0000 7fe17effd640 1 -- 10.20.193.58:0/2072767254 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe18c0117b0 con 0x7fe19815c4b0 2026-02-23T06:31:29.529 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.531+0000 7fe17effd640 1 -- 10.20.193.58:0/2072767254 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe18c011a00 con 0x7fe19815c4b0 2026-02-23T06:31:29.529 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.531+0000 7fe19f483640 1 -- 10.20.193.58:0/2072767254 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe198141bf0 con 0x7fe19815c4b0 2026-02-23T06:31:29.529 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.531+0000 7fe19f483640 1 -- 10.20.193.58:0/2072767254 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1981637f0 con 0x7fe19815c4b0 2026-02-23T06:31:29.529 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.531+0000 7fe17effd640 1 -- 10.20.193.58:0/2072767254 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe18c011db0 con 0x7fe19815c4b0 2026-02-23T06:31:29.530 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.532+0000 7fe19f483640 1 -- 10.20.193.58:0/2072767254 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe198163a00 con 0x7fe19815c4b0 2026-02-23T06:31:29.531 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.533+0000 7fe17effd640 1 -- 10.20.193.58:0/2072767254 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fe18c01c460 con 0x7fe19815c4b0 2026-02-23T06:31:29.531 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.534+0000 7fe17effd640 1 --2- 10.20.193.58:0/2072767254 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe16807a6c0 0x7fe16809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:29.531 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.534+0000 7fe17effd640 1 -- 10.20.193.58:0/2072767254 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fe18c0653c0 con 0x7fe19815c4b0 2026-02-23T06:31:29.531 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.534+0000 7fe19e481640 1 --2- 10.20.193.58:0/2072767254 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe16807a6c0 0x7fe16809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:29.531 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.534+0000 7fe17effd640 1 -- 10.20.193.58:0/2072767254 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fe18c061240 con 0x7fe19815c4b0 2026-02-23T06:31:29.531 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.535+0000 7fe19e481640 1 --2- 10.20.193.58:0/2072767254 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe16807a6c0 0x7fe16809ab70 secure :-1 s=READY pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1880023d0 tx=0x7fe188031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:29.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.688+0000 7fe19f483640 1 -- 10.20.193.58:0/2072767254 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe198142060 con 0x7fe19815c4b0 2026-02-23T06:31:29.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.689+0000 7fe17effd640 1 -- 10.20.193.58:0/2072767254 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7fe18c0613e0 con 0x7fe19815c4b0 2026-02-23T06:31:29.685 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":82,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:31:29.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.690+0000 7fe19f483640 1 -- 10.20.193.58:0/2072767254 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe16807a6c0 msgr2=0x7fe16809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:29.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.690+0000 7fe19f483640 1 --2- 10.20.193.58:0/2072767254 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe16807a6c0 0x7fe16809ab70 secure :-1 s=READY pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1880023d0 tx=0x7fe188031040 comp rx=0 tx=0).stop 2026-02-23T06:31:29.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.690+0000 7fe19f483640 1 -- 10.20.193.58:0/2072767254 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe19815c4b0 msgr2=0x7fe198164390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:29.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.690+0000 7fe19f483640 1 --2- 10.20.193.58:0/2072767254 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe19815c4b0 0x7fe198164390 secure :-1 s=READY pgs=53 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe18c00c450 tx=0x7fe18c00c920 comp rx=0 tx=0).stop 2026-02-23T06:31:29.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.690+0000 7fe19f483640 1 -- 10.20.193.58:0/2072767254 shutdown_connections 2026-02-23T06:31:29.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.690+0000 7fe19f483640 1 --2- 10.20.193.58:0/2072767254 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe16807a6c0 0x7fe16809ab70 unknown :-1 s=CLOSED pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:29.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.690+0000 7fe19f483640 1 --2- 10.20.193.58:0/2072767254 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe198162ca0 0x7fe19805b370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:29.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.690+0000 7fe19f483640 1 --2- 10.20.193.58:0/2072767254 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe19815c4b0 0x7fe198164390 unknown :-1 s=CLOSED pgs=53 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:29.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.690+0000 7fe19f483640 1 --2- 10.20.193.58:0/2072767254 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe198056960 0x7fe19813f180 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:29.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.690+0000 7fe19f483640 1 -- 10.20.193.58:0/2072767254 >> 10.20.193.58:0/2072767254 conn(0x7fe1980b3c20 msgr2=0x7fe1980b5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:31:29.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.690+0000 7fe19f483640 1 -- 10.20.193.58:0/2072767254 shutdown_connections 2026-02-23T06:31:29.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.690+0000 7fe19f483640 1 -- 10.20.193.58:0/2072767254 wait complete. 2026-02-23T06:31:29.696 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:31:29.697 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:31:29.697 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:31:29.697 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:31:29.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.823+0000 7f037f643640 1 -- 10.20.193.58:0/1915684194 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f037815d870 msgr2=0x7f03780587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:29.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.823+0000 7f037f643640 1 --2- 10.20.193.58:0/1915684194 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f037815d870 0x7f03780587b0 secure :-1 s=READY pgs=11 gs=2 cs=0 l=1 c_cookie=210982732513235881 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0378059740 tx=0x7f036402f190 comp rx=0 tx=0).stop 2026-02-23T06:31:29.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.823+0000 7f037f643640 1 -- 10.20.193.58:0/1915684194 shutdown_connections 2026-02-23T06:31:29.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.823+0000 7f037f643640 1 --2- 10.20.193.58:0/1915684194 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f037815d870 0x7f03780587b0 unknown :-1 s=CLOSED pgs=11 gs=2 cs=0 l=1 c_cookie=210982732513235881 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:29.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.823+0000 7f037f643640 1 --2- 10.20.193.58:0/1915684194 >> v2:10.20.193.58:3300/0 conn(0x7f037815d4a0 0x7f03780affb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:29.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.823+0000 7f037f643640 1 -- 10.20.193.58:0/1915684194 >> 10.20.193.58:0/1915684194 conn(0x7f03780b3c20 msgr2=0x7f03780b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:31:29.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.823+0000 7f037f643640 1 -- 10.20.193.58:0/1915684194 shutdown_connections 2026-02-23T06:31:29.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.823+0000 7f037f643640 1 -- 10.20.193.58:0/1915684194 wait complete. 2026-02-23T06:31:29.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.824+0000 7f037f643640 1 Processor -- start 2026-02-23T06:31:29.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.825+0000 7f037f643640 1 -- start start 2026-02-23T06:31:29.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.825+0000 7f037f643640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f03780b6690 0x7f03781412b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:29.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.825+0000 7f037f643640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f037815d4a0 0x7f0378057750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:29.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.825+0000 7f037f643640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f037815d870 0x7f0378161c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:29.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.825+0000 7f037f643640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f0378128dd0 con 0x7f03780b6690 2026-02-23T06:31:29.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.825+0000 7f037f643640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f03781299a0 con 0x7f037815d4a0 2026-02-23T06:31:29.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.825+0000 7f037f643640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f0378141c50 con 0x7f037815d870 2026-02-23T06:31:29.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.825+0000 7f037e641640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f03780b6690 0x7f03781412b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:29.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.825+0000 7f037de40640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f037815d4a0 0x7f0378057750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:29.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.825+0000 7f037e641640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f03780b6690 0x7f03781412b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:56490/0 (socket says 10.20.193.58:56490) 2026-02-23T06:31:29.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.825+0000 7f037e641640 1 -- 10.20.193.58:0/2882063265 learned_addr learned my addr 10.20.193.58:0/2882063265 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:31:29.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.825+0000 7f037ee42640 1 --2- 10.20.193.58:0/2882063265 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f037815d870 0x7f0378161c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:29.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.826+0000 7f037e641640 1 -- 10.20.193.58:0/2882063265 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f037815d870 msgr2=0x7f0378161c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:29.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.826+0000 7f037e641640 1 --2- 10.20.193.58:0/2882063265 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f037815d870 0x7f0378161c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:29.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.826+0000 7f037e641640 1 -- 10.20.193.58:0/2882063265 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f037815d4a0 msgr2=0x7f0378057750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:29.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.826+0000 7f037e641640 1 --2- 10.20.193.58:0/2882063265 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f037815d4a0 0x7f0378057750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:29.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.826+0000 7f037e641640 1 -- 10.20.193.58:0/2882063265 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03640094b0 con 0x7f03780b6690 2026-02-23T06:31:29.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.826+0000 7f037ee42640 1 --2- 10.20.193.58:0/2882063265 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f037815d870 0x7f0378161c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:31:29.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.826+0000 7f037de40640 1 --2- 10.20.193.58:0/2882063265 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f037815d4a0 0x7f0378057750 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:31:29.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.826+0000 7f037e641640 1 --2- 10.20.193.58:0/2882063265 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f03780b6690 0x7f03781412b0 secure :-1 s=READY pgs=54 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0370009480 tx=0x7f037000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:29.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.826+0000 7f0362ffd640 1 -- 10.20.193.58:0/2882063265 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f037000cd40 con 0x7f03780b6690 2026-02-23T06:31:29.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.826+0000 7f0362ffd640 1 -- 10.20.193.58:0/2882063265 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0370004850 con 0x7f03780b6690 2026-02-23T06:31:29.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.826+0000 7f0362ffd640 1 -- 10.20.193.58:0/2882063265 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f037000cea0 con 0x7f03780b6690 2026-02-23T06:31:29.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.826+0000 7f037f643640 1 -- 10.20.193.58:0/2882063265 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0378141f10 con 0x7f03780b6690 2026-02-23T06:31:29.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.826+0000 7f037f643640 1 -- 10.20.193.58:0/2882063265 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0378129350 con 0x7f03780b6690 2026-02-23T06:31:29.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.827+0000 7f037f643640 1 --2- 10.20.193.58:0/2882063265 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0378129540 0x7f03781621c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:29.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.827+0000 7f037f643640 1 -- 10.20.193.58:0/2882063265 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f03780b6330 con 0x7f0378129540 2026-02-23T06:31:29.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.827+0000 7f037de40640 1 --2- 10.20.193.58:0/2882063265 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0378129540 0x7f03781621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:29.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.827+0000 7f037de40640 1 -- 10.20.193.58:0/2882063265 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f03780b5e10 con 0x7f0378129540 2026-02-23T06:31:29.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.827+0000 7f037de40640 1 --2- 10.20.193.58:0/2882063265 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0378129540 0x7f03781621c0 secure :-1 s=READY pgs=55 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0378059740 tx=0x7f0364002bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:29.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.828+0000 7f0362ffd640 1 -- 10.20.193.58:0/2882063265 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f036403d050 con 0x7f0378129540 2026-02-23T06:31:29.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.828+0000 7f0362ffd640 1 -- 10.20.193.58:0/2882063265 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f036403e040 con 0x7f0378129540 2026-02-23T06:31:29.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.828+0000 7f0362ffd640 1 -- 10.20.193.58:0/2882063265 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0378129540 msgr2=0x7f03781621c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:29.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.828+0000 7f0362ffd640 1 --2- 10.20.193.58:0/2882063265 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0378129540 0x7f03781621c0 secure :-1 s=READY pgs=55 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0378059740 tx=0x7f0364002bd0 comp rx=0 tx=0).stop 2026-02-23T06:31:29.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.828+0000 7f0362ffd640 1 -- 10.20.193.58:0/2882063265 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0378129540 msgr2=0x7f03781621c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:31:29.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.828+0000 7f0362ffd640 1 --2- 10.20.193.58:0/2882063265 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0378129540 0x7f03781621c0 secure :-1 s=CLOSED pgs=55 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0378059740 tx=0x7f0364002bd0 comp rx=0 tx=0).stop 2026-02-23T06:31:29.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.828+0000 7f0362ffd640 1 -- 10.20.193.58:0/2882063265 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f037001f060 con 0x7f03780b6690 2026-02-23T06:31:29.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.829+0000 7f0362ffd640 1 --2- 10.20.193.58:0/2882063265 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f034807a430 0x7f034809a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:29.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.829+0000 7f0362ffd640 1 -- 10.20.193.58:0/2882063265 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f0370014070 con 0x7f03780b6690 2026-02-23T06:31:29.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.829+0000 7f037de40640 1 --2- 10.20.193.58:0/2882063265 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f034807a430 0x7f034809a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:29.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.830+0000 7f037de40640 1 --2- 10.20.193.58:0/2882063265 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f034807a430 0x7f034809a8e0 secure :-1 s=READY pgs=273 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f03640023d0 tx=0x7f0364042000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:29.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.831+0000 7f037f643640 1 --2- 10.20.193.58:0/2882063265 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f037814fc10 0x7f037814ffe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:29.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.831+0000 7f037f643640 1 -- 10.20.193.58:0/2882063265 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f03780b6d50 con 0x7f037814fc10 2026-02-23T06:31:29.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.832+0000 7f037ee42640 1 --2- 10.20.193.58:0/2882063265 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f037814fc10 0x7f037814ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:29.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.832+0000 7f037ee42640 1 -- 10.20.193.58:0/2882063265 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f037805b0e0 con 0x7f037814fc10 2026-02-23T06:31:29.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.832+0000 7f037ee42640 1 --2- 10.20.193.58:0/2882063265 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f037814fc10 0x7f037814ffe0 secure :-1 s=READY pgs=56 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f036c0038b0 tx=0x7f036c00fba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:29.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.832+0000 7f0362ffd640 1 -- 10.20.193.58:0/2882063265 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f036c01a070 con 0x7f037814fc10 2026-02-23T06:31:29.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.832+0000 7f0362ffd640 1 -- 10.20.193.58:0/2882063265 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4913 (secure 0 0 0) 0x7f036c003a30 con 0x7f037814fc10 2026-02-23T06:31:29.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.832+0000 7f0362ffd640 1 -- 10.20.193.58:0/2882063265 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f037814fc10 msgr2=0x7f037814ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:29.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.832+0000 7f0362ffd640 1 --2- 10.20.193.58:0/2882063265 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f037814fc10 0x7f037814ffe0 secure :-1 s=READY pgs=56 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f036c0038b0 tx=0x7f036c00fba0 comp rx=0 tx=0).stop 2026-02-23T06:31:29.830 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:31:29.831 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:31:29.831 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:31:29.831 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:31:29.831 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 82, 2026-02-23T06:31:29.831 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 78649, 2026-02-23T06:31:29.831 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:31:29.831 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:31:29.831 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:31:29.831 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:31:29.832 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:29.832 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:31:29.832 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:31:29.832 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:31:29.832 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:31:29.832 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:31:29.832 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:31:29.832 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:31:29.832 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:31:29.832 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:31:29.832 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:31:29.833 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:31:29.833 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:31:29.833 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:31:29.833 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:31:29.833 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:31:29.833 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:31:29.833 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:31:29.833 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:29.833 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:31:29.833 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:31:29.833 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:31:29.833 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:31:29.834 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:31:29.834 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:31:29.834 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:31:29.834 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:31:29.834 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:31:29.834 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:31:29.834 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:31:29.834 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:31:29.834 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:31:29.834 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:31:29.834 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:31:29.835 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:29.835 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:29.835 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:31:29.835 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:31:29.835 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:31:29.835 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:31:29.835 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:31:29.835 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:31:29.835 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:31:29.835 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:31:29.835 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:31:29.835 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:31:29.836 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:31:29.836 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:31:29.836 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:31:29.836 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:31:29.836 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:31:29.836 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:31:29.836 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:31:29.836 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:31:29.836 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:31:29.836 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:31:29.836 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:31:29.836 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:31:29.837 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:31:29.837 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:31:29.837 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:31:29.837 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:31:29.837 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:31:29.837 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:31:29.837 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:31:29.837 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:31:29.837 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:29.837 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:31:29.837 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:29.837 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:31:29.838 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:29.838 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:31:29.838 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:31:29.838 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:31:29.838 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:31:29.838 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:29.838 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:31:29.838 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:31:29.838 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:29.838 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:29.838 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:29.838 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:31:29.839 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:31:29.839 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:29.839 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:29.839 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:29.839 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:29.839 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:31:29.839 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:31:29.839 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:31:29.839 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:31:29.839 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:31:29.839 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:31:29.839 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:29.840 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:29.840 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:31:29.840 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:31:29.840 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:31:29.840 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:31:29.840 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:29.840 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:31:29.840 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:31:29.840 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:29.840 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:29.840 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:29.840 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:31:29.841 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:31:29.841 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:29.841 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:29.841 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:29.841 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:29.841 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:31:29.841 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:31:29.841 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:31:29.841 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:31:29.841 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:31:29.841 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:31:29.841 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:29.842 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:29.842 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:31:29.842 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:31:29.842 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:31:29.842 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:31:29.842 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:29.842 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:31:29.842 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:31:29.842 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:29.842 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:29.842 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:29.843 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:31:29.843 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:31:29.843 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:29.843 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:29.843 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:29.843 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:29.843 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:31:29.843 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:31:29.843 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:31:29.843 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:31:29.843 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:31:29.843 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:31:29.843 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:29.844 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:29.844 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:29.844 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:31:29.844 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:31:29.844 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:29.844 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:31:29.844 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:31:29.844 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:31:29.844 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:29.844 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:29.844 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:31:29.844 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:29.845 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:31:29.845 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:31:29.845 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:31:29.845 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:29.845 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:29.845 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:29.845 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:31:29.845 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:31:29.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.832+0000 7f0362ffd640 1 -- 10.20.193.58:0/2882063265 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f037814fc10 msgr2=0x7f037814ffe0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:31:29.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.832+0000 7f0362ffd640 1 --2- 10.20.193.58:0/2882063265 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f037814fc10 0x7f037814ffe0 unknown :-1 s=CLOSED pgs=56 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:29.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.833+0000 7f037f643640 1 -- 10.20.193.58:0/2882063265 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f034807a430 msgr2=0x7f034809a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:29.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.833+0000 7f037f643640 1 --2- 10.20.193.58:0/2882063265 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f034807a430 0x7f034809a8e0 secure :-1 s=READY pgs=273 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f03640023d0 tx=0x7f0364042000 comp rx=0 tx=0).stop 2026-02-23T06:31:29.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.833+0000 7f037f643640 1 -- 10.20.193.58:0/2882063265 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f03780b6690 msgr2=0x7f03781412b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:29.848 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.833+0000 7f037f643640 1 --2- 10.20.193.58:0/2882063265 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f03780b6690 0x7f03781412b0 secure :-1 s=READY pgs=54 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0370009480 tx=0x7f037000ee60 comp rx=0 tx=0).stop 2026-02-23T06:31:29.848 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.833+0000 7f037ee42640 1 -- 10.20.193.58:0/2882063265 reap_dead start 2026-02-23T06:31:29.848 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.833+0000 7f037f643640 1 -- 10.20.193.58:0/2882063265 shutdown_connections 2026-02-23T06:31:29.848 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.833+0000 7f037f643640 1 -- 10.20.193.58:0/2882063265 >> 10.20.193.58:0/2882063265 conn(0x7f03780b3c20 msgr2=0x7f037815bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:31:29.848 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.833+0000 7f037f643640 1 -- 10.20.193.58:0/2882063265 shutdown_connections 2026-02-23T06:31:29.848 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.833+0000 7f037f643640 1 -- 10.20.193.58:0/2882063265 wait complete. 2026-02-23T06:31:29.848 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:31:29.849 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:31:29.849 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:31:29.971 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.975+0000 7fc4f8843640 1 -- 10.20.193.58:0/2943020973 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc4f415d4a0 msgr2=0x7fc4f40affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:29.971 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.975+0000 7fc4f8843640 1 --2- 10.20.193.58:0/2943020973 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc4f415d4a0 0x7fc4f40affb0 secure :-1 s=READY pgs=13 gs=2 cs=0 l=1 c_cookie=3519414021363514230 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4e0005e70 tx=0x7fc4e002f290 comp rx=0 tx=0).stop 2026-02-23T06:31:29.971 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.975+0000 7fc4f8843640 1 -- 10.20.193.58:0/2943020973 shutdown_connections 2026-02-23T06:31:29.972 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.975+0000 7fc4f8843640 1 --2- 10.20.193.58:0/2943020973 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc4f40b6690 0x7fc4f4058ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:29.972 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.975+0000 7fc4f8843640 1 --2- 10.20.193.58:0/2943020973 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc4f415d4a0 0x7fc4f40affb0 unknown :-1 s=CLOSED pgs=13 gs=2 cs=0 l=1 c_cookie=3519414021363514230 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:29.972 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.975+0000 7fc4f8843640 1 -- 10.20.193.58:0/2943020973 >> 10.20.193.58:0/2943020973 conn(0x7fc4f40b3c20 msgr2=0x7fc4f40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:31:29.972 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.975+0000 7fc4f8843640 1 -- 10.20.193.58:0/2943020973 shutdown_connections 2026-02-23T06:31:29.972 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.975+0000 7fc4f8843640 1 -- 10.20.193.58:0/2943020973 wait complete. 2026-02-23T06:31:29.975 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.976+0000 7fc4f8843640 1 Processor -- start 2026-02-23T06:31:29.975 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.976+0000 7fc4f8843640 1 -- start start 2026-02-23T06:31:29.975 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.977+0000 7fc4f8843640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc4f40b6690 0x7fc4f4057100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:29.975 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.977+0000 7fc4f8843640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc4f415d4a0 0x7fc4f414d5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:29.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.977+0000 7fc4f8843640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc4f415d870 0x7fc4f411c440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:29.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.977+0000 7fc4f8843640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f413b520 con 0x7fc4f415d4a0 2026-02-23T06:31:29.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.977+0000 7fc4f8843640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f4056710 con 0x7fc4f415d870 2026-02-23T06:31:29.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.977+0000 7fc4f8843640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc4f4163590 con 0x7fc4f40b6690 2026-02-23T06:31:29.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.977+0000 7fc4f2ffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc4f415d4a0 0x7fc4f414d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:29.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.977+0000 7fc4f37fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc4f40b6690 0x7fc4f4057100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:29.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.977+0000 7fc4f37fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc4f40b6690 0x7fc4f4057100 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:36742/0 (socket says 10.20.193.58:36742) 2026-02-23T06:31:29.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.977+0000 7fc4f37fe640 1 -- 10.20.193.58:0/469754845 learned_addr learned my addr 10.20.193.58:0/469754845 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:31:29.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.977+0000 7fc4f3fff640 1 --2- 10.20.193.58:0/469754845 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc4f415d870 0x7fc4f411c440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:29.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.978+0000 7fc4f2ffd640 1 -- 10.20.193.58:0/469754845 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc4f40b6690 msgr2=0x7fc4f4057100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:29.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.978+0000 7fc4f2ffd640 1 --2- 10.20.193.58:0/469754845 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc4f40b6690 0x7fc4f4057100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:29.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.978+0000 7fc4f2ffd640 1 -- 10.20.193.58:0/469754845 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc4f415d870 msgr2=0x7fc4f411c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:29.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.978+0000 7fc4f2ffd640 1 --2- 10.20.193.58:0/469754845 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc4f415d870 0x7fc4f411c440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:29.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.978+0000 7fc4f2ffd640 1 -- 10.20.193.58:0/469754845 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e0009570 con 0x7fc4f415d4a0 2026-02-23T06:31:29.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.978+0000 7fc4f2ffd640 1 --2- 10.20.193.58:0/469754845 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc4f415d4a0 0x7fc4f414d5e0 secure :-1 s=READY pgs=57 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4e400c410 tx=0x7fc4e400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:29.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.978+0000 7fc4cffff640 1 -- 10.20.193.58:0/469754845 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4e4006ab0 con 0x7fc4f415d4a0 2026-02-23T06:31:29.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.978+0000 7fc4cffff640 1 -- 10.20.193.58:0/469754845 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4e4006d00 con 0x7fc4f415d4a0 2026-02-23T06:31:29.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.978+0000 7fc4cffff640 1 -- 10.20.193.58:0/469754845 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4e40072b0 con 0x7fc4f415d4a0 2026-02-23T06:31:29.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.978+0000 7fc4f8843640 1 -- 10.20.193.58:0/469754845 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4f40561f0 con 0x7fc4f415d4a0 2026-02-23T06:31:29.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.978+0000 7fc4f8843640 1 -- 10.20.193.58:0/469754845 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4f411ba20 con 0x7fc4f415d4a0 2026-02-23T06:31:29.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.978+0000 7fc4f8843640 1 --2- 10.20.193.58:0/469754845 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc4f411d080 0x7fc4f413ae60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:29.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.978+0000 7fc4f8843640 1 -- 10.20.193.58:0/469754845 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f40b6330 con 0x7fc4f411d080 2026-02-23T06:31:29.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.979+0000 7fc4f37fe640 1 --2- 10.20.193.58:0/469754845 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc4f411d080 0x7fc4f413ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:29.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.979+0000 7fc4f37fe640 1 -- 10.20.193.58:0/469754845 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc4f40b5e10 con 0x7fc4f411d080 2026-02-23T06:31:29.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.979+0000 7fc4f37fe640 1 --2- 10.20.193.58:0/469754845 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc4f411d080 0x7fc4f413ae60 secure :-1 s=READY pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4e002ff80 tx=0x7fc4e00028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:29.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.980+0000 7fc4cffff640 1 -- 10.20.193.58:0/469754845 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4e003d050 con 0x7fc4f411d080 2026-02-23T06:31:29.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.980+0000 7fc4cffff640 1 -- 10.20.193.58:0/469754845 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fc4e4007410 con 0x7fc4f415d4a0 2026-02-23T06:31:29.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.981+0000 7fc4cffff640 1 --2- 10.20.193.58:0/469754845 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc4c407a660 0x7fc4c409ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:29.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.981+0000 7fc4cffff640 1 -- 10.20.193.58:0/469754845 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fc4e409cc30 con 0x7fc4f415d4a0 2026-02-23T06:31:29.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.981+0000 7fc4cffff640 1 -- 10.20.193.58:0/469754845 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fc4e003e040 con 0x7fc4f411d080 2026-02-23T06:31:29.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.981+0000 7fc4cffff640 1 -- 10.20.193.58:0/469754845 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc4f411d080 msgr2=0x7fc4f413ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:29.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.981+0000 7fc4cffff640 1 --2- 10.20.193.58:0/469754845 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc4f411d080 0x7fc4f413ae60 secure :-1 s=READY pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4e002ff80 tx=0x7fc4e00028d0 comp rx=0 tx=0).stop 2026-02-23T06:31:29.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.981+0000 7fc4f3fff640 1 --2- 10.20.193.58:0/469754845 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc4c407a660 0x7fc4c409ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:29.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.981+0000 7fc4cffff640 1 -- 10.20.193.58:0/469754845 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc4f411d080 msgr2=0x7fc4f413ae60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:31:29.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.981+0000 7fc4cffff640 1 --2- 10.20.193.58:0/469754845 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc4f411d080 0x7fc4f413ae60 unknown :-1 s=CLOSED pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:29.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.982+0000 7fc4f3fff640 1 --2- 10.20.193.58:0/469754845 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc4c407a660 0x7fc4c409ab10 secure :-1 s=READY pgs=274 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4e8005820 tx=0x7fc4e800a310 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:29.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.985+0000 7fc4f8843640 1 --2- 10.20.193.58:0/469754845 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc4f413b660 0x7fc4f411e290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:29.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.985+0000 7fc4f8843640 1 -- 10.20.193.58:0/469754845 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f40b6d50 con 0x7fc4f413b660 2026-02-23T06:31:29.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.985+0000 7fc4f37fe640 1 --2- 10.20.193.58:0/469754845 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc4f413b660 0x7fc4f411e290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:29.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.986+0000 7fc4f37fe640 1 -- 10.20.193.58:0/469754845 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc4f405b0e0 con 0x7fc4f413b660 2026-02-23T06:31:29.982 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.986+0000 7fc4f37fe640 1 --2- 10.20.193.58:0/469754845 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc4f413b660 0x7fc4f411e290 secure :-1 s=READY pgs=15 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4f4062d20 tx=0x7fc4e0009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:29.982 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.986+0000 7fc4cffff640 1 -- 10.20.193.58:0/469754845 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4e0052070 con 0x7fc4f413b660 2026-02-23T06:31:29.982 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.986+0000 7fc4cffff640 1 -- 10.20.193.58:0/469754845 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4911 (secure 0 0 0) 0x7fc4e004b420 con 0x7fc4f413b660 2026-02-23T06:31:29.982 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.986+0000 7fc4cffff640 1 -- 10.20.193.58:0/469754845 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc4f413b660 msgr2=0x7fc4f411e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:29.982 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.986+0000 7fc4cffff640 1 --2- 10.20.193.58:0/469754845 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc4f413b660 0x7fc4f411e290 secure :-1 s=READY pgs=15 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4f4062d20 tx=0x7fc4e0009310 comp rx=0 tx=0).stop 2026-02-23T06:31:29.982 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.986+0000 7fc4cffff640 1 -- 10.20.193.58:0/469754845 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc4f413b660 msgr2=0x7fc4f411e290 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:31:29.982 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.986+0000 7fc4cffff640 1 --2- 10.20.193.58:0/469754845 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc4f413b660 0x7fc4f411e290 secure :-1 s=CLOSED pgs=15 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4f4062d20 tx=0x7fc4e0009310 comp rx=0 tx=0).stop 2026-02-23T06:31:29.983 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:31:29.983 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:31:29.983 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:31:29.983 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:31:29.983 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 82, 2026-02-23T06:31:29.983 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 26563, 2026-02-23T06:31:29.983 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:31:29.983 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:31:29.983 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:31:29.983 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:31:29.984 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:29.984 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:31:29.984 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:31:29.984 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:31:29.984 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:31:29.984 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:31:29.984 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:31:29.984 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:31:29.984 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:31:29.984 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:31:29.984 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:31:29.984 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:31:29.985 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:31:29.985 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:31:29.985 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:31:29.985 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:31:29.985 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:31:29.985 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:31:29.985 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:29.985 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:31:29.985 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:31:29.985 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:31:29.985 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:31:29.985 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:31:29.986 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:31:29.986 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:31:29.986 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:31:29.986 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:31:29.986 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:31:29.986 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:31:29.986 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:31:29.986 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:31:29.986 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:31:29.986 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:31:29.986 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:29.986 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:29.987 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:31:29.987 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:31:29.987 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:31:29.987 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:31:29.987 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:31:29.987 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:31:29.987 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:31:29.987 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:31:29.987 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:31:29.987 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:31:29.987 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:31:29.988 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:31:29.988 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:31:29.988 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:31:29.988 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:31:29.988 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:31:29.988 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:31:29.988 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:31:29.988 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:31:29.988 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:31:29.988 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:31:29.988 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:31:29.988 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:31:29.989 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:31:29.989 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:31:29.989 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:31:29.989 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:31:29.989 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:31:29.989 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:31:29.989 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:31:29.989 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:29.989 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:31:29.989 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:29.989 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:31:29.989 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:29.990 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:31:29.990 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:31:29.990 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:31:29.990 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:31:29.990 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:29.990 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:31:29.990 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:31:29.990 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:29.990 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:29.990 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:29.990 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:31:29.990 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:31:29.990 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:29.991 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:29.991 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:29.991 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:29.991 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:31:29.991 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:31:29.991 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:31:29.991 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:31:29.991 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:31:29.991 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:31:29.991 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:29.991 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:29.991 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:31:29.992 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:31:29.992 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:31:29.992 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:31:29.992 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:29.992 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:31:29.992 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:31:29.992 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:29.992 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:29.992 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:29.992 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:31:29.992 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:31:29.992 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:29.993 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:29.993 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:29.993 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:29.993 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:31:29.993 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:31:29.993 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:31:29.993 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:31:29.993 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:31:29.993 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:31:29.993 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:29.993 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:29.993 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:31:29.993 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:31:29.994 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:31:29.994 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:31:29.994 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:29.994 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:31:29.994 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:31:29.994 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:29.994 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:29.994 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:29.994 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:31:29.994 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:31:29.994 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:29.994 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:29.994 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:29.995 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:29.995 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:31:29.995 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:31:29.995 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:31:29.995 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:31:29.995 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:31:29.995 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:31:29.995 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:29.995 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:29.995 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:29.995 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:31:29.995 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:31:29.995 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:29.996 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:31:29.996 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:31:29.996 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:31:29.996 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:29.996 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:29.996 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:31:29.996 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:29.996 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:31:29.996 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:31:29.996 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:31:29.996 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:29.996 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:29.997 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:29.997 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:31:29.997 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:31:29.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.986+0000 7fc4f8843640 1 -- 10.20.193.58:0/469754845 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc4c407a660 msgr2=0x7fc4c409ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:29.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.986+0000 7fc4f8843640 1 --2- 10.20.193.58:0/469754845 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc4c407a660 0x7fc4c409ab10 secure :-1 s=READY pgs=274 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4e8005820 tx=0x7fc4e800a310 comp rx=0 tx=0).stop 2026-02-23T06:31:29.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.986+0000 7fc4f8843640 1 -- 10.20.193.58:0/469754845 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc4f415d4a0 msgr2=0x7fc4f414d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:29.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.986+0000 7fc4f8843640 1 --2- 10.20.193.58:0/469754845 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc4f415d4a0 0x7fc4f414d5e0 secure :-1 s=READY pgs=57 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4e400c410 tx=0x7fc4e400c8e0 comp rx=0 tx=0).stop 2026-02-23T06:31:29.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.986+0000 7fc4f3fff640 1 -- 10.20.193.58:0/469754845 reap_dead start 2026-02-23T06:31:29.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.986+0000 7fc4f3fff640 1 -- 10.20.193.58:0/469754845 reap_dead start 2026-02-23T06:31:29.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.986+0000 7fc4f8843640 1 -- 10.20.193.58:0/469754845 shutdown_connections 2026-02-23T06:31:29.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.986+0000 7fc4f8843640 1 -- 10.20.193.58:0/469754845 >> 10.20.193.58:0/469754845 conn(0x7fc4f40b3c20 msgr2=0x7fc4f415c730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:31:29.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.987+0000 7fc4f8843640 1 -- 10.20.193.58:0/469754845 shutdown_connections 2026-02-23T06:31:29.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:29.987+0000 7fc4f8843640 1 -- 10.20.193.58:0/469754845 wait complete. 2026-02-23T06:31:30.000 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:31:30.000 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:31:30.000 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:31:30.124 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.128+0000 7f0056964640 1 -- 10.20.193.58:0/2638314563 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0038003a80 msgr2=0x7f0038003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:30.124 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.128+0000 7f0056964640 1 --2- 10.20.193.58:0/2638314563 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0038003a80 0x7f0038003e90 secure :-1 s=READY pgs=59 gs=4 cs=0 l=1 c_cookie=1178041356966639751 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f004000bb10 tx=0x7f004002f740 comp rx=0 tx=0).stop 2026-02-23T06:31:30.124 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.128+0000 7f0056163640 1 -- 10.20.193.58:0/2638314563 reap_dead start 2026-02-23T06:31:30.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.128+0000 7f0056964640 1 -- 10.20.193.58:0/2638314563 shutdown_connections 2026-02-23T06:31:30.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.128+0000 7f0056964640 1 -- 10.20.193.58:0/2638314563 >> 10.20.193.58:0/2638314563 conn(0x7f00500b3c20 msgr2=0x7f00500b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:31:30.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.128+0000 7f0056964640 1 -- 10.20.193.58:0/2638314563 shutdown_connections 2026-02-23T06:31:30.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.128+0000 7f0056964640 1 -- 10.20.193.58:0/2638314563 wait complete. 2026-02-23T06:31:30.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.130+0000 7f0056964640 1 Processor -- start 2026-02-23T06:31:30.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.130+0000 7f0056964640 1 -- start start 2026-02-23T06:31:30.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.130+0000 7f0056964640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0038003a80 0x7f0050056390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:30.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.130+0000 7f0056964640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f00501255b0 0x7f00501261b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:30.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.130+0000 7f0056964640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0050056b90 0x7f0050057030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:30.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.130+0000 7f0056964640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f0050057570 con 0x7f0038003a80 2026-02-23T06:31:30.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.130+0000 7f0056964640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f0050120340 con 0x7f0050056b90 2026-02-23T06:31:30.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.130+0000 7f0056964640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f005013cf60 con 0x7f00501255b0 2026-02-23T06:31:30.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.130+0000 7f0055962640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0038003a80 0x7f0050056390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:30.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.130+0000 7f0055962640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0038003a80 0x7f0050056390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:56520/0 (socket says 10.20.193.58:56520) 2026-02-23T06:31:30.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.130+0000 7f0055962640 1 -- 10.20.193.58:0/2055573634 learned_addr learned my addr 10.20.193.58:0/2055573634 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:31:30.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.130+0000 7f0055161640 1 --2- 10.20.193.58:0/2055573634 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f00501255b0 0x7f00501261b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:30.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.130+0000 7f0056163640 1 --2- 10.20.193.58:0/2055573634 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0050056b90 0x7f0050057030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:30.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.131+0000 7f0055962640 1 -- 10.20.193.58:0/2055573634 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f00501255b0 msgr2=0x7f00501261b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:30.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.131+0000 7f0055962640 1 --2- 10.20.193.58:0/2055573634 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f00501255b0 0x7f00501261b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:30.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.131+0000 7f0055962640 1 -- 10.20.193.58:0/2055573634 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0050056b90 msgr2=0x7f0050057030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:30.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.131+0000 7f0055962640 1 --2- 10.20.193.58:0/2055573634 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0050056b90 0x7f0050057030 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:30.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.131+0000 7f0055962640 1 -- 10.20.193.58:0/2055573634 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f005013eb40 con 0x7f0038003a80 2026-02-23T06:31:30.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.131+0000 7f0055962640 1 --2- 10.20.193.58:0/2055573634 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0038003a80 0x7f0050056390 secure :-1 s=READY pgs=60 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0040002950 tx=0x7f0040002980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:30.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.131+0000 7f003e7fc640 1 -- 10.20.193.58:0/2055573634 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0040041440 con 0x7f0038003a80 2026-02-23T06:31:30.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.131+0000 7f003e7fc640 1 -- 10.20.193.58:0/2055573634 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0040041690 con 0x7f0038003a80 2026-02-23T06:31:30.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.131+0000 7f003e7fc640 1 -- 10.20.193.58:0/2055573634 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0040041ac0 con 0x7f0038003a80 2026-02-23T06:31:30.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.131+0000 7f0056964640 1 -- 10.20.193.58:0/2055573634 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0050120590 con 0x7f0038003a80 2026-02-23T06:31:30.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.131+0000 7f0056964640 1 -- 10.20.193.58:0/2055573634 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00500b1820 con 0x7f0038003a80 2026-02-23T06:31:30.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.131+0000 7f0017fff640 1 --2- 10.20.193.58:0/2055573634 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f00500ae350 0x7f00501513e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:30.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.131+0000 7f0017fff640 1 -- 10.20.193.58:0/2055573634 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f0050120720 con 0x7f00500ae350 2026-02-23T06:31:30.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.132+0000 7f0055161640 1 --2- 10.20.193.58:0/2055573634 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f00500ae350 0x7f00501513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:30.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.132+0000 7f0055161640 1 -- 10.20.193.58:0/2055573634 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f00500b6330 con 0x7f00500ae350 2026-02-23T06:31:30.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.133+0000 7f0055161640 1 --2- 10.20.193.58:0/2055573634 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f00500ae350 0x7f00501513e0 secure :-1 s=READY pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00500ae270 tx=0x7f004400eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:30.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.133+0000 7f003e7fc640 1 -- 10.20.193.58:0/2055573634 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f0040041c20 con 0x7f0038003a80 2026-02-23T06:31:30.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.134+0000 7f003e7fc640 1 --2- 10.20.193.58:0/2055573634 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f002007a5f0 0x7f002009aaa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:30.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.134+0000 7f003e7fc640 1 -- 10.20.193.58:0/2055573634 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f004002fe40 con 0x7f0038003a80 2026-02-23T06:31:30.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.134+0000 7f003e7fc640 1 -- 10.20.193.58:0/2055573634 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f004400cda0 con 0x7f00500ae350 2026-02-23T06:31:30.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.134+0000 7f003e7fc640 1 -- 10.20.193.58:0/2055573634 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f0044010420 con 0x7f00500ae350 2026-02-23T06:31:30.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.134+0000 7f003e7fc640 1 -- 10.20.193.58:0/2055573634 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f00500ae350 msgr2=0x7f00501513e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:30.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.134+0000 7f003e7fc640 1 --2- 10.20.193.58:0/2055573634 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f00500ae350 0x7f00501513e0 secure :-1 s=READY pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00500ae270 tx=0x7f004400eec0 comp rx=0 tx=0).stop 2026-02-23T06:31:30.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.134+0000 7f003e7fc640 1 -- 10.20.193.58:0/2055573634 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f00500ae350 msgr2=0x7f00501513e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:31:30.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.134+0000 7f003e7fc640 1 --2- 10.20.193.58:0/2055573634 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f00500ae350 0x7f00501513e0 secure :-1 s=CLOSED pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00500ae270 tx=0x7f004400eec0 comp rx=0 tx=0).stop 2026-02-23T06:31:30.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.134+0000 7f0056163640 1 --2- 10.20.193.58:0/2055573634 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f002007a5f0 0x7f002009aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:30.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.135+0000 7f0056163640 1 --2- 10.20.193.58:0/2055573634 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f002007a5f0 0x7f002009aaa0 secure :-1 s=READY pgs=275 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00500b5230 tx=0x7f004c006e20 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:30.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.138+0000 7f0017fff640 1 --2- 10.20.193.58:0/2055573634 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f005015a2f0 0x7f005015a6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:30.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.138+0000 7f0017fff640 1 -- 10.20.193.58:0/2055573634 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f005015ac30 con 0x7f005015a2f0 2026-02-23T06:31:30.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.138+0000 7f0055161640 1 --2- 10.20.193.58:0/2055573634 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f005015a2f0 0x7f005015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:30.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.138+0000 7f0055161640 1 -- 10.20.193.58:0/2055573634 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f00500b5e10 con 0x7f005015a2f0 2026-02-23T06:31:30.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.139+0000 7f0055161640 1 --2- 10.20.193.58:0/2055573634 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f005015a2f0 0x7f005015a6f0 secure :-1 s=READY pgs=174 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0044002fa0 tx=0x7f0050163350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:30.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.139+0000 7f003e7fc640 1 -- 10.20.193.58:0/2055573634 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0044023070 con 0x7f005015a2f0 2026-02-23T06:31:30.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.139+0000 7f003e7fc640 1 -- 10.20.193.58:0/2055573634 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5556 (secure 0 0 0) 0x7f00440107b0 con 0x7f005015a2f0 2026-02-23T06:31:30.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.139+0000 7f003e7fc640 1 -- 10.20.193.58:0/2055573634 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f005015a2f0 msgr2=0x7f005015a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:30.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.139+0000 7f003e7fc640 1 --2- 10.20.193.58:0/2055573634 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f005015a2f0 0x7f005015a6f0 secure :-1 s=READY pgs=174 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0044002fa0 tx=0x7f0050163350 comp rx=0 tx=0).stop 2026-02-23T06:31:30.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.139+0000 7f003e7fc640 1 -- 10.20.193.58:0/2055573634 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f005015a2f0 msgr2=0x7f005015a6f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:31:30.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.139+0000 7f003e7fc640 1 --2- 10.20.193.58:0/2055573634 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f005015a2f0 0x7f005015a6f0 unknown :-1 s=CLOSED pgs=174 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:30.136 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:31:30.136 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:31:30.136 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:31:30.136 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:31:30.136 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 82, 2026-02-23T06:31:30.136 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 364651, 2026-02-23T06:31:30.136 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:31:30.136 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:31:30.136 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:31:30.136 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:31:30.137 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:30.137 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:31:30.137 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:31:30.137 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:31:30.137 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:31:30.137 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:31:30.137 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:31:30.137 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:31:30.137 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:31:30.137 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:31:30.137 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:31:30.138 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:31:30.138 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:31:30.138 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:31:30.138 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:31:30.138 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:31:30.138 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:31:30.138 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:31:30.138 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:30.138 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:31:30.138 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:31:30.138 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:31:30.138 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:31:30.138 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:31:30.139 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:31:30.139 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:31:30.139 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:31:30.139 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:31:30.139 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:31:30.139 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:31:30.139 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:31:30.139 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:31:30.139 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:31:30.139 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:31:30.139 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:30.139 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:30.140 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:31:30.140 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:31:30.140 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:31:30.140 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:31:30.140 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:31:30.140 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:31:30.140 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:31:30.140 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:31:30.140 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:31:30.140 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:31:30.140 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:31:30.140 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:31:30.141 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:31:30.141 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:31:30.141 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:31:30.141 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:31:30.141 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:31:30.141 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:31:30.141 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:31:30.141 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:31:30.141 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:31:30.141 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:31:30.141 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:31:30.141 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:31:30.142 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:31:30.142 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:31:30.142 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:31:30.142 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:31:30.142 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:31:30.142 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:31:30.142 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:30.142 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:31:30.142 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:30.142 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:31:30.142 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:30.142 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:31:30.143 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:31:30.143 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:31:30.143 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:31:30.143 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:30.143 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:31:30.143 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:31:30.143 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:30.143 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:30.143 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:30.143 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:31:30.143 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:31:30.143 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:30.143 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:30.144 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:30.144 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:30.144 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:31:30.144 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:31:30.144 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:31:30.144 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:31:30.144 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:31:30.144 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:31:30.144 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:30.144 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:30.144 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:31:30.144 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:31:30.145 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:31:30.145 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:31:30.145 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:30.145 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:31:30.145 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:31:30.145 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:30.145 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:30.145 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:30.145 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:31:30.145 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:31:30.145 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:30.145 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:30.145 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:30.146 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:30.146 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:31:30.146 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:31:30.146 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:31:30.146 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:31:30.146 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:31:30.146 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:31:30.146 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:30.146 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:30.146 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:31:30.146 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:31:30.146 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:31:30.146 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:31:30.147 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:30.147 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:31:30.147 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:31:30.147 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:30.147 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:30.147 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:30.147 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:31:30.147 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:31:30.147 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:30.147 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:30.147 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:30.147 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:30.147 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:31:30.148 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:31:30.148 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:31:30.148 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:31:30.148 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:31:30.148 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:31:30.148 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:30.148 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:30.148 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:30.148 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:31:30.148 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:31:30.148 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:30.148 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:31:30.148 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:31:30.149 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:31:30.149 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:30.149 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:30.149 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:31:30.149 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:30.149 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:31:30.149 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:31:30.149 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:31:30.149 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:30.149 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:30.149 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:31:30.149 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:30.150 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:31:30.150 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:31:30.150 INFO:teuthology.orchestra.run.trial058.stdout: "num": 8 2026-02-23T06:31:30.150 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:30.150 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:30.150 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:31:30.150 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:30.150 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:31:30.150 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:31:30.150 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:31:30.150 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:30.150 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:30.150 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:31:30.151 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:31:30.151 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:31:30.151 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:30.151 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:30.151 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:31:30.151 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:30.151 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:31:30.151 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:31:30.151 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:31:30.151 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:30.151 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:30.151 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:30.151 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:31:30.152 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:31:30.153 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.139+0000 7f0017fff640 1 -- 10.20.193.58:0/2055573634 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f002007a5f0 msgr2=0x7f002009aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:30.153 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.139+0000 7f0017fff640 1 --2- 10.20.193.58:0/2055573634 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f002007a5f0 0x7f002009aaa0 secure :-1 s=READY pgs=275 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00500b5230 tx=0x7f004c006e20 comp rx=0 tx=0).stop 2026-02-23T06:31:30.153 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.139+0000 7f0017fff640 1 -- 10.20.193.58:0/2055573634 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0038003a80 msgr2=0x7f0050056390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:30.153 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.139+0000 7f0017fff640 1 --2- 10.20.193.58:0/2055573634 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0038003a80 0x7f0050056390 secure :-1 s=READY pgs=60 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0040002950 tx=0x7f0040002980 comp rx=0 tx=0).stop 2026-02-23T06:31:30.153 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.139+0000 7f0056163640 1 -- 10.20.193.58:0/2055573634 reap_dead start 2026-02-23T06:31:30.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.139+0000 7f0056163640 1 -- 10.20.193.58:0/2055573634 reap_dead start 2026-02-23T06:31:30.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.139+0000 7f0017fff640 1 -- 10.20.193.58:0/2055573634 shutdown_connections 2026-02-23T06:31:30.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.139+0000 7f0017fff640 1 -- 10.20.193.58:0/2055573634 >> 10.20.193.58:0/2055573634 conn(0x7f00500b3c20 msgr2=0x7f00500b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:31:30.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.139+0000 7f0017fff640 1 -- 10.20.193.58:0/2055573634 shutdown_connections 2026-02-23T06:31:30.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:30.139+0000 7f0017fff640 1 -- 10.20.193.58:0/2055573634 wait complete. 2026-02-23T06:31:30.154 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:31:30.155 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-23T06:31:30.155 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2026-02-23T06:31:30.155 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-23T06:31:30.155 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-23T06:31:30.155 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-23T06:31:30.155 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:31:30.173 INFO:tasks.ceph.mon.a:Stopped 2026-02-23T06:31:30.173 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.b 2026-02-23T06:31:30.174 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-23T06:31:30.174 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-23T06:31:30.174 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-23T06:31:43.069 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:31:43.073 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:31:45.175 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.b 2026-02-23T06:31:45.175 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-23T06:31:45.176 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-23T06:31:45.176 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:31:45.176 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:31:50.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.190+0000 7f5e669d2640 1 -- 10.20.193.58:0/1828546466 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5e48005400 msgr2=0x7f5e48065a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:50.186 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.190+0000 7f5e669d2640 1 --2- 10.20.193.58:0/1828546466 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5e48005400 0x7f5e48065a10 secure :-1 s=READY pgs=22 gs=29 cs=0 l=1 c_cookie=2656183979335883403 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e600b1b90 tx=0x7f5e5c031020 comp rx=0 tx=0).stop 2026-02-23T06:31:50.186 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.190+0000 7f5e669d2640 1 -- 10.20.193.58:0/1828546466 shutdown_connections 2026-02-23T06:31:50.186 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.190+0000 7f5e669d2640 1 --2- 10.20.193.58:0/1828546466 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5e48005400 0x7f5e48065a10 unknown :-1 s=CLOSED pgs=22 gs=29 cs=0 l=1 c_cookie=2656183979335883403 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:50.186 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.190+0000 7f5e669d2640 1 --2- 10.20.193.58:0/1828546466 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5e48004850 0x7f5e48004cc0 unknown :-1 s=CLOSED pgs=0 gs=27 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:50.186 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.190+0000 7f5e669d2640 1 --2- 10.20.193.58:0/1828546466 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5e48003a30 0x7f5e48003e20 unknown :-1 s=CLOSED pgs=0 gs=28 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:50.186 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.190+0000 7f5e669d2640 1 -- 10.20.193.58:0/1828546466 >> 10.20.193.58:0/1828546466 conn(0x7f5e600b3c20 msgr2=0x7f5e600b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:31:50.186 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.190+0000 7f5e669d2640 1 -- 10.20.193.58:0/1828546466 shutdown_connections 2026-02-23T06:31:50.186 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.190+0000 7f5e669d2640 1 -- 10.20.193.58:0/1828546466 wait complete. 2026-02-23T06:31:50.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.191+0000 7f5e669d2640 1 Processor -- start 2026-02-23T06:31:50.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.191+0000 7f5e669d2640 1 -- start start 2026-02-23T06:31:50.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.192+0000 7f5e669d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5e48003a30 0x7f5e60056a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:50.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.192+0000 7f5e669d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5e48004850 0x7f5e6013abc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:50.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.192+0000 7f5e669d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5e48005400 0x7f5e60159510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:50.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.192+0000 7f5e669d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f5e60201500 con 0x7f5e48005400 2026-02-23T06:31:50.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.192+0000 7f5e669d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f5e60201920 con 0x7f5e48003a30 2026-02-23T06:31:50.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.192+0000 7f5e669d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f5e6013cae0 con 0x7f5e48004850 2026-02-23T06:31:50.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.192+0000 7f5e661d1640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5e48005400 msgr2=0x7f5e60159510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:31:50.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.192+0000 7f5e661d1640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5e48005400 0x7f5e60159510 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:31:50.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.192+0000 7f5e651cf640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5e48004850 0x7f5e6013abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:50.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.192+0000 7f5e659d0640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5e48003a30 0x7f5e60056a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:50.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.192+0000 7f5e651cf640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5e48004850 0x7f5e6013abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:57714/0 (socket says 10.20.193.58:57714) 2026-02-23T06:31:50.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.192+0000 7f5e659d0640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5e48003a30 0x7f5e60056a50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:51934/0 (socket says 10.20.193.58:51934) 2026-02-23T06:31:50.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.192+0000 7f5e651cf640 1 -- 10.20.193.58:0/2317797849 learned_addr learned my addr 10.20.193.58:0/2317797849 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:31:50.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.193+0000 7f5e651cf640 1 -- 10.20.193.58:0/2317797849 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5e48003a30 msgr2=0x7f5e60056a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:50.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.193+0000 7f5e651cf640 1 --2- 10.20.193.58:0/2317797849 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5e48003a30 0x7f5e60056a50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:50.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.193+0000 7f5e651cf640 1 -- 10.20.193.58:0/2317797849 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5e48005400 msgr2=0x7f5e60159510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:31:50.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.193+0000 7f5e651cf640 1 --2- 10.20.193.58:0/2317797849 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5e48005400 0x7f5e60159510 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:50.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.193+0000 7f5e651cf640 1 -- 10.20.193.58:0/2317797849 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e60057290 con 0x7f5e48004850 2026-02-23T06:31:50.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.193+0000 7f5e651cf640 1 --2- 10.20.193.58:0/2317797849 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5e48004850 0x7f5e6013abc0 secure :-1 s=READY pgs=178 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e5400c730 tx=0x7f5e5400cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:50.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.193+0000 7f5e4e7fc640 1 -- 10.20.193.58:0/2317797849 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e5400aa70 con 0x7f5e48004850 2026-02-23T06:31:50.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.193+0000 7f5e669d2640 1 -- 10.20.193.58:0/2317797849 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e60057b60 con 0x7f5e48004850 2026-02-23T06:31:50.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.193+0000 7f5e4e7fc640 1 -- 10.20.193.58:0/2317797849 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e5400ace0 con 0x7f5e48004850 2026-02-23T06:31:50.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.193+0000 7f5e4e7fc640 1 -- 10.20.193.58:0/2317797849 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e540126c0 con 0x7f5e48004850 2026-02-23T06:31:50.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.193+0000 7f5e669d2640 1 -- 10.20.193.58:0/2317797849 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e60057880 con 0x7f5e48004850 2026-02-23T06:31:50.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.194+0000 7f5e669d2640 1 -- 10.20.193.58:0/2317797849 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e600b6d50 con 0x7f5e48004850 2026-02-23T06:31:50.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.195+0000 7f5e4e7fc640 1 -- 10.20.193.58:0/2317797849 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f5e54007030 con 0x7f5e48004850 2026-02-23T06:31:50.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.196+0000 7f5e4e7fc640 1 --2- 10.20.193.58:0/2317797849 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5e3007a5b0 0x7f5e3009aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:50.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.196+0000 7f5e4e7fc640 1 -- 10.20.193.58:0/2317797849 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f5e5409dfa0 con 0x7f5e48004850 2026-02-23T06:31:50.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.197+0000 7f5e4e7fc640 1 -- 10.20.193.58:0/2317797849 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f5e54061020 con 0x7f5e48004850 2026-02-23T06:31:50.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.197+0000 7f5e659d0640 1 --2- 10.20.193.58:0/2317797849 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5e3007a5b0 0x7f5e3009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:50.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.198+0000 7f5e659d0640 1 --2- 10.20.193.58:0/2317797849 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5e3007a5b0 0x7f5e3009aa60 secure :-1 s=READY pgs=276 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e500040b0 tx=0x7f5e50015040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:50.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.352+0000 7f5e669d2640 1 -- 10.20.193.58:0/2317797849 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5e6005b0e0 con 0x7f5e48004850 2026-02-23T06:31:50.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.353+0000 7f5e4e7fc640 1 -- 10.20.193.58:0/2317797849 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1748 (secure 0 0 0) 0x7f5e540641d0 con 0x7f5e48004850 2026-02-23T06:31:50.348 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":84,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:31:50.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.354+0000 7f5e669d2640 1 -- 10.20.193.58:0/2317797849 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5e3007a5b0 msgr2=0x7f5e3009aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:50.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.354+0000 7f5e669d2640 1 --2- 10.20.193.58:0/2317797849 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5e3007a5b0 0x7f5e3009aa60 secure :-1 s=READY pgs=276 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e500040b0 tx=0x7f5e50015040 comp rx=0 tx=0).stop 2026-02-23T06:31:50.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.354+0000 7f5e669d2640 1 -- 10.20.193.58:0/2317797849 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5e48004850 msgr2=0x7f5e6013abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:50.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.354+0000 7f5e669d2640 1 --2- 10.20.193.58:0/2317797849 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5e48004850 0x7f5e6013abc0 secure :-1 s=READY pgs=178 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e5400c730 tx=0x7f5e5400cc00 comp rx=0 tx=0).stop 2026-02-23T06:31:50.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.354+0000 7f5e669d2640 1 -- 10.20.193.58:0/2317797849 shutdown_connections 2026-02-23T06:31:50.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.354+0000 7f5e669d2640 1 --2- 10.20.193.58:0/2317797849 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5e3007a5b0 0x7f5e3009aa60 unknown :-1 s=CLOSED pgs=276 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:50.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.354+0000 7f5e669d2640 1 --2- 10.20.193.58:0/2317797849 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5e48005400 0x7f5e60159510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:50.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.354+0000 7f5e669d2640 1 --2- 10.20.193.58:0/2317797849 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5e48004850 0x7f5e6013abc0 unknown :-1 s=CLOSED pgs=178 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:50.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.354+0000 7f5e669d2640 1 --2- 10.20.193.58:0/2317797849 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5e48003a30 0x7f5e60056a50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:50.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.354+0000 7f5e669d2640 1 -- 10.20.193.58:0/2317797849 >> 10.20.193.58:0/2317797849 conn(0x7f5e600b3c20 msgr2=0x7f5e6005d100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:31:50.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.354+0000 7f5e669d2640 1 -- 10.20.193.58:0/2317797849 shutdown_connections 2026-02-23T06:31:50.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.354+0000 7f5e669d2640 1 -- 10.20.193.58:0/2317797849 wait complete. 2026-02-23T06:31:50.361 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:31:50.361 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-23T06:31:50.361 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:31:50.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.487+0000 7f0063fff640 1 -- 10.20.193.58:0/905760101 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f00640b5680 msgr2=0x7f00640b5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:50.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.487+0000 7f0063fff640 1 --2- 10.20.193.58:0/905760101 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f00640b5680 0x7f00640b5b00 secure :-1 s=READY pgs=179 gs=4 cs=0 l=1 c_cookie=452981156935911221 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f005400a970 tx=0x7f00540302d0 comp rx=0 tx=0).stop 2026-02-23T06:31:50.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.487+0000 7f0063fff640 1 -- 10.20.193.58:0/905760101 shutdown_connections 2026-02-23T06:31:50.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.487+0000 7f0063fff640 1 --2- 10.20.193.58:0/905760101 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f00640b5680 0x7f00640b5b00 unknown :-1 s=CLOSED pgs=179 gs=4 cs=0 l=1 c_cookie=452981156935911221 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:50.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.487+0000 7f0063fff640 1 -- 10.20.193.58:0/905760101 >> 10.20.193.58:0/905760101 conn(0x7f00640b3c20 msgr2=0x7f00640b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:31:50.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.487+0000 7f0063fff640 1 -- 10.20.193.58:0/905760101 shutdown_connections 2026-02-23T06:31:50.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.487+0000 7f0063fff640 1 -- 10.20.193.58:0/905760101 wait complete. 2026-02-23T06:31:50.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.488+0000 7f0063fff640 1 Processor -- start 2026-02-23T06:31:50.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.488+0000 7f0063fff640 1 -- start start 2026-02-23T06:31:50.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.489+0000 7f0063fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0064056550 0x7f00641553b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:50.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.489+0000 7f0063fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00640b5680 0x7f00640b0870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:50.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.489+0000 7f0063fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f006415c040 0x7f00640b0db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:50.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.489+0000 7f0063fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f00640b1740 con 0x7f00640b5680 2026-02-23T06:31:50.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.489+0000 7f0063fff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f0064160330 con 0x7f0064056550 2026-02-23T06:31:50.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.489+0000 7f0063fff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f0064162010 con 0x7f006415c040 2026-02-23T06:31:50.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.489+0000 7f00627fc640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00640b5680 msgr2=0x7f00640b0870 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:31:50.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.489+0000 7f00627fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00640b5680 0x7f00640b0870 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:31:50.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.489+0000 7f0062ffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0064056550 0x7f00641553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:50.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.489+0000 7f00637fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f006415c040 0x7f00640b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:50.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.489+0000 7f0062ffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0064056550 0x7f00641553b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:51940/0 (socket says 10.20.193.58:51940) 2026-02-23T06:31:50.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.489+0000 7f0062ffd640 1 -- 10.20.193.58:0/2463298908 learned_addr learned my addr 10.20.193.58:0/2463298908 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:31:50.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.490+0000 7f0062ffd640 1 -- 10.20.193.58:0/2463298908 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f006415c040 msgr2=0x7f00640b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:50.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.490+0000 7f0062ffd640 1 --2- 10.20.193.58:0/2463298908 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f006415c040 0x7f00640b0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:50.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.490+0000 7f0062ffd640 1 -- 10.20.193.58:0/2463298908 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00640b5680 msgr2=0x7f00640b0870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:31:50.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.490+0000 7f0062ffd640 1 --2- 10.20.193.58:0/2463298908 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00640b5680 0x7f00640b0870 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:50.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.490+0000 7f0062ffd640 1 -- 10.20.193.58:0/2463298908 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f005400a590 con 0x7f0064056550 2026-02-23T06:31:50.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.490+0000 7f0062ffd640 1 --2- 10.20.193.58:0/2463298908 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0064056550 0x7f00641553b0 secure :-1 s=READY pgs=24 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f005800b520 tx=0x7f005800b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:50.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.490+0000 7f00437fe640 1 -- 10.20.193.58:0/2463298908 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0058002cd0 con 0x7f0064056550 2026-02-23T06:31:50.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.490+0000 7f00437fe640 1 -- 10.20.193.58:0/2463298908 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0058004070 con 0x7f0064056550 2026-02-23T06:31:50.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.490+0000 7f0063fff640 1 -- 10.20.193.58:0/2463298908 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00640b14a0 con 0x7f0064056550 2026-02-23T06:31:50.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.490+0000 7f00437fe640 1 -- 10.20.193.58:0/2463298908 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00580044a0 con 0x7f0064056550 2026-02-23T06:31:50.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.490+0000 7f0063fff640 1 -- 10.20.193.58:0/2463298908 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f006415ff50 con 0x7f0064056550 2026-02-23T06:31:50.487 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.491+0000 7f0063fff640 1 --2- 10.20.193.58:0/2463298908 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0064162b40 0x7f0064160a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:50.487 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.491+0000 7f0063fff640 1 -- 10.20.193.58:0/2463298908 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f006415c410 con 0x7f0064162b40 2026-02-23T06:31:50.487 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.491+0000 7f00627fc640 1 --2- 10.20.193.58:0/2463298908 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0064162b40 0x7f0064160a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:50.487 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.491+0000 7f00627fc640 1 -- 10.20.193.58:0/2463298908 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0064166120 con 0x7f0064162b40 2026-02-23T06:31:50.487 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.491+0000 7f00627fc640 1 --2- 10.20.193.58:0/2463298908 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0064162b40 0x7f0064160a30 secure :-1 s=READY pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0064157400 tx=0x7f004c00c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:50.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.491+0000 7f00437fe640 1 -- 10.20.193.58:0/2463298908 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f004c005e30 con 0x7f0064162b40 2026-02-23T06:31:50.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.492+0000 7f00437fe640 1 -- 10.20.193.58:0/2463298908 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f004c0070d0 con 0x7f0064162b40 2026-02-23T06:31:50.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.492+0000 7f00437fe640 1 -- 10.20.193.58:0/2463298908 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0064162b40 msgr2=0x7f0064160a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:50.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.492+0000 7f00437fe640 1 --2- 10.20.193.58:0/2463298908 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0064162b40 0x7f0064160a30 secure :-1 s=READY pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0064157400 tx=0x7f004c00c910 comp rx=0 tx=0).stop 2026-02-23T06:31:50.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.492+0000 7f00437fe640 1 -- 10.20.193.58:0/2463298908 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0064162b40 msgr2=0x7f0064160a30 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:31:50.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.492+0000 7f00437fe640 1 --2- 10.20.193.58:0/2463298908 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0064162b40 0x7f0064160a30 secure :-1 s=CLOSED pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0064157400 tx=0x7f004c00c910 comp rx=0 tx=0).stop 2026-02-23T06:31:50.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.492+0000 7f00437fe640 1 -- 10.20.193.58:0/2463298908 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f005800d040 con 0x7f0064056550 2026-02-23T06:31:50.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.493+0000 7f00437fe640 1 --2- 10.20.193.58:0/2463298908 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f003007a430 0x7f003009a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:50.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.493+0000 7f00437fe640 1 -- 10.20.193.58:0/2463298908 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f005809d330 con 0x7f0064056550 2026-02-23T06:31:50.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.493+0000 7f00627fc640 1 --2- 10.20.193.58:0/2463298908 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f003007a430 0x7f003009a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:50.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.494+0000 7f00627fc640 1 --2- 10.20.193.58:0/2463298908 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f003007a430 0x7f003009a8e0 secure :-1 s=READY pgs=277 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f004c00cfd0 tx=0x7f004c007000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:50.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.496+0000 7f0063fff640 1 --2- 10.20.193.58:0/2463298908 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0064164b00 0x7f0064160f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:50.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.496+0000 7f0063fff640 1 -- 10.20.193.58:0/2463298908 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f0064160470 con 0x7f0064164b00 2026-02-23T06:31:50.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.496+0000 7f00637fe640 1 --2- 10.20.193.58:0/2463298908 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0064164b00 0x7f0064160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:50.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.496+0000 7f00637fe640 1 -- 10.20.193.58:0/2463298908 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0064155dd0 con 0x7f0064164b00 2026-02-23T06:31:50.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.496+0000 7f00637fe640 1 --2- 10.20.193.58:0/2463298908 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0064164b00 0x7f0064160f70 secure :-1 s=READY pgs=26 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f005400a970 tx=0x7f0054003d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:50.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.497+0000 7f00437fe640 1 -- 10.20.193.58:0/2463298908 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f005403e050 con 0x7f0064164b00 2026-02-23T06:31:50.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.497+0000 7f00437fe640 1 -- 10.20.193.58:0/2463298908 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4901 (secure 0 0 0) 0x7f005403f040 con 0x7f0064164b00 2026-02-23T06:31:50.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.497+0000 7f00437fe640 1 -- 10.20.193.58:0/2463298908 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0064164b00 msgr2=0x7f0064160f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:50.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.497+0000 7f00437fe640 1 --2- 10.20.193.58:0/2463298908 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0064164b00 0x7f0064160f70 secure :-1 s=READY pgs=26 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f005400a970 tx=0x7f0054003d20 comp rx=0 tx=0).stop 2026-02-23T06:31:50.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.497+0000 7f00437fe640 1 -- 10.20.193.58:0/2463298908 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0064164b00 msgr2=0x7f0064160f70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:31:50.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.497+0000 7f00437fe640 1 --2- 10.20.193.58:0/2463298908 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0064164b00 0x7f0064160f70 unknown :-1 s=CLOSED pgs=26 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:50.492 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:31:50.492 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:31:50.493 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:31:50.493 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:31:50.493 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 84, 2026-02-23T06:31:50.493 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 47073, 2026-02-23T06:31:50.493 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:31:50.493 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:31:50.493 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:31:50.493 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:50.493 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:31:50.493 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:31:50.493 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:31:50.493 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:31:50.493 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:31:50.493 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:31:50.493 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:31:50.493 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:31:50.493 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:31:50.494 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:31:50.494 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:31:50.494 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:31:50.494 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:31:50.494 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:31:50.494 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:31:50.494 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:31:50.494 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:31:50.494 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:50.494 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:31:50.494 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:31:50.494 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:31:50.494 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:31:50.494 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:31:50.494 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:31:50.494 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:31:50.494 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:31:50.495 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:31:50.495 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:31:50.495 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:31:50.495 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:31:50.495 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:31:50.495 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:31:50.495 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:31:50.495 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:50.495 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:50.495 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:31:50.495 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:31:50.495 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:31:50.495 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:31:50.495 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:31:50.495 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:31:50.495 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:31:50.496 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:31:50.496 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:31:50.496 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:31:50.496 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:31:50.496 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:31:50.496 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:31:50.496 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:31:50.496 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:31:50.496 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:31:50.496 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:31:50.496 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:31:50.496 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:31:50.496 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:31:50.496 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:31:50.496 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:31:50.496 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:31:50.496 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:31:50.497 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:31:50.497 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:31:50.497 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:31:50.497 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:31:50.497 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:31:50.497 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:31:50.497 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:50.497 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:31:50.497 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:50.497 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:31:50.497 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:50.497 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:31:50.497 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:31:50.497 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:31:50.497 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:31:50.497 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:50.497 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:31:50.497 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:31:50.497 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:50.497 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:50.498 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:50.498 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:31:50.498 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:31:50.498 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:50.498 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:50.498 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:50.498 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:50.498 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:31:50.498 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:31:50.498 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:31:50.498 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:31:50.498 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:31:50.498 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:31:50.498 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:50.498 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:50.498 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:31:50.498 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:31:50.498 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:31:50.498 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:31:50.498 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:50.498 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:31:50.499 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:31:50.499 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:50.499 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:50.499 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:50.499 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:31:50.499 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:31:50.499 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:50.499 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:50.499 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:50.499 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:50.499 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:31:50.499 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:31:50.499 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:31:50.499 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:31:50.499 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:31:50.499 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:31:50.499 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:50.499 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:50.499 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:31:50.499 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:31:50.499 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:31:50.500 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:31:50.500 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:50.500 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:31:50.500 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:31:50.500 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:50.500 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:50.500 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:50.500 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:31:50.500 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:31:50.500 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:50.500 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:50.500 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:50.500 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:50.500 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:31:50.500 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:31:50.500 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:31:50.500 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:31:50.500 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:31:50.500 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:31:50.500 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:50.501 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:50.501 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:50.501 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:31:50.501 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:31:50.501 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:50.501 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:31:50.501 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:31:50.501 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:31:50.501 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:50.501 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:50.501 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:31:50.501 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:50.501 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:31:50.501 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:31:50.501 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:31:50.501 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:50.501 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:50.501 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:50.501 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:31:50.501 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:31:50.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.497+0000 7f0063fff640 1 -- 10.20.193.58:0/2463298908 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f003007a430 msgr2=0x7f003009a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:50.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.497+0000 7f0063fff640 1 --2- 10.20.193.58:0/2463298908 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f003007a430 0x7f003009a8e0 secure :-1 s=READY pgs=277 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f004c00cfd0 tx=0x7f004c007000 comp rx=0 tx=0).stop 2026-02-23T06:31:50.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.497+0000 7f0063fff640 1 -- 10.20.193.58:0/2463298908 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0064056550 msgr2=0x7f00641553b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:50.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.497+0000 7f0063fff640 1 --2- 10.20.193.58:0/2463298908 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0064056550 0x7f00641553b0 secure :-1 s=READY pgs=24 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f005800b520 tx=0x7f005800b9f0 comp rx=0 tx=0).stop 2026-02-23T06:31:50.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.497+0000 7f00637fe640 1 -- 10.20.193.58:0/2463298908 reap_dead start 2026-02-23T06:31:50.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.497+0000 7f00637fe640 1 -- 10.20.193.58:0/2463298908 reap_dead start 2026-02-23T06:31:50.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.497+0000 7f0063fff640 1 -- 10.20.193.58:0/2463298908 shutdown_connections 2026-02-23T06:31:50.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.497+0000 7f0063fff640 1 -- 10.20.193.58:0/2463298908 >> 10.20.193.58:0/2463298908 conn(0x7f00640b3c20 msgr2=0x7f0064157430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:31:50.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.497+0000 7f0063fff640 1 -- 10.20.193.58:0/2463298908 shutdown_connections 2026-02-23T06:31:50.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.497+0000 7f0063fff640 1 -- 10.20.193.58:0/2463298908 wait complete. 2026-02-23T06:31:50.503 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:31:50.503 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-23T06:31:50.503 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:31:50.626 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.629+0000 7fb622c3a640 1 -- 10.20.193.58:0/848597171 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb61c056550 msgr2=0x7fb61c05ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:50.626 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.629+0000 7fb622c3a640 1 --2- 10.20.193.58:0/848597171 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb61c056550 0x7fb61c05ce30 secure :-1 s=READY pgs=27 gs=2 cs=0 l=1 c_cookie=4527278813767177300 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb61c059aa0 tx=0x7fb61002f280 comp rx=0 tx=0).stop 2026-02-23T06:31:50.626 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.629+0000 7fb622c3a640 1 -- 10.20.193.58:0/848597171 shutdown_connections 2026-02-23T06:31:50.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.629+0000 7fb622c3a640 1 --2- 10.20.193.58:0/848597171 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb61c056550 0x7fb61c05ce30 unknown :-1 s=CLOSED pgs=27 gs=2 cs=0 l=1 c_cookie=4527278813767177300 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:50.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.629+0000 7fb622c3a640 1 --2- 10.20.193.58:0/848597171 >> v2:10.20.193.58:3300/0 conn(0x7fb61c15c040 0x7fb61c05b0e0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:50.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.629+0000 7fb622c3a640 1 -- 10.20.193.58:0/848597171 >> 10.20.193.58:0/848597171 conn(0x7fb61c0b3c20 msgr2=0x7fb61c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:31:50.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.629+0000 7fb622c3a640 1 -- 10.20.193.58:0/848597171 shutdown_connections 2026-02-23T06:31:50.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.629+0000 7fb622c3a640 1 -- 10.20.193.58:0/848597171 wait complete. 2026-02-23T06:31:50.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.631+0000 7fb622c3a640 1 Processor -- start 2026-02-23T06:31:50.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.631+0000 7fb622c3a640 1 -- start start 2026-02-23T06:31:50.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.631+0000 7fb622c3a640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb61c056550 0x7fb61c120540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:50.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.631+0000 7fb622c3a640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb61c05d370 0x7fb61c156af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:50.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.631+0000 7fb622c3a640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb61c15c040 0x7fb61c057b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:50.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.631+0000 7fb622c3a640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb61c121a60 con 0x7fb61c15c040 2026-02-23T06:31:50.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.631+0000 7fb622c3a640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb61c121de0 con 0x7fb61c056550 2026-02-23T06:31:50.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.631+0000 7fb622c3a640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb61c122010 con 0x7fb61c05d370 2026-02-23T06:31:50.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.631+0000 7fb622439640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb61c15c040 msgr2=0x7fb61c057b50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:31:50.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.631+0000 7fb622439640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb61c15c040 0x7fb61c057b50 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:31:50.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.631+0000 7fb621c38640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb61c056550 0x7fb61c120540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:50.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.631+0000 7fb621c38640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb61c056550 0x7fb61c120540 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:51980/0 (socket says 10.20.193.58:51980) 2026-02-23T06:31:50.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.631+0000 7fb621c38640 1 -- 10.20.193.58:0/491288854 learned_addr learned my addr 10.20.193.58:0/491288854 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:31:50.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.632+0000 7fb621437640 1 --2- 10.20.193.58:0/491288854 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb61c05d370 0x7fb61c156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:50.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.632+0000 7fb621c38640 1 -- 10.20.193.58:0/491288854 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb61c05d370 msgr2=0x7fb61c156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:50.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.632+0000 7fb621c38640 1 --2- 10.20.193.58:0/491288854 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb61c05d370 0x7fb61c156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:50.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.632+0000 7fb621c38640 1 -- 10.20.193.58:0/491288854 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb61c15c040 msgr2=0x7fb61c057b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:31:50.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.632+0000 7fb621c38640 1 --2- 10.20.193.58:0/491288854 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb61c15c040 0x7fb61c057b50 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:50.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.632+0000 7fb621c38640 1 -- 10.20.193.58:0/491288854 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb610009570 con 0x7fb61c056550 2026-02-23T06:31:50.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.632+0000 7fb621437640 1 --2- 10.20.193.58:0/491288854 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb61c05d370 0x7fb61c156af0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:31:50.637 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.632+0000 7fb621c38640 1 --2- 10.20.193.58:0/491288854 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb61c056550 0x7fb61c120540 secure :-1 s=READY pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb60c00b520 tx=0x7fb60c00b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:50.637 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.632+0000 7fb60a7fc640 1 -- 10.20.193.58:0/491288854 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb60c002cd0 con 0x7fb61c056550 2026-02-23T06:31:50.637 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.632+0000 7fb60a7fc640 1 -- 10.20.193.58:0/491288854 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb60c004070 con 0x7fb61c056550 2026-02-23T06:31:50.637 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.632+0000 7fb60a7fc640 1 -- 10.20.193.58:0/491288854 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb60c0044a0 con 0x7fb61c056550 2026-02-23T06:31:50.637 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.632+0000 7fb622c3a640 1 -- 10.20.193.58:0/491288854 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb61c121530 con 0x7fb61c056550 2026-02-23T06:31:50.637 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.632+0000 7fb622c3a640 1 -- 10.20.193.58:0/491288854 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb61c1210d0 con 0x7fb61c056550 2026-02-23T06:31:50.637 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.633+0000 7fb622c3a640 1 --2- 10.20.193.58:0/491288854 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb61c157030 0x7fb61c124610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:50.638 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.633+0000 7fb622c3a640 1 -- 10.20.193.58:0/491288854 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb61c15c410 con 0x7fb61c157030 2026-02-23T06:31:50.638 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.633+0000 7fb621437640 1 --2- 10.20.193.58:0/491288854 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb61c157030 0x7fb61c124610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:50.638 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.633+0000 7fb621437640 1 -- 10.20.193.58:0/491288854 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb61c05b620 con 0x7fb61c157030 2026-02-23T06:31:50.638 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.634+0000 7fb621437640 1 --2- 10.20.193.58:0/491288854 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb61c157030 0x7fb61c124610 secure :-1 s=READY pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb610004740 tx=0x7fb610002d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:50.638 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.634+0000 7fb60a7fc640 1 -- 10.20.193.58:0/491288854 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb61003d050 con 0x7fb61c157030 2026-02-23T06:31:50.638 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.634+0000 7fb60a7fc640 1 -- 10.20.193.58:0/491288854 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fb61003e040 con 0x7fb61c157030 2026-02-23T06:31:50.638 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.634+0000 7fb60a7fc640 1 -- 10.20.193.58:0/491288854 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb61c157030 msgr2=0x7fb61c124610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:50.638 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.634+0000 7fb60a7fc640 1 --2- 10.20.193.58:0/491288854 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb61c157030 0x7fb61c124610 secure :-1 s=READY pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb610004740 tx=0x7fb610002d10 comp rx=0 tx=0).stop 2026-02-23T06:31:50.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.634+0000 7fb60a7fc640 1 -- 10.20.193.58:0/491288854 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb61c157030 msgr2=0x7fb61c124610 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:31:50.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.634+0000 7fb60a7fc640 1 --2- 10.20.193.58:0/491288854 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb61c157030 0x7fb61c124610 unknown :-1 s=CLOSED pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:50.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.634+0000 7fb60a7fc640 1 -- 10.20.193.58:0/491288854 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fb60c00d040 con 0x7fb61c056550 2026-02-23T06:31:50.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.635+0000 7fb60a7fc640 1 --2- 10.20.193.58:0/491288854 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb5ec07a3c0 0x7fb5ec09a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:50.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.635+0000 7fb60a7fc640 1 -- 10.20.193.58:0/491288854 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fb60c09d430 con 0x7fb61c056550 2026-02-23T06:31:50.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.636+0000 7fb621437640 1 --2- 10.20.193.58:0/491288854 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb5ec07a3c0 0x7fb5ec09a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:50.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.636+0000 7fb621437640 1 --2- 10.20.193.58:0/491288854 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb5ec07a3c0 0x7fb5ec09a870 secure :-1 s=READY pgs=278 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb610005b30 tx=0x7fb610031030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:50.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.638+0000 7fb622c3a640 1 --2- 10.20.193.58:0/491288854 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb61c058090 0x7fb61c124b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:31:50.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.638+0000 7fb622c3a640 1 -- 10.20.193.58:0/491288854 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb61c058610 con 0x7fb61c058090 2026-02-23T06:31:50.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.638+0000 7fb622439640 1 --2- 10.20.193.58:0/491288854 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb61c058090 0x7fb61c124b50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:31:50.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.638+0000 7fb622439640 1 -- 10.20.193.58:0/491288854 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb61c05ce30 con 0x7fb61c058090 2026-02-23T06:31:50.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.638+0000 7fb622439640 1 --2- 10.20.193.58:0/491288854 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb61c058090 0x7fb61c124b50 secure :-1 s=READY pgs=181 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb61c1584a0 tx=0x7fb61800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:31:50.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.639+0000 7fb60a7fc640 1 -- 10.20.193.58:0/491288854 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6180070d0 con 0x7fb61c058090 2026-02-23T06:31:50.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.639+0000 7fb60a7fc640 1 -- 10.20.193.58:0/491288854 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5544 (secure 0 0 0) 0x7fb618007230 con 0x7fb61c058090 2026-02-23T06:31:50.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.639+0000 7fb60a7fc640 1 -- 10.20.193.58:0/491288854 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb61c058090 msgr2=0x7fb61c124b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:50.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.639+0000 7fb60a7fc640 1 --2- 10.20.193.58:0/491288854 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb61c058090 0x7fb61c124b50 secure :-1 s=READY pgs=181 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb61c1584a0 tx=0x7fb61800c8f0 comp rx=0 tx=0).stop 2026-02-23T06:31:50.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.639+0000 7fb60a7fc640 1 -- 10.20.193.58:0/491288854 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb61c058090 msgr2=0x7fb61c124b50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:31:50.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.639+0000 7fb60a7fc640 1 --2- 10.20.193.58:0/491288854 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb61c058090 0x7fb61c124b50 unknown :-1 s=CLOSED pgs=181 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:31:50.643 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:31:50.644 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:31:50.644 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:31:50.644 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:31:50.645 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 84, 2026-02-23T06:31:50.645 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 385151, 2026-02-23T06:31:50.645 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:31:50.645 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:31:50.645 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:31:50.645 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:50.645 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:31:50.645 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:31:50.646 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:31:50.646 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:31:50.646 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:31:50.646 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:31:50.646 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:31:50.646 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:31:50.646 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:31:50.646 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:31:50.646 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:31:50.646 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:31:50.646 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:31:50.646 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:31:50.647 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:31:50.647 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:31:50.647 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:31:50.647 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:50.647 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:31:50.647 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:31:50.647 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:31:50.647 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:31:50.647 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:31:50.647 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:31:50.647 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:31:50.648 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:31:50.648 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:31:50.648 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:31:50.648 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:31:50.648 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:31:50.648 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:31:50.648 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:31:50.648 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:31:50.648 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:50.648 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:50.648 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:31:50.648 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:31:50.648 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:31:50.649 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:31:50.649 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:31:50.649 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:31:50.649 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:31:50.649 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:31:50.649 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:31:50.649 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:31:50.649 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:31:50.649 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:31:50.649 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:31:50.649 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:31:50.650 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:31:50.650 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:31:50.650 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:31:50.650 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:31:50.650 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:31:50.650 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:31:50.650 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:31:50.650 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:31:50.650 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:31:50.650 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:31:50.650 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:31:50.650 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:31:50.651 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:31:50.651 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:31:50.651 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:31:50.651 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:31:50.651 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:50.651 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:31:50.651 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:50.651 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:31:50.651 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:50.651 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:31:50.651 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:31:50.651 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:31:50.652 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:31:50.652 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:50.652 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:31:50.652 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:31:50.652 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:50.652 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:50.652 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:50.652 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:31:50.652 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:31:50.652 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:50.652 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:50.652 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:50.653 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:50.653 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:31:50.653 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:31:50.653 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:31:50.653 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:31:50.653 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:31:50.653 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:31:50.653 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:50.653 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:50.653 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:31:50.653 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:31:50.653 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:31:50.654 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:31:50.654 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:50.654 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:31:50.654 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:31:50.654 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:50.654 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:50.654 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:50.654 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:31:50.654 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:31:50.654 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:50.654 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:50.654 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:50.655 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:50.655 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:31:50.655 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:31:50.655 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:31:50.655 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:31:50.655 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:31:50.655 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:31:50.655 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:50.655 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:50.655 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:31:50.655 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:31:50.655 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:31:50.656 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:31:50.656 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:50.656 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:31:50.656 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:31:50.656 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:50.656 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:50.656 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:50.656 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:31:50.656 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:31:50.656 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:31:50.656 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:50.656 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:50.656 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:50.657 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:31:50.657 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:31:50.657 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:31:50.657 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:31:50.657 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:31:50.657 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:31:50.657 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:50.657 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:50.657 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:50.657 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:31:50.657 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:31:50.657 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:50.658 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:31:50.658 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:31:50.658 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:31:50.658 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:50.658 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:50.658 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:31:50.658 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:50.658 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:31:50.658 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:31:50.658 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:31:50.658 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:50.658 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:50.658 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:31:50.658 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:50.659 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:31:50.659 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:31:50.659 INFO:teuthology.orchestra.run.trial058.stdout: "num": 8 2026-02-23T06:31:50.659 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:50.659 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:50.659 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:31:50.659 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:50.659 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:31:50.659 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:31:50.659 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:31:50.659 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:50.659 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:50.659 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:31:50.660 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:31:50.660 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:31:50.660 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:50.660 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:31:50.660 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:31:50.660 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:31:50.660 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:31:50.660 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:31:50.660 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:31:50.660 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:31:50.660 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:31:50.660 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:31:50.660 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:31:50.660 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:31:50.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.639+0000 7fb622c3a640 1 -- 10.20.193.58:0/491288854 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb5ec07a3c0 msgr2=0x7fb5ec09a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:50.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.639+0000 7fb622c3a640 1 --2- 10.20.193.58:0/491288854 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb5ec07a3c0 0x7fb5ec09a870 secure :-1 s=READY pgs=278 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb610005b30 tx=0x7fb610031030 comp rx=0 tx=0).stop 2026-02-23T06:31:50.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.639+0000 7fb622c3a640 1 -- 10.20.193.58:0/491288854 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb61c056550 msgr2=0x7fb61c120540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:31:50.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.639+0000 7fb622c3a640 1 --2- 10.20.193.58:0/491288854 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb61c056550 0x7fb61c120540 secure :-1 s=READY pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb60c00b520 tx=0x7fb60c00b9f0 comp rx=0 tx=0).stop 2026-02-23T06:31:50.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.639+0000 7fb622439640 1 -- 10.20.193.58:0/491288854 reap_dead start 2026-02-23T06:31:50.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.639+0000 7fb622439640 1 -- 10.20.193.58:0/491288854 reap_dead start 2026-02-23T06:31:50.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.639+0000 7fb622c3a640 1 -- 10.20.193.58:0/491288854 shutdown_connections 2026-02-23T06:31:50.664 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.639+0000 7fb622c3a640 1 -- 10.20.193.58:0/491288854 >> 10.20.193.58:0/491288854 conn(0x7fb61c0b3c20 msgr2=0x7fb61c15aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:31:50.664 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.639+0000 7fb622c3a640 1 -- 10.20.193.58:0/491288854 shutdown_connections 2026-02-23T06:31:50.664 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:31:50.639+0000 7fb622c3a640 1 -- 10.20.193.58:0/491288854 wait complete. 2026-02-23T06:31:50.664 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:31:50.665 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:32:10.665 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-23T06:32:10.665 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-23T06:32:10.665 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-23T06:32:10.666 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-23T06:32:10.671 INFO:tasks.ceph.mon.a:Started 2026-02-23T06:32:10.671 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.b 2026-02-23T06:32:10.671 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-23T06:32:10.672 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-23T06:32:10.672 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-23T06:32:13.130 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:32:13.135 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:32:25.672 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.b 2026-02-23T06:32:25.672 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-23T06:32:25.673 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-23T06:32:25.673 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:32:25.673 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:32:25.796 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.800+0000 7fb734954640 1 -- 10.20.193.58:0/3123334658 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb73015d4a0 msgr2=0x7fb7300affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:25.796 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.800+0000 7fb734954640 1 --2- 10.20.193.58:0/3123334658 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb73015d4a0 0x7fb7300affb0 secure :-1 s=READY pgs=5 gs=2 cs=0 l=1 c_cookie=5498929084101942028 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb71c005e70 tx=0x7fb71c02f290 comp rx=0 tx=0).stop 2026-02-23T06:32:25.796 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.800+0000 7fb734954640 1 -- 10.20.193.58:0/3123334658 shutdown_connections 2026-02-23T06:32:25.796 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.800+0000 7fb734954640 1 --2- 10.20.193.58:0/3123334658 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb73015d870 0x7fb7300587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:25.796 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.800+0000 7fb734954640 1 --2- 10.20.193.58:0/3123334658 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb73015d4a0 0x7fb7300affb0 unknown :-1 s=CLOSED pgs=5 gs=2 cs=0 l=1 c_cookie=5498929084101942028 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:25.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.800+0000 7fb734954640 1 -- 10.20.193.58:0/3123334658 >> 10.20.193.58:0/3123334658 conn(0x7fb7300b3c20 msgr2=0x7fb7300b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:25.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.800+0000 7fb734954640 1 -- 10.20.193.58:0/3123334658 shutdown_connections 2026-02-23T06:32:25.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.800+0000 7fb734954640 1 -- 10.20.193.58:0/3123334658 wait complete. 2026-02-23T06:32:25.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.801+0000 7fb734954640 1 Processor -- start 2026-02-23T06:32:25.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.801+0000 7fb734954640 1 -- start start 2026-02-23T06:32:25.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.802+0000 7fb734954640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7300b6690 0x7fb73013d3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:25.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.802+0000 7fb734954640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb73015d4a0 0x7fb7301404e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:25.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.802+0000 7fb734954640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb73015d870 0x7fb730140a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:25.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.802+0000 7fb734954640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb730140050 con 0x7fb7300b6690 2026-02-23T06:32:25.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.802+0000 7fb734954640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb730057e50 con 0x7fb73015d4a0 2026-02-23T06:32:25.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.802+0000 7fb734954640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb7300580f0 con 0x7fb73015d870 2026-02-23T06:32:25.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.802+0000 7fb72f7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7300b6690 0x7fb73013d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:25.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.802+0000 7fb72f7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7300b6690 0x7fb73013d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:45142/0 (socket says 10.20.193.58:45142) 2026-02-23T06:32:25.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.802+0000 7fb72f7fe640 1 -- 10.20.193.58:0/149879911 learned_addr learned my addr 10.20.193.58:0/149879911 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:32:25.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.802+0000 7fb72effd640 1 --2- 10.20.193.58:0/149879911 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb73015d4a0 0x7fb7301404e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:25.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.802+0000 7fb72f7fe640 1 -- 10.20.193.58:0/149879911 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb73015d870 msgr2=0x7fb730140a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:25.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.802+0000 7fb72f7fe640 1 --2- 10.20.193.58:0/149879911 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb73015d870 0x7fb730140a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:25.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.802+0000 7fb72f7fe640 1 -- 10.20.193.58:0/149879911 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb73015d4a0 msgr2=0x7fb7301404e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:25.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.802+0000 7fb72f7fe640 1 --2- 10.20.193.58:0/149879911 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb73015d4a0 0x7fb7301404e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:25.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.802+0000 7fb72f7fe640 1 -- 10.20.193.58:0/149879911 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb71c009570 con 0x7fb7300b6690 2026-02-23T06:32:25.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.803+0000 7fb72f7fe640 1 --2- 10.20.193.58:0/149879911 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7300b6690 0x7fb73013d3f0 secure :-1 s=READY pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb71c004740 tx=0x7fb71c0028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:25.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.803+0000 7fb70bfff640 1 -- 10.20.193.58:0/149879911 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb71c03d070 con 0x7fb7300b6690 2026-02-23T06:32:25.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.803+0000 7fb70bfff640 1 -- 10.20.193.58:0/149879911 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb71c038470 con 0x7fb7300b6690 2026-02-23T06:32:25.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.803+0000 7fb70bfff640 1 -- 10.20.193.58:0/149879911 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb71c0388a0 con 0x7fb7300b6690 2026-02-23T06:32:25.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.803+0000 7fb734954640 1 -- 10.20.193.58:0/149879911 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7301fe5b0 con 0x7fb7300b6690 2026-02-23T06:32:25.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.803+0000 7fb734954640 1 -- 10.20.193.58:0/149879911 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb73015e030 con 0x7fb7300b6690 2026-02-23T06:32:25.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.803+0000 7fb709ffb640 1 -- 10.20.193.58:0/149879911 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6f4005300 con 0x7fb7300b6690 2026-02-23T06:32:25.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.805+0000 7fb70bfff640 1 -- 10.20.193.58:0/149879911 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fb71c038a00 con 0x7fb7300b6690 2026-02-23T06:32:25.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.806+0000 7fb70bfff640 1 --2- 10.20.193.58:0/149879911 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb70007a6c0 0x7fb70009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:25.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.806+0000 7fb70bfff640 1 -- 10.20.193.58:0/149879911 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fb71c0c23a0 con 0x7fb7300b6690 2026-02-23T06:32:25.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.806+0000 7fb72effd640 1 --2- 10.20.193.58:0/149879911 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb70007a6c0 0x7fb70009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:25.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.807+0000 7fb72effd640 1 --2- 10.20.193.58:0/149879911 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb70007a6c0 0x7fb70009ab70 secure :-1 s=READY pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb720005970 tx=0x7fb720005900 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:25.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.809+0000 7fb70bfff640 1 -- 10.20.193.58:0/149879911 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fb71c085420 con 0x7fb7300b6690 2026-02-23T06:32:25.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.964+0000 7fb709ffb640 1 -- 10.20.193.58:0/149879911 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb6f4005b30 con 0x7fb7300b6690 2026-02-23T06:32:25.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.964+0000 7fb70bfff640 1 -- 10.20.193.58:0/149879911 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1754 (secure 0 0 0) 0x7fb71c0885d0 con 0x7fb7300b6690 2026-02-23T06:32:25.960 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":92,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:32:25.961 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.966+0000 7fb709ffb640 1 -- 10.20.193.58:0/149879911 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb70007a6c0 msgr2=0x7fb70009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:25.961 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.966+0000 7fb709ffb640 1 --2- 10.20.193.58:0/149879911 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb70007a6c0 0x7fb70009ab70 secure :-1 s=READY pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb720005970 tx=0x7fb720005900 comp rx=0 tx=0).stop 2026-02-23T06:32:25.962 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.966+0000 7fb709ffb640 1 -- 10.20.193.58:0/149879911 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7300b6690 msgr2=0x7fb73013d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:25.962 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.966+0000 7fb709ffb640 1 --2- 10.20.193.58:0/149879911 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7300b6690 0x7fb73013d3f0 secure :-1 s=READY pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb71c004740 tx=0x7fb71c0028d0 comp rx=0 tx=0).stop 2026-02-23T06:32:25.962 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.966+0000 7fb709ffb640 1 -- 10.20.193.58:0/149879911 shutdown_connections 2026-02-23T06:32:25.962 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.966+0000 7fb709ffb640 1 --2- 10.20.193.58:0/149879911 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb70007a6c0 0x7fb70009ab70 unknown :-1 s=CLOSED pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:25.962 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.966+0000 7fb709ffb640 1 --2- 10.20.193.58:0/149879911 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb73015d870 0x7fb730140a20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:25.962 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.966+0000 7fb709ffb640 1 --2- 10.20.193.58:0/149879911 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb73015d4a0 0x7fb7301404e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:25.962 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.966+0000 7fb709ffb640 1 --2- 10.20.193.58:0/149879911 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7300b6690 0x7fb73013d3f0 unknown :-1 s=CLOSED pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:25.962 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.966+0000 7fb709ffb640 1 -- 10.20.193.58:0/149879911 >> 10.20.193.58:0/149879911 conn(0x7fb7300b3c20 msgr2=0x7fb73015c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:25.962 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.966+0000 7fb709ffb640 1 -- 10.20.193.58:0/149879911 shutdown_connections 2026-02-23T06:32:25.962 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:25.966+0000 7fb709ffb640 1 -- 10.20.193.58:0/149879911 wait complete. 2026-02-23T06:32:25.973 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:32:25.973 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:32:25.973 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:32:26.095 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.100+0000 7f02f6dd2640 1 -- 10.20.193.58:0/40134958 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f02f00b6690 msgr2=0x7f02f0058ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:26.096 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.100+0000 7f02f6dd2640 1 --2- 10.20.193.58:0/40134958 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f02f00b6690 0x7f02f0058ec0 secure :-1 s=READY pgs=184 gs=3 cs=0 l=1 c_cookie=15347726336644169654 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02ec00a970 tx=0x7f02ec0302d0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.096 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.100+0000 7f02f6dd2640 1 -- 10.20.193.58:0/40134958 shutdown_connections 2026-02-23T06:32:26.096 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.100+0000 7f02f6dd2640 1 --2- 10.20.193.58:0/40134958 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f02f00b6690 0x7f02f0058ec0 unknown :-1 s=CLOSED pgs=184 gs=3 cs=0 l=1 c_cookie=15347726336644169654 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.096 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.100+0000 7f02f6dd2640 1 -- 10.20.193.58:0/40134958 >> 10.20.193.58:0/40134958 conn(0x7f02f00b3c20 msgr2=0x7f02f00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:26.096 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.100+0000 7f02f6dd2640 1 -- 10.20.193.58:0/40134958 shutdown_connections 2026-02-23T06:32:26.096 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.100+0000 7f02f6dd2640 1 -- 10.20.193.58:0/40134958 wait complete. 2026-02-23T06:32:26.099 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.101+0000 7f02f6dd2640 1 Processor -- start 2026-02-23T06:32:26.099 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.101+0000 7f02f6dd2640 1 -- start start 2026-02-23T06:32:26.099 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.102+0000 7f02f6dd2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f02f00b6690 0x7f02f00561f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:26.099 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.102+0000 7f02f6dd2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f02f015d4a0 0x7f02f013e7e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:26.099 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.102+0000 7f02f6dd2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02f015d870 0x7f02f013a820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:26.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.102+0000 7f02f6dd2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f02f013a680 con 0x7f02f015d870 2026-02-23T06:32:26.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.102+0000 7f02f6dd2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f02f015b950 con 0x7f02f015d4a0 2026-02-23T06:32:26.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.102+0000 7f02f6dd2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f02f013a3e0 con 0x7f02f00b6690 2026-02-23T06:32:26.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.102+0000 7f02f5dd0640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f02f00b6690 0x7f02f00561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:26.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.102+0000 7f02f5dd0640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f02f00b6690 0x7f02f00561f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:43398/0 (socket says 10.20.193.58:43398) 2026-02-23T06:32:26.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.102+0000 7f02f5dd0640 1 -- 10.20.193.58:0/2298722820 learned_addr learned my addr 10.20.193.58:0/2298722820 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:32:26.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.102+0000 7f02f65d1640 1 --2- 10.20.193.58:0/2298722820 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02f015d870 0x7f02f013a820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:26.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.102+0000 7f02f55cf640 1 --2- 10.20.193.58:0/2298722820 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f02f015d4a0 0x7f02f013e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:26.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.103+0000 7f02f5dd0640 1 -- 10.20.193.58:0/2298722820 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f02f015d4a0 msgr2=0x7f02f013e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:26.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.103+0000 7f02f5dd0640 1 --2- 10.20.193.58:0/2298722820 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f02f015d4a0 0x7f02f013e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.103+0000 7f02f5dd0640 1 -- 10.20.193.58:0/2298722820 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02f015d870 msgr2=0x7f02f013a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:26.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.103+0000 7f02f5dd0640 1 --2- 10.20.193.58:0/2298722820 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02f015d870 0x7f02f013a820 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.103+0000 7f02f5dd0640 1 -- 10.20.193.58:0/2298722820 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02ec00a590 con 0x7f02f00b6690 2026-02-23T06:32:26.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.103+0000 7f02f65d1640 1 --2- 10.20.193.58:0/2298722820 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02f015d870 0x7f02f013a820 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:32:26.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.103+0000 7f02f5dd0640 1 --2- 10.20.193.58:0/2298722820 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f02f00b6690 0x7f02f00561f0 secure :-1 s=READY pgs=185 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02e000c730 tx=0x7f02e000cb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:26.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.103+0000 7f02de7fc640 1 -- 10.20.193.58:0/2298722820 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f02e000a860 con 0x7f02f00b6690 2026-02-23T06:32:26.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.103+0000 7f02de7fc640 1 -- 10.20.193.58:0/2298722820 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02e000aab0 con 0x7f02f00b6690 2026-02-23T06:32:26.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.103+0000 7f02de7fc640 1 -- 10.20.193.58:0/2298722820 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f02e000ce80 con 0x7f02f00b6690 2026-02-23T06:32:26.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.103+0000 7f02f6dd2640 1 -- 10.20.193.58:0/2298722820 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02f0057690 con 0x7f02f00b6690 2026-02-23T06:32:26.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.103+0000 7f02f6dd2640 1 -- 10.20.193.58:0/2298722820 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f02f0057c10 con 0x7f02f00b6690 2026-02-23T06:32:26.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.104+0000 7f02f6dd2640 1 --2- 10.20.193.58:0/2298722820 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02f013ad60 0x7f02f013b130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:26.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.104+0000 7f02f6dd2640 1 -- 10.20.193.58:0/2298722820 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f02f00b5e10 con 0x7f02f013ad60 2026-02-23T06:32:26.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.104+0000 7f02f55cf640 1 --2- 10.20.193.58:0/2298722820 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02f013ad60 0x7f02f013b130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:26.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.104+0000 7f02f55cf640 1 -- 10.20.193.58:0/2298722820 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f02f00b5b30 con 0x7f02f013ad60 2026-02-23T06:32:26.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.105+0000 7f02f55cf640 1 --2- 10.20.193.58:0/2298722820 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02f013ad60 0x7f02f013b130 secure :-1 s=READY pgs=8 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02e40023d0 tx=0x7f02e400ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:26.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.105+0000 7f02de7fc640 1 -- 10.20.193.58:0/2298722820 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f02e400c7b0 con 0x7f02f013ad60 2026-02-23T06:32:26.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.105+0000 7f02de7fc640 1 -- 10.20.193.58:0/2298722820 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f02e400c910 con 0x7f02f013ad60 2026-02-23T06:32:26.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.105+0000 7f02de7fc640 1 -- 10.20.193.58:0/2298722820 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02f013ad60 msgr2=0x7f02f013b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:26.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.105+0000 7f02de7fc640 1 --2- 10.20.193.58:0/2298722820 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02f013ad60 0x7f02f013b130 secure :-1 s=READY pgs=8 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02e40023d0 tx=0x7f02e400ebc0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.105+0000 7f02de7fc640 1 -- 10.20.193.58:0/2298722820 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02f013ad60 msgr2=0x7f02f013b130 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:32:26.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.105+0000 7f02de7fc640 1 --2- 10.20.193.58:0/2298722820 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02f013ad60 0x7f02f013b130 secure :-1 s=CLOSED pgs=8 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02e40023d0 tx=0x7f02e400ebc0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.105+0000 7f02de7fc640 1 -- 10.20.193.58:0/2298722820 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f02e001b400 con 0x7f02f00b6690 2026-02-23T06:32:26.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.106+0000 7f02de7fc640 1 --2- 10.20.193.58:0/2298722820 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f02c007a430 0x7f02c009a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:26.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.106+0000 7f02de7fc640 1 -- 10.20.193.58:0/2298722820 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f02e009d610 con 0x7f02f00b6690 2026-02-23T06:32:26.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.106+0000 7f02f55cf640 1 --2- 10.20.193.58:0/2298722820 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f02c007a430 0x7f02c009a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:26.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.107+0000 7f02f55cf640 1 --2- 10.20.193.58:0/2298722820 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f02c007a430 0x7f02c009a8e0 secure :-1 s=READY pgs=281 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02e40023d0 tx=0x7f02e4014000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:26.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.108+0000 7f02f6dd2640 1 --2- 10.20.193.58:0/2298722820 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02f02014d0 0x7f02f02018a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:26.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.109+0000 7f02f6dd2640 1 -- 10.20.193.58:0/2298722820 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f02f00b6d50 con 0x7f02f02014d0 2026-02-23T06:32:26.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.109+0000 7f02f65d1640 1 --2- 10.20.193.58:0/2298722820 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02f02014d0 0x7f02f02018a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:26.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.109+0000 7f02f65d1640 1 -- 10.20.193.58:0/2298722820 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f02f00574f0 con 0x7f02f02014d0 2026-02-23T06:32:26.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.109+0000 7f02f65d1640 1 --2- 10.20.193.58:0/2298722820 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02f02014d0 0x7f02f02018a0 secure :-1 s=READY pgs=9 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02ec00a970 tx=0x7f02ec005080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:26.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.109+0000 7f02de7fc640 1 -- 10.20.193.58:0/2298722820 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f02ec03e050 con 0x7f02f02014d0 2026-02-23T06:32:26.106 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:32:26.107 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:32:26.107 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:32:26.107 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:32:26.107 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 92, 2026-02-23T06:32:26.107 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 15324, 2026-02-23T06:32:26.107 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:32:26.107 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:32:26.107 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:32:26.107 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:32:26.107 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:26.107 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:32:26.108 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:32:26.108 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:32:26.108 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:32:26.108 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:32:26.108 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:32:26.108 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:32:26.108 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:32:26.108 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:32:26.108 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:32:26.108 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:32:26.108 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:32:26.108 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:32:26.109 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:32:26.109 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:32:26.109 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:32:26.109 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:32:26.109 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:26.109 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:32:26.109 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:32:26.109 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:32:26.109 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:32:26.109 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:32:26.109 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:32:26.110 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:32:26.110 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:32:26.110 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:32:26.110 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:32:26.110 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:32:26.110 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:32:26.110 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:32:26.110 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:32:26.110 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:32:26.110 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:26.110 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.110 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:32:26.110 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:32:26.111 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:32:26.111 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:32:26.111 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:32:26.111 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:32:26.111 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:32:26.111 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:32:26.111 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:32:26.111 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:32:26.111 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:32:26.111 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:32:26.111 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:32:26.111 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:32:26.112 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:32:26.112 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:32:26.112 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:32:26.112 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:32:26.112 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:32:26.112 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:32:26.112 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:32:26.112 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:32:26.112 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:32:26.112 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:32:26.112 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:32:26.112 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:32:26.113 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:32:26.113 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:32:26.113 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:32:26.113 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:32:26.113 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:26.113 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:32:26.113 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.113 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:32:26.113 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.113 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:32:26.113 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:32:26.113 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:32:26.113 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:32:26.114 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.114 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:32:26.114 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:32:26.114 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:26.114 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.114 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.114 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:32:26.114 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:32:26.114 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:26.114 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:26.114 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:26.114 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.114 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:32:26.115 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:32:26.115 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:32:26.115 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:32:26.115 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:32:26.115 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:32:26.115 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.115 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.115 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:32:26.115 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:32:26.115 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:32:26.115 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:32:26.115 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.116 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:32:26.116 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:32:26.116 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:26.116 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.116 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.116 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:32:26.116 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:32:26.116 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:26.116 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:26.116 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:26.116 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.116 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:32:26.116 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:32:26.117 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:32:26.117 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:32:26.117 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:32:26.117 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:32:26.117 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.117 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.117 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:32:26.117 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:32:26.117 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:32:26.117 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:32:26.117 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.117 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:32:26.117 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:32:26.118 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:26.118 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.118 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.118 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:32:26.118 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:32:26.118 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:26.118 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:26.118 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:26.118 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.118 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:32:26.118 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:32:26.118 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:32:26.119 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:32:26.119 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:32:26.119 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:32:26.119 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:26.119 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:26.119 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.119 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:32:26.119 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:32:26.119 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.119 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:32:26.119 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:32:26.119 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:32:26.119 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:26.120 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:26.120 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:32:26.120 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.120 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:32:26.120 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:32:26.120 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:32:26.120 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:26.120 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:26.120 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.120 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:32:26.120 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:32:26.122 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.110+0000 7f02de7fc640 1 -- 10.20.193.58:0/2298722820 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4912 (secure 0 0 0) 0x7f02ec03f040 con 0x7f02f02014d0 2026-02-23T06:32:26.122 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.110+0000 7f02de7fc640 1 -- 10.20.193.58:0/2298722820 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02f02014d0 msgr2=0x7f02f02018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:26.122 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.110+0000 7f02de7fc640 1 --2- 10.20.193.58:0/2298722820 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02f02014d0 0x7f02f02018a0 secure :-1 s=READY pgs=9 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02ec00a970 tx=0x7f02ec005080 comp rx=0 tx=0).stop 2026-02-23T06:32:26.122 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.110+0000 7f02de7fc640 1 -- 10.20.193.58:0/2298722820 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02f02014d0 msgr2=0x7f02f02018a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:32:26.122 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.110+0000 7f02de7fc640 1 --2- 10.20.193.58:0/2298722820 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02f02014d0 0x7f02f02018a0 secure :-1 s=CLOSED pgs=9 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02ec00a970 tx=0x7f02ec005080 comp rx=0 tx=0).stop 2026-02-23T06:32:26.122 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.110+0000 7f02f6dd2640 1 -- 10.20.193.58:0/2298722820 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f02c007a430 msgr2=0x7f02c009a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:26.123 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.110+0000 7f02f6dd2640 1 --2- 10.20.193.58:0/2298722820 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f02c007a430 0x7f02c009a8e0 secure :-1 s=READY pgs=281 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02e40023d0 tx=0x7f02e4014000 comp rx=0 tx=0).stop 2026-02-23T06:32:26.123 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.110+0000 7f02f6dd2640 1 -- 10.20.193.58:0/2298722820 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f02f00b6690 msgr2=0x7f02f00561f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:26.123 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.110+0000 7f02f6dd2640 1 --2- 10.20.193.58:0/2298722820 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f02f00b6690 0x7f02f00561f0 secure :-1 s=READY pgs=185 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02e000c730 tx=0x7f02e000cb30 comp rx=0 tx=0).stop 2026-02-23T06:32:26.123 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.110+0000 7f02f65d1640 1 -- 10.20.193.58:0/2298722820 reap_dead start 2026-02-23T06:32:26.123 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.110+0000 7f02f6dd2640 1 -- 10.20.193.58:0/2298722820 shutdown_connections 2026-02-23T06:32:26.123 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.110+0000 7f02f6dd2640 1 -- 10.20.193.58:0/2298722820 >> 10.20.193.58:0/2298722820 conn(0x7f02f00b3c20 msgr2=0x7f02f0058bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:26.123 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.110+0000 7f02f6dd2640 1 -- 10.20.193.58:0/2298722820 shutdown_connections 2026-02-23T06:32:26.123 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.110+0000 7f02f6dd2640 1 -- 10.20.193.58:0/2298722820 wait complete. 2026-02-23T06:32:26.124 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:32:26.124 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:32:26.124 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:32:26.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.250+0000 7ff8d5c43640 1 -- 10.20.193.58:0/858191162 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff8d015d4a0 msgr2=0x7ff8d00affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:26.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.250+0000 7ff8d5c43640 1 --2- 10.20.193.58:0/858191162 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff8d015d4a0 0x7ff8d00affb0 secure :-1 s=READY pgs=10 gs=2 cs=0 l=1 c_cookie=2096139528761674870 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8c0004740 tx=0x7ff8c002f1d0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.250+0000 7ff8d5c43640 1 -- 10.20.193.58:0/858191162 shutdown_connections 2026-02-23T06:32:26.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.250+0000 7ff8d5c43640 1 --2- 10.20.193.58:0/858191162 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff8d015d870 0x7ff8d00587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.250+0000 7ff8d5c43640 1 --2- 10.20.193.58:0/858191162 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff8d015d4a0 0x7ff8d00affb0 unknown :-1 s=CLOSED pgs=10 gs=2 cs=0 l=1 c_cookie=2096139528761674870 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.250+0000 7ff8d5c43640 1 -- 10.20.193.58:0/858191162 >> 10.20.193.58:0/858191162 conn(0x7ff8d00b3c20 msgr2=0x7ff8d00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:26.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.250+0000 7ff8d5c43640 1 -- 10.20.193.58:0/858191162 shutdown_connections 2026-02-23T06:32:26.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.250+0000 7ff8d5c43640 1 -- 10.20.193.58:0/858191162 wait complete. 2026-02-23T06:32:26.249 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.252+0000 7ff8d5c43640 1 Processor -- start 2026-02-23T06:32:26.249 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.252+0000 7ff8d5c43640 1 -- start start 2026-02-23T06:32:26.249 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.252+0000 7ff8d5c43640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff8d00b6690 0x7ff8d013b060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:26.250 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.252+0000 7ff8d5c43640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff8d015d4a0 0x7ff8d0161830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:26.250 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.252+0000 7ff8d5c43640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8d015d870 0x7ff8d015a270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:26.250 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.252+0000 7ff8d5c43640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d013e260 con 0x7ff8d015d4a0 2026-02-23T06:32:26.250 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.252+0000 7ff8d5c43640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d01613a0 con 0x7ff8d015d870 2026-02-23T06:32:26.250 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.252+0000 7ff8d5c43640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7ff8d0163720 con 0x7ff8d00b6690 2026-02-23T06:32:26.250 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.253+0000 7ff8c7fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff8d015d4a0 0x7ff8d0161830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:26.250 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.253+0000 7ff8d4c41640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff8d00b6690 0x7ff8d013b060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:26.250 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.253+0000 7ff8c7fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff8d015d4a0 0x7ff8d0161830 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:45196/0 (socket says 10.20.193.58:45196) 2026-02-23T06:32:26.250 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.253+0000 7ff8c7fff640 1 -- 10.20.193.58:0/3629061276 learned_addr learned my addr 10.20.193.58:0/3629061276 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:32:26.250 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.253+0000 7ff8d5442640 1 --2- 10.20.193.58:0/3629061276 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8d015d870 0x7ff8d015a270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:26.250 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.253+0000 7ff8c7fff640 1 -- 10.20.193.58:0/3629061276 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff8d00b6690 msgr2=0x7ff8d013b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:26.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.253+0000 7ff8c7fff640 1 --2- 10.20.193.58:0/3629061276 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff8d00b6690 0x7ff8d013b060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.253+0000 7ff8c7fff640 1 -- 10.20.193.58:0/3629061276 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8d015d870 msgr2=0x7ff8d015a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:26.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.253+0000 7ff8c7fff640 1 --2- 10.20.193.58:0/3629061276 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8d015d870 0x7ff8d015a270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.253+0000 7ff8c7fff640 1 -- 10.20.193.58:0/3629061276 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c00094b0 con 0x7ff8d015d4a0 2026-02-23T06:32:26.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.253+0000 7ff8c7fff640 1 --2- 10.20.193.58:0/3629061276 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff8d015d4a0 0x7ff8d0161830 secure :-1 s=READY pgs=11 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8b8009480 tx=0x7ff8b800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:26.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.253+0000 7ff8c57fa640 1 -- 10.20.193.58:0/3629061276 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8b800cd40 con 0x7ff8d015d4a0 2026-02-23T06:32:26.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.253+0000 7ff8c57fa640 1 -- 10.20.193.58:0/3629061276 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8b8004850 con 0x7ff8d015d4a0 2026-02-23T06:32:26.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.253+0000 7ff8c57fa640 1 -- 10.20.193.58:0/3629061276 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8b800cea0 con 0x7ff8d015d4a0 2026-02-23T06:32:26.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.253+0000 7ff8d5c43640 1 -- 10.20.193.58:0/3629061276 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8d013e470 con 0x7ff8d015d4a0 2026-02-23T06:32:26.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.253+0000 7ff8d5c43640 1 -- 10.20.193.58:0/3629061276 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8d0161030 con 0x7ff8d015d4a0 2026-02-23T06:32:26.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.254+0000 7ff8d5c43640 1 --2- 10.20.193.58:0/3629061276 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8d015a7b0 0x7ff8d01626d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:26.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.254+0000 7ff8d5c43640 1 -- 10.20.193.58:0/3629061276 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d00b6330 con 0x7ff8d015a7b0 2026-02-23T06:32:26.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.254+0000 7ff8d4c41640 1 --2- 10.20.193.58:0/3629061276 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8d015a7b0 0x7ff8d01626d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:26.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.255+0000 7ff8d4c41640 1 -- 10.20.193.58:0/3629061276 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff8d00b5e10 con 0x7ff8d015a7b0 2026-02-23T06:32:26.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.255+0000 7ff8d4c41640 1 --2- 10.20.193.58:0/3629061276 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8d015a7b0 0x7ff8d01626d0 secure :-1 s=READY pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8c0004740 tx=0x7ff8c00028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:26.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.255+0000 7ff8c57fa640 1 -- 10.20.193.58:0/3629061276 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8c003d050 con 0x7ff8d015a7b0 2026-02-23T06:32:26.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.255+0000 7ff8c57fa640 1 -- 10.20.193.58:0/3629061276 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7ff8b801f060 con 0x7ff8d015d4a0 2026-02-23T06:32:26.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.256+0000 7ff8c57fa640 1 --2- 10.20.193.58:0/3629061276 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff8a007a660 0x7ff8a009ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:26.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.256+0000 7ff8c57fa640 1 -- 10.20.193.58:0/3629061276 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7ff8b8014070 con 0x7ff8d015d4a0 2026-02-23T06:32:26.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.256+0000 7ff8c57fa640 1 -- 10.20.193.58:0/3629061276 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7ff8c003e040 con 0x7ff8d015a7b0 2026-02-23T06:32:26.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.256+0000 7ff8c57fa640 1 -- 10.20.193.58:0/3629061276 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8d015a7b0 msgr2=0x7ff8d01626d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:26.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.256+0000 7ff8c57fa640 1 --2- 10.20.193.58:0/3629061276 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8d015a7b0 0x7ff8d01626d0 secure :-1 s=READY pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8c0004740 tx=0x7ff8c00028d0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.256+0000 7ff8c57fa640 1 -- 10.20.193.58:0/3629061276 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8d015a7b0 msgr2=0x7ff8d01626d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:32:26.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.256+0000 7ff8c57fa640 1 --2- 10.20.193.58:0/3629061276 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8d015a7b0 0x7ff8d01626d0 unknown :-1 s=CLOSED pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.257+0000 7ff8d5442640 1 --2- 10.20.193.58:0/3629061276 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff8a007a660 0x7ff8a009ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:26.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.257+0000 7ff8d5442640 1 --2- 10.20.193.58:0/3629061276 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff8a007a660 0x7ff8a009ab10 secure :-1 s=READY pgs=282 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8cc005850 tx=0x7ff8cc00a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:26.255 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.260+0000 7ff8d5c43640 1 --2- 10.20.193.58:0/3629061276 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8d0162c10 0x7ff8d013bd60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:26.256 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.260+0000 7ff8d5c43640 1 -- 10.20.193.58:0/3629061276 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d00b6d50 con 0x7ff8d0162c10 2026-02-23T06:32:26.256 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.260+0000 7ff8d4c41640 1 --2- 10.20.193.58:0/3629061276 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8d0162c10 0x7ff8d013bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:26.256 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.261+0000 7ff8d4c41640 1 -- 10.20.193.58:0/3629061276 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff8d01611c0 con 0x7ff8d0162c10 2026-02-23T06:32:26.256 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.261+0000 7ff8d4c41640 1 --2- 10.20.193.58:0/3629061276 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8d0162c10 0x7ff8d013bd60 secure :-1 s=READY pgs=38 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8c00097e0 tx=0x7ff8c0005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:26.256 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.261+0000 7ff8c57fa640 1 -- 10.20.193.58:0/3629061276 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8c0043680 con 0x7ff8d0162c10 2026-02-23T06:32:26.256 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.261+0000 7ff8c57fa640 1 -- 10.20.193.58:0/3629061276 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4910 (secure 0 0 0) 0x7ff8c00437e0 con 0x7ff8d0162c10 2026-02-23T06:32:26.256 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.261+0000 7ff8c57fa640 1 -- 10.20.193.58:0/3629061276 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8d0162c10 msgr2=0x7ff8d013bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:26.256 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.261+0000 7ff8c57fa640 1 --2- 10.20.193.58:0/3629061276 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8d0162c10 0x7ff8d013bd60 secure :-1 s=READY pgs=38 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8c00097e0 tx=0x7ff8c0005f90 comp rx=0 tx=0).stop 2026-02-23T06:32:26.256 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.261+0000 7ff8c57fa640 1 -- 10.20.193.58:0/3629061276 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8d0162c10 msgr2=0x7ff8d013bd60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:32:26.256 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.261+0000 7ff8c57fa640 1 --2- 10.20.193.58:0/3629061276 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff8d0162c10 0x7ff8d013bd60 unknown :-1 s=CLOSED pgs=38 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.257 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:32:26.257 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:32:26.257 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:32:26.257 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:32:26.257 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 92, 2026-02-23T06:32:26.257 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 82838, 2026-02-23T06:32:26.257 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:32:26.257 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:32:26.257 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:32:26.257 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:32:26.257 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:26.257 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:32:26.257 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:32:26.257 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:32:26.257 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:32:26.257 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:32:26.257 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:32:26.258 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:32:26.258 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:32:26.258 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:32:26.258 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:32:26.258 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:32:26.258 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:32:26.258 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:32:26.258 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:32:26.258 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:32:26.258 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:32:26.258 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:32:26.258 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:26.258 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:32:26.258 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:32:26.258 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:32:26.258 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:32:26.258 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:32:26.258 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:32:26.258 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:32:26.258 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:32:26.258 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:32:26.258 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:32:26.258 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:32:26.258 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:32:26.258 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:32:26.258 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:32:26.258 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:32:26.259 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:32:26.260 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:32:26.261 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:26.262 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:32:26.263 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.263 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:32:26.263 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:32:26.263 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:32:26.263 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:26.263 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:26.263 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.263 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:32:26.263 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:32:26.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.262+0000 7ff8d5c43640 1 -- 10.20.193.58:0/3629061276 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff8a007a660 msgr2=0x7ff8a009ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:26.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.262+0000 7ff8d5c43640 1 --2- 10.20.193.58:0/3629061276 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff8a007a660 0x7ff8a009ab10 secure :-1 s=READY pgs=282 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8cc005850 tx=0x7ff8cc00a040 comp rx=0 tx=0).stop 2026-02-23T06:32:26.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.262+0000 7ff8d5c43640 1 -- 10.20.193.58:0/3629061276 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff8d015d4a0 msgr2=0x7ff8d0161830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:26.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.262+0000 7ff8d5c43640 1 --2- 10.20.193.58:0/3629061276 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff8d015d4a0 0x7ff8d0161830 secure :-1 s=READY pgs=11 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8b8009480 tx=0x7ff8b800ee60 comp rx=0 tx=0).stop 2026-02-23T06:32:26.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.262+0000 7ff8d5442640 1 -- 10.20.193.58:0/3629061276 reap_dead start 2026-02-23T06:32:26.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.262+0000 7ff8d5442640 1 -- 10.20.193.58:0/3629061276 reap_dead start 2026-02-23T06:32:26.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.262+0000 7ff8d5c43640 1 -- 10.20.193.58:0/3629061276 shutdown_connections 2026-02-23T06:32:26.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.262+0000 7ff8d5c43640 1 -- 10.20.193.58:0/3629061276 >> 10.20.193.58:0/3629061276 conn(0x7ff8d00b3c20 msgr2=0x7ff8d015be10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:26.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.262+0000 7ff8d5c43640 1 -- 10.20.193.58:0/3629061276 shutdown_connections 2026-02-23T06:32:26.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.262+0000 7ff8d5c43640 1 -- 10.20.193.58:0/3629061276 wait complete. 2026-02-23T06:32:26.264 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:32:26.264 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:32:26.264 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:32:26.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.393+0000 7f7236b30640 1 -- 10.20.193.58:0/1623338931 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f72300b6620 msgr2=0x7f72301633c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:26.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.393+0000 7f7236b30640 1 --2- 10.20.193.58:0/1623338931 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f72300b6620 0x7f72301633c0 secure :-1 s=READY pgs=40 gs=3 cs=0 l=1 c_cookie=10146998847634025511 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f722c005820 tx=0x7f722c030300 comp rx=0 tx=0).stop 2026-02-23T06:32:26.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.393+0000 7f7236b30640 1 -- 10.20.193.58:0/1623338931 shutdown_connections 2026-02-23T06:32:26.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.393+0000 7f7236b30640 1 --2- 10.20.193.58:0/1623338931 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f72300b6620 0x7f72301633c0 unknown :-1 s=CLOSED pgs=40 gs=3 cs=0 l=1 c_cookie=10146998847634025511 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.393+0000 7f7236b30640 1 -- 10.20.193.58:0/1623338931 >> 10.20.193.58:0/1623338931 conn(0x7f7230059db0 msgr2=0x7f723005a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:26.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.393+0000 7f7236b30640 1 -- 10.20.193.58:0/1623338931 shutdown_connections 2026-02-23T06:32:26.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.394+0000 7f7236b30640 1 -- 10.20.193.58:0/1623338931 wait complete. 2026-02-23T06:32:26.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.395+0000 7f7236b30640 1 Processor -- start 2026-02-23T06:32:26.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.395+0000 7f7236b30640 1 -- start start 2026-02-23T06:32:26.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.396+0000 7f7236b30640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f72300b6620 0x7f723015ec50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:26.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.396+0000 7f7236b30640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7230159c90 0x7f7230162270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:26.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.396+0000 7f7236b30640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f723015a060 0x7f7230200d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:26.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.396+0000 7f7236b30640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f723015dcb0 con 0x7f72300b6620 2026-02-23T06:32:26.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.396+0000 7f7236b30640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f723015b900 con 0x7f723015a060 2026-02-23T06:32:26.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.396+0000 7f7236b30640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f723005e050 con 0x7f7230159c90 2026-02-23T06:32:26.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.396+0000 7f7235b2e640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f72300b6620 0x7f723015ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:26.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.396+0000 7f7235b2e640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f72300b6620 0x7f723015ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:45198/0 (socket says 10.20.193.58:45198) 2026-02-23T06:32:26.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.396+0000 7f7235b2e640 1 -- 10.20.193.58:0/1408568845 learned_addr learned my addr 10.20.193.58:0/1408568845 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:32:26.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.396+0000 7f723532d640 1 --2- 10.20.193.58:0/1408568845 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7230159c90 0x7f7230162270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:26.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.396+0000 7f723632f640 1 --2- 10.20.193.58:0/1408568845 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f723015a060 0x7f7230200d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:26.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.396+0000 7f7235b2e640 1 -- 10.20.193.58:0/1408568845 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7230159c90 msgr2=0x7f7230162270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:26.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.396+0000 7f7235b2e640 1 --2- 10.20.193.58:0/1408568845 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7230159c90 0x7f7230162270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.396+0000 7f7235b2e640 1 -- 10.20.193.58:0/1408568845 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f723015a060 msgr2=0x7f7230200d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:26.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.396+0000 7f7235b2e640 1 --2- 10.20.193.58:0/1408568845 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f723015a060 0x7f7230200d90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.396+0000 7f7235b2e640 1 -- 10.20.193.58:0/1408568845 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f722c00a590 con 0x7f72300b6620 2026-02-23T06:32:26.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.396+0000 7f7235b2e640 1 --2- 10.20.193.58:0/1408568845 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f72300b6620 0x7f723015ec50 secure :-1 s=READY pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f722000c500 tx=0x7f722000c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:26.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.397+0000 7f721e7fc640 1 -- 10.20.193.58:0/1408568845 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f72200052f0 con 0x7f72300b6620 2026-02-23T06:32:26.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.397+0000 7f7236b30640 1 -- 10.20.193.58:0/1408568845 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72300b5b00 con 0x7f72300b6620 2026-02-23T06:32:26.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.397+0000 7f7236b30640 1 -- 10.20.193.58:0/1408568845 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72300b5860 con 0x7f72300b6620 2026-02-23T06:32:26.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.397+0000 7f721e7fc640 1 -- 10.20.193.58:0/1408568845 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7220005540 con 0x7f72300b6620 2026-02-23T06:32:26.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.397+0000 7f721e7fc640 1 -- 10.20.193.58:0/1408568845 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f72200052f0 con 0x7f72300b6620 2026-02-23T06:32:26.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.397+0000 7f7236b30640 1 --2- 10.20.193.58:0/1408568845 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f723005d830 0x7f72302012d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:26.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.397+0000 7f7236b30640 1 -- 10.20.193.58:0/1408568845 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f72300b3af0 con 0x7f723005d830 2026-02-23T06:32:26.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.398+0000 7f723532d640 1 --2- 10.20.193.58:0/1408568845 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f723005d830 0x7f72302012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:26.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.398+0000 7f723532d640 1 -- 10.20.193.58:0/1408568845 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f72300b3810 con 0x7f723005d830 2026-02-23T06:32:26.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.398+0000 7f723532d640 1 --2- 10.20.193.58:0/1408568845 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f723005d830 0x7f72302012d0 secure :-1 s=READY pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72240023d0 tx=0x7f722400eba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:26.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.399+0000 7f721e7fc640 1 -- 10.20.193.58:0/1408568845 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f72200036b0 con 0x7f72300b6620 2026-02-23T06:32:26.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.399+0000 7f721e7fc640 1 --2- 10.20.193.58:0/1408568845 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f720007a6b0 0x7f720009ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:26.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.400+0000 7f721e7fc640 1 -- 10.20.193.58:0/1408568845 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f722400c830 con 0x7f723005d830 2026-02-23T06:32:26.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.400+0000 7f721e7fc640 1 -- 10.20.193.58:0/1408568845 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f722009c830 con 0x7f72300b6620 2026-02-23T06:32:26.395 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.400+0000 7f721e7fc640 1 -- 10.20.193.58:0/1408568845 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f722400c990 con 0x7f723005d830 2026-02-23T06:32:26.395 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.400+0000 7f721e7fc640 1 -- 10.20.193.58:0/1408568845 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f723005d830 msgr2=0x7f72302012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:26.395 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.400+0000 7f721e7fc640 1 --2- 10.20.193.58:0/1408568845 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f723005d830 0x7f72302012d0 secure :-1 s=READY pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72240023d0 tx=0x7f722400eba0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.395 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.400+0000 7f723632f640 1 --2- 10.20.193.58:0/1408568845 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f720007a6b0 0x7f720009ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:26.395 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.400+0000 7f721e7fc640 1 -- 10.20.193.58:0/1408568845 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f723005d830 msgr2=0x7f72302012d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:32:26.395 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.400+0000 7f721e7fc640 1 --2- 10.20.193.58:0/1408568845 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f723005d830 0x7f72302012d0 secure :-1 s=CLOSED pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72240023d0 tx=0x7f722400eba0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.396 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.401+0000 7f723632f640 1 --2- 10.20.193.58:0/1408568845 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f720007a6b0 0x7f720009ab60 secure :-1 s=READY pgs=283 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f722c030830 tx=0x7f722c032040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:26.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.403+0000 7f7236b30640 1 --2- 10.20.193.58:0/1408568845 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7230159080 0x7f7230159480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:26.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.403+0000 7f7236b30640 1 -- 10.20.193.58:0/1408568845 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f7230163970 con 0x7f7230159080 2026-02-23T06:32:26.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.403+0000 7f723532d640 1 --2- 10.20.193.58:0/1408568845 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7230159080 0x7f7230159480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:26.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.404+0000 7f723532d640 1 -- 10.20.193.58:0/1408568845 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f72300b4ef0 con 0x7f7230159080 2026-02-23T06:32:26.399 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.404+0000 7f723532d640 1 --2- 10.20.193.58:0/1408568845 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7230159080 0x7f7230159480 secure :-1 s=READY pgs=187 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72240023d0 tx=0x7f72240046e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:26.399 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.404+0000 7f721e7fc640 1 -- 10.20.193.58:0/1408568845 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7224003260 con 0x7f7230159080 2026-02-23T06:32:26.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.404+0000 7f721e7fc640 1 -- 10.20.193.58:0/1408568845 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5555 (secure 0 0 0) 0x7f722401f8b0 con 0x7f7230159080 2026-02-23T06:32:26.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.404+0000 7f721e7fc640 1 -- 10.20.193.58:0/1408568845 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7230159080 msgr2=0x7f7230159480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:26.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.404+0000 7f721e7fc640 1 --2- 10.20.193.58:0/1408568845 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7230159080 0x7f7230159480 secure :-1 s=READY pgs=187 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72240023d0 tx=0x7f72240046e0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.404+0000 7f721e7fc640 1 -- 10.20.193.58:0/1408568845 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7230159080 msgr2=0x7f7230159480 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:32:26.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.404+0000 7f721e7fc640 1 --2- 10.20.193.58:0/1408568845 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7230159080 0x7f7230159480 unknown :-1 s=CLOSED pgs=187 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.400 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:32:26.400 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:32:26.401 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:32:26.401 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:32:26.401 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 92, 2026-02-23T06:32:26.401 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 420916, 2026-02-23T06:32:26.401 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:32:26.401 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:32:26.401 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:32:26.401 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:32:26.401 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:26.401 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:32:26.401 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:32:26.402 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:32:26.402 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:32:26.402 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:32:26.402 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:32:26.402 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:32:26.402 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:32:26.402 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:32:26.402 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:32:26.402 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:32:26.402 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:32:26.402 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:32:26.402 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:32:26.403 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:32:26.403 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:32:26.403 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:32:26.403 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:26.403 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:32:26.403 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:32:26.403 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:32:26.403 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:32:26.403 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:32:26.403 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:32:26.403 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:32:26.403 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:32:26.404 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:32:26.404 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:32:26.404 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:32:26.404 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:32:26.404 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:32:26.404 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:32:26.404 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:32:26.404 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:26.404 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.404 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:32:26.404 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:32:26.404 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:32:26.405 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:32:26.405 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:32:26.405 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:32:26.405 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:32:26.405 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:32:26.405 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:32:26.405 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:32:26.405 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:32:26.405 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:32:26.405 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:32:26.405 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:32:26.405 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:32:26.406 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:32:26.406 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:32:26.406 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:32:26.406 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:32:26.406 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:32:26.406 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:32:26.406 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:32:26.406 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:32:26.406 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:32:26.406 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:32:26.406 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:32:26.406 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:32:26.406 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:32:26.406 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:32:26.407 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:32:26.407 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:26.407 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:32:26.407 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.407 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:32:26.407 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.407 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:32:26.407 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:32:26.407 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:32:26.407 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:32:26.407 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.407 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:32:26.407 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:32:26.407 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:26.408 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.408 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.408 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:32:26.408 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:32:26.408 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:26.408 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:26.408 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:26.408 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.408 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:32:26.408 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:32:26.408 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:32:26.408 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:32:26.408 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:32:26.408 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:32:26.409 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.409 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.409 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:32:26.409 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:32:26.409 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:32:26.409 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:32:26.409 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.409 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:32:26.409 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:32:26.409 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:26.409 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.409 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.409 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:32:26.409 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:32:26.409 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:26.410 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:26.410 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:26.410 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.410 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:32:26.410 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:32:26.410 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:32:26.410 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:32:26.410 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:32:26.410 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:32:26.410 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.410 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.410 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:32:26.410 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:32:26.410 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:32:26.410 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:32:26.411 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.411 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:32:26.411 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:32:26.411 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:26.411 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.411 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.411 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:32:26.411 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:32:26.411 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:26.411 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:26.411 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:26.411 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.411 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:32:26.411 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:32:26.411 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:32:26.412 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:32:26.412 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:32:26.412 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:32:26.412 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:26.412 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:26.412 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.412 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:32:26.412 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:32:26.412 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.412 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:32:26.412 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:32:26.412 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:32:26.412 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:26.412 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:26.412 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:32:26.413 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.413 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:32:26.413 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:32:26.413 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:32:26.413 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:26.413 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:26.413 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:32:26.413 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.413 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:32:26.413 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:32:26.413 INFO:teuthology.orchestra.run.trial058.stdout: "num": 8 2026-02-23T06:32:26.413 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:26.413 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:26.413 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:32:26.413 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.413 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:32:26.414 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:32:26.414 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:32:26.414 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.414 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.414 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:32:26.414 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:32:26.414 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:32:26.414 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:26.414 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:26.414 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:32:26.414 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:26.414 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:32:26.414 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:32:26.414 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:32:26.414 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:26.414 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:26.415 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:26.415 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:32:26.415 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:32:26.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.405+0000 7f7236b30640 1 -- 10.20.193.58:0/1408568845 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f720007a6b0 msgr2=0x7f720009ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:26.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.405+0000 7f7236b30640 1 --2- 10.20.193.58:0/1408568845 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f720007a6b0 0x7f720009ab60 secure :-1 s=READY pgs=283 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f722c030830 tx=0x7f722c032040 comp rx=0 tx=0).stop 2026-02-23T06:32:26.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.405+0000 7f7236b30640 1 -- 10.20.193.58:0/1408568845 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f72300b6620 msgr2=0x7f723015ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:26.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.405+0000 7f7236b30640 1 --2- 10.20.193.58:0/1408568845 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f72300b6620 0x7f723015ec50 secure :-1 s=READY pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f722000c500 tx=0x7f722000c9d0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.405+0000 7f723632f640 1 -- 10.20.193.58:0/1408568845 reap_dead start 2026-02-23T06:32:26.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.405+0000 7f723632f640 1 -- 10.20.193.58:0/1408568845 reap_dead start 2026-02-23T06:32:26.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.405+0000 7f7236b30640 1 -- 10.20.193.58:0/1408568845 shutdown_connections 2026-02-23T06:32:26.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.405+0000 7f7236b30640 1 -- 10.20.193.58:0/1408568845 >> 10.20.193.58:0/1408568845 conn(0x7f7230059db0 msgr2=0x7f7230164be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:26.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.405+0000 7f7236b30640 1 -- 10.20.193.58:0/1408568845 shutdown_connections 2026-02-23T06:32:26.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.405+0000 7f7236b30640 1 -- 10.20.193.58:0/1408568845 wait complete. 2026-02-23T06:32:26.417 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:32:26.417 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:32:26.417 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:32:26.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.544+0000 7f2d43577640 1 -- 10.20.193.58:0/1210742238 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2d4415d870 msgr2=0x7f2d440587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:26.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.544+0000 7f2d43577640 1 --2- 10.20.193.58:0/1210742238 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2d4415d870 0x7f2d440587b0 secure :-1 s=READY pgs=42 gs=2 cs=0 l=1 c_cookie=11735322579961932597 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d2c005e70 tx=0x7f2d2c02f290 comp rx=0 tx=0).stop 2026-02-23T06:32:26.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.544+0000 7f2d43577640 1 -- 10.20.193.58:0/1210742238 shutdown_connections 2026-02-23T06:32:26.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.544+0000 7f2d43577640 1 --2- 10.20.193.58:0/1210742238 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2d440b6690 0x7f2d44058cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.544+0000 7f2d43577640 1 --2- 10.20.193.58:0/1210742238 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2d4415d870 0x7f2d440587b0 unknown :-1 s=CLOSED pgs=42 gs=2 cs=0 l=1 c_cookie=11735322579961932597 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.544+0000 7f2d43577640 1 -- 10.20.193.58:0/1210742238 >> 10.20.193.58:0/1210742238 conn(0x7f2d440b3c20 msgr2=0x7f2d440b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:26.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.544+0000 7f2d43577640 1 -- 10.20.193.58:0/1210742238 shutdown_connections 2026-02-23T06:32:26.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.544+0000 7f2d43577640 1 -- 10.20.193.58:0/1210742238 wait complete. 2026-02-23T06:32:26.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.545+0000 7f2d43577640 1 Processor -- start 2026-02-23T06:32:26.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.545+0000 7f2d43577640 1 -- start start 2026-02-23T06:32:26.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.546+0000 7f2d43577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2d440b6690 0x7f2d4413cf30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:26.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.546+0000 7f2d43577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2d4415d4a0 0x7f2d44057750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:26.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.546+0000 7f2d43577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2d4415d870 0x7f2d4415a070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:26.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.546+0000 7f2d43577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4413f480 con 0x7f2d4415d870 2026-02-23T06:32:26.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.546+0000 7f2d43577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4413e860 con 0x7f2d4415d4a0 2026-02-23T06:32:26.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.546+0000 7f2d43577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f2d44202000 con 0x7f2d440b6690 2026-02-23T06:32:26.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.546+0000 7f2d42575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2d440b6690 0x7f2d4413cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:26.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.546+0000 7f2d41d74640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2d4415d4a0 0x7f2d44057750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:26.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.546+0000 7f2d42575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2d440b6690 0x7f2d4413cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:43464/0 (socket says 10.20.193.58:43464) 2026-02-23T06:32:26.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.546+0000 7f2d42575640 1 -- 10.20.193.58:0/704192022 learned_addr learned my addr 10.20.193.58:0/704192022 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:32:26.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.546+0000 7f2d42d76640 1 --2- 10.20.193.58:0/704192022 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2d4415d870 0x7f2d4415a070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:26.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.546+0000 7f2d42575640 1 -- 10.20.193.58:0/704192022 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2d4415d4a0 msgr2=0x7f2d44057750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:26.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.546+0000 7f2d42575640 1 --2- 10.20.193.58:0/704192022 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2d4415d4a0 0x7f2d44057750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.546+0000 7f2d42575640 1 -- 10.20.193.58:0/704192022 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2d4415d870 msgr2=0x7f2d4415a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:26.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.546+0000 7f2d42575640 1 --2- 10.20.193.58:0/704192022 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2d4415d870 0x7f2d4415a070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.546+0000 7f2d42575640 1 -- 10.20.193.58:0/704192022 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d2c009570 con 0x7f2d440b6690 2026-02-23T06:32:26.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.546+0000 7f2d42d76640 1 --2- 10.20.193.58:0/704192022 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2d4415d870 0x7f2d4415a070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:32:26.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.547+0000 7f2d42575640 1 --2- 10.20.193.58:0/704192022 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2d440b6690 0x7f2d4413cf30 secure :-1 s=READY pgs=188 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d3800c4d0 tx=0x7f2d3800c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:26.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.547+0000 7f2d2affd640 1 -- 10.20.193.58:0/704192022 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2d38004250 con 0x7f2d440b6690 2026-02-23T06:32:26.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.547+0000 7f2d2affd640 1 -- 10.20.193.58:0/704192022 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d380044a0 con 0x7f2d440b6690 2026-02-23T06:32:26.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.547+0000 7f2d2affd640 1 -- 10.20.193.58:0/704192022 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2d38006b10 con 0x7f2d440b6690 2026-02-23T06:32:26.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.547+0000 7f2d43577640 1 -- 10.20.193.58:0/704192022 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d4413e470 con 0x7f2d440b6690 2026-02-23T06:32:26.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.547+0000 7f2d43577640 1 -- 10.20.193.58:0/704192022 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d44201d20 con 0x7f2d440b6690 2026-02-23T06:32:26.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.547+0000 7f2d43577640 1 -- 10.20.193.58:0/704192022 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d440b6d50 con 0x7f2d440b6690 2026-02-23T06:32:26.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.549+0000 7f2d2affd640 1 -- 10.20.193.58:0/704192022 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f2d38003670 con 0x7f2d440b6690 2026-02-23T06:32:26.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.550+0000 7f2d2affd640 1 --2- 10.20.193.58:0/704192022 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2d1007a6c0 0x7f2d1009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:26.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.550+0000 7f2d2affd640 1 -- 10.20.193.58:0/704192022 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f2d3809da90 con 0x7f2d440b6690 2026-02-23T06:32:26.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.550+0000 7f2d41d74640 1 --2- 10.20.193.58:0/704192022 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2d1007a6c0 0x7f2d1009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:26.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.550+0000 7f2d2affd640 1 -- 10.20.193.58:0/704192022 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f2d38060cb0 con 0x7f2d440b6690 2026-02-23T06:32:26.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.551+0000 7f2d41d74640 1 --2- 10.20.193.58:0/704192022 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2d1007a6c0 0x7f2d1009ab70 secure :-1 s=READY pgs=284 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d2c0023d0 tx=0x7f2d2c03a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:26.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.706+0000 7f2d43577640 1 -- 10.20.193.58:0/704192022 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f2d44201b80 con 0x7f2d440b6690 2026-02-23T06:32:26.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.707+0000 7f2d2affd640 1 -- 10.20.193.58:0/704192022 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f2d44201b80 con 0x7f2d440b6690 2026-02-23T06:32:26.703 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.708+0000 7f2d43577640 1 -- 10.20.193.58:0/704192022 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2d1007a6c0 msgr2=0x7f2d1009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:26.703 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.708+0000 7f2d43577640 1 --2- 10.20.193.58:0/704192022 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2d1007a6c0 0x7f2d1009ab70 secure :-1 s=READY pgs=284 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d2c0023d0 tx=0x7f2d2c03a040 comp rx=0 tx=0).stop 2026-02-23T06:32:26.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.708+0000 7f2d43577640 1 -- 10.20.193.58:0/704192022 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2d440b6690 msgr2=0x7f2d4413cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:26.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.708+0000 7f2d43577640 1 --2- 10.20.193.58:0/704192022 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2d440b6690 0x7f2d4413cf30 secure :-1 s=READY pgs=188 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d3800c4d0 tx=0x7f2d3800c9a0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.708+0000 7f2d43577640 1 -- 10.20.193.58:0/704192022 shutdown_connections 2026-02-23T06:32:26.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.708+0000 7f2d43577640 1 --2- 10.20.193.58:0/704192022 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2d1007a6c0 0x7f2d1009ab70 unknown :-1 s=CLOSED pgs=284 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.708+0000 7f2d43577640 1 --2- 10.20.193.58:0/704192022 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2d4415d870 0x7f2d4415a070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.708+0000 7f2d43577640 1 --2- 10.20.193.58:0/704192022 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2d4415d4a0 0x7f2d44057750 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.708+0000 7f2d43577640 1 --2- 10.20.193.58:0/704192022 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2d440b6690 0x7f2d4413cf30 unknown :-1 s=CLOSED pgs=188 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:26.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.708+0000 7f2d43577640 1 -- 10.20.193.58:0/704192022 >> 10.20.193.58:0/704192022 conn(0x7f2d440b3c20 msgr2=0x7f2d4405ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:26.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.708+0000 7f2d43577640 1 -- 10.20.193.58:0/704192022 shutdown_connections 2026-02-23T06:32:26.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:26.708+0000 7f2d43577640 1 -- 10.20.193.58:0/704192022 wait complete. 2026-02-23T06:32:26.716 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:32:36.717 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:32:36.717 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:32:36.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.843+0000 7fbedcf75640 1 -- 10.20.193.58:0/3881577491 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbed815d4a0 msgr2=0x7fbed80affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:36.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.843+0000 7fbedcf75640 1 --2- 10.20.193.58:0/3881577491 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbed815d4a0 0x7fbed80affb0 secure :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=12739505431298697817 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbed8059740 tx=0x7fbec402f190 comp rx=0 tx=0).stop 2026-02-23T06:32:36.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.843+0000 7fbedcf75640 1 -- 10.20.193.58:0/3881577491 shutdown_connections 2026-02-23T06:32:36.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.843+0000 7fbedcf75640 1 --2- 10.20.193.58:0/3881577491 >> v2:10.20.193.93:3300/0 conn(0x7fbed815d870 0x7fbed80587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:36.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.843+0000 7fbedcf75640 1 --2- 10.20.193.58:0/3881577491 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbed815d4a0 0x7fbed80affb0 unknown :-1 s=CLOSED pgs=15 gs=2 cs=0 l=1 c_cookie=12739505431298697817 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:36.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.843+0000 7fbedcf75640 1 -- 10.20.193.58:0/3881577491 >> 10.20.193.58:0/3881577491 conn(0x7fbed80b3c20 msgr2=0x7fbed80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:36.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.843+0000 7fbedcf75640 1 -- 10.20.193.58:0/3881577491 shutdown_connections 2026-02-23T06:32:36.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.843+0000 7fbedcf75640 1 -- 10.20.193.58:0/3881577491 wait complete. 2026-02-23T06:32:36.842 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.845+0000 7fbedcf75640 1 Processor -- start 2026-02-23T06:32:36.842 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.845+0000 7fbedcf75640 1 -- start start 2026-02-23T06:32:36.843 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.845+0000 7fbedcf75640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbed80b6690 0x7fbed815dd80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:36.843 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.845+0000 7fbedcf75640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbed815d4a0 0x7fbed815ebe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:36.843 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.845+0000 7fbedcf75640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbed815d870 0x7fbed815f120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:36.843 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.845+0000 7fbedcf75640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fbed813da40 con 0x7fbed815d4a0 2026-02-23T06:32:36.843 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.845+0000 7fbedcf75640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fbed813d6c0 con 0x7fbed815d870 2026-02-23T06:32:36.843 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.845+0000 7fbedcf75640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fbed8160350 con 0x7fbed80b6690 2026-02-23T06:32:36.843 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.845+0000 7fbed6ffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbed815d4a0 0x7fbed815ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:36.843 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.845+0000 7fbed6ffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbed815d4a0 0x7fbed815ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:51606/0 (socket says 10.20.193.58:51606) 2026-02-23T06:32:36.843 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.845+0000 7fbed6ffd640 1 -- 10.20.193.58:0/1480952831 learned_addr learned my addr 10.20.193.58:0/1480952831 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:32:36.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.846+0000 7fbed7fff640 1 --2- 10.20.193.58:0/1480952831 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbed815d870 0x7fbed815f120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:36.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.846+0000 7fbed77fe640 1 --2- 10.20.193.58:0/1480952831 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbed80b6690 0x7fbed815dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:36.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.846+0000 7fbed6ffd640 1 -- 10.20.193.58:0/1480952831 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbed80b6690 msgr2=0x7fbed815dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:36.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.846+0000 7fbed6ffd640 1 --2- 10.20.193.58:0/1480952831 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbed80b6690 0x7fbed815dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:36.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.846+0000 7fbed6ffd640 1 -- 10.20.193.58:0/1480952831 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbed815d870 msgr2=0x7fbed815f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:36.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.846+0000 7fbed6ffd640 1 --2- 10.20.193.58:0/1480952831 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbed815d870 0x7fbed815f120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:36.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.846+0000 7fbed6ffd640 1 -- 10.20.193.58:0/1480952831 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec40094b0 con 0x7fbed815d4a0 2026-02-23T06:32:36.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.846+0000 7fbed6ffd640 1 --2- 10.20.193.58:0/1480952831 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbed815d4a0 0x7fbed815ebe0 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbec800d950 tx=0x7fbec800de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:36.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.846+0000 7fbeb3fff640 1 -- 10.20.193.58:0/1480952831 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbec8004540 con 0x7fbed815d4a0 2026-02-23T06:32:36.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.846+0000 7fbeb3fff640 1 -- 10.20.193.58:0/1480952831 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbec8009910 con 0x7fbed815d4a0 2026-02-23T06:32:36.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.846+0000 7fbeb3fff640 1 -- 10.20.193.58:0/1480952831 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbec8009d20 con 0x7fbed815d4a0 2026-02-23T06:32:36.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.846+0000 7fbedcf75640 1 -- 10.20.193.58:0/1480952831 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed813ecb0 con 0x7fbed815d4a0 2026-02-23T06:32:36.845 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.846+0000 7fbedcf75640 1 -- 10.20.193.58:0/1480952831 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbed80581e0 con 0x7fbed815d4a0 2026-02-23T06:32:36.845 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.847+0000 7fbedcf75640 1 -- 10.20.193.58:0/1480952831 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbed80b6d50 con 0x7fbed815d4a0 2026-02-23T06:32:36.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.848+0000 7fbeb3fff640 1 -- 10.20.193.58:0/1480952831 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fbec80026a0 con 0x7fbed815d4a0 2026-02-23T06:32:36.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.849+0000 7fbeb3fff640 1 --2- 10.20.193.58:0/1480952831 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbea807a6b0 0x7fbea809ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:36.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.849+0000 7fbeb3fff640 1 -- 10.20.193.58:0/1480952831 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fbec809dff0 con 0x7fbed815d4a0 2026-02-23T06:32:36.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.849+0000 7fbed77fe640 1 --2- 10.20.193.58:0/1480952831 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbea807a6b0 0x7fbea809ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:36.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.850+0000 7fbed77fe640 1 --2- 10.20.193.58:0/1480952831 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbea807a6b0 0x7fbea809ab60 secure :-1 s=READY pgs=285 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbec40023d0 tx=0x7fbec4031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:36.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:36.851+0000 7fbeb3fff640 1 -- 10.20.193.58:0/1480952831 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fbec80dd680 con 0x7fbed815d4a0 2026-02-23T06:32:37.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.005+0000 7fbedcf75640 1 -- 10.20.193.58:0/1480952831 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fbed805b0e0 con 0x7fbed815d4a0 2026-02-23T06:32:37.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.005+0000 7fbeb3fff640 1 -- 10.20.193.58:0/1480952831 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7fbec8061190 con 0x7fbed815d4a0 2026-02-23T06:32:37.001 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":92,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:32:37.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.006+0000 7fbedcf75640 1 -- 10.20.193.58:0/1480952831 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbea807a6b0 msgr2=0x7fbea809ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:37.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.006+0000 7fbedcf75640 1 --2- 10.20.193.58:0/1480952831 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbea807a6b0 0x7fbea809ab60 secure :-1 s=READY pgs=285 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbec40023d0 tx=0x7fbec4031040 comp rx=0 tx=0).stop 2026-02-23T06:32:37.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.006+0000 7fbedcf75640 1 -- 10.20.193.58:0/1480952831 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbed815d4a0 msgr2=0x7fbed815ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:37.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.006+0000 7fbedcf75640 1 --2- 10.20.193.58:0/1480952831 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbed815d4a0 0x7fbed815ebe0 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbec800d950 tx=0x7fbec800de20 comp rx=0 tx=0).stop 2026-02-23T06:32:37.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.006+0000 7fbedcf75640 1 -- 10.20.193.58:0/1480952831 shutdown_connections 2026-02-23T06:32:37.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.006+0000 7fbedcf75640 1 --2- 10.20.193.58:0/1480952831 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbea807a6b0 0x7fbea809ab60 unknown :-1 s=CLOSED pgs=285 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.006+0000 7fbedcf75640 1 --2- 10.20.193.58:0/1480952831 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbed815d870 0x7fbed815f120 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.006+0000 7fbedcf75640 1 --2- 10.20.193.58:0/1480952831 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbed815d4a0 0x7fbed815ebe0 unknown :-1 s=CLOSED pgs=16 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.006+0000 7fbedcf75640 1 --2- 10.20.193.58:0/1480952831 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbed80b6690 0x7fbed815dd80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.006+0000 7fbedcf75640 1 -- 10.20.193.58:0/1480952831 >> 10.20.193.58:0/1480952831 conn(0x7fbed80b3c20 msgr2=0x7fbed815bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:37.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.006+0000 7fbedcf75640 1 -- 10.20.193.58:0/1480952831 shutdown_connections 2026-02-23T06:32:37.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.006+0000 7fbedcf75640 1 -- 10.20.193.58:0/1480952831 wait complete. 2026-02-23T06:32:37.014 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:32:37.014 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:32:37.014 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:32:37.014 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:32:37.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.142+0000 7f2b7bfff640 1 -- 10.20.193.58:0/4127988224 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2b7c056960 msgr2=0x7f2b7c0b6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:37.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.142+0000 7f2b7bfff640 1 --2- 10.20.193.58:0/4127988224 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2b7c056960 0x7f2b7c0b6720 secure :-1 s=READY pgs=17 gs=2 cs=0 l=1 c_cookie=10900211258174977529 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b64004740 tx=0x7f2b6402f1e0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.142+0000 7f2b7bfff640 1 -- 10.20.193.58:0/4127988224 shutdown_connections 2026-02-23T06:32:37.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.142+0000 7f2b7bfff640 1 --2- 10.20.193.58:0/4127988224 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2b7c056960 0x7f2b7c0b6720 unknown :-1 s=CLOSED pgs=17 gs=2 cs=0 l=1 c_cookie=10900211258174977529 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.142+0000 7f2b7bfff640 1 --2- 10.20.193.58:0/4127988224 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2b7c15c4b0 0x7f2b7c058200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.142+0000 7f2b7bfff640 1 -- 10.20.193.58:0/4127988224 >> 10.20.193.58:0/4127988224 conn(0x7f2b7c0b3c20 msgr2=0x7f2b7c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:37.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.142+0000 7f2b7bfff640 1 -- 10.20.193.58:0/4127988224 shutdown_connections 2026-02-23T06:32:37.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.142+0000 7f2b7bfff640 1 -- 10.20.193.58:0/4127988224 wait complete. 2026-02-23T06:32:37.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.143+0000 7f2b7bfff640 1 Processor -- start 2026-02-23T06:32:37.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.143+0000 7f2b7bfff640 1 -- start start 2026-02-23T06:32:37.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.144+0000 7f2b7bfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2b7c056960 0x7f2b7c1646b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:37.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.144+0000 7f2b7bfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2b7c15c4b0 0x7f2b7c141750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:37.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.144+0000 7f2b7bfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2b7c162ca0 0x7f2b7c17a210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:37.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.144+0000 7f2b7bfff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7c1422e0 con 0x7f2b7c056960 2026-02-23T06:32:37.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.144+0000 7f2b7bfff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7c1425c0 con 0x7f2b7c15c4b0 2026-02-23T06:32:37.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.144+0000 7f2b7bfff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f2b7c1428a0 con 0x7f2b7c162ca0 2026-02-23T06:32:37.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.144+0000 7f2b7affd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2b7c056960 0x7f2b7c1646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:37.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.144+0000 7f2b7affd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2b7c056960 0x7f2b7c1646b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:51620/0 (socket says 10.20.193.58:51620) 2026-02-23T06:32:37.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.144+0000 7f2b7affd640 1 -- 10.20.193.58:0/3020834915 learned_addr learned my addr 10.20.193.58:0/3020834915 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:32:37.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.144+0000 7f2b7b7fe640 1 --2- 10.20.193.58:0/3020834915 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2b7c162ca0 0x7f2b7c17a210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:37.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.144+0000 7f2b7a7fc640 1 --2- 10.20.193.58:0/3020834915 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2b7c15c4b0 0x7f2b7c141750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:37.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.144+0000 7f2b7affd640 1 -- 10.20.193.58:0/3020834915 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2b7c162ca0 msgr2=0x7f2b7c17a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:37.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.144+0000 7f2b7affd640 1 --2- 10.20.193.58:0/3020834915 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2b7c162ca0 0x7f2b7c17a210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.144+0000 7f2b7affd640 1 -- 10.20.193.58:0/3020834915 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2b7c15c4b0 msgr2=0x7f2b7c141750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:37.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.144+0000 7f2b7affd640 1 --2- 10.20.193.58:0/3020834915 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2b7c15c4b0 0x7f2b7c141750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.144+0000 7f2b7affd640 1 -- 10.20.193.58:0/3020834915 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b640094b0 con 0x7f2b7c056960 2026-02-23T06:32:37.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.144+0000 7f2b7affd640 1 --2- 10.20.193.58:0/3020834915 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2b7c056960 0x7f2b7c1646b0 secure :-1 s=READY pgs=18 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b70009480 tx=0x7f2b7000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:37.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.144+0000 7f2b53fff640 1 -- 10.20.193.58:0/3020834915 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b7000cd40 con 0x7f2b7c056960 2026-02-23T06:32:37.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.145+0000 7f2b53fff640 1 -- 10.20.193.58:0/3020834915 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b70004850 con 0x7f2b7c056960 2026-02-23T06:32:37.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.145+0000 7f2b7bfff640 1 -- 10.20.193.58:0/3020834915 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b7c142b80 con 0x7f2b7c056960 2026-02-23T06:32:37.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.145+0000 7f2b53fff640 1 -- 10.20.193.58:0/3020834915 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b7000cea0 con 0x7f2b7c056960 2026-02-23T06:32:37.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.145+0000 7f2b7bfff640 1 -- 10.20.193.58:0/3020834915 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b7c0b6360 con 0x7f2b7c056960 2026-02-23T06:32:37.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.145+0000 7f2b7bfff640 1 --2- 10.20.193.58:0/3020834915 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2b7c1633e0 0x7f2b7c17a750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:37.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.145+0000 7f2b7bfff640 1 -- 10.20.193.58:0/3020834915 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7c1637b0 con 0x7f2b7c1633e0 2026-02-23T06:32:37.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.145+0000 7f2b7a7fc640 1 --2- 10.20.193.58:0/3020834915 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2b7c1633e0 0x7f2b7c17a750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:37.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.146+0000 7f2b7a7fc640 1 -- 10.20.193.58:0/3020834915 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2b7c059690 con 0x7f2b7c1633e0 2026-02-23T06:32:37.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.146+0000 7f2b7a7fc640 1 --2- 10.20.193.58:0/3020834915 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2b7c1633e0 0x7f2b7c17a750 secure :-1 s=READY pgs=19 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b64009230 tx=0x7f2b640028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:37.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.146+0000 7f2b53fff640 1 -- 10.20.193.58:0/3020834915 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b64046070 con 0x7f2b7c1633e0 2026-02-23T06:32:37.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.146+0000 7f2b53fff640 1 -- 10.20.193.58:0/3020834915 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f2b6403e040 con 0x7f2b7c1633e0 2026-02-23T06:32:37.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.146+0000 7f2b53fff640 1 -- 10.20.193.58:0/3020834915 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2b7c1633e0 msgr2=0x7f2b7c17a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:37.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.146+0000 7f2b53fff640 1 --2- 10.20.193.58:0/3020834915 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2b7c1633e0 0x7f2b7c17a750 secure :-1 s=READY pgs=19 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b64009230 tx=0x7f2b640028d0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.146+0000 7f2b53fff640 1 -- 10.20.193.58:0/3020834915 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2b7c1633e0 msgr2=0x7f2b7c17a750 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:32:37.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.146+0000 7f2b53fff640 1 --2- 10.20.193.58:0/3020834915 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2b7c1633e0 0x7f2b7c17a750 secure :-1 s=CLOSED pgs=19 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b64009230 tx=0x7f2b640028d0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.146+0000 7f2b53fff640 1 -- 10.20.193.58:0/3020834915 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f2b7001f060 con 0x7f2b7c056960 2026-02-23T06:32:37.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.147+0000 7f2b53fff640 1 --2- 10.20.193.58:0/3020834915 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2b4c07a430 0x7f2b4c09a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:37.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.147+0000 7f2b53fff640 1 -- 10.20.193.58:0/3020834915 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f2b70014070 con 0x7f2b7c056960 2026-02-23T06:32:37.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.147+0000 7f2b7a7fc640 1 --2- 10.20.193.58:0/3020834915 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2b4c07a430 0x7f2b4c09a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:37.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.148+0000 7f2b7a7fc640 1 --2- 10.20.193.58:0/3020834915 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2b4c07a430 0x7f2b4c09a8e0 secure :-1 s=READY pgs=286 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b64009230 tx=0x7f2b6403a000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:37.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.149+0000 7f2b7bfff640 1 --2- 10.20.193.58:0/3020834915 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2b7c158c60 0x7f2b7c159030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:37.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.149+0000 7f2b7bfff640 1 -- 10.20.193.58:0/3020834915 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7c0593b0 con 0x7f2b7c158c60 2026-02-23T06:32:37.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.150+0000 7f2b7b7fe640 1 --2- 10.20.193.58:0/3020834915 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2b7c158c60 0x7f2b7c159030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:37.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.150+0000 7f2b7b7fe640 1 -- 10.20.193.58:0/3020834915 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2b7c15c880 con 0x7f2b7c158c60 2026-02-23T06:32:37.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.150+0000 7f2b7b7fe640 1 --2- 10.20.193.58:0/3020834915 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2b7c158c60 0x7f2b7c159030 secure :-1 s=READY pgs=20 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b6c0038b0 tx=0x7f2b6c00fba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:37.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.150+0000 7f2b53fff640 1 -- 10.20.193.58:0/3020834915 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b6c01a070 con 0x7f2b7c158c60 2026-02-23T06:32:37.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.150+0000 7f2b53fff640 1 -- 10.20.193.58:0/3020834915 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4913 (secure 0 0 0) 0x7f2b6c00d8d0 con 0x7f2b7c158c60 2026-02-23T06:32:37.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.150+0000 7f2b53fff640 1 -- 10.20.193.58:0/3020834915 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2b7c158c60 msgr2=0x7f2b7c159030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:37.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.150+0000 7f2b53fff640 1 --2- 10.20.193.58:0/3020834915 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2b7c158c60 0x7f2b7c159030 secure :-1 s=READY pgs=20 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b6c0038b0 tx=0x7f2b6c00fba0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.150+0000 7f2b53fff640 1 -- 10.20.193.58:0/3020834915 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2b7c158c60 msgr2=0x7f2b7c159030 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:32:37.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.150+0000 7f2b53fff640 1 --2- 10.20.193.58:0/3020834915 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2b7c158c60 0x7f2b7c159030 unknown :-1 s=CLOSED pgs=20 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.146 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:32:37.146 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:32:37.146 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:32:37.146 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:32:37.146 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 92, 2026-02-23T06:32:37.146 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 26365, 2026-02-23T06:32:37.146 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:32:37.146 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:32:37.146 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:32:37.146 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:32:37.146 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:37.146 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:32:37.146 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:32:37.146 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:32:37.146 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:32:37.146 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:32:37.146 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:32:37.146 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:32:37.147 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:32:37.147 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:32:37.147 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:32:37.147 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:32:37.147 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:32:37.147 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:32:37.147 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:32:37.147 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:32:37.147 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:32:37.147 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:32:37.147 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:37.147 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:32:37.147 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:32:37.147 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:32:37.147 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:32:37.147 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:32:37.147 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:32:37.147 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:32:37.147 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:32:37.147 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:32:37.147 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:32:37.147 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:32:37.147 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:32:37.148 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:32:37.148 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:32:37.148 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:32:37.148 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:37.148 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.148 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:32:37.148 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:32:37.148 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:32:37.148 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:32:37.148 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:32:37.148 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:32:37.148 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:32:37.148 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:32:37.148 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:32:37.148 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:32:37.148 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:32:37.148 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:32:37.148 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:32:37.148 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:32:37.148 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:32:37.148 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:32:37.148 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:32:37.148 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:32:37.148 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:32:37.149 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:32:37.149 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:32:37.149 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:32:37.149 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:32:37.149 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:32:37.149 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:32:37.149 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:32:37.149 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:32:37.149 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:32:37.149 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:32:37.149 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:32:37.149 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:37.149 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:32:37.149 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.149 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:32:37.149 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.149 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:32:37.149 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:32:37.149 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:32:37.149 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:32:37.149 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.149 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:32:37.149 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:32:37.149 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:37.149 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.150 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.150 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:32:37.150 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:32:37.150 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:37.150 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:37.150 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:37.150 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.150 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:32:37.150 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:32:37.150 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:32:37.150 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:32:37.150 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:32:37.150 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:32:37.150 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.150 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.150 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:32:37.150 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:32:37.150 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:32:37.150 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:32:37.150 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.150 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:32:37.150 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:32:37.150 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:37.150 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.150 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.151 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:32:37.151 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:32:37.151 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:37.151 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:37.151 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:37.151 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.151 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:32:37.151 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:32:37.151 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:32:37.151 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:32:37.151 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:32:37.151 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:32:37.151 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.151 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.151 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:32:37.151 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:32:37.151 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:32:37.151 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:32:37.151 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.151 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:32:37.151 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:32:37.151 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:37.151 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.151 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.151 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:32:37.151 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:32:37.152 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:37.152 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:37.152 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:37.152 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.152 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:32:37.152 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:32:37.152 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:32:37.152 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:32:37.152 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:32:37.152 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:32:37.152 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:37.152 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:37.152 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.152 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:32:37.152 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:32:37.152 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.152 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:32:37.152 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:32:37.152 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:32:37.152 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:37.152 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:37.152 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:32:37.152 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.152 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:32:37.153 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:32:37.153 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:32:37.153 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:37.153 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:37.153 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.153 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:32:37.153 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:32:37.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.151+0000 7f2b7bfff640 1 -- 10.20.193.58:0/3020834915 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2b4c07a430 msgr2=0x7f2b4c09a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:37.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.151+0000 7f2b7bfff640 1 --2- 10.20.193.58:0/3020834915 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2b4c07a430 0x7f2b4c09a8e0 secure :-1 s=READY pgs=286 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b64009230 tx=0x7f2b6403a000 comp rx=0 tx=0).stop 2026-02-23T06:32:37.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.151+0000 7f2b7bfff640 1 -- 10.20.193.58:0/3020834915 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2b7c056960 msgr2=0x7f2b7c1646b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:37.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.151+0000 7f2b7bfff640 1 --2- 10.20.193.58:0/3020834915 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2b7c056960 0x7f2b7c1646b0 secure :-1 s=READY pgs=18 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b70009480 tx=0x7f2b7000ee60 comp rx=0 tx=0).stop 2026-02-23T06:32:37.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.151+0000 7f2b7b7fe640 1 -- 10.20.193.58:0/3020834915 reap_dead start 2026-02-23T06:32:37.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.151+0000 7f2b7b7fe640 1 -- 10.20.193.58:0/3020834915 reap_dead start 2026-02-23T06:32:37.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.151+0000 7f2b7bfff640 1 -- 10.20.193.58:0/3020834915 shutdown_connections 2026-02-23T06:32:37.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.151+0000 7f2b7bfff640 1 -- 10.20.193.58:0/3020834915 >> 10.20.193.58:0/3020834915 conn(0x7f2b7c0b3c20 msgr2=0x7f2b7c15b180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:37.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.151+0000 7f2b7bfff640 1 -- 10.20.193.58:0/3020834915 shutdown_connections 2026-02-23T06:32:37.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.151+0000 7f2b7bfff640 1 -- 10.20.193.58:0/3020834915 wait complete. 2026-02-23T06:32:37.154 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:32:37.154 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:32:37.154 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:32:37.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.281+0000 7faaa5683640 1 -- 10.20.193.58:0/100394168 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faaa0056960 msgr2=0x7faaa0058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:37.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.281+0000 7faaa5683640 1 --2- 10.20.193.58:0/100394168 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faaa0056960 0x7faaa0058200 secure :-1 s=READY pgs=21 gs=2 cs=0 l=1 c_cookie=8055241476084487736 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faaa005e310 tx=0x7faa9002f190 comp rx=0 tx=0).stop 2026-02-23T06:32:37.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.281+0000 7faaa5683640 1 -- 10.20.193.58:0/100394168 shutdown_connections 2026-02-23T06:32:37.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.281+0000 7faaa5683640 1 --2- 10.20.193.58:0/100394168 >> v2:10.20.193.93:3300/0 conn(0x7faaa0162ca0 0x7faaa0056fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.281+0000 7faaa5683640 1 --2- 10.20.193.58:0/100394168 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faaa0056960 0x7faaa0058200 unknown :-1 s=CLOSED pgs=21 gs=2 cs=0 l=1 c_cookie=8055241476084487736 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.281+0000 7faaa5683640 1 -- 10.20.193.58:0/100394168 >> 10.20.193.58:0/100394168 conn(0x7faaa00b3c20 msgr2=0x7faaa00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:37.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.281+0000 7faaa5683640 1 -- 10.20.193.58:0/100394168 shutdown_connections 2026-02-23T06:32:37.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.281+0000 7faaa5683640 1 -- 10.20.193.58:0/100394168 wait complete. 2026-02-23T06:32:37.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.282+0000 7faaa5683640 1 Processor -- start 2026-02-23T06:32:37.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.283+0000 7faaa5683640 1 -- start start 2026-02-23T06:32:37.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.283+0000 7faaa5683640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faaa0056960 0x7faaa011cf90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:37.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.283+0000 7faaa5683640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faaa015c4b0 0x7faaa013a6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:37.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.283+0000 7faaa5683640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faaa0162ca0 0x7faaa013b4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:37.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.283+0000 7faaa5683640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7faaa0160ae0 con 0x7faaa0162ca0 2026-02-23T06:32:37.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.283+0000 7faaa5683640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7faaa015b850 con 0x7faaa0056960 2026-02-23T06:32:37.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.283+0000 7faaa5683640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7faaa0160090 con 0x7faaa015c4b0 2026-02-23T06:32:37.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.283+0000 7faa9ffff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faaa0056960 0x7faaa011cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:37.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.283+0000 7faa9f7fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faaa015c4b0 0x7faaa013a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:37.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.283+0000 7faaa4e82640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faaa0162ca0 0x7faaa013b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:37.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.283+0000 7faa9f7fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faaa015c4b0 0x7faaa013a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:45760/0 (socket says 10.20.193.58:45760) 2026-02-23T06:32:37.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.283+0000 7faa9f7fe640 1 -- 10.20.193.58:0/1938183395 learned_addr learned my addr 10.20.193.58:0/1938183395 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:32:37.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.284+0000 7faaa4e82640 1 -- 10.20.193.58:0/1938183395 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faaa015c4b0 msgr2=0x7faaa013a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:37.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.284+0000 7faaa4e82640 1 --2- 10.20.193.58:0/1938183395 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faaa015c4b0 0x7faaa013a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.284+0000 7faaa4e82640 1 -- 10.20.193.58:0/1938183395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faaa0056960 msgr2=0x7faaa011cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:37.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.284+0000 7faaa4e82640 1 --2- 10.20.193.58:0/1938183395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faaa0056960 0x7faaa011cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.284+0000 7faaa4e82640 1 -- 10.20.193.58:0/1938183395 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa9400a590 con 0x7faaa0162ca0 2026-02-23T06:32:37.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.284+0000 7faa9f7fe640 1 --2- 10.20.193.58:0/1938183395 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faaa015c4b0 0x7faaa013a6b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:32:37.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.284+0000 7faaa4e82640 1 --2- 10.20.193.58:0/1938183395 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faaa0162ca0 0x7faaa013b4f0 secure :-1 s=READY pgs=22 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa9400aef0 tx=0x7faa94003b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:37.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.284+0000 7faa9cff9640 1 -- 10.20.193.58:0/1938183395 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa9400fb50 con 0x7faaa0162ca0 2026-02-23T06:32:37.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.284+0000 7faa9cff9640 1 -- 10.20.193.58:0/1938183395 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa9400fcb0 con 0x7faaa0162ca0 2026-02-23T06:32:37.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.284+0000 7faaa5683640 1 -- 10.20.193.58:0/1938183395 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa900094b0 con 0x7faaa0162ca0 2026-02-23T06:32:37.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.284+0000 7faa9cff9640 1 -- 10.20.193.58:0/1938183395 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa940116b0 con 0x7faaa0162ca0 2026-02-23T06:32:37.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.284+0000 7faaa5683640 1 -- 10.20.193.58:0/1938183395 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaa0139d30 con 0x7faaa0162ca0 2026-02-23T06:32:37.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.285+0000 7faaa5683640 1 --2- 10.20.193.58:0/1938183395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faaa013abf0 0x7faaa0160340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:37.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.285+0000 7faaa5683640 1 -- 10.20.193.58:0/1938183395 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7faaa0059690 con 0x7faaa013abf0 2026-02-23T06:32:37.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.285+0000 7faa9ffff640 1 --2- 10.20.193.58:0/1938183395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faaa013abf0 0x7faaa0160340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:37.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.285+0000 7faa9ffff640 1 -- 10.20.193.58:0/1938183395 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faaa00593b0 con 0x7faaa013abf0 2026-02-23T06:32:37.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.285+0000 7faa9ffff640 1 --2- 10.20.193.58:0/1938183395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faaa013abf0 0x7faaa0160340 secure :-1 s=READY pgs=45 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa8c0029a0 tx=0x7faa8c00fc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:37.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.286+0000 7faa9cff9640 1 -- 10.20.193.58:0/1938183395 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa8c00dae0 con 0x7faaa013abf0 2026-02-23T06:32:37.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.286+0000 7faa9cff9640 1 -- 10.20.193.58:0/1938183395 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7faa8c00fe10 con 0x7faaa013abf0 2026-02-23T06:32:37.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.286+0000 7faa9cff9640 1 -- 10.20.193.58:0/1938183395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faaa013abf0 msgr2=0x7faaa0160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:37.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.286+0000 7faa9cff9640 1 --2- 10.20.193.58:0/1938183395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faaa013abf0 0x7faaa0160340 secure :-1 s=READY pgs=45 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa8c0029a0 tx=0x7faa8c00fc10 comp rx=0 tx=0).stop 2026-02-23T06:32:37.285 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.286+0000 7faa9cff9640 1 -- 10.20.193.58:0/1938183395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faaa013abf0 msgr2=0x7faaa0160340 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:32:37.285 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.286+0000 7faa9cff9640 1 --2- 10.20.193.58:0/1938183395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faaa013abf0 0x7faaa0160340 secure :-1 s=CLOSED pgs=45 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa8c0029a0 tx=0x7faa8c00fc10 comp rx=0 tx=0).stop 2026-02-23T06:32:37.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.287+0000 7faa9cff9640 1 -- 10.20.193.58:0/1938183395 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7faa94020060 con 0x7faaa0162ca0 2026-02-23T06:32:37.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.288+0000 7faa9cff9640 1 --2- 10.20.193.58:0/1938183395 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa7007a430 0x7faa7009a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:37.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.288+0000 7faa9cff9640 1 -- 10.20.193.58:0/1938183395 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7faa9409ed70 con 0x7faaa0162ca0 2026-02-23T06:32:37.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.288+0000 7faa9ffff640 1 --2- 10.20.193.58:0/1938183395 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa7007a430 0x7faa7009a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:37.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.289+0000 7faa9ffff640 1 --2- 10.20.193.58:0/1938183395 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa7007a430 0x7faa7009a8e0 secure :-1 s=READY pgs=287 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa8c0023d0 tx=0x7faa8c009030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:37.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.289+0000 7faaa5683640 1 --2- 10.20.193.58:0/1938183395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faaa013ba30 0x7faaa013dc20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:37.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.289+0000 7faaa5683640 1 -- 10.20.193.58:0/1938183395 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7faaa013be00 con 0x7faaa013ba30 2026-02-23T06:32:37.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.290+0000 7faa9f7fe640 1 --2- 10.20.193.58:0/1938183395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faaa013ba30 0x7faaa013dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:37.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.290+0000 7faa9f7fe640 1 -- 10.20.193.58:0/1938183395 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faaa013ca50 con 0x7faaa013ba30 2026-02-23T06:32:37.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.290+0000 7faa9f7fe640 1 --2- 10.20.193.58:0/1938183395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faaa013ba30 0x7faaa013dc20 secure :-1 s=READY pgs=46 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa9002f6c0 tx=0x7faa90002bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:37.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.290+0000 7faa9cff9640 1 -- 10.20.193.58:0/1938183395 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa90047070 con 0x7faaa013ba30 2026-02-23T06:32:37.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.290+0000 7faa9cff9640 1 -- 10.20.193.58:0/1938183395 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4911 (secure 0 0 0) 0x7faa9003e040 con 0x7faaa013ba30 2026-02-23T06:32:37.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.290+0000 7faa9cff9640 1 -- 10.20.193.58:0/1938183395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faaa013ba30 msgr2=0x7faaa013dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:37.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.290+0000 7faa9cff9640 1 --2- 10.20.193.58:0/1938183395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faaa013ba30 0x7faaa013dc20 secure :-1 s=READY pgs=46 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa9002f6c0 tx=0x7faa90002bd0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.290+0000 7faa9cff9640 1 -- 10.20.193.58:0/1938183395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faaa013ba30 msgr2=0x7faaa013dc20 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:32:37.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.290+0000 7faa9cff9640 1 --2- 10.20.193.58:0/1938183395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faaa013ba30 0x7faaa013dc20 secure :-1 s=CLOSED pgs=46 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa9002f6c0 tx=0x7faa90002bd0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.288 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:32:37.288 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:32:37.289 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:32:37.289 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:32:37.289 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 92, 2026-02-23T06:32:37.289 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 93867, 2026-02-23T06:32:37.289 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:32:37.289 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:32:37.289 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:32:37.289 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:32:37.289 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:37.289 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:32:37.289 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:32:37.289 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:32:37.290 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:32:37.290 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:32:37.290 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:32:37.290 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:32:37.290 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:32:37.290 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:32:37.290 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:32:37.290 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:32:37.290 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:32:37.290 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:32:37.290 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:32:37.291 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:32:37.291 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:32:37.291 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:32:37.291 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:37.291 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:32:37.291 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:32:37.291 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:32:37.291 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:32:37.291 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:32:37.291 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:32:37.291 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:32:37.291 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:32:37.292 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:32:37.292 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:32:37.292 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:32:37.292 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:32:37.292 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:32:37.292 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:32:37.292 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:32:37.292 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:37.292 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.292 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:32:37.292 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:32:37.292 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:32:37.292 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:32:37.293 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:32:37.293 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:32:37.293 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:32:37.293 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:32:37.293 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:32:37.293 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:32:37.293 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:32:37.293 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:32:37.293 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:32:37.293 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:32:37.293 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:32:37.293 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:32:37.294 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:32:37.294 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:32:37.294 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:32:37.294 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:32:37.294 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:32:37.294 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:32:37.294 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:32:37.294 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:32:37.294 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:32:37.294 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:32:37.294 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:32:37.294 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:32:37.295 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:32:37.295 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:32:37.295 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:37.295 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:32:37.295 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.295 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:32:37.295 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.295 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:32:37.295 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:32:37.295 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:32:37.295 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:32:37.295 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.295 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:32:37.296 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:32:37.296 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:37.296 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.296 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.296 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:32:37.296 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:32:37.296 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:37.296 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:37.296 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:37.296 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.296 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:32:37.296 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:32:37.296 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:32:37.297 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:32:37.297 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:32:37.297 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:32:37.297 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.297 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.297 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:32:37.297 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:32:37.297 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:32:37.297 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:32:37.297 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.297 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:32:37.297 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:32:37.297 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:37.298 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.298 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.298 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:32:37.298 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:32:37.298 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:37.298 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:37.298 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:37.298 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.298 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:32:37.298 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:32:37.298 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:32:37.298 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:32:37.298 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:32:37.299 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:32:37.299 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.299 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.299 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:32:37.299 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:32:37.299 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:32:37.299 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:32:37.299 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.299 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:32:37.299 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:32:37.299 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:37.299 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.300 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.300 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:32:37.300 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:32:37.300 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:37.300 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:37.300 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:37.300 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.300 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:32:37.300 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:32:37.300 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:32:37.300 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:32:37.300 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:32:37.300 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:32:37.301 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:37.301 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:37.301 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.301 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:32:37.301 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:32:37.301 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.301 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:32:37.301 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:32:37.301 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:32:37.301 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:37.301 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:37.301 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:32:37.301 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.302 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:32:37.302 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:32:37.302 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:32:37.302 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:37.302 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:37.302 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.302 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:32:37.302 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:32:37.304 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.291+0000 7faaa5683640 1 -- 10.20.193.58:0/1938183395 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa7007a430 msgr2=0x7faa7009a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:37.304 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.291+0000 7faaa5683640 1 --2- 10.20.193.58:0/1938183395 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa7007a430 0x7faa7009a8e0 secure :-1 s=READY pgs=287 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa8c0023d0 tx=0x7faa8c009030 comp rx=0 tx=0).stop 2026-02-23T06:32:37.304 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.291+0000 7faaa5683640 1 -- 10.20.193.58:0/1938183395 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faaa0162ca0 msgr2=0x7faaa013b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:37.304 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.291+0000 7faaa5683640 1 --2- 10.20.193.58:0/1938183395 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faaa0162ca0 0x7faaa013b4f0 secure :-1 s=READY pgs=22 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa9400aef0 tx=0x7faa94003b50 comp rx=0 tx=0).stop 2026-02-23T06:32:37.304 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.291+0000 7faaa4e82640 1 -- 10.20.193.58:0/1938183395 reap_dead start 2026-02-23T06:32:37.304 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.291+0000 7faaa4e82640 1 -- 10.20.193.58:0/1938183395 reap_dead start 2026-02-23T06:32:37.304 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.291+0000 7faaa5683640 1 -- 10.20.193.58:0/1938183395 shutdown_connections 2026-02-23T06:32:37.304 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.291+0000 7faaa5683640 1 -- 10.20.193.58:0/1938183395 >> 10.20.193.58:0/1938183395 conn(0x7faaa00b3c20 msgr2=0x7faaa00b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:37.304 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.291+0000 7faaa5683640 1 -- 10.20.193.58:0/1938183395 shutdown_connections 2026-02-23T06:32:37.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.291+0000 7faaa5683640 1 -- 10.20.193.58:0/1938183395 wait complete. 2026-02-23T06:32:37.305 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:32:37.305 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:32:37.305 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:32:37.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.432+0000 7fc79645b640 1 -- 10.20.193.58:0/4156303221 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc79015baa0 msgr2=0x7fc7900b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:37.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.432+0000 7fc79645b640 1 --2- 10.20.193.58:0/4156303221 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc79015baa0 0x7fc7900b5610 secure :-1 s=READY pgs=189 gs=3 cs=0 l=1 c_cookie=9493308572435146344 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc77c009890 tx=0x7fc77c02f200 comp rx=0 tx=0).stop 2026-02-23T06:32:37.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.432+0000 7fc79645b640 1 -- 10.20.193.58:0/4156303221 shutdown_connections 2026-02-23T06:32:37.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.432+0000 7fc79645b640 1 --2- 10.20.193.58:0/4156303221 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc79015baa0 0x7fc7900b5610 unknown :-1 s=CLOSED pgs=189 gs=3 cs=0 l=1 c_cookie=9493308572435146344 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.432+0000 7fc79645b640 1 -- 10.20.193.58:0/4156303221 >> 10.20.193.58:0/4156303221 conn(0x7fc790058e50 msgr2=0x7fc790059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:37.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.432+0000 7fc79645b640 1 -- 10.20.193.58:0/4156303221 shutdown_connections 2026-02-23T06:32:37.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.432+0000 7fc79645b640 1 -- 10.20.193.58:0/4156303221 wait complete. 2026-02-23T06:32:37.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.433+0000 7fc79645b640 1 Processor -- start 2026-02-23T06:32:37.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.433+0000 7fc79645b640 1 -- start start 2026-02-23T06:32:37.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.434+0000 7fc79645b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc7900b39f0 0x7fc790160e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:37.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.434+0000 7fc79645b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc79015baa0 0x7fc79015a860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:37.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.434+0000 7fc79645b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc79015be70 0x7fc790161810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:37.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.434+0000 7fc79645b640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc79015fed0 con 0x7fc79015be70 2026-02-23T06:32:37.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.434+0000 7fc79645b640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc790160360 con 0x7fc79015baa0 2026-02-23T06:32:37.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.434+0000 7fc79645b640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc790162970 con 0x7fc7900b39f0 2026-02-23T06:32:37.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.434+0000 7fc7949d1640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc79015be70 0x7fc790161810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:37.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.434+0000 7fc78ffff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc7900b39f0 0x7fc790160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:37.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.434+0000 7fc7949d1640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc79015be70 0x7fc790161810 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:51670/0 (socket says 10.20.193.58:51670) 2026-02-23T06:32:37.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.434+0000 7fc7949d1640 1 -- 10.20.193.58:0/905246185 learned_addr learned my addr 10.20.193.58:0/905246185 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:32:37.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.434+0000 7fc78f7fe640 1 --2- 10.20.193.58:0/905246185 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc79015baa0 0x7fc79015a860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:37.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.434+0000 7fc7949d1640 1 -- 10.20.193.58:0/905246185 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc7900b39f0 msgr2=0x7fc790160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:37.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.434+0000 7fc7949d1640 1 --2- 10.20.193.58:0/905246185 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc7900b39f0 0x7fc790160e30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.434+0000 7fc7949d1640 1 -- 10.20.193.58:0/905246185 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc79015baa0 msgr2=0x7fc79015a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:37.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.434+0000 7fc7949d1640 1 --2- 10.20.193.58:0/905246185 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc79015baa0 0x7fc79015a860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.434+0000 7fc7949d1640 1 -- 10.20.193.58:0/905246185 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc77c0094b0 con 0x7fc79015be70 2026-02-23T06:32:37.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.434+0000 7fc78f7fe640 1 --2- 10.20.193.58:0/905246185 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc79015baa0 0x7fc79015a860 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:32:37.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.434+0000 7fc7949d1640 1 --2- 10.20.193.58:0/905246185 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc79015be70 0x7fc790161810 secure :-1 s=READY pgs=24 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc78400d700 tx=0x7fc78400dbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:37.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.434+0000 7fc78cff9640 1 -- 10.20.193.58:0/905246185 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc784007b90 con 0x7fc79015be70 2026-02-23T06:32:37.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.434+0000 7fc78cff9640 1 -- 10.20.193.58:0/905246185 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc784007de0 con 0x7fc79015be70 2026-02-23T06:32:37.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.434+0000 7fc78cff9640 1 -- 10.20.193.58:0/905246185 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc784006280 con 0x7fc79015be70 2026-02-23T06:32:37.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.434+0000 7fc79645b640 1 -- 10.20.193.58:0/905246185 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc79013ba10 con 0x7fc79015be70 2026-02-23T06:32:37.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.435+0000 7fc79645b640 1 -- 10.20.193.58:0/905246185 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc79013bf90 con 0x7fc79015be70 2026-02-23T06:32:37.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.435+0000 7fc79645b640 1 --2- 10.20.193.58:0/905246185 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc790161d50 0x7fc79014b670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:37.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.435+0000 7fc79645b640 1 -- 10.20.193.58:0/905246185 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc790165d30 con 0x7fc790161d50 2026-02-23T06:32:37.432 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.435+0000 7fc78ffff640 1 --2- 10.20.193.58:0/905246185 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc790161d50 0x7fc79014b670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:37.432 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.436+0000 7fc78ffff640 1 -- 10.20.193.58:0/905246185 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc790165a50 con 0x7fc790161d50 2026-02-23T06:32:37.432 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.436+0000 7fc78ffff640 1 --2- 10.20.193.58:0/905246185 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc790161d50 0x7fc79014b670 secure :-1 s=READY pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc77c009230 tx=0x7fc77c0028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:37.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.436+0000 7fc78cff9640 1 -- 10.20.193.58:0/905246185 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc77c047070 con 0x7fc790161d50 2026-02-23T06:32:37.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.436+0000 7fc78cff9640 1 -- 10.20.193.58:0/905246185 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fc78401a030 con 0x7fc79015be70 2026-02-23T06:32:37.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.437+0000 7fc78cff9640 1 --2- 10.20.193.58:0/905246185 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc76007a660 0x7fc76009ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:37.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.437+0000 7fc78cff9640 1 -- 10.20.193.58:0/905246185 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fc78409dc50 con 0x7fc79015be70 2026-02-23T06:32:37.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.437+0000 7fc78cff9640 1 -- 10.20.193.58:0/905246185 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fc77c03e040 con 0x7fc790161d50 2026-02-23T06:32:37.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.437+0000 7fc78cff9640 1 -- 10.20.193.58:0/905246185 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc790161d50 msgr2=0x7fc79014b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:37.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.437+0000 7fc78cff9640 1 --2- 10.20.193.58:0/905246185 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc790161d50 0x7fc79014b670 secure :-1 s=READY pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc77c009230 tx=0x7fc77c0028d0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.437+0000 7fc78cff9640 1 -- 10.20.193.58:0/905246185 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc790161d50 msgr2=0x7fc79014b670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:32:37.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.437+0000 7fc78cff9640 1 --2- 10.20.193.58:0/905246185 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc790161d50 0x7fc79014b670 unknown :-1 s=CLOSED pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.437+0000 7fc78f7fe640 1 --2- 10.20.193.58:0/905246185 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc76007a660 0x7fc76009ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:37.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.438+0000 7fc78f7fe640 1 --2- 10.20.193.58:0/905246185 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc76007a660 0x7fc76009ab10 secure :-1 s=READY pgs=288 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7900aeab0 tx=0x7fc780009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:37.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.441+0000 7fc79645b640 1 --2- 10.20.193.58:0/905246185 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc79014bbb0 0x7fc79014bfb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:37.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.441+0000 7fc79645b640 1 -- 10.20.193.58:0/905246185 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc79014c4f0 con 0x7fc79014bbb0 2026-02-23T06:32:37.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.441+0000 7fc78ffff640 1 --2- 10.20.193.58:0/905246185 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc79014bbb0 0x7fc79014bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:37.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.441+0000 7fc78ffff640 1 -- 10.20.193.58:0/905246185 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc7900b5610 con 0x7fc79014bbb0 2026-02-23T06:32:37.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.442+0000 7fc78ffff640 1 --2- 10.20.193.58:0/905246185 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc79014bbb0 0x7fc79014bfb0 secure :-1 s=READY pgs=191 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc77c0097e0 tx=0x7fc77c005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:37.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.442+0000 7fc78cff9640 1 -- 10.20.193.58:0/905246185 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc77c047070 con 0x7fc79014bbb0 2026-02-23T06:32:37.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.442+0000 7fc78cff9640 1 -- 10.20.193.58:0/905246185 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5556 (secure 0 0 0) 0x7fc77c050070 con 0x7fc79014bbb0 2026-02-23T06:32:37.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.442+0000 7fc78cff9640 1 -- 10.20.193.58:0/905246185 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc79014bbb0 msgr2=0x7fc79014bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:37.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.442+0000 7fc78cff9640 1 --2- 10.20.193.58:0/905246185 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc79014bbb0 0x7fc79014bfb0 secure :-1 s=READY pgs=191 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc77c0097e0 tx=0x7fc77c005f90 comp rx=0 tx=0).stop 2026-02-23T06:32:37.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.442+0000 7fc78cff9640 1 -- 10.20.193.58:0/905246185 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc79014bbb0 msgr2=0x7fc79014bfb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:32:37.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.442+0000 7fc78cff9640 1 --2- 10.20.193.58:0/905246185 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc79014bbb0 0x7fc79014bfb0 unknown :-1 s=CLOSED pgs=191 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.438 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:32:37.438 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:32:37.438 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:32:37.438 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:32:37.438 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 92, 2026-02-23T06:32:37.438 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 431955, 2026-02-23T06:32:37.438 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:32:37.438 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:32:37.438 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:32:37.438 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:32:37.438 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:37.438 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:32:37.438 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:32:37.438 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:32:37.439 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:32:37.439 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:32:37.439 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:32:37.439 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:32:37.439 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:32:37.439 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:32:37.439 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:32:37.439 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:32:37.439 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:32:37.439 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:32:37.439 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:32:37.439 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:32:37.439 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:32:37.439 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:32:37.439 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:37.439 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:32:37.439 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:32:37.439 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:32:37.439 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:32:37.440 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:32:37.440 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:32:37.440 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:32:37.440 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:32:37.440 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:32:37.440 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:32:37.440 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:32:37.440 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:32:37.440 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:32:37.440 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:32:37.440 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:32:37.440 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:37.440 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.440 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:32:37.440 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:32:37.440 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:32:37.440 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:32:37.440 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:32:37.440 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:32:37.440 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:32:37.441 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:32:37.441 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:32:37.441 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:32:37.441 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:32:37.441 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:32:37.441 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:32:37.441 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:32:37.441 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:32:37.441 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:32:37.441 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:32:37.441 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:32:37.441 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:32:37.441 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:32:37.441 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:32:37.441 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:32:37.441 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:32:37.441 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:32:37.441 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:32:37.441 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:32:37.441 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:32:37.442 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:32:37.442 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:32:37.442 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:32:37.442 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:37.442 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:32:37.442 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.442 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:32:37.442 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.442 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:32:37.442 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:32:37.442 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:32:37.442 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:32:37.442 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.442 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:32:37.442 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:32:37.442 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:37.442 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.442 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.442 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:32:37.442 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:32:37.443 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:37.443 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:37.443 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:37.443 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.443 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:32:37.443 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:32:37.443 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:32:37.443 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:32:37.443 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:32:37.443 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:32:37.443 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.443 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.443 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:32:37.443 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:32:37.443 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:32:37.443 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:32:37.443 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.443 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:32:37.443 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:32:37.443 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:37.444 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.444 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.444 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:32:37.444 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:32:37.444 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:37.444 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:37.444 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:37.444 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.444 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:32:37.444 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:32:37.444 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:32:37.444 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:32:37.444 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:32:37.444 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:32:37.444 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.444 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.444 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:32:37.444 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:32:37.444 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:32:37.444 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:32:37.444 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.445 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:32:37.445 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:32:37.445 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:37.445 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.445 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.445 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:32:37.445 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:32:37.445 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:37.445 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:37.445 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:37.445 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.445 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:32:37.445 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:32:37.445 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:32:37.445 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:32:37.445 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:32:37.445 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:32:37.445 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:37.445 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:37.445 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.446 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:32:37.446 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:32:37.446 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.446 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:32:37.446 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:32:37.446 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:32:37.446 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:37.446 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:37.446 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:32:37.446 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.446 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:32:37.446 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:32:37.446 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:32:37.446 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:37.446 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:37.446 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:32:37.446 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.446 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:32:37.446 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:32:37.446 INFO:teuthology.orchestra.run.trial058.stdout: "num": 8 2026-02-23T06:32:37.446 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:37.447 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:37.447 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:32:37.447 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.447 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:32:37.447 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:32:37.447 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:32:37.447 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.447 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.447 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:32:37.447 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:32:37.447 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:32:37.447 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:37.447 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:37.447 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:32:37.447 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:37.447 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:32:37.447 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:32:37.447 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:32:37.447 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:37.447 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:37.448 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:37.448 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:32:37.448 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:32:37.449 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.442+0000 7fc79645b640 1 -- 10.20.193.58:0/905246185 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc76007a660 msgr2=0x7fc76009ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:37.449 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.442+0000 7fc79645b640 1 --2- 10.20.193.58:0/905246185 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc76007a660 0x7fc76009ab10 secure :-1 s=READY pgs=288 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7900aeab0 tx=0x7fc780009040 comp rx=0 tx=0).stop 2026-02-23T06:32:37.449 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.442+0000 7fc79645b640 1 -- 10.20.193.58:0/905246185 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc79015be70 msgr2=0x7fc790161810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:37.449 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.442+0000 7fc79645b640 1 --2- 10.20.193.58:0/905246185 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc79015be70 0x7fc790161810 secure :-1 s=READY pgs=24 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc78400d700 tx=0x7fc78400dbd0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.449 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.442+0000 7fc7949d1640 1 -- 10.20.193.58:0/905246185 reap_dead start 2026-02-23T06:32:37.449 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.442+0000 7fc7949d1640 1 -- 10.20.193.58:0/905246185 reap_dead start 2026-02-23T06:32:37.449 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.443+0000 7fc79645b640 1 -- 10.20.193.58:0/905246185 shutdown_connections 2026-02-23T06:32:37.449 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.443+0000 7fc79645b640 1 -- 10.20.193.58:0/905246185 >> 10.20.193.58:0/905246185 conn(0x7fc790058e50 msgr2=0x7fc790163090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:37.449 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.443+0000 7fc79645b640 1 -- 10.20.193.58:0/905246185 shutdown_connections 2026-02-23T06:32:37.449 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.443+0000 7fc79645b640 1 -- 10.20.193.58:0/905246185 wait complete. 2026-02-23T06:32:37.450 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:32:37.450 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-23T06:32:37.450 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-23T06:32:37.450 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-23T06:32:37.450 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-23T06:32:37.450 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-23T06:32:37.450 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:32:37.467 INFO:tasks.ceph.mon.a:Stopped 2026-02-23T06:32:37.468 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:32:37.468 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:32:37.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.633+0000 7f582e043640 1 -- 10.20.193.58:0/1082455276 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f582815d870 msgr2=0x7f58280587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:37.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.633+0000 7f582e043640 1 --2- 10.20.193.58:0/1082455276 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f582815d870 0x7f58280587b0 secure :-1 s=READY pgs=192 gs=3 cs=0 l=1 c_cookie=17064037086595379391 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f581c005e70 tx=0x7f581c02f2b0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.634+0000 7f582e043640 1 -- 10.20.193.58:0/1082455276 shutdown_connections 2026-02-23T06:32:37.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.634+0000 7f582e043640 1 --2- 10.20.193.58:0/1082455276 >> v2:10.20.193.58:3300/0 conn(0x7f58280b6690 0x7f5828058cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.634+0000 7f582e043640 1 --2- 10.20.193.58:0/1082455276 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f582815d870 0x7f58280587b0 unknown :-1 s=CLOSED pgs=192 gs=3 cs=0 l=1 c_cookie=17064037086595379391 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.634+0000 7f582e043640 1 -- 10.20.193.58:0/1082455276 >> 10.20.193.58:0/1082455276 conn(0x7f58280b3c20 msgr2=0x7f58280b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:37.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.634+0000 7f582e043640 1 -- 10.20.193.58:0/1082455276 shutdown_connections 2026-02-23T06:32:37.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.634+0000 7f582e043640 1 -- 10.20.193.58:0/1082455276 wait complete. 2026-02-23T06:32:37.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.635+0000 7f582e043640 1 Processor -- start 2026-02-23T06:32:37.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.635+0000 7f582e043640 1 -- start start 2026-02-23T06:32:37.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.636+0000 7f582e043640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f58280b6690 0x7f582814cac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:37.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.636+0000 7f582e043640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f582815d4a0 0x7f58280561f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:37.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.636+0000 7f582e043640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f582815d870 0x7f582813e690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:37.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.636+0000 7f582e043640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f5828057c10 con 0x7f58280b6690 2026-02-23T06:32:37.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.636+0000 7f582e043640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f5828057650 con 0x7f582815d870 2026-02-23T06:32:37.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.636+0000 7f582e043640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f5828057930 con 0x7f582815d4a0 2026-02-23T06:32:37.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.636+0000 7f582d041640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f58280b6690 msgr2=0x7f582814cac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:32:37.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.636+0000 7f582d041640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f58280b6690 0x7f582814cac0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:32:37.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.636+0000 7f582d842640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f582815d870 0x7f582813e690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:37.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.636+0000 7f582c840640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f582815d4a0 0x7f58280561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:37.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.636+0000 7f582d842640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f582815d870 0x7f582813e690 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:39454/0 (socket says 10.20.193.58:39454) 2026-02-23T06:32:37.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.636+0000 7f582d842640 1 -- 10.20.193.58:0/1198308418 learned_addr learned my addr 10.20.193.58:0/1198308418 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:32:37.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.636+0000 7f582d842640 1 -- 10.20.193.58:0/1198308418 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f582815d4a0 msgr2=0x7f58280561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:37.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.636+0000 7f582d842640 1 --2- 10.20.193.58:0/1198308418 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f582815d4a0 0x7f58280561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.636+0000 7f582d842640 1 -- 10.20.193.58:0/1198308418 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f58280b6690 msgr2=0x7f582814cac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:32:37.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.636+0000 7f582d842640 1 --2- 10.20.193.58:0/1198308418 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f58280b6690 0x7f582814cac0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.636+0000 7f582d842640 1 -- 10.20.193.58:0/1198308418 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f581c009570 con 0x7f582815d870 2026-02-23T06:32:37.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.636+0000 7f582d842640 1 --2- 10.20.193.58:0/1198308418 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f582815d870 0x7f582813e690 secure :-1 s=READY pgs=49 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f582400c520 tx=0x7f582400c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:37.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.637+0000 7f5815ffb640 1 -- 10.20.193.58:0/1198308418 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5824003db0 con 0x7f582815d870 2026-02-23T06:32:37.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.637+0000 7f5815ffb640 1 -- 10.20.193.58:0/1198308418 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5824005070 con 0x7f582815d870 2026-02-23T06:32:37.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.637+0000 7f582e043640 1 -- 10.20.193.58:0/1198308418 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f582814bfe0 con 0x7f582815d870 2026-02-23T06:32:37.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.637+0000 7f5815ffb640 1 -- 10.20.193.58:0/1198308418 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f58240054a0 con 0x7f582815d870 2026-02-23T06:32:37.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.637+0000 7f582e043640 1 -- 10.20.193.58:0/1198308418 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f582814c5a0 con 0x7f582815d870 2026-02-23T06:32:37.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.637+0000 7f582e043640 1 -- 10.20.193.58:0/1198308418 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58280b6d50 con 0x7f582815d870 2026-02-23T06:32:37.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.639+0000 7f5815ffb640 1 -- 10.20.193.58:0/1198308418 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f582400e040 con 0x7f582815d870 2026-02-23T06:32:37.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.640+0000 7f5815ffb640 1 --2- 10.20.193.58:0/1198308418 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f57f807a5b0 0x7f57f809aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:37.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.640+0000 7f5815ffb640 1 -- 10.20.193.58:0/1198308418 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f582409ea40 con 0x7f582815d870 2026-02-23T06:32:37.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.640+0000 7f582d041640 1 --2- 10.20.193.58:0/1198308418 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f57f807a5b0 0x7f57f809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:37.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.640+0000 7f5815ffb640 1 -- 10.20.193.58:0/1198308418 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f5824061c00 con 0x7f582815d870 2026-02-23T06:32:37.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.640+0000 7f582d041640 1 --2- 10.20.193.58:0/1198308418 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f57f807a5b0 0x7f57f809aa60 secure :-1 s=READY pgs=289 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5818002390 tx=0x7f5818007a70 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:37.791 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.795+0000 7f582e043640 1 -- 10.20.193.58:0/1198308418 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f582814c790 con 0x7f582815d870 2026-02-23T06:32:37.791 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.796+0000 7f5815ffb640 1 -- 10.20.193.58:0/1198308418 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f5824014080 con 0x7f582815d870 2026-02-23T06:32:37.791 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":92,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:32:37.792 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.797+0000 7f582e043640 1 -- 10.20.193.58:0/1198308418 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f57f807a5b0 msgr2=0x7f57f809aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:37.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.797+0000 7f582e043640 1 --2- 10.20.193.58:0/1198308418 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f57f807a5b0 0x7f57f809aa60 secure :-1 s=READY pgs=289 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5818002390 tx=0x7f5818007a70 comp rx=0 tx=0).stop 2026-02-23T06:32:37.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.797+0000 7f582e043640 1 -- 10.20.193.58:0/1198308418 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f582815d870 msgr2=0x7f582813e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:37.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.797+0000 7f582e043640 1 --2- 10.20.193.58:0/1198308418 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f582815d870 0x7f582813e690 secure :-1 s=READY pgs=49 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f582400c520 tx=0x7f582400c9f0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.797+0000 7f582e043640 1 -- 10.20.193.58:0/1198308418 shutdown_connections 2026-02-23T06:32:37.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.797+0000 7f582e043640 1 --2- 10.20.193.58:0/1198308418 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f57f807a5b0 0x7f57f809aa60 unknown :-1 s=CLOSED pgs=289 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.797+0000 7f582e043640 1 --2- 10.20.193.58:0/1198308418 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f582815d870 0x7f582813e690 unknown :-1 s=CLOSED pgs=49 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.797+0000 7f582e043640 1 --2- 10.20.193.58:0/1198308418 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f582815d4a0 0x7f58280561f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.797+0000 7f582e043640 1 --2- 10.20.193.58:0/1198308418 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f58280b6690 0x7f582814cac0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:37.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.797+0000 7f582e043640 1 -- 10.20.193.58:0/1198308418 >> 10.20.193.58:0/1198308418 conn(0x7f58280b3c20 msgr2=0x7f582815ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:37.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.797+0000 7f582e043640 1 -- 10.20.193.58:0/1198308418 shutdown_connections 2026-02-23T06:32:37.794 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:37.797+0000 7f582e043640 1 -- 10.20.193.58:0/1198308418 wait complete. 2026-02-23T06:32:40.804 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:32:40.925 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.930+0000 7fddc4dd2640 1 -- 10.20.193.58:0/1383958271 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fddc015d4a0 msgr2=0x7fddc00affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:40.925 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.930+0000 7fddc4dd2640 1 --2- 10.20.193.58:0/1383958271 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fddc015d4a0 0x7fddc00affb0 secure :-1 s=READY pgs=198 gs=4 cs=0 l=1 c_cookie=4375035840803273858 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddac005e70 tx=0x7fddac02f290 comp rx=0 tx=0).stop 2026-02-23T06:32:40.925 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.930+0000 7fddc4dd2640 1 -- 10.20.193.58:0/1383958271 shutdown_connections 2026-02-23T06:32:40.925 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.930+0000 7fddc4dd2640 1 --2- 10.20.193.58:0/1383958271 >> v2:10.20.193.93:3300/0 conn(0x7fddc015d870 0x7fddc00587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:40.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.930+0000 7fddc4dd2640 1 --2- 10.20.193.58:0/1383958271 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fddc015d4a0 0x7fddc00affb0 unknown :-1 s=CLOSED pgs=198 gs=4 cs=0 l=1 c_cookie=4375035840803273858 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:40.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.930+0000 7fddc4dd2640 1 -- 10.20.193.58:0/1383958271 >> 10.20.193.58:0/1383958271 conn(0x7fddc00b3c20 msgr2=0x7fddc00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:40.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.930+0000 7fddc4dd2640 1 -- 10.20.193.58:0/1383958271 shutdown_connections 2026-02-23T06:32:40.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.930+0000 7fddc4dd2640 1 -- 10.20.193.58:0/1383958271 wait complete. 2026-02-23T06:32:40.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.932+0000 7fddc4dd2640 1 Processor -- start 2026-02-23T06:32:40.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.932+0000 7fddc4dd2640 1 -- start start 2026-02-23T06:32:40.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.932+0000 7fddc4dd2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fddc00b6690 0x7fddc01284b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:40.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.932+0000 7fddc4dd2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fddc015d4a0 0x7fddc00b0390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:40.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.932+0000 7fddc4dd2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fddc015d870 0x7fddc0123b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:40.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.932+0000 7fddc4dd2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fddc0140770 con 0x7fddc015d870 2026-02-23T06:32:40.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.932+0000 7fddc4dd2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fddc0140af0 con 0x7fddc015d4a0 2026-02-23T06:32:40.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.932+0000 7fddc4dd2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fddc013cbb0 con 0x7fddc00b6690 2026-02-23T06:32:40.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.932+0000 7fddbffff640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fddc015d870 msgr2=0x7fddc0123b00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:32:40.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.932+0000 7fddbffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fddc015d870 0x7fddc0123b00 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:32:40.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.932+0000 7fddbf7fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fddc00b6690 0x7fddc01284b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:40.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.932+0000 7fddbf7fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fddc00b6690 0x7fddc01284b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:55034/0 (socket says 10.20.193.58:55034) 2026-02-23T06:32:40.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.933+0000 7fddbf7fe640 1 -- 10.20.193.58:0/4126755051 learned_addr learned my addr 10.20.193.58:0/4126755051 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:32:40.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.932+0000 7fddbeffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fddc015d4a0 0x7fddc00b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:40.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.933+0000 7fddbf7fe640 1 -- 10.20.193.58:0/4126755051 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fddc015d4a0 msgr2=0x7fddc00b0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:40.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.933+0000 7fddbf7fe640 1 --2- 10.20.193.58:0/4126755051 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fddc015d4a0 0x7fddc00b0390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:40.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.933+0000 7fddbf7fe640 1 -- 10.20.193.58:0/4126755051 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fddc015d870 msgr2=0x7fddc0123b00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:32:40.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.933+0000 7fddbf7fe640 1 --2- 10.20.193.58:0/4126755051 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fddc015d870 0x7fddc0123b00 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:40.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.933+0000 7fddbf7fe640 1 -- 10.20.193.58:0/4126755051 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddac009570 con 0x7fddc00b6690 2026-02-23T06:32:40.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.933+0000 7fddbeffd640 1 --2- 10.20.193.58:0/4126755051 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fddc015d4a0 0x7fddc00b0390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:32:40.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.933+0000 7fddbf7fe640 1 --2- 10.20.193.58:0/4126755051 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fddc00b6690 0x7fddc01284b0 secure :-1 s=READY pgs=199 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddac004740 tx=0x7fddac0028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:40.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.933+0000 7fdd9bfff640 1 -- 10.20.193.58:0/4126755051 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fddac03d070 con 0x7fddc00b6690 2026-02-23T06:32:40.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.933+0000 7fdd9bfff640 1 -- 10.20.193.58:0/4126755051 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fddac038470 con 0x7fddc00b6690 2026-02-23T06:32:40.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.933+0000 7fdd9bfff640 1 -- 10.20.193.58:0/4126755051 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fddac0388a0 con 0x7fddc00b6690 2026-02-23T06:32:40.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.933+0000 7fddc4dd2640 1 -- 10.20.193.58:0/4126755051 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddc0140d60 con 0x7fddc00b6690 2026-02-23T06:32:40.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.933+0000 7fddc4dd2640 1 -- 10.20.193.58:0/4126755051 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fddc0127cb0 con 0x7fddc00b6690 2026-02-23T06:32:40.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.934+0000 7fdd99ffb640 1 -- 10.20.193.58:0/4126755051 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd84005300 con 0x7fddc00b6690 2026-02-23T06:32:40.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.935+0000 7fdd9bfff640 1 -- 10.20.193.58:0/4126755051 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fddac066b20 con 0x7fddc00b6690 2026-02-23T06:32:40.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.936+0000 7fdd9bfff640 1 --2- 10.20.193.58:0/4126755051 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdd9007a5b0 0x7fdd9009aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:40.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.936+0000 7fdd9bfff640 1 -- 10.20.193.58:0/4126755051 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fddac0c2430 con 0x7fddc00b6690 2026-02-23T06:32:40.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.937+0000 7fddbeffd640 1 --2- 10.20.193.58:0/4126755051 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdd9007a5b0 0x7fdd9009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:40.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.937+0000 7fdd9bfff640 1 -- 10.20.193.58:0/4126755051 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fddac0856b0 con 0x7fddc00b6690 2026-02-23T06:32:40.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:40.937+0000 7fddbeffd640 1 --2- 10.20.193.58:0/4126755051 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdd9007a5b0 0x7fdd9009aa60 secure :-1 s=READY pgs=290 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddc0127960 tx=0x7fddb0005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:41.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:41.091+0000 7fdd99ffb640 1 -- 10.20.193.58:0/4126755051 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fdd84005950 con 0x7fddc00b6690 2026-02-23T06:32:41.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:41.091+0000 7fdd9bfff640 1 -- 10.20.193.58:0/4126755051 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7fddac0887d0 con 0x7fddc00b6690 2026-02-23T06:32:41.087 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":92,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:32:41.088 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:41.092+0000 7fdd99ffb640 1 -- 10.20.193.58:0/4126755051 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdd9007a5b0 msgr2=0x7fdd9009aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:41.088 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:41.092+0000 7fdd99ffb640 1 --2- 10.20.193.58:0/4126755051 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdd9007a5b0 0x7fdd9009aa60 secure :-1 s=READY pgs=290 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddc0127960 tx=0x7fddb0005f90 comp rx=0 tx=0).stop 2026-02-23T06:32:41.088 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:41.092+0000 7fdd99ffb640 1 -- 10.20.193.58:0/4126755051 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fddc00b6690 msgr2=0x7fddc01284b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:41.088 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:41.092+0000 7fdd99ffb640 1 --2- 10.20.193.58:0/4126755051 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fddc00b6690 0x7fddc01284b0 secure :-1 s=READY pgs=199 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddac004740 tx=0x7fddac0028d0 comp rx=0 tx=0).stop 2026-02-23T06:32:41.088 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:41.092+0000 7fdd99ffb640 1 -- 10.20.193.58:0/4126755051 shutdown_connections 2026-02-23T06:32:41.088 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:41.092+0000 7fdd99ffb640 1 --2- 10.20.193.58:0/4126755051 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdd9007a5b0 0x7fdd9009aa60 unknown :-1 s=CLOSED pgs=290 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:41.089 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:41.092+0000 7fdd99ffb640 1 --2- 10.20.193.58:0/4126755051 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fddc015d870 0x7fddc0123b00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:41.089 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:41.092+0000 7fdd99ffb640 1 --2- 10.20.193.58:0/4126755051 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fddc015d4a0 0x7fddc00b0390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:41.089 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:41.092+0000 7fdd99ffb640 1 --2- 10.20.193.58:0/4126755051 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fddc00b6690 0x7fddc01284b0 unknown :-1 s=CLOSED pgs=199 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:41.089 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:41.092+0000 7fdd99ffb640 1 -- 10.20.193.58:0/4126755051 >> 10.20.193.58:0/4126755051 conn(0x7fddc00b3c20 msgr2=0x7fddc0142870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:41.089 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:41.092+0000 7fdd99ffb640 1 -- 10.20.193.58:0/4126755051 shutdown_connections 2026-02-23T06:32:41.089 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:41.092+0000 7fdd99ffb640 1 -- 10.20.193.58:0/4126755051 wait complete. 2026-02-23T06:32:43.192 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:32:43.196 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:32:44.099 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:32:44.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.227+0000 7fc23c8cb640 1 -- 10.20.193.58:0/3746063216 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc23815c040 msgr2=0x7fc23805b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:44.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.227+0000 7fc23c8cb640 1 --2- 10.20.193.58:0/3746063216 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc23815c040 0x7fc23805b0e0 secure :-1 s=READY pgs=57 gs=4 cs=0 l=1 c_cookie=12481369835913509082 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc22c004740 tx=0x7fc22c02f1d0 comp rx=0 tx=0).stop 2026-02-23T06:32:44.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.227+0000 7fc23c8cb640 1 -- 10.20.193.58:0/3746063216 shutdown_connections 2026-02-23T06:32:44.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.227+0000 7fc23c8cb640 1 --2- 10.20.193.58:0/3746063216 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc23815c040 0x7fc23805b0e0 unknown :-1 s=CLOSED pgs=57 gs=4 cs=0 l=1 c_cookie=12481369835913509082 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:44.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.227+0000 7fc23c8cb640 1 -- 10.20.193.58:0/3746063216 >> 10.20.193.58:0/3746063216 conn(0x7fc2380b3c20 msgr2=0x7fc2380b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:44.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.227+0000 7fc23c8cb640 1 -- 10.20.193.58:0/3746063216 shutdown_connections 2026-02-23T06:32:44.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.227+0000 7fc23c8cb640 1 -- 10.20.193.58:0/3746063216 wait complete. 2026-02-23T06:32:44.223 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.228+0000 7fc23c8cb640 1 Processor -- start 2026-02-23T06:32:44.223 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.228+0000 7fc23c8cb640 1 -- start start 2026-02-23T06:32:44.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.229+0000 7fc23c8cb640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc238056550 0x7fc23815c590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:44.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.229+0000 7fc23c8cb640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc2380b5680 0x7fc2381559a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:44.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.229+0000 7fc236575640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc2380b5680 msgr2=0x7fc2381559a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:32:44.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.229+0000 7fc236575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc2380b5680 0x7fc2381559a0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:32:44.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.229+0000 7fc23c8cb640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc23815c040 0x7fc238058330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:44.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.229+0000 7fc23c8cb640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc2380b0580 con 0x7fc2380b5680 2026-02-23T06:32:44.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.229+0000 7fc23c8cb640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc238162c40 con 0x7fc238056550 2026-02-23T06:32:44.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.229+0000 7fc23c8cb640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc2380b0050 con 0x7fc23815c040 2026-02-23T06:32:44.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.229+0000 7fc236d76640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc238056550 0x7fc23815c590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:44.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.229+0000 7fc236d76640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc238056550 0x7fc23815c590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:46224/0 (socket says 10.20.193.58:46224) 2026-02-23T06:32:44.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.229+0000 7fc236d76640 1 -- 10.20.193.58:0/4245540410 learned_addr learned my addr 10.20.193.58:0/4245540410 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:32:44.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.229+0000 7fc237577640 1 --2- 10.20.193.58:0/4245540410 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc23815c040 0x7fc238058330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:44.225 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.229+0000 7fc236d76640 1 -- 10.20.193.58:0/4245540410 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc23815c040 msgr2=0x7fc238058330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:44.225 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.229+0000 7fc236d76640 1 --2- 10.20.193.58:0/4245540410 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc23815c040 0x7fc238058330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:44.225 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.229+0000 7fc236d76640 1 -- 10.20.193.58:0/4245540410 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc2380b5680 msgr2=0x7fc2381559a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:32:44.225 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.229+0000 7fc236d76640 1 --2- 10.20.193.58:0/4245540410 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc2380b5680 0x7fc2381559a0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:44.225 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.229+0000 7fc236d76640 1 -- 10.20.193.58:0/4245540410 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22c0094b0 con 0x7fc238056550 2026-02-23T06:32:44.225 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.230+0000 7fc236d76640 1 --2- 10.20.193.58:0/4245540410 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc238056550 0x7fc23815c590 secure :-1 s=READY pgs=58 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc22c009960 tx=0x7fc22c002cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:44.225 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.230+0000 7fc2177fe640 1 -- 10.20.193.58:0/4245540410 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc22c0388a0 con 0x7fc238056550 2026-02-23T06:32:44.225 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.230+0000 7fc2177fe640 1 -- 10.20.193.58:0/4245540410 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc22c038af0 con 0x7fc238056550 2026-02-23T06:32:44.225 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.230+0000 7fc2177fe640 1 -- 10.20.193.58:0/4245540410 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc22c02fc40 con 0x7fc238056550 2026-02-23T06:32:44.225 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.230+0000 7fc23c8cb640 1 -- 10.20.193.58:0/4245540410 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2380b1b60 con 0x7fc238056550 2026-02-23T06:32:44.226 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.230+0000 7fc23c8cb640 1 -- 10.20.193.58:0/4245540410 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc238162440 con 0x7fc238056550 2026-02-23T06:32:44.226 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.231+0000 7fc23c8cb640 1 -- 10.20.193.58:0/4245540410 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc23805b0e0 con 0x7fc238056550 2026-02-23T06:32:44.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.232+0000 7fc2177fe640 1 -- 10.20.193.58:0/4245540410 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fc22c040420 con 0x7fc238056550 2026-02-23T06:32:44.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.233+0000 7fc2177fe640 1 --2- 10.20.193.58:0/4245540410 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc20407a5b0 0x7fc20409aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:44.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.233+0000 7fc2177fe640 1 -- 10.20.193.58:0/4245540410 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fc22c0c3340 con 0x7fc238056550 2026-02-23T06:32:44.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.233+0000 7fc236575640 1 --2- 10.20.193.58:0/4245540410 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc20407a5b0 0x7fc20409aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:44.229 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.233+0000 7fc2177fe640 1 -- 10.20.193.58:0/4245540410 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fc22c086680 con 0x7fc238056550 2026-02-23T06:32:44.229 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.234+0000 7fc236575640 1 --2- 10.20.193.58:0/4245540410 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc20407a5b0 0x7fc20409aa60 secure :-1 s=READY pgs=291 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc238163dc0 tx=0x7fc220007b70 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:44.384 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.389+0000 7fc23c8cb640 1 -- 10.20.193.58:0/4245540410 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc23805d990 con 0x7fc238056550 2026-02-23T06:32:44.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.389+0000 7fc2177fe640 1 -- 10.20.193.58:0/4245540410 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7fc22c0897a0 con 0x7fc238056550 2026-02-23T06:32:44.385 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":92,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:32:44.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.390+0000 7fc23c8cb640 1 -- 10.20.193.58:0/4245540410 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc20407a5b0 msgr2=0x7fc20409aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:44.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.390+0000 7fc23c8cb640 1 --2- 10.20.193.58:0/4245540410 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc20407a5b0 0x7fc20409aa60 secure :-1 s=READY pgs=291 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc238163dc0 tx=0x7fc220007b70 comp rx=0 tx=0).stop 2026-02-23T06:32:44.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.390+0000 7fc23c8cb640 1 -- 10.20.193.58:0/4245540410 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc238056550 msgr2=0x7fc23815c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:44.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.390+0000 7fc23c8cb640 1 --2- 10.20.193.58:0/4245540410 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc238056550 0x7fc23815c590 secure :-1 s=READY pgs=58 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc22c009960 tx=0x7fc22c002cc0 comp rx=0 tx=0).stop 2026-02-23T06:32:44.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.390+0000 7fc23c8cb640 1 -- 10.20.193.58:0/4245540410 shutdown_connections 2026-02-23T06:32:44.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.390+0000 7fc23c8cb640 1 --2- 10.20.193.58:0/4245540410 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc20407a5b0 0x7fc20409aa60 unknown :-1 s=CLOSED pgs=291 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:44.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.390+0000 7fc23c8cb640 1 --2- 10.20.193.58:0/4245540410 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc23815c040 0x7fc238058330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:44.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.390+0000 7fc23c8cb640 1 --2- 10.20.193.58:0/4245540410 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc2380b5680 0x7fc2381559a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:44.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.390+0000 7fc23c8cb640 1 --2- 10.20.193.58:0/4245540410 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc238056550 0x7fc23815c590 unknown :-1 s=CLOSED pgs=58 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:44.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.390+0000 7fc23c8cb640 1 -- 10.20.193.58:0/4245540410 >> 10.20.193.58:0/4245540410 conn(0x7fc2380b3c20 msgr2=0x7fc2380b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:44.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.390+0000 7fc23c8cb640 1 -- 10.20.193.58:0/4245540410 shutdown_connections 2026-02-23T06:32:44.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:44.390+0000 7fc23c8cb640 1 -- 10.20.193.58:0/4245540410 wait complete. 2026-02-23T06:32:47.399 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:32:51.893 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.897+0000 7fb0f7083640 1 -- 10.20.193.58:0/3364578193 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb0d8005400 msgr2=0x7fb0d8065a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:51.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.897+0000 7fb0f7083640 1 --2- 10.20.193.58:0/3364578193 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb0d8005400 0x7fb0d8065a10 secure :-1 s=READY pgs=202 gs=28 cs=0 l=1 c_cookie=14953537275991147741 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0f005e340 tx=0x7fb0ec031000 comp rx=0 tx=0).stop 2026-02-23T06:32:51.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.898+0000 7fb0f7083640 1 -- 10.20.193.58:0/3364578193 shutdown_connections 2026-02-23T06:32:51.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.898+0000 7fb0f7083640 1 --2- 10.20.193.58:0/3364578193 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb0d8005400 0x7fb0d8065a10 unknown :-1 s=CLOSED pgs=202 gs=28 cs=0 l=1 c_cookie=14953537275991147741 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:51.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.898+0000 7fb0f7083640 1 --2- 10.20.193.58:0/3364578193 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb0d8004850 0x7fb0d8004cc0 unknown :-1 s=CLOSED pgs=0 gs=27 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:51.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.898+0000 7fb0f7083640 1 --2- 10.20.193.58:0/3364578193 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb0d8003a30 0x7fb0d8003e20 unknown :-1 s=CLOSED pgs=0 gs=26 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:51.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.898+0000 7fb0f7083640 1 -- 10.20.193.58:0/3364578193 >> 10.20.193.58:0/3364578193 conn(0x7fb0f00b3c20 msgr2=0x7fb0f00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:51.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.898+0000 7fb0f7083640 1 -- 10.20.193.58:0/3364578193 shutdown_connections 2026-02-23T06:32:51.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.898+0000 7fb0f7083640 1 -- 10.20.193.58:0/3364578193 wait complete. 2026-02-23T06:32:51.897 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.899+0000 7fb0f7083640 1 Processor -- start 2026-02-23T06:32:51.897 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.899+0000 7fb0f7083640 1 -- start start 2026-02-23T06:32:51.897 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.900+0000 7fb0f7083640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb0d8003a30 0x7fb0f0140fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:51.897 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.900+0000 7fb0f7083640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb0d8004850 0x7fb0f015f3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:51.897 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.900+0000 7fb0f7083640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb0d8005400 0x7fb0f01fea30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:51.897 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.900+0000 7fb0f7083640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f0142410 con 0x7fb0d8003a30 2026-02-23T06:32:51.897 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.900+0000 7fb0f7083640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f0140530 con 0x7fb0d8005400 2026-02-23T06:32:51.897 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.900+0000 7fb0f7083640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb0f0142df0 con 0x7fb0d8004850 2026-02-23T06:32:51.897 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.900+0000 7fb0f6081640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb0d8003a30 msgr2=0x7fb0f0140fc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:32:51.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.900+0000 7fb0f6081640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb0d8003a30 0x7fb0f0140fc0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:32:51.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.900+0000 7fb0f5880640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb0d8004850 0x7fb0f015f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:51.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.900+0000 7fb0f6882640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb0d8005400 0x7fb0f01fea30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:51.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.900+0000 7fb0f5880640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb0d8004850 0x7fb0f015f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:53930/0 (socket says 10.20.193.58:53930) 2026-02-23T06:32:51.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.900+0000 7fb0f5880640 1 -- 10.20.193.58:0/607545545 learned_addr learned my addr 10.20.193.58:0/607545545 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:32:51.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.900+0000 7fb0f6882640 1 -- 10.20.193.58:0/607545545 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb0d8004850 msgr2=0x7fb0f015f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:51.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.900+0000 7fb0f6882640 1 --2- 10.20.193.58:0/607545545 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb0d8004850 0x7fb0f015f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:51.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.900+0000 7fb0f6882640 1 -- 10.20.193.58:0/607545545 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb0d8003a30 msgr2=0x7fb0f0140fc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:32:51.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.900+0000 7fb0f6882640 1 --2- 10.20.193.58:0/607545545 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb0d8003a30 0x7fb0f0140fc0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:51.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.900+0000 7fb0f6882640 1 -- 10.20.193.58:0/607545545 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0f0141f80 con 0x7fb0d8005400 2026-02-23T06:32:51.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.900+0000 7fb0f5880640 1 --2- 10.20.193.58:0/607545545 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb0d8004850 0x7fb0f015f3d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:32:51.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.901+0000 7fb0f6882640 1 --2- 10.20.193.58:0/607545545 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb0d8005400 0x7fb0f01fea30 secure :-1 s=READY pgs=61 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0d8066620 tx=0x7fb0ec006630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:51.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.901+0000 7fb0d6ffd640 1 -- 10.20.193.58:0/607545545 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb0ec03f690 con 0x7fb0d8005400 2026-02-23T06:32:51.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.901+0000 7fb0f7083640 1 -- 10.20.193.58:0/607545545 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0f01419a0 con 0x7fb0d8005400 2026-02-23T06:32:51.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.901+0000 7fb0d6ffd640 1 -- 10.20.193.58:0/607545545 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0ec005b40 con 0x7fb0d8005400 2026-02-23T06:32:51.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.901+0000 7fb0d6ffd640 1 -- 10.20.193.58:0/607545545 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb0ec03fb40 con 0x7fb0d8005400 2026-02-23T06:32:51.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.901+0000 7fb0f7083640 1 -- 10.20.193.58:0/607545545 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0f0141c10 con 0x7fb0d8005400 2026-02-23T06:32:51.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.902+0000 7fb0f7083640 1 -- 10.20.193.58:0/607545545 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0f015a720 con 0x7fb0d8005400 2026-02-23T06:32:51.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.903+0000 7fb0d6ffd640 1 -- 10.20.193.58:0/607545545 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fb0ec03fca0 con 0x7fb0d8005400 2026-02-23T06:32:51.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.904+0000 7fb0d6ffd640 1 --2- 10.20.193.58:0/607545545 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb0c007a5b0 0x7fb0c009aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:51.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.904+0000 7fb0d6ffd640 1 -- 10.20.193.58:0/607545545 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fb0ec0c2f00 con 0x7fb0d8005400 2026-02-23T06:32:51.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.904+0000 7fb0f6081640 1 --2- 10.20.193.58:0/607545545 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb0c007a5b0 0x7fb0c009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:51.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.904+0000 7fb0f6081640 1 --2- 10.20.193.58:0/607545545 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb0c007a5b0 0x7fb0c009aa60 secure :-1 s=READY pgs=292 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0e0005e40 tx=0x7fb0e0005900 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:51.901 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:51.905+0000 7fb0d6ffd640 1 -- 10.20.193.58:0/607545545 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fb0ec0860c0 con 0x7fb0d8005400 2026-02-23T06:32:52.054 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.059+0000 7fb0f7083640 1 -- 10.20.193.58:0/607545545 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb0f00ae720 con 0x7fb0d8005400 2026-02-23T06:32:52.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.059+0000 7fb0d6ffd640 1 -- 10.20.193.58:0/607545545 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1748 (secure 0 0 0) 0x7fb0ec03a6f0 con 0x7fb0d8005400 2026-02-23T06:32:52.055 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":94,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:32:52.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.060+0000 7fb0f7083640 1 -- 10.20.193.58:0/607545545 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb0c007a5b0 msgr2=0x7fb0c009aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:52.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.060+0000 7fb0f7083640 1 --2- 10.20.193.58:0/607545545 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb0c007a5b0 0x7fb0c009aa60 secure :-1 s=READY pgs=292 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0e0005e40 tx=0x7fb0e0005900 comp rx=0 tx=0).stop 2026-02-23T06:32:52.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.060+0000 7fb0f7083640 1 -- 10.20.193.58:0/607545545 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb0d8005400 msgr2=0x7fb0f01fea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:52.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.060+0000 7fb0f7083640 1 --2- 10.20.193.58:0/607545545 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb0d8005400 0x7fb0f01fea30 secure :-1 s=READY pgs=61 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0d8066620 tx=0x7fb0ec006630 comp rx=0 tx=0).stop 2026-02-23T06:32:52.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.060+0000 7fb0f7083640 1 -- 10.20.193.58:0/607545545 shutdown_connections 2026-02-23T06:32:52.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.060+0000 7fb0f7083640 1 --2- 10.20.193.58:0/607545545 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb0c007a5b0 0x7fb0c009aa60 unknown :-1 s=CLOSED pgs=292 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:52.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.060+0000 7fb0f7083640 1 --2- 10.20.193.58:0/607545545 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb0d8005400 0x7fb0f01fea30 unknown :-1 s=CLOSED pgs=61 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:52.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.060+0000 7fb0f7083640 1 --2- 10.20.193.58:0/607545545 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb0d8004850 0x7fb0f015f3d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:52.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.060+0000 7fb0f7083640 1 --2- 10.20.193.58:0/607545545 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb0d8003a30 0x7fb0f0140fc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:52.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.060+0000 7fb0f7083640 1 -- 10.20.193.58:0/607545545 >> 10.20.193.58:0/607545545 conn(0x7fb0f00b3c20 msgr2=0x7fb0f0159d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:52.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.060+0000 7fb0f7083640 1 -- 10.20.193.58:0/607545545 shutdown_connections 2026-02-23T06:32:52.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.060+0000 7fb0f7083640 1 -- 10.20.193.58:0/607545545 wait complete. 2026-02-23T06:32:52.068 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:32:52.068 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-23T06:32:52.068 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:32:52.193 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.198+0000 7fd624930640 1 -- 10.20.193.58:0/1287917862 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd6200b6b60 msgr2=0x7fd62005b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:52.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.198+0000 7fd624930640 1 --2- 10.20.193.58:0/1287917862 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd6200b6b60 0x7fd62005b4a0 secure :-1 s=READY pgs=63 gs=4 cs=0 l=1 c_cookie=12828492294492791050 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd610009890 tx=0x7fd61002f240 comp rx=0 tx=0).stop 2026-02-23T06:32:52.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.198+0000 7fd624930640 1 -- 10.20.193.58:0/1287917862 shutdown_connections 2026-02-23T06:32:52.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.198+0000 7fd624930640 1 --2- 10.20.193.58:0/1287917862 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd6200b6b60 0x7fd62005b4a0 unknown :-1 s=CLOSED pgs=63 gs=4 cs=0 l=1 c_cookie=12828492294492791050 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:52.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.198+0000 7fd624930640 1 -- 10.20.193.58:0/1287917862 >> 10.20.193.58:0/1287917862 conn(0x7fd620054390 msgr2=0x7fd620054760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:52.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.198+0000 7fd624930640 1 -- 10.20.193.58:0/1287917862 shutdown_connections 2026-02-23T06:32:52.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.198+0000 7fd624930640 1 -- 10.20.193.58:0/1287917862 wait complete. 2026-02-23T06:32:52.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.199+0000 7fd624930640 1 Processor -- start 2026-02-23T06:32:52.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.199+0000 7fd624930640 1 -- start start 2026-02-23T06:32:52.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.199+0000 7fd624930640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd6200b2030 0x7fd62014aa40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:52.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.199+0000 7fd624930640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd6200b6790 0x7fd62011e7b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:52.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.199+0000 7fd624930640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd6200b6b60 0x7fd62013d340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:52.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.200+0000 7fd624930640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fd62014a5b0 con 0x7fd6200b2030 2026-02-23T06:32:52.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.200+0000 7fd624930640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fd62011fb40 con 0x7fd6200b6b60 2026-02-23T06:32:52.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.200+0000 7fd624930640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fd62011f2a0 con 0x7fd6200b6790 2026-02-23T06:32:52.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.200+0000 7fd61f7fe640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd6200b2030 msgr2=0x7fd62014aa40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:32:52.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.200+0000 7fd61f7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd6200b2030 0x7fd62014aa40 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:32:52.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.200+0000 7fd61ffff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd6200b6b60 0x7fd62013d340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:52.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.200+0000 7fd61ffff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd6200b6b60 0x7fd62013d340 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:39996/0 (socket says 10.20.193.58:39996) 2026-02-23T06:32:52.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.200+0000 7fd61ffff640 1 -- 10.20.193.58:0/1119258005 learned_addr learned my addr 10.20.193.58:0/1119258005 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:32:52.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.200+0000 7fd61effd640 1 --2- 10.20.193.58:0/1119258005 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd6200b6790 0x7fd62011e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:52.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.200+0000 7fd61ffff640 1 -- 10.20.193.58:0/1119258005 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd6200b6790 msgr2=0x7fd62011e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:52.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.200+0000 7fd61ffff640 1 --2- 10.20.193.58:0/1119258005 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd6200b6790 0x7fd62011e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:52.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.200+0000 7fd61ffff640 1 -- 10.20.193.58:0/1119258005 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd6200b2030 msgr2=0x7fd62014aa40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:32:52.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.200+0000 7fd61ffff640 1 --2- 10.20.193.58:0/1119258005 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd6200b2030 0x7fd62014aa40 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:52.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.200+0000 7fd61ffff640 1 -- 10.20.193.58:0/1119258005 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6100094b0 con 0x7fd6200b6b60 2026-02-23T06:32:52.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.201+0000 7fd61ffff640 1 --2- 10.20.193.58:0/1119258005 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd6200b6b60 0x7fd62013d340 secure :-1 s=READY pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd61400c520 tx=0x7fd61400c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:52.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.201+0000 7fd5fbfff640 1 -- 10.20.193.58:0/1119258005 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd614003db0 con 0x7fd6200b6b60 2026-02-23T06:32:52.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.201+0000 7fd5fbfff640 1 -- 10.20.193.58:0/1119258005 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd614005070 con 0x7fd6200b6b60 2026-02-23T06:32:52.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.201+0000 7fd5fbfff640 1 -- 10.20.193.58:0/1119258005 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6140054a0 con 0x7fd6200b6b60 2026-02-23T06:32:52.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.201+0000 7fd624930640 1 -- 10.20.193.58:0/1119258005 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd62011f580 con 0x7fd6200b6b60 2026-02-23T06:32:52.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.201+0000 7fd624930640 1 -- 10.20.193.58:0/1119258005 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd62014a240 con 0x7fd6200b6b60 2026-02-23T06:32:52.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.201+0000 7fd624930640 1 --2- 10.20.193.58:0/1119258005 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd62011e2f0 0x7fd62013dee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:52.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.201+0000 7fd624930640 1 -- 10.20.193.58:0/1119258005 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fd62005aca0 con 0x7fd62011e2f0 2026-02-23T06:32:52.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.202+0000 7fd61f7fe640 1 --2- 10.20.193.58:0/1119258005 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd62011e2f0 0x7fd62013dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:52.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.202+0000 7fd61f7fe640 1 -- 10.20.193.58:0/1119258005 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd62005a9c0 con 0x7fd62011e2f0 2026-02-23T06:32:52.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.202+0000 7fd61f7fe640 1 --2- 10.20.193.58:0/1119258005 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd62011e2f0 0x7fd62013dee0 secure :-1 s=READY pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd60c003760 tx=0x7fd60c00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:52.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.202+0000 7fd5fbfff640 1 -- 10.20.193.58:0/1119258005 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd60c005d70 con 0x7fd62011e2f0 2026-02-23T06:32:52.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.203+0000 7fd5fbfff640 1 -- 10.20.193.58:0/1119258005 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fd60c0070d0 con 0x7fd62011e2f0 2026-02-23T06:32:52.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.203+0000 7fd5fbfff640 1 -- 10.20.193.58:0/1119258005 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd62011e2f0 msgr2=0x7fd62013dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:52.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.203+0000 7fd5fbfff640 1 --2- 10.20.193.58:0/1119258005 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd62011e2f0 0x7fd62013dee0 secure :-1 s=READY pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd60c003760 tx=0x7fd60c00c8d0 comp rx=0 tx=0).stop 2026-02-23T06:32:52.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.203+0000 7fd5fbfff640 1 -- 10.20.193.58:0/1119258005 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd62011e2f0 msgr2=0x7fd62013dee0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:32:52.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.203+0000 7fd5fbfff640 1 --2- 10.20.193.58:0/1119258005 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd62011e2f0 0x7fd62013dee0 secure :-1 s=CLOSED pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd60c003760 tx=0x7fd60c00c8d0 comp rx=0 tx=0).stop 2026-02-23T06:32:52.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.203+0000 7fd5fbfff640 1 -- 10.20.193.58:0/1119258005 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fd61400e040 con 0x7fd6200b6b60 2026-02-23T06:32:52.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.204+0000 7fd5fbfff640 1 --2- 10.20.193.58:0/1119258005 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd5f007a3c0 0x7fd5f009a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:52.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.204+0000 7fd5fbfff640 1 -- 10.20.193.58:0/1119258005 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fd61409e4f0 con 0x7fd6200b6b60 2026-02-23T06:32:52.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.204+0000 7fd61f7fe640 1 --2- 10.20.193.58:0/1119258005 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd5f007a3c0 0x7fd5f009a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:52.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.205+0000 7fd61f7fe640 1 --2- 10.20.193.58:0/1119258005 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd5f007a3c0 0x7fd5f009a870 secure :-1 s=READY pgs=293 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd60c0027a0 tx=0x7fd60c00a000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:52.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.206+0000 7fd624930640 1 --2- 10.20.193.58:0/1119258005 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd62013e420 0x7fd62013e7f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:52.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.206+0000 7fd624930640 1 -- 10.20.193.58:0/1119258005 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fd62014a0a0 con 0x7fd62013e420 2026-02-23T06:32:52.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.207+0000 7fd61effd640 1 --2- 10.20.193.58:0/1119258005 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd62013e420 0x7fd62013e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:52.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.207+0000 7fd61effd640 1 -- 10.20.193.58:0/1119258005 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd62014a760 con 0x7fd62013e420 2026-02-23T06:32:52.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.208+0000 7fd61effd640 1 --2- 10.20.193.58:0/1119258005 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd62013e420 0x7fd62013e7f0 secure :-1 s=READY pgs=66 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd610009230 tx=0x7fd610002bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:52.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.208+0000 7fd5fbfff640 1 -- 10.20.193.58:0/1119258005 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd61003d050 con 0x7fd62013e420 2026-02-23T06:32:52.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.208+0000 7fd5fbfff640 1 -- 10.20.193.58:0/1119258005 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4902 (secure 0 0 0) 0x7fd61003e040 con 0x7fd62013e420 2026-02-23T06:32:52.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.208+0000 7fd5fbfff640 1 -- 10.20.193.58:0/1119258005 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd62013e420 msgr2=0x7fd62013e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:52.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.208+0000 7fd5fbfff640 1 --2- 10.20.193.58:0/1119258005 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd62013e420 0x7fd62013e7f0 secure :-1 s=READY pgs=66 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd610009230 tx=0x7fd610002bd0 comp rx=0 tx=0).stop 2026-02-23T06:32:52.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.208+0000 7fd5fbfff640 1 -- 10.20.193.58:0/1119258005 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd62013e420 msgr2=0x7fd62013e7f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:32:52.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.208+0000 7fd5fbfff640 1 --2- 10.20.193.58:0/1119258005 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd62013e420 0x7fd62013e7f0 unknown :-1 s=CLOSED pgs=66 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:52.203 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:32:52.203 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:32:52.203 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:32:52.203 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:32:52.203 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 94, 2026-02-23T06:32:52.203 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 108785, 2026-02-23T06:32:52.203 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:32:52.203 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:32:52.203 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:32:52.203 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:52.203 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:32:52.203 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:32:52.203 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:32:52.203 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:32:52.203 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:32:52.203 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:32:52.203 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:32:52.204 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:52.205 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:32:52.206 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.208+0000 7fd624930640 1 -- 10.20.193.58:0/1119258005 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd5f007a3c0 msgr2=0x7fd5f009a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.208+0000 7fd624930640 1 --2- 10.20.193.58:0/1119258005 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd5f007a3c0 0x7fd5f009a870 secure :-1 s=READY pgs=293 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd60c0027a0 tx=0x7fd60c00a000 comp rx=0 tx=0).stop 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.208+0000 7fd624930640 1 -- 10.20.193.58:0/1119258005 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd6200b6b60 msgr2=0x7fd62013d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.208+0000 7fd624930640 1 --2- 10.20.193.58:0/1119258005 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd6200b6b60 0x7fd62013d340 secure :-1 s=READY pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd61400c520 tx=0x7fd61400c9f0 comp rx=0 tx=0).stop 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.208+0000 7fd61ffff640 1 -- 10.20.193.58:0/1119258005 reap_dead start 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.208+0000 7fd61ffff640 1 -- 10.20.193.58:0/1119258005 reap_dead start 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.208+0000 7fd624930640 1 -- 10.20.193.58:0/1119258005 shutdown_connections 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.208+0000 7fd624930640 1 -- 10.20.193.58:0/1119258005 >> 10.20.193.58:0/1119258005 conn(0x7fd620054390 msgr2=0x7fd6200b7650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:52.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.209+0000 7fd624930640 1 -- 10.20.193.58:0/1119258005 shutdown_connections 2026-02-23T06:32:52.208 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.209+0000 7fd624930640 1 -- 10.20.193.58:0/1119258005 wait complete. 2026-02-23T06:32:52.211 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:32:52.211 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-23T06:32:52.211 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:32:52.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.338+0000 7fbeb8f0c640 1 -- 10.20.193.58:0/1738901606 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbeb40b2b20 msgr2=0x7fbeb40b6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:52.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.338+0000 7fbeb8f0c640 1 --2- 10.20.193.58:0/1738901606 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbeb40b2b20 0x7fbeb40b6cb0 secure :-1 s=READY pgs=67 gs=4 cs=0 l=1 c_cookie=7734909130755537269 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe9c004740 tx=0x7fbe9c02f1d0 comp rx=0 tx=0).stop 2026-02-23T06:32:52.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.338+0000 7fbeb8f0c640 1 -- 10.20.193.58:0/1738901606 shutdown_connections 2026-02-23T06:32:52.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.338+0000 7fbeb8f0c640 1 --2- 10.20.193.58:0/1738901606 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbeb40b2b20 0x7fbeb40b6cb0 unknown :-1 s=CLOSED pgs=67 gs=4 cs=0 l=1 c_cookie=7734909130755537269 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:52.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.338+0000 7fbeb8f0c640 1 --2- 10.20.193.58:0/1738901606 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbeb4158b40 0x7fbeb40b6770 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:52.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.338+0000 7fbeb8f0c640 1 -- 10.20.193.58:0/1738901606 >> 10.20.193.58:0/1738901606 conn(0x7fbeb40561f0 msgr2=0x7fbeb40565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:52.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.338+0000 7fbeb8f0c640 1 -- 10.20.193.58:0/1738901606 shutdown_connections 2026-02-23T06:32:52.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.338+0000 7fbeb8f0c640 1 -- 10.20.193.58:0/1738901606 wait complete. 2026-02-23T06:32:52.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.339+0000 7fbeb8f0c640 1 Processor -- start 2026-02-23T06:32:52.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.339+0000 7fbeb8f0c640 1 -- start start 2026-02-23T06:32:52.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.339+0000 7fbeb8f0c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbeb40b2b20 0x7fbeb405df70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:52.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.339+0000 7fbeb8f0c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbeb40b3370 0x7fbeb415b640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:52.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.339+0000 7fbeb8f0c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbeb4158b40 0x7fbeb40af9c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:52.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.339+0000 7fbeb8f0c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb405ddb0 con 0x7fbeb4158b40 2026-02-23T06:32:52.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.339+0000 7fbeb8f0c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb405c3a0 con 0x7fbeb40b2b20 2026-02-23T06:32:52.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.339+0000 7fbeb8f0c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fbeb415bb80 con 0x7fbeb40b3370 2026-02-23T06:32:52.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.340+0000 7fbeb2d76640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbeb4158b40 msgr2=0x7fbeb40af9c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:32:52.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.340+0000 7fbeb2d76640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbeb4158b40 0x7fbeb40af9c0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:32:52.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.340+0000 7fbeb1d74640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbeb40b3370 0x7fbeb415b640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:52.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.340+0000 7fbeb2575640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbeb40b2b20 0x7fbeb405df70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:52.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.340+0000 7fbeb1d74640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbeb40b3370 0x7fbeb415b640 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:53964/0 (socket says 10.20.193.58:53964) 2026-02-23T06:32:52.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.340+0000 7fbeb1d74640 1 -- 10.20.193.58:0/1478792064 learned_addr learned my addr 10.20.193.58:0/1478792064 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:32:52.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.340+0000 7fbeb2575640 1 --2- 10.20.193.58:0/1478792064 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbeb40b2b20 0x7fbeb405df70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:40032/0 (socket says 10.20.193.58:40032) 2026-02-23T06:32:52.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.340+0000 7fbeb2575640 1 -- 10.20.193.58:0/1478792064 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbeb40b3370 msgr2=0x7fbeb415b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:52.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.340+0000 7fbeb2575640 1 --2- 10.20.193.58:0/1478792064 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbeb40b3370 0x7fbeb415b640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:52.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.340+0000 7fbeb2575640 1 -- 10.20.193.58:0/1478792064 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbeb4158b40 msgr2=0x7fbeb40af9c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:32:52.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.340+0000 7fbeb2575640 1 --2- 10.20.193.58:0/1478792064 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbeb4158b40 0x7fbeb40af9c0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:52.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.340+0000 7fbeb2575640 1 -- 10.20.193.58:0/1478792064 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9c0094b0 con 0x7fbeb40b2b20 2026-02-23T06:32:52.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.340+0000 7fbeb1d74640 1 --2- 10.20.193.58:0/1478792064 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbeb40b3370 0x7fbeb415b640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:32:52.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.341+0000 7fbeb2575640 1 --2- 10.20.193.58:0/1478792064 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbeb40b2b20 0x7fbeb405df70 secure :-1 s=READY pgs=68 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbea800e9c0 tx=0x7fbea800ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:52.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.341+0000 7fbe9affd640 1 -- 10.20.193.58:0/1478792064 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbea8004460 con 0x7fbeb40b2b20 2026-02-23T06:32:52.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.341+0000 7fbe9affd640 1 -- 10.20.193.58:0/1478792064 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbea800c880 con 0x7fbeb40b2b20 2026-02-23T06:32:52.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.341+0000 7fbe9affd640 1 -- 10.20.193.58:0/1478792064 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbea800ccb0 con 0x7fbeb40b2b20 2026-02-23T06:32:52.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.341+0000 7fbeb8f0c640 1 -- 10.20.193.58:0/1478792064 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbeb405c600 con 0x7fbeb40b2b20 2026-02-23T06:32:52.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.341+0000 7fbeb8f0c640 1 -- 10.20.193.58:0/1478792064 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbeb405cbc0 con 0x7fbeb40b2b20 2026-02-23T06:32:52.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.341+0000 7fbeb8f0c640 1 --2- 10.20.193.58:0/1478792064 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbeb405cdb0 0x7fbeb40aff00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:52.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.341+0000 7fbeb8f0c640 1 -- 10.20.193.58:0/1478792064 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fbeb40609c0 con 0x7fbeb405cdb0 2026-02-23T06:32:52.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.342+0000 7fbeb1d74640 1 --2- 10.20.193.58:0/1478792064 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbeb405cdb0 0x7fbeb40aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:52.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.342+0000 7fbeb1d74640 1 -- 10.20.193.58:0/1478792064 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbeb4166080 con 0x7fbeb405cdb0 2026-02-23T06:32:52.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.342+0000 7fbeb1d74640 1 --2- 10.20.193.58:0/1478792064 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbeb405cdb0 0x7fbeb40aff00 secure :-1 s=READY pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbeb40b50c0 tx=0x7fbe9c002ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:52.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.342+0000 7fbe9affd640 1 -- 10.20.193.58:0/1478792064 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbe9c03d050 con 0x7fbeb405cdb0 2026-02-23T06:32:52.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.343+0000 7fbe9affd640 1 -- 10.20.193.58:0/1478792064 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fbe9c03e040 con 0x7fbeb405cdb0 2026-02-23T06:32:52.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.343+0000 7fbe9affd640 1 -- 10.20.193.58:0/1478792064 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbeb405cdb0 msgr2=0x7fbeb40aff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:52.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.343+0000 7fbe9affd640 1 --2- 10.20.193.58:0/1478792064 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbeb405cdb0 0x7fbeb40aff00 secure :-1 s=READY pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbeb40b50c0 tx=0x7fbe9c002ca0 comp rx=0 tx=0).stop 2026-02-23T06:32:52.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.343+0000 7fbe9affd640 1 -- 10.20.193.58:0/1478792064 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbeb405cdb0 msgr2=0x7fbeb40aff00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:32:52.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.343+0000 7fbe9affd640 1 --2- 10.20.193.58:0/1478792064 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbeb405cdb0 0x7fbeb40aff00 unknown :-1 s=CLOSED pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:52.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.343+0000 7fbe9affd640 1 -- 10.20.193.58:0/1478792064 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fbea80036d0 con 0x7fbeb40b2b20 2026-02-23T06:32:52.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.344+0000 7fbe9affd640 1 --2- 10.20.193.58:0/1478792064 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbe8007a3c0 0x7fbe8009a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:52.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.344+0000 7fbe9affd640 1 -- 10.20.193.58:0/1478792064 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fbea8014070 con 0x7fbeb40b2b20 2026-02-23T06:32:52.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.344+0000 7fbeb1d74640 1 --2- 10.20.193.58:0/1478792064 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbe8007a3c0 0x7fbe8009a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:52.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.345+0000 7fbeb1d74640 1 --2- 10.20.193.58:0/1478792064 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbe8007a3c0 0x7fbe8009a870 secure :-1 s=READY pgs=294 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbeb40b50c0 tx=0x7fbe9c042000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:52.342 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.346+0000 7fbeb8f0c640 1 --2- 10.20.193.58:0/1478792064 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbeb4146e50 0x7fbeb41430a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:32:52.342 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.346+0000 7fbeb8f0c640 1 -- 10.20.193.58:0/1478792064 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fbeb4158f10 con 0x7fbeb4146e50 2026-02-23T06:32:52.342 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.347+0000 7fbeb2d76640 1 --2- 10.20.193.58:0/1478792064 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbeb4146e50 0x7fbeb41430a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:32:52.342 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.347+0000 7fbeb2d76640 1 -- 10.20.193.58:0/1478792064 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbeb4058640 con 0x7fbeb4146e50 2026-02-23T06:32:52.343 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.348+0000 7fbeb2d76640 1 --2- 10.20.193.58:0/1478792064 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbeb4146e50 0x7fbeb41430a0 secure :-1 s=READY pgs=204 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbea4003860 tx=0x7fbea400cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:32:52.343 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.348+0000 7fbe9affd640 1 -- 10.20.193.58:0/1478792064 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbea400d880 con 0x7fbeb4146e50 2026-02-23T06:32:52.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.348+0000 7fbe9affd640 1 -- 10.20.193.58:0/1478792064 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5544 (secure 0 0 0) 0x7fbea400d9e0 con 0x7fbeb4146e50 2026-02-23T06:32:52.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.348+0000 7fbe9affd640 1 -- 10.20.193.58:0/1478792064 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbeb4146e50 msgr2=0x7fbeb41430a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:52.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.348+0000 7fbe9affd640 1 --2- 10.20.193.58:0/1478792064 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbeb4146e50 0x7fbeb41430a0 secure :-1 s=READY pgs=204 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbea4003860 tx=0x7fbea400cf90 comp rx=0 tx=0).stop 2026-02-23T06:32:52.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.348+0000 7fbe9affd640 1 -- 10.20.193.58:0/1478792064 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbeb4146e50 msgr2=0x7fbeb41430a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:32:52.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.348+0000 7fbe9affd640 1 --2- 10.20.193.58:0/1478792064 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbeb4146e50 0x7fbeb41430a0 secure :-1 s=CLOSED pgs=204 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbea4003860 tx=0x7fbea400cf90 comp rx=0 tx=0).stop 2026-02-23T06:32:52.344 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:32:52.344 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:32:52.345 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:32:52.345 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:32:52.345 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 94, 2026-02-23T06:32:52.345 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 446859, 2026-02-23T06:32:52.345 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:32:52.345 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:32:52.345 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:32:52.345 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:52.345 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:32:52.345 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:32:52.345 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:32:52.346 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:32:52.346 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:32:52.346 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:32:52.346 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:32:52.346 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:32:52.346 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:32:52.346 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:32:52.346 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:32:52.346 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:32:52.346 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:32:52.346 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:32:52.346 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:32:52.347 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:32:52.347 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:32:52.347 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:52.347 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:32:52.347 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:32:52.347 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:32:52.347 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:32:52.347 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:32:52.347 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:32:52.347 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:32:52.347 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:32:52.347 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:32:52.348 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:32:52.348 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:32:52.348 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:32:52.348 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:32:52.348 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:32:52.348 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:32:52.348 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:52.348 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:52.348 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:32:52.348 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:32:52.348 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:32:52.348 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:32:52.349 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:32:52.349 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:32:52.349 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:32:52.349 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:32:52.349 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:32:52.349 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:32:52.349 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:32:52.349 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:32:52.349 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:32:52.349 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:32:52.349 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:32:52.349 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:32:52.350 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:32:52.350 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:32:52.350 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:32:52.350 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:32:52.350 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:32:52.350 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:32:52.350 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:32:52.350 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:32:52.350 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:32:52.350 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:32:52.350 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:32:52.350 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:32:52.351 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:32:52.351 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:32:52.351 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:52.351 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:32:52.351 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:52.351 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:32:52.351 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:52.351 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:32:52.351 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:32:52.351 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:32:52.351 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:32:52.351 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:52.352 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:32:52.352 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:32:52.352 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:52.352 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:52.352 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:52.352 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:32:52.352 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:32:52.352 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:52.352 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:52.352 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:52.352 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:52.352 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:32:52.353 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:32:52.353 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:32:52.353 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:32:52.353 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:32:52.353 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:32:52.353 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:52.353 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:52.353 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:32:52.353 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:32:52.353 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:32:52.353 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:32:52.353 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:52.354 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:32:52.354 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:32:52.354 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:52.354 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:52.354 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:52.354 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:32:52.354 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:32:52.354 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:52.354 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:52.354 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:52.354 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:52.354 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:32:52.355 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:32:52.355 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:32:52.355 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:32:52.355 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:32:52.355 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:32:52.355 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:52.355 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:52.355 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:32:52.355 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:32:52.355 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:32:52.355 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:32:52.355 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:52.356 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:32:52.356 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:32:52.356 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:52.356 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:52.356 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:52.356 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:32:52.356 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:32:52.356 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:32:52.356 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:52.356 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:52.356 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:52.356 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:32:52.356 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:32:52.357 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:32:52.357 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:32:52.357 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:32:52.357 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:32:52.357 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:52.357 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:52.357 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:52.357 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:32:52.357 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:32:52.357 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:52.357 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:32:52.357 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:32:52.357 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:32:52.358 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:52.358 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:52.358 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:32:52.358 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:52.358 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:32:52.358 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:32:52.358 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:32:52.358 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:52.358 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:52.358 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:32:52.358 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:52.358 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:32:52.359 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:32:52.359 INFO:teuthology.orchestra.run.trial058.stdout: "num": 8 2026-02-23T06:32:52.359 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:52.359 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:52.359 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:32:52.359 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:52.359 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:32:52.359 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:32:52.359 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:32:52.359 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:52.359 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:52.359 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:32:52.360 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:32:52.360 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:32:52.360 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:52.360 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:32:52.360 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:32:52.360 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:32:52.360 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:32:52.360 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:32:52.360 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:32:52.360 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:32:52.360 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:32:52.360 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:32:52.360 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:32:52.361 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:32:52.362 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.348+0000 7fbeb8f0c640 1 -- 10.20.193.58:0/1478792064 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbe8007a3c0 msgr2=0x7fbe8009a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:52.362 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.348+0000 7fbeb8f0c640 1 --2- 10.20.193.58:0/1478792064 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbe8007a3c0 0x7fbe8009a870 secure :-1 s=READY pgs=294 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbeb40b50c0 tx=0x7fbe9c042000 comp rx=0 tx=0).stop 2026-02-23T06:32:52.363 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.348+0000 7fbeb8f0c640 1 -- 10.20.193.58:0/1478792064 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbeb40b2b20 msgr2=0x7fbeb405df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:32:52.363 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.348+0000 7fbeb8f0c640 1 --2- 10.20.193.58:0/1478792064 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbeb40b2b20 0x7fbeb405df70 secure :-1 s=READY pgs=68 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbea800e9c0 tx=0x7fbea800ee90 comp rx=0 tx=0).stop 2026-02-23T06:32:52.363 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.348+0000 7fbeb2d76640 1 -- 10.20.193.58:0/1478792064 reap_dead start 2026-02-23T06:32:52.363 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.348+0000 7fbeb8f0c640 1 -- 10.20.193.58:0/1478792064 shutdown_connections 2026-02-23T06:32:52.363 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.348+0000 7fbeb8f0c640 1 --2- 10.20.193.58:0/1478792064 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbeb40b2b20 0x7fbeb405df70 unknown :-1 s=CLOSED pgs=68 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:32:52.363 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.348+0000 7fbeb8f0c640 1 -- 10.20.193.58:0/1478792064 >> 10.20.193.58:0/1478792064 conn(0x7fbeb40561f0 msgr2=0x7fbeb40b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:32:52.363 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.348+0000 7fbeb8f0c640 1 -- 10.20.193.58:0/1478792064 shutdown_connections 2026-02-23T06:32:52.363 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:32:52.348+0000 7fbeb8f0c640 1 -- 10.20.193.58:0/1478792064 wait complete. 2026-02-23T06:32:52.364 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:32:52.364 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:33:12.364 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-23T06:33:12.364 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-23T06:33:12.364 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-23T06:33:12.364 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-23T06:33:12.374 INFO:tasks.ceph.mon.a:Started 2026-02-23T06:33:12.374 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:33:12.374 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:33:12.493 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.497+0000 7f9071483640 1 -- 10.20.193.58:0/2822796684 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f906c05d080 msgr2=0x7f906c05b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:12.493 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.497+0000 7f9071483640 1 --2- 10.20.193.58:0/2822796684 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f906c05d080 0x7f906c05b0e0 secure :-1 s=READY pgs=71 gs=2 cs=0 l=1 c_cookie=4544480876516889294 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f906c0b5040 tx=0x7f905802f070 comp rx=0 tx=0).stop 2026-02-23T06:33:12.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.498+0000 7f9071483640 1 -- 10.20.193.58:0/2822796684 shutdown_connections 2026-02-23T06:33:12.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.498+0000 7f9071483640 1 --2- 10.20.193.58:0/2822796684 >> v2:10.20.193.58:3300/0 conn(0x7f906c0b5d90 0x7f906c15abd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:12.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.498+0000 7f9071483640 1 --2- 10.20.193.58:0/2822796684 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f906c05d080 0x7f906c05b0e0 unknown :-1 s=CLOSED pgs=71 gs=2 cs=0 l=1 c_cookie=4544480876516889294 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:12.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.498+0000 7f9071483640 1 -- 10.20.193.58:0/2822796684 >> 10.20.193.58:0/2822796684 conn(0x7f906c0b3c20 msgr2=0x7f906c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:12.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.498+0000 7f9071483640 1 -- 10.20.193.58:0/2822796684 shutdown_connections 2026-02-23T06:33:12.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.498+0000 7f9071483640 1 -- 10.20.193.58:0/2822796684 wait complete. 2026-02-23T06:33:12.498 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.499+0000 7f9071483640 1 Processor -- start 2026-02-23T06:33:12.498 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.499+0000 7f9071483640 1 -- start start 2026-02-23T06:33:12.498 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.500+0000 7f9071483640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f906c05d080 0x7f906c132320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:12.498 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.500+0000 7f9071483640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f906c05d450 0x7f906c058a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:12.498 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.500+0000 7f9071483640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f906c0b5d90 0x7f906c205920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:12.498 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.500+0000 7f9071483640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f906c164c20 con 0x7f906c0b5d90 2026-02-23T06:33:12.498 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.500+0000 7f9071483640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f906c1329b0 con 0x7f906c05d080 2026-02-23T06:33:12.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.500+0000 7f9071483640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f906c160070 con 0x7f906c05d450 2026-02-23T06:33:12.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.500+0000 7f9070c82640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f906c0b5d90 0x7f906c205920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:12.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.500+0000 7f906b7fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f906c05d450 0x7f906c058a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:12.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.501+0000 7f9070c82640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f906c0b5d90 0x7f906c205920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:33718/0 (socket says 10.20.193.58:33718) 2026-02-23T06:33:12.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.501+0000 7f9070c82640 1 -- 10.20.193.58:0/2944757273 learned_addr learned my addr 10.20.193.58:0/2944757273 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:33:12.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.501+0000 7f906bfff640 1 --2- 10.20.193.58:0/2944757273 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f906c05d080 0x7f906c132320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:12.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.501+0000 7f9070c82640 1 -- 10.20.193.58:0/2944757273 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f906c0b5d90 msgr2=0x7f906c205920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-23T06:33:12.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.501+0000 7f9070c82640 1 -- 10.20.193.58:0/2944757273 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f906c0b5d90 msgr2=0x7f906c205920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:33:12.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.501+0000 7f9070c82640 1 --2- 10.20.193.58:0/2944757273 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f906c0b5d90 0x7f906c205920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:33:12.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.501+0000 7f9070c82640 1 --2- 10.20.193.58:0/2944757273 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f906c0b5d90 0x7f906c205920 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:33:12.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.501+0000 7f906b7fe640 1 -- 10.20.193.58:0/2944757273 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f906c05d080 msgr2=0x7f906c132320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:12.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.501+0000 7f906b7fe640 1 --2- 10.20.193.58:0/2944757273 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f906c05d080 0x7f906c132320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:12.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.501+0000 7f906b7fe640 1 -- 10.20.193.58:0/2944757273 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f906c0b5d90 msgr2=0x7f906c205920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:33:12.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.501+0000 7f906b7fe640 1 --2- 10.20.193.58:0/2944757273 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f906c0b5d90 0x7f906c205920 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:12.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.501+0000 7f906b7fe640 1 -- 10.20.193.58:0/2944757273 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90580094b0 con 0x7f906c05d450 2026-02-23T06:33:12.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.501+0000 7f906b7fe640 1 --2- 10.20.193.58:0/2944757273 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f906c05d450 0x7f906c058a50 secure :-1 s=READY pgs=207 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f905c0029a0 tx=0x7f905c00c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:12.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.501+0000 7f9068ff9640 1 -- 10.20.193.58:0/2944757273 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f905c012850 con 0x7f906c05d450 2026-02-23T06:33:12.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.501+0000 7f9071483640 1 -- 10.20.193.58:0/2944757273 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f906c160350 con 0x7f906c05d450 2026-02-23T06:33:12.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.501+0000 7f9068ff9640 1 -- 10.20.193.58:0/2944757273 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f905c012aa0 con 0x7f906c05d450 2026-02-23T06:33:12.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.501+0000 7f9068ff9640 1 -- 10.20.193.58:0/2944757273 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f905c011380 con 0x7f906c05d450 2026-02-23T06:33:12.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.502+0000 7f9071483640 1 -- 10.20.193.58:0/2944757273 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f906c160910 con 0x7f906c05d450 2026-02-23T06:33:12.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.504+0000 7f9068ff9640 1 -- 10.20.193.58:0/2944757273 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f905c0114e0 con 0x7f906c05d450 2026-02-23T06:33:12.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.504+0000 7f9071483640 1 -- 10.20.193.58:0/2944757273 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f906c160b30 con 0x7f906c05d450 2026-02-23T06:33:12.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.505+0000 7f9068ff9640 1 --2- 10.20.193.58:0/2944757273 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f904007a6b0 0x7f904009ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:12.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.505+0000 7f9068ff9640 1 -- 10.20.193.58:0/2944757273 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f905c09d910 con 0x7f906c05d450 2026-02-23T06:33:12.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.505+0000 7f906bfff640 1 --2- 10.20.193.58:0/2944757273 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f904007a6b0 0x7f904009ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:12.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.506+0000 7f906bfff640 1 --2- 10.20.193.58:0/2944757273 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f904007a6b0 0x7f904009ab60 secure :-1 s=READY pgs=297 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90580023d0 tx=0x7f905803a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:12.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.507+0000 7f9068ff9640 1 -- 10.20.193.58:0/2944757273 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f905c060990 con 0x7f906c05d450 2026-02-23T06:33:12.657 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.662+0000 7f9071483640 1 -- 10.20.193.58:0/2944757273 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f906c057090 con 0x7f906c05d450 2026-02-23T06:33:12.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.663+0000 7f9068ff9640 1 -- 10.20.193.58:0/2944757273 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1754 (secure 0 0 0) 0x7f905c063b40 con 0x7f906c05d450 2026-02-23T06:33:12.658 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":98,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:33:12.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.664+0000 7f9071483640 1 -- 10.20.193.58:0/2944757273 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f904007a6b0 msgr2=0x7f904009ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:12.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.664+0000 7f9071483640 1 --2- 10.20.193.58:0/2944757273 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f904007a6b0 0x7f904009ab60 secure :-1 s=READY pgs=297 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90580023d0 tx=0x7f905803a040 comp rx=0 tx=0).stop 2026-02-23T06:33:12.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.664+0000 7f9071483640 1 -- 10.20.193.58:0/2944757273 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f906c05d450 msgr2=0x7f906c058a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:12.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.664+0000 7f9071483640 1 --2- 10.20.193.58:0/2944757273 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f906c05d450 0x7f906c058a50 secure :-1 s=READY pgs=207 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f905c0029a0 tx=0x7f905c00c970 comp rx=0 tx=0).stop 2026-02-23T06:33:12.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.664+0000 7f9071483640 1 -- 10.20.193.58:0/2944757273 shutdown_connections 2026-02-23T06:33:12.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.664+0000 7f9071483640 1 --2- 10.20.193.58:0/2944757273 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f904007a6b0 0x7f904009ab60 unknown :-1 s=CLOSED pgs=297 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:12.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.664+0000 7f9071483640 1 --2- 10.20.193.58:0/2944757273 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f906c0b5d90 0x7f906c205920 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:12.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.664+0000 7f9071483640 1 --2- 10.20.193.58:0/2944757273 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f906c05d450 0x7f906c058a50 unknown :-1 s=CLOSED pgs=207 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:12.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.664+0000 7f9071483640 1 --2- 10.20.193.58:0/2944757273 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f906c05d080 0x7f906c132320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:12.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.664+0000 7f9071483640 1 -- 10.20.193.58:0/2944757273 >> 10.20.193.58:0/2944757273 conn(0x7f906c0b3c20 msgr2=0x7f906c0b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:12.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.664+0000 7f9071483640 1 -- 10.20.193.58:0/2944757273 shutdown_connections 2026-02-23T06:33:12.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.664+0000 7f9071483640 1 -- 10.20.193.58:0/2944757273 wait complete. 2026-02-23T06:33:12.671 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:33:12.671 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:33:12.671 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:33:12.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.797+0000 7f2a96403640 1 -- 10.20.193.58:0/1510217261 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2a90162ca0 msgr2=0x7f2a90056fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:12.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.797+0000 7f2a96403640 1 --2- 10.20.193.58:0/1510217261 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2a90162ca0 0x7f2a90056fc0 secure :-1 s=READY pgs=208 gs=3 cs=0 l=1 c_cookie=13639964399446775556 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a8c006f50 tx=0x7f2a8c030300 comp rx=0 tx=0).stop 2026-02-23T06:33:12.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.798+0000 7f2a96403640 1 -- 10.20.193.58:0/1510217261 shutdown_connections 2026-02-23T06:33:12.794 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.798+0000 7f2a96403640 1 --2- 10.20.193.58:0/1510217261 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2a90162ca0 0x7f2a90056fc0 unknown :-1 s=CLOSED pgs=208 gs=3 cs=0 l=1 c_cookie=13639964399446775556 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:12.794 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.798+0000 7f2a96403640 1 --2- 10.20.193.58:0/1510217261 >> v2:10.20.193.58:3300/0 conn(0x7f2a9015c4b0 0x7f2a90058200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:12.794 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.798+0000 7f2a96403640 1 -- 10.20.193.58:0/1510217261 >> 10.20.193.58:0/1510217261 conn(0x7f2a900b3c20 msgr2=0x7f2a900b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:12.794 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.798+0000 7f2a96403640 1 -- 10.20.193.58:0/1510217261 shutdown_connections 2026-02-23T06:33:12.794 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.798+0000 7f2a96403640 1 -- 10.20.193.58:0/1510217261 wait complete. 2026-02-23T06:33:12.796 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.799+0000 7f2a96403640 1 Processor -- start 2026-02-23T06:33:12.796 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.799+0000 7f2a96403640 1 -- start start 2026-02-23T06:33:12.796 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.800+0000 7f2a96403640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2a90056960 0x7f2a901634c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:12.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.800+0000 7f2a96403640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2a9015c4b0 0x7f2a9015f630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:12.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.800+0000 7f2a96403640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2a90162ca0 0x7f2a900b0480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:12.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.800+0000 7f2a96403640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9015fb70 con 0x7f2a90162ca0 2026-02-23T06:33:12.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.800+0000 7f2a96403640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9015cfb0 con 0x7f2a9015c4b0 2026-02-23T06:33:12.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.800+0000 7f2a96403640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f2a9013cd40 con 0x7f2a90056960 2026-02-23T06:33:12.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.800+0000 7f2a95401640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2a90056960 0x7f2a901634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:12.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.800+0000 7f2a94c00640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2a9015c4b0 0x7f2a9015f630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:12.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.800+0000 7f2a94c00640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2a9015c4b0 0x7f2a9015f630 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:36350/0 (socket says 10.20.193.58:36350) 2026-02-23T06:33:12.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.800+0000 7f2a95401640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2a90056960 0x7f2a901634c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:38696/0 (socket says 10.20.193.58:38696) 2026-02-23T06:33:12.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.800+0000 7f2a95401640 1 -- 10.20.193.58:0/3325966112 learned_addr learned my addr 10.20.193.58:0/3325966112 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:33:12.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.800+0000 7f2a95c02640 1 --2- 10.20.193.58:0/3325966112 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2a90162ca0 0x7f2a900b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:12.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.800+0000 7f2a95c02640 1 -- 10.20.193.58:0/3325966112 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2a90056960 msgr2=0x7f2a901634c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:12.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.800+0000 7f2a95c02640 1 --2- 10.20.193.58:0/3325966112 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2a90056960 0x7f2a901634c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:12.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.800+0000 7f2a95c02640 1 -- 10.20.193.58:0/3325966112 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2a9015c4b0 msgr2=0x7f2a9015f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:12.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.800+0000 7f2a95c02640 1 --2- 10.20.193.58:0/3325966112 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2a9015c4b0 0x7f2a9015f630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:12.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.800+0000 7f2a95c02640 1 -- 10.20.193.58:0/3325966112 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a8c00a650 con 0x7f2a90162ca0 2026-02-23T06:33:12.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.800+0000 7f2a95c02640 1 --2- 10.20.193.58:0/3325966112 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2a90162ca0 0x7f2a900b0480 secure :-1 s=READY pgs=4 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a8c005820 tx=0x7f2a8c003d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:12.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.801+0000 7f2a7dffb640 1 -- 10.20.193.58:0/3325966112 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a8c045070 con 0x7f2a90162ca0 2026-02-23T06:33:12.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.801+0000 7f2a7dffb640 1 -- 10.20.193.58:0/3325966112 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a8c003e90 con 0x7f2a90162ca0 2026-02-23T06:33:12.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.801+0000 7f2a96403640 1 -- 10.20.193.58:0/3325966112 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a90166300 con 0x7f2a90162ca0 2026-02-23T06:33:12.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.801+0000 7f2a7dffb640 1 -- 10.20.193.58:0/3325966112 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a8c039c10 con 0x7f2a90162ca0 2026-02-23T06:33:12.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.801+0000 7f2a96403640 1 -- 10.20.193.58:0/3325966112 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a901665a0 con 0x7f2a90162ca0 2026-02-23T06:33:12.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.801+0000 7f2a96403640 1 --2- 10.20.193.58:0/3325966112 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2a90163d40 0x7f2a90164110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:12.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.801+0000 7f2a96403640 1 -- 10.20.193.58:0/3325966112 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f2a90164650 con 0x7f2a90163d40 2026-02-23T06:33:12.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.801+0000 7f2a95401640 1 --2- 10.20.193.58:0/3325966112 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2a90163d40 0x7f2a90164110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:12.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.802+0000 7f2a95401640 1 -- 10.20.193.58:0/3325966112 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2a90059690 con 0x7f2a90163d40 2026-02-23T06:33:12.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.802+0000 7f2a95401640 1 --2- 10.20.193.58:0/3325966112 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2a90163d40 0x7f2a90164110 secure :-1 s=READY pgs=5 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a80009480 tx=0x7f2a80002d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:12.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.802+0000 7f2a7dffb640 1 -- 10.20.193.58:0/3325966112 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a80009e20 con 0x7f2a90163d40 2026-02-23T06:33:12.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.802+0000 7f2a7dffb640 1 -- 10.20.193.58:0/3325966112 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f2a80011ca0 con 0x7f2a90163d40 2026-02-23T06:33:12.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.802+0000 7f2a7dffb640 1 -- 10.20.193.58:0/3325966112 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2a90163d40 msgr2=0x7f2a90164110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:12.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.802+0000 7f2a7dffb640 1 --2- 10.20.193.58:0/3325966112 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2a90163d40 0x7f2a90164110 secure :-1 s=READY pgs=5 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a80009480 tx=0x7f2a80002d70 comp rx=0 tx=0).stop 2026-02-23T06:33:12.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.802+0000 7f2a7dffb640 1 -- 10.20.193.58:0/3325966112 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2a90163d40 msgr2=0x7f2a90164110 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:33:12.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.802+0000 7f2a7dffb640 1 --2- 10.20.193.58:0/3325966112 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2a90163d40 0x7f2a90164110 secure :-1 s=CLOSED pgs=5 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a80009480 tx=0x7f2a80002d70 comp rx=0 tx=0).stop 2026-02-23T06:33:12.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.803+0000 7f2a7dffb640 1 -- 10.20.193.58:0/3325966112 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f2a8c048370 con 0x7f2a90162ca0 2026-02-23T06:33:12.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.804+0000 7f2a7dffb640 1 --2- 10.20.193.58:0/3325966112 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2a6007a430 0x7f2a6009a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:12.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.804+0000 7f2a7dffb640 1 -- 10.20.193.58:0/3325966112 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f2a8c0c3560 con 0x7f2a90162ca0 2026-02-23T06:33:12.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.804+0000 7f2a95401640 1 --2- 10.20.193.58:0/3325966112 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2a6007a430 0x7f2a6009a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:12.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.805+0000 7f2a95401640 1 --2- 10.20.193.58:0/3325966112 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2a6007a430 0x7f2a6009a8e0 secure :-1 s=READY pgs=298 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a800118b0 tx=0x7f2a8000e000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:12.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.806+0000 7f2a96403640 1 --2- 10.20.193.58:0/3325966112 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2a901648e0 0x7f2a90164cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:12.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.806+0000 7f2a96403640 1 -- 10.20.193.58:0/3325966112 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f2a900593b0 con 0x7f2a901648e0 2026-02-23T06:33:12.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.806+0000 7f2a94c00640 1 --2- 10.20.193.58:0/3325966112 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2a901648e0 0x7f2a90164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:12.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.806+0000 7f2a94c00640 1 -- 10.20.193.58:0/3325966112 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2a9015c880 con 0x7f2a901648e0 2026-02-23T06:33:12.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.807+0000 7f2a94c00640 1 --2- 10.20.193.58:0/3325966112 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2a901648e0 0x7f2a90164cb0 secure :-1 s=READY pgs=6 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a90166080 tx=0x7f2a8400eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:12.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.807+0000 7f2a7dffb640 1 -- 10.20.193.58:0/3325966112 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a84019070 con 0x7f2a901648e0 2026-02-23T06:33:12.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.807+0000 7f2a7dffb640 1 -- 10.20.193.58:0/3325966112 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4910 (secure 0 0 0) 0x7f2a84006ab0 con 0x7f2a901648e0 2026-02-23T06:33:12.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.807+0000 7f2a7dffb640 1 -- 10.20.193.58:0/3325966112 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2a901648e0 msgr2=0x7f2a90164cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:12.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.807+0000 7f2a7dffb640 1 --2- 10.20.193.58:0/3325966112 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2a901648e0 0x7f2a90164cb0 secure :-1 s=READY pgs=6 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a90166080 tx=0x7f2a8400eba0 comp rx=0 tx=0).stop 2026-02-23T06:33:12.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.807+0000 7f2a7dffb640 1 -- 10.20.193.58:0/3325966112 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2a901648e0 msgr2=0x7f2a90164cb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:33:12.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.807+0000 7f2a7dffb640 1 --2- 10.20.193.58:0/3325966112 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2a901648e0 0x7f2a90164cb0 secure :-1 s=CLOSED pgs=6 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a90166080 tx=0x7f2a8400eba0 comp rx=0 tx=0).stop 2026-02-23T06:33:12.804 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:33:12.804 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:33:12.804 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:33:12.804 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:33:12.804 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 98, 2026-02-23T06:33:12.804 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 319, 2026-02-23T06:33:12.804 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:33:12.805 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:33:12.805 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:33:12.805 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:33:12.805 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:12.805 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:33:12.805 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:33:12.805 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:33:12.805 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:33:12.805 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:12.806 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:12.806 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:12.806 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:12.806 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:12.806 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:12.806 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:12.806 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:12.806 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:12.806 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:12.806 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:12.806 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:12.806 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:12.806 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:12.807 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:33:12.807 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:33:12.807 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:12.807 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:12.807 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:12.807 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:12.807 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:12.807 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:12.807 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:12.807 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:12.807 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:12.807 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:12.808 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:12.808 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:12.808 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:12.808 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:12.808 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:12.808 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:33:12.808 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:33:12.808 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:33:12.808 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:33:12.808 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:33:12.808 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:33:12.808 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:33:12.809 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:33:12.809 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:33:12.809 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:33:12.809 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:33:12.809 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:33:12.809 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:33:12.809 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:33:12.809 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:33:12.809 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:33:12.809 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:33:12.809 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:12.809 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:12.809 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:12.810 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:12.810 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:12.810 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:12.810 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:12.810 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:12.810 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:12.810 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:12.810 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:12.810 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:12.810 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:12.810 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:12.810 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:33:12.810 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:12.811 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:33:12.811 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:12.811 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:33:12.811 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:33:12.811 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:12.811 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:12.811 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:12.811 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:12.811 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:33:12.811 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:12.811 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:12.811 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:12.811 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:12.812 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:33:12.812 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:12.812 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:12.812 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:12.812 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:12.812 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:33:12.812 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:33:12.812 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:12.812 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:12.812 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:33:12.812 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:12.812 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:12.813 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:12.813 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:33:12.813 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:33:12.813 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:12.813 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:12.813 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:12.813 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:12.813 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:33:12.813 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:12.813 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:12.813 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:12.813 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:12.813 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:33:12.814 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:12.814 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:12.814 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:12.814 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:12.814 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:33:12.814 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:33:12.814 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:12.814 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:12.814 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:33:12.814 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:12.814 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:12.814 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:12.815 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:33:12.815 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:33:12.815 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:12.815 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:12.815 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:12.815 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:12.815 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:33:12.815 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:12.816 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:12.816 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:12.816 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:12.816 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:33:12.816 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:12.816 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:12.816 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:12.816 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:12.816 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:33:12.816 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:33:12.816 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:12.816 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:12.817 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:33:12.817 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:12.817 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:12.817 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:12.817 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:12.817 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:33:12.817 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:33:12.817 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:12.817 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:12.817 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:12.817 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:33:12.817 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:12.818 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:12.818 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:33:12.818 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:12.818 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:12.818 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:12.818 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:33:12.818 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:12.818 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:12.818 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:12.818 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:33:12.818 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:33:12.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.807+0000 7f2a96403640 1 -- 10.20.193.58:0/3325966112 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2a6007a430 msgr2=0x7f2a6009a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:12.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.807+0000 7f2a96403640 1 --2- 10.20.193.58:0/3325966112 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2a6007a430 0x7f2a6009a8e0 secure :-1 s=READY pgs=298 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a800118b0 tx=0x7f2a8000e000 comp rx=0 tx=0).stop 2026-02-23T06:33:12.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.807+0000 7f2a96403640 1 -- 10.20.193.58:0/3325966112 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2a90162ca0 msgr2=0x7f2a900b0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:12.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.807+0000 7f2a96403640 1 --2- 10.20.193.58:0/3325966112 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2a90162ca0 0x7f2a900b0480 secure :-1 s=READY pgs=4 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a8c005820 tx=0x7f2a8c003d20 comp rx=0 tx=0).stop 2026-02-23T06:33:12.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.807+0000 7f2a95c02640 1 -- 10.20.193.58:0/3325966112 reap_dead start 2026-02-23T06:33:12.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.807+0000 7f2a95c02640 1 -- 10.20.193.58:0/3325966112 reap_dead start 2026-02-23T06:33:12.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.807+0000 7f2a96403640 1 -- 10.20.193.58:0/3325966112 shutdown_connections 2026-02-23T06:33:12.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.807+0000 7f2a96403640 1 -- 10.20.193.58:0/3325966112 >> 10.20.193.58:0/3325966112 conn(0x7f2a900b3c20 msgr2=0x7f2a9013d990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:12.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.807+0000 7f2a96403640 1 -- 10.20.193.58:0/3325966112 shutdown_connections 2026-02-23T06:33:12.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.807+0000 7f2a96403640 1 -- 10.20.193.58:0/3325966112 wait complete. 2026-02-23T06:33:12.821 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:33:12.821 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:33:12.822 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:33:12.945 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.950+0000 7f64789d2640 1 -- 10.20.193.58:0/1738354198 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f64741688d0 msgr2=0x7f6474168ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:12.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.950+0000 7f64789d2640 1 --2- 10.20.193.58:0/1738354198 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f64741688d0 0x7f6474168ca0 secure :-1 s=READY pgs=74 gs=3 cs=0 l=1 c_cookie=9601451189063686416 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6460004740 tx=0x7f646002f230 comp rx=0 tx=0).stop 2026-02-23T06:33:12.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.950+0000 7f64789d2640 1 -- 10.20.193.58:0/1738354198 shutdown_connections 2026-02-23T06:33:12.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.950+0000 7f64789d2640 1 --2- 10.20.193.58:0/1738354198 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f64741688d0 0x7f6474168ca0 unknown :-1 s=CLOSED pgs=74 gs=3 cs=0 l=1 c_cookie=9601451189063686416 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:12.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.950+0000 7f64789d2640 1 -- 10.20.193.58:0/1738354198 >> 10.20.193.58:0/1738354198 conn(0x7f6474054e40 msgr2=0x7f6474057b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:12.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.950+0000 7f64789d2640 1 -- 10.20.193.58:0/1738354198 shutdown_connections 2026-02-23T06:33:12.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.950+0000 7f64789d2640 1 -- 10.20.193.58:0/1738354198 wait complete. 2026-02-23T06:33:12.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.951+0000 7f64789d2640 1 Processor -- start 2026-02-23T06:33:12.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.951+0000 7f64789d2640 1 -- start start 2026-02-23T06:33:12.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.952+0000 7f64789d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f64740b6440 0x7f64741598a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:12.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.952+0000 7f64789d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f64740bb0b0 0x7f6474164530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:12.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.952+0000 7f64789d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f64741688d0 0x7f647411b600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:12.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.952+0000 7f64789d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f647411cd00 con 0x7f64740bb0b0 2026-02-23T06:33:12.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.952+0000 7f64789d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f647411efd0 con 0x7f64741688d0 2026-02-23T06:33:12.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.952+0000 7f64789d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f647411c7d0 con 0x7f64740b6440 2026-02-23T06:33:12.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.952+0000 7f6472ffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f64740bb0b0 0x7f6474164530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:12.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.952+0000 7f6473fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f64741688d0 0x7f647411b600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:12.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.952+0000 7f64737fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f64740b6440 0x7f64741598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:12.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.952+0000 7f6472ffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f64740bb0b0 0x7f6474164530 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:33748/0 (socket says 10.20.193.58:33748) 2026-02-23T06:33:12.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.952+0000 7f6472ffd640 1 -- 10.20.193.58:0/623638007 learned_addr learned my addr 10.20.193.58:0/623638007 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:33:12.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.952+0000 7f64737fe640 1 -- 10.20.193.58:0/623638007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f64741688d0 msgr2=0x7f647411b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:12.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.952+0000 7f64737fe640 1 --2- 10.20.193.58:0/623638007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f64741688d0 0x7f647411b600 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:12.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.952+0000 7f64737fe640 1 -- 10.20.193.58:0/623638007 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f64740bb0b0 msgr2=0x7f6474164530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:12.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.952+0000 7f64737fe640 1 --2- 10.20.193.58:0/623638007 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f64740bb0b0 0x7f6474164530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:12.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.952+0000 7f64737fe640 1 -- 10.20.193.58:0/623638007 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64600094b0 con 0x7f64740b6440 2026-02-23T06:33:12.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.952+0000 7f6472ffd640 1 --2- 10.20.193.58:0/623638007 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f64740bb0b0 0x7f6474164530 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:33:12.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.953+0000 7f64737fe640 1 --2- 10.20.193.58:0/623638007 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f64740b6440 0x7f64741598a0 secure :-1 s=READY pgs=209 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6460009230 tx=0x7f6460002950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:12.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.953+0000 7f644ffff640 1 -- 10.20.193.58:0/623638007 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6460044070 con 0x7f64740b6440 2026-02-23T06:33:12.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.953+0000 7f644ffff640 1 -- 10.20.193.58:0/623638007 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6460038560 con 0x7f64740b6440 2026-02-23T06:33:12.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.953+0000 7f644ffff640 1 -- 10.20.193.58:0/623638007 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6460038970 con 0x7f64740b6440 2026-02-23T06:33:12.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.953+0000 7f64789d2640 1 -- 10.20.193.58:0/623638007 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647411ca20 con 0x7f64740b6440 2026-02-23T06:33:12.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.953+0000 7f64789d2640 1 -- 10.20.193.58:0/623638007 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6474163c90 con 0x7f64740b6440 2026-02-23T06:33:12.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.953+0000 7f64789d2640 1 --2- 10.20.193.58:0/623638007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6474164a70 0x7f647411ae00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:12.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.953+0000 7f64789d2640 1 -- 10.20.193.58:0/623638007 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f64740609c0 con 0x7f6474164a70 2026-02-23T06:33:12.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.954+0000 7f6472ffd640 1 --2- 10.20.193.58:0/623638007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6474164a70 0x7f647411ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:12.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.954+0000 7f6472ffd640 1 -- 10.20.193.58:0/623638007 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f64740bb7d0 con 0x7f6474164a70 2026-02-23T06:33:12.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.954+0000 7f6472ffd640 1 --2- 10.20.193.58:0/623638007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6474164a70 0x7f647411ae00 secure :-1 s=READY pgs=75 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6474162dd0 tx=0x7f646400d520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:12.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.954+0000 7f644ffff640 1 -- 10.20.193.58:0/623638007 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f646400ddb0 con 0x7f6474164a70 2026-02-23T06:33:12.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.954+0000 7f644ffff640 1 -- 10.20.193.58:0/623638007 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f6464014470 con 0x7f6474164a70 2026-02-23T06:33:12.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.954+0000 7f644ffff640 1 -- 10.20.193.58:0/623638007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6474164a70 msgr2=0x7f647411ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:12.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.954+0000 7f644ffff640 1 --2- 10.20.193.58:0/623638007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6474164a70 0x7f647411ae00 secure :-1 s=READY pgs=75 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6474162dd0 tx=0x7f646400d520 comp rx=0 tx=0).stop 2026-02-23T06:33:12.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.954+0000 7f644ffff640 1 -- 10.20.193.58:0/623638007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6474164a70 msgr2=0x7f647411ae00 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:33:12.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.954+0000 7f644ffff640 1 --2- 10.20.193.58:0/623638007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6474164a70 0x7f647411ae00 secure :-1 s=CLOSED pgs=75 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6474162dd0 tx=0x7f646400d520 comp rx=0 tx=0).stop 2026-02-23T06:33:12.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.954+0000 7f644ffff640 1 -- 10.20.193.58:0/623638007 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f6460038ad0 con 0x7f64740b6440 2026-02-23T06:33:12.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.956+0000 7f644ffff640 1 --2- 10.20.193.58:0/623638007 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f644407a430 0x7f644409a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:12.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.956+0000 7f644ffff640 1 -- 10.20.193.58:0/623638007 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f64600c22d0 con 0x7f64740b6440 2026-02-23T06:33:12.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.956+0000 7f6472ffd640 1 --2- 10.20.193.58:0/623638007 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f644407a430 0x7f644409a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:12.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.956+0000 7f6472ffd640 1 --2- 10.20.193.58:0/623638007 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f644407a430 0x7f644409a8e0 secure :-1 s=READY pgs=299 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6474162dd0 tx=0x7f6464009030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:12.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.958+0000 7f64789d2640 1 --2- 10.20.193.58:0/623638007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f647411bb40 0x7f6474148950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:12.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.958+0000 7f64789d2640 1 -- 10.20.193.58:0/623638007 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f64741691e0 con 0x7f647411bb40 2026-02-23T06:33:12.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.958+0000 7f6473fff640 1 --2- 10.20.193.58:0/623638007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f647411bb40 0x7f6474148950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:12.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.959+0000 7f6473fff640 1 -- 10.20.193.58:0/623638007 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f647411b340 con 0x7f647411bb40 2026-02-23T06:33:12.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.959+0000 7f6473fff640 1 --2- 10.20.193.58:0/623638007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f647411bb40 0x7f6474148950 secure :-1 s=READY pgs=76 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64680034b0 tx=0x7f646800ff10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:12.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.959+0000 7f644ffff640 1 -- 10.20.193.58:0/623638007 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6468007b90 con 0x7f647411bb40 2026-02-23T06:33:12.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.959+0000 7f644ffff640 1 -- 10.20.193.58:0/623638007 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4911 (secure 0 0 0) 0x7f6468007cf0 con 0x7f647411bb40 2026-02-23T06:33:12.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.959+0000 7f644ffff640 1 -- 10.20.193.58:0/623638007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f647411bb40 msgr2=0x7f6474148950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:12.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.959+0000 7f644ffff640 1 --2- 10.20.193.58:0/623638007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f647411bb40 0x7f6474148950 secure :-1 s=READY pgs=76 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64680034b0 tx=0x7f646800ff10 comp rx=0 tx=0).stop 2026-02-23T06:33:12.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.959+0000 7f644ffff640 1 -- 10.20.193.58:0/623638007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f647411bb40 msgr2=0x7f6474148950 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:33:12.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.959+0000 7f644ffff640 1 --2- 10.20.193.58:0/623638007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f647411bb40 0x7f6474148950 unknown :-1 s=CLOSED pgs=76 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:12.956 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:33:12.956 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:33:12.956 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:33:12.956 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:33:12.956 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 98, 2026-02-23T06:33:12.956 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 129536, 2026-02-23T06:33:12.957 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:33:12.957 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:33:12.957 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:33:12.957 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:33:12.957 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:12.957 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:33:12.957 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:33:12.957 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:33:12.957 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:33:12.957 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:12.957 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:12.958 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:12.958 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:12.958 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:12.958 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:12.958 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:12.958 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:12.958 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:12.958 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:12.958 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:12.958 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:12.958 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:12.958 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:12.959 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:33:12.959 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:33:12.959 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:12.959 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:12.959 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:12.959 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:12.959 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:12.959 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:12.959 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:12.959 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:12.959 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:12.959 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:12.960 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:12.960 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:12.960 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:12.960 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:12.960 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:12.960 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:33:12.960 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:33:12.960 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:33:12.960 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:33:12.960 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:33:12.960 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:33:12.960 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:33:12.961 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:33:12.961 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:33:12.961 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:33:12.961 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:33:12.961 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:33:12.961 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:33:12.961 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:33:12.961 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:33:12.961 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:33:12.961 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:33:12.961 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:12.961 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:12.962 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:12.962 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:12.962 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:12.962 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:12.962 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:12.962 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:12.962 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:12.962 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:12.962 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:12.962 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:12.962 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:12.962 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:12.962 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:33:12.963 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:12.963 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:33:12.963 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:12.963 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:33:12.963 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:33:12.963 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:12.963 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:12.963 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:12.963 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:12.963 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:33:12.963 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:12.963 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:12.964 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:12.964 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:12.964 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:33:12.964 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:12.964 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:12.964 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:12.964 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:12.964 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:33:12.964 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:33:12.964 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:12.964 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:12.964 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:33:12.964 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:12.965 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:12.965 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:12.965 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:33:12.965 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:33:12.965 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:12.965 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:12.965 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:12.965 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:12.965 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:33:12.965 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:12.965 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:12.965 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:12.966 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:12.966 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:33:12.966 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:12.966 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:12.966 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:12.966 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:12.966 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:33:12.966 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:33:12.966 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:12.966 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:12.966 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:33:12.966 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:12.966 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:12.967 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:12.967 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:33:12.967 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:33:12.967 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:12.967 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:12.967 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:12.967 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:12.967 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:33:12.967 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:12.967 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:12.967 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:12.967 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:12.968 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:33:12.968 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:12.968 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:12.968 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:12.968 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:12.968 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:33:12.968 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:33:12.968 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:12.968 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:12.968 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:33:12.968 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:12.968 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:12.968 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:12.969 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:12.969 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:33:12.969 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:33:12.969 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:12.969 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:12.969 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:12.969 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:33:12.969 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:12.969 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:12.969 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:33:12.969 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:12.969 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:12.970 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:12.970 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:33:12.970 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:12.970 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:12.970 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:12.970 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:33:12.970 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:33:12.972 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.959+0000 7f64789d2640 1 -- 10.20.193.58:0/623638007 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f644407a430 msgr2=0x7f644409a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:12.972 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.959+0000 7f64789d2640 1 --2- 10.20.193.58:0/623638007 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f644407a430 0x7f644409a8e0 secure :-1 s=READY pgs=299 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6474162dd0 tx=0x7f6464009030 comp rx=0 tx=0).stop 2026-02-23T06:33:12.972 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.959+0000 7f64789d2640 1 -- 10.20.193.58:0/623638007 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f64740b6440 msgr2=0x7f64741598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:12.972 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.959+0000 7f64789d2640 1 --2- 10.20.193.58:0/623638007 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f64740b6440 0x7f64741598a0 secure :-1 s=READY pgs=209 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6460009230 tx=0x7f6460002950 comp rx=0 tx=0).stop 2026-02-23T06:33:12.972 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.959+0000 7f6473fff640 1 -- 10.20.193.58:0/623638007 reap_dead start 2026-02-23T06:33:12.972 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.960+0000 7f64789d2640 1 -- 10.20.193.58:0/623638007 shutdown_connections 2026-02-23T06:33:12.972 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.960+0000 7f64789d2640 1 --2- 10.20.193.58:0/623638007 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f64740b6440 0x7f64741598a0 unknown :-1 s=CLOSED pgs=209 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:12.972 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.960+0000 7f64789d2640 1 -- 10.20.193.58:0/623638007 >> 10.20.193.58:0/623638007 conn(0x7f6474054e40 msgr2=0x7f647415a910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:12.972 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.960+0000 7f64789d2640 1 -- 10.20.193.58:0/623638007 shutdown_connections 2026-02-23T06:33:12.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:12.960+0000 7f64789d2640 1 -- 10.20.193.58:0/623638007 wait complete. 2026-02-23T06:33:12.973 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:33:12.973 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:33:12.973 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:33:13.098 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.103+0000 7efc3d643640 1 -- 10.20.193.58:0/160215604 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc3805d370 msgr2=0x7efc380b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:13.098 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.103+0000 7efc3d643640 1 --2- 10.20.193.58:0/160215604 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc3805d370 0x7efc380b5680 secure :-1 s=READY pgs=78 gs=3 cs=0 l=1 c_cookie=9131616012628997264 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc2c005820 tx=0x7efc2c0302b0 comp rx=0 tx=0).stop 2026-02-23T06:33:13.099 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.103+0000 7efc3d643640 1 -- 10.20.193.58:0/160215604 shutdown_connections 2026-02-23T06:33:13.099 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.103+0000 7efc3d643640 1 --2- 10.20.193.58:0/160215604 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc3805d370 0x7efc380b5680 unknown :-1 s=CLOSED pgs=78 gs=3 cs=0 l=1 c_cookie=9131616012628997264 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:13.099 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.103+0000 7efc3d643640 1 --2- 10.20.193.58:0/160215604 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc38056550 0x7efc3805ce30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:13.099 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.103+0000 7efc3d643640 1 -- 10.20.193.58:0/160215604 >> 10.20.193.58:0/160215604 conn(0x7efc380b3c20 msgr2=0x7efc380b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:13.099 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.103+0000 7efc3d643640 1 -- 10.20.193.58:0/160215604 shutdown_connections 2026-02-23T06:33:13.099 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.103+0000 7efc3d643640 1 -- 10.20.193.58:0/160215604 wait complete. 2026-02-23T06:33:13.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.104+0000 7efc3d643640 1 Processor -- start 2026-02-23T06:33:13.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.104+0000 7efc3d643640 1 -- start start 2026-02-23T06:33:13.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.105+0000 7efc3d643640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc38056550 0x7efc380585d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:13.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.105+0000 7efc3d643640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc3805d370 0x7efc38201590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:13.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.105+0000 7efc3d643640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc3815c040 0x7efc38201ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:13.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.105+0000 7efc3d643640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7efc381fdde0 con 0x7efc38056550 2026-02-23T06:33:13.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.105+0000 7efc3d643640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7efc38201090 con 0x7efc3815c040 2026-02-23T06:33:13.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.105+0000 7efc3d643640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7efc381fe0a0 con 0x7efc3805d370 2026-02-23T06:33:13.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.105+0000 7efc377fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc3805d370 0x7efc38201590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:13.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.105+0000 7efc37fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc38056550 0x7efc380585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:13.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.105+0000 7efc377fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc3805d370 0x7efc38201590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:38714/0 (socket says 10.20.193.58:38714) 2026-02-23T06:33:13.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.105+0000 7efc377fe640 1 -- 10.20.193.58:0/3371294228 learned_addr learned my addr 10.20.193.58:0/3371294228 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:33:13.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.105+0000 7efc3ce42640 1 --2- 10.20.193.58:0/3371294228 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc3815c040 0x7efc38201ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:13.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.105+0000 7efc377fe640 1 -- 10.20.193.58:0/3371294228 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc3815c040 msgr2=0x7efc38201ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:13.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.105+0000 7efc377fe640 1 --2- 10.20.193.58:0/3371294228 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc3815c040 0x7efc38201ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:13.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.105+0000 7efc377fe640 1 -- 10.20.193.58:0/3371294228 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc38056550 msgr2=0x7efc380585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:13.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.105+0000 7efc377fe640 1 --2- 10.20.193.58:0/3371294228 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc38056550 0x7efc380585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:13.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.105+0000 7efc377fe640 1 -- 10.20.193.58:0/3371294228 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc2c00a590 con 0x7efc3805d370 2026-02-23T06:33:13.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.105+0000 7efc377fe640 1 --2- 10.20.193.58:0/3371294228 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc3805d370 0x7efc38201590 secure :-1 s=READY pgs=210 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc28009480 tx=0x7efc2800ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:13.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.105+0000 7efc34ff9640 1 -- 10.20.193.58:0/3371294228 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc2800cd40 con 0x7efc3805d370 2026-02-23T06:33:13.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.105+0000 7efc3d643640 1 -- 10.20.193.58:0/3371294228 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc381fe380 con 0x7efc3805d370 2026-02-23T06:33:13.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.106+0000 7efc3d643640 1 -- 10.20.193.58:0/3371294228 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efc381fe940 con 0x7efc3805d370 2026-02-23T06:33:13.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.106+0000 7efc34ff9640 1 -- 10.20.193.58:0/3371294228 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc28004020 con 0x7efc3805d370 2026-02-23T06:33:13.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.106+0000 7efc34ff9640 1 -- 10.20.193.58:0/3371294228 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc2800cea0 con 0x7efc3805d370 2026-02-23T06:33:13.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.106+0000 7efc3d643640 1 --2- 10.20.193.58:0/3371294228 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc38058b10 0x7efc3815c410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:13.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.106+0000 7efc3d643640 1 -- 10.20.193.58:0/3371294228 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7efc3815c950 con 0x7efc38058b10 2026-02-23T06:33:13.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.106+0000 7efc37fff640 1 --2- 10.20.193.58:0/3371294228 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc38058b10 0x7efc3815c410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:13.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.107+0000 7efc37fff640 1 -- 10.20.193.58:0/3371294228 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efc3805d9c0 con 0x7efc38058b10 2026-02-23T06:33:13.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.107+0000 7efc37fff640 1 --2- 10.20.193.58:0/3371294228 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc38058b10 0x7efc3815c410 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc240029a0 tx=0x7efc2400fc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:13.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.107+0000 7efc34ff9640 1 -- 10.20.193.58:0/3371294228 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc2400dae0 con 0x7efc38058b10 2026-02-23T06:33:13.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.107+0000 7efc34ff9640 1 -- 10.20.193.58:0/3371294228 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7efc2400fe10 con 0x7efc38058b10 2026-02-23T06:33:13.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.107+0000 7efc34ff9640 1 -- 10.20.193.58:0/3371294228 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc38058b10 msgr2=0x7efc3815c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:13.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.107+0000 7efc34ff9640 1 --2- 10.20.193.58:0/3371294228 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc38058b10 0x7efc3815c410 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc240029a0 tx=0x7efc2400fc10 comp rx=0 tx=0).stop 2026-02-23T06:33:13.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.107+0000 7efc34ff9640 1 -- 10.20.193.58:0/3371294228 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc38058b10 msgr2=0x7efc3815c410 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:33:13.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.107+0000 7efc34ff9640 1 --2- 10.20.193.58:0/3371294228 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc38058b10 0x7efc3815c410 secure :-1 s=CLOSED pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc240029a0 tx=0x7efc2400fc10 comp rx=0 tx=0).stop 2026-02-23T06:33:13.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.107+0000 7efc34ff9640 1 -- 10.20.193.58:0/3371294228 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7efc2801f060 con 0x7efc3805d370 2026-02-23T06:33:13.107 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.108+0000 7efc34ff9640 1 --2- 10.20.193.58:0/3371294228 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efc0807a3c0 0x7efc0809a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:13.107 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.108+0000 7efc34ff9640 1 -- 10.20.193.58:0/3371294228 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7efc28014070 con 0x7efc3805d370 2026-02-23T06:33:13.107 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.108+0000 7efc37fff640 1 --2- 10.20.193.58:0/3371294228 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efc0807a3c0 0x7efc0809a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:13.107 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.109+0000 7efc37fff640 1 --2- 10.20.193.58:0/3371294228 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efc0807a3c0 0x7efc0809a870 secure :-1 s=READY pgs=300 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc240023d0 tx=0x7efc24009030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:13.108 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.111+0000 7efc3d643640 1 --2- 10.20.193.58:0/3371294228 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc381558a0 0x7efc38155ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:13.108 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.111+0000 7efc3d643640 1 -- 10.20.193.58:0/3371294228 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7efc3805ce30 con 0x7efc381558a0 2026-02-23T06:33:13.108 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.111+0000 7efc3ce42640 1 --2- 10.20.193.58:0/3371294228 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc381558a0 0x7efc38155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:13.108 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.111+0000 7efc3ce42640 1 -- 10.20.193.58:0/3371294228 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efc38159e60 con 0x7efc381558a0 2026-02-23T06:33:13.108 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.111+0000 7efc3ce42640 1 --2- 10.20.193.58:0/3371294228 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc381558a0 0x7efc38155ca0 secure :-1 s=READY pgs=212 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc2c005820 tx=0x7efc2c006cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:13.108 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.111+0000 7efc34ff9640 1 -- 10.20.193.58:0/3371294228 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc2c047070 con 0x7efc381558a0 2026-02-23T06:33:13.108 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.112+0000 7efc34ff9640 1 -- 10.20.193.58:0/3371294228 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5555 (secure 0 0 0) 0x7efc2c03f040 con 0x7efc381558a0 2026-02-23T06:33:13.108 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.112+0000 7efc34ff9640 1 -- 10.20.193.58:0/3371294228 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc381558a0 msgr2=0x7efc38155ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:13.108 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.112+0000 7efc34ff9640 1 --2- 10.20.193.58:0/3371294228 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc381558a0 0x7efc38155ca0 secure :-1 s=READY pgs=212 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc2c005820 tx=0x7efc2c006cd0 comp rx=0 tx=0).stop 2026-02-23T06:33:13.108 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.112+0000 7efc34ff9640 1 -- 10.20.193.58:0/3371294228 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc381558a0 msgr2=0x7efc38155ca0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:33:13.108 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.112+0000 7efc34ff9640 1 --2- 10.20.193.58:0/3371294228 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc381558a0 0x7efc38155ca0 secure :-1 s=CLOSED pgs=212 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc2c005820 tx=0x7efc2c006cd0 comp rx=0 tx=0).stop 2026-02-23T06:33:13.109 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:33:13.109 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:33:13.109 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:33:13.109 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:33:13.109 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 98, 2026-02-23T06:33:13.109 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 467623, 2026-02-23T06:33:13.109 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:33:13.109 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:33:13.110 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:33:13.110 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:33:13.110 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:13.110 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:33:13.110 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:33:13.110 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:33:13.110 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:33:13.110 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:13.110 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:13.110 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:13.110 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:13.111 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:13.111 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:13.111 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:13.111 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:13.111 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:13.111 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:13.111 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:13.111 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:13.111 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:13.111 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:13.111 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:33:13.111 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:33:13.111 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:13.112 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:13.112 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:13.112 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:13.112 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:13.112 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:13.112 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:13.112 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:13.112 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:13.112 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:13.112 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:13.112 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:13.112 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:13.112 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:13.113 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:13.113 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:33:13.113 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:33:13.113 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:33:13.113 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:33:13.113 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:33:13.113 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:33:13.113 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:33:13.113 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:33:13.113 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:33:13.114 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:33:13.114 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:33:13.114 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:33:13.114 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:33:13.114 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:33:13.114 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:33:13.114 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:33:13.114 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:33:13.114 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:13.114 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:13.114 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:13.115 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:13.115 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:13.115 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:13.115 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:13.115 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:13.115 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:13.115 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:13.115 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:13.115 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:13.115 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:13.115 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:13.115 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:33:13.116 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:13.116 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:33:13.116 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:13.116 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:33:13.116 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:33:13.116 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:13.116 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:13.116 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:13.116 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:13.116 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:33:13.116 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:13.116 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:13.117 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:13.117 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:13.117 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:33:13.117 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:13.117 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:13.117 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:13.117 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:13.117 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:33:13.117 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:33:13.117 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:13.118 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:13.118 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:33:13.118 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:13.118 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:13.118 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:13.118 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:33:13.118 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:33:13.118 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:13.118 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:13.118 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:13.118 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:13.118 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:33:13.119 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:13.119 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:13.119 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:13.119 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:13.119 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:33:13.119 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:13.119 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:13.119 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:13.119 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:13.119 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:33:13.120 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:33:13.120 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:13.120 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:13.120 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:33:13.120 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:13.120 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:13.120 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:13.120 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:33:13.120 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:33:13.120 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:13.120 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:13.121 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:13.121 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:13.121 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:33:13.121 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:13.121 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:13.121 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:13.121 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:13.121 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:33:13.121 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:13.121 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:13.122 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:13.122 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:13.122 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:33:13.122 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:33:13.122 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:13.122 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:13.122 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:33:13.122 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:13.122 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:13.122 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:13.122 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:13.123 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:33:13.123 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:33:13.123 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:13.123 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:13.123 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:13.123 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:33:13.123 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:13.123 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:13.123 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:33:13.123 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:13.124 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:13.124 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:13.124 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:33:13.124 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:13.124 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:13.124 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:33:13.124 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:13.124 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:13.124 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:13.124 INFO:teuthology.orchestra.run.trial058.stdout: "num": 8 2026-02-23T06:33:13.124 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:13.124 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:13.125 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:33:13.125 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:13.125 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:33:13.125 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:33:13.125 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:33:13.125 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:13.125 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:13.125 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:13.125 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:13.125 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:33:13.126 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:13.126 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:13.126 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:33:13.126 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:13.126 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:13.126 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:13.126 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:33:13.126 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:13.126 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:13.126 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:13.126 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:33:13.127 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:33:13.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.112+0000 7efc3d643640 1 -- 10.20.193.58:0/3371294228 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efc0807a3c0 msgr2=0x7efc0809a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:13.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.112+0000 7efc3d643640 1 --2- 10.20.193.58:0/3371294228 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efc0807a3c0 0x7efc0809a870 secure :-1 s=READY pgs=300 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc240023d0 tx=0x7efc24009030 comp rx=0 tx=0).stop 2026-02-23T06:33:13.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.112+0000 7efc3d643640 1 -- 10.20.193.58:0/3371294228 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc3805d370 msgr2=0x7efc38201590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:13.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.112+0000 7efc3d643640 1 --2- 10.20.193.58:0/3371294228 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc3805d370 0x7efc38201590 secure :-1 s=READY pgs=210 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc28009480 tx=0x7efc2800ee60 comp rx=0 tx=0).stop 2026-02-23T06:33:13.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.112+0000 7efc3ce42640 1 -- 10.20.193.58:0/3371294228 reap_dead start 2026-02-23T06:33:13.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.112+0000 7efc3d643640 1 -- 10.20.193.58:0/3371294228 shutdown_connections 2026-02-23T06:33:13.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.112+0000 7efc3d643640 1 --2- 10.20.193.58:0/3371294228 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc3805d370 0x7efc38201590 unknown :-1 s=CLOSED pgs=210 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:13.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.112+0000 7efc3d643640 1 -- 10.20.193.58:0/3371294228 >> 10.20.193.58:0/3371294228 conn(0x7efc380b3c20 msgr2=0x7efc380b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:13.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.112+0000 7efc3d643640 1 -- 10.20.193.58:0/3371294228 shutdown_connections 2026-02-23T06:33:13.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.112+0000 7efc3d643640 1 -- 10.20.193.58:0/3371294228 wait complete. 2026-02-23T06:33:13.130 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:33:13.130 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:33:13.130 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:33:13.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.256+0000 7fdbd2c43640 1 -- 10.20.193.58:0/2273743036 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdbcc15d4a0 msgr2=0x7fdbcc0affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:13.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.256+0000 7fdbd2c43640 1 --2- 10.20.193.58:0/2273743036 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdbcc15d4a0 0x7fdbcc0affb0 secure :-1 s=READY pgs=8 gs=2 cs=0 l=1 c_cookie=10992214371655512248 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdbbc005e70 tx=0x7fdbbc02f290 comp rx=0 tx=0).stop 2026-02-23T06:33:13.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.256+0000 7fdbd2c43640 1 -- 10.20.193.58:0/2273743036 shutdown_connections 2026-02-23T06:33:13.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.256+0000 7fdbd2c43640 1 --2- 10.20.193.58:0/2273743036 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdbcc15d870 0x7fdbcc0587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:13.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.256+0000 7fdbd2c43640 1 --2- 10.20.193.58:0/2273743036 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdbcc15d4a0 0x7fdbcc0affb0 unknown :-1 s=CLOSED pgs=8 gs=2 cs=0 l=1 c_cookie=10992214371655512248 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:13.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.256+0000 7fdbd2c43640 1 -- 10.20.193.58:0/2273743036 >> 10.20.193.58:0/2273743036 conn(0x7fdbcc0b3c20 msgr2=0x7fdbcc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:13.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.256+0000 7fdbd2c43640 1 -- 10.20.193.58:0/2273743036 shutdown_connections 2026-02-23T06:33:13.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.256+0000 7fdbd2c43640 1 -- 10.20.193.58:0/2273743036 wait complete. 2026-02-23T06:33:13.252 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.257+0000 7fdbd2c43640 1 Processor -- start 2026-02-23T06:33:13.252 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.257+0000 7fdbd2c43640 1 -- start start 2026-02-23T06:33:13.252 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.258+0000 7fdbd2c43640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdbcc0b6690 0x7fdbcc14b940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:13.253 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:33:13.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.258+0000 7fdbd2c43640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdbcc15d4a0 0x7fdbcc11e400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:13.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.258+0000 7fdbd2c43640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdbcc15d870 0x7fdbcc11e940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:13.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.258+0000 7fdbd2c43640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc14b520 con 0x7fdbcc15d870 2026-02-23T06:33:13.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.258+0000 7fdbd2c43640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc13e8d0 con 0x7fdbcc0b6690 2026-02-23T06:33:13.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.258+0000 7fdbd2c43640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fdbcc13d030 con 0x7fdbcc15d4a0 2026-02-23T06:33:13.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.258+0000 7fdbd2442640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdbcc15d870 0x7fdbcc11e940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:13.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.258+0000 7fdbd1440640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdbcc15d4a0 0x7fdbcc11e400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:13.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.258+0000 7fdbd1440640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdbcc15d4a0 0x7fdbcc11e400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:38748/0 (socket says 10.20.193.58:38748) 2026-02-23T06:33:13.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.258+0000 7fdbd1440640 1 -- 10.20.193.58:0/3756893402 learned_addr learned my addr 10.20.193.58:0/3756893402 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:33:13.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.259+0000 7fdbd1c41640 1 --2- 10.20.193.58:0/3756893402 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdbcc0b6690 0x7fdbcc14b940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:13.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.259+0000 7fdbd1440640 1 -- 10.20.193.58:0/3756893402 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdbcc0b6690 msgr2=0x7fdbcc14b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:13.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.259+0000 7fdbd1440640 1 --2- 10.20.193.58:0/3756893402 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdbcc0b6690 0x7fdbcc14b940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:13.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.259+0000 7fdbd1440640 1 -- 10.20.193.58:0/3756893402 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdbcc15d870 msgr2=0x7fdbcc11e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:13.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.259+0000 7fdbd1440640 1 --2- 10.20.193.58:0/3756893402 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdbcc15d870 0x7fdbcc11e940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:13.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.259+0000 7fdbd1440640 1 -- 10.20.193.58:0/3756893402 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbbc009570 con 0x7fdbcc15d4a0 2026-02-23T06:33:13.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.259+0000 7fdbd1c41640 1 --2- 10.20.193.58:0/3756893402 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdbcc0b6690 0x7fdbcc14b940 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:33:13.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.259+0000 7fdbd2442640 1 --2- 10.20.193.58:0/3756893402 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdbcc15d870 0x7fdbcc11e940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:33:13.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.259+0000 7fdbd1440640 1 --2- 10.20.193.58:0/3756893402 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdbcc15d4a0 0x7fdbcc11e400 secure :-1 s=READY pgs=213 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdbc000d950 tx=0x7fdbc000de20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:13.257 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:33:13.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.259+0000 7fdbba7fc640 1 -- 10.20.193.58:0/3756893402 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdbc0004500 con 0x7fdbcc15d4a0 2026-02-23T06:33:13.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.259+0000 7fdbd2c43640 1 -- 10.20.193.58:0/3756893402 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbcc11c7f0 con 0x7fdbcc15d4a0 2026-02-23T06:33:13.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.259+0000 7fdbba7fc640 1 -- 10.20.193.58:0/3756893402 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbc0004940 con 0x7fdbcc15d4a0 2026-02-23T06:33:13.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.259+0000 7fdbba7fc640 1 -- 10.20.193.58:0/3756893402 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdbc0004d70 con 0x7fdbcc15d4a0 2026-02-23T06:33:13.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.259+0000 7fdbd2c43640 1 -- 10.20.193.58:0/3756893402 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbcc13d280 con 0x7fdbcc15d4a0 2026-02-23T06:33:13.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.260+0000 7fdbd2c43640 1 -- 10.20.193.58:0/3756893402 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbcc0b6d50 con 0x7fdbcc15d4a0 2026-02-23T06:33:13.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.261+0000 7fdbba7fc640 1 -- 10.20.193.58:0/3756893402 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fdbc00097c0 con 0x7fdbcc15d4a0 2026-02-23T06:33:13.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.263+0000 7fdbba7fc640 1 --2- 10.20.193.58:0/3756893402 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdb9c07a6c0 0x7fdb9c09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:13.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.263+0000 7fdbba7fc640 1 -- 10.20.193.58:0/3756893402 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fdbc009e090 con 0x7fdbcc15d4a0 2026-02-23T06:33:13.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.263+0000 7fdbba7fc640 1 -- 10.20.193.58:0/3756893402 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fdbc0061260 con 0x7fdbcc15d4a0 2026-02-23T06:33:13.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.263+0000 7fdbd1c41640 1 --2- 10.20.193.58:0/3756893402 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdb9c07a6c0 0x7fdb9c09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:13.259 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.264+0000 7fdbd1c41640 1 --2- 10.20.193.58:0/3756893402 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdb9c07a6c0 0x7fdb9c09ab70 secure :-1 s=READY pgs=301 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdbbc005f70 tx=0x7fdbbc031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:13.413 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.417+0000 7fdbd2c43640 1 -- 10.20.193.58:0/3756893402 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fdbcc14b660 con 0x7fdbcc15d4a0 2026-02-23T06:33:13.413 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.418+0000 7fdbba7fc640 1 -- 10.20.193.58:0/3756893402 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fdbcc14b660 con 0x7fdbcc15d4a0 2026-02-23T06:33:13.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.420+0000 7fdbd2c43640 1 -- 10.20.193.58:0/3756893402 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdb9c07a6c0 msgr2=0x7fdb9c09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:13.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.420+0000 7fdbd2c43640 1 --2- 10.20.193.58:0/3756893402 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdb9c07a6c0 0x7fdb9c09ab70 secure :-1 s=READY pgs=301 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdbbc005f70 tx=0x7fdbbc031040 comp rx=0 tx=0).stop 2026-02-23T06:33:13.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.420+0000 7fdbd2c43640 1 -- 10.20.193.58:0/3756893402 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdbcc15d4a0 msgr2=0x7fdbcc11e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:13.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.420+0000 7fdbd2c43640 1 --2- 10.20.193.58:0/3756893402 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdbcc15d4a0 0x7fdbcc11e400 secure :-1 s=READY pgs=213 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdbc000d950 tx=0x7fdbc000de20 comp rx=0 tx=0).stop 2026-02-23T06:33:13.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.420+0000 7fdbd2c43640 1 -- 10.20.193.58:0/3756893402 shutdown_connections 2026-02-23T06:33:13.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.420+0000 7fdbd2c43640 1 --2- 10.20.193.58:0/3756893402 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdb9c07a6c0 0x7fdb9c09ab70 unknown :-1 s=CLOSED pgs=301 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:13.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.420+0000 7fdbd2c43640 1 --2- 10.20.193.58:0/3756893402 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdbcc15d870 0x7fdbcc11e940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:13.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.420+0000 7fdbd2c43640 1 --2- 10.20.193.58:0/3756893402 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdbcc15d4a0 0x7fdbcc11e400 unknown :-1 s=CLOSED pgs=213 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:13.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.420+0000 7fdbd2c43640 1 --2- 10.20.193.58:0/3756893402 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdbcc0b6690 0x7fdbcc14b940 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:13.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.420+0000 7fdbd2c43640 1 -- 10.20.193.58:0/3756893402 >> 10.20.193.58:0/3756893402 conn(0x7fdbcc0b3c20 msgr2=0x7fdbcc15c810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:13.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.420+0000 7fdbd2c43640 1 -- 10.20.193.58:0/3756893402 shutdown_connections 2026-02-23T06:33:13.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:13.420+0000 7fdbd2c43640 1 -- 10.20.193.58:0/3756893402 wait complete. 2026-02-23T06:33:13.427 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:33:23.429 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:33:23.429 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:33:23.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.555+0000 7f8c21d64640 1 -- 10.20.193.58:0/1699858942 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8c1c15c040 msgr2=0x7f8c1c05b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:23.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.555+0000 7f8c21d64640 1 --2- 10.20.193.58:0/1699858942 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8c1c15c040 0x7f8c1c05b0e0 secure :-1 s=READY pgs=80 gs=2 cs=0 l=1 c_cookie=13340112555484302145 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c0c005e70 tx=0x7f8c0c02f290 comp rx=0 tx=0).stop 2026-02-23T06:33:23.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.555+0000 7f8c21d64640 1 -- 10.20.193.58:0/1699858942 shutdown_connections 2026-02-23T06:33:23.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.555+0000 7f8c21d64640 1 --2- 10.20.193.58:0/1699858942 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8c1c056550 0x7f8c1c05ce30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:23.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.555+0000 7f8c21d64640 1 --2- 10.20.193.58:0/1699858942 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8c1c15c040 0x7f8c1c05b0e0 unknown :-1 s=CLOSED pgs=80 gs=2 cs=0 l=1 c_cookie=13340112555484302145 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:23.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.555+0000 7f8c21d64640 1 -- 10.20.193.58:0/1699858942 >> 10.20.193.58:0/1699858942 conn(0x7f8c1c0b3c20 msgr2=0x7f8c1c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:23.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.555+0000 7f8c21d64640 1 -- 10.20.193.58:0/1699858942 shutdown_connections 2026-02-23T06:33:23.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.555+0000 7f8c21d64640 1 -- 10.20.193.58:0/1699858942 wait complete. 2026-02-23T06:33:23.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.556+0000 7f8c21d64640 1 Processor -- start 2026-02-23T06:33:23.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.556+0000 7f8c21d64640 1 -- start start 2026-02-23T06:33:23.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.557+0000 7f8c21d64640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8c1c056550 0x7f8c1c130e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:23.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.557+0000 7f8c21d64640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8c1c05d370 0x7f8c1c1360e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:23.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.557+0000 7f8c21d64640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8c1c15c040 0x7f8c1c155a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:23.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.557+0000 7f8c21d64640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c136620 con 0x7f8c1c05d370 2026-02-23T06:33:23.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.557+0000 7f8c21d64640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c059370 con 0x7f8c1c056550 2026-02-23T06:33:23.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.557+0000 7f8c21d64640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f8c1c138840 con 0x7f8c1c15c040 2026-02-23T06:33:23.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.557+0000 7f8c20d62640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8c1c056550 0x7f8c1c130e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:23.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.557+0000 7f8c13fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8c1c05d370 0x7f8c1c1360e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:23.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.557+0000 7f8c20d62640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8c1c056550 0x7f8c1c130e80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:57072/0 (socket says 10.20.193.58:57072) 2026-02-23T06:33:23.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.557+0000 7f8c20d62640 1 -- 10.20.193.58:0/621057293 learned_addr learned my addr 10.20.193.58:0/621057293 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:33:23.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.557+0000 7f8c21563640 1 --2- 10.20.193.58:0/621057293 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8c1c15c040 0x7f8c1c155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:23.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.558+0000 7f8c13fff640 1 -- 10.20.193.58:0/621057293 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8c1c15c040 msgr2=0x7f8c1c155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:23.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.558+0000 7f8c13fff640 1 --2- 10.20.193.58:0/621057293 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8c1c15c040 0x7f8c1c155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:23.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.558+0000 7f8c13fff640 1 -- 10.20.193.58:0/621057293 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8c1c056550 msgr2=0x7f8c1c130e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:23.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.558+0000 7f8c13fff640 1 --2- 10.20.193.58:0/621057293 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8c1c056550 0x7f8c1c130e80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:23.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.558+0000 7f8c13fff640 1 -- 10.20.193.58:0/621057293 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c040094b0 con 0x7f8c1c05d370 2026-02-23T06:33:23.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.558+0000 7f8c21563640 1 --2- 10.20.193.58:0/621057293 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8c1c15c040 0x7f8c1c155a20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:33:23.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.558+0000 7f8c13fff640 1 --2- 10.20.193.58:0/621057293 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8c1c05d370 0x7f8c1c1360e0 secure :-1 s=READY pgs=10 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c040046a0 tx=0x7f8c04002b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:23.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.558+0000 7f8c117fa640 1 -- 10.20.193.58:0/621057293 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c0400eac0 con 0x7f8c1c05d370 2026-02-23T06:33:23.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.558+0000 7f8c117fa640 1 -- 10.20.193.58:0/621057293 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c0400ed10 con 0x7f8c1c05d370 2026-02-23T06:33:23.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.558+0000 7f8c21d64640 1 -- 10.20.193.58:0/621057293 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c0c009570 con 0x7f8c1c05d370 2026-02-23T06:33:23.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.558+0000 7f8c117fa640 1 -- 10.20.193.58:0/621057293 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c04004ad0 con 0x7f8c1c05d370 2026-02-23T06:33:23.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.558+0000 7f8c21d64640 1 -- 10.20.193.58:0/621057293 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c1c130960 con 0x7f8c1c05d370 2026-02-23T06:33:23.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.559+0000 7f8c21d64640 1 -- 10.20.193.58:0/621057293 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c1c05ce30 con 0x7f8c1c05d370 2026-02-23T06:33:23.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.560+0000 7f8c117fa640 1 -- 10.20.193.58:0/621057293 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f8c04016070 con 0x7f8c1c05d370 2026-02-23T06:33:23.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.561+0000 7f8c117fa640 1 --2- 10.20.193.58:0/621057293 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8bec07a6b0 0x7f8bec09ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:23.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.561+0000 7f8c117fa640 1 -- 10.20.193.58:0/621057293 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f8c0409e250 con 0x7f8c1c05d370 2026-02-23T06:33:23.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.561+0000 7f8c20d62640 1 --2- 10.20.193.58:0/621057293 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8bec07a6b0 0x7f8bec09ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:23.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.562+0000 7f8c20d62640 1 --2- 10.20.193.58:0/621057293 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8bec07a6b0 0x7f8bec09ab60 secure :-1 s=READY pgs=302 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c0c0098a0 tx=0x7f8c0c03a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:23.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.562+0000 7f8c117fa640 1 -- 10.20.193.58:0/621057293 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f8c040614b0 con 0x7f8c1c05d370 2026-02-23T06:33:23.712 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.717+0000 7f8c21d64640 1 -- 10.20.193.58:0/621057293 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8c1c056330 con 0x7f8c1c05d370 2026-02-23T06:33:23.712 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.717+0000 7f8c117fa640 1 -- 10.20.193.58:0/621057293 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f8c040645d0 con 0x7f8c1c05d370 2026-02-23T06:33:23.712 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":98,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:33:23.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.719+0000 7f8c21d64640 1 -- 10.20.193.58:0/621057293 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8bec07a6b0 msgr2=0x7f8bec09ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:23.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.719+0000 7f8c21d64640 1 --2- 10.20.193.58:0/621057293 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8bec07a6b0 0x7f8bec09ab60 secure :-1 s=READY pgs=302 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c0c0098a0 tx=0x7f8c0c03a040 comp rx=0 tx=0).stop 2026-02-23T06:33:23.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.719+0000 7f8c21d64640 1 -- 10.20.193.58:0/621057293 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8c1c05d370 msgr2=0x7f8c1c1360e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:23.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.719+0000 7f8c21d64640 1 --2- 10.20.193.58:0/621057293 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8c1c05d370 0x7f8c1c1360e0 secure :-1 s=READY pgs=10 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c040046a0 tx=0x7f8c04002b40 comp rx=0 tx=0).stop 2026-02-23T06:33:23.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.719+0000 7f8c21d64640 1 -- 10.20.193.58:0/621057293 shutdown_connections 2026-02-23T06:33:23.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.719+0000 7f8c21d64640 1 --2- 10.20.193.58:0/621057293 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8bec07a6b0 0x7f8bec09ab60 unknown :-1 s=CLOSED pgs=302 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:23.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.719+0000 7f8c21d64640 1 --2- 10.20.193.58:0/621057293 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8c1c15c040 0x7f8c1c155a20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:23.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.719+0000 7f8c21d64640 1 --2- 10.20.193.58:0/621057293 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8c1c05d370 0x7f8c1c1360e0 unknown :-1 s=CLOSED pgs=10 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:23.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.719+0000 7f8c21d64640 1 --2- 10.20.193.58:0/621057293 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8c1c056550 0x7f8c1c130e80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:23.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.719+0000 7f8c21d64640 1 -- 10.20.193.58:0/621057293 >> 10.20.193.58:0/621057293 conn(0x7f8c1c0b3c20 msgr2=0x7f8c1c0b5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:23.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.719+0000 7f8c21d64640 1 -- 10.20.193.58:0/621057293 shutdown_connections 2026-02-23T06:33:23.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.719+0000 7f8c21d64640 1 -- 10.20.193.58:0/621057293 wait complete. 2026-02-23T06:33:23.725 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:33:23.726 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:33:23.726 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:33:23.726 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:33:23.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.854+0000 7f3e1ee83640 1 -- 10.20.193.58:0/331022816 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3e18056960 msgr2=0x7f3e18058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:23.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.854+0000 7f3e1ee83640 1 --2- 10.20.193.58:0/331022816 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3e18056960 0x7f3e18058200 secure :-1 s=READY pgs=12 gs=3 cs=0 l=1 c_cookie=15488289142691018817 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e0c004740 tx=0x7f3e0c02f230 comp rx=0 tx=0).stop 2026-02-23T06:33:23.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.854+0000 7f3e1ee83640 1 -- 10.20.193.58:0/331022816 shutdown_connections 2026-02-23T06:33:23.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.854+0000 7f3e1ee83640 1 --2- 10.20.193.58:0/331022816 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3e18056960 0x7f3e18058200 unknown :-1 s=CLOSED pgs=12 gs=3 cs=0 l=1 c_cookie=15488289142691018817 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:23.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.854+0000 7f3e1ee83640 1 -- 10.20.193.58:0/331022816 >> 10.20.193.58:0/331022816 conn(0x7f3e180b3c20 msgr2=0x7f3e180b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:23.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.854+0000 7f3e1ee83640 1 -- 10.20.193.58:0/331022816 shutdown_connections 2026-02-23T06:33:23.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.854+0000 7f3e1ee83640 1 -- 10.20.193.58:0/331022816 wait complete. 2026-02-23T06:33:23.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.855+0000 7f3e1ee83640 1 Processor -- start 2026-02-23T06:33:23.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.855+0000 7f3e1ee83640 1 -- start start 2026-02-23T06:33:23.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.856+0000 7f3e1ee83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3e18056960 0x7f3e180b0380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:23.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.856+0000 7f3e1ee83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3e1815c4b0 0x7f3e1815d040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:23.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.856+0000 7f3e1ee83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3e18162ca0 0x7f3e1815d580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:23.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.856+0000 7f3e1ee83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f3e18159b20 con 0x7f3e1815c4b0 2026-02-23T06:33:23.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.856+0000 7f3e1ee83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f3e181fd700 con 0x7f3e18162ca0 2026-02-23T06:33:23.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.856+0000 7f3e1ee83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f3e1815f8e0 con 0x7f3e18056960 2026-02-23T06:33:23.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.856+0000 7f3e1d680640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3e1815c4b0 0x7f3e1815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:23.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.856+0000 7f3e1d680640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3e1815c4b0 0x7f3e1815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:48356/0 (socket says 10.20.193.58:48356) 2026-02-23T06:33:23.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.856+0000 7f3e1d680640 1 -- 10.20.193.58:0/3740863881 learned_addr learned my addr 10.20.193.58:0/3740863881 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:33:23.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.856+0000 7f3e1e682640 1 --2- 10.20.193.58:0/3740863881 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3e18162ca0 0x7f3e1815d580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:23.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.856+0000 7f3e1de81640 1 --2- 10.20.193.58:0/3740863881 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3e18056960 0x7f3e180b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:23.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.856+0000 7f3e1d680640 1 -- 10.20.193.58:0/3740863881 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3e18056960 msgr2=0x7f3e180b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:23.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.856+0000 7f3e1d680640 1 --2- 10.20.193.58:0/3740863881 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3e18056960 0x7f3e180b0380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:23.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.856+0000 7f3e1d680640 1 -- 10.20.193.58:0/3740863881 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3e18162ca0 msgr2=0x7f3e1815d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:23.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.856+0000 7f3e1d680640 1 --2- 10.20.193.58:0/3740863881 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3e18162ca0 0x7f3e1815d580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:23.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.856+0000 7f3e1d680640 1 -- 10.20.193.58:0/3740863881 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0c0094b0 con 0x7f3e1815c4b0 2026-02-23T06:33:23.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.856+0000 7f3e1d680640 1 --2- 10.20.193.58:0/3740863881 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3e1815c4b0 0x7f3e1815d040 secure :-1 s=READY pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e0c0023d0 tx=0x7f3e0c002cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:23.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.856+0000 7f3e067fc640 1 -- 10.20.193.58:0/3740863881 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e0c0388a0 con 0x7f3e1815c4b0 2026-02-23T06:33:23.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.856+0000 7f3e067fc640 1 -- 10.20.193.58:0/3740863881 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e0c038af0 con 0x7f3e1815c4b0 2026-02-23T06:33:23.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.856+0000 7f3e067fc640 1 -- 10.20.193.58:0/3740863881 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e0c02fcd0 con 0x7f3e1815c4b0 2026-02-23T06:33:23.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.856+0000 7f3e1ee83640 1 -- 10.20.193.58:0/3740863881 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e181fd930 con 0x7f3e1815c4b0 2026-02-23T06:33:23.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.857+0000 7f3e1ee83640 1 -- 10.20.193.58:0/3740863881 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e181fdef0 con 0x7f3e1815c4b0 2026-02-23T06:33:23.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.857+0000 7f3e1ee83640 1 --2- 10.20.193.58:0/3740863881 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3e180b08c0 0x7f3e18139f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:23.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.857+0000 7f3e1ee83640 1 -- 10.20.193.58:0/3740863881 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f3e18059690 con 0x7f3e180b08c0 2026-02-23T06:33:23.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.857+0000 7f3e1de81640 1 --2- 10.20.193.58:0/3740863881 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3e180b08c0 0x7f3e18139f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:23.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.858+0000 7f3e1de81640 1 -- 10.20.193.58:0/3740863881 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3e180593b0 con 0x7f3e180b08c0 2026-02-23T06:33:23.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.858+0000 7f3e1de81640 1 --2- 10.20.193.58:0/3740863881 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3e180b08c0 0x7f3e18139f60 secure :-1 s=READY pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e08002730 tx=0x7f3e0800e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:23.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.858+0000 7f3e067fc640 1 -- 10.20.193.58:0/3740863881 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e08017070 con 0x7f3e180b08c0 2026-02-23T06:33:23.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.858+0000 7f3e067fc640 1 -- 10.20.193.58:0/3740863881 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f3e08002d80 con 0x7f3e180b08c0 2026-02-23T06:33:23.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.858+0000 7f3e067fc640 1 -- 10.20.193.58:0/3740863881 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3e180b08c0 msgr2=0x7f3e18139f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:23.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.858+0000 7f3e067fc640 1 --2- 10.20.193.58:0/3740863881 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3e180b08c0 0x7f3e18139f60 secure :-1 s=READY pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e08002730 tx=0x7f3e0800e970 comp rx=0 tx=0).stop 2026-02-23T06:33:23.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.858+0000 7f3e067fc640 1 -- 10.20.193.58:0/3740863881 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3e180b08c0 msgr2=0x7f3e18139f60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:33:23.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.858+0000 7f3e067fc640 1 --2- 10.20.193.58:0/3740863881 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3e180b08c0 0x7f3e18139f60 unknown :-1 s=CLOSED pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:23.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.858+0000 7f3e067fc640 1 -- 10.20.193.58:0/3740863881 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f3e0c040420 con 0x7f3e1815c4b0 2026-02-23T06:33:23.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.859+0000 7f3e067fc640 1 --2- 10.20.193.58:0/3740863881 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3de807a3c0 0x7f3de809a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:23.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.859+0000 7f3e067fc640 1 -- 10.20.193.58:0/3740863881 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f3e0c0c2cd0 con 0x7f3e1815c4b0 2026-02-23T06:33:23.854 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.859+0000 7f3e1de81640 1 --2- 10.20.193.58:0/3740863881 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3de807a3c0 0x7f3de809a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:23.855 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.860+0000 7f3e1de81640 1 --2- 10.20.193.58:0/3740863881 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3de807a3c0 0x7f3de809a870 secure :-1 s=READY pgs=303 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e08002730 tx=0x7f3e08004000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:23.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.862+0000 7f3e1ee83640 1 --2- 10.20.193.58:0/3740863881 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3e181fe110 0x7f3e1813a4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:23.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.862+0000 7f3e1ee83640 1 -- 10.20.193.58:0/3740863881 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1813b640 con 0x7f3e181fe110 2026-02-23T06:33:23.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.862+0000 7f3e1e682640 1 --2- 10.20.193.58:0/3740863881 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3e181fe110 0x7f3e1813a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:23.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.862+0000 7f3e1e682640 1 -- 10.20.193.58:0/3740863881 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3e1813b920 con 0x7f3e181fe110 2026-02-23T06:33:23.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.862+0000 7f3e1e682640 1 --2- 10.20.193.58:0/3740863881 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3e181fe110 0x7f3e1813a4a0 secure :-1 s=READY pgs=15 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e14005850 tx=0x7f3e14010ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:23.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.862+0000 7f3e067fc640 1 -- 10.20.193.58:0/3740863881 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e1400e920 con 0x7f3e181fe110 2026-02-23T06:33:23.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.863+0000 7f3e067fc640 1 -- 10.20.193.58:0/3740863881 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4913 (secure 0 0 0) 0x7f3e1400ea80 con 0x7f3e181fe110 2026-02-23T06:33:23.857 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:33:23.858 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:33:23.858 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:33:23.858 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:33:23.858 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 98, 2026-02-23T06:33:23.858 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 11374, 2026-02-23T06:33:23.858 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:33:23.858 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:33:23.858 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:33:23.858 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:33:23.858 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:23.858 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:33:23.858 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:33:23.858 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:33:23.858 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:33:23.858 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:23.858 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:23.858 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:23.858 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:23.858 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:23.858 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:23.858 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:23.858 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:23.858 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:23.858 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:23.859 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:23.859 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:23.859 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:23.859 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:23.859 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:33:23.859 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:33:23.859 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:23.859 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:23.859 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:23.859 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:23.859 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:23.859 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:23.859 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:23.859 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:23.859 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:23.859 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:23.859 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:23.859 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:23.859 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:23.859 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:23.859 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:23.859 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:33:23.859 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:33:23.859 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:33:23.859 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:33:23.860 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:33:23.861 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:23.862 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:23.863 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:23.864 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:33:23.864 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:33:23.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.863+0000 7f3e067fc640 1 -- 10.20.193.58:0/3740863881 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3e181fe110 msgr2=0x7f3e1813a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:23.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.863+0000 7f3e067fc640 1 --2- 10.20.193.58:0/3740863881 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3e181fe110 0x7f3e1813a4a0 secure :-1 s=READY pgs=15 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e14005850 tx=0x7f3e14010ba0 comp rx=0 tx=0).stop 2026-02-23T06:33:23.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.863+0000 7f3e067fc640 1 -- 10.20.193.58:0/3740863881 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3e181fe110 msgr2=0x7f3e1813a4a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:33:23.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.863+0000 7f3e067fc640 1 --2- 10.20.193.58:0/3740863881 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3e181fe110 0x7f3e1813a4a0 unknown :-1 s=CLOSED pgs=15 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:23.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.863+0000 7f3e1ee83640 1 -- 10.20.193.58:0/3740863881 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3de807a3c0 msgr2=0x7f3de809a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:23.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.863+0000 7f3e1ee83640 1 --2- 10.20.193.58:0/3740863881 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3de807a3c0 0x7f3de809a870 secure :-1 s=READY pgs=303 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e08002730 tx=0x7f3e08004000 comp rx=0 tx=0).stop 2026-02-23T06:33:23.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.863+0000 7f3e1ee83640 1 -- 10.20.193.58:0/3740863881 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3e1815c4b0 msgr2=0x7f3e1815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:23.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.863+0000 7f3e1ee83640 1 --2- 10.20.193.58:0/3740863881 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3e1815c4b0 0x7f3e1815d040 secure :-1 s=READY pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e0c0023d0 tx=0x7f3e0c002cc0 comp rx=0 tx=0).stop 2026-02-23T06:33:23.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.863+0000 7f3e1e682640 1 -- 10.20.193.58:0/3740863881 reap_dead start 2026-02-23T06:33:23.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.863+0000 7f3e1e682640 1 -- 10.20.193.58:0/3740863881 reap_dead start 2026-02-23T06:33:23.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.863+0000 7f3e1ee83640 1 -- 10.20.193.58:0/3740863881 shutdown_connections 2026-02-23T06:33:23.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.863+0000 7f3e1ee83640 1 -- 10.20.193.58:0/3740863881 >> 10.20.193.58:0/3740863881 conn(0x7f3e180b3c20 msgr2=0x7f3e18160da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:23.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.863+0000 7f3e1ee83640 1 -- 10.20.193.58:0/3740863881 shutdown_connections 2026-02-23T06:33:23.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.863+0000 7f3e1ee83640 1 -- 10.20.193.58:0/3740863881 wait complete. 2026-02-23T06:33:23.865 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:33:23.865 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:33:23.865 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:33:23.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.996+0000 7efe32d39640 1 -- 10.20.193.58:0/2821521772 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efe2c15d4a0 msgr2=0x7efe2c0affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:23.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.996+0000 7efe32d39640 1 --2- 10.20.193.58:0/2821521772 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efe2c15d4a0 0x7efe2c0affb0 secure :-1 s=READY pgs=17 gs=3 cs=0 l=1 c_cookie=17453955438867273550 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe1c005e70 tx=0x7efe1c02f290 comp rx=0 tx=0).stop 2026-02-23T06:33:23.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.996+0000 7efe32d39640 1 -- 10.20.193.58:0/2821521772 shutdown_connections 2026-02-23T06:33:23.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.996+0000 7efe32d39640 1 --2- 10.20.193.58:0/2821521772 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efe2c15d4a0 0x7efe2c0affb0 unknown :-1 s=CLOSED pgs=17 gs=3 cs=0 l=1 c_cookie=17453955438867273550 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:23.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.996+0000 7efe32d39640 1 -- 10.20.193.58:0/2821521772 >> 10.20.193.58:0/2821521772 conn(0x7efe2c0b3c20 msgr2=0x7efe2c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:23.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.996+0000 7efe32d39640 1 -- 10.20.193.58:0/2821521772 shutdown_connections 2026-02-23T06:33:23.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.996+0000 7efe32d39640 1 -- 10.20.193.58:0/2821521772 wait complete. 2026-02-23T06:33:23.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.997+0000 7efe32d39640 1 Processor -- start 2026-02-23T06:33:23.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.997+0000 7efe32d39640 1 -- start start 2026-02-23T06:33:23.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.998+0000 7efe32d39640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efe2c0b6690 0x7efe2c160440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:23.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.998+0000 7efe32d39640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efe2c15d4a0 0x7efe2c13b100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:23.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.998+0000 7efe32d39640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efe2c15d870 0x7efe2c1fda20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:23.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.998+0000 7efe32d39640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7efe2c160a30 con 0x7efe2c15d870 2026-02-23T06:33:23.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.998+0000 7efe32d39640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7efe2c200f50 con 0x7efe2c0b6690 2026-02-23T06:33:23.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.998+0000 7efe32d39640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7efe2c13cc80 con 0x7efe2c15d4a0 2026-02-23T06:33:23.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.998+0000 7efe32538640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efe2c15d870 0x7efe2c1fda20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:23.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.998+0000 7efe32538640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efe2c15d870 0x7efe2c1fda20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:48380/0 (socket says 10.20.193.58:48380) 2026-02-23T06:33:23.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.998+0000 7efe32538640 1 -- 10.20.193.58:0/2745088078 learned_addr learned my addr 10.20.193.58:0/2745088078 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:33:23.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.998+0000 7efe31d37640 1 --2- 10.20.193.58:0/2745088078 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efe2c0b6690 0x7efe2c160440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:23.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.998+0000 7efe31536640 1 --2- 10.20.193.58:0/2745088078 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efe2c15d4a0 0x7efe2c13b100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:23.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.998+0000 7efe32538640 1 -- 10.20.193.58:0/2745088078 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efe2c15d4a0 msgr2=0x7efe2c13b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:23.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.998+0000 7efe32538640 1 --2- 10.20.193.58:0/2745088078 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efe2c15d4a0 0x7efe2c13b100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:23.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.998+0000 7efe32538640 1 -- 10.20.193.58:0/2745088078 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efe2c0b6690 msgr2=0x7efe2c160440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:23.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.998+0000 7efe32538640 1 --2- 10.20.193.58:0/2745088078 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efe2c0b6690 0x7efe2c160440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:23.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.998+0000 7efe32538640 1 -- 10.20.193.58:0/2745088078 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1c009570 con 0x7efe2c15d870 2026-02-23T06:33:23.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.999+0000 7efe32538640 1 --2- 10.20.193.58:0/2745088078 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efe2c15d870 0x7efe2c1fda20 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe2800c4a0 tx=0x7efe2800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:23.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.999+0000 7efe1a7fc640 1 -- 10.20.193.58:0/2745088078 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe280054a0 con 0x7efe2c15d870 2026-02-23T06:33:23.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.999+0000 7efe1a7fc640 1 -- 10.20.193.58:0/2745088078 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe28003780 con 0x7efe2c15d870 2026-02-23T06:33:23.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.999+0000 7efe1a7fc640 1 -- 10.20.193.58:0/2745088078 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe28003b90 con 0x7efe2c15d870 2026-02-23T06:33:23.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.999+0000 7efe32d39640 1 -- 10.20.193.58:0/2745088078 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe2c2011f0 con 0x7efe2c15d870 2026-02-23T06:33:23.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.999+0000 7efe32d39640 1 -- 10.20.193.58:0/2745088078 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe2c2017b0 con 0x7efe2c15d870 2026-02-23T06:33:23.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.999+0000 7efe32d39640 1 --2- 10.20.193.58:0/2745088078 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efe2c0b0550 0x7efe2c1fdf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:23.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:23.999+0000 7efe32d39640 1 -- 10.20.193.58:0/2745088078 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7efe2c0609c0 con 0x7efe2c0b0550 2026-02-23T06:33:23.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.000+0000 7efe31d37640 1 --2- 10.20.193.58:0/2745088078 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efe2c0b0550 0x7efe2c1fdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:23.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.000+0000 7efe31d37640 1 -- 10.20.193.58:0/2745088078 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efe2c164250 con 0x7efe2c0b0550 2026-02-23T06:33:23.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.000+0000 7efe31d37640 1 --2- 10.20.193.58:0/2745088078 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efe2c0b0550 0x7efe2c1fdf60 secure :-1 s=READY pgs=83 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe1c004740 tx=0x7efe1c0028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:23.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.000+0000 7efe1a7fc640 1 -- 10.20.193.58:0/2745088078 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe1c03d050 con 0x7efe2c0b0550 2026-02-23T06:33:23.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.000+0000 7efe1a7fc640 1 -- 10.20.193.58:0/2745088078 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7efe28003cf0 con 0x7efe2c15d870 2026-02-23T06:33:23.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.001+0000 7efe1a7fc640 1 --2- 10.20.193.58:0/2745088078 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efdfc07a660 0x7efdfc09ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:23.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.001+0000 7efe1a7fc640 1 -- 10.20.193.58:0/2745088078 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7efe2809e420 con 0x7efe2c15d870 2026-02-23T06:33:23.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.001+0000 7efe1a7fc640 1 -- 10.20.193.58:0/2745088078 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7efe1c03e040 con 0x7efe2c0b0550 2026-02-23T06:33:23.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.001+0000 7efe1a7fc640 1 -- 10.20.193.58:0/2745088078 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efe2c0b0550 msgr2=0x7efe2c1fdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:23.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.001+0000 7efe1a7fc640 1 --2- 10.20.193.58:0/2745088078 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efe2c0b0550 0x7efe2c1fdf60 secure :-1 s=READY pgs=83 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe1c004740 tx=0x7efe1c0028d0 comp rx=0 tx=0).stop 2026-02-23T06:33:23.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.001+0000 7efe1a7fc640 1 -- 10.20.193.58:0/2745088078 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efe2c0b0550 msgr2=0x7efe2c1fdf60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:33:23.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.001+0000 7efe1a7fc640 1 --2- 10.20.193.58:0/2745088078 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efe2c0b0550 0x7efe2c1fdf60 unknown :-1 s=CLOSED pgs=83 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:23.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.002+0000 7efe31536640 1 --2- 10.20.193.58:0/2745088078 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efdfc07a660 0x7efdfc09ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:23.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.002+0000 7efe31536640 1 --2- 10.20.193.58:0/2745088078 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efdfc07a660 0x7efdfc09ab10 secure :-1 s=READY pgs=304 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe2c0ae930 tx=0x7efe20007de0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:24.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.005+0000 7efe32d39640 1 --2- 10.20.193.58:0/2745088078 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efe2c2019a0 0x7efe2c1622d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:24.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.005+0000 7efe32d39640 1 -- 10.20.193.58:0/2745088078 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7efe2c05b0e0 con 0x7efe2c2019a0 2026-02-23T06:33:24.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.005+0000 7efe31d37640 1 --2- 10.20.193.58:0/2745088078 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efe2c2019a0 0x7efe2c1622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:24.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.005+0000 7efe31d37640 1 -- 10.20.193.58:0/2745088078 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efe2c0b7260 con 0x7efe2c2019a0 2026-02-23T06:33:24.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.006+0000 7efe31d37640 1 --2- 10.20.193.58:0/2745088078 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efe2c2019a0 0x7efe2c1622d0 secure :-1 s=READY pgs=84 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe1c0098a0 tx=0x7efe1c009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:24.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.006+0000 7efe1a7fc640 1 -- 10.20.193.58:0/2745088078 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe1c052070 con 0x7efe2c2019a0 2026-02-23T06:33:24.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.006+0000 7efe1a7fc640 1 -- 10.20.193.58:0/2745088078 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4912 (secure 0 0 0) 0x7efe1c038e00 con 0x7efe2c2019a0 2026-02-23T06:33:24.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.006+0000 7efe1a7fc640 1 -- 10.20.193.58:0/2745088078 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efe2c2019a0 msgr2=0x7efe2c1622d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:24.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.006+0000 7efe1a7fc640 1 --2- 10.20.193.58:0/2745088078 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efe2c2019a0 0x7efe2c1622d0 secure :-1 s=READY pgs=84 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe1c0098a0 tx=0x7efe1c009310 comp rx=0 tx=0).stop 2026-02-23T06:33:24.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.006+0000 7efe1a7fc640 1 -- 10.20.193.58:0/2745088078 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efe2c2019a0 msgr2=0x7efe2c1622d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:33:24.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.006+0000 7efe1a7fc640 1 --2- 10.20.193.58:0/2745088078 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efe2c2019a0 0x7efe2c1622d0 secure :-1 s=CLOSED pgs=84 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe1c0098a0 tx=0x7efe1c009310 comp rx=0 tx=0).stop 2026-02-23T06:33:24.002 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:33:24.002 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:33:24.002 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:33:24.002 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:33:24.003 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 98, 2026-02-23T06:33:24.003 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 140582, 2026-02-23T06:33:24.003 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:33:24.003 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:33:24.003 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:33:24.003 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:33:24.003 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:24.003 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:33:24.003 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:33:24.003 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:33:24.003 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:33:24.004 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:24.004 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:24.004 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:24.004 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:24.004 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:24.004 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:24.004 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:24.004 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:24.004 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:24.004 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:24.004 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:24.004 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:24.005 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:24.005 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:24.005 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:33:24.005 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:33:24.005 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:24.005 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:24.005 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:24.005 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:24.005 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:24.005 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:24.005 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:24.005 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:24.006 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:24.006 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:24.006 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:24.006 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:24.006 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:24.006 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:24.006 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:24.006 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:33:24.006 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:33:24.006 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:33:24.006 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:33:24.006 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:33:24.007 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:33:24.007 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:33:24.007 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:33:24.007 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:33:24.007 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:33:24.007 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:33:24.007 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:33:24.007 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:33:24.007 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:33:24.007 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:33:24.007 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:33:24.007 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:33:24.008 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:24.008 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:24.008 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:24.008 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:24.008 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:24.008 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:24.008 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:24.008 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:24.008 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:24.008 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:24.008 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:24.009 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:24.009 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:24.009 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:24.009 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:33:24.009 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:24.009 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:33:24.009 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:24.009 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:33:24.009 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:33:24.009 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:24.009 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:24.009 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:24.010 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:24.010 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:33:24.010 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:24.010 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:24.010 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:24.010 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:24.010 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:33:24.010 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:24.010 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:24.010 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:24.010 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:24.010 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:33:24.011 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:33:24.011 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:24.011 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:24.011 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:33:24.011 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:24.011 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:24.011 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:24.011 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:33:24.011 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:33:24.011 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:24.011 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:24.011 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:24.012 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:24.012 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:33:24.012 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:24.012 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:24.012 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:24.012 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:24.012 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:33:24.012 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:24.012 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:24.012 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:24.012 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:24.012 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:33:24.013 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:33:24.013 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:24.013 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:24.013 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:33:24.013 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:24.013 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:24.013 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:24.013 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:33:24.013 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:33:24.013 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:24.013 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:24.013 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:24.014 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:24.014 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:33:24.014 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:24.014 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:24.014 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:24.014 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:24.014 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:33:24.014 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:24.014 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:24.014 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:24.014 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:24.014 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:33:24.015 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:33:24.015 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:24.015 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:24.015 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:33:24.015 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:24.015 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:24.015 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:24.015 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:24.015 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:33:24.015 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:33:24.015 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:24.015 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:24.015 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:24.016 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:33:24.016 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:24.016 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:24.016 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:33:24.016 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:24.016 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:24.016 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:24.016 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:33:24.016 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:24.016 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:24.016 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:24.017 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:33:24.017 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:33:24.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.006+0000 7efe32d39640 1 -- 10.20.193.58:0/2745088078 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efdfc07a660 msgr2=0x7efdfc09ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:24.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.006+0000 7efe32d39640 1 --2- 10.20.193.58:0/2745088078 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efdfc07a660 0x7efdfc09ab10 secure :-1 s=READY pgs=304 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe2c0ae930 tx=0x7efe20007de0 comp rx=0 tx=0).stop 2026-02-23T06:33:24.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.006+0000 7efe32d39640 1 -- 10.20.193.58:0/2745088078 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efe2c15d870 msgr2=0x7efe2c1fda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:24.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.006+0000 7efe32d39640 1 --2- 10.20.193.58:0/2745088078 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efe2c15d870 0x7efe2c1fda20 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe2800c4a0 tx=0x7efe2800c970 comp rx=0 tx=0).stop 2026-02-23T06:33:24.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.006+0000 7efe32538640 1 -- 10.20.193.58:0/2745088078 reap_dead start 2026-02-23T06:33:24.019 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.006+0000 7efe32538640 1 -- 10.20.193.58:0/2745088078 reap_dead start 2026-02-23T06:33:24.019 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.006+0000 7efe32d39640 1 -- 10.20.193.58:0/2745088078 shutdown_connections 2026-02-23T06:33:24.019 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.006+0000 7efe32d39640 1 -- 10.20.193.58:0/2745088078 >> 10.20.193.58:0/2745088078 conn(0x7efe2c0b3c20 msgr2=0x7efe2c05d100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:24.019 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.006+0000 7efe32d39640 1 -- 10.20.193.58:0/2745088078 shutdown_connections 2026-02-23T06:33:24.019 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.006+0000 7efe32d39640 1 -- 10.20.193.58:0/2745088078 wait complete. 2026-02-23T06:33:24.019 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:33:24.020 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:33:24.020 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:33:24.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.146+0000 7f3403483640 1 -- 10.20.193.58:0/688526869 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f33fc15fb00 msgr2=0x7f33fc0b7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:24.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.146+0000 7f3403483640 1 --2- 10.20.193.58:0/688526869 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f33fc15fb00 0x7f33fc0b7cd0 secure :-1 s=READY pgs=19 gs=2 cs=0 l=1 c_cookie=17078162998828514370 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33fc0b7c40 tx=0x7f33f002f250 comp rx=0 tx=0).stop 2026-02-23T06:33:24.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.146+0000 7f3403483640 1 -- 10.20.193.58:0/688526869 shutdown_connections 2026-02-23T06:33:24.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.146+0000 7f3403483640 1 --2- 10.20.193.58:0/688526869 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33fc0b8210 0x7f33fc0b9c00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:24.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.146+0000 7f3403483640 1 --2- 10.20.193.58:0/688526869 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f33fc15fb00 0x7f33fc0b7cd0 unknown :-1 s=CLOSED pgs=19 gs=2 cs=0 l=1 c_cookie=17078162998828514370 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:24.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.146+0000 7f3403483640 1 --2- 10.20.193.58:0/688526869 >> v2:10.20.193.93:3300/0 conn(0x7f33fc15f730 0x7f33fc168be0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:24.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.146+0000 7f3403483640 1 -- 10.20.193.58:0/688526869 >> 10.20.193.58:0/688526869 conn(0x7f33fc0b65c0 msgr2=0x7f33fc0b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:24.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.146+0000 7f3403483640 1 -- 10.20.193.58:0/688526869 shutdown_connections 2026-02-23T06:33:24.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.146+0000 7f3403483640 1 -- 10.20.193.58:0/688526869 wait complete. 2026-02-23T06:33:24.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.147+0000 7f3403483640 1 Processor -- start 2026-02-23T06:33:24.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.147+0000 7f3403483640 1 -- start start 2026-02-23T06:33:24.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.147+0000 7f3403483640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f33fc0b8210 0x7f33fc15c8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:24.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.147+0000 7f3403483640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33fc15f730 0x7f33fc123670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:24.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.147+0000 7f3403483640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f33fc15fb00 0x7f33fc123bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:24.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.147+0000 7f3403483640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f33fc14cef0 con 0x7f33fc0b8210 2026-02-23T06:33:24.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.147+0000 7f3403483640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f33fc15ce30 con 0x7f33fc15fb00 2026-02-23T06:33:24.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.147+0000 7f3403483640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f33fc140560 con 0x7f33fc15f730 2026-02-23T06:33:24.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.148+0000 7f3402481640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f33fc0b8210 0x7f33fc15c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:24.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.148+0000 7f3402481640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f33fc0b8210 0x7f33fc15c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:48402/0 (socket says 10.20.193.58:48402) 2026-02-23T06:33:24.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.148+0000 7f3402481640 1 -- 10.20.193.58:0/2532896398 learned_addr learned my addr 10.20.193.58:0/2532896398 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:33:24.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.148+0000 7f3402c82640 1 --2- 10.20.193.58:0/2532896398 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f33fc15fb00 0x7f33fc123bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:24.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.148+0000 7f3401c80640 1 --2- 10.20.193.58:0/2532896398 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33fc15f730 0x7f33fc123670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:24.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.148+0000 7f3402481640 1 -- 10.20.193.58:0/2532896398 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33fc15f730 msgr2=0x7f33fc123670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:24.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.148+0000 7f3402481640 1 --2- 10.20.193.58:0/2532896398 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33fc15f730 0x7f33fc123670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:24.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.148+0000 7f3402481640 1 -- 10.20.193.58:0/2532896398 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f33fc15fb00 msgr2=0x7f33fc123bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:24.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.148+0000 7f3402481640 1 --2- 10.20.193.58:0/2532896398 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f33fc15fb00 0x7f33fc123bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:24.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.148+0000 7f3402481640 1 -- 10.20.193.58:0/2532896398 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f0009570 con 0x7f33fc0b8210 2026-02-23T06:33:24.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.148+0000 7f3402481640 1 --2- 10.20.193.58:0/2532896398 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f33fc0b8210 0x7f33fc15c8f0 secure :-1 s=READY pgs=20 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33ec00d950 tx=0x7f33ec00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:24.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.148+0000 7f33e2ffd640 1 -- 10.20.193.58:0/2532896398 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f33ec004540 con 0x7f33fc0b8210 2026-02-23T06:33:24.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.148+0000 7f3403483640 1 -- 10.20.193.58:0/2532896398 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33fc13fcc0 con 0x7f33fc0b8210 2026-02-23T06:33:24.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.148+0000 7f3403483640 1 -- 10.20.193.58:0/2532896398 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33fc140280 con 0x7f33fc0b8210 2026-02-23T06:33:24.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.148+0000 7f33e2ffd640 1 -- 10.20.193.58:0/2532896398 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33ec004940 con 0x7f33fc0b8210 2026-02-23T06:33:24.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.148+0000 7f33e2ffd640 1 -- 10.20.193.58:0/2532896398 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f33ec004d50 con 0x7f33fc0b8210 2026-02-23T06:33:24.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.149+0000 7f3403483640 1 --2- 10.20.193.58:0/2532896398 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33fc13f030 0x7f33fc14d380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:24.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.149+0000 7f3403483640 1 -- 10.20.193.58:0/2532896398 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f33fc14d060 con 0x7f33fc13f030 2026-02-23T06:33:24.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.149+0000 7f3401c80640 1 --2- 10.20.193.58:0/2532896398 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33fc13f030 0x7f33fc14d380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:24.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.149+0000 7f3401c80640 1 -- 10.20.193.58:0/2532896398 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f33fc165c20 con 0x7f33fc13f030 2026-02-23T06:33:24.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.150+0000 7f3401c80640 1 --2- 10.20.193.58:0/2532896398 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33fc13f030 0x7f33fc14d380 secure :-1 s=READY pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33fc15fed0 tx=0x7f33f0005c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:24.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.150+0000 7f33e2ffd640 1 -- 10.20.193.58:0/2532896398 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f33f0002ce0 con 0x7f33fc13f030 2026-02-23T06:33:24.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.150+0000 7f33e2ffd640 1 -- 10.20.193.58:0/2532896398 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f33f0038470 con 0x7f33fc13f030 2026-02-23T06:33:24.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.150+0000 7f33e2ffd640 1 -- 10.20.193.58:0/2532896398 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33fc13f030 msgr2=0x7f33fc14d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:24.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.150+0000 7f33e2ffd640 1 --2- 10.20.193.58:0/2532896398 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33fc13f030 0x7f33fc14d380 secure :-1 s=READY pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33fc15fed0 tx=0x7f33f0005c80 comp rx=0 tx=0).stop 2026-02-23T06:33:24.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.150+0000 7f33e2ffd640 1 -- 10.20.193.58:0/2532896398 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33fc13f030 msgr2=0x7f33fc14d380 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:33:24.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.150+0000 7f33e2ffd640 1 --2- 10.20.193.58:0/2532896398 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33fc13f030 0x7f33fc14d380 unknown :-1 s=CLOSED pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:24.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.150+0000 7f33e2ffd640 1 -- 10.20.193.58:0/2532896398 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f33ec009820 con 0x7f33fc0b8210 2026-02-23T06:33:24.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.151+0000 7f33e2ffd640 1 --2- 10.20.193.58:0/2532896398 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f33cc07a3c0 0x7f33cc09a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:24.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.151+0000 7f33e2ffd640 1 -- 10.20.193.58:0/2532896398 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f33ec09de80 con 0x7f33fc0b8210 2026-02-23T06:33:24.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.152+0000 7f3401c80640 1 --2- 10.20.193.58:0/2532896398 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f33cc07a3c0 0x7f33cc09a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:24.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.152+0000 7f3401c80640 1 --2- 10.20.193.58:0/2532896398 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f33cc07a3c0 0x7f33cc09a870 secure :-1 s=READY pgs=305 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33f00046f0 tx=0x7f33f003a030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:24.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.154+0000 7f3403483640 1 --2- 10.20.193.58:0/2532896398 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33fc140db0 0x7f33fc14d8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:24.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.154+0000 7f3403483640 1 -- 10.20.193.58:0/2532896398 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f33fc1655f0 con 0x7f33fc140db0 2026-02-23T06:33:24.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.154+0000 7f3402c82640 1 --2- 10.20.193.58:0/2532896398 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33fc140db0 0x7f33fc14d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:24.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.154+0000 7f3402c82640 1 -- 10.20.193.58:0/2532896398 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f33fc166500 con 0x7f33fc140db0 2026-02-23T06:33:24.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.154+0000 7f3402c82640 1 --2- 10.20.193.58:0/2532896398 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33fc140db0 0x7f33fc14d8c0 secure :-1 s=READY pgs=215 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33f8005820 tx=0x7f33f8010a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:24.152 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.155+0000 7f33e2ffd640 1 -- 10.20.193.58:0/2532896398 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f33f8005b50 con 0x7f33fc140db0 2026-02-23T06:33:24.152 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.155+0000 7f33e2ffd640 1 -- 10.20.193.58:0/2532896398 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5556 (secure 0 0 0) 0x7f33f8005cb0 con 0x7f33fc140db0 2026-02-23T06:33:24.152 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.155+0000 7f33e2ffd640 1 -- 10.20.193.58:0/2532896398 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33fc140db0 msgr2=0x7f33fc14d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:24.152 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.155+0000 7f33e2ffd640 1 --2- 10.20.193.58:0/2532896398 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33fc140db0 0x7f33fc14d8c0 secure :-1 s=READY pgs=215 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33f8005820 tx=0x7f33f8010a30 comp rx=0 tx=0).stop 2026-02-23T06:33:24.152 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.155+0000 7f33e2ffd640 1 -- 10.20.193.58:0/2532896398 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33fc140db0 msgr2=0x7f33fc14d8c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:33:24.152 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.155+0000 7f33e2ffd640 1 --2- 10.20.193.58:0/2532896398 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f33fc140db0 0x7f33fc14d8c0 unknown :-1 s=CLOSED pgs=215 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:24.152 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:33:24.153 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:33:24.153 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:33:24.153 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:33:24.153 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 98, 2026-02-23T06:33:24.153 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 478667, 2026-02-23T06:33:24.153 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:33:24.153 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:33:24.153 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:33:24.153 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:33:24.153 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:24.153 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:33:24.154 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:33:24.154 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:33:24.154 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:33:24.154 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:24.154 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:24.154 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:24.154 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:24.154 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:24.154 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:24.154 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:24.154 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:24.154 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:24.154 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:24.155 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:24.155 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:24.155 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:24.155 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:24.155 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:33:24.155 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:33:24.155 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:24.155 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:24.155 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:24.155 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:24.155 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:24.155 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:24.156 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:24.156 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:24.156 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:24.156 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:24.156 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:24.156 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:24.156 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:24.156 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:24.156 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:24.156 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:33:24.156 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:33:24.156 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:33:24.157 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:33:24.157 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:33:24.157 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:33:24.157 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:33:24.157 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:33:24.157 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:33:24.157 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:33:24.157 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:33:24.157 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:33:24.158 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:33:24.158 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:33:24.158 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:33:24.158 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:33:24.158 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:33:24.158 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:24.158 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:24.158 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:24.158 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:24.158 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:24.158 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:24.158 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:24.159 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:24.159 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:24.159 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:24.159 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:24.159 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:24.159 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:24.159 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:24.159 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:33:24.159 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:24.159 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:33:24.159 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:24.159 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:33:24.160 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:33:24.160 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:24.160 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:24.160 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:24.160 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:24.160 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:33:24.160 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:24.160 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:24.160 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:24.161 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:24.161 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:33:24.161 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:24.161 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:24.161 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:24.161 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:24.161 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:33:24.161 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:33:24.161 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:24.161 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:24.161 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:33:24.162 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:24.162 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:24.162 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:24.162 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:33:24.162 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:33:24.162 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:24.162 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:24.162 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:24.162 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:24.162 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:33:24.162 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:24.162 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:24.162 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:24.163 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:24.163 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:33:24.163 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:24.163 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:24.163 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:24.163 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:24.163 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:33:24.163 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:33:24.163 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:24.163 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:24.163 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:33:24.163 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:24.164 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:24.164 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:24.164 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:33:24.164 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:33:24.164 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:24.164 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:24.164 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:24.164 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:24.164 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:33:24.164 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:24.164 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:24.164 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:24.165 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:24.165 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:33:24.165 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:24.165 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:24.165 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:24.165 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:24.165 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:33:24.165 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:33:24.165 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:24.165 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:24.165 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:33:24.165 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:24.166 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:24.166 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:24.166 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:24.166 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:33:24.166 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:33:24.166 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:24.166 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:24.166 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:24.166 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:33:24.166 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:24.166 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:24.166 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:33:24.166 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:24.167 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:24.167 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:24.167 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:33:24.167 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:24.167 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:24.167 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:33:24.167 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:24.167 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:24.167 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:24.167 INFO:teuthology.orchestra.run.trial058.stdout: "num": 8 2026-02-23T06:33:24.167 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:24.167 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:24.167 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:33:24.168 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:24.168 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:33:24.168 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:33:24.168 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:33:24.168 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:24.168 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:24.168 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:24.168 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:24.168 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:33:24.168 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:24.168 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:24.168 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:33:24.168 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:24.169 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:24.169 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:24.169 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:33:24.169 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:24.169 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:24.169 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:24.169 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:33:24.169 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:33:24.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.155+0000 7f3403483640 1 -- 10.20.193.58:0/2532896398 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f33cc07a3c0 msgr2=0x7f33cc09a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:24.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.155+0000 7f3403483640 1 --2- 10.20.193.58:0/2532896398 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f33cc07a3c0 0x7f33cc09a870 secure :-1 s=READY pgs=305 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33f00046f0 tx=0x7f33f003a030 comp rx=0 tx=0).stop 2026-02-23T06:33:24.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.155+0000 7f3403483640 1 -- 10.20.193.58:0/2532896398 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f33fc0b8210 msgr2=0x7f33fc15c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:24.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.155+0000 7f3403483640 1 --2- 10.20.193.58:0/2532896398 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f33fc0b8210 0x7f33fc15c8f0 secure :-1 s=READY pgs=20 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33ec00d950 tx=0x7f33ec00de20 comp rx=0 tx=0).stop 2026-02-23T06:33:24.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.155+0000 7f3402c82640 1 -- 10.20.193.58:0/2532896398 reap_dead start 2026-02-23T06:33:24.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.155+0000 7f3402c82640 1 -- 10.20.193.58:0/2532896398 reap_dead start 2026-02-23T06:33:24.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.155+0000 7f3403483640 1 -- 10.20.193.58:0/2532896398 shutdown_connections 2026-02-23T06:33:24.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.155+0000 7f3403483640 1 -- 10.20.193.58:0/2532896398 >> 10.20.193.58:0/2532896398 conn(0x7f33fc0b65c0 msgr2=0x7f33fc1416e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:24.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.155+0000 7f3403483640 1 -- 10.20.193.58:0/2532896398 shutdown_connections 2026-02-23T06:33:24.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.155+0000 7f3403483640 1 -- 10.20.193.58:0/2532896398 wait complete. 2026-02-23T06:33:24.172 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:33:24.173 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-23T06:33:24.173 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-23T06:33:24.173 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-23T06:33:24.173 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-23T06:33:24.173 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-23T06:33:24.173 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:33:24.182 INFO:tasks.ceph.mon.b:Stopped 2026-02-23T06:33:24.183 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:33:24.183 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:33:24.304 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.309+0000 7fa6ad944640 1 -- 10.20.193.58:0/1314096126 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa694003a30 msgr2=0x7fa694003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:24.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.309+0000 7fa6ad944640 1 --2- 10.20.193.58:0/1314096126 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa694003a30 0x7fa694003e20 secure :-1 s=READY pgs=22 gs=5 cs=0 l=1 c_cookie=13304153970371891889 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa698009b40 tx=0x7fa69802fc30 comp rx=0 tx=0).stop 2026-02-23T06:33:24.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.309+0000 7fa6ad143640 1 -- 10.20.193.58:0/1314096126 reap_dead start 2026-02-23T06:33:24.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.309+0000 7fa6ad944640 1 -- 10.20.193.58:0/1314096126 shutdown_connections 2026-02-23T06:33:24.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.309+0000 7fa6ad944640 1 -- 10.20.193.58:0/1314096126 >> 10.20.193.58:0/1314096126 conn(0x7fa6a80b3c20 msgr2=0x7fa6a80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:24.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.309+0000 7fa6ad944640 1 -- 10.20.193.58:0/1314096126 shutdown_connections 2026-02-23T06:33:24.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.309+0000 7fa6ad944640 1 -- 10.20.193.58:0/1314096126 wait complete. 2026-02-23T06:33:24.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.310+0000 7fa6ad944640 1 Processor -- start 2026-02-23T06:33:24.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.310+0000 7fa6ad944640 1 -- start start 2026-02-23T06:33:24.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.311+0000 7fa6ad944640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa694003a30 0x7fa6a813fab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:24.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.311+0000 7fa6ad944640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa6a81614d0 0x7fa6a8161900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:24.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.311+0000 7fa6ad944640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa6a8140740 0x7fa6a8140bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:24.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.311+0000 7fa6ad944640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a81620d0 con 0x7fa6a81614d0 2026-02-23T06:33:24.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.311+0000 7fa6ad944640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a8058270 con 0x7fa694003a30 2026-02-23T06:33:24.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.311+0000 7fa6ad944640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa6a81410f0 con 0x7fa6a8140740 2026-02-23T06:33:24.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.311+0000 7fa6ac942640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa694003a30 msgr2=0x7fa6a813fab0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:33:24.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.311+0000 7fa6ac942640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa694003a30 0x7fa6a813fab0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:33:24.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.311+0000 7fa69ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa6a81614d0 0x7fa6a8161900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:24.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.311+0000 7fa69ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa6a81614d0 0x7fa6a8161900 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:48418/0 (socket says 10.20.193.58:48418) 2026-02-23T06:33:24.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.311+0000 7fa69ffff640 1 -- 10.20.193.58:0/317490527 learned_addr learned my addr 10.20.193.58:0/317490527 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:33:24.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.311+0000 7fa6ad143640 1 --2- 10.20.193.58:0/317490527 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa6a8140740 0x7fa6a8140bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:24.309 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.311+0000 7fa69ffff640 1 -- 10.20.193.58:0/317490527 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa6a8140740 msgr2=0x7fa6a8140bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:24.309 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.311+0000 7fa69ffff640 1 --2- 10.20.193.58:0/317490527 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa6a8140740 0x7fa6a8140bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:24.309 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.311+0000 7fa69ffff640 1 -- 10.20.193.58:0/317490527 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa694003a30 msgr2=0x7fa6a813fab0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:33:24.309 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.311+0000 7fa69ffff640 1 --2- 10.20.193.58:0/317490527 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa694003a30 0x7fa6a813fab0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:24.309 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.311+0000 7fa69ffff640 1 -- 10.20.193.58:0/317490527 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a80ad9b0 con 0x7fa6a81614d0 2026-02-23T06:33:24.309 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.311+0000 7fa69ffff640 1 --2- 10.20.193.58:0/317490527 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa6a81614d0 0x7fa6a8161900 secure :-1 s=READY pgs=23 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa690002780 tx=0x7fa69000eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:24.309 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.311+0000 7fa69d7fa640 1 -- 10.20.193.58:0/317490527 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa69000ca80 con 0x7fa6a81614d0 2026-02-23T06:33:24.309 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.311+0000 7fa69d7fa640 1 -- 10.20.193.58:0/317490527 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa69000ccd0 con 0x7fa6a81614d0 2026-02-23T06:33:24.309 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.311+0000 7fa69d7fa640 1 -- 10.20.193.58:0/317490527 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa6900116e0 con 0x7fa6a81614d0 2026-02-23T06:33:24.309 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.311+0000 7fa6ad944640 1 -- 10.20.193.58:0/317490527 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6a80adc70 con 0x7fa6a81614d0 2026-02-23T06:33:24.309 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.312+0000 7fa6ad944640 1 -- 10.20.193.58:0/317490527 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6a813ef70 con 0x7fa6a81614d0 2026-02-23T06:33:24.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.313+0000 7fa6ad944640 1 -- 10.20.193.58:0/317490527 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6a80b7260 con 0x7fa6a81614d0 2026-02-23T06:33:24.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.313+0000 7fa69d7fa640 1 -- 10.20.193.58:0/317490527 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fa690011840 con 0x7fa6a81614d0 2026-02-23T06:33:24.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.314+0000 7fa69d7fa640 1 --2- 10.20.193.58:0/317490527 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa67807a5b0 0x7fa67809aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:24.311 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.314+0000 7fa69d7fa640 1 -- 10.20.193.58:0/317490527 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fa69009dd60 con 0x7fa6a81614d0 2026-02-23T06:33:24.311 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.314+0000 7fa6ac942640 1 --2- 10.20.193.58:0/317490527 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa67807a5b0 0x7fa67809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:24.311 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.315+0000 7fa6ac942640 1 --2- 10.20.193.58:0/317490527 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa67807a5b0 0x7fa67809aa60 secure :-1 s=READY pgs=306 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa698009230 tx=0x7fa698004770 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:24.312 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.317+0000 7fa69d7fa640 1 -- 10.20.193.58:0/317490527 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fa690060f00 con 0x7fa6a81614d0 2026-02-23T06:33:24.466 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.471+0000 7fa6ad944640 1 -- 10.20.193.58:0/317490527 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa6a81435f0 con 0x7fa6a81614d0 2026-02-23T06:33:24.466 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.471+0000 7fa69d7fa640 1 -- 10.20.193.58:0/317490527 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7fa690064020 con 0x7fa6a81614d0 2026-02-23T06:33:24.466 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":98,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:33:24.468 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.472+0000 7fa6ad944640 1 -- 10.20.193.58:0/317490527 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa67807a5b0 msgr2=0x7fa67809aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:24.468 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.472+0000 7fa6ad944640 1 --2- 10.20.193.58:0/317490527 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa67807a5b0 0x7fa67809aa60 secure :-1 s=READY pgs=306 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa698009230 tx=0x7fa698004770 comp rx=0 tx=0).stop 2026-02-23T06:33:24.468 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.472+0000 7fa6ad944640 1 -- 10.20.193.58:0/317490527 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa6a81614d0 msgr2=0x7fa6a8161900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:24.468 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.472+0000 7fa6ad944640 1 --2- 10.20.193.58:0/317490527 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa6a81614d0 0x7fa6a8161900 secure :-1 s=READY pgs=23 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa690002780 tx=0x7fa69000eaf0 comp rx=0 tx=0).stop 2026-02-23T06:33:24.468 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.472+0000 7fa6ad944640 1 -- 10.20.193.58:0/317490527 shutdown_connections 2026-02-23T06:33:24.468 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.472+0000 7fa6ad944640 1 --2- 10.20.193.58:0/317490527 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa67807a5b0 0x7fa67809aa60 unknown :-1 s=CLOSED pgs=306 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:24.468 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.472+0000 7fa6ad944640 1 --2- 10.20.193.58:0/317490527 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa6a8140740 0x7fa6a8140bb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:24.468 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.472+0000 7fa6ad944640 1 --2- 10.20.193.58:0/317490527 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa6a81614d0 0x7fa6a8161900 unknown :-1 s=CLOSED pgs=23 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:24.468 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.472+0000 7fa6ad944640 1 --2- 10.20.193.58:0/317490527 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa694003a30 0x7fa6a813fab0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:24.468 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.472+0000 7fa6ad944640 1 -- 10.20.193.58:0/317490527 >> 10.20.193.58:0/317490527 conn(0x7fa6a80b3c20 msgr2=0x7fa6a8163420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:24.469 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.472+0000 7fa6ad944640 1 -- 10.20.193.58:0/317490527 shutdown_connections 2026-02-23T06:33:24.469 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:24.472+0000 7fa6ad944640 1 -- 10.20.193.58:0/317490527 wait complete. 2026-02-23T06:33:27.482 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:33:27.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.608+0000 7fd52e94b640 1 -- 10.20.193.58:0/1632695616 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd528056550 msgr2=0x7fd52805ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:27.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.608+0000 7fd52e94b640 1 --2- 10.20.193.58:0/1632695616 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd528056550 0x7fd52805ce30 secure :-1 s=READY pgs=217 gs=2 cs=0 l=1 c_cookie=7951008789908455065 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd51c005e70 tx=0x7fd51c02f290 comp rx=0 tx=0).stop 2026-02-23T06:33:27.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.608+0000 7fd52e94b640 1 -- 10.20.193.58:0/1632695616 shutdown_connections 2026-02-23T06:33:27.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.608+0000 7fd52e94b640 1 --2- 10.20.193.58:0/1632695616 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd528056550 0x7fd52805ce30 unknown :-1 s=CLOSED pgs=217 gs=2 cs=0 l=1 c_cookie=7951008789908455065 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:27.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.608+0000 7fd52e94b640 1 --2- 10.20.193.58:0/1632695616 >> v2:10.20.193.58:3300/0 conn(0x7fd52815c040 0x7fd52805b0e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:27.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.608+0000 7fd52e94b640 1 -- 10.20.193.58:0/1632695616 >> 10.20.193.58:0/1632695616 conn(0x7fd5280b3c20 msgr2=0x7fd5280b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:27.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.609+0000 7fd52e94b640 1 -- 10.20.193.58:0/1632695616 shutdown_connections 2026-02-23T06:33:27.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.609+0000 7fd52e94b640 1 -- 10.20.193.58:0/1632695616 wait complete. 2026-02-23T06:33:27.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.610+0000 7fd52e94b640 1 Processor -- start 2026-02-23T06:33:27.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.610+0000 7fd52e94b640 1 -- start start 2026-02-23T06:33:27.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.610+0000 7fd52e94b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd528056550 0x7fd528136fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:27.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.610+0000 7fd52e94b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd52805d370 0x7fd5280572b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:27.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.610+0000 7fd52e94b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd52815c040 0x7fd52813ae60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:27.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.610+0000 7fd52e94b640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fd528139440 con 0x7fd528056550 2026-02-23T06:33:27.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.610+0000 7fd52e94b640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fd528202020 con 0x7fd52815c040 2026-02-23T06:33:27.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.610+0000 7fd52e94b640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fd5281309c0 con 0x7fd52805d370 2026-02-23T06:33:27.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.611+0000 7fd52e14a640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd52815c040 msgr2=0x7fd52813ae60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:33:27.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.611+0000 7fd52e14a640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd52815c040 0x7fd52813ae60 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:33:27.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.611+0000 7fd52d949640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd528056550 0x7fd528136fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:27.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.611+0000 7fd52d148640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd52805d370 0x7fd5280572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:27.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.611+0000 7fd52d949640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd528056550 0x7fd528136fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:48436/0 (socket says 10.20.193.58:48436) 2026-02-23T06:33:27.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.611+0000 7fd52d949640 1 -- 10.20.193.58:0/2616693644 learned_addr learned my addr 10.20.193.58:0/2616693644 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:33:27.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.611+0000 7fd52d949640 1 -- 10.20.193.58:0/2616693644 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd52805d370 msgr2=0x7fd5280572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:27.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.611+0000 7fd52d949640 1 --2- 10.20.193.58:0/2616693644 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd52805d370 0x7fd5280572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:27.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.611+0000 7fd52d949640 1 -- 10.20.193.58:0/2616693644 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd52815c040 msgr2=0x7fd52813ae60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:33:27.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.611+0000 7fd52d949640 1 --2- 10.20.193.58:0/2616693644 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd52815c040 0x7fd52813ae60 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:27.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.611+0000 7fd52d949640 1 -- 10.20.193.58:0/2616693644 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5180094b0 con 0x7fd528056550 2026-02-23T06:33:27.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.611+0000 7fd52d949640 1 --2- 10.20.193.58:0/2616693644 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd528056550 0x7fd528136fa0 secure :-1 s=READY pgs=30 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd518009fd0 tx=0x7fd518002bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:27.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.611+0000 7fd5167fc640 1 -- 10.20.193.58:0/2616693644 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd51800ed00 con 0x7fd528056550 2026-02-23T06:33:27.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.611+0000 7fd5167fc640 1 -- 10.20.193.58:0/2616693644 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd518002e20 con 0x7fd528056550 2026-02-23T06:33:27.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.611+0000 7fd52e94b640 1 -- 10.20.193.58:0/2616693644 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd51c009570 con 0x7fd528056550 2026-02-23T06:33:27.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.611+0000 7fd5167fc640 1 -- 10.20.193.58:0/2616693644 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5180106b0 con 0x7fd528056550 2026-02-23T06:33:27.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.611+0000 7fd52e94b640 1 -- 10.20.193.58:0/2616693644 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd528139160 con 0x7fd528056550 2026-02-23T06:33:27.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.612+0000 7fd52e94b640 1 -- 10.20.193.58:0/2616693644 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd52805ce30 con 0x7fd528056550 2026-02-23T06:33:27.610 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.613+0000 7fd5167fc640 1 -- 10.20.193.58:0/2616693644 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fd518016020 con 0x7fd528056550 2026-02-23T06:33:27.610 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.614+0000 7fd5167fc640 1 --2- 10.20.193.58:0/2616693644 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd4f807a5b0 0x7fd4f809aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:27.610 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.614+0000 7fd5167fc640 1 -- 10.20.193.58:0/2616693644 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fd51809de00 con 0x7fd528056550 2026-02-23T06:33:27.610 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.614+0000 7fd52d148640 1 --2- 10.20.193.58:0/2616693644 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd4f807a5b0 0x7fd4f809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:27.610 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.615+0000 7fd52d148640 1 --2- 10.20.193.58:0/2616693644 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd4f807a5b0 0x7fd4f809aa60 secure :-1 s=READY pgs=307 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd51c004740 tx=0x7fd51c031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:27.611 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.616+0000 7fd5167fc640 1 -- 10.20.193.58:0/2616693644 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fd518060fa0 con 0x7fd528056550 2026-02-23T06:33:27.766 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.770+0000 7fd52e94b640 1 -- 10.20.193.58:0/2616693644 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd5280b1b80 con 0x7fd528056550 2026-02-23T06:33:27.766 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.771+0000 7fd5167fc640 1 -- 10.20.193.58:0/2616693644 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7fd5180640c0 con 0x7fd528056550 2026-02-23T06:33:27.766 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":98,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:33:27.767 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.772+0000 7fd52e94b640 1 -- 10.20.193.58:0/2616693644 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd4f807a5b0 msgr2=0x7fd4f809aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:27.768 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.772+0000 7fd52e94b640 1 --2- 10.20.193.58:0/2616693644 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd4f807a5b0 0x7fd4f809aa60 secure :-1 s=READY pgs=307 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd51c004740 tx=0x7fd51c031040 comp rx=0 tx=0).stop 2026-02-23T06:33:27.768 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.772+0000 7fd52e94b640 1 -- 10.20.193.58:0/2616693644 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd528056550 msgr2=0x7fd528136fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:27.768 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.772+0000 7fd52e94b640 1 --2- 10.20.193.58:0/2616693644 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd528056550 0x7fd528136fa0 secure :-1 s=READY pgs=30 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd518009fd0 tx=0x7fd518002bc0 comp rx=0 tx=0).stop 2026-02-23T06:33:27.768 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.772+0000 7fd52e94b640 1 -- 10.20.193.58:0/2616693644 shutdown_connections 2026-02-23T06:33:27.768 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.772+0000 7fd52e94b640 1 --2- 10.20.193.58:0/2616693644 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd4f807a5b0 0x7fd4f809aa60 unknown :-1 s=CLOSED pgs=307 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:27.768 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.772+0000 7fd52e94b640 1 --2- 10.20.193.58:0/2616693644 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd52815c040 0x7fd52813ae60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:27.768 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.772+0000 7fd52e94b640 1 --2- 10.20.193.58:0/2616693644 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd52805d370 0x7fd5280572b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:27.768 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.772+0000 7fd52e94b640 1 --2- 10.20.193.58:0/2616693644 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd528056550 0x7fd528136fa0 unknown :-1 s=CLOSED pgs=30 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:27.768 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.772+0000 7fd52e94b640 1 -- 10.20.193.58:0/2616693644 >> 10.20.193.58:0/2616693644 conn(0x7fd5280b3c20 msgr2=0x7fd52815ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:27.768 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.772+0000 7fd52e94b640 1 -- 10.20.193.58:0/2616693644 shutdown_connections 2026-02-23T06:33:27.769 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:27.772+0000 7fd52e94b640 1 -- 10.20.193.58:0/2616693644 wait complete. 2026-02-23T06:33:30.780 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:33:30.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.906+0000 7f269cd5c640 1 -- 10.20.193.58:0/3117948983 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f269815d4a0 msgr2=0x7f26980affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:30.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.906+0000 7f269cd5c640 1 --2- 10.20.193.58:0/3117948983 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f269815d4a0 0x7f26980affb0 secure :-1 s=READY pgs=32 gs=2 cs=0 l=1 c_cookie=8759473687700422474 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2684005e70 tx=0x7f268402f280 comp rx=0 tx=0).stop 2026-02-23T06:33:30.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.906+0000 7f269cd5c640 1 -- 10.20.193.58:0/3117948983 shutdown_connections 2026-02-23T06:33:30.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.906+0000 7f269cd5c640 1 --2- 10.20.193.58:0/3117948983 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f26980b6690 0x7f2698058ec0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:30.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.906+0000 7f269cd5c640 1 --2- 10.20.193.58:0/3117948983 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f269815d4a0 0x7f26980affb0 unknown :-1 s=CLOSED pgs=32 gs=2 cs=0 l=1 c_cookie=8759473687700422474 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:30.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.906+0000 7f269cd5c640 1 -- 10.20.193.58:0/3117948983 >> 10.20.193.58:0/3117948983 conn(0x7f26980b3c20 msgr2=0x7f26980b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:30.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.906+0000 7f269cd5c640 1 -- 10.20.193.58:0/3117948983 shutdown_connections 2026-02-23T06:33:30.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.906+0000 7f269cd5c640 1 -- 10.20.193.58:0/3117948983 wait complete. 2026-02-23T06:33:30.905 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.908+0000 7f269cd5c640 1 Processor -- start 2026-02-23T06:33:30.906 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.908+0000 7f269cd5c640 1 -- start start 2026-02-23T06:33:30.906 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.909+0000 7f269cd5c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f26980b6690 0x7f26980587e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:30.906 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.909+0000 7f269cd5c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f269815d4a0 0x7f269814d4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:30.906 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.909+0000 7f269cd5c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f269815d870 0x7f269814da30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:30.906 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.909+0000 7f269cd5c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f269814ab00 con 0x7f26980b6690 2026-02-23T06:33:30.906 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.909+0000 7f269cd5c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f2698149ca0 con 0x7f269815d4a0 2026-02-23T06:33:30.906 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.909+0000 7f269cd5c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f2698149f80 con 0x7f269815d870 2026-02-23T06:33:30.906 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.909+0000 7f26977fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f26980b6690 0x7f26980587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:30.906 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.909+0000 7f26977fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f26980b6690 0x7f26980587e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:33150/0 (socket says 10.20.193.58:33150) 2026-02-23T06:33:30.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.909+0000 7f26977fe640 1 -- 10.20.193.58:0/3908693649 learned_addr learned my addr 10.20.193.58:0/3908693649 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:33:30.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.909+0000 7f2696ffd640 1 -- 10.20.193.58:0/3908693649 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f269815d4a0 msgr2=0x7f269814d4f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:33:30.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.909+0000 7f2696ffd640 1 --2- 10.20.193.58:0/3908693649 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f269815d4a0 0x7f269814d4f0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:33:30.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.909+0000 7f2697fff640 1 --2- 10.20.193.58:0/3908693649 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f269815d870 0x7f269814da30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:30.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.909+0000 7f26977fe640 1 -- 10.20.193.58:0/3908693649 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f269815d870 msgr2=0x7f269814da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:30.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.909+0000 7f26977fe640 1 --2- 10.20.193.58:0/3908693649 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f269815d870 0x7f269814da30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:30.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.909+0000 7f26977fe640 1 -- 10.20.193.58:0/3908693649 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f269815d4a0 msgr2=0x7f269814d4f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:33:30.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.909+0000 7f26977fe640 1 --2- 10.20.193.58:0/3908693649 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f269815d4a0 0x7f269814d4f0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:30.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.909+0000 7f26977fe640 1 -- 10.20.193.58:0/3908693649 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2684009570 con 0x7f26980b6690 2026-02-23T06:33:30.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.909+0000 7f26977fe640 1 --2- 10.20.193.58:0/3908693649 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f26980b6690 0x7f26980587e0 secure :-1 s=READY pgs=33 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2684004740 tx=0x7f26840028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:30.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.909+0000 7f2673fff640 1 -- 10.20.193.58:0/3908693649 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f268403d070 con 0x7f26980b6690 2026-02-23T06:33:30.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.910+0000 7f2673fff640 1 -- 10.20.193.58:0/3908693649 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2684038470 con 0x7f26980b6690 2026-02-23T06:33:30.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.910+0000 7f2673fff640 1 -- 10.20.193.58:0/3908693649 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26840388a0 con 0x7f26980b6690 2026-02-23T06:33:30.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.910+0000 7f269cd5c640 1 -- 10.20.193.58:0/3908693649 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f269814a260 con 0x7f26980b6690 2026-02-23T06:33:30.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.910+0000 7f269cd5c640 1 -- 10.20.193.58:0/3908693649 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f269814a820 con 0x7f26980b6690 2026-02-23T06:33:30.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.910+0000 7f269cd5c640 1 -- 10.20.193.58:0/3908693649 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26980b6d50 con 0x7f26980b6690 2026-02-23T06:33:30.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.911+0000 7f2673fff640 1 -- 10.20.193.58:0/3908693649 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f2684038a00 con 0x7f26980b6690 2026-02-23T06:33:30.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.912+0000 7f2673fff640 1 --2- 10.20.193.58:0/3908693649 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f266807a5b0 0x7f266809aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:30.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.912+0000 7f2673fff640 1 -- 10.20.193.58:0/3908693649 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f26840c2280 con 0x7f26980b6690 2026-02-23T06:33:30.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.913+0000 7f2696ffd640 1 --2- 10.20.193.58:0/3908693649 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f266807a5b0 0x7f266809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:30.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.914+0000 7f2696ffd640 1 --2- 10.20.193.58:0/3908693649 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f266807a5b0 0x7f266809aa60 secure :-1 s=READY pgs=308 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f269815b7b0 tx=0x7f2688006dc0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:30.910 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:30.914+0000 7f2673fff640 1 -- 10.20.193.58:0/3908693649 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f26840853d0 con 0x7f26980b6690 2026-02-23T06:33:31.064 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:31.069+0000 7f269cd5c640 1 -- 10.20.193.58:0/3908693649 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f269814d210 con 0x7f26980b6690 2026-02-23T06:33:31.065 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:31.069+0000 7f2673fff640 1 -- 10.20.193.58:0/3908693649 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f269814d210 con 0x7f26980b6690 2026-02-23T06:33:31.065 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":98,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:33:31.066 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:31.070+0000 7f269cd5c640 1 -- 10.20.193.58:0/3908693649 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f266807a5b0 msgr2=0x7f266809aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:31.066 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:31.070+0000 7f269cd5c640 1 --2- 10.20.193.58:0/3908693649 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f266807a5b0 0x7f266809aa60 secure :-1 s=READY pgs=308 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f269815b7b0 tx=0x7f2688006dc0 comp rx=0 tx=0).stop 2026-02-23T06:33:31.066 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:31.070+0000 7f269cd5c640 1 -- 10.20.193.58:0/3908693649 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f26980b6690 msgr2=0x7f26980587e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:31.066 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:31.070+0000 7f269cd5c640 1 --2- 10.20.193.58:0/3908693649 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f26980b6690 0x7f26980587e0 secure :-1 s=READY pgs=33 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2684004740 tx=0x7f26840028d0 comp rx=0 tx=0).stop 2026-02-23T06:33:31.067 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:31.070+0000 7f269cd5c640 1 -- 10.20.193.58:0/3908693649 shutdown_connections 2026-02-23T06:33:31.067 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:31.070+0000 7f269cd5c640 1 --2- 10.20.193.58:0/3908693649 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f266807a5b0 0x7f266809aa60 unknown :-1 s=CLOSED pgs=308 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:31.067 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:31.070+0000 7f269cd5c640 1 --2- 10.20.193.58:0/3908693649 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f269815d870 0x7f269814da30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:31.067 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:31.070+0000 7f269cd5c640 1 --2- 10.20.193.58:0/3908693649 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f269815d4a0 0x7f269814d4f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:31.067 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:31.070+0000 7f269cd5c640 1 --2- 10.20.193.58:0/3908693649 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f26980b6690 0x7f26980587e0 unknown :-1 s=CLOSED pgs=33 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:31.067 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:31.070+0000 7f269cd5c640 1 -- 10.20.193.58:0/3908693649 >> 10.20.193.58:0/3908693649 conn(0x7f26980b3c20 msgr2=0x7f26980aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:31.067 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:31.070+0000 7f269cd5c640 1 -- 10.20.193.58:0/3908693649 shutdown_connections 2026-02-23T06:33:31.067 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:31.070+0000 7f269cd5c640 1 -- 10.20.193.58:0/3908693649 wait complete. 2026-02-23T06:33:34.078 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:33:38.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.609+0000 7f50d2dd2640 1 -- 10.20.193.58:0/798243005 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f50b0003760 msgr2=0x7f50b0023ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:38.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.609+0000 7f50d2dd2640 1 --2- 10.20.193.58:0/798243005 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f50b0003760 0x7f50b0023ba0 secure :-1 s=READY pgs=218 gs=25 cs=0 l=1 c_cookie=17565938044006067266 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50bc002820 tx=0x7f50bc02fa30 comp rx=0 tx=0).stop 2026-02-23T06:33:38.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.609+0000 7f50d25d1640 1 -- 10.20.193.58:0/798243005 reap_dead start 2026-02-23T06:33:38.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.609+0000 7f50d2dd2640 1 -- 10.20.193.58:0/798243005 shutdown_connections 2026-02-23T06:33:38.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.609+0000 7f50d2dd2640 1 -- 10.20.193.58:0/798243005 >> 10.20.193.58:0/798243005 conn(0x7f50cc0b65c0 msgr2=0x7f50cc0b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:38.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.609+0000 7f50d2dd2640 1 -- 10.20.193.58:0/798243005 shutdown_connections 2026-02-23T06:33:38.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.609+0000 7f50d2dd2640 1 -- 10.20.193.58:0/798243005 wait complete. 2026-02-23T06:33:38.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.610+0000 7f50d2dd2640 1 Processor -- start 2026-02-23T06:33:38.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.610+0000 7f50d2dd2640 1 -- start start 2026-02-23T06:33:38.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.611+0000 7f50d2dd2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f50b0003760 0x7f50cc153400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:38.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.611+0000 7f50d2dd2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f50cc125cf0 0x7f50cc1288d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:38.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.611+0000 7f50d2dd2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f50cc126190 0x7f50cc1293c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:38.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.611+0000 7f50d2dd2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f50cc14fe10 con 0x7f50cc126190 2026-02-23T06:33:38.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.611+0000 7f50d2dd2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f50cc0b4ed0 con 0x7f50b0003760 2026-02-23T06:33:38.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.611+0000 7f50d2dd2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f50cc0b51b0 con 0x7f50cc125cf0 2026-02-23T06:33:38.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.611+0000 7f50d1dd0640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f50b0003760 msgr2=0x7f50cc153400 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:33:38.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.611+0000 7f50d1dd0640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f50b0003760 0x7f50cc153400 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:33:38.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.611+0000 7f50d25d1640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f50cc126190 0x7f50cc1293c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:38.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.611+0000 7f50d15cf640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f50cc125cf0 0x7f50cc1288d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:38.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.611+0000 7f50d25d1640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f50cc126190 0x7f50cc1293c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:33198/0 (socket says 10.20.193.58:33198) 2026-02-23T06:33:38.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.611+0000 7f50d25d1640 1 -- 10.20.193.58:0/440083632 learned_addr learned my addr 10.20.193.58:0/440083632 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:33:38.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.611+0000 7f50d25d1640 1 -- 10.20.193.58:0/440083632 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f50cc125cf0 msgr2=0x7f50cc1288d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:38.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.611+0000 7f50d25d1640 1 --2- 10.20.193.58:0/440083632 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f50cc125cf0 0x7f50cc1288d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:38.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.611+0000 7f50d25d1640 1 -- 10.20.193.58:0/440083632 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f50b0003760 msgr2=0x7f50cc153400 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:33:38.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.611+0000 7f50d25d1640 1 --2- 10.20.193.58:0/440083632 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f50b0003760 0x7f50cc153400 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:38.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.611+0000 7f50d25d1640 1 -- 10.20.193.58:0/440083632 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50bc009170 con 0x7f50cc126190 2026-02-23T06:33:38.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.611+0000 7f50d25d1640 1 --2- 10.20.193.58:0/440083632 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f50cc126190 0x7f50cc1293c0 secure :-1 s=READY pgs=36 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50cc0b0c50 tx=0x7f50c800d4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:38.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.612+0000 7f50ba7fc640 1 -- 10.20.193.58:0/440083632 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50c8006d90 con 0x7f50cc126190 2026-02-23T06:33:38.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.612+0000 7f50ba7fc640 1 -- 10.20.193.58:0/440083632 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50c800d910 con 0x7f50cc126190 2026-02-23T06:33:38.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.612+0000 7f50ba7fc640 1 -- 10.20.193.58:0/440083632 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50c800dd00 con 0x7f50cc126190 2026-02-23T06:33:38.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.612+0000 7f50d2dd2640 1 -- 10.20.193.58:0/440083632 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50cc1500d0 con 0x7f50cc126190 2026-02-23T06:33:38.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.612+0000 7f50d2dd2640 1 -- 10.20.193.58:0/440083632 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50cc150690 con 0x7f50cc126190 2026-02-23T06:33:38.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.612+0000 7f50d2dd2640 1 -- 10.20.193.58:0/440083632 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50cc1671e0 con 0x7f50cc126190 2026-02-23T06:33:38.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.614+0000 7f50ba7fc640 1 -- 10.20.193.58:0/440083632 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f50c8005020 con 0x7f50cc126190 2026-02-23T06:33:38.610 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.615+0000 7f50ba7fc640 1 --2- 10.20.193.58:0/440083632 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f509c07a5a0 0x7f509c09aa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:38.610 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.615+0000 7f50ba7fc640 1 -- 10.20.193.58:0/440083632 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f50c809cf80 con 0x7f50cc126190 2026-02-23T06:33:38.611 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.616+0000 7f50d1dd0640 1 --2- 10.20.193.58:0/440083632 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f509c07a5a0 0x7f509c09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:38.611 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.616+0000 7f50ba7fc640 1 -- 10.20.193.58:0/440083632 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f50c80601c0 con 0x7f50cc126190 2026-02-23T06:33:38.611 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.617+0000 7f50d1dd0640 1 --2- 10.20.193.58:0/440083632 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f509c07a5a0 0x7f509c09aa50 secure :-1 s=READY pgs=309 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50bc002820 tx=0x7f50bc009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:38.767 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.771+0000 7f50d2dd2640 1 -- 10.20.193.58:0/440083632 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f50cc0b9560 con 0x7f50cc126190 2026-02-23T06:33:38.767 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.771+0000 7f50ba7fc640 1 -- 10.20.193.58:0/440083632 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1749 (secure 0 0 0) 0x7f50c80632e0 con 0x7f50cc126190 2026-02-23T06:33:38.767 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":102,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:33:38.768 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.773+0000 7f50d2dd2640 1 -- 10.20.193.58:0/440083632 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f509c07a5a0 msgr2=0x7f509c09aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:38.768 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.773+0000 7f50d2dd2640 1 --2- 10.20.193.58:0/440083632 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f509c07a5a0 0x7f509c09aa50 secure :-1 s=READY pgs=309 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50bc002820 tx=0x7f50bc009040 comp rx=0 tx=0).stop 2026-02-23T06:33:38.769 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.773+0000 7f50d2dd2640 1 -- 10.20.193.58:0/440083632 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f50cc126190 msgr2=0x7f50cc1293c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:38.769 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.773+0000 7f50d2dd2640 1 --2- 10.20.193.58:0/440083632 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f50cc126190 0x7f50cc1293c0 secure :-1 s=READY pgs=36 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50cc0b0c50 tx=0x7f50c800d4d0 comp rx=0 tx=0).stop 2026-02-23T06:33:38.769 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.773+0000 7f50d2dd2640 1 -- 10.20.193.58:0/440083632 shutdown_connections 2026-02-23T06:33:38.769 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.773+0000 7f50d2dd2640 1 --2- 10.20.193.58:0/440083632 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f509c07a5a0 0x7f509c09aa50 unknown :-1 s=CLOSED pgs=309 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:38.769 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.773+0000 7f50d2dd2640 1 --2- 10.20.193.58:0/440083632 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f50cc126190 0x7f50cc1293c0 unknown :-1 s=CLOSED pgs=36 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:38.769 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.773+0000 7f50d2dd2640 1 --2- 10.20.193.58:0/440083632 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f50cc125cf0 0x7f50cc1288d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:38.769 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.773+0000 7f50d2dd2640 1 --2- 10.20.193.58:0/440083632 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f50b0003760 0x7f50cc153400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:38.769 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.773+0000 7f50d2dd2640 1 -- 10.20.193.58:0/440083632 >> 10.20.193.58:0/440083632 conn(0x7f50cc0b65c0 msgr2=0x7f50cc161070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:38.769 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.773+0000 7f50d2dd2640 1 -- 10.20.193.58:0/440083632 shutdown_connections 2026-02-23T06:33:38.769 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.773+0000 7f50d2dd2640 1 -- 10.20.193.58:0/440083632 wait complete. 2026-02-23T06:33:38.781 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:33:38.781 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-23T06:33:38.781 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:33:38.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.909+0000 7f50129b5640 1 -- 10.20.193.58:0/2545782486 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f500c15d870 msgr2=0x7f500c0587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:38.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.909+0000 7f50129b5640 1 --2- 10.20.193.58:0/2545782486 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f500c15d870 0x7f500c0587b0 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=1025265677187831970 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5000005e70 tx=0x7f500002f290 comp rx=0 tx=0).stop 2026-02-23T06:33:38.905 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.909+0000 7f50129b5640 1 -- 10.20.193.58:0/2545782486 shutdown_connections 2026-02-23T06:33:38.905 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.909+0000 7f50129b5640 1 --2- 10.20.193.58:0/2545782486 >> v2:10.20.193.58:3300/0 conn(0x7f500c0b6690 0x7f500c058cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:38.905 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.909+0000 7f50129b5640 1 --2- 10.20.193.58:0/2545782486 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f500c15d870 0x7f500c0587b0 unknown :-1 s=CLOSED pgs=219 gs=4 cs=0 l=1 c_cookie=1025265677187831970 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:38.905 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.909+0000 7f50129b5640 1 -- 10.20.193.58:0/2545782486 >> 10.20.193.58:0/2545782486 conn(0x7f500c0b3c20 msgr2=0x7f500c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:38.905 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.909+0000 7f50129b5640 1 -- 10.20.193.58:0/2545782486 shutdown_connections 2026-02-23T06:33:38.905 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.909+0000 7f50129b5640 1 -- 10.20.193.58:0/2545782486 wait complete. 2026-02-23T06:33:38.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.910+0000 7f50129b5640 1 Processor -- start 2026-02-23T06:33:38.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.910+0000 7f50129b5640 1 -- start start 2026-02-23T06:33:38.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.911+0000 7f50129b5640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f500c0b6690 0x7f500c2028b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:38.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.911+0000 7f50129b5640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f500c15d4a0 0x7f500c1392d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:38.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.911+0000 7f50129b5640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f500c15d870 0x7f500c141c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:38.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.911+0000 7f50129b5640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f500c202420 con 0x7f500c15d4a0 2026-02-23T06:33:38.908 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.911+0000 7f50129b5640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f500c13b550 con 0x7f500c15d870 2026-02-23T06:33:38.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.911+0000 7f50129b5640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f500c1638f0 con 0x7f500c0b6690 2026-02-23T06:33:38.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.911+0000 7f50119b3640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f500c0b6690 0x7f500c2028b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:38.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.911+0000 7f50119b3640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f500c0b6690 0x7f500c2028b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:33140/0 (socket says 10.20.193.58:33140) 2026-02-23T06:33:38.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.911+0000 7f50119b3640 1 -- 10.20.193.58:0/608307851 learned_addr learned my addr 10.20.193.58:0/608307851 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:33:38.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.911+0000 7f50111b2640 1 --2- 10.20.193.58:0/608307851 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f500c15d4a0 0x7f500c1392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:38.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.911+0000 7f50121b4640 1 -- 10.20.193.58:0/608307851 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f500c15d870 msgr2=0x7f500c141c50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:33:38.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.911+0000 7f50121b4640 1 --2- 10.20.193.58:0/608307851 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f500c15d870 0x7f500c141c50 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:33:38.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.911+0000 7f50119b3640 1 -- 10.20.193.58:0/608307851 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f500c15d870 msgr2=0x7f500c141c50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:33:38.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.911+0000 7f50119b3640 1 --2- 10.20.193.58:0/608307851 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f500c15d870 0x7f500c141c50 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:38.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.911+0000 7f50119b3640 1 -- 10.20.193.58:0/608307851 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f500c15d4a0 msgr2=0x7f500c1392d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:38.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.911+0000 7f50119b3640 1 --2- 10.20.193.58:0/608307851 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f500c15d4a0 0x7f500c1392d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:38.909 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.911+0000 7f50119b3640 1 -- 10.20.193.58:0/608307851 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500800a590 con 0x7f500c0b6690 2026-02-23T06:33:38.910 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.911+0000 7f50119b3640 1 --2- 10.20.193.58:0/608307851 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f500c0b6690 0x7f500c2028b0 secure :-1 s=READY pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ffc00b550 tx=0x7f4ffc00ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:38.910 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.912+0000 7f4ffa7fc640 1 -- 10.20.193.58:0/608307851 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ffc002c80 con 0x7f500c0b6690 2026-02-23T06:33:38.910 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.912+0000 7f4ffa7fc640 1 -- 10.20.193.58:0/608307851 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ffc004070 con 0x7f500c0b6690 2026-02-23T06:33:38.910 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.912+0000 7f4ffa7fc640 1 -- 10.20.193.58:0/608307851 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ffc004440 con 0x7f500c0b6690 2026-02-23T06:33:38.910 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.912+0000 7f50129b5640 1 -- 10.20.193.58:0/608307851 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5000009570 con 0x7f500c0b6690 2026-02-23T06:33:38.910 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.912+0000 7f50129b5640 1 -- 10.20.193.58:0/608307851 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f500c13b7c0 con 0x7f500c0b6690 2026-02-23T06:33:38.910 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.912+0000 7f50129b5640 1 --2- 10.20.193.58:0/608307851 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f500c15bb40 0x7f500c142190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:38.910 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.912+0000 7f50129b5640 1 -- 10.20.193.58:0/608307851 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f500c0b6330 con 0x7f500c15bb40 2026-02-23T06:33:38.910 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.912+0000 7f50111b2640 1 --2- 10.20.193.58:0/608307851 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f500c15bb40 0x7f500c142190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:38.910 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.913+0000 7f50111b2640 1 -- 10.20.193.58:0/608307851 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f500c0b5e10 con 0x7f500c15bb40 2026-02-23T06:33:38.910 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.913+0000 7f50111b2640 1 --2- 10.20.193.58:0/608307851 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f500c15bb40 0x7f500c142190 secure :-1 s=READY pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5000004740 tx=0x7f50000028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:38.910 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.913+0000 7f4ffa7fc640 1 -- 10.20.193.58:0/608307851 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f500003d050 con 0x7f500c15bb40 2026-02-23T06:33:38.912 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.913+0000 7f4ffa7fc640 1 -- 10.20.193.58:0/608307851 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f500003e040 con 0x7f500c15bb40 2026-02-23T06:33:38.912 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.913+0000 7f4ffa7fc640 1 -- 10.20.193.58:0/608307851 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f500c15bb40 msgr2=0x7f500c142190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:38.912 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.913+0000 7f4ffa7fc640 1 --2- 10.20.193.58:0/608307851 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f500c15bb40 0x7f500c142190 secure :-1 s=READY pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5000004740 tx=0x7f50000028d0 comp rx=0 tx=0).stop 2026-02-23T06:33:38.912 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.913+0000 7f4ffa7fc640 1 -- 10.20.193.58:0/608307851 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f500c15bb40 msgr2=0x7f500c142190 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:33:38.912 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.913+0000 7f4ffa7fc640 1 --2- 10.20.193.58:0/608307851 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f500c15bb40 0x7f500c142190 unknown :-1 s=CLOSED pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:38.912 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.914+0000 7f4ffa7fc640 1 -- 10.20.193.58:0/608307851 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f4ffc00d040 con 0x7f500c0b6690 2026-02-23T06:33:38.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.915+0000 7f4ffa7fc640 1 --2- 10.20.193.58:0/608307851 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f4fdc07a3c0 0x7f4fdc09a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:38.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.915+0000 7f4ffa7fc640 1 -- 10.20.193.58:0/608307851 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f4ffc09d590 con 0x7f500c0b6690 2026-02-23T06:33:38.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.915+0000 7f50111b2640 1 --2- 10.20.193.58:0/608307851 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f4fdc07a3c0 0x7f4fdc09a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:38.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.915+0000 7f50111b2640 1 --2- 10.20.193.58:0/608307851 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f4fdc07a3c0 0x7f4fdc09a870 secure :-1 s=READY pgs=310 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f500002ff30 tx=0x7f5000031030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:38.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.917+0000 7f50129b5640 1 --2- 10.20.193.58:0/608307851 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f500c057b00 0x7f500c201d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:38.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.917+0000 7f50129b5640 1 -- 10.20.193.58:0/608307851 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f500c057ed0 con 0x7f500c057b00 2026-02-23T06:33:38.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.917+0000 7f50121b4640 1 --2- 10.20.193.58:0/608307851 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f500c057b00 0x7f500c201d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:38.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.917+0000 7f50121b4640 1 -- 10.20.193.58:0/608307851 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f500c164250 con 0x7f500c057b00 2026-02-23T06:33:38.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.918+0000 7f50121b4640 1 --2- 10.20.193.58:0/608307851 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f500c057b00 0x7f500c201d10 secure :-1 s=READY pgs=38 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f500800aef0 tx=0x7f5008003b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:38.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.918+0000 7f4ffa7fc640 1 -- 10.20.193.58:0/608307851 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f500800fb40 con 0x7f500c057b00 2026-02-23T06:33:38.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.918+0000 7f4ffa7fc640 1 -- 10.20.193.58:0/608307851 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4902 (secure 0 0 0) 0x7f500800fca0 con 0x7f500c057b00 2026-02-23T06:33:38.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.918+0000 7f4ffa7fc640 1 -- 10.20.193.58:0/608307851 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f500c057b00 msgr2=0x7f500c201d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:38.915 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.918+0000 7f4ffa7fc640 1 --2- 10.20.193.58:0/608307851 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f500c057b00 0x7f500c201d10 secure :-1 s=READY pgs=38 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f500800aef0 tx=0x7f5008003b50 comp rx=0 tx=0).stop 2026-02-23T06:33:38.915 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.918+0000 7f4ffa7fc640 1 -- 10.20.193.58:0/608307851 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f500c057b00 msgr2=0x7f500c201d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:33:38.915 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.918+0000 7f4ffa7fc640 1 --2- 10.20.193.58:0/608307851 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f500c057b00 0x7f500c201d10 unknown :-1 s=CLOSED pgs=38 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:38.915 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:33:38.915 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:33:38.915 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:33:38.915 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:33:38.916 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 102, 2026-02-23T06:33:38.916 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 26430, 2026-02-23T06:33:38.916 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:33:38.916 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:33:38.916 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:33:38.916 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:38.916 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:33:38.916 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:33:38.916 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:33:38.916 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:33:38.916 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:38.917 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:38.917 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:38.917 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:38.917 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:38.917 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:38.917 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:38.917 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:38.917 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:38.917 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:38.917 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:38.917 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:38.917 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:38.918 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:38.918 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:33:38.918 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:33:38.918 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:38.918 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:38.918 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:38.918 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:38.918 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:38.918 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:38.918 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:38.918 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:38.918 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:38.919 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:38.919 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:38.919 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:38.919 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:38.919 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:38.919 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:38.919 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:33:38.919 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:33:38.919 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:33:38.919 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:33:38.919 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:33:38.919 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:33:38.920 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:33:38.920 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:33:38.920 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:33:38.920 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:33:38.920 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:33:38.920 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:33:38.920 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:33:38.920 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:33:38.920 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:33:38.920 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:33:38.920 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:33:38.920 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:38.920 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:38.921 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:38.921 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:38.921 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:38.921 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:38.921 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:38.921 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:38.921 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:38.921 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:38.921 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:38.921 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:38.921 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:38.921 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:38.922 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:33:38.922 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:38.922 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:33:38.922 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:38.922 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:33:38.922 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:33:38.922 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:38.922 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:38.922 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:38.922 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:38.922 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:33:38.922 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:38.922 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:38.923 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:38.923 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:38.923 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:33:38.923 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:38.923 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:38.923 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:38.923 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:38.923 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:33:38.923 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:33:38.923 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:38.923 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:38.923 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:33:38.924 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:38.924 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:38.924 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:38.924 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:33:38.924 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:33:38.924 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:38.924 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:38.924 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:38.924 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:38.924 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:33:38.924 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:38.924 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:38.924 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:38.925 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:38.925 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:33:38.925 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:38.925 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:38.925 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:38.925 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:38.925 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:33:38.925 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:33:38.925 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:38.925 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:38.925 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:33:38.925 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:38.926 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:38.926 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:38.926 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:33:38.926 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:33:38.926 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:38.926 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:38.926 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:38.926 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:38.926 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:33:38.926 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:38.926 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:38.926 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:38.927 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:38.927 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:33:38.927 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:38.927 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:38.927 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:38.927 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:38.927 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:33:38.927 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:33:38.927 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:38.927 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:38.927 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:33:38.927 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:38.927 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:38.928 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:38.928 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:38.928 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:33:38.928 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:33:38.928 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:38.928 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:38.928 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:38.928 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:33:38.928 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:38.928 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:38.928 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:33:38.928 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:38.928 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:38.929 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:38.929 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:33:38.929 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:38.929 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:38.929 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:38.929 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:33:38.929 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:33:38.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.918+0000 7f50129b5640 1 -- 10.20.193.58:0/608307851 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f4fdc07a3c0 msgr2=0x7f4fdc09a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:38.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.918+0000 7f50129b5640 1 --2- 10.20.193.58:0/608307851 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f4fdc07a3c0 0x7f4fdc09a870 secure :-1 s=READY pgs=310 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f500002ff30 tx=0x7f5000031030 comp rx=0 tx=0).stop 2026-02-23T06:33:38.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.918+0000 7f50129b5640 1 -- 10.20.193.58:0/608307851 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f500c0b6690 msgr2=0x7f500c2028b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:38.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.918+0000 7f50129b5640 1 --2- 10.20.193.58:0/608307851 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f500c0b6690 0x7f500c2028b0 secure :-1 s=READY pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ffc00b550 tx=0x7f4ffc00ba20 comp rx=0 tx=0).stop 2026-02-23T06:33:38.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.918+0000 7f50121b4640 1 -- 10.20.193.58:0/608307851 reap_dead start 2026-02-23T06:33:38.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.918+0000 7f50121b4640 1 -- 10.20.193.58:0/608307851 reap_dead start 2026-02-23T06:33:38.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.918+0000 7f50129b5640 1 -- 10.20.193.58:0/608307851 shutdown_connections 2026-02-23T06:33:38.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.918+0000 7f50129b5640 1 -- 10.20.193.58:0/608307851 >> 10.20.193.58:0/608307851 conn(0x7f500c0b3c20 msgr2=0x7f500c0aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:38.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.918+0000 7f50129b5640 1 -- 10.20.193.58:0/608307851 shutdown_connections 2026-02-23T06:33:38.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:38.918+0000 7f50129b5640 1 -- 10.20.193.58:0/608307851 wait complete. 2026-02-23T06:33:38.932 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:33:38.932 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-23T06:33:38.932 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:33:39.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.060+0000 7f7e8eb92640 1 -- 10.20.193.58:0/3263016560 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e88056960 msgr2=0x7f7e88058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:39.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.060+0000 7f7e8eb92640 1 --2- 10.20.193.58:0/3263016560 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e88056960 0x7f7e88058200 secure :-1 s=READY pgs=221 gs=3 cs=0 l=1 c_cookie=162235784349938002 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e7c009950 tx=0x7f7e7c02f250 comp rx=0 tx=0).stop 2026-02-23T06:33:39.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.060+0000 7f7e8eb92640 1 -- 10.20.193.58:0/3263016560 shutdown_connections 2026-02-23T06:33:39.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.060+0000 7f7e8eb92640 1 --2- 10.20.193.58:0/3263016560 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e88056960 0x7f7e88058200 unknown :-1 s=CLOSED pgs=221 gs=3 cs=0 l=1 c_cookie=162235784349938002 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:39.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.060+0000 7f7e8eb92640 1 -- 10.20.193.58:0/3263016560 >> 10.20.193.58:0/3263016560 conn(0x7f7e880b3c20 msgr2=0x7f7e880b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:39.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.060+0000 7f7e8eb92640 1 -- 10.20.193.58:0/3263016560 shutdown_connections 2026-02-23T06:33:39.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.060+0000 7f7e8eb92640 1 -- 10.20.193.58:0/3263016560 wait complete. 2026-02-23T06:33:39.058 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.061+0000 7f7e8eb92640 1 Processor -- start 2026-02-23T06:33:39.058 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.061+0000 7f7e8eb92640 1 -- start start 2026-02-23T06:33:39.058 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.062+0000 7f7e8eb92640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7e88056960 0x7f7e88132670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:39.058 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.062+0000 7f7e8eb92640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7e8815c4b0 0x7f7e880ada30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:39.058 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.062+0000 7f7e8eb92640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e88162ca0 0x7f7e8813ad50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:39.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.062+0000 7f7e8eb92640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f7e88117950 con 0x7f7e8815c4b0 2026-02-23T06:33:39.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.062+0000 7f7e8eb92640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f7e88116f00 con 0x7f7e88056960 2026-02-23T06:33:39.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.062+0000 7f7e8eb92640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f7e8815b4f0 con 0x7f7e88162ca0 2026-02-23T06:33:39.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.062+0000 7f7e8db90640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7e88056960 msgr2=0x7f7e88132670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:33:39.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.062+0000 7f7e8db90640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7e88056960 0x7f7e88132670 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:33:39.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.062+0000 7f7e8d38f640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7e8815c4b0 0x7f7e880ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:39.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.062+0000 7f7e8e391640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e88162ca0 0x7f7e8813ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:39.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.062+0000 7f7e8d38f640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7e8815c4b0 0x7f7e880ada30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:58864/0 (socket says 10.20.193.58:58864) 2026-02-23T06:33:39.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.062+0000 7f7e8d38f640 1 -- 10.20.193.58:0/3892204898 learned_addr learned my addr 10.20.193.58:0/3892204898 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:33:39.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.062+0000 7f7e8d38f640 1 -- 10.20.193.58:0/3892204898 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e88162ca0 msgr2=0x7f7e8813ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:39.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.062+0000 7f7e8d38f640 1 --2- 10.20.193.58:0/3892204898 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e88162ca0 0x7f7e8813ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:39.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.062+0000 7f7e8d38f640 1 -- 10.20.193.58:0/3892204898 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7e88056960 msgr2=0x7f7e88132670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:33:39.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.062+0000 7f7e8d38f640 1 --2- 10.20.193.58:0/3892204898 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7e88056960 0x7f7e88132670 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:39.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.062+0000 7f7e8d38f640 1 -- 10.20.193.58:0/3892204898 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e7c009570 con 0x7f7e8815c4b0 2026-02-23T06:33:39.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.063+0000 7f7e8d38f640 1 --2- 10.20.193.58:0/3892204898 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7e8815c4b0 0x7f7e880ada30 secure :-1 s=READY pgs=40 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e7c004740 tx=0x7f7e7c0028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:39.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.063+0000 7f7e767fc640 1 -- 10.20.193.58:0/3892204898 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7e7c03d070 con 0x7f7e8815c4b0 2026-02-23T06:33:39.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.063+0000 7f7e767fc640 1 -- 10.20.193.58:0/3892204898 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e7c038470 con 0x7f7e8815c4b0 2026-02-23T06:33:39.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.063+0000 7f7e8eb92640 1 -- 10.20.193.58:0/3892204898 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e8815bbf0 con 0x7f7e8815c4b0 2026-02-23T06:33:39.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.063+0000 7f7e767fc640 1 -- 10.20.193.58:0/3892204898 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7e7c038840 con 0x7f7e8815c4b0 2026-02-23T06:33:39.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.063+0000 7f7e8eb92640 1 -- 10.20.193.58:0/3892204898 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e88119b00 con 0x7f7e8815c4b0 2026-02-23T06:33:39.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.063+0000 7f7e8eb92640 1 --2- 10.20.193.58:0/3892204898 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e88161aa0 0x7f7e8813b290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:39.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.063+0000 7f7e8eb92640 1 -- 10.20.193.58:0/3892204898 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f7e88059690 con 0x7f7e88161aa0 2026-02-23T06:33:39.062 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.063+0000 7f7e8db90640 1 --2- 10.20.193.58:0/3892204898 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e88161aa0 0x7f7e8813b290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:39.062 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.064+0000 7f7e8db90640 1 -- 10.20.193.58:0/3892204898 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7e880593b0 con 0x7f7e88161aa0 2026-02-23T06:33:39.062 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.064+0000 7f7e8db90640 1 --2- 10.20.193.58:0/3892204898 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e88161aa0 0x7f7e8813b290 secure :-1 s=READY pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e78002730 tx=0x7f7e7800b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:39.062 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.064+0000 7f7e767fc640 1 -- 10.20.193.58:0/3892204898 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7e78003e30 con 0x7f7e88161aa0 2026-02-23T06:33:39.062 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.065+0000 7f7e767fc640 1 -- 10.20.193.58:0/3892204898 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f7e78005070 con 0x7f7e88161aa0 2026-02-23T06:33:39.062 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.065+0000 7f7e767fc640 1 -- 10.20.193.58:0/3892204898 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e88161aa0 msgr2=0x7f7e8813b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:39.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.065+0000 7f7e767fc640 1 --2- 10.20.193.58:0/3892204898 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e88161aa0 0x7f7e8813b290 secure :-1 s=READY pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e78002730 tx=0x7f7e7800b8f0 comp rx=0 tx=0).stop 2026-02-23T06:33:39.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.065+0000 7f7e767fc640 1 -- 10.20.193.58:0/3892204898 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e88161aa0 msgr2=0x7f7e8813b290 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:33:39.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.065+0000 7f7e767fc640 1 --2- 10.20.193.58:0/3892204898 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e88161aa0 0x7f7e8813b290 secure :-1 s=CLOSED pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e78002730 tx=0x7f7e7800b8f0 comp rx=0 tx=0).stop 2026-02-23T06:33:39.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.065+0000 7f7e767fc640 1 -- 10.20.193.58:0/3892204898 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f7e7c0389a0 con 0x7f7e8815c4b0 2026-02-23T06:33:39.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.066+0000 7f7e767fc640 1 --2- 10.20.193.58:0/3892204898 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7e5807a430 0x7f7e5809a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:39.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.066+0000 7f7e767fc640 1 -- 10.20.193.58:0/3892204898 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f7e7c0c2380 con 0x7f7e8815c4b0 2026-02-23T06:33:39.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.066+0000 7f7e8db90640 1 --2- 10.20.193.58:0/3892204898 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7e5807a430 0x7f7e5809a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:39.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.066+0000 7f7e8db90640 1 --2- 10.20.193.58:0/3892204898 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7e5807a430 0x7f7e5809a8e0 secure :-1 s=READY pgs=311 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e78012040 tx=0x7f7e78008030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:39.065 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.068+0000 7f7e8eb92640 1 --2- 10.20.193.58:0/3892204898 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e880adf70 0x7f7e8813c3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:39.065 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.068+0000 7f7e8eb92640 1 -- 10.20.193.58:0/3892204898 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f7e8813bec0 con 0x7f7e880adf70 2026-02-23T06:33:39.065 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.068+0000 7f7e8e391640 1 --2- 10.20.193.58:0/3892204898 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e880adf70 0x7f7e8813c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:39.065 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.068+0000 7f7e8e391640 1 -- 10.20.193.58:0/3892204898 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7e8813bbe0 con 0x7f7e880adf70 2026-02-23T06:33:39.065 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.069+0000 7f7e8e391640 1 --2- 10.20.193.58:0/3892204898 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e880adf70 0x7f7e8813c3e0 secure :-1 s=READY pgs=223 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e84003470 tx=0x7f7e8400ff10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:39.065 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.069+0000 7f7e767fc640 1 -- 10.20.193.58:0/3892204898 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7e8401a070 con 0x7f7e880adf70 2026-02-23T06:33:39.065 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.069+0000 7f7e767fc640 1 -- 10.20.193.58:0/3892204898 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5545 (secure 0 0 0) 0x7f7e84007b90 con 0x7f7e880adf70 2026-02-23T06:33:39.065 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.069+0000 7f7e767fc640 1 -- 10.20.193.58:0/3892204898 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e880adf70 msgr2=0x7f7e8813c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:39.065 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.069+0000 7f7e767fc640 1 --2- 10.20.193.58:0/3892204898 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e880adf70 0x7f7e8813c3e0 secure :-1 s=READY pgs=223 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e84003470 tx=0x7f7e8400ff10 comp rx=0 tx=0).stop 2026-02-23T06:33:39.066 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.069+0000 7f7e767fc640 1 -- 10.20.193.58:0/3892204898 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e880adf70 msgr2=0x7f7e8813c3e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:33:39.066 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.069+0000 7f7e767fc640 1 --2- 10.20.193.58:0/3892204898 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e880adf70 0x7f7e8813c3e0 unknown :-1 s=CLOSED pgs=223 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:39.066 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:33:39.066 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:33:39.066 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:33:39.066 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:33:39.066 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 102, 2026-02-23T06:33:39.067 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 493581, 2026-02-23T06:33:39.067 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:33:39.067 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:33:39.067 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:33:39.067 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:39.067 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:33:39.067 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:33:39.067 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:33:39.067 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:33:39.067 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:39.067 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:39.067 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:39.068 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:39.068 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:39.068 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:39.068 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:39.068 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:39.068 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:39.068 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:39.068 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:39.068 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:39.068 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:39.068 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:39.068 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:33:39.069 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:33:39.069 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:39.069 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:39.069 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:39.069 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:39.069 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:39.069 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:39.069 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:39.069 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:39.069 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:39.069 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:39.069 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:39.070 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:39.070 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:39.070 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:39.070 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:39.070 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:33:39.070 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:33:39.070 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:33:39.070 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:33:39.070 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:33:39.070 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:33:39.070 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:33:39.070 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:33:39.071 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:33:39.071 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:33:39.071 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:33:39.071 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:33:39.071 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:33:39.071 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:33:39.071 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:33:39.071 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:33:39.071 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:33:39.071 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:39.071 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:39.071 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:39.071 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:39.072 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:39.072 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:39.072 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:39.072 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:39.072 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:39.072 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:39.072 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:39.072 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:39.072 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:39.072 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:39.072 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:33:39.072 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:39.073 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:33:39.073 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:39.073 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:33:39.073 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:33:39.073 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:39.073 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:39.073 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:39.073 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:39.073 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:33:39.073 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:39.073 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:39.073 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:39.073 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:39.074 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:33:39.074 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:39.074 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:39.074 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:39.074 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:39.074 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:33:39.074 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:33:39.074 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:39.074 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:39.074 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:33:39.074 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:39.074 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:39.075 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:39.075 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:33:39.075 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:33:39.075 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:39.075 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:39.075 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:39.075 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:39.075 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:33:39.075 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:39.075 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:39.075 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:39.075 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:39.075 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:33:39.076 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:39.076 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:39.076 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:39.076 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:39.076 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:33:39.076 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:33:39.076 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:39.076 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:39.076 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:33:39.076 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:39.076 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:39.076 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:39.076 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:33:39.077 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:33:39.077 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:39.077 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:39.077 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:39.077 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:39.077 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:33:39.077 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:39.077 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:39.077 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:39.077 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:39.077 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:33:39.077 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:39.077 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:39.078 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:39.078 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:39.078 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:33:39.078 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:33:39.078 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:39.078 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:39.078 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:33:39.078 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:39.078 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:39.078 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:39.078 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:39.078 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:33:39.078 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:33:39.079 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:39.079 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:39.079 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:39.079 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:33:39.079 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:39.079 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:39.079 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:33:39.079 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:39.079 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:39.079 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:39.079 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:33:39.079 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:39.079 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:39.080 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:33:39.080 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:39.080 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:39.080 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:39.080 INFO:teuthology.orchestra.run.trial058.stdout: "num": 8 2026-02-23T06:33:39.080 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:39.080 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:39.080 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:33:39.080 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:39.080 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:33:39.080 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:33:39.080 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:33:39.080 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:39.081 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:39.081 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:39.081 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:39.081 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:33:39.081 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:39.081 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:39.081 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:33:39.081 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:39.081 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:39.081 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:39.081 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:33:39.081 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:39.082 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:39.082 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:39.082 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:33:39.082 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:33:39.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.069+0000 7f7e8eb92640 1 -- 10.20.193.58:0/3892204898 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7e5807a430 msgr2=0x7f7e5809a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:39.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.069+0000 7f7e8eb92640 1 --2- 10.20.193.58:0/3892204898 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7e5807a430 0x7f7e5809a8e0 secure :-1 s=READY pgs=311 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e78012040 tx=0x7f7e78008030 comp rx=0 tx=0).stop 2026-02-23T06:33:39.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.069+0000 7f7e8eb92640 1 -- 10.20.193.58:0/3892204898 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7e8815c4b0 msgr2=0x7f7e880ada30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:39.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.069+0000 7f7e8eb92640 1 --2- 10.20.193.58:0/3892204898 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7e8815c4b0 0x7f7e880ada30 secure :-1 s=READY pgs=40 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e7c004740 tx=0x7f7e7c0028d0 comp rx=0 tx=0).stop 2026-02-23T06:33:39.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.069+0000 7f7e8e391640 1 -- 10.20.193.58:0/3892204898 reap_dead start 2026-02-23T06:33:39.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.069+0000 7f7e8eb92640 1 -- 10.20.193.58:0/3892204898 shutdown_connections 2026-02-23T06:33:39.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.069+0000 7f7e8eb92640 1 -- 10.20.193.58:0/3892204898 >> 10.20.193.58:0/3892204898 conn(0x7f7e880b3c20 msgr2=0x7f7e880b40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:39.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.070+0000 7f7e8eb92640 1 -- 10.20.193.58:0/3892204898 shutdown_connections 2026-02-23T06:33:39.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:39.070+0000 7f7e8eb92640 1 -- 10.20.193.58:0/3892204898 wait complete. 2026-02-23T06:33:39.084 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:33:39.085 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:33:43.318 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:33:43.323 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:33:59.085 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-23T06:33:59.085 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-23T06:33:59.085 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-23T06:33:59.085 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-23T06:33:59.087 INFO:tasks.ceph.mon.b:Started 2026-02-23T06:33:59.087 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:33:59.087 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:33:59.212 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.217+0000 7fe29ca5a640 1 -- 10.20.193.58:0/2783029815 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe284004850 msgr2=0x7fe284004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:59.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.217+0000 7fe29ca5a640 1 --2- 10.20.193.58:0/2783029815 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe284004850 0x7fe284004cc0 secure :-1 s=READY pgs=44 gs=5 cs=0 l=1 c_cookie=15627319294844447862 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe280003180 tx=0x7fe28002f890 comp rx=0 tx=0).stop 2026-02-23T06:33:59.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.217+0000 7fe29ca5a640 1 -- 10.20.193.58:0/2783029815 shutdown_connections 2026-02-23T06:33:59.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.217+0000 7fe29ca5a640 1 --2- 10.20.193.58:0/2783029815 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe284004850 0x7fe284004cc0 unknown :-1 s=CLOSED pgs=44 gs=5 cs=0 l=1 c_cookie=15627319294844447862 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:59.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.217+0000 7fe29ca5a640 1 -- 10.20.193.58:0/2783029815 >> 10.20.193.58:0/2783029815 conn(0x7fe2980b3c20 msgr2=0x7fe2980b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:59.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.217+0000 7fe29ca5a640 1 -- 10.20.193.58:0/2783029815 shutdown_connections 2026-02-23T06:33:59.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.217+0000 7fe29ca5a640 1 -- 10.20.193.58:0/2783029815 wait complete. 2026-02-23T06:33:59.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.218+0000 7fe29ca5a640 1 Processor -- start 2026-02-23T06:33:59.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.219+0000 7fe29ca5a640 1 -- start start 2026-02-23T06:33:59.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.219+0000 7fe29ca5a640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe284004850 0x7fe298201aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:59.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.219+0000 7fe29ca5a640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe29815dc40 0x7fe2981606d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:59.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.219+0000 7fe29ca5a640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe298160f90 0x7fe29813faf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:59.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.219+0000 7fe29ca5a640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe2980580a0 con 0x7fe29815dc40 2026-02-23T06:33:59.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.219+0000 7fe29ca5a640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe2981631e0 con 0x7fe284004850 2026-02-23T06:33:59.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.219+0000 7fe29ca5a640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe298201fe0 con 0x7fe298160f90 2026-02-23T06:33:59.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.219+0000 7fe296d76640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe284004850 0x7fe298201aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:59.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.219+0000 7fe296575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe29815dc40 0x7fe2981606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:59.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.219+0000 7fe296d76640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe284004850 0x7fe298201aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:55420/0 (socket says 10.20.193.58:55420) 2026-02-23T06:33:59.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.219+0000 7fe296d76640 1 -- 10.20.193.58:0/3666568239 learned_addr learned my addr 10.20.193.58:0/3666568239 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:33:59.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.220+0000 7fe297577640 1 --2- 10.20.193.58:0/3666568239 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe298160f90 0x7fe29813faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:59.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.220+0000 7fe296575640 1 -- 10.20.193.58:0/3666568239 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe298160f90 msgr2=0x7fe29813faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:59.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.220+0000 7fe296575640 1 --2- 10.20.193.58:0/3666568239 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe298160f90 0x7fe29813faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:59.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.220+0000 7fe296575640 1 -- 10.20.193.58:0/3666568239 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe284004850 msgr2=0x7fe298201aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:59.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.220+0000 7fe296575640 1 --2- 10.20.193.58:0/3666568239 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe284004850 0x7fe298201aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:59.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.220+0000 7fe296575640 1 -- 10.20.193.58:0/3666568239 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe29815aba0 con 0x7fe29815dc40 2026-02-23T06:33:59.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.220+0000 7fe296d76640 1 --2- 10.20.193.58:0/3666568239 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe284004850 0x7fe298201aa0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:33:59.216 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.220+0000 7fe296575640 1 --2- 10.20.193.58:0/3666568239 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe29815dc40 0x7fe2981606d0 secure :-1 s=READY pgs=45 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2840661e0 tx=0x7fe280003570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:59.217 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.220+0000 7fe2777fe640 1 -- 10.20.193.58:0/3666568239 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe28003e070 con 0x7fe29815dc40 2026-02-23T06:33:59.217 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.220+0000 7fe29ca5a640 1 -- 10.20.193.58:0/3666568239 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe298160c10 con 0x7fe29815dc40 2026-02-23T06:33:59.217 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.220+0000 7fe2777fe640 1 -- 10.20.193.58:0/3666568239 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe280003680 con 0x7fe29815dc40 2026-02-23T06:33:59.217 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.220+0000 7fe2777fe640 1 -- 10.20.193.58:0/3666568239 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe280003ab0 con 0x7fe29815dc40 2026-02-23T06:33:59.217 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.220+0000 7fe29ca5a640 1 -- 10.20.193.58:0/3666568239 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe298162f00 con 0x7fe29815dc40 2026-02-23T06:33:59.217 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.221+0000 7fe29ca5a640 1 -- 10.20.193.58:0/3666568239 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2980ae820 con 0x7fe29815dc40 2026-02-23T06:33:59.217 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.222+0000 7fe2777fe640 1 -- 10.20.193.58:0/3666568239 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fe280003c10 con 0x7fe29815dc40 2026-02-23T06:33:59.217 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.223+0000 7fe2777fe640 1 --2- 10.20.193.58:0/3666568239 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe26407a6c0 0x7fe26409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:59.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.223+0000 7fe2777fe640 1 -- 10.20.193.58:0/3666568239 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fe2800c1a40 con 0x7fe29815dc40 2026-02-23T06:33:59.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.223+0000 7fe296d76640 1 --2- 10.20.193.58:0/3666568239 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe26407a6c0 0x7fe26409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:59.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.224+0000 7fe296d76640 1 --2- 10.20.193.58:0/3666568239 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe26407a6c0 0x7fe26409ab70 secure :-1 s=READY pgs=313 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe28c005db0 tx=0x7fe28c00b260 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:59.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.225+0000 7fe2777fe640 1 -- 10.20.193.58:0/3666568239 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fe280084c20 con 0x7fe29815dc40 2026-02-23T06:33:59.374 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.379+0000 7fe29ca5a640 1 -- 10.20.193.58:0/3666568239 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe2980b7260 con 0x7fe29815dc40 2026-02-23T06:33:59.374 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.379+0000 7fe2777fe640 1 -- 10.20.193.58:0/3666568239 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7fe280087d40 con 0x7fe29815dc40 2026-02-23T06:33:59.374 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":108,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:33:59.375 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.380+0000 7fe29ca5a640 1 -- 10.20.193.58:0/3666568239 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe26407a6c0 msgr2=0x7fe26409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:59.375 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.380+0000 7fe29ca5a640 1 --2- 10.20.193.58:0/3666568239 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe26407a6c0 0x7fe26409ab70 secure :-1 s=READY pgs=313 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe28c005db0 tx=0x7fe28c00b260 comp rx=0 tx=0).stop 2026-02-23T06:33:59.375 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.380+0000 7fe29ca5a640 1 -- 10.20.193.58:0/3666568239 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe29815dc40 msgr2=0x7fe2981606d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:59.375 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.380+0000 7fe29ca5a640 1 --2- 10.20.193.58:0/3666568239 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe29815dc40 0x7fe2981606d0 secure :-1 s=READY pgs=45 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2840661e0 tx=0x7fe280003570 comp rx=0 tx=0).stop 2026-02-23T06:33:59.375 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.380+0000 7fe29ca5a640 1 -- 10.20.193.58:0/3666568239 shutdown_connections 2026-02-23T06:33:59.375 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.380+0000 7fe29ca5a640 1 --2- 10.20.193.58:0/3666568239 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe26407a6c0 0x7fe26409ab70 unknown :-1 s=CLOSED pgs=313 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:59.375 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.380+0000 7fe29ca5a640 1 --2- 10.20.193.58:0/3666568239 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe298160f90 0x7fe29813faf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:59.376 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.380+0000 7fe29ca5a640 1 --2- 10.20.193.58:0/3666568239 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe29815dc40 0x7fe2981606d0 unknown :-1 s=CLOSED pgs=45 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:59.376 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.380+0000 7fe29ca5a640 1 --2- 10.20.193.58:0/3666568239 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe284004850 0x7fe298201aa0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:59.376 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.380+0000 7fe29ca5a640 1 -- 10.20.193.58:0/3666568239 >> 10.20.193.58:0/3666568239 conn(0x7fe2980b3c20 msgr2=0x7fe29813c690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:59.376 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.381+0000 7fe29ca5a640 1 -- 10.20.193.58:0/3666568239 shutdown_connections 2026-02-23T06:33:59.376 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.381+0000 7fe29ca5a640 1 -- 10.20.193.58:0/3666568239 wait complete. 2026-02-23T06:33:59.387 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:33:59.387 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:33:59.387 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:33:59.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.515+0000 7fba24e43640 1 -- 10.20.193.58:0/1699718192 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba04004d90 msgr2=0x7fba04005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:59.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.515+0000 7fba24e43640 1 --2- 10.20.193.58:0/1699718192 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba04004d90 0x7fba04005200 secure :-1 s=READY pgs=47 gs=5 cs=0 l=1 c_cookie=6741135637172690918 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba14004260 tx=0x7fba14030990 comp rx=0 tx=0).stop 2026-02-23T06:33:59.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.515+0000 7fba1ffff640 1 -- 10.20.193.58:0/1699718192 reap_dead start 2026-02-23T06:33:59.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.515+0000 7fba24e43640 1 -- 10.20.193.58:0/1699718192 shutdown_connections 2026-02-23T06:33:59.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.515+0000 7fba24e43640 1 -- 10.20.193.58:0/1699718192 >> 10.20.193.58:0/1699718192 conn(0x7fba200b3c20 msgr2=0x7fba200b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:59.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.515+0000 7fba24e43640 1 -- 10.20.193.58:0/1699718192 shutdown_connections 2026-02-23T06:33:59.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.515+0000 7fba24e43640 1 -- 10.20.193.58:0/1699718192 wait complete. 2026-02-23T06:33:59.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.516+0000 7fba24e43640 1 Processor -- start 2026-02-23T06:33:59.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.516+0000 7fba24e43640 1 -- start start 2026-02-23T06:33:59.513 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.517+0000 7fba24e43640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fba20140500 0x7fba201408d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:59.513 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.517+0000 7fba24e43640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba2011e390 0x7fba2013c8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:59.513 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.517+0000 7fba24e43640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba2011e800 0x7fba2013cde0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:59.513 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.517+0000 7fba24e43640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fba20140e10 con 0x7fba2011e390 2026-02-23T06:33:59.513 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.517+0000 7fba24e43640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fba20057920 con 0x7fba2011e800 2026-02-23T06:33:59.513 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.517+0000 7fba24e43640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fba20057d60 con 0x7fba20140500 2026-02-23T06:33:59.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.517+0000 7fba1effd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba2011e390 0x7fba2013c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:59.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.517+0000 7fba1f7fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fba20140500 0x7fba201408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:59.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.517+0000 7fba1ffff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba2011e800 0x7fba2013cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:59.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.517+0000 7fba1ffff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba2011e800 0x7fba2013cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:55454/0 (socket says 10.20.193.58:55454) 2026-02-23T06:33:59.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.517+0000 7fba1ffff640 1 -- 10.20.193.58:0/1440118463 learned_addr learned my addr 10.20.193.58:0/1440118463 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:33:59.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.517+0000 7fba1effd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba2011e390 0x7fba2013c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:55446/0 (socket says 10.20.193.58:55446) 2026-02-23T06:33:59.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.517+0000 7fba1f7fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fba20140500 0x7fba201408d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:41338/0 (socket says 10.20.193.58:41338) 2026-02-23T06:33:59.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.517+0000 7fba1effd640 1 -- 10.20.193.58:0/1440118463 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fba20140500 msgr2=0x7fba201408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:59.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.517+0000 7fba1effd640 1 --2- 10.20.193.58:0/1440118463 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fba20140500 0x7fba201408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:59.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.517+0000 7fba1effd640 1 -- 10.20.193.58:0/1440118463 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba2011e800 msgr2=0x7fba2013cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:59.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.517+0000 7fba1effd640 1 --2- 10.20.193.58:0/1440118463 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba2011e800 0x7fba2013cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:59.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.517+0000 7fba1effd640 1 -- 10.20.193.58:0/1440118463 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba201411e0 con 0x7fba2011e390 2026-02-23T06:33:59.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.517+0000 7fba1ffff640 1 --2- 10.20.193.58:0/1440118463 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba2011e800 0x7fba2013cde0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:33:59.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.518+0000 7fba1effd640 1 --2- 10.20.193.58:0/1440118463 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba2011e390 0x7fba2013c8a0 secure :-1 s=READY pgs=48 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba1000f690 tx=0x7fba1000fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:59.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.518+0000 7fb9fbfff640 1 -- 10.20.193.58:0/1440118463 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba10004a70 con 0x7fba2011e390 2026-02-23T06:33:59.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.518+0000 7fb9fbfff640 1 -- 10.20.193.58:0/1440118463 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba10004cc0 con 0x7fba2011e390 2026-02-23T06:33:59.515 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.518+0000 7fb9fbfff640 1 -- 10.20.193.58:0/1440118463 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba1000daa0 con 0x7fba2011e390 2026-02-23T06:33:59.515 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.518+0000 7fba24e43640 1 -- 10.20.193.58:0/1440118463 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba201456b0 con 0x7fba2011e390 2026-02-23T06:33:59.515 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.518+0000 7fba24e43640 1 -- 10.20.193.58:0/1440118463 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba2011de70 con 0x7fba2011e390 2026-02-23T06:33:59.515 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.520+0000 7fb9fbfff640 1 -- 10.20.193.58:0/1440118463 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fba1000dc00 con 0x7fba2011e390 2026-02-23T06:33:59.515 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.520+0000 7fba24e43640 1 --2- 10.20.193.58:0/1440118463 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba20057ea0 0x7fba2013d320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:59.516 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.520+0000 7fba24e43640 1 -- 10.20.193.58:0/1440118463 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fba2011e080 con 0x7fba20057ea0 2026-02-23T06:33:59.516 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.520+0000 7fba1f7fe640 1 --2- 10.20.193.58:0/1440118463 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba20057ea0 0x7fba2013d320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:59.516 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.520+0000 7fba1f7fe640 1 -- 10.20.193.58:0/1440118463 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fba200b6330 con 0x7fba20057ea0 2026-02-23T06:33:59.516 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.520+0000 7fba1f7fe640 1 --2- 10.20.193.58:0/1440118463 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba20057ea0 0x7fba2013d320 secure :-1 s=READY pgs=49 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba0c011b20 tx=0x7fba0c00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:59.516 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.521+0000 7fb9fbfff640 1 --2- 10.20.193.58:0/1440118463 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb9f007a6b0 0x7fb9f009ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:59.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.521+0000 7fb9fbfff640 1 -- 10.20.193.58:0/1440118463 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fba1009dcc0 con 0x7fba2011e390 2026-02-23T06:33:59.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.521+0000 7fb9fbfff640 1 -- 10.20.193.58:0/1440118463 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba0c00fe80 con 0x7fba20057ea0 2026-02-23T06:33:59.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.521+0000 7fb9fbfff640 1 -- 10.20.193.58:0/1440118463 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fba0c004110 con 0x7fba20057ea0 2026-02-23T06:33:59.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.521+0000 7fb9fbfff640 1 -- 10.20.193.58:0/1440118463 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba20057ea0 msgr2=0x7fba2013d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:59.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.521+0000 7fb9fbfff640 1 --2- 10.20.193.58:0/1440118463 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba20057ea0 0x7fba2013d320 secure :-1 s=READY pgs=49 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba0c011b20 tx=0x7fba0c00f3c0 comp rx=0 tx=0).stop 2026-02-23T06:33:59.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.521+0000 7fb9fbfff640 1 -- 10.20.193.58:0/1440118463 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba20057ea0 msgr2=0x7fba2013d320 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:33:59.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.521+0000 7fb9fbfff640 1 --2- 10.20.193.58:0/1440118463 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba20057ea0 0x7fba2013d320 unknown :-1 s=CLOSED pgs=49 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:59.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.521+0000 7fba1ffff640 1 --2- 10.20.193.58:0/1440118463 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb9f007a6b0 0x7fb9f009ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:59.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.522+0000 7fba1ffff640 1 --2- 10.20.193.58:0/1440118463 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb9f007a6b0 0x7fb9f009ab60 secure :-1 s=READY pgs=314 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba2011ebf0 tx=0x7fba14004190 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:59.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.524+0000 7fba24e43640 1 --2- 10.20.193.58:0/1440118463 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba2013dab0 0x7fba2013deb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:59.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.524+0000 7fba24e43640 1 -- 10.20.193.58:0/1440118463 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fba2013c750 con 0x7fba2013dab0 2026-02-23T06:33:59.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.524+0000 7fba1f7fe640 1 --2- 10.20.193.58:0/1440118463 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba2013dab0 0x7fba2013deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:59.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.525+0000 7fba1f7fe640 1 -- 10.20.193.58:0/1440118463 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fba200b5e10 con 0x7fba2013dab0 2026-02-23T06:33:59.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.525+0000 7fba1f7fe640 1 --2- 10.20.193.58:0/1440118463 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba2013dab0 0x7fba2013deb0 secure :-1 s=READY pgs=50 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba0c011b20 tx=0x7fba0c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:59.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.525+0000 7fb9fbfff640 1 -- 10.20.193.58:0/1440118463 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba0c024070 con 0x7fba2013dab0 2026-02-23T06:33:59.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.525+0000 7fb9fbfff640 1 -- 10.20.193.58:0/1440118463 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4913 (secure 0 0 0) 0x7fba0c01e050 con 0x7fba2013dab0 2026-02-23T06:33:59.520 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:33:59.520 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:33:59.520 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:33:59.520 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:33:59.520 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 108, 2026-02-23T06:33:59.520 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 47037, 2026-02-23T06:33:59.520 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:33:59.520 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:33:59.520 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:33:59.520 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:33:59.520 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:59.520 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:33:59.520 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:33:59.520 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:33:59.520 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:33:59.520 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:59.520 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:59.520 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:59.520 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:59.520 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:33:59.521 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:33:59.522 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:33:59.523 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:33:59.524 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:33:59.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.525+0000 7fb9fbfff640 1 -- 10.20.193.58:0/1440118463 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba2013dab0 msgr2=0x7fba2013deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:59.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.525+0000 7fb9fbfff640 1 --2- 10.20.193.58:0/1440118463 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba2013dab0 0x7fba2013deb0 secure :-1 s=READY pgs=50 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba0c011b20 tx=0x7fba0c0047e0 comp rx=0 tx=0).stop 2026-02-23T06:33:59.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.525+0000 7fb9fbfff640 1 -- 10.20.193.58:0/1440118463 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba2013dab0 msgr2=0x7fba2013deb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:33:59.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.525+0000 7fb9fbfff640 1 --2- 10.20.193.58:0/1440118463 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba2013dab0 0x7fba2013deb0 secure :-1 s=CLOSED pgs=50 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba0c011b20 tx=0x7fba0c0047e0 comp rx=0 tx=0).stop 2026-02-23T06:33:59.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.525+0000 7fba24e43640 1 -- 10.20.193.58:0/1440118463 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb9f007a6b0 msgr2=0x7fb9f009ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:59.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.525+0000 7fba24e43640 1 --2- 10.20.193.58:0/1440118463 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb9f007a6b0 0x7fb9f009ab60 secure :-1 s=READY pgs=314 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba2011ebf0 tx=0x7fba14004190 comp rx=0 tx=0).stop 2026-02-23T06:33:59.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.525+0000 7fba24e43640 1 -- 10.20.193.58:0/1440118463 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba2011e390 msgr2=0x7fba2013c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:59.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.525+0000 7fba24e43640 1 --2- 10.20.193.58:0/1440118463 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba2011e390 0x7fba2013c8a0 secure :-1 s=READY pgs=48 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba1000f690 tx=0x7fba1000fb60 comp rx=0 tx=0).stop 2026-02-23T06:33:59.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.525+0000 7fba1ffff640 1 -- 10.20.193.58:0/1440118463 reap_dead start 2026-02-23T06:33:59.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.525+0000 7fba1ffff640 1 -- 10.20.193.58:0/1440118463 reap_dead start 2026-02-23T06:33:59.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.526+0000 7fba24e43640 1 -- 10.20.193.58:0/1440118463 shutdown_connections 2026-02-23T06:33:59.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.526+0000 7fba24e43640 1 -- 10.20.193.58:0/1440118463 >> 10.20.193.58:0/1440118463 conn(0x7fba200b3c20 msgr2=0x7fba20141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:59.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.526+0000 7fba24e43640 1 -- 10.20.193.58:0/1440118463 shutdown_connections 2026-02-23T06:33:59.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.526+0000 7fba24e43640 1 -- 10.20.193.58:0/1440118463 wait complete. 2026-02-23T06:33:59.530 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:33:59.530 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:33:59.530 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:33:59.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.656+0000 7fb601139640 1 -- 10.20.193.58:0/2841584332 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5fc15d4a0 msgr2=0x7fb5fc0affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:59.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.656+0000 7fb601139640 1 --2- 10.20.193.58:0/2841584332 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5fc15d4a0 0x7fb5fc0affb0 secure :-1 s=READY pgs=5 gs=3 cs=0 l=1 c_cookie=6620678514205736744 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5e8004740 tx=0x7fb5e802f230 comp rx=0 tx=0).stop 2026-02-23T06:33:59.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.656+0000 7fb601139640 1 -- 10.20.193.58:0/2841584332 shutdown_connections 2026-02-23T06:33:59.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.656+0000 7fb601139640 1 --2- 10.20.193.58:0/2841584332 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5fc15d4a0 0x7fb5fc0affb0 unknown :-1 s=CLOSED pgs=5 gs=3 cs=0 l=1 c_cookie=6620678514205736744 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:59.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.656+0000 7fb601139640 1 -- 10.20.193.58:0/2841584332 >> 10.20.193.58:0/2841584332 conn(0x7fb5fc0b3c20 msgr2=0x7fb5fc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:59.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.656+0000 7fb601139640 1 -- 10.20.193.58:0/2841584332 shutdown_connections 2026-02-23T06:33:59.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.656+0000 7fb601139640 1 -- 10.20.193.58:0/2841584332 wait complete. 2026-02-23T06:33:59.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.658+0000 7fb601139640 1 Processor -- start 2026-02-23T06:33:59.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.658+0000 7fb601139640 1 -- start start 2026-02-23T06:33:59.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.658+0000 7fb601139640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5fc0b6690 0x7fb5fc13f410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:59.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.658+0000 7fb601139640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb5fc15d4a0 0x7fb5fc13b100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:59.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.658+0000 7fb601139640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5fc15d870 0x7fb5fc13d160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:59.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.658+0000 7fb601139640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb5fc162cc0 con 0x7fb5fc15d4a0 2026-02-23T06:33:59.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.658+0000 7fb601139640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb5fc162ef0 con 0x7fb5fc0b6690 2026-02-23T06:33:59.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.658+0000 7fb601139640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb5fc1fdef0 con 0x7fb5fc15d870 2026-02-23T06:33:59.654 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.658+0000 7fb5fb7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb5fc15d4a0 0x7fb5fc13b100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:59.654 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.658+0000 7fb5fbfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5fc0b6690 0x7fb5fc13f410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:59.654 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.659+0000 7fb5fbfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5fc0b6690 0x7fb5fc13f410 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:55468/0 (socket says 10.20.193.58:55468) 2026-02-23T06:33:59.654 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.659+0000 7fb5fbfff640 1 -- 10.20.193.58:0/226928706 learned_addr learned my addr 10.20.193.58:0/226928706 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:33:59.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.659+0000 7fb600938640 1 --2- 10.20.193.58:0/226928706 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5fc15d870 0x7fb5fc13d160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:59.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.659+0000 7fb5fbfff640 1 -- 10.20.193.58:0/226928706 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5fc15d870 msgr2=0x7fb5fc13d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:59.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.659+0000 7fb5fbfff640 1 --2- 10.20.193.58:0/226928706 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5fc15d870 0x7fb5fc13d160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:59.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.659+0000 7fb5fbfff640 1 -- 10.20.193.58:0/226928706 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb5fc15d4a0 msgr2=0x7fb5fc13b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:59.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.659+0000 7fb5fbfff640 1 --2- 10.20.193.58:0/226928706 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb5fc15d4a0 0x7fb5fc13b100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:59.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.659+0000 7fb5fbfff640 1 -- 10.20.193.58:0/226928706 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e80094b0 con 0x7fb5fc0b6690 2026-02-23T06:33:59.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.659+0000 7fb5fb7fe640 1 --2- 10.20.193.58:0/226928706 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb5fc15d4a0 0x7fb5fc13b100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:33:59.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.659+0000 7fb5fbfff640 1 --2- 10.20.193.58:0/226928706 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5fc0b6690 0x7fb5fc13f410 secure :-1 s=READY pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5e80097e0 tx=0x7fb5e8002950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:59.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.659+0000 7fb5f8ff9640 1 -- 10.20.193.58:0/226928706 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5e8038470 con 0x7fb5fc0b6690 2026-02-23T06:33:59.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.659+0000 7fb5f8ff9640 1 -- 10.20.193.58:0/226928706 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5e80386c0 con 0x7fb5fc0b6690 2026-02-23T06:33:59.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.659+0000 7fb5f8ff9640 1 -- 10.20.193.58:0/226928706 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5e8038ad0 con 0x7fb5fc0b6690 2026-02-23T06:33:59.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.659+0000 7fb601139640 1 -- 10.20.193.58:0/226928706 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5fc1fe1d0 con 0x7fb5fc0b6690 2026-02-23T06:33:59.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.659+0000 7fb601139640 1 -- 10.20.193.58:0/226928706 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5fc1fe790 con 0x7fb5fc0b6690 2026-02-23T06:33:59.656 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.660+0000 7fb601139640 1 --2- 10.20.193.58:0/226928706 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5fc160a70 0x7fb5fc13d6a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:59.656 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.660+0000 7fb601139640 1 -- 10.20.193.58:0/226928706 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb5fc0609c0 con 0x7fb5fc160a70 2026-02-23T06:33:59.656 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.660+0000 7fb5fb7fe640 1 --2- 10.20.193.58:0/226928706 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5fc160a70 0x7fb5fc13d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:59.656 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.660+0000 7fb5fb7fe640 1 -- 10.20.193.58:0/226928706 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb5fc164250 con 0x7fb5fc160a70 2026-02-23T06:33:59.656 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.661+0000 7fb5fb7fe640 1 --2- 10.20.193.58:0/226928706 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5fc160a70 0x7fb5fc13d6a0 secure :-1 s=READY pgs=7 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5fc140360 tx=0x7fb5ec00ff80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:59.656 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.661+0000 7fb5f8ff9640 1 -- 10.20.193.58:0/226928706 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5ec00dca0 con 0x7fb5fc160a70 2026-02-23T06:33:59.656 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.661+0000 7fb5f8ff9640 1 -- 10.20.193.58:0/226928706 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fb5ec00de00 con 0x7fb5fc160a70 2026-02-23T06:33:59.656 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.661+0000 7fb5f8ff9640 1 -- 10.20.193.58:0/226928706 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5fc160a70 msgr2=0x7fb5fc13d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:59.656 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.661+0000 7fb5f8ff9640 1 --2- 10.20.193.58:0/226928706 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5fc160a70 0x7fb5fc13d6a0 secure :-1 s=READY pgs=7 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5fc140360 tx=0x7fb5ec00ff80 comp rx=0 tx=0).stop 2026-02-23T06:33:59.656 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.661+0000 7fb5f8ff9640 1 -- 10.20.193.58:0/226928706 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5fc160a70 msgr2=0x7fb5fc13d6a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:33:59.656 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.661+0000 7fb5f8ff9640 1 --2- 10.20.193.58:0/226928706 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5fc160a70 0x7fb5fc13d6a0 unknown :-1 s=CLOSED pgs=7 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:59.656 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.661+0000 7fb5f8ff9640 1 -- 10.20.193.58:0/226928706 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fb5e8038c30 con 0x7fb5fc0b6690 2026-02-23T06:33:59.657 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.662+0000 7fb5f8ff9640 1 --2- 10.20.193.58:0/226928706 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb5cc07a3c0 0x7fb5cc09a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:59.657 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.662+0000 7fb5f8ff9640 1 -- 10.20.193.58:0/226928706 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fb5e80c2a90 con 0x7fb5fc0b6690 2026-02-23T06:33:59.657 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.662+0000 7fb5fb7fe640 1 --2- 10.20.193.58:0/226928706 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb5cc07a3c0 0x7fb5cc09a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:59.657 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.663+0000 7fb5fb7fe640 1 --2- 10.20.193.58:0/226928706 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb5cc07a3c0 0x7fb5cc09a870 secure :-1 s=READY pgs=315 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5ec0023d0 tx=0x7fb5ec014000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:59.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.665+0000 7fb601139640 1 --2- 10.20.193.58:0/226928706 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5fc15a050 0x7fb5fc15a420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:59.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.665+0000 7fb601139640 1 -- 10.20.193.58:0/226928706 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb5fc05b0e0 con 0x7fb5fc15a050 2026-02-23T06:33:59.660 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.665+0000 7fb600938640 1 --2- 10.20.193.58:0/226928706 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5fc15a050 0x7fb5fc15a420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:59.660 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.665+0000 7fb600938640 1 -- 10.20.193.58:0/226928706 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb5fc0b83c0 con 0x7fb5fc15a050 2026-02-23T06:33:59.660 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.665+0000 7fb600938640 1 --2- 10.20.193.58:0/226928706 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5fc15a050 0x7fb5fc15a420 secure :-1 s=READY pgs=8 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5f00038b0 tx=0x7fb5f000ff10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:59.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.666+0000 7fb5f8ff9640 1 -- 10.20.193.58:0/226928706 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5f001a070 con 0x7fb5fc15a050 2026-02-23T06:33:59.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.666+0000 7fb5f8ff9640 1 -- 10.20.193.58:0/226928706 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4909 (secure 0 0 0) 0x7fb5f0007b90 con 0x7fb5fc15a050 2026-02-23T06:33:59.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.666+0000 7fb5f8ff9640 1 -- 10.20.193.58:0/226928706 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5fc15a050 msgr2=0x7fb5fc15a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:59.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.666+0000 7fb5f8ff9640 1 --2- 10.20.193.58:0/226928706 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5fc15a050 0x7fb5fc15a420 secure :-1 s=READY pgs=8 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5f00038b0 tx=0x7fb5f000ff10 comp rx=0 tx=0).stop 2026-02-23T06:33:59.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.666+0000 7fb5f8ff9640 1 -- 10.20.193.58:0/226928706 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5fc15a050 msgr2=0x7fb5fc15a420 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:33:59.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.666+0000 7fb5f8ff9640 1 --2- 10.20.193.58:0/226928706 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5fc15a050 0x7fb5fc15a420 unknown :-1 s=CLOSED pgs=8 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:59.661 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:33:59.661 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:33:59.661 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:33:59.661 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:33:59.661 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 108, 2026-02-23T06:33:59.661 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 513, 2026-02-23T06:33:59.661 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:33:59.661 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:33:59.661 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:33:59.661 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:33:59.661 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:59.661 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:33:59.661 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:33:59.662 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:33:59.663 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:33:59.663 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:33:59.663 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:33:59.663 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:33:59.663 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:33:59.663 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:33:59.663 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:33:59.663 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:33:59.663 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:33:59.663 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:33:59.663 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:33:59.663 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:33:59.663 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:33:59.663 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:33:59.663 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:59.663 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:59.663 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:59.663 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:59.663 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:59.663 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:59.663 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:59.663 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:59.663 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:59.663 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:59.663 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:59.663 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:59.664 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:59.664 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:59.664 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:33:59.664 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.664 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:33:59.664 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.664 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:33:59.664 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:33:59.664 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:59.664 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:59.664 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.664 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:59.664 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:33:59.664 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:59.664 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.664 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.664 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:59.664 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:33:59.664 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:59.664 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:59.664 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:59.664 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.664 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:33:59.664 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:33:59.665 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:59.665 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:59.665 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:33:59.665 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:59.665 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.665 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.665 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:33:59.665 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:33:59.665 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:59.665 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:59.665 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.665 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:59.665 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:33:59.665 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:59.665 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.665 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.665 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:59.665 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:33:59.665 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:59.665 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:59.665 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:59.665 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.666 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:33:59.666 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:33:59.666 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:59.666 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:59.666 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:33:59.666 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:59.666 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.666 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.666 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:33:59.666 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:33:59.666 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:59.666 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:59.666 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.666 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:59.666 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:33:59.666 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:59.666 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.666 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.666 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:59.666 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:33:59.666 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:59.666 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:59.666 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:59.667 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.667 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:33:59.667 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:33:59.667 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:59.667 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:59.667 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:33:59.667 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:59.667 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:59.667 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:59.667 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.667 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:33:59.667 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:33:59.667 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.667 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:59.667 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:59.667 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:33:59.667 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:59.667 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:59.667 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:33:59.667 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.667 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:59.667 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:59.667 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:33:59.667 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:59.667 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:59.667 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.667 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:33:59.667 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:33:59.668 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.666+0000 7fb601139640 1 -- 10.20.193.58:0/226928706 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb5cc07a3c0 msgr2=0x7fb5cc09a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:59.668 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.666+0000 7fb601139640 1 --2- 10.20.193.58:0/226928706 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb5cc07a3c0 0x7fb5cc09a870 secure :-1 s=READY pgs=315 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5ec0023d0 tx=0x7fb5ec014000 comp rx=0 tx=0).stop 2026-02-23T06:33:59.668 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.666+0000 7fb601139640 1 -- 10.20.193.58:0/226928706 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5fc0b6690 msgr2=0x7fb5fc13f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:59.668 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.666+0000 7fb601139640 1 --2- 10.20.193.58:0/226928706 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5fc0b6690 0x7fb5fc13f410 secure :-1 s=READY pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5e80097e0 tx=0x7fb5e8002950 comp rx=0 tx=0).stop 2026-02-23T06:33:59.668 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.666+0000 7fb600938640 1 -- 10.20.193.58:0/226928706 reap_dead start 2026-02-23T06:33:59.668 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.666+0000 7fb601139640 1 -- 10.20.193.58:0/226928706 shutdown_connections 2026-02-23T06:33:59.668 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.666+0000 7fb601139640 1 -- 10.20.193.58:0/226928706 >> 10.20.193.58:0/226928706 conn(0x7fb5fc0b3c20 msgr2=0x7fb5fc0b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:59.669 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.666+0000 7fb601139640 1 -- 10.20.193.58:0/226928706 shutdown_connections 2026-02-23T06:33:59.669 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.666+0000 7fb601139640 1 -- 10.20.193.58:0/226928706 wait complete. 2026-02-23T06:33:59.669 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:33:59.669 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:33:59.669 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:33:59.792 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f837ee83640 1 -- 10.20.193.58:0/3283924995 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8360004850 msgr2=0x7f8360004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:59.792 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f837ee83640 1 --2- 10.20.193.58:0/3283924995 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8360004850 0x7f8360004cc0 secure :-1 s=READY pgs=53 gs=3 cs=0 l=1 c_cookie=13120682522563647129 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f836c005fd0 tx=0x7f836c02efb0 comp rx=0 tx=0).stop 2026-02-23T06:33:59.792 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f837e682640 1 -- 10.20.193.58:0/3283924995 reap_dead start 2026-02-23T06:33:59.792 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f837ee83640 1 -- 10.20.193.58:0/3283924995 shutdown_connections 2026-02-23T06:33:59.792 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f837ee83640 1 -- 10.20.193.58:0/3283924995 >> 10.20.193.58:0/3283924995 conn(0x7f83780b3c20 msgr2=0x7f83780b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:59.792 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f837ee83640 1 -- 10.20.193.58:0/3283924995 shutdown_connections 2026-02-23T06:33:59.794 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f837ee83640 1 -- 10.20.193.58:0/3283924995 wait complete. 2026-02-23T06:33:59.794 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f837ee83640 1 Processor -- start 2026-02-23T06:33:59.794 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f837ee83640 1 -- start start 2026-02-23T06:33:59.794 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f837ee83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f83782010d0 0x7f83780b1350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:59.794 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f837ee83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f83782014a0 0x7f8378124f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:59.794 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f837ee83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f83780aef20 0x7f8378125480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:59.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f837ee83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f83780b1890 con 0x7f83780aef20 2026-02-23T06:33:59.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f837ee83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f8378155ef0 con 0x7f83782010d0 2026-02-23T06:33:59.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f837ee83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f83780b1c40 con 0x7f83782014a0 2026-02-23T06:33:59.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f837e682640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f83780aef20 0x7f8378125480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:59.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f837e682640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f83780aef20 0x7f8378125480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:55488/0 (socket says 10.20.193.58:55488) 2026-02-23T06:33:59.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f837e682640 1 -- 10.20.193.58:0/4056331597 learned_addr learned my addr 10.20.193.58:0/4056331597 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:33:59.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f837e682640 1 -- 10.20.193.58:0/4056331597 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f83782014a0 msgr2=0x7f8378124f40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-23T06:33:59.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f837e682640 1 --2- 10.20.193.58:0/4056331597 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f83782014a0 0x7f8378124f40 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:59.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f837e682640 1 -- 10.20.193.58:0/4056331597 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f83782010d0 msgr2=0x7f83780b1350 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-23T06:33:59.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f837e682640 1 --2- 10.20.193.58:0/4056331597 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f83782010d0 0x7f83780b1350 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:59.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f837e682640 1 -- 10.20.193.58:0/4056331597 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8378155bf0 con 0x7f83780aef20 2026-02-23T06:33:59.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f837e682640 1 --2- 10.20.193.58:0/4056331597 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f83780aef20 0x7f8378125480 secure :-1 s=READY pgs=54 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f83780b5010 tx=0x7f837400d7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:59.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f83667fc640 1 -- 10.20.193.58:0/4056331597 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8374006a20 con 0x7f83780aef20 2026-02-23T06:33:59.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f83667fc640 1 -- 10.20.193.58:0/4056331597 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8374006c70 con 0x7f83780aef20 2026-02-23T06:33:59.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f83667fc640 1 -- 10.20.193.58:0/4056331597 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f83740082f0 con 0x7f83780aef20 2026-02-23T06:33:59.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f837ee83640 1 -- 10.20.193.58:0/4056331597 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83780aec60 con 0x7f83780aef20 2026-02-23T06:33:59.796 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.795+0000 7f837ee83640 1 -- 10.20.193.58:0/4056331597 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8378164a30 con 0x7f83780aef20 2026-02-23T06:33:59.796 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.800+0000 7f837ee83640 1 --2- 10.20.193.58:0/4056331597 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8378201b70 0x7f83781ff890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:59.796 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.800+0000 7f837ee83640 1 -- 10.20.193.58:0/4056331597 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f8378155d80 con 0x7f8378201b70 2026-02-23T06:33:59.796 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.801+0000 7f837de81640 1 --2- 10.20.193.58:0/4056331597 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8378201b70 0x7f83781ff890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:59.796 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.801+0000 7f837de81640 1 -- 10.20.193.58:0/4056331597 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f837805d9c0 con 0x7f8378201b70 2026-02-23T06:33:59.796 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.801+0000 7f837de81640 1 --2- 10.20.193.58:0/4056331597 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8378201b70 0x7f83781ff890 secure :-1 s=READY pgs=227 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f836800b310 tx=0x7f836800b7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:59.796 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.802+0000 7f83667fc640 1 -- 10.20.193.58:0/4056331597 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f83680044a0 con 0x7f8378201b70 2026-02-23T06:33:59.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.802+0000 7f83667fc640 1 -- 10.20.193.58:0/4056331597 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f8368002740 con 0x7f8378201b70 2026-02-23T06:33:59.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.802+0000 7f83667fc640 1 -- 10.20.193.58:0/4056331597 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8378201b70 msgr2=0x7f83781ff890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:59.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.802+0000 7f83667fc640 1 --2- 10.20.193.58:0/4056331597 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8378201b70 0x7f83781ff890 secure :-1 s=READY pgs=227 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f836800b310 tx=0x7f836800b7e0 comp rx=0 tx=0).stop 2026-02-23T06:33:59.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.802+0000 7f83667fc640 1 -- 10.20.193.58:0/4056331597 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8378201b70 msgr2=0x7f83781ff890 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:33:59.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.802+0000 7f83667fc640 1 --2- 10.20.193.58:0/4056331597 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8378201b70 0x7f83781ff890 unknown :-1 s=CLOSED pgs=227 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:59.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.802+0000 7f83667fc640 1 -- 10.20.193.58:0/4056331597 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f8374008450 con 0x7f83780aef20 2026-02-23T06:33:59.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.803+0000 7f83667fc640 1 --2- 10.20.193.58:0/4056331597 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f834807a3c0 0x7f834809a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:59.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.803+0000 7f83667fc640 1 -- 10.20.193.58:0/4056331597 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f837409cee0 con 0x7f83780aef20 2026-02-23T06:33:59.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.804+0000 7f837de81640 1 --2- 10.20.193.58:0/4056331597 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f834807a3c0 0x7f834809a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:59.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.804+0000 7f837de81640 1 --2- 10.20.193.58:0/4056331597 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f834807a3c0 0x7f834809a870 secure :-1 s=READY pgs=316 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f83680023d0 tx=0x7f8368008030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:59.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.806+0000 7f837ee83640 1 --2- 10.20.193.58:0/4056331597 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f83781ffdd0 0x7f83780af940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:59.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.806+0000 7f837ee83640 1 -- 10.20.193.58:0/4056331597 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f837805d540 con 0x7f83781ffdd0 2026-02-23T06:33:59.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.806+0000 7f837d680640 1 --2- 10.20.193.58:0/4056331597 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f83781ffdd0 0x7f83780af940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:59.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.806+0000 7f837d680640 1 -- 10.20.193.58:0/4056331597 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8378156030 con 0x7f83781ffdd0 2026-02-23T06:33:59.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.807+0000 7f837d680640 1 --2- 10.20.193.58:0/4056331597 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f83781ffdd0 0x7f83780af940 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f837805df80 tx=0x7f836c030e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:59.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.807+0000 7f83667fc640 1 -- 10.20.193.58:0/4056331597 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f836c002740 con 0x7f83781ffdd0 2026-02-23T06:33:59.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.807+0000 7f83667fc640 1 -- 10.20.193.58:0/4056331597 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5556 (secure 0 0 0) 0x7f836c0028a0 con 0x7f83781ffdd0 2026-02-23T06:33:59.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.807+0000 7f83667fc640 1 -- 10.20.193.58:0/4056331597 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f83781ffdd0 msgr2=0x7f83780af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:59.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.807+0000 7f83667fc640 1 --2- 10.20.193.58:0/4056331597 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f83781ffdd0 0x7f83780af940 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f837805df80 tx=0x7f836c030e40 comp rx=0 tx=0).stop 2026-02-23T06:33:59.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.807+0000 7f83667fc640 1 -- 10.20.193.58:0/4056331597 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f83781ffdd0 msgr2=0x7f83780af940 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:33:59.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.807+0000 7f83667fc640 1 --2- 10.20.193.58:0/4056331597 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f83781ffdd0 0x7f83780af940 secure :-1 s=CLOSED pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f837805df80 tx=0x7f836c030e40 comp rx=0 tx=0).stop 2026-02-23T06:33:59.802 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:33:59.802 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:33:59.802 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:33:59.802 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:33:59.802 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 108, 2026-02-23T06:33:59.802 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 514319, 2026-02-23T06:33:59.802 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:33:59.802 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:33:59.802 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:33:59.802 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:33:59.802 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:59.802 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:33:59.802 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:33:59.802 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:33:59.802 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:33:59.803 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.804 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:33:59.805 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:33:59.806 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: "num": 8 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:33:59.807 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:33:59.808 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:33:59.808 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.807+0000 7f837ee83640 1 -- 10.20.193.58:0/4056331597 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f834807a3c0 msgr2=0x7f834809a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:59.808 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.807+0000 7f837ee83640 1 --2- 10.20.193.58:0/4056331597 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f834807a3c0 0x7f834809a870 secure :-1 s=READY pgs=316 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f83680023d0 tx=0x7f8368008030 comp rx=0 tx=0).stop 2026-02-23T06:33:59.808 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.807+0000 7f837ee83640 1 -- 10.20.193.58:0/4056331597 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f83780aef20 msgr2=0x7f8378125480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:59.808 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.807+0000 7f837ee83640 1 --2- 10.20.193.58:0/4056331597 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f83780aef20 0x7f8378125480 secure :-1 s=READY pgs=54 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f83780b5010 tx=0x7f837400d7d0 comp rx=0 tx=0).stop 2026-02-23T06:33:59.808 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.807+0000 7f837e682640 1 -- 10.20.193.58:0/4056331597 reap_dead start 2026-02-23T06:33:59.808 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.807+0000 7f837e682640 1 -- 10.20.193.58:0/4056331597 reap_dead start 2026-02-23T06:33:59.808 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.807+0000 7f837ee83640 1 -- 10.20.193.58:0/4056331597 shutdown_connections 2026-02-23T06:33:59.809 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.807+0000 7f837ee83640 1 -- 10.20.193.58:0/4056331597 >> 10.20.193.58:0/4056331597 conn(0x7f83780b3c20 msgr2=0x7f837815af00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:59.809 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.807+0000 7f837ee83640 1 -- 10.20.193.58:0/4056331597 shutdown_connections 2026-02-23T06:33:59.809 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.808+0000 7f837ee83640 1 -- 10.20.193.58:0/4056331597 wait complete. 2026-02-23T06:33:59.813 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:33:59.813 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:33:59.813 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:33:59.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.942+0000 7f7e85a43640 1 -- 10.20.193.58:0/1836599296 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7e8015d870 msgr2=0x7f7e800587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:59.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.942+0000 7f7e85a43640 1 --2- 10.20.193.58:0/1836599296 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7e8015d870 0x7f7e800587b0 secure :-1 s=READY pgs=10 gs=2 cs=0 l=1 c_cookie=9985957271106081216 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e80059740 tx=0x7f7e6802f250 comp rx=0 tx=0).stop 2026-02-23T06:33:59.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.942+0000 7f7e85a43640 1 -- 10.20.193.58:0/1836599296 shutdown_connections 2026-02-23T06:33:59.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.942+0000 7f7e85a43640 1 --2- 10.20.193.58:0/1836599296 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7e8015d870 0x7f7e800587b0 unknown :-1 s=CLOSED pgs=10 gs=2 cs=0 l=1 c_cookie=9985957271106081216 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:59.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.942+0000 7f7e85a43640 1 --2- 10.20.193.58:0/1836599296 >> v2:10.20.193.58:3300/0 conn(0x7f7e8015d4a0 0x7f7e800affb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:59.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.942+0000 7f7e85a43640 1 -- 10.20.193.58:0/1836599296 >> 10.20.193.58:0/1836599296 conn(0x7f7e800b3c20 msgr2=0x7f7e800b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:33:59.938 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.942+0000 7f7e85a43640 1 -- 10.20.193.58:0/1836599296 shutdown_connections 2026-02-23T06:33:59.938 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.942+0000 7f7e85a43640 1 -- 10.20.193.58:0/1836599296 wait complete. 2026-02-23T06:33:59.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.943+0000 7f7e85a43640 1 Processor -- start 2026-02-23T06:33:59.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.943+0000 7f7e85a43640 1 -- start start 2026-02-23T06:33:59.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.943+0000 7f7e85a43640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e800b6690 0x7f7e80161e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:59.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.943+0000 7f7e85a43640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7e8015d4a0 0x7f7e800572d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:59.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.943+0000 7f7e85a43640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7e8015d870 0x7f7e80141950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:59.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.943+0000 7f7e85a43640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f7e80161310 con 0x7f7e8015d4a0 2026-02-23T06:33:59.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.943+0000 7f7e85a43640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f7e80140740 con 0x7f7e8015d870 2026-02-23T06:33:59.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.943+0000 7f7e85a43640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f7e80162a20 con 0x7f7e800b6690 2026-02-23T06:33:59.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.944+0000 7f7e84a41640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e800b6690 0x7f7e80161e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:59.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.944+0000 7f7e77fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7e8015d4a0 0x7f7e800572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:59.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.944+0000 7f7e84a41640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e800b6690 0x7f7e80161e00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:41394/0 (socket says 10.20.193.58:41394) 2026-02-23T06:33:59.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.944+0000 7f7e84a41640 1 -- 10.20.193.58:0/2761751069 learned_addr learned my addr 10.20.193.58:0/2761751069 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:33:59.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.944+0000 7f7e85242640 1 --2- 10.20.193.58:0/2761751069 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7e8015d870 0x7f7e80141950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:59.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.944+0000 7f7e77fff640 1 -- 10.20.193.58:0/2761751069 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e800b6690 msgr2=0x7f7e80161e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:59.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.944+0000 7f7e77fff640 1 --2- 10.20.193.58:0/2761751069 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e800b6690 0x7f7e80161e00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:59.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.944+0000 7f7e77fff640 1 -- 10.20.193.58:0/2761751069 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7e8015d870 msgr2=0x7f7e80141950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:33:59.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.944+0000 7f7e77fff640 1 --2- 10.20.193.58:0/2761751069 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7e8015d870 0x7f7e80141950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:33:59.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.944+0000 7f7e77fff640 1 -- 10.20.193.58:0/2761751069 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e68009570 con 0x7f7e8015d4a0 2026-02-23T06:33:59.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.944+0000 7f7e84a41640 1 --2- 10.20.193.58:0/2761751069 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e800b6690 0x7f7e80161e00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:33:59.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.944+0000 7f7e77fff640 1 --2- 10.20.193.58:0/2761751069 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7e8015d4a0 0x7f7e800572d0 secure :-1 s=READY pgs=55 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e80059740 tx=0x7f7e680028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:59.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.944+0000 7f7e757fa640 1 -- 10.20.193.58:0/2761751069 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7e6803d070 con 0x7f7e8015d4a0 2026-02-23T06:33:59.941 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.944+0000 7f7e757fa640 1 -- 10.20.193.58:0/2761751069 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e68038470 con 0x7f7e8015d4a0 2026-02-23T06:33:59.941 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.944+0000 7f7e757fa640 1 -- 10.20.193.58:0/2761751069 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7e68038880 con 0x7f7e8015d4a0 2026-02-23T06:33:59.941 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.944+0000 7f7e85a43640 1 -- 10.20.193.58:0/2761751069 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e80162610 con 0x7f7e8015d4a0 2026-02-23T06:33:59.941 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.944+0000 7f7e85a43640 1 -- 10.20.193.58:0/2761751069 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e80140190 con 0x7f7e8015d4a0 2026-02-23T06:33:59.941 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.945+0000 7f7e85a43640 1 -- 10.20.193.58:0/2761751069 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e800b6d50 con 0x7f7e8015d4a0 2026-02-23T06:33:59.941 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.946+0000 7f7e757fa640 1 -- 10.20.193.58:0/2761751069 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f7e68048060 con 0x7f7e8015d4a0 2026-02-23T06:33:59.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.947+0000 7f7e757fa640 1 --2- 10.20.193.58:0/2761751069 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7e5007a6c0 0x7f7e5009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:33:59.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.947+0000 7f7e757fa640 1 -- 10.20.193.58:0/2761751069 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f7e680c1c50 con 0x7f7e8015d4a0 2026-02-23T06:33:59.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.947+0000 7f7e84a41640 1 --2- 10.20.193.58:0/2761751069 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7e5007a6c0 0x7f7e5009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:33:59.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.948+0000 7f7e84a41640 1 --2- 10.20.193.58:0/2761751069 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7e5007a6c0 0x7f7e5009ab70 secure :-1 s=READY pgs=317 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e700095d0 tx=0x7f7e70005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:33:59.943 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:33:59.949+0000 7f7e757fa640 1 -- 10.20.193.58:0/2761751069 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f7e68084ea0 con 0x7f7e8015d4a0 2026-02-23T06:34:00.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:00.107+0000 7f7e85a43640 1 -- 10.20.193.58:0/2761751069 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f7e8005b0e0 con 0x7f7e8015d4a0 2026-02-23T06:34:00.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:00.108+0000 7f7e757fa640 1 -- 10.20.193.58:0/2761751069 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f7e68087fc0 con 0x7f7e8015d4a0 2026-02-23T06:34:00.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:00.109+0000 7f7e85a43640 1 -- 10.20.193.58:0/2761751069 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7e5007a6c0 msgr2=0x7f7e5009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:00.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:00.109+0000 7f7e85a43640 1 --2- 10.20.193.58:0/2761751069 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7e5007a6c0 0x7f7e5009ab70 secure :-1 s=READY pgs=317 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e700095d0 tx=0x7f7e70005f90 comp rx=0 tx=0).stop 2026-02-23T06:34:00.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:00.109+0000 7f7e85a43640 1 -- 10.20.193.58:0/2761751069 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7e8015d4a0 msgr2=0x7f7e800572d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:00.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:00.109+0000 7f7e85a43640 1 --2- 10.20.193.58:0/2761751069 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7e8015d4a0 0x7f7e800572d0 secure :-1 s=READY pgs=55 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e80059740 tx=0x7f7e680028d0 comp rx=0 tx=0).stop 2026-02-23T06:34:00.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:00.109+0000 7f7e85a43640 1 -- 10.20.193.58:0/2761751069 shutdown_connections 2026-02-23T06:34:00.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:00.109+0000 7f7e85a43640 1 --2- 10.20.193.58:0/2761751069 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7e5007a6c0 0x7f7e5009ab70 unknown :-1 s=CLOSED pgs=317 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:00.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:00.109+0000 7f7e85a43640 1 --2- 10.20.193.58:0/2761751069 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7e8015d870 0x7f7e80141950 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:00.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:00.109+0000 7f7e85a43640 1 --2- 10.20.193.58:0/2761751069 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7e8015d4a0 0x7f7e800572d0 unknown :-1 s=CLOSED pgs=55 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:00.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:00.109+0000 7f7e85a43640 1 --2- 10.20.193.58:0/2761751069 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e800b6690 0x7f7e80161e00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:00.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:00.109+0000 7f7e85a43640 1 -- 10.20.193.58:0/2761751069 >> 10.20.193.58:0/2761751069 conn(0x7f7e800b3c20 msgr2=0x7f7e800b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:00.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:00.109+0000 7f7e85a43640 1 -- 10.20.193.58:0/2761751069 shutdown_connections 2026-02-23T06:34:00.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:00.109+0000 7f7e85a43640 1 -- 10.20.193.58:0/2761751069 wait complete. 2026-02-23T06:34:00.116 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:34:10.117 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:34:10.117 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:34:10.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.245+0000 7f479e330640 1 -- 10.20.193.58:0/3924874246 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f479815c4b0 msgr2=0x7f4798058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:10.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.245+0000 7f479e330640 1 --2- 10.20.193.58:0/3924874246 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f479815c4b0 0x7f4798058200 secure :-1 s=READY pgs=229 gs=3 cs=0 l=1 c_cookie=6917168723236412226 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4788004740 tx=0x7f478802f180 comp rx=0 tx=0).stop 2026-02-23T06:34:10.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.245+0000 7f479e330640 1 -- 10.20.193.58:0/3924874246 shutdown_connections 2026-02-23T06:34:10.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.245+0000 7f479e330640 1 --2- 10.20.193.58:0/3924874246 >> v2:10.20.193.93:3300/0 conn(0x7f4798056960 0x7f47980b6720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.245+0000 7f479e330640 1 --2- 10.20.193.58:0/3924874246 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f479815c4b0 0x7f4798058200 unknown :-1 s=CLOSED pgs=229 gs=3 cs=0 l=1 c_cookie=6917168723236412226 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.245+0000 7f479e330640 1 -- 10.20.193.58:0/3924874246 >> 10.20.193.58:0/3924874246 conn(0x7f47980b3c20 msgr2=0x7f47980b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:10.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.245+0000 7f479e330640 1 -- 10.20.193.58:0/3924874246 shutdown_connections 2026-02-23T06:34:10.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.245+0000 7f479e330640 1 -- 10.20.193.58:0/3924874246 wait complete. 2026-02-23T06:34:10.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.246+0000 7f479e330640 1 Processor -- start 2026-02-23T06:34:10.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.247+0000 7f479e330640 1 -- start start 2026-02-23T06:34:10.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.247+0000 7f479e330640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4798056960 0x7f47982009b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:10.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.247+0000 7f479e330640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f479815c4b0 0x7f4798139370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:10.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.247+0000 7f479e330640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4798162ca0 0x7f479813bd60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:10.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.247+0000 7f479e330640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f479813e3f0 con 0x7f4798056960 2026-02-23T06:34:10.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.247+0000 7f479e330640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f479813eca0 con 0x7f4798162ca0 2026-02-23T06:34:10.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.247+0000 7f479e330640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f4798200ef0 con 0x7f479815c4b0 2026-02-23T06:34:10.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.247+0000 7f479d32e640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4798056960 0x7f47982009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:10.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.247+0000 7f479d32e640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4798056960 0x7f47982009b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:51326/0 (socket says 10.20.193.58:51326) 2026-02-23T06:34:10.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.247+0000 7f479d32e640 1 -- 10.20.193.58:0/4053421275 learned_addr learned my addr 10.20.193.58:0/4053421275 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:34:10.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.248+0000 7f479cb2d640 1 --2- 10.20.193.58:0/4053421275 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f479815c4b0 0x7f4798139370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:10.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.248+0000 7f479d32e640 1 -- 10.20.193.58:0/4053421275 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f479815c4b0 msgr2=0x7f4798139370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:10.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.248+0000 7f479d32e640 1 --2- 10.20.193.58:0/4053421275 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f479815c4b0 0x7f4798139370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.248+0000 7f479d32e640 1 -- 10.20.193.58:0/4053421275 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4798162ca0 msgr2=0x7f479813bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:10.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.248+0000 7f479db2f640 1 --2- 10.20.193.58:0/4053421275 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4798162ca0 0x7f479813bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:10.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.248+0000 7f479d32e640 1 --2- 10.20.193.58:0/4053421275 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4798162ca0 0x7f479813bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.248+0000 7f479d32e640 1 -- 10.20.193.58:0/4053421275 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f478c0094b0 con 0x7f4798056960 2026-02-23T06:34:10.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.248+0000 7f479db2f640 1 --2- 10.20.193.58:0/4053421275 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4798162ca0 0x7f479813bd60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:34:10.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.248+0000 7f479d32e640 1 --2- 10.20.193.58:0/4053421275 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4798056960 0x7f47982009b0 secure :-1 s=READY pgs=56 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47880023d0 tx=0x7f4788002950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:10.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.248+0000 7f4785ffb640 1 -- 10.20.193.58:0/4053421275 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4788038470 con 0x7f4798056960 2026-02-23T06:34:10.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.248+0000 7f4785ffb640 1 -- 10.20.193.58:0/4053421275 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47880386c0 con 0x7f4798056960 2026-02-23T06:34:10.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.248+0000 7f4785ffb640 1 -- 10.20.193.58:0/4053421275 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4788038ab0 con 0x7f4798056960 2026-02-23T06:34:10.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.248+0000 7f479e330640 1 -- 10.20.193.58:0/4053421275 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47880094b0 con 0x7f4798056960 2026-02-23T06:34:10.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.248+0000 7f479e330640 1 -- 10.20.193.58:0/4053421275 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47980b0e20 con 0x7f4798056960 2026-02-23T06:34:10.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.249+0000 7f479e330640 1 -- 10.20.193.58:0/4053421275 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f479813ee10 con 0x7f4798056960 2026-02-23T06:34:10.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.250+0000 7f4785ffb640 1 -- 10.20.193.58:0/4053421275 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f4788038c10 con 0x7f4798056960 2026-02-23T06:34:10.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.251+0000 7f4785ffb640 1 --2- 10.20.193.58:0/4053421275 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f476807a780 0x7f476809ac30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:10.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.251+0000 7f4785ffb640 1 -- 10.20.193.58:0/4053421275 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f47880c2a10 con 0x7f4798056960 2026-02-23T06:34:10.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.252+0000 7f479cb2d640 1 --2- 10.20.193.58:0/4053421275 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f476807a780 0x7f476809ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:10.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.253+0000 7f479cb2d640 1 --2- 10.20.193.58:0/4053421275 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f476807a780 0x7f476809ac30 secure :-1 s=READY pgs=318 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47980b81b0 tx=0x7f478c005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:10.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.253+0000 7f4785ffb640 1 -- 10.20.193.58:0/4053421275 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f4788085d50 con 0x7f4798056960 2026-02-23T06:34:10.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.408+0000 7f479e330640 1 -- 10.20.193.58:0/4053421275 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f479813b9d0 con 0x7f4798056960 2026-02-23T06:34:10.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.408+0000 7f4785ffb640 1 -- 10.20.193.58:0/4053421275 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f4788088e70 con 0x7f4798056960 2026-02-23T06:34:10.404 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":108,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:34:10.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.409+0000 7f479e330640 1 -- 10.20.193.58:0/4053421275 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f476807a780 msgr2=0x7f476809ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:10.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.409+0000 7f479e330640 1 --2- 10.20.193.58:0/4053421275 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f476807a780 0x7f476809ac30 secure :-1 s=READY pgs=318 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47980b81b0 tx=0x7f478c005f90 comp rx=0 tx=0).stop 2026-02-23T06:34:10.406 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.409+0000 7f479e330640 1 -- 10.20.193.58:0/4053421275 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4798056960 msgr2=0x7f47982009b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:10.406 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.409+0000 7f479e330640 1 --2- 10.20.193.58:0/4053421275 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4798056960 0x7f47982009b0 secure :-1 s=READY pgs=56 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47880023d0 tx=0x7f4788002950 comp rx=0 tx=0).stop 2026-02-23T06:34:10.406 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.409+0000 7f479e330640 1 -- 10.20.193.58:0/4053421275 shutdown_connections 2026-02-23T06:34:10.406 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.409+0000 7f479e330640 1 --2- 10.20.193.58:0/4053421275 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f476807a780 0x7f476809ac30 unknown :-1 s=CLOSED pgs=318 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.406 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.409+0000 7f479e330640 1 --2- 10.20.193.58:0/4053421275 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4798162ca0 0x7f479813bd60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.406 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.409+0000 7f479e330640 1 --2- 10.20.193.58:0/4053421275 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f479815c4b0 0x7f4798139370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.406 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.409+0000 7f479e330640 1 --2- 10.20.193.58:0/4053421275 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4798056960 0x7f47982009b0 unknown :-1 s=CLOSED pgs=56 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.406 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.409+0000 7f479e330640 1 -- 10.20.193.58:0/4053421275 >> 10.20.193.58:0/4053421275 conn(0x7f47980b3c20 msgr2=0x7f47980b61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:10.406 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.410+0000 7f479e330640 1 -- 10.20.193.58:0/4053421275 shutdown_connections 2026-02-23T06:34:10.406 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.410+0000 7f479e330640 1 -- 10.20.193.58:0/4053421275 wait complete. 2026-02-23T06:34:10.416 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:34:10.417 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:34:10.417 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:34:10.417 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:34:10.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.546+0000 7fcbef083640 1 -- 10.20.193.58:0/3123665197 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcbe8162ca0 msgr2=0x7fcbe8056fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:10.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.546+0000 7fcbef083640 1 --2- 10.20.193.58:0/3123665197 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcbe8162ca0 0x7fcbe8056fc0 secure :-1 s=READY pgs=58 gs=3 cs=0 l=1 c_cookie=12787366840470147104 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcbe8059b80 tx=0x7fcbe4030270 comp rx=0 tx=0).stop 2026-02-23T06:34:10.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.547+0000 7fcbef083640 1 -- 10.20.193.58:0/3123665197 shutdown_connections 2026-02-23T06:34:10.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.547+0000 7fcbef083640 1 --2- 10.20.193.58:0/3123665197 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcbe8162ca0 0x7fcbe8056fc0 unknown :-1 s=CLOSED pgs=58 gs=3 cs=0 l=1 c_cookie=12787366840470147104 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.547+0000 7fcbef083640 1 --2- 10.20.193.58:0/3123665197 >> v2:10.20.193.93:3300/0 conn(0x7fcbe815c4b0 0x7fcbe8058200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.547+0000 7fcbef083640 1 -- 10.20.193.58:0/3123665197 >> 10.20.193.58:0/3123665197 conn(0x7fcbe80b3c20 msgr2=0x7fcbe80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:10.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.547+0000 7fcbef083640 1 -- 10.20.193.58:0/3123665197 shutdown_connections 2026-02-23T06:34:10.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.547+0000 7fcbef083640 1 -- 10.20.193.58:0/3123665197 wait complete. 2026-02-23T06:34:10.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.548+0000 7fcbef083640 1 Processor -- start 2026-02-23T06:34:10.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.548+0000 7fcbef083640 1 -- start start 2026-02-23T06:34:10.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.549+0000 7fcbef083640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcbe8056960 0x7fcbe80b0b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:10.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.549+0000 7fcbef083640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcbe815c4b0 0x7fcbe813e440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:10.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.549+0000 7fcbef083640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcbe8162ca0 0x7fcbe8159530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:10.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.549+0000 7fcbef083640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe80aef20 con 0x7fcbe815c4b0 2026-02-23T06:34:10.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.549+0000 7fcbef083640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe8141aa0 con 0x7fcbe8056960 2026-02-23T06:34:10.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.549+0000 7fcbef083640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fcbe80af150 con 0x7fcbe8162ca0 2026-02-23T06:34:10.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.549+0000 7fcbed880640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcbe815c4b0 0x7fcbe813e440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:10.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.549+0000 7fcbed880640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcbe815c4b0 0x7fcbe813e440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:51342/0 (socket says 10.20.193.58:51342) 2026-02-23T06:34:10.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.549+0000 7fcbed880640 1 -- 10.20.193.58:0/598196535 learned_addr learned my addr 10.20.193.58:0/598196535 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:34:10.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.549+0000 7fcbee081640 1 --2- 10.20.193.58:0/598196535 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcbe8056960 0x7fcbe80b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:10.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.549+0000 7fcbee882640 1 --2- 10.20.193.58:0/598196535 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcbe8162ca0 0x7fcbe8159530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:10.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.549+0000 7fcbed880640 1 -- 10.20.193.58:0/598196535 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcbe8162ca0 msgr2=0x7fcbe8159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:10.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.549+0000 7fcbed880640 1 --2- 10.20.193.58:0/598196535 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcbe8162ca0 0x7fcbe8159530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.549+0000 7fcbed880640 1 -- 10.20.193.58:0/598196535 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcbe8056960 msgr2=0x7fcbe80b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:10.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.549+0000 7fcbed880640 1 --2- 10.20.193.58:0/598196535 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcbe8056960 0x7fcbe80b0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.549+0000 7fcbed880640 1 -- 10.20.193.58:0/598196535 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe400a590 con 0x7fcbe815c4b0 2026-02-23T06:34:10.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.549+0000 7fcbee081640 1 --2- 10.20.193.58:0/598196535 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcbe8056960 0x7fcbe80b0b20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:34:10.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.549+0000 7fcbed880640 1 --2- 10.20.193.58:0/598196535 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcbe815c4b0 0x7fcbe813e440 secure :-1 s=READY pgs=59 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcbdc00c460 tx=0x7fcbdc00c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:10.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.550+0000 7fcbceffd640 1 -- 10.20.193.58:0/598196535 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcbdc006ab0 con 0x7fcbe815c4b0 2026-02-23T06:34:10.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.550+0000 7fcbceffd640 1 -- 10.20.193.58:0/598196535 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcbdc006d00 con 0x7fcbe815c4b0 2026-02-23T06:34:10.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.550+0000 7fcbceffd640 1 -- 10.20.193.58:0/598196535 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcbdc0072b0 con 0x7fcbe815c4b0 2026-02-23T06:34:10.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.550+0000 7fcbef083640 1 -- 10.20.193.58:0/598196535 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe80af430 con 0x7fcbe815c4b0 2026-02-23T06:34:10.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.550+0000 7fcbef083640 1 -- 10.20.193.58:0/598196535 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe813ddf0 con 0x7fcbe815c4b0 2026-02-23T06:34:10.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.551+0000 7fcbef083640 1 --2- 10.20.193.58:0/598196535 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcbe813e010 0x7fcbe8200a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:10.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.551+0000 7fcbef083640 1 -- 10.20.193.58:0/598196535 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe8059690 con 0x7fcbe813e010 2026-02-23T06:34:10.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.551+0000 7fcbee081640 1 --2- 10.20.193.58:0/598196535 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcbe813e010 0x7fcbe8200a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:10.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.551+0000 7fcbee081640 1 -- 10.20.193.58:0/598196535 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcbe80593b0 con 0x7fcbe813e010 2026-02-23T06:34:10.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.551+0000 7fcbee081640 1 --2- 10.20.193.58:0/598196535 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcbe813e010 0x7fcbe8200a10 secure :-1 s=READY pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcbd8005e70 tx=0x7fcbd8009ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:10.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.551+0000 7fcbceffd640 1 -- 10.20.193.58:0/598196535 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcbd8010b70 con 0x7fcbe813e010 2026-02-23T06:34:10.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.552+0000 7fcbceffd640 1 -- 10.20.193.58:0/598196535 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fcbd8010cd0 con 0x7fcbe813e010 2026-02-23T06:34:10.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.552+0000 7fcbceffd640 1 -- 10.20.193.58:0/598196535 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcbe813e010 msgr2=0x7fcbe8200a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:10.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.552+0000 7fcbceffd640 1 --2- 10.20.193.58:0/598196535 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcbe813e010 0x7fcbe8200a10 secure :-1 s=READY pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcbd8005e70 tx=0x7fcbd8009ab0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.552+0000 7fcbceffd640 1 -- 10.20.193.58:0/598196535 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcbe813e010 msgr2=0x7fcbe8200a10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:34:10.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.552+0000 7fcbceffd640 1 --2- 10.20.193.58:0/598196535 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcbe813e010 0x7fcbe8200a10 unknown :-1 s=CLOSED pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.552+0000 7fcbceffd640 1 -- 10.20.193.58:0/598196535 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fcbdc019070 con 0x7fcbe815c4b0 2026-02-23T06:34:10.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.553+0000 7fcbceffd640 1 --2- 10.20.193.58:0/598196535 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcbb807a410 0x7fcbb809a8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:10.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.553+0000 7fcbceffd640 1 -- 10.20.193.58:0/598196535 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fcbdc09d110 con 0x7fcbe815c4b0 2026-02-23T06:34:10.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.553+0000 7fcbee081640 1 --2- 10.20.193.58:0/598196535 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcbb807a410 0x7fcbb809a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:10.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.554+0000 7fcbee081640 1 --2- 10.20.193.58:0/598196535 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcbb807a410 0x7fcbb809a8c0 secure :-1 s=READY pgs=319 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcbd80023d0 tx=0x7fcbd8014000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:10.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.555+0000 7fcbef083640 1 --2- 10.20.193.58:0/598196535 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcbe8141f30 0x7fcbe8200f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:10.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.555+0000 7fcbef083640 1 -- 10.20.193.58:0/598196535 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe815c880 con 0x7fcbe8141f30 2026-02-23T06:34:10.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.555+0000 7fcbee882640 1 --2- 10.20.193.58:0/598196535 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcbe8141f30 0x7fcbe8200f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:10.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.556+0000 7fcbee882640 1 -- 10.20.193.58:0/598196535 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcbe805b0e0 con 0x7fcbe8141f30 2026-02-23T06:34:10.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.556+0000 7fcbee882640 1 --2- 10.20.193.58:0/598196535 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcbe8141f30 0x7fcbe8200f50 secure :-1 s=READY pgs=61 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcbe40307a0 tx=0x7fcbe4003af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:10.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.556+0000 7fcbceffd640 1 -- 10.20.193.58:0/598196535 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcbe4039690 con 0x7fcbe8141f30 2026-02-23T06:34:10.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.556+0000 7fcbceffd640 1 -- 10.20.193.58:0/598196535 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4914 (secure 0 0 0) 0x7fcbe4003e40 con 0x7fcbe8141f30 2026-02-23T06:34:10.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.556+0000 7fcbceffd640 1 -- 10.20.193.58:0/598196535 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcbe8141f30 msgr2=0x7fcbe8200f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:10.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.556+0000 7fcbceffd640 1 --2- 10.20.193.58:0/598196535 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcbe8141f30 0x7fcbe8200f50 secure :-1 s=READY pgs=61 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcbe40307a0 tx=0x7fcbe4003af0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.556+0000 7fcbceffd640 1 -- 10.20.193.58:0/598196535 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcbe8141f30 msgr2=0x7fcbe8200f50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:34:10.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.556+0000 7fcbceffd640 1 --2- 10.20.193.58:0/598196535 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcbe8141f30 0x7fcbe8200f50 secure :-1 s=CLOSED pgs=61 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcbe40307a0 tx=0x7fcbe4003af0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.551 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:34:10.551 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:34:10.551 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:34:10.551 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:34:10.551 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 108, 2026-02-23T06:34:10.551 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 58068, 2026-02-23T06:34:10.551 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:34:10.551 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:34:10.551 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:34:10.551 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:34:10.551 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:10.551 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:34:10.552 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:10.553 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:34:10.554 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:34:10.555 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:34:10.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.556+0000 7fcbef083640 1 -- 10.20.193.58:0/598196535 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcbb807a410 msgr2=0x7fcbb809a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:10.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.556+0000 7fcbef083640 1 --2- 10.20.193.58:0/598196535 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcbb807a410 0x7fcbb809a8c0 secure :-1 s=READY pgs=319 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcbd80023d0 tx=0x7fcbd8014000 comp rx=0 tx=0).stop 2026-02-23T06:34:10.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.556+0000 7fcbef083640 1 -- 10.20.193.58:0/598196535 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcbe815c4b0 msgr2=0x7fcbe813e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:10.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.556+0000 7fcbef083640 1 --2- 10.20.193.58:0/598196535 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcbe815c4b0 0x7fcbe813e440 secure :-1 s=READY pgs=59 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcbdc00c460 tx=0x7fcbdc00c930 comp rx=0 tx=0).stop 2026-02-23T06:34:10.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.556+0000 7fcbee882640 1 -- 10.20.193.58:0/598196535 reap_dead start 2026-02-23T06:34:10.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.557+0000 7fcbef083640 1 -- 10.20.193.58:0/598196535 shutdown_connections 2026-02-23T06:34:10.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.557+0000 7fcbef083640 1 --2- 10.20.193.58:0/598196535 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcbe815c4b0 0x7fcbe813e440 unknown :-1 s=CLOSED pgs=59 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.557+0000 7fcbef083640 1 -- 10.20.193.58:0/598196535 >> 10.20.193.58:0/598196535 conn(0x7fcbe80b3c20 msgr2=0x7fcbe805b600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:10.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.557+0000 7fcbef083640 1 -- 10.20.193.58:0/598196535 shutdown_connections 2026-02-23T06:34:10.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.557+0000 7fcbef083640 1 -- 10.20.193.58:0/598196535 wait complete. 2026-02-23T06:34:10.558 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:34:10.558 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:34:10.558 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:34:10.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.684+0000 7f8a448c3640 1 -- 10.20.193.58:0/3795988028 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8a24004d90 msgr2=0x7f8a24005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:10.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.684+0000 7f8a448c3640 1 --2- 10.20.193.58:0/3795988028 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8a24004d90 0x7f8a24005200 secure :-1 s=READY pgs=63 gs=5 cs=0 l=1 c_cookie=4759698110553632155 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a34003890 tx=0x7f8a340302d0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.684+0000 7f8a3ffff640 1 -- 10.20.193.58:0/3795988028 reap_dead start 2026-02-23T06:34:10.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.684+0000 7f8a448c3640 1 -- 10.20.193.58:0/3795988028 shutdown_connections 2026-02-23T06:34:10.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.684+0000 7f8a448c3640 1 -- 10.20.193.58:0/3795988028 >> 10.20.193.58:0/3795988028 conn(0x7f8a400b3c20 msgr2=0x7f8a400b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:10.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.684+0000 7f8a448c3640 1 -- 10.20.193.58:0/3795988028 shutdown_connections 2026-02-23T06:34:10.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.684+0000 7f8a448c3640 1 -- 10.20.193.58:0/3795988028 wait complete. 2026-02-23T06:34:10.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.685+0000 7f8a448c3640 1 Processor -- start 2026-02-23T06:34:10.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.685+0000 7f8a448c3640 1 -- start start 2026-02-23T06:34:10.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.686+0000 7f8a448c3640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8a40151910 0x7f8a400aeab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:10.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.686+0000 7f8a448c3640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8a40151ce0 0x7f8a40058b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:10.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.686+0000 7f8a448c3640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8a400590c0 0x7f8a40200c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:10.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.686+0000 7f8a448c3640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f8a40162880 con 0x7f8a40151910 2026-02-23T06:34:10.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.686+0000 7f8a448c3640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f8a40161d70 con 0x7f8a40151ce0 2026-02-23T06:34:10.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.686+0000 7f8a448c3640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f8a400b05d0 con 0x7f8a400590c0 2026-02-23T06:34:10.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.686+0000 7f8a3f7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8a40151910 0x7f8a400aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:10.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.686+0000 7f8a3f7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8a40151910 0x7f8a400aeab0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:51382/0 (socket says 10.20.193.58:51382) 2026-02-23T06:34:10.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.686+0000 7f8a3f7fe640 1 -- 10.20.193.58:0/836177717 learned_addr learned my addr 10.20.193.58:0/836177717 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:34:10.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.686+0000 7f8a3ffff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8a400590c0 0x7f8a40200c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:10.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.686+0000 7f8a3effd640 1 --2- 10.20.193.58:0/836177717 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8a40151ce0 0x7f8a40058b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:10.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.687+0000 7f8a3f7fe640 1 -- 10.20.193.58:0/836177717 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8a400590c0 msgr2=0x7f8a40200c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:10.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.687+0000 7f8a3f7fe640 1 --2- 10.20.193.58:0/836177717 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8a400590c0 0x7f8a40200c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.687+0000 7f8a3f7fe640 1 -- 10.20.193.58:0/836177717 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8a40151ce0 msgr2=0x7f8a40058b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:10.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.687+0000 7f8a3f7fe640 1 --2- 10.20.193.58:0/836177717 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8a40151ce0 0x7f8a40058b80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.687+0000 7f8a3f7fe640 1 -- 10.20.193.58:0/836177717 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a400b18b0 con 0x7f8a40151910 2026-02-23T06:34:10.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.687+0000 7f8a3f7fe640 1 --2- 10.20.193.58:0/836177717 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8a40151910 0x7f8a400aeab0 secure :-1 s=READY pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a2c0066b0 tx=0x7f8a2c003a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:10.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.687+0000 7f8a1bfff640 1 -- 10.20.193.58:0/836177717 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a2c00f940 con 0x7f8a40151910 2026-02-23T06:34:10.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.687+0000 7f8a1bfff640 1 -- 10.20.193.58:0/836177717 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a2c00faa0 con 0x7f8a40151910 2026-02-23T06:34:10.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.687+0000 7f8a1bfff640 1 -- 10.20.193.58:0/836177717 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a2c00fed0 con 0x7f8a40151910 2026-02-23T06:34:10.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.687+0000 7f8a448c3640 1 -- 10.20.193.58:0/836177717 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a4015fc20 con 0x7f8a40151910 2026-02-23T06:34:10.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.687+0000 7f8a448c3640 1 -- 10.20.193.58:0/836177717 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a401fe400 con 0x7f8a40151910 2026-02-23T06:34:10.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.687+0000 7f8a448c3640 1 --2- 10.20.193.58:0/836177717 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8a400b0720 0x7f8a40201190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:10.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.687+0000 7f8a448c3640 1 -- 10.20.193.58:0/836177717 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4005d9c0 con 0x7f8a400b0720 2026-02-23T06:34:10.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.688+0000 7f8a3effd640 1 --2- 10.20.193.58:0/836177717 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8a400b0720 0x7f8a40201190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:10.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.688+0000 7f8a3effd640 1 -- 10.20.193.58:0/836177717 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a4015c410 con 0x7f8a400b0720 2026-02-23T06:34:10.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.688+0000 7f8a3effd640 1 --2- 10.20.193.58:0/836177717 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8a400b0720 0x7f8a40201190 secure :-1 s=READY pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a40059aa0 tx=0x7f8a300099f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:10.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.688+0000 7f8a1bfff640 1 -- 10.20.193.58:0/836177717 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a30016070 con 0x7f8a400b0720 2026-02-23T06:34:10.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.688+0000 7f8a1bfff640 1 -- 10.20.193.58:0/836177717 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f8a300119b0 con 0x7f8a400b0720 2026-02-23T06:34:10.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.688+0000 7f8a1bfff640 1 -- 10.20.193.58:0/836177717 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8a400b0720 msgr2=0x7f8a40201190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:10.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.688+0000 7f8a1bfff640 1 --2- 10.20.193.58:0/836177717 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8a400b0720 0x7f8a40201190 secure :-1 s=READY pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a40059aa0 tx=0x7f8a300099f0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.688+0000 7f8a1bfff640 1 -- 10.20.193.58:0/836177717 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8a400b0720 msgr2=0x7f8a40201190 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:34:10.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.688+0000 7f8a1bfff640 1 --2- 10.20.193.58:0/836177717 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8a400b0720 0x7f8a40201190 unknown :-1 s=CLOSED pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.689+0000 7f8a1bfff640 1 -- 10.20.193.58:0/836177717 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f8a2c011430 con 0x7f8a40151910 2026-02-23T06:34:10.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.690+0000 7f8a1bfff640 1 --2- 10.20.193.58:0/836177717 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8a1007a3c0 0x7f8a1009a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:10.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.690+0000 7f8a1bfff640 1 -- 10.20.193.58:0/836177717 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f8a2c09e210 con 0x7f8a40151910 2026-02-23T06:34:10.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.690+0000 7f8a3effd640 1 --2- 10.20.193.58:0/836177717 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8a1007a3c0 0x7f8a1009a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:10.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.691+0000 7f8a3effd640 1 --2- 10.20.193.58:0/836177717 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8a1007a3c0 0x7f8a1009a870 secure :-1 s=READY pgs=320 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a40059aa0 tx=0x7f8a30008000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:10.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.692+0000 7f8a448c3640 1 --2- 10.20.193.58:0/836177717 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8a402016d0 0x7f8a40156200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:10.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.692+0000 7f8a448c3640 1 -- 10.20.193.58:0/836177717 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f8a400b18b0 con 0x7f8a402016d0 2026-02-23T06:34:10.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.692+0000 7f8a3ffff640 1 --2- 10.20.193.58:0/836177717 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8a402016d0 0x7f8a40156200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:10.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.692+0000 7f8a3ffff640 1 -- 10.20.193.58:0/836177717 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8a40201aa0 con 0x7f8a402016d0 2026-02-23T06:34:10.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.693+0000 7f8a3ffff640 1 --2- 10.20.193.58:0/836177717 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8a402016d0 0x7f8a40156200 secure :-1 s=READY pgs=14 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a40062050 tx=0x7f8a34030d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:10.688 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.693+0000 7f8a1bfff640 1 -- 10.20.193.58:0/836177717 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a3403e070 con 0x7f8a402016d0 2026-02-23T06:34:10.688 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.693+0000 7f8a1bfff640 1 -- 10.20.193.58:0/836177717 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4912 (secure 0 0 0) 0x7f8a34007400 con 0x7f8a402016d0 2026-02-23T06:34:10.688 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.693+0000 7f8a1bfff640 1 -- 10.20.193.58:0/836177717 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8a402016d0 msgr2=0x7f8a40156200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:10.688 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.693+0000 7f8a1bfff640 1 --2- 10.20.193.58:0/836177717 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8a402016d0 0x7f8a40156200 secure :-1 s=READY pgs=14 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a40062050 tx=0x7f8a34030d60 comp rx=0 tx=0).stop 2026-02-23T06:34:10.688 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.693+0000 7f8a1bfff640 1 -- 10.20.193.58:0/836177717 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8a402016d0 msgr2=0x7f8a40156200 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:34:10.688 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.693+0000 7f8a1bfff640 1 --2- 10.20.193.58:0/836177717 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8a402016d0 0x7f8a40156200 secure :-1 s=CLOSED pgs=14 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a40062050 tx=0x7f8a34030d60 comp rx=0 tx=0).stop 2026-02-23T06:34:10.688 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:34:10.689 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:34:10.689 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:34:10.689 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:34:10.689 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 108, 2026-02-23T06:34:10.689 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 11542, 2026-02-23T06:34:10.689 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:34:10.689 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:34:10.689 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:34:10.689 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:34:10.689 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:10.689 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:34:10.689 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:34:10.689 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:34:10.689 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:34:10.689 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:34:10.689 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:34:10.689 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:34:10.689 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:34:10.689 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:34:10.689 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:34:10.690 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:34:10.690 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:34:10.690 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:34:10.690 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:34:10.690 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:34:10.690 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:34:10.690 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:34:10.690 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:10.690 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:34:10.690 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:34:10.690 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:34:10.690 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:34:10.690 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:34:10.690 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:34:10.690 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:34:10.690 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:34:10.690 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:34:10.690 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:34:10.690 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:34:10.690 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:34:10.690 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:34:10.690 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:34:10.691 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:34:10.691 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:10.691 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.691 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:34:10.691 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:34:10.691 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:34:10.691 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:34:10.691 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:34:10.691 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:34:10.691 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:34:10.691 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:34:10.691 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:34:10.691 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:34:10.691 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:34:10.691 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:34:10.691 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:34:10.691 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:34:10.691 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:34:10.691 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:34:10.691 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:34:10.691 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:34:10.692 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:34:10.692 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:34:10.692 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:34:10.692 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:34:10.692 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:34:10.692 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:34:10.692 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:34:10.692 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:34:10.692 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:34:10.692 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:34:10.692 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:34:10.692 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:34:10.692 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:10.692 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:34:10.692 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.692 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:34:10.692 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.692 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:34:10.692 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:34:10.692 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:34:10.692 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:34:10.692 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.692 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:34:10.693 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:34:10.693 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:10.693 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.693 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.693 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:34:10.693 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:34:10.693 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:10.693 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:10.693 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:10.693 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.693 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:34:10.693 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:34:10.693 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:34:10.693 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:34:10.693 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:34:10.693 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:34:10.693 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.693 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.693 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:34:10.693 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:34:10.693 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:34:10.693 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:34:10.694 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.694 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:34:10.694 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:34:10.694 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:10.694 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.694 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.694 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:34:10.694 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:34:10.694 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:10.694 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:10.694 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:10.694 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.694 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:34:10.694 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:34:10.694 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:34:10.694 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:34:10.694 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:34:10.694 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:34:10.694 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.694 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.694 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:34:10.694 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:34:10.694 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:34:10.695 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:34:10.695 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.695 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:34:10.695 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:34:10.695 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:10.695 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.695 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.695 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:34:10.695 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:34:10.695 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:10.695 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:10.695 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:10.695 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.695 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:34:10.695 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:34:10.695 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:34:10.695 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:34:10.695 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:34:10.695 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:34:10.695 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:10.695 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:10.695 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.695 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:34:10.696 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:34:10.696 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.696 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:34:10.696 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:34:10.696 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:34:10.696 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:10.696 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:10.696 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:34:10.696 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.696 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:34:10.696 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:34:10.696 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:34:10.696 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:10.696 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:10.696 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.696 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:34:10.696 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:34:10.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.693+0000 7f8a448c3640 1 -- 10.20.193.58:0/836177717 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8a1007a3c0 msgr2=0x7f8a1009a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:10.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.693+0000 7f8a448c3640 1 --2- 10.20.193.58:0/836177717 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8a1007a3c0 0x7f8a1009a870 secure :-1 s=READY pgs=320 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a40059aa0 tx=0x7f8a30008000 comp rx=0 tx=0).stop 2026-02-23T06:34:10.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.693+0000 7f8a448c3640 1 -- 10.20.193.58:0/836177717 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8a40151910 msgr2=0x7f8a400aeab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:10.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.693+0000 7f8a448c3640 1 --2- 10.20.193.58:0/836177717 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8a40151910 0x7f8a400aeab0 secure :-1 s=READY pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a2c0066b0 tx=0x7f8a2c003a60 comp rx=0 tx=0).stop 2026-02-23T06:34:10.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.693+0000 7f8a3ffff640 1 -- 10.20.193.58:0/836177717 reap_dead start 2026-02-23T06:34:10.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.694+0000 7f8a448c3640 1 -- 10.20.193.58:0/836177717 shutdown_connections 2026-02-23T06:34:10.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.694+0000 7f8a448c3640 1 --2- 10.20.193.58:0/836177717 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8a40151910 0x7f8a400aeab0 unknown :-1 s=CLOSED pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.694+0000 7f8a448c3640 1 -- 10.20.193.58:0/836177717 >> 10.20.193.58:0/836177717 conn(0x7f8a400b3c20 msgr2=0x7f8a40163290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:10.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.694+0000 7f8a448c3640 1 -- 10.20.193.58:0/836177717 shutdown_connections 2026-02-23T06:34:10.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.694+0000 7f8a448c3640 1 -- 10.20.193.58:0/836177717 wait complete. 2026-02-23T06:34:10.698 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:34:10.698 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:34:10.699 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:34:10.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624ebd2640 1 -- 10.20.193.58:0/1735578240 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6248162ca0 msgr2=0x7f6248056fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:10.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624ebd2640 1 --2- 10.20.193.58:0/1735578240 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6248162ca0 0x7f6248056fc0 secure :-1 s=READY pgs=66 gs=2 cs=0 l=1 c_cookie=9431939512116030290 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6244006f50 tx=0x7f6244030380 comp rx=0 tx=0).stop 2026-02-23T06:34:10.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624ebd2640 1 -- 10.20.193.58:0/1735578240 shutdown_connections 2026-02-23T06:34:10.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624ebd2640 1 --2- 10.20.193.58:0/1735578240 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6248162ca0 0x7f6248056fc0 unknown :-1 s=CLOSED pgs=66 gs=2 cs=0 l=1 c_cookie=9431939512116030290 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624ebd2640 1 --2- 10.20.193.58:0/1735578240 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f624815c4b0 0x7f6248058200 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624ebd2640 1 -- 10.20.193.58:0/1735578240 >> 10.20.193.58:0/1735578240 conn(0x7f62480b3c20 msgr2=0x7f62480b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:10.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624ebd2640 1 -- 10.20.193.58:0/1735578240 shutdown_connections 2026-02-23T06:34:10.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624ebd2640 1 -- 10.20.193.58:0/1735578240 wait complete. 2026-02-23T06:34:10.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624ebd2640 1 Processor -- start 2026-02-23T06:34:10.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624ebd2640 1 -- start start 2026-02-23T06:34:10.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624ebd2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6248056960 0x7f624813f8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:10.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624ebd2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f624815c4b0 0x7f6248141aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:10.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624ebd2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6248162ca0 0x7f6248160c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:10.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624ebd2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f624813fe00 con 0x7f6248056960 2026-02-23T06:34:10.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624ebd2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f624815ff90 con 0x7f624815c4b0 2026-02-23T06:34:10.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624ebd2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f624813f280 con 0x7f6248162ca0 2026-02-23T06:34:10.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624dbd0640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6248056960 0x7f624813f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:10.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624dbd0640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6248056960 0x7f624813f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:51402/0 (socket says 10.20.193.58:51402) 2026-02-23T06:34:10.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624dbd0640 1 -- 10.20.193.58:0/4167517260 learned_addr learned my addr 10.20.193.58:0/4167517260 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:34:10.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624dbd0640 1 -- 10.20.193.58:0/4167517260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6248162ca0 msgr2=0x7f6248160c90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-23T06:34:10.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624dbd0640 1 --2- 10.20.193.58:0/4167517260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6248162ca0 0x7f6248160c90 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624dbd0640 1 -- 10.20.193.58:0/4167517260 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f624815c4b0 msgr2=0x7f6248141aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-23T06:34:10.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624dbd0640 1 --2- 10.20.193.58:0/4167517260 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f624815c4b0 0x7f6248141aa0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624dbd0640 1 -- 10.20.193.58:0/4167517260 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624400a650 con 0x7f6248056960 2026-02-23T06:34:10.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624dbd0640 1 --2- 10.20.193.58:0/4167517260 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6248056960 0x7f624813f8c0 secure :-1 s=READY pgs=67 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f623800b520 tx=0x7f623800b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:10.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f62367fc640 1 -- 10.20.193.58:0/4167517260 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f62380044a0 con 0x7f6248056960 2026-02-23T06:34:10.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f62367fc640 1 -- 10.20.193.58:0/4167517260 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6238002740 con 0x7f6248056960 2026-02-23T06:34:10.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f62367fc640 1 -- 10.20.193.58:0/4167517260 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6238002b70 con 0x7f6248056960 2026-02-23T06:34:10.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624ebd2640 1 -- 10.20.193.58:0/4167517260 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6248160230 con 0x7f6248056960 2026-02-23T06:34:10.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624ebd2640 1 -- 10.20.193.58:0/4167517260 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f624813d540 con 0x7f6248056960 2026-02-23T06:34:10.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624ebd2640 1 --2- 10.20.193.58:0/4167517260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6248161910 0x7f62481590b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:10.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.824+0000 7f624ebd2640 1 -- 10.20.193.58:0/4167517260 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f62481603c0 con 0x7f6248161910 2026-02-23T06:34:10.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.830+0000 7f62367fc640 1 -- 10.20.193.58:0/4167517260 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f6238002cd0 con 0x7f6248056960 2026-02-23T06:34:10.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.831+0000 7f624d3cf640 1 --2- 10.20.193.58:0/4167517260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6248161910 0x7f62481590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:10.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.831+0000 7f624d3cf640 1 -- 10.20.193.58:0/4167517260 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6248059690 con 0x7f6248161910 2026-02-23T06:34:10.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.831+0000 7f624d3cf640 1 --2- 10.20.193.58:0/4167517260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6248161910 0x7f62481590b0 secure :-1 s=READY pgs=230 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f62481668d0 tx=0x7f623c00c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:10.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.831+0000 7f62367fc640 1 --2- 10.20.193.58:0/4167517260 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f621807a6c0 0x7f621809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:10.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.832+0000 7f62367fc640 1 -- 10.20.193.58:0/4167517260 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f623809d650 con 0x7f6248056960 2026-02-23T06:34:10.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.832+0000 7f624e3d1640 1 --2- 10.20.193.58:0/4167517260 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f621807a6c0 0x7f621809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:10.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.832+0000 7f62367fc640 1 -- 10.20.193.58:0/4167517260 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f623c0052f0 con 0x7f6248161910 2026-02-23T06:34:10.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.832+0000 7f62367fc640 1 -- 10.20.193.58:0/4167517260 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f623c005450 con 0x7f6248161910 2026-02-23T06:34:10.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.832+0000 7f62367fc640 1 -- 10.20.193.58:0/4167517260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6248161910 msgr2=0x7f62481590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:10.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.832+0000 7f62367fc640 1 --2- 10.20.193.58:0/4167517260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6248161910 0x7f62481590b0 secure :-1 s=READY pgs=230 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f62481668d0 tx=0x7f623c00c7b0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.832+0000 7f62367fc640 1 -- 10.20.193.58:0/4167517260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6248161910 msgr2=0x7f62481590b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:34:10.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.832+0000 7f62367fc640 1 --2- 10.20.193.58:0/4167517260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6248161910 0x7f62481590b0 secure :-1 s=CLOSED pgs=230 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f62481668d0 tx=0x7f623c00c7b0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.836+0000 7f624ebd2640 1 --2- 10.20.193.58:0/4167517260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f624813d9b0 0x7f62481595f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:10.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.836+0000 7f624ebd2640 1 -- 10.20.193.58:0/4167517260 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f624813dd80 con 0x7f624813d9b0 2026-02-23T06:34:10.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.836+0000 7f624d3cf640 1 --2- 10.20.193.58:0/4167517260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f624813d9b0 0x7f62481595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:10.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.836+0000 7f624e3d1640 1 --2- 10.20.193.58:0/4167517260 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f621807a6c0 0x7f621809ab70 secure :-1 s=READY pgs=321 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f624400a230 tx=0x7f62440058c0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:10.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.836+0000 7f624d3cf640 1 -- 10.20.193.58:0/4167517260 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f624815c880 con 0x7f624813d9b0 2026-02-23T06:34:10.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.837+0000 7f624d3cf640 1 --2- 10.20.193.58:0/4167517260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f624813d9b0 0x7f62481595f0 secure :-1 s=READY pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f623c005040 tx=0x7f623c002390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:10.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.837+0000 7f62367fc640 1 -- 10.20.193.58:0/4167517260 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f623c01e070 con 0x7f624813d9b0 2026-02-23T06:34:10.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.837+0000 7f62367fc640 1 -- 10.20.193.58:0/4167517260 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5557 (secure 0 0 0) 0x7f623c003860 con 0x7f624813d9b0 2026-02-23T06:34:10.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.837+0000 7f62367fc640 1 -- 10.20.193.58:0/4167517260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f624813d9b0 msgr2=0x7f62481595f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:10.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.837+0000 7f62367fc640 1 --2- 10.20.193.58:0/4167517260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f624813d9b0 0x7f62481595f0 secure :-1 s=READY pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f623c005040 tx=0x7f623c002390 comp rx=0 tx=0).stop 2026-02-23T06:34:10.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.837+0000 7f62367fc640 1 -- 10.20.193.58:0/4167517260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f624813d9b0 msgr2=0x7f62481595f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:34:10.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.837+0000 7f62367fc640 1 --2- 10.20.193.58:0/4167517260 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f624813d9b0 0x7f62481595f0 secure :-1 s=CLOSED pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f623c005040 tx=0x7f623c002390 comp rx=0 tx=0).stop 2026-02-23T06:34:10.833 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:34:10.833 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:34:10.833 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:34:10.833 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:34:10.833 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 108, 2026-02-23T06:34:10.833 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 525349, 2026-02-23T06:34:10.833 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:34:10.833 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:34:10.833 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:34:10.833 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:34:10.833 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:10.833 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:34:10.834 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:34:10.834 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:34:10.834 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:34:10.834 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:34:10.834 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:34:10.834 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:34:10.834 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:34:10.834 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:34:10.834 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:34:10.834 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:34:10.834 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:34:10.834 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:34:10.834 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:34:10.834 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:34:10.834 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:34:10.834 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:34:10.835 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:10.835 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:34:10.835 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:34:10.835 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:34:10.835 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:34:10.835 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:34:10.835 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:34:10.835 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:34:10.835 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:34:10.835 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:34:10.835 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:34:10.835 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:34:10.835 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:34:10.835 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:34:10.835 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:34:10.835 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:34:10.836 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:10.836 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.836 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:34:10.836 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:34:10.836 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:34:10.836 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:34:10.836 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:34:10.836 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:34:10.836 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:34:10.836 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:34:10.836 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:34:10.836 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:34:10.836 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:34:10.836 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:34:10.836 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:34:10.836 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:34:10.837 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:34:10.837 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:34:10.837 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:34:10.837 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:34:10.837 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:34:10.837 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:34:10.837 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:34:10.837 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:34:10.837 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:34:10.837 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:34:10.837 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:34:10.837 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:34:10.837 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:34:10.837 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:34:10.837 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:34:10.837 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:34:10.837 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:10.837 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:34:10.838 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.838 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:34:10.838 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.838 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:34:10.838 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:34:10.838 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:34:10.838 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:34:10.838 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.838 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:34:10.838 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:34:10.838 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:10.838 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.838 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.838 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:34:10.838 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:34:10.838 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:10.838 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:10.838 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:10.838 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.838 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:34:10.839 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:34:10.839 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:34:10.839 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:34:10.839 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:34:10.839 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:34:10.839 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.839 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.839 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:34:10.839 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:34:10.839 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:34:10.839 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:34:10.839 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.839 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:34:10.839 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:34:10.839 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:10.839 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.839 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.839 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:34:10.839 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:34:10.839 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:10.839 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:10.839 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:10.840 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.840 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:34:10.840 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:34:10.840 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:34:10.840 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:34:10.840 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:34:10.840 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:34:10.840 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.840 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.840 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:34:10.840 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:34:10.840 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:34:10.840 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:34:10.840 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.840 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:34:10.840 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:34:10.840 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:10.840 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.840 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.840 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:34:10.840 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:34:10.840 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:10.841 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:10.841 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:10.841 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.841 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:34:10.841 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:34:10.841 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:34:10.841 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:34:10.841 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:34:10.841 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:34:10.841 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:10.841 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:10.841 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.841 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:34:10.841 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:34:10.841 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.841 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:34:10.841 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:34:10.841 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:34:10.841 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:10.841 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:10.841 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:34:10.841 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.842 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:34:10.842 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:34:10.842 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:34:10.842 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:10.842 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:10.842 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:34:10.842 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.842 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:34:10.842 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:34:10.842 INFO:teuthology.orchestra.run.trial058.stdout: "num": 8 2026-02-23T06:34:10.842 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:10.842 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:10.842 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:34:10.842 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.842 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:34:10.842 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:34:10.842 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:34:10.842 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.842 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.842 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:34:10.842 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:34:10.842 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:34:10.842 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:10.843 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:10.843 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:34:10.843 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:10.843 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:34:10.843 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:34:10.843 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:34:10.843 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:10.843 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:10.843 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:10.843 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:34:10.843 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:34:10.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.837+0000 7f624ebd2640 1 -- 10.20.193.58:0/4167517260 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f621807a6c0 msgr2=0x7f621809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:10.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.837+0000 7f624ebd2640 1 --2- 10.20.193.58:0/4167517260 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f621807a6c0 0x7f621809ab70 secure :-1 s=READY pgs=321 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f624400a230 tx=0x7f62440058c0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.837+0000 7f624ebd2640 1 -- 10.20.193.58:0/4167517260 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6248056960 msgr2=0x7f624813f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:10.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.837+0000 7f624ebd2640 1 --2- 10.20.193.58:0/4167517260 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6248056960 0x7f624813f8c0 secure :-1 s=READY pgs=67 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f623800b520 tx=0x7f623800b9f0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.837+0000 7f624e3d1640 1 -- 10.20.193.58:0/4167517260 reap_dead start 2026-02-23T06:34:10.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.837+0000 7f624e3d1640 1 -- 10.20.193.58:0/4167517260 reap_dead start 2026-02-23T06:34:10.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.837+0000 7f624ebd2640 1 -- 10.20.193.58:0/4167517260 shutdown_connections 2026-02-23T06:34:10.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.837+0000 7f624ebd2640 1 -- 10.20.193.58:0/4167517260 >> 10.20.193.58:0/4167517260 conn(0x7f62480b3c20 msgr2=0x7f62480b4150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:10.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.837+0000 7f624ebd2640 1 -- 10.20.193.58:0/4167517260 shutdown_connections 2026-02-23T06:34:10.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.837+0000 7f624ebd2640 1 -- 10.20.193.58:0/4167517260 wait complete. 2026-02-23T06:34:10.844 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:34:10.845 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-23T06:34:10.845 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-23T06:34:10.845 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-23T06:34:10.845 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-23T06:34:10.845 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-23T06:34:10.845 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:34:10.853 INFO:tasks.ceph.mon.b:Stopped 2026-02-23T06:34:10.853 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:34:10.853 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:34:10.975 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.980+0000 7f9f78c43640 1 -- 10.20.193.58:0/2037774999 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9f740b6690 msgr2=0x7f9f74058ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:10.975 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.980+0000 7f9f78c43640 1 --2- 10.20.193.58:0/2037774999 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9f740b6690 0x7f9f74058ec0 secure :-1 s=READY pgs=232 gs=2 cs=0 l=1 c_cookie=1894164257116553617 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f68006f50 tx=0x7f9f68030380 comp rx=0 tx=0).stop 2026-02-23T06:34:10.975 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.980+0000 7f9f78c43640 1 -- 10.20.193.58:0/2037774999 shutdown_connections 2026-02-23T06:34:10.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.980+0000 7f9f78c43640 1 --2- 10.20.193.58:0/2037774999 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9f740b6690 0x7f9f74058ec0 unknown :-1 s=CLOSED pgs=232 gs=2 cs=0 l=1 c_cookie=1894164257116553617 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.980+0000 7f9f78c43640 1 --2- 10.20.193.58:0/2037774999 >> v2:10.20.193.58:3300/0 conn(0x7f9f7415d4a0 0x7f9f740affb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.980+0000 7f9f78c43640 1 -- 10.20.193.58:0/2037774999 >> 10.20.193.58:0/2037774999 conn(0x7f9f740b3c20 msgr2=0x7f9f740b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:10.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.980+0000 7f9f78c43640 1 -- 10.20.193.58:0/2037774999 shutdown_connections 2026-02-23T06:34:10.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.980+0000 7f9f78c43640 1 -- 10.20.193.58:0/2037774999 wait complete. 2026-02-23T06:34:10.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.981+0000 7f9f78c43640 1 Processor -- start 2026-02-23T06:34:10.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.981+0000 7f9f78c43640 1 -- start start 2026-02-23T06:34:10.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.982+0000 7f9f78c43640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9f740b6690 0x7f9f74057750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:10.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.982+0000 7f9f78c43640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9f7415d4a0 0x7f9f741fd990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:10.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.982+0000 7f9f78c43640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f7415d870 0x7f9f741fded0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:10.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.982+0000 7f9f78c43640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7413bee0 con 0x7f9f7415d870 2026-02-23T06:34:10.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.982+0000 7f9f78c43640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9f741670e0 con 0x7f9f7415d4a0 2026-02-23T06:34:10.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.982+0000 7f9f78c43640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f9f741622b0 con 0x7f9f740b6690 2026-02-23T06:34:10.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.982+0000 7f9f72ffd640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9f7415d4a0 msgr2=0x7f9f741fd990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:34:10.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.982+0000 7f9f737fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9f740b6690 0x7f9f74057750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:10.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.982+0000 7f9f72ffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9f7415d4a0 0x7f9f741fd990 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:34:10.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.982+0000 7f9f737fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9f740b6690 0x7f9f74057750 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:53122/0 (socket says 10.20.193.58:53122) 2026-02-23T06:34:10.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.982+0000 7f9f737fe640 1 -- 10.20.193.58:0/2366320831 learned_addr learned my addr 10.20.193.58:0/2366320831 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:34:10.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.982+0000 7f9f73fff640 1 --2- 10.20.193.58:0/2366320831 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f7415d870 0x7f9f741fded0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:10.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.982+0000 7f9f73fff640 1 -- 10.20.193.58:0/2366320831 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9f740b6690 msgr2=0x7f9f74057750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:10.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.982+0000 7f9f73fff640 1 --2- 10.20.193.58:0/2366320831 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9f740b6690 0x7f9f74057750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.982+0000 7f9f73fff640 1 -- 10.20.193.58:0/2366320831 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9f7415d4a0 msgr2=0x7f9f741fd990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:34:10.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.982+0000 7f9f73fff640 1 --2- 10.20.193.58:0/2366320831 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9f7415d4a0 0x7f9f741fd990 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:10.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.982+0000 7f9f73fff640 1 -- 10.20.193.58:0/2366320831 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f6800a650 con 0x7f9f7415d870 2026-02-23T06:34:10.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.982+0000 7f9f737fe640 1 --2- 10.20.193.58:0/2366320831 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9f740b6690 0x7f9f74057750 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:34:10.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.983+0000 7f9f73fff640 1 --2- 10.20.193.58:0/2366320831 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f7415d870 0x7f9f741fded0 secure :-1 s=READY pgs=69 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f6800a980 tx=0x7f9f68003d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:10.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.983+0000 7f9f4ffff640 1 -- 10.20.193.58:0/2366320831 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f680398a0 con 0x7f9f7415d870 2026-02-23T06:34:10.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.983+0000 7f9f4ffff640 1 -- 10.20.193.58:0/2366320831 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f68039a00 con 0x7f9f7415d870 2026-02-23T06:34:10.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.983+0000 7f9f4ffff640 1 -- 10.20.193.58:0/2366320831 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f68039dd0 con 0x7f9f7415d870 2026-02-23T06:34:10.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.983+0000 7f9f78c43640 1 -- 10.20.193.58:0/2366320831 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f74162590 con 0x7f9f7415d870 2026-02-23T06:34:10.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.983+0000 7f9f78c43640 1 -- 10.20.193.58:0/2366320831 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f74162b50 con 0x7f9f7415d870 2026-02-23T06:34:10.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.983+0000 7f9f78c43640 1 -- 10.20.193.58:0/2366320831 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f740b6d50 con 0x7f9f7415d870 2026-02-23T06:34:10.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.984+0000 7f9f4ffff640 1 -- 10.20.193.58:0/2366320831 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f9f6804b460 con 0x7f9f7415d870 2026-02-23T06:34:10.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.985+0000 7f9f4ffff640 1 --2- 10.20.193.58:0/2366320831 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9f4407a5a0 0x7f9f4409aa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:10.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.985+0000 7f9f4ffff640 1 -- 10.20.193.58:0/2366320831 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f9f680c4380 con 0x7f9f7415d870 2026-02-23T06:34:10.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.986+0000 7f9f737fe640 1 --2- 10.20.193.58:0/2366320831 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9f4407a5a0 0x7f9f4409aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:10.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.986+0000 7f9f737fe640 1 --2- 10.20.193.58:0/2366320831 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9f4407a5a0 0x7f9f4409aa50 secure :-1 s=READY pgs=322 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f600095d0 tx=0x7f9f60005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:10.982 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:10.987+0000 7f9f4ffff640 1 -- 10.20.193.58:0/2366320831 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f9f68087490 con 0x7f9f7415d870 2026-02-23T06:34:11.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:11.150+0000 7f9f78c43640 1 -- 10.20.193.58:0/2366320831 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9f7405b0e0 con 0x7f9f7415d870 2026-02-23T06:34:11.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:11.151+0000 7f9f4ffff640 1 -- 10.20.193.58:0/2366320831 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f9f6808a5b0 con 0x7f9f7415d870 2026-02-23T06:34:11.146 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":108,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:34:11.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:11.152+0000 7f9f78c43640 1 -- 10.20.193.58:0/2366320831 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9f4407a5a0 msgr2=0x7f9f4409aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:11.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:11.152+0000 7f9f78c43640 1 --2- 10.20.193.58:0/2366320831 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9f4407a5a0 0x7f9f4409aa50 secure :-1 s=READY pgs=322 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f600095d0 tx=0x7f9f60005f90 comp rx=0 tx=0).stop 2026-02-23T06:34:11.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:11.152+0000 7f9f78c43640 1 -- 10.20.193.58:0/2366320831 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f7415d870 msgr2=0x7f9f741fded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:11.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:11.152+0000 7f9f78c43640 1 --2- 10.20.193.58:0/2366320831 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f7415d870 0x7f9f741fded0 secure :-1 s=READY pgs=69 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f6800a980 tx=0x7f9f68003d20 comp rx=0 tx=0).stop 2026-02-23T06:34:11.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:11.152+0000 7f9f78c43640 1 -- 10.20.193.58:0/2366320831 shutdown_connections 2026-02-23T06:34:11.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:11.152+0000 7f9f78c43640 1 --2- 10.20.193.58:0/2366320831 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9f4407a5a0 0x7f9f4409aa50 unknown :-1 s=CLOSED pgs=322 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:11.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:11.152+0000 7f9f78c43640 1 --2- 10.20.193.58:0/2366320831 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f7415d870 0x7f9f741fded0 unknown :-1 s=CLOSED pgs=69 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:11.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:11.152+0000 7f9f78c43640 1 --2- 10.20.193.58:0/2366320831 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9f7415d4a0 0x7f9f741fd990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:11.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:11.152+0000 7f9f78c43640 1 --2- 10.20.193.58:0/2366320831 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9f740b6690 0x7f9f74057750 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:11.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:11.152+0000 7f9f78c43640 1 -- 10.20.193.58:0/2366320831 >> 10.20.193.58:0/2366320831 conn(0x7f9f740b3c20 msgr2=0x7f9f7415be30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:11.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:11.152+0000 7f9f78c43640 1 -- 10.20.193.58:0/2366320831 shutdown_connections 2026-02-23T06:34:11.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:11.152+0000 7f9f78c43640 1 -- 10.20.193.58:0/2366320831 wait complete. 2026-02-23T06:34:13.381 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:34:13.385 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:34:14.161 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:34:14.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.285+0000 7fc7ebfff640 1 -- 10.20.193.58:0/3111542307 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7ec162ca0 msgr2=0x7fc7ec056fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:14.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.285+0000 7fc7ebfff640 1 --2- 10.20.193.58:0/3111542307 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7ec162ca0 0x7fc7ec056fc0 secure :-1 s=READY pgs=76 gs=2 cs=0 l=1 c_cookie=13680286024722307107 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7dc006f50 tx=0x7fc7dc030360 comp rx=0 tx=0).stop 2026-02-23T06:34:14.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.286+0000 7fc7ebfff640 1 -- 10.20.193.58:0/3111542307 shutdown_connections 2026-02-23T06:34:14.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.286+0000 7fc7ebfff640 1 --2- 10.20.193.58:0/3111542307 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7ec162ca0 0x7fc7ec056fc0 unknown :-1 s=CLOSED pgs=76 gs=2 cs=0 l=1 c_cookie=13680286024722307107 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:14.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.286+0000 7fc7ebfff640 1 --2- 10.20.193.58:0/3111542307 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc7ec15c4b0 0x7fc7ec058200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:14.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.286+0000 7fc7ebfff640 1 -- 10.20.193.58:0/3111542307 >> 10.20.193.58:0/3111542307 conn(0x7fc7ec0b3c20 msgr2=0x7fc7ec0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:14.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.286+0000 7fc7ebfff640 1 -- 10.20.193.58:0/3111542307 shutdown_connections 2026-02-23T06:34:14.283 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.286+0000 7fc7ebfff640 1 -- 10.20.193.58:0/3111542307 wait complete. 2026-02-23T06:34:14.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.287+0000 7fc7ebfff640 1 Processor -- start 2026-02-23T06:34:14.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.287+0000 7fc7ebfff640 1 -- start start 2026-02-23T06:34:14.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.288+0000 7fc7ebfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc7ec056960 0x7fc7ec1fecc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:14.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.288+0000 7fc7ebfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7ec15c4b0 0x7fc7ec159e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:14.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.288+0000 7fc7ebfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc7ec162ca0 0x7fc7ec15a350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:14.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.288+0000 7fc7ebfff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ec1ff8f0 con 0x7fc7ec15c4b0 2026-02-23T06:34:14.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.288+0000 7fc7ebfff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ec1613b0 con 0x7fc7ec162ca0 2026-02-23T06:34:14.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.288+0000 7fc7ebfff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc7ec1ff630 con 0x7fc7ec056960 2026-02-23T06:34:14.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.288+0000 7fc7eb7fe640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc7ec162ca0 msgr2=0x7fc7ec15a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:34:14.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.288+0000 7fc7eb7fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc7ec162ca0 0x7fc7ec15a350 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:34:14.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.288+0000 7fc7ea7fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7ec15c4b0 0x7fc7ec159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:14.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.288+0000 7fc7ea7fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7ec15c4b0 0x7fc7ec159e10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:51444/0 (socket says 10.20.193.58:51444) 2026-02-23T06:34:14.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.288+0000 7fc7ea7fc640 1 -- 10.20.193.58:0/295055723 learned_addr learned my addr 10.20.193.58:0/295055723 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:34:14.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.288+0000 7fc7eaffd640 1 --2- 10.20.193.58:0/295055723 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc7ec056960 0x7fc7ec1fecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:14.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.288+0000 7fc7ea7fc640 1 -- 10.20.193.58:0/295055723 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc7ec056960 msgr2=0x7fc7ec1fecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:14.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.288+0000 7fc7ea7fc640 1 --2- 10.20.193.58:0/295055723 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc7ec056960 0x7fc7ec1fecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:14.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.288+0000 7fc7ea7fc640 1 -- 10.20.193.58:0/295055723 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc7ec162ca0 msgr2=0x7fc7ec15a350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:34:14.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.288+0000 7fc7ea7fc640 1 --2- 10.20.193.58:0/295055723 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc7ec162ca0 0x7fc7ec15a350 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:14.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.288+0000 7fc7ea7fc640 1 -- 10.20.193.58:0/295055723 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7dc00a650 con 0x7fc7ec15c4b0 2026-02-23T06:34:14.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.288+0000 7fc7ea7fc640 1 --2- 10.20.193.58:0/295055723 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7ec15c4b0 0x7fc7ec159e10 secure :-1 s=READY pgs=77 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7d400c4d0 tx=0x7fc7d400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:14.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.289+0000 7fc7cb7fe640 1 -- 10.20.193.58:0/295055723 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc7d40052f0 con 0x7fc7ec15c4b0 2026-02-23T06:34:14.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.289+0000 7fc7cb7fe640 1 -- 10.20.193.58:0/295055723 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7d4005540 con 0x7fc7ec15c4b0 2026-02-23T06:34:14.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.289+0000 7fc7ebfff640 1 -- 10.20.193.58:0/295055723 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7ec160a10 con 0x7fc7ec15c4b0 2026-02-23T06:34:14.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.289+0000 7fc7cb7fe640 1 -- 10.20.193.58:0/295055723 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc7d4006af0 con 0x7fc7ec15c4b0 2026-02-23T06:34:14.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.289+0000 7fc7ebfff640 1 -- 10.20.193.58:0/295055723 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7ec160fd0 con 0x7fc7ec15c4b0 2026-02-23T06:34:14.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.289+0000 7fc7ebfff640 1 -- 10.20.193.58:0/295055723 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7ec13e4d0 con 0x7fc7ec15c4b0 2026-02-23T06:34:14.293 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.290+0000 7fc7cb7fe640 1 -- 10.20.193.58:0/295055723 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fc7d4019030 con 0x7fc7ec15c4b0 2026-02-23T06:34:14.293 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.291+0000 7fc7cb7fe640 1 --2- 10.20.193.58:0/295055723 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc7b807a5b0 0x7fc7b809aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:14.293 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.291+0000 7fc7cb7fe640 1 -- 10.20.193.58:0/295055723 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fc7d409cc20 con 0x7fc7ec15c4b0 2026-02-23T06:34:14.293 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.292+0000 7fc7eaffd640 1 --2- 10.20.193.58:0/295055723 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc7b807a5b0 0x7fc7b809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:14.293 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.292+0000 7fc7eaffd640 1 --2- 10.20.193.58:0/295055723 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc7b807a5b0 0x7fc7b809aa60 secure :-1 s=READY pgs=323 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7e0004740 tx=0x7fc7e000b410 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:14.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.294+0000 7fc7cb7fe640 1 -- 10.20.193.58:0/295055723 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fc7d405fe50 con 0x7fc7ec15c4b0 2026-02-23T06:34:14.446 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.450+0000 7fc7ebfff640 1 -- 10.20.193.58:0/295055723 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc7ec05ba20 con 0x7fc7ec15c4b0 2026-02-23T06:34:14.446 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.451+0000 7fc7cb7fe640 1 -- 10.20.193.58:0/295055723 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7fc7d4062f70 con 0x7fc7ec15c4b0 2026-02-23T06:34:14.446 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":108,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:34:14.447 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.452+0000 7fc7ebfff640 1 -- 10.20.193.58:0/295055723 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc7b807a5b0 msgr2=0x7fc7b809aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:14.447 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.452+0000 7fc7ebfff640 1 --2- 10.20.193.58:0/295055723 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc7b807a5b0 0x7fc7b809aa60 secure :-1 s=READY pgs=323 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7e0004740 tx=0x7fc7e000b410 comp rx=0 tx=0).stop 2026-02-23T06:34:14.448 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.452+0000 7fc7ebfff640 1 -- 10.20.193.58:0/295055723 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7ec15c4b0 msgr2=0x7fc7ec159e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:14.448 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.452+0000 7fc7ebfff640 1 --2- 10.20.193.58:0/295055723 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7ec15c4b0 0x7fc7ec159e10 secure :-1 s=READY pgs=77 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7d400c4d0 tx=0x7fc7d400c9a0 comp rx=0 tx=0).stop 2026-02-23T06:34:14.448 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.452+0000 7fc7ebfff640 1 -- 10.20.193.58:0/295055723 shutdown_connections 2026-02-23T06:34:14.448 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.452+0000 7fc7ebfff640 1 --2- 10.20.193.58:0/295055723 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc7b807a5b0 0x7fc7b809aa60 unknown :-1 s=CLOSED pgs=323 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:14.448 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.452+0000 7fc7ebfff640 1 --2- 10.20.193.58:0/295055723 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc7ec162ca0 0x7fc7ec15a350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:14.448 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.452+0000 7fc7ebfff640 1 --2- 10.20.193.58:0/295055723 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7ec15c4b0 0x7fc7ec159e10 unknown :-1 s=CLOSED pgs=77 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:14.448 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.452+0000 7fc7ebfff640 1 --2- 10.20.193.58:0/295055723 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc7ec056960 0x7fc7ec1fecc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:14.448 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.452+0000 7fc7ebfff640 1 -- 10.20.193.58:0/295055723 >> 10.20.193.58:0/295055723 conn(0x7fc7ec0b3c20 msgr2=0x7fc7ec0b40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:14.448 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.452+0000 7fc7ebfff640 1 -- 10.20.193.58:0/295055723 shutdown_connections 2026-02-23T06:34:14.448 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:14.452+0000 7fc7ebfff640 1 -- 10.20.193.58:0/295055723 wait complete. 2026-02-23T06:34:17.460 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:34:17.582 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.586+0000 7fec049be640 1 -- 10.20.193.58:0/1969272067 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fec0015d870 msgr2=0x7fec000587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:17.582 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.586+0000 7fec049be640 1 --2- 10.20.193.58:0/1969272067 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fec0015d870 0x7fec000587b0 secure :-1 s=READY pgs=80 gs=3 cs=0 l=1 c_cookie=1495841118503708363 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7febf0005e70 tx=0x7febf002f290 comp rx=0 tx=0).stop 2026-02-23T06:34:17.582 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.586+0000 7fec049be640 1 -- 10.20.193.58:0/1969272067 shutdown_connections 2026-02-23T06:34:17.583 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.586+0000 7fec049be640 1 --2- 10.20.193.58:0/1969272067 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fec0015d870 0x7fec000587b0 unknown :-1 s=CLOSED pgs=80 gs=3 cs=0 l=1 c_cookie=1495841118503708363 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:17.583 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.586+0000 7fec049be640 1 -- 10.20.193.58:0/1969272067 >> 10.20.193.58:0/1969272067 conn(0x7fec000b3c20 msgr2=0x7fec000b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:17.583 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.586+0000 7fec049be640 1 -- 10.20.193.58:0/1969272067 shutdown_connections 2026-02-23T06:34:17.583 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.586+0000 7fec049be640 1 -- 10.20.193.58:0/1969272067 wait complete. 2026-02-23T06:34:17.586 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.587+0000 7fec049be640 1 Processor -- start 2026-02-23T06:34:17.586 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.587+0000 7fec049be640 1 -- start start 2026-02-23T06:34:17.586 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.588+0000 7fec049be640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fec000b6690 0x7fec0013d5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:17.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.588+0000 7fec049be640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fec0015d4a0 0x7fec0015a1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:17.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.588+0000 7fec049be640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fec0015d870 0x7fec0015a730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:17.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.588+0000 7fec049be640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fec00159da0 con 0x7fec0015d870 2026-02-23T06:34:17.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.588+0000 7fec049be640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fec0013bc90 con 0x7fec0015d4a0 2026-02-23T06:34:17.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.588+0000 7fec049be640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fec00160b40 con 0x7fec000b6690 2026-02-23T06:34:17.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.588+0000 7febfeffd640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fec0015d4a0 msgr2=0x7fec0015a1f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:34:17.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.588+0000 7febfeffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fec0015d4a0 0x7fec0015a1f0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:34:17.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.588+0000 7febfffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fec0015d870 0x7fec0015a730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:17.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.588+0000 7febfffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fec0015d870 0x7fec0015a730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:51464/0 (socket says 10.20.193.58:51464) 2026-02-23T06:34:17.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.588+0000 7febfffff640 1 -- 10.20.193.58:0/2451528962 learned_addr learned my addr 10.20.193.58:0/2451528962 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:34:17.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.588+0000 7febff7fe640 1 --2- 10.20.193.58:0/2451528962 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fec000b6690 0x7fec0013d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:17.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.588+0000 7febfffff640 1 -- 10.20.193.58:0/2451528962 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fec000b6690 msgr2=0x7fec0013d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:17.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.588+0000 7febfffff640 1 --2- 10.20.193.58:0/2451528962 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fec000b6690 0x7fec0013d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:17.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.588+0000 7febfffff640 1 -- 10.20.193.58:0/2451528962 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fec0015d4a0 msgr2=0x7fec0015a1f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:34:17.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.588+0000 7febfffff640 1 --2- 10.20.193.58:0/2451528962 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fec0015d4a0 0x7fec0015a1f0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:17.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.588+0000 7febfffff640 1 -- 10.20.193.58:0/2451528962 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febf0009570 con 0x7fec0015d870 2026-02-23T06:34:17.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.589+0000 7febfffff640 1 --2- 10.20.193.58:0/2451528962 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fec0015d870 0x7fec0015a730 secure :-1 s=READY pgs=81 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7febf400c520 tx=0x7febf400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:17.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.589+0000 7febdbfff640 1 -- 10.20.193.58:0/2451528962 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7febf4003d60 con 0x7fec0015d870 2026-02-23T06:34:17.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.589+0000 7fec049be640 1 -- 10.20.193.58:0/2451528962 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec0015dce0 con 0x7fec0015d870 2026-02-23T06:34:17.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.589+0000 7febdbfff640 1 -- 10.20.193.58:0/2451528962 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7febf4005070 con 0x7fec0015d870 2026-02-23T06:34:17.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.589+0000 7febdbfff640 1 -- 10.20.193.58:0/2451528962 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7febf4005440 con 0x7fec0015d870 2026-02-23T06:34:17.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.589+0000 7fec049be640 1 -- 10.20.193.58:0/2451528962 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec0015e2a0 con 0x7fec0015d870 2026-02-23T06:34:17.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.591+0000 7febdbfff640 1 -- 10.20.193.58:0/2451528962 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7febf400e040 con 0x7fec0015d870 2026-02-23T06:34:17.589 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.591+0000 7fec049be640 1 -- 10.20.193.58:0/2451528962 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec000b6d50 con 0x7fec0015d870 2026-02-23T06:34:17.589 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.592+0000 7febdbfff640 1 --2- 10.20.193.58:0/2451528962 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7febd007a5b0 0x7febd009aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:17.590 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.592+0000 7febdbfff640 1 -- 10.20.193.58:0/2451528962 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7febf409e4e0 con 0x7fec0015d870 2026-02-23T06:34:17.590 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.592+0000 7febff7fe640 1 --2- 10.20.193.58:0/2451528962 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7febd007a5b0 0x7febd009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:17.590 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.592+0000 7febff7fe640 1 --2- 10.20.193.58:0/2451528962 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7febd007a5b0 0x7febd009aa60 secure :-1 s=READY pgs=324 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7febec0027d0 tx=0x7febec007ee0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:17.590 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.594+0000 7febdbfff640 1 -- 10.20.193.58:0/2451528962 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7febf40615f0 con 0x7fec0015d870 2026-02-23T06:34:17.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.748+0000 7fec049be640 1 -- 10.20.193.58:0/2451528962 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fec00159ee0 con 0x7fec0015d870 2026-02-23T06:34:17.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.748+0000 7febdbfff640 1 -- 10.20.193.58:0/2451528962 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7febf4064710 con 0x7fec0015d870 2026-02-23T06:34:17.744 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":108,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:34:17.745 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.749+0000 7fec049be640 1 -- 10.20.193.58:0/2451528962 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7febd007a5b0 msgr2=0x7febd009aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:17.745 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.749+0000 7fec049be640 1 --2- 10.20.193.58:0/2451528962 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7febd007a5b0 0x7febd009aa60 secure :-1 s=READY pgs=324 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7febec0027d0 tx=0x7febec007ee0 comp rx=0 tx=0).stop 2026-02-23T06:34:17.745 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.749+0000 7fec049be640 1 -- 10.20.193.58:0/2451528962 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fec0015d870 msgr2=0x7fec0015a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:17.745 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.749+0000 7fec049be640 1 --2- 10.20.193.58:0/2451528962 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fec0015d870 0x7fec0015a730 secure :-1 s=READY pgs=81 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7febf400c520 tx=0x7febf400c9f0 comp rx=0 tx=0).stop 2026-02-23T06:34:17.745 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.749+0000 7fec049be640 1 -- 10.20.193.58:0/2451528962 shutdown_connections 2026-02-23T06:34:17.745 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.749+0000 7fec049be640 1 --2- 10.20.193.58:0/2451528962 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7febd007a5b0 0x7febd009aa60 unknown :-1 s=CLOSED pgs=324 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:17.745 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.749+0000 7fec049be640 1 --2- 10.20.193.58:0/2451528962 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fec0015d870 0x7fec0015a730 unknown :-1 s=CLOSED pgs=81 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:17.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.749+0000 7fec049be640 1 --2- 10.20.193.58:0/2451528962 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fec0015d4a0 0x7fec0015a1f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:17.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.749+0000 7fec049be640 1 --2- 10.20.193.58:0/2451528962 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fec000b6690 0x7fec0013d5a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:17.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.749+0000 7fec049be640 1 -- 10.20.193.58:0/2451528962 >> 10.20.193.58:0/2451528962 conn(0x7fec000b3c20 msgr2=0x7fec000585b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:17.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.749+0000 7fec049be640 1 -- 10.20.193.58:0/2451528962 shutdown_connections 2026-02-23T06:34:17.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:17.749+0000 7fec049be640 1 -- 10.20.193.58:0/2451528962 wait complete. 2026-02-23T06:34:20.757 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:34:26.882 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.887+0000 7fccb7fff640 1 -- 10.20.193.58:0/896373376 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcca4004d90 msgr2=0x7fcca4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:26.882 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.887+0000 7fccb7fff640 1 --2- 10.20.193.58:0/896373376 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcca4004d90 0x7fcca4005200 secure :-1 s=READY pgs=85 gs=31 cs=0 l=1 c_cookie=10080070245799310652 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fccb805e5f0 tx=0x7fcca8030380 comp rx=0 tx=0).stop 2026-02-23T06:34:26.883 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.887+0000 7fccb77fe640 1 -- 10.20.193.58:0/896373376 reap_dead start 2026-02-23T06:34:26.883 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.887+0000 7fccb7fff640 1 -- 10.20.193.58:0/896373376 shutdown_connections 2026-02-23T06:34:26.883 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.887+0000 7fccb7fff640 1 -- 10.20.193.58:0/896373376 >> 10.20.193.58:0/896373376 conn(0x7fccb8059db0 msgr2=0x7fccb805a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:26.883 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.887+0000 7fccb7fff640 1 -- 10.20.193.58:0/896373376 shutdown_connections 2026-02-23T06:34:26.883 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.887+0000 7fccb7fff640 1 -- 10.20.193.58:0/896373376 wait complete. 2026-02-23T06:34:26.886 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.888+0000 7fccb7fff640 1 Processor -- start 2026-02-23T06:34:26.886 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.888+0000 7fccb7fff640 1 -- start start 2026-02-23T06:34:26.886 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.889+0000 7fccb7fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fccb8165930 0x7fccb815f940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:26.886 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.889+0000 7fccb7fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fccb8165d00 0x7fccb81591a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:26.886 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.889+0000 7fccb7fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fccb813e510 0x7fccb81596e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:26.886 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.889+0000 7fccb7fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fccb815edc0 con 0x7fccb8165d00 2026-02-23T06:34:26.886 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.889+0000 7fccb7fff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fccb815fe80 con 0x7fccb813e510 2026-02-23T06:34:26.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.889+0000 7fccb7fff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fccb8200490 con 0x7fccb8165930 2026-02-23T06:34:26.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.889+0000 7fccb77fe640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fccb813e510 msgr2=0x7fccb81596e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:34:26.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.889+0000 7fccb67fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fccb8165d00 0x7fccb81591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:26.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.889+0000 7fccb77fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fccb813e510 0x7fccb81596e0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:34:26.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.889+0000 7fccb67fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fccb8165d00 0x7fccb81591a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:38850/0 (socket says 10.20.193.58:38850) 2026-02-23T06:34:26.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.889+0000 7fccb67fc640 1 -- 10.20.193.58:0/2294197636 learned_addr learned my addr 10.20.193.58:0/2294197636 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:34:26.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.889+0000 7fccb6ffd640 1 --2- 10.20.193.58:0/2294197636 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fccb8165930 0x7fccb815f940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:26.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.889+0000 7fccb67fc640 1 -- 10.20.193.58:0/2294197636 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fccb8165930 msgr2=0x7fccb815f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:26.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.889+0000 7fccb67fc640 1 --2- 10.20.193.58:0/2294197636 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fccb8165930 0x7fccb815f940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:26.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.889+0000 7fccb67fc640 1 -- 10.20.193.58:0/2294197636 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fccb813e510 msgr2=0x7fccb81596e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:34:26.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.889+0000 7fccb67fc640 1 --2- 10.20.193.58:0/2294197636 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fccb813e510 0x7fccb81596e0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:26.888 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.889+0000 7fccb67fc640 1 -- 10.20.193.58:0/2294197636 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb81fcea0 con 0x7fccb8165d00 2026-02-23T06:34:26.888 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.889+0000 7fccb67fc640 1 --2- 10.20.193.58:0/2294197636 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fccb8165d00 0x7fccb81591a0 secure :-1 s=READY pgs=86 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcca0005e30 tx=0x7fcca0012bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:26.888 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.890+0000 7fcc977fe640 1 -- 10.20.193.58:0/2294197636 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcca0011be0 con 0x7fccb8165d00 2026-02-23T06:34:26.888 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.890+0000 7fcc977fe640 1 -- 10.20.193.58:0/2294197636 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcca0018040 con 0x7fccb8165d00 2026-02-23T06:34:26.888 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.890+0000 7fcc977fe640 1 -- 10.20.193.58:0/2294197636 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcca0004850 con 0x7fccb8165d00 2026-02-23T06:34:26.888 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.890+0000 7fccb7fff640 1 -- 10.20.193.58:0/2294197636 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccb81fd160 con 0x7fccb8165d00 2026-02-23T06:34:26.888 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.890+0000 7fccb7fff640 1 -- 10.20.193.58:0/2294197636 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccb81fd720 con 0x7fccb8165d00 2026-02-23T06:34:26.888 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.890+0000 7fccb7fff640 1 -- 10.20.193.58:0/2294197636 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccb80b4ef0 con 0x7fccb8165d00 2026-02-23T06:34:26.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.891+0000 7fcc977fe640 1 -- 10.20.193.58:0/2294197636 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fcca001d040 con 0x7fccb8165d00 2026-02-23T06:34:26.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.892+0000 7fcc977fe640 1 --2- 10.20.193.58:0/2294197636 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcc8407a5a0 0x7fcc8409aa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:26.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.892+0000 7fcc977fe640 1 -- 10.20.193.58:0/2294197636 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fcca009f640 con 0x7fccb8165d00 2026-02-23T06:34:26.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.892+0000 7fccb6ffd640 1 --2- 10.20.193.58:0/2294197636 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcc8407a5a0 0x7fcc8409aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:26.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.893+0000 7fccb6ffd640 1 --2- 10.20.193.58:0/2294197636 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcc8407a5a0 0x7fcc8409aa50 secure :-1 s=READY pgs=325 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fccac0030b0 tx=0x7fccac002f60 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:26.890 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:26.894+0000 7fcc977fe640 1 -- 10.20.193.58:0/2294197636 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fcca0062750 con 0x7fccb8165d00 2026-02-23T06:34:27.043 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.047+0000 7fccb7fff640 1 -- 10.20.193.58:0/2294197636 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fccb8160c30 con 0x7fccb8165d00 2026-02-23T06:34:27.043 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.048+0000 7fcc977fe640 1 -- 10.20.193.58:0/2294197636 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1749 (secure 0 0 0) 0x7fcca001d320 con 0x7fccb8165d00 2026-02-23T06:34:27.044 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":112,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:34:27.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.049+0000 7fccb7fff640 1 -- 10.20.193.58:0/2294197636 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcc8407a5a0 msgr2=0x7fcc8409aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:27.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.049+0000 7fccb7fff640 1 --2- 10.20.193.58:0/2294197636 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcc8407a5a0 0x7fcc8409aa50 secure :-1 s=READY pgs=325 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fccac0030b0 tx=0x7fccac002f60 comp rx=0 tx=0).stop 2026-02-23T06:34:27.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.049+0000 7fccb7fff640 1 -- 10.20.193.58:0/2294197636 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fccb8165d00 msgr2=0x7fccb81591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:27.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.049+0000 7fccb7fff640 1 --2- 10.20.193.58:0/2294197636 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fccb8165d00 0x7fccb81591a0 secure :-1 s=READY pgs=86 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcca0005e30 tx=0x7fcca0012bf0 comp rx=0 tx=0).stop 2026-02-23T06:34:27.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.049+0000 7fccb7fff640 1 -- 10.20.193.58:0/2294197636 shutdown_connections 2026-02-23T06:34:27.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.049+0000 7fccb7fff640 1 --2- 10.20.193.58:0/2294197636 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcc8407a5a0 0x7fcc8409aa50 unknown :-1 s=CLOSED pgs=325 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:27.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.049+0000 7fccb7fff640 1 --2- 10.20.193.58:0/2294197636 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fccb813e510 0x7fccb81596e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:27.046 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.049+0000 7fccb7fff640 1 --2- 10.20.193.58:0/2294197636 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fccb8165d00 0x7fccb81591a0 unknown :-1 s=CLOSED pgs=86 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:27.046 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.049+0000 7fccb7fff640 1 --2- 10.20.193.58:0/2294197636 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fccb8165930 0x7fccb815f940 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:27.046 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.049+0000 7fccb7fff640 1 -- 10.20.193.58:0/2294197636 >> 10.20.193.58:0/2294197636 conn(0x7fccb8059db0 msgr2=0x7fccb80b52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:27.046 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.049+0000 7fccb7fff640 1 -- 10.20.193.58:0/2294197636 shutdown_connections 2026-02-23T06:34:27.046 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.049+0000 7fccb7fff640 1 -- 10.20.193.58:0/2294197636 wait complete. 2026-02-23T06:34:27.056 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:34:27.056 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-23T06:34:27.057 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:34:27.179 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.184+0000 7fc927fff640 1 -- 10.20.193.58:0/3575987549 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc92815d4a0 msgr2=0x7fc9280affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:27.180 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.184+0000 7fc927fff640 1 --2- 10.20.193.58:0/3575987549 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc92815d4a0 0x7fc9280affb0 secure :-1 s=READY pgs=240 gs=1 cs=0 l=1 c_cookie=13860800508289133159 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9280b1b90 tx=0x7fc91c02f270 comp rx=0 tx=0).stop 2026-02-23T06:34:27.180 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.184+0000 7fc927fff640 1 -- 10.20.193.58:0/3575987549 shutdown_connections 2026-02-23T06:34:27.180 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.184+0000 7fc927fff640 1 --2- 10.20.193.58:0/3575987549 >> v2:10.20.193.93:3300/0 conn(0x7fc9280b6690 0x7fc928058cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:27.180 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.184+0000 7fc927fff640 1 --2- 10.20.193.58:0/3575987549 >> v2:10.20.193.58:3300/0 conn(0x7fc92815d870 0x7fc9280587b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:27.180 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.184+0000 7fc927fff640 1 --2- 10.20.193.58:0/3575987549 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc92815d4a0 0x7fc9280affb0 unknown :-1 s=CLOSED pgs=240 gs=1 cs=0 l=1 c_cookie=13860800508289133159 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:27.180 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.184+0000 7fc927fff640 1 -- 10.20.193.58:0/3575987549 >> 10.20.193.58:0/3575987549 conn(0x7fc9280b3c20 msgr2=0x7fc9280b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:27.180 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.184+0000 7fc927fff640 1 -- 10.20.193.58:0/3575987549 shutdown_connections 2026-02-23T06:34:27.180 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.184+0000 7fc927fff640 1 -- 10.20.193.58:0/3575987549 wait complete. 2026-02-23T06:34:27.183 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.185+0000 7fc927fff640 1 Processor -- start 2026-02-23T06:34:27.183 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.185+0000 7fc927fff640 1 -- start start 2026-02-23T06:34:27.183 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.186+0000 7fc927fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc9280b6690 0x7fc92815a5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:27.183 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.186+0000 7fc927fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc92815d4a0 0x7fc928144070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:27.183 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.186+0000 7fc927fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc92815d870 0x7fc928200d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:27.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.186+0000 7fc927fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc928163420 con 0x7fc92815d4a0 2026-02-23T06:34:27.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.186+0000 7fc927fff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc928201c50 con 0x7fc92815d870 2026-02-23T06:34:27.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.186+0000 7fc927fff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc9281625a0 con 0x7fc9280b6690 2026-02-23T06:34:27.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.186+0000 7fc9277fe640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc92815d870 msgr2=0x7fc928200d30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:34:27.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.186+0000 7fc9277fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc92815d870 0x7fc928200d30 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:34:27.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.186+0000 7fc926ffd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc9280b6690 0x7fc92815a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:27.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.186+0000 7fc926ffd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc9280b6690 0x7fc92815a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:51194/0 (socket says 10.20.193.58:51194) 2026-02-23T06:34:27.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.186+0000 7fc926ffd640 1 -- 10.20.193.58:0/177660449 learned_addr learned my addr 10.20.193.58:0/177660449 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:34:27.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.186+0000 7fc9267fc640 1 --2- 10.20.193.58:0/177660449 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc92815d4a0 0x7fc928144070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:27.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.186+0000 7fc9267fc640 1 -- 10.20.193.58:0/177660449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc9280b6690 msgr2=0x7fc92815a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:27.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.186+0000 7fc9267fc640 1 --2- 10.20.193.58:0/177660449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc9280b6690 0x7fc92815a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:27.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.186+0000 7fc9267fc640 1 -- 10.20.193.58:0/177660449 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc92815d870 msgr2=0x7fc928200d30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:34:27.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.186+0000 7fc9267fc640 1 --2- 10.20.193.58:0/177660449 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc92815d870 0x7fc928200d30 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:27.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.187+0000 7fc9267fc640 1 -- 10.20.193.58:0/177660449 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9100094b0 con 0x7fc92815d4a0 2026-02-23T06:34:27.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.187+0000 7fc9267fc640 1 --2- 10.20.193.58:0/177660449 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc92815d4a0 0x7fc928144070 secure :-1 s=READY pgs=87 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9280b1d30 tx=0x7fc910002b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:27.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.187+0000 7fc9077fe640 1 -- 10.20.193.58:0/177660449 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc91000eac0 con 0x7fc92815d4a0 2026-02-23T06:34:27.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.187+0000 7fc9077fe640 1 -- 10.20.193.58:0/177660449 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc91000ec20 con 0x7fc92815d4a0 2026-02-23T06:34:27.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.187+0000 7fc9077fe640 1 -- 10.20.193.58:0/177660449 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc910010430 con 0x7fc92815d4a0 2026-02-23T06:34:27.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.187+0000 7fc927fff640 1 -- 10.20.193.58:0/177660449 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc91c009570 con 0x7fc92815d4a0 2026-02-23T06:34:27.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.187+0000 7fc927fff640 1 -- 10.20.193.58:0/177660449 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc928163140 con 0x7fc92815d4a0 2026-02-23T06:34:27.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.188+0000 7fc927fff640 1 --2- 10.20.193.58:0/177660449 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc928161da0 0x7fc928201270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:27.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.188+0000 7fc927fff640 1 -- 10.20.193.58:0/177660449 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc928162170 con 0x7fc928161da0 2026-02-23T06:34:27.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.188+0000 7fc926ffd640 1 --2- 10.20.193.58:0/177660449 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc928161da0 0x7fc928201270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:27.186 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.188+0000 7fc926ffd640 1 -- 10.20.193.58:0/177660449 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc928164250 con 0x7fc928161da0 2026-02-23T06:34:27.187 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.188+0000 7fc926ffd640 1 --2- 10.20.193.58:0/177660449 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc928161da0 0x7fc928201270 secure :-1 s=READY pgs=88 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc91c005b30 tx=0x7fc91c0028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:27.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.189+0000 7fc9077fe640 1 -- 10.20.193.58:0/177660449 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc91c03d050 con 0x7fc928161da0 2026-02-23T06:34:27.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.189+0000 7fc9077fe640 1 -- 10.20.193.58:0/177660449 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fc91c03e040 con 0x7fc928161da0 2026-02-23T06:34:27.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.189+0000 7fc9077fe640 1 -- 10.20.193.58:0/177660449 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc928161da0 msgr2=0x7fc928201270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:27.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.189+0000 7fc9077fe640 1 --2- 10.20.193.58:0/177660449 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc928161da0 0x7fc928201270 secure :-1 s=READY pgs=88 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc91c005b30 tx=0x7fc91c0028d0 comp rx=0 tx=0).stop 2026-02-23T06:34:27.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.189+0000 7fc9077fe640 1 -- 10.20.193.58:0/177660449 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc928161da0 msgr2=0x7fc928201270 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:34:27.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.189+0000 7fc9077fe640 1 --2- 10.20.193.58:0/177660449 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc928161da0 0x7fc928201270 unknown :-1 s=CLOSED pgs=88 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:27.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.189+0000 7fc9077fe640 1 -- 10.20.193.58:0/177660449 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fc91001f060 con 0x7fc92815d4a0 2026-02-23T06:34:27.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.190+0000 7fc9077fe640 1 --2- 10.20.193.58:0/177660449 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc8f407a3c0 0x7fc8f409a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:27.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.190+0000 7fc9077fe640 1 -- 10.20.193.58:0/177660449 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fc91009dcc0 con 0x7fc92815d4a0 2026-02-23T06:34:27.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.190+0000 7fc926ffd640 1 --2- 10.20.193.58:0/177660449 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc8f407a3c0 0x7fc8f409a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:27.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.191+0000 7fc926ffd640 1 --2- 10.20.193.58:0/177660449 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc8f407a3c0 0x7fc8f409a870 secure :-1 s=READY pgs=326 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc91c005b30 tx=0x7fc91c031030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:27.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.192+0000 7fc927fff640 1 --2- 10.20.193.58:0/177660449 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc92813bf00 0x7fc9281fd7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:27.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.192+0000 7fc927fff640 1 -- 10.20.193.58:0/177660449 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc92813c2d0 con 0x7fc92813bf00 2026-02-23T06:34:27.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.193+0000 7fc9277fe640 1 --2- 10.20.193.58:0/177660449 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc92813bf00 0x7fc9281fd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:27.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.193+0000 7fc9277fe640 1 -- 10.20.193.58:0/177660449 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc92805b0e0 con 0x7fc92813bf00 2026-02-23T06:34:27.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.193+0000 7fc9277fe640 1 --2- 10.20.193.58:0/177660449 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc92813bf00 0x7fc9281fd7a0 secure :-1 s=READY pgs=89 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc918007fd0 tx=0x7fc91800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:27.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.193+0000 7fc9077fe640 1 -- 10.20.193.58:0/177660449 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc918006070 con 0x7fc92813bf00 2026-02-23T06:34:27.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.193+0000 7fc9077fe640 1 -- 10.20.193.58:0/177660449 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4902 (secure 0 0 0) 0x7fc9180061d0 con 0x7fc92813bf00 2026-02-23T06:34:27.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.193+0000 7fc9077fe640 1 -- 10.20.193.58:0/177660449 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc92813bf00 msgr2=0x7fc9281fd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:27.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.193+0000 7fc9077fe640 1 --2- 10.20.193.58:0/177660449 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc92813bf00 0x7fc9281fd7a0 secure :-1 s=READY pgs=89 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc918007fd0 tx=0x7fc91800c840 comp rx=0 tx=0).stop 2026-02-23T06:34:27.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.193+0000 7fc9077fe640 1 -- 10.20.193.58:0/177660449 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc92813bf00 msgr2=0x7fc9281fd7a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:34:27.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.193+0000 7fc9077fe640 1 --2- 10.20.193.58:0/177660449 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc92813bf00 0x7fc9281fd7a0 secure :-1 s=CLOSED pgs=89 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc918007fd0 tx=0x7fc91800c840 comp rx=0 tx=0).stop 2026-02-23T06:34:27.191 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:34:27.191 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:34:27.191 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:34:27.191 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:34:27.191 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 112, 2026-02-23T06:34:27.191 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 74705, 2026-02-23T06:34:27.192 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:34:27.192 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:34:27.192 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:34:27.192 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:27.192 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 1, 2026-02-23T06:34:27.192 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:34:27.192 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:34:27.192 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:34:27.192 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:34:27.192 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:34:27.192 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:34:27.193 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:34:27.193 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:34:27.193 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:34:27.193 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:34:27.193 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:34:27.193 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:34:27.193 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:34:27.193 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:34:27.193 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:34:27.193 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:34:27.193 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:27.193 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:34:27.193 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:34:27.194 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:34:27.194 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:34:27.194 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:34:27.194 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:34:27.194 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:34:27.194 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:34:27.194 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:34:27.194 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:34:27.194 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:34:27.194 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:34:27.194 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:34:27.194 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:34:27.195 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:34:27.195 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:27.195 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:27.195 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:34:27.195 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:34:27.195 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:34:27.195 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:34:27.195 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:34:27.195 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:34:27.195 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:34:27.195 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:34:27.195 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:34:27.196 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:34:27.196 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:34:27.196 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:34:27.196 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:34:27.196 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:34:27.196 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:34:27.196 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:34:27.196 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:34:27.196 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:34:27.196 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:34:27.196 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:34:27.196 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:34:27.197 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:34:27.197 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:34:27.197 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:34:27.197 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:34:27.197 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:34:27.197 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:34:27.197 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:34:27.197 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:34:27.197 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:34:27.197 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:27.197 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:34:27.197 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:27.198 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:34:27.198 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:27.198 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:34:27.198 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:34:27.198 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:34:27.198 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:34:27.198 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:27.198 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:34:27.198 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:34:27.198 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:27.198 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:27.198 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:27.199 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:34:27.199 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:34:27.199 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:27.199 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:27.199 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:27.199 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:27.199 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:34:27.199 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:34:27.199 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:34:27.199 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:34:27.199 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:34:27.199 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:34:27.199 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:27.200 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:27.200 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:34:27.200 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:34:27.200 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:34:27.200 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:34:27.200 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:27.200 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:34:27.200 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:34:27.200 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:27.200 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:27.200 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:27.200 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:34:27.201 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:34:27.201 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:27.201 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:27.201 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:27.201 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:27.201 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:34:27.201 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:34:27.201 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:34:27.201 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:34:27.201 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:34:27.201 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:34:27.201 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:27.202 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:27.202 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:34:27.202 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:34:27.202 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:34:27.202 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:34:27.202 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:27.202 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:34:27.202 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:34:27.202 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:27.202 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:27.202 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:27.202 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:34:27.203 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:34:27.203 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:27.203 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:27.203 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:27.203 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:27.203 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:34:27.203 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:34:27.203 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:34:27.203 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:34:27.203 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:34:27.203 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:34:27.203 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:27.204 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:27.204 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:27.204 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:34:27.204 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:34:27.204 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:27.204 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:34:27.204 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:34:27.204 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:34:27.204 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:27.204 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:27.204 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:34:27.204 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:27.205 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:34:27.205 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:34:27.205 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:34:27.205 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:27.205 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:27.205 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:27.205 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:34:27.205 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:34:27.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.193+0000 7fc927fff640 1 -- 10.20.193.58:0/177660449 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc8f407a3c0 msgr2=0x7fc8f409a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:27.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.193+0000 7fc927fff640 1 --2- 10.20.193.58:0/177660449 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc8f407a3c0 0x7fc8f409a870 secure :-1 s=READY pgs=326 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc91c005b30 tx=0x7fc91c031030 comp rx=0 tx=0).stop 2026-02-23T06:34:27.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.193+0000 7fc927fff640 1 -- 10.20.193.58:0/177660449 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc92815d4a0 msgr2=0x7fc928144070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:27.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.193+0000 7fc927fff640 1 --2- 10.20.193.58:0/177660449 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc92815d4a0 0x7fc928144070 secure :-1 s=READY pgs=87 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9280b1d30 tx=0x7fc910002b40 comp rx=0 tx=0).stop 2026-02-23T06:34:27.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.193+0000 7fc9277fe640 1 -- 10.20.193.58:0/177660449 reap_dead start 2026-02-23T06:34:27.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.194+0000 7fc927fff640 1 -- 10.20.193.58:0/177660449 shutdown_connections 2026-02-23T06:34:27.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.194+0000 7fc927fff640 1 --2- 10.20.193.58:0/177660449 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc92815d4a0 0x7fc928144070 unknown :-1 s=CLOSED pgs=87 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:27.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.194+0000 7fc927fff640 1 -- 10.20.193.58:0/177660449 >> 10.20.193.58:0/177660449 conn(0x7fc9280b3c20 msgr2=0x7fc928056770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:27.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.194+0000 7fc927fff640 1 -- 10.20.193.58:0/177660449 shutdown_connections 2026-02-23T06:34:27.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.194+0000 7fc927fff640 1 -- 10.20.193.58:0/177660449 wait complete. 2026-02-23T06:34:27.208 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:34:27.208 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-23T06:34:27.208 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:34:27.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.335+0000 7f392d989640 1 -- 10.20.193.58:0/3246551609 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f392815c040 msgr2=0x7f392805b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:27.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.335+0000 7f392d989640 1 --2- 10.20.193.58:0/3246551609 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f392815c040 0x7f392805b0e0 secure :-1 s=READY pgs=241 gs=2 cs=0 l=1 c_cookie=8588274891446762846 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3918005e70 tx=0x7f391802f290 comp rx=0 tx=0).stop 2026-02-23T06:34:27.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.335+0000 7f392d989640 1 -- 10.20.193.58:0/3246551609 shutdown_connections 2026-02-23T06:34:27.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.335+0000 7f392d989640 1 --2- 10.20.193.58:0/3246551609 >> v2:10.20.193.58:3300/0 conn(0x7f3928056550 0x7f392805ce30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:27.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.335+0000 7f392d989640 1 --2- 10.20.193.58:0/3246551609 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f392815c040 0x7f392805b0e0 unknown :-1 s=CLOSED pgs=241 gs=2 cs=0 l=1 c_cookie=8588274891446762846 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:27.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.335+0000 7f392d989640 1 -- 10.20.193.58:0/3246551609 >> 10.20.193.58:0/3246551609 conn(0x7f39280b3c20 msgr2=0x7f39280b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:27.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.335+0000 7f392d989640 1 -- 10.20.193.58:0/3246551609 shutdown_connections 2026-02-23T06:34:27.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.335+0000 7f392d989640 1 -- 10.20.193.58:0/3246551609 wait complete. 2026-02-23T06:34:27.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.336+0000 7f392d989640 1 Processor -- start 2026-02-23T06:34:27.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.336+0000 7f392d989640 1 -- start start 2026-02-23T06:34:27.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.336+0000 7f392d989640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3928056550 0x7f392815d5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:27.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.336+0000 7f392d989640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f392805d370 0x7f392815db20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:27.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.336+0000 7f392d989640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f392815c040 0x7f39280585d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:27.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.336+0000 7f392d989640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f392815fa50 con 0x7f392815c040 2026-02-23T06:34:27.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.336+0000 7f392d989640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f39280a5480 con 0x7f392805d370 2026-02-23T06:34:27.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.336+0000 7f392d989640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f392815ce70 con 0x7f3928056550 2026-02-23T06:34:27.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.336+0000 7f391ffff640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f392805d370 msgr2=0x7f392815db20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:34:27.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.336+0000 7f391ffff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f392805d370 0x7f392815db20 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:34:27.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.336+0000 7f392d188640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f392815c040 0x7f39280585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:27.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.337+0000 7f392d188640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f392815c040 0x7f39280585d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:38910/0 (socket says 10.20.193.58:38910) 2026-02-23T06:34:27.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.337+0000 7f392d188640 1 -- 10.20.193.58:0/589339468 learned_addr learned my addr 10.20.193.58:0/589339468 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:34:27.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.337+0000 7f392c987640 1 --2- 10.20.193.58:0/589339468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3928056550 0x7f392815d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:27.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.337+0000 7f392d188640 1 -- 10.20.193.58:0/589339468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3928056550 msgr2=0x7f392815d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:27.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.337+0000 7f392d188640 1 --2- 10.20.193.58:0/589339468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3928056550 0x7f392815d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:27.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.337+0000 7f392d188640 1 -- 10.20.193.58:0/589339468 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f392805d370 msgr2=0x7f392815db20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:34:27.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.337+0000 7f392d188640 1 --2- 10.20.193.58:0/589339468 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f392805d370 0x7f392815db20 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:27.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.337+0000 7f392d188640 1 -- 10.20.193.58:0/589339468 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39100094b0 con 0x7f392815c040 2026-02-23T06:34:27.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.337+0000 7f392d188640 1 --2- 10.20.193.58:0/589339468 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f392815c040 0x7f39280585d0 secure :-1 s=READY pgs=91 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f392400d700 tx=0x7f392400dbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:27.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.337+0000 7f391d7fa640 1 -- 10.20.193.58:0/589339468 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3924007b90 con 0x7f392815c040 2026-02-23T06:34:27.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.337+0000 7f391d7fa640 1 -- 10.20.193.58:0/589339468 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3924007de0 con 0x7f392815c040 2026-02-23T06:34:27.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.337+0000 7f391d7fa640 1 -- 10.20.193.58:0/589339468 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3924006280 con 0x7f392815c040 2026-02-23T06:34:27.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.337+0000 7f392d989640 1 -- 10.20.193.58:0/589339468 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3918009570 con 0x7f392815c040 2026-02-23T06:34:27.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.337+0000 7f392d989640 1 -- 10.20.193.58:0/589339468 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3928162250 con 0x7f392815c040 2026-02-23T06:34:27.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.338+0000 7f392d989640 1 --2- 10.20.193.58:0/589339468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3928162b90 0x7f3928162530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:27.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.338+0000 7f392d989640 1 -- 10.20.193.58:0/589339468 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f392815c410 con 0x7f3928162b90 2026-02-23T06:34:27.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.338+0000 7f392c987640 1 --2- 10.20.193.58:0/589339468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3928162b90 0x7f3928162530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:27.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.338+0000 7f392c987640 1 -- 10.20.193.58:0/589339468 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f392805b620 con 0x7f3928162b90 2026-02-23T06:34:27.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.339+0000 7f392c987640 1 --2- 10.20.193.58:0/589339468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3928162b90 0x7f3928162530 secure :-1 s=READY pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3918004740 tx=0x7f3918004660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:27.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.339+0000 7f391d7fa640 1 -- 10.20.193.58:0/589339468 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3918002c90 con 0x7f3928162b90 2026-02-23T06:34:27.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.339+0000 7f391d7fa640 1 -- 10.20.193.58:0/589339468 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f392401a030 con 0x7f392815c040 2026-02-23T06:34:27.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.340+0000 7f391d7fa640 1 --2- 10.20.193.58:0/589339468 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f38f807a660 0x7f38f809ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:27.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.340+0000 7f391d7fa640 1 -- 10.20.193.58:0/589339468 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f392409de80 con 0x7f392815c040 2026-02-23T06:34:27.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.340+0000 7f391d7fa640 1 -- 10.20.193.58:0/589339468 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f3918038470 con 0x7f3928162b90 2026-02-23T06:34:27.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.340+0000 7f391d7fa640 1 -- 10.20.193.58:0/589339468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3928162b90 msgr2=0x7f3928162530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:27.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.340+0000 7f391d7fa640 1 --2- 10.20.193.58:0/589339468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3928162b90 0x7f3928162530 secure :-1 s=READY pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3918004740 tx=0x7f3918004660 comp rx=0 tx=0).stop 2026-02-23T06:34:27.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.340+0000 7f391d7fa640 1 -- 10.20.193.58:0/589339468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3928162b90 msgr2=0x7f3928162530 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:34:27.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.340+0000 7f391d7fa640 1 --2- 10.20.193.58:0/589339468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3928162b90 0x7f3928162530 unknown :-1 s=CLOSED pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:27.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.340+0000 7f391ffff640 1 --2- 10.20.193.58:0/589339468 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f38f807a660 0x7f38f809ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:27.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.341+0000 7f391ffff640 1 --2- 10.20.193.58:0/589339468 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f38f807a660 0x7f38f809ab10 secure :-1 s=READY pgs=327 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3928161ea0 tx=0x7f3910005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:27.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.344+0000 7f392d989640 1 --2- 10.20.193.58:0/589339468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f392815cfb0 0x7f3928058b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:27.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.344+0000 7f392d989640 1 -- 10.20.193.58:0/589339468 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f3928059050 con 0x7f392815cfb0 2026-02-23T06:34:27.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.344+0000 7f392c987640 1 --2- 10.20.193.58:0/589339468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f392815cfb0 0x7f3928058b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:27.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.345+0000 7f392c987640 1 -- 10.20.193.58:0/589339468 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f392805ce30 con 0x7f392815cfb0 2026-02-23T06:34:27.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.345+0000 7f392c987640 1 --2- 10.20.193.58:0/589339468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f392815cfb0 0x7f3928058b10 secure :-1 s=READY pgs=243 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39180098a0 tx=0x7f3918009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:27.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.346+0000 7f391d7fa640 1 -- 10.20.193.58:0/589339468 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3918054410 con 0x7f392815cfb0 2026-02-23T06:34:27.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.346+0000 7f391d7fa640 1 -- 10.20.193.58:0/589339468 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5545 (secure 0 0 0) 0x7f39180423a0 con 0x7f392815cfb0 2026-02-23T06:34:27.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.346+0000 7f391d7fa640 1 -- 10.20.193.58:0/589339468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f392815cfb0 msgr2=0x7f3928058b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:27.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.346+0000 7f391d7fa640 1 --2- 10.20.193.58:0/589339468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f392815cfb0 0x7f3928058b10 secure :-1 s=READY pgs=243 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39180098a0 tx=0x7f3918009310 comp rx=0 tx=0).stop 2026-02-23T06:34:27.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.346+0000 7f391d7fa640 1 -- 10.20.193.58:0/589339468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f392815cfb0 msgr2=0x7f3928058b10 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:34:27.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.346+0000 7f391d7fa640 1 --2- 10.20.193.58:0/589339468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f392815cfb0 0x7f3928058b10 secure :-1 s=CLOSED pgs=243 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39180098a0 tx=0x7f3918009310 comp rx=0 tx=0).stop 2026-02-23T06:34:27.341 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:34:27.341 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:34:27.341 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:34:27.341 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:34:27.341 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 112, 2026-02-23T06:34:27.341 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 541857, 2026-02-23T06:34:27.341 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:34:27.341 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:34:27.341 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:34:27.342 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:27.342 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 1, 2026-02-23T06:34:27.342 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:34:27.342 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:34:27.342 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:34:27.342 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:34:27.342 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:34:27.342 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:34:27.342 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:34:27.342 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:34:27.342 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:34:27.342 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:34:27.342 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:34:27.342 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:34:27.342 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:34:27.342 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:34:27.342 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:34:27.342 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:34:27.342 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:27.342 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:34:27.342 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:34:27.343 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:34:27.343 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:34:27.343 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:34:27.343 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:34:27.343 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:34:27.343 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:34:27.343 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:34:27.343 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:34:27.343 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:34:27.343 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:34:27.343 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:34:27.343 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:34:27.343 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:34:27.343 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:27.343 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:27.343 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:34:27.343 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:34:27.343 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:34:27.343 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:34:27.343 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:34:27.343 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:34:27.343 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:34:27.344 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:34:27.344 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:34:27.344 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:34:27.344 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:34:27.344 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:34:27.344 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:34:27.344 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:34:27.344 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:34:27.344 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:34:27.344 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:34:27.344 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:34:27.344 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:34:27.344 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:34:27.344 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:34:27.344 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:34:27.344 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:34:27.344 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:34:27.344 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:34:27.344 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:34:27.344 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:34:27.344 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:34:27.344 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:34:27.344 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:34:27.344 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:27.345 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:34:27.345 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:27.345 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:34:27.345 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:27.345 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:34:27.345 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:34:27.345 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:34:27.345 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:34:27.345 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:27.345 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:34:27.345 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:34:27.345 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:27.345 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:27.345 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:27.345 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:34:27.345 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:34:27.345 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:27.345 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:27.345 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:27.345 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:27.345 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:34:27.345 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:34:27.345 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:34:27.345 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:34:27.346 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:34:27.346 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:34:27.346 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:27.346 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:27.346 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:34:27.346 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:34:27.346 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:34:27.346 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:34:27.346 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:27.346 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:34:27.346 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:34:27.346 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:27.346 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:27.346 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:27.346 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:34:27.346 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:34:27.346 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:27.346 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:27.346 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:27.346 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:27.346 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:34:27.346 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:34:27.346 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:34:27.346 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:34:27.346 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:34:27.347 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:34:27.347 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:27.347 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:27.347 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:34:27.347 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:34:27.347 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:34:27.347 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:34:27.347 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:27.347 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:34:27.347 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:34:27.347 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:27.347 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:27.347 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:27.347 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:34:27.347 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:34:27.347 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:27.347 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:27.347 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:27.347 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:27.347 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:34:27.347 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:34:27.347 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:34:27.347 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:34:27.347 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:34:27.347 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:34:27.347 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:27.348 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:27.348 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:27.348 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:34:27.348 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:34:27.348 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:27.348 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:34:27.348 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:34:27.348 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:34:27.348 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:27.348 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:27.348 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:34:27.348 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:27.348 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:34:27.348 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:34:27.348 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:34:27.348 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:27.348 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:27.348 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:34:27.348 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:27.348 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:34:27.348 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:34:27.348 INFO:teuthology.orchestra.run.trial058.stdout: "num": 8 2026-02-23T06:34:27.348 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:27.348 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:27.348 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:34:27.348 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:27.349 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:34:27.349 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:34:27.349 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:34:27.349 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:27.349 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:27.349 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:34:27.349 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:34:27.349 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:34:27.349 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:27.349 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:27.349 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:34:27.349 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:27.349 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:34:27.349 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:34:27.349 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:34:27.349 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:27.349 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:27.349 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:27.349 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:34:27.349 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:34:27.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.346+0000 7f392d989640 1 -- 10.20.193.58:0/589339468 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f38f807a660 msgr2=0x7f38f809ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:27.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.346+0000 7f392d989640 1 --2- 10.20.193.58:0/589339468 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f38f807a660 0x7f38f809ab10 secure :-1 s=READY pgs=327 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3928161ea0 tx=0x7f3910005f90 comp rx=0 tx=0).stop 2026-02-23T06:34:27.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.346+0000 7f392d989640 1 -- 10.20.193.58:0/589339468 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f392815c040 msgr2=0x7f39280585d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:27.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.346+0000 7f392d989640 1 --2- 10.20.193.58:0/589339468 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f392815c040 0x7f39280585d0 secure :-1 s=READY pgs=91 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f392400d700 tx=0x7f392400dbd0 comp rx=0 tx=0).stop 2026-02-23T06:34:27.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.346+0000 7f392d188640 1 -- 10.20.193.58:0/589339468 reap_dead start 2026-02-23T06:34:27.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.346+0000 7f392d188640 1 -- 10.20.193.58:0/589339468 reap_dead start 2026-02-23T06:34:27.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.346+0000 7f392d989640 1 -- 10.20.193.58:0/589339468 shutdown_connections 2026-02-23T06:34:27.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.346+0000 7f392d989640 1 -- 10.20.193.58:0/589339468 >> 10.20.193.58:0/589339468 conn(0x7f39280b3c20 msgr2=0x7f392815a460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:27.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.346+0000 7f392d989640 1 -- 10.20.193.58:0/589339468 shutdown_connections 2026-02-23T06:34:27.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:27.346+0000 7f392d989640 1 -- 10.20.193.58:0/589339468 wait complete. 2026-02-23T06:34:27.351 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:34:27.351 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:34:43.443 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:34:43.448 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:34:47.352 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-23T06:34:47.352 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-23T06:34:47.352 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-23T06:34:47.352 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-23T06:34:47.355 INFO:tasks.ceph.mon.b:Started 2026-02-23T06:34:47.355 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:34:47.355 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:34:47.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.482+0000 7f6b4a164640 1 -- 10.20.193.58:0/3579790115 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6b440b6690 msgr2=0x7f6b44058ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:47.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.482+0000 7f6b4a164640 1 --2- 10.20.193.58:0/3579790115 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6b440b6690 0x7f6b44058ec0 secure :-1 s=READY pgs=95 gs=3 cs=0 l=1 c_cookie=2808814548214064262 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b40006f50 tx=0x7f6b40030360 comp rx=0 tx=0).stop 2026-02-23T06:34:47.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.483+0000 7f6b4a164640 1 -- 10.20.193.58:0/3579790115 shutdown_connections 2026-02-23T06:34:47.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.483+0000 7f6b4a164640 1 --2- 10.20.193.58:0/3579790115 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6b440b6690 0x7f6b44058ec0 unknown :-1 s=CLOSED pgs=95 gs=3 cs=0 l=1 c_cookie=2808814548214064262 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:47.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.483+0000 7f6b4a164640 1 -- 10.20.193.58:0/3579790115 >> 10.20.193.58:0/3579790115 conn(0x7f6b440b3c20 msgr2=0x7f6b440b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:47.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.483+0000 7f6b4a164640 1 -- 10.20.193.58:0/3579790115 shutdown_connections 2026-02-23T06:34:47.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.483+0000 7f6b4a164640 1 -- 10.20.193.58:0/3579790115 wait complete. 2026-02-23T06:34:47.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.484+0000 7f6b4a164640 1 Processor -- start 2026-02-23T06:34:47.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.484+0000 7f6b4a164640 1 -- start start 2026-02-23T06:34:47.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.484+0000 7f6b4a164640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6b440b6690 0x7f6b4415edb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:47.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.484+0000 7f6b4a164640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6b4415d4a0 0x7f6b441624f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:47.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.484+0000 7f6b4a164640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6b4415d870 0x7f6b4415a1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:47.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.484+0000 7f6b4a164640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4415e990 con 0x7f6b440b6690 2026-02-23T06:34:47.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.484+0000 7f6b4a164640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4415f2f0 con 0x7f6b4415d870 2026-02-23T06:34:47.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.484+0000 7f6b4a164640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f6b441ff680 con 0x7f6b4415d4a0 2026-02-23T06:34:47.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.485+0000 7f6b49162640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6b440b6690 0x7f6b4415edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:47.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.485+0000 7f6b49162640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6b440b6690 0x7f6b4415edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:56702/0 (socket says 10.20.193.58:56702) 2026-02-23T06:34:47.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.485+0000 7f6b49162640 1 -- 10.20.193.58:0/1983225869 learned_addr learned my addr 10.20.193.58:0/1983225869 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:34:47.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.485+0000 7f6b48961640 1 --2- 10.20.193.58:0/1983225869 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6b4415d4a0 0x7f6b441624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:47.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.485+0000 7f6b49963640 1 --2- 10.20.193.58:0/1983225869 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6b4415d870 0x7f6b4415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:47.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.485+0000 7f6b49162640 1 -- 10.20.193.58:0/1983225869 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6b4415d4a0 msgr2=0x7f6b441624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:47.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.485+0000 7f6b49162640 1 --2- 10.20.193.58:0/1983225869 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6b4415d4a0 0x7f6b441624f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:47.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.485+0000 7f6b49162640 1 -- 10.20.193.58:0/1983225869 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6b4415d870 msgr2=0x7f6b4415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:47.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.485+0000 7f6b49162640 1 --2- 10.20.193.58:0/1983225869 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6b4415d870 0x7f6b4415a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:47.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.485+0000 7f6b49162640 1 -- 10.20.193.58:0/1983225869 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4000a650 con 0x7f6b440b6690 2026-02-23T06:34:47.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.485+0000 7f6b49162640 1 --2- 10.20.193.58:0/1983225869 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6b440b6690 0x7f6b4415edb0 secure :-1 s=READY pgs=96 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b3400c480 tx=0x7f6b3400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:47.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.485+0000 7f6b31ffb640 1 -- 10.20.193.58:0/1983225869 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6b34006ab0 con 0x7f6b440b6690 2026-02-23T06:34:47.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.485+0000 7f6b31ffb640 1 -- 10.20.193.58:0/1983225869 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b34006d00 con 0x7f6b440b6690 2026-02-23T06:34:47.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.485+0000 7f6b4a164640 1 -- 10.20.193.58:0/1983225869 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b441ff3b0 con 0x7f6b440b6690 2026-02-23T06:34:47.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.485+0000 7f6b31ffb640 1 -- 10.20.193.58:0/1983225869 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6b340072b0 con 0x7f6b440b6690 2026-02-23T06:34:47.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.485+0000 7f6b4a164640 1 -- 10.20.193.58:0/1983225869 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b4415e2d0 con 0x7f6b440b6690 2026-02-23T06:34:47.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.486+0000 7f6b4a164640 1 -- 10.20.193.58:0/1983225869 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b440b6d50 con 0x7f6b440b6690 2026-02-23T06:34:47.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.486+0000 7f6b31ffb640 1 -- 10.20.193.58:0/1983225869 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f6b34007410 con 0x7f6b440b6690 2026-02-23T06:34:47.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.486+0000 7f6b31ffb640 1 --2- 10.20.193.58:0/1983225869 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6b1407a6b0 0x7f6b1409ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:47.487 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.486+0000 7f6b31ffb640 1 -- 10.20.193.58:0/1983225869 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f6b3409cda0 con 0x7f6b440b6690 2026-02-23T06:34:47.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.486+0000 7f6b31ffb640 1 -- 10.20.193.58:0/1983225869 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f6b3405feb0 con 0x7f6b440b6690 2026-02-23T06:34:47.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.494+0000 7f6b48961640 1 --2- 10.20.193.58:0/1983225869 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6b1407a6b0 0x7f6b1409ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:47.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.495+0000 7f6b48961640 1 --2- 10.20.193.58:0/1983225869 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6b1407a6b0 0x7f6b1409ab60 secure :-1 s=READY pgs=329 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b44140390 tx=0x7f6b38009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:47.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.646+0000 7f6b4a164640 1 -- 10.20.193.58:0/1983225869 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6b44164250 con 0x7f6b440b6690 2026-02-23T06:34:47.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.646+0000 7f6b31ffb640 1 -- 10.20.193.58:0/1983225869 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f6b34062fd0 con 0x7f6b440b6690 2026-02-23T06:34:47.642 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":118,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:34:47.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.647+0000 7f6b4a164640 1 -- 10.20.193.58:0/1983225869 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6b1407a6b0 msgr2=0x7f6b1409ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:47.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.647+0000 7f6b4a164640 1 --2- 10.20.193.58:0/1983225869 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6b1407a6b0 0x7f6b1409ab60 secure :-1 s=READY pgs=329 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b44140390 tx=0x7f6b38009040 comp rx=0 tx=0).stop 2026-02-23T06:34:47.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.647+0000 7f6b4a164640 1 -- 10.20.193.58:0/1983225869 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6b440b6690 msgr2=0x7f6b4415edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:47.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.647+0000 7f6b4a164640 1 --2- 10.20.193.58:0/1983225869 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6b440b6690 0x7f6b4415edb0 secure :-1 s=READY pgs=96 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b3400c480 tx=0x7f6b3400c950 comp rx=0 tx=0).stop 2026-02-23T06:34:47.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.647+0000 7f6b4a164640 1 -- 10.20.193.58:0/1983225869 shutdown_connections 2026-02-23T06:34:47.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.647+0000 7f6b4a164640 1 --2- 10.20.193.58:0/1983225869 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6b1407a6b0 0x7f6b1409ab60 unknown :-1 s=CLOSED pgs=329 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:47.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.647+0000 7f6b4a164640 1 --2- 10.20.193.58:0/1983225869 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6b4415d870 0x7f6b4415a1e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:47.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.647+0000 7f6b4a164640 1 --2- 10.20.193.58:0/1983225869 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6b4415d4a0 0x7f6b441624f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:47.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.647+0000 7f6b4a164640 1 --2- 10.20.193.58:0/1983225869 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6b440b6690 0x7f6b4415edb0 unknown :-1 s=CLOSED pgs=96 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:47.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.647+0000 7f6b4a164640 1 -- 10.20.193.58:0/1983225869 >> 10.20.193.58:0/1983225869 conn(0x7f6b440b3c20 msgr2=0x7f6b4405c900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:47.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.648+0000 7f6b4a164640 1 -- 10.20.193.58:0/1983225869 shutdown_connections 2026-02-23T06:34:47.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.648+0000 7f6b4a164640 1 -- 10.20.193.58:0/1983225869 wait complete. 2026-02-23T06:34:47.654 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:34:47.655 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:34:47.655 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:34:47.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.783+0000 7ff5aa82f640 1 -- 10.20.193.58:0/549109813 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5a415d870 msgr2=0x7ff5a40587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:47.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.783+0000 7ff5aa82f640 1 --2- 10.20.193.58:0/549109813 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5a415d870 0x7ff5a40587b0 secure :-1 s=READY pgs=97 gs=2 cs=0 l=1 c_cookie=2163523548869973792 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5a40afed0 tx=0x7ff59802f280 comp rx=0 tx=0).stop 2026-02-23T06:34:47.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.783+0000 7ff5aa82f640 1 -- 10.20.193.58:0/549109813 shutdown_connections 2026-02-23T06:34:47.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.783+0000 7ff5aa82f640 1 --2- 10.20.193.58:0/549109813 >> v2:10.20.193.93:3300/0 conn(0x7ff5a40b6690 0x7ff5a4058cf0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:47.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.783+0000 7ff5aa82f640 1 --2- 10.20.193.58:0/549109813 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5a415d870 0x7ff5a40587b0 unknown :-1 s=CLOSED pgs=97 gs=2 cs=0 l=1 c_cookie=2163523548869973792 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:47.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.783+0000 7ff5aa82f640 1 -- 10.20.193.58:0/549109813 >> 10.20.193.58:0/549109813 conn(0x7ff5a40b3c20 msgr2=0x7ff5a40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:47.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.783+0000 7ff5aa82f640 1 -- 10.20.193.58:0/549109813 shutdown_connections 2026-02-23T06:34:47.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.783+0000 7ff5aa82f640 1 -- 10.20.193.58:0/549109813 wait complete. 2026-02-23T06:34:47.782 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.785+0000 7ff5aa82f640 1 Processor -- start 2026-02-23T06:34:47.782 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.785+0000 7ff5aa82f640 1 -- start start 2026-02-23T06:34:47.782 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.785+0000 7ff5aa82f640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5a40b6690 0x7ff5a415dc40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:47.782 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.785+0000 7ff5aa82f640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff5a415d4a0 0x7ff5a415a6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:47.782 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.785+0000 7ff5aa82f640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff5a415d870 0x7ff5a413d650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:47.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.785+0000 7ff5aa82f640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a415ac00 con 0x7ff5a40b6690 2026-02-23T06:34:47.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.785+0000 7ff5aa82f640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a413db90 con 0x7ff5a415d4a0 2026-02-23T06:34:47.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.785+0000 7ff5aa82f640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7ff5a414e760 con 0x7ff5a415d870 2026-02-23T06:34:47.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.786+0000 7ff5a982d640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5a40b6690 0x7ff5a415dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:47.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.786+0000 7ff5a902c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff5a415d4a0 0x7ff5a415a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:47.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.786+0000 7ff5a902c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff5a415d4a0 0x7ff5a415a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:42140/0 (socket says 10.20.193.58:42140) 2026-02-23T06:34:47.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.786+0000 7ff5a982d640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5a40b6690 0x7ff5a415dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:56720/0 (socket says 10.20.193.58:56720) 2026-02-23T06:34:47.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.786+0000 7ff5a902c640 1 -- 10.20.193.58:0/2538215645 learned_addr learned my addr 10.20.193.58:0/2538215645 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:34:47.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.786+0000 7ff5aa02e640 1 --2- 10.20.193.58:0/2538215645 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff5a415d870 0x7ff5a413d650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:47.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.786+0000 7ff5a902c640 1 -- 10.20.193.58:0/2538215645 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff5a415d4a0 msgr2=0x7ff5a415a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-23T06:34:47.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.786+0000 7ff5a902c640 1 -- 10.20.193.58:0/2538215645 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff5a415d4a0 msgr2=0x7ff5a415a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:34:47.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.786+0000 7ff5a902c640 1 --2- 10.20.193.58:0/2538215645 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff5a415d4a0 0x7ff5a415a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:34:47.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.786+0000 7ff5a902c640 1 --2- 10.20.193.58:0/2538215645 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff5a415d4a0 0x7ff5a415a6c0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:34:47.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.786+0000 7ff5a982d640 1 -- 10.20.193.58:0/2538215645 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff5a415d870 msgr2=0x7ff5a413d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:47.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.786+0000 7ff5a982d640 1 --2- 10.20.193.58:0/2538215645 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff5a415d870 0x7ff5a413d650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:47.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.786+0000 7ff5a982d640 1 -- 10.20.193.58:0/2538215645 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff5a415d4a0 msgr2=0x7ff5a415a6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:34:47.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.786+0000 7ff5a982d640 1 --2- 10.20.193.58:0/2538215645 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff5a415d4a0 0x7ff5a415a6c0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:47.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.786+0000 7ff5a982d640 1 -- 10.20.193.58:0/2538215645 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff598009570 con 0x7ff5a40b6690 2026-02-23T06:34:47.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.786+0000 7ff5a982d640 1 --2- 10.20.193.58:0/2538215645 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5a40b6690 0x7ff5a415dc40 secure :-1 s=READY pgs=98 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff59400b400 tx=0x7ff59400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:47.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.786+0000 7ff5927fc640 1 -- 10.20.193.58:0/2538215645 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff5940044a0 con 0x7ff5a40b6690 2026-02-23T06:34:47.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.786+0000 7ff5aa82f640 1 -- 10.20.193.58:0/2538215645 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5a414db50 con 0x7ff5a40b6690 2026-02-23T06:34:47.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.786+0000 7ff5927fc640 1 -- 10.20.193.58:0/2538215645 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff594002740 con 0x7ff5a40b6690 2026-02-23T06:34:47.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.786+0000 7ff5927fc640 1 -- 10.20.193.58:0/2538215645 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff594002b70 con 0x7ff5a40b6690 2026-02-23T06:34:47.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.786+0000 7ff5aa82f640 1 -- 10.20.193.58:0/2538215645 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5a414e110 con 0x7ff5a40b6690 2026-02-23T06:34:47.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.787+0000 7ff5aa82f640 1 --2- 10.20.193.58:0/2538215645 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5a414e330 0x7ff5a413b390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:47.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.787+0000 7ff5aa82f640 1 -- 10.20.193.58:0/2538215645 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a40b6330 con 0x7ff5a414e330 2026-02-23T06:34:47.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.787+0000 7ff5a902c640 1 --2- 10.20.193.58:0/2538215645 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5a414e330 0x7ff5a413b390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:47.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.787+0000 7ff5a902c640 1 -- 10.20.193.58:0/2538215645 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff5a40b5e10 con 0x7ff5a414e330 2026-02-23T06:34:47.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.787+0000 7ff5a902c640 1 --2- 10.20.193.58:0/2538215645 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5a414e330 0x7ff5a413b390 secure :-1 s=READY pgs=99 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5980023d0 tx=0x7ff5980026a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:47.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.788+0000 7ff5927fc640 1 -- 10.20.193.58:0/2538215645 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff598002d50 con 0x7ff5a414e330 2026-02-23T06:34:47.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.788+0000 7ff5927fc640 1 -- 10.20.193.58:0/2538215645 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7ff598004850 con 0x7ff5a414e330 2026-02-23T06:34:47.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.788+0000 7ff5927fc640 1 -- 10.20.193.58:0/2538215645 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5a414e330 msgr2=0x7ff5a413b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:47.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.788+0000 7ff5927fc640 1 --2- 10.20.193.58:0/2538215645 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5a414e330 0x7ff5a413b390 secure :-1 s=READY pgs=99 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5980023d0 tx=0x7ff5980026a0 comp rx=0 tx=0).stop 2026-02-23T06:34:47.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.788+0000 7ff5927fc640 1 -- 10.20.193.58:0/2538215645 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5a414e330 msgr2=0x7ff5a413b390 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:34:47.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.788+0000 7ff5927fc640 1 --2- 10.20.193.58:0/2538215645 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5a414e330 0x7ff5a413b390 unknown :-1 s=CLOSED pgs=99 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:47.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.790+0000 7ff5927fc640 1 -- 10.20.193.58:0/2538215645 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7ff594002cd0 con 0x7ff5a40b6690 2026-02-23T06:34:47.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.790+0000 7ff5927fc640 1 --2- 10.20.193.58:0/2538215645 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff57407a3c0 0x7ff57409a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:47.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.790+0000 7ff5927fc640 1 -- 10.20.193.58:0/2538215645 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7ff59409cbe0 con 0x7ff5a40b6690 2026-02-23T06:34:47.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.791+0000 7ff5a902c640 1 --2- 10.20.193.58:0/2538215645 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff57407a3c0 0x7ff57409a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:47.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.791+0000 7ff5aa82f640 1 --2- 10.20.193.58:0/2538215645 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5a413b8d0 0x7ff5a413e330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:47.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.791+0000 7ff5aa82f640 1 -- 10.20.193.58:0/2538215645 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a414e8a0 con 0x7ff5a413b8d0 2026-02-23T06:34:47.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.791+0000 7ff5aa02e640 1 --2- 10.20.193.58:0/2538215645 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5a413b8d0 0x7ff5a413e330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:47.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.791+0000 7ff5a902c640 1 --2- 10.20.193.58:0/2538215645 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff57407a3c0 0x7ff57409a870 secure :-1 s=READY pgs=330 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5980023d0 tx=0x7ff59803a030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:47.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.792+0000 7ff5aa02e640 1 -- 10.20.193.58:0/2538215645 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff5a413bca0 con 0x7ff5a413b8d0 2026-02-23T06:34:47.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.792+0000 7ff5aa02e640 1 --2- 10.20.193.58:0/2538215645 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5a413b8d0 0x7ff5a413e330 secure :-1 s=READY pgs=100 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5a000a570 tx=0x7ff5a000aa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:47.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.792+0000 7ff5927fc640 1 -- 10.20.193.58:0/2538215645 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff5a000f940 con 0x7ff5a413b8d0 2026-02-23T06:34:47.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.792+0000 7ff5927fc640 1 -- 10.20.193.58:0/2538215645 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4913 (secure 0 0 0) 0x7ff5a000faa0 con 0x7ff5a413b8d0 2026-02-23T06:34:47.789 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:34:47.789 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:34:47.789 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:34:47.789 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:34:47.789 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 118, 2026-02-23T06:34:47.789 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 95304, 2026-02-23T06:34:47.790 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:34:47.790 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:34:47.790 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:34:47.790 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:34:47.790 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:47.790 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:34:47.790 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:34:47.790 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:34:47.790 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:34:47.790 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:34:47.790 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:34:47.791 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:34:47.791 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:34:47.791 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:34:47.791 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:34:47.791 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:34:47.791 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:34:47.791 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:34:47.791 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:34:47.791 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:34:47.791 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:34:47.791 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:34:47.791 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:47.791 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:34:47.792 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:34:47.792 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:34:47.792 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:34:47.792 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:34:47.792 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:34:47.792 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:34:47.792 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:34:47.792 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:34:47.792 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:34:47.792 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:34:47.792 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:34:47.792 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:34:47.793 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:34:47.793 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:34:47.793 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:47.793 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:47.793 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:34:47.793 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:34:47.793 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:34:47.793 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:34:47.793 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:34:47.793 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:34:47.793 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:34:47.794 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:34:47.794 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:34:47.794 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:34:47.794 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:34:47.794 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:34:47.794 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:34:47.794 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:34:47.794 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:34:47.794 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:34:47.794 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:34:47.794 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:34:47.794 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:34:47.794 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:34:47.795 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:34:47.795 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:34:47.795 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:34:47.795 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:34:47.795 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:34:47.795 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:34:47.795 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:34:47.795 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:34:47.795 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:34:47.795 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:34:47.795 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:47.795 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:34:47.796 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:47.796 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:34:47.796 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:47.796 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:34:47.796 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:34:47.796 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:34:47.796 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:34:47.796 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:47.796 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:34:47.796 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:34:47.796 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:47.796 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:47.796 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:47.797 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:34:47.797 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:34:47.797 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:47.797 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:47.797 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:47.797 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:47.797 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:34:47.797 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:34:47.797 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:34:47.797 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:34:47.797 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:34:47.797 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:34:47.798 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:47.798 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:47.798 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:34:47.798 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:34:47.798 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:34:47.798 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:34:47.798 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:47.798 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:34:47.798 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:34:47.798 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:47.798 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:47.798 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:47.799 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:34:47.799 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:34:47.799 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:47.799 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:47.799 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:47.799 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:47.799 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:34:47.799 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:34:47.799 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:34:47.799 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:34:47.799 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:34:47.799 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:34:47.800 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:47.800 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:47.800 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:34:47.800 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:34:47.800 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:34:47.800 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:34:47.800 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:47.800 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:34:47.800 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:34:47.800 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:47.800 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:47.800 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:47.800 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:34:47.801 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:34:47.801 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:47.801 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:47.801 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:47.801 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:47.801 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:34:47.801 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:34:47.801 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:34:47.801 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:34:47.801 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:34:47.801 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:34:47.801 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:47.802 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:47.802 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:47.802 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:34:47.802 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:34:47.802 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:47.802 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:34:47.802 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:34:47.802 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:34:47.802 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:47.802 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:47.802 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:34:47.802 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:47.803 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:34:47.803 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:34:47.803 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:34:47.803 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:47.803 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:47.803 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:47.803 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:34:47.803 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:34:47.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.792+0000 7ff5927fc640 1 -- 10.20.193.58:0/2538215645 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5a413b8d0 msgr2=0x7ff5a413e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:47.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.792+0000 7ff5927fc640 1 --2- 10.20.193.58:0/2538215645 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5a413b8d0 0x7ff5a413e330 secure :-1 s=READY pgs=100 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5a000a570 tx=0x7ff5a000aa40 comp rx=0 tx=0).stop 2026-02-23T06:34:47.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.792+0000 7ff5927fc640 1 -- 10.20.193.58:0/2538215645 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5a413b8d0 msgr2=0x7ff5a413e330 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:34:47.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.792+0000 7ff5927fc640 1 --2- 10.20.193.58:0/2538215645 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5a413b8d0 0x7ff5a413e330 unknown :-1 s=CLOSED pgs=100 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:47.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.792+0000 7ff5aa82f640 1 -- 10.20.193.58:0/2538215645 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff57407a3c0 msgr2=0x7ff57409a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:47.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.792+0000 7ff5aa82f640 1 --2- 10.20.193.58:0/2538215645 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff57407a3c0 0x7ff57409a870 secure :-1 s=READY pgs=330 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5980023d0 tx=0x7ff59803a030 comp rx=0 tx=0).stop 2026-02-23T06:34:47.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.792+0000 7ff5aa82f640 1 -- 10.20.193.58:0/2538215645 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5a40b6690 msgr2=0x7ff5a415dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:47.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.792+0000 7ff5aa82f640 1 --2- 10.20.193.58:0/2538215645 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5a40b6690 0x7ff5a415dc40 secure :-1 s=READY pgs=98 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff59400b400 tx=0x7ff59400b8d0 comp rx=0 tx=0).stop 2026-02-23T06:34:47.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.792+0000 7ff5aa02e640 1 -- 10.20.193.58:0/2538215645 reap_dead start 2026-02-23T06:34:47.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.792+0000 7ff5aa02e640 1 -- 10.20.193.58:0/2538215645 reap_dead start 2026-02-23T06:34:47.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.792+0000 7ff5aa82f640 1 -- 10.20.193.58:0/2538215645 shutdown_connections 2026-02-23T06:34:47.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.792+0000 7ff5aa82f640 1 -- 10.20.193.58:0/2538215645 >> 10.20.193.58:0/2538215645 conn(0x7ff5a40b3c20 msgr2=0x7ff5a405c970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:47.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.792+0000 7ff5aa82f640 1 -- 10.20.193.58:0/2538215645 shutdown_connections 2026-02-23T06:34:47.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.793+0000 7ff5aa82f640 1 -- 10.20.193.58:0/2538215645 wait complete. 2026-02-23T06:34:47.806 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:34:47.807 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:34:47.807 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:34:47.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.934+0000 7f74a7577640 1 -- 10.20.193.58:0/834344188 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f74a80b6690 msgr2=0x7f74a8058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:47.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.934+0000 7f74a7577640 1 --2- 10.20.193.58:0/834344188 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f74a80b6690 0x7f74a8058cf0 secure :-1 s=READY pgs=246 gs=3 cs=0 l=1 c_cookie=1747495314853788565 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7498005820 tx=0x7f74980302b0 comp rx=0 tx=0).stop 2026-02-23T06:34:47.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.934+0000 7f74a7577640 1 -- 10.20.193.58:0/834344188 shutdown_connections 2026-02-23T06:34:47.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.934+0000 7f74a7577640 1 --2- 10.20.193.58:0/834344188 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f74a80b6690 0x7f74a8058cf0 unknown :-1 s=CLOSED pgs=246 gs=3 cs=0 l=1 c_cookie=1747495314853788565 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:47.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.934+0000 7f74a7577640 1 --2- 10.20.193.58:0/834344188 >> v2:10.20.193.58:3300/0 conn(0x7f74a815d870 0x7f74a80587b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:47.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.934+0000 7f74a7577640 1 -- 10.20.193.58:0/834344188 >> 10.20.193.58:0/834344188 conn(0x7f74a80b3c20 msgr2=0x7f74a80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:47.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.934+0000 7f74a7577640 1 -- 10.20.193.58:0/834344188 shutdown_connections 2026-02-23T06:34:47.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.934+0000 7f74a7577640 1 -- 10.20.193.58:0/834344188 wait complete. 2026-02-23T06:34:47.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.935+0000 7f74a7577640 1 Processor -- start 2026-02-23T06:34:47.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.935+0000 7f74a7577640 1 -- start start 2026-02-23T06:34:47.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.936+0000 7f74a7577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f74a80b6690 0x7f74a813f070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:47.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.936+0000 7f74a7577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f74a815d4a0 0x7f74a81fe610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:47.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.936+0000 7f74a7577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a815d870 0x7f74a815a5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:47.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.936+0000 7f74a7577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f74a81fdc00 con 0x7f74a815d4a0 2026-02-23T06:34:47.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.936+0000 7f74a7577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f74a813cd00 con 0x7f74a815d870 2026-02-23T06:34:47.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.936+0000 7f74a7577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f74a813c7d0 con 0x7f74a80b6690 2026-02-23T06:34:47.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.936+0000 7f74a6575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f74a80b6690 0x7f74a813f070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:47.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.936+0000 7f74a6575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f74a80b6690 0x7f74a813f070 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:39260/0 (socket says 10.20.193.58:39260) 2026-02-23T06:34:47.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.936+0000 7f74a6575640 1 -- 10.20.193.58:0/3138894056 learned_addr learned my addr 10.20.193.58:0/3138894056 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:34:47.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.936+0000 7f74a5d74640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f74a815d4a0 0x7f74a81fe610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:47.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.936+0000 7f74a6d76640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a815d870 0x7f74a815a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:47.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.936+0000 7f74a6575640 1 -- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a815d870 msgr2=0x7f74a815a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:47.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.936+0000 7f74a6575640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a815d870 0x7f74a815a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:47.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.936+0000 7f74a6575640 1 -- 10.20.193.58:0/3138894056 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f74a815d4a0 msgr2=0x7f74a81fe610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:47.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.936+0000 7f74a6575640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f74a815d4a0 0x7f74a81fe610 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:47.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.936+0000 7f74a6575640 1 -- 10.20.193.58:0/3138894056 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f749800a590 con 0x7f74a80b6690 2026-02-23T06:34:47.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.936+0000 7f74a5d74640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f74a815d4a0 0x7f74a81fe610 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:34:47.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.937+0000 7f74a6575640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f74a80b6690 0x7f74a813f070 secure :-1 s=READY pgs=247 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f749c00c4d0 tx=0x7f749c00c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:47.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.937+0000 7f748effd640 1 -- 10.20.193.58:0/3138894056 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f749c004250 con 0x7f74a80b6690 2026-02-23T06:34:47.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.937+0000 7f748effd640 1 -- 10.20.193.58:0/3138894056 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f749c0044a0 con 0x7f74a80b6690 2026-02-23T06:34:47.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.937+0000 7f748effd640 1 -- 10.20.193.58:0/3138894056 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f749c006b10 con 0x7f74a80b6690 2026-02-23T06:34:47.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.937+0000 7f74a7577640 1 -- 10.20.193.58:0/3138894056 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74a81fe180 con 0x7f74a80b6690 2026-02-23T06:34:47.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.937+0000 7f74a7577640 1 -- 10.20.193.58:0/3138894056 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f74a8201c00 con 0x7f74a80b6690 2026-02-23T06:34:47.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.937+0000 7f74a7577640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 0x7f74a805c3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:47.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.937+0000 7f74a7577640 1 -- 10.20.193.58:0/3138894056 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f74a80b6330 con 0x7f74a8139f90 2026-02-23T06:34:47.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.938+0000 7f74a5d74640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 0x7f74a805c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:47.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.938+0000 7f74a5d74640 1 -- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 msgr2=0x7f74a805c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-23T06:34:47.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.938+0000 7f74a5d74640 1 -- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 msgr2=0x7f74a805c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:34:47.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.938+0000 7f74a5d74640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 0x7f74a805c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:34:47.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.938+0000 7f74a5d74640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 0x7f74a805c3c0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:34:47.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.939+0000 7f748effd640 1 -- 10.20.193.58:0/3138894056 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f749c003670 con 0x7f74a80b6690 2026-02-23T06:34:47.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.939+0000 7f748effd640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f747407a6c0 0x7f747409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:47.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.939+0000 7f748effd640 1 -- 10.20.193.58:0/3138894056 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f749c09cf70 con 0x7f74a80b6690 2026-02-23T06:34:47.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.940+0000 7f74a6d76640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f747407a6c0 0x7f747409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:47.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:47.940+0000 7f74a6d76640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f747407a6c0 0x7f747409ab70 secure :-1 s=READY pgs=331 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f749800a8c0 tx=0x7f7498032040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:48.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:48.138+0000 7f74a5d74640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 0x7f74a805c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:48.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:48.138+0000 7f74a5d74640 1 -- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 msgr2=0x7f74a805c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:34:48.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:48.138+0000 7f74a5d74640 1 -- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 msgr2=0x7f74a805c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:34:48.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:48.138+0000 7f74a5d74640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 0x7f74a805c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:34:48.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:48.138+0000 7f74a5d74640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 0x7f74a805c3c0 unknown :-1 s=START_CONNECT pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-23T06:34:48.534 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:48.539+0000 7f74a5d74640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 0x7f74a805c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:48.535 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:48.539+0000 7f74a5d74640 1 -- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 msgr2=0x7f74a805c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:34:48.535 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:48.539+0000 7f74a5d74640 1 -- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 msgr2=0x7f74a805c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:34:48.535 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:48.539+0000 7f74a5d74640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 0x7f74a805c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:34:48.535 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:48.539+0000 7f74a5d74640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 0x7f74a805c3c0 unknown :-1 s=START_CONNECT pgs=0 gs=10 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-23T06:34:49.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:49.340+0000 7f74a5d74640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 0x7f74a805c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=11 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:49.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:49.341+0000 7f74a5d74640 1 -- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 msgr2=0x7f74a805c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:34:49.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:49.341+0000 7f74a5d74640 1 -- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 msgr2=0x7f74a805c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:34:49.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:49.341+0000 7f74a5d74640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 0x7f74a805c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=11 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:34:49.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:49.341+0000 7f74a5d74640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 0x7f74a805c3c0 unknown :-1 s=START_CONNECT pgs=0 gs=12 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-23T06:34:50.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:50.947+0000 7f74a5d74640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 0x7f74a805c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=13 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:50.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:50.947+0000 7f74a5d74640 1 -- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 msgr2=0x7f74a805c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:34:50.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:50.947+0000 7f74a5d74640 1 -- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 msgr2=0x7f74a805c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:34:50.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:50.947+0000 7f74a5d74640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 0x7f74a805c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=13 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:34:50.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:50.947+0000 7f74a5d74640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 0x7f74a805c3c0 unknown :-1 s=START_CONNECT pgs=0 gs=14 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2026-02-23T06:34:51.931 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:51.936+0000 7f748dffb640 1 -- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 msgr2=0x7f74a805c3c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:34:51.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:51.936+0000 7f748dffb640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 0x7f74a805c3c0 unknown :-1 s=START_CONNECT pgs=0 gs=14 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:51.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:51.936+0000 7f748dffb640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f746c003600 0x7f746c023a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:51.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:51.936+0000 7f748dffb640 1 -- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 msgr2=0x7f74a805c3c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:34:51.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:51.936+0000 7f748dffb640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a8139f90 0x7f74a805c3c0 unknown :-1 s=CLOSED pgs=0 gs=14 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:51.932 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:51.936+0000 7f748dffb640 1 -- 10.20.193.58:0/3138894056 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f74a80b6330 con 0x7f746c003600 2026-02-23T06:34:51.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:51.939+0000 7f74a5d74640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f746c003600 0x7f746c023a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=15 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:51.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:51.939+0000 7f74a5d74640 1 -- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f746c003600 msgr2=0x7f746c023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:34:51.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:51.939+0000 7f74a5d74640 1 -- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f746c003600 msgr2=0x7f746c023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:34:51.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:51.939+0000 7f74a5d74640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f746c003600 0x7f746c023a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=15 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:34:51.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:51.939+0000 7f74a5d74640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f746c003600 0x7f746c023a80 unknown :-1 s=START_CONNECT pgs=0 gs=16 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:34:52.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.139+0000 7f74a5d74640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f746c003600 0x7f746c023a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=17 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:52.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.139+0000 7f74a5d74640 1 -- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f746c003600 msgr2=0x7f746c023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:34:52.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.139+0000 7f74a5d74640 1 -- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f746c003600 msgr2=0x7f746c023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:34:52.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.139+0000 7f74a5d74640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f746c003600 0x7f746c023a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=17 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:34:52.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.139+0000 7f74a5d74640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f746c003600 0x7f746c023a80 unknown :-1 s=START_CONNECT pgs=0 gs=18 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-23T06:34:52.535 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.540+0000 7f74a5d74640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f746c003600 0x7f746c023a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=19 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:52.536 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.540+0000 7f74a5d74640 1 -- 10.20.193.58:0/3138894056 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f746c024160 con 0x7f746c003600 2026-02-23T06:34:52.536 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.541+0000 7f74a5d74640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f746c003600 0x7f746c023a80 secure :-1 s=READY pgs=4 gs=19 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74a805d0b0 tx=0x7f7490010800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:52.536 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.541+0000 7f748effd640 1 -- 10.20.193.58:0/3138894056 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7490015070 con 0x7f746c003600 2026-02-23T06:34:52.536 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.541+0000 7f748effd640 1 -- 10.20.193.58:0/3138894056 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f7490004a70 con 0x7f746c003600 2026-02-23T06:34:52.536 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.541+0000 7f748effd640 1 -- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f746c003600 msgr2=0x7f746c023a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:52.536 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.541+0000 7f748effd640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f746c003600 0x7f746c023a80 secure :-1 s=READY pgs=4 gs=19 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74a805d0b0 tx=0x7f7490010800 comp rx=0 tx=0).stop 2026-02-23T06:34:52.536 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.541+0000 7f748effd640 1 -- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f746c003600 msgr2=0x7f746c023a80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:34:52.536 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.541+0000 7f748effd640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f746c003600 0x7f746c023a80 secure :-1 s=CLOSED pgs=4 gs=19 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74a805d0b0 tx=0x7f7490010800 comp rx=0 tx=0).stop 2026-02-23T06:34:52.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.545+0000 7f74a7577640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a81fdd70 0x7f74a805c900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:52.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.545+0000 7f74a7577640 1 -- 10.20.193.58:0/3138894056 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f74a80b6d50 con 0x7f74a81fdd70 2026-02-23T06:34:52.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.545+0000 7f74a5d74640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a81fdd70 0x7f74a805c900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=20 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:52.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.545+0000 7f74a5d74640 1 -- 10.20.193.58:0/3138894056 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f74a80b06c0 con 0x7f74a81fdd70 2026-02-23T06:34:52.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.545+0000 7f74a5d74640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a81fdd70 0x7f74a805c900 secure :-1 s=READY pgs=5 gs=20 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f746c024130 tx=0x7f74900047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:52.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.546+0000 7f748effd640 1 -- 10.20.193.58:0/3138894056 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7490023070 con 0x7f74a81fdd70 2026-02-23T06:34:52.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.546+0000 7f748effd640 1 -- 10.20.193.58:0/3138894056 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4910 (secure 0 0 0) 0x7f749001e3a0 con 0x7f74a81fdd70 2026-02-23T06:34:52.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.546+0000 7f748effd640 1 -- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a81fdd70 msgr2=0x7f74a805c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:52.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.546+0000 7f748effd640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a81fdd70 0x7f74a805c900 secure :-1 s=READY pgs=5 gs=20 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f746c024130 tx=0x7f74900047e0 comp rx=0 tx=0).stop 2026-02-23T06:34:52.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.546+0000 7f748effd640 1 -- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a81fdd70 msgr2=0x7f74a805c900 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:34:52.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.546+0000 7f748effd640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f74a81fdd70 0x7f74a805c900 unknown :-1 s=CLOSED pgs=5 gs=20 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:52.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.546+0000 7f74a6d76640 1 -- 10.20.193.58:0/3138894056 reap_dead start 2026-02-23T06:34:52.541 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:34:52.541 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:34:52.541 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:34:52.541 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:34:52.541 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 118, 2026-02-23T06:34:52.541 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 5129, 2026-02-23T06:34:52.541 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:34:52.542 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:34:52.542 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:34:52.542 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:34:52.542 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:52.542 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 5, 2026-02-23T06:34:52.542 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:34:52.542 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:34:52.542 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:34:52.542 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:34:52.542 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:34:52.542 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:34:52.542 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:34:52.542 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:34:52.542 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:34:52.542 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:34:52.542 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:34:52.542 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:34:52.542 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:34:52.542 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:34:52.542 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:34:52.542 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:34:52.542 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:52.542 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:34:52.542 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:34:52.543 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:34:52.543 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:34:52.543 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:34:52.543 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:34:52.543 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:34:52.543 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:34:52.543 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:34:52.543 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:34:52.543 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:34:52.543 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:34:52.543 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:34:52.543 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:34:52.543 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:34:52.543 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:52.543 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:52.543 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:34:52.543 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:34:52.543 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:34:52.543 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:34:52.543 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:34:52.543 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:34:52.543 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:34:52.543 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:34:52.544 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:34:52.544 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:34:52.544 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:34:52.544 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:34:52.544 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:34:52.544 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:34:52.544 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:34:52.544 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:34:52.544 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:34:52.544 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:34:52.544 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:34:52.544 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:34:52.544 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:34:52.544 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:34:52.544 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:34:52.544 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:34:52.544 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:34:52.544 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:34:52.544 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:34:52.544 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:34:52.544 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:34:52.544 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:34:52.544 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:52.544 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:34:52.545 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:52.545 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:34:52.545 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:52.545 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:34:52.545 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:34:52.545 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:34:52.545 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:34:52.545 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:52.545 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:34:52.545 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:34:52.545 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:52.545 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:52.545 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:52.545 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:34:52.545 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:34:52.545 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:52.545 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:52.545 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:52.545 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:52.545 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:34:52.545 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:34:52.545 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:34:52.545 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:34:52.545 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:34:52.545 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:34:52.546 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:52.546 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:52.546 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:34:52.546 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:34:52.546 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:34:52.546 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:34:52.546 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:52.546 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:34:52.546 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:34:52.546 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:52.546 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:52.546 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:52.546 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:34:52.546 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:34:52.546 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:52.546 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:52.546 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:52.546 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:52.546 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:34:52.546 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:34:52.546 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:34:52.546 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:34:52.546 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:34:52.546 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:34:52.546 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:52.547 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:52.547 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:34:52.547 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:34:52.547 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:34:52.547 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:34:52.547 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:52.547 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:34:52.547 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:34:52.547 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:52.547 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:52.547 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:52.547 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:34:52.547 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:34:52.547 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:52.547 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:52.547 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:52.547 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:52.547 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:34:52.547 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:34:52.547 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:34:52.547 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:34:52.547 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:34:52.547 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:34:52.547 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:52.548 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:52.548 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:52.548 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:34:52.548 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:34:52.548 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:52.548 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:34:52.548 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:34:52.548 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:34:52.548 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:52.548 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:52.548 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:34:52.548 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:52.548 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:34:52.548 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:34:52.548 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:34:52.548 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:52.548 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:52.548 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:52.548 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:34:52.548 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:34:52.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.546+0000 7f74a7577640 1 -- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f747407a6c0 msgr2=0x7f747409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:52.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.546+0000 7f74a7577640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f747407a6c0 0x7f747409ab70 secure :-1 s=READY pgs=331 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f749800a8c0 tx=0x7f7498032040 comp rx=0 tx=0).stop 2026-02-23T06:34:52.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.546+0000 7f74a7577640 1 -- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f74a80b6690 msgr2=0x7f74a813f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:52.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.546+0000 7f74a7577640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f74a80b6690 0x7f74a813f070 secure :-1 s=READY pgs=247 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f749c00c4d0 tx=0x7f749c00c9a0 comp rx=0 tx=0).stop 2026-02-23T06:34:52.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.546+0000 7f74a7577640 1 -- 10.20.193.58:0/3138894056 shutdown_connections 2026-02-23T06:34:52.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.546+0000 7f74a7577640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f747407a6c0 0x7f747409ab70 unknown :-1 s=CLOSED pgs=331 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:52.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.546+0000 7f74a7577640 1 --2- 10.20.193.58:0/3138894056 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f74a80b6690 0x7f74a813f070 unknown :-1 s=CLOSED pgs=247 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:52.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.546+0000 7f74a7577640 1 -- 10.20.193.58:0/3138894056 >> 10.20.193.58:0/3138894056 conn(0x7f74a80b3c20 msgr2=0x7f74a805bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:52.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.546+0000 7f74a7577640 1 -- 10.20.193.58:0/3138894056 shutdown_connections 2026-02-23T06:34:52.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.546+0000 7f74a7577640 1 -- 10.20.193.58:0/3138894056 wait complete. 2026-02-23T06:34:52.552 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:34:52.553 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:34:52.553 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:34:52.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.680+0000 7f88f8c83640 1 -- 10.20.193.58:0/2952700393 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f88f40b6690 msgr2=0x7f88f4058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:52.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.680+0000 7f88f8c83640 1 --2- 10.20.193.58:0/2952700393 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f88f40b6690 0x7f88f4058cf0 secure :-1 s=READY pgs=6 gs=3 cs=0 l=1 c_cookie=14607675864037941845 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88f40afed0 tx=0x7f88e8030270 comp rx=0 tx=0).stop 2026-02-23T06:34:52.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.680+0000 7f88f8c83640 1 -- 10.20.193.58:0/2952700393 shutdown_connections 2026-02-23T06:34:52.676 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.680+0000 7f88f8c83640 1 --2- 10.20.193.58:0/2952700393 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f88f40b6690 0x7f88f4058cf0 unknown :-1 s=CLOSED pgs=6 gs=3 cs=0 l=1 c_cookie=14607675864037941845 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:52.676 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.680+0000 7f88f8c83640 1 --2- 10.20.193.58:0/2952700393 >> v2:10.20.193.58:3300/0 conn(0x7f88f415d870 0x7f88f40587b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:52.676 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.680+0000 7f88f8c83640 1 -- 10.20.193.58:0/2952700393 >> 10.20.193.58:0/2952700393 conn(0x7f88f40b3c20 msgr2=0x7f88f40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:52.676 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.680+0000 7f88f8c83640 1 -- 10.20.193.58:0/2952700393 shutdown_connections 2026-02-23T06:34:52.676 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.680+0000 7f88f8c83640 1 -- 10.20.193.58:0/2952700393 wait complete. 2026-02-23T06:34:52.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.681+0000 7f88f8c83640 1 Processor -- start 2026-02-23T06:34:52.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.681+0000 7f88f8c83640 1 -- start start 2026-02-23T06:34:52.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.682+0000 7f88f8c83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f88f40b6690 0x7f88f4127a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:52.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.682+0000 7f88f8c83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f88f415d4a0 0x7f88f4057170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:52.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.682+0000 7f88f8c83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88f415d870 0x7f88f40576b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:52.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.682+0000 7f88f8c83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f88f413e130 con 0x7f88f40b6690 2026-02-23T06:34:52.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.682+0000 7f88f8c83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f88f413ede0 con 0x7f88f415d4a0 2026-02-23T06:34:52.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.682+0000 7f88f8c83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f88f413e6a0 con 0x7f88f415d870 2026-02-23T06:34:52.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.682+0000 7f88f37fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f88f40b6690 0x7f88f4127a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:52.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.682+0000 7f88f2ffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f88f415d4a0 0x7f88f4057170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:52.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.682+0000 7f88f37fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f88f40b6690 0x7f88f4127a40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:39686/0 (socket says 10.20.193.58:39686) 2026-02-23T06:34:52.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.682+0000 7f88f37fe640 1 -- 10.20.193.58:0/574573390 learned_addr learned my addr 10.20.193.58:0/574573390 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:34:52.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.682+0000 7f88f3fff640 1 --2- 10.20.193.58:0/574573390 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88f415d870 0x7f88f40576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:52.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.682+0000 7f88f37fe640 1 -- 10.20.193.58:0/574573390 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88f415d870 msgr2=0x7f88f40576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:52.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.682+0000 7f88f37fe640 1 --2- 10.20.193.58:0/574573390 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88f415d870 0x7f88f40576b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:52.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.682+0000 7f88f37fe640 1 -- 10.20.193.58:0/574573390 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f88f415d4a0 msgr2=0x7f88f4057170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:52.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.682+0000 7f88f37fe640 1 --2- 10.20.193.58:0/574573390 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f88f415d4a0 0x7f88f4057170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:52.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.682+0000 7f88f37fe640 1 -- 10.20.193.58:0/574573390 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e800a590 con 0x7f88f40b6690 2026-02-23T06:34:52.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.682+0000 7f88f3fff640 1 --2- 10.20.193.58:0/574573390 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88f415d870 0x7f88f40576b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:34:52.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.682+0000 7f88f37fe640 1 --2- 10.20.193.58:0/574573390 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f88f40b6690 0x7f88f4127a40 secure :-1 s=READY pgs=103 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88e0007fd0 tx=0x7f88e000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:52.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.682+0000 7f88cffff640 1 -- 10.20.193.58:0/574573390 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f88e0012850 con 0x7f88f40b6690 2026-02-23T06:34:52.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.683+0000 7f88cffff640 1 -- 10.20.193.58:0/574573390 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f88e0012aa0 con 0x7f88f40b6690 2026-02-23T06:34:52.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.683+0000 7f88cffff640 1 -- 10.20.193.58:0/574573390 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f88e0012e50 con 0x7f88f40b6690 2026-02-23T06:34:52.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.683+0000 7f88f8c83640 1 -- 10.20.193.58:0/574573390 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88f413d3d0 con 0x7f88f40b6690 2026-02-23T06:34:52.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.683+0000 7f88f8c83640 1 -- 10.20.193.58:0/574573390 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88f4128690 con 0x7f88f40b6690 2026-02-23T06:34:52.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.684+0000 7f88f8c83640 1 --2- 10.20.193.58:0/574573390 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88f413db10 0x7f88f4150af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:52.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.684+0000 7f88f8c83640 1 -- 10.20.193.58:0/574573390 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f88f413d560 con 0x7f88f413db10 2026-02-23T06:34:52.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.684+0000 7f88f2ffd640 1 --2- 10.20.193.58:0/574573390 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88f413db10 0x7f88f4150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:52.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.684+0000 7f88f2ffd640 1 -- 10.20.193.58:0/574573390 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f88f40b6330 con 0x7f88f413db10 2026-02-23T06:34:52.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.685+0000 7f88f2ffd640 1 --2- 10.20.193.58:0/574573390 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88f413db10 0x7f88f4150af0 secure :-1 s=READY pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88f4127500 tx=0x7f88e4009ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:52.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.685+0000 7f88cffff640 1 -- 10.20.193.58:0/574573390 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f88e4011920 con 0x7f88f413db10 2026-02-23T06:34:52.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.685+0000 7f88cffff640 1 -- 10.20.193.58:0/574573390 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f88e0022020 con 0x7f88f40b6690 2026-02-23T06:34:52.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.686+0000 7f88cffff640 1 --2- 10.20.193.58:0/574573390 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f88c407a660 0x7f88c409ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:52.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.686+0000 7f88cffff640 1 -- 10.20.193.58:0/574573390 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f88e009d220 con 0x7f88f40b6690 2026-02-23T06:34:52.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.686+0000 7f88cffff640 1 -- 10.20.193.58:0/574573390 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f88e4011a80 con 0x7f88f413db10 2026-02-23T06:34:52.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.686+0000 7f88cffff640 1 -- 10.20.193.58:0/574573390 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88f413db10 msgr2=0x7f88f4150af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:52.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.686+0000 7f88cffff640 1 --2- 10.20.193.58:0/574573390 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88f413db10 0x7f88f4150af0 secure :-1 s=READY pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88f4127500 tx=0x7f88e4009ae0 comp rx=0 tx=0).stop 2026-02-23T06:34:52.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.686+0000 7f88cffff640 1 -- 10.20.193.58:0/574573390 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88f413db10 msgr2=0x7f88f4150af0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:34:52.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.686+0000 7f88cffff640 1 --2- 10.20.193.58:0/574573390 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88f413db10 0x7f88f4150af0 unknown :-1 s=CLOSED pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:52.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.686+0000 7f88f3fff640 1 --2- 10.20.193.58:0/574573390 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f88c407a660 0x7f88c409ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:52.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.687+0000 7f88f3fff640 1 --2- 10.20.193.58:0/574573390 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f88c407a660 0x7f88c409ab10 secure :-1 s=READY pgs=332 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88e800a8c0 tx=0x7f88e8032040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:52.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.690+0000 7f88f8c83640 1 --2- 10.20.193.58:0/574573390 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88f4151030 0x7f88f4151430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:52.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.690+0000 7f88f8c83640 1 -- 10.20.193.58:0/574573390 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f88f40b5e10 con 0x7f88f4151030 2026-02-23T06:34:52.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.690+0000 7f88f2ffd640 1 --2- 10.20.193.58:0/574573390 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88f4151030 0x7f88f4151430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:52.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.691+0000 7f88f2ffd640 1 -- 10.20.193.58:0/574573390 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f88f4164250 con 0x7f88f4151030 2026-02-23T06:34:52.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.691+0000 7f88f2ffd640 1 --2- 10.20.193.58:0/574573390 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88f4151030 0x7f88f4151430 secure :-1 s=READY pgs=249 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88e4017000 tx=0x7f88e4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:52.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.691+0000 7f88cffff640 1 -- 10.20.193.58:0/574573390 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f88e4025070 con 0x7f88f4151030 2026-02-23T06:34:52.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.691+0000 7f88cffff640 1 -- 10.20.193.58:0/574573390 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5556 (secure 0 0 0) 0x7f88e401f870 con 0x7f88f4151030 2026-02-23T06:34:52.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.691+0000 7f88cffff640 1 -- 10.20.193.58:0/574573390 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88f4151030 msgr2=0x7f88f4151430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:52.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.691+0000 7f88cffff640 1 --2- 10.20.193.58:0/574573390 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88f4151030 0x7f88f4151430 secure :-1 s=READY pgs=249 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88e4017000 tx=0x7f88e4004770 comp rx=0 tx=0).stop 2026-02-23T06:34:52.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.691+0000 7f88cffff640 1 -- 10.20.193.58:0/574573390 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88f4151030 msgr2=0x7f88f4151430 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:34:52.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.691+0000 7f88cffff640 1 --2- 10.20.193.58:0/574573390 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88f4151030 0x7f88f4151430 unknown :-1 s=CLOSED pgs=249 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:52.687 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:34:52.687 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:34:52.687 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:34:52.688 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:34:52.688 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 118, 2026-02-23T06:34:52.688 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 567204, 2026-02-23T06:34:52.688 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:34:52.688 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:34:52.688 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:34:52.688 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:34:52.688 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:52.688 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 5, 2026-02-23T06:34:52.688 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:34:52.688 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:34:52.688 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:34:52.688 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:34:52.688 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:34:52.689 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:34:52.689 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:34:52.689 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:34:52.689 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:34:52.689 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:34:52.689 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:34:52.689 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:34:52.689 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:34:52.689 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:34:52.689 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:34:52.689 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:34:52.689 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:52.689 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:34:52.689 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:34:52.689 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:34:52.690 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:34:52.690 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:34:52.690 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:34:52.690 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:34:52.690 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:34:52.690 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:34:52.690 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:34:52.690 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:34:52.690 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:34:52.690 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:34:52.690 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:34:52.690 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:34:52.690 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:52.690 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:52.690 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:34:52.691 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:34:52.691 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:34:52.691 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:34:52.691 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:34:52.691 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:34:52.691 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:34:52.691 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:34:52.691 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:34:52.691 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:34:52.691 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:34:52.691 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:34:52.691 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:34:52.691 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:34:52.691 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:34:52.692 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:34:52.692 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:34:52.692 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:34:52.692 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:34:52.692 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:34:52.692 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:34:52.692 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:34:52.692 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:34:52.692 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:34:52.692 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:34:52.692 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:34:52.692 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:34:52.692 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:34:52.692 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:34:52.692 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:34:52.692 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:52.693 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:34:52.693 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:52.693 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:34:52.693 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:52.693 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:34:52.693 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:34:52.693 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:34:52.693 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:34:52.693 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:52.693 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:34:52.693 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:34:52.693 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:52.693 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:52.693 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:52.693 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:34:52.694 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:34:52.694 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:52.694 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:52.694 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:52.694 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:52.694 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:34:52.694 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:34:52.694 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:34:52.694 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:34:52.694 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:34:52.694 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:34:52.694 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:52.694 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:52.694 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:34:52.694 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:34:52.694 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:34:52.695 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:34:52.695 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:52.695 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:34:52.695 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:34:52.695 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:52.695 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:52.695 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:52.695 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:34:52.695 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:34:52.695 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:52.695 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:52.695 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:52.695 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:52.695 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:34:52.695 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:34:52.695 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:34:52.696 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:34:52.696 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:34:52.696 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:34:52.696 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:52.696 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:52.696 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:34:52.696 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:34:52.696 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:34:52.696 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:34:52.696 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:52.696 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:34:52.696 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:34:52.696 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:52.696 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:52.696 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:52.696 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:34:52.697 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:34:52.697 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:34:52.697 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:52.697 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:52.697 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:52.697 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:34:52.697 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:34:52.697 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:34:52.697 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:34:52.697 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:34:52.697 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:34:52.697 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:52.697 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:52.697 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:52.697 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:34:52.698 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:34:52.698 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:52.698 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:34:52.698 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:34:52.698 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:34:52.698 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:52.698 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:52.698 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:34:52.698 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:52.698 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:34:52.698 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:34:52.698 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:34:52.698 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:52.698 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:52.698 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:34:52.698 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:52.699 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:34:52.699 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:34:52.699 INFO:teuthology.orchestra.run.trial058.stdout: "num": 8 2026-02-23T06:34:52.699 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:52.699 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:52.699 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:34:52.699 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:52.699 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:34:52.699 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:34:52.699 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:34:52.699 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:52.699 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:52.699 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:34:52.699 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:34:52.699 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:34:52.699 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:52.699 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:34:52.700 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:34:52.700 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:34:52.700 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:34:52.700 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:34:52.700 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:34:52.700 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:34:52.700 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:34:52.700 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:34:52.700 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:34:52.700 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:34:52.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.692+0000 7f88f8c83640 1 -- 10.20.193.58:0/574573390 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f88c407a660 msgr2=0x7f88c409ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:52.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.692+0000 7f88f8c83640 1 --2- 10.20.193.58:0/574573390 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f88c407a660 0x7f88c409ab10 secure :-1 s=READY pgs=332 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88e800a8c0 tx=0x7f88e8032040 comp rx=0 tx=0).stop 2026-02-23T06:34:52.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.692+0000 7f88f8c83640 1 -- 10.20.193.58:0/574573390 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f88f40b6690 msgr2=0x7f88f4127a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:52.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.692+0000 7f88f8c83640 1 --2- 10.20.193.58:0/574573390 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f88f40b6690 0x7f88f4127a40 secure :-1 s=READY pgs=103 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88e0007fd0 tx=0x7f88e000c970 comp rx=0 tx=0).stop 2026-02-23T06:34:52.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.692+0000 7f88f3fff640 1 -- 10.20.193.58:0/574573390 reap_dead start 2026-02-23T06:34:52.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.692+0000 7f88f3fff640 1 -- 10.20.193.58:0/574573390 reap_dead start 2026-02-23T06:34:52.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.692+0000 7f88f8c83640 1 -- 10.20.193.58:0/574573390 shutdown_connections 2026-02-23T06:34:52.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.692+0000 7f88f8c83640 1 -- 10.20.193.58:0/574573390 >> 10.20.193.58:0/574573390 conn(0x7f88f40b3c20 msgr2=0x7f88f41635a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:52.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.692+0000 7f88f8c83640 1 -- 10.20.193.58:0/574573390 shutdown_connections 2026-02-23T06:34:52.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.692+0000 7f88f8c83640 1 -- 10.20.193.58:0/574573390 wait complete. 2026-02-23T06:34:52.702 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:34:52.702 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:34:52.702 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:34:52.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.830+0000 7ff0d7577640 1 -- 10.20.193.58:0/2027097261 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff0d815d4a0 msgr2=0x7ff0d80affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:52.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.830+0000 7ff0d7577640 1 --2- 10.20.193.58:0/2027097261 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff0d815d4a0 0x7ff0d80affb0 secure :-1 s=READY pgs=250 gs=2 cs=0 l=1 c_cookie=15425018352608111900 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0cc004740 tx=0x7ff0cc02f1e0 comp rx=0 tx=0).stop 2026-02-23T06:34:52.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.830+0000 7ff0d7577640 1 -- 10.20.193.58:0/2027097261 shutdown_connections 2026-02-23T06:34:52.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.830+0000 7ff0d7577640 1 --2- 10.20.193.58:0/2027097261 >> v2:10.20.193.93:3300/0 conn(0x7ff0d80b6690 0x7ff0d8058ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:52.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.830+0000 7ff0d7577640 1 --2- 10.20.193.58:0/2027097261 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff0d815d4a0 0x7ff0d80affb0 unknown :-1 s=CLOSED pgs=250 gs=2 cs=0 l=1 c_cookie=15425018352608111900 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:52.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.830+0000 7ff0d7577640 1 -- 10.20.193.58:0/2027097261 >> 10.20.193.58:0/2027097261 conn(0x7ff0d80b3c20 msgr2=0x7ff0d80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:52.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.830+0000 7ff0d7577640 1 -- 10.20.193.58:0/2027097261 shutdown_connections 2026-02-23T06:34:52.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.830+0000 7ff0d7577640 1 -- 10.20.193.58:0/2027097261 wait complete. 2026-02-23T06:34:52.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.831+0000 7ff0d7577640 1 Processor -- start 2026-02-23T06:34:52.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.832+0000 7ff0d7577640 1 -- start start 2026-02-23T06:34:52.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.832+0000 7ff0d7577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff0d80b6690 0x7ff0d8121200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:52.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.832+0000 7ff0d7577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff0d815d4a0 0x7ff0d8124710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:52.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.832+0000 7ff0d7577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff0d815d870 0x7ff0d8124c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:52.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.832+0000 7ff0d7577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d8121740 con 0x7ff0d80b6690 2026-02-23T06:34:52.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.832+0000 7ff0d7577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d814c2d0 con 0x7ff0d815d4a0 2026-02-23T06:34:52.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.832+0000 7ff0d7577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7ff0d813e840 con 0x7ff0d815d870 2026-02-23T06:34:52.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.832+0000 7ff0d6575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff0d80b6690 0x7ff0d8121200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:52.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.832+0000 7ff0d6d76640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff0d815d870 0x7ff0d8124c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:52.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.832+0000 7ff0d6575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff0d80b6690 0x7ff0d8121200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:39702/0 (socket says 10.20.193.58:39702) 2026-02-23T06:34:52.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.832+0000 7ff0d6575640 1 -- 10.20.193.58:0/3713723161 learned_addr learned my addr 10.20.193.58:0/3713723161 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:34:52.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.832+0000 7ff0d5d74640 1 --2- 10.20.193.58:0/3713723161 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff0d815d4a0 0x7ff0d8124710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:52.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.833+0000 7ff0d6575640 1 -- 10.20.193.58:0/3713723161 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff0d815d870 msgr2=0x7ff0d8124c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:52.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.833+0000 7ff0d6575640 1 --2- 10.20.193.58:0/3713723161 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff0d815d870 0x7ff0d8124c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:52.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.833+0000 7ff0d6575640 1 -- 10.20.193.58:0/3713723161 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff0d815d4a0 msgr2=0x7ff0d8124710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:52.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.833+0000 7ff0d6575640 1 --2- 10.20.193.58:0/3713723161 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff0d815d4a0 0x7ff0d8124710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:52.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.833+0000 7ff0d6575640 1 -- 10.20.193.58:0/3713723161 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0cc0094b0 con 0x7ff0d80b6690 2026-02-23T06:34:52.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.833+0000 7ff0d5d74640 1 --2- 10.20.193.58:0/3713723161 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff0d815d4a0 0x7ff0d8124710 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:34:52.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.833+0000 7ff0d6575640 1 --2- 10.20.193.58:0/3713723161 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff0d80b6690 0x7ff0d8121200 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0cc009960 tx=0x7ff0cc002950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:52.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.833+0000 7ff0beffd640 1 -- 10.20.193.58:0/3713723161 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff0cc038470 con 0x7ff0d80b6690 2026-02-23T06:34:52.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.833+0000 7ff0beffd640 1 -- 10.20.193.58:0/3713723161 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0cc0386c0 con 0x7ff0d80b6690 2026-02-23T06:34:52.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.833+0000 7ff0d7577640 1 -- 10.20.193.58:0/3713723161 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0d8120160 con 0x7ff0d80b6690 2026-02-23T06:34:52.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.833+0000 7ff0beffd640 1 -- 10.20.193.58:0/3713723161 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff0cc038ad0 con 0x7ff0d80b6690 2026-02-23T06:34:52.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.833+0000 7ff0d7577640 1 -- 10.20.193.58:0/3713723161 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0d8120720 con 0x7ff0d80b6690 2026-02-23T06:34:52.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.834+0000 7ff0d7577640 1 -- 10.20.193.58:0/3713723161 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0d80b6d50 con 0x7ff0d80b6690 2026-02-23T06:34:52.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.835+0000 7ff0beffd640 1 -- 10.20.193.58:0/3713723161 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7ff0cc038c30 con 0x7ff0d80b6690 2026-02-23T06:34:52.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.836+0000 7ff0beffd640 1 --2- 10.20.193.58:0/3713723161 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff0a407a6c0 0x7ff0a409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:34:52.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.836+0000 7ff0beffd640 1 -- 10.20.193.58:0/3713723161 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7ff0cc0c2b70 con 0x7ff0d80b6690 2026-02-23T06:34:52.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.836+0000 7ff0d5d74640 1 --2- 10.20.193.58:0/3713723161 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff0a407a6c0 0x7ff0a409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:34:52.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.837+0000 7ff0d5d74640 1 --2- 10.20.193.58:0/3713723161 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff0a407a6c0 0x7ff0a409ab70 secure :-1 s=READY pgs=333 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0d8145570 tx=0x7ff0c0009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:34:52.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.837+0000 7ff0beffd640 1 -- 10.20.193.58:0/3713723161 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7ff0cc085da0 con 0x7ff0d80b6690 2026-02-23T06:34:52.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.994+0000 7ff0d7577640 1 -- 10.20.193.58:0/3713723161 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7ff0d805b0e0 con 0x7ff0d80b6690 2026-02-23T06:34:52.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.995+0000 7ff0beffd640 1 -- 10.20.193.58:0/3713723161 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7ff0cc088ec0 con 0x7ff0d80b6690 2026-02-23T06:34:52.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.996+0000 7ff0d7577640 1 -- 10.20.193.58:0/3713723161 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff0a407a6c0 msgr2=0x7ff0a409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:52.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.996+0000 7ff0d7577640 1 --2- 10.20.193.58:0/3713723161 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff0a407a6c0 0x7ff0a409ab70 secure :-1 s=READY pgs=333 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0d8145570 tx=0x7ff0c0009040 comp rx=0 tx=0).stop 2026-02-23T06:34:52.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.996+0000 7ff0d7577640 1 -- 10.20.193.58:0/3713723161 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff0d80b6690 msgr2=0x7ff0d8121200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:34:52.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.996+0000 7ff0d7577640 1 --2- 10.20.193.58:0/3713723161 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff0d80b6690 0x7ff0d8121200 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0cc009960 tx=0x7ff0cc002950 comp rx=0 tx=0).stop 2026-02-23T06:34:52.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.996+0000 7ff0d7577640 1 -- 10.20.193.58:0/3713723161 shutdown_connections 2026-02-23T06:34:52.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.996+0000 7ff0d7577640 1 --2- 10.20.193.58:0/3713723161 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff0a407a6c0 0x7ff0a409ab70 unknown :-1 s=CLOSED pgs=333 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:52.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.996+0000 7ff0d7577640 1 --2- 10.20.193.58:0/3713723161 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff0d815d870 0x7ff0d8124c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:52.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.996+0000 7ff0d7577640 1 --2- 10.20.193.58:0/3713723161 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff0d815d4a0 0x7ff0d8124710 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:52.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.996+0000 7ff0d7577640 1 --2- 10.20.193.58:0/3713723161 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff0d80b6690 0x7ff0d8121200 unknown :-1 s=CLOSED pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:34:52.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.996+0000 7ff0d7577640 1 -- 10.20.193.58:0/3713723161 >> 10.20.193.58:0/3713723161 conn(0x7ff0d80b3c20 msgr2=0x7ff0d805d100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:34:52.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.996+0000 7ff0d7577640 1 -- 10.20.193.58:0/3713723161 shutdown_connections 2026-02-23T06:34:52.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:34:52.996+0000 7ff0d7577640 1 -- 10.20.193.58:0/3713723161 wait complete. 2026-02-23T06:34:53.005 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:35:03.006 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:35:03.006 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:35:03.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.136+0000 7f6d29883640 1 -- 10.20.193.58:0/2064716117 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6d24056960 msgr2=0x7f6d24058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:03.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.136+0000 7f6d29883640 1 --2- 10.20.193.58:0/2064716117 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6d24056960 0x7f6d24058200 secure :-1 s=READY pgs=251 gs=3 cs=0 l=1 c_cookie=17148134832145362207 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d24059b80 tx=0x7f6d0c02f1b0 comp rx=0 tx=0).stop 2026-02-23T06:35:03.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.136+0000 7f6d29883640 1 -- 10.20.193.58:0/2064716117 shutdown_connections 2026-02-23T06:35:03.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.136+0000 7f6d29883640 1 --2- 10.20.193.58:0/2064716117 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6d24056960 0x7f6d24058200 unknown :-1 s=CLOSED pgs=251 gs=3 cs=0 l=1 c_cookie=17148134832145362207 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:03.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.136+0000 7f6d29883640 1 -- 10.20.193.58:0/2064716117 >> 10.20.193.58:0/2064716117 conn(0x7f6d240b3c20 msgr2=0x7f6d240b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:35:03.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.136+0000 7f6d29883640 1 -- 10.20.193.58:0/2064716117 shutdown_connections 2026-02-23T06:35:03.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.136+0000 7f6d29883640 1 -- 10.20.193.58:0/2064716117 wait complete. 2026-02-23T06:35:03.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.137+0000 7f6d29883640 1 Processor -- start 2026-02-23T06:35:03.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.137+0000 7f6d29883640 1 -- start start 2026-02-23T06:35:03.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.138+0000 7f6d29883640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6d24056960 0x7f6d2414dfe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:03.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.138+0000 7f6d29883640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6d2415c4b0 0x7f6d2411ee70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:03.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.138+0000 7f6d29883640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6d24162ca0 0x7f6d241210e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:03.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.138+0000 7f6d29883640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2415bcf0 con 0x7f6d24056960 2026-02-23T06:35:03.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.138+0000 7f6d29883640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f6d24121620 con 0x7f6d24162ca0 2026-02-23T06:35:03.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.138+0000 7f6d29883640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f6d2415b030 con 0x7f6d2415c4b0 2026-02-23T06:35:03.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.138+0000 7f6d28881640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6d24056960 0x7f6d2414dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:03.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.138+0000 7f6d1bfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6d2415c4b0 0x7f6d2411ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:03.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.138+0000 7f6d28881640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6d24056960 0x7f6d2414dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:54364/0 (socket says 10.20.193.58:54364) 2026-02-23T06:35:03.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.138+0000 7f6d1bfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6d2415c4b0 0x7f6d2411ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:57020/0 (socket says 10.20.193.58:57020) 2026-02-23T06:35:03.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.138+0000 7f6d1bfff640 1 -- 10.20.193.58:0/3350604825 learned_addr learned my addr 10.20.193.58:0/3350604825 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:35:03.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.138+0000 7f6d29082640 1 --2- 10.20.193.58:0/3350604825 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6d24162ca0 0x7f6d241210e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:03.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.138+0000 7f6d1bfff640 1 -- 10.20.193.58:0/3350604825 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6d24162ca0 msgr2=0x7f6d241210e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:03.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.138+0000 7f6d1bfff640 1 --2- 10.20.193.58:0/3350604825 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6d24162ca0 0x7f6d241210e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:03.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.138+0000 7f6d1bfff640 1 -- 10.20.193.58:0/3350604825 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6d24056960 msgr2=0x7f6d2414dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:03.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.138+0000 7f6d1bfff640 1 --2- 10.20.193.58:0/3350604825 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6d24056960 0x7f6d2414dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:03.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.138+0000 7f6d1bfff640 1 -- 10.20.193.58:0/3350604825 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d0c0094b0 con 0x7f6d2415c4b0 2026-02-23T06:35:03.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.138+0000 7f6d1bfff640 1 --2- 10.20.193.58:0/3350604825 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6d2415c4b0 0x7f6d2411ee70 secure :-1 s=READY pgs=252 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d0c0099a0 tx=0x7f6d0c0026a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:35:03.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.139+0000 7f6d197fa640 1 -- 10.20.193.58:0/3350604825 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6d0c03d070 con 0x7f6d2415c4b0 2026-02-23T06:35:03.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.139+0000 7f6d197fa640 1 -- 10.20.193.58:0/3350604825 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d0c002d00 con 0x7f6d2415c4b0 2026-02-23T06:35:03.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.139+0000 7f6d197fa640 1 -- 10.20.193.58:0/3350604825 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6d0c031350 con 0x7f6d2415c4b0 2026-02-23T06:35:03.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.139+0000 7f6d29883640 1 -- 10.20.193.58:0/3350604825 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d241415a0 con 0x7f6d2415c4b0 2026-02-23T06:35:03.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.139+0000 7f6d29883640 1 -- 10.20.193.58:0/3350604825 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d24121b00 con 0x7f6d2415c4b0 2026-02-23T06:35:03.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.139+0000 7f6d29883640 1 -- 10.20.193.58:0/3350604825 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d24121de0 con 0x7f6d2415c4b0 2026-02-23T06:35:03.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.141+0000 7f6d197fa640 1 -- 10.20.193.58:0/3350604825 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f6d0c067b80 con 0x7f6d2415c4b0 2026-02-23T06:35:03.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.142+0000 7f6d197fa640 1 --2- 10.20.193.58:0/3350604825 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6cf407a780 0x7f6cf409ac30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:03.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.142+0000 7f6d197fa640 1 -- 10.20.193.58:0/3350604825 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f6d0c0c2570 con 0x7f6d2415c4b0 2026-02-23T06:35:03.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.142+0000 7f6d28881640 1 --2- 10.20.193.58:0/3350604825 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6cf407a780 0x7f6cf409ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:03.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.142+0000 7f6d197fa640 1 -- 10.20.193.58:0/3350604825 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f6d0c085830 con 0x7f6d2415c4b0 2026-02-23T06:35:03.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.143+0000 7f6d28881640 1 --2- 10.20.193.58:0/3350604825 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6cf407a780 0x7f6cf409ac30 secure :-1 s=READY pgs=335 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d140046e0 tx=0x7f6d14007dd0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:35:03.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.296+0000 7f6d29883640 1 -- 10.20.193.58:0/3350604825 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6d241420f0 con 0x7f6d2415c4b0 2026-02-23T06:35:03.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.296+0000 7f6d197fa640 1 -- 10.20.193.58:0/3350604825 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f6d0c067e60 con 0x7f6d2415c4b0 2026-02-23T06:35:03.292 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":118,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:35:03.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.298+0000 7f6d29883640 1 -- 10.20.193.58:0/3350604825 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6cf407a780 msgr2=0x7f6cf409ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:03.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.298+0000 7f6d29883640 1 --2- 10.20.193.58:0/3350604825 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6cf407a780 0x7f6cf409ac30 secure :-1 s=READY pgs=335 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d140046e0 tx=0x7f6d14007dd0 comp rx=0 tx=0).stop 2026-02-23T06:35:03.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.298+0000 7f6d29883640 1 -- 10.20.193.58:0/3350604825 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6d2415c4b0 msgr2=0x7f6d2411ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:03.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.298+0000 7f6d29883640 1 --2- 10.20.193.58:0/3350604825 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6d2415c4b0 0x7f6d2411ee70 secure :-1 s=READY pgs=252 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d0c0099a0 tx=0x7f6d0c0026a0 comp rx=0 tx=0).stop 2026-02-23T06:35:03.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.298+0000 7f6d29883640 1 -- 10.20.193.58:0/3350604825 shutdown_connections 2026-02-23T06:35:03.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.298+0000 7f6d29883640 1 --2- 10.20.193.58:0/3350604825 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6cf407a780 0x7f6cf409ac30 unknown :-1 s=CLOSED pgs=335 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:03.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.298+0000 7f6d29883640 1 --2- 10.20.193.58:0/3350604825 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6d24162ca0 0x7f6d241210e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:03.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.298+0000 7f6d29883640 1 --2- 10.20.193.58:0/3350604825 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6d2415c4b0 0x7f6d2411ee70 unknown :-1 s=CLOSED pgs=252 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:03.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.298+0000 7f6d29883640 1 --2- 10.20.193.58:0/3350604825 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6d24056960 0x7f6d2414dfe0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:03.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.298+0000 7f6d29883640 1 -- 10.20.193.58:0/3350604825 >> 10.20.193.58:0/3350604825 conn(0x7f6d240b3c20 msgr2=0x7f6d240b5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:35:03.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.298+0000 7f6d29883640 1 -- 10.20.193.58:0/3350604825 shutdown_connections 2026-02-23T06:35:03.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.298+0000 7f6d29883640 1 -- 10.20.193.58:0/3350604825 wait complete. 2026-02-23T06:35:03.305 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:35:03.305 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:35:03.305 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:35:03.305 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:35:03.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.432+0000 7f9fcaf1c640 1 -- 10.20.193.58:0/3745619390 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9fc415d870 msgr2=0x7f9fc40587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:03.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.432+0000 7f9fcaf1c640 1 --2- 10.20.193.58:0/3745619390 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9fc415d870 0x7f9fc40587b0 secure :-1 s=READY pgs=10 gs=3 cs=0 l=1 c_cookie=3085650349910071787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fb8004740 tx=0x7f9fb802f230 comp rx=0 tx=0).stop 2026-02-23T06:35:03.429 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.432+0000 7f9fcaf1c640 1 -- 10.20.193.58:0/3745619390 shutdown_connections 2026-02-23T06:35:03.429 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.432+0000 7f9fcaf1c640 1 --2- 10.20.193.58:0/3745619390 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9fc415d870 0x7f9fc40587b0 unknown :-1 s=CLOSED pgs=10 gs=3 cs=0 l=1 c_cookie=3085650349910071787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:03.429 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.432+0000 7f9fcaf1c640 1 -- 10.20.193.58:0/3745619390 >> 10.20.193.58:0/3745619390 conn(0x7f9fc40b3c20 msgr2=0x7f9fc40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:35:03.429 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.433+0000 7f9fcaf1c640 1 -- 10.20.193.58:0/3745619390 shutdown_connections 2026-02-23T06:35:03.429 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.433+0000 7f9fcaf1c640 1 -- 10.20.193.58:0/3745619390 wait complete. 2026-02-23T06:35:03.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.434+0000 7f9fcaf1c640 1 Processor -- start 2026-02-23T06:35:03.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.434+0000 7f9fcaf1c640 1 -- start start 2026-02-23T06:35:03.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.434+0000 7f9fcaf1c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9fc40b6690 0x7f9fc4129080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:03.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.434+0000 7f9fcaf1c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9fc415d4a0 0x7f9fc40569e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:03.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.434+0000 7f9fcaf1c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9fc415d870 0x7f9fc4161ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:03.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.434+0000 7f9fcaf1c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc41627f0 con 0x7f9fc40b6690 2026-02-23T06:35:03.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.434+0000 7f9fcaf1c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc4162ad0 con 0x7f9fc415d4a0 2026-02-23T06:35:03.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.434+0000 7f9fcaf1c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f9fc41610a0 con 0x7f9fc415d870 2026-02-23T06:35:03.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.435+0000 7f9fc9f1a640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9fc40b6690 0x7f9fc4129080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:03.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.435+0000 7f9fc9719640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9fc415d4a0 0x7f9fc40569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:03.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.435+0000 7f9fc9719640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9fc415d4a0 0x7f9fc40569e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:34250/0 (socket says 10.20.193.58:34250) 2026-02-23T06:35:03.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.435+0000 7f9fc9719640 1 -- 10.20.193.58:0/2101296711 learned_addr learned my addr 10.20.193.58:0/2101296711 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:35:03.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.435+0000 7f9fc9f1a640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9fc40b6690 0x7f9fc4129080 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:54372/0 (socket says 10.20.193.58:54372) 2026-02-23T06:35:03.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.435+0000 7f9fca71b640 1 --2- 10.20.193.58:0/2101296711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9fc415d870 0x7f9fc4161ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:03.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.435+0000 7f9fc9719640 1 -- 10.20.193.58:0/2101296711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9fc415d870 msgr2=0x7f9fc4161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:03.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.435+0000 7f9fc9719640 1 --2- 10.20.193.58:0/2101296711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9fc415d870 0x7f9fc4161ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:03.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.435+0000 7f9fc9719640 1 -- 10.20.193.58:0/2101296711 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9fc40b6690 msgr2=0x7f9fc4129080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:03.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.435+0000 7f9fc9719640 1 --2- 10.20.193.58:0/2101296711 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9fc40b6690 0x7f9fc4129080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:03.435 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.435+0000 7f9fc9719640 1 -- 10.20.193.58:0/2101296711 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb80094b0 con 0x7f9fc415d4a0 2026-02-23T06:35:03.435 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.435+0000 7f9fc9719640 1 --2- 10.20.193.58:0/2101296711 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9fc415d4a0 0x7f9fc40569e0 secure :-1 s=READY pgs=11 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fb80023d0 tx=0x7f9fb8002950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:35:03.435 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.435+0000 7f9fb27fc640 1 -- 10.20.193.58:0/2101296711 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9fb8038470 con 0x7f9fc415d4a0 2026-02-23T06:35:03.435 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.435+0000 7f9fb27fc640 1 -- 10.20.193.58:0/2101296711 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9fb80386c0 con 0x7f9fc415d4a0 2026-02-23T06:35:03.435 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.435+0000 7f9fb27fc640 1 -- 10.20.193.58:0/2101296711 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9fb8038a90 con 0x7f9fc415d4a0 2026-02-23T06:35:03.435 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.435+0000 7f9fcaf1c640 1 -- 10.20.193.58:0/2101296711 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fc4161380 con 0x7f9fc415d4a0 2026-02-23T06:35:03.435 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.435+0000 7f9fcaf1c640 1 -- 10.20.193.58:0/2101296711 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fc4163020 con 0x7f9fc415d4a0 2026-02-23T06:35:03.435 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.436+0000 7f9fcaf1c640 1 --2- 10.20.193.58:0/2101296711 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9fc41620e0 0x7f9fc413f180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:03.435 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.436+0000 7f9fcaf1c640 1 -- 10.20.193.58:0/2101296711 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc40609c0 con 0x7f9fc41620e0 2026-02-23T06:35:03.435 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.436+0000 7f9fc9f1a640 1 --2- 10.20.193.58:0/2101296711 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9fc41620e0 0x7f9fc413f180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:03.435 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.436+0000 7f9fc9f1a640 1 -- 10.20.193.58:0/2101296711 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9fc40b5e10 con 0x7f9fc41620e0 2026-02-23T06:35:03.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.437+0000 7f9fc9f1a640 1 --2- 10.20.193.58:0/2101296711 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9fc41620e0 0x7f9fc413f180 secure :-1 s=READY pgs=107 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fb4007fd0 tx=0x7f9fb400fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:35:03.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.437+0000 7f9fb27fc640 1 -- 10.20.193.58:0/2101296711 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9fb4006b70 con 0x7f9fc41620e0 2026-02-23T06:35:03.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.437+0000 7f9fb27fc640 1 -- 10.20.193.58:0/2101296711 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f9fb4006cd0 con 0x7f9fc41620e0 2026-02-23T06:35:03.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.437+0000 7f9fb27fc640 1 -- 10.20.193.58:0/2101296711 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9fc41620e0 msgr2=0x7f9fc413f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:03.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.437+0000 7f9fb27fc640 1 --2- 10.20.193.58:0/2101296711 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9fc41620e0 0x7f9fc413f180 secure :-1 s=READY pgs=107 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fb4007fd0 tx=0x7f9fb400fc10 comp rx=0 tx=0).stop 2026-02-23T06:35:03.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.437+0000 7f9fb27fc640 1 -- 10.20.193.58:0/2101296711 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9fc41620e0 msgr2=0x7f9fc413f180 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:35:03.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.437+0000 7f9fb27fc640 1 --2- 10.20.193.58:0/2101296711 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9fc41620e0 0x7f9fc413f180 unknown :-1 s=CLOSED pgs=107 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:03.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.437+0000 7f9fb27fc640 1 -- 10.20.193.58:0/2101296711 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f9fb8038bf0 con 0x7f9fc415d4a0 2026-02-23T06:35:03.438 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.438+0000 7f9fb27fc640 1 --2- 10.20.193.58:0/2101296711 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9f9407a410 0x7f9f9409a8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:03.438 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.438+0000 7f9fb27fc640 1 -- 10.20.193.58:0/2101296711 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f9fb80c23e0 con 0x7f9fc415d4a0 2026-02-23T06:35:03.438 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.438+0000 7f9fc9f1a640 1 --2- 10.20.193.58:0/2101296711 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9f9407a410 0x7f9f9409a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:03.438 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.439+0000 7f9fc9f1a640 1 --2- 10.20.193.58:0/2101296711 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9f9407a410 0x7f9f9409a8c0 secure :-1 s=READY pgs=336 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fb4007fd0 tx=0x7f9fb4009030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:35:03.438 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.440+0000 7f9fcaf1c640 1 --2- 10.20.193.58:0/2101296711 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9fc4140340 0x7f9fc413f6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:03.438 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.440+0000 7f9fcaf1c640 1 -- 10.20.193.58:0/2101296711 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc4140710 con 0x7f9fc4140340 2026-02-23T06:35:03.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.440+0000 7f9fca71b640 1 --2- 10.20.193.58:0/2101296711 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9fc4140340 0x7f9fc413f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:03.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.441+0000 7f9fca71b640 1 -- 10.20.193.58:0/2101296711 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9fc40b6330 con 0x7f9fc4140340 2026-02-23T06:35:03.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.441+0000 7f9fca71b640 1 --2- 10.20.193.58:0/2101296711 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9fc4140340 0x7f9fc413f6c0 secure :-1 s=READY pgs=108 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fc0008fd0 tx=0x7f9fc000ff10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:35:03.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.441+0000 7f9fb27fc640 1 -- 10.20.193.58:0/2101296711 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9fc001a070 con 0x7f9fc4140340 2026-02-23T06:35:03.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.441+0000 7f9fb27fc640 1 -- 10.20.193.58:0/2101296711 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4915 (secure 0 0 0) 0x7f9fc000d940 con 0x7f9fc4140340 2026-02-23T06:35:03.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.441+0000 7f9fb27fc640 1 -- 10.20.193.58:0/2101296711 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9fc4140340 msgr2=0x7f9fc413f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:03.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.441+0000 7f9fb27fc640 1 --2- 10.20.193.58:0/2101296711 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9fc4140340 0x7f9fc413f6c0 secure :-1 s=READY pgs=108 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fc0008fd0 tx=0x7f9fc000ff10 comp rx=0 tx=0).stop 2026-02-23T06:35:03.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.441+0000 7f9fb27fc640 1 -- 10.20.193.58:0/2101296711 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9fc4140340 msgr2=0x7f9fc413f6c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:35:03.440 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:35:03.440 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:35:03.440 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:35:03.440 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:35:03.440 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 118, 2026-02-23T06:35:03.440 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 110953, 2026-02-23T06:35:03.440 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:35:03.440 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:35:03.440 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:35:03.440 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:35:03.441 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:03.441 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 16, 2026-02-23T06:35:03.441 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:35:03.441 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:35:03.441 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:35:03.441 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:35:03.441 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:35:03.441 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:35:03.442 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:35:03.442 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:35:03.442 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:35:03.442 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:35:03.442 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:35:03.442 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:35:03.442 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:35:03.442 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:35:03.442 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:35:03.442 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:35:03.442 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:03.443 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:35:03.443 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:35:03.443 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:35:03.443 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:35:03.443 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:35:03.443 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:35:03.443 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:35:03.443 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:35:03.443 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:35:03.443 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:35:03.443 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:35:03.444 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:35:03.444 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:35:03.444 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:35:03.444 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:35:03.444 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:03.444 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.444 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:35:03.444 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:35:03.444 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:35:03.444 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:35:03.444 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:35:03.444 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:35:03.445 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:35:03.445 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:35:03.445 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:35:03.445 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:35:03.445 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:35:03.445 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:35:03.445 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:35:03.445 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:35:03.445 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:35:03.445 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:35:03.445 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:35:03.445 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:35:03.446 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:35:03.446 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:35:03.446 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:35:03.446 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:35:03.446 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:35:03.446 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:35:03.446 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:35:03.446 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:35:03.446 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:35:03.446 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:35:03.446 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:35:03.446 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:35:03.447 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:03.447 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:35:03.447 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.447 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:35:03.447 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.447 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:35:03.447 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:35:03.447 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:35:03.447 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:35:03.447 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.447 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:35:03.447 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:35:03.448 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:03.448 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.448 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.448 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:35:03.448 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:35:03.448 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:03.448 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:03.448 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:03.448 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.448 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:35:03.448 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:35:03.449 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:35:03.449 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:35:03.449 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:35:03.449 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:35:03.449 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.449 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.449 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:35:03.449 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:35:03.449 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:35:03.449 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:35:03.449 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.449 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:35:03.450 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:35:03.450 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:03.450 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.450 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.450 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:35:03.450 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:35:03.450 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:03.450 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:03.450 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:03.450 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.450 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:35:03.450 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:35:03.451 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:35:03.451 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:35:03.451 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:35:03.451 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:35:03.451 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.451 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.451 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:35:03.451 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:35:03.451 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:35:03.451 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:35:03.451 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.451 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:35:03.452 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:35:03.452 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:03.452 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.452 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.452 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:35:03.452 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:35:03.452 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:03.452 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:03.452 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:03.453 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.453 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:35:03.453 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:35:03.453 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:35:03.453 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:35:03.453 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:35:03.453 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:35:03.453 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:03.453 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:03.453 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.453 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:35:03.454 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:35:03.454 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.454 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:35:03.454 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:35:03.454 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:35:03.454 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:03.454 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:03.454 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:35:03.454 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.454 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:35:03.454 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:35:03.454 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:35:03.454 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:03.455 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:03.455 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.455 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:35:03.455 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:35:03.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.441+0000 7f9fb27fc640 1 --2- 10.20.193.58:0/2101296711 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9fc4140340 0x7f9fc413f6c0 unknown :-1 s=CLOSED pgs=108 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:03.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.441+0000 7f9fcaf1c640 1 -- 10.20.193.58:0/2101296711 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9f9407a410 msgr2=0x7f9f9409a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:03.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.441+0000 7f9fcaf1c640 1 --2- 10.20.193.58:0/2101296711 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9f9407a410 0x7f9f9409a8c0 secure :-1 s=READY pgs=336 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fb4007fd0 tx=0x7f9fb4009030 comp rx=0 tx=0).stop 2026-02-23T06:35:03.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.441+0000 7f9fcaf1c640 1 -- 10.20.193.58:0/2101296711 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9fc415d4a0 msgr2=0x7f9fc40569e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:03.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.441+0000 7f9fcaf1c640 1 --2- 10.20.193.58:0/2101296711 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9fc415d4a0 0x7f9fc40569e0 secure :-1 s=READY pgs=11 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fb80023d0 tx=0x7f9fb8002950 comp rx=0 tx=0).stop 2026-02-23T06:35:03.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.441+0000 7f9fca71b640 1 -- 10.20.193.58:0/2101296711 reap_dead start 2026-02-23T06:35:03.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.442+0000 7f9fcaf1c640 1 -- 10.20.193.58:0/2101296711 shutdown_connections 2026-02-23T06:35:03.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.442+0000 7f9fcaf1c640 1 --2- 10.20.193.58:0/2101296711 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9fc415d4a0 0x7f9fc40569e0 unknown :-1 s=CLOSED pgs=11 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:03.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.442+0000 7f9fcaf1c640 1 -- 10.20.193.58:0/2101296711 >> 10.20.193.58:0/2101296711 conn(0x7f9fc40b3c20 msgr2=0x7f9fc40585b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:35:03.458 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.442+0000 7f9fcaf1c640 1 -- 10.20.193.58:0/2101296711 shutdown_connections 2026-02-23T06:35:03.458 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.442+0000 7f9fcaf1c640 1 -- 10.20.193.58:0/2101296711 wait complete. 2026-02-23T06:35:03.458 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:35:03.458 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:35:03.458 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:35:03.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.584+0000 7f864b23a640 1 -- 10.20.193.58:0/1097392398 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f864415d870 msgr2=0x7f86440587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:03.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.584+0000 7f864b23a640 1 --2- 10.20.193.58:0/1097392398 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f864415d870 0x7f86440587b0 secure :-1 s=READY pgs=109 gs=2 cs=0 l=1 c_cookie=16292387736119159565 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86440afed0 tx=0x7f863802f250 comp rx=0 tx=0).stop 2026-02-23T06:35:03.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.584+0000 7f864b23a640 1 -- 10.20.193.58:0/1097392398 shutdown_connections 2026-02-23T06:35:03.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.584+0000 7f864b23a640 1 --2- 10.20.193.58:0/1097392398 >> v2:10.20.193.93:3300/0 conn(0x7f86440b6690 0x7f8644058cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:03.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.584+0000 7f864b23a640 1 --2- 10.20.193.58:0/1097392398 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f864415d870 0x7f86440587b0 unknown :-1 s=CLOSED pgs=109 gs=2 cs=0 l=1 c_cookie=16292387736119159565 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:03.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.584+0000 7f864b23a640 1 -- 10.20.193.58:0/1097392398 >> 10.20.193.58:0/1097392398 conn(0x7f86440b3c20 msgr2=0x7f86440b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:35:03.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.584+0000 7f864b23a640 1 -- 10.20.193.58:0/1097392398 shutdown_connections 2026-02-23T06:35:03.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.584+0000 7f864b23a640 1 -- 10.20.193.58:0/1097392398 wait complete. 2026-02-23T06:35:03.583 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.586+0000 7f864b23a640 1 Processor -- start 2026-02-23T06:35:03.583 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.586+0000 7f864b23a640 1 -- start start 2026-02-23T06:35:03.584 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.586+0000 7f864b23a640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f86440b6690 0x7f8644120650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:03.584 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.586+0000 7f864b23a640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f864415d4a0 0x7f86441249d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:03.584 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.586+0000 7f864b23a640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f864415d870 0x7f8644124f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:03.584 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.586+0000 7f864b23a640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f864414bd90 con 0x7f86440b6690 2026-02-23T06:35:03.584 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.586+0000 7f864b23a640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f86440aea00 con 0x7f864415d4a0 2026-02-23T06:35:03.584 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.586+0000 7f864b23a640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f86440ae760 con 0x7f864415d870 2026-02-23T06:35:03.584 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.586+0000 7f864a238640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f86440b6690 0x7f8644120650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:03.584 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.587+0000 7f864a238640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f86440b6690 0x7f8644120650 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:54418/0 (socket says 10.20.193.58:54418) 2026-02-23T06:35:03.584 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.587+0000 7f864a238640 1 -- 10.20.193.58:0/3623113148 learned_addr learned my addr 10.20.193.58:0/3623113148 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:35:03.584 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.587+0000 7f8649a37640 1 --2- 10.20.193.58:0/3623113148 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f864415d4a0 0x7f86441249d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:03.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.587+0000 7f864a238640 1 -- 10.20.193.58:0/3623113148 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f864415d870 msgr2=0x7f8644124f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:03.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.587+0000 7f864a238640 1 --2- 10.20.193.58:0/3623113148 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f864415d870 0x7f8644124f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:03.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.587+0000 7f864a238640 1 -- 10.20.193.58:0/3623113148 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f864415d4a0 msgr2=0x7f86441249d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:03.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.587+0000 7f864a238640 1 --2- 10.20.193.58:0/3623113148 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f864415d4a0 0x7f86441249d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:03.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.587+0000 7f864a238640 1 -- 10.20.193.58:0/3623113148 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8638009570 con 0x7f86440b6690 2026-02-23T06:35:03.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.587+0000 7f8649a37640 1 --2- 10.20.193.58:0/3623113148 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f864415d4a0 0x7f86441249d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:35:03.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.587+0000 7f864a238640 1 --2- 10.20.193.58:0/3623113148 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f86440b6690 0x7f8644120650 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f863400c4d0 tx=0x7f863400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:35:03.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.587+0000 7f862affd640 1 -- 10.20.193.58:0/3623113148 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8634004250 con 0x7f86440b6690 2026-02-23T06:35:03.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.587+0000 7f862affd640 1 -- 10.20.193.58:0/3623113148 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f86340044a0 con 0x7f86440b6690 2026-02-23T06:35:03.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.587+0000 7f862affd640 1 -- 10.20.193.58:0/3623113148 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8634006b10 con 0x7f86440b6690 2026-02-23T06:35:03.586 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.587+0000 7f864b23a640 1 -- 10.20.193.58:0/3623113148 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f864414afd0 con 0x7f86440b6690 2026-02-23T06:35:03.586 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.587+0000 7f864b23a640 1 -- 10.20.193.58:0/3623113148 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f864414b590 con 0x7f86440b6690 2026-02-23T06:35:03.586 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.588+0000 7f864b23a640 1 --2- 10.20.193.58:0/3623113148 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8644161c40 0x7f864414b780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:03.586 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.588+0000 7f864b23a640 1 -- 10.20.193.58:0/3623113148 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f86440b6330 con 0x7f8644161c40 2026-02-23T06:35:03.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.589+0000 7f862affd640 1 -- 10.20.193.58:0/3623113148 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f8634003670 con 0x7f86440b6690 2026-02-23T06:35:03.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.589+0000 7f8649a37640 1 --2- 10.20.193.58:0/3623113148 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8644161c40 0x7f864414b780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:03.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.590+0000 7f8649a37640 1 -- 10.20.193.58:0/3623113148 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f86440b5e10 con 0x7f8644161c40 2026-02-23T06:35:03.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.590+0000 7f862affd640 1 --2- 10.20.193.58:0/3623113148 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f861407a6c0 0x7f861409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:03.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.590+0000 7f862affd640 1 -- 10.20.193.58:0/3623113148 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f863409d010 con 0x7f86440b6690 2026-02-23T06:35:03.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.590+0000 7f864aa39640 1 --2- 10.20.193.58:0/3623113148 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f861407a6c0 0x7f861409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:03.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.590+0000 7f8649a37640 1 --2- 10.20.193.58:0/3623113148 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8644161c40 0x7f864414b780 secure :-1 s=READY pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f864405c260 tx=0x7f8638002940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:35:03.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.591+0000 7f862affd640 1 -- 10.20.193.58:0/3623113148 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f863803f070 con 0x7f8644161c40 2026-02-23T06:35:03.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.591+0000 7f862affd640 1 -- 10.20.193.58:0/3623113148 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f8638038470 con 0x7f8644161c40 2026-02-23T06:35:03.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.591+0000 7f862affd640 1 -- 10.20.193.58:0/3623113148 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8644161c40 msgr2=0x7f864414b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:03.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.591+0000 7f862affd640 1 --2- 10.20.193.58:0/3623113148 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8644161c40 0x7f864414b780 secure :-1 s=READY pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f864405c260 tx=0x7f8638002940 comp rx=0 tx=0).stop 2026-02-23T06:35:03.589 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.591+0000 7f862affd640 1 -- 10.20.193.58:0/3623113148 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8644161c40 msgr2=0x7f864414b780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:35:03.589 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.591+0000 7f862affd640 1 --2- 10.20.193.58:0/3623113148 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8644161c40 0x7f864414b780 unknown :-1 s=CLOSED pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:03.589 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.591+0000 7f864aa39640 1 --2- 10.20.193.58:0/3623113148 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f861407a6c0 0x7f861409ab70 secure :-1 s=READY pgs=337 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8640005820 tx=0x7f8640006d70 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:35:03.590 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.595+0000 7f864b23a640 1 --2- 10.20.193.58:0/3623113148 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8644120120 0x7f8644122060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:03.590 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.595+0000 7f864b23a640 1 -- 10.20.193.58:0/3623113148 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f86440b6d50 con 0x7f8644120120 2026-02-23T06:35:03.590 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.595+0000 7f8649a37640 1 --2- 10.20.193.58:0/3623113148 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8644120120 0x7f8644122060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:03.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.596+0000 7f8649a37640 1 -- 10.20.193.58:0/3623113148 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f86440b06c0 con 0x7f8644120120 2026-02-23T06:35:03.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.596+0000 7f8649a37640 1 --2- 10.20.193.58:0/3623113148 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8644120120 0x7f8644122060 secure :-1 s=READY pgs=14 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86380023d0 tx=0x7f8638009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:35:03.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.596+0000 7f862affd640 1 -- 10.20.193.58:0/3623113148 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8638038de0 con 0x7f8644120120 2026-02-23T06:35:03.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.596+0000 7f862affd640 1 -- 10.20.193.58:0/3623113148 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4912 (secure 0 0 0) 0x7f8638052410 con 0x7f8644120120 2026-02-23T06:35:03.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.596+0000 7f862affd640 1 -- 10.20.193.58:0/3623113148 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8644120120 msgr2=0x7f8644122060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:03.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.596+0000 7f862affd640 1 --2- 10.20.193.58:0/3623113148 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8644120120 0x7f8644122060 secure :-1 s=READY pgs=14 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86380023d0 tx=0x7f8638009310 comp rx=0 tx=0).stop 2026-02-23T06:35:03.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.596+0000 7f862affd640 1 -- 10.20.193.58:0/3623113148 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8644120120 msgr2=0x7f8644122060 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:35:03.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.596+0000 7f862affd640 1 --2- 10.20.193.58:0/3623113148 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8644120120 0x7f8644122060 unknown :-1 s=CLOSED pgs=14 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:03.592 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:35:03.593 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:35:03.593 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:35:03.593 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:35:03.593 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 118, 2026-02-23T06:35:03.593 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 16180, 2026-02-23T06:35:03.593 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:35:03.593 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:35:03.593 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:35:03.593 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:35:03.593 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:03.594 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 16, 2026-02-23T06:35:03.594 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:35:03.594 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:35:03.594 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:35:03.594 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:35:03.594 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:35:03.594 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:35:03.594 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:35:03.594 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:35:03.594 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:35:03.595 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:35:03.595 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:35:03.595 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:35:03.595 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:35:03.595 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:35:03.595 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:35:03.595 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:35:03.595 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:03.595 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:35:03.595 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:35:03.595 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:35:03.596 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:35:03.596 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:35:03.596 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:35:03.596 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:35:03.596 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:35:03.596 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:35:03.596 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:35:03.596 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:35:03.596 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:35:03.596 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:35:03.596 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:35:03.596 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:35:03.597 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:03.597 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.597 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:35:03.597 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:35:03.597 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:35:03.597 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:35:03.597 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:35:03.597 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:35:03.597 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:35:03.597 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:35:03.597 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:35:03.598 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:35:03.598 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:35:03.598 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:35:03.598 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:35:03.598 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:35:03.598 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:35:03.598 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:35:03.598 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:35:03.598 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:35:03.598 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:35:03.598 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:35:03.598 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:35:03.599 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:35:03.599 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:35:03.599 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:35:03.599 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:35:03.599 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:35:03.599 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:35:03.599 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:35:03.599 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:35:03.599 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:35:03.599 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:03.599 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:35:03.599 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.600 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:35:03.600 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.600 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:35:03.600 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:35:03.600 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:35:03.600 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:35:03.600 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.600 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:35:03.600 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:35:03.600 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:03.600 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.601 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.601 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:35:03.601 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:35:03.601 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:03.601 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:03.601 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:03.601 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.601 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:35:03.601 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:35:03.601 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:35:03.601 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:35:03.601 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:35:03.601 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:35:03.602 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.602 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.602 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:35:03.602 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:35:03.602 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:35:03.602 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:35:03.602 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.602 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:35:03.602 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:35:03.602 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:03.602 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.602 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.603 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:35:03.603 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:35:03.603 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:03.603 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:03.603 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:03.603 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.603 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:35:03.603 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:35:03.603 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:35:03.603 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:35:03.603 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:35:03.603 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:35:03.604 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.604 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.604 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:35:03.604 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:35:03.604 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:35:03.604 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:35:03.604 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.604 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:35:03.604 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:35:03.604 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:03.604 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.605 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.605 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:35:03.605 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:35:03.605 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:03.605 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:03.605 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:03.605 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.605 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:35:03.605 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:35:03.605 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:35:03.605 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:35:03.605 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:35:03.606 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:35:03.606 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:03.606 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:03.606 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.606 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:35:03.606 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:35:03.606 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.606 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:35:03.606 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:35:03.606 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:35:03.606 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:03.606 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:03.606 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:35:03.607 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.607 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:35:03.607 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:35:03.607 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:35:03.607 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:03.607 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:03.607 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.607 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:35:03.607 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:35:03.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.596+0000 7f864b23a640 1 -- 10.20.193.58:0/3623113148 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f861407a6c0 msgr2=0x7f861409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:03.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.596+0000 7f864b23a640 1 --2- 10.20.193.58:0/3623113148 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f861407a6c0 0x7f861409ab70 secure :-1 s=READY pgs=337 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8640005820 tx=0x7f8640006d70 comp rx=0 tx=0).stop 2026-02-23T06:35:03.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.596+0000 7f864b23a640 1 -- 10.20.193.58:0/3623113148 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f86440b6690 msgr2=0x7f8644120650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:03.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.596+0000 7f864b23a640 1 --2- 10.20.193.58:0/3623113148 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f86440b6690 0x7f8644120650 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f863400c4d0 tx=0x7f863400c9a0 comp rx=0 tx=0).stop 2026-02-23T06:35:03.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.597+0000 7f864aa39640 1 -- 10.20.193.58:0/3623113148 reap_dead start 2026-02-23T06:35:03.610 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.597+0000 7f864aa39640 1 -- 10.20.193.58:0/3623113148 reap_dead start 2026-02-23T06:35:03.610 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.597+0000 7f864b23a640 1 -- 10.20.193.58:0/3623113148 shutdown_connections 2026-02-23T06:35:03.610 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.597+0000 7f864b23a640 1 -- 10.20.193.58:0/3623113148 >> 10.20.193.58:0/3623113148 conn(0x7f86440b3c20 msgr2=0x7f8644163690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:35:03.610 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.597+0000 7f864b23a640 1 -- 10.20.193.58:0/3623113148 shutdown_connections 2026-02-23T06:35:03.610 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.597+0000 7f864b23a640 1 -- 10.20.193.58:0/3623113148 wait complete. 2026-02-23T06:35:03.610 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:35:03.610 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:35:03.611 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:35:03.734 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.739+0000 7f8854e83640 1 -- 10.20.193.58:0/2250150923 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8834004850 msgr2=0x7f8834004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:03.734 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.739+0000 7f8854e83640 1 --2- 10.20.193.58:0/2250150923 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8834004850 0x7f8834004cc0 secure :-1 s=READY pgs=253 gs=4 cs=0 l=1 c_cookie=14130686601231228729 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8840003130 tx=0x7f884002f8e0 comp rx=0 tx=0).stop 2026-02-23T06:35:03.734 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.739+0000 7f8854e83640 1 -- 10.20.193.58:0/2250150923 shutdown_connections 2026-02-23T06:35:03.734 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.739+0000 7f8854e83640 1 --2- 10.20.193.58:0/2250150923 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8834004850 0x7f8834004cc0 unknown :-1 s=CLOSED pgs=253 gs=4 cs=0 l=1 c_cookie=14130686601231228729 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:03.734 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.739+0000 7f8854e83640 1 -- 10.20.193.58:0/2250150923 >> 10.20.193.58:0/2250150923 conn(0x7f88500b3c20 msgr2=0x7f88500b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:35:03.734 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.739+0000 7f8854e83640 1 -- 10.20.193.58:0/2250150923 shutdown_connections 2026-02-23T06:35:03.734 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.739+0000 7f8854e83640 1 -- 10.20.193.58:0/2250150923 wait complete. 2026-02-23T06:35:03.735 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.740+0000 7f8854e83640 1 Processor -- start 2026-02-23T06:35:03.735 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.741+0000 7f8854e83640 1 -- start start 2026-02-23T06:35:03.736 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.741+0000 7f8854e83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8834004850 0x7f8850058780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:03.736 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.741+0000 7f8854e83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88501381f0 0x7f88501374e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:03.736 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.741+0000 7f8854e83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8850137a20 0x7f8850139cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:03.736 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.741+0000 7f8854e83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f8850139270 con 0x7f8834004850 2026-02-23T06:35:03.736 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.741+0000 7f8854e83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f88501389a0 con 0x7f8850137a20 2026-02-23T06:35:03.736 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.741+0000 7f8854e83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f88501364a0 con 0x7f88501381f0 2026-02-23T06:35:03.736 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.741+0000 7f884f7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8834004850 0x7f8850058780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:03.736 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.741+0000 7f884f7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8834004850 0x7f8850058780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:54428/0 (socket says 10.20.193.58:54428) 2026-02-23T06:35:03.736 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.741+0000 7f884f7fe640 1 -- 10.20.193.58:0/3606656552 learned_addr learned my addr 10.20.193.58:0/3606656552 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:35:03.736 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.741+0000 7f884effd640 1 --2- 10.20.193.58:0/3606656552 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88501381f0 0x7f88501374e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:03.736 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.741+0000 7f884ffff640 1 --2- 10.20.193.58:0/3606656552 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8850137a20 0x7f8850139cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:03.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.742+0000 7f884f7fe640 1 -- 10.20.193.58:0/3606656552 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88501381f0 msgr2=0x7f88501374e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:03.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.742+0000 7f884f7fe640 1 --2- 10.20.193.58:0/3606656552 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88501381f0 0x7f88501374e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:03.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.742+0000 7f884f7fe640 1 -- 10.20.193.58:0/3606656552 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8850137a20 msgr2=0x7f8850139cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:03.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.742+0000 7f884f7fe640 1 --2- 10.20.193.58:0/3606656552 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8850137a20 0x7f8850139cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:03.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.742+0000 7f884f7fe640 1 -- 10.20.193.58:0/3606656552 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8850136cb0 con 0x7f8834004850 2026-02-23T06:35:03.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.742+0000 7f884f7fe640 1 --2- 10.20.193.58:0/3606656552 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8834004850 0x7f8850058780 secure :-1 s=READY pgs=112 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f883c002900 tx=0x7f883c002a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:35:03.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.742+0000 7f882bfff640 1 -- 10.20.193.58:0/3606656552 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f883c004850 con 0x7f8834004850 2026-02-23T06:35:03.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.742+0000 7f882bfff640 1 -- 10.20.193.58:0/3606656552 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f883c0049b0 con 0x7f8834004850 2026-02-23T06:35:03.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.742+0000 7f8854e83640 1 -- 10.20.193.58:0/3606656552 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88501366f0 con 0x7f8834004850 2026-02-23T06:35:03.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.742+0000 7f882bfff640 1 -- 10.20.193.58:0/3606656552 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f883c004da0 con 0x7f8834004850 2026-02-23T06:35:03.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.742+0000 7f8854e83640 1 -- 10.20.193.58:0/3606656552 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8850138bb0 con 0x7f8834004850 2026-02-23T06:35:03.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.743+0000 7f8854e83640 1 --2- 10.20.193.58:0/3606656552 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f885013a200 0x7f8850153ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:03.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.743+0000 7f8854e83640 1 -- 10.20.193.58:0/3606656552 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f885005d9c0 con 0x7f885013a200 2026-02-23T06:35:03.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.743+0000 7f884effd640 1 --2- 10.20.193.58:0/3606656552 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f885013a200 0x7f8850153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:03.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.743+0000 7f884effd640 1 -- 10.20.193.58:0/3606656552 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f885015c410 con 0x7f885013a200 2026-02-23T06:35:03.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.743+0000 7f884effd640 1 --2- 10.20.193.58:0/3606656552 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f885013a200 0x7f8850153ca0 secure :-1 s=READY pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f885015f9f0 tx=0x7f8840003480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:35:03.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.744+0000 7f882bfff640 1 -- 10.20.193.58:0/3606656552 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f884003f030 con 0x7f885013a200 2026-02-23T06:35:03.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.744+0000 7f882bfff640 1 -- 10.20.193.58:0/3606656552 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f8840040040 con 0x7f885013a200 2026-02-23T06:35:03.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.744+0000 7f882bfff640 1 -- 10.20.193.58:0/3606656552 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f885013a200 msgr2=0x7f8850153ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:03.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.744+0000 7f882bfff640 1 --2- 10.20.193.58:0/3606656552 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f885013a200 0x7f8850153ca0 secure :-1 s=READY pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f885015f9f0 tx=0x7f8840003480 comp rx=0 tx=0).stop 2026-02-23T06:35:03.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.744+0000 7f882bfff640 1 -- 10.20.193.58:0/3606656552 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f885013a200 msgr2=0x7f8850153ca0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:35:03.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.744+0000 7f882bfff640 1 --2- 10.20.193.58:0/3606656552 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f885013a200 0x7f8850153ca0 secure :-1 s=CLOSED pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f885015f9f0 tx=0x7f8840003480 comp rx=0 tx=0).stop 2026-02-23T06:35:03.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.744+0000 7f882bfff640 1 -- 10.20.193.58:0/3606656552 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f883c020060 con 0x7f8834004850 2026-02-23T06:35:03.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.745+0000 7f882bfff640 1 --2- 10.20.193.58:0/3606656552 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f882007a4a0 0x7f882009a950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:03.740 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.745+0000 7f882bfff640 1 -- 10.20.193.58:0/3606656552 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f883c09da00 con 0x7f8834004850 2026-02-23T06:35:03.740 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.745+0000 7f884effd640 1 --2- 10.20.193.58:0/3606656552 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f882007a4a0 0x7f882009a950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:03.740 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.746+0000 7f884effd640 1 --2- 10.20.193.58:0/3606656552 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f882007a4a0 0x7f882009a950 secure :-1 s=READY pgs=338 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88400067b0 tx=0x7f8840004000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:35:03.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.748+0000 7f8854e83640 1 --2- 10.20.193.58:0/3606656552 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88501541e0 0x7f88501545d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:03.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.748+0000 7f8854e83640 1 -- 10.20.193.58:0/3606656552 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f88501393b0 con 0x7f88501541e0 2026-02-23T06:35:03.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.748+0000 7f884ffff640 1 --2- 10.20.193.58:0/3606656552 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88501541e0 0x7f88501545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:03.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.748+0000 7f884ffff640 1 -- 10.20.193.58:0/3606656552 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8850154b10 con 0x7f88501541e0 2026-02-23T06:35:03.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.748+0000 7f884ffff640 1 --2- 10.20.193.58:0/3606656552 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88501541e0 0x7f88501545d0 secure :-1 s=READY pgs=255 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88500b50c0 tx=0x7f8844011b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:35:03.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.748+0000 7f882bfff640 1 -- 10.20.193.58:0/3606656552 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8844013660 con 0x7f88501541e0 2026-02-23T06:35:03.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.749+0000 7f882bfff640 1 -- 10.20.193.58:0/3606656552 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5557 (secure 0 0 0) 0x7f88440137c0 con 0x7f88501541e0 2026-02-23T06:35:03.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.749+0000 7f882bfff640 1 -- 10.20.193.58:0/3606656552 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88501541e0 msgr2=0x7f88501545d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:03.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.749+0000 7f882bfff640 1 --2- 10.20.193.58:0/3606656552 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88501541e0 0x7f88501545d0 secure :-1 s=READY pgs=255 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88500b50c0 tx=0x7f8844011b10 comp rx=0 tx=0).stop 2026-02-23T06:35:03.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.749+0000 7f882bfff640 1 -- 10.20.193.58:0/3606656552 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88501541e0 msgr2=0x7f88501545d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:35:03.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.749+0000 7f882bfff640 1 --2- 10.20.193.58:0/3606656552 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f88501541e0 0x7f88501545d0 secure :-1 s=CLOSED pgs=255 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88500b50c0 tx=0x7f8844011b10 comp rx=0 tx=0).stop 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 118, 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 578260, 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 16, 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:35:03.744 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:35:03.745 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:35:03.745 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:35:03.745 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:35:03.745 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:35:03.745 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:35:03.745 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:35:03.745 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:35:03.745 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:35:03.745 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:35:03.745 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:35:03.745 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:35:03.745 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:35:03.745 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:03.745 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.745 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:35:03.745 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:35:03.745 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:35:03.745 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:35:03.745 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:35:03.745 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:35:03.745 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:35:03.745 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:35:03.746 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:35:03.746 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:35:03.746 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:35:03.746 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:35:03.746 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:35:03.746 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:35:03.746 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:35:03.746 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:35:03.746 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:35:03.746 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:35:03.746 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:35:03.746 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:35:03.746 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:35:03.746 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:35:03.746 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:35:03.746 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:35:03.746 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:35:03.746 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:35:03.746 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:35:03.746 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:35:03.746 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:35:03.747 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:35:03.747 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:03.747 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:35:03.747 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.747 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:35:03.747 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.747 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:35:03.747 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:35:03.747 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:35:03.747 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:35:03.747 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.747 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:35:03.747 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:35:03.747 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:03.747 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.747 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.747 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:35:03.747 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:35:03.747 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:03.747 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:03.747 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:03.748 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.748 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:35:03.748 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:35:03.748 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:35:03.748 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:35:03.748 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:35:03.748 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:35:03.748 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.748 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.748 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:35:03.748 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:35:03.748 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:35:03.748 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:35:03.748 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.748 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:35:03.748 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:35:03.748 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:03.748 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.748 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.748 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:35:03.748 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:35:03.749 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:03.749 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:03.749 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:03.749 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.749 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:35:03.749 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:35:03.749 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:35:03.749 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:35:03.749 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:35:03.749 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:35:03.749 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.749 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.749 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:35:03.749 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:35:03.749 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:35:03.749 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:35:03.749 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.749 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:35:03.749 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:35:03.749 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:03.749 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.750 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.750 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:35:03.750 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:35:03.750 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:03.750 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:03.750 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:03.750 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.750 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:35:03.750 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:35:03.750 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:35:03.750 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:35:03.750 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:35:03.750 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:35:03.750 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:03.750 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:03.750 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.750 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:35:03.750 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:35:03.750 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.750 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:35:03.750 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:35:03.751 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:35:03.751 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:03.751 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:03.751 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:35:03.751 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.751 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:35:03.751 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:35:03.751 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:35:03.751 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:03.751 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:03.751 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:35:03.751 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.751 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:35:03.751 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:35:03.751 INFO:teuthology.orchestra.run.trial058.stdout: "num": 8 2026-02-23T06:35:03.751 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:03.751 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:03.751 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:35:03.751 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.751 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:35:03.751 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:35:03.752 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:35:03.752 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.752 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.752 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:35:03.752 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:35:03.752 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:35:03.752 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:03.752 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:03.752 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:35:03.752 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:03.752 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:35:03.752 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:35:03.752 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:35:03.752 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:03.752 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:03.752 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:03.752 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:35:03.752 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:35:03.753 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.749+0000 7f8854e83640 1 -- 10.20.193.58:0/3606656552 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f882007a4a0 msgr2=0x7f882009a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:03.753 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.749+0000 7f8854e83640 1 --2- 10.20.193.58:0/3606656552 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f882007a4a0 0x7f882009a950 secure :-1 s=READY pgs=338 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88400067b0 tx=0x7f8840004000 comp rx=0 tx=0).stop 2026-02-23T06:35:03.754 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.749+0000 7f8854e83640 1 -- 10.20.193.58:0/3606656552 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8834004850 msgr2=0x7f8850058780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:03.754 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.749+0000 7f8854e83640 1 --2- 10.20.193.58:0/3606656552 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8834004850 0x7f8850058780 secure :-1 s=READY pgs=112 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f883c002900 tx=0x7f883c002a00 comp rx=0 tx=0).stop 2026-02-23T06:35:03.754 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.749+0000 7f884ffff640 1 -- 10.20.193.58:0/3606656552 reap_dead start 2026-02-23T06:35:03.754 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.749+0000 7f884ffff640 1 -- 10.20.193.58:0/3606656552 reap_dead start 2026-02-23T06:35:03.754 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.749+0000 7f8854e83640 1 -- 10.20.193.58:0/3606656552 shutdown_connections 2026-02-23T06:35:03.754 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.749+0000 7f8854e83640 1 -- 10.20.193.58:0/3606656552 >> 10.20.193.58:0/3606656552 conn(0x7f88500b3c20 msgr2=0x7f8850159ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:35:03.754 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.749+0000 7f8854e83640 1 -- 10.20.193.58:0/3606656552 shutdown_connections 2026-02-23T06:35:03.754 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:03.749+0000 7f8854e83640 1 -- 10.20.193.58:0/3606656552 wait complete. 2026-02-23T06:35:03.754 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:35:03.754 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-23T06:35:03.754 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2026-02-23T06:35:03.754 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-23T06:35:03.755 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-23T06:35:03.755 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-23T06:35:03.755 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:35:03.766 INFO:tasks.ceph.mon.c:Stopped 2026-02-23T06:35:03.766 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.a 2026-02-23T06:35:03.767 INFO:tasks.mon_thrash:Sending STOP to mon a 2026-02-23T06:35:03.767 INFO:tasks.ceph.mon.a:Sent signal 19 2026-02-23T06:35:03.767 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-23T06:35:13.507 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:35:13.511 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:35:18.768 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.a 2026-02-23T06:35:18.768 INFO:tasks.mon_thrash:Sending CONT to mon a 2026-02-23T06:35:18.769 INFO:tasks.ceph.mon.a:Sent signal 18 2026-02-23T06:35:18.769 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:35:18.769 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:35:24.376 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.380+0000 7f29d0a83640 1 -- 10.20.193.58:0/3619900300 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f29b0003a30 msgr2=0x7f29b0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:24.376 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.380+0000 7f29d0a83640 1 --2- 10.20.193.58:0/3619900300 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f29b0003a30 0x7f29b0003e20 secure :-1 s=READY pgs=128 gs=23 cs=0 l=1 c_cookie=6515302597573480487 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29b800c610 tx=0x7f29b802fca0 comp rx=0 tx=0).stop 2026-02-23T06:35:24.376 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.380+0000 7f29d0a83640 1 -- 10.20.193.58:0/3619900300 shutdown_connections 2026-02-23T06:35:24.376 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.380+0000 7f29d0a83640 1 --2- 10.20.193.58:0/3619900300 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f29b0005320 0x7f29b0065a10 unknown :-1 s=CLOSED pgs=0 gs=25 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:24.376 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.380+0000 7f29d0a83640 1 --2- 10.20.193.58:0/3619900300 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f29b0004850 0x7f29b0004cc0 unknown :-1 s=CLOSED pgs=0 gs=24 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:24.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.380+0000 7f29d0a83640 1 --2- 10.20.193.58:0/3619900300 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f29b0003a30 0x7f29b0003e20 unknown :-1 s=CLOSED pgs=128 gs=23 cs=0 l=1 c_cookie=6515302597573480487 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:24.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.380+0000 7f29d0a83640 1 -- 10.20.193.58:0/3619900300 >> 10.20.193.58:0/3619900300 conn(0x7f29cc0b3c20 msgr2=0x7f29cc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:35:24.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.380+0000 7f29d0a83640 1 -- 10.20.193.58:0/3619900300 shutdown_connections 2026-02-23T06:35:24.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.380+0000 7f29d0a83640 1 -- 10.20.193.58:0/3619900300 wait complete. 2026-02-23T06:35:24.379 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.381+0000 7f29d0a83640 1 Processor -- start 2026-02-23T06:35:24.379 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.381+0000 7f29d0a83640 1 -- start start 2026-02-23T06:35:24.379 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.382+0000 7f29d0a83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f29b0003a30 0x7f29cc137f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:24.379 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.382+0000 7f29d0a83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f29b0004850 0x7f29cc1388c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:24.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.382+0000 7f29d0a83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f29b0005320 0x7f29cc13a910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:24.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.382+0000 7f29d0a83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f29cc058f90 con 0x7f29b0004850 2026-02-23T06:35:24.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.382+0000 7f29d0a83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f29cc0572b0 con 0x7f29b0005320 2026-02-23T06:35:24.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.382+0000 7f29d0a83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f29cc1384a0 con 0x7f29b0003a30 2026-02-23T06:35:24.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.382+0000 7f29cb7fe640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f29b0003a30 msgr2=0x7f29cc137f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:35:24.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.382+0000 7f29cb7fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f29b0003a30 0x7f29cc137f60 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:35:24.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.382+0000 7f29caffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f29b0004850 0x7f29cc1388c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:24.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.382+0000 7f29caffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f29b0004850 0x7f29cc1388c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:33182/0 (socket says 10.20.193.58:33182) 2026-02-23T06:35:24.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.382+0000 7f29caffd640 1 -- 10.20.193.58:0/2590209281 learned_addr learned my addr 10.20.193.58:0/2590209281 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:35:24.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.382+0000 7f29cbfff640 1 --2- 10.20.193.58:0/2590209281 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f29b0005320 0x7f29cc13a910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:24.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.382+0000 7f29caffd640 1 -- 10.20.193.58:0/2590209281 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f29b0003a30 msgr2=0x7f29cc137f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:35:24.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.382+0000 7f29caffd640 1 --2- 10.20.193.58:0/2590209281 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f29b0003a30 0x7f29cc137f60 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:24.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.382+0000 7f29caffd640 1 -- 10.20.193.58:0/2590209281 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f29b0005320 msgr2=0x7f29cc13a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:24.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.382+0000 7f29caffd640 1 --2- 10.20.193.58:0/2590209281 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f29b0005320 0x7f29cc13a910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:24.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.382+0000 7f29caffd640 1 -- 10.20.193.58:0/2590209281 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29cc165350 con 0x7f29b0004850 2026-02-23T06:35:24.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.383+0000 7f29caffd640 1 --2- 10.20.193.58:0/2590209281 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f29b0004850 0x7f29cc1388c0 secure :-1 s=READY pgs=129 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29bc013680 tx=0x7f29bc013b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:35:24.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.383+0000 7f29a7fff640 1 -- 10.20.193.58:0/2590209281 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f29bc018070 con 0x7f29b0004850 2026-02-23T06:35:24.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.383+0000 7f29a7fff640 1 -- 10.20.193.58:0/2590209281 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29bc0129c0 con 0x7f29b0004850 2026-02-23T06:35:24.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.383+0000 7f29d0a83640 1 -- 10.20.193.58:0/2590209281 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29cc058c90 con 0x7f29b0004850 2026-02-23T06:35:24.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.383+0000 7f29a7fff640 1 -- 10.20.193.58:0/2590209281 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f29bc012df0 con 0x7f29b0004850 2026-02-23T06:35:24.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.383+0000 7f29d0a83640 1 -- 10.20.193.58:0/2590209281 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29cc059290 con 0x7f29b0004850 2026-02-23T06:35:24.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.384+0000 7f29d0a83640 1 -- 10.20.193.58:0/2590209281 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29cc0b5aa0 con 0x7f29b0004850 2026-02-23T06:35:24.382 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.385+0000 7f29a7fff640 1 -- 10.20.193.58:0/2590209281 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f29bc004110 con 0x7f29b0004850 2026-02-23T06:35:24.382 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.386+0000 7f29a7fff640 1 --2- 10.20.193.58:0/2590209281 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f299c07a5b0 0x7f299c09aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:24.382 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.386+0000 7f29a7fff640 1 -- 10.20.193.58:0/2590209281 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f29bc09e950 con 0x7f29b0004850 2026-02-23T06:35:24.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.386+0000 7f29cb7fe640 1 --2- 10.20.193.58:0/2590209281 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f299c07a5b0 0x7f299c09aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:24.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.387+0000 7f29cb7fe640 1 --2- 10.20.193.58:0/2590209281 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f299c07a5b0 0x7f299c09aa60 secure :-1 s=READY pgs=339 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29b80028f0 tx=0x7f29b8004440 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:35:24.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.388+0000 7f29a7fff640 1 -- 10.20.193.58:0/2590209281 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f29bc061b10 con 0x7f29b0004850 2026-02-23T06:35:24.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.541+0000 7f29d0a83640 1 -- 10.20.193.58:0/2590209281 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f29cc056330 con 0x7f29b0004850 2026-02-23T06:35:24.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.542+0000 7f29a7fff640 1 -- 10.20.193.58:0/2590209281 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1749 (secure 0 0 0) 0x7f29bc064c30 con 0x7f29b0004850 2026-02-23T06:35:24.538 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":122,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:35:24.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.543+0000 7f29d0a83640 1 -- 10.20.193.58:0/2590209281 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f299c07a5b0 msgr2=0x7f299c09aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:24.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.543+0000 7f29d0a83640 1 --2- 10.20.193.58:0/2590209281 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f299c07a5b0 0x7f299c09aa60 secure :-1 s=READY pgs=339 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29b80028f0 tx=0x7f29b8004440 comp rx=0 tx=0).stop 2026-02-23T06:35:24.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.543+0000 7f29d0a83640 1 -- 10.20.193.58:0/2590209281 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f29b0004850 msgr2=0x7f29cc1388c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:24.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.543+0000 7f29d0a83640 1 --2- 10.20.193.58:0/2590209281 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f29b0004850 0x7f29cc1388c0 secure :-1 s=READY pgs=129 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29bc013680 tx=0x7f29bc013b50 comp rx=0 tx=0).stop 2026-02-23T06:35:24.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.543+0000 7f29d0a83640 1 -- 10.20.193.58:0/2590209281 shutdown_connections 2026-02-23T06:35:24.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.543+0000 7f29d0a83640 1 --2- 10.20.193.58:0/2590209281 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f299c07a5b0 0x7f299c09aa60 unknown :-1 s=CLOSED pgs=339 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:24.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.543+0000 7f29d0a83640 1 --2- 10.20.193.58:0/2590209281 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f29b0005320 0x7f29cc13a910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:24.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.543+0000 7f29d0a83640 1 --2- 10.20.193.58:0/2590209281 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f29b0004850 0x7f29cc1388c0 unknown :-1 s=CLOSED pgs=129 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:24.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.543+0000 7f29d0a83640 1 --2- 10.20.193.58:0/2590209281 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f29b0003a30 0x7f29cc137f60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:24.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.543+0000 7f29d0a83640 1 -- 10.20.193.58:0/2590209281 >> 10.20.193.58:0/2590209281 conn(0x7f29cc0b3c20 msgr2=0x7f29cc15a690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:35:24.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.543+0000 7f29d0a83640 1 -- 10.20.193.58:0/2590209281 shutdown_connections 2026-02-23T06:35:24.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.543+0000 7f29d0a83640 1 -- 10.20.193.58:0/2590209281 wait complete. 2026-02-23T06:35:24.551 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:35:24.552 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-23T06:35:24.552 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:35:24.676 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.680+0000 7f6313577640 1 -- 10.20.193.58:0/107807756 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6300004c40 msgr2=0x7f6300005010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:24.677 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.680+0000 7f6313577640 1 --2- 10.20.193.58:0/107807756 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6300004c40 0x7f6300005010 secure :-1 s=READY pgs=131 gs=4 cs=0 l=1 c_cookie=2807108949666679501 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6308006f70 tx=0x7f630802f860 comp rx=0 tx=0).stop 2026-02-23T06:35:24.677 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.680+0000 7f6312d76640 1 -- 10.20.193.58:0/107807756 reap_dead start 2026-02-23T06:35:24.677 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.681+0000 7f6313577640 1 -- 10.20.193.58:0/107807756 shutdown_connections 2026-02-23T06:35:24.677 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.681+0000 7f6313577640 1 -- 10.20.193.58:0/107807756 >> 10.20.193.58:0/107807756 conn(0x7f63140b3c20 msgr2=0x7f63140b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:35:24.677 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.681+0000 7f6313577640 1 -- 10.20.193.58:0/107807756 shutdown_connections 2026-02-23T06:35:24.677 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.681+0000 7f6313577640 1 -- 10.20.193.58:0/107807756 wait complete. 2026-02-23T06:35:24.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.682+0000 7f6313577640 1 Processor -- start 2026-02-23T06:35:24.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.682+0000 7f6313577640 1 -- start start 2026-02-23T06:35:24.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.683+0000 7f6313577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6300004c40 0x7f63140af6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:24.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.683+0000 7f6313577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f63140af190 0x7f6314201400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:24.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.683+0000 7f6313577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f631415ef60 0x7f63141592e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:24.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.683+0000 7f6313577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f631415f850 con 0x7f63140af190 2026-02-23T06:35:24.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.683+0000 7f6313577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f63142009b0 con 0x7f6300004c40 2026-02-23T06:35:24.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.683+0000 7f6313577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f6314159820 con 0x7f631415ef60 2026-02-23T06:35:24.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.683+0000 7f6312d76640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f631415ef60 msgr2=0x7f63141592e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:35:24.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.683+0000 7f6312d76640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f631415ef60 0x7f63141592e0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:35:24.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.683+0000 7f6312575640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6300004c40 0x7f63140af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:24.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.683+0000 7f6312575640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6300004c40 0x7f63140af6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:37542/0 (socket says 10.20.193.58:37542) 2026-02-23T06:35:24.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.683+0000 7f6312575640 1 -- 10.20.193.58:0/580230202 learned_addr learned my addr 10.20.193.58:0/580230202 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:35:24.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.683+0000 7f6311d74640 1 --2- 10.20.193.58:0/580230202 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f63140af190 0x7f6314201400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:24.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.683+0000 7f6312575640 1 -- 10.20.193.58:0/580230202 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f631415ef60 msgr2=0x7f63141592e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:35:24.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.683+0000 7f6312575640 1 --2- 10.20.193.58:0/580230202 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f631415ef60 0x7f63141592e0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:24.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.683+0000 7f6312575640 1 -- 10.20.193.58:0/580230202 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f63140af190 msgr2=0x7f6314201400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:24.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.683+0000 7f6312575640 1 --2- 10.20.193.58:0/580230202 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f63140af190 0x7f6314201400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:24.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.683+0000 7f6312575640 1 -- 10.20.193.58:0/580230202 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f631415f400 con 0x7f6300004c40 2026-02-23T06:35:24.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.683+0000 7f6311d74640 1 --2- 10.20.193.58:0/580230202 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f63140af190 0x7f6314201400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:35:24.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.684+0000 7f6312575640 1 --2- 10.20.193.58:0/580230202 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6300004c40 0x7f63140af6f0 secure :-1 s=READY pgs=38 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63080028e0 tx=0x7f63080034f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:35:24.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.684+0000 7f62faffd640 1 -- 10.20.193.58:0/580230202 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6308040070 con 0x7f6300004c40 2026-02-23T06:35:24.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.684+0000 7f62faffd640 1 -- 10.20.193.58:0/580230202 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6308003ac0 con 0x7f6300004c40 2026-02-23T06:35:24.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.684+0000 7f6313577640 1 -- 10.20.193.58:0/580230202 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f631415e0b0 con 0x7f6300004c40 2026-02-23T06:35:24.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.684+0000 7f62faffd640 1 -- 10.20.193.58:0/580230202 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6308006290 con 0x7f6300004c40 2026-02-23T06:35:24.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.684+0000 7f6313577640 1 -- 10.20.193.58:0/580230202 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6314200c00 con 0x7f6300004c40 2026-02-23T06:35:24.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.684+0000 7f6313577640 1 --2- 10.20.193.58:0/580230202 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6314200dc0 0x7f631413c090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:24.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.684+0000 7f6313577640 1 -- 10.20.193.58:0/580230202 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f63140609c0 con 0x7f6314200dc0 2026-02-23T06:35:24.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.685+0000 7f6311d74640 1 --2- 10.20.193.58:0/580230202 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6314200dc0 0x7f631413c090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:24.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.685+0000 7f6311d74640 1 -- 10.20.193.58:0/580230202 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6314059690 con 0x7f6314200dc0 2026-02-23T06:35:24.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.685+0000 7f6311d74640 1 --2- 10.20.193.58:0/580230202 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6314200dc0 0x7f631413c090 secure :-1 s=READY pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f62fc002820 tx=0x7f62fc009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:35:24.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.685+0000 7f62faffd640 1 -- 10.20.193.58:0/580230202 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f62fc011d10 con 0x7f6314200dc0 2026-02-23T06:35:24.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.685+0000 7f62faffd640 1 -- 10.20.193.58:0/580230202 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f62fc011e70 con 0x7f6314200dc0 2026-02-23T06:35:24.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.685+0000 7f62faffd640 1 -- 10.20.193.58:0/580230202 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6314200dc0 msgr2=0x7f631413c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:24.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.685+0000 7f62faffd640 1 --2- 10.20.193.58:0/580230202 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6314200dc0 0x7f631413c090 secure :-1 s=READY pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f62fc002820 tx=0x7f62fc009ec0 comp rx=0 tx=0).stop 2026-02-23T06:35:24.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.685+0000 7f62faffd640 1 -- 10.20.193.58:0/580230202 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6314200dc0 msgr2=0x7f631413c090 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:35:24.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.685+0000 7f62faffd640 1 --2- 10.20.193.58:0/580230202 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6314200dc0 0x7f631413c090 secure :-1 s=CLOSED pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f62fc002820 tx=0x7f62fc009ec0 comp rx=0 tx=0).stop 2026-02-23T06:35:24.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.686+0000 7f62faffd640 1 -- 10.20.193.58:0/580230202 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f6308046430 con 0x7f6300004c40 2026-02-23T06:35:24.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.687+0000 7f62faffd640 1 --2- 10.20.193.58:0/580230202 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f62e007a430 0x7f62e009a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:24.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.687+0000 7f62faffd640 1 -- 10.20.193.58:0/580230202 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f63080c2b60 con 0x7f6300004c40 2026-02-23T06:35:24.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.689+0000 7f6313577640 1 --2- 10.20.193.58:0/580230202 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f631413c5d0 0x7f631415ad60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:24.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.689+0000 7f6313577640 1 -- 10.20.193.58:0/580230202 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f631413c9c0 con 0x7f631413c5d0 2026-02-23T06:35:24.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.689+0000 7f6311d74640 1 --2- 10.20.193.58:0/580230202 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f62e007a430 0x7f62e009a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:24.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.689+0000 7f6312d76640 1 --2- 10.20.193.58:0/580230202 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f631413c5d0 0x7f631415ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:24.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.689+0000 7f6312d76640 1 -- 10.20.193.58:0/580230202 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f63140593b0 con 0x7f631413c5d0 2026-02-23T06:35:24.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.689+0000 7f6312d76640 1 --2- 10.20.193.58:0/580230202 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f631413c5d0 0x7f631415ad60 secure :-1 s=READY pgs=133 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f631415fe10 tx=0x7f630400d450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:35:24.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.690+0000 7f62faffd640 1 -- 10.20.193.58:0/580230202 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6304006e50 con 0x7f631413c5d0 2026-02-23T06:35:24.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.690+0000 7f6311d74640 1 --2- 10.20.193.58:0/580230202 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f62e007a430 0x7f62e009a8e0 secure :-1 s=READY pgs=340 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f62fc002820 tx=0x7f62fc00e000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:35:24.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.690+0000 7f62faffd640 1 -- 10.20.193.58:0/580230202 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5547 (secure 0 0 0) 0x7f630400d810 con 0x7f631413c5d0 2026-02-23T06:35:24.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.690+0000 7f62faffd640 1 -- 10.20.193.58:0/580230202 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f631413c5d0 msgr2=0x7f631415ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:24.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.690+0000 7f62faffd640 1 --2- 10.20.193.58:0/580230202 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f631413c5d0 0x7f631415ad60 secure :-1 s=READY pgs=133 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f631415fe10 tx=0x7f630400d450 comp rx=0 tx=0).stop 2026-02-23T06:35:24.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.690+0000 7f62faffd640 1 -- 10.20.193.58:0/580230202 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f631413c5d0 msgr2=0x7f631415ad60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:35:24.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.690+0000 7f62faffd640 1 --2- 10.20.193.58:0/580230202 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f631413c5d0 0x7f631415ad60 unknown :-1 s=CLOSED pgs=133 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:24.687 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:35:24.687 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:35:24.687 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:35:24.687 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:35:24.688 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 122, 2026-02-23T06:35:24.688 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 132202, 2026-02-23T06:35:24.688 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:35:24.688 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:35:24.688 INFO:teuthology.orchestra.run.trial058.stdout: 1 2026-02-23T06:35:24.688 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:24.688 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:35:24.688 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:35:24.688 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:35:24.688 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:35:24.688 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:35:24.688 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:35:24.689 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:35:24.689 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:35:24.689 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:35:24.689 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:35:24.689 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:35:24.689 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:35:24.689 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:35:24.689 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:35:24.689 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:35:24.689 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:35:24.690 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:35:24.690 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:24.690 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:35:24.690 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:35:24.690 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:35:24.690 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:35:24.690 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:35:24.690 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:35:24.690 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:35:24.690 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:35:24.690 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:35:24.690 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:35:24.691 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:35:24.691 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:35:24.691 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:35:24.691 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:35:24.691 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:35:24.691 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:24.691 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:24.691 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:35:24.691 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:35:24.691 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:35:24.691 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:35:24.691 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:35:24.691 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:35:24.692 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:35:24.692 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:35:24.692 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:35:24.692 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:35:24.692 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:35:24.692 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:35:24.692 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:35:24.692 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:35:24.692 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:35:24.692 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:35:24.692 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:35:24.693 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:35:24.693 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:35:24.693 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:35:24.693 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:35:24.693 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:35:24.693 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:35:24.693 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:35:24.693 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:35:24.693 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:35:24.693 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:35:24.693 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:35:24.693 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:35:24.693 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:35:24.694 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:35:24.694 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:35:24.694 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:35:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:35:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:35:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:35:24.694 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:35:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:35:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:24.695 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:24.695 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:35:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:35:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:24.695 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:24.695 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:24.695 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:35:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:35:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:35:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:35:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:35:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:35:24.696 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:24.696 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:35:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:35:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:35:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:35:24.696 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:35:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:35:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:24.697 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:24.697 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:35:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:35:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:24.697 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:24.697 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:24.697 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:35:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:35:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:35:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:35:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:35:24.698 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:35:24.698 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:24.698 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.698 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:35:24.698 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:35:24.698 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:35:24.698 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:35:24.698 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.698 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:35:24.698 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:35:24.698 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:24.698 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:24.698 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.698 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:35:24.699 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:35:24.699 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:24.699 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:24.699 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:24.699 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:24.699 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:35:24.699 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:35:24.699 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:35:24.699 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:35:24.699 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:35:24.699 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:35:24.699 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:24.699 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:24.699 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:24.700 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:35:24.700 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:35:24.700 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.700 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:35:24.700 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:35:24.700 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:35:24.700 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:24.700 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:24.700 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:35:24.700 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.700 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:35:24.700 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:35:24.700 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:35:24.700 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:24.700 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:24.701 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:35:24.701 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.701 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:35:24.701 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:35:24.701 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:35:24.701 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:24.701 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:24.701 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:35:24.701 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.701 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:35:24.701 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:35:24.701 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:35:24.701 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:24.701 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.702 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:35:24.702 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:35:24.702 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:35:24.702 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:24.702 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:24.702 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:35:24.702 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.702 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:35:24.702 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:35:24.702 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:35:24.702 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:24.702 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:24.702 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:24.702 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:35:24.702 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:35:24.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.690+0000 7f6313577640 1 -- 10.20.193.58:0/580230202 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f62e007a430 msgr2=0x7f62e009a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:24.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.690+0000 7f6313577640 1 --2- 10.20.193.58:0/580230202 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f62e007a430 0x7f62e009a8e0 secure :-1 s=READY pgs=340 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f62fc002820 tx=0x7f62fc00e000 comp rx=0 tx=0).stop 2026-02-23T06:35:24.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.690+0000 7f6313577640 1 -- 10.20.193.58:0/580230202 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6300004c40 msgr2=0x7f63140af6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:24.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.690+0000 7f6313577640 1 --2- 10.20.193.58:0/580230202 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6300004c40 0x7f63140af6f0 secure :-1 s=READY pgs=38 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63080028e0 tx=0x7f63080034f0 comp rx=0 tx=0).stop 2026-02-23T06:35:24.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.690+0000 7f6312d76640 1 -- 10.20.193.58:0/580230202 reap_dead start 2026-02-23T06:35:24.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.690+0000 7f6312d76640 1 -- 10.20.193.58:0/580230202 reap_dead start 2026-02-23T06:35:24.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.690+0000 7f6313577640 1 -- 10.20.193.58:0/580230202 shutdown_connections 2026-02-23T06:35:24.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.690+0000 7f6313577640 1 -- 10.20.193.58:0/580230202 >> 10.20.193.58:0/580230202 conn(0x7f63140b3c20 msgr2=0x7f63140b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:35:24.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.690+0000 7f6313577640 1 -- 10.20.193.58:0/580230202 shutdown_connections 2026-02-23T06:35:24.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.690+0000 7f6313577640 1 -- 10.20.193.58:0/580230202 wait complete. 2026-02-23T06:35:24.705 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:35:24.705 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-23T06:35:24.705 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:35:24.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.833+0000 7f9444a47640 1 -- 10.20.193.58:0/3851646081 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9440163820 msgr2=0x7f944015d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:24.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.833+0000 7f9444a47640 1 --2- 10.20.193.58:0/3851646081 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9440163820 0x7f944015d380 secure :-1 s=READY pgs=134 gs=2 cs=0 l=1 c_cookie=4751679296616632815 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9430006f50 tx=0x7f9430030380 comp rx=0 tx=0).stop 2026-02-23T06:35:24.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.834+0000 7f9444a47640 1 -- 10.20.193.58:0/3851646081 shutdown_connections 2026-02-23T06:35:24.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.834+0000 7f9444a47640 1 --2- 10.20.193.58:0/3851646081 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9440163820 0x7f944015d380 unknown :-1 s=CLOSED pgs=134 gs=2 cs=0 l=1 c_cookie=4751679296616632815 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:24.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.834+0000 7f9444a47640 1 --2- 10.20.193.58:0/3851646081 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94400b1170 0x7f944015ce40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:24.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.834+0000 7f9444a47640 1 -- 10.20.193.58:0/3851646081 >> 10.20.193.58:0/3851646081 conn(0x7f9440058e50 msgr2=0x7f9440059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:35:24.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.834+0000 7f9444a47640 1 -- 10.20.193.58:0/3851646081 shutdown_connections 2026-02-23T06:35:24.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.834+0000 7f9444a47640 1 -- 10.20.193.58:0/3851646081 wait complete. 2026-02-23T06:35:24.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.835+0000 7f9444a47640 1 Processor -- start 2026-02-23T06:35:24.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.835+0000 7f9444a47640 1 -- start start 2026-02-23T06:35:24.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.835+0000 7f9444a47640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f94400b1170 0x7f944013a9e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:24.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.835+0000 7f9444a47640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94400b1540 0x7f94401fd500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:24.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.835+0000 7f9444a47640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9440163820 0x7f94401fda40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:24.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.835+0000 7f9444a47640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f9440158720 con 0x7f9440163820 2026-02-23T06:35:24.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.835+0000 7f9444a47640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9440138d90 con 0x7f94400b1170 2026-02-23T06:35:24.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.835+0000 7f9444a47640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f9440158970 con 0x7f94400b1540 2026-02-23T06:35:24.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.835+0000 7f943dd74640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94400b1540 msgr2=0x7f94401fd500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:35:24.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.835+0000 7f943dd74640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94400b1540 0x7f94401fd500 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:35:24.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.836+0000 7f943ed76640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9440163820 0x7f94401fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:24.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.836+0000 7f943ed76640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9440163820 0x7f94401fda40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:33226/0 (socket says 10.20.193.58:33226) 2026-02-23T06:35:24.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.836+0000 7f943ed76640 1 -- 10.20.193.58:0/1510934081 learned_addr learned my addr 10.20.193.58:0/1510934081 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:35:24.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.836+0000 7f943e575640 1 --2- 10.20.193.58:0/1510934081 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f94400b1170 0x7f944013a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:24.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.836+0000 7f943ed76640 1 -- 10.20.193.58:0/1510934081 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94400b1540 msgr2=0x7f94401fd500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:35:24.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.836+0000 7f943ed76640 1 --2- 10.20.193.58:0/1510934081 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94400b1540 0x7f94401fd500 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:24.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.836+0000 7f943ed76640 1 -- 10.20.193.58:0/1510934081 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f94400b1170 msgr2=0x7f944013a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:24.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.836+0000 7f943ed76640 1 --2- 10.20.193.58:0/1510934081 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f94400b1170 0x7f944013a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:24.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.836+0000 7f943ed76640 1 -- 10.20.193.58:0/1510934081 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f943000a650 con 0x7f9440163820 2026-02-23T06:35:24.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.836+0000 7f943e575640 1 --2- 10.20.193.58:0/1510934081 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f94400b1170 0x7f944013a9e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:35:24.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.836+0000 7f943ed76640 1 --2- 10.20.193.58:0/1510934081 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9440163820 0x7f94401fda40 secure :-1 s=READY pgs=135 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f943000ab00 tx=0x7f9430003a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:35:24.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.836+0000 7f9426ffd640 1 -- 10.20.193.58:0/1510934081 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9430045070 con 0x7f9440163820 2026-02-23T06:35:24.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.836+0000 7f9426ffd640 1 -- 10.20.193.58:0/1510934081 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9430005c40 con 0x7f9440163820 2026-02-23T06:35:24.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.836+0000 7f9426ffd640 1 -- 10.20.193.58:0/1510934081 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9430006020 con 0x7f9440163820 2026-02-23T06:35:24.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.836+0000 7f9444a47640 1 -- 10.20.193.58:0/1510934081 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9440158c50 con 0x7f9440163820 2026-02-23T06:35:24.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.836+0000 7f9444a47640 1 -- 10.20.193.58:0/1510934081 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f944015d420 con 0x7f9440163820 2026-02-23T06:35:24.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.837+0000 7f9424ff9640 1 --2- 10.20.193.58:0/1510934081 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9440156c60 0x7f9440200ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:24.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.837+0000 7f9424ff9640 1 -- 10.20.193.58:0/1510934081 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9440166fe0 con 0x7f9440156c60 2026-02-23T06:35:24.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.837+0000 7f943e575640 1 --2- 10.20.193.58:0/1510934081 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9440156c60 0x7f9440200ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:24.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.837+0000 7f943e575640 1 -- 10.20.193.58:0/1510934081 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9440166d00 con 0x7f9440156c60 2026-02-23T06:35:24.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.838+0000 7f943e575640 1 --2- 10.20.193.58:0/1510934081 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9440156c60 0x7f9440200ac0 secure :-1 s=READY pgs=40 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9434006fd0 tx=0x7f943400dba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:35:24.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.838+0000 7f9426ffd640 1 -- 10.20.193.58:0/1510934081 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f943400b8f0 con 0x7f9440156c60 2026-02-23T06:35:24.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.838+0000 7f9426ffd640 1 -- 10.20.193.58:0/1510934081 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f9430006180 con 0x7f9440163820 2026-02-23T06:35:24.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.839+0000 7f9426ffd640 1 --2- 10.20.193.58:0/1510934081 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f940c07a660 0x7f940c09ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:24.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.839+0000 7f9426ffd640 1 -- 10.20.193.58:0/1510934081 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f94300c3ce0 con 0x7f9440163820 2026-02-23T06:35:24.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.839+0000 7f9426ffd640 1 -- 10.20.193.58:0/1510934081 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f943400ba50 con 0x7f9440156c60 2026-02-23T06:35:24.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.839+0000 7f9426ffd640 1 -- 10.20.193.58:0/1510934081 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9440156c60 msgr2=0x7f9440200ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:24.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.839+0000 7f9426ffd640 1 --2- 10.20.193.58:0/1510934081 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9440156c60 0x7f9440200ac0 secure :-1 s=READY pgs=40 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9434006fd0 tx=0x7f943400dba0 comp rx=0 tx=0).stop 2026-02-23T06:35:24.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.839+0000 7f9426ffd640 1 -- 10.20.193.58:0/1510934081 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9440156c60 msgr2=0x7f9440200ac0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:35:24.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.839+0000 7f9426ffd640 1 --2- 10.20.193.58:0/1510934081 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9440156c60 0x7f9440200ac0 secure :-1 s=CLOSED pgs=40 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9434006fd0 tx=0x7f943400dba0 comp rx=0 tx=0).stop 2026-02-23T06:35:24.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.839+0000 7f943dd74640 1 --2- 10.20.193.58:0/1510934081 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f940c07a660 0x7f940c09ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:24.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.840+0000 7f943dd74640 1 --2- 10.20.193.58:0/1510934081 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f940c07a660 0x7f940c09ab10 secure :-1 s=READY pgs=341 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94401373a0 tx=0x7f9428007ad0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:35:24.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.843+0000 7f9424ff9640 1 --2- 10.20.193.58:0/1510934081 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9440158020 0x7f9440201000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:24.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.843+0000 7f9424ff9640 1 -- 10.20.193.58:0/1510934081 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f944005b2d0 con 0x7f9440158020 2026-02-23T06:35:24.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.843+0000 7f943e575640 1 --2- 10.20.193.58:0/1510934081 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9440158020 0x7f9440201000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:24.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.843+0000 7f943e575640 1 -- 10.20.193.58:0/1510934081 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9440160a30 con 0x7f9440158020 2026-02-23T06:35:24.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.844+0000 7f943e575640 1 --2- 10.20.193.58:0/1510934081 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9440158020 0x7f9440201000 secure :-1 s=READY pgs=41 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f943400dfd0 tx=0x7f94340048c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:35:24.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.844+0000 7f9426ffd640 1 -- 10.20.193.58:0/1510934081 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9434021070 con 0x7f9440158020 2026-02-23T06:35:24.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.844+0000 7f9426ffd640 1 -- 10.20.193.58:0/1510934081 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5401 (secure 0 0 0) 0x7f9434012400 con 0x7f9440158020 2026-02-23T06:35:24.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.844+0000 7f9426ffd640 1 -- 10.20.193.58:0/1510934081 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9440158020 msgr2=0x7f9440201000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:24.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.844+0000 7f9426ffd640 1 --2- 10.20.193.58:0/1510934081 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9440158020 0x7f9440201000 secure :-1 s=READY pgs=41 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f943400dfd0 tx=0x7f94340048c0 comp rx=0 tx=0).stop 2026-02-23T06:35:24.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.844+0000 7f9426ffd640 1 -- 10.20.193.58:0/1510934081 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9440158020 msgr2=0x7f9440201000 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:35:24.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.844+0000 7f9426ffd640 1 --2- 10.20.193.58:0/1510934081 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9440158020 0x7f9440201000 unknown :-1 s=CLOSED pgs=41 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:24.840 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:35:24.841 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:35:24.841 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:35:24.841 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:35:24.841 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 122, 2026-02-23T06:35:24.841 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 37428, 2026-02-23T06:35:24.841 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:35:24.841 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:35:24.841 INFO:teuthology.orchestra.run.trial058.stdout: 1 2026-02-23T06:35:24.841 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:24.841 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:35:24.842 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:35:24.842 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:35:24.842 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:35:24.842 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:35:24.842 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:35:24.842 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:35:24.842 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:35:24.842 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:35:24.842 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:35:24.842 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:35:24.842 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:35:24.842 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:35:24.843 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:35:24.843 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:35:24.843 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:35:24.843 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:35:24.843 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:24.843 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:35:24.843 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:35:24.843 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:35:24.843 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:35:24.843 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:35:24.843 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:35:24.843 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:35:24.843 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:35:24.844 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:35:24.844 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:35:24.844 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:35:24.844 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:35:24.844 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:35:24.844 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:35:24.844 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:35:24.844 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:24.844 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:24.844 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:35:24.844 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:35:24.844 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:35:24.844 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:35:24.845 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:35:24.845 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:35:24.845 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:35:24.845 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:35:24.845 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:35:24.845 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:35:24.845 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:35:24.845 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:35:24.845 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:35:24.845 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:35:24.845 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:35:24.845 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:35:24.846 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:35:24.846 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:35:24.846 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:35:24.846 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:35:24.846 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:35:24.846 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:35:24.846 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:35:24.846 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:35:24.846 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:35:24.846 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:35:24.846 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:35:24.846 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:35:24.846 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:35:24.847 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:35:24.847 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:24.847 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:35:24.847 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:24.847 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:35:24.847 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.847 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:35:24.847 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:35:24.847 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:35:24.847 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:35:24.847 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.847 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:35:24.848 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:35:24.848 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:24.848 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:24.848 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.848 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:35:24.848 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:35:24.848 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:24.848 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:24.848 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:24.848 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:24.848 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:35:24.848 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:35:24.848 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:35:24.849 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:35:24.849 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:35:24.849 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:35:24.849 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:24.849 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.849 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:35:24.849 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:35:24.849 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:35:24.849 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:35:24.849 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.849 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:35:24.849 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:35:24.849 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:24.850 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:24.850 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.850 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:35:24.850 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:35:24.850 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:24.850 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:24.850 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:24.850 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:24.850 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:35:24.850 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:35:24.850 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:35:24.850 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:35:24.851 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:35:24.851 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:35:24.851 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:24.851 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.851 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:35:24.851 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:35:24.851 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:35:24.851 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:35:24.851 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.851 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:35:24.851 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:35:24.851 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:24.851 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:24.852 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.852 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:35:24.852 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:35:24.852 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:35:24.852 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:24.852 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:24.852 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:24.852 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:35:24.852 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:35:24.852 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:35:24.852 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:35:24.852 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:35:24.852 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:35:24.853 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:24.853 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:24.853 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:24.853 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:35:24.853 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:35:24.853 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.853 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:35:24.853 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:35:24.853 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:35:24.853 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:24.853 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:24.853 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:35:24.853 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.854 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:35:24.854 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:35:24.854 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:35:24.854 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:24.854 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:24.854 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:35:24.854 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.854 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:35:24.854 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:35:24.854 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:35:24.854 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:24.854 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:24.854 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:35:24.855 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.855 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:35:24.855 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:35:24.855 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:35:24.855 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:24.855 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:35:24.855 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:35:24.855 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:35:24.855 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:35:24.855 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:35:24.855 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:35:24.855 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:35:24.855 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:35:24.856 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:35:24.856 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:35:24.856 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:35:24.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.844+0000 7f9424ff9640 1 -- 10.20.193.58:0/1510934081 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f940c07a660 msgr2=0x7f940c09ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:24.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.844+0000 7f9424ff9640 1 --2- 10.20.193.58:0/1510934081 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f940c07a660 0x7f940c09ab10 secure :-1 s=READY pgs=341 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94401373a0 tx=0x7f9428007ad0 comp rx=0 tx=0).stop 2026-02-23T06:35:24.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.844+0000 7f9424ff9640 1 -- 10.20.193.58:0/1510934081 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9440163820 msgr2=0x7f94401fda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:24.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.844+0000 7f9424ff9640 1 --2- 10.20.193.58:0/1510934081 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9440163820 0x7f94401fda40 secure :-1 s=READY pgs=135 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f943000ab00 tx=0x7f9430003a20 comp rx=0 tx=0).stop 2026-02-23T06:35:24.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.844+0000 7f943ed76640 1 -- 10.20.193.58:0/1510934081 reap_dead start 2026-02-23T06:35:24.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.845+0000 7f943ed76640 1 -- 10.20.193.58:0/1510934081 reap_dead start 2026-02-23T06:35:24.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.845+0000 7f9424ff9640 1 -- 10.20.193.58:0/1510934081 shutdown_connections 2026-02-23T06:35:24.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.845+0000 7f9424ff9640 1 -- 10.20.193.58:0/1510934081 >> 10.20.193.58:0/1510934081 conn(0x7f9440058e50 msgr2=0x7f94401612f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:35:24.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.845+0000 7f9424ff9640 1 -- 10.20.193.58:0/1510934081 shutdown_connections 2026-02-23T06:35:24.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:24.845+0000 7f9424ff9640 1 -- 10.20.193.58:0/1510934081 wait complete. 2026-02-23T06:35:24.859 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:35:24.859 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:35:43.570 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:35:43.575 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:35:44.859 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-23T06:35:44.860 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-23T06:35:44.860 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-23T06:35:44.860 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-23T06:35:44.862 INFO:tasks.ceph.mon.c:Started 2026-02-23T06:35:44.863 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.a 2026-02-23T06:35:44.863 INFO:tasks.mon_thrash:Sending STOP to mon a 2026-02-23T06:35:44.863 INFO:tasks.ceph.mon.a:Sent signal 19 2026-02-23T06:35:44.863 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-23T06:35:59.863 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.a 2026-02-23T06:35:59.864 INFO:tasks.mon_thrash:Sending CONT to mon a 2026-02-23T06:35:59.864 INFO:tasks.ceph.mon.a:Sent signal 18 2026-02-23T06:35:59.864 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:35:59.865 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:35:59.985 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.989+0000 7f80ae083640 1 -- 10.20.193.58:0/1209203637 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f80a8056960 msgr2=0x7f80a8058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:59.985 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.989+0000 7f80ae083640 1 --2- 10.20.193.58:0/1209203637 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f80a8056960 0x7f80a8058200 secure :-1 s=READY pgs=141 gs=3 cs=0 l=1 c_cookie=4149641524809142674 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f809c004740 tx=0x7f809c02f230 comp rx=0 tx=0).stop 2026-02-23T06:35:59.985 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.989+0000 7f80ae083640 1 -- 10.20.193.58:0/1209203637 shutdown_connections 2026-02-23T06:35:59.985 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.989+0000 7f80ae083640 1 --2- 10.20.193.58:0/1209203637 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f80a8056960 0x7f80a8058200 unknown :-1 s=CLOSED pgs=141 gs=3 cs=0 l=1 c_cookie=4149641524809142674 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:59.985 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.989+0000 7f80ae083640 1 -- 10.20.193.58:0/1209203637 >> 10.20.193.58:0/1209203637 conn(0x7f80a80b3c20 msgr2=0x7f80a80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:35:59.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.989+0000 7f80ae083640 1 -- 10.20.193.58:0/1209203637 shutdown_connections 2026-02-23T06:35:59.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.990+0000 7f80ae083640 1 -- 10.20.193.58:0/1209203637 wait complete. 2026-02-23T06:35:59.988 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.991+0000 7f80ae083640 1 Processor -- start 2026-02-23T06:35:59.988 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.991+0000 7f80ae083640 1 -- start start 2026-02-23T06:35:59.988 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.992+0000 7f80ae083640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f80a8056960 0x7f80a815f380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:59.988 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.992+0000 7f80ae083640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f80a815c4b0 0x7f80a80b0480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:59.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.992+0000 7f80ae083640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f80a8162ca0 0x7f80a8201330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:59.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.992+0000 7f80ae083640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f80a813c610 con 0x7f80a815c4b0 2026-02-23T06:35:59.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.992+0000 7f80ae083640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f80a813ea90 con 0x7f80a8162ca0 2026-02-23T06:35:59.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.992+0000 7f80ae083640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f80a8200ea0 con 0x7f80a8056960 2026-02-23T06:35:59.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.992+0000 7f80ac880640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f80a815c4b0 0x7f80a80b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:59.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.992+0000 7f80ac880640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f80a815c4b0 0x7f80a80b0480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:35444/0 (socket says 10.20.193.58:35444) 2026-02-23T06:35:59.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.992+0000 7f80ac880640 1 -- 10.20.193.58:0/1845468129 learned_addr learned my addr 10.20.193.58:0/1845468129 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:35:59.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.992+0000 7f80ad081640 1 --2- 10.20.193.58:0/1845468129 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f80a8056960 0x7f80a815f380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:59.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.992+0000 7f80ad882640 1 --2- 10.20.193.58:0/1845468129 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f80a8162ca0 0x7f80a8201330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:59.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.992+0000 7f80ac880640 1 -- 10.20.193.58:0/1845468129 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f80a8056960 msgr2=0x7f80a815f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:59.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.992+0000 7f80ac880640 1 --2- 10.20.193.58:0/1845468129 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f80a8056960 0x7f80a815f380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:59.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.992+0000 7f80ac880640 1 -- 10.20.193.58:0/1845468129 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f80a8162ca0 msgr2=0x7f80a8201330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:35:59.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.992+0000 7f80ac880640 1 --2- 10.20.193.58:0/1845468129 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f80a8162ca0 0x7f80a8201330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:35:59.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.992+0000 7f80ac880640 1 -- 10.20.193.58:0/1845468129 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f809c0094b0 con 0x7f80a815c4b0 2026-02-23T06:35:59.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.992+0000 7f80ac880640 1 --2- 10.20.193.58:0/1845468129 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f80a815c4b0 0x7f80a80b0480 secure :-1 s=READY pgs=142 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f809c0097e0 tx=0x7f809c002950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:35:59.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.992+0000 7f8095ffb640 1 -- 10.20.193.58:0/1845468129 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f809c038470 con 0x7f80a815c4b0 2026-02-23T06:35:59.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.992+0000 7f8095ffb640 1 -- 10.20.193.58:0/1845468129 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f809c0386c0 con 0x7f80a815c4b0 2026-02-23T06:35:59.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.992+0000 7f80ae083640 1 -- 10.20.193.58:0/1845468129 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80a815dce0 con 0x7f80a815c4b0 2026-02-23T06:35:59.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.992+0000 7f8095ffb640 1 -- 10.20.193.58:0/1845468129 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f809c038ab0 con 0x7f80a815c4b0 2026-02-23T06:35:59.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.992+0000 7f80ae083640 1 -- 10.20.193.58:0/1845468129 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80a815e260 con 0x7f80a815c4b0 2026-02-23T06:35:59.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.993+0000 7f80ae083640 1 -- 10.20.193.58:0/1845468129 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80a8200fe0 con 0x7f80a815c4b0 2026-02-23T06:35:59.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.994+0000 7f8095ffb640 1 -- 10.20.193.58:0/1845468129 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f809c038c10 con 0x7f80a815c4b0 2026-02-23T06:35:59.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.995+0000 7f8095ffb640 1 --2- 10.20.193.58:0/1845468129 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f807807a630 0x7f807809aae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:35:59.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.995+0000 7f8095ffb640 1 -- 10.20.193.58:0/1845468129 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f809c0c2b60 con 0x7f80a815c4b0 2026-02-23T06:35:59.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.995+0000 7f80ad081640 1 --2- 10.20.193.58:0/1845468129 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f807807a630 0x7f807809aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:35:59.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.996+0000 7f80ad081640 1 --2- 10.20.193.58:0/1845468129 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f807807a630 0x7f807809aae0 secure :-1 s=READY pgs=343 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8098004770 tx=0x7f8098009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:35:59.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:35:59.997+0000 7f8095ffb640 1 -- 10.20.193.58:0/1845468129 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f809c085e20 con 0x7f80a815c4b0 2026-02-23T06:36:00.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.152+0000 7f80ae083640 1 -- 10.20.193.58:0/1845468129 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f80a80ada30 con 0x7f80a815c4b0 2026-02-23T06:36:00.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.152+0000 7f8095ffb640 1 -- 10.20.193.58:0/1845468129 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f809c088f40 con 0x7f80a815c4b0 2026-02-23T06:36:00.148 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":126,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:36:00.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.153+0000 7f80ae083640 1 -- 10.20.193.58:0/1845468129 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f807807a630 msgr2=0x7f807809aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:00.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.153+0000 7f80ae083640 1 --2- 10.20.193.58:0/1845468129 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f807807a630 0x7f807809aae0 secure :-1 s=READY pgs=343 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8098004770 tx=0x7f8098009040 comp rx=0 tx=0).stop 2026-02-23T06:36:00.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.153+0000 7f80ae083640 1 -- 10.20.193.58:0/1845468129 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f80a815c4b0 msgr2=0x7f80a80b0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:00.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.153+0000 7f80ae083640 1 --2- 10.20.193.58:0/1845468129 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f80a815c4b0 0x7f80a80b0480 secure :-1 s=READY pgs=142 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f809c0097e0 tx=0x7f809c002950 comp rx=0 tx=0).stop 2026-02-23T06:36:00.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.153+0000 7f80ae083640 1 -- 10.20.193.58:0/1845468129 shutdown_connections 2026-02-23T06:36:00.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.153+0000 7f80ae083640 1 --2- 10.20.193.58:0/1845468129 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f807807a630 0x7f807809aae0 unknown :-1 s=CLOSED pgs=343 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.153+0000 7f80ae083640 1 --2- 10.20.193.58:0/1845468129 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f80a8162ca0 0x7f80a8201330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.153+0000 7f80ae083640 1 --2- 10.20.193.58:0/1845468129 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f80a815c4b0 0x7f80a80b0480 unknown :-1 s=CLOSED pgs=142 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.153+0000 7f80ae083640 1 --2- 10.20.193.58:0/1845468129 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f80a8056960 0x7f80a815f380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.153+0000 7f80ae083640 1 -- 10.20.193.58:0/1845468129 >> 10.20.193.58:0/1845468129 conn(0x7f80a80b3c20 msgr2=0x7f80a805bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:36:00.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.153+0000 7f80ae083640 1 -- 10.20.193.58:0/1845468129 shutdown_connections 2026-02-23T06:36:00.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.154+0000 7f80ae083640 1 -- 10.20.193.58:0/1845468129 wait complete. 2026-02-23T06:36:00.160 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:36:00.160 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:36:00.160 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:36:00.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.286+0000 7fdda8fd2640 1 -- 10.20.193.58:0/3357704201 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdda415d4a0 msgr2=0x7fdda40affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:00.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.286+0000 7fdda8fd2640 1 --2- 10.20.193.58:0/3357704201 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdda415d4a0 0x7fdda40affb0 secure :-1 s=READY pgs=143 gs=2 cs=0 l=1 c_cookie=17039754931749252000 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdda4059740 tx=0x7fdd9002f250 comp rx=0 tx=0).stop 2026-02-23T06:36:00.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.286+0000 7fdda8fd2640 1 -- 10.20.193.58:0/3357704201 shutdown_connections 2026-02-23T06:36:00.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.286+0000 7fdda8fd2640 1 --2- 10.20.193.58:0/3357704201 >> v2:10.20.193.93:3300/0 conn(0x7fdda415d870 0x7fdda40587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.286+0000 7fdda8fd2640 1 --2- 10.20.193.58:0/3357704201 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdda415d4a0 0x7fdda40affb0 unknown :-1 s=CLOSED pgs=143 gs=2 cs=0 l=1 c_cookie=17039754931749252000 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.286+0000 7fdda8fd2640 1 -- 10.20.193.58:0/3357704201 >> 10.20.193.58:0/3357704201 conn(0x7fdda40b3c20 msgr2=0x7fdda40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:36:00.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.286+0000 7fdda8fd2640 1 -- 10.20.193.58:0/3357704201 shutdown_connections 2026-02-23T06:36:00.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.286+0000 7fdda8fd2640 1 -- 10.20.193.58:0/3357704201 wait complete. 2026-02-23T06:36:00.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.288+0000 7fdda8fd2640 1 Processor -- start 2026-02-23T06:36:00.285 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.288+0000 7fdda8fd2640 1 -- start start 2026-02-23T06:36:00.285 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.288+0000 7fdda8fd2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdda40b6690 0x7fdda4160f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:00.285 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.288+0000 7fdda8fd2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdda415d4a0 0x7fdda4141fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:00.285 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.288+0000 7fdda8fd2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdda415d870 0x7fdda4140e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:00.285 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.288+0000 7fdda8fd2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fdda4142cc0 con 0x7fdda415d4a0 2026-02-23T06:36:00.285 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.288+0000 7fdda8fd2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fdda41fbf10 con 0x7fdda40b6690 2026-02-23T06:36:00.285 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.288+0000 7fdda8fd2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fdda415dd70 con 0x7fdda415d870 2026-02-23T06:36:00.285 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.288+0000 7fdda2ffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdda415d4a0 0x7fdda4141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:00.285 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.288+0000 7fdda2ffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdda415d4a0 0x7fdda4141fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:35458/0 (socket says 10.20.193.58:35458) 2026-02-23T06:36:00.285 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.288+0000 7fdda2ffd640 1 -- 10.20.193.58:0/2184853163 learned_addr learned my addr 10.20.193.58:0/2184853163 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:36:00.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.288+0000 7fdda37fe640 1 --2- 10.20.193.58:0/2184853163 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdda40b6690 0x7fdda4160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:00.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.289+0000 7fdda3fff640 1 --2- 10.20.193.58:0/2184853163 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdda415d870 0x7fdda4140e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:00.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.289+0000 7fdda2ffd640 1 -- 10.20.193.58:0/2184853163 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdda415d870 msgr2=0x7fdda4140e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:00.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.289+0000 7fdda2ffd640 1 --2- 10.20.193.58:0/2184853163 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdda415d870 0x7fdda4140e80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.289+0000 7fdda2ffd640 1 -- 10.20.193.58:0/2184853163 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdda40b6690 msgr2=0x7fdda4160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:00.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.289+0000 7fdda2ffd640 1 --2- 10.20.193.58:0/2184853163 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdda40b6690 0x7fdda4160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.289+0000 7fdda2ffd640 1 -- 10.20.193.58:0/2184853163 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd90009570 con 0x7fdda415d4a0 2026-02-23T06:36:00.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.289+0000 7fdda3fff640 1 --2- 10.20.193.58:0/2184853163 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdda415d870 0x7fdda4140e80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:36:00.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.289+0000 7fdda2ffd640 1 --2- 10.20.193.58:0/2184853163 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdda415d4a0 0x7fdda4141fc0 secure :-1 s=READY pgs=144 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd9400d950 tx=0x7fdd9400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:00.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.289+0000 7fdd7ffff640 1 -- 10.20.193.58:0/2184853163 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd94004500 con 0x7fdda415d4a0 2026-02-23T06:36:00.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.289+0000 7fdd7ffff640 1 -- 10.20.193.58:0/2184853163 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd94004940 con 0x7fdda415d4a0 2026-02-23T06:36:00.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.289+0000 7fdd7ffff640 1 -- 10.20.193.58:0/2184853163 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd94004d70 con 0x7fdda415d4a0 2026-02-23T06:36:00.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.289+0000 7fdda8fd2640 1 -- 10.20.193.58:0/2184853163 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda4140700 con 0x7fdda415d4a0 2026-02-23T06:36:00.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.289+0000 7fdda8fd2640 1 -- 10.20.193.58:0/2184853163 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda41fc100 con 0x7fdda415d4a0 2026-02-23T06:36:00.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.290+0000 7fdda8fd2640 1 --2- 10.20.193.58:0/2184853163 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdda415e1a0 0x7fdda41fea50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:00.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.290+0000 7fdda8fd2640 1 -- 10.20.193.58:0/2184853163 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fdda40b6330 con 0x7fdda415e1a0 2026-02-23T06:36:00.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.290+0000 7fdda37fe640 1 --2- 10.20.193.58:0/2184853163 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdda415e1a0 0x7fdda41fea50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:00.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.290+0000 7fdda37fe640 1 -- 10.20.193.58:0/2184853163 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdda40b5e10 con 0x7fdda415e1a0 2026-02-23T06:36:00.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.290+0000 7fdda37fe640 1 --2- 10.20.193.58:0/2184853163 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdda415e1a0 0x7fdda41fea50 secure :-1 s=READY pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd90004740 tx=0x7fdd900028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:00.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.291+0000 7fdd7ffff640 1 -- 10.20.193.58:0/2184853163 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd9003d050 con 0x7fdda415e1a0 2026-02-23T06:36:00.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.291+0000 7fdd7ffff640 1 -- 10.20.193.58:0/2184853163 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fdd9003e040 con 0x7fdda415e1a0 2026-02-23T06:36:00.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.291+0000 7fdd7ffff640 1 -- 10.20.193.58:0/2184853163 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdda415e1a0 msgr2=0x7fdda41fea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:00.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.291+0000 7fdd7ffff640 1 --2- 10.20.193.58:0/2184853163 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdda415e1a0 0x7fdda41fea50 secure :-1 s=READY pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd90004740 tx=0x7fdd900028d0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.291+0000 7fdd7ffff640 1 -- 10.20.193.58:0/2184853163 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdda415e1a0 msgr2=0x7fdda41fea50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:36:00.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.291+0000 7fdd7ffff640 1 --2- 10.20.193.58:0/2184853163 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdda415e1a0 0x7fdda41fea50 secure :-1 s=CLOSED pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd90004740 tx=0x7fdd900028d0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.291+0000 7fdd7ffff640 1 -- 10.20.193.58:0/2184853163 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fdd94009820 con 0x7fdda415d4a0 2026-02-23T06:36:00.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.292+0000 7fdd7ffff640 1 --2- 10.20.193.58:0/2184853163 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdd7407a430 0x7fdd7409a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:00.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.292+0000 7fdd7ffff640 1 -- 10.20.193.58:0/2184853163 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fdd9409dd20 con 0x7fdda415d4a0 2026-02-23T06:36:00.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.292+0000 7fdda37fe640 1 --2- 10.20.193.58:0/2184853163 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdd7407a430 0x7fdd7409a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:00.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.292+0000 7fdda37fe640 1 --2- 10.20.193.58:0/2184853163 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdd7407a430 0x7fdd7409a8e0 secure :-1 s=READY pgs=344 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd900023d0 tx=0x7fdd90031030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:00.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.294+0000 7fdda8fd2640 1 --2- 10.20.193.58:0/2184853163 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdda41413c0 0x7fdda41fef90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:00.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.294+0000 7fdda8fd2640 1 -- 10.20.193.58:0/2184853163 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fdda40b6d50 con 0x7fdda41413c0 2026-02-23T06:36:00.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.294+0000 7fdda3fff640 1 --2- 10.20.193.58:0/2184853163 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdda41413c0 0x7fdda41fef90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:00.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.295+0000 7fdda3fff640 1 -- 10.20.193.58:0/2184853163 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdda415dee0 con 0x7fdda41413c0 2026-02-23T06:36:00.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.295+0000 7fdda3fff640 1 --2- 10.20.193.58:0/2184853163 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdda41413c0 0x7fdda41fef90 secure :-1 s=READY pgs=146 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd98008fd0 tx=0x7fdd9800fba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:00.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.295+0000 7fdd7ffff640 1 -- 10.20.193.58:0/2184853163 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd9800fe60 con 0x7fdda41413c0 2026-02-23T06:36:00.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.295+0000 7fdd7ffff640 1 -- 10.20.193.58:0/2184853163 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5558 (secure 0 0 0) 0x7fdd98007970 con 0x7fdda41413c0 2026-02-23T06:36:00.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.295+0000 7fdd7ffff640 1 -- 10.20.193.58:0/2184853163 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdda41413c0 msgr2=0x7fdda41fef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:00.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.295+0000 7fdd7ffff640 1 --2- 10.20.193.58:0/2184853163 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdda41413c0 0x7fdda41fef90 secure :-1 s=READY pgs=146 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd98008fd0 tx=0x7fdd9800fba0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.295+0000 7fdd7ffff640 1 -- 10.20.193.58:0/2184853163 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdda41413c0 msgr2=0x7fdda41fef90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:36:00.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.295+0000 7fdd7ffff640 1 --2- 10.20.193.58:0/2184853163 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdda41413c0 0x7fdda41fef90 unknown :-1 s=CLOSED pgs=146 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.292 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:36:00.292 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:36:00.292 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:36:00.292 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:36:00.292 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 126, 2026-02-23T06:36:00.292 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 167807, 2026-02-23T06:36:00.293 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:36:00.293 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:36:00.293 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:36:00.293 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:36:00.293 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:00.293 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:36:00.293 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:36:00.293 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:36:00.293 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:36:00.293 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:36:00.293 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:36:00.294 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:36:00.294 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:36:00.294 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:36:00.294 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:36:00.294 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:36:00.294 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:36:00.294 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:36:00.294 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:36:00.294 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:36:00.294 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:36:00.294 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:36:00.294 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:00.295 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:36:00.295 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:36:00.295 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:36:00.295 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:36:00.295 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:36:00.295 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:36:00.295 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:36:00.295 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:36:00.295 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:36:00.295 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:36:00.295 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:36:00.295 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:36:00.295 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:36:00.296 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:36:00.296 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:36:00.296 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:00.296 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.296 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:36:00.296 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:36:00.296 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:36:00.296 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:36:00.296 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:36:00.296 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:36:00.296 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:36:00.297 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:36:00.297 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:36:00.297 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:36:00.297 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:36:00.297 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:36:00.297 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:36:00.297 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:36:00.297 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:36:00.297 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:36:00.297 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:36:00.297 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:36:00.297 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:36:00.298 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:36:00.298 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:36:00.298 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:36:00.298 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:36:00.298 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:36:00.298 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:36:00.298 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:36:00.298 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:36:00.298 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:36:00.298 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:36:00.298 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:36:00.298 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:00.298 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:36:00.299 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.299 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:36:00.299 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.299 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:36:00.299 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:36:00.299 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:36:00.299 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:36:00.299 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.299 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:36:00.299 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:36:00.299 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:00.299 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.299 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.300 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:36:00.300 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:36:00.300 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:00.300 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:00.300 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:00.300 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.300 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:36:00.300 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:36:00.300 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:36:00.300 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:36:00.300 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:36:00.300 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:36:00.301 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.301 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.301 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:36:00.301 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:36:00.301 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:36:00.301 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:36:00.301 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.301 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:36:00.301 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:36:00.301 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:00.301 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.301 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.302 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:36:00.302 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:36:00.302 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:00.302 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:00.302 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:00.302 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.302 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:36:00.302 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:36:00.302 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:36:00.302 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:36:00.302 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:36:00.302 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:36:00.302 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.303 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.303 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:36:00.303 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:36:00.303 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:36:00.303 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:36:00.303 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.303 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:36:00.303 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:36:00.303 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:00.303 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.303 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.303 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:36:00.304 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:36:00.304 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:00.304 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:00.304 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:00.304 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.304 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:36:00.304 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:36:00.304 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:36:00.304 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:36:00.304 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:36:00.304 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:36:00.304 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:00.304 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:00.305 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.305 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:36:00.305 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:36:00.305 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.305 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:00.305 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:00.305 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:36:00.305 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:00.305 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:00.305 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:36:00.305 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.305 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:00.306 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:00.306 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:36:00.306 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:00.306 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:00.306 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:36:00.306 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.306 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:00.306 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:00.306 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:36:00.306 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:00.306 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:00.306 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:36:00.307 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.307 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:36:00.307 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:36:00.307 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:36:00.307 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.307 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.307 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:00.307 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:00.307 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:36:00.307 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:00.307 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:00.307 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:36:00.308 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.308 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:00.308 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:00.308 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:36:00.308 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:00.308 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:00.308 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.308 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:36:00.308 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:36:00.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.295+0000 7fdda8fd2640 1 -- 10.20.193.58:0/2184853163 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdd7407a430 msgr2=0x7fdd7409a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:00.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.295+0000 7fdda8fd2640 1 --2- 10.20.193.58:0/2184853163 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdd7407a430 0x7fdd7409a8e0 secure :-1 s=READY pgs=344 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd900023d0 tx=0x7fdd90031030 comp rx=0 tx=0).stop 2026-02-23T06:36:00.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.295+0000 7fdda8fd2640 1 -- 10.20.193.58:0/2184853163 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdda415d4a0 msgr2=0x7fdda4141fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:00.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.295+0000 7fdda8fd2640 1 --2- 10.20.193.58:0/2184853163 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdda415d4a0 0x7fdda4141fc0 secure :-1 s=READY pgs=144 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd9400d950 tx=0x7fdd9400de20 comp rx=0 tx=0).stop 2026-02-23T06:36:00.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.295+0000 7fdda3fff640 1 -- 10.20.193.58:0/2184853163 reap_dead start 2026-02-23T06:36:00.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.295+0000 7fdda8fd2640 1 -- 10.20.193.58:0/2184853163 shutdown_connections 2026-02-23T06:36:00.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.295+0000 7fdda8fd2640 1 -- 10.20.193.58:0/2184853163 >> 10.20.193.58:0/2184853163 conn(0x7fdda40b3c20 msgr2=0x7fdda415bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:36:00.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.295+0000 7fdda8fd2640 1 -- 10.20.193.58:0/2184853163 shutdown_connections 2026-02-23T06:36:00.311 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.295+0000 7fdda8fd2640 1 -- 10.20.193.58:0/2184853163 wait complete. 2026-02-23T06:36:00.311 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:36:00.311 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:36:00.311 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:36:00.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.437+0000 7f28ca714640 1 -- 10.20.193.58:0/334798726 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f28c40b6690 msgr2=0x7f28c4058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:00.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.437+0000 7f28ca714640 1 --2- 10.20.193.58:0/334798726 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f28c40b6690 0x7f28c4058cf0 secure :-1 s=READY pgs=147 gs=3 cs=0 l=1 c_cookie=9239756937027197179 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28c0005820 tx=0x7f28c00302b0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.438+0000 7f28ca714640 1 -- 10.20.193.58:0/334798726 shutdown_connections 2026-02-23T06:36:00.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.438+0000 7f28ca714640 1 --2- 10.20.193.58:0/334798726 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f28c40b6690 0x7f28c4058cf0 unknown :-1 s=CLOSED pgs=147 gs=3 cs=0 l=1 c_cookie=9239756937027197179 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.438+0000 7f28ca714640 1 --2- 10.20.193.58:0/334798726 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f28c415d870 0x7f28c40587b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.438+0000 7f28ca714640 1 -- 10.20.193.58:0/334798726 >> 10.20.193.58:0/334798726 conn(0x7f28c40b3c20 msgr2=0x7f28c40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:36:00.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.438+0000 7f28ca714640 1 -- 10.20.193.58:0/334798726 shutdown_connections 2026-02-23T06:36:00.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.438+0000 7f28ca714640 1 -- 10.20.193.58:0/334798726 wait complete. 2026-02-23T06:36:00.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.439+0000 7f28ca714640 1 Processor -- start 2026-02-23T06:36:00.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.439+0000 7f28ca714640 1 -- start start 2026-02-23T06:36:00.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.439+0000 7f28ca714640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f28c40b6690 0x7f28c40b76f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:00.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.439+0000 7f28ca714640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f28c415d4a0 0x7f28c40b7c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:00.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.439+0000 7f28ca714640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f28c415d870 0x7f28c4164f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:00.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.439+0000 7f28ca714640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f28c4166e40 con 0x7f28c40b6690 2026-02-23T06:36:00.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.439+0000 7f28ca714640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f28c414a2b0 con 0x7f28c415d870 2026-02-23T06:36:00.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.439+0000 7f28ca714640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f28c4167830 con 0x7f28c415d4a0 2026-02-23T06:36:00.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.440+0000 7f28c9712640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f28c40b6690 0x7f28c40b76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:00.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.440+0000 7f28c9712640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f28c40b6690 0x7f28c40b76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:35494/0 (socket says 10.20.193.58:35494) 2026-02-23T06:36:00.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.440+0000 7f28c9712640 1 -- 10.20.193.58:0/1971514775 learned_addr learned my addr 10.20.193.58:0/1971514775 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:36:00.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.440+0000 7f28c9f13640 1 --2- 10.20.193.58:0/1971514775 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f28c415d870 0x7f28c4164f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:00.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.440+0000 7f28c8f11640 1 --2- 10.20.193.58:0/1971514775 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f28c415d4a0 0x7f28c40b7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:00.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.440+0000 7f28c9712640 1 -- 10.20.193.58:0/1971514775 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f28c415d4a0 msgr2=0x7f28c40b7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:00.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.440+0000 7f28c9712640 1 --2- 10.20.193.58:0/1971514775 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f28c415d4a0 0x7f28c40b7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.440+0000 7f28c9712640 1 -- 10.20.193.58:0/1971514775 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f28c415d870 msgr2=0x7f28c4164f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:00.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.440+0000 7f28c9712640 1 --2- 10.20.193.58:0/1971514775 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f28c415d870 0x7f28c4164f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.440+0000 7f28c9712640 1 -- 10.20.193.58:0/1971514775 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c000a590 con 0x7f28c40b6690 2026-02-23T06:36:00.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.440+0000 7f28c9f13640 1 --2- 10.20.193.58:0/1971514775 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f28c415d870 0x7f28c4164f30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:36:00.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.440+0000 7f28c9712640 1 --2- 10.20.193.58:0/1971514775 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f28c40b6690 0x7f28c40b76f0 secure :-1 s=READY pgs=148 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28b400c760 tx=0x7f28b400cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:00.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.440+0000 7f28b1ffb640 1 -- 10.20.193.58:0/1971514775 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f28b4005290 con 0x7f28c40b6690 2026-02-23T06:36:00.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.440+0000 7f28b1ffb640 1 -- 10.20.193.58:0/1971514775 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28b40054e0 con 0x7f28c40b6690 2026-02-23T06:36:00.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.440+0000 7f28b1ffb640 1 -- 10.20.193.58:0/1971514775 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f28b40038d0 con 0x7f28c40b6690 2026-02-23T06:36:00.438 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.440+0000 7f28ca714640 1 -- 10.20.193.58:0/1971514775 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28c415c2e0 con 0x7f28c40b6690 2026-02-23T06:36:00.438 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.441+0000 7f28ca714640 1 -- 10.20.193.58:0/1971514775 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28c414d620 con 0x7f28c40b6690 2026-02-23T06:36:00.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.441+0000 7f28ca714640 1 --2- 10.20.193.58:0/1971514775 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f28c40b8230 0x7f28c4165470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:00.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.441+0000 7f28ca714640 1 -- 10.20.193.58:0/1971514775 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f28c40b6330 con 0x7f28c40b8230 2026-02-23T06:36:00.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.441+0000 7f28c8f11640 1 --2- 10.20.193.58:0/1971514775 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f28c40b8230 0x7f28c4165470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:00.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.442+0000 7f28c8f11640 1 -- 10.20.193.58:0/1971514775 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f28c40b5e10 con 0x7f28c40b8230 2026-02-23T06:36:00.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.442+0000 7f28c8f11640 1 --2- 10.20.193.58:0/1971514775 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f28c40b8230 0x7f28c4165470 secure :-1 s=READY pgs=48 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28c40ae830 tx=0x7f28b80099f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:00.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.442+0000 7f28b1ffb640 1 -- 10.20.193.58:0/1971514775 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f28b8010a10 con 0x7f28c40b8230 2026-02-23T06:36:00.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.442+0000 7f28b1ffb640 1 -- 10.20.193.58:0/1971514775 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f28b4003a30 con 0x7f28c40b6690 2026-02-23T06:36:00.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.443+0000 7f28b1ffb640 1 --2- 10.20.193.58:0/1971514775 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f289407a6e0 0x7f289409ab90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:00.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.443+0000 7f28b1ffb640 1 -- 10.20.193.58:0/1971514775 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f28b8010b70 con 0x7f28c40b8230 2026-02-23T06:36:00.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.443+0000 7f28b1ffb640 1 -- 10.20.193.58:0/1971514775 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f28c40b8230 msgr2=0x7f28c4165470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:00.441 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.443+0000 7f28b1ffb640 1 --2- 10.20.193.58:0/1971514775 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f28c40b8230 0x7f28c4165470 secure :-1 s=READY pgs=48 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28c40ae830 tx=0x7f28b80099f0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.441 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.443+0000 7f28b1ffb640 1 -- 10.20.193.58:0/1971514775 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f28c40b8230 msgr2=0x7f28c4165470 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:36:00.441 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.443+0000 7f28b1ffb640 1 --2- 10.20.193.58:0/1971514775 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f28c40b8230 0x7f28c4165470 unknown :-1 s=CLOSED pgs=48 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.441 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.443+0000 7f28b1ffb640 1 -- 10.20.193.58:0/1971514775 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f28b409ca90 con 0x7f28c40b6690 2026-02-23T06:36:00.441 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.443+0000 7f28c9f13640 1 --2- 10.20.193.58:0/1971514775 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f289407a6e0 0x7f289409ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:00.441 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.444+0000 7f28c9f13640 1 --2- 10.20.193.58:0/1971514775 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f289407a6e0 0x7f289409ab90 secure :-1 s=READY pgs=345 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28c000a8c0 tx=0x7f28c0032040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:00.441 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.447+0000 7f28ca714640 1 --2- 10.20.193.58:0/1971514775 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f28c414d980 0x7f28c414dd50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:00.442 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.447+0000 7f28ca714640 1 -- 10.20.193.58:0/1971514775 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f28c4164250 con 0x7f28c414d980 2026-02-23T06:36:00.442 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.447+0000 7f28c8f11640 1 --2- 10.20.193.58:0/1971514775 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f28c414d980 0x7f28c414dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:00.442 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.447+0000 7f28c8f11640 1 -- 10.20.193.58:0/1971514775 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f28c40b6d50 con 0x7f28c414d980 2026-02-23T06:36:00.443 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.448+0000 7f28c8f11640 1 --2- 10.20.193.58:0/1971514775 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f28c414d980 0x7f28c414dd50 secure :-1 s=READY pgs=49 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28b80023d0 tx=0x7f28b8004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:00.443 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.448+0000 7f28b1ffb640 1 -- 10.20.193.58:0/1971514775 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f28b801e030 con 0x7f28c414d980 2026-02-23T06:36:00.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.448+0000 7f28b1ffb640 1 -- 10.20.193.58:0/1971514775 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5412 (secure 0 0 0) 0x7f28b8010e70 con 0x7f28c414d980 2026-02-23T06:36:00.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.448+0000 7f28b1ffb640 1 -- 10.20.193.58:0/1971514775 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f28c414d980 msgr2=0x7f28c414dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:00.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.448+0000 7f28b1ffb640 1 --2- 10.20.193.58:0/1971514775 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f28c414d980 0x7f28c414dd50 secure :-1 s=READY pgs=49 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28b80023d0 tx=0x7f28b8004770 comp rx=0 tx=0).stop 2026-02-23T06:36:00.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.448+0000 7f28b1ffb640 1 -- 10.20.193.58:0/1971514775 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f28c414d980 msgr2=0x7f28c414dd50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:36:00.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.448+0000 7f28b1ffb640 1 --2- 10.20.193.58:0/1971514775 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f28c414d980 0x7f28c414dd50 unknown :-1 s=CLOSED pgs=49 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.444 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:36:00.444 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:36:00.445 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:36:00.445 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:36:00.445 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 126, 2026-02-23T06:36:00.445 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 73032, 2026-02-23T06:36:00.445 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:36:00.445 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:36:00.445 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:36:00.445 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:36:00.445 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:00.445 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:36:00.445 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:36:00.445 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:36:00.446 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:36:00.446 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:36:00.446 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:36:00.446 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:36:00.446 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:36:00.446 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:36:00.446 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:36:00.446 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:36:00.446 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:36:00.446 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:36:00.446 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:36:00.446 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:36:00.447 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:36:00.447 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:36:00.447 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:00.447 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:36:00.447 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:36:00.447 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:36:00.447 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:36:00.447 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:36:00.447 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:36:00.447 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:36:00.447 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:36:00.447 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:36:00.448 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:36:00.448 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:36:00.448 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:36:00.448 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:36:00.448 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:36:00.448 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:36:00.448 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:00.448 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.448 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:36:00.448 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:36:00.448 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:36:00.448 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:36:00.448 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:36:00.449 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:36:00.449 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:36:00.449 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:36:00.449 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:36:00.449 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:36:00.449 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:36:00.449 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:36:00.449 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:36:00.449 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:36:00.449 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:36:00.449 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:36:00.449 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:36:00.450 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:36:00.450 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:36:00.450 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:36:00.450 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:36:00.450 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:36:00.450 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:36:00.450 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:36:00.450 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:36:00.450 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:36:00.450 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:36:00.450 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:36:00.450 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:36:00.450 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:36:00.451 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:00.451 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:36:00.451 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.451 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:36:00.451 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.451 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:36:00.451 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:36:00.451 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:36:00.451 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:36:00.451 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.451 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:36:00.451 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:36:00.451 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:00.452 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.452 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.452 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:36:00.452 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:36:00.452 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:00.452 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:00.452 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:00.452 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.452 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:36:00.452 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:36:00.452 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:36:00.452 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:36:00.452 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:36:00.453 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:36:00.453 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.453 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.453 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:36:00.453 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:36:00.453 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:36:00.453 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:36:00.453 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.453 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:36:00.453 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:36:00.453 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:00.453 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.453 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.454 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:36:00.454 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:36:00.454 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:00.454 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:00.454 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:00.454 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.454 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:36:00.454 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:36:00.454 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:36:00.454 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:36:00.454 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:36:00.454 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:36:00.454 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.455 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.455 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:36:00.455 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:36:00.455 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:36:00.455 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:36:00.455 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.455 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:36:00.455 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:36:00.455 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:00.455 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.455 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.455 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:36:00.455 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:36:00.456 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:00.456 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:00.456 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:00.456 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.456 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:36:00.456 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:36:00.456 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:36:00.456 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:36:00.456 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:36:00.456 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:36:00.456 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:00.456 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:00.456 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.457 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:36:00.457 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:36:00.457 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.457 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:00.457 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:00.457 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:36:00.457 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:00.457 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:00.457 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:36:00.457 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.457 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:00.457 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:00.457 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:36:00.458 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:00.458 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:00.458 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:36:00.458 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.458 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:00.458 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:00.458 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:36:00.458 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:00.458 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:00.458 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:36:00.458 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.458 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:00.458 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:00.458 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:36:00.459 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:00.459 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:00.459 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:36:00.459 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.459 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:00.459 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:00.459 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:36:00.459 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:00.459 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:00.459 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.459 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:36:00.459 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:36:00.461 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.449+0000 7f28ca714640 1 -- 10.20.193.58:0/1971514775 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f289407a6e0 msgr2=0x7f289409ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:00.461 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.449+0000 7f28ca714640 1 --2- 10.20.193.58:0/1971514775 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f289407a6e0 0x7f289409ab90 secure :-1 s=READY pgs=345 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28c000a8c0 tx=0x7f28c0032040 comp rx=0 tx=0).stop 2026-02-23T06:36:00.461 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.449+0000 7f28ca714640 1 -- 10.20.193.58:0/1971514775 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f28c40b6690 msgr2=0x7f28c40b76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:00.461 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.449+0000 7f28ca714640 1 --2- 10.20.193.58:0/1971514775 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f28c40b6690 0x7f28c40b76f0 secure :-1 s=READY pgs=148 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28b400c760 tx=0x7f28b400cb60 comp rx=0 tx=0).stop 2026-02-23T06:36:00.461 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.449+0000 7f28c9f13640 1 -- 10.20.193.58:0/1971514775 reap_dead start 2026-02-23T06:36:00.462 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.449+0000 7f28c9f13640 1 -- 10.20.193.58:0/1971514775 reap_dead start 2026-02-23T06:36:00.462 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.449+0000 7f28ca714640 1 -- 10.20.193.58:0/1971514775 shutdown_connections 2026-02-23T06:36:00.462 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.449+0000 7f28ca714640 1 -- 10.20.193.58:0/1971514775 >> 10.20.193.58:0/1971514775 conn(0x7f28c40b3c20 msgr2=0x7f28c405ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:36:00.462 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.449+0000 7f28ca714640 1 -- 10.20.193.58:0/1971514775 shutdown_connections 2026-02-23T06:36:00.462 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.449+0000 7f28ca714640 1 -- 10.20.193.58:0/1971514775 wait complete. 2026-02-23T06:36:00.462 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:36:00.462 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:36:00.463 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:36:00.584 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.589+0000 7f1ce630c640 1 -- 10.20.193.58:0/1803663173 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1ce00b1170 msgr2=0x7f1ce015ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:00.584 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.589+0000 7f1ce630c640 1 --2- 10.20.193.58:0/1803663173 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1ce00b1170 0x7f1ce015ce40 secure :-1 s=READY pgs=149 gs=1 cs=0 l=1 c_cookie=16844246511971153852 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ce00b1ce0 tx=0x7f1ccc02f250 comp rx=0 tx=0).stop 2026-02-23T06:36:00.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.589+0000 7f1ce630c640 1 -- 10.20.193.58:0/1803663173 shutdown_connections 2026-02-23T06:36:00.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.589+0000 7f1ce630c640 1 --2- 10.20.193.58:0/1803663173 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1ce00b58a0 0x7f1ce0163110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.589+0000 7f1ce630c640 1 --2- 10.20.193.58:0/1803663173 >> v2:10.20.193.93:3300/0 conn(0x7f1ce00b1540 0x7f1ce015d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.589+0000 7f1ce630c640 1 --2- 10.20.193.58:0/1803663173 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1ce00b1170 0x7f1ce015ce40 unknown :-1 s=CLOSED pgs=149 gs=1 cs=0 l=1 c_cookie=16844246511971153852 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.589+0000 7f1ce630c640 1 -- 10.20.193.58:0/1803663173 >> 10.20.193.58:0/1803663173 conn(0x7f1ce0058e50 msgr2=0x7f1ce0059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:36:00.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.589+0000 7f1ce630c640 1 -- 10.20.193.58:0/1803663173 shutdown_connections 2026-02-23T06:36:00.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.589+0000 7f1ce630c640 1 -- 10.20.193.58:0/1803663173 wait complete. 2026-02-23T06:36:00.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.590+0000 7f1ce630c640 1 Processor -- start 2026-02-23T06:36:00.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.590+0000 7f1ce630c640 1 -- start start 2026-02-23T06:36:00.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.591+0000 7f1ce630c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1ce00b1170 0x7f1ce00aeee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:00.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.591+0000 7f1ce630c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1ce00b1540 0x7f1ce01345f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:00.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.591+0000 7f1ce630c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1ce00b58a0 0x7f1ce0165480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:00.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.591+0000 7f1ce630c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce00b0a90 con 0x7f1ce00b58a0 2026-02-23T06:36:00.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.591+0000 7f1ce630c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce0118ad0 con 0x7f1ce00b1540 2026-02-23T06:36:00.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.591+0000 7f1ce630c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce0133400 con 0x7f1ce00b1170 2026-02-23T06:36:00.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.591+0000 7f1ce4882640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1ce00b58a0 0x7f1ce0165480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:00.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.591+0000 7f1ce4882640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1ce00b58a0 0x7f1ce0165480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:35506/0 (socket says 10.20.193.58:35506) 2026-02-23T06:36:00.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.591+0000 7f1ce4882640 1 -- 10.20.193.58:0/880313113 learned_addr learned my addr 10.20.193.58:0/880313113 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:36:00.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.591+0000 7f1cdffff640 1 --2- 10.20.193.58:0/880313113 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1ce00b1170 0x7f1ce00aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:00.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.591+0000 7f1ce4882640 1 -- 10.20.193.58:0/880313113 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1ce00b1170 msgr2=0x7f1ce00aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:00.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.591+0000 7f1ce4882640 1 --2- 10.20.193.58:0/880313113 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1ce00b1170 0x7f1ce00aeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.591+0000 7f1ce4882640 1 -- 10.20.193.58:0/880313113 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1ce00b1540 msgr2=0x7f1ce01345f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:00.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.591+0000 7f1ce4882640 1 --2- 10.20.193.58:0/880313113 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1ce00b1540 0x7f1ce01345f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.591+0000 7f1ce4882640 1 -- 10.20.193.58:0/880313113 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ccc009570 con 0x7f1ce00b58a0 2026-02-23T06:36:00.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.591+0000 7f1ce4882640 1 --2- 10.20.193.58:0/880313113 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1ce00b58a0 0x7f1ce0165480 secure :-1 s=READY pgs=150 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1cd4006e90 tx=0x7f1cd400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:00.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.592+0000 7f1cdcff9640 1 -- 10.20.193.58:0/880313113 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1cd4005500 con 0x7f1ce00b58a0 2026-02-23T06:36:00.589 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.592+0000 7f1cdcff9640 1 -- 10.20.193.58:0/880313113 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1cd4005930 con 0x7f1ce00b58a0 2026-02-23T06:36:00.589 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.592+0000 7f1cdcff9640 1 -- 10.20.193.58:0/880313113 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1cd4005d60 con 0x7f1ce00b58a0 2026-02-23T06:36:00.589 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.592+0000 7f1ce630c640 1 -- 10.20.193.58:0/880313113 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce0119be0 con 0x7f1ce00b58a0 2026-02-23T06:36:00.589 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.592+0000 7f1ce630c640 1 -- 10.20.193.58:0/880313113 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce00b07b0 con 0x7f1ce00b58a0 2026-02-23T06:36:00.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.592+0000 7f1ce630c640 1 --2- 10.20.193.58:0/880313113 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1ce00afe50 0x7f1ce01659c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:00.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.592+0000 7f1ce630c640 1 -- 10.20.193.58:0/880313113 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce0166fe0 con 0x7f1ce00afe50 2026-02-23T06:36:00.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.593+0000 7f1cdffff640 1 --2- 10.20.193.58:0/880313113 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1ce00afe50 0x7f1ce01659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:00.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.593+0000 7f1cdffff640 1 -- 10.20.193.58:0/880313113 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1ce0166d00 con 0x7f1ce00afe50 2026-02-23T06:36:00.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.593+0000 7f1cdffff640 1 --2- 10.20.193.58:0/880313113 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1ce00afe50 0x7f1ce01659c0 secure :-1 s=READY pgs=5 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ce00b1ce0 tx=0x7f1ccc0028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:00.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.594+0000 7f1cdcff9640 1 -- 10.20.193.58:0/880313113 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ccc03f070 con 0x7f1ce00afe50 2026-02-23T06:36:00.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.594+0000 7f1cdcff9640 1 -- 10.20.193.58:0/880313113 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f1cd400c840 con 0x7f1ce00b58a0 2026-02-23T06:36:00.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.594+0000 7f1cdcff9640 1 --2- 10.20.193.58:0/880313113 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1cb007a660 0x7f1cb009ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:00.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.594+0000 7f1cdcff9640 1 -- 10.20.193.58:0/880313113 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f1cd409eaa0 con 0x7f1ce00b58a0 2026-02-23T06:36:00.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.595+0000 7f1cdcff9640 1 -- 10.20.193.58:0/880313113 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f1ccc038470 con 0x7f1ce00afe50 2026-02-23T06:36:00.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.595+0000 7f1cdcff9640 1 -- 10.20.193.58:0/880313113 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1ce00afe50 msgr2=0x7f1ce01659c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:00.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.595+0000 7f1cdcff9640 1 --2- 10.20.193.58:0/880313113 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1ce00afe50 0x7f1ce01659c0 secure :-1 s=READY pgs=5 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ce00b1ce0 tx=0x7f1ccc0028d0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.595+0000 7f1cdcff9640 1 -- 10.20.193.58:0/880313113 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1ce00afe50 msgr2=0x7f1ce01659c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:36:00.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.595+0000 7f1cdcff9640 1 --2- 10.20.193.58:0/880313113 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1ce00afe50 0x7f1ce01659c0 secure :-1 s=CLOSED pgs=5 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ce00b1ce0 tx=0x7f1ccc0028d0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.595+0000 7f1cdf7fe640 1 --2- 10.20.193.58:0/880313113 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1cb007a660 0x7f1cb009ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:00.592 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.595+0000 7f1cdf7fe640 1 --2- 10.20.193.58:0/880313113 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1cb007a660 0x7f1cb009ab10 secure :-1 s=READY pgs=346 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1cd0005fd0 tx=0x7f1cd0005f00 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:00.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.599+0000 7f1ce630c640 1 --2- 10.20.193.58:0/880313113 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1ce0134b30 0x7f1ce00af420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:00.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.599+0000 7f1ce630c640 1 -- 10.20.193.58:0/880313113 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce005b2d0 con 0x7f1ce0134b30 2026-02-23T06:36:00.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.599+0000 7f1cdffff640 1 --2- 10.20.193.58:0/880313113 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1ce0134b30 0x7f1ce00af420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:00.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.599+0000 7f1cdffff640 1 -- 10.20.193.58:0/880313113 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1ce0160a30 con 0x7f1ce0134b30 2026-02-23T06:36:00.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.599+0000 7f1cdffff640 1 --2- 10.20.193.58:0/880313113 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1ce0134b30 0x7f1ce00af420 secure :-1 s=READY pgs=6 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ccc004740 tx=0x7f1ccc009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:00.596 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.599+0000 7f1cdcff9640 1 -- 10.20.193.58:0/880313113 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ccc038ce0 con 0x7f1ce0134b30 2026-02-23T06:36:00.596 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.600+0000 7f1cdcff9640 1 -- 10.20.193.58:0/880313113 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4911 (secure 0 0 0) 0x7f1ccc04a890 con 0x7f1ce0134b30 2026-02-23T06:36:00.596 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.600+0000 7f1cdcff9640 1 -- 10.20.193.58:0/880313113 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1ce0134b30 msgr2=0x7f1ce00af420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:00.596 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.600+0000 7f1cdcff9640 1 --2- 10.20.193.58:0/880313113 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1ce0134b30 0x7f1ce00af420 secure :-1 s=READY pgs=6 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ccc004740 tx=0x7f1ccc009310 comp rx=0 tx=0).stop 2026-02-23T06:36:00.596 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.600+0000 7f1cdcff9640 1 -- 10.20.193.58:0/880313113 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1ce0134b30 msgr2=0x7f1ce00af420 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:36:00.596 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.600+0000 7f1cdcff9640 1 --2- 10.20.193.58:0/880313113 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1ce0134b30 0x7f1ce00af420 secure :-1 s=CLOSED pgs=6 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ccc004740 tx=0x7f1ccc009310 comp rx=0 tx=0).stop 2026-02-23T06:36:00.597 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:36:00.597 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:36:00.597 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:36:00.597 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:36:00.597 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 126, 2026-02-23T06:36:00.597 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 15677, 2026-02-23T06:36:00.597 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:36:00.597 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:36:00.597 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:36:00.598 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:36:00.598 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:00.598 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:36:00.598 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:36:00.598 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:36:00.598 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:36:00.598 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:36:00.598 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:36:00.598 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:36:00.598 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:36:00.598 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:36:00.598 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:36:00.599 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:36:00.599 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:36:00.599 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:36:00.599 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:36:00.599 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:36:00.599 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:36:00.599 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:36:00.599 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:00.599 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:36:00.599 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:36:00.599 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:36:00.599 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:36:00.600 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:36:00.600 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:36:00.600 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:36:00.600 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:36:00.600 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:36:00.600 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:36:00.600 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:36:00.600 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:36:00.600 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:36:00.600 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:36:00.600 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:36:00.600 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:00.601 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.601 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:36:00.601 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:36:00.601 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:36:00.601 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:36:00.601 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:36:00.601 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:36:00.601 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:36:00.601 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:36:00.601 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:36:00.601 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:36:00.602 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:36:00.602 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:36:00.602 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:36:00.602 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:36:00.602 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:36:00.602 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:36:00.602 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:36:00.602 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:36:00.602 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:36:00.602 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:36:00.602 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:36:00.602 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:36:00.602 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:36:00.603 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:36:00.603 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:36:00.603 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:36:00.603 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:36:00.603 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:36:00.603 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:36:00.603 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:36:00.603 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:00.603 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:36:00.603 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.603 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:36:00.603 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.604 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:36:00.604 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:36:00.604 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:36:00.604 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:36:00.604 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.604 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:36:00.604 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:36:00.604 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:00.604 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.605 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.605 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:36:00.605 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:36:00.605 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:00.605 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:00.605 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:00.605 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.605 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:36:00.605 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:36:00.605 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:36:00.605 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:36:00.605 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:36:00.606 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:36:00.606 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.606 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.606 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:36:00.606 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:36:00.606 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:36:00.606 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:36:00.606 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.606 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:36:00.607 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:36:00.607 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:00.607 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.607 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.607 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:36:00.607 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:36:00.607 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:00.607 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:00.607 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:00.607 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.607 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:36:00.607 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:36:00.608 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:36:00.608 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:36:00.608 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:36:00.608 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:36:00.608 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.608 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.608 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:36:00.608 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:36:00.608 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:36:00.608 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:36:00.608 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.608 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:36:00.608 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:36:00.609 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:00.609 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.609 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.609 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:36:00.609 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:36:00.609 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:00.609 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:00.609 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:00.609 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.609 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:36:00.609 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:36:00.609 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:36:00.610 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:36:00.610 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:36:00.610 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:36:00.610 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:00.610 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:00.610 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.610 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:36:00.610 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:36:00.610 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.610 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:00.610 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:00.610 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:36:00.611 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:00.611 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:00.611 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:36:00.611 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:00.611 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:00.611 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:00.611 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:36:00.611 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:00.611 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:00.611 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:00.611 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:36:00.611 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:36:00.613 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.600+0000 7f1ce630c640 1 -- 10.20.193.58:0/880313113 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1cb007a660 msgr2=0x7f1cb009ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:00.613 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.600+0000 7f1ce630c640 1 --2- 10.20.193.58:0/880313113 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1cb007a660 0x7f1cb009ab10 secure :-1 s=READY pgs=346 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1cd0005fd0 tx=0x7f1cd0005f00 comp rx=0 tx=0).stop 2026-02-23T06:36:00.613 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.600+0000 7f1ce630c640 1 -- 10.20.193.58:0/880313113 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1ce00b58a0 msgr2=0x7f1ce0165480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:00.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.600+0000 7f1ce630c640 1 --2- 10.20.193.58:0/880313113 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1ce00b58a0 0x7f1ce0165480 secure :-1 s=READY pgs=150 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1cd4006e90 tx=0x7f1cd400edf0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.600+0000 7f1ce4882640 1 -- 10.20.193.58:0/880313113 reap_dead start 2026-02-23T06:36:00.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.600+0000 7f1ce4882640 1 -- 10.20.193.58:0/880313113 reap_dead start 2026-02-23T06:36:00.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.600+0000 7f1ce630c640 1 -- 10.20.193.58:0/880313113 shutdown_connections 2026-02-23T06:36:00.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.600+0000 7f1ce630c640 1 -- 10.20.193.58:0/880313113 >> 10.20.193.58:0/880313113 conn(0x7f1ce0058e50 msgr2=0x7f1ce0135900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:36:00.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.600+0000 7f1ce630c640 1 -- 10.20.193.58:0/880313113 shutdown_connections 2026-02-23T06:36:00.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.600+0000 7f1ce630c640 1 -- 10.20.193.58:0/880313113 wait complete. 2026-02-23T06:36:00.615 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:36:00.615 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:36:00.615 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:36:00.735 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.740+0000 7f549514b640 1 -- 10.20.193.58:0/3242431663 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f549015d870 msgr2=0x7f54900587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:00.735 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.740+0000 7f549514b640 1 --2- 10.20.193.58:0/3242431663 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f549015d870 0x7f54900587b0 secure :-1 s=READY pgs=152 gs=3 cs=0 l=1 c_cookie=10190238820797829925 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5480004740 tx=0x7f548002f1d0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.735 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.740+0000 7f549514b640 1 -- 10.20.193.58:0/3242431663 shutdown_connections 2026-02-23T06:36:00.735 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.740+0000 7f549514b640 1 --2- 10.20.193.58:0/3242431663 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f549015d870 0x7f54900587b0 unknown :-1 s=CLOSED pgs=152 gs=3 cs=0 l=1 c_cookie=10190238820797829925 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.735 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.740+0000 7f549514b640 1 -- 10.20.193.58:0/3242431663 >> 10.20.193.58:0/3242431663 conn(0x7f54900b3c20 msgr2=0x7f54900b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:36:00.735 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.740+0000 7f549514b640 1 -- 10.20.193.58:0/3242431663 shutdown_connections 2026-02-23T06:36:00.735 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.740+0000 7f549514b640 1 -- 10.20.193.58:0/3242431663 wait complete. 2026-02-23T06:36:00.736 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.741+0000 7f549514b640 1 Processor -- start 2026-02-23T06:36:00.736 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.741+0000 7f549514b640 1 -- start start 2026-02-23T06:36:00.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.742+0000 7f549514b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f54900b6690 0x7f5490120540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:00.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.742+0000 7f549514b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549015d4a0 0x7f549011c290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:00.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.742+0000 7f549514b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f549015d870 0x7f5490057650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:00.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.742+0000 7f549514b640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f54900571c0 con 0x7f54900b6690 2026-02-23T06:36:00.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.742+0000 7f549514b640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f5490161e10 con 0x7f549015d870 2026-02-23T06:36:00.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.742+0000 7f549514b640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f5490058dc0 con 0x7f549015d4a0 2026-02-23T06:36:00.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.742+0000 7f548ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f54900b6690 0x7f5490120540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:00.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.742+0000 7f548ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f54900b6690 0x7f5490120540 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:35518/0 (socket says 10.20.193.58:35518) 2026-02-23T06:36:00.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.742+0000 7f548ffff640 1 -- 10.20.193.58:0/2897446220 learned_addr learned my addr 10.20.193.58:0/2897446220 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:36:00.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.742+0000 7f548f7fe640 1 --2- 10.20.193.58:0/2897446220 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549015d4a0 0x7f549011c290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:00.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.742+0000 7f549494a640 1 --2- 10.20.193.58:0/2897446220 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f549015d870 0x7f5490057650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:00.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.742+0000 7f548ffff640 1 -- 10.20.193.58:0/2897446220 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549015d4a0 msgr2=0x7f549011c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:00.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.742+0000 7f548ffff640 1 --2- 10.20.193.58:0/2897446220 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549015d4a0 0x7f549011c290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.742+0000 7f548ffff640 1 -- 10.20.193.58:0/2897446220 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f549015d870 msgr2=0x7f5490057650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:00.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.742+0000 7f548ffff640 1 --2- 10.20.193.58:0/2897446220 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f549015d870 0x7f5490057650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.742+0000 7f548ffff640 1 -- 10.20.193.58:0/2897446220 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54800094b0 con 0x7f54900b6690 2026-02-23T06:36:00.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.742+0000 7f548f7fe640 1 --2- 10.20.193.58:0/2897446220 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549015d4a0 0x7f549011c290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:36:00.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.742+0000 7f549494a640 1 --2- 10.20.193.58:0/2897446220 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f549015d870 0x7f5490057650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:36:00.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.743+0000 7f548ffff640 1 --2- 10.20.193.58:0/2897446220 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f54900b6690 0x7f5490120540 secure :-1 s=READY pgs=153 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f547c00c4d0 tx=0x7f547c00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:00.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.743+0000 7f548cff9640 1 -- 10.20.193.58:0/2897446220 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f547c016070 con 0x7f54900b6690 2026-02-23T06:36:00.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.743+0000 7f548cff9640 1 -- 10.20.193.58:0/2897446220 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f547c005330 con 0x7f54900b6690 2026-02-23T06:36:00.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.743+0000 7f549514b640 1 -- 10.20.193.58:0/2897446220 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54901622e0 con 0x7f54900b6690 2026-02-23T06:36:00.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.743+0000 7f548cff9640 1 -- 10.20.193.58:0/2897446220 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f547c004780 con 0x7f54900b6690 2026-02-23T06:36:00.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.743+0000 7f549514b640 1 -- 10.20.193.58:0/2897446220 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54901628a0 con 0x7f54900b6690 2026-02-23T06:36:00.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.743+0000 7f549514b640 1 -- 10.20.193.58:0/2897446220 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54900b6d50 con 0x7f54900b6690 2026-02-23T06:36:00.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.745+0000 7f548cff9640 1 -- 10.20.193.58:0/2897446220 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f547c0048e0 con 0x7f54900b6690 2026-02-23T06:36:00.740 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.746+0000 7f548cff9640 1 --2- 10.20.193.58:0/2897446220 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f546007a630 0x7f546009aae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:00.740 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.746+0000 7f548cff9640 1 -- 10.20.193.58:0/2897446220 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f547c09dc20 con 0x7f54900b6690 2026-02-23T06:36:00.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.746+0000 7f548f7fe640 1 --2- 10.20.193.58:0/2897446220 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f546007a630 0x7f546009aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:00.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.746+0000 7f548cff9640 1 -- 10.20.193.58:0/2897446220 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f547c09de60 con 0x7f54900b6690 2026-02-23T06:36:00.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.747+0000 7f548f7fe640 1 --2- 10.20.193.58:0/2897446220 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f546007a630 0x7f546009aae0 secure :-1 s=READY pgs=347 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54800023d0 tx=0x7f5480031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:00.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.901+0000 7f549514b640 1 -- 10.20.193.58:0/2897446220 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f549011ea60 con 0x7f54900b6690 2026-02-23T06:36:00.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.901+0000 7f548cff9640 1 -- 10.20.193.58:0/2897446220 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f547c064700 con 0x7f54900b6690 2026-02-23T06:36:00.897 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.902+0000 7f549514b640 1 -- 10.20.193.58:0/2897446220 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f546007a630 msgr2=0x7f546009aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:00.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.902+0000 7f549514b640 1 --2- 10.20.193.58:0/2897446220 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f546007a630 0x7f546009aae0 secure :-1 s=READY pgs=347 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54800023d0 tx=0x7f5480031040 comp rx=0 tx=0).stop 2026-02-23T06:36:00.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.902+0000 7f549514b640 1 -- 10.20.193.58:0/2897446220 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f54900b6690 msgr2=0x7f5490120540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:00.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.902+0000 7f549514b640 1 --2- 10.20.193.58:0/2897446220 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f54900b6690 0x7f5490120540 secure :-1 s=READY pgs=153 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f547c00c4d0 tx=0x7f547c00c9a0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.902+0000 7f549514b640 1 -- 10.20.193.58:0/2897446220 shutdown_connections 2026-02-23T06:36:00.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.902+0000 7f549514b640 1 --2- 10.20.193.58:0/2897446220 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f546007a630 0x7f546009aae0 unknown :-1 s=CLOSED pgs=347 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.902+0000 7f549514b640 1 --2- 10.20.193.58:0/2897446220 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f549015d870 0x7f5490057650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.902+0000 7f549514b640 1 --2- 10.20.193.58:0/2897446220 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549015d4a0 0x7f549011c290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.902+0000 7f549514b640 1 --2- 10.20.193.58:0/2897446220 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f54900b6690 0x7f5490120540 unknown :-1 s=CLOSED pgs=153 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:00.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.902+0000 7f549514b640 1 -- 10.20.193.58:0/2897446220 >> 10.20.193.58:0/2897446220 conn(0x7f54900b3c20 msgr2=0x7f54900aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:36:00.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.902+0000 7f549514b640 1 -- 10.20.193.58:0/2897446220 shutdown_connections 2026-02-23T06:36:00.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:00.902+0000 7f549514b640 1 -- 10.20.193.58:0/2897446220 wait complete. 2026-02-23T06:36:00.911 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:36:10.911 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:36:10.911 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:36:11.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.039+0000 7f3c0f5d2640 1 -- 10.20.193.58:0/544283688 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c08056960 msgr2=0x7f3c080b6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:11.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.039+0000 7f3c0f5d2640 1 --2- 10.20.193.58:0/544283688 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c08056960 0x7f3c080b6720 secure :-1 s=READY pgs=154 gs=1 cs=0 l=1 c_cookie=5004808572372954593 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c08062070 tx=0x7f3bf402f1f0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.040+0000 7f3c0f5d2640 1 -- 10.20.193.58:0/544283688 shutdown_connections 2026-02-23T06:36:11.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.040+0000 7f3c0f5d2640 1 --2- 10.20.193.58:0/544283688 >> v2:10.20.193.93:3300/0 conn(0x7f3c08162ca0 0x7f3c080b6c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.040+0000 7f3c0f5d2640 1 --2- 10.20.193.58:0/544283688 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c08056960 0x7f3c080b6720 unknown :-1 s=CLOSED pgs=154 gs=1 cs=0 l=1 c_cookie=5004808572372954593 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.040+0000 7f3c0f5d2640 1 --2- 10.20.193.58:0/544283688 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c0815c4b0 0x7f3c08058200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.040+0000 7f3c0f5d2640 1 -- 10.20.193.58:0/544283688 >> 10.20.193.58:0/544283688 conn(0x7f3c080b3c20 msgr2=0x7f3c080b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:36:11.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.040+0000 7f3c0f5d2640 1 -- 10.20.193.58:0/544283688 shutdown_connections 2026-02-23T06:36:11.039 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.040+0000 7f3c0f5d2640 1 -- 10.20.193.58:0/544283688 wait complete. 2026-02-23T06:36:11.039 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.041+0000 7f3c0f5d2640 1 Processor -- start 2026-02-23T06:36:11.039 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.041+0000 7f3c0f5d2640 1 -- start start 2026-02-23T06:36:11.039 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.041+0000 7f3c0f5d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c08056960 0x7f3c0814a5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:11.039 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.041+0000 7f3c0f5d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3c0815c4b0 0x7f3c0811e640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:11.039 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.041+0000 7f3c0f5d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c08162ca0 0x7f3c0811eb80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:11.040 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.041+0000 7f3c0f5d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0814ab20 con 0x7f3c08056960 2026-02-23T06:36:11.040 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.041+0000 7f3c0f5d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0814a150 con 0x7f3c0815c4b0 2026-02-23T06:36:11.040 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.041+0000 7f3c0f5d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f3c0814dea0 con 0x7f3c08162ca0 2026-02-23T06:36:11.040 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.042+0000 7f3c0e5d0640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c08056960 0x7f3c0814a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:11.040 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.042+0000 7f3c0e5d0640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c08056960 0x7f3c0814a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:56258/0 (socket says 10.20.193.58:56258) 2026-02-23T06:36:11.040 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.042+0000 7f3c0e5d0640 1 -- 10.20.193.58:0/1414578261 learned_addr learned my addr 10.20.193.58:0/1414578261 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:36:11.040 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.042+0000 7f3c0edd1640 1 --2- 10.20.193.58:0/1414578261 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c08162ca0 0x7f3c0811eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:11.040 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.042+0000 7f3c0ddcf640 1 --2- 10.20.193.58:0/1414578261 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3c0815c4b0 0x7f3c0811e640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:11.040 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.042+0000 7f3c0e5d0640 1 -- 10.20.193.58:0/1414578261 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c08162ca0 msgr2=0x7f3c0811eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:11.040 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.042+0000 7f3c0e5d0640 1 --2- 10.20.193.58:0/1414578261 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c08162ca0 0x7f3c0811eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.040 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.042+0000 7f3c0e5d0640 1 -- 10.20.193.58:0/1414578261 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3c0815c4b0 msgr2=0x7f3c0811e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:11.040 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.042+0000 7f3c0e5d0640 1 --2- 10.20.193.58:0/1414578261 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3c0815c4b0 0x7f3c0811e640 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.041 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.042+0000 7f3c0e5d0640 1 -- 10.20.193.58:0/1414578261 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf4009570 con 0x7f3c08056960 2026-02-23T06:36:11.041 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.042+0000 7f3c0e5d0640 1 --2- 10.20.193.58:0/1414578261 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c08056960 0x7f3c0814a5e0 secure :-1 s=READY pgs=155 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c00006a50 tx=0x7f3c0000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:11.041 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.042+0000 7f3bf2ffd640 1 -- 10.20.193.58:0/1414578261 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3c00005500 con 0x7f3c08056960 2026-02-23T06:36:11.041 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.042+0000 7f3bf2ffd640 1 -- 10.20.193.58:0/1414578261 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c00005930 con 0x7f3c08056960 2026-02-23T06:36:11.041 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.042+0000 7f3c0f5d2640 1 -- 10.20.193.58:0/1414578261 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c080af0c0 con 0x7f3c08056960 2026-02-23T06:36:11.041 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.042+0000 7f3bf2ffd640 1 -- 10.20.193.58:0/1414578261 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3c00005d60 con 0x7f3c08056960 2026-02-23T06:36:11.041 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.042+0000 7f3c0f5d2640 1 -- 10.20.193.58:0/1414578261 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c08149de0 con 0x7f3c08056960 2026-02-23T06:36:11.041 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.043+0000 7f3c0f5d2640 1 -- 10.20.193.58:0/1414578261 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c0813a9a0 con 0x7f3c08056960 2026-02-23T06:36:11.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.045+0000 7f3bf2ffd640 1 -- 10.20.193.58:0/1414578261 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f3c0000a820 con 0x7f3c08056960 2026-02-23T06:36:11.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.046+0000 7f3bf2ffd640 1 --2- 10.20.193.58:0/1414578261 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3bd807a6c0 0x7f3bd809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:11.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.046+0000 7f3bf2ffd640 1 -- 10.20.193.58:0/1414578261 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f3c0009ead0 con 0x7f3c08056960 2026-02-23T06:36:11.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.046+0000 7f3c0ddcf640 1 --2- 10.20.193.58:0/1414578261 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3bd807a6c0 0x7f3bd809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:11.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.046+0000 7f3c0ddcf640 1 --2- 10.20.193.58:0/1414578261 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3bd807a6c0 0x7f3bd809ab70 secure :-1 s=READY pgs=354 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3bf40023d0 tx=0x7f3bf4031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:11.043 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.048+0000 7f3bf2ffd640 1 -- 10.20.193.58:0/1414578261 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f3c00061c70 con 0x7f3c08056960 2026-02-23T06:36:11.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.202+0000 7f3c0f5d2640 1 -- 10.20.193.58:0/1414578261 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3c080b7090 con 0x7f3c08056960 2026-02-23T06:36:11.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.202+0000 7f3bf2ffd640 1 -- 10.20.193.58:0/1414578261 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f3c00064d90 con 0x7f3c08056960 2026-02-23T06:36:11.197 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":126,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:36:11.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.203+0000 7f3c0f5d2640 1 -- 10.20.193.58:0/1414578261 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3bd807a6c0 msgr2=0x7f3bd809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:11.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.203+0000 7f3c0f5d2640 1 --2- 10.20.193.58:0/1414578261 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3bd807a6c0 0x7f3bd809ab70 secure :-1 s=READY pgs=354 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3bf40023d0 tx=0x7f3bf4031040 comp rx=0 tx=0).stop 2026-02-23T06:36:11.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.203+0000 7f3c0f5d2640 1 -- 10.20.193.58:0/1414578261 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c08056960 msgr2=0x7f3c0814a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:11.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.203+0000 7f3c0f5d2640 1 --2- 10.20.193.58:0/1414578261 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c08056960 0x7f3c0814a5e0 secure :-1 s=READY pgs=155 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c00006a50 tx=0x7f3c0000edf0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.203+0000 7f3c0f5d2640 1 -- 10.20.193.58:0/1414578261 shutdown_connections 2026-02-23T06:36:11.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.203+0000 7f3c0f5d2640 1 --2- 10.20.193.58:0/1414578261 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3bd807a6c0 0x7f3bd809ab70 unknown :-1 s=CLOSED pgs=354 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.203+0000 7f3c0f5d2640 1 --2- 10.20.193.58:0/1414578261 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3c08162ca0 0x7f3c0811eb80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.204+0000 7f3c0f5d2640 1 --2- 10.20.193.58:0/1414578261 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3c0815c4b0 0x7f3c0811e640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.204+0000 7f3c0f5d2640 1 --2- 10.20.193.58:0/1414578261 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3c08056960 0x7f3c0814a5e0 unknown :-1 s=CLOSED pgs=155 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.204+0000 7f3c0f5d2640 1 -- 10.20.193.58:0/1414578261 >> 10.20.193.58:0/1414578261 conn(0x7f3c080b3c20 msgr2=0x7f3c080b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:36:11.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.204+0000 7f3c0f5d2640 1 -- 10.20.193.58:0/1414578261 shutdown_connections 2026-02-23T06:36:11.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.204+0000 7f3c0f5d2640 1 -- 10.20.193.58:0/1414578261 wait complete. 2026-02-23T06:36:11.211 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:36:11.211 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:36:11.211 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:36:11.211 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:36:11.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.339+0000 7f498b283640 1 -- 10.20.193.58:0/4178815326 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f496c004de0 msgr2=0x7f496c005250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:11.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.339+0000 7f498b283640 1 --2- 10.20.193.58:0/4178815326 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f496c004de0 0x7f496c005250 secure :-1 s=READY pgs=157 gs=6 cs=0 l=1 c_cookie=11959167169434075925 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4980005820 tx=0x7f49800307b0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.339+0000 7f498aa82640 1 -- 10.20.193.58:0/4178815326 reap_dead start 2026-02-23T06:36:11.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.339+0000 7f498b283640 1 -- 10.20.193.58:0/4178815326 shutdown_connections 2026-02-23T06:36:11.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.339+0000 7f498b283640 1 -- 10.20.193.58:0/4178815326 >> 10.20.193.58:0/4178815326 conn(0x7f49840b3c20 msgr2=0x7f49840b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:36:11.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.339+0000 7f498b283640 1 -- 10.20.193.58:0/4178815326 shutdown_connections 2026-02-23T06:36:11.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.339+0000 7f498b283640 1 -- 10.20.193.58:0/4178815326 wait complete. 2026-02-23T06:36:11.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.340+0000 7f498b283640 1 Processor -- start 2026-02-23T06:36:11.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.340+0000 7f498b283640 1 -- start start 2026-02-23T06:36:11.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.341+0000 7f498b283640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f496c004de0 0x7f4984142800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:11.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.341+0000 7f498b283640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f49840b7920 0x7f498413e6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:11.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.341+0000 7f498b283640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49840b7d90 0x7f4984143c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:11.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.341+0000 7f498b283640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f498413e480 con 0x7f49840b7920 2026-02-23T06:36:11.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.341+0000 7f498b283640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f49840581c0 con 0x7f49840b7d90 2026-02-23T06:36:11.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.341+0000 7f498b283640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f498413bd70 con 0x7f496c004de0 2026-02-23T06:36:11.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.341+0000 7f4989a80640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f49840b7920 0x7f498413e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:11.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.341+0000 7f498aa82640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49840b7d90 0x7f4984143c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:11.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.341+0000 7f498aa82640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49840b7d90 0x7f4984143c80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:46350/0 (socket says 10.20.193.58:46350) 2026-02-23T06:36:11.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.341+0000 7f498aa82640 1 -- 10.20.193.58:0/3187111129 learned_addr learned my addr 10.20.193.58:0/3187111129 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:36:11.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.341+0000 7f498a281640 1 --2- 10.20.193.58:0/3187111129 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f496c004de0 0x7f4984142800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:11.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.341+0000 7f498aa82640 1 -- 10.20.193.58:0/3187111129 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f496c004de0 msgr2=0x7f4984142800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:11.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.341+0000 7f498aa82640 1 --2- 10.20.193.58:0/3187111129 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f496c004de0 0x7f4984142800 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.341+0000 7f498aa82640 1 -- 10.20.193.58:0/3187111129 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f49840b7920 msgr2=0x7f498413e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:11.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.341+0000 7f498aa82640 1 --2- 10.20.193.58:0/3187111129 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f49840b7920 0x7f498413e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.341+0000 7f498aa82640 1 -- 10.20.193.58:0/3187111129 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4984142fa0 con 0x7f49840b7d90 2026-02-23T06:36:11.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.342+0000 7f498aa82640 1 --2- 10.20.193.58:0/3187111129 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49840b7d90 0x7f4984143c80 secure :-1 s=READY pgs=52 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4980005040 tx=0x7f4980003920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:11.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.342+0000 7f496affd640 1 -- 10.20.193.58:0/3187111129 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4980003e40 con 0x7f49840b7d90 2026-02-23T06:36:11.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.342+0000 7f496affd640 1 -- 10.20.193.58:0/3187111129 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4980040410 con 0x7f49840b7d90 2026-02-23T06:36:11.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.342+0000 7f496affd640 1 -- 10.20.193.58:0/3187111129 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4980040820 con 0x7f49840b7d90 2026-02-23T06:36:11.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.342+0000 7f498b283640 1 -- 10.20.193.58:0/3187111129 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f498413e1a0 con 0x7f49840b7d90 2026-02-23T06:36:11.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.342+0000 7f498b283640 1 -- 10.20.193.58:0/3187111129 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4984143760 con 0x7f49840b7d90 2026-02-23T06:36:11.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.342+0000 7f498b283640 1 --2- 10.20.193.58:0/3187111129 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f498413ec30 0x7f49841441c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:11.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.343+0000 7f498b283640 1 -- 10.20.193.58:0/3187111129 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f4984143620 con 0x7f498413ec30 2026-02-23T06:36:11.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.343+0000 7f498a281640 1 --2- 10.20.193.58:0/3187111129 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f498413ec30 0x7f49841441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:11.342 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.343+0000 7f498a281640 1 -- 10.20.193.58:0/3187111129 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f49840b5e10 con 0x7f498413ec30 2026-02-23T06:36:11.342 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.343+0000 7f498a281640 1 --2- 10.20.193.58:0/3187111129 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f498413ec30 0x7f49841441c0 secure :-1 s=READY pgs=158 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4974002780 tx=0x7f4974003b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:11.342 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.343+0000 7f496affd640 1 -- 10.20.193.58:0/3187111129 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4974011a40 con 0x7f498413ec30 2026-02-23T06:36:11.342 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.344+0000 7f496affd640 1 -- 10.20.193.58:0/3187111129 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f4974011ba0 con 0x7f498413ec30 2026-02-23T06:36:11.342 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.344+0000 7f496affd640 1 -- 10.20.193.58:0/3187111129 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f498413ec30 msgr2=0x7f49841441c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:11.342 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.344+0000 7f496affd640 1 --2- 10.20.193.58:0/3187111129 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f498413ec30 0x7f49841441c0 secure :-1 s=READY pgs=158 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4974002780 tx=0x7f4974003b50 comp rx=0 tx=0).stop 2026-02-23T06:36:11.342 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.344+0000 7f496affd640 1 -- 10.20.193.58:0/3187111129 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f498413ec30 msgr2=0x7f49841441c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:36:11.342 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.344+0000 7f496affd640 1 --2- 10.20.193.58:0/3187111129 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f498413ec30 0x7f49841441c0 unknown :-1 s=CLOSED pgs=158 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.342 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.344+0000 7f496affd640 1 -- 10.20.193.58:0/3187111129 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f4980040980 con 0x7f49840b7d90 2026-02-23T06:36:11.342 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.345+0000 7f496affd640 1 --2- 10.20.193.58:0/3187111129 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f495407a3c0 0x7f495409a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:11.342 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.345+0000 7f496affd640 1 -- 10.20.193.58:0/3187111129 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f49800c3a10 con 0x7f49840b7d90 2026-02-23T06:36:11.343 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.345+0000 7f498a281640 1 --2- 10.20.193.58:0/3187111129 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f495407a3c0 0x7f495409a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:11.343 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.346+0000 7f498a281640 1 --2- 10.20.193.58:0/3187111129 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f495407a3c0 0x7f495409a870 secure :-1 s=READY pgs=355 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4974002b30 tx=0x7f497400c000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:11.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.347+0000 7f498b283640 1 --2- 10.20.193.58:0/3187111129 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f498413d0f0 0x7f498413d4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:11.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.347+0000 7f498b283640 1 -- 10.20.193.58:0/3187111129 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f498413e330 con 0x7f498413d0f0 2026-02-23T06:36:11.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.347+0000 7f4989a80640 1 --2- 10.20.193.58:0/3187111129 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f498413d0f0 0x7f498413d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:11.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.347+0000 7f4989a80640 1 -- 10.20.193.58:0/3187111129 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f49840b5b30 con 0x7f498413d0f0 2026-02-23T06:36:11.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.348+0000 7f4989a80640 1 --2- 10.20.193.58:0/3187111129 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f498413d0f0 0x7f498413d4c0 secure :-1 s=READY pgs=159 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49780067a0 tx=0x7f4978011be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:11.345 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.348+0000 7f496affd640 1 -- 10.20.193.58:0/3187111129 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f497800fb20 con 0x7f498413d0f0 2026-02-23T06:36:11.345 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.348+0000 7f496affd640 1 -- 10.20.193.58:0/3187111129 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5559 (secure 0 0 0) 0x7f4978016070 con 0x7f498413d0f0 2026-02-23T06:36:11.345 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.348+0000 7f496affd640 1 -- 10.20.193.58:0/3187111129 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f498413d0f0 msgr2=0x7f498413d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:11.345 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.348+0000 7f496affd640 1 --2- 10.20.193.58:0/3187111129 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f498413d0f0 0x7f498413d4c0 secure :-1 s=READY pgs=159 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49780067a0 tx=0x7f4978011be0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.345 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.348+0000 7f496affd640 1 -- 10.20.193.58:0/3187111129 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f498413d0f0 msgr2=0x7f498413d4c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:36:11.345 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.348+0000 7f496affd640 1 --2- 10.20.193.58:0/3187111129 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f498413d0f0 0x7f498413d4c0 unknown :-1 s=CLOSED pgs=159 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.345 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:36:11.345 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:36:11.346 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:36:11.346 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:36:11.346 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 126, 2026-02-23T06:36:11.346 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 178860, 2026-02-23T06:36:11.346 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:36:11.346 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:36:11.346 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:36:11.346 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:36:11.346 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:11.346 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:36:11.346 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:36:11.347 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:36:11.347 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:36:11.347 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:36:11.347 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:36:11.347 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:36:11.347 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:36:11.347 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:36:11.347 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:36:11.347 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:36:11.347 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:36:11.347 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:36:11.347 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:36:11.348 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:36:11.348 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:36:11.348 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:36:11.348 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:11.348 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:36:11.348 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:36:11.348 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:36:11.348 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:36:11.348 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:36:11.348 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:36:11.348 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:36:11.348 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:36:11.349 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:36:11.349 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:36:11.349 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:36:11.349 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:36:11.349 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:36:11.349 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:36:11.349 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:36:11.349 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:11.349 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.349 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:36:11.349 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:36:11.349 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:36:11.350 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:36:11.350 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:36:11.350 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:36:11.350 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:36:11.350 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:36:11.350 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:36:11.350 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:36:11.350 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:36:11.350 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:36:11.350 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:36:11.350 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:36:11.351 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:36:11.351 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:36:11.351 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:36:11.351 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:36:11.351 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:36:11.351 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:36:11.351 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:36:11.351 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:36:11.351 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:36:11.351 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:36:11.351 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:36:11.351 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:36:11.352 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:36:11.352 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:36:11.352 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:36:11.352 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:36:11.352 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:11.352 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:36:11.352 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.352 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:36:11.352 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.352 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:36:11.352 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:36:11.352 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:36:11.352 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:36:11.353 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.353 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:36:11.353 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:36:11.353 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:11.353 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.353 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.353 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:36:11.353 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:36:11.353 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:11.353 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:11.353 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:11.353 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.354 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:36:11.354 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:36:11.354 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:36:11.354 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:36:11.354 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:36:11.354 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:36:11.354 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.354 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.354 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:36:11.354 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:36:11.355 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:36:11.355 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:36:11.355 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.355 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:36:11.355 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:36:11.355 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:11.355 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.355 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.355 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:36:11.355 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:36:11.355 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:11.355 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:11.356 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:11.356 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.356 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:36:11.356 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:36:11.356 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:36:11.356 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:36:11.356 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:36:11.356 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:36:11.356 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.356 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.356 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:36:11.356 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:36:11.356 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:36:11.357 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:36:11.357 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.357 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:36:11.357 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:36:11.357 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:11.357 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.357 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.357 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:36:11.357 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:36:11.357 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:11.357 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:11.357 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:11.357 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.358 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:36:11.358 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:36:11.358 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:36:11.358 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:36:11.358 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:36:11.358 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:36:11.358 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:11.358 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:11.358 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.358 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:36:11.358 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:36:11.358 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.359 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:11.359 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:11.359 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:36:11.359 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:11.359 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:11.359 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:36:11.359 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.359 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:11.359 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:11.359 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:36:11.359 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:11.359 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:11.359 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:36:11.360 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.360 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:11.360 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:11.360 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:36:11.360 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:11.360 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:11.360 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:36:11.360 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.360 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:36:11.360 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:36:11.360 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:36:11.360 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.361 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.361 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:11.361 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:11.361 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:36:11.361 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:11.361 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:11.361 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:36:11.361 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.361 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:11.361 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:11.361 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:36:11.361 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:11.361 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:11.362 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.362 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:36:11.362 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:36:11.363 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.348+0000 7f498b283640 1 -- 10.20.193.58:0/3187111129 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f495407a3c0 msgr2=0x7f495409a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:11.363 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.348+0000 7f498b283640 1 --2- 10.20.193.58:0/3187111129 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f495407a3c0 0x7f495409a870 secure :-1 s=READY pgs=355 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4974002b30 tx=0x7f497400c000 comp rx=0 tx=0).stop 2026-02-23T06:36:11.363 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.348+0000 7f498b283640 1 -- 10.20.193.58:0/3187111129 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49840b7d90 msgr2=0x7f4984143c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:11.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.348+0000 7f498b283640 1 --2- 10.20.193.58:0/3187111129 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f49840b7d90 0x7f4984143c80 secure :-1 s=READY pgs=52 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4980005040 tx=0x7f4980003920 comp rx=0 tx=0).stop 2026-02-23T06:36:11.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.348+0000 7f498aa82640 1 -- 10.20.193.58:0/3187111129 reap_dead start 2026-02-23T06:36:11.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.348+0000 7f498aa82640 1 -- 10.20.193.58:0/3187111129 reap_dead start 2026-02-23T06:36:11.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.348+0000 7f498b283640 1 -- 10.20.193.58:0/3187111129 shutdown_connections 2026-02-23T06:36:11.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.348+0000 7f498b283640 1 -- 10.20.193.58:0/3187111129 >> 10.20.193.58:0/3187111129 conn(0x7f49840b3c20 msgr2=0x7f4984141e10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:36:11.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.348+0000 7f498b283640 1 -- 10.20.193.58:0/3187111129 shutdown_connections 2026-02-23T06:36:11.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.348+0000 7f498b283640 1 -- 10.20.193.58:0/3187111129 wait complete. 2026-02-23T06:36:11.365 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:36:11.365 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:36:11.365 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:36:11.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.493+0000 7ff646483640 1 -- 10.20.193.58:0/444219676 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff64015c040 msgr2=0x7ff628004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:11.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.493+0000 7ff646483640 1 --2- 10.20.193.58:0/444219676 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff64015c040 0x7ff628004ce0 secure :-1 s=READY pgs=7 gs=4 cs=0 l=1 c_cookie=8020905381251931141 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff630009b40 tx=0x7ff63002fc80 comp rx=0 tx=0).stop 2026-02-23T06:36:11.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.493+0000 7ff645c82640 1 -- 10.20.193.58:0/444219676 reap_dead start 2026-02-23T06:36:11.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.494+0000 7ff646483640 1 -- 10.20.193.58:0/444219676 shutdown_connections 2026-02-23T06:36:11.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.494+0000 7ff646483640 1 -- 10.20.193.58:0/444219676 >> 10.20.193.58:0/444219676 conn(0x7ff6400b3c20 msgr2=0x7ff6400b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:36:11.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.494+0000 7ff646483640 1 -- 10.20.193.58:0/444219676 shutdown_connections 2026-02-23T06:36:11.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.494+0000 7ff646483640 1 -- 10.20.193.58:0/444219676 wait complete. 2026-02-23T06:36:11.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.495+0000 7ff646483640 1 Processor -- start 2026-02-23T06:36:11.493 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.495+0000 7ff646483640 1 -- start start 2026-02-23T06:36:11.493 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.495+0000 7ff646483640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff64015c040 0x7ff6400ac4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:11.493 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.495+0000 7ff646483640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff640058430 0x7ff640155930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:11.493 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.495+0000 7ff646483640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff6400ad5f0 0x7ff6400ada90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:11.493 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.495+0000 7ff646483640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff6400afde0 con 0x7ff64015c040 2026-02-23T06:36:11.493 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.495+0000 7ff646483640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff6400ace60 con 0x7ff6400ad5f0 2026-02-23T06:36:11.493 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.495+0000 7ff646483640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7ff6400aca30 con 0x7ff640058430 2026-02-23T06:36:11.493 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.496+0000 7ff645481640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff64015c040 0x7ff6400ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:11.493 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.496+0000 7ff645481640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff64015c040 0x7ff6400ac4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:56324/0 (socket says 10.20.193.58:56324) 2026-02-23T06:36:11.493 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.496+0000 7ff645481640 1 -- 10.20.193.58:0/2263193629 learned_addr learned my addr 10.20.193.58:0/2263193629 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:36:11.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.496+0000 7ff644c80640 1 --2- 10.20.193.58:0/2263193629 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff640058430 0x7ff640155930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:11.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.496+0000 7ff645c82640 1 --2- 10.20.193.58:0/2263193629 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff6400ad5f0 0x7ff6400ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:11.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.496+0000 7ff645481640 1 -- 10.20.193.58:0/2263193629 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff640058430 msgr2=0x7ff640155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:11.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.496+0000 7ff645481640 1 --2- 10.20.193.58:0/2263193629 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff640058430 0x7ff640155930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.496+0000 7ff645481640 1 -- 10.20.193.58:0/2263193629 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff6400ad5f0 msgr2=0x7ff6400ada90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:11.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.496+0000 7ff645481640 1 --2- 10.20.193.58:0/2263193629 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff6400ad5f0 0x7ff6400ada90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.496+0000 7ff645481640 1 -- 10.20.193.58:0/2263193629 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff640059090 con 0x7ff64015c040 2026-02-23T06:36:11.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.496+0000 7ff645481640 1 --2- 10.20.193.58:0/2263193629 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff64015c040 0x7ff6400ac4f0 secure :-1 s=READY pgs=161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff630009a90 tx=0x7ff630004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:11.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.496+0000 7ff62dffb640 1 -- 10.20.193.58:0/2263193629 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff630004520 con 0x7ff64015c040 2026-02-23T06:36:11.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.496+0000 7ff62dffb640 1 -- 10.20.193.58:0/2263193629 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff6300026a0 con 0x7ff64015c040 2026-02-23T06:36:11.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.496+0000 7ff62dffb640 1 -- 10.20.193.58:0/2263193629 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff630002a70 con 0x7ff64015c040 2026-02-23T06:36:11.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.496+0000 7ff646483640 1 -- 10.20.193.58:0/2263193629 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff640058db0 con 0x7ff64015c040 2026-02-23T06:36:11.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.496+0000 7ff646483640 1 -- 10.20.193.58:0/2263193629 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff640201da0 con 0x7ff64015c040 2026-02-23T06:36:11.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.497+0000 7ff646483640 1 --2- 10.20.193.58:0/2263193629 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff6400acfd0 0x7ff6401598a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:11.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.497+0000 7ff646483640 1 -- 10.20.193.58:0/2263193629 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff6400609c0 con 0x7ff6400acfd0 2026-02-23T06:36:11.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.497+0000 7ff644c80640 1 --2- 10.20.193.58:0/2263193629 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff6400acfd0 0x7ff6401598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:11.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.498+0000 7ff644c80640 1 -- 10.20.193.58:0/2263193629 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff64005d9c0 con 0x7ff6400acfd0 2026-02-23T06:36:11.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.498+0000 7ff644c80640 1 --2- 10.20.193.58:0/2263193629 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff6400acfd0 0x7ff6401598a0 secure :-1 s=READY pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff640059330 tx=0x7ff634011e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:11.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.498+0000 7ff62dffb640 1 -- 10.20.193.58:0/2263193629 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff63400fc30 con 0x7ff6400acfd0 2026-02-23T06:36:11.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.498+0000 7ff62dffb640 1 -- 10.20.193.58:0/2263193629 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7ff630002bd0 con 0x7ff64015c040 2026-02-23T06:36:11.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.499+0000 7ff62dffb640 1 --2- 10.20.193.58:0/2263193629 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff61007a660 0x7ff61009ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:11.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.499+0000 7ff62dffb640 1 -- 10.20.193.58:0/2263193629 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7ff634016070 con 0x7ff6400acfd0 2026-02-23T06:36:11.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.499+0000 7ff62dffb640 1 -- 10.20.193.58:0/2263193629 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff6400acfd0 msgr2=0x7ff6401598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:11.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.499+0000 7ff62dffb640 1 --2- 10.20.193.58:0/2263193629 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff6400acfd0 0x7ff6401598a0 secure :-1 s=READY pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff640059330 tx=0x7ff634011e10 comp rx=0 tx=0).stop 2026-02-23T06:36:11.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.499+0000 7ff62dffb640 1 -- 10.20.193.58:0/2263193629 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff6400acfd0 msgr2=0x7ff6401598a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:36:11.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.499+0000 7ff62dffb640 1 --2- 10.20.193.58:0/2263193629 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff6400acfd0 0x7ff6401598a0 secure :-1 s=CLOSED pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff640059330 tx=0x7ff634011e10 comp rx=0 tx=0).stop 2026-02-23T06:36:11.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.499+0000 7ff62dffb640 1 -- 10.20.193.58:0/2263193629 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7ff630035070 con 0x7ff64015c040 2026-02-23T06:36:11.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.500+0000 7ff645c82640 1 --2- 10.20.193.58:0/2263193629 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff61007a660 0x7ff61009ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:11.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.500+0000 7ff645c82640 1 --2- 10.20.193.58:0/2263193629 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff61007a660 0x7ff61009ab10 secure :-1 s=READY pgs=357 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff63c0039b0 tx=0x7ff63c004640 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:11.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.504+0000 7ff646483640 1 --2- 10.20.193.58:0/2263193629 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff6400b1090 0x7ff640159de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:11.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.504+0000 7ff646483640 1 -- 10.20.193.58:0/2263193629 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff64015c410 con 0x7ff6400b1090 2026-02-23T06:36:11.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.504+0000 7ff644c80640 1 --2- 10.20.193.58:0/2263193629 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff6400b1090 0x7ff640159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:11.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.504+0000 7ff644c80640 1 -- 10.20.193.58:0/2263193629 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff64005d540 con 0x7ff6400b1090 2026-02-23T06:36:11.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.504+0000 7ff644c80640 1 --2- 10.20.193.58:0/2263193629 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff6400b1090 0x7ff640159de0 secure :-1 s=READY pgs=55 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff640038c20 tx=0x7ff634006cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:11.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.505+0000 7ff62dffb640 1 -- 10.20.193.58:0/2263193629 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff634012d10 con 0x7ff6400b1090 2026-02-23T06:36:11.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.505+0000 7ff62dffb640 1 -- 10.20.193.58:0/2263193629 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5413 (secure 0 0 0) 0x7ff634012e70 con 0x7ff6400b1090 2026-02-23T06:36:11.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.505+0000 7ff62dffb640 1 -- 10.20.193.58:0/2263193629 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff6400b1090 msgr2=0x7ff640159de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:11.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.505+0000 7ff62dffb640 1 --2- 10.20.193.58:0/2263193629 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff6400b1090 0x7ff640159de0 secure :-1 s=READY pgs=55 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff640038c20 tx=0x7ff634006cc0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.505+0000 7ff62dffb640 1 -- 10.20.193.58:0/2263193629 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff6400b1090 msgr2=0x7ff640159de0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:36:11.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.505+0000 7ff62dffb640 1 --2- 10.20.193.58:0/2263193629 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff6400b1090 0x7ff640159de0 unknown :-1 s=CLOSED pgs=55 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.501 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:36:11.501 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:36:11.501 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:36:11.501 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:36:11.501 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 126, 2026-02-23T06:36:11.502 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 84088, 2026-02-23T06:36:11.502 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:36:11.502 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:36:11.502 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:36:11.502 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:36:11.502 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:11.502 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:36:11.502 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:36:11.502 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:36:11.502 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:36:11.502 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:36:11.503 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:36:11.503 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:36:11.503 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:36:11.503 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:36:11.503 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:36:11.503 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:36:11.503 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:36:11.503 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:36:11.503 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:36:11.503 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:36:11.503 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:36:11.503 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:36:11.503 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:11.504 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:36:11.504 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:36:11.504 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:36:11.504 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:36:11.504 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:36:11.504 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:36:11.504 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:36:11.504 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:36:11.504 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:36:11.504 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:36:11.504 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:36:11.504 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:36:11.505 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:36:11.505 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:36:11.505 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:36:11.505 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:11.505 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.505 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:36:11.505 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:36:11.505 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:36:11.505 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:36:11.505 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:36:11.505 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:36:11.505 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:36:11.506 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:36:11.506 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:36:11.506 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:36:11.506 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:36:11.506 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:36:11.506 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:36:11.506 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:36:11.506 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:36:11.506 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:36:11.506 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:36:11.506 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:36:11.506 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:36:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:36:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:36:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:36:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:36:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:36:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:36:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:36:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:36:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:36:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:36:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:36:11.507 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:36:11.508 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:36:11.508 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:36:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:36:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:36:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:36:11.508 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:36:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:36:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:11.508 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.509 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.509 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:36:11.509 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:36:11.509 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:11.509 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:11.509 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:11.509 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.509 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:36:11.509 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:36:11.509 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:36:11.509 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:36:11.509 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:36:11.510 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:36:11.510 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.510 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.510 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:36:11.510 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:36:11.510 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:36:11.510 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:36:11.510 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.510 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:36:11.510 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:36:11.510 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:11.510 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.510 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:36:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:36:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:11.511 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:11.511 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:11.511 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:36:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:36:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:36:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:36:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:36:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:36:11.511 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.512 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.512 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:36:11.512 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:36:11.512 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:36:11.512 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:36:11.512 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.512 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:36:11.512 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:36:11.512 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:11.512 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.512 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.512 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:36:11.512 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:36:11.513 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:11.513 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:11.513 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:11.513 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.513 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:36:11.513 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:36:11.513 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:36:11.513 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:36:11.513 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:36:11.513 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:36:11.513 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:11.514 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:11.514 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.514 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:36:11.514 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:36:11.514 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.514 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:11.514 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:11.514 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:36:11.514 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:11.514 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:11.514 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:36:11.514 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.514 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:11.515 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:11.515 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:36:11.515 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:11.515 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:11.515 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:36:11.515 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.515 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:11.515 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:11.515 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:36:11.515 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:11.516 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:11.516 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:36:11.516 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.516 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:11.516 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:11.516 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:36:11.516 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:11.516 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:11.516 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:36:11.516 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.516 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:11.516 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:11.516 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:36:11.517 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:11.517 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:11.517 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.517 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:36:11.517 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:36:11.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.505+0000 7ff646483640 1 -- 10.20.193.58:0/2263193629 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff61007a660 msgr2=0x7ff61009ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:11.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.505+0000 7ff646483640 1 --2- 10.20.193.58:0/2263193629 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff61007a660 0x7ff61009ab10 secure :-1 s=READY pgs=357 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff63c0039b0 tx=0x7ff63c004640 comp rx=0 tx=0).stop 2026-02-23T06:36:11.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.505+0000 7ff646483640 1 -- 10.20.193.58:0/2263193629 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff64015c040 msgr2=0x7ff6400ac4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:11.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.505+0000 7ff646483640 1 --2- 10.20.193.58:0/2263193629 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff64015c040 0x7ff6400ac4f0 secure :-1 s=READY pgs=161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff630009a90 tx=0x7ff630004a50 comp rx=0 tx=0).stop 2026-02-23T06:36:11.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.505+0000 7ff645c82640 1 -- 10.20.193.58:0/2263193629 reap_dead start 2026-02-23T06:36:11.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.505+0000 7ff645c82640 1 -- 10.20.193.58:0/2263193629 reap_dead start 2026-02-23T06:36:11.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.505+0000 7ff646483640 1 -- 10.20.193.58:0/2263193629 shutdown_connections 2026-02-23T06:36:11.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.505+0000 7ff646483640 1 -- 10.20.193.58:0/2263193629 >> 10.20.193.58:0/2263193629 conn(0x7ff6400b3c20 msgr2=0x7ff640156a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:36:11.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.505+0000 7ff646483640 1 -- 10.20.193.58:0/2263193629 shutdown_connections 2026-02-23T06:36:11.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.505+0000 7ff646483640 1 -- 10.20.193.58:0/2263193629 wait complete. 2026-02-23T06:36:11.520 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:36:11.520 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:36:11.520 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:36:11.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.647+0000 7fbd2a083640 1 -- 10.20.193.58:0/1113442127 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd2415d870 msgr2=0x7fbd240587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:11.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.647+0000 7fbd2a083640 1 --2- 10.20.193.58:0/1113442127 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd2415d870 0x7fbd240587b0 secure :-1 s=READY pgs=162 gs=3 cs=0 l=1 c_cookie=10045565451921151383 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd18004740 tx=0x7fbd1802f1e0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.647+0000 7fbd2a083640 1 -- 10.20.193.58:0/1113442127 shutdown_connections 2026-02-23T06:36:11.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.647+0000 7fbd2a083640 1 --2- 10.20.193.58:0/1113442127 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd240b6690 0x7fbd24058cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.647+0000 7fbd2a083640 1 --2- 10.20.193.58:0/1113442127 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd2415d870 0x7fbd240587b0 unknown :-1 s=CLOSED pgs=162 gs=3 cs=0 l=1 c_cookie=10045565451921151383 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.647+0000 7fbd2a083640 1 -- 10.20.193.58:0/1113442127 >> 10.20.193.58:0/1113442127 conn(0x7fbd240b3c20 msgr2=0x7fbd240b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:36:11.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.647+0000 7fbd2a083640 1 -- 10.20.193.58:0/1113442127 shutdown_connections 2026-02-23T06:36:11.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.647+0000 7fbd2a083640 1 -- 10.20.193.58:0/1113442127 wait complete. 2026-02-23T06:36:11.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.648+0000 7fbd2a083640 1 Processor -- start 2026-02-23T06:36:11.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.648+0000 7fbd2a083640 1 -- start start 2026-02-23T06:36:11.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.649+0000 7fbd2a083640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd240b6690 0x7fbd241fda60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:11.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.649+0000 7fbd2a083640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd2415d4a0 0x7fbd24141650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:11.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.649+0000 7fbd2a083640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd2415d870 0x7fbd24141b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:11.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.649+0000 7fbd2a083640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fbd24057b10 con 0x7fbd2415d4a0 2026-02-23T06:36:11.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.649+0000 7fbd2a083640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fbd242019a0 con 0x7fbd240b6690 2026-02-23T06:36:11.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.649+0000 7fbd2a083640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fbd241422a0 con 0x7fbd2415d870 2026-02-23T06:36:11.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.649+0000 7fbd29081640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd240b6690 0x7fbd241fda60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:11.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.649+0000 7fbd28880640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd2415d4a0 0x7fbd24141650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:11.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.649+0000 7fbd29081640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd240b6690 0x7fbd241fda60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:46398/0 (socket says 10.20.193.58:46398) 2026-02-23T06:36:11.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.649+0000 7fbd29081640 1 -- 10.20.193.58:0/3634502909 learned_addr learned my addr 10.20.193.58:0/3634502909 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:36:11.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.649+0000 7fbd29882640 1 --2- 10.20.193.58:0/3634502909 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd2415d870 0x7fbd24141b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:11.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.649+0000 7fbd28880640 1 -- 10.20.193.58:0/3634502909 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd2415d870 msgr2=0x7fbd24141b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:11.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.649+0000 7fbd28880640 1 --2- 10.20.193.58:0/3634502909 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd2415d870 0x7fbd24141b90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.649+0000 7fbd28880640 1 -- 10.20.193.58:0/3634502909 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd240b6690 msgr2=0x7fbd241fda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:11.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.649+0000 7fbd28880640 1 --2- 10.20.193.58:0/3634502909 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd240b6690 0x7fbd241fda60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.649+0000 7fbd28880640 1 -- 10.20.193.58:0/3634502909 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd180094b0 con 0x7fbd2415d4a0 2026-02-23T06:36:11.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.649+0000 7fbd29081640 1 --2- 10.20.193.58:0/3634502909 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd240b6690 0x7fbd241fda60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:36:11.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.650+0000 7fbd28880640 1 --2- 10.20.193.58:0/3634502909 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd2415d4a0 0x7fbd24141650 secure :-1 s=READY pgs=163 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd18009230 tx=0x7fbd180028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:11.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.650+0000 7fbd11ffb640 1 -- 10.20.193.58:0/3634502909 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd18038470 con 0x7fbd2415d4a0 2026-02-23T06:36:11.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.650+0000 7fbd11ffb640 1 -- 10.20.193.58:0/3634502909 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd180386c0 con 0x7fbd2415d4a0 2026-02-23T06:36:11.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.650+0000 7fbd11ffb640 1 -- 10.20.193.58:0/3634502909 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd18038af0 con 0x7fbd2415d4a0 2026-02-23T06:36:11.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.650+0000 7fbd2a083640 1 -- 10.20.193.58:0/3634502909 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd2413f670 con 0x7fbd2415d4a0 2026-02-23T06:36:11.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.650+0000 7fbd2a083640 1 -- 10.20.193.58:0/3634502909 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd24201e30 con 0x7fbd2415d4a0 2026-02-23T06:36:11.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.650+0000 7fbd2a083640 1 --2- 10.20.193.58:0/3634502909 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd241fdfa0 0x7fbd24201070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:11.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.650+0000 7fbd2a083640 1 -- 10.20.193.58:0/3634502909 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fbd240b6330 con 0x7fbd241fdfa0 2026-02-23T06:36:11.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.651+0000 7fbd29081640 1 --2- 10.20.193.58:0/3634502909 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd241fdfa0 0x7fbd24201070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:11.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.651+0000 7fbd29081640 1 -- 10.20.193.58:0/3634502909 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd240b5e10 con 0x7fbd241fdfa0 2026-02-23T06:36:11.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.651+0000 7fbd29081640 1 --2- 10.20.193.58:0/3634502909 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd241fdfa0 0x7fbd24201070 secure :-1 s=READY pgs=8 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd14007a80 tx=0x7fbd1400eba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:11.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.651+0000 7fbd11ffb640 1 -- 10.20.193.58:0/3634502909 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fbd18038c50 con 0x7fbd2415d4a0 2026-02-23T06:36:11.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.652+0000 7fbd11ffb640 1 --2- 10.20.193.58:0/3634502909 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbcf407a5f0 0x7fbcf409aaa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:11.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.652+0000 7fbd11ffb640 1 -- 10.20.193.58:0/3634502909 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fbd180c2c60 con 0x7fbd2415d4a0 2026-02-23T06:36:11.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.652+0000 7fbd11ffb640 1 -- 10.20.193.58:0/3634502909 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd1400ca90 con 0x7fbd241fdfa0 2026-02-23T06:36:11.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.652+0000 7fbd11ffb640 1 -- 10.20.193.58:0/3634502909 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fbd1400ee00 con 0x7fbd241fdfa0 2026-02-23T06:36:11.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.652+0000 7fbd11ffb640 1 -- 10.20.193.58:0/3634502909 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd241fdfa0 msgr2=0x7fbd24201070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:11.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.652+0000 7fbd11ffb640 1 --2- 10.20.193.58:0/3634502909 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd241fdfa0 0x7fbd24201070 secure :-1 s=READY pgs=8 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd14007a80 tx=0x7fbd1400eba0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.653+0000 7fbd11ffb640 1 -- 10.20.193.58:0/3634502909 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd241fdfa0 msgr2=0x7fbd24201070 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:36:11.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.653+0000 7fbd11ffb640 1 --2- 10.20.193.58:0/3634502909 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd241fdfa0 0x7fbd24201070 secure :-1 s=CLOSED pgs=8 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd14007a80 tx=0x7fbd1400eba0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.653+0000 7fbd29882640 1 --2- 10.20.193.58:0/3634502909 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbcf407a5f0 0x7fbcf409aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:11.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.654+0000 7fbd29882640 1 --2- 10.20.193.58:0/3634502909 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbcf407a5f0 0x7fbcf409aaa0 secure :-1 s=READY pgs=358 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd20005820 tx=0x7fbd2000a310 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:11.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.656+0000 7fbd2a083640 1 --2- 10.20.193.58:0/3634502909 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd2415fb20 0x7fbd2415fef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:11.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.656+0000 7fbd2a083640 1 -- 10.20.193.58:0/3634502909 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fbd240b6d50 con 0x7fbd2415fb20 2026-02-23T06:36:11.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.657+0000 7fbd29081640 1 --2- 10.20.193.58:0/3634502909 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd2415fb20 0x7fbd2415fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:11.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.657+0000 7fbd29081640 1 -- 10.20.193.58:0/3634502909 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbd2405b0e0 con 0x7fbd2415fb20 2026-02-23T06:36:11.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.657+0000 7fbd29081640 1 --2- 10.20.193.58:0/3634502909 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd2415fb20 0x7fbd2415fef0 secure :-1 s=READY pgs=9 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd14007a80 tx=0x7fbd14002850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:11.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.658+0000 7fbd11ffb640 1 -- 10.20.193.58:0/3634502909 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd14022070 con 0x7fbd2415fb20 2026-02-23T06:36:11.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.658+0000 7fbd11ffb640 1 -- 10.20.193.58:0/3634502909 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4912 (secure 0 0 0) 0x7fbd140040d0 con 0x7fbd2415fb20 2026-02-23T06:36:11.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.658+0000 7fbd11ffb640 1 -- 10.20.193.58:0/3634502909 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd2415fb20 msgr2=0x7fbd2415fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:11.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.658+0000 7fbd11ffb640 1 --2- 10.20.193.58:0/3634502909 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd2415fb20 0x7fbd2415fef0 secure :-1 s=READY pgs=9 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd14007a80 tx=0x7fbd14002850 comp rx=0 tx=0).stop 2026-02-23T06:36:11.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.658+0000 7fbd11ffb640 1 -- 10.20.193.58:0/3634502909 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd2415fb20 msgr2=0x7fbd2415fef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:36:11.654 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.658+0000 7fbd11ffb640 1 --2- 10.20.193.58:0/3634502909 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd2415fb20 0x7fbd2415fef0 secure :-1 s=CLOSED pgs=9 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd14007a80 tx=0x7fbd14002850 comp rx=0 tx=0).stop 2026-02-23T06:36:11.654 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:36:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:36:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:36:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:36:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 126, 2026-02-23T06:36:11.654 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 26735, 2026-02-23T06:36:11.655 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:36:11.655 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:36:11.655 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:36:11.655 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:36:11.655 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:11.655 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:36:11.655 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:36:11.655 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:36:11.655 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:36:11.655 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:36:11.655 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:36:11.656 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:36:11.656 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:36:11.656 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:36:11.656 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:36:11.656 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:36:11.656 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:36:11.656 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:36:11.656 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:36:11.656 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:36:11.656 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:36:11.656 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:36:11.656 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:11.656 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:36:11.657 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:36:11.657 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:36:11.657 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:36:11.657 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:36:11.657 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:36:11.657 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:36:11.657 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:36:11.657 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:36:11.657 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:36:11.658 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:36:11.658 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:36:11.658 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:36:11.658 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:36:11.658 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:36:11.658 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:11.658 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.658 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:36:11.658 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:36:11.658 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:36:11.658 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:36:11.658 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:36:11.659 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:36:11.659 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:36:11.659 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:36:11.659 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:36:11.659 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:36:11.659 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:36:11.659 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:36:11.659 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:36:11.659 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:36:11.659 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:36:11.659 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:36:11.659 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:36:11.659 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:36:11.660 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:36:11.660 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:36:11.660 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:36:11.660 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:36:11.660 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:36:11.660 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:36:11.660 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:36:11.660 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:36:11.660 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:36:11.660 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:36:11.660 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:36:11.660 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:36:11.661 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:11.661 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:36:11.661 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.661 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:36:11.661 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.661 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:36:11.661 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:36:11.661 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:36:11.661 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:36:11.661 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.661 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:36:11.661 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:36:11.662 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:11.662 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.662 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.662 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:36:11.662 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:36:11.662 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:11.662 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:11.662 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:11.662 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.662 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:36:11.662 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:36:11.662 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:36:11.662 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:36:11.663 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:36:11.663 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:36:11.663 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.663 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.663 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:36:11.663 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:36:11.663 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:36:11.663 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:36:11.663 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.663 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:36:11.663 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:36:11.663 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:11.664 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.664 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.664 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:36:11.664 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:36:11.664 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:11.664 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:11.664 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:11.664 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.664 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:36:11.664 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:36:11.664 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:36:11.664 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:36:11.664 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:36:11.665 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:36:11.665 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.665 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.665 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:36:11.665 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:36:11.665 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:36:11.665 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:36:11.665 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.665 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:36:11.665 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:36:11.665 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:11.666 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.666 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.666 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:36:11.666 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:36:11.666 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:11.666 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:11.666 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:11.666 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.666 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:36:11.666 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:36:11.666 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:36:11.667 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:36:11.667 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:36:11.667 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:36:11.667 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:11.667 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:11.667 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.667 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:36:11.667 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:36:11.667 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.667 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:11.667 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:11.667 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:36:11.668 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:11.668 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:11.668 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:36:11.668 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:11.668 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:11.668 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:11.668 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:36:11.668 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:11.668 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:11.668 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:11.668 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:36:11.668 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:36:11.670 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.658+0000 7fbd2a083640 1 -- 10.20.193.58:0/3634502909 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbcf407a5f0 msgr2=0x7fbcf409aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:11.670 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.658+0000 7fbd2a083640 1 --2- 10.20.193.58:0/3634502909 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbcf407a5f0 0x7fbcf409aaa0 secure :-1 s=READY pgs=358 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd20005820 tx=0x7fbd2000a310 comp rx=0 tx=0).stop 2026-02-23T06:36:11.670 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.658+0000 7fbd2a083640 1 -- 10.20.193.58:0/3634502909 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd2415d4a0 msgr2=0x7fbd24141650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:11.671 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.658+0000 7fbd2a083640 1 --2- 10.20.193.58:0/3634502909 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd2415d4a0 0x7fbd24141650 secure :-1 s=READY pgs=163 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd18009230 tx=0x7fbd180028d0 comp rx=0 tx=0).stop 2026-02-23T06:36:11.671 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.658+0000 7fbd29882640 1 -- 10.20.193.58:0/3634502909 reap_dead start 2026-02-23T06:36:11.671 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.658+0000 7fbd29882640 1 -- 10.20.193.58:0/3634502909 reap_dead start 2026-02-23T06:36:11.671 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.658+0000 7fbd2a083640 1 -- 10.20.193.58:0/3634502909 shutdown_connections 2026-02-23T06:36:11.671 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.658+0000 7fbd2a083640 1 -- 10.20.193.58:0/3634502909 >> 10.20.193.58:0/3634502909 conn(0x7fbd240b3c20 msgr2=0x7fbd240aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:36:11.671 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.658+0000 7fbd2a083640 1 -- 10.20.193.58:0/3634502909 shutdown_connections 2026-02-23T06:36:11.671 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:11.658+0000 7fbd2a083640 1 -- 10.20.193.58:0/3634502909 wait complete. 2026-02-23T06:36:11.672 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:36:11.672 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-23T06:36:11.672 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2026-02-23T06:36:11.672 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-23T06:36:11.672 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-23T06:36:11.673 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-23T06:36:11.673 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:36:11.681 INFO:tasks.ceph.mon.c:Stopped 2026-02-23T06:36:11.682 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.b 2026-02-23T06:36:11.682 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-23T06:36:11.682 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-23T06:36:11.682 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-23T06:36:13.632 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:36:13.637 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:36:20.170 INFO:tasks.workunit.client.0.trial058.stdout:Syncing()...757 sec 2026-02-23T06:36:20.171 INFO:tasks.workunit.client.0.trial058.stdout:Starting Actual Benchmark At: Mon Feb 23 06:36:20 2026 2026-02-23T06:36:20.171 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-23T06:36:26.683 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.b 2026-02-23T06:36:26.683 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-23T06:36:26.683 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-23T06:36:26.683 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:36:26.684 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:36:32.843 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.847+0000 7f49749c9640 1 -- 10.20.193.58:0/3534274091 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f494c0263d0 msgr2=0x7f494c026830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:32.843 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.847+0000 7f49749c9640 1 --2- 10.20.193.58:0/3534274091 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f494c0263d0 0x7f494c026830 secure :-1 s=READY pgs=63 gs=25 cs=0 l=1 c_cookie=1032918164055040405 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f497005c5d0 tx=0x7f496002ecd0 comp rx=0 tx=0).stop 2026-02-23T06:36:32.843 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.848+0000 7f49749c9640 1 -- 10.20.193.58:0/3534274091 shutdown_connections 2026-02-23T06:36:32.843 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.848+0000 7f49749c9640 1 --2- 10.20.193.58:0/3534274091 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f494c0263d0 0x7f494c026830 unknown :-1 s=CLOSED pgs=63 gs=25 cs=0 l=1 c_cookie=1032918164055040405 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:32.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.848+0000 7f49749c9640 1 --2- 10.20.193.58:0/3534274091 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f494c023be0 0x7f494c025e60 unknown :-1 s=CLOSED pgs=0 gs=24 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:32.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.848+0000 7f49749c9640 1 -- 10.20.193.58:0/3534274091 >> 10.20.193.58:0/3534274091 conn(0x7f49700b3c20 msgr2=0x7f49700b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:36:32.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.849+0000 7f49749c9640 1 -- 10.20.193.58:0/3534274091 shutdown_connections 2026-02-23T06:36:32.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.849+0000 7f49749c9640 1 -- 10.20.193.58:0/3534274091 wait complete. 2026-02-23T06:36:32.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.850+0000 7f49749c9640 1 Processor -- start 2026-02-23T06:36:32.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.850+0000 7f49749c9640 1 -- start start 2026-02-23T06:36:32.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.851+0000 7f49749c9640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f494c0037d0 0x7f49701223c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:32.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.851+0000 7f49749c9640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f494c023be0 0x7f49701173b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:32.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.851+0000 7f49749c9640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f494c0263d0 0x7f4970139880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:32.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.852+0000 7f49749c9640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f4970160670 con 0x7f494c023be0 2026-02-23T06:36:32.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.852+0000 7f49749c9640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f4970160090 con 0x7f494c0037d0 2026-02-23T06:36:32.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.852+0000 7f49749c9640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f497015e660 con 0x7f494c0263d0 2026-02-23T06:36:32.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.852+0000 7f496ffff640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f494c0263d0 msgr2=0x7f4970139880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:36:32.848 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.852+0000 7f496ffff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f494c0263d0 0x7f4970139880 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:36:32.848 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.852+0000 7f496effd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f494c023be0 0x7f49701173b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:32.848 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.852+0000 7f496effd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f494c023be0 0x7f49701173b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:35138/0 (socket says 10.20.193.58:35138) 2026-02-23T06:36:32.848 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.852+0000 7f496effd640 1 -- 10.20.193.58:0/2123425856 learned_addr learned my addr 10.20.193.58:0/2123425856 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:36:32.848 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.852+0000 7f496f7fe640 1 --2- 10.20.193.58:0/2123425856 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f494c0037d0 0x7f49701223c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:32.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.852+0000 7f496f7fe640 1 -- 10.20.193.58:0/2123425856 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f494c0263d0 msgr2=0x7f4970139880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:36:32.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.852+0000 7f496f7fe640 1 --2- 10.20.193.58:0/2123425856 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f494c0263d0 0x7f4970139880 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:32.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.852+0000 7f496f7fe640 1 -- 10.20.193.58:0/2123425856 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f494c023be0 msgr2=0x7f49701173b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:32.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.852+0000 7f496f7fe640 1 --2- 10.20.193.58:0/2123425856 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f494c023be0 0x7f49701173b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:32.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.852+0000 7f496f7fe640 1 -- 10.20.193.58:0/2123425856 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4960009ad0 con 0x7f494c0037d0 2026-02-23T06:36:32.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.853+0000 7f496f7fe640 1 --2- 10.20.193.58:0/2123425856 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f494c0037d0 0x7f49701223c0 secure :-1 s=READY pgs=64 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49500028f0 tx=0x7f4950012960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:32.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.853+0000 7f4967fff640 1 -- 10.20.193.58:0/2123425856 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4950002c70 con 0x7f494c0037d0 2026-02-23T06:36:32.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.854+0000 7f49749c9640 1 -- 10.20.193.58:0/2123425856 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f497015e940 con 0x7f494c0037d0 2026-02-23T06:36:32.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.854+0000 7f49749c9640 1 -- 10.20.193.58:0/2123425856 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f497015ec20 con 0x7f494c0037d0 2026-02-23T06:36:32.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.854+0000 7f4967fff640 1 -- 10.20.193.58:0/2123425856 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49500040d0 con 0x7f494c0037d0 2026-02-23T06:36:32.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.854+0000 7f4967fff640 1 -- 10.20.193.58:0/2123425856 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4950004500 con 0x7f494c0037d0 2026-02-23T06:36:32.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.854+0000 7f49749c9640 1 -- 10.20.193.58:0/2123425856 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49701604a0 con 0x7f494c0037d0 2026-02-23T06:36:32.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.856+0000 7f4967fff640 1 -- 10.20.193.58:0/2123425856 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f4950004660 con 0x7f494c0037d0 2026-02-23T06:36:32.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.857+0000 7f4967fff640 1 --2- 10.20.193.58:0/2123425856 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f495407a5a0 0x7f495409aa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:32.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.857+0000 7f4967fff640 1 -- 10.20.193.58:0/2123425856 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f495009e3e0 con 0x7f494c0037d0 2026-02-23T06:36:32.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.857+0000 7f496effd640 1 --2- 10.20.193.58:0/2123425856 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f495407a5a0 0x7f495409aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:32.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.857+0000 7f496effd640 1 --2- 10.20.193.58:0/2123425856 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f495407a5a0 0x7f495409aa50 secure :-1 s=READY pgs=363 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f497015e450 tx=0x7f4958003ef0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:32.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:32.858+0000 7f4967fff640 1 -- 10.20.193.58:0/2123425856 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f4950061580 con 0x7f494c0037d0 2026-02-23T06:36:33.067 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.072+0000 7f49749c9640 1 -- 10.20.193.58:0/2123425856 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f49700b52a0 con 0x7f494c0037d0 2026-02-23T06:36:33.067 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.072+0000 7f4967fff640 1 -- 10.20.193.58:0/2123425856 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1749 (secure 0 0 0) 0x7f49500646a0 con 0x7f494c0037d0 2026-02-23T06:36:33.069 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":128,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:36:33.072 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.077+0000 7f49749c9640 1 -- 10.20.193.58:0/2123425856 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f495407a5a0 msgr2=0x7f495409aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:33.072 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.077+0000 7f49749c9640 1 --2- 10.20.193.58:0/2123425856 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f495407a5a0 0x7f495409aa50 secure :-1 s=READY pgs=363 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f497015e450 tx=0x7f4958003ef0 comp rx=0 tx=0).stop 2026-02-23T06:36:33.072 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.077+0000 7f49749c9640 1 -- 10.20.193.58:0/2123425856 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f494c0037d0 msgr2=0x7f49701223c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:33.072 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.077+0000 7f49749c9640 1 --2- 10.20.193.58:0/2123425856 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f494c0037d0 0x7f49701223c0 secure :-1 s=READY pgs=64 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49500028f0 tx=0x7f4950012960 comp rx=0 tx=0).stop 2026-02-23T06:36:33.072 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.077+0000 7f49749c9640 1 -- 10.20.193.58:0/2123425856 shutdown_connections 2026-02-23T06:36:33.072 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.077+0000 7f49749c9640 1 --2- 10.20.193.58:0/2123425856 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f495407a5a0 0x7f495409aa50 unknown :-1 s=CLOSED pgs=363 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:33.072 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.077+0000 7f49749c9640 1 --2- 10.20.193.58:0/2123425856 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f494c0263d0 0x7f4970139880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:33.073 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.077+0000 7f49749c9640 1 --2- 10.20.193.58:0/2123425856 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f494c023be0 0x7f49701173b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:33.073 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.077+0000 7f49749c9640 1 --2- 10.20.193.58:0/2123425856 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f494c0037d0 0x7f49701223c0 unknown :-1 s=CLOSED pgs=64 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:33.073 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.077+0000 7f49749c9640 1 -- 10.20.193.58:0/2123425856 >> 10.20.193.58:0/2123425856 conn(0x7f49700b3c20 msgr2=0x7f4970163b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:36:33.073 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.077+0000 7f49749c9640 1 -- 10.20.193.58:0/2123425856 shutdown_connections 2026-02-23T06:36:33.073 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.077+0000 7f49749c9640 1 -- 10.20.193.58:0/2123425856 wait complete. 2026-02-23T06:36:33.086 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:36:33.086 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-23T06:36:33.087 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:36:33.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.236+0000 7fe6e3fff640 1 -- 10.20.193.58:0/3922141317 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe6e415f5c0 msgr2=0x7fe6e4058970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:33.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.236+0000 7fe6e3fff640 1 --2- 10.20.193.58:0/3922141317 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe6e415f5c0 0x7fe6e4058970 secure :-1 s=READY pgs=66 gs=2 cs=0 l=1 c_cookie=16757711885986993932 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6e415ffc0 tx=0x7fe6c402f320 comp rx=0 tx=0).stop 2026-02-23T06:36:33.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.237+0000 7fe6e3fff640 1 -- 10.20.193.58:0/3922141317 shutdown_connections 2026-02-23T06:36:33.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.237+0000 7fe6e3fff640 1 --2- 10.20.193.58:0/3922141317 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe6e415f990 0x7fe6e4058eb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:33.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.237+0000 7fe6e3fff640 1 --2- 10.20.193.58:0/3922141317 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe6e415f5c0 0x7fe6e4058970 unknown :-1 s=CLOSED pgs=66 gs=2 cs=0 l=1 c_cookie=16757711885986993932 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:33.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.237+0000 7fe6e3fff640 1 -- 10.20.193.58:0/3922141317 >> 10.20.193.58:0/3922141317 conn(0x7fe6e40b3c20 msgr2=0x7fe6e40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:36:33.233 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.237+0000 7fe6e3fff640 1 -- 10.20.193.58:0/3922141317 shutdown_connections 2026-02-23T06:36:33.233 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.237+0000 7fe6e3fff640 1 -- 10.20.193.58:0/3922141317 wait complete. 2026-02-23T06:36:33.233 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.238+0000 7fe6e3fff640 1 Processor -- start 2026-02-23T06:36:33.233 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.238+0000 7fe6e3fff640 1 -- start start 2026-02-23T06:36:33.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.239+0000 7fe6e3fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe6e405d8b0 0x7fe6e4057d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:33.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.239+0000 7fe6e3fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe6e415f5c0 0x7fe6e4124e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:33.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.239+0000 7fe6e3fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe6e415f990 0x7fe6e4146a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:33.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.239+0000 7fe6e27fc640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe6e415f5c0 msgr2=0x7fe6e4124e40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:36:33.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.239+0000 7fe6e27fc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe6e415f5c0 0x7fe6e4124e40 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:36:33.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.239+0000 7fe6e3fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e414ac10 con 0x7fe6e415f990 2026-02-23T06:36:33.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.239+0000 7fe6e3fff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e4149d20 con 0x7fe6e405d8b0 2026-02-23T06:36:33.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.239+0000 7fe6e3fff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe6e414a000 con 0x7fe6e415f5c0 2026-02-23T06:36:33.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.239+0000 7fe6e2ffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe6e405d8b0 0x7fe6e4057d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:33.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.239+0000 7fe6e2ffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe6e405d8b0 0x7fe6e4057d20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:49420/0 (socket says 10.20.193.58:49420) 2026-02-23T06:36:33.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.239+0000 7fe6e2ffd640 1 -- 10.20.193.58:0/2656436628 learned_addr learned my addr 10.20.193.58:0/2656436628 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:36:33.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.239+0000 7fe6e37fe640 1 --2- 10.20.193.58:0/2656436628 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe6e415f990 0x7fe6e4146a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:33.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.239+0000 7fe6e2ffd640 1 -- 10.20.193.58:0/2656436628 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe6e415f5c0 msgr2=0x7fe6e4124e40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:36:33.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.239+0000 7fe6e2ffd640 1 --2- 10.20.193.58:0/2656436628 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe6e415f5c0 0x7fe6e4124e40 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:33.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.239+0000 7fe6e2ffd640 1 -- 10.20.193.58:0/2656436628 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe6e415f990 msgr2=0x7fe6e4146a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:33.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.239+0000 7fe6e2ffd640 1 --2- 10.20.193.58:0/2656436628 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe6e415f990 0x7fe6e4146a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:33.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.240+0000 7fe6e2ffd640 1 -- 10.20.193.58:0/2656436628 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c4009570 con 0x7fe6e405d8b0 2026-02-23T06:36:33.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.240+0000 7fe6e2ffd640 1 --2- 10.20.193.58:0/2656436628 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe6e405d8b0 0x7fe6e4057d20 secure :-1 s=READY pgs=67 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6c4004740 tx=0x7fe6c4004690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:33.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.240+0000 7fe6db7fe640 1 -- 10.20.193.58:0/2656436628 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6c40029d0 con 0x7fe6e405d8b0 2026-02-23T06:36:33.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.240+0000 7fe6e3fff640 1 -- 10.20.193.58:0/2656436628 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6e414a2e0 con 0x7fe6e405d8b0 2026-02-23T06:36:33.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.240+0000 7fe6e3fff640 1 -- 10.20.193.58:0/2656436628 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6e414a8a0 con 0x7fe6e405d8b0 2026-02-23T06:36:33.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.241+0000 7fe6db7fe640 1 -- 10.20.193.58:0/2656436628 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6c4002b30 con 0x7fe6e405d8b0 2026-02-23T06:36:33.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.241+0000 7fe6db7fe640 1 -- 10.20.193.58:0/2656436628 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6c4004850 con 0x7fe6e405d8b0 2026-02-23T06:36:33.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.241+0000 7fe6e3fff640 1 --2- 10.20.193.58:0/2656436628 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe69c0041f0 0x7fe69c0246a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:33.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.241+0000 7fe6e3fff640 1 -- 10.20.193.58:0/2656436628 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe69c025f20 con 0x7fe69c0041f0 2026-02-23T06:36:33.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.241+0000 7fe6e27fc640 1 --2- 10.20.193.58:0/2656436628 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe69c0041f0 0x7fe69c0246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:33.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.243+0000 7fe6db7fe640 1 -- 10.20.193.58:0/2656436628 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fe6c4038470 con 0x7fe6e405d8b0 2026-02-23T06:36:33.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.244+0000 7fe6db7fe640 1 --2- 10.20.193.58:0/2656436628 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe6c007a710 0x7fe6c009abc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:33.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.244+0000 7fe6db7fe640 1 -- 10.20.193.58:0/2656436628 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fe6c40cb480 con 0x7fe6e405d8b0 2026-02-23T06:36:33.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.244+0000 7fe6e37fe640 1 --2- 10.20.193.58:0/2656436628 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe6c007a710 0x7fe6c009abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:33.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.245+0000 7fe6e27fc640 1 -- 10.20.193.58:0/2656436628 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe69c0260e0 con 0x7fe69c0041f0 2026-02-23T06:36:33.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.245+0000 7fe6e27fc640 1 --2- 10.20.193.58:0/2656436628 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe69c0041f0 0x7fe69c0246a0 secure :-1 s=READY pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6e4127a40 tx=0x7fe6d400bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:33.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.245+0000 7fe6e37fe640 1 --2- 10.20.193.58:0/2656436628 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe6c007a710 0x7fe6c009abc0 secure :-1 s=READY pgs=364 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6cc007fd0 tx=0x7fe6cc00a190 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:33.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.247+0000 7fe6db7fe640 1 -- 10.20.193.58:0/2656436628 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6d4005c80 con 0x7fe69c0041f0 2026-02-23T06:36:33.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.247+0000 7fe6db7fe640 1 -- 10.20.193.58:0/2656436628 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fe6d4005de0 con 0x7fe69c0041f0 2026-02-23T06:36:33.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.247+0000 7fe6db7fe640 1 -- 10.20.193.58:0/2656436628 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe69c0041f0 msgr2=0x7fe69c0246a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:33.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.247+0000 7fe6db7fe640 1 --2- 10.20.193.58:0/2656436628 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe69c0041f0 0x7fe69c0246a0 secure :-1 s=READY pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6e4127a40 tx=0x7fe6d400bb20 comp rx=0 tx=0).stop 2026-02-23T06:36:33.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.247+0000 7fe6db7fe640 1 -- 10.20.193.58:0/2656436628 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe69c0041f0 msgr2=0x7fe69c0246a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:36:33.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.247+0000 7fe6db7fe640 1 --2- 10.20.193.58:0/2656436628 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe69c0041f0 0x7fe69c0246a0 secure :-1 s=CLOSED pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6e4127a40 tx=0x7fe6d400bb20 comp rx=0 tx=0).stop 2026-02-23T06:36:33.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.250+0000 7fe6e3fff640 1 --2- 10.20.193.58:0/2656436628 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe69c025050 0x7fe69c0254d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:33.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.250+0000 7fe6e3fff640 1 -- 10.20.193.58:0/2656436628 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe69c025b30 con 0x7fe69c025050 2026-02-23T06:36:33.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.251+0000 7fe6e27fc640 1 --2- 10.20.193.58:0/2656436628 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe69c025050 0x7fe69c0254d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:33.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.251+0000 7fe6e27fc640 1 -- 10.20.193.58:0/2656436628 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe69c025cf0 con 0x7fe69c025050 2026-02-23T06:36:33.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.251+0000 7fe6e27fc640 1 --2- 10.20.193.58:0/2656436628 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe69c025050 0x7fe69c0254d0 secure :-1 s=READY pgs=174 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6d4009fd0 tx=0x7fe6d4005980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:33.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.253+0000 7fe6db7fe640 1 -- 10.20.193.58:0/2656436628 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6d401f070 con 0x7fe69c025050 2026-02-23T06:36:33.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.253+0000 7fe6db7fe640 1 -- 10.20.193.58:0/2656436628 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5547 (secure 0 0 0) 0x7fe6d40195e0 con 0x7fe69c025050 2026-02-23T06:36:33.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.253+0000 7fe6db7fe640 1 -- 10.20.193.58:0/2656436628 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe69c025050 msgr2=0x7fe69c0254d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:33.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.253+0000 7fe6db7fe640 1 --2- 10.20.193.58:0/2656436628 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe69c025050 0x7fe69c0254d0 secure :-1 s=READY pgs=174 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6d4009fd0 tx=0x7fe6d4005980 comp rx=0 tx=0).stop 2026-02-23T06:36:33.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.253+0000 7fe6db7fe640 1 -- 10.20.193.58:0/2656436628 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe69c025050 msgr2=0x7fe69c0254d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:36:33.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.253+0000 7fe6db7fe640 1 --2- 10.20.193.58:0/2656436628 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe69c025050 0x7fe69c0254d0 secure :-1 s=CLOSED pgs=174 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6d4009fd0 tx=0x7fe6d4005980 comp rx=0 tx=0).stop 2026-02-23T06:36:33.249 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:36:33.249 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:36:33.249 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:36:33.249 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:36:33.249 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 128, 2026-02-23T06:36:33.249 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 200763, 2026-02-23T06:36:33.249 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:36:33.249 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:36:33.249 INFO:teuthology.orchestra.run.trial058.stdout: 1 2026-02-23T06:36:33.250 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:33.250 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 1, 2026-02-23T06:36:33.250 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:36:33.250 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:36:33.250 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:36:33.250 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:36:33.250 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:36:33.250 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:36:33.250 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:36:33.250 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:36:33.250 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:36:33.250 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:36:33.250 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:36:33.250 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:36:33.251 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:36:33.251 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:36:33.251 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:36:33.251 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:36:33.251 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:33.251 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:36:33.251 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:36:33.251 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:36:33.251 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:36:33.251 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:36:33.251 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:36:33.251 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:36:33.251 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:36:33.251 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:36:33.251 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:36:33.251 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:36:33.251 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:36:33.251 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:36:33.251 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:36:33.251 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:36:33.252 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:33.252 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:33.252 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:36:33.252 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:36:33.252 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:36:33.252 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:36:33.252 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:36:33.252 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:36:33.252 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:36:33.252 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:36:33.252 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:36:33.252 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:36:33.252 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:36:33.252 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:36:33.252 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:36:33.252 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:36:33.252 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:36:33.252 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:36:33.252 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:36:33.253 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:36:33.253 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:36:33.253 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:36:33.253 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:36:33.253 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:36:33.253 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:36:33.253 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:36:33.253 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:36:33.253 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:36:33.253 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:36:33.253 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:36:33.253 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:36:33.253 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:36:33.253 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:33.253 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:36:33.253 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:33.253 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:36:33.253 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.253 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:36:33.253 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:36:33.254 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:36:33.254 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:36:33.254 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.254 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:36:33.254 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:36:33.254 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:33.254 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:33.254 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.254 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:36:33.254 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:36:33.254 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:33.254 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:33.254 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:33.254 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:33.254 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:36:33.254 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:36:33.254 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:36:33.254 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:36:33.254 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:36:33.254 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:36:33.255 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:33.255 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.255 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:36:33.255 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:36:33.255 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:36:33.255 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:36:33.255 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.255 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:36:33.255 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:36:33.255 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:33.255 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:33.255 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.255 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:36:33.255 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:36:33.255 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:33.255 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:33.255 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:33.255 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:33.255 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:36:33.255 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:36:33.256 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:36:33.256 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:36:33.256 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:36:33.256 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:36:33.256 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:33.256 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.256 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:36:33.256 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:36:33.256 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:36:33.256 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:36:33.256 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.256 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:36:33.256 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:36:33.256 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:33.256 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:33.256 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.256 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:36:33.256 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:36:33.256 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:33.256 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:33.257 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:33.257 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:33.257 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:36:33.257 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:36:33.257 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:36:33.257 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:36:33.257 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:36:33.257 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:36:33.257 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:33.257 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:33.257 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:33.257 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:36:33.257 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:36:33.257 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.257 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:33.257 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:33.257 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:36:33.257 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:33.257 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:33.257 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:36:33.258 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.258 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:33.258 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:33.258 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:36:33.258 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:33.258 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:33.258 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:36:33.258 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.258 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:33.258 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:33.258 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:36:33.258 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:33.258 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:33.258 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:36:33.258 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.258 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:36:33.258 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:36:33.258 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:36:33.258 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:33.258 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.258 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:33.259 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:33.259 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:36:33.259 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:33.259 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:33.259 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:36:33.259 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.259 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:33.259 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:33.259 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:36:33.259 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:33.259 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:33.259 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:33.259 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:36:33.259 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:36:33.261 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.254+0000 7fe6e3fff640 1 -- 10.20.193.58:0/2656436628 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe6c007a710 msgr2=0x7fe6c009abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:33.261 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.254+0000 7fe6e3fff640 1 --2- 10.20.193.58:0/2656436628 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe6c007a710 0x7fe6c009abc0 secure :-1 s=READY pgs=364 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6cc007fd0 tx=0x7fe6cc00a190 comp rx=0 tx=0).stop 2026-02-23T06:36:33.261 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.254+0000 7fe6e3fff640 1 -- 10.20.193.58:0/2656436628 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe6e405d8b0 msgr2=0x7fe6e4057d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:33.261 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.254+0000 7fe6e3fff640 1 --2- 10.20.193.58:0/2656436628 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe6e405d8b0 0x7fe6e4057d20 secure :-1 s=READY pgs=67 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6c4004740 tx=0x7fe6c4004690 comp rx=0 tx=0).stop 2026-02-23T06:36:33.261 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.254+0000 7fe6e37fe640 1 -- 10.20.193.58:0/2656436628 reap_dead start 2026-02-23T06:36:33.261 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.254+0000 7fe6e37fe640 1 -- 10.20.193.58:0/2656436628 reap_dead start 2026-02-23T06:36:33.261 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.254+0000 7fe6e3fff640 1 -- 10.20.193.58:0/2656436628 shutdown_connections 2026-02-23T06:36:33.261 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.254+0000 7fe6e3fff640 1 -- 10.20.193.58:0/2656436628 >> 10.20.193.58:0/2656436628 conn(0x7fe6e40b3c20 msgr2=0x7fe6e415bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:36:33.261 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.254+0000 7fe6e3fff640 1 -- 10.20.193.58:0/2656436628 shutdown_connections 2026-02-23T06:36:33.261 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.254+0000 7fe6e3fff640 1 -- 10.20.193.58:0/2656436628 wait complete. 2026-02-23T06:36:33.262 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:36:33.262 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-23T06:36:33.262 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:36:33.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.418+0000 7f01765d2640 1 -- 10.20.193.58:0/3027094750 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0158003a30 msgr2=0x7f0158003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:33.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.419+0000 7f01765d2640 1 --2- 10.20.193.58:0/3027094750 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0158003a30 0x7f0158003e00 secure :-1 s=READY pgs=176 gs=4 cs=0 l=1 c_cookie=292072822073590117 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f015c00ad30 tx=0x7f015c030740 comp rx=0 tx=0).stop 2026-02-23T06:36:33.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.419+0000 7f0175dd1640 1 -- 10.20.193.58:0/3027094750 reap_dead start 2026-02-23T06:36:33.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.419+0000 7f01765d2640 1 -- 10.20.193.58:0/3027094750 shutdown_connections 2026-02-23T06:36:33.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.419+0000 7f01765d2640 1 -- 10.20.193.58:0/3027094750 >> 10.20.193.58:0/3027094750 conn(0x7f01700b3c20 msgr2=0x7f01700b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:36:33.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.419+0000 7f01765d2640 1 -- 10.20.193.58:0/3027094750 shutdown_connections 2026-02-23T06:36:33.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.419+0000 7f01765d2640 1 -- 10.20.193.58:0/3027094750 wait complete. 2026-02-23T06:36:33.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.421+0000 7f01765d2640 1 Processor -- start 2026-02-23T06:36:33.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.421+0000 7f01765d2640 1 -- start start 2026-02-23T06:36:33.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.422+0000 7f01765d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f01701593a0 0x7f0170159770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:33.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.422+0000 7f01765d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f017015a610 0x7f0170156810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:33.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.422+0000 7f01765d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0170156d50 0x7f0170154bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:33.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.422+0000 7f01765d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f0170139260 con 0x7f017015a610 2026-02-23T06:36:33.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.422+0000 7f01765d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f01701563f0 con 0x7f01701593a0 2026-02-23T06:36:33.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.422+0000 7f01765d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f017015c000 con 0x7f0170156d50 2026-02-23T06:36:33.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.422+0000 7f0175dd1640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0170156d50 msgr2=0x7f0170154bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:36:33.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.422+0000 7f0175dd1640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0170156d50 0x7f0170154bd0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:36:33.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.422+0000 7f0174dcf640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f017015a610 0x7f0170156810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:33.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.422+0000 7f01755d0640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f01701593a0 0x7f0170159770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:33.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.422+0000 7f01755d0640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f01701593a0 0x7f0170159770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:49442/0 (socket says 10.20.193.58:49442) 2026-02-23T06:36:33.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.422+0000 7f01755d0640 1 -- 10.20.193.58:0/2861715966 learned_addr learned my addr 10.20.193.58:0/2861715966 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:36:33.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.423+0000 7f01755d0640 1 -- 10.20.193.58:0/2861715966 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0170156d50 msgr2=0x7f0170154bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:36:33.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.423+0000 7f01755d0640 1 --2- 10.20.193.58:0/2861715966 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0170156d50 0x7f0170154bd0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:33.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.423+0000 7f01755d0640 1 -- 10.20.193.58:0/2861715966 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f017015a610 msgr2=0x7f0170156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:33.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.423+0000 7f01755d0640 1 --2- 10.20.193.58:0/2861715966 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f017015a610 0x7f0170156810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:33.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.423+0000 7f01755d0640 1 -- 10.20.193.58:0/2861715966 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0170158e40 con 0x7f01701593a0 2026-02-23T06:36:33.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.423+0000 7f0174dcf640 1 --2- 10.20.193.58:0/2861715966 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f017015a610 0x7f0170156810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:36:33.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.423+0000 7f01755d0640 1 --2- 10.20.193.58:0/2861715966 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f01701593a0 0x7f0170159770 secure :-1 s=READY pgs=69 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f015c00ae30 tx=0x7f015c0029e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:33.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.423+0000 7f0161ffb640 1 -- 10.20.193.58:0/2861715966 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f015c002c00 con 0x7f01701593a0 2026-02-23T06:36:33.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.424+0000 7f01765d2640 1 -- 10.20.193.58:0/2861715966 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f017015c300 con 0x7f01701593a0 2026-02-23T06:36:33.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.424+0000 7f01765d2640 1 -- 10.20.193.58:0/2861715966 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0170138f80 con 0x7f01701593a0 2026-02-23T06:36:33.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.424+0000 7f0161ffb640 1 -- 10.20.193.58:0/2861715966 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f015c002d60 con 0x7f01701593a0 2026-02-23T06:36:33.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.424+0000 7f0161ffb640 1 -- 10.20.193.58:0/2861715966 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f015c002c00 con 0x7f01701593a0 2026-02-23T06:36:33.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.425+0000 7f01765d2640 1 --2- 10.20.193.58:0/2861715966 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f01300041f0 0x7f01300246a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:33.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.425+0000 7f01765d2640 1 -- 10.20.193.58:0/2861715966 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f0130025f20 con 0x7f01300041f0 2026-02-23T06:36:33.421 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.425+0000 7f0174dcf640 1 --2- 10.20.193.58:0/2861715966 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f01300041f0 0x7f01300246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:33.421 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.426+0000 7f0174dcf640 1 -- 10.20.193.58:0/2861715966 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f01300260e0 con 0x7f01300041f0 2026-02-23T06:36:33.421 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.426+0000 7f0174dcf640 1 --2- 10.20.193.58:0/2861715966 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f01300041f0 0x7f01300246a0 secure :-1 s=READY pgs=70 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0170139620 tx=0x7f016800c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:33.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.427+0000 7f0161ffb640 1 -- 10.20.193.58:0/2861715966 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f016800ee70 con 0x7f01300041f0 2026-02-23T06:36:33.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.427+0000 7f0161ffb640 1 -- 10.20.193.58:0/2861715966 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f015c004030 con 0x7f01701593a0 2026-02-23T06:36:33.423 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.428+0000 7f0161ffb640 1 --2- 10.20.193.58:0/2861715966 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f014407a6c0 0x7f014409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:33.423 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.428+0000 7f0161ffb640 1 -- 10.20.193.58:0/2861715966 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f0168003e90 con 0x7f01300041f0 2026-02-23T06:36:33.424 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.428+0000 7f0161ffb640 1 -- 10.20.193.58:0/2861715966 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f01300041f0 msgr2=0x7f01300246a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:33.424 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.428+0000 7f0161ffb640 1 --2- 10.20.193.58:0/2861715966 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f01300041f0 0x7f01300246a0 secure :-1 s=READY pgs=70 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0170139620 tx=0x7f016800c4b0 comp rx=0 tx=0).stop 2026-02-23T06:36:33.424 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.428+0000 7f0161ffb640 1 -- 10.20.193.58:0/2861715966 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f01300041f0 msgr2=0x7f01300246a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:36:33.424 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.428+0000 7f0161ffb640 1 --2- 10.20.193.58:0/2861715966 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f01300041f0 0x7f01300246a0 unknown :-1 s=CLOSED pgs=70 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:33.424 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.428+0000 7f0161ffb640 1 -- 10.20.193.58:0/2861715966 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f015c0c1d30 con 0x7f01701593a0 2026-02-23T06:36:33.424 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.428+0000 7f0175dd1640 1 --2- 10.20.193.58:0/2861715966 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f014407a6c0 0x7f014409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:33.424 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.429+0000 7f0175dd1640 1 --2- 10.20.193.58:0/2861715966 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f014407a6c0 0x7f014409ab70 secure :-1 s=READY pgs=365 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f016c0034b0 tx=0x7f016c003fb0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:33.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.434+0000 7f01765d2640 1 --2- 10.20.193.58:0/2861715966 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0130025080 0x7f0130025500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:36:33.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.434+0000 7f01765d2640 1 -- 10.20.193.58:0/2861715966 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f0130025a90 con 0x7f0130025080 2026-02-23T06:36:33.429 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.434+0000 7f0174dcf640 1 --2- 10.20.193.58:0/2861715966 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0130025080 0x7f0130025500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:36:33.429 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.434+0000 7f0174dcf640 1 -- 10.20.193.58:0/2861715966 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0130025c50 con 0x7f0130025080 2026-02-23T06:36:33.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.435+0000 7f0174dcf640 1 --2- 10.20.193.58:0/2861715966 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0130025080 0x7f0130025500 secure :-1 s=READY pgs=71 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0168007fd0 tx=0x7f0168002710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:36:33.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.435+0000 7f0161ffb640 1 -- 10.20.193.58:0/2861715966 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f016800ee70 con 0x7f0130025080 2026-02-23T06:36:33.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.435+0000 7f0161ffb640 1 -- 10.20.193.58:0/2861715966 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5402 (secure 0 0 0) 0x7f016801c820 con 0x7f0130025080 2026-02-23T06:36:33.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.435+0000 7f0161ffb640 1 -- 10.20.193.58:0/2861715966 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0130025080 msgr2=0x7f0130025500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:33.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.435+0000 7f0161ffb640 1 --2- 10.20.193.58:0/2861715966 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0130025080 0x7f0130025500 secure :-1 s=READY pgs=71 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0168007fd0 tx=0x7f0168002710 comp rx=0 tx=0).stop 2026-02-23T06:36:33.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.435+0000 7f0161ffb640 1 -- 10.20.193.58:0/2861715966 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0130025080 msgr2=0x7f0130025500 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:36:33.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.435+0000 7f0161ffb640 1 --2- 10.20.193.58:0/2861715966 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0130025080 0x7f0130025500 unknown :-1 s=CLOSED pgs=71 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:33.431 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:36:33.431 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:36:33.431 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:36:33.431 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:36:33.431 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 128, 2026-02-23T06:36:33.431 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 106019, 2026-02-23T06:36:33.431 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:36:33.431 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:36:33.431 INFO:teuthology.orchestra.run.trial058.stdout: 1 2026-02-23T06:36:33.431 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:33.431 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 1, 2026-02-23T06:36:33.431 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:36:33.431 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:36:33.431 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:36:33.431 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:36:33.431 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:36:33.432 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:36:33.432 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:36:33.432 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:36:33.432 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:36:33.432 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:36:33.432 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:36:33.432 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:36:33.432 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:36:33.432 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:36:33.432 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:36:33.432 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:36:33.432 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:33.432 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:36:33.432 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:36:33.432 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:36:33.432 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:36:33.432 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:36:33.432 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:36:33.432 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:36:33.432 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:36:33.432 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:36:33.432 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:36:33.433 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:36:33.433 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:36:33.433 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:36:33.433 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:36:33.433 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:36:33.433 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:33.433 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:33.433 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:36:33.433 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:36:33.433 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:36:33.433 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:36:33.433 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:36:33.433 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:36:33.433 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:36:33.433 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:36:33.433 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:36:33.433 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:36:33.433 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:36:33.433 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:36:33.433 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:36:33.434 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:36:33.434 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:36:33.434 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:36:33.434 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:36:33.434 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:36:33.434 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:36:33.434 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:36:33.434 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:36:33.434 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:36:33.434 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:36:33.434 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:36:33.434 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:36:33.435 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:36:33.435 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:36:33.435 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:36:33.435 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:36:33.435 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:36:33.435 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:33.435 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:36:33.435 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:33.435 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:36:33.435 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.435 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:36:33.435 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:36:33.436 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:36:33.436 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:36:33.436 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.436 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:36:33.436 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:36:33.436 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:33.436 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:33.436 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.436 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:36:33.436 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:36:33.436 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:33.436 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:33.436 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:33.437 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:33.437 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:36:33.437 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:36:33.437 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:36:33.437 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:36:33.437 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:36:33.437 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:36:33.437 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:33.437 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.437 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:36:33.437 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:36:33.437 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:36:33.437 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:36:33.438 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.438 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:36:33.438 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:36:33.438 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:33.438 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:33.438 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.438 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:36:33.438 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:36:33.438 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:33.438 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:33.438 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:33.438 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:33.438 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:36:33.439 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:36:33.439 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:36:33.439 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:36:33.439 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:36:33.439 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:36:33.439 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:33.439 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.439 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:36:33.439 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:36:33.439 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:36:33.439 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:36:33.439 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.439 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:36:33.440 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:36:33.440 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:33.440 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:33.440 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.440 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:36:33.440 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:36:33.440 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:36:33.440 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:33.440 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:33.440 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:33.440 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:36:33.440 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:36:33.440 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:36:33.440 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:36:33.440 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:36:33.440 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:36:33.440 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:33.441 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:33.441 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:33.441 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:36:33.441 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:36:33.441 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.441 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:33.441 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:33.441 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:36:33.441 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:33.441 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:33.441 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:36:33.441 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.441 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:33.441 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:33.441 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:36:33.441 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:33.441 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:33.442 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:36:33.442 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.442 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:33.442 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:33.442 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:36:33.442 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:33.442 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:33.442 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:36:33.442 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.442 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:33.442 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:33.442 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:36:33.442 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:33.443 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:36:33.443 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:36:33.443 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:36:33.443 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:36:33.443 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:36:33.443 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:36:33.443 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:36:33.443 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:36:33.443 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:36:33.443 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:36:33.443 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:36:33.445 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.438+0000 7f01765d2640 1 -- 10.20.193.58:0/2861715966 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f014407a6c0 msgr2=0x7f014409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:33.445 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.438+0000 7f01765d2640 1 --2- 10.20.193.58:0/2861715966 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f014407a6c0 0x7f014409ab70 secure :-1 s=READY pgs=365 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f016c0034b0 tx=0x7f016c003fb0 comp rx=0 tx=0).stop 2026-02-23T06:36:33.445 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.438+0000 7f01765d2640 1 -- 10.20.193.58:0/2861715966 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f01701593a0 msgr2=0x7f0170159770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:36:33.445 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.438+0000 7f01765d2640 1 --2- 10.20.193.58:0/2861715966 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f01701593a0 0x7f0170159770 secure :-1 s=READY pgs=69 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f015c00ae30 tx=0x7f015c0029e0 comp rx=0 tx=0).stop 2026-02-23T06:36:33.445 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.438+0000 7f0175dd1640 1 -- 10.20.193.58:0/2861715966 reap_dead start 2026-02-23T06:36:33.445 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.438+0000 7f01765d2640 1 -- 10.20.193.58:0/2861715966 shutdown_connections 2026-02-23T06:36:33.445 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.438+0000 7f01765d2640 1 --2- 10.20.193.58:0/2861715966 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f01701593a0 0x7f0170159770 unknown :-1 s=CLOSED pgs=69 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:36:33.445 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.438+0000 7f01765d2640 1 -- 10.20.193.58:0/2861715966 >> 10.20.193.58:0/2861715966 conn(0x7f01700b3c20 msgr2=0x7f017015f350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:36:33.445 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.438+0000 7f01765d2640 1 -- 10.20.193.58:0/2861715966 shutdown_connections 2026-02-23T06:36:33.446 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:36:33.438+0000 7f01765d2640 1 -- 10.20.193.58:0/2861715966 wait complete. 2026-02-23T06:36:33.453 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:36:33.453 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:36:43.696 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:36:43.703 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:36:53.454 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-23T06:36:53.455 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-23T06:36:53.455 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-23T06:36:53.455 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-23T06:36:53.457 INFO:tasks.ceph.mon.c:Started 2026-02-23T06:36:53.458 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.b 2026-02-23T06:36:53.458 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-23T06:36:53.458 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-23T06:36:53.458 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-23T06:37:08.459 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.b 2026-02-23T06:37:08.460 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-23T06:37:08.460 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-23T06:37:08.460 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:37:08.461 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:37:08.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.623+0000 7f8e3530c640 1 -- 10.20.193.58:0/3462251324 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8e300b3e70 msgr2=0x7f8e300b46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:08.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.623+0000 7f8e3530c640 1 --2- 10.20.193.58:0/3462251324 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8e300b3e70 0x7f8e300b46c0 secure :-1 s=READY pgs=5 gs=3 cs=0 l=1 c_cookie=17028946710146162017 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e24007520 tx=0x7f8e2402fee0 comp rx=0 tx=0).stop 2026-02-23T06:37:08.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.624+0000 7f8e3530c640 1 -- 10.20.193.58:0/3462251324 shutdown_connections 2026-02-23T06:37:08.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.624+0000 7f8e3530c640 1 --2- 10.20.193.58:0/3462251324 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8e300b3e70 0x7f8e300b46c0 unknown :-1 s=CLOSED pgs=5 gs=3 cs=0 l=1 c_cookie=17028946710146162017 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:08.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.624+0000 7f8e3530c640 1 -- 10.20.193.58:0/3462251324 >> 10.20.193.58:0/3462251324 conn(0x7f8e30058e50 msgr2=0x7f8e30059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:08.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.624+0000 7f8e3530c640 1 -- 10.20.193.58:0/3462251324 shutdown_connections 2026-02-23T06:37:08.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.624+0000 7f8e3530c640 1 -- 10.20.193.58:0/3462251324 wait complete. 2026-02-23T06:37:08.620 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.625+0000 7f8e3530c640 1 Processor -- start 2026-02-23T06:37:08.620 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.626+0000 7f8e3530c640 1 -- start start 2026-02-23T06:37:08.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.626+0000 7f8e3530c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8e300b1770 0x7f8e30172cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:08.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.626+0000 7f8e3530c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8e300b3e70 0x7f8e30163890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:08.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.627+0000 7f8e3530c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e3015b4c0 0x7f8e3005d770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:08.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.627+0000 7f8e3530c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f8e30173200 con 0x7f8e3015b4c0 2026-02-23T06:37:08.622 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.627+0000 7f8e3530c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3005d2e0 con 0x7f8e300b3e70 2026-02-23T06:37:08.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.627+0000 7f8e3530c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f8e3015c780 con 0x7f8e300b1770 2026-02-23T06:37:08.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.627+0000 7f8e2effd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8e300b1770 0x7f8e30172cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:08.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.627+0000 7f8e2effd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8e300b1770 0x7f8e30172cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:49958/0 (socket says 10.20.193.58:49958) 2026-02-23T06:37:08.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.627+0000 7f8e2effd640 1 -- 10.20.193.58:0/266151640 learned_addr learned my addr 10.20.193.58:0/266151640 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:37:08.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.627+0000 7f8e2f7fe640 1 --2- 10.20.193.58:0/266151640 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e3015b4c0 0x7f8e3005d770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:08.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.627+0000 7f8e2e7fc640 1 --2- 10.20.193.58:0/266151640 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8e300b3e70 0x7f8e30163890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:08.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.627+0000 7f8e2effd640 1 -- 10.20.193.58:0/266151640 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8e300b3e70 msgr2=0x7f8e30163890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:08.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.627+0000 7f8e2effd640 1 --2- 10.20.193.58:0/266151640 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8e300b3e70 0x7f8e30163890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:08.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.627+0000 7f8e2effd640 1 -- 10.20.193.58:0/266151640 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e3015b4c0 msgr2=0x7f8e3005d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:08.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.627+0000 7f8e2effd640 1 --2- 10.20.193.58:0/266151640 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e3015b4c0 0x7f8e3005d770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:08.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.627+0000 7f8e2effd640 1 -- 10.20.193.58:0/266151640 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e240071c0 con 0x7f8e300b1770 2026-02-23T06:37:08.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.627+0000 7f8e2e7fc640 1 --2- 10.20.193.58:0/266151640 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8e300b3e70 0x7f8e30163890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:37:08.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.627+0000 7f8e2effd640 1 --2- 10.20.193.58:0/266151640 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8e300b1770 0x7f8e30172cc0 secure :-1 s=READY pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e18007be0 tx=0x7f8e1800c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:08.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.628+0000 7f8e0f7fe640 1 -- 10.20.193.58:0/266151640 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e18012910 con 0x7f8e300b1770 2026-02-23T06:37:08.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.628+0000 7f8e3530c640 1 -- 10.20.193.58:0/266151640 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e3015bc20 con 0x7f8e300b1770 2026-02-23T06:37:08.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.628+0000 7f8e3530c640 1 -- 10.20.193.58:0/266151640 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e3015c1c0 con 0x7f8e300b1770 2026-02-23T06:37:08.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.628+0000 7f8e0f7fe640 1 -- 10.20.193.58:0/266151640 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e18012b60 con 0x7f8e300b1770 2026-02-23T06:37:08.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.628+0000 7f8e0f7fe640 1 -- 10.20.193.58:0/266151640 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e18011380 con 0x7f8e300b1770 2026-02-23T06:37:08.625 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.628+0000 7f8e3530c640 1 -- 10.20.193.58:0/266151640 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e300b0f90 con 0x7f8e300b1770 2026-02-23T06:37:08.625 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.630+0000 7f8e0f7fe640 1 -- 10.20.193.58:0/266151640 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f8e180114e0 con 0x7f8e300b1770 2026-02-23T06:37:08.625 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.630+0000 7f8e0f7fe640 1 --2- 10.20.193.58:0/266151640 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8dfc07a730 0x7f8dfc09abe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:08.625 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.630+0000 7f8e0f7fe640 1 -- 10.20.193.58:0/266151640 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f8e1809de50 con 0x7f8e300b1770 2026-02-23T06:37:08.626 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.632+0000 7f8e0f7fe640 1 -- 10.20.193.58:0/266151640 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f8e180649b0 con 0x7f8e300b1770 2026-02-23T06:37:08.626 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.632+0000 7f8e2e7fc640 1 --2- 10.20.193.58:0/266151640 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8dfc07a730 0x7f8dfc09abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:08.626 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.633+0000 7f8e2e7fc640 1 --2- 10.20.193.58:0/266151640 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8dfc07a730 0x7f8dfc09abe0 secure :-1 s=READY pgs=367 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e240023d0 tx=0x7f8e240047e0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:08.794 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.800+0000 7f8e3530c640 1 -- 10.20.193.58:0/266151640 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8e3005d090 con 0x7f8e300b1770 2026-02-23T06:37:08.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.801+0000 7f8e0f7fe640 1 -- 10.20.193.58:0/266151640 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f8e18064100 con 0x7f8e300b1770 2026-02-23T06:37:08.795 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":136,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:37:08.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.803+0000 7f8e3530c640 1 -- 10.20.193.58:0/266151640 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8dfc07a730 msgr2=0x7f8dfc09abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:08.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.803+0000 7f8e3530c640 1 --2- 10.20.193.58:0/266151640 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8dfc07a730 0x7f8dfc09abe0 secure :-1 s=READY pgs=367 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e240023d0 tx=0x7f8e240047e0 comp rx=0 tx=0).stop 2026-02-23T06:37:08.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.803+0000 7f8e3530c640 1 -- 10.20.193.58:0/266151640 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8e300b1770 msgr2=0x7f8e30172cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:08.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.803+0000 7f8e3530c640 1 --2- 10.20.193.58:0/266151640 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8e300b1770 0x7f8e30172cc0 secure :-1 s=READY pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e18007be0 tx=0x7f8e1800c970 comp rx=0 tx=0).stop 2026-02-23T06:37:08.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.803+0000 7f8e3530c640 1 -- 10.20.193.58:0/266151640 shutdown_connections 2026-02-23T06:37:08.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.803+0000 7f8e3530c640 1 --2- 10.20.193.58:0/266151640 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8dfc07a730 0x7f8dfc09abe0 unknown :-1 s=CLOSED pgs=367 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:08.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.803+0000 7f8e3530c640 1 --2- 10.20.193.58:0/266151640 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e3015b4c0 0x7f8e3005d770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:08.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.803+0000 7f8e3530c640 1 --2- 10.20.193.58:0/266151640 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8e300b3e70 0x7f8e30163890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:08.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.803+0000 7f8e3530c640 1 --2- 10.20.193.58:0/266151640 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8e300b1770 0x7f8e30172cc0 unknown :-1 s=CLOSED pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:08.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.803+0000 7f8e3530c640 1 -- 10.20.193.58:0/266151640 >> 10.20.193.58:0/266151640 conn(0x7f8e30058e50 msgr2=0x7f8e3015a320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:08.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.804+0000 7f8e3530c640 1 -- 10.20.193.58:0/266151640 shutdown_connections 2026-02-23T06:37:08.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.804+0000 7f8e3530c640 1 -- 10.20.193.58:0/266151640 wait complete. 2026-02-23T06:37:08.811 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:37:08.811 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:37:08.811 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:37:08.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.940+0000 7fbf59b9d640 1 -- 10.20.193.58:0/1056083633 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbf540b1170 msgr2=0x7fbf5415ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:08.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.940+0000 7fbf59b9d640 1 --2- 10.20.193.58:0/1056083633 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbf540b1170 0x7fbf5415ce40 secure :-1 s=READY pgs=7 gs=2 cs=0 l=1 c_cookie=5489476895217498372 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf5405b260 tx=0x7fbf4002f250 comp rx=0 tx=0).stop 2026-02-23T06:37:08.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.940+0000 7fbf59b9d640 1 -- 10.20.193.58:0/1056083633 shutdown_connections 2026-02-23T06:37:08.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.940+0000 7fbf59b9d640 1 --2- 10.20.193.58:0/1056083633 >> v2:10.20.193.93:3300/0 conn(0x7fbf540b58a0 0x7fbf54163110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:08.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.940+0000 7fbf59b9d640 1 --2- 10.20.193.58:0/1056083633 >> v2:10.20.193.58:3300/0 conn(0x7fbf540b1540 0x7fbf5415d380 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:08.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.940+0000 7fbf59b9d640 1 --2- 10.20.193.58:0/1056083633 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbf540b1170 0x7fbf5415ce40 unknown :-1 s=CLOSED pgs=7 gs=2 cs=0 l=1 c_cookie=5489476895217498372 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:08.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.940+0000 7fbf59b9d640 1 -- 10.20.193.58:0/1056083633 >> 10.20.193.58:0/1056083633 conn(0x7fbf54058e50 msgr2=0x7fbf54059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:08.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.940+0000 7fbf59b9d640 1 -- 10.20.193.58:0/1056083633 shutdown_connections 2026-02-23T06:37:08.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.940+0000 7fbf59b9d640 1 -- 10.20.193.58:0/1056083633 wait complete. 2026-02-23T06:37:08.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.941+0000 7fbf59b9d640 1 Processor -- start 2026-02-23T06:37:08.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.941+0000 7fbf59b9d640 1 -- start start 2026-02-23T06:37:08.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.942+0000 7fbf59b9d640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbf540b1170 0x7fbf54158b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:08.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.942+0000 7fbf59b9d640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf540b1540 0x7fbf54116aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:08.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.942+0000 7fbf59b9d640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf540b58a0 0x7fbf54116fe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:08.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.942+0000 7fbf59b9d640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fbf54126210 con 0x7fbf540b58a0 2026-02-23T06:37:08.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.942+0000 7fbf59b9d640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fbf541180e0 con 0x7fbf540b1540 2026-02-23T06:37:08.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.942+0000 7fbf59b9d640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fbf54134040 con 0x7fbf540b1170 2026-02-23T06:37:08.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.942+0000 7fbf537fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbf540b1170 0x7fbf54158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:08.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.942+0000 7fbf52ffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf540b1540 0x7fbf54116aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:08.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.942+0000 7fbf537fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbf540b1170 0x7fbf54158b40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:39420/0 (socket says 10.20.193.58:39420) 2026-02-23T06:37:08.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.942+0000 7fbf537fe640 1 -- 10.20.193.58:0/4027762138 learned_addr learned my addr 10.20.193.58:0/4027762138 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:37:08.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.942+0000 7fbf53fff640 1 --2- 10.20.193.58:0/4027762138 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf540b58a0 0x7fbf54116fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:08.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.942+0000 7fbf537fe640 1 -- 10.20.193.58:0/4027762138 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf540b1540 msgr2=0x7fbf54116aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:08.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.942+0000 7fbf537fe640 1 --2- 10.20.193.58:0/4027762138 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf540b1540 0x7fbf54116aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:08.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.942+0000 7fbf537fe640 1 -- 10.20.193.58:0/4027762138 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf540b58a0 msgr2=0x7fbf54116fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:08.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.942+0000 7fbf537fe640 1 --2- 10.20.193.58:0/4027762138 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf540b58a0 0x7fbf54116fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:08.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.942+0000 7fbf537fe640 1 -- 10.20.193.58:0/4027762138 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf40009570 con 0x7fbf540b1170 2026-02-23T06:37:08.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.943+0000 7fbf537fe640 1 --2- 10.20.193.58:0/4027762138 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbf540b1170 0x7fbf54158b40 secure :-1 s=READY pgs=8 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf40004740 tx=0x7fbf400028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:08.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.943+0000 7fbf2ffff640 1 -- 10.20.193.58:0/4027762138 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf4003d070 con 0x7fbf540b1170 2026-02-23T06:37:08.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.943+0000 7fbf59b9d640 1 -- 10.20.193.58:0/4027762138 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf54125690 con 0x7fbf540b1170 2026-02-23T06:37:08.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.943+0000 7fbf2ffff640 1 -- 10.20.193.58:0/4027762138 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf40038470 con 0x7fbf540b1170 2026-02-23T06:37:08.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.943+0000 7fbf2ffff640 1 -- 10.20.193.58:0/4027762138 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf400388a0 con 0x7fbf540b1170 2026-02-23T06:37:08.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.943+0000 7fbf59b9d640 1 -- 10.20.193.58:0/4027762138 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf54125c50 con 0x7fbf540b1170 2026-02-23T06:37:08.938 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.943+0000 7fbf59b9d640 1 --2- 10.20.193.58:0/4027762138 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf54125e10 0x7fbf541163c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:08.938 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.943+0000 7fbf59b9d640 1 -- 10.20.193.58:0/4027762138 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fbf54166fe0 con 0x7fbf54125e10 2026-02-23T06:37:08.938 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.944+0000 7fbf52ffd640 1 --2- 10.20.193.58:0/4027762138 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf54125e10 0x7fbf541163c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:08.938 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.944+0000 7fbf52ffd640 1 -- 10.20.193.58:0/4027762138 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbf54166d00 con 0x7fbf54125e10 2026-02-23T06:37:08.938 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.944+0000 7fbf52ffd640 1 --2- 10.20.193.58:0/4027762138 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf54125e10 0x7fbf541163c0 secure :-1 s=READY pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf540ae8e0 tx=0x7fbf440099d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:08.938 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.944+0000 7fbf2ffff640 1 -- 10.20.193.58:0/4027762138 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf44011990 con 0x7fbf54125e10 2026-02-23T06:37:08.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.945+0000 7fbf2ffff640 1 -- 10.20.193.58:0/4027762138 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fbf44011af0 con 0x7fbf54125e10 2026-02-23T06:37:08.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.945+0000 7fbf2ffff640 1 -- 10.20.193.58:0/4027762138 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf54125e10 msgr2=0x7fbf541163c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:08.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.945+0000 7fbf2ffff640 1 --2- 10.20.193.58:0/4027762138 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf54125e10 0x7fbf541163c0 secure :-1 s=READY pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf540ae8e0 tx=0x7fbf440099d0 comp rx=0 tx=0).stop 2026-02-23T06:37:08.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.945+0000 7fbf2ffff640 1 -- 10.20.193.58:0/4027762138 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf54125e10 msgr2=0x7fbf541163c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:37:08.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.945+0000 7fbf2ffff640 1 --2- 10.20.193.58:0/4027762138 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf54125e10 0x7fbf541163c0 secure :-1 s=CLOSED pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf540ae8e0 tx=0x7fbf440099d0 comp rx=0 tx=0).stop 2026-02-23T06:37:08.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.945+0000 7fbf2ffff640 1 -- 10.20.193.58:0/4027762138 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fbf40038a00 con 0x7fbf540b1170 2026-02-23T06:37:08.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.946+0000 7fbf2ffff640 1 --2- 10.20.193.58:0/4027762138 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbf2407a430 0x7fbf2409a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:08.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.946+0000 7fbf2ffff640 1 -- 10.20.193.58:0/4027762138 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fbf400c2150 con 0x7fbf540b1170 2026-02-23T06:37:08.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.946+0000 7fbf52ffd640 1 --2- 10.20.193.58:0/4027762138 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbf2407a430 0x7fbf2409a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:08.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.947+0000 7fbf52ffd640 1 --2- 10.20.193.58:0/4027762138 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbf2407a430 0x7fbf2409a8e0 secure :-1 s=READY pgs=368 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf44009fd0 tx=0x7fbf4400e000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:08.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.948+0000 7fbf59b9d640 1 --2- 10.20.193.58:0/4027762138 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf540b84e0 0x7fbf54114c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:08.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.948+0000 7fbf59b9d640 1 -- 10.20.193.58:0/4027762138 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5405b2d0 con 0x7fbf540b84e0 2026-02-23T06:37:08.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.949+0000 7fbf53fff640 1 --2- 10.20.193.58:0/4027762138 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf540b84e0 0x7fbf54114c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:08.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.949+0000 7fbf53fff640 1 -- 10.20.193.58:0/4027762138 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbf54160a30 con 0x7fbf540b84e0 2026-02-23T06:37:08.943 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.949+0000 7fbf53fff640 1 --2- 10.20.193.58:0/4027762138 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf540b84e0 0x7fbf54114c40 secure :-1 s=READY pgs=182 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf48003f40 tx=0x7fbf4800aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:08.943 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.949+0000 7fbf2ffff640 1 -- 10.20.193.58:0/4027762138 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf48012a10 con 0x7fbf540b84e0 2026-02-23T06:37:08.943 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.949+0000 7fbf2ffff640 1 -- 10.20.193.58:0/4027762138 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5558 (secure 0 0 0) 0x7fbf48012b70 con 0x7fbf540b84e0 2026-02-23T06:37:08.943 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.949+0000 7fbf2ffff640 1 -- 10.20.193.58:0/4027762138 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf540b84e0 msgr2=0x7fbf54114c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:08.943 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.949+0000 7fbf2ffff640 1 --2- 10.20.193.58:0/4027762138 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf540b84e0 0x7fbf54114c40 secure :-1 s=READY pgs=182 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf48003f40 tx=0x7fbf4800aba0 comp rx=0 tx=0).stop 2026-02-23T06:37:08.943 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.949+0000 7fbf2ffff640 1 -- 10.20.193.58:0/4027762138 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf540b84e0 msgr2=0x7fbf54114c40 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:37:08.943 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.949+0000 7fbf2ffff640 1 --2- 10.20.193.58:0/4027762138 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf540b84e0 0x7fbf54114c40 secure :-1 s=CLOSED pgs=182 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf48003f40 tx=0x7fbf4800aba0 comp rx=0 tx=0).stop 2026-02-23T06:37:08.943 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:37:08.944 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:37:08.944 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:37:08.944 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:37:08.944 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 136, 2026-02-23T06:37:08.944 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 236460, 2026-02-23T06:37:08.944 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:37:08.944 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:37:08.944 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:37:08.944 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:37:08.944 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:08.944 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:37:08.944 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:37:08.944 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:37:08.944 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:37:08.944 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:08.944 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:08.944 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:08.944 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:08.944 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:08.945 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:08.945 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:08.945 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:08.945 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:08.945 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:08.945 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:08.945 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:08.945 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:08.945 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:08.945 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:37:08.945 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:37:08.945 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:08.945 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:08.945 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:08.945 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:08.945 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:08.945 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:08.945 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:08.945 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:08.945 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:08.945 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:08.945 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:08.946 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:08.946 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:08.946 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:08.946 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:08.946 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:37:08.946 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:37:08.946 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:37:08.946 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:37:08.946 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:37:08.946 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:37:08.946 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:37:08.946 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:37:08.946 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:37:08.946 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:37:08.946 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:37:08.946 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:37:08.946 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:37:08.946 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:37:08.946 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:37:08.946 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:37:08.946 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:37:08.946 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:08.947 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:08.947 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:08.947 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:08.947 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:08.947 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:08.947 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:08.947 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:08.947 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:08.947 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:08.947 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:08.947 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:08.947 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:08.947 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:08.947 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:37:08.947 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:08.947 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:37:08.947 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:08.947 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:37:08.947 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:37:08.947 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:08.947 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:08.947 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:08.947 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:08.947 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:37:08.947 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:08.948 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:08.948 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:08.948 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:08.948 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:37:08.948 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:08.948 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:08.948 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:08.948 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:08.948 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:37:08.948 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:37:08.948 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:08.948 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:08.948 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:37:08.948 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:08.948 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:08.948 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:08.948 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:37:08.948 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:37:08.948 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:08.948 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:08.948 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:08.948 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:08.948 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:37:08.948 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:08.949 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:08.949 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:08.949 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:08.949 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:37:08.949 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:08.949 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:08.949 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:08.949 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:08.949 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:37:08.949 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:37:08.949 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:08.949 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:08.949 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:37:08.949 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:08.949 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:08.949 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:08.949 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:37:08.949 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:37:08.949 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:08.949 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:08.949 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:08.949 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:08.949 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:37:08.949 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:08.949 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:08.949 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:08.950 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:08.950 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:37:08.950 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:08.950 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:08.950 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:08.950 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:08.950 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:37:08.950 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:37:08.950 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:08.950 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:08.950 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:37:08.950 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:08.950 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:08.950 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:08.950 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:08.950 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:37:08.950 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:37:08.950 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:08.950 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:08.950 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:08.950 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:37:08.950 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:08.950 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:08.950 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:37:08.950 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:08.950 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:08.950 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:08.951 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:37:08.951 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:08.951 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:08.951 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:37:08.951 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:08.951 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:08.951 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:08.951 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:37:08.951 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:08.951 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:08.951 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:37:08.951 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:08.951 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:37:08.951 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:37:08.951 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:37:08.951 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:08.951 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:08.951 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:08.951 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:08.951 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:37:08.951 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:08.951 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:08.951 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:37:08.952 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:08.952 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:08.952 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:08.952 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:37:08.952 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:08.952 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:08.952 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:08.952 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:37:08.952 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:37:08.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.949+0000 7fbf59b9d640 1 -- 10.20.193.58:0/4027762138 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbf2407a430 msgr2=0x7fbf2409a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:08.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.949+0000 7fbf59b9d640 1 --2- 10.20.193.58:0/4027762138 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbf2407a430 0x7fbf2409a8e0 secure :-1 s=READY pgs=368 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf44009fd0 tx=0x7fbf4400e000 comp rx=0 tx=0).stop 2026-02-23T06:37:08.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.949+0000 7fbf59b9d640 1 -- 10.20.193.58:0/4027762138 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbf540b1170 msgr2=0x7fbf54158b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:08.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.949+0000 7fbf59b9d640 1 --2- 10.20.193.58:0/4027762138 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbf540b1170 0x7fbf54158b40 secure :-1 s=READY pgs=8 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf40004740 tx=0x7fbf400028d0 comp rx=0 tx=0).stop 2026-02-23T06:37:08.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.950+0000 7fbf53fff640 1 -- 10.20.193.58:0/4027762138 reap_dead start 2026-02-23T06:37:08.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.950+0000 7fbf59b9d640 1 -- 10.20.193.58:0/4027762138 shutdown_connections 2026-02-23T06:37:08.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.950+0000 7fbf59b9d640 1 -- 10.20.193.58:0/4027762138 >> 10.20.193.58:0/4027762138 conn(0x7fbf54058e50 msgr2=0x7fbf540b4240 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:08.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.950+0000 7fbf59b9d640 1 -- 10.20.193.58:0/4027762138 shutdown_connections 2026-02-23T06:37:08.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:08.950+0000 7fbf59b9d640 1 -- 10.20.193.58:0/4027762138 wait complete. 2026-02-23T06:37:08.953 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:37:08.953 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:37:08.954 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:37:09.075 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.080+0000 7fd908d0b640 1 -- 10.20.193.58:0/3385638799 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd904056550 msgr2=0x7fd90405ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:09.075 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.080+0000 7fd908d0b640 1 --2- 10.20.193.58:0/3385638799 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd904056550 0x7fd90405ce30 secure :-1 s=READY pgs=183 gs=2 cs=0 l=1 c_cookie=14700970924528587659 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd904054f60 tx=0x7fd8f402f260 comp rx=0 tx=0).stop 2026-02-23T06:37:09.075 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.080+0000 7fd908d0b640 1 -- 10.20.193.58:0/3385638799 shutdown_connections 2026-02-23T06:37:09.075 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.080+0000 7fd908d0b640 1 --2- 10.20.193.58:0/3385638799 >> v2:10.20.193.93:3300/0 conn(0x7fd90405d370 0x7fd9040b5680 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:09.075 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.080+0000 7fd908d0b640 1 --2- 10.20.193.58:0/3385638799 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd904056550 0x7fd90405ce30 unknown :-1 s=CLOSED pgs=183 gs=2 cs=0 l=1 c_cookie=14700970924528587659 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:09.075 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.080+0000 7fd908d0b640 1 -- 10.20.193.58:0/3385638799 >> 10.20.193.58:0/3385638799 conn(0x7fd9040b3c20 msgr2=0x7fd9040b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:09.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.080+0000 7fd908d0b640 1 -- 10.20.193.58:0/3385638799 shutdown_connections 2026-02-23T06:37:09.076 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.080+0000 7fd908d0b640 1 -- 10.20.193.58:0/3385638799 wait complete. 2026-02-23T06:37:09.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.081+0000 7fd908d0b640 1 Processor -- start 2026-02-23T06:37:09.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.082+0000 7fd908d0b640 1 -- start start 2026-02-23T06:37:09.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.082+0000 7fd908d0b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd904056550 0x7fd904157120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:09.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.082+0000 7fd908d0b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd90405d370 0x7fd904161e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:09.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.082+0000 7fd908d0b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd90415c040 0x7fd9041623b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:09.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.082+0000 7fd908d0b640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fd9041564c0 con 0x7fd90405d370 2026-02-23T06:37:09.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.082+0000 7fd908d0b640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fd904155eb0 con 0x7fd904056550 2026-02-23T06:37:09.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.082+0000 7fd908d0b640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fd904157c00 con 0x7fd90415c040 2026-02-23T06:37:09.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.082+0000 7fd902ffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd90405d370 0x7fd904161e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:09.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.083+0000 7fd902ffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd90405d370 0x7fd904161e70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:32946/0 (socket says 10.20.193.58:32946) 2026-02-23T06:37:09.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.083+0000 7fd902ffd640 1 -- 10.20.193.58:0/2765066395 learned_addr learned my addr 10.20.193.58:0/2765066395 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:37:09.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.083+0000 7fd903fff640 1 --2- 10.20.193.58:0/2765066395 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd90415c040 0x7fd9041623b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:09.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.083+0000 7fd9037fe640 1 --2- 10.20.193.58:0/2765066395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd904056550 0x7fd904157120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:09.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.083+0000 7fd902ffd640 1 -- 10.20.193.58:0/2765066395 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd90415c040 msgr2=0x7fd9041623b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:09.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.083+0000 7fd902ffd640 1 --2- 10.20.193.58:0/2765066395 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd90415c040 0x7fd9041623b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:09.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.083+0000 7fd902ffd640 1 -- 10.20.193.58:0/2765066395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd904056550 msgr2=0x7fd904157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:09.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.083+0000 7fd902ffd640 1 --2- 10.20.193.58:0/2765066395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd904056550 0x7fd904157120 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:09.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.083+0000 7fd902ffd640 1 -- 10.20.193.58:0/2765066395 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f800a590 con 0x7fd90405d370 2026-02-23T06:37:09.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.083+0000 7fd902ffd640 1 --2- 10.20.193.58:0/2765066395 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd90405d370 0x7fd904161e70 secure :-1 s=READY pgs=184 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8f4004740 tx=0x7fd8f40028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:09.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.083+0000 7fd8dffff640 1 -- 10.20.193.58:0/2765066395 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd8f403d070 con 0x7fd90405d370 2026-02-23T06:37:09.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.083+0000 7fd8dffff640 1 -- 10.20.193.58:0/2765066395 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8f4038470 con 0x7fd90405d370 2026-02-23T06:37:09.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.083+0000 7fd908d0b640 1 -- 10.20.193.58:0/2765066395 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8f4009570 con 0x7fd90405d370 2026-02-23T06:37:09.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.083+0000 7fd8dffff640 1 -- 10.20.193.58:0/2765066395 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd8f4038880 con 0x7fd90405d370 2026-02-23T06:37:09.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.083+0000 7fd908d0b640 1 -- 10.20.193.58:0/2765066395 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd904156150 con 0x7fd90405d370 2026-02-23T06:37:09.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.084+0000 7fd908d0b640 1 --2- 10.20.193.58:0/2765066395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd904058dd0 0x7fd90415c8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:09.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.084+0000 7fd908d0b640 1 -- 10.20.193.58:0/2765066395 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fd90405d9c0 con 0x7fd904058dd0 2026-02-23T06:37:09.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.084+0000 7fd9037fe640 1 --2- 10.20.193.58:0/2765066395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd904058dd0 0x7fd90415c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:09.081 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.084+0000 7fd9037fe640 1 -- 10.20.193.58:0/2765066395 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd9040b5bc0 con 0x7fd904058dd0 2026-02-23T06:37:09.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.085+0000 7fd8dffff640 1 -- 10.20.193.58:0/2765066395 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fd8f4048060 con 0x7fd90405d370 2026-02-23T06:37:09.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.085+0000 7fd9037fe640 1 --2- 10.20.193.58:0/2765066395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd904058dd0 0x7fd90415c8c0 secure :-1 s=READY pgs=78 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8f0002730 tx=0x7fd8f000d8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:09.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.086+0000 7fd8dffff640 1 --2- 10.20.193.58:0/2765066395 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd8d407a640 0x7fd8d409aaf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:09.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.086+0000 7fd8dffff640 1 -- 10.20.193.58:0/2765066395 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fd8f40c1e20 con 0x7fd90405d370 2026-02-23T06:37:09.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.086+0000 7fd8dffff640 1 -- 10.20.193.58:0/2765066395 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd8f00052f0 con 0x7fd904058dd0 2026-02-23T06:37:09.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.086+0000 7fd8dffff640 1 -- 10.20.193.58:0/2765066395 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fd8f0005450 con 0x7fd904058dd0 2026-02-23T06:37:09.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.086+0000 7fd8dffff640 1 -- 10.20.193.58:0/2765066395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd904058dd0 msgr2=0x7fd90415c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:09.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.086+0000 7fd8dffff640 1 --2- 10.20.193.58:0/2765066395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd904058dd0 0x7fd90415c8c0 secure :-1 s=READY pgs=78 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8f0002730 tx=0x7fd8f000d8f0 comp rx=0 tx=0).stop 2026-02-23T06:37:09.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.086+0000 7fd903fff640 1 --2- 10.20.193.58:0/2765066395 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd8d407a640 0x7fd8d409aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:09.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.086+0000 7fd8dffff640 1 -- 10.20.193.58:0/2765066395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd904058dd0 msgr2=0x7fd90415c8c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:37:09.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.086+0000 7fd8dffff640 1 --2- 10.20.193.58:0/2765066395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd904058dd0 0x7fd90415c8c0 unknown :-1 s=CLOSED pgs=78 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:09.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.086+0000 7fd903fff640 1 --2- 10.20.193.58:0/2765066395 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd8d407a640 0x7fd8d409aaf0 secure :-1 s=READY pgs=369 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8f8005820 tx=0x7fd8f800a310 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:09.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.089+0000 7fd908d0b640 1 --2- 10.20.193.58:0/2765066395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd904157660 0x7fd90415ce00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:09.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.089+0000 7fd908d0b640 1 -- 10.20.193.58:0/2765066395 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fd90415d340 con 0x7fd904157660 2026-02-23T06:37:09.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.090+0000 7fd9037fe640 1 --2- 10.20.193.58:0/2765066395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd904157660 0x7fd90415ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:09.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.090+0000 7fd9037fe640 1 -- 10.20.193.58:0/2765066395 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd904056330 con 0x7fd904157660 2026-02-23T06:37:09.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.090+0000 7fd9037fe640 1 --2- 10.20.193.58:0/2765066395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd904157660 0x7fd90415ce00 secure :-1 s=READY pgs=79 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8f0002730 tx=0x7fd8f00026a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:09.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.091+0000 7fd8dffff640 1 -- 10.20.193.58:0/2765066395 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd8f0021070 con 0x7fd904157660 2026-02-23T06:37:09.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.091+0000 7fd8dffff640 1 -- 10.20.193.58:0/2765066395 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5413 (secure 0 0 0) 0x7fd8f001b870 con 0x7fd904157660 2026-02-23T06:37:09.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.091+0000 7fd8dffff640 1 -- 10.20.193.58:0/2765066395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd904157660 msgr2=0x7fd90415ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:09.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.091+0000 7fd8dffff640 1 --2- 10.20.193.58:0/2765066395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd904157660 0x7fd90415ce00 secure :-1 s=READY pgs=79 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8f0002730 tx=0x7fd8f00026a0 comp rx=0 tx=0).stop 2026-02-23T06:37:09.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.091+0000 7fd8dffff640 1 -- 10.20.193.58:0/2765066395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd904157660 msgr2=0x7fd90415ce00 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:37:09.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.091+0000 7fd8dffff640 1 --2- 10.20.193.58:0/2765066395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd904157660 0x7fd90415ce00 secure :-1 s=CLOSED pgs=79 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8f0002730 tx=0x7fd8f00026a0 comp rx=0 tx=0).stop 2026-02-23T06:37:09.086 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:37:09.086 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:37:09.086 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:37:09.086 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:37:09.087 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 136, 2026-02-23T06:37:09.087 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 141673, 2026-02-23T06:37:09.087 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:37:09.087 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:37:09.087 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:37:09.087 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:37:09.087 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:09.087 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:37:09.087 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:37:09.087 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:37:09.087 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:37:09.088 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:09.088 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:09.088 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:09.088 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:09.088 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:09.088 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:09.088 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:09.088 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:09.088 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:09.088 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:09.088 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:09.088 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:09.088 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:09.089 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:09.089 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:37:09.089 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:37:09.089 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:09.089 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:09.089 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:09.089 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:09.089 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:09.089 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:09.089 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:09.089 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:09.090 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:09.090 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:09.090 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:09.090 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:09.090 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:09.090 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:09.090 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:09.090 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:37:09.090 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:37:09.090 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:37:09.090 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:37:09.090 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:37:09.091 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:37:09.091 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:37:09.091 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:37:09.091 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:37:09.091 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:37:09.091 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:37:09.091 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:37:09.091 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:37:09.091 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:37:09.091 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:37:09.091 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:37:09.092 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:37:09.092 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:09.092 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:09.092 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:09.092 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:09.092 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:09.092 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:09.092 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:09.092 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:09.092 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:09.092 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:09.092 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:09.092 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:09.093 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:09.093 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:09.093 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:37:09.093 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:09.093 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:37:09.093 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:09.093 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:37:09.093 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:37:09.093 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:09.093 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:09.093 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:09.093 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:09.094 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:37:09.094 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:09.094 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:09.094 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:09.094 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:09.094 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:37:09.094 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:09.094 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:09.094 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:09.094 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:09.094 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:37:09.095 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:37:09.095 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:09.095 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:09.095 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:37:09.095 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:09.095 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:09.095 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:09.095 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:37:09.095 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:37:09.095 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:09.095 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:09.095 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:09.096 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:09.096 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:37:09.096 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:09.096 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:09.096 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:09.096 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:09.096 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:37:09.096 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:09.096 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:09.096 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:09.096 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:09.096 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:37:09.097 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:37:09.097 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:09.097 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:09.097 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:37:09.097 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:09.097 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:09.097 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:09.097 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:37:09.097 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:37:09.097 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:09.097 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:09.097 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:09.097 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:09.098 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:37:09.098 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:09.098 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:09.098 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:09.098 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:09.098 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:37:09.098 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:09.098 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:09.098 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:09.098 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:09.098 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:37:09.098 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:37:09.098 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:09.099 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:09.099 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:37:09.099 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:09.099 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:09.099 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:09.099 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:09.099 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:37:09.099 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:37:09.099 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:09.099 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:09.099 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:09.100 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:37:09.100 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:09.100 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:09.100 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:37:09.100 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:09.100 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:09.100 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:09.100 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:37:09.100 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:09.100 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:09.100 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:37:09.100 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:09.100 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:09.101 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:09.101 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:37:09.101 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:09.101 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:09.101 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:37:09.101 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:09.101 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:09.101 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:09.101 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:37:09.101 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:09.101 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:09.101 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:37:09.101 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:09.102 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:09.102 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:09.102 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:37:09.102 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:09.102 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:09.102 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:09.102 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:37:09.102 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:37:09.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.091+0000 7fd908d0b640 1 -- 10.20.193.58:0/2765066395 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd8d407a640 msgr2=0x7fd8d409aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:09.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.091+0000 7fd908d0b640 1 --2- 10.20.193.58:0/2765066395 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd8d407a640 0x7fd8d409aaf0 secure :-1 s=READY pgs=369 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8f8005820 tx=0x7fd8f800a310 comp rx=0 tx=0).stop 2026-02-23T06:37:09.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.091+0000 7fd908d0b640 1 -- 10.20.193.58:0/2765066395 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd90405d370 msgr2=0x7fd904161e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:09.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.091+0000 7fd908d0b640 1 --2- 10.20.193.58:0/2765066395 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd90405d370 0x7fd904161e70 secure :-1 s=READY pgs=184 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8f4004740 tx=0x7fd8f40028d0 comp rx=0 tx=0).stop 2026-02-23T06:37:09.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.091+0000 7fd903fff640 1 -- 10.20.193.58:0/2765066395 reap_dead start 2026-02-23T06:37:09.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.091+0000 7fd903fff640 1 -- 10.20.193.58:0/2765066395 reap_dead start 2026-02-23T06:37:09.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.091+0000 7fd908d0b640 1 -- 10.20.193.58:0/2765066395 shutdown_connections 2026-02-23T06:37:09.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.091+0000 7fd908d0b640 1 -- 10.20.193.58:0/2765066395 >> 10.20.193.58:0/2765066395 conn(0x7fd9040b3c20 msgr2=0x7fd904164b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:09.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.091+0000 7fd908d0b640 1 -- 10.20.193.58:0/2765066395 shutdown_connections 2026-02-23T06:37:09.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.091+0000 7fd908d0b640 1 -- 10.20.193.58:0/2765066395 wait complete. 2026-02-23T06:37:09.105 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:37:09.105 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:37:09.106 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:37:09.226 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.231+0000 7fc533577640 1 -- 10.20.193.58:0/3496890805 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc53415c4b0 msgr2=0x7fc534058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:09.226 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.231+0000 7fc533577640 1 --2- 10.20.193.58:0/3496890805 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc53415c4b0 0x7fc534058200 secure :-1 s=READY pgs=186 gs=3 cs=0 l=1 c_cookie=3870103160365380632 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc528005e70 tx=0x7fc52802f280 comp rx=0 tx=0).stop 2026-02-23T06:37:09.226 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.232+0000 7fc533577640 1 -- 10.20.193.58:0/3496890805 shutdown_connections 2026-02-23T06:37:09.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.232+0000 7fc533577640 1 --2- 10.20.193.58:0/3496890805 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc53415c4b0 0x7fc534058200 unknown :-1 s=CLOSED pgs=186 gs=3 cs=0 l=1 c_cookie=3870103160365380632 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:09.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.232+0000 7fc533577640 1 -- 10.20.193.58:0/3496890805 >> 10.20.193.58:0/3496890805 conn(0x7fc5340b3c20 msgr2=0x7fc5340b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:09.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.232+0000 7fc533577640 1 -- 10.20.193.58:0/3496890805 shutdown_connections 2026-02-23T06:37:09.227 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.232+0000 7fc533577640 1 -- 10.20.193.58:0/3496890805 wait complete. 2026-02-23T06:37:09.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.233+0000 7fc533577640 1 Processor -- start 2026-02-23T06:37:09.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.233+0000 7fc533577640 1 -- start start 2026-02-23T06:37:09.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.233+0000 7fc533577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc534056960 0x7fc53413e520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:09.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.233+0000 7fc533577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc53415c4b0 0x7fc534159290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:09.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.233+0000 7fc533577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc534162ca0 0x7fc5341597d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:09.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.233+0000 7fc533577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc5341fd800 con 0x7fc534056960 2026-02-23T06:37:09.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.233+0000 7fc533577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc534161f70 con 0x7fc534162ca0 2026-02-23T06:37:09.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.233+0000 7fc533577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc534162210 con 0x7fc53415c4b0 2026-02-23T06:37:09.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.234+0000 7fc532575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc534056960 0x7fc53413e520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:09.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.234+0000 7fc531d74640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc53415c4b0 0x7fc534159290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:09.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.234+0000 7fc532575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc534056960 0x7fc53413e520 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:32962/0 (socket says 10.20.193.58:32962) 2026-02-23T06:37:09.228 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.234+0000 7fc532575640 1 -- 10.20.193.58:0/2894875684 learned_addr learned my addr 10.20.193.58:0/2894875684 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:37:09.229 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.234+0000 7fc532d76640 1 --2- 10.20.193.58:0/2894875684 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc534162ca0 0x7fc5341597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:09.229 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.234+0000 7fc532575640 1 -- 10.20.193.58:0/2894875684 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc53415c4b0 msgr2=0x7fc534159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:09.229 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.234+0000 7fc532575640 1 --2- 10.20.193.58:0/2894875684 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc53415c4b0 0x7fc534159290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:09.229 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.234+0000 7fc532575640 1 -- 10.20.193.58:0/2894875684 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc534162ca0 msgr2=0x7fc5341597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:09.229 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.234+0000 7fc532575640 1 --2- 10.20.193.58:0/2894875684 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc534162ca0 0x7fc5341597d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:09.229 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.234+0000 7fc532575640 1 -- 10.20.193.58:0/2894875684 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc528009570 con 0x7fc534056960 2026-02-23T06:37:09.229 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.234+0000 7fc532d76640 1 --2- 10.20.193.58:0/2894875684 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc534162ca0 0x7fc5341597d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:37:09.229 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.234+0000 7fc532575640 1 --2- 10.20.193.58:0/2894875684 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc534056960 0x7fc53413e520 secure :-1 s=READY pgs=187 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc528004740 tx=0x7fc5280028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:09.229 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.235+0000 7fc51affd640 1 -- 10.20.193.58:0/2894875684 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc52803d070 con 0x7fc534056960 2026-02-23T06:37:09.229 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.235+0000 7fc51affd640 1 -- 10.20.193.58:0/2894875684 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc528038470 con 0x7fc534056960 2026-02-23T06:37:09.229 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.235+0000 7fc51affd640 1 -- 10.20.193.58:0/2894875684 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc5280388a0 con 0x7fc534056960 2026-02-23T06:37:09.229 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.235+0000 7fc533577640 1 -- 10.20.193.58:0/2894875684 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc534161b90 con 0x7fc534056960 2026-02-23T06:37:09.229 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.235+0000 7fc533577640 1 -- 10.20.193.58:0/2894875684 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc534141c50 con 0x7fc534056960 2026-02-23T06:37:09.229 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.235+0000 7fc533577640 1 --2- 10.20.193.58:0/2894875684 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc534160870 0x7fc534141e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:09.229 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.235+0000 7fc533577640 1 -- 10.20.193.58:0/2894875684 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc5341fd9a0 con 0x7fc534160870 2026-02-23T06:37:09.230 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.236+0000 7fc51affd640 1 -- 10.20.193.58:0/2894875684 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fc528038a00 con 0x7fc534056960 2026-02-23T06:37:09.230 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.237+0000 7fc531d74640 1 --2- 10.20.193.58:0/2894875684 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc534160870 0x7fc534141e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:09.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.237+0000 7fc531d74640 1 -- 10.20.193.58:0/2894875684 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc534059690 con 0x7fc534160870 2026-02-23T06:37:09.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.237+0000 7fc531d74640 1 --2- 10.20.193.58:0/2894875684 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc534160870 0x7fc534141e60 secure :-1 s=READY pgs=9 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc51c007fd0 tx=0x7fc51c00fc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:09.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.238+0000 7fc51affd640 1 --2- 10.20.193.58:0/2894875684 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc50007a6c0 0x7fc50009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:09.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.238+0000 7fc51affd640 1 -- 10.20.193.58:0/2894875684 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fc5280c21d0 con 0x7fc534056960 2026-02-23T06:37:09.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.238+0000 7fc51affd640 1 -- 10.20.193.58:0/2894875684 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc51c00d990 con 0x7fc534160870 2026-02-23T06:37:09.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.238+0000 7fc51affd640 1 -- 10.20.193.58:0/2894875684 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fc51c00daf0 con 0x7fc534160870 2026-02-23T06:37:09.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.238+0000 7fc51affd640 1 -- 10.20.193.58:0/2894875684 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc534160870 msgr2=0x7fc534141e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:09.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.238+0000 7fc51affd640 1 --2- 10.20.193.58:0/2894875684 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc534160870 0x7fc534141e60 secure :-1 s=READY pgs=9 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc51c007fd0 tx=0x7fc51c00fc10 comp rx=0 tx=0).stop 2026-02-23T06:37:09.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.238+0000 7fc51affd640 1 -- 10.20.193.58:0/2894875684 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc534160870 msgr2=0x7fc534141e60 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:37:09.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.238+0000 7fc51affd640 1 --2- 10.20.193.58:0/2894875684 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc534160870 0x7fc534141e60 secure :-1 s=CLOSED pgs=9 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc51c007fd0 tx=0x7fc51c00fc10 comp rx=0 tx=0).stop 2026-02-23T06:37:09.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.239+0000 7fc532d76640 1 --2- 10.20.193.58:0/2894875684 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc50007a6c0 0x7fc50009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:09.233 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.239+0000 7fc532d76640 1 --2- 10.20.193.58:0/2894875684 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc50007a6c0 0x7fc50009ab70 secure :-1 s=READY pgs=370 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5340b6090 tx=0x7fc524009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:09.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.242+0000 7fc533577640 1 --2- 10.20.193.58:0/2894875684 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc5340aef00 0x7fc5341fdca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:09.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.242+0000 7fc533577640 1 -- 10.20.193.58:0/2894875684 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc53415c880 con 0x7fc5340aef00 2026-02-23T06:37:09.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.242+0000 7fc531d74640 1 --2- 10.20.193.58:0/2894875684 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc5340aef00 0x7fc5341fdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:09.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.243+0000 7fc531d74640 1 -- 10.20.193.58:0/2894875684 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc5341423a0 con 0x7fc5340aef00 2026-02-23T06:37:09.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.243+0000 7fc531d74640 1 --2- 10.20.193.58:0/2894875684 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc5340aef00 0x7fc5341fdca0 secure :-1 s=READY pgs=10 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc51c016000 tx=0x7fc51c0037e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:09.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.243+0000 7fc51affd640 1 -- 10.20.193.58:0/2894875684 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc51c0148a0 con 0x7fc5340aef00 2026-02-23T06:37:09.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.243+0000 7fc51affd640 1 -- 10.20.193.58:0/2894875684 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4911 (secure 0 0 0) 0x7fc51c014a00 con 0x7fc5340aef00 2026-02-23T06:37:09.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.243+0000 7fc51affd640 1 -- 10.20.193.58:0/2894875684 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc5340aef00 msgr2=0x7fc5341fdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:09.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.243+0000 7fc51affd640 1 --2- 10.20.193.58:0/2894875684 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc5340aef00 0x7fc5341fdca0 secure :-1 s=READY pgs=10 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc51c016000 tx=0x7fc51c0037e0 comp rx=0 tx=0).stop 2026-02-23T06:37:09.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.243+0000 7fc51affd640 1 -- 10.20.193.58:0/2894875684 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc5340aef00 msgr2=0x7fc5341fdca0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:37:09.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.243+0000 7fc51affd640 1 --2- 10.20.193.58:0/2894875684 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc5340aef00 0x7fc5341fdca0 secure :-1 s=CLOSED pgs=10 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc51c016000 tx=0x7fc51c0037e0 comp rx=0 tx=0).stop 2026-02-23T06:37:09.237 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:37:09.237 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:37:09.237 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:37:09.237 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:37:09.237 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 136, 2026-02-23T06:37:09.237 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 15722, 2026-02-23T06:37:09.237 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:37:09.237 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:37:09.237 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:37:09.237 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:37:09.237 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:09.237 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:37:09.237 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:37:09.237 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:37:09.237 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:37:09.237 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:09.237 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:09.237 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:09.237 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:09.237 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:37:09.238 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:09.239 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:09.240 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:37:09.241 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:37:09.241 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:09.241 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:09.241 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:09.241 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:37:09.241 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:09.241 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:09.241 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:37:09.241 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:09.241 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:09.241 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:09.241 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:37:09.241 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:09.241 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:09.241 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:09.241 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:37:09.241 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:37:09.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.243+0000 7fc533577640 1 -- 10.20.193.58:0/2894875684 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc50007a6c0 msgr2=0x7fc50009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:09.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.243+0000 7fc533577640 1 --2- 10.20.193.58:0/2894875684 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc50007a6c0 0x7fc50009ab70 secure :-1 s=READY pgs=370 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5340b6090 tx=0x7fc524009040 comp rx=0 tx=0).stop 2026-02-23T06:37:09.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.243+0000 7fc533577640 1 -- 10.20.193.58:0/2894875684 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc534056960 msgr2=0x7fc53413e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:09.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.243+0000 7fc533577640 1 --2- 10.20.193.58:0/2894875684 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc534056960 0x7fc53413e520 secure :-1 s=READY pgs=187 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc528004740 tx=0x7fc5280028d0 comp rx=0 tx=0).stop 2026-02-23T06:37:09.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.243+0000 7fc532d76640 1 -- 10.20.193.58:0/2894875684 reap_dead start 2026-02-23T06:37:09.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.243+0000 7fc532d76640 1 -- 10.20.193.58:0/2894875684 reap_dead start 2026-02-23T06:37:09.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.243+0000 7fc533577640 1 -- 10.20.193.58:0/2894875684 shutdown_connections 2026-02-23T06:37:09.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.244+0000 7fc533577640 1 -- 10.20.193.58:0/2894875684 >> 10.20.193.58:0/2894875684 conn(0x7fc5340b3c20 msgr2=0x7fc53415b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:09.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.244+0000 7fc533577640 1 -- 10.20.193.58:0/2894875684 shutdown_connections 2026-02-23T06:37:09.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.244+0000 7fc533577640 1 -- 10.20.193.58:0/2894875684 wait complete. 2026-02-23T06:37:09.247 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:37:09.247 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:37:09.247 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:37:09.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.377+0000 7fa0abacc640 1 -- 10.20.193.58:0/3343233312 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa0a40b39f0 msgr2=0x7fa0a40b6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:09.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.377+0000 7fa0abacc640 1 --2- 10.20.193.58:0/3343233312 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa0a40b39f0 0x7fa0a40b6a20 secure :-1 s=READY pgs=81 gs=3 cs=0 l=1 c_cookie=7489557446652813894 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa0a40b0690 tx=0x7fa0a00302f0 comp rx=0 tx=0).stop 2026-02-23T06:37:09.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.381+0000 7fa0abacc640 1 -- 10.20.193.58:0/3343233312 shutdown_connections 2026-02-23T06:37:09.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.381+0000 7fa0abacc640 1 --2- 10.20.193.58:0/3343233312 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa0a40b39f0 0x7fa0a40b6a20 unknown :-1 s=CLOSED pgs=81 gs=3 cs=0 l=1 c_cookie=7489557446652813894 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:09.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.381+0000 7fa0abacc640 1 --2- 10.20.193.58:0/3343233312 >> v2:10.20.193.58:3300/0 conn(0x7fa0a415baa0 0x7fa0a40b5610 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:09.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.381+0000 7fa0abacc640 1 -- 10.20.193.58:0/3343233312 >> 10.20.193.58:0/3343233312 conn(0x7fa0a4058e50 msgr2=0x7fa0a4059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:09.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.381+0000 7fa0abacc640 1 -- 10.20.193.58:0/3343233312 shutdown_connections 2026-02-23T06:37:09.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.381+0000 7fa0abacc640 1 -- 10.20.193.58:0/3343233312 wait complete. 2026-02-23T06:37:09.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.392+0000 7fa0abacc640 1 Processor -- start 2026-02-23T06:37:09.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.392+0000 7fa0abacc640 1 -- start start 2026-02-23T06:37:09.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.393+0000 7fa0abacc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa0a40b39f0 0x7fa0a411fb10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:09.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.393+0000 7fa0abacc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa0a415baa0 0x7fa0a413b600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:09.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.393+0000 7fa0abacc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa0a415be70 0x7fa0a413bb40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:09.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.393+0000 7fa0abacc640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a411af20 con 0x7fa0a415be70 2026-02-23T06:37:09.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.393+0000 7fa0abacc640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a414c230 con 0x7fa0a415baa0 2026-02-23T06:37:09.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.393+0000 7fa0abacc640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa0a411b9c0 con 0x7fa0a40b39f0 2026-02-23T06:37:09.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.393+0000 7fa0a9841640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa0a40b39f0 0x7fa0a411fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:09.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.393+0000 7fa0aa042640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa0a415be70 0x7fa0a413bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:09.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.393+0000 7fa0a9040640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa0a415baa0 0x7fa0a413b600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:09.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.394+0000 7fa0aa042640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa0a415be70 0x7fa0a413bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:32978/0 (socket says 10.20.193.58:32978) 2026-02-23T06:37:09.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.394+0000 7fa0aa042640 1 -- 10.20.193.58:0/710548287 learned_addr learned my addr 10.20.193.58:0/710548287 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:37:09.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.394+0000 7fa0aa042640 1 -- 10.20.193.58:0/710548287 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa0a40b39f0 msgr2=0x7fa0a411fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:09.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.394+0000 7fa0aa042640 1 --2- 10.20.193.58:0/710548287 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa0a40b39f0 0x7fa0a411fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:09.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.394+0000 7fa0aa042640 1 -- 10.20.193.58:0/710548287 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa0a415baa0 msgr2=0x7fa0a413b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:09.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.395+0000 7fa0aa042640 1 --2- 10.20.193.58:0/710548287 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa0a415baa0 0x7fa0a413b600 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:09.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.395+0000 7fa0aa042640 1 -- 10.20.193.58:0/710548287 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a000a650 con 0x7fa0a415be70 2026-02-23T06:37:09.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.395+0000 7fa0aa042640 1 --2- 10.20.193.58:0/710548287 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa0a415be70 0x7fa0a413bb40 secure :-1 s=READY pgs=188 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa0a0006f50 tx=0x7fa0a0003d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:09.391 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.395+0000 7fa0927fc640 1 -- 10.20.193.58:0/710548287 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa0a0045070 con 0x7fa0a415be70 2026-02-23T06:37:09.391 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.395+0000 7fa0927fc640 1 -- 10.20.193.58:0/710548287 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0a0005b50 con 0x7fa0a415be70 2026-02-23T06:37:09.391 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.395+0000 7fa0927fc640 1 -- 10.20.193.58:0/710548287 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa0a0006020 con 0x7fa0a415be70 2026-02-23T06:37:09.391 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.395+0000 7fa0abacc640 1 -- 10.20.193.58:0/710548287 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0a4119e50 con 0x7fa0a415be70 2026-02-23T06:37:09.391 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.395+0000 7fa0abacc640 1 -- 10.20.193.58:0/710548287 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0a411a410 con 0x7fa0a415be70 2026-02-23T06:37:09.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.400+0000 7fa0abacc640 1 -- 10.20.193.58:0/710548287 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa070005300 con 0x7fa0a415be70 2026-02-23T06:37:09.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.400+0000 7fa0927fc640 1 -- 10.20.193.58:0/710548287 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fa0a0006180 con 0x7fa0a415be70 2026-02-23T06:37:09.395 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.401+0000 7fa0927fc640 1 --2- 10.20.193.58:0/710548287 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa07407a810 0x7fa07409acc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:09.395 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.401+0000 7fa0927fc640 1 -- 10.20.193.58:0/710548287 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fa0a00c35a0 con 0x7fa0a415be70 2026-02-23T06:37:09.395 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.401+0000 7fa0a9841640 1 --2- 10.20.193.58:0/710548287 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa07407a810 0x7fa07409acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:09.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.404+0000 7fa0927fc640 1 -- 10.20.193.58:0/710548287 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fa0a0086870 con 0x7fa0a415be70 2026-02-23T06:37:09.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.404+0000 7fa0a9841640 1 --2- 10.20.193.58:0/710548287 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa07407a810 0x7fa07409acc0 secure :-1 s=READY pgs=371 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa094004740 tx=0x7fa094005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:09.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.569+0000 7fa0abacc640 1 -- 10.20.193.58:0/710548287 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fa070005dc0 con 0x7fa0a415be70 2026-02-23T06:37:09.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.569+0000 7fa0927fc640 1 -- 10.20.193.58:0/710548287 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fa0a0089990 con 0x7fa0a415be70 2026-02-23T06:37:09.570 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.576+0000 7fa0abacc640 1 -- 10.20.193.58:0/710548287 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa07407a810 msgr2=0x7fa07409acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:09.570 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.576+0000 7fa0abacc640 1 --2- 10.20.193.58:0/710548287 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa07407a810 0x7fa07409acc0 secure :-1 s=READY pgs=371 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa094004740 tx=0x7fa094005f90 comp rx=0 tx=0).stop 2026-02-23T06:37:09.570 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.576+0000 7fa0abacc640 1 -- 10.20.193.58:0/710548287 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa0a415be70 msgr2=0x7fa0a413bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:09.571 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.576+0000 7fa0abacc640 1 --2- 10.20.193.58:0/710548287 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa0a415be70 0x7fa0a413bb40 secure :-1 s=READY pgs=188 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa0a0006f50 tx=0x7fa0a0003d20 comp rx=0 tx=0).stop 2026-02-23T06:37:09.571 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.577+0000 7fa0abacc640 1 -- 10.20.193.58:0/710548287 shutdown_connections 2026-02-23T06:37:09.571 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.577+0000 7fa0abacc640 1 --2- 10.20.193.58:0/710548287 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa07407a810 0x7fa07409acc0 unknown :-1 s=CLOSED pgs=371 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:09.571 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.577+0000 7fa0abacc640 1 --2- 10.20.193.58:0/710548287 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa0a415be70 0x7fa0a413bb40 unknown :-1 s=CLOSED pgs=188 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:09.571 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.577+0000 7fa0abacc640 1 --2- 10.20.193.58:0/710548287 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa0a415baa0 0x7fa0a413b600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:09.571 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.577+0000 7fa0abacc640 1 --2- 10.20.193.58:0/710548287 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa0a40b39f0 0x7fa0a411fb10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:09.571 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.577+0000 7fa0abacc640 1 -- 10.20.193.58:0/710548287 >> 10.20.193.58:0/710548287 conn(0x7fa0a4058e50 msgr2=0x7fa0a40b28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:09.571 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.577+0000 7fa0abacc640 1 -- 10.20.193.58:0/710548287 shutdown_connections 2026-02-23T06:37:09.571 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:09.577+0000 7fa0abacc640 1 -- 10.20.193.58:0/710548287 wait complete. 2026-02-23T06:37:09.586 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:37:13.773 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:37:13.778 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:37:19.587 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:37:19.588 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:37:19.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.726+0000 7f3249dd2640 1 -- 10.20.193.58:0/1185339379 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f324415d870 msgr2=0x7f32440587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:19.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.726+0000 7f3249dd2640 1 --2- 10.20.193.58:0/1185339379 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f324415d870 0x7f32440587b0 secure :-1 s=READY pgs=190 gs=3 cs=0 l=1 c_cookie=3705576869212142007 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f322c004740 tx=0x7f322c02f230 comp rx=0 tx=0).stop 2026-02-23T06:37:19.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.727+0000 7f3249dd2640 1 -- 10.20.193.58:0/1185339379 shutdown_connections 2026-02-23T06:37:19.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.727+0000 7f3249dd2640 1 --2- 10.20.193.58:0/1185339379 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f324415d870 0x7f32440587b0 unknown :-1 s=CLOSED pgs=190 gs=3 cs=0 l=1 c_cookie=3705576869212142007 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:19.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.727+0000 7f3249dd2640 1 -- 10.20.193.58:0/1185339379 >> 10.20.193.58:0/1185339379 conn(0x7f32440b3c20 msgr2=0x7f32440b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:19.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.727+0000 7f3249dd2640 1 -- 10.20.193.58:0/1185339379 shutdown_connections 2026-02-23T06:37:19.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.727+0000 7f3249dd2640 1 -- 10.20.193.58:0/1185339379 wait complete. 2026-02-23T06:37:19.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.728+0000 7f3249dd2640 1 Processor -- start 2026-02-23T06:37:19.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.728+0000 7f3249dd2640 1 -- start start 2026-02-23T06:37:19.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.728+0000 7f3249dd2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f32440b6690 0x7f324414d280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:19.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.728+0000 7f3249dd2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f324415d4a0 0x7f324415eec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:19.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.728+0000 7f3249dd2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f324415d870 0x7f3244149b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:19.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.728+0000 7f3249dd2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f324414a0d0 con 0x7f324415d870 2026-02-23T06:37:19.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.728+0000 7f3249dd2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f3244142290 con 0x7f32440b6690 2026-02-23T06:37:19.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.728+0000 7f3249dd2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f324414cdf0 con 0x7f324415d4a0 2026-02-23T06:37:19.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.729+0000 7f32495d1640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f324415d870 0x7f3244149b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:19.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.729+0000 7f3248dd0640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f32440b6690 0x7f324414d280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:19.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.729+0000 7f323bfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f324415d4a0 0x7f324415eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:19.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.729+0000 7f32495d1640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f324415d870 0x7f3244149b90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:37708/0 (socket says 10.20.193.58:37708) 2026-02-23T06:37:19.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.729+0000 7f32495d1640 1 -- 10.20.193.58:0/3916371051 learned_addr learned my addr 10.20.193.58:0/3916371051 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:37:19.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.729+0000 7f32495d1640 1 -- 10.20.193.58:0/3916371051 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f324415d4a0 msgr2=0x7f324415eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:19.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.729+0000 7f32495d1640 1 --2- 10.20.193.58:0/3916371051 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f324415d4a0 0x7f324415eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:19.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.729+0000 7f32495d1640 1 -- 10.20.193.58:0/3916371051 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f32440b6690 msgr2=0x7f324414d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:19.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.729+0000 7f32495d1640 1 --2- 10.20.193.58:0/3916371051 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f32440b6690 0x7f324414d280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:19.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.729+0000 7f32495d1640 1 -- 10.20.193.58:0/3916371051 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f322c0094b0 con 0x7f324415d870 2026-02-23T06:37:19.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.729+0000 7f32495d1640 1 --2- 10.20.193.58:0/3916371051 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f324415d870 0x7f3244149b90 secure :-1 s=READY pgs=191 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f324000d560 tx=0x7f324000da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:19.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.729+0000 7f32397fa640 1 -- 10.20.193.58:0/3916371051 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3240007c50 con 0x7f324415d870 2026-02-23T06:37:19.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.729+0000 7f32397fa640 1 -- 10.20.193.58:0/3916371051 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3240013630 con 0x7f324415d870 2026-02-23T06:37:19.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.729+0000 7f32397fa640 1 -- 10.20.193.58:0/3916371051 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3240007ea0 con 0x7f324415d870 2026-02-23T06:37:19.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.729+0000 7f3249dd2640 1 -- 10.20.193.58:0/3916371051 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32441424a0 con 0x7f324415d870 2026-02-23T06:37:19.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.729+0000 7f3249dd2640 1 -- 10.20.193.58:0/3916371051 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f324414ca80 con 0x7f324415d870 2026-02-23T06:37:19.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.730+0000 7f3249dd2640 1 -- 10.20.193.58:0/3916371051 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32440b6d50 con 0x7f324415d870 2026-02-23T06:37:19.725 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.731+0000 7f32397fa640 1 -- 10.20.193.58:0/3916371051 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f324001a070 con 0x7f324415d870 2026-02-23T06:37:19.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.731+0000 7f32397fa640 1 --2- 10.20.193.58:0/3916371051 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f321407a790 0x7f321409ac40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:19.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.731+0000 7f32397fa640 1 -- 10.20.193.58:0/3916371051 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f324009e7a0 con 0x7f324415d870 2026-02-23T06:37:19.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.731+0000 7f32397fa640 1 -- 10.20.193.58:0/3916371051 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f3240061a70 con 0x7f324415d870 2026-02-23T06:37:19.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.738+0000 7f3248dd0640 1 --2- 10.20.193.58:0/3916371051 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f321407a790 0x7f321409ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:19.733 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.739+0000 7f3248dd0640 1 --2- 10.20.193.58:0/3916371051 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f321407a790 0x7f321409ac40 secure :-1 s=READY pgs=372 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32340027d0 tx=0x7f3234007ee0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:19.883 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.889+0000 7f3249dd2640 1 -- 10.20.193.58:0/3916371051 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f32440b06c0 con 0x7f324415d870 2026-02-23T06:37:19.884 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.889+0000 7f32397fa640 1 -- 10.20.193.58:0/3916371051 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f32440b06c0 con 0x7f324415d870 2026-02-23T06:37:19.884 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":136,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:37:19.886 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.892+0000 7f3249dd2640 1 -- 10.20.193.58:0/3916371051 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f321407a790 msgr2=0x7f321409ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:19.886 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.892+0000 7f3249dd2640 1 --2- 10.20.193.58:0/3916371051 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f321407a790 0x7f321409ac40 secure :-1 s=READY pgs=372 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32340027d0 tx=0x7f3234007ee0 comp rx=0 tx=0).stop 2026-02-23T06:37:19.886 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.892+0000 7f3249dd2640 1 -- 10.20.193.58:0/3916371051 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f324415d870 msgr2=0x7f3244149b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:19.886 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.892+0000 7f3249dd2640 1 --2- 10.20.193.58:0/3916371051 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f324415d870 0x7f3244149b90 secure :-1 s=READY pgs=191 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f324000d560 tx=0x7f324000da30 comp rx=0 tx=0).stop 2026-02-23T06:37:19.886 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.892+0000 7f3249dd2640 1 -- 10.20.193.58:0/3916371051 shutdown_connections 2026-02-23T06:37:19.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.892+0000 7f3249dd2640 1 --2- 10.20.193.58:0/3916371051 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f321407a790 0x7f321409ac40 unknown :-1 s=CLOSED pgs=372 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:19.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.892+0000 7f3249dd2640 1 --2- 10.20.193.58:0/3916371051 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f324415d870 0x7f3244149b90 unknown :-1 s=CLOSED pgs=191 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:19.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.892+0000 7f3249dd2640 1 --2- 10.20.193.58:0/3916371051 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f324415d4a0 0x7f324415eec0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:19.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.892+0000 7f3249dd2640 1 --2- 10.20.193.58:0/3916371051 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f32440b6690 0x7f324414d280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:19.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.892+0000 7f3249dd2640 1 -- 10.20.193.58:0/3916371051 >> 10.20.193.58:0/3916371051 conn(0x7f32440b3c20 msgr2=0x7f324405c750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:19.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.892+0000 7f3249dd2640 1 -- 10.20.193.58:0/3916371051 shutdown_connections 2026-02-23T06:37:19.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:19.892+0000 7f3249dd2640 1 -- 10.20.193.58:0/3916371051 wait complete. 2026-02-23T06:37:19.898 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:37:19.898 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:37:19.898 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:37:19.899 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:37:20.021 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.027+0000 7f97fb22f640 1 -- 10.20.193.58:0/3729675084 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97f415d870 msgr2=0x7f97f40587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:20.021 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.027+0000 7f97fb22f640 1 --2- 10.20.193.58:0/3729675084 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97f415d870 0x7f97f40587b0 secure :-1 s=READY pgs=193 gs=2 cs=0 l=1 c_cookie=10466195510970844687 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97e8005e70 tx=0x7f97e802f290 comp rx=0 tx=0).stop 2026-02-23T06:37:20.021 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.027+0000 7f97fb22f640 1 -- 10.20.193.58:0/3729675084 shutdown_connections 2026-02-23T06:37:20.021 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.027+0000 7f97fb22f640 1 --2- 10.20.193.58:0/3729675084 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97f415d870 0x7f97f40587b0 unknown :-1 s=CLOSED pgs=193 gs=2 cs=0 l=1 c_cookie=10466195510970844687 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:20.021 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.027+0000 7f97fb22f640 1 --2- 10.20.193.58:0/3729675084 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f97f415d4a0 0x7f97f40affb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:20.021 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.027+0000 7f97fb22f640 1 -- 10.20.193.58:0/3729675084 >> 10.20.193.58:0/3729675084 conn(0x7f97f40b3c20 msgr2=0x7f97f40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:20.021 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.027+0000 7f97fb22f640 1 -- 10.20.193.58:0/3729675084 shutdown_connections 2026-02-23T06:37:20.021 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.027+0000 7f97fb22f640 1 -- 10.20.193.58:0/3729675084 wait complete. 2026-02-23T06:37:20.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.028+0000 7f97fb22f640 1 Processor -- start 2026-02-23T06:37:20.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.028+0000 7f97fb22f640 1 -- start start 2026-02-23T06:37:20.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.029+0000 7f97fb22f640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f97f40b6690 0x7f97f41424d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:20.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.029+0000 7f97fb22f640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97f415d4a0 0x7f97f4143ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:20.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.029+0000 7f97fb22f640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f97f415d870 0x7f97f4057750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:20.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.029+0000 7f97fb22f640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f97f4162d70 con 0x7f97f415d4a0 2026-02-23T06:37:20.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.029+0000 7f97fb22f640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f97f4162440 con 0x7f97f40b6690 2026-02-23T06:37:20.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.029+0000 7f97fb22f640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f97f4142a10 con 0x7f97f415d870 2026-02-23T06:37:20.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.029+0000 7f97f9a2c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97f415d4a0 0x7f97f4143ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:20.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.029+0000 7f97f9a2c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97f415d4a0 0x7f97f4143ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:37730/0 (socket says 10.20.193.58:37730) 2026-02-23T06:37:20.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.029+0000 7f97f9a2c640 1 -- 10.20.193.58:0/3339668602 learned_addr learned my addr 10.20.193.58:0/3339668602 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:37:20.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.029+0000 7f97fa22d640 1 --2- 10.20.193.58:0/3339668602 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f97f40b6690 0x7f97f41424d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:20.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.029+0000 7f97faa2e640 1 --2- 10.20.193.58:0/3339668602 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f97f415d870 0x7f97f4057750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:20.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.029+0000 7f97f9a2c640 1 -- 10.20.193.58:0/3339668602 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f97f415d870 msgr2=0x7f97f4057750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:20.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.029+0000 7f97f9a2c640 1 --2- 10.20.193.58:0/3339668602 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f97f415d870 0x7f97f4057750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:20.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.029+0000 7f97f9a2c640 1 -- 10.20.193.58:0/3339668602 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f97f40b6690 msgr2=0x7f97f41424d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:20.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.029+0000 7f97f9a2c640 1 --2- 10.20.193.58:0/3339668602 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f97f40b6690 0x7f97f41424d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:20.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.029+0000 7f97f9a2c640 1 -- 10.20.193.58:0/3339668602 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e8009570 con 0x7f97f415d4a0 2026-02-23T06:37:20.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.030+0000 7f97f9a2c640 1 --2- 10.20.193.58:0/3339668602 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97f415d4a0 0x7f97f4143ca0 secure :-1 s=READY pgs=194 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97e8009a50 tx=0x7f97e80028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:20.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.030+0000 7f97daffd640 1 -- 10.20.193.58:0/3339668602 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97e803d070 con 0x7f97f415d4a0 2026-02-23T06:37:20.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.030+0000 7f97daffd640 1 -- 10.20.193.58:0/3339668602 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97e8038470 con 0x7f97f415d4a0 2026-02-23T06:37:20.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.030+0000 7f97daffd640 1 -- 10.20.193.58:0/3339668602 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97e80388a0 con 0x7f97f415d4a0 2026-02-23T06:37:20.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.030+0000 7f97fb22f640 1 -- 10.20.193.58:0/3339668602 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97f4161250 con 0x7f97f415d4a0 2026-02-23T06:37:20.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.030+0000 7f97fb22f640 1 -- 10.20.193.58:0/3339668602 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97f4161df0 con 0x7f97f415d4a0 2026-02-23T06:37:20.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.030+0000 7f97d8ff9640 1 --2- 10.20.193.58:0/3339668602 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97f41628b0 0x7f97f4141150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:20.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.030+0000 7f97d8ff9640 1 -- 10.20.193.58:0/3339668602 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f97f40b6330 con 0x7f97f41628b0 2026-02-23T06:37:20.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.031+0000 7f97fa22d640 1 --2- 10.20.193.58:0/3339668602 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97f41628b0 0x7f97f4141150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:20.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.031+0000 7f97fa22d640 1 -- 10.20.193.58:0/3339668602 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f97f40b5e10 con 0x7f97f41628b0 2026-02-23T06:37:20.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.031+0000 7f97fa22d640 1 --2- 10.20.193.58:0/3339668602 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97f41628b0 0x7f97f4141150 secure :-1 s=READY pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97e4002fc0 tx=0x7f97e4009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:20.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.031+0000 7f97daffd640 1 -- 10.20.193.58:0/3339668602 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97e4011030 con 0x7f97f41628b0 2026-02-23T06:37:20.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.031+0000 7f97daffd640 1 -- 10.20.193.58:0/3339668602 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f97e4011190 con 0x7f97f41628b0 2026-02-23T06:37:20.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.031+0000 7f97daffd640 1 -- 10.20.193.58:0/3339668602 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97f41628b0 msgr2=0x7f97f4141150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:20.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.031+0000 7f97daffd640 1 --2- 10.20.193.58:0/3339668602 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97f41628b0 0x7f97f4141150 secure :-1 s=READY pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97e4002fc0 tx=0x7f97e4009ae0 comp rx=0 tx=0).stop 2026-02-23T06:37:20.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.031+0000 7f97daffd640 1 -- 10.20.193.58:0/3339668602 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97f41628b0 msgr2=0x7f97f4141150 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:37:20.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.031+0000 7f97daffd640 1 --2- 10.20.193.58:0/3339668602 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97f41628b0 0x7f97f4141150 unknown :-1 s=CLOSED pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:20.027 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.032+0000 7f97daffd640 1 -- 10.20.193.58:0/3339668602 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f97e8038a00 con 0x7f97f415d4a0 2026-02-23T06:37:20.027 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.033+0000 7f97daffd640 1 --2- 10.20.193.58:0/3339668602 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f97c407a410 0x7f97c409a8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:20.027 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.033+0000 7f97daffd640 1 -- 10.20.193.58:0/3339668602 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f97e80c20e0 con 0x7f97f415d4a0 2026-02-23T06:37:20.027 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.033+0000 7f97fa22d640 1 --2- 10.20.193.58:0/3339668602 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f97c407a410 0x7f97c409a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:20.027 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.034+0000 7f97fa22d640 1 --2- 10.20.193.58:0/3339668602 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f97c407a410 0x7f97c409a8c0 secure :-1 s=READY pgs=373 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97e4011000 tx=0x7f97e401d040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:20.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.035+0000 7f97d8ff9640 1 --2- 10.20.193.58:0/3339668602 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97f4140b50 0x7f97f4158f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:20.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.035+0000 7f97d8ff9640 1 -- 10.20.193.58:0/3339668602 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f97f4140f20 con 0x7f97f4140b50 2026-02-23T06:37:20.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.035+0000 7f97faa2e640 1 --2- 10.20.193.58:0/3339668602 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97f4140b50 0x7f97f4158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:20.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.036+0000 7f97faa2e640 1 -- 10.20.193.58:0/3339668602 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f97f40b6d50 con 0x7f97f4140b50 2026-02-23T06:37:20.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.036+0000 7f97faa2e640 1 --2- 10.20.193.58:0/3339668602 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97f4140b50 0x7f97f4158f60 secure :-1 s=READY pgs=196 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97f0003810 tx=0x7f97f000fba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:20.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.036+0000 7f97daffd640 1 -- 10.20.193.58:0/3339668602 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97f0018070 con 0x7f97f4140b50 2026-02-23T06:37:20.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.036+0000 7f97daffd640 1 -- 10.20.193.58:0/3339668602 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5559 (secure 0 0 0) 0x7f97f0003cc0 con 0x7f97f4140b50 2026-02-23T06:37:20.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.036+0000 7f97daffd640 1 -- 10.20.193.58:0/3339668602 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97f4140b50 msgr2=0x7f97f4158f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:20.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.036+0000 7f97daffd640 1 --2- 10.20.193.58:0/3339668602 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97f4140b50 0x7f97f4158f60 secure :-1 s=READY pgs=196 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97f0003810 tx=0x7f97f000fba0 comp rx=0 tx=0).stop 2026-02-23T06:37:20.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.036+0000 7f97daffd640 1 -- 10.20.193.58:0/3339668602 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97f4140b50 msgr2=0x7f97f4158f60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:37:20.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.036+0000 7f97daffd640 1 --2- 10.20.193.58:0/3339668602 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97f4140b50 0x7f97f4158f60 unknown :-1 s=CLOSED pgs=196 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:20.030 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:37:20.030 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:37:20.030 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:37:20.030 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:37:20.030 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 136, 2026-02-23T06:37:20.030 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 247547, 2026-02-23T06:37:20.030 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:37:20.030 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:37:20.030 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:37:20.030 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:37:20.030 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:20.030 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:20.031 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:20.032 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:20.032 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:20.032 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:20.032 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:20.032 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.032 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:37:20.032 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:37:20.032 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:37:20.032 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:37:20.032 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:37:20.032 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:37:20.032 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:37:20.032 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:37:20.032 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:37:20.032 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:37:20.032 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:37:20.032 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:37:20.032 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:37:20.032 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:37:20.032 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:37:20.032 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:37:20.032 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:37:20.032 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:20.032 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:20.032 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:20.032 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:20.032 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:20.032 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:37:20.033 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.034 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:37:20.035 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:20.036 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:20.037 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:37:20.037 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:20.037 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:20.037 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.037 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:37:20.037 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:37:20.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.036+0000 7f97d8ff9640 1 -- 10.20.193.58:0/3339668602 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f97c407a410 msgr2=0x7f97c409a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:20.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.036+0000 7f97d8ff9640 1 --2- 10.20.193.58:0/3339668602 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f97c407a410 0x7f97c409a8c0 secure :-1 s=READY pgs=373 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97e4011000 tx=0x7f97e401d040 comp rx=0 tx=0).stop 2026-02-23T06:37:20.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.036+0000 7f97d8ff9640 1 -- 10.20.193.58:0/3339668602 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97f415d4a0 msgr2=0x7f97f4143ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:20.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.036+0000 7f97d8ff9640 1 --2- 10.20.193.58:0/3339668602 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f97f415d4a0 0x7f97f4143ca0 secure :-1 s=READY pgs=194 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97e8009a50 tx=0x7f97e80028d0 comp rx=0 tx=0).stop 2026-02-23T06:37:20.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.036+0000 7f97faa2e640 1 -- 10.20.193.58:0/3339668602 reap_dead start 2026-02-23T06:37:20.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.036+0000 7f97faa2e640 1 -- 10.20.193.58:0/3339668602 reap_dead start 2026-02-23T06:37:20.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.036+0000 7f97d8ff9640 1 -- 10.20.193.58:0/3339668602 shutdown_connections 2026-02-23T06:37:20.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.036+0000 7f97d8ff9640 1 -- 10.20.193.58:0/3339668602 >> 10.20.193.58:0/3339668602 conn(0x7f97f40b3c20 msgr2=0x7f97f40585b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:20.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.036+0000 7f97d8ff9640 1 -- 10.20.193.58:0/3339668602 shutdown_connections 2026-02-23T06:37:20.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.037+0000 7f97d8ff9640 1 -- 10.20.193.58:0/3339668602 wait complete. 2026-02-23T06:37:20.038 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:37:20.038 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:37:20.038 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:37:20.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.172+0000 7f9551d74640 1 -- 10.20.193.58:0/1943862184 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f95480044a0 con 0x7f955415c040 2026-02-23T06:37:20.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.172+0000 7f955885a640 1 -- 10.20.193.58:0/1943862184 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f955415c040 msgr2=0x7f955405b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:20.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.172+0000 7f955885a640 1 --2- 10.20.193.58:0/1943862184 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f955415c040 0x7f955405b0e0 secure :-1 s=READY pgs=11 gs=1 cs=0 l=1 c_cookie=18254820579518155486 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f955405df80 tx=0x7f954802f280 comp rx=0 tx=0).stop 2026-02-23T06:37:20.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.172+0000 7f955885a640 1 -- 10.20.193.58:0/1943862184 shutdown_connections 2026-02-23T06:37:20.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.172+0000 7f955885a640 1 --2- 10.20.193.58:0/1943862184 >> v2:10.20.193.93:3300/0 conn(0x7f955405d370 0x7f95540b5680 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:20.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.172+0000 7f955885a640 1 --2- 10.20.193.58:0/1943862184 >> v2:10.20.193.58:3300/0 conn(0x7f9554056550 0x7f955405ce30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:20.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.172+0000 7f955885a640 1 --2- 10.20.193.58:0/1943862184 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f955415c040 0x7f955405b0e0 unknown :-1 s=CLOSED pgs=11 gs=1 cs=0 l=1 c_cookie=18254820579518155486 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:20.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.172+0000 7f955885a640 1 -- 10.20.193.58:0/1943862184 >> 10.20.193.58:0/1943862184 conn(0x7f95540b3c20 msgr2=0x7f95540b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:20.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.173+0000 7f955885a640 1 -- 10.20.193.58:0/1943862184 shutdown_connections 2026-02-23T06:37:20.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.173+0000 7f955885a640 1 -- 10.20.193.58:0/1943862184 wait complete. 2026-02-23T06:37:20.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.174+0000 7f955885a640 1 Processor -- start 2026-02-23T06:37:20.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.174+0000 7f955885a640 1 -- start start 2026-02-23T06:37:20.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.174+0000 7f955885a640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9554056550 0x7f9554058810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:20.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.174+0000 7f955885a640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f955405d370 0x7f955415df10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:20.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.174+0000 7f955885a640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f955415c040 0x7f9554161fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:20.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.174+0000 7f955885a640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f95541557f0 con 0x7f955415c040 2026-02-23T06:37:20.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.174+0000 7f955885a640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f95541fd750 con 0x7f955405d370 2026-02-23T06:37:20.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.174+0000 7f955885a640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f9554155550 con 0x7f9554056550 2026-02-23T06:37:20.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.175+0000 7f9553577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f955415c040 0x7f9554161fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:20.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.175+0000 7f9552d76640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9554056550 0x7f9554058810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:20.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.175+0000 7f9552d76640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9554056550 0x7f9554058810 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:58598/0 (socket says 10.20.193.58:58598) 2026-02-23T06:37:20.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.175+0000 7f9552d76640 1 -- 10.20.193.58:0/618491919 learned_addr learned my addr 10.20.193.58:0/618491919 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:37:20.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.175+0000 7f9552575640 1 --2- 10.20.193.58:0/618491919 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f955405d370 0x7f955415df10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:20.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.175+0000 7f9552d76640 1 -- 10.20.193.58:0/618491919 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f955405d370 msgr2=0x7f955415df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:20.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.175+0000 7f9552d76640 1 --2- 10.20.193.58:0/618491919 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f955405d370 0x7f955415df10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:20.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.175+0000 7f9552d76640 1 -- 10.20.193.58:0/618491919 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f955415c040 msgr2=0x7f9554161fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:20.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.175+0000 7f9552d76640 1 --2- 10.20.193.58:0/618491919 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f955415c040 0x7f9554161fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:20.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.175+0000 7f9552d76640 1 -- 10.20.193.58:0/618491919 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9548009570 con 0x7f9554056550 2026-02-23T06:37:20.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.175+0000 7f9552d76640 1 --2- 10.20.193.58:0/618491919 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9554056550 0x7f9554058810 secure :-1 s=READY pgs=12 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95480098a0 tx=0x7f9548002950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:20.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.175+0000 7f95337fe640 1 -- 10.20.193.58:0/618491919 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f954803d070 con 0x7f9554056550 2026-02-23T06:37:20.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.175+0000 7f955885a640 1 -- 10.20.193.58:0/618491919 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f955415dcb0 con 0x7f9554056550 2026-02-23T06:37:20.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.175+0000 7f955885a640 1 -- 10.20.193.58:0/618491919 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9554201ac0 con 0x7f9554056550 2026-02-23T06:37:20.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.176+0000 7f95337fe640 1 -- 10.20.193.58:0/618491919 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9548038470 con 0x7f9554056550 2026-02-23T06:37:20.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.176+0000 7f95337fe640 1 -- 10.20.193.58:0/618491919 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9548038880 con 0x7f9554056550 2026-02-23T06:37:20.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.176+0000 7f955885a640 1 --2- 10.20.193.58:0/618491919 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f955415e450 0x7f955415eed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:20.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.176+0000 7f955885a640 1 -- 10.20.193.58:0/618491919 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f955405b620 con 0x7f955415e450 2026-02-23T06:37:20.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.176+0000 7f9552575640 1 --2- 10.20.193.58:0/618491919 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f955415e450 0x7f955415eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:20.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.177+0000 7f9552575640 1 -- 10.20.193.58:0/618491919 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f955405d9c0 con 0x7f955415e450 2026-02-23T06:37:20.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.177+0000 7f9552575640 1 --2- 10.20.193.58:0/618491919 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f955415e450 0x7f955415eed0 secure :-1 s=READY pgs=83 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95540392c0 tx=0x7f953c010e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:20.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.177+0000 7f95337fe640 1 -- 10.20.193.58:0/618491919 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f953c004500 con 0x7f955415e450 2026-02-23T06:37:20.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.177+0000 7f95337fe640 1 -- 10.20.193.58:0/618491919 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f95480389e0 con 0x7f9554056550 2026-02-23T06:37:20.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.178+0000 7f95337fe640 1 --2- 10.20.193.58:0/618491919 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f952007a660 0x7f952009ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:20.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.178+0000 7f95337fe640 1 -- 10.20.193.58:0/618491919 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f95480c2230 con 0x7f9554056550 2026-02-23T06:37:20.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.178+0000 7f95337fe640 1 -- 10.20.193.58:0/618491919 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f953c00e970 con 0x7f955415e450 2026-02-23T06:37:20.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.178+0000 7f95337fe640 1 -- 10.20.193.58:0/618491919 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f955415e450 msgr2=0x7f955415eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:20.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.178+0000 7f95337fe640 1 --2- 10.20.193.58:0/618491919 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f955415e450 0x7f955415eed0 secure :-1 s=READY pgs=83 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95540392c0 tx=0x7f953c010e10 comp rx=0 tx=0).stop 2026-02-23T06:37:20.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.178+0000 7f95337fe640 1 -- 10.20.193.58:0/618491919 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f955415e450 msgr2=0x7f955415eed0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:37:20.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.178+0000 7f95337fe640 1 --2- 10.20.193.58:0/618491919 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f955415e450 0x7f955415eed0 secure :-1 s=CLOSED pgs=83 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95540392c0 tx=0x7f953c010e10 comp rx=0 tx=0).stop 2026-02-23T06:37:20.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.178+0000 7f9553577640 1 --2- 10.20.193.58:0/618491919 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f952007a660 0x7f952009ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:20.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.179+0000 7f9553577640 1 --2- 10.20.193.58:0/618491919 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f952007a660 0x7f952009ab10 secure :-1 s=READY pgs=374 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9544005820 tx=0x7f954400a310 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:20.175 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.182+0000 7f955885a640 1 --2- 10.20.193.58:0/618491919 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9554162510 0x7f95541fdb80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:20.175 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.182+0000 7f955885a640 1 -- 10.20.193.58:0/618491919 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f955405ce30 con 0x7f9554162510 2026-02-23T06:37:20.176 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.182+0000 7f9552575640 1 --2- 10.20.193.58:0/618491919 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9554162510 0x7f95541fdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:20.176 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.182+0000 7f9552575640 1 -- 10.20.193.58:0/618491919 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9554056330 con 0x7f9554162510 2026-02-23T06:37:20.176 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.183+0000 7f9552575640 1 --2- 10.20.193.58:0/618491919 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9554162510 0x7f95541fdb80 secure :-1 s=READY pgs=84 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9554038c20 tx=0x7f953c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:20.177 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.183+0000 7f95337fe640 1 -- 10.20.193.58:0/618491919 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f953c01f8c0 con 0x7f9554162510 2026-02-23T06:37:20.177 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.183+0000 7f95337fe640 1 -- 10.20.193.58:0/618491919 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5414 (secure 0 0 0) 0x7f953c004850 con 0x7f9554162510 2026-02-23T06:37:20.177 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.183+0000 7f95337fe640 1 -- 10.20.193.58:0/618491919 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9554162510 msgr2=0x7f95541fdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:20.177 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:37:20.177 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:37:20.177 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:37:20.177 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:37:20.177 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 136, 2026-02-23T06:37:20.177 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 152766, 2026-02-23T06:37:20.177 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:37:20.177 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:37:20.177 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:37:20.177 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:37:20.177 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:37:20.178 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:20.179 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:20.180 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:37:20.181 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.182 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:20.182 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:20.182 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:37:20.182 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:20.182 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:20.182 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:37:20.182 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.182 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:20.182 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:20.182 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:37:20.182 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:20.182 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:20.182 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:37:20.182 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.182 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:20.182 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:20.182 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:37:20.182 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:20.182 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:20.182 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:37:20.182 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.182 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:20.183 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:20.183 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:37:20.183 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:20.183 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:20.183 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.183 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:37:20.183 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:37:20.183 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.183+0000 7f95337fe640 1 --2- 10.20.193.58:0/618491919 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9554162510 0x7f95541fdb80 secure :-1 s=READY pgs=84 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9554038c20 tx=0x7f953c004770 comp rx=0 tx=0).stop 2026-02-23T06:37:20.183 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.183+0000 7f95337fe640 1 -- 10.20.193.58:0/618491919 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9554162510 msgr2=0x7f95541fdb80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:37:20.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.183+0000 7f95337fe640 1 --2- 10.20.193.58:0/618491919 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9554162510 0x7f95541fdb80 unknown :-1 s=CLOSED pgs=84 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:20.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.184+0000 7f955885a640 1 -- 10.20.193.58:0/618491919 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f952007a660 msgr2=0x7f952009ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:20.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.184+0000 7f955885a640 1 --2- 10.20.193.58:0/618491919 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f952007a660 0x7f952009ab10 secure :-1 s=READY pgs=374 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9544005820 tx=0x7f954400a310 comp rx=0 tx=0).stop 2026-02-23T06:37:20.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.184+0000 7f955885a640 1 -- 10.20.193.58:0/618491919 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9554056550 msgr2=0x7f9554058810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:20.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.184+0000 7f955885a640 1 --2- 10.20.193.58:0/618491919 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9554056550 0x7f9554058810 secure :-1 s=READY pgs=12 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95480098a0 tx=0x7f9548002950 comp rx=0 tx=0).stop 2026-02-23T06:37:20.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.184+0000 7f9553577640 1 -- 10.20.193.58:0/618491919 reap_dead start 2026-02-23T06:37:20.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.184+0000 7f9553577640 1 -- 10.20.193.58:0/618491919 reap_dead start 2026-02-23T06:37:20.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.184+0000 7f955885a640 1 -- 10.20.193.58:0/618491919 shutdown_connections 2026-02-23T06:37:20.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.184+0000 7f955885a640 1 -- 10.20.193.58:0/618491919 >> 10.20.193.58:0/618491919 conn(0x7f95540b3c20 msgr2=0x7f955415a220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:20.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.184+0000 7f955885a640 1 -- 10.20.193.58:0/618491919 shutdown_connections 2026-02-23T06:37:20.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.184+0000 7f955885a640 1 -- 10.20.193.58:0/618491919 wait complete. 2026-02-23T06:37:20.184 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:37:20.184 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:37:20.184 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:37:20.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.334+0000 7f68a5a83640 1 -- 10.20.193.58:0/2644059339 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f688c004100 msgr2=0x7f688c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:20.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.334+0000 7f68a5a83640 1 --2- 10.20.193.58:0/2644059339 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f688c004100 0x7f688c004850 secure :-1 s=READY pgs=198 gs=4 cs=0 l=1 c_cookie=15817234530364850507 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6888004740 tx=0x7f688802f6d0 comp rx=0 tx=0).stop 2026-02-23T06:37:20.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.334+0000 7f68a5282640 1 -- 10.20.193.58:0/2644059339 reap_dead start 2026-02-23T06:37:20.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.334+0000 7f68a5a83640 1 -- 10.20.193.58:0/2644059339 shutdown_connections 2026-02-23T06:37:20.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.334+0000 7f68a5a83640 1 -- 10.20.193.58:0/2644059339 >> 10.20.193.58:0/2644059339 conn(0x7f68a00b3c20 msgr2=0x7f68a00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:20.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.334+0000 7f68a5a83640 1 -- 10.20.193.58:0/2644059339 shutdown_connections 2026-02-23T06:37:20.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.334+0000 7f68a5a83640 1 -- 10.20.193.58:0/2644059339 wait complete. 2026-02-23T06:37:20.329 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.335+0000 7f68a5a83640 1 Processor -- start 2026-02-23T06:37:20.329 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.335+0000 7f68a5a83640 1 -- start start 2026-02-23T06:37:20.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.336+0000 7f68a5a83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f68a012cbe0 0x7f68a012a410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:20.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.336+0000 7f68a5a83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f68a00ae570 0x7f68a0140640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:20.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.336+0000 7f68a5a83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f68a0140b80 0x7f68a012b010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:20.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.336+0000 7f68a5a83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f68a01425e0 con 0x7f68a0140b80 2026-02-23T06:37:20.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.336+0000 7f68a5a83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f68a012a950 con 0x7f68a00ae570 2026-02-23T06:37:20.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.336+0000 7f68a5a83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f68a01420b0 con 0x7f68a012cbe0 2026-02-23T06:37:20.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.336+0000 7f68a4a81640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f68a012cbe0 0x7f68a012a410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:20.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.336+0000 7f68a4a81640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f68a012cbe0 0x7f68a012a410 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:58604/0 (socket says 10.20.193.58:58604) 2026-02-23T06:37:20.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.336+0000 7f68a4a81640 1 -- 10.20.193.58:0/888632507 learned_addr learned my addr 10.20.193.58:0/888632507 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:37:20.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.336+0000 7f6897fff640 1 --2- 10.20.193.58:0/888632507 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f68a00ae570 0x7f68a0140640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:20.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.336+0000 7f68a5282640 1 --2- 10.20.193.58:0/888632507 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f68a0140b80 0x7f68a012b010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:20.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.337+0000 7f6897fff640 1 -- 10.20.193.58:0/888632507 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f68a012cbe0 msgr2=0x7f68a012a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:20.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.337+0000 7f6897fff640 1 --2- 10.20.193.58:0/888632507 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f68a012cbe0 0x7f68a012a410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:20.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.337+0000 7f6897fff640 1 -- 10.20.193.58:0/888632507 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f68a0140b80 msgr2=0x7f68a012b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:20.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.337+0000 7f6897fff640 1 --2- 10.20.193.58:0/888632507 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f68a0140b80 0x7f68a012b010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:20.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.337+0000 7f6897fff640 1 -- 10.20.193.58:0/888632507 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a012dd80 con 0x7f68a00ae570 2026-02-23T06:37:20.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.337+0000 7f6897fff640 1 --2- 10.20.193.58:0/888632507 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f68a00ae570 0x7f68a0140640 secure :-1 s=READY pgs=86 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f688c065bd0 tx=0x7f68880038e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:20.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.337+0000 7f68957fa640 1 -- 10.20.193.58:0/888632507 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6888003f00 con 0x7f68a00ae570 2026-02-23T06:37:20.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.337+0000 7f68957fa640 1 -- 10.20.193.58:0/888632507 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6888041440 con 0x7f68a00ae570 2026-02-23T06:37:20.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.337+0000 7f68957fa640 1 -- 10.20.193.58:0/888632507 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6888041830 con 0x7f68a00ae570 2026-02-23T06:37:20.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.337+0000 7f68a5a83640 1 -- 10.20.193.58:0/888632507 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68a0142300 con 0x7f68a00ae570 2026-02-23T06:37:20.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.337+0000 7f68a5a83640 1 -- 10.20.193.58:0/888632507 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68a0129650 con 0x7f68a00ae570 2026-02-23T06:37:20.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.338+0000 7f686effd640 1 --2- 10.20.193.58:0/888632507 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f68a0141be0 0x7f68a012b550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:20.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.338+0000 7f686effd640 1 -- 10.20.193.58:0/888632507 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f68a0142490 con 0x7f68a0141be0 2026-02-23T06:37:20.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.338+0000 7f68a4a81640 1 --2- 10.20.193.58:0/888632507 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f68a0141be0 0x7f68a012b550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:20.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.338+0000 7f68a4a81640 1 -- 10.20.193.58:0/888632507 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68a00b5e10 con 0x7f68a0141be0 2026-02-23T06:37:20.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.339+0000 7f68957fa640 1 -- 10.20.193.58:0/888632507 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f6888041990 con 0x7f68a00ae570 2026-02-23T06:37:20.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.339+0000 7f68a4a81640 1 --2- 10.20.193.58:0/888632507 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f68a0141be0 0x7f68a012b550 secure :-1 s=READY pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6890003590 tx=0x7f6890011e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:20.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.340+0000 7f68957fa640 1 --2- 10.20.193.58:0/888632507 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f687007a6b0 0x7f687009ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:20.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.340+0000 7f68957fa640 1 -- 10.20.193.58:0/888632507 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f68880c2b20 con 0x7f68a00ae570 2026-02-23T06:37:20.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.340+0000 7f68957fa640 1 -- 10.20.193.58:0/888632507 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f689000fd70 con 0x7f68a0141be0 2026-02-23T06:37:20.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.340+0000 7f68957fa640 1 -- 10.20.193.58:0/888632507 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f6890016070 con 0x7f68a0141be0 2026-02-23T06:37:20.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.340+0000 7f68957fa640 1 -- 10.20.193.58:0/888632507 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f68a0141be0 msgr2=0x7f68a012b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:20.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.340+0000 7f68957fa640 1 --2- 10.20.193.58:0/888632507 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f68a0141be0 0x7f68a012b550 secure :-1 s=READY pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6890003590 tx=0x7f6890011e10 comp rx=0 tx=0).stop 2026-02-23T06:37:20.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.340+0000 7f68957fa640 1 -- 10.20.193.58:0/888632507 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f68a0141be0 msgr2=0x7f68a012b550 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:37:20.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.340+0000 7f68957fa640 1 --2- 10.20.193.58:0/888632507 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f68a0141be0 0x7f68a012b550 secure :-1 s=CLOSED pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6890003590 tx=0x7f6890011e10 comp rx=0 tx=0).stop 2026-02-23T06:37:20.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.340+0000 7f68a5282640 1 --2- 10.20.193.58:0/888632507 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f687007a6b0 0x7f687009ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:20.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.341+0000 7f68a5282640 1 --2- 10.20.193.58:0/888632507 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f687007a6b0 0x7f687009ab60 secure :-1 s=READY pgs=375 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f689c0034b0 tx=0x7f689c007de0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:20.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.344+0000 7f686effd640 1 --2- 10.20.193.58:0/888632507 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f68a012e9c0 0x7f68a00561f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:20.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.344+0000 7f686effd640 1 -- 10.20.193.58:0/888632507 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f68a00b6330 con 0x7f68a012e9c0 2026-02-23T06:37:20.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.344+0000 7f68a4a81640 1 --2- 10.20.193.58:0/888632507 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f68a012e9c0 0x7f68a00561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:20.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.345+0000 7f68a4a81640 1 -- 10.20.193.58:0/888632507 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f68a0140f50 con 0x7f68a012e9c0 2026-02-23T06:37:20.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.345+0000 7f68a4a81640 1 --2- 10.20.193.58:0/888632507 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f68a012e9c0 0x7f68a00561f0 secure :-1 s=READY pgs=14 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6890003590 tx=0x7f68a00af960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:20.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.345+0000 7f68957fa640 1 -- 10.20.193.58:0/888632507 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68900039b0 con 0x7f68a012e9c0 2026-02-23T06:37:20.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.346+0000 7f68957fa640 1 -- 10.20.193.58:0/888632507 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4912 (secure 0 0 0) 0x7f6890003b10 con 0x7f68a012e9c0 2026-02-23T06:37:20.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.346+0000 7f68957fa640 1 -- 10.20.193.58:0/888632507 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f68a012e9c0 msgr2=0x7f68a00561f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:20.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.346+0000 7f68957fa640 1 --2- 10.20.193.58:0/888632507 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f68a012e9c0 0x7f68a00561f0 secure :-1 s=READY pgs=14 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6890003590 tx=0x7f68a00af960 comp rx=0 tx=0).stop 2026-02-23T06:37:20.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.346+0000 7f68957fa640 1 -- 10.20.193.58:0/888632507 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f68a012e9c0 msgr2=0x7f68a00561f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:37:20.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.346+0000 7f68957fa640 1 --2- 10.20.193.58:0/888632507 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f68a012e9c0 0x7f68a00561f0 secure :-1 s=CLOSED pgs=14 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6890003590 tx=0x7f68a00af960 comp rx=0 tx=0).stop 2026-02-23T06:37:20.341 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:37:20.341 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:37:20.341 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:37:20.341 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:37:20.341 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 136, 2026-02-23T06:37:20.341 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 26824, 2026-02-23T06:37:20.341 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:37:20.341 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:37:20.341 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:37:20.341 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:37:20.341 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:20.342 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:37:20.342 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:37:20.342 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:37:20.342 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:37:20.342 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:20.342 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:20.342 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:20.342 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:20.342 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:20.342 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:20.342 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:20.342 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:20.342 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:20.343 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:20.343 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:20.343 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:20.343 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:20.343 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:20.343 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:37:20.343 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:37:20.343 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:20.343 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:20.343 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:20.343 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:20.343 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:20.343 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:20.343 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:20.344 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:20.344 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:20.344 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:20.344 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:20.344 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:20.344 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:20.344 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:20.344 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.344 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:37:20.344 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:37:20.345 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:37:20.345 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:37:20.345 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:37:20.345 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:37:20.345 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:37:20.345 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:37:20.345 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:37:20.345 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:37:20.345 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:37:20.345 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:37:20.345 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:37:20.345 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:37:20.345 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:37:20.346 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:37:20.346 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:37:20.346 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:20.346 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:20.346 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:20.346 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:20.346 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:20.346 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:20.346 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:20.346 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:20.346 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:20.346 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:20.346 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:20.346 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:20.346 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:20.347 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:20.347 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:37:20.347 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.347 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:37:20.347 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.347 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:37:20.347 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:37:20.347 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:20.347 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:20.347 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.347 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:20.347 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:37:20.347 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:20.347 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.347 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.347 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:20.348 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:37:20.348 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:20.348 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:20.348 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:20.348 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.348 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:37:20.348 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:37:20.348 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:20.348 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:20.348 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:37:20.348 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:20.348 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.348 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.348 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:37:20.349 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:37:20.349 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:20.349 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:20.349 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.349 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:20.349 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:37:20.349 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:20.349 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.349 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.349 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:20.349 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:37:20.349 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:20.349 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:20.349 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:20.349 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.349 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:37:20.350 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:37:20.350 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:20.350 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:20.350 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:37:20.350 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:20.350 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.350 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.350 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:37:20.350 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:37:20.350 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:20.350 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:20.350 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.350 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:20.350 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:37:20.350 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:20.350 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.350 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.350 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:20.351 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:37:20.351 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:20.351 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:20.351 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:20.351 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.351 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:37:20.351 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:37:20.351 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:20.351 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:20.351 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:37:20.351 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:20.351 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:20.351 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:20.351 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.351 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:37:20.351 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:37:20.351 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.351 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:20.351 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:20.352 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:37:20.352 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:20.352 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:20.352 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:37:20.352 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:20.352 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:20.352 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:20.352 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:37:20.352 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:20.352 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:20.352 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:20.352 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:37:20.352 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:37:20.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.346+0000 7f686effd640 1 -- 10.20.193.58:0/888632507 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f687007a6b0 msgr2=0x7f687009ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:20.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.346+0000 7f686effd640 1 --2- 10.20.193.58:0/888632507 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f687007a6b0 0x7f687009ab60 secure :-1 s=READY pgs=375 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f689c0034b0 tx=0x7f689c007de0 comp rx=0 tx=0).stop 2026-02-23T06:37:20.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.346+0000 7f686effd640 1 -- 10.20.193.58:0/888632507 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f68a00ae570 msgr2=0x7f68a0140640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:20.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.346+0000 7f686effd640 1 --2- 10.20.193.58:0/888632507 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f68a00ae570 0x7f68a0140640 secure :-1 s=READY pgs=86 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f688c065bd0 tx=0x7f68880038e0 comp rx=0 tx=0).stop 2026-02-23T06:37:20.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.346+0000 7f68a5282640 1 -- 10.20.193.58:0/888632507 reap_dead start 2026-02-23T06:37:20.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.346+0000 7f68a5282640 1 -- 10.20.193.58:0/888632507 reap_dead start 2026-02-23T06:37:20.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.346+0000 7f686effd640 1 -- 10.20.193.58:0/888632507 shutdown_connections 2026-02-23T06:37:20.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.346+0000 7f686effd640 1 -- 10.20.193.58:0/888632507 >> 10.20.193.58:0/888632507 conn(0x7f68a00b3c20 msgr2=0x7f68a00b7480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:20.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.346+0000 7f686effd640 1 -- 10.20.193.58:0/888632507 shutdown_connections 2026-02-23T06:37:20.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.346+0000 7f686effd640 1 -- 10.20.193.58:0/888632507 wait complete. 2026-02-23T06:37:20.354 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:37:20.354 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-23T06:37:20.355 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-23T06:37:20.355 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-23T06:37:20.355 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-23T06:37:20.355 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-23T06:37:20.355 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:37:20.363 INFO:tasks.ceph.mon.c:Stopped 2026-02-23T06:37:20.363 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:37:20.363 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:37:20.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.489+0000 7f375b30b640 1 -- 10.20.193.58:0/1218086771 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f373c003a30 msgr2=0x7f373c003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:20.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.489+0000 7f375b30b640 1 --2- 10.20.193.58:0/1218086771 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f373c003a30 0x7f373c003e40 secure :-1 s=READY pgs=200 gs=4 cs=0 l=1 c_cookie=13914258625766521322 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3744009b40 tx=0x7f374402fc80 comp rx=0 tx=0).stop 2026-02-23T06:37:20.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.489+0000 7f375ab0a640 1 -- 10.20.193.58:0/1218086771 reap_dead start 2026-02-23T06:37:20.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.490+0000 7f375b30b640 1 -- 10.20.193.58:0/1218086771 shutdown_connections 2026-02-23T06:37:20.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.490+0000 7f375b30b640 1 -- 10.20.193.58:0/1218086771 >> 10.20.193.58:0/1218086771 conn(0x7f37540b3c20 msgr2=0x7f37540b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:20.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.490+0000 7f375b30b640 1 -- 10.20.193.58:0/1218086771 shutdown_connections 2026-02-23T06:37:20.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.490+0000 7f375b30b640 1 -- 10.20.193.58:0/1218086771 wait complete. 2026-02-23T06:37:20.487 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.491+0000 7f375b30b640 1 Processor -- start 2026-02-23T06:37:20.487 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.491+0000 7f375b30b640 1 -- start start 2026-02-23T06:37:20.487 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.491+0000 7f375b30b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f37541597c0 0x7f375413c020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:20.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.491+0000 7f375b30b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f375413e550 0x7f375413d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:20.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.491+0000 7f375b30b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f375413eca0 0x7f375413f630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:20.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.491+0000 7f375b30b640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f375413cac0 con 0x7f375413e550 2026-02-23T06:37:20.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.491+0000 7f375b30b640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f375413bb90 con 0x7f375413eca0 2026-02-23T06:37:20.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.491+0000 7f375b30b640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f375413cff0 con 0x7f37541597c0 2026-02-23T06:37:20.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.492+0000 7f3759b08640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f375413e550 0x7f375413d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:20.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.492+0000 7f3759b08640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f375413e550 0x7f375413d260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:37806/0 (socket says 10.20.193.58:37806) 2026-02-23T06:37:20.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.492+0000 7f3759b08640 1 -- 10.20.193.58:0/1136729084 learned_addr learned my addr 10.20.193.58:0/1136729084 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:37:20.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.492+0000 7f375a309640 1 -- 10.20.193.58:0/1136729084 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f37541597c0 msgr2=0x7f375413c020 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:37:20.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.492+0000 7f375ab0a640 1 --2- 10.20.193.58:0/1136729084 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f375413eca0 0x7f375413f630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:20.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.492+0000 7f375a309640 1 --2- 10.20.193.58:0/1136729084 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f37541597c0 0x7f375413c020 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:37:20.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.492+0000 7f3759b08640 1 -- 10.20.193.58:0/1136729084 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f37541597c0 msgr2=0x7f375413c020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:37:20.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.492+0000 7f3759b08640 1 --2- 10.20.193.58:0/1136729084 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f37541597c0 0x7f375413c020 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:20.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.492+0000 7f3759b08640 1 -- 10.20.193.58:0/1136729084 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f375413eca0 msgr2=0x7f375413f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:20.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.492+0000 7f3759b08640 1 --2- 10.20.193.58:0/1136729084 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f375413eca0 0x7f375413f630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:20.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.492+0000 7f3759b08640 1 -- 10.20.193.58:0/1136729084 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3754140540 con 0x7f375413e550 2026-02-23T06:37:20.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.492+0000 7f3759b08640 1 --2- 10.20.193.58:0/1136729084 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f375413e550 0x7f375413d260 secure :-1 s=READY pgs=201 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f374800d7f0 tx=0x7f374800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:20.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.492+0000 7f373affd640 1 -- 10.20.193.58:0/1136729084 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3748005500 con 0x7f375413e550 2026-02-23T06:37:20.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.492+0000 7f375b30b640 1 -- 10.20.193.58:0/1136729084 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f375413cd10 con 0x7f375413e550 2026-02-23T06:37:20.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.492+0000 7f375b30b640 1 -- 10.20.193.58:0/1136729084 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f375413a0c0 con 0x7f375413e550 2026-02-23T06:37:20.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.492+0000 7f373affd640 1 -- 10.20.193.58:0/1136729084 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3748003790 con 0x7f375413e550 2026-02-23T06:37:20.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.492+0000 7f373affd640 1 -- 10.20.193.58:0/1136729084 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3748003ba0 con 0x7f375413e550 2026-02-23T06:37:20.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.493+0000 7f375b30b640 1 -- 10.20.193.58:0/1136729084 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37540b6d50 con 0x7f375413e550 2026-02-23T06:37:20.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.494+0000 7f373affd640 1 -- 10.20.193.58:0/1136729084 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f3748003d00 con 0x7f375413e550 2026-02-23T06:37:20.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.495+0000 7f373affd640 1 --2- 10.20.193.58:0/1136729084 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f372407a5a0 0x7f372409aa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:20.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.495+0000 7f373affd640 1 -- 10.20.193.58:0/1136729084 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f374809d2a0 con 0x7f375413e550 2026-02-23T06:37:20.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.495+0000 7f375a309640 1 --2- 10.20.193.58:0/1136729084 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f372407a5a0 0x7f372409aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:20.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.496+0000 7f375a309640 1 --2- 10.20.193.58:0/1136729084 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f372407a5a0 0x7f372409aa50 secure :-1 s=READY pgs=376 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3744004740 tx=0x7f3744004770 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:20.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.497+0000 7f373affd640 1 -- 10.20.193.58:0/1136729084 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f37480604f0 con 0x7f375413e550 2026-02-23T06:37:20.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.654+0000 7f375b30b640 1 -- 10.20.193.58:0/1136729084 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f375405b0e0 con 0x7f375413e550 2026-02-23T06:37:20.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.654+0000 7f373affd640 1 -- 10.20.193.58:0/1136729084 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f3748063610 con 0x7f375413e550 2026-02-23T06:37:20.649 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":136,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:37:20.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.655+0000 7f375b30b640 1 -- 10.20.193.58:0/1136729084 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f372407a5a0 msgr2=0x7f372409aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:20.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.655+0000 7f375b30b640 1 --2- 10.20.193.58:0/1136729084 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f372407a5a0 0x7f372409aa50 secure :-1 s=READY pgs=376 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3744004740 tx=0x7f3744004770 comp rx=0 tx=0).stop 2026-02-23T06:37:20.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.655+0000 7f375b30b640 1 -- 10.20.193.58:0/1136729084 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f375413e550 msgr2=0x7f375413d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:20.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.655+0000 7f375b30b640 1 --2- 10.20.193.58:0/1136729084 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f375413e550 0x7f375413d260 secure :-1 s=READY pgs=201 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f374800d7f0 tx=0x7f374800dcc0 comp rx=0 tx=0).stop 2026-02-23T06:37:20.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.655+0000 7f375b30b640 1 -- 10.20.193.58:0/1136729084 shutdown_connections 2026-02-23T06:37:20.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.655+0000 7f375b30b640 1 --2- 10.20.193.58:0/1136729084 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f372407a5a0 0x7f372409aa50 unknown :-1 s=CLOSED pgs=376 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:20.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.655+0000 7f375b30b640 1 --2- 10.20.193.58:0/1136729084 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f375413eca0 0x7f375413f630 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:20.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.655+0000 7f375b30b640 1 --2- 10.20.193.58:0/1136729084 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f375413e550 0x7f375413d260 unknown :-1 s=CLOSED pgs=201 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:20.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.655+0000 7f375b30b640 1 --2- 10.20.193.58:0/1136729084 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f37541597c0 0x7f375413c020 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:20.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.655+0000 7f375b30b640 1 -- 10.20.193.58:0/1136729084 >> 10.20.193.58:0/1136729084 conn(0x7f37540b3c20 msgr2=0x7f375415b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:20.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.655+0000 7f375b30b640 1 -- 10.20.193.58:0/1136729084 shutdown_connections 2026-02-23T06:37:20.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:20.655+0000 7f375b30b640 1 -- 10.20.193.58:0/1136729084 wait complete. 2026-02-23T06:37:23.662 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:37:23.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.789+0000 7f595f403640 1 -- 10.20.193.58:0/1689411756 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f59580b6690 msgr2=0x7f5958058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:23.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.789+0000 7f595f403640 1 --2- 10.20.193.58:0/1689411756 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f59580b6690 0x7f5958058cf0 secure :-1 s=READY pgs=207 gs=2 cs=0 l=1 c_cookie=5245044921133831725 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5954006f50 tx=0x7f5954030380 comp rx=0 tx=0).stop 2026-02-23T06:37:23.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.789+0000 7f595f403640 1 -- 10.20.193.58:0/1689411756 shutdown_connections 2026-02-23T06:37:23.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.789+0000 7f595f403640 1 --2- 10.20.193.58:0/1689411756 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f59580b6690 0x7f5958058cf0 unknown :-1 s=CLOSED pgs=207 gs=2 cs=0 l=1 c_cookie=5245044921133831725 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:23.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.789+0000 7f595f403640 1 --2- 10.20.193.58:0/1689411756 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f595815d870 0x7f59580587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:23.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.789+0000 7f595f403640 1 -- 10.20.193.58:0/1689411756 >> 10.20.193.58:0/1689411756 conn(0x7f59580b3c20 msgr2=0x7f59580b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:23.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.789+0000 7f595f403640 1 -- 10.20.193.58:0/1689411756 shutdown_connections 2026-02-23T06:37:23.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.789+0000 7f595f403640 1 -- 10.20.193.58:0/1689411756 wait complete. 2026-02-23T06:37:23.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.790+0000 7f595f403640 1 Processor -- start 2026-02-23T06:37:23.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.790+0000 7f595f403640 1 -- start start 2026-02-23T06:37:23.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.791+0000 7f595f403640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f59580b6690 0x7f59580574e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:23.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.791+0000 7f595f403640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f595815d4a0 0x7f595815fd10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:23.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.791+0000 7f595f403640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f595815d870 0x7f5958160250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:23.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.791+0000 7f595f403640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f595813a240 con 0x7f595815d870 2026-02-23T06:37:23.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.791+0000 7f595f403640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f5958163330 con 0x7f595815d4a0 2026-02-23T06:37:23.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.791+0000 7f595f403640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f5958139ef0 con 0x7f59580b6690 2026-02-23T06:37:23.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.791+0000 7f595e401640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f59580b6690 msgr2=0x7f59580574e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:37:23.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.791+0000 7f595e401640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f59580b6690 0x7f59580574e0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:37:23.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.791+0000 7f595ec02640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f595815d870 0x7f5958160250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:23.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.791+0000 7f595dc00640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f595815d4a0 0x7f595815fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:23.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.791+0000 7f595ec02640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f595815d870 0x7f5958160250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:37824/0 (socket says 10.20.193.58:37824) 2026-02-23T06:37:23.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.791+0000 7f595ec02640 1 -- 10.20.193.58:0/1361466731 learned_addr learned my addr 10.20.193.58:0/1361466731 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:37:23.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.791+0000 7f595ec02640 1 -- 10.20.193.58:0/1361466731 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f59580b6690 msgr2=0x7f59580574e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:37:23.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.791+0000 7f595ec02640 1 --2- 10.20.193.58:0/1361466731 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f59580b6690 0x7f59580574e0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:23.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.791+0000 7f595ec02640 1 -- 10.20.193.58:0/1361466731 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f595815d4a0 msgr2=0x7f595815fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:23.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.791+0000 7f595ec02640 1 --2- 10.20.193.58:0/1361466731 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f595815d4a0 0x7f595815fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:23.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.791+0000 7f595ec02640 1 -- 10.20.193.58:0/1361466731 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595400a650 con 0x7f595815d870 2026-02-23T06:37:23.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.792+0000 7f595ec02640 1 --2- 10.20.193.58:0/1361466731 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f595815d870 0x7f5958160250 secure :-1 s=READY pgs=208 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5954005820 tx=0x7f5954003a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:23.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.792+0000 7f593effd640 1 -- 10.20.193.58:0/1361466731 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5954045070 con 0x7f595815d870 2026-02-23T06:37:23.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.792+0000 7f593effd640 1 -- 10.20.193.58:0/1361466731 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5954005b50 con 0x7f595815d870 2026-02-23T06:37:23.790 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.792+0000 7f593effd640 1 -- 10.20.193.58:0/1361466731 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5954006020 con 0x7f595815d870 2026-02-23T06:37:23.790 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.792+0000 7f595f403640 1 -- 10.20.193.58:0/1361466731 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5958162d00 con 0x7f595815d870 2026-02-23T06:37:23.790 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.792+0000 7f595f403640 1 -- 10.20.193.58:0/1361466731 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5958139c10 con 0x7f595815d870 2026-02-23T06:37:23.790 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.792+0000 7f595f403640 1 -- 10.20.193.58:0/1361466731 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59580b6d50 con 0x7f595815d870 2026-02-23T06:37:23.790 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.794+0000 7f593effd640 1 -- 10.20.193.58:0/1361466731 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f5954006180 con 0x7f595815d870 2026-02-23T06:37:23.791 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.795+0000 7f593effd640 1 --2- 10.20.193.58:0/1361466731 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f592807a5b0 0x7f592809aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:23.791 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.795+0000 7f593effd640 1 -- 10.20.193.58:0/1361466731 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f59540c4760 con 0x7f595815d870 2026-02-23T06:37:23.791 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.795+0000 7f595e401640 1 --2- 10.20.193.58:0/1361466731 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f592807a5b0 0x7f592809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:23.791 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.795+0000 7f593effd640 1 -- 10.20.193.58:0/1361466731 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f5954087a00 con 0x7f595815d870 2026-02-23T06:37:23.796 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.803+0000 7f595e401640 1 --2- 10.20.193.58:0/1361466731 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f592807a5b0 0x7f592809aa60 secure :-1 s=READY pgs=377 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59480037e0 tx=0x7f5948007ad0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:23.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.953+0000 7f595f403640 1 -- 10.20.193.58:0/1361466731 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f59580ae8d0 con 0x7f595815d870 2026-02-23T06:37:23.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.954+0000 7f593effd640 1 -- 10.20.193.58:0/1361466731 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f59580ae8d0 con 0x7f595815d870 2026-02-23T06:37:23.948 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":136,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:37:23.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.956+0000 7f595f403640 1 -- 10.20.193.58:0/1361466731 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f592807a5b0 msgr2=0x7f592809aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:23.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.956+0000 7f595f403640 1 --2- 10.20.193.58:0/1361466731 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f592807a5b0 0x7f592809aa60 secure :-1 s=READY pgs=377 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59480037e0 tx=0x7f5948007ad0 comp rx=0 tx=0).stop 2026-02-23T06:37:23.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.956+0000 7f595f403640 1 -- 10.20.193.58:0/1361466731 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f595815d870 msgr2=0x7f5958160250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:23.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.956+0000 7f595f403640 1 --2- 10.20.193.58:0/1361466731 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f595815d870 0x7f5958160250 secure :-1 s=READY pgs=208 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5954005820 tx=0x7f5954003a20 comp rx=0 tx=0).stop 2026-02-23T06:37:23.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.956+0000 7f595f403640 1 -- 10.20.193.58:0/1361466731 shutdown_connections 2026-02-23T06:37:23.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.956+0000 7f595f403640 1 --2- 10.20.193.58:0/1361466731 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f592807a5b0 0x7f592809aa60 unknown :-1 s=CLOSED pgs=377 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:23.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.956+0000 7f595f403640 1 --2- 10.20.193.58:0/1361466731 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f595815d870 0x7f5958160250 unknown :-1 s=CLOSED pgs=208 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:23.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.956+0000 7f595f403640 1 --2- 10.20.193.58:0/1361466731 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f595815d4a0 0x7f595815fd10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:23.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.956+0000 7f595f403640 1 --2- 10.20.193.58:0/1361466731 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f59580b6690 0x7f59580574e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:23.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.956+0000 7f595f403640 1 -- 10.20.193.58:0/1361466731 >> 10.20.193.58:0/1361466731 conn(0x7f59580b3c20 msgr2=0x7f59581635a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:23.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.956+0000 7f595f403640 1 -- 10.20.193.58:0/1361466731 shutdown_connections 2026-02-23T06:37:23.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:23.956+0000 7f595f403640 1 -- 10.20.193.58:0/1361466731 wait complete. 2026-02-23T06:37:26.964 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:37:27.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.093+0000 7fae057d2640 1 -- 10.20.193.58:0/2739243066 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fae0015d870 msgr2=0x7fae000587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:27.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.093+0000 7fae057d2640 1 --2- 10.20.193.58:0/2739243066 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fae0015d870 0x7fae000587b0 secure :-1 s=READY pgs=210 gs=2 cs=0 l=1 c_cookie=2242362042187735311 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fadf0005e70 tx=0x7fadf002f2b0 comp rx=0 tx=0).stop 2026-02-23T06:37:27.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.093+0000 7fae057d2640 1 -- 10.20.193.58:0/2739243066 shutdown_connections 2026-02-23T06:37:27.088 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.093+0000 7fae057d2640 1 --2- 10.20.193.58:0/2739243066 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fae0015d870 0x7fae000587b0 unknown :-1 s=CLOSED pgs=210 gs=2 cs=0 l=1 c_cookie=2242362042187735311 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:27.088 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.093+0000 7fae057d2640 1 --2- 10.20.193.58:0/2739243066 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fae0015d4a0 0x7fae000affb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:27.088 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.093+0000 7fae057d2640 1 -- 10.20.193.58:0/2739243066 >> 10.20.193.58:0/2739243066 conn(0x7fae000b3c20 msgr2=0x7fae000b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:27.088 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.093+0000 7fae057d2640 1 -- 10.20.193.58:0/2739243066 shutdown_connections 2026-02-23T06:37:27.088 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.093+0000 7fae057d2640 1 -- 10.20.193.58:0/2739243066 wait complete. 2026-02-23T06:37:27.088 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.094+0000 7fae057d2640 1 Processor -- start 2026-02-23T06:37:27.088 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.094+0000 7fae057d2640 1 -- start start 2026-02-23T06:37:27.089 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.095+0000 7fae057d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fae000b6690 0x7fae00056b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:27.089 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.095+0000 7fae057d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fae0015d4a0 0x7fae00120a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:27.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.095+0000 7fae057d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fae0015d870 0x7fae0013cf10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:27.091 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.095+0000 7fae057d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fae0011e8b0 con 0x7fae0015d4a0 2026-02-23T06:37:27.091 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.095+0000 7fae057d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fae0011dbc0 con 0x7fae000b6690 2026-02-23T06:37:27.091 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.095+0000 7fae057d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fae00122180 con 0x7fae0015d870 2026-02-23T06:37:27.091 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.096+0000 7fadff7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fae0015d4a0 0x7fae00120a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:27.091 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.096+0000 7fadff7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fae0015d4a0 0x7fae00120a00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:37850/0 (socket says 10.20.193.58:37850) 2026-02-23T06:37:27.091 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.096+0000 7fae04fd1640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fae0015d870 msgr2=0x7fae0013cf10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:37:27.091 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.096+0000 7fadff7fe640 1 -- 10.20.193.58:0/2456253411 learned_addr learned my addr 10.20.193.58:0/2456253411 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:37:27.092 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.096+0000 7fae04fd1640 1 --2- 10.20.193.58:0/2456253411 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fae0015d870 0x7fae0013cf10 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:37:27.092 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.096+0000 7fadfffff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fae000b6690 0x7fae00056b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:27.092 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.096+0000 7fadff7fe640 1 -- 10.20.193.58:0/2456253411 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fae0015d870 msgr2=0x7fae0013cf10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:37:27.092 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.096+0000 7fadff7fe640 1 --2- 10.20.193.58:0/2456253411 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fae0015d870 0x7fae0013cf10 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:27.092 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.096+0000 7fadff7fe640 1 -- 10.20.193.58:0/2456253411 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fae000b6690 msgr2=0x7fae00056b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:27.092 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.096+0000 7fadff7fe640 1 --2- 10.20.193.58:0/2456253411 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fae000b6690 0x7fae00056b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:27.092 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.096+0000 7fadff7fe640 1 -- 10.20.193.58:0/2456253411 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf0009570 con 0x7fae0015d4a0 2026-02-23T06:37:27.092 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.096+0000 7fadfffff640 1 --2- 10.20.193.58:0/2456253411 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fae000b6690 0x7fae00056b00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:37:27.092 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.096+0000 7fadff7fe640 1 --2- 10.20.193.58:0/2456253411 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fae0015d4a0 0x7fae00120a00 secure :-1 s=READY pgs=211 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fadf0004740 tx=0x7fadf0002a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:27.092 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.096+0000 7fadfcff9640 1 -- 10.20.193.58:0/2456253411 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fadf003d070 con 0x7fae0015d4a0 2026-02-23T06:37:27.092 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.096+0000 7fadfcff9640 1 -- 10.20.193.58:0/2456253411 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fadf0004a70 con 0x7fae0015d4a0 2026-02-23T06:37:27.092 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.096+0000 7fadfcff9640 1 -- 10.20.193.58:0/2456253411 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fadf0004e40 con 0x7fae0015d4a0 2026-02-23T06:37:27.092 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.096+0000 7fae057d2640 1 -- 10.20.193.58:0/2456253411 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae00122460 con 0x7fae0015d4a0 2026-02-23T06:37:27.092 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.096+0000 7fae057d2640 1 -- 10.20.193.58:0/2456253411 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae0011c2a0 con 0x7fae0015d4a0 2026-02-23T06:37:27.093 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.097+0000 7fae057d2640 1 -- 10.20.193.58:0/2456253411 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae000b6d50 con 0x7fae0015d4a0 2026-02-23T06:37:27.093 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.098+0000 7fadfcff9640 1 -- 10.20.193.58:0/2456253411 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fadf0004fa0 con 0x7fae0015d4a0 2026-02-23T06:37:27.094 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.099+0000 7fadfcff9640 1 --2- 10.20.193.58:0/2456253411 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fadd007a680 0x7fadd009ab30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:27.094 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.099+0000 7fadfcff9640 1 -- 10.20.193.58:0/2456253411 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fadf00c2410 con 0x7fae0015d4a0 2026-02-23T06:37:27.094 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.100+0000 7fadfffff640 1 --2- 10.20.193.58:0/2456253411 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fadd007a680 0x7fadd009ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:27.095 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.101+0000 7fadfffff640 1 --2- 10.20.193.58:0/2456253411 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fadd007a680 0x7fadd009ab30 secure :-1 s=READY pgs=378 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fadec002820 tx=0x7fadec0028a0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:27.095 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.101+0000 7fadfcff9640 1 -- 10.20.193.58:0/2456253411 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fadf0085630 con 0x7fae0015d4a0 2026-02-23T06:37:27.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.256+0000 7fae057d2640 1 -- 10.20.193.58:0/2456253411 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fae0011ea20 con 0x7fae0015d4a0 2026-02-23T06:37:27.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.257+0000 7fadfcff9640 1 -- 10.20.193.58:0/2456253411 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7fadf0093020 con 0x7fae0015d4a0 2026-02-23T06:37:27.251 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":136,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:37:27.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.258+0000 7fae057d2640 1 -- 10.20.193.58:0/2456253411 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fadd007a680 msgr2=0x7fadd009ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:27.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.258+0000 7fae057d2640 1 --2- 10.20.193.58:0/2456253411 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fadd007a680 0x7fadd009ab30 secure :-1 s=READY pgs=378 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fadec002820 tx=0x7fadec0028a0 comp rx=0 tx=0).stop 2026-02-23T06:37:27.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.258+0000 7fae057d2640 1 -- 10.20.193.58:0/2456253411 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fae0015d4a0 msgr2=0x7fae00120a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:27.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.258+0000 7fae057d2640 1 --2- 10.20.193.58:0/2456253411 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fae0015d4a0 0x7fae00120a00 secure :-1 s=READY pgs=211 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fadf0004740 tx=0x7fadf0002a10 comp rx=0 tx=0).stop 2026-02-23T06:37:27.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.259+0000 7fae057d2640 1 -- 10.20.193.58:0/2456253411 shutdown_connections 2026-02-23T06:37:27.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.259+0000 7fae057d2640 1 --2- 10.20.193.58:0/2456253411 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fadd007a680 0x7fadd009ab30 unknown :-1 s=CLOSED pgs=378 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:27.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.259+0000 7fae057d2640 1 --2- 10.20.193.58:0/2456253411 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fae0015d870 0x7fae0013cf10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:27.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.259+0000 7fae057d2640 1 --2- 10.20.193.58:0/2456253411 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fae0015d4a0 0x7fae00120a00 unknown :-1 s=CLOSED pgs=211 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:27.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.259+0000 7fae057d2640 1 --2- 10.20.193.58:0/2456253411 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fae000b6690 0x7fae00056b00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:27.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.259+0000 7fae057d2640 1 -- 10.20.193.58:0/2456253411 >> 10.20.193.58:0/2456253411 conn(0x7fae000b3c20 msgr2=0x7fae000b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:27.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.259+0000 7fae057d2640 1 -- 10.20.193.58:0/2456253411 shutdown_connections 2026-02-23T06:37:27.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:27.259+0000 7fae057d2640 1 -- 10.20.193.58:0/2456253411 wait complete. 2026-02-23T06:37:30.266 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:37:34.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.799+0000 7feea71d2640 1 -- 10.20.193.58:0/4056831993 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fee84024270 msgr2=0x7fee84044700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:34.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.799+0000 7feea71d2640 1 --2- 10.20.193.58:0/4056831993 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fee84024270 0x7fee84044700 secure :-1 s=READY pgs=91 gs=19 cs=0 l=1 c_cookie=7029611889912374940 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee84024240 tx=0x7fee9002f9f0 comp rx=0 tx=0).stop 2026-02-23T06:37:34.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.799+0000 7feea69d1640 1 -- 10.20.193.58:0/4056831993 reap_dead start 2026-02-23T06:37:34.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.799+0000 7feea71d2640 1 -- 10.20.193.58:0/4056831993 shutdown_connections 2026-02-23T06:37:34.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.799+0000 7feea71d2640 1 --2- 10.20.193.58:0/4056831993 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fee84024270 0x7fee84044700 unknown :-1 s=CLOSED pgs=91 gs=19 cs=0 l=1 c_cookie=7029611889912374940 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:34.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.799+0000 7feea71d2640 1 -- 10.20.193.58:0/4056831993 >> 10.20.193.58:0/4056831993 conn(0x7feea0054e40 msgr2=0x7feea0057b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:34.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.800+0000 7feea71d2640 1 -- 10.20.193.58:0/4056831993 shutdown_connections 2026-02-23T06:37:34.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.800+0000 7feea71d2640 1 -- 10.20.193.58:0/4056831993 wait complete. 2026-02-23T06:37:34.796 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.802+0000 7feea71d2640 1 Processor -- start 2026-02-23T06:37:34.796 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.802+0000 7feea71d2640 1 -- start start 2026-02-23T06:37:34.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.803+0000 7feea71d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fee84024270 0x7feea0162560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:34.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.803+0000 7feea71d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feea00b57f0 0x7feea00b2e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:34.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.803+0000 7feea71d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feea013ca20 0x7feea013bc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:34.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.803+0000 7feea71d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7feea015f9a0 con 0x7feea00b57f0 2026-02-23T06:37:34.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.803+0000 7feea71d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7feea0162140 con 0x7fee84024270 2026-02-23T06:37:34.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.803+0000 7feea71d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7feea013add0 con 0x7feea013ca20 2026-02-23T06:37:34.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.803+0000 7feea61d0640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fee84024270 0x7feea0162560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:34.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.804+0000 7feea69d1640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feea013ca20 msgr2=0x7feea013bc50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:37:34.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.804+0000 7feea61d0640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fee84024270 0x7feea0162560 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:49260/0 (socket says 10.20.193.58:49260) 2026-02-23T06:37:34.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.804+0000 7feea61d0640 1 -- 10.20.193.58:0/2398827726 learned_addr learned my addr 10.20.193.58:0/2398827726 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:37:34.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.804+0000 7feea69d1640 1 --2- 10.20.193.58:0/2398827726 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feea013ca20 0x7feea013bc50 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:37:34.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.804+0000 7feea61d0640 1 -- 10.20.193.58:0/2398827726 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feea013ca20 msgr2=0x7feea013bc50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:37:34.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.804+0000 7feea61d0640 1 --2- 10.20.193.58:0/2398827726 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feea013ca20 0x7feea013bc50 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:34.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.804+0000 7feea61d0640 1 -- 10.20.193.58:0/2398827726 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feea00b57f0 msgr2=0x7feea00b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:34.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.804+0000 7feea61d0640 1 --2- 10.20.193.58:0/2398827726 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feea00b57f0 0x7feea00b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:34.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.804+0000 7feea61d0640 1 -- 10.20.193.58:0/2398827726 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee90009150 con 0x7fee84024270 2026-02-23T06:37:34.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.804+0000 7feea61d0640 1 --2- 10.20.193.58:0/2398827726 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fee84024270 0x7feea0162560 secure :-1 s=READY pgs=92 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee94011720 tx=0x7fee94011bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:34.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.805+0000 7fee8effd640 1 -- 10.20.193.58:0/2398827726 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee94002e60 con 0x7fee84024270 2026-02-23T06:37:34.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.805+0000 7fee8effd640 1 -- 10.20.193.58:0/2398827726 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee9400f930 con 0x7fee84024270 2026-02-23T06:37:34.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.805+0000 7fee8effd640 1 -- 10.20.193.58:0/2398827726 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee9400fd60 con 0x7fee84024270 2026-02-23T06:37:34.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.805+0000 7feea71d2640 1 -- 10.20.193.58:0/2398827726 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feea0161df0 con 0x7fee84024270 2026-02-23T06:37:34.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.805+0000 7feea71d2640 1 -- 10.20.193.58:0/2398827726 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feea013b000 con 0x7fee84024270 2026-02-23T06:37:34.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.807+0000 7feea71d2640 1 -- 10.20.193.58:0/2398827726 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feea00bcc10 con 0x7fee84024270 2026-02-23T06:37:34.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.807+0000 7fee8effd640 1 -- 10.20.193.58:0/2398827726 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fee94004110 con 0x7fee84024270 2026-02-23T06:37:34.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.808+0000 7fee8effd640 1 --2- 10.20.193.58:0/2398827726 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fee7807a5a0 0x7fee7809aa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:34.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.809+0000 7fee8effd640 1 -- 10.20.193.58:0/2398827726 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fee9409e670 con 0x7fee84024270 2026-02-23T06:37:34.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.809+0000 7feea59cf640 1 --2- 10.20.193.58:0/2398827726 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fee7807a5a0 0x7fee7809aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:34.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.809+0000 7feea59cf640 1 --2- 10.20.193.58:0/2398827726 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fee7807a5a0 0x7fee7809aa50 secure :-1 s=READY pgs=379 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee900023d0 tx=0x7fee90009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:34.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.811+0000 7fee8effd640 1 -- 10.20.193.58:0/2398827726 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fee940617c0 con 0x7fee84024270 2026-02-23T06:37:34.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.982+0000 7feea71d2640 1 -- 10.20.193.58:0/2398827726 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7feea0166bb0 con 0x7fee84024270 2026-02-23T06:37:34.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.983+0000 7fee8effd640 1 -- 10.20.193.58:0/2398827726 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1749 (secure 0 0 0) 0x7fee940648e0 con 0x7fee84024270 2026-02-23T06:37:34.977 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":140,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:37:34.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.985+0000 7feea71d2640 1 -- 10.20.193.58:0/2398827726 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fee7807a5a0 msgr2=0x7fee7809aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:34.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.985+0000 7feea71d2640 1 --2- 10.20.193.58:0/2398827726 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fee7807a5a0 0x7fee7809aa50 secure :-1 s=READY pgs=379 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee900023d0 tx=0x7fee90009040 comp rx=0 tx=0).stop 2026-02-23T06:37:34.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.985+0000 7feea71d2640 1 -- 10.20.193.58:0/2398827726 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fee84024270 msgr2=0x7feea0162560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:34.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.985+0000 7feea71d2640 1 --2- 10.20.193.58:0/2398827726 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fee84024270 0x7feea0162560 secure :-1 s=READY pgs=92 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee94011720 tx=0x7fee94011bf0 comp rx=0 tx=0).stop 2026-02-23T06:37:34.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.985+0000 7feea71d2640 1 -- 10.20.193.58:0/2398827726 shutdown_connections 2026-02-23T06:37:34.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.985+0000 7feea71d2640 1 --2- 10.20.193.58:0/2398827726 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fee7807a5a0 0x7fee7809aa50 unknown :-1 s=CLOSED pgs=379 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:34.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.985+0000 7feea71d2640 1 --2- 10.20.193.58:0/2398827726 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feea013ca20 0x7feea013bc50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:34.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.985+0000 7feea71d2640 1 --2- 10.20.193.58:0/2398827726 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feea00b57f0 0x7feea00b2e00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:34.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.985+0000 7feea71d2640 1 --2- 10.20.193.58:0/2398827726 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fee84024270 0x7feea0162560 unknown :-1 s=CLOSED pgs=92 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:34.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.985+0000 7feea71d2640 1 -- 10.20.193.58:0/2398827726 >> 10.20.193.58:0/2398827726 conn(0x7feea0054e40 msgr2=0x7feea0167f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:34.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.985+0000 7feea71d2640 1 -- 10.20.193.58:0/2398827726 shutdown_connections 2026-02-23T06:37:34.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:34.985+0000 7feea71d2640 1 -- 10.20.193.58:0/2398827726 wait complete. 2026-02-23T06:37:34.994 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:37:34.994 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-23T06:37:34.994 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:37:35.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.131+0000 7fdc5fc1b640 1 -- 10.20.193.58:0/3645752548 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdc580b1170 msgr2=0x7fdc5815ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:35.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.131+0000 7fdc5fc1b640 1 --2- 10.20.193.58:0/3645752548 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdc580b1170 0x7fdc5815ce40 secure :-1 s=READY pgs=215 gs=3 cs=0 l=1 c_cookie=10757587098655682819 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc48005820 tx=0x7fdc48030300 comp rx=0 tx=0).stop 2026-02-23T06:37:35.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.132+0000 7fdc5fc1b640 1 -- 10.20.193.58:0/3645752548 shutdown_connections 2026-02-23T06:37:35.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.132+0000 7fdc5fc1b640 1 --2- 10.20.193.58:0/3645752548 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdc580b1170 0x7fdc5815ce40 unknown :-1 s=CLOSED pgs=215 gs=3 cs=0 l=1 c_cookie=10757587098655682819 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:35.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.132+0000 7fdc5fc1b640 1 -- 10.20.193.58:0/3645752548 >> 10.20.193.58:0/3645752548 conn(0x7fdc58058e50 msgr2=0x7fdc58059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:35.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.132+0000 7fdc5fc1b640 1 -- 10.20.193.58:0/3645752548 shutdown_connections 2026-02-23T06:37:35.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.133+0000 7fdc5fc1b640 1 -- 10.20.193.58:0/3645752548 wait complete. 2026-02-23T06:37:35.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.134+0000 7fdc5fc1b640 1 Processor -- start 2026-02-23T06:37:35.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.134+0000 7fdc5fc1b640 1 -- start start 2026-02-23T06:37:35.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.135+0000 7fdc5fc1b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdc580b1170 0x7fdc5815b6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:35.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.135+0000 7fdc5fc1b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdc580b1540 0x7fdc58132b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:35.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.135+0000 7fdc5fc1b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdc58163820 0x7fdc580b7810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:35.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.136+0000 7fdc5d990640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdc580b1170 0x7fdc5815b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:35.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.136+0000 7fdc5d990640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdc580b1170 0x7fdc5815b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:44448/0 (socket says 10.20.193.58:44448) 2026-02-23T06:37:35.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.136+0000 7fdc5d18f640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdc580b1540 0x7fdc58132b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:35.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.136+0000 7fdc5d18f640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdc580b1540 0x7fdc58132b30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:49272/0 (socket says 10.20.193.58:49272) 2026-02-23T06:37:35.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.136+0000 7fdc5e191640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdc58163820 msgr2=0x7fdc580b7810 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:37:35.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.136+0000 7fdc5e191640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdc58163820 0x7fdc580b7810 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:37:35.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.136+0000 7fdc5fc1b640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5815a970 con 0x7fdc580b1170 2026-02-23T06:37:35.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.136+0000 7fdc5d990640 1 -- 10.20.193.58:0/1664343395 learned_addr learned my addr 10.20.193.58:0/1664343395 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:37:35.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.136+0000 7fdc5fc1b640 1 -- 10.20.193.58:0/1664343395 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fdc581fc190 con 0x7fdc580b1540 2026-02-23T06:37:35.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.136+0000 7fdc5fc1b640 1 -- 10.20.193.58:0/1664343395 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fdc5815ac10 con 0x7fdc58163820 2026-02-23T06:37:35.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.136+0000 7fdc5d990640 1 -- 10.20.193.58:0/1664343395 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdc58163820 msgr2=0x7fdc580b7810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:37:35.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.136+0000 7fdc5d990640 1 --2- 10.20.193.58:0/1664343395 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdc58163820 0x7fdc580b7810 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:35.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.136+0000 7fdc5d990640 1 -- 10.20.193.58:0/1664343395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdc580b1540 msgr2=0x7fdc58132b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:35.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.136+0000 7fdc5d990640 1 --2- 10.20.193.58:0/1664343395 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdc580b1540 0x7fdc58132b30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:35.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.136+0000 7fdc5d990640 1 -- 10.20.193.58:0/1664343395 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc4800a590 con 0x7fdc580b1170 2026-02-23T06:37:35.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.137+0000 7fdc5d990640 1 --2- 10.20.193.58:0/1664343395 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdc580b1170 0x7fdc5815b6f0 secure :-1 s=READY pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc480034b0 tx=0x7fdc48005130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:35.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.137+0000 7fdc467fc640 1 -- 10.20.193.58:0/1664343395 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdc48040a00 con 0x7fdc580b1170 2026-02-23T06:37:35.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.137+0000 7fdc467fc640 1 -- 10.20.193.58:0/1664343395 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc48040c50 con 0x7fdc580b1170 2026-02-23T06:37:35.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.137+0000 7fdc467fc640 1 -- 10.20.193.58:0/1664343395 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdc48039470 con 0x7fdc580b1170 2026-02-23T06:37:35.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.137+0000 7fdc5fc1b640 1 -- 10.20.193.58:0/1664343395 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc5815aef0 con 0x7fdc580b1170 2026-02-23T06:37:35.133 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.137+0000 7fdc5fc1b640 1 -- 10.20.193.58:0/1664343395 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc581fc470 con 0x7fdc580b1170 2026-02-23T06:37:35.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.138+0000 7fdc5fc1b640 1 --2- 10.20.193.58:0/1664343395 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdc58160480 0x7fdc581feae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:35.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.138+0000 7fdc5fc1b640 1 -- 10.20.193.58:0/1664343395 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fdc58166fe0 con 0x7fdc58160480 2026-02-23T06:37:35.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.139+0000 7fdc5d18f640 1 --2- 10.20.193.58:0/1664343395 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdc58160480 0x7fdc581feae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:35.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.139+0000 7fdc467fc640 1 -- 10.20.193.58:0/1664343395 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fdc4804f060 con 0x7fdc580b1170 2026-02-23T06:37:35.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.140+0000 7fdc5d18f640 1 -- 10.20.193.58:0/1664343395 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdc58166d00 con 0x7fdc58160480 2026-02-23T06:37:35.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.140+0000 7fdc5d18f640 1 --2- 10.20.193.58:0/1664343395 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdc58160480 0x7fdc581feae0 secure :-1 s=READY pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc58139140 tx=0x7fdc4c00fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:35.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.140+0000 7fdc467fc640 1 --2- 10.20.193.58:0/1664343395 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdc2c07a680 0x7fdc2c09ab30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:35.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.140+0000 7fdc467fc640 1 -- 10.20.193.58:0/1664343395 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fdc480c7db0 con 0x7fdc580b1170 2026-02-23T06:37:35.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.141+0000 7fdc467fc640 1 -- 10.20.193.58:0/1664343395 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdc4c00dab0 con 0x7fdc58160480 2026-02-23T06:37:35.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.141+0000 7fdc5e191640 1 --2- 10.20.193.58:0/1664343395 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdc2c07a680 0x7fdc2c09ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:35.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.141+0000 7fdc467fc640 1 -- 10.20.193.58:0/1664343395 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fdc4c00fe10 con 0x7fdc58160480 2026-02-23T06:37:35.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.141+0000 7fdc467fc640 1 -- 10.20.193.58:0/1664343395 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdc58160480 msgr2=0x7fdc581feae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:35.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.141+0000 7fdc467fc640 1 --2- 10.20.193.58:0/1664343395 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdc58160480 0x7fdc581feae0 secure :-1 s=READY pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc58139140 tx=0x7fdc4c00fc10 comp rx=0 tx=0).stop 2026-02-23T06:37:35.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.141+0000 7fdc467fc640 1 -- 10.20.193.58:0/1664343395 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdc58160480 msgr2=0x7fdc581feae0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:37:35.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.141+0000 7fdc467fc640 1 --2- 10.20.193.58:0/1664343395 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdc58160480 0x7fdc581feae0 secure :-1 s=CLOSED pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc58139140 tx=0x7fdc4c00fc10 comp rx=0 tx=0).stop 2026-02-23T06:37:35.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.141+0000 7fdc5e191640 1 --2- 10.20.193.58:0/1664343395 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdc2c07a680 0x7fdc2c09ab30 secure :-1 s=READY pgs=380 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc54002390 tx=0x7fdc540079f0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:35.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.144+0000 7fdc5fc1b640 1 --2- 10.20.193.58:0/1664343395 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdc58158fe0 0x7fdc581ff020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:35.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.144+0000 7fdc5fc1b640 1 -- 10.20.193.58:0/1664343395 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fdc581672c0 con 0x7fdc58158fe0 2026-02-23T06:37:35.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.145+0000 7fdc5d18f640 1 --2- 10.20.193.58:0/1664343395 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdc58158fe0 0x7fdc581ff020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:35.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.145+0000 7fdc5d18f640 1 -- 10.20.193.58:0/1664343395 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdc5805b2d0 con 0x7fdc58158fe0 2026-02-23T06:37:35.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.146+0000 7fdc5d18f640 1 --2- 10.20.193.58:0/1664343395 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdc58158fe0 0x7fdc581ff020 secure :-1 s=READY pgs=218 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc58139140 tx=0x7fdc4c0046e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:35.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.147+0000 7fdc467fc640 1 -- 10.20.193.58:0/1664343395 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdc4c014ab0 con 0x7fdc58158fe0 2026-02-23T06:37:35.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.147+0000 7fdc467fc640 1 -- 10.20.193.58:0/1664343395 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5547 (secure 0 0 0) 0x7fdc4c01f890 con 0x7fdc58158fe0 2026-02-23T06:37:35.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.147+0000 7fdc467fc640 1 -- 10.20.193.58:0/1664343395 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdc58158fe0 msgr2=0x7fdc581ff020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:35.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.147+0000 7fdc467fc640 1 --2- 10.20.193.58:0/1664343395 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdc58158fe0 0x7fdc581ff020 secure :-1 s=READY pgs=218 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc58139140 tx=0x7fdc4c0046e0 comp rx=0 tx=0).stop 2026-02-23T06:37:35.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.147+0000 7fdc467fc640 1 -- 10.20.193.58:0/1664343395 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdc58158fe0 msgr2=0x7fdc581ff020 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:37:35.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.147+0000 7fdc467fc640 1 --2- 10.20.193.58:0/1664343395 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdc58158fe0 0x7fdc581ff020 secure :-1 s=CLOSED pgs=218 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc58139140 tx=0x7fdc4c0046e0 comp rx=0 tx=0).stop 2026-02-23T06:37:35.142 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:37:35.142 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:37:35.142 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:37:35.142 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:37:35.142 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 140, 2026-02-23T06:37:35.142 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 262657, 2026-02-23T06:37:35.142 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:37:35.142 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:37:35.142 INFO:teuthology.orchestra.run.trial058.stdout: 1 2026-02-23T06:37:35.143 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:35.143 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:37:35.143 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:37:35.143 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:37:35.143 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:37:35.143 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:35.143 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:35.143 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:35.143 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:35.143 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:35.143 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:35.143 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:35.144 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:35.144 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:35.144 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:35.144 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:35.144 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:35.144 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:35.144 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:35.144 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:37:35.144 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:37:35.144 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:35.144 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:35.144 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:35.145 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:35.145 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:35.145 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:35.145 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:35.145 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:35.145 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:35.145 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:35.145 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:35.145 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:35.145 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:35.145 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:35.145 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:35.146 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:37:35.146 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:37:35.146 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:37:35.146 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:37:35.146 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:37:35.146 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:37:35.146 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:37:35.146 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:37:35.146 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:37:35.146 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:37:35.146 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:37:35.146 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:37:35.147 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:37:35.147 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:37:35.147 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:37:35.147 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:37:35.147 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:37:35.147 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:35.147 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:35.147 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:35.147 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:35.147 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:35.147 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:35.147 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:35.147 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:35.148 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:35.148 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:35.148 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:35.148 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:35.148 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:35.148 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:35.148 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:37:35.148 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:35.148 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:37:35.148 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.148 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:37:35.148 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:37:35.148 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:35.149 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:35.149 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.149 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:35.149 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:37:35.149 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:35.149 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:35.149 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.149 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:35.149 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:37:35.149 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:35.149 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:35.149 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:35.150 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:35.150 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:37:35.150 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:37:35.150 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:35.150 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:35.150 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:37:35.150 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:35.150 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:35.150 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.150 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:37:35.150 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:37:35.150 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:35.151 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:35.151 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.151 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:35.151 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:37:35.151 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:35.151 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:35.151 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.151 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:35.151 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:37:35.151 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:35.151 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:35.151 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:35.151 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:35.151 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:37:35.152 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:37:35.152 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:35.152 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:35.152 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:37:35.152 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:35.152 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:35.152 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.152 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:37:35.152 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:37:35.152 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:35.152 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:35.152 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.152 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:35.153 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:37:35.153 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:35.153 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:35.153 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.153 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:35.153 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:37:35.153 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:35.153 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:35.153 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:35.153 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:35.153 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:37:35.153 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:37:35.154 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:35.154 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:35.154 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:37:35.154 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:35.154 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:35.154 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:35.154 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:35.154 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:37:35.154 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:37:35.154 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.154 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:35.154 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:35.154 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:37:35.155 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:35.155 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:35.155 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:37:35.155 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.155 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:35.155 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:35.155 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:37:35.155 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:35.155 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:35.155 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:37:35.155 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.155 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:35.155 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:35.156 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:37:35.156 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:35.156 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:35.156 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:37:35.156 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.156 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:37:35.156 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:37:35.156 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:37:35.156 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:35.156 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.156 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:35.156 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:35.157 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:37:35.157 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:35.157 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:35.157 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:37:35.157 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.157 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:35.157 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:35.157 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:37:35.157 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:35.157 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:35.157 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:35.157 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:37:35.157 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:37:35.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.148+0000 7fdc5fc1b640 1 -- 10.20.193.58:0/1664343395 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdc2c07a680 msgr2=0x7fdc2c09ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:35.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.148+0000 7fdc5fc1b640 1 --2- 10.20.193.58:0/1664343395 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdc2c07a680 0x7fdc2c09ab30 secure :-1 s=READY pgs=380 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc54002390 tx=0x7fdc540079f0 comp rx=0 tx=0).stop 2026-02-23T06:37:35.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.148+0000 7fdc5fc1b640 1 -- 10.20.193.58:0/1664343395 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdc580b1170 msgr2=0x7fdc5815b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:35.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.148+0000 7fdc5fc1b640 1 --2- 10.20.193.58:0/1664343395 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdc580b1170 0x7fdc5815b6f0 secure :-1 s=READY pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc480034b0 tx=0x7fdc48005130 comp rx=0 tx=0).stop 2026-02-23T06:37:35.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.148+0000 7fdc5e191640 1 -- 10.20.193.58:0/1664343395 reap_dead start 2026-02-23T06:37:35.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.148+0000 7fdc5e191640 1 -- 10.20.193.58:0/1664343395 reap_dead start 2026-02-23T06:37:35.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.148+0000 7fdc5fc1b640 1 -- 10.20.193.58:0/1664343395 shutdown_connections 2026-02-23T06:37:35.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.148+0000 7fdc5fc1b640 1 -- 10.20.193.58:0/1664343395 >> 10.20.193.58:0/1664343395 conn(0x7fdc58058e50 msgr2=0x7fdc58059220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:35.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.148+0000 7fdc5fc1b640 1 -- 10.20.193.58:0/1664343395 shutdown_connections 2026-02-23T06:37:35.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.149+0000 7fdc5fc1b640 1 -- 10.20.193.58:0/1664343395 wait complete. 2026-02-23T06:37:35.160 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:37:35.161 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-23T06:37:35.161 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:37:35.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.340+0000 7f2717283640 1 -- 10.20.193.58:0/1750526341 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2704004850 msgr2=0x7f2704004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:35.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.340+0000 7f2717283640 1 --2- 10.20.193.58:0/1750526341 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2704004850 0x7f2704004cc0 secure :-1 s=READY pgs=95 gs=4 cs=0 l=1 c_cookie=16495704330104807289 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2700006ef0 tx=0x7f270002f750 comp rx=0 tx=0).stop 2026-02-23T06:37:35.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.341+0000 7f2716a82640 1 -- 10.20.193.58:0/1750526341 reap_dead start 2026-02-23T06:37:35.384 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.386+0000 7f2717283640 1 -- 10.20.193.58:0/1750526341 shutdown_connections 2026-02-23T06:37:35.384 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.386+0000 7f2717283640 1 -- 10.20.193.58:0/1750526341 >> 10.20.193.58:0/1750526341 conn(0x7f27100b3c20 msgr2=0x7f27100b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:35.384 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.386+0000 7f2717283640 1 -- 10.20.193.58:0/1750526341 shutdown_connections 2026-02-23T06:37:35.384 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.386+0000 7f2717283640 1 -- 10.20.193.58:0/1750526341 wait complete. 2026-02-23T06:37:35.384 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.387+0000 7f2717283640 1 Processor -- start 2026-02-23T06:37:35.384 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.388+0000 7f2717283640 1 -- start start 2026-02-23T06:37:35.384 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.388+0000 7f2717283640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2704004850 0x7f271016f840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:35.384 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.389+0000 7f2717283640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f271016ce80 0x7f271016d2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:35.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.389+0000 7f2717283640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2710111f20 0x7f2710112390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:35.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.389+0000 7f2715a80640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f271016ce80 msgr2=0x7f271016d2d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:37:35.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.389+0000 7f2715a80640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f271016ce80 0x7f271016d2d0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:37:35.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.389+0000 7f2717283640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f27100ae1f0 con 0x7f2710111f20 2026-02-23T06:37:35.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.389+0000 7f2717283640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f2710111360 con 0x7f2704004850 2026-02-23T06:37:35.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.389+0000 7f2717283640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f271016d810 con 0x7f271016ce80 2026-02-23T06:37:35.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.389+0000 7f2716281640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2704004850 0x7f271016f840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:35.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.389+0000 7f2716281640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2704004850 0x7f271016f840 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:49296/0 (socket says 10.20.193.58:49296) 2026-02-23T06:37:35.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.389+0000 7f2716281640 1 -- 10.20.193.58:0/695190057 learned_addr learned my addr 10.20.193.58:0/695190057 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:37:35.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.389+0000 7f2716a82640 1 --2- 10.20.193.58:0/695190057 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2710111f20 0x7f2710112390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:35.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.389+0000 7f2716281640 1 -- 10.20.193.58:0/695190057 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f271016ce80 msgr2=0x7f271016d2d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:37:35.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.389+0000 7f2716281640 1 --2- 10.20.193.58:0/695190057 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f271016ce80 0x7f271016d2d0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:35.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.389+0000 7f2716281640 1 -- 10.20.193.58:0/695190057 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2710111f20 msgr2=0x7f2710112390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:35.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.389+0000 7f2716281640 1 --2- 10.20.193.58:0/695190057 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2710111f20 0x7f2710112390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:35.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.389+0000 7f2716281640 1 -- 10.20.193.58:0/695190057 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271016ae20 con 0x7f2704004850 2026-02-23T06:37:35.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.389+0000 7f2716a82640 1 --2- 10.20.193.58:0/695190057 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2710111f20 0x7f2710112390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:37:35.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.390+0000 7f2716281640 1 --2- 10.20.193.58:0/695190057 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2704004850 0x7f271016f840 secure :-1 s=READY pgs=96 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f270c0027c0 tx=0x7f270c00dd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:35.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.390+0000 7f26f6ffd640 1 -- 10.20.193.58:0/695190057 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f270c006ea0 con 0x7f2704004850 2026-02-23T06:37:35.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.390+0000 7f2717283640 1 -- 10.20.193.58:0/695190057 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2710057080 con 0x7f2704004850 2026-02-23T06:37:35.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.390+0000 7f26f6ffd640 1 -- 10.20.193.58:0/695190057 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f270c00bd70 con 0x7f2704004850 2026-02-23T06:37:35.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.390+0000 7f26f6ffd640 1 -- 10.20.193.58:0/695190057 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f270c0106d0 con 0x7f2704004850 2026-02-23T06:37:35.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.390+0000 7f2717283640 1 -- 10.20.193.58:0/695190057 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27101115d0 con 0x7f2704004850 2026-02-23T06:37:35.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.391+0000 7f2717283640 1 --2- 10.20.193.58:0/695190057 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f27100ae570 0x7f2710165590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:35.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.391+0000 7f2717283640 1 -- 10.20.193.58:0/695190057 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f27100b5d70 con 0x7f27100ae570 2026-02-23T06:37:35.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.391+0000 7f2715a80640 1 --2- 10.20.193.58:0/695190057 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f27100ae570 0x7f2710165590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:35.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.392+0000 7f26f6ffd640 1 -- 10.20.193.58:0/695190057 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f270c010830 con 0x7f2704004850 2026-02-23T06:37:35.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.393+0000 7f2715a80640 1 -- 10.20.193.58:0/695190057 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f27100b5a90 con 0x7f27100ae570 2026-02-23T06:37:35.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.393+0000 7f2715a80640 1 --2- 10.20.193.58:0/695190057 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f27100ae570 0x7f2710165590 secure :-1 s=READY pgs=97 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2710169300 tx=0x7f2700002d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:35.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.393+0000 7f26f6ffd640 1 --2- 10.20.193.58:0/695190057 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f26e007a5b0 0x7f26e009aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:35.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.393+0000 7f26f6ffd640 1 -- 10.20.193.58:0/695190057 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f270c09e7d0 con 0x7f2704004850 2026-02-23T06:37:35.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.394+0000 7f2716a82640 1 --2- 10.20.193.58:0/695190057 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f26e007a5b0 0x7f26e009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:35.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.394+0000 7f26f6ffd640 1 -- 10.20.193.58:0/695190057 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f27000065c0 con 0x7f27100ae570 2026-02-23T06:37:35.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.394+0000 7f2716a82640 1 --2- 10.20.193.58:0/695190057 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f26e007a5b0 0x7f26e009aa60 secure :-1 s=READY pgs=381 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2708003810 tx=0x7f2708009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:35.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.396+0000 7f26f6ffd640 1 -- 10.20.193.58:0/695190057 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f270002fe90 con 0x7f27100ae570 2026-02-23T06:37:35.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.396+0000 7f26f6ffd640 1 -- 10.20.193.58:0/695190057 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f27100ae570 msgr2=0x7f2710165590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:35.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.396+0000 7f26f6ffd640 1 --2- 10.20.193.58:0/695190057 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f27100ae570 0x7f2710165590 secure :-1 s=READY pgs=97 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2710169300 tx=0x7f2700002d80 comp rx=0 tx=0).stop 2026-02-23T06:37:35.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.396+0000 7f26f6ffd640 1 -- 10.20.193.58:0/695190057 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f27100ae570 msgr2=0x7f2710165590 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:37:35.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.396+0000 7f26f6ffd640 1 --2- 10.20.193.58:0/695190057 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f27100ae570 0x7f2710165590 unknown :-1 s=CLOSED pgs=97 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:35.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.400+0000 7f2717283640 1 --2- 10.20.193.58:0/695190057 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2710165ad0 0x7f2710165ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:35.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.400+0000 7f2717283640 1 -- 10.20.193.58:0/695190057 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f27101663e0 con 0x7f2710165ad0 2026-02-23T06:37:35.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.400+0000 7f2715a80640 1 --2- 10.20.193.58:0/695190057 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2710165ad0 0x7f2710165ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:35.395 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.401+0000 7f2715a80640 1 -- 10.20.193.58:0/695190057 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2710056930 con 0x7f2710165ad0 2026-02-23T06:37:35.396 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.402+0000 7f2715a80640 1 --2- 10.20.193.58:0/695190057 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2710165ad0 0x7f2710165ea0 secure :-1 s=READY pgs=98 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2700006d90 tx=0x7f270002f750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:35.396 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.402+0000 7f26f6ffd640 1 -- 10.20.193.58:0/695190057 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f270004a8c0 con 0x7f2710165ad0 2026-02-23T06:37:35.398 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:37:35.398 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:37:35.398 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:37:35.398 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:37:35.398 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 140, 2026-02-23T06:37:35.398 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 167985, 2026-02-23T06:37:35.399 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:37:35.399 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:37:35.399 INFO:teuthology.orchestra.run.trial058.stdout: 1 2026-02-23T06:37:35.399 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:35.399 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:37:35.399 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:37:35.399 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:37:35.399 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:37:35.399 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:35.399 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:35.399 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:35.399 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:35.400 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:35.400 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:35.400 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:35.400 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:35.400 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:35.400 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:35.400 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:35.400 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:35.400 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:35.400 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:35.400 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:37:35.400 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:37:35.400 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:35.401 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:35.401 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:35.401 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:35.401 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:35.401 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:35.401 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:35.401 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:35.401 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:35.401 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:35.401 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:35.401 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:35.401 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:35.402 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:35.402 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:35.402 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:37:35.402 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:37:35.402 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:37:35.402 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:37:35.402 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:37:35.402 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:37:35.402 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:37:35.402 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:37:35.402 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:37:35.402 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:37:35.403 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:37:35.403 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:37:35.403 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:37:35.403 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:37:35.403 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:37:35.403 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:37:35.403 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:37:35.403 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:35.403 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:35.403 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:35.403 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:35.403 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:35.404 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:35.404 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:35.404 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:35.404 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:35.404 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:35.404 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:35.404 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:35.404 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:35.404 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:35.404 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:37:35.404 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:35.404 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:37:35.405 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.405 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:37:35.405 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:37:35.405 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:35.405 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:35.405 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.405 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:35.405 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:37:35.405 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:35.405 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:35.405 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.405 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:35.406 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:37:35.406 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:35.406 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:35.406 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:35.406 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:35.406 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:37:35.406 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:37:35.406 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:35.406 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:35.406 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:37:35.406 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:35.406 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:35.407 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.407 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:37:35.407 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:37:35.407 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:35.407 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:35.407 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.407 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:35.407 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:37:35.407 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:35.407 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:35.407 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.407 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:35.407 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:37:35.408 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:35.408 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:35.408 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:35.408 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:35.408 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:37:35.408 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:37:35.408 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:35.408 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:35.408 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:37:35.408 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:35.408 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:35.408 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.408 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:37:35.409 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:37:35.409 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:35.409 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:35.409 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.409 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:35.409 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:37:35.409 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:35.409 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:35.409 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.409 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:35.409 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:37:35.409 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:35.410 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:35.410 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:35.410 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:35.410 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:37:35.410 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:37:35.410 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:35.410 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:35.410 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:37:35.410 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:35.410 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:35.410 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:35.410 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:35.411 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:37:35.411 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:37:35.411 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.411 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:35.411 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:35.411 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:37:35.411 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:35.411 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:35.411 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:37:35.411 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.411 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:35.411 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:35.411 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:37:35.412 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:35.412 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:35.412 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:37:35.412 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.412 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:35.412 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:35.412 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:37:35.412 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:35.412 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:35.412 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:37:35.412 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.412 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:35.413 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:35.413 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:37:35.413 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:35.413 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:35.413 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:37:35.413 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:35.413 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:35.413 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:35.413 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:37:35.413 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:35.413 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:35.413 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:35.413 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:37:35.414 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:37:35.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.404+0000 7f26f6ffd640 1 -- 10.20.193.58:0/695190057 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5402 (secure 0 0 0) 0x7f2700043480 con 0x7f2710165ad0 2026-02-23T06:37:35.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.404+0000 7f26f6ffd640 1 -- 10.20.193.58:0/695190057 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2710165ad0 msgr2=0x7f2710165ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:35.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.404+0000 7f26f6ffd640 1 --2- 10.20.193.58:0/695190057 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2710165ad0 0x7f2710165ea0 secure :-1 s=READY pgs=98 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2700006d90 tx=0x7f270002f750 comp rx=0 tx=0).stop 2026-02-23T06:37:35.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.404+0000 7f26f6ffd640 1 -- 10.20.193.58:0/695190057 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2710165ad0 msgr2=0x7f2710165ea0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:37:35.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.404+0000 7f26f6ffd640 1 --2- 10.20.193.58:0/695190057 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2710165ad0 0x7f2710165ea0 secure :-1 s=CLOSED pgs=98 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2700006d90 tx=0x7f270002f750 comp rx=0 tx=0).stop 2026-02-23T06:37:35.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.404+0000 7f2717283640 1 -- 10.20.193.58:0/695190057 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f26e007a5b0 msgr2=0x7f26e009aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:35.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.404+0000 7f2717283640 1 --2- 10.20.193.58:0/695190057 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f26e007a5b0 0x7f26e009aa60 secure :-1 s=READY pgs=381 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2708003810 tx=0x7f2708009040 comp rx=0 tx=0).stop 2026-02-23T06:37:35.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.404+0000 7f2717283640 1 -- 10.20.193.58:0/695190057 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2704004850 msgr2=0x7f271016f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:35.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.404+0000 7f2717283640 1 --2- 10.20.193.58:0/695190057 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2704004850 0x7f271016f840 secure :-1 s=READY pgs=96 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f270c0027c0 tx=0x7f270c00dd90 comp rx=0 tx=0).stop 2026-02-23T06:37:35.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.404+0000 7f2716a82640 1 -- 10.20.193.58:0/695190057 reap_dead start 2026-02-23T06:37:35.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.404+0000 7f2716a82640 1 -- 10.20.193.58:0/695190057 reap_dead start 2026-02-23T06:37:35.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.404+0000 7f2717283640 1 -- 10.20.193.58:0/695190057 shutdown_connections 2026-02-23T06:37:35.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.405+0000 7f2717283640 1 -- 10.20.193.58:0/695190057 >> 10.20.193.58:0/695190057 conn(0x7f27100b3c20 msgr2=0x7f271016a470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:35.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.405+0000 7f2717283640 1 -- 10.20.193.58:0/695190057 shutdown_connections 2026-02-23T06:37:35.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:35.405+0000 7f2717283640 1 -- 10.20.193.58:0/695190057 wait complete. 2026-02-23T06:37:35.417 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:37:35.417 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:37:43.853 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:37:43.858 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:37:55.418 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-23T06:37:55.418 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-23T06:37:55.418 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-23T06:37:55.418 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-23T06:37:55.420 INFO:tasks.ceph.mon.c:Started 2026-02-23T06:37:55.420 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:37:55.421 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:37:55.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.547+0000 7fe2f69d2640 1 -- 10.20.193.58:0/261161176 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe2f0056550 msgr2=0x7fe2f005ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:55.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.547+0000 7fe2f69d2640 1 --2- 10.20.193.58:0/261161176 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe2f0056550 0x7fe2f005ce30 secure :-1 s=READY pgs=222 gs=1 cs=0 l=1 c_cookie=12861591590126886396 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2f005df80 tx=0x7fe2e402f290 comp rx=0 tx=0).stop 2026-02-23T06:37:55.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.547+0000 7fe2f69d2640 1 -- 10.20.193.58:0/261161176 shutdown_connections 2026-02-23T06:37:55.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.547+0000 7fe2f69d2640 1 --2- 10.20.193.58:0/261161176 >> v2:10.20.193.93:3300/0 conn(0x7fe2f005d370 0x7fe2f00b5680 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:55.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.547+0000 7fe2f69d2640 1 --2- 10.20.193.58:0/261161176 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe2f0056550 0x7fe2f005ce30 unknown :-1 s=CLOSED pgs=222 gs=1 cs=0 l=1 c_cookie=12861591590126886396 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:55.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.547+0000 7fe2f69d2640 1 --2- 10.20.193.58:0/261161176 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe2f015c040 0x7fe2f005b0e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:55.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.547+0000 7fe2f69d2640 1 -- 10.20.193.58:0/261161176 >> 10.20.193.58:0/261161176 conn(0x7fe2f00b3c20 msgr2=0x7fe2f00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:55.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.547+0000 7fe2f69d2640 1 -- 10.20.193.58:0/261161176 shutdown_connections 2026-02-23T06:37:55.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.547+0000 7fe2f69d2640 1 -- 10.20.193.58:0/261161176 wait complete. 2026-02-23T06:37:55.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.548+0000 7fe2f69d2640 1 Processor -- start 2026-02-23T06:37:55.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.548+0000 7fe2f69d2640 1 -- start start 2026-02-23T06:37:55.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.548+0000 7fe2f69d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2f0056550 0x7fe2f0058810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:55.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.548+0000 7fe2f69d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe2f005d370 0x7fe2f015ea20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:55.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.548+0000 7fe2f69d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe2f015c040 0x7fe2f015ef60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:55.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.548+0000 7fe2f69d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f00affa0 con 0x7fe2f015c040 2026-02-23T06:37:55.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.548+0000 7fe2f69d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f00b0b50 con 0x7fe2f0056550 2026-02-23T06:37:55.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.548+0000 7fe2f69d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe2f01fe660 con 0x7fe2f005d370 2026-02-23T06:37:55.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.548+0000 7fe2f61d1640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe2f015c040 0x7fe2f015ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:55.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.548+0000 7fe2f61d1640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe2f015c040 0x7fe2f015ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:41986/0 (socket says 10.20.193.58:41986) 2026-02-23T06:37:55.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.548+0000 7fe2f61d1640 1 -- 10.20.193.58:0/3561669489 learned_addr learned my addr 10.20.193.58:0/3561669489 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:37:55.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.548+0000 7fe2f61d1640 1 -- 10.20.193.58:0/3561669489 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe2f005d370 msgr2=0x7fe2f015ea20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-23T06:37:55.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.548+0000 7fe2f61d1640 1 --2- 10.20.193.58:0/3561669489 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe2f005d370 0x7fe2f015ea20 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:55.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.548+0000 7fe2f61d1640 1 -- 10.20.193.58:0/3561669489 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2f0056550 msgr2=0x7fe2f0058810 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-23T06:37:55.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.548+0000 7fe2f61d1640 1 --2- 10.20.193.58:0/3561669489 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2f0056550 0x7fe2f0058810 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:55.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.548+0000 7fe2f61d1640 1 -- 10.20.193.58:0/3561669489 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e4009570 con 0x7fe2f015c040 2026-02-23T06:37:55.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.548+0000 7fe2f61d1640 1 --2- 10.20.193.58:0/3561669489 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe2f015c040 0x7fe2f015ef60 secure :-1 s=READY pgs=223 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2ec00c750 tx=0x7fe2ec00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:55.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.548+0000 7fe2de7fc640 1 -- 10.20.193.58:0/3561669489 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe2ec005500 con 0x7fe2f015c040 2026-02-23T06:37:55.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.548+0000 7fe2de7fc640 1 -- 10.20.193.58:0/3561669489 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2ec003780 con 0x7fe2f015c040 2026-02-23T06:37:55.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.548+0000 7fe2de7fc640 1 -- 10.20.193.58:0/3561669489 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe2ec003bb0 con 0x7fe2f015c040 2026-02-23T06:37:55.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.548+0000 7fe2f69d2640 1 -- 10.20.193.58:0/3561669489 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2f01fe940 con 0x7fe2f015c040 2026-02-23T06:37:55.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.548+0000 7fe2f69d2640 1 -- 10.20.193.58:0/3561669489 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2f00b04d0 con 0x7fe2f015c040 2026-02-23T06:37:55.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.548+0000 7fe2f69d2640 1 -- 10.20.193.58:0/3561669489 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2f005ce30 con 0x7fe2f015c040 2026-02-23T06:37:55.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.548+0000 7fe2de7fc640 1 -- 10.20.193.58:0/3561669489 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fe2ec003d10 con 0x7fe2f015c040 2026-02-23T06:37:55.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.554+0000 7fe2de7fc640 1 --2- 10.20.193.58:0/3561669489 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe2c007a790 0x7fe2c009ac40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:55.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.554+0000 7fe2de7fc640 1 -- 10.20.193.58:0/3561669489 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fe2ec09df90 con 0x7fe2f015c040 2026-02-23T06:37:55.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.555+0000 7fe2f59d0640 1 --2- 10.20.193.58:0/3561669489 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe2c007a790 0x7fe2c009ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:55.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.556+0000 7fe2de7fc640 1 -- 10.20.193.58:0/3561669489 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fe2ec061240 con 0x7fe2f015c040 2026-02-23T06:37:55.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.558+0000 7fe2f59d0640 1 --2- 10.20.193.58:0/3561669489 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe2c007a790 0x7fe2c009ac40 secure :-1 s=READY pgs=383 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2e0004740 tx=0x7fe2e0006cd0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:55.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.712+0000 7fe2f69d2640 1 -- 10.20.193.58:0/3561669489 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe2f0057090 con 0x7fe2f015c040 2026-02-23T06:37:55.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.713+0000 7fe2de7fc640 1 -- 10.20.193.58:0/3561669489 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7fe2ec064360 con 0x7fe2f015c040 2026-02-23T06:37:55.707 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":142,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:37:55.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.714+0000 7fe2f69d2640 1 -- 10.20.193.58:0/3561669489 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe2c007a790 msgr2=0x7fe2c009ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:55.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.714+0000 7fe2f69d2640 1 --2- 10.20.193.58:0/3561669489 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe2c007a790 0x7fe2c009ac40 secure :-1 s=READY pgs=383 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2e0004740 tx=0x7fe2e0006cd0 comp rx=0 tx=0).stop 2026-02-23T06:37:55.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.714+0000 7fe2f69d2640 1 -- 10.20.193.58:0/3561669489 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe2f015c040 msgr2=0x7fe2f015ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:55.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.714+0000 7fe2f69d2640 1 --2- 10.20.193.58:0/3561669489 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe2f015c040 0x7fe2f015ef60 secure :-1 s=READY pgs=223 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2ec00c750 tx=0x7fe2ec00cc20 comp rx=0 tx=0).stop 2026-02-23T06:37:55.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.715+0000 7fe2f69d2640 1 -- 10.20.193.58:0/3561669489 shutdown_connections 2026-02-23T06:37:55.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.715+0000 7fe2f69d2640 1 --2- 10.20.193.58:0/3561669489 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe2c007a790 0x7fe2c009ac40 unknown :-1 s=CLOSED pgs=383 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:55.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.715+0000 7fe2f69d2640 1 --2- 10.20.193.58:0/3561669489 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe2f015c040 0x7fe2f015ef60 unknown :-1 s=CLOSED pgs=223 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:55.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.715+0000 7fe2f69d2640 1 --2- 10.20.193.58:0/3561669489 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe2f005d370 0x7fe2f015ea20 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:55.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.715+0000 7fe2f69d2640 1 --2- 10.20.193.58:0/3561669489 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2f0056550 0x7fe2f0058810 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:55.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.715+0000 7fe2f69d2640 1 -- 10.20.193.58:0/3561669489 >> 10.20.193.58:0/3561669489 conn(0x7fe2f00b3c20 msgr2=0x7fe2f0163200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:55.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.715+0000 7fe2f69d2640 1 -- 10.20.193.58:0/3561669489 shutdown_connections 2026-02-23T06:37:55.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.715+0000 7fe2f69d2640 1 -- 10.20.193.58:0/3561669489 wait complete. 2026-02-23T06:37:55.720 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:37:55.721 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:37:55.721 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:37:55.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.847+0000 7fb3f5589640 1 -- 10.20.193.58:0/1452979014 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3f00b6690 msgr2=0x7fb3f0058ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:55.842 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.847+0000 7fb3f5589640 1 --2- 10.20.193.58:0/1452979014 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3f00b6690 0x7fb3f0058ec0 secure :-1 s=READY pgs=102 gs=2 cs=0 l=1 c_cookie=14364512865152040552 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3f00afed0 tx=0x7fb3e4030270 comp rx=0 tx=0).stop 2026-02-23T06:37:55.842 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.847+0000 7fb3f5589640 1 -- 10.20.193.58:0/1452979014 shutdown_connections 2026-02-23T06:37:55.842 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.847+0000 7fb3f5589640 1 --2- 10.20.193.58:0/1452979014 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3f00b6690 0x7fb3f0058ec0 unknown :-1 s=CLOSED pgs=102 gs=2 cs=0 l=1 c_cookie=14364512865152040552 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:55.842 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.847+0000 7fb3f5589640 1 --2- 10.20.193.58:0/1452979014 >> v2:10.20.193.58:3300/0 conn(0x7fb3f015d4a0 0x7fb3f00affb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:55.842 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.847+0000 7fb3f5589640 1 -- 10.20.193.58:0/1452979014 >> 10.20.193.58:0/1452979014 conn(0x7fb3f00b3c20 msgr2=0x7fb3f00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:55.842 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.847+0000 7fb3f5589640 1 -- 10.20.193.58:0/1452979014 shutdown_connections 2026-02-23T06:37:55.842 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.847+0000 7fb3f5589640 1 -- 10.20.193.58:0/1452979014 wait complete. 2026-02-23T06:37:55.845 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.848+0000 7fb3f5589640 1 Processor -- start 2026-02-23T06:37:55.845 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.848+0000 7fb3f5589640 1 -- start start 2026-02-23T06:37:55.845 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.849+0000 7fb3f5589640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3f00b6690 0x7fb3f011f8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:55.845 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.849+0000 7fb3f5589640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3f015d4a0 0x7fb3f013d2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:55.845 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.849+0000 7fb3f5589640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3f015d870 0x7fb3f014d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:55.845 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.849+0000 7fb3f5589640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f0121630 con 0x7fb3f015d4a0 2026-02-23T06:37:55.845 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.849+0000 7fb3f5589640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f0121910 con 0x7fb3f015d870 2026-02-23T06:37:55.845 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.849+0000 7fb3f5589640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb3f0149db0 con 0x7fb3f00b6690 2026-02-23T06:37:55.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.849+0000 7fb3ef7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3f015d4a0 0x7fb3f013d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:55.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.849+0000 7fb3ef7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3f015d4a0 0x7fb3f013d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:42000/0 (socket says 10.20.193.58:42000) 2026-02-23T06:37:55.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.849+0000 7fb3ef7fe640 1 -- 10.20.193.58:0/511240879 learned_addr learned my addr 10.20.193.58:0/511240879 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:37:55.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.849+0000 7fb3effff640 1 --2- 10.20.193.58:0/511240879 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3f00b6690 0x7fb3f011f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:55.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.849+0000 7fb3f4d88640 1 --2- 10.20.193.58:0/511240879 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3f015d870 0x7fb3f014d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:55.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.849+0000 7fb3effff640 1 -- 10.20.193.58:0/511240879 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3f00b6690 msgr2=0x7fb3f011f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-23T06:37:55.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.849+0000 7fb3effff640 1 -- 10.20.193.58:0/511240879 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3f00b6690 msgr2=0x7fb3f011f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:37:55.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.849+0000 7fb3effff640 1 --2- 10.20.193.58:0/511240879 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3f00b6690 0x7fb3f011f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:37:55.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.849+0000 7fb3effff640 1 --2- 10.20.193.58:0/511240879 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3f00b6690 0x7fb3f011f8b0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:37:55.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.849+0000 7fb3ef7fe640 1 -- 10.20.193.58:0/511240879 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3f00b6690 msgr2=0x7fb3f011f8b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:37:55.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.849+0000 7fb3ef7fe640 1 --2- 10.20.193.58:0/511240879 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3f00b6690 0x7fb3f011f8b0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:55.846 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.849+0000 7fb3ef7fe640 1 -- 10.20.193.58:0/511240879 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3f015d870 msgr2=0x7fb3f014d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:55.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.849+0000 7fb3ef7fe640 1 --2- 10.20.193.58:0/511240879 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3f015d870 0x7fb3f014d250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:55.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.849+0000 7fb3ef7fe640 1 -- 10.20.193.58:0/511240879 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3dc0094b0 con 0x7fb3f015d4a0 2026-02-23T06:37:55.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.850+0000 7fb3ef7fe640 1 --2- 10.20.193.58:0/511240879 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3f015d4a0 0x7fb3f013d2d0 secure :-1 s=READY pgs=225 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3e000c4d0 tx=0x7fb3e000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:55.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.850+0000 7fb3ecff9640 1 -- 10.20.193.58:0/511240879 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3e0016070 con 0x7fb3f015d4a0 2026-02-23T06:37:55.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.850+0000 7fb3ecff9640 1 -- 10.20.193.58:0/511240879 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3e0005330 con 0x7fb3f015d4a0 2026-02-23T06:37:55.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.850+0000 7fb3ecff9640 1 -- 10.20.193.58:0/511240879 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3e0004780 con 0x7fb3f015d4a0 2026-02-23T06:37:55.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.850+0000 7fb3f5589640 1 -- 10.20.193.58:0/511240879 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3e400a590 con 0x7fb3f015d4a0 2026-02-23T06:37:55.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.850+0000 7fb3f5589640 1 -- 10.20.193.58:0/511240879 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3f014a370 con 0x7fb3f015d4a0 2026-02-23T06:37:55.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.850+0000 7fb3f5589640 1 --2- 10.20.193.58:0/511240879 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3f014a590 0x7fb3f011fed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:55.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.850+0000 7fb3f5589640 1 -- 10.20.193.58:0/511240879 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f00b6330 con 0x7fb3f014a590 2026-02-23T06:37:55.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.850+0000 7fb3effff640 1 --2- 10.20.193.58:0/511240879 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3f014a590 0x7fb3f011fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:55.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.851+0000 7fb3effff640 1 -- 10.20.193.58:0/511240879 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb3f00b5e10 con 0x7fb3f014a590 2026-02-23T06:37:55.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.851+0000 7fb3effff640 1 --2- 10.20.193.58:0/511240879 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3f014a590 0x7fb3f011fed0 secure :-1 s=READY pgs=226 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3dc0046f0 tx=0x7fb3dc002b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:55.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.851+0000 7fb3ecff9640 1 -- 10.20.193.58:0/511240879 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3dc011c50 con 0x7fb3f014a590 2026-02-23T06:37:55.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.851+0000 7fb3ecff9640 1 -- 10.20.193.58:0/511240879 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fb3dc011db0 con 0x7fb3f014a590 2026-02-23T06:37:55.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.851+0000 7fb3ecff9640 1 -- 10.20.193.58:0/511240879 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3f014a590 msgr2=0x7fb3f011fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:55.849 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.851+0000 7fb3ecff9640 1 --2- 10.20.193.58:0/511240879 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3f014a590 0x7fb3f011fed0 secure :-1 s=READY pgs=226 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3dc0046f0 tx=0x7fb3dc002b40 comp rx=0 tx=0).stop 2026-02-23T06:37:55.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.851+0000 7fb3ecff9640 1 -- 10.20.193.58:0/511240879 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3f014a590 msgr2=0x7fb3f011fed0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:37:55.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.851+0000 7fb3ecff9640 1 --2- 10.20.193.58:0/511240879 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3f014a590 0x7fb3f011fed0 unknown :-1 s=CLOSED pgs=226 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:55.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.851+0000 7fb3ecff9640 1 -- 10.20.193.58:0/511240879 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fb3e00048e0 con 0x7fb3f015d4a0 2026-02-23T06:37:55.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.852+0000 7fb3ecff9640 1 --2- 10.20.193.58:0/511240879 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb3c007a3c0 0x7fb3c009a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:55.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.852+0000 7fb3ecff9640 1 -- 10.20.193.58:0/511240879 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fb3e009d0a0 con 0x7fb3f015d4a0 2026-02-23T06:37:55.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.852+0000 7fb3effff640 1 --2- 10.20.193.58:0/511240879 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb3c007a3c0 0x7fb3c009a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:55.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.855+0000 7fb3f5589640 1 --2- 10.20.193.58:0/511240879 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3f0120410 0x7fb3f01207e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:55.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.855+0000 7fb3f5589640 1 -- 10.20.193.58:0/511240879 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f0120d20 con 0x7fb3f0120410 2026-02-23T06:37:55.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.855+0000 7fb3effff640 1 --2- 10.20.193.58:0/511240879 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb3c007a3c0 0x7fb3c009a870 secure :-1 s=READY pgs=384 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3dc002fd0 tx=0x7fb3dc015000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:55.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.855+0000 7fb3f4d88640 1 --2- 10.20.193.58:0/511240879 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3f0120410 0x7fb3f01207e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:55.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.855+0000 7fb3f4d88640 1 -- 10.20.193.58:0/511240879 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb3f00b6d50 con 0x7fb3f0120410 2026-02-23T06:37:55.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.855+0000 7fb3f4d88640 1 --2- 10.20.193.58:0/511240879 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3f0120410 0x7fb3f01207e0 secure :-1 s=READY pgs=227 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3e40307a0 tx=0x7fb3e4003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:55.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.856+0000 7fb3ecff9640 1 -- 10.20.193.58:0/511240879 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3e4047070 con 0x7fb3f0120410 2026-02-23T06:37:55.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.856+0000 7fb3ecff9640 1 -- 10.20.193.58:0/511240879 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5558 (secure 0 0 0) 0x7fb3e403f040 con 0x7fb3f0120410 2026-02-23T06:37:55.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.856+0000 7fb3ecff9640 1 -- 10.20.193.58:0/511240879 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3f0120410 msgr2=0x7fb3f01207e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:55.851 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.856+0000 7fb3ecff9640 1 --2- 10.20.193.58:0/511240879 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3f0120410 0x7fb3f01207e0 secure :-1 s=READY pgs=227 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3e40307a0 tx=0x7fb3e4003a80 comp rx=0 tx=0).stop 2026-02-23T06:37:55.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.856+0000 7fb3ecff9640 1 -- 10.20.193.58:0/511240879 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3f0120410 msgr2=0x7fb3f01207e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:37:55.852 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:37:55.852 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:37:55.852 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:37:55.852 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:37:55.852 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 142, 2026-02-23T06:37:55.852 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 283367, 2026-02-23T06:37:55.853 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:37:55.853 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:37:55.853 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:37:55.853 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:37:55.853 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:55.853 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:37:55.853 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:37:55.853 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:37:55.853 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:37:55.853 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:55.853 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:55.853 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:55.854 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:55.854 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:55.854 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:55.854 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:55.854 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:55.854 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:55.854 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:55.854 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:55.854 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:55.854 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:55.854 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:55.854 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:37:55.855 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:37:55.855 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:55.855 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:55.855 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:55.855 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:55.855 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:55.855 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:55.855 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:55.855 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:55.855 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:55.855 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:55.855 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:55.855 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:55.856 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:55.856 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:55.856 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:55.856 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:37:55.856 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:37:55.856 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:37:55.856 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:37:55.856 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:37:55.856 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:37:55.856 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:37:55.856 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:37:55.856 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:37:55.857 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:37:55.857 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:37:55.857 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:37:55.857 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:37:55.857 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:37:55.857 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:37:55.857 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:37:55.857 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:37:55.857 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:55.857 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:55.857 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:55.857 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:55.858 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:55.858 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:55.858 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:55.858 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:55.858 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:55.858 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:55.858 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:55.858 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:55.858 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:55.858 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:55.858 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:37:55.858 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:55.858 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:37:55.859 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:55.859 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:37:55.859 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:37:55.859 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:55.859 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:55.859 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:55.859 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:55.859 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:37:55.859 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:55.859 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:55.859 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:55.859 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:55.860 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:37:55.860 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:55.860 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:55.860 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:55.860 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:55.860 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:37:55.860 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:37:55.860 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:55.860 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:55.860 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:37:55.860 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:55.860 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:55.860 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:55.861 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:37:55.861 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:37:55.861 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:55.861 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:55.861 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:55.861 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:55.861 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:37:55.861 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:55.861 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:55.861 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:55.861 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:55.861 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:37:55.861 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:55.862 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:55.862 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:55.862 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:55.862 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:37:55.862 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:37:55.862 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:55.862 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:55.862 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:37:55.862 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:55.862 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:55.862 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:55.862 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:37:55.862 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:37:55.863 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:55.863 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:55.863 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:55.863 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:55.863 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:37:55.863 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:55.863 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:55.863 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:55.863 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:55.863 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:37:55.863 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:55.863 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:55.864 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:55.864 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:55.864 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:37:55.864 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:37:55.864 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:55.864 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:55.864 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:37:55.864 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:55.864 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:55.864 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:55.864 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:55.864 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:37:55.864 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:37:55.865 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:55.865 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:55.865 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:55.865 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:37:55.865 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:55.865 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:55.865 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:37:55.865 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:55.865 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:55.865 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:55.865 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:37:55.865 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:55.865 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:55.866 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:37:55.866 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:55.866 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:55.866 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:55.866 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:37:55.866 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:55.866 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:55.866 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:37:55.866 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:55.866 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:37:55.866 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:37:55.866 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:37:55.867 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:55.867 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:55.867 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:55.867 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:55.867 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:37:55.867 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:55.867 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:55.867 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:37:55.867 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:55.867 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:55.867 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:55.867 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:37:55.867 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:55.868 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:55.868 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:55.868 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:37:55.868 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:37:55.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.856+0000 7fb3ecff9640 1 --2- 10.20.193.58:0/511240879 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3f0120410 0x7fb3f01207e0 unknown :-1 s=CLOSED pgs=227 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:55.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.856+0000 7fb3f5589640 1 -- 10.20.193.58:0/511240879 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb3c007a3c0 msgr2=0x7fb3c009a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:55.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.856+0000 7fb3f5589640 1 --2- 10.20.193.58:0/511240879 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb3c007a3c0 0x7fb3c009a870 secure :-1 s=READY pgs=384 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3dc002fd0 tx=0x7fb3dc015000 comp rx=0 tx=0).stop 2026-02-23T06:37:55.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.856+0000 7fb3f5589640 1 -- 10.20.193.58:0/511240879 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3f015d4a0 msgr2=0x7fb3f013d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:55.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.856+0000 7fb3f5589640 1 --2- 10.20.193.58:0/511240879 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3f015d4a0 0x7fb3f013d2d0 secure :-1 s=READY pgs=225 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3e000c4d0 tx=0x7fb3e000c9a0 comp rx=0 tx=0).stop 2026-02-23T06:37:55.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.856+0000 7fb3f4d88640 1 -- 10.20.193.58:0/511240879 reap_dead start 2026-02-23T06:37:55.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.856+0000 7fb3f4d88640 1 -- 10.20.193.58:0/511240879 reap_dead start 2026-02-23T06:37:55.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.857+0000 7fb3f5589640 1 -- 10.20.193.58:0/511240879 shutdown_connections 2026-02-23T06:37:55.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.857+0000 7fb3f5589640 1 -- 10.20.193.58:0/511240879 >> 10.20.193.58:0/511240879 conn(0x7fb3f00b3c20 msgr2=0x7fb3f013de20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:55.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.857+0000 7fb3f5589640 1 -- 10.20.193.58:0/511240879 shutdown_connections 2026-02-23T06:37:55.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.857+0000 7fb3f5589640 1 -- 10.20.193.58:0/511240879 wait complete. 2026-02-23T06:37:55.871 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:37:55.871 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:37:55.871 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:37:55.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.998+0000 7f7a3e175640 1 -- 10.20.193.58:0/2003897969 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7a20004850 msgr2=0x7f7a20004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:55.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.998+0000 7f7a3e175640 1 --2- 10.20.193.58:0/2003897969 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7a20004850 0x7f7a20004cc0 secure :-1 s=READY pgs=229 gs=4 cs=0 l=1 c_cookie=18426061602073222453 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a2c002d20 tx=0x7f7a2c02ef70 comp rx=0 tx=0).stop 2026-02-23T06:37:55.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.998+0000 7f7a3e175640 1 -- 10.20.193.58:0/2003897969 shutdown_connections 2026-02-23T06:37:55.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.998+0000 7f7a3e175640 1 --2- 10.20.193.58:0/2003897969 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7a20004850 0x7f7a20004cc0 unknown :-1 s=CLOSED pgs=229 gs=4 cs=0 l=1 c_cookie=18426061602073222453 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:55.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.998+0000 7f7a3e175640 1 -- 10.20.193.58:0/2003897969 >> 10.20.193.58:0/2003897969 conn(0x7f7a380b3c20 msgr2=0x7f7a380b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:55.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.998+0000 7f7a3e175640 1 -- 10.20.193.58:0/2003897969 shutdown_connections 2026-02-23T06:37:55.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.998+0000 7f7a3e175640 1 -- 10.20.193.58:0/2003897969 wait complete. 2026-02-23T06:37:55.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.999+0000 7f7a3e175640 1 Processor -- start 2026-02-23T06:37:55.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:55.999+0000 7f7a3e175640 1 -- start start 2026-02-23T06:37:55.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.000+0000 7f7a3e175640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7a20004850 0x7f7a3813f520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:55.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.000+0000 7f7a3e175640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7a38056590 0x7f7a3813c2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:55.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.000+0000 7f7a3e175640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7a3813fea0 0x7f7a3813c7f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:55.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.000+0000 7f7a3e175640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3815e300 con 0x7f7a3813fea0 2026-02-23T06:37:55.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.000+0000 7f7a3e175640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f7a38056b40 con 0x7f7a38056590 2026-02-23T06:37:55.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.000+0000 7f7a3e175640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f7a38056e20 con 0x7f7a20004850 2026-02-23T06:37:55.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.000+0000 7f7a3d974640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7a3813fea0 0x7f7a3813c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:55.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.000+0000 7f7a3d974640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7a3813fea0 0x7f7a3813c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:42012/0 (socket says 10.20.193.58:42012) 2026-02-23T06:37:55.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.000+0000 7f7a3d974640 1 -- 10.20.193.58:0/4200831248 learned_addr learned my addr 10.20.193.58:0/4200831248 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:37:55.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.000+0000 7f7a3d974640 1 -- 10.20.193.58:0/4200831248 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7a20004850 msgr2=0x7f7a3813f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:55.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.000+0000 7f7a3d173640 1 --2- 10.20.193.58:0/4200831248 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7a20004850 0x7f7a3813f520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:55.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.000+0000 7f7a3c972640 1 --2- 10.20.193.58:0/4200831248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7a38056590 0x7f7a3813c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:55.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.000+0000 7f7a3d974640 1 --2- 10.20.193.58:0/4200831248 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7a20004850 0x7f7a3813f520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:55.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.000+0000 7f7a3d974640 1 -- 10.20.193.58:0/4200831248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7a38056590 msgr2=0x7f7a3813c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:55.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.000+0000 7f7a3d974640 1 --2- 10.20.193.58:0/4200831248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7a38056590 0x7f7a3813c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:55.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.000+0000 7f7a3d974640 1 -- 10.20.193.58:0/4200831248 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a38057100 con 0x7f7a3813fea0 2026-02-23T06:37:55.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.000+0000 7f7a3d173640 1 --2- 10.20.193.58:0/4200831248 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7a20004850 0x7f7a3813f520 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:37:55.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.000+0000 7f7a3d974640 1 --2- 10.20.193.58:0/4200831248 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7a3813fea0 0x7f7a3813c7f0 secure :-1 s=READY pgs=230 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a38163350 tx=0x7f7a34003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:55.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.001+0000 7f7a25ffb640 1 -- 10.20.193.58:0/4200831248 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7a3400acd0 con 0x7f7a3813fea0 2026-02-23T06:37:55.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.001+0000 7f7a25ffb640 1 -- 10.20.193.58:0/4200831248 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a3401b470 con 0x7f7a3813fea0 2026-02-23T06:37:55.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.001+0000 7f7a25ffb640 1 -- 10.20.193.58:0/4200831248 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7a3401b8a0 con 0x7f7a3813fea0 2026-02-23T06:37:55.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.001+0000 7f7a3e175640 1 -- 10.20.193.58:0/4200831248 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a380573e0 con 0x7f7a3813fea0 2026-02-23T06:37:55.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.001+0000 7f7a3e175640 1 -- 10.20.193.58:0/4200831248 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a3813bd90 con 0x7f7a3813fea0 2026-02-23T06:37:55.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.001+0000 7f7a3e175640 1 --2- 10.20.193.58:0/4200831248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7a38057e00 0x7f7a38200e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:55.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.001+0000 7f7a3e175640 1 -- 10.20.193.58:0/4200831248 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f7a38057290 con 0x7f7a38057e00 2026-02-23T06:37:55.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.001+0000 7f7a3d173640 1 --2- 10.20.193.58:0/4200831248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7a38057e00 0x7f7a38200e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:55.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.002+0000 7f7a3d173640 1 -- 10.20.193.58:0/4200831248 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7a380b5e10 con 0x7f7a38057e00 2026-02-23T06:37:55.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.002+0000 7f7a3d173640 1 --2- 10.20.193.58:0/4200831248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7a38057e00 0x7f7a38200e20 secure :-1 s=READY pgs=104 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a28002780 tx=0x7f7a2800f680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:55.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.002+0000 7f7a25ffb640 1 -- 10.20.193.58:0/4200831248 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7a28012690 con 0x7f7a38057e00 2026-02-23T06:37:55.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.003+0000 7f7a25ffb640 1 -- 10.20.193.58:0/4200831248 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f7a34024020 con 0x7f7a3813fea0 2026-02-23T06:37:55.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.004+0000 7f7a25ffb640 1 --2- 10.20.193.58:0/4200831248 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7a0807a660 0x7f7a0809ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:55.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.004+0000 7f7a25ffb640 1 -- 10.20.193.58:0/4200831248 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f7a280127f0 con 0x7f7a38057e00 2026-02-23T06:37:55.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.004+0000 7f7a25ffb640 1 -- 10.20.193.58:0/4200831248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7a38057e00 msgr2=0x7f7a38200e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:56.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.004+0000 7f7a25ffb640 1 --2- 10.20.193.58:0/4200831248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7a38057e00 0x7f7a38200e20 secure :-1 s=READY pgs=104 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a28002780 tx=0x7f7a2800f680 comp rx=0 tx=0).stop 2026-02-23T06:37:56.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.004+0000 7f7a25ffb640 1 -- 10.20.193.58:0/4200831248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7a38057e00 msgr2=0x7f7a38200e20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:37:56.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.004+0000 7f7a25ffb640 1 --2- 10.20.193.58:0/4200831248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7a38057e00 0x7f7a38200e20 unknown :-1 s=CLOSED pgs=104 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:56.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.004+0000 7f7a25ffb640 1 -- 10.20.193.58:0/4200831248 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f7a3409ea30 con 0x7f7a3813fea0 2026-02-23T06:37:56.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.004+0000 7f7a3c972640 1 --2- 10.20.193.58:0/4200831248 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7a0807a660 0x7f7a0809ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:56.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.005+0000 7f7a3c972640 1 --2- 10.20.193.58:0/4200831248 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7a0807a660 0x7f7a0809ab10 secure :-1 s=READY pgs=385 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a2c0027a0 tx=0x7f7a2c031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:56.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.008+0000 7f7a3e175640 1 --2- 10.20.193.58:0/4200831248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7a3815dcf0 0x7f7a38201360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:56.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.008+0000 7f7a3e175640 1 -- 10.20.193.58:0/4200831248 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f7a38057570 con 0x7f7a3815dcf0 2026-02-23T06:37:56.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.008+0000 7f7a3d173640 1 --2- 10.20.193.58:0/4200831248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7a3815dcf0 0x7f7a38201360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:56.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.008+0000 7f7a3d173640 1 -- 10.20.193.58:0/4200831248 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7a380b5b30 con 0x7f7a3815dcf0 2026-02-23T06:37:56.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.009+0000 7f7a3d173640 1 --2- 10.20.193.58:0/4200831248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7a3815dcf0 0x7f7a38201360 secure :-1 s=READY pgs=105 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a38038c20 tx=0x7f7a380af960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:56.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.009+0000 7f7a25ffb640 1 -- 10.20.193.58:0/4200831248 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7a28023070 con 0x7f7a3815dcf0 2026-02-23T06:37:56.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.009+0000 7f7a25ffb640 1 -- 10.20.193.58:0/4200831248 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5413 (secure 0 0 0) 0x7f7a28011b80 con 0x7f7a3815dcf0 2026-02-23T06:37:56.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.009+0000 7f7a25ffb640 1 -- 10.20.193.58:0/4200831248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7a3815dcf0 msgr2=0x7f7a38201360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:56.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.009+0000 7f7a25ffb640 1 --2- 10.20.193.58:0/4200831248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7a3815dcf0 0x7f7a38201360 secure :-1 s=READY pgs=105 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a38038c20 tx=0x7f7a380af960 comp rx=0 tx=0).stop 2026-02-23T06:37:56.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.009+0000 7f7a25ffb640 1 -- 10.20.193.58:0/4200831248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7a3815dcf0 msgr2=0x7f7a38201360 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:37:56.004 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.009+0000 7f7a25ffb640 1 --2- 10.20.193.58:0/4200831248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7a3815dcf0 0x7f7a38201360 unknown :-1 s=CLOSED pgs=105 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:56.004 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:37:56.004 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:37:56.004 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:37:56.004 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:37:56.004 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 142, 2026-02-23T06:37:56.004 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 188591, 2026-02-23T06:37:56.005 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:37:56.005 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:37:56.005 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:37:56.005 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:37:56.005 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:56.005 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:37:56.005 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:37:56.005 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:37:56.005 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:37:56.005 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:56.005 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:56.006 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:56.006 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:56.006 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:56.006 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:56.006 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:56.006 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:56.006 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:56.006 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:56.006 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:56.006 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:56.006 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:56.006 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:56.006 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:37:56.007 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:37:56.007 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:56.007 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:56.007 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:56.007 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:56.007 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:56.007 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:56.007 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:56.007 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:56.007 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:56.007 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:56.007 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:56.007 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:56.008 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:56.008 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:56.008 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:56.008 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:37:56.008 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:37:56.008 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:37:56.008 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:37:56.008 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:37:56.008 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:37:56.008 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:37:56.008 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:37:56.008 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:37:56.009 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:37:56.009 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:37:56.009 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:37:56.009 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:37:56.009 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:37:56.009 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:37:56.009 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:37:56.009 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:37:56.009 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:37:56.009 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:37:56.009 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:37:56.009 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:37:56.010 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:37:56.010 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:37:56.010 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:37:56.010 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:37:56.010 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:37:56.010 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:37:56.010 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:37:56.010 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:37:56.010 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:37:56.010 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:56.010 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:37:56.010 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:56.011 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:37:56.011 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:56.011 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:37:56.011 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:37:56.011 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:56.011 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:56.011 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:56.011 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:56.011 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:37:56.011 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:56.011 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:56.011 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:56.011 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:56.012 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:37:56.012 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:56.012 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:56.012 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:56.012 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:56.012 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:37:56.012 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:37:56.012 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:56.012 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:56.012 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:37:56.012 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:56.012 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:56.012 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:56.013 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:37:56.013 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:37:56.013 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:56.013 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:56.013 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:56.013 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:56.013 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:37:56.013 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:56.013 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:56.013 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:56.013 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:56.013 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:37:56.014 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:56.014 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:56.014 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:56.014 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:56.014 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:37:56.014 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:37:56.014 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:56.014 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:56.014 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:37:56.014 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:56.014 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:56.014 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:56.015 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:37:56.015 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:37:56.015 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:37:56.015 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:37:56.015 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:56.015 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:37:56.015 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:37:56.015 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:56.015 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:56.015 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:56.015 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:37:56.015 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:37:56.015 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:37:56.016 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:56.016 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:56.016 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:56.016 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:37:56.016 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:37:56.016 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:37:56.016 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:37:56.016 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:37:56.016 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:37:56.016 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:56.016 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:56.016 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:56.016 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:37:56.017 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:37:56.017 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:56.017 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:56.017 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:56.017 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:37:56.017 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:56.017 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:56.017 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:37:56.017 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:56.017 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:56.017 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:56.017 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:37:56.018 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:56.018 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:56.018 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:37:56.018 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:56.018 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:56.018 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:56.018 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:37:56.018 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:56.018 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:56.018 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:37:56.018 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:56.018 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:56.018 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:56.019 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:37:56.019 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:56.019 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:37:56.019 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:37:56.019 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:37:56.019 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:37:56.019 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:37:56.019 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:37:56.019 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:37:56.019 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:37:56.019 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:37:56.019 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:37:56.019 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:37:56.021 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.009+0000 7f7a3e175640 1 -- 10.20.193.58:0/4200831248 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7a0807a660 msgr2=0x7f7a0809ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:56.021 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.009+0000 7f7a3e175640 1 --2- 10.20.193.58:0/4200831248 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7a0807a660 0x7f7a0809ab10 secure :-1 s=READY pgs=385 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a2c0027a0 tx=0x7f7a2c031040 comp rx=0 tx=0).stop 2026-02-23T06:37:56.021 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.009+0000 7f7a3e175640 1 -- 10.20.193.58:0/4200831248 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7a3813fea0 msgr2=0x7f7a3813c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:56.021 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.009+0000 7f7a3e175640 1 --2- 10.20.193.58:0/4200831248 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7a3813fea0 0x7f7a3813c7f0 secure :-1 s=READY pgs=230 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a38163350 tx=0x7f7a34003f30 comp rx=0 tx=0).stop 2026-02-23T06:37:56.021 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.009+0000 7f7a3d974640 1 -- 10.20.193.58:0/4200831248 reap_dead start 2026-02-23T06:37:56.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.009+0000 7f7a3d974640 1 -- 10.20.193.58:0/4200831248 reap_dead start 2026-02-23T06:37:56.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.009+0000 7f7a3e175640 1 -- 10.20.193.58:0/4200831248 shutdown_connections 2026-02-23T06:37:56.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.009+0000 7f7a3e175640 1 -- 10.20.193.58:0/4200831248 >> 10.20.193.58:0/4200831248 conn(0x7f7a380b3c20 msgr2=0x7f7a3813e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:56.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.009+0000 7f7a3e175640 1 -- 10.20.193.58:0/4200831248 shutdown_connections 2026-02-23T06:37:56.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.009+0000 7f7a3e175640 1 -- 10.20.193.58:0/4200831248 wait complete. 2026-02-23T06:37:56.022 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:37:56.022 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:37:56.023 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:37:56.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.148+0000 7fc3d0c83640 1 -- 10.20.193.58:0/2814981198 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc3cc15d4a0 msgr2=0x7fc3cc0affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:56.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.148+0000 7fc3d0c83640 1 --2- 10.20.193.58:0/2814981198 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc3cc15d4a0 0x7fc3cc0affb0 secure :-1 s=READY pgs=106 gs=3 cs=0 l=1 c_cookie=12172136769366545047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3cc0b5040 tx=0x7fc3b802f260 comp rx=0 tx=0).stop 2026-02-23T06:37:56.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.148+0000 7fc3d0c83640 1 -- 10.20.193.58:0/2814981198 shutdown_connections 2026-02-23T06:37:56.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.148+0000 7fc3d0c83640 1 --2- 10.20.193.58:0/2814981198 >> v2:10.20.193.58:3300/0 conn(0x7fc3cc0b6690 0x7fc3cc058cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:56.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.148+0000 7fc3d0c83640 1 --2- 10.20.193.58:0/2814981198 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc3cc15d870 0x7fc3cc0587b0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:56.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.148+0000 7fc3d0c83640 1 --2- 10.20.193.58:0/2814981198 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc3cc15d4a0 0x7fc3cc0affb0 unknown :-1 s=CLOSED pgs=106 gs=3 cs=0 l=1 c_cookie=12172136769366545047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:56.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.148+0000 7fc3d0c83640 1 -- 10.20.193.58:0/2814981198 >> 10.20.193.58:0/2814981198 conn(0x7fc3cc0b3c20 msgr2=0x7fc3cc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:37:56.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.149+0000 7fc3d0c83640 1 -- 10.20.193.58:0/2814981198 shutdown_connections 2026-02-23T06:37:56.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.149+0000 7fc3d0c83640 1 -- 10.20.193.58:0/2814981198 wait complete. 2026-02-23T06:37:56.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.150+0000 7fc3d0c83640 1 Processor -- start 2026-02-23T06:37:56.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.150+0000 7fc3d0c83640 1 -- start start 2026-02-23T06:37:56.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.150+0000 7fc3d0c83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc3cc0b6690 0x7fc3cc15a750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:56.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.150+0000 7fc3d0c83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc3cc15d4a0 0x7fc3cc160f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:56.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.150+0000 7fc3d0c83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc3cc15d870 0x7fc3cc15de40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:56.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.150+0000 7fc3d0c83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc201830 con 0x7fc3cc15d4a0 2026-02-23T06:37:56.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.150+0000 7fc3d0c83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc163210 con 0x7fc3cc15d870 2026-02-23T06:37:56.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.150+0000 7fc3d0c83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc3cc201c50 con 0x7fc3cc0b6690 2026-02-23T06:37:56.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.151+0000 7fc3caffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc3cc15d4a0 0x7fc3cc160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:56.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.151+0000 7fc3cb7fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc3cc0b6690 0x7fc3cc15a750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:56.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.151+0000 7fc3caffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc3cc15d4a0 0x7fc3cc160f90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:42024/0 (socket says 10.20.193.58:42024) 2026-02-23T06:37:56.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.151+0000 7fc3caffd640 1 -- 10.20.193.58:0/2491347449 learned_addr learned my addr 10.20.193.58:0/2491347449 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:37:56.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.151+0000 7fc3cbfff640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc3cc15d870 0x7fc3cc15de40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:56.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.151+0000 7fc3cb7fe640 1 -- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc3cc0b6690 msgr2=0x7fc3cc15a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-23T06:37:56.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.151+0000 7fc3cb7fe640 1 -- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc3cc0b6690 msgr2=0x7fc3cc15a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:37:56.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.151+0000 7fc3cb7fe640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc3cc0b6690 0x7fc3cc15a750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:37:56.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.151+0000 7fc3cb7fe640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc3cc0b6690 0x7fc3cc15a750 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:37:56.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.151+0000 7fc3caffd640 1 -- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc3cc0b6690 msgr2=0x7fc3cc15a750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:37:56.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.151+0000 7fc3caffd640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc3cc0b6690 0x7fc3cc15a750 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:56.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.151+0000 7fc3caffd640 1 -- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc3cc15d870 msgr2=0x7fc3cc15de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:37:56.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.151+0000 7fc3caffd640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc3cc15d870 0x7fc3cc15de40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:37:56.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.151+0000 7fc3caffd640 1 -- 10.20.193.58:0/2491347449 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b8009570 con 0x7fc3cc15d4a0 2026-02-23T06:37:56.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.151+0000 7fc3caffd640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc3cc15d4a0 0x7fc3cc160f90 secure :-1 s=READY pgs=231 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3bc005db0 tx=0x7fc3bc00ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:56.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.151+0000 7fc3a7fff640 1 -- 10.20.193.58:0/2491347449 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc3bc004540 con 0x7fc3cc15d4a0 2026-02-23T06:37:56.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.151+0000 7fc3a7fff640 1 -- 10.20.193.58:0/2491347449 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3bc004960 con 0x7fc3cc15d4a0 2026-02-23T06:37:56.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.151+0000 7fc3a7fff640 1 -- 10.20.193.58:0/2491347449 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc3bc004d90 con 0x7fc3cc15d4a0 2026-02-23T06:37:56.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.151+0000 7fc3d0c83640 1 -- 10.20.193.58:0/2491347449 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3cc162f30 con 0x7fc3cc15d4a0 2026-02-23T06:37:56.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.151+0000 7fc3d0c83640 1 -- 10.20.193.58:0/2491347449 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3cc201170 con 0x7fc3cc15d4a0 2026-02-23T06:37:56.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.152+0000 7fc3d0c83640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 0x7fc38c0246a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:56.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.152+0000 7fc3d0c83640 1 -- 10.20.193.58:0/2491347449 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc38c025f20 con 0x7fc38c0041f0 2026-02-23T06:37:56.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.152+0000 7fc3cb7fe640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 0x7fc38c0246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:56.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.152+0000 7fc3cb7fe640 1 -- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 msgr2=0x7fc38c0246a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-23T06:37:56.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.152+0000 7fc3cb7fe640 1 -- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 msgr2=0x7fc38c0246a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:37:56.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.152+0000 7fc3cb7fe640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 0x7fc38c0246a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:37:56.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.152+0000 7fc3cb7fe640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 0x7fc38c0246a0 unknown :-1 s=START_CONNECT pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:37:56.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.153+0000 7fc3a7fff640 1 -- 10.20.193.58:0/2491347449 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fc3bc009820 con 0x7fc3cc15d4a0 2026-02-23T06:37:56.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.155+0000 7fc3a7fff640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc39c07a6c0 0x7fc39c09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:37:56.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.155+0000 7fc3a7fff640 1 -- 10.20.193.58:0/2491347449 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fc3bc09dcf0 con 0x7fc3cc15d4a0 2026-02-23T06:37:56.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.155+0000 7fc3cbfff640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc39c07a6c0 0x7fc39c09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:56.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.156+0000 7fc3cbfff640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc39c07a6c0 0x7fc39c09ab70 secure :-1 s=READY pgs=386 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3c0005820 tx=0x7fc3c000a310 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:37:56.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.353+0000 7fc3cb7fe640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 0x7fc38c0246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:56.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.353+0000 7fc3cb7fe640 1 -- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 msgr2=0x7fc38c0246a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:37:56.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.353+0000 7fc3cb7fe640 1 -- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 msgr2=0x7fc38c0246a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:37:56.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.353+0000 7fc3cb7fe640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 0x7fc38c0246a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:37:56.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.353+0000 7fc3cb7fe640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 0x7fc38c0246a0 unknown :-1 s=START_CONNECT pgs=0 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-23T06:37:56.748 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.754+0000 7fc3cb7fe640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 0x7fc38c0246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=10 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:56.748 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.754+0000 7fc3cb7fe640 1 -- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 msgr2=0x7fc38c0246a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:37:56.748 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.754+0000 7fc3cb7fe640 1 -- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 msgr2=0x7fc38c0246a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:37:56.748 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.754+0000 7fc3cb7fe640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 0x7fc38c0246a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=10 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:37:56.749 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:56.754+0000 7fc3cb7fe640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 0x7fc38c0246a0 unknown :-1 s=START_CONNECT pgs=0 gs=11 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-23T06:37:57.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:57.560+0000 7fc3cb7fe640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 0x7fc38c0246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=12 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:57.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:57.561+0000 7fc3cb7fe640 1 -- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 msgr2=0x7fc38c0246a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:37:57.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:57.561+0000 7fc3cb7fe640 1 -- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 msgr2=0x7fc38c0246a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:37:57.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:57.561+0000 7fc3cb7fe640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 0x7fc38c0246a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=12 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:37:57.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:57.561+0000 7fc3cb7fe640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 0x7fc38c0246a0 unknown :-1 s=START_CONNECT pgs=0 gs=13 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-23T06:37:59.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:59.162+0000 7fc3cb7fe640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 0x7fc38c0246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=14 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:37:59.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:59.163+0000 7fc3cb7fe640 1 -- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 msgr2=0x7fc38c0246a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:37:59.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:59.163+0000 7fc3cb7fe640 1 -- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 msgr2=0x7fc38c0246a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:37:59.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:59.163+0000 7fc3cb7fe640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 0x7fc38c0246a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=14 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:37:59.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:37:59.163+0000 7fc3cb7fe640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 0x7fc38c0246a0 unknown :-1 s=START_CONNECT pgs=0 gs=15 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2026-02-23T06:38:00.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.150+0000 7fc3a6ffd640 1 -- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 msgr2=0x7fc38c0246a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:38:00.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.150+0000 7fc3a6ffd640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 0x7fc38c0246a0 unknown :-1 s=START_CONNECT pgs=0 gs=15 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:00.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.150+0000 7fc3a6ffd640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc398003600 0x7fc398023a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:00.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.150+0000 7fc3a6ffd640 1 -- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 msgr2=0x7fc38c0246a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:38:00.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.150+0000 7fc3a6ffd640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c0041f0 0x7fc38c0246a0 unknown :-1 s=CLOSED pgs=0 gs=15 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:00.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.150+0000 7fc3a6ffd640 1 -- 10.20.193.58:0/2491347449 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc38c025f20 con 0x7fc398003600 2026-02-23T06:38:00.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.151+0000 7fc3cb7fe640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc398003600 0x7fc398023a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=16 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:00.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.151+0000 7fc3cb7fe640 1 -- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc398003600 msgr2=0x7fc398023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:38:00.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.151+0000 7fc3cb7fe640 1 -- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc398003600 msgr2=0x7fc398023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:38:00.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.151+0000 7fc3cb7fe640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc398003600 0x7fc398023a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=16 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:38:00.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.151+0000 7fc3cb7fe640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc398003600 0x7fc398023a80 unknown :-1 s=START_CONNECT pgs=0 gs=17 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:38:00.346 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.352+0000 7fc3cb7fe640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc398003600 0x7fc398023a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=18 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:00.346 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.352+0000 7fc3cb7fe640 1 -- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc398003600 msgr2=0x7fc398023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:38:00.346 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.352+0000 7fc3cb7fe640 1 -- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc398003600 msgr2=0x7fc398023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:38:00.346 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.352+0000 7fc3cb7fe640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc398003600 0x7fc398023a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=18 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:38:00.346 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.352+0000 7fc3cb7fe640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc398003600 0x7fc398023a80 unknown :-1 s=START_CONNECT pgs=0 gs=19 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-23T06:38:00.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.753+0000 7fc3cb7fe640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc398003600 0x7fc398023a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=20 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:00.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.753+0000 7fc3cb7fe640 1 -- 10.20.193.58:0/2491347449 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc398024160 con 0x7fc398003600 2026-02-23T06:38:00.748 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.754+0000 7fc3cb7fe640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc398003600 0x7fc398023a80 secure :-1 s=READY pgs=3 gs=20 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3b8004740 tx=0x7fc3b8004410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:38:00.748 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.754+0000 7fc3a7fff640 1 -- 10.20.193.58:0/2491347449 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc3b80028b0 con 0x7fc398003600 2026-02-23T06:38:00.748 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.754+0000 7fc3a7fff640 1 -- 10.20.193.58:0/2491347449 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fc3b8038470 con 0x7fc398003600 2026-02-23T06:38:00.749 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.754+0000 7fc3a7fff640 1 -- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc398003600 msgr2=0x7fc398023a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:00.749 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.754+0000 7fc3a7fff640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc398003600 0x7fc398023a80 secure :-1 s=READY pgs=3 gs=20 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3b8004740 tx=0x7fc3b8004410 comp rx=0 tx=0).stop 2026-02-23T06:38:00.749 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.754+0000 7fc3a7fff640 1 -- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc398003600 msgr2=0x7fc398023a80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:38:00.749 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.754+0000 7fc3a7fff640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc398003600 0x7fc398023a80 unknown :-1 s=CLOSED pgs=3 gs=20 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:00.752 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.758+0000 7fc3d0c83640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c024f80 0x7fc38c0253e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:00.752 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.758+0000 7fc3d0c83640 1 -- 10.20.193.58:0/2491347449 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc38c025ae0 con 0x7fc38c024f80 2026-02-23T06:38:00.752 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.758+0000 7fc3cb7fe640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c024f80 0x7fc38c0253e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=21 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:00.753 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.759+0000 7fc3cb7fe640 1 -- 10.20.193.58:0/2491347449 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc38c025ca0 con 0x7fc38c024f80 2026-02-23T06:38:00.753 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.759+0000 7fc3cb7fe640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c024f80 0x7fc38c0253e0 secure :-1 s=READY pgs=4 gs=21 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3b8004740 tx=0x7fc3b8009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:38:00.754 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.759+0000 7fc3a7fff640 1 -- 10.20.193.58:0/2491347449 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc3b80385e0 con 0x7fc38c024f80 2026-02-23T06:38:00.754 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.759+0000 7fc3a7fff640 1 -- 10.20.193.58:0/2491347449 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4910 (secure 0 0 0) 0x7fc3b8061450 con 0x7fc38c024f80 2026-02-23T06:38:00.754 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.759+0000 7fc3a7fff640 1 -- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c024f80 msgr2=0x7fc38c0253e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:00.754 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.759+0000 7fc3a7fff640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c024f80 0x7fc38c0253e0 secure :-1 s=READY pgs=4 gs=21 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3b8004740 tx=0x7fc3b8009310 comp rx=0 tx=0).stop 2026-02-23T06:38:00.754 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.759+0000 7fc3a7fff640 1 -- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c024f80 msgr2=0x7fc38c0253e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:38:00.754 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.759+0000 7fc3a7fff640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc38c024f80 0x7fc38c0253e0 unknown :-1 s=CLOSED pgs=4 gs=21 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:00.754 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.760+0000 7fc3cbfff640 1 -- 10.20.193.58:0/2491347449 reap_dead start 2026-02-23T06:38:00.755 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:38:00.755 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:38:00.755 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:38:00.755 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:38:00.755 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 142, 2026-02-23T06:38:00.755 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 5275, 2026-02-23T06:38:00.755 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:38:00.756 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:38:00.756 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:38:00.756 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:38:00.756 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:00.756 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 5, 2026-02-23T06:38:00.756 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:38:00.756 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:38:00.756 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:38:00.756 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:38:00.756 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:38:00.756 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:38:00.756 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:38:00.757 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:38:00.757 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:38:00.757 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:38:00.757 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:38:00.757 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:38:00.757 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:38:00.757 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:38:00.757 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:38:00.757 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:38:00.757 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:00.757 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:38:00.757 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:38:00.757 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:38:00.758 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:38:00.758 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:38:00.758 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:38:00.758 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:38:00.758 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:38:00.758 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:38:00.758 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:38:00.758 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:38:00.758 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:38:00.758 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:38:00.758 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:38:00.758 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:38:00.759 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:00.759 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:00.759 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:38:00.759 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:38:00.759 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:38:00.759 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:38:00.759 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:38:00.759 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:38:00.759 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:38:00.759 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:38:00.759 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:38:00.759 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:38:00.760 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:38:00.760 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:38:00.760 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:38:00.760 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:38:00.760 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:38:00.760 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:38:00.760 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:38:00.760 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:38:00.760 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:38:00.760 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:38:00.760 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:38:00.760 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:38:00.760 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:38:00.761 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:38:00.761 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:38:00.761 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:38:00.761 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:38:00.761 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:38:00.761 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:38:00.761 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:38:00.761 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:00.761 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:38:00.761 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:00.761 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:38:00.761 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:00.762 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:38:00.762 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:38:00.762 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:38:00.762 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:38:00.762 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:00.762 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:38:00.762 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:38:00.762 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:00.762 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:00.762 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:00.762 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:38:00.762 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:38:00.762 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:00.763 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:00.763 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:00.763 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:00.763 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:38:00.763 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:38:00.763 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:38:00.763 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:38:00.763 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:38:00.763 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:38:00.763 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:00.763 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:00.763 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:38:00.763 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:38:00.764 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:38:00.764 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:38:00.764 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:00.764 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:38:00.764 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:38:00.764 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:00.764 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:00.764 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:00.764 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:38:00.764 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:38:00.764 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:00.764 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:00.765 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:00.765 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:00.765 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:38:00.765 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:38:00.765 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:38:00.765 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:38:00.765 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:38:00.765 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:38:00.765 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:00.765 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:00.765 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:38:00.765 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:38:00.765 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:38:00.766 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:38:00.766 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:00.766 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:38:00.766 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:38:00.766 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:00.766 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:00.766 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:00.766 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:38:00.766 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:38:00.766 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:00.766 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:00.766 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:00.766 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:00.767 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:38:00.767 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:38:00.767 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:38:00.767 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:38:00.767 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:38:00.767 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:38:00.767 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:00.767 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:00.767 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:00.767 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:38:00.767 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:38:00.767 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:00.768 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:38:00.768 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:38:00.768 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:38:00.768 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:00.768 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:00.768 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:38:00.768 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:00.768 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:38:00.768 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:38:00.768 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:38:00.768 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:00.768 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:00.768 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:00.769 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:38:00.769 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:38:00.770 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.760+0000 7fc3d0c83640 1 -- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc39c07a6c0 msgr2=0x7fc39c09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:00.770 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.760+0000 7fc3d0c83640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc39c07a6c0 0x7fc39c09ab70 secure :-1 s=READY pgs=386 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3c0005820 tx=0x7fc3c000a310 comp rx=0 tx=0).stop 2026-02-23T06:38:00.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.760+0000 7fc3d0c83640 1 -- 10.20.193.58:0/2491347449 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc3cc15d4a0 msgr2=0x7fc3cc160f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:00.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.760+0000 7fc3d0c83640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc3cc15d4a0 0x7fc3cc160f90 secure :-1 s=READY pgs=231 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3bc005db0 tx=0x7fc3bc00ddf0 comp rx=0 tx=0).stop 2026-02-23T06:38:00.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.760+0000 7fc3d0c83640 1 -- 10.20.193.58:0/2491347449 shutdown_connections 2026-02-23T06:38:00.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.760+0000 7fc3d0c83640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc39c07a6c0 0x7fc39c09ab70 unknown :-1 s=CLOSED pgs=386 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:00.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.760+0000 7fc3d0c83640 1 --2- 10.20.193.58:0/2491347449 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc3cc15d4a0 0x7fc3cc160f90 unknown :-1 s=CLOSED pgs=231 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:00.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.760+0000 7fc3d0c83640 1 -- 10.20.193.58:0/2491347449 >> 10.20.193.58:0/2491347449 conn(0x7fc3cc0b3c20 msgr2=0x7fc3cc05d100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:38:00.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.760+0000 7fc3d0c83640 1 -- 10.20.193.58:0/2491347449 shutdown_connections 2026-02-23T06:38:00.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.760+0000 7fc3d0c83640 1 -- 10.20.193.58:0/2491347449 wait complete. 2026-02-23T06:38:00.772 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:38:00.772 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:38:00.772 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:38:00.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.901+0000 7fa4e4047640 1 -- 10.20.193.58:0/3698965441 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa4dc158740 msgr2=0x7fa4dc0b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:00.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.901+0000 7fa4e4047640 1 --2- 10.20.193.58:0/3698965441 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa4dc158740 0x7fa4dc0b72c0 secure :-1 s=READY pgs=5 gs=2 cs=0 l=1 c_cookie=7177242300340522111 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4cc005e70 tx=0x7fa4cc02f290 comp rx=0 tx=0).stop 2026-02-23T06:38:00.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.901+0000 7fa4e4047640 1 -- 10.20.193.58:0/3698965441 shutdown_connections 2026-02-23T06:38:00.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.901+0000 7fa4e4047640 1 --2- 10.20.193.58:0/3698965441 >> v2:10.20.193.93:3300/0 conn(0x7fa4dc0b6a20 0x7fa4dc0b3300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:00.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.901+0000 7fa4e4047640 1 --2- 10.20.193.58:0/3698965441 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa4dc158740 0x7fa4dc0b72c0 unknown :-1 s=CLOSED pgs=5 gs=2 cs=0 l=1 c_cookie=7177242300340522111 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:00.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.901+0000 7fa4e4047640 1 -- 10.20.193.58:0/3698965441 >> 10.20.193.58:0/3698965441 conn(0x7fa4dc058e50 msgr2=0x7fa4dc059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:38:00.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.901+0000 7fa4e4047640 1 -- 10.20.193.58:0/3698965441 shutdown_connections 2026-02-23T06:38:00.897 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.901+0000 7fa4e4047640 1 -- 10.20.193.58:0/3698965441 wait complete. 2026-02-23T06:38:00.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.902+0000 7fa4e4047640 1 Processor -- start 2026-02-23T06:38:00.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.902+0000 7fa4e4047640 1 -- start start 2026-02-23T06:38:00.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.903+0000 7fa4e4047640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa4dc0b6a20 0x7fa4dc0b0080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:00.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.903+0000 7fa4e4047640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa4dc158740 0x7fa4dc201550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:00.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.903+0000 7fa4e4047640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa4dc161ee0 0x7fa4dc155300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:00.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.903+0000 7fa4e4047640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc1fe940 con 0x7fa4dc161ee0 2026-02-23T06:38:00.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.903+0000 7fa4e4047640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc15c0b0 con 0x7fa4dc158740 2026-02-23T06:38:00.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.903+0000 7fa4e4047640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa4dc0b0d90 con 0x7fa4dc0b6a20 2026-02-23T06:38:00.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.903+0000 7fa4e1dbc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa4dc0b6a20 0x7fa4dc0b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:00.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.903+0000 7fa4e25bd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa4dc161ee0 0x7fa4dc155300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:00.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.903+0000 7fa4e1dbc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa4dc0b6a20 0x7fa4dc0b0080 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:43368/0 (socket says 10.20.193.58:43368) 2026-02-23T06:38:00.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.903+0000 7fa4e1dbc640 1 -- 10.20.193.58:0/48357735 learned_addr learned my addr 10.20.193.58:0/48357735 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:38:00.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.903+0000 7fa4e15bb640 1 --2- 10.20.193.58:0/48357735 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa4dc158740 0x7fa4dc201550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:00.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.904+0000 7fa4e25bd640 1 -- 10.20.193.58:0/48357735 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa4dc0b6a20 msgr2=0x7fa4dc0b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:00.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.904+0000 7fa4e25bd640 1 --2- 10.20.193.58:0/48357735 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa4dc0b6a20 0x7fa4dc0b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:00.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.904+0000 7fa4e25bd640 1 -- 10.20.193.58:0/48357735 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa4dc158740 msgr2=0x7fa4dc201550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:00.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.904+0000 7fa4e25bd640 1 --2- 10.20.193.58:0/48357735 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa4dc158740 0x7fa4dc201550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:00.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.904+0000 7fa4e25bd640 1 -- 10.20.193.58:0/48357735 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4cc009570 con 0x7fa4dc161ee0 2026-02-23T06:38:00.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.904+0000 7fa4e25bd640 1 --2- 10.20.193.58:0/48357735 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa4dc161ee0 0x7fa4dc155300 secure :-1 s=READY pgs=232 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4dc0b6e40 tx=0x7fa4d800fde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:38:00.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.904+0000 7fa4ca7fc640 1 -- 10.20.193.58:0/48357735 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa4d800dcb0 con 0x7fa4dc161ee0 2026-02-23T06:38:00.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.904+0000 7fa4ca7fc640 1 -- 10.20.193.58:0/48357735 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4d800de30 con 0x7fa4dc161ee0 2026-02-23T06:38:00.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.904+0000 7fa4ca7fc640 1 -- 10.20.193.58:0/48357735 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa4d8005b90 con 0x7fa4dc161ee0 2026-02-23T06:38:00.901 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.904+0000 7fa4e4047640 1 -- 10.20.193.58:0/48357735 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4dc162a00 con 0x7fa4dc161ee0 2026-02-23T06:38:00.901 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.904+0000 7fa4e4047640 1 -- 10.20.193.58:0/48357735 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4dc05cf50 con 0x7fa4dc161ee0 2026-02-23T06:38:00.901 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.905+0000 7fa4e4047640 1 -- 10.20.193.58:0/48357735 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4a8005300 con 0x7fa4dc161ee0 2026-02-23T06:38:00.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.906+0000 7fa4ca7fc640 1 -- 10.20.193.58:0/48357735 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fa4d8020060 con 0x7fa4dc161ee0 2026-02-23T06:38:00.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.907+0000 7fa4ca7fc640 1 --2- 10.20.193.58:0/48357735 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa4ac07a6c0 0x7fa4ac09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:00.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.907+0000 7fa4ca7fc640 1 -- 10.20.193.58:0/48357735 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fa4d8015070 con 0x7fa4dc161ee0 2026-02-23T06:38:00.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.907+0000 7fa4e1dbc640 1 --2- 10.20.193.58:0/48357735 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa4ac07a6c0 0x7fa4ac09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:00.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.908+0000 7fa4e1dbc640 1 --2- 10.20.193.58:0/48357735 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa4ac07a6c0 0x7fa4ac09ab70 secure :-1 s=READY pgs=387 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4cc0098a0 tx=0x7fa4cc03a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:38:00.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:00.908+0000 7fa4ca7fc640 1 -- 10.20.193.58:0/48357735 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fa4d8061d10 con 0x7fa4dc161ee0 2026-02-23T06:38:01.058 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:01.064+0000 7fa4e4047640 1 -- 10.20.193.58:0/48357735 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fa4a8005dc0 con 0x7fa4dc161ee0 2026-02-23T06:38:01.058 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:01.064+0000 7fa4ca7fc640 1 -- 10.20.193.58:0/48357735 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fa4d8064ec0 con 0x7fa4dc161ee0 2026-02-23T06:38:01.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:01.066+0000 7fa4e4047640 1 -- 10.20.193.58:0/48357735 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa4ac07a6c0 msgr2=0x7fa4ac09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:01.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:01.066+0000 7fa4e4047640 1 --2- 10.20.193.58:0/48357735 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa4ac07a6c0 0x7fa4ac09ab70 secure :-1 s=READY pgs=387 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4cc0098a0 tx=0x7fa4cc03a040 comp rx=0 tx=0).stop 2026-02-23T06:38:01.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:01.066+0000 7fa4e4047640 1 -- 10.20.193.58:0/48357735 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa4dc161ee0 msgr2=0x7fa4dc155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:01.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:01.066+0000 7fa4e4047640 1 --2- 10.20.193.58:0/48357735 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa4dc161ee0 0x7fa4dc155300 secure :-1 s=READY pgs=232 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4dc0b6e40 tx=0x7fa4d800fde0 comp rx=0 tx=0).stop 2026-02-23T06:38:01.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:01.066+0000 7fa4e4047640 1 -- 10.20.193.58:0/48357735 shutdown_connections 2026-02-23T06:38:01.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:01.066+0000 7fa4e4047640 1 --2- 10.20.193.58:0/48357735 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa4ac07a6c0 0x7fa4ac09ab70 unknown :-1 s=CLOSED pgs=387 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:01.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:01.066+0000 7fa4e4047640 1 --2- 10.20.193.58:0/48357735 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa4dc161ee0 0x7fa4dc155300 unknown :-1 s=CLOSED pgs=232 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:01.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:01.066+0000 7fa4e4047640 1 --2- 10.20.193.58:0/48357735 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa4dc158740 0x7fa4dc201550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:01.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:01.066+0000 7fa4e4047640 1 --2- 10.20.193.58:0/48357735 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa4dc0b6a20 0x7fa4dc0b0080 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:01.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:01.066+0000 7fa4e4047640 1 -- 10.20.193.58:0/48357735 >> 10.20.193.58:0/48357735 conn(0x7fa4dc058e50 msgr2=0x7fa4dc160740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:38:01.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:01.066+0000 7fa4e4047640 1 -- 10.20.193.58:0/48357735 shutdown_connections 2026-02-23T06:38:01.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:01.066+0000 7fa4e4047640 1 -- 10.20.193.58:0/48357735 wait complete. 2026-02-23T06:38:01.074 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:38:11.075 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:38:11.075 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:38:11.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.241+0000 7f8baac43640 1 -- 10.20.193.58:0/2083876783 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ba415d4a0 msgr2=0x7f8ba4163d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:11.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.241+0000 7f8baac43640 1 --2- 10.20.193.58:0/2083876783 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ba415d4a0 0x7f8ba4163d60 secure :-1 s=READY pgs=6 gs=2 cs=0 l=1 c_cookie=15365821038022227858 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ba0005e70 tx=0x7f8ba002f200 comp rx=0 tx=0).stop 2026-02-23T06:38:11.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.242+0000 7f8baac43640 1 -- 10.20.193.58:0/2083876783 shutdown_connections 2026-02-23T06:38:11.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.242+0000 7f8baac43640 1 --2- 10.20.193.58:0/2083876783 >> v2:10.20.193.58:3300/0 conn(0x7f8ba4058970 0x7f8ba40b6700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:11.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.242+0000 7f8baac43640 1 --2- 10.20.193.58:0/2083876783 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ba415d4a0 0x7f8ba4163d60 unknown :-1 s=CLOSED pgs=6 gs=2 cs=0 l=1 c_cookie=15365821038022227858 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:11.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.242+0000 7f8baac43640 1 -- 10.20.193.58:0/2083876783 >> 10.20.193.58:0/2083876783 conn(0x7f8ba40b3c20 msgr2=0x7f8ba40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:38:11.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.242+0000 7f8baac43640 1 -- 10.20.193.58:0/2083876783 shutdown_connections 2026-02-23T06:38:11.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.242+0000 7f8baac43640 1 -- 10.20.193.58:0/2083876783 wait complete. 2026-02-23T06:38:11.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.243+0000 7f8baac43640 1 Processor -- start 2026-02-23T06:38:11.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.243+0000 7f8baac43640 1 -- start start 2026-02-23T06:38:11.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.244+0000 7f8baac43640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8ba4058970 0x7f8ba415dc00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:11.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.244+0000 7f8baac43640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ba4058da0 0x7f8ba4141490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:11.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.244+0000 7f8baac43640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ba415d4a0 0x7f8ba41fc030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:11.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.244+0000 7f8baac43640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba41fbba0 con 0x7f8ba415d4a0 2026-02-23T06:38:11.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.244+0000 7f8baac43640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba4142d70 con 0x7f8ba4058970 2026-02-23T06:38:11.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.244+0000 7f8baac43640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f8ba4142950 con 0x7f8ba4058da0 2026-02-23T06:38:11.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.245+0000 7f8ba9440640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ba4058da0 0x7f8ba4141490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:11.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.245+0000 7f8baa442640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ba415d4a0 0x7f8ba41fc030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:11.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.245+0000 7f8ba9c41640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8ba4058970 0x7f8ba415dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:11.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.245+0000 7f8ba9440640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ba4058da0 0x7f8ba4141490 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:56126/0 (socket says 10.20.193.58:56126) 2026-02-23T06:38:11.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.245+0000 7f8ba9440640 1 -- 10.20.193.58:0/3793848500 learned_addr learned my addr 10.20.193.58:0/3793848500 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:38:11.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.245+0000 7f8ba9440640 1 -- 10.20.193.58:0/3793848500 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8ba4058970 msgr2=0x7f8ba415dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:11.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.245+0000 7f8ba9440640 1 --2- 10.20.193.58:0/3793848500 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8ba4058970 0x7f8ba415dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:11.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.245+0000 7f8ba9440640 1 -- 10.20.193.58:0/3793848500 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ba415d4a0 msgr2=0x7f8ba41fc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:11.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.245+0000 7f8ba9440640 1 --2- 10.20.193.58:0/3793848500 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ba415d4a0 0x7f8ba41fc030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:11.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.246+0000 7f8ba9440640 1 -- 10.20.193.58:0/3793848500 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba0009570 con 0x7f8ba4058da0 2026-02-23T06:38:11.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.246+0000 7f8baa442640 1 --2- 10.20.193.58:0/3793848500 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ba415d4a0 0x7f8ba41fc030 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:38:11.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.246+0000 7f8ba9440640 1 --2- 10.20.193.58:0/3793848500 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ba4058da0 0x7f8ba4141490 secure :-1 s=READY pgs=7 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8b9400c920 tx=0x7f8b9400cdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:38:11.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.246+0000 7f8b927fc640 1 -- 10.20.193.58:0/3793848500 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8b94004540 con 0x7f8ba4058da0 2026-02-23T06:38:11.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.246+0000 7f8b927fc640 1 -- 10.20.193.58:0/3793848500 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b94007950 con 0x7f8ba4058da0 2026-02-23T06:38:11.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.246+0000 7f8b927fc640 1 -- 10.20.193.58:0/3793848500 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8b94007ce0 con 0x7f8ba4058da0 2026-02-23T06:38:11.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.246+0000 7f8baac43640 1 -- 10.20.193.58:0/3793848500 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba4142fe0 con 0x7f8ba4058da0 2026-02-23T06:38:11.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.246+0000 7f8baac43640 1 -- 10.20.193.58:0/3793848500 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba41fb830 con 0x7f8ba4058da0 2026-02-23T06:38:11.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.247+0000 7f8baac43640 1 -- 10.20.193.58:0/3793848500 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b70005300 con 0x7f8ba4058da0 2026-02-23T06:38:11.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.249+0000 7f8b927fc640 1 -- 10.20.193.58:0/3793848500 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f8b940026a0 con 0x7f8ba4058da0 2026-02-23T06:38:11.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.250+0000 7f8b927fc640 1 --2- 10.20.193.58:0/3793848500 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8b7407a6c0 0x7f8b7409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:11.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.250+0000 7f8b927fc640 1 -- 10.20.193.58:0/3793848500 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f8b9409e380 con 0x7f8ba4058da0 2026-02-23T06:38:11.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.250+0000 7f8ba9c41640 1 --2- 10.20.193.58:0/3793848500 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8b7407a6c0 0x7f8b7409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:11.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.250+0000 7f8b927fc640 1 -- 10.20.193.58:0/3793848500 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f8b940615c0 con 0x7f8ba4058da0 2026-02-23T06:38:11.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.251+0000 7f8ba9c41640 1 --2- 10.20.193.58:0/3793848500 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8b7407a6c0 0x7f8b7409ab70 secure :-1 s=READY pgs=388 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ba00098a0 tx=0x7f8ba003c040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:38:11.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.510+0000 7f8baac43640 1 -- 10.20.193.58:0/3793848500 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8b70005950 con 0x7f8ba4058da0 2026-02-23T06:38:11.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.510+0000 7f8b927fc640 1 -- 10.20.193.58:0/3793848500 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f8b9405ee60 con 0x7f8ba4058da0 2026-02-23T06:38:11.505 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":142,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:38:11.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.514+0000 7f8baac43640 1 -- 10.20.193.58:0/3793848500 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8b7407a6c0 msgr2=0x7f8b7409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:11.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.514+0000 7f8baac43640 1 --2- 10.20.193.58:0/3793848500 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8b7407a6c0 0x7f8b7409ab70 secure :-1 s=READY pgs=388 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ba00098a0 tx=0x7f8ba003c040 comp rx=0 tx=0).stop 2026-02-23T06:38:11.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.514+0000 7f8baac43640 1 -- 10.20.193.58:0/3793848500 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ba4058da0 msgr2=0x7f8ba4141490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:11.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.514+0000 7f8baac43640 1 --2- 10.20.193.58:0/3793848500 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ba4058da0 0x7f8ba4141490 secure :-1 s=READY pgs=7 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8b9400c920 tx=0x7f8b9400cdf0 comp rx=0 tx=0).stop 2026-02-23T06:38:11.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.514+0000 7f8baac43640 1 -- 10.20.193.58:0/3793848500 shutdown_connections 2026-02-23T06:38:11.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.514+0000 7f8baac43640 1 --2- 10.20.193.58:0/3793848500 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8b7407a6c0 0x7f8b7409ab70 unknown :-1 s=CLOSED pgs=388 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:11.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.514+0000 7f8baac43640 1 --2- 10.20.193.58:0/3793848500 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ba415d4a0 0x7f8ba41fc030 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:11.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.514+0000 7f8baac43640 1 --2- 10.20.193.58:0/3793848500 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ba4058da0 0x7f8ba4141490 unknown :-1 s=CLOSED pgs=7 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:11.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.514+0000 7f8baac43640 1 --2- 10.20.193.58:0/3793848500 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8ba4058970 0x7f8ba415dc00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:11.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.514+0000 7f8baac43640 1 -- 10.20.193.58:0/3793848500 >> 10.20.193.58:0/3793848500 conn(0x7f8ba40b3c20 msgr2=0x7f8ba405c480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:38:11.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.514+0000 7f8baac43640 1 -- 10.20.193.58:0/3793848500 shutdown_connections 2026-02-23T06:38:11.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.514+0000 7f8baac43640 1 -- 10.20.193.58:0/3793848500 wait complete. 2026-02-23T06:38:11.523 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:38:11.523 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:38:11.523 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:38:11.523 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:38:11.770 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.775+0000 7fac1230c640 1 -- 10.20.193.58:0/55443256 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac0c0b1540 msgr2=0x7fac0c0b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:11.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.775+0000 7fac0affd640 1 -- 10.20.193.58:0/55443256 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fabf0004070 con 0x7fac0c0b1540 2026-02-23T06:38:11.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.775+0000 7fac1230c640 1 --2- 10.20.193.58:0/55443256 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac0c0b1540 0x7fac0c0b5610 secure :-1 s=READY pgs=235 gs=1 cs=0 l=1 c_cookie=8785033512973649416 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fabf0004740 tx=0x7fabf002ff20 comp rx=0 tx=0).stop 2026-02-23T06:38:11.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.776+0000 7fac1230c640 1 -- 10.20.193.58:0/55443256 shutdown_connections 2026-02-23T06:38:11.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.776+0000 7fac1230c640 1 --2- 10.20.193.58:0/55443256 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac0c161d50 0x7fac0c157670 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:11.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.776+0000 7fac1230c640 1 --2- 10.20.193.58:0/55443256 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac0c0b1540 0x7fac0c0b5610 unknown :-1 s=CLOSED pgs=235 gs=1 cs=0 l=1 c_cookie=8785033512973649416 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:11.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.776+0000 7fac1230c640 1 -- 10.20.193.58:0/55443256 >> 10.20.193.58:0/55443256 conn(0x7fac0c058e50 msgr2=0x7fac0c059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:38:11.772 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.776+0000 7fac1230c640 1 -- 10.20.193.58:0/55443256 shutdown_connections 2026-02-23T06:38:11.772 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.776+0000 7fac1230c640 1 -- 10.20.193.58:0/55443256 wait complete. 2026-02-23T06:38:11.774 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.777+0000 7fac1230c640 1 Processor -- start 2026-02-23T06:38:11.774 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.777+0000 7fac1230c640 1 -- start start 2026-02-23T06:38:11.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.778+0000 7fac1230c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac0c0b1540 0x7fac0c1565d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:11.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.778+0000 7fac1230c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fac0c0b1910 0x7fac0c05b850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:11.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.778+0000 7fac1230c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac0c161d50 0x7fac0c05bd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:11.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.779+0000 7fac1230c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fac0c05e910 con 0x7fac0c0b1540 2026-02-23T06:38:11.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.779+0000 7fac1230c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fac0c15daa0 con 0x7fac0c0b1910 2026-02-23T06:38:11.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.779+0000 7fac10882640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac0c161d50 0x7fac0c05bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:11.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.779+0000 7fac10882640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac0c161d50 0x7fac0c05bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:56138/0 (socket says 10.20.193.58:56138) 2026-02-23T06:38:11.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.779+0000 7fac10882640 1 -- 10.20.193.58:0/3200937167 learned_addr learned my addr 10.20.193.58:0/3200937167 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:38:11.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.779+0000 7fac1230c640 1 -- 10.20.193.58:0/3200937167 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fac0c152510 con 0x7fac0c161d50 2026-02-23T06:38:11.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.779+0000 7fac0bfff640 1 --2- 10.20.193.58:0/3200937167 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac0c0b1540 0x7fac0c1565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:11.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.779+0000 7fac0b7fe640 1 --2- 10.20.193.58:0/3200937167 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fac0c0b1910 0x7fac0c05b850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:11.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.779+0000 7fac10882640 1 -- 10.20.193.58:0/3200937167 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fac0c0b1910 msgr2=0x7fac0c05b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:11.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.779+0000 7fac10882640 1 --2- 10.20.193.58:0/3200937167 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fac0c0b1910 0x7fac0c05b850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:11.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.779+0000 7fac10882640 1 -- 10.20.193.58:0/3200937167 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac0c0b1540 msgr2=0x7fac0c1565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:11.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.780+0000 7fac10882640 1 --2- 10.20.193.58:0/3200937167 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac0c0b1540 0x7fac0c1565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:11.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.780+0000 7fac10882640 1 -- 10.20.193.58:0/3200937167 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf00071c0 con 0x7fac0c161d50 2026-02-23T06:38:11.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.780+0000 7fac0bfff640 1 --2- 10.20.193.58:0/3200937167 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac0c0b1540 0x7fac0c1565d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:38:11.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.780+0000 7fac10882640 1 --2- 10.20.193.58:0/3200937167 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac0c161d50 0x7fac0c05bd90 secure :-1 s=READY pgs=8 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac00008fd0 tx=0x7fac0000dba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:38:11.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.780+0000 7fac08ff9640 1 -- 10.20.193.58:0/3200937167 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac00006290 con 0x7fac0c161d50 2026-02-23T06:38:11.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.780+0000 7fac08ff9640 1 -- 10.20.193.58:0/3200937167 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac000063f0 con 0x7fac0c161d50 2026-02-23T06:38:11.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.780+0000 7fac1230c640 1 -- 10.20.193.58:0/3200937167 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac0c15e8c0 con 0x7fac0c161d50 2026-02-23T06:38:11.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.780+0000 7fac1230c640 1 -- 10.20.193.58:0/3200937167 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fac0c05e630 con 0x7fac0c161d50 2026-02-23T06:38:11.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.781+0000 7fac08ff9640 1 -- 10.20.193.58:0/3200937167 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac00004790 con 0x7fac0c161d50 2026-02-23T06:38:11.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.782+0000 7fac08ff9640 1 -- 10.20.193.58:0/3200937167 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fac0001a020 con 0x7fac0c161d50 2026-02-23T06:38:11.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.783+0000 7fac1230c640 1 --2- 10.20.193.58:0/3200937167 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac0c05d2f0 0x7fac0c05d6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:11.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.783+0000 7fac1230c640 1 -- 10.20.193.58:0/3200937167 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fac0c0aecb0 con 0x7fac0c05d2f0 2026-02-23T06:38:11.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.783+0000 7fac08ff9640 1 --2- 10.20.193.58:0/3200937167 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fabe407a6c0 0x7fabe409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:11.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.783+0000 7fac0bfff640 1 --2- 10.20.193.58:0/3200937167 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac0c05d2f0 0x7fac0c05d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:11.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.784+0000 7fac08ff9640 1 -- 10.20.193.58:0/3200937167 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fac0009dec0 con 0x7fac0c161d50 2026-02-23T06:38:11.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.784+0000 7fac0b7fe640 1 --2- 10.20.193.58:0/3200937167 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fabe407a6c0 0x7fabe409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:11.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.784+0000 7fac0bfff640 1 -- 10.20.193.58:0/3200937167 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fac0c0b7540 con 0x7fac0c05d2f0 2026-02-23T06:38:11.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.784+0000 7fac0bfff640 1 --2- 10.20.193.58:0/3200937167 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac0c05d2f0 0x7fac0c05d6c0 secure :-1 s=READY pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fabf00023d0 tx=0x7fabf0004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:38:11.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.784+0000 7fac0b7fe640 1 --2- 10.20.193.58:0/3200937167 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fabe407a6c0 0x7fabe409ab70 secure :-1 s=READY pgs=389 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac0c0af9d0 tx=0x7fabf8005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:38:11.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.785+0000 7fac08ff9640 1 -- 10.20.193.58:0/3200937167 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fabf0007c90 con 0x7fac0c05d2f0 2026-02-23T06:38:11.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.785+0000 7fac08ff9640 1 -- 10.20.193.58:0/3200937167 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fabf0007df0 con 0x7fac0c05d2f0 2026-02-23T06:38:11.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.785+0000 7fac08ff9640 1 -- 10.20.193.58:0/3200937167 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac0c05d2f0 msgr2=0x7fac0c05d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:11.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.785+0000 7fac08ff9640 1 --2- 10.20.193.58:0/3200937167 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac0c05d2f0 0x7fac0c05d6c0 secure :-1 s=READY pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fabf00023d0 tx=0x7fabf0004660 comp rx=0 tx=0).stop 2026-02-23T06:38:11.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.785+0000 7fac08ff9640 1 -- 10.20.193.58:0/3200937167 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac0c05d2f0 msgr2=0x7fac0c05d6c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:38:11.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.785+0000 7fac08ff9640 1 --2- 10.20.193.58:0/3200937167 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac0c05d2f0 0x7fac0c05d6c0 secure :-1 s=CLOSED pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fabf00023d0 tx=0x7fabf0004660 comp rx=0 tx=0).stop 2026-02-23T06:38:11.792 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.798+0000 7fac1230c640 1 --2- 10.20.193.58:0/3200937167 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac0c05dc00 0x7fac0c15ba00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:11.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.799+0000 7fac1230c640 1 -- 10.20.193.58:0/3200937167 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fac0c05b570 con 0x7fac0c05dc00 2026-02-23T06:38:11.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.799+0000 7fac0bfff640 1 --2- 10.20.193.58:0/3200937167 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac0c05dc00 0x7fac0c15ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:11.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.800+0000 7fac0bfff640 1 -- 10.20.193.58:0/3200937167 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fac0c0b5b00 con 0x7fac0c05dc00 2026-02-23T06:38:11.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.800+0000 7fac0bfff640 1 --2- 10.20.193.58:0/3200937167 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac0c05dc00 0x7fac0c15ba00 secure :-1 s=READY pgs=237 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fabf0004740 tx=0x7fabf0005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:38:11.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.801+0000 7fac08ff9640 1 -- 10.20.193.58:0/3200937167 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fabf0002d90 con 0x7fac0c05dc00 2026-02-23T06:38:11.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.801+0000 7fac08ff9640 1 -- 10.20.193.58:0/3200937167 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5559 (secure 0 0 0) 0x7fabf004d070 con 0x7fac0c05dc00 2026-02-23T06:38:11.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.801+0000 7fac08ff9640 1 -- 10.20.193.58:0/3200937167 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac0c05dc00 msgr2=0x7fac0c15ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:11.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.801+0000 7fac08ff9640 1 --2- 10.20.193.58:0/3200937167 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac0c05dc00 0x7fac0c15ba00 secure :-1 s=READY pgs=237 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fabf0004740 tx=0x7fabf0005f90 comp rx=0 tx=0).stop 2026-02-23T06:38:11.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.801+0000 7fac08ff9640 1 -- 10.20.193.58:0/3200937167 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac0c05dc00 msgr2=0x7fac0c15ba00 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:38:11.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.801+0000 7fac08ff9640 1 --2- 10.20.193.58:0/3200937167 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fac0c05dc00 0x7fac0c15ba00 secure :-1 s=CLOSED pgs=237 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fabf0004740 tx=0x7fabf0005f90 comp rx=0 tx=0).stop 2026-02-23T06:38:11.796 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:38:11.796 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:38:11.796 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:38:11.796 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:38:11.796 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 142, 2026-02-23T06:38:11.796 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 299312, 2026-02-23T06:38:11.797 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:38:11.797 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:38:11.797 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:38:11.797 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:38:11.797 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:11.797 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 16, 2026-02-23T06:38:11.797 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:38:11.797 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:38:11.797 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:38:11.797 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:38:11.797 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:38:11.798 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:38:11.798 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:38:11.798 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:38:11.798 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:38:11.798 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:38:11.798 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:38:11.798 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:38:11.798 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:38:11.798 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:38:11.798 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:38:11.798 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:38:11.798 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:11.798 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:38:11.799 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:38:11.799 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:38:11.799 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:38:11.799 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:38:11.799 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:38:11.799 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:38:11.799 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:38:11.799 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:38:11.799 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:38:11.799 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:38:11.799 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:38:11.799 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:38:11.800 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:38:11.800 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:38:11.800 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:11.800 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:11.800 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:38:11.800 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:38:11.800 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:38:11.800 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:38:11.800 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:38:11.800 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:38:11.800 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:38:11.800 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:38:11.801 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:38:11.801 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:38:11.801 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:38:11.801 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:38:11.801 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:38:11.801 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:38:11.801 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:38:11.801 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:38:11.801 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:38:11.801 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:38:11.801 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:38:11.801 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:38:11.802 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:38:11.802 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:38:11.802 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:38:11.802 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:38:11.802 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:38:11.802 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:38:11.802 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:38:11.802 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:38:11.802 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:38:11.802 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:38:11.802 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:11.802 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:38:11.802 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:11.803 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:38:11.803 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:11.803 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:38:11.803 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:38:11.803 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:38:11.803 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:38:11.803 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:11.803 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:38:11.803 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:38:11.803 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:11.803 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:11.803 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:11.803 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:38:11.804 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:38:11.804 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:11.804 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:11.804 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:11.804 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:11.804 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:38:11.804 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:38:11.804 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:38:11.804 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:38:11.804 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:38:11.804 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:38:11.804 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:11.805 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:11.805 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:38:11.805 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:38:11.805 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:38:11.805 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:38:11.805 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:11.805 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:38:11.805 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:38:11.805 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:11.805 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:11.805 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:11.805 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:38:11.805 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:38:11.806 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:11.806 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:11.806 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:11.806 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:11.806 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:38:11.806 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:38:11.806 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:38:11.806 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:38:11.806 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:38:11.806 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:38:11.806 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:11.806 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:11.807 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:38:11.807 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:38:11.807 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:38:11.807 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:38:11.807 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:11.807 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:38:11.807 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:38:11.807 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:11.807 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:11.807 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:11.807 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:38:11.807 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:38:11.807 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:11.808 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:11.808 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:11.808 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:11.808 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:38:11.808 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:38:11.808 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:38:11.808 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:38:11.808 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:38:11.808 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:38:11.808 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:11.808 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:11.808 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:11.808 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:38:11.809 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:38:11.809 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:11.809 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:38:11.809 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:38:11.809 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:38:11.809 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:11.809 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:11.809 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:38:11.809 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:11.809 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:38:11.809 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:38:11.809 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:38:11.810 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:11.810 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:11.810 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:38:11.810 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:11.810 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:38:11.810 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:38:11.810 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:38:11.810 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:11.810 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:11.810 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:38:11.810 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:11.810 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:38:11.810 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:38:11.811 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:38:11.811 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:11.811 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:11.811 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:38:11.811 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:38:11.811 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:38:11.811 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:11.811 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:11.811 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:38:11.811 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:11.811 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:38:11.811 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:38:11.811 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:38:11.812 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:11.812 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:11.812 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:11.812 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:38:11.812 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:38:11.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.803+0000 7fac1230c640 1 -- 10.20.193.58:0/3200937167 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fabe407a6c0 msgr2=0x7fabe409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:11.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.803+0000 7fac1230c640 1 --2- 10.20.193.58:0/3200937167 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fabe407a6c0 0x7fabe409ab70 secure :-1 s=READY pgs=389 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac0c0af9d0 tx=0x7fabf8005f90 comp rx=0 tx=0).stop 2026-02-23T06:38:11.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.803+0000 7fac1230c640 1 -- 10.20.193.58:0/3200937167 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac0c161d50 msgr2=0x7fac0c05bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:11.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.803+0000 7fac1230c640 1 --2- 10.20.193.58:0/3200937167 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fac0c161d50 0x7fac0c05bd90 secure :-1 s=READY pgs=8 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac00008fd0 tx=0x7fac0000dba0 comp rx=0 tx=0).stop 2026-02-23T06:38:11.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.803+0000 7fac10882640 1 -- 10.20.193.58:0/3200937167 reap_dead start 2026-02-23T06:38:11.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.803+0000 7fac10882640 1 -- 10.20.193.58:0/3200937167 reap_dead start 2026-02-23T06:38:11.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.803+0000 7fac1230c640 1 -- 10.20.193.58:0/3200937167 shutdown_connections 2026-02-23T06:38:11.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.803+0000 7fac1230c640 1 -- 10.20.193.58:0/3200937167 >> 10.20.193.58:0/3200937167 conn(0x7fac0c058e50 msgr2=0x7fac0c161540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:38:11.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.803+0000 7fac1230c640 1 -- 10.20.193.58:0/3200937167 shutdown_connections 2026-02-23T06:38:11.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.803+0000 7fac1230c640 1 -- 10.20.193.58:0/3200937167 wait complete. 2026-02-23T06:38:11.815 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:38:11.815 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:38:11.816 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:38:11.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.996+0000 7f7cd2ecc640 1 -- 10.20.193.58:0/3150853942 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7cc4049190 msgr2=0x7f7cc4049610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:11.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.996+0000 7f7cd2ecc640 1 --2- 10.20.193.58:0/3150853942 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7cc4049190 0x7f7cc4049610 secure :-1 s=READY pgs=239 gs=2 cs=0 l=1 c_cookie=12027667196135372558 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cc4010bf0 tx=0x7f7cc8030300 comp rx=0 tx=0).stop 2026-02-23T06:38:11.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.996+0000 7f7cd2ecc640 1 -- 10.20.193.58:0/3150853942 shutdown_connections 2026-02-23T06:38:11.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.996+0000 7f7cd2ecc640 1 --2- 10.20.193.58:0/3150853942 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7cc4049190 0x7f7cc4049610 unknown :-1 s=CLOSED pgs=239 gs=2 cs=0 l=1 c_cookie=12027667196135372558 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:11.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.996+0000 7f7cd2ecc640 1 --2- 10.20.193.58:0/3150853942 >> v2:10.20.193.93:3300/0 conn(0x7f7cc40f7ad0 0x7f7cc40fe350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:11.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.996+0000 7f7cd2ecc640 1 -- 10.20.193.58:0/3150853942 >> 10.20.193.58:0/3150853942 conn(0x7f7cc400e7f0 msgr2=0x7f7cc400fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:38:11.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.997+0000 7f7cd2ecc640 1 -- 10.20.193.58:0/3150853942 shutdown_connections 2026-02-23T06:38:11.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.997+0000 7f7cd2ecc640 1 -- 10.20.193.58:0/3150853942 wait complete. 2026-02-23T06:38:11.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.998+0000 7f7cd2ecc640 1 Processor -- start 2026-02-23T06:38:11.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.998+0000 7f7cd2ecc640 1 -- start start 2026-02-23T06:38:11.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.999+0000 7f7cd2ecc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7cc4049190 0x7f7cc41995b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:11.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.999+0000 7f7cd2ecc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7cc4052ed0 0x7f7cc40f0100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:11.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.999+0000 7f7cd2ecc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7cc40f7ad0 0x7f7cc40f0640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:11.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.999+0000 7f7cd2ecc640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc404ba60 con 0x7f7cc40f7ad0 2026-02-23T06:38:11.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.999+0000 7f7cd2ecc640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc40f6130 con 0x7f7cc4052ed0 2026-02-23T06:38:11.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.999+0000 7f7cd2ecc640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f7cc404b780 con 0x7f7cc4049190 2026-02-23T06:38:11.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.999+0000 7f7cd0c41640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7cc4049190 0x7f7cc41995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:11.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.999+0000 7f7cd1442640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7cc40f7ad0 0x7f7cc40f0640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:11.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.999+0000 7f7cd1442640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7cc40f7ad0 0x7f7cc40f0640 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:46232/0 (socket says 10.20.193.58:46232) 2026-02-23T06:38:11.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.999+0000 7f7cd1442640 1 -- 10.20.193.58:0/2809245519 learned_addr learned my addr 10.20.193.58:0/2809245519 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:38:11.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.999+0000 7f7cc3fff640 1 --2- 10.20.193.58:0/2809245519 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7cc4052ed0 0x7f7cc40f0100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:11.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.999+0000 7f7cd0c41640 1 -- 10.20.193.58:0/2809245519 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7cc4052ed0 msgr2=0x7f7cc40f0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:11.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.999+0000 7f7cd0c41640 1 --2- 10.20.193.58:0/2809245519 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7cc4052ed0 0x7f7cc40f0100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:11.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.999+0000 7f7cd0c41640 1 -- 10.20.193.58:0/2809245519 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7cc40f7ad0 msgr2=0x7f7cc40f0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:11.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.999+0000 7f7cd0c41640 1 --2- 10.20.193.58:0/2809245519 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7cc40f7ad0 0x7f7cc40f0640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:11.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:11.999+0000 7f7cd0c41640 1 -- 10.20.193.58:0/2809245519 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cbc0094b0 con 0x7f7cc4049190 2026-02-23T06:38:11.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.000+0000 7f7cd1442640 1 --2- 10.20.193.58:0/2809245519 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7cc40f7ad0 0x7f7cc40f0640 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:38:11.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.000+0000 7f7cc3fff640 1 --2- 10.20.193.58:0/2809245519 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7cc4052ed0 0x7f7cc40f0100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:38:11.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.000+0000 7f7cd0c41640 1 --2- 10.20.193.58:0/2809245519 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7cc4049190 0x7f7cc41995b0 secure :-1 s=READY pgs=9 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cbc004680 tx=0x7f7cbc002b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:38:11.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.000+0000 7f7cc17fa640 1 -- 10.20.193.58:0/2809245519 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7cbc00eb20 con 0x7f7cc4049190 2026-02-23T06:38:11.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.000+0000 7f7cc17fa640 1 -- 10.20.193.58:0/2809245519 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7cbc00ec80 con 0x7f7cc4049190 2026-02-23T06:38:11.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.000+0000 7f7cc17fa640 1 -- 10.20.193.58:0/2809245519 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7cbc0106b0 con 0x7f7cc4049190 2026-02-23T06:38:11.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.000+0000 7f7cd2ecc640 1 -- 10.20.193.58:0/2809245519 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cc800a590 con 0x7f7cc4049190 2026-02-23T06:38:11.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.000+0000 7f7cd2ecc640 1 -- 10.20.193.58:0/2809245519 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cc419a020 con 0x7f7cc4049190 2026-02-23T06:38:11.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.001+0000 7f7cd2ecc640 1 --2- 10.20.193.58:0/2809245519 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7c8c0041f0 0x7f7c8c0246a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:11.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.001+0000 7f7cd2ecc640 1 -- 10.20.193.58:0/2809245519 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8c025f20 con 0x7f7c8c0041f0 2026-02-23T06:38:11.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.001+0000 7f7cc3fff640 1 --2- 10.20.193.58:0/2809245519 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7c8c0041f0 0x7f7c8c0246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:11.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.002+0000 7f7cc3fff640 1 -- 10.20.193.58:0/2809245519 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7c8c0260e0 con 0x7f7c8c0041f0 2026-02-23T06:38:11.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.002+0000 7f7cc3fff640 1 --2- 10.20.193.58:0/2809245519 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7c8c0041f0 0x7f7c8c0246a0 secure :-1 s=READY pgs=108 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cc40f6390 tx=0x7f7cb400ff80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:38:11.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.002+0000 7f7cc17fa640 1 -- 10.20.193.58:0/2809245519 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f7cbc01f060 con 0x7f7cc4049190 2026-02-23T06:38:11.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.003+0000 7f7cc17fa640 1 --2- 10.20.193.58:0/2809245519 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7c9c07a5f0 0x7f7c9c09aaa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:11.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.004+0000 7f7cc17fa640 1 -- 10.20.193.58:0/2809245519 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f7cbc09ddc0 con 0x7f7cc4049190 2026-02-23T06:38:11.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.004+0000 7f7cd1442640 1 --2- 10.20.193.58:0/2809245519 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7c9c07a5f0 0x7f7c9c09aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:11.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.004+0000 7f7cc17fa640 1 -- 10.20.193.58:0/2809245519 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7cb400dc90 con 0x7f7c8c0041f0 2026-02-23T06:38:11.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.004+0000 7f7cc17fa640 1 -- 10.20.193.58:0/2809245519 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f7cb400ddf0 con 0x7f7c8c0041f0 2026-02-23T06:38:11.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.004+0000 7f7cc17fa640 1 -- 10.20.193.58:0/2809245519 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7c8c0041f0 msgr2=0x7f7c8c0246a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:12.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.004+0000 7f7cc17fa640 1 --2- 10.20.193.58:0/2809245519 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7c8c0041f0 0x7f7c8c0246a0 secure :-1 s=READY pgs=108 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cc40f6390 tx=0x7f7cb400ff80 comp rx=0 tx=0).stop 2026-02-23T06:38:12.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.007+0000 7f7cc17fa640 1 -- 10.20.193.58:0/2809245519 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7c8c0041f0 msgr2=0x7f7c8c0246a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:38:12.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.007+0000 7f7cc17fa640 1 --2- 10.20.193.58:0/2809245519 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7c8c0041f0 0x7f7c8c0246a0 secure :-1 s=CLOSED pgs=108 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cc40f6390 tx=0x7f7cb400ff80 comp rx=0 tx=0).stop 2026-02-23T06:38:12.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.007+0000 7f7cd1442640 1 --2- 10.20.193.58:0/2809245519 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7c9c07a5f0 0x7f7c9c09aaa0 secure :-1 s=READY pgs=390 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cc800a8c0 tx=0x7f7cc80058c0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:38:12.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.008+0000 7f7cd2ecc640 1 --2- 10.20.193.58:0/2809245519 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7c8c002f30 0x7f7c8c0033b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:12.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.008+0000 7f7cd2ecc640 1 -- 10.20.193.58:0/2809245519 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8c003950 con 0x7f7c8c002f30 2026-02-23T06:38:12.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.008+0000 7f7cc3fff640 1 --2- 10.20.193.58:0/2809245519 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7c8c002f30 0x7f7c8c0033b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:12.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.009+0000 7f7cc3fff640 1 -- 10.20.193.58:0/2809245519 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7c8c003b10 con 0x7f7c8c002f30 2026-02-23T06:38:12.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.009+0000 7f7cc3fff640 1 --2- 10.20.193.58:0/2809245519 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7c8c002f30 0x7f7c8c0033b0 secure :-1 s=READY pgs=109 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cb4003000 tx=0x7f7cb40026a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:38:12.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.009+0000 7f7cc17fa640 1 -- 10.20.193.58:0/2809245519 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7cb4023070 con 0x7f7c8c002f30 2026-02-23T06:38:12.004 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.010+0000 7f7cc17fa640 1 -- 10.20.193.58:0/2809245519 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5414 (secure 0 0 0) 0x7f7cb4014e70 con 0x7f7c8c002f30 2026-02-23T06:38:12.004 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:38:12.004 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:38:12.004 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:38:12.004 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:38:12.005 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 142, 2026-02-23T06:38:12.005 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 204592, 2026-02-23T06:38:12.005 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:38:12.005 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:38:12.005 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:38:12.005 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:38:12.005 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:12.005 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 16, 2026-02-23T06:38:12.005 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:38:12.005 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:38:12.005 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:38:12.006 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:38:12.006 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:38:12.006 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:38:12.006 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:38:12.006 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:38:12.006 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:38:12.006 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:38:12.006 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:38:12.006 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:38:12.006 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:38:12.006 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:38:12.006 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:38:12.007 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:38:12.007 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:12.007 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:38:12.007 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:38:12.007 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:38:12.007 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:38:12.007 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:38:12.007 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:38:12.007 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:38:12.007 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:38:12.007 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:38:12.007 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:38:12.007 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:38:12.008 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:38:12.008 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:38:12.008 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:38:12.008 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:38:12.008 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:12.008 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:12.008 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:38:12.008 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:38:12.008 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:38:12.008 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:38:12.008 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:38:12.009 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:38:12.009 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:38:12.009 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:38:12.009 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:38:12.009 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:38:12.009 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:38:12.009 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:38:12.009 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:38:12.009 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:38:12.009 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:38:12.009 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:38:12.009 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:38:12.010 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:38:12.010 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:38:12.010 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:38:12.010 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:38:12.010 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:38:12.010 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:38:12.010 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:38:12.010 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:38:12.010 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:38:12.010 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:38:12.010 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:38:12.010 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:38:12.011 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:38:12.011 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:12.011 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:38:12.011 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:12.011 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:38:12.011 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:12.011 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:38:12.011 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:38:12.011 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:38:12.011 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:38:12.011 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:12.011 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:38:12.012 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:38:12.012 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:12.012 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:12.012 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:12.012 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:38:12.012 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:38:12.012 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:12.012 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:12.012 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:12.012 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:12.012 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:38:12.012 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:38:12.012 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:38:12.013 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:38:12.013 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:38:12.013 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:38:12.013 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:12.013 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:12.013 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:38:12.013 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:38:12.013 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:38:12.013 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:38:12.013 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:12.013 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:38:12.013 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:38:12.014 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:12.014 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:12.014 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:12.014 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:38:12.014 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:38:12.014 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:12.014 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:12.014 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:12.014 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:12.014 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:38:12.014 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:38:12.014 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:38:12.015 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:38:12.015 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:38:12.015 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:38:12.015 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:12.015 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:12.015 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:38:12.015 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:38:12.015 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:38:12.015 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:38:12.015 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:12.015 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:38:12.015 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:38:12.016 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:12.016 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:12.016 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:12.016 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:38:12.016 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:38:12.016 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:12.016 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:12.016 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:12.016 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:12.016 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:38:12.016 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:38:12.016 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:38:12.017 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:38:12.017 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:38:12.017 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:38:12.017 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:12.017 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:12.017 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:12.017 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:38:12.017 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:38:12.017 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:12.017 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:38:12.017 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:38:12.017 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:38:12.018 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:12.018 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:12.018 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:38:12.018 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:12.018 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:38:12.018 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:38:12.018 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:38:12.018 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:12.018 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:12.018 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:38:12.018 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:12.018 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:38:12.019 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:38:12.019 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:38:12.019 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:12.019 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:12.019 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:38:12.019 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:12.019 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:38:12.019 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:38:12.019 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:38:12.019 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:12.019 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:12.019 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:38:12.020 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:12.020 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:38:12.020 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:38:12.020 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:38:12.020 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:12.020 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:12.020 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:12.020 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:38:12.020 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:38:12.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.010+0000 7f7cc17fa640 1 -- 10.20.193.58:0/2809245519 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7c8c002f30 msgr2=0x7f7c8c0033b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:12.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.010+0000 7f7cc17fa640 1 --2- 10.20.193.58:0/2809245519 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7c8c002f30 0x7f7c8c0033b0 secure :-1 s=READY pgs=109 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cb4003000 tx=0x7f7cb40026a0 comp rx=0 tx=0).stop 2026-02-23T06:38:12.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.010+0000 7f7cc17fa640 1 -- 10.20.193.58:0/2809245519 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7c8c002f30 msgr2=0x7f7c8c0033b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:38:12.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.010+0000 7f7cc17fa640 1 --2- 10.20.193.58:0/2809245519 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7c8c002f30 0x7f7c8c0033b0 secure :-1 s=CLOSED pgs=109 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cb4003000 tx=0x7f7cb40026a0 comp rx=0 tx=0).stop 2026-02-23T06:38:12.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.023+0000 7f7cd2ecc640 1 -- 10.20.193.58:0/2809245519 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7c9c07a5f0 msgr2=0x7f7c9c09aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:12.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.023+0000 7f7cd2ecc640 1 --2- 10.20.193.58:0/2809245519 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7c9c07a5f0 0x7f7c9c09aaa0 secure :-1 s=READY pgs=390 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cc800a8c0 tx=0x7f7cc80058c0 comp rx=0 tx=0).stop 2026-02-23T06:38:12.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.023+0000 7f7cd1442640 1 -- 10.20.193.58:0/2809245519 reap_dead start 2026-02-23T06:38:12.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.023+0000 7f7cd2ecc640 1 -- 10.20.193.58:0/2809245519 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7cc4049190 msgr2=0x7f7cc41995b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:12.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.023+0000 7f7cd2ecc640 1 --2- 10.20.193.58:0/2809245519 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7cc4049190 0x7f7cc41995b0 secure :-1 s=READY pgs=9 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cbc004680 tx=0x7f7cbc002b40 comp rx=0 tx=0).stop 2026-02-23T06:38:12.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.024+0000 7f7cd2ecc640 1 -- 10.20.193.58:0/2809245519 shutdown_connections 2026-02-23T06:38:12.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.024+0000 7f7cd2ecc640 1 --2- 10.20.193.58:0/2809245519 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7cc4049190 0x7f7cc41995b0 unknown :-1 s=CLOSED pgs=9 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:12.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.024+0000 7f7cd2ecc640 1 -- 10.20.193.58:0/2809245519 >> 10.20.193.58:0/2809245519 conn(0x7f7cc400e7f0 msgr2=0x7f7cc40fc050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:38:12.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.024+0000 7f7cd2ecc640 1 -- 10.20.193.58:0/2809245519 shutdown_connections 2026-02-23T06:38:12.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.024+0000 7f7cd2ecc640 1 -- 10.20.193.58:0/2809245519 wait complete. 2026-02-23T06:38:12.031 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:38:12.032 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:38:12.032 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:38:12.316 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.321+0000 7f44b3e5b640 1 -- 10.20.193.58:0/2550353832 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f44ac0b4450 msgr2=0x7f44ac0b39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:12.316 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.321+0000 7f44b3e5b640 1 --2- 10.20.193.58:0/2550353832 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f44ac0b4450 0x7f44ac0b39f0 secure :-1 s=READY pgs=10 gs=2 cs=0 l=1 c_cookie=5549624485196386691 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44a8005e70 tx=0x7f44a802f280 comp rx=0 tx=0).stop 2026-02-23T06:38:12.316 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.322+0000 7f44b3e5b640 1 -- 10.20.193.58:0/2550353832 shutdown_connections 2026-02-23T06:38:12.316 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.322+0000 7f44b3e5b640 1 --2- 10.20.193.58:0/2550353832 >> v2:10.20.193.93:3300/0 conn(0x7f44ac0b4820 0x7f44ac0b5610 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:12.316 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.322+0000 7f44b3e5b640 1 --2- 10.20.193.58:0/2550353832 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f44ac0b4450 0x7f44ac0b39f0 unknown :-1 s=CLOSED pgs=10 gs=2 cs=0 l=1 c_cookie=5549624485196386691 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:12.316 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.322+0000 7f44b3e5b640 1 -- 10.20.193.58:0/2550353832 >> 10.20.193.58:0/2550353832 conn(0x7f44ac058e50 msgr2=0x7f44ac059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:38:12.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.322+0000 7f44b3e5b640 1 -- 10.20.193.58:0/2550353832 shutdown_connections 2026-02-23T06:38:12.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.322+0000 7f44b3e5b640 1 -- 10.20.193.58:0/2550353832 wait complete. 2026-02-23T06:38:12.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.323+0000 7f44b3e5b640 1 Processor -- start 2026-02-23T06:38:12.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.323+0000 7f44b3e5b640 1 -- start start 2026-02-23T06:38:12.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.324+0000 7f44b3e5b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f44ac0b4450 0x7f44ac162290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:12.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.325+0000 7f44b3e5b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f44ac0b4820 0x7f44ac1524e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:12.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.325+0000 7f44b3e5b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f44ac15b7e0 0x7f44ac1395f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:12.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.325+0000 7f44b23d1640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f44ac15b7e0 0x7f44ac1395f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:12.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.325+0000 7f44b23d1640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f44ac15b7e0 0x7f44ac1395f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:46240/0 (socket says 10.20.193.58:46240) 2026-02-23T06:38:12.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.328+0000 7f44b23d1640 1 -- 10.20.193.58:0/1300554356 learned_addr learned my addr 10.20.193.58:0/1300554356 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:38:12.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.328+0000 7f44b3e5b640 1 -- 10.20.193.58:0/1300554356 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f44ac15bbe0 con 0x7f44ac15b7e0 2026-02-23T06:38:12.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.328+0000 7f44b3e5b640 1 -- 10.20.193.58:0/1300554356 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f44ac157d00 con 0x7f44ac0b4450 2026-02-23T06:38:12.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.328+0000 7f44b3e5b640 1 -- 10.20.193.58:0/1300554356 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f44ac15c0d0 con 0x7f44ac0b4820 2026-02-23T06:38:12.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.328+0000 7f44b1bd0640 1 --2- 10.20.193.58:0/1300554356 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f44ac0b4450 0x7f44ac162290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:12.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.328+0000 7f44b13cf640 1 --2- 10.20.193.58:0/1300554356 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f44ac0b4820 0x7f44ac1524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:12.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.329+0000 7f44b23d1640 1 -- 10.20.193.58:0/1300554356 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f44ac0b4820 msgr2=0x7f44ac1524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:12.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.329+0000 7f44b23d1640 1 --2- 10.20.193.58:0/1300554356 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f44ac0b4820 0x7f44ac1524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:12.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.329+0000 7f44b23d1640 1 -- 10.20.193.58:0/1300554356 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f44ac0b4450 msgr2=0x7f44ac162290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:12.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.329+0000 7f44b23d1640 1 --2- 10.20.193.58:0/1300554356 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f44ac0b4450 0x7f44ac162290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:12.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.329+0000 7f44b23d1640 1 -- 10.20.193.58:0/1300554356 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a8009570 con 0x7f44ac15b7e0 2026-02-23T06:38:12.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.329+0000 7f44b13cf640 1 --2- 10.20.193.58:0/1300554356 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f44ac0b4820 0x7f44ac1524e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:38:12.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.329+0000 7f44b23d1640 1 --2- 10.20.193.58:0/1300554356 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f44ac15b7e0 0x7f44ac1395f0 secure :-1 s=READY pgs=241 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44a400d520 tx=0x7f44a400d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:38:12.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.329+0000 7f449a7fc640 1 -- 10.20.193.58:0/1300554356 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f44a4007b90 con 0x7f44ac15b7e0 2026-02-23T06:38:12.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.329+0000 7f449a7fc640 1 -- 10.20.193.58:0/1300554356 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f44a4007de0 con 0x7f44ac15b7e0 2026-02-23T06:38:12.324 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.329+0000 7f44b3e5b640 1 -- 10.20.193.58:0/1300554356 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44ac157870 con 0x7f44ac15b7e0 2026-02-23T06:38:12.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.330+0000 7f449a7fc640 1 -- 10.20.193.58:0/1300554356 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f44a40062b0 con 0x7f44ac15b7e0 2026-02-23T06:38:12.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.330+0000 7f44b3e5b640 1 -- 10.20.193.58:0/1300554356 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44ac15bdf0 con 0x7f44ac15b7e0 2026-02-23T06:38:12.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.331+0000 7f4473fff640 1 --2- 10.20.193.58:0/1300554356 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f446c0041f0 0x7f446c0246a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:12.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.331+0000 7f4473fff640 1 -- 10.20.193.58:0/1300554356 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f446c025f20 con 0x7f446c0041f0 2026-02-23T06:38:12.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.331+0000 7f44b1bd0640 1 --2- 10.20.193.58:0/1300554356 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f446c0041f0 0x7f446c0246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:12.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.333+0000 7f449a7fc640 1 -- 10.20.193.58:0/1300554356 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f44a4006410 con 0x7f44ac15b7e0 2026-02-23T06:38:12.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.333+0000 7f44b1bd0640 1 -- 10.20.193.58:0/1300554356 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f446c0260e0 con 0x7f446c0041f0 2026-02-23T06:38:12.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.334+0000 7f44b1bd0640 1 --2- 10.20.193.58:0/1300554356 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f446c0041f0 0x7f446c0246a0 secure :-1 s=READY pgs=11 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44a80023d0 tx=0x7f44a80028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:38:12.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.334+0000 7f449a7fc640 1 --2- 10.20.193.58:0/1300554356 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f447c07a790 0x7f447c09ac40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:12.329 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.334+0000 7f449a7fc640 1 -- 10.20.193.58:0/1300554356 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f44a80045c0 con 0x7f446c0041f0 2026-02-23T06:38:12.329 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.335+0000 7f449a7fc640 1 -- 10.20.193.58:0/1300554356 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f44a409df20 con 0x7f44ac15b7e0 2026-02-23T06:38:12.329 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.335+0000 7f44b13cf640 1 --2- 10.20.193.58:0/1300554356 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f447c07a790 0x7f447c09ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:12.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.335+0000 7f449a7fc640 1 -- 10.20.193.58:0/1300554356 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f44a8002c50 con 0x7f446c0041f0 2026-02-23T06:38:12.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.335+0000 7f449a7fc640 1 -- 10.20.193.58:0/1300554356 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f446c0041f0 msgr2=0x7f446c0246a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:12.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.335+0000 7f449a7fc640 1 --2- 10.20.193.58:0/1300554356 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f446c0041f0 0x7f446c0246a0 secure :-1 s=READY pgs=11 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44a80023d0 tx=0x7f44a80028d0 comp rx=0 tx=0).stop 2026-02-23T06:38:12.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.335+0000 7f449a7fc640 1 -- 10.20.193.58:0/1300554356 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f446c0041f0 msgr2=0x7f446c0246a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:38:12.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.335+0000 7f449a7fc640 1 --2- 10.20.193.58:0/1300554356 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f446c0041f0 0x7f446c0246a0 unknown :-1 s=CLOSED pgs=11 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:12.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.336+0000 7f44b13cf640 1 --2- 10.20.193.58:0/1300554356 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f447c07a790 0x7f447c09ac40 secure :-1 s=READY pgs=391 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44ac0b1860 tx=0x7f449c005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:38:12.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.339+0000 7f4473fff640 1 --2- 10.20.193.58:0/1300554356 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f446c024fb0 0x7f446c025430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:12.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.339+0000 7f4473fff640 1 -- 10.20.193.58:0/1300554356 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f446c025b30 con 0x7f446c024fb0 2026-02-23T06:38:12.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.339+0000 7f44b1bd0640 1 --2- 10.20.193.58:0/1300554356 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f446c024fb0 0x7f446c025430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:12.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.340+0000 7f44b1bd0640 1 -- 10.20.193.58:0/1300554356 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f446c025cf0 con 0x7f446c024fb0 2026-02-23T06:38:12.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.340+0000 7f44b1bd0640 1 --2- 10.20.193.58:0/1300554356 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f446c024fb0 0x7f446c025430 secure :-1 s=READY pgs=12 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44a8005e70 tx=0x7f44a8009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:38:12.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.340+0000 7f449a7fc640 1 -- 10.20.193.58:0/1300554356 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f44a8042660 con 0x7f446c024fb0 2026-02-23T06:38:12.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.340+0000 7f449a7fc640 1 -- 10.20.193.58:0/1300554356 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4912 (secure 0 0 0) 0x7f44a8002e80 con 0x7f446c024fb0 2026-02-23T06:38:12.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.341+0000 7f449a7fc640 1 -- 10.20.193.58:0/1300554356 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f446c024fb0 msgr2=0x7f446c025430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:12.335 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:38:12.335 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:38:12.335 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:38:12.335 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:38:12.336 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 142, 2026-02-23T06:38:12.336 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 16856, 2026-02-23T06:38:12.336 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:38:12.336 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:38:12.336 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:38:12.336 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:38:12.336 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:12.336 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 16, 2026-02-23T06:38:12.336 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:38:12.336 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:38:12.336 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:38:12.336 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:38:12.337 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:38:12.337 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:38:12.337 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:38:12.337 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:38:12.337 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:38:12.337 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:38:12.337 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:38:12.337 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:38:12.337 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:38:12.337 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:38:12.337 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:38:12.337 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:38:12.338 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:12.338 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:38:12.338 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:38:12.338 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:38:12.338 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:38:12.338 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:38:12.338 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:38:12.338 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:38:12.338 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:38:12.338 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:38:12.338 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:38:12.338 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:38:12.339 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:38:12.339 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:38:12.339 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:38:12.339 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:38:12.339 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:12.339 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:12.339 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:38:12.339 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:38:12.339 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:38:12.339 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:38:12.339 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:38:12.339 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:38:12.340 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:38:12.340 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:38:12.340 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:38:12.340 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:38:12.340 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:38:12.340 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:38:12.340 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:38:12.340 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:38:12.340 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:38:12.340 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:38:12.340 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:38:12.340 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:38:12.341 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:38:12.341 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:38:12.341 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:38:12.341 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:38:12.341 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:38:12.341 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:38:12.341 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:38:12.341 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:38:12.341 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:38:12.341 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:38:12.341 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:38:12.341 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:38:12.341 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:12.342 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:38:12.342 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:12.342 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:38:12.342 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:12.342 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:38:12.342 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:38:12.342 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:38:12.342 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:38:12.342 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:12.342 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:38:12.342 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:38:12.342 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:12.342 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:12.343 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:12.343 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:38:12.343 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:38:12.343 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:12.343 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:12.343 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:12.343 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:12.343 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:38:12.343 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:38:12.343 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:38:12.343 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:38:12.343 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:38:12.343 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:38:12.344 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:12.344 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:12.344 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:38:12.344 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:38:12.344 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:38:12.344 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:38:12.344 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:12.344 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:38:12.344 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:38:12.344 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:12.344 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:12.344 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:12.345 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:38:12.345 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:38:12.345 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:12.345 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:12.345 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:12.345 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:12.345 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:38:12.345 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:38:12.345 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:38:12.345 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:38:12.345 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:38:12.345 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:38:12.345 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:12.346 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:12.346 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:38:12.346 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:38:12.346 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:38:12.346 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:38:12.346 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:12.346 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:38:12.346 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:38:12.346 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:12.346 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:12.346 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:12.346 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:38:12.346 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:38:12.347 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:12.347 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:12.347 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:12.347 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:12.347 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:38:12.347 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:38:12.347 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:38:12.347 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:38:12.347 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:38:12.347 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:38:12.347 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:12.347 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:12.347 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:12.348 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:38:12.348 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:38:12.348 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:12.348 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:38:12.348 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:38:12.348 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:38:12.348 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:12.348 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:12.348 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:38:12.348 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:12.348 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:38:12.348 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:38:12.349 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:38:12.349 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:12.349 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:12.349 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:12.349 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:38:12.349 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:38:12.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.341+0000 7f449a7fc640 1 --2- 10.20.193.58:0/1300554356 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f446c024fb0 0x7f446c025430 secure :-1 s=READY pgs=12 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44a8005e70 tx=0x7f44a8009310 comp rx=0 tx=0).stop 2026-02-23T06:38:12.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.341+0000 7f449a7fc640 1 -- 10.20.193.58:0/1300554356 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f446c024fb0 msgr2=0x7f446c025430 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:38:12.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.341+0000 7f449a7fc640 1 --2- 10.20.193.58:0/1300554356 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f446c024fb0 0x7f446c025430 secure :-1 s=CLOSED pgs=12 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44a8005e70 tx=0x7f44a8009310 comp rx=0 tx=0).stop 2026-02-23T06:38:12.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.341+0000 7f4473fff640 1 -- 10.20.193.58:0/1300554356 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f447c07a790 msgr2=0x7f447c09ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:12.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.341+0000 7f4473fff640 1 --2- 10.20.193.58:0/1300554356 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f447c07a790 0x7f447c09ac40 secure :-1 s=READY pgs=391 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44ac0b1860 tx=0x7f449c005f90 comp rx=0 tx=0).stop 2026-02-23T06:38:12.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.341+0000 7f4473fff640 1 -- 10.20.193.58:0/1300554356 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f44ac15b7e0 msgr2=0x7f44ac1395f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:12.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.341+0000 7f4473fff640 1 --2- 10.20.193.58:0/1300554356 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f44ac15b7e0 0x7f44ac1395f0 secure :-1 s=READY pgs=241 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44a400d520 tx=0x7f44a400d9f0 comp rx=0 tx=0).stop 2026-02-23T06:38:12.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.341+0000 7f44b23d1640 1 -- 10.20.193.58:0/1300554356 reap_dead start 2026-02-23T06:38:12.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.341+0000 7f44b23d1640 1 -- 10.20.193.58:0/1300554356 reap_dead start 2026-02-23T06:38:12.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.341+0000 7f4473fff640 1 -- 10.20.193.58:0/1300554356 shutdown_connections 2026-02-23T06:38:12.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.341+0000 7f4473fff640 1 -- 10.20.193.58:0/1300554356 >> 10.20.193.58:0/1300554356 conn(0x7f44ac058e50 msgr2=0x7f44ac15a650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:38:12.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.341+0000 7f4473fff640 1 -- 10.20.193.58:0/1300554356 shutdown_connections 2026-02-23T06:38:12.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:12.341+0000 7f4473fff640 1 -- 10.20.193.58:0/1300554356 wait complete. 2026-02-23T06:38:12.355 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:38:12.355 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-23T06:38:12.355 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['c'] 2026-02-23T06:38:12.355 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-23T06:38:12.356 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-23T06:38:12.356 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-23T06:38:12.356 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:38:12.366 INFO:tasks.ceph.mon.b:Stopped 2026-02-23T06:38:12.366 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.c 2026-02-23T06:38:12.366 INFO:tasks.mon_thrash:Sending STOP to mon c 2026-02-23T06:38:12.367 INFO:tasks.ceph.mon.c:Sent signal 19 2026-02-23T06:38:12.367 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-23T06:38:13.921 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:38:13.974 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:38:27.367 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.c 2026-02-23T06:38:27.367 INFO:tasks.mon_thrash:Sending CONT to mon c 2026-02-23T06:38:27.368 INFO:tasks.ceph.mon.c:Sent signal 18 2026-02-23T06:38:27.368 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:38:27.368 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:38:33.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.496+0000 7f418bfff640 1 -- 10.20.193.58:0/2569958456 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4178003a30 msgr2=0x7f4178003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:33.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.496+0000 7f418bfff640 1 --2- 10.20.193.58:0/2569958456 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4178003a30 0x7f4178003e20 secure :-1 s=READY pgs=247 gs=31 cs=0 l=1 c_cookie=2259581705851143287 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4180002aa0 tx=0x7f4180030610 comp rx=0 tx=0).stop 2026-02-23T06:38:33.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.496+0000 7f418b7fe640 1 -- 10.20.193.58:0/2569958456 reap_dead start 2026-02-23T06:38:33.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.496+0000 7f418bfff640 1 -- 10.20.193.58:0/2569958456 shutdown_connections 2026-02-23T06:38:33.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.496+0000 7f418bfff640 1 -- 10.20.193.58:0/2569958456 >> 10.20.193.58:0/2569958456 conn(0x7f418c0b3c20 msgr2=0x7f418c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:38:33.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.496+0000 7f418bfff640 1 -- 10.20.193.58:0/2569958456 shutdown_connections 2026-02-23T06:38:33.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.496+0000 7f418bfff640 1 -- 10.20.193.58:0/2569958456 wait complete. 2026-02-23T06:38:33.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.498+0000 7f418bfff640 1 Processor -- start 2026-02-23T06:38:33.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.498+0000 7f418bfff640 1 -- start start 2026-02-23T06:38:33.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.498+0000 7f418bfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4178003a30 0x7f418c057d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:33.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.498+0000 7f418bfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f418c1209b0 0x7f418c1238c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:33.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.498+0000 7f418bfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f418c11ef90 0x7f418c11f400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:33.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.498+0000 7f418bfff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f418c162860 con 0x7f418c1209b0 2026-02-23T06:38:33.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.498+0000 7f418bfff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f418c162f70 con 0x7f418c11ef90 2026-02-23T06:38:33.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.498+0000 7f418bfff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f418c11f940 con 0x7f4178003a30 2026-02-23T06:38:33.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.498+0000 7f418b7fe640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f418c11ef90 msgr2=0x7f418c11f400 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:38:33.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.498+0000 7f418b7fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f418c11ef90 0x7f418c11f400 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:38:33.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.498+0000 7f418a7fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f418c1209b0 0x7f418c1238c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:33.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.498+0000 7f418a7fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f418c1209b0 0x7f418c1238c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:36832/0 (socket says 10.20.193.58:36832) 2026-02-23T06:38:33.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.498+0000 7f418a7fc640 1 -- 10.20.193.58:0/1803135270 learned_addr learned my addr 10.20.193.58:0/1803135270 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:38:33.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.498+0000 7f418affd640 1 --2- 10.20.193.58:0/1803135270 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4178003a30 0x7f418c057d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:33.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.499+0000 7f418a7fc640 1 -- 10.20.193.58:0/1803135270 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4178003a30 msgr2=0x7f418c057d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:33.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.499+0000 7f418a7fc640 1 --2- 10.20.193.58:0/1803135270 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4178003a30 0x7f418c057d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:33.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.499+0000 7f418a7fc640 1 -- 10.20.193.58:0/1803135270 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f418c11ef90 msgr2=0x7f418c11f400 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:38:33.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.499+0000 7f418a7fc640 1 --2- 10.20.193.58:0/1803135270 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f418c11ef90 0x7f418c11f400 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:33.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.499+0000 7f418a7fc640 1 -- 10.20.193.58:0/1803135270 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f418c161520 con 0x7f418c1209b0 2026-02-23T06:38:33.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.499+0000 7f418a7fc640 1 --2- 10.20.193.58:0/1803135270 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f418c1209b0 0x7f418c1238c0 secure :-1 s=READY pgs=248 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4174002730 tx=0x7f4174012b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:38:33.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.499+0000 7f416b7fe640 1 -- 10.20.193.58:0/1803135270 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4174017070 con 0x7f418c1209b0 2026-02-23T06:38:33.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.499+0000 7f416b7fe640 1 -- 10.20.193.58:0/1803135270 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f41740119b0 con 0x7f418c1209b0 2026-02-23T06:38:33.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.499+0000 7f418bfff640 1 -- 10.20.193.58:0/1803135270 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f418c1622a0 con 0x7f418c1209b0 2026-02-23T06:38:33.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.499+0000 7f416b7fe640 1 -- 10.20.193.58:0/1803135270 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4174011da0 con 0x7f418c1209b0 2026-02-23T06:38:33.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.499+0000 7f418bfff640 1 -- 10.20.193.58:0/1803135270 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f418c162c00 con 0x7f418c1209b0 2026-02-23T06:38:33.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.500+0000 7f41697fa640 1 -- 10.20.193.58:0/1803135270 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f418c162a60 con 0x7f418c1209b0 2026-02-23T06:38:33.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.501+0000 7f416b7fe640 1 -- 10.20.193.58:0/1803135270 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f4174004110 con 0x7f418c1209b0 2026-02-23T06:38:33.498 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.502+0000 7f416b7fe640 1 --2- 10.20.193.58:0/1803135270 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f415807a5a0 0x7f415809aa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:33.498 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.502+0000 7f416b7fe640 1 -- 10.20.193.58:0/1803135270 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f417409e670 con 0x7f418c1209b0 2026-02-23T06:38:33.498 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.502+0000 7f418affd640 1 --2- 10.20.193.58:0/1803135270 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f415807a5a0 0x7f415809aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:33.498 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.503+0000 7f418affd640 1 --2- 10.20.193.58:0/1803135270 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f415807a5a0 0x7f415809aa50 secure :-1 s=READY pgs=392 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4180004740 tx=0x7f41800047e0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:38:33.498 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.504+0000 7f416b7fe640 1 -- 10.20.193.58:0/1803135270 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f418c162a60 con 0x7f418c1209b0 2026-02-23T06:38:33.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.660+0000 7f41697fa640 1 -- 10.20.193.58:0/1803135270 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f418c1630b0 con 0x7f418c1209b0 2026-02-23T06:38:33.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.661+0000 7f416b7fe640 1 -- 10.20.193.58:0/1803135270 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1749 (secure 0 0 0) 0x7f418c1630b0 con 0x7f418c1209b0 2026-02-23T06:38:33.655 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":144,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:38:33.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.663+0000 7f41697fa640 1 -- 10.20.193.58:0/1803135270 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f415807a5a0 msgr2=0x7f415809aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:33.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.663+0000 7f41697fa640 1 --2- 10.20.193.58:0/1803135270 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f415807a5a0 0x7f415809aa50 secure :-1 s=READY pgs=392 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4180004740 tx=0x7f41800047e0 comp rx=0 tx=0).stop 2026-02-23T06:38:33.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.663+0000 7f41697fa640 1 -- 10.20.193.58:0/1803135270 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f418c1209b0 msgr2=0x7f418c1238c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:33.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.663+0000 7f41697fa640 1 --2- 10.20.193.58:0/1803135270 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f418c1209b0 0x7f418c1238c0 secure :-1 s=READY pgs=248 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4174002730 tx=0x7f4174012b10 comp rx=0 tx=0).stop 2026-02-23T06:38:33.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.663+0000 7f41697fa640 1 -- 10.20.193.58:0/1803135270 shutdown_connections 2026-02-23T06:38:33.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.663+0000 7f41697fa640 1 --2- 10.20.193.58:0/1803135270 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f415807a5a0 0x7f415809aa50 unknown :-1 s=CLOSED pgs=392 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:33.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.663+0000 7f41697fa640 1 --2- 10.20.193.58:0/1803135270 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f418c11ef90 0x7f418c11f400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:33.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.663+0000 7f41697fa640 1 --2- 10.20.193.58:0/1803135270 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f418c1209b0 0x7f418c1238c0 unknown :-1 s=CLOSED pgs=248 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:33.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.663+0000 7f41697fa640 1 --2- 10.20.193.58:0/1803135270 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4178003a30 0x7f418c057d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:33.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.663+0000 7f41697fa640 1 -- 10.20.193.58:0/1803135270 >> 10.20.193.58:0/1803135270 conn(0x7f418c0b3c20 msgr2=0x7f418c15b990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:38:33.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.663+0000 7f41697fa640 1 -- 10.20.193.58:0/1803135270 shutdown_connections 2026-02-23T06:38:33.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.663+0000 7f41697fa640 1 -- 10.20.193.58:0/1803135270 wait complete. 2026-02-23T06:38:33.671 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:38:33.671 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-23T06:38:33.671 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:38:33.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.798+0000 7f27f3fff640 1 -- 10.20.193.58:0/883355276 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f27f40b6690 msgr2=0x7f27f4058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:33.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.798+0000 7f27f3fff640 1 --2- 10.20.193.58:0/883355276 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f27f40b6690 0x7f27f4058cf0 secure :-1 s=READY pgs=249 gs=3 cs=0 l=1 c_cookie=12868976760432689491 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27f4059740 tx=0x7f27e4030360 comp rx=0 tx=0).stop 2026-02-23T06:38:33.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.798+0000 7f27f3fff640 1 -- 10.20.193.58:0/883355276 shutdown_connections 2026-02-23T06:38:33.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.798+0000 7f27f3fff640 1 --2- 10.20.193.58:0/883355276 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f27f40b6690 0x7f27f4058cf0 unknown :-1 s=CLOSED pgs=249 gs=3 cs=0 l=1 c_cookie=12868976760432689491 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:33.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.798+0000 7f27f3fff640 1 --2- 10.20.193.58:0/883355276 >> v2:10.20.193.93:3300/0 conn(0x7f27f415d870 0x7f27f40587b0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:33.794 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.798+0000 7f27f3fff640 1 -- 10.20.193.58:0/883355276 >> 10.20.193.58:0/883355276 conn(0x7f27f40b3c20 msgr2=0x7f27f40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:38:33.794 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.798+0000 7f27f3fff640 1 -- 10.20.193.58:0/883355276 shutdown_connections 2026-02-23T06:38:33.794 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.798+0000 7f27f3fff640 1 -- 10.20.193.58:0/883355276 wait complete. 2026-02-23T06:38:33.796 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.800+0000 7f27f3fff640 1 Processor -- start 2026-02-23T06:38:33.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.800+0000 7f27f3fff640 1 -- start start 2026-02-23T06:38:33.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.800+0000 7f27f3fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f27f40b6690 0x7f27f411d310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:33.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.800+0000 7f27f3fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f27f415d4a0 0x7f27f4057130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:33.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.800+0000 7f27f3fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f27f415d870 0x7f27f4057670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:33.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.800+0000 7f27f3fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f27f4056ca0 con 0x7f27f415d4a0 2026-02-23T06:38:33.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.800+0000 7f27f3fff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f27f41c7aa0 con 0x7f27f415d870 2026-02-23T06:38:33.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.800+0000 7f27f3fff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f27f415e0a0 con 0x7f27f40b6690 2026-02-23T06:38:33.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.800+0000 7f27f27fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f27f415d4a0 0x7f27f4057130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:33.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.800+0000 7f27f37fe640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f27f415d870 msgr2=0x7f27f4057670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:38:33.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.800+0000 7f27f27fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f27f415d4a0 0x7f27f4057130 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:36862/0 (socket says 10.20.193.58:36862) 2026-02-23T06:38:33.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.800+0000 7f27f27fc640 1 -- 10.20.193.58:0/2483856665 learned_addr learned my addr 10.20.193.58:0/2483856665 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:38:33.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.800+0000 7f27f37fe640 1 --2- 10.20.193.58:0/2483856665 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f27f415d870 0x7f27f4057670 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:38:33.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.800+0000 7f27f2ffd640 1 --2- 10.20.193.58:0/2483856665 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f27f40b6690 0x7f27f411d310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:33.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.801+0000 7f27f27fc640 1 -- 10.20.193.58:0/2483856665 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f27f40b6690 msgr2=0x7f27f411d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:33.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.801+0000 7f27f27fc640 1 --2- 10.20.193.58:0/2483856665 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f27f40b6690 0x7f27f411d310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:33.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.801+0000 7f27f27fc640 1 -- 10.20.193.58:0/2483856665 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f27f415d870 msgr2=0x7f27f4057670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:38:33.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.801+0000 7f27f27fc640 1 --2- 10.20.193.58:0/2483856665 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f27f415d870 0x7f27f4057670 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:33.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.801+0000 7f27f27fc640 1 -- 10.20.193.58:0/2483856665 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e400a650 con 0x7f27f415d4a0 2026-02-23T06:38:33.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.801+0000 7f27f27fc640 1 --2- 10.20.193.58:0/2483856665 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f27f415d4a0 0x7f27f4057130 secure :-1 s=READY pgs=250 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27dc006fd0 tx=0x7f27dc00bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:38:33.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.801+0000 7f27d37fe640 1 -- 10.20.193.58:0/2483856665 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f27dc002cd0 con 0x7f27f415d4a0 2026-02-23T06:38:33.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.801+0000 7f27d37fe640 1 -- 10.20.193.58:0/2483856665 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f27dc004070 con 0x7f27f415d4a0 2026-02-23T06:38:33.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.801+0000 7f27d37fe640 1 -- 10.20.193.58:0/2483856665 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f27dc004460 con 0x7f27f415d4a0 2026-02-23T06:38:33.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.801+0000 7f27f3fff640 1 -- 10.20.193.58:0/2483856665 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27f4056370 con 0x7f27f415d4a0 2026-02-23T06:38:33.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.801+0000 7f27f3fff640 1 -- 10.20.193.58:0/2483856665 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27f4056930 con 0x7f27f415d4a0 2026-02-23T06:38:33.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.802+0000 7f27f3fff640 1 --2- 10.20.193.58:0/2483856665 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f27f413aa10 0x7f27f4149160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:33.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.802+0000 7f27f3fff640 1 -- 10.20.193.58:0/2483856665 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f27f40b6330 con 0x7f27f413aa10 2026-02-23T06:38:33.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.802+0000 7f27f2ffd640 1 --2- 10.20.193.58:0/2483856665 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f27f413aa10 0x7f27f4149160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:33.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.803+0000 7f27f2ffd640 1 -- 10.20.193.58:0/2483856665 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f27f40b5e10 con 0x7f27f413aa10 2026-02-23T06:38:33.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.803+0000 7f27f2ffd640 1 --2- 10.20.193.58:0/2483856665 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f27f413aa10 0x7f27f4149160 secure :-1 s=READY pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27e8002820 tx=0x7f27e800dba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:38:33.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.803+0000 7f27d37fe640 1 -- 10.20.193.58:0/2483856665 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f27dc0045c0 con 0x7f27f415d4a0 2026-02-23T06:38:33.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.804+0000 7f27d37fe640 1 --2- 10.20.193.58:0/2483856665 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f27c007a570 0x7f27c009aa20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:33.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.804+0000 7f27d37fe640 1 -- 10.20.193.58:0/2483856665 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f27dc09d040 con 0x7f27f415d4a0 2026-02-23T06:38:33.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.804+0000 7f27d37fe640 1 -- 10.20.193.58:0/2483856665 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f27e8002ac0 con 0x7f27f413aa10 2026-02-23T06:38:33.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.804+0000 7f27d37fe640 1 -- 10.20.193.58:0/2483856665 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f27e8002c20 con 0x7f27f413aa10 2026-02-23T06:38:33.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.804+0000 7f27d37fe640 1 -- 10.20.193.58:0/2483856665 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f27f413aa10 msgr2=0x7f27f4149160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:33.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.804+0000 7f27d37fe640 1 --2- 10.20.193.58:0/2483856665 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f27f413aa10 0x7f27f4149160 secure :-1 s=READY pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27e8002820 tx=0x7f27e800dba0 comp rx=0 tx=0).stop 2026-02-23T06:38:33.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.804+0000 7f27d37fe640 1 -- 10.20.193.58:0/2483856665 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f27f413aa10 msgr2=0x7f27f4149160 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:38:33.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.804+0000 7f27d37fe640 1 --2- 10.20.193.58:0/2483856665 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f27f413aa10 0x7f27f4149160 secure :-1 s=CLOSED pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27e8002820 tx=0x7f27e800dba0 comp rx=0 tx=0).stop 2026-02-23T06:38:33.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.804+0000 7f27f37fe640 1 --2- 10.20.193.58:0/2483856665 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f27c007a570 0x7f27c009aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:33.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.805+0000 7f27f37fe640 1 --2- 10.20.193.58:0/2483856665 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f27c007a570 0x7f27c009aa20 secure :-1 s=READY pgs=393 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27e400a230 tx=0x7f27e40058c0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:38:33.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.807+0000 7f27f3fff640 1 --2- 10.20.193.58:0/2483856665 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f27f41609a0 0x7f27f41496a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:33.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.807+0000 7f27f3fff640 1 -- 10.20.193.58:0/2483856665 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f27f40b6d50 con 0x7f27f41609a0 2026-02-23T06:38:33.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.808+0000 7f27f2ffd640 1 --2- 10.20.193.58:0/2483856665 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f27f41609a0 0x7f27f41496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:33.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.808+0000 7f27f2ffd640 1 -- 10.20.193.58:0/2483856665 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f27f405b0e0 con 0x7f27f41609a0 2026-02-23T06:38:33.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.808+0000 7f27f2ffd640 1 --2- 10.20.193.58:0/2483856665 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f27f41609a0 0x7f27f41496a0 secure :-1 s=READY pgs=252 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27e8002820 tx=0x7f27e80048c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:38:33.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.809+0000 7f27d37fe640 1 -- 10.20.193.58:0/2483856665 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f27e8021070 con 0x7f27f41609a0 2026-02-23T06:38:33.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.809+0000 7f27d37fe640 1 -- 10.20.193.58:0/2483856665 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5547 (secure 0 0 0) 0x7f27e8002e60 con 0x7f27f41609a0 2026-02-23T06:38:33.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.809+0000 7f27d37fe640 1 -- 10.20.193.58:0/2483856665 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f27f41609a0 msgr2=0x7f27f41496a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:33.804 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.809+0000 7f27d37fe640 1 --2- 10.20.193.58:0/2483856665 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f27f41609a0 0x7f27f41496a0 secure :-1 s=READY pgs=252 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27e8002820 tx=0x7f27e80048c0 comp rx=0 tx=0).stop 2026-02-23T06:38:33.804 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.809+0000 7f27d37fe640 1 -- 10.20.193.58:0/2483856665 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f27f41609a0 msgr2=0x7f27f41496a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:38:33.804 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.809+0000 7f27d37fe640 1 --2- 10.20.193.58:0/2483856665 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f27f41609a0 0x7f27f41496a0 secure :-1 s=CLOSED pgs=252 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27e8002820 tx=0x7f27e80048c0 comp rx=0 tx=0).stop 2026-02-23T06:38:33.804 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:38:33.804 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:38:33.804 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:38:33.804 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:38:33.805 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 144, 2026-02-23T06:38:33.805 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 321320, 2026-02-23T06:38:33.805 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:38:33.805 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:38:33.805 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:38:33.805 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:33.805 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 1, 2026-02-23T06:38:33.805 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:38:33.805 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:38:33.805 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:38:33.805 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:38:33.806 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:38:33.806 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:38:33.806 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:38:33.806 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:38:33.806 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:38:33.806 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:38:33.806 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:38:33.806 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:38:33.806 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:38:33.806 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:38:33.806 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:38:33.806 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:38:33.807 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:33.807 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:38:33.807 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:38:33.807 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:38:33.807 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:38:33.807 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:38:33.807 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:38:33.807 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:38:33.807 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:38:33.807 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:38:33.807 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:38:33.807 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:38:33.808 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:38:33.808 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:38:33.808 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:38:33.808 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:38:33.808 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:33.808 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:33.808 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:38:33.808 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:38:33.808 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:38:33.808 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:38:33.808 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:38:33.809 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:38:33.809 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:38:33.809 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:38:33.809 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:38:33.809 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:38:33.809 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:38:33.809 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:38:33.809 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:38:33.809 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:38:33.809 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:38:33.809 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:38:33.809 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:38:33.810 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:38:33.810 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:38:33.810 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:38:33.810 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:38:33.810 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:38:33.810 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:38:33.810 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:38:33.810 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:38:33.810 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:38:33.810 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:38:33.810 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:38:33.810 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:38:33.811 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:38:33.811 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:33.811 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:38:33.811 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:33.811 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:38:33.811 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.811 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:38:33.811 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:38:33.811 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:38:33.811 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:38:33.811 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.811 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:38:33.811 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:38:33.812 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:33.812 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:33.812 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.812 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:38:33.812 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:38:33.812 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:33.812 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:33.812 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:33.812 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:33.812 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:38:33.813 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:38:33.813 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:38:33.813 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:38:33.813 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:38:33.813 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:38:33.813 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:33.813 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.813 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:38:33.813 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:38:33.813 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:38:33.813 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:38:33.814 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.814 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:38:33.814 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:38:33.814 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:33.814 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:33.814 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.814 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:38:33.814 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:38:33.814 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:33.814 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:33.814 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:33.814 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:33.815 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:38:33.815 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:38:33.815 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:38:33.815 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:38:33.815 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:38:33.815 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:38:33.815 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:33.815 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.815 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:38:33.815 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:38:33.815 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:38:33.815 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:38:33.816 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.816 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:38:33.816 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:38:33.816 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:33.816 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:33.816 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.816 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:38:33.816 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:38:33.816 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:33.816 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:33.816 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:33.816 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:33.817 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:38:33.817 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:38:33.817 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:38:33.817 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:38:33.817 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:38:33.817 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:38:33.817 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:33.817 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:33.817 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:33.817 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:38:33.817 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:38:33.817 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.818 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:38:33.818 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:38:33.818 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:38:33.818 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:33.818 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:33.818 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:38:33.818 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.818 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:38:33.818 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:38:33.818 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:38:33.818 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:33.818 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:33.818 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:38:33.819 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.819 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:38:33.819 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:38:33.819 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:38:33.819 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:33.819 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:33.819 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:38:33.819 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.819 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:38:33.819 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:38:33.819 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:38:33.819 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:33.820 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.820 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:38:33.820 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:38:33.820 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:38:33.820 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:33.820 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:33.820 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:38:33.820 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.820 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:38:33.820 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:38:33.820 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:38:33.820 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:33.820 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:33.821 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:33.821 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:38:33.821 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:38:33.822 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.809+0000 7f27f3fff640 1 -- 10.20.193.58:0/2483856665 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f27c007a570 msgr2=0x7f27c009aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:33.822 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.809+0000 7f27f3fff640 1 --2- 10.20.193.58:0/2483856665 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f27c007a570 0x7f27c009aa20 secure :-1 s=READY pgs=393 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27e400a230 tx=0x7f27e40058c0 comp rx=0 tx=0).stop 2026-02-23T06:38:33.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.809+0000 7f27f3fff640 1 -- 10.20.193.58:0/2483856665 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f27f415d4a0 msgr2=0x7f27f4057130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:33.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.809+0000 7f27f3fff640 1 --2- 10.20.193.58:0/2483856665 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f27f415d4a0 0x7f27f4057130 secure :-1 s=READY pgs=250 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27dc006fd0 tx=0x7f27dc00bbf0 comp rx=0 tx=0).stop 2026-02-23T06:38:33.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.809+0000 7f27f37fe640 1 -- 10.20.193.58:0/2483856665 reap_dead start 2026-02-23T06:38:33.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.809+0000 7f27f37fe640 1 -- 10.20.193.58:0/2483856665 reap_dead start 2026-02-23T06:38:33.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.809+0000 7f27f3fff640 1 -- 10.20.193.58:0/2483856665 shutdown_connections 2026-02-23T06:38:33.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.809+0000 7f27f3fff640 1 -- 10.20.193.58:0/2483856665 >> 10.20.193.58:0/2483856665 conn(0x7f27f40b3c20 msgr2=0x7f27f40b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:38:33.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.809+0000 7f27f3fff640 1 -- 10.20.193.58:0/2483856665 shutdown_connections 2026-02-23T06:38:33.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.809+0000 7f27f3fff640 1 -- 10.20.193.58:0/2483856665 wait complete. 2026-02-23T06:38:33.824 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:38:33.824 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-23T06:38:33.824 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:38:33.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.951+0000 7fe657577640 1 -- 10.20.193.58:0/1176960916 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe65815d4a0 msgr2=0x7fe6580affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:33.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.951+0000 7fe657577640 1 --2- 10.20.193.58:0/1176960916 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe65815d4a0 0x7fe6580affb0 secure :-1 s=READY pgs=253 gs=2 cs=0 l=1 c_cookie=13721225863838296904 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6580afed0 tx=0x7fe64c02f280 comp rx=0 tx=0).stop 2026-02-23T06:38:33.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.951+0000 7fe657577640 1 -- 10.20.193.58:0/1176960916 shutdown_connections 2026-02-23T06:38:33.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.951+0000 7fe657577640 1 --2- 10.20.193.58:0/1176960916 >> v2:10.20.193.93:3300/0 conn(0x7fe6580b6690 0x7fe658058ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:33.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.951+0000 7fe657577640 1 --2- 10.20.193.58:0/1176960916 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe65815d4a0 0x7fe6580affb0 unknown :-1 s=CLOSED pgs=253 gs=2 cs=0 l=1 c_cookie=13721225863838296904 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:33.947 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.951+0000 7fe657577640 1 -- 10.20.193.58:0/1176960916 >> 10.20.193.58:0/1176960916 conn(0x7fe6580b3c20 msgr2=0x7fe6580b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:38:33.947 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.951+0000 7fe657577640 1 -- 10.20.193.58:0/1176960916 shutdown_connections 2026-02-23T06:38:33.947 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.951+0000 7fe657577640 1 -- 10.20.193.58:0/1176960916 wait complete. 2026-02-23T06:38:33.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.952+0000 7fe657577640 1 Processor -- start 2026-02-23T06:38:33.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.952+0000 7fe657577640 1 -- start start 2026-02-23T06:38:33.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.953+0000 7fe657577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe6580b6690 0x7fe65813d070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:33.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.953+0000 7fe657577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe65815d4a0 0x7fe6580587e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:33.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.953+0000 7fe657577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe65815d870 0x7fe658175dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:33.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.953+0000 7fe657577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe65813c4e0 con 0x7fe6580b6690 2026-02-23T06:38:33.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.953+0000 7fe657577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe65813d5b0 con 0x7fe65815d870 2026-02-23T06:38:33.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.953+0000 7fe657577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe65813d910 con 0x7fe65815d4a0 2026-02-23T06:38:33.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.953+0000 7fe655d74640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe65815d4a0 0x7fe6580587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:33.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.953+0000 7fe655d74640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe65815d4a0 0x7fe6580587e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:33956/0 (socket says 10.20.193.58:33956) 2026-02-23T06:38:33.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.953+0000 7fe655d74640 1 -- 10.20.193.58:0/1838040241 learned_addr learned my addr 10.20.193.58:0/1838040241 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:38:33.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.953+0000 7fe656575640 1 --2- 10.20.193.58:0/1838040241 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe6580b6690 0x7fe65813d070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:33.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.954+0000 7fe656d76640 1 -- 10.20.193.58:0/1838040241 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe65815d870 msgr2=0x7fe658175dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:38:33.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.954+0000 7fe655d74640 1 -- 10.20.193.58:0/1838040241 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe65815d870 msgr2=0x7fe658175dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-23T06:38:33.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.954+0000 7fe656d76640 1 --2- 10.20.193.58:0/1838040241 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe65815d870 0x7fe658175dd0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:38:33.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.954+0000 7fe655d74640 1 --2- 10.20.193.58:0/1838040241 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe65815d870 0x7fe658175dd0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:33.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.954+0000 7fe655d74640 1 -- 10.20.193.58:0/1838040241 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe6580b6690 msgr2=0x7fe65813d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:33.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.954+0000 7fe655d74640 1 --2- 10.20.193.58:0/1838040241 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe6580b6690 0x7fe65813d070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:38:33.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.954+0000 7fe655d74640 1 -- 10.20.193.58:0/1838040241 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe64c009570 con 0x7fe65815d4a0 2026-02-23T06:38:33.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.954+0000 7fe656575640 1 --2- 10.20.193.58:0/1838040241 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe6580b6690 0x7fe65813d070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:38:33.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.954+0000 7fe655d74640 1 --2- 10.20.193.58:0/1838040241 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe65815d4a0 0x7fe6580587e0 secure :-1 s=READY pgs=30 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe64000b550 tx=0x7fe64000ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:38:33.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.954+0000 7fe63effd640 1 -- 10.20.193.58:0/1838040241 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe640002c80 con 0x7fe65815d4a0 2026-02-23T06:38:33.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.954+0000 7fe63effd640 1 -- 10.20.193.58:0/1838040241 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe640004070 con 0x7fe65815d4a0 2026-02-23T06:38:33.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.954+0000 7fe63effd640 1 -- 10.20.193.58:0/1838040241 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe640004440 con 0x7fe65815d4a0 2026-02-23T06:38:33.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.954+0000 7fe657577640 1 -- 10.20.193.58:0/1838040241 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe658173260 con 0x7fe65815d4a0 2026-02-23T06:38:33.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.955+0000 7fe657577640 1 -- 10.20.193.58:0/1838040241 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe658173730 con 0x7fe65815d4a0 2026-02-23T06:38:33.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.955+0000 7fe657577640 1 --2- 10.20.193.58:0/1838040241 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe658162e80 0x7fe658160840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:33.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.955+0000 7fe657577640 1 -- 10.20.193.58:0/1838040241 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe6580b6330 con 0x7fe658162e80 2026-02-23T06:38:33.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.956+0000 7fe656575640 1 --2- 10.20.193.58:0/1838040241 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe658162e80 0x7fe658160840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:33.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.956+0000 7fe656575640 1 -- 10.20.193.58:0/1838040241 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe6580b5e10 con 0x7fe658162e80 2026-02-23T06:38:33.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.956+0000 7fe656575640 1 --2- 10.20.193.58:0/1838040241 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe658162e80 0x7fe658160840 secure :-1 s=READY pgs=31 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe64c004740 tx=0x7fe64c0028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:38:33.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.956+0000 7fe63effd640 1 -- 10.20.193.58:0/1838040241 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe64c002e70 con 0x7fe658162e80 2026-02-23T06:38:33.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.957+0000 7fe63effd640 1 -- 10.20.193.58:0/1838040241 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fe64000d040 con 0x7fe65815d4a0 2026-02-23T06:38:33.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.957+0000 7fe63effd640 1 --2- 10.20.193.58:0/1838040241 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe62407a660 0x7fe62409ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:33.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.958+0000 7fe63effd640 1 -- 10.20.193.58:0/1838040241 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fe64c004850 con 0x7fe658162e80 2026-02-23T06:38:33.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.958+0000 7fe63effd640 1 -- 10.20.193.58:0/1838040241 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe658162e80 msgr2=0x7fe658160840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:33.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.958+0000 7fe63effd640 1 --2- 10.20.193.58:0/1838040241 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe658162e80 0x7fe658160840 secure :-1 s=READY pgs=31 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe64c004740 tx=0x7fe64c0028d0 comp rx=0 tx=0).stop 2026-02-23T06:38:33.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.958+0000 7fe63effd640 1 -- 10.20.193.58:0/1838040241 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe658162e80 msgr2=0x7fe658160840 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:38:33.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.958+0000 7fe63effd640 1 --2- 10.20.193.58:0/1838040241 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe658162e80 0x7fe658160840 secure :-1 s=CLOSED pgs=31 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe64c004740 tx=0x7fe64c0028d0 comp rx=0 tx=0).stop 2026-02-23T06:38:33.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.958+0000 7fe63effd640 1 -- 10.20.193.58:0/1838040241 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fe64009d5a0 con 0x7fe65815d4a0 2026-02-23T06:38:33.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.958+0000 7fe656d76640 1 --2- 10.20.193.58:0/1838040241 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe62407a660 0x7fe62409ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:33.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.958+0000 7fe656d76640 1 --2- 10.20.193.58:0/1838040241 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe62407a660 0x7fe62409ab10 secure :-1 s=READY pgs=394 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe65816ce50 tx=0x7fe64800a1f0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:38:33.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.961+0000 7fe657577640 1 --2- 10.20.193.58:0/1838040241 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe65813da50 0x7fe658159960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:38:33.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.961+0000 7fe657577640 1 -- 10.20.193.58:0/1838040241 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe6580b6d50 con 0x7fe65813da50 2026-02-23T06:38:33.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.961+0000 7fe656575640 1 --2- 10.20.193.58:0/1838040241 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe65813da50 0x7fe658159960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:38:33.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.962+0000 7fe656575640 1 -- 10.20.193.58:0/1838040241 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe65805b0e0 con 0x7fe65813da50 2026-02-23T06:38:33.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.962+0000 7fe656575640 1 --2- 10.20.193.58:0/1838040241 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe65813da50 0x7fe658159960 secure :-1 s=READY pgs=32 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe64c004740 tx=0x7fe64c009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:38:33.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.962+0000 7fe63effd640 1 -- 10.20.193.58:0/1838040241 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe64c04f070 con 0x7fe65813da50 2026-02-23T06:38:33.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.962+0000 7fe63effd640 1 -- 10.20.193.58:0/1838040241 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5401 (secure 0 0 0) 0x7fe64c04a820 con 0x7fe65813da50 2026-02-23T06:38:33.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.962+0000 7fe63effd640 1 -- 10.20.193.58:0/1838040241 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe65813da50 msgr2=0x7fe658159960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:33.958 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:38:33.958 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:38:33.958 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:38:33.958 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:38:33.958 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 144, 2026-02-23T06:38:33.958 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 38479, 2026-02-23T06:38:33.959 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:38:33.959 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:38:33.959 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:38:33.959 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:33.959 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 1, 2026-02-23T06:38:33.959 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:38:33.959 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:38:33.959 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:38:33.959 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:38:33.959 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:38:33.960 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:38:33.960 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:38:33.960 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:38:33.960 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:38:33.960 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:38:33.960 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:38:33.960 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:38:33.960 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:38:33.960 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:38:33.961 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:38:33.961 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:38:33.961 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:33.961 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:38:33.961 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:38:33.961 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:38:33.961 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:38:33.961 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:38:33.961 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:38:33.961 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:38:33.961 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:38:33.961 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:38:33.962 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:38:33.962 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:38:33.962 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:38:33.962 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:38:33.962 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:38:33.962 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:38:33.962 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:33.962 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:33.962 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:38:33.962 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:38:33.962 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:38:33.963 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:38:33.963 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:38:33.963 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:38:33.963 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:38:33.963 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:38:33.963 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:38:33.963 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:38:33.963 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:38:33.963 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:38:33.963 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:38:33.963 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:38:33.963 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:38:33.964 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:38:33.964 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:38:33.964 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:38:33.964 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:38:33.964 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:38:33.964 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:38:33.964 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:38:33.964 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:38:33.964 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:38:33.964 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:38:33.964 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:38:33.964 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:38:33.965 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:38:33.965 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:38:33.965 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:38:33.965 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:33.965 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:38:33.965 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:33.965 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:38:33.965 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.965 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:38:33.965 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:38:33.965 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:38:33.965 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:38:33.965 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.966 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:38:33.966 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:38:33.966 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:33.966 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:33.966 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.966 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:38:33.966 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:38:33.966 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:33.966 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:33.966 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:33.966 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:33.967 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:38:33.967 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:38:33.967 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:38:33.967 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:38:33.967 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:38:33.967 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:38:33.967 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:33.967 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.967 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:38:33.967 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:38:33.967 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:38:33.967 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:38:33.968 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.968 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:38:33.968 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:38:33.968 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:33.968 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:33.968 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.968 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:38:33.968 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:38:33.968 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:33.968 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:33.968 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:33.968 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:33.968 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:38:33.969 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:38:33.969 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:38:33.969 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:38:33.969 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:38:33.969 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:38:33.969 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:33.969 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.969 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:38:33.969 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:38:33.969 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:38:33.969 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:38:33.969 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.970 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:38:33.970 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:38:33.970 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:33.970 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:33.970 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.970 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:38:33.970 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:38:33.970 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:38:33.970 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:33.970 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:33.971 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:33.971 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:38:33.971 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:38:33.971 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:38:33.971 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:38:33.971 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:38:33.971 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:38:33.971 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:33.971 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:33.971 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:33.971 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:38:33.971 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:38:33.972 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.972 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:38:33.972 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:38:33.972 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:38:33.972 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:33.972 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:33.972 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:38:33.972 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.972 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:38:33.972 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:38:33.972 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:38:33.972 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:33.973 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:33.973 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:38:33.973 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.973 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:38:33.973 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:38:33.973 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:38:33.973 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:33.973 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:33.973 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:38:33.973 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.973 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:38:33.973 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:38:33.973 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:38:33.974 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:33.974 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:38:33.974 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:38:33.974 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:38:33.974 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:38:33.974 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:38:33.974 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:38:33.974 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:38:33.974 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:38:33.974 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:38:33.974 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:38:33.974 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:38:33.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.962+0000 7fe63effd640 1 --2- 10.20.193.58:0/1838040241 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe65813da50 0x7fe658159960 secure :-1 s=READY pgs=32 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe64c004740 tx=0x7fe64c009310 comp rx=0 tx=0).stop 2026-02-23T06:38:33.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.962+0000 7fe63effd640 1 -- 10.20.193.58:0/1838040241 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe65813da50 msgr2=0x7fe658159960 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:38:33.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.962+0000 7fe63effd640 1 --2- 10.20.193.58:0/1838040241 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe65813da50 0x7fe658159960 secure :-1 s=CLOSED pgs=32 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe64c004740 tx=0x7fe64c009310 comp rx=0 tx=0).stop 2026-02-23T06:38:33.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.962+0000 7fe657577640 1 -- 10.20.193.58:0/1838040241 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe62407a660 msgr2=0x7fe62409ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:33.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.962+0000 7fe657577640 1 --2- 10.20.193.58:0/1838040241 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe62407a660 0x7fe62409ab10 secure :-1 s=READY pgs=394 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe65816ce50 tx=0x7fe64800a1f0 comp rx=0 tx=0).stop 2026-02-23T06:38:33.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.962+0000 7fe657577640 1 -- 10.20.193.58:0/1838040241 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe65815d4a0 msgr2=0x7fe6580587e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:38:33.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.962+0000 7fe657577640 1 --2- 10.20.193.58:0/1838040241 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe65815d4a0 0x7fe6580587e0 secure :-1 s=READY pgs=30 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe64000b550 tx=0x7fe64000ba20 comp rx=0 tx=0).stop 2026-02-23T06:38:33.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.963+0000 7fe656d76640 1 -- 10.20.193.58:0/1838040241 reap_dead start 2026-02-23T06:38:33.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.963+0000 7fe656d76640 1 -- 10.20.193.58:0/1838040241 reap_dead start 2026-02-23T06:38:33.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.963+0000 7fe657577640 1 -- 10.20.193.58:0/1838040241 shutdown_connections 2026-02-23T06:38:33.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.963+0000 7fe657577640 1 -- 10.20.193.58:0/1838040241 >> 10.20.193.58:0/1838040241 conn(0x7fe6580b3c20 msgr2=0x7fe65815c200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:38:33.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.963+0000 7fe657577640 1 -- 10.20.193.58:0/1838040241 shutdown_connections 2026-02-23T06:38:33.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:38:33.963+0000 7fe657577640 1 -- 10.20.193.58:0/1838040241 wait complete. 2026-02-23T06:38:33.978 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:38:33.978 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:38:44.071 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:38:44.079 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:38:53.979 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-23T06:38:53.979 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-23T06:38:53.979 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-23T06:38:53.979 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-23T06:38:53.982 INFO:tasks.ceph.mon.b:Started 2026-02-23T06:38:53.982 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.c 2026-02-23T06:38:53.982 INFO:tasks.mon_thrash:Sending STOP to mon c 2026-02-23T06:38:53.982 INFO:tasks.ceph.mon.c:Sent signal 19 2026-02-23T06:38:53.983 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-23T06:39:08.984 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.c 2026-02-23T06:39:08.984 INFO:tasks.mon_thrash:Sending CONT to mon c 2026-02-23T06:39:08.985 INFO:tasks.ceph.mon.c:Sent signal 18 2026-02-23T06:39:08.985 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:39:08.985 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:39:09.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.113+0000 7f66f1c83640 1 -- 10.20.193.58:0/2641803960 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f66ec0b6690 msgr2=0x7f66ec058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.113+0000 7f66f1c83640 1 --2- 10.20.193.58:0/2641803960 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f66ec0b6690 0x7f66ec058cf0 secure :-1 s=READY pgs=37 gs=3 cs=0 l=1 c_cookie=10657630792409491081 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66e8006f50 tx=0x7f66e8030360 comp rx=0 tx=0).stop 2026-02-23T06:39:09.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.113+0000 7f66f1c83640 1 -- 10.20.193.58:0/2641803960 shutdown_connections 2026-02-23T06:39:09.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.113+0000 7f66f1c83640 1 --2- 10.20.193.58:0/2641803960 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f66ec0b6690 0x7f66ec058cf0 unknown :-1 s=CLOSED pgs=37 gs=3 cs=0 l=1 c_cookie=10657630792409491081 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.113+0000 7f66f1c83640 1 --2- 10.20.193.58:0/2641803960 >> v2:10.20.193.93:3300/0 conn(0x7f66ec15d870 0x7f66ec0587b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.113+0000 7f66f1c83640 1 -- 10.20.193.58:0/2641803960 >> 10.20.193.58:0/2641803960 conn(0x7f66ec0b3c20 msgr2=0x7f66ec0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:09.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.113+0000 7f66f1c83640 1 -- 10.20.193.58:0/2641803960 shutdown_connections 2026-02-23T06:39:09.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.113+0000 7f66f1c83640 1 -- 10.20.193.58:0/2641803960 wait complete. 2026-02-23T06:39:09.112 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.115+0000 7f66f1c83640 1 Processor -- start 2026-02-23T06:39:09.112 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.115+0000 7f66f1c83640 1 -- start start 2026-02-23T06:39:09.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.115+0000 7f66f1c83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f66ec0b6690 0x7f66ec13b080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:09.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.115+0000 7f66f1c83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f66ec15d4a0 0x7f66ec1fe7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:09.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.116+0000 7f66f1c83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f66ec15d870 0x7f66ec15a5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:09.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.116+0000 7f66f1c83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f66ec1fe340 con 0x7f66ec15d870 2026-02-23T06:39:09.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.116+0000 7f66f1c83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f66ec059430 con 0x7f66ec0b6690 2026-02-23T06:39:09.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.116+0000 7f66f1c83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f66ec13e6c0 con 0x7f66ec15d4a0 2026-02-23T06:39:09.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.116+0000 7f66e3fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f66ec15d4a0 0x7f66ec1fe7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:09.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.116+0000 7f66e3fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f66ec15d4a0 0x7f66ec1fe7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:33466/0 (socket says 10.20.193.58:33466) 2026-02-23T06:39:09.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.116+0000 7f66e3fff640 1 -- 10.20.193.58:0/3947682134 learned_addr learned my addr 10.20.193.58:0/3947682134 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:39:09.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.116+0000 7f66f0c81640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f66ec0b6690 0x7f66ec13b080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:09.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.116+0000 7f66f1482640 1 --2- 10.20.193.58:0/3947682134 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f66ec15d870 0x7f66ec15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:09.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.116+0000 7f66f1482640 1 -- 10.20.193.58:0/3947682134 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f66ec15d4a0 msgr2=0x7f66ec1fe7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.116+0000 7f66f1482640 1 --2- 10.20.193.58:0/3947682134 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f66ec15d4a0 0x7f66ec1fe7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.116+0000 7f66f1482640 1 -- 10.20.193.58:0/3947682134 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f66ec0b6690 msgr2=0x7f66ec13b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.116+0000 7f66f1482640 1 --2- 10.20.193.58:0/3947682134 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f66ec0b6690 0x7f66ec13b080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.116+0000 7f66f1482640 1 -- 10.20.193.58:0/3947682134 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e800a650 con 0x7f66ec15d870 2026-02-23T06:39:09.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.117+0000 7f66f1482640 1 --2- 10.20.193.58:0/3947682134 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f66ec15d870 0x7f66ec15a5e0 secure :-1 s=READY pgs=256 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66e8005820 tx=0x7f66e8003da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:09.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.117+0000 7f66e17fa640 1 -- 10.20.193.58:0/3947682134 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66e80398a0 con 0x7f66ec15d870 2026-02-23T06:39:09.115 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.117+0000 7f66e17fa640 1 -- 10.20.193.58:0/3947682134 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66e8039af0 con 0x7f66ec15d870 2026-02-23T06:39:09.115 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.117+0000 7f66e17fa640 1 -- 10.20.193.58:0/3947682134 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66e8041420 con 0x7f66ec15d870 2026-02-23T06:39:09.115 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.117+0000 7f66f1c83640 1 -- 10.20.193.58:0/3947682134 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66ec13e960 con 0x7f66ec15d870 2026-02-23T06:39:09.115 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.117+0000 7f66f1c83640 1 -- 10.20.193.58:0/3947682134 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66ec13c810 con 0x7f66ec15d870 2026-02-23T06:39:09.115 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.117+0000 7f66f1c83640 1 -- 10.20.193.58:0/3947682134 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66ec0b6d50 con 0x7f66ec15d870 2026-02-23T06:39:09.116 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.119+0000 7f66e17fa640 1 -- 10.20.193.58:0/3947682134 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f66e8041580 con 0x7f66ec15d870 2026-02-23T06:39:09.116 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.119+0000 7f66e17fa640 1 --2- 10.20.193.58:0/3947682134 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f66c007a6c0 0x7f66c009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:09.116 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.120+0000 7f66e17fa640 1 -- 10.20.193.58:0/3947682134 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f66e80c40f0 con 0x7f66ec15d870 2026-02-23T06:39:09.116 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.120+0000 7f66f0c81640 1 --2- 10.20.193.58:0/3947682134 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f66c007a6c0 0x7f66c009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:09.116 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.121+0000 7f66f0c81640 1 --2- 10.20.193.58:0/3947682134 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f66c007a6c0 0x7f66c009ab70 secure :-1 s=READY pgs=396 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66dc0027d0 tx=0x7f66dc007ee0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:09.117 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.122+0000 7f66e17fa640 1 -- 10.20.193.58:0/3947682134 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f66e8087450 con 0x7f66ec15d870 2026-02-23T06:39:09.276 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.281+0000 7f66f1c83640 1 -- 10.20.193.58:0/3947682134 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f66ec1fe4b0 con 0x7f66ec15d870 2026-02-23T06:39:09.276 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.281+0000 7f66e17fa640 1 -- 10.20.193.58:0/3947682134 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f66e808a570 con 0x7f66ec15d870 2026-02-23T06:39:09.277 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":148,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:39:09.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.284+0000 7f66f1c83640 1 -- 10.20.193.58:0/3947682134 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f66c007a6c0 msgr2=0x7f66c009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.284+0000 7f66f1c83640 1 --2- 10.20.193.58:0/3947682134 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f66c007a6c0 0x7f66c009ab70 secure :-1 s=READY pgs=396 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66dc0027d0 tx=0x7f66dc007ee0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.284+0000 7f66f1c83640 1 -- 10.20.193.58:0/3947682134 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f66ec15d870 msgr2=0x7f66ec15a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.284+0000 7f66f1c83640 1 --2- 10.20.193.58:0/3947682134 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f66ec15d870 0x7f66ec15a5e0 secure :-1 s=READY pgs=256 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66e8005820 tx=0x7f66e8003da0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.284+0000 7f66f1c83640 1 -- 10.20.193.58:0/3947682134 shutdown_connections 2026-02-23T06:39:09.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.284+0000 7f66f1c83640 1 --2- 10.20.193.58:0/3947682134 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f66c007a6c0 0x7f66c009ab70 unknown :-1 s=CLOSED pgs=396 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.284+0000 7f66f1c83640 1 --2- 10.20.193.58:0/3947682134 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f66ec15d870 0x7f66ec15a5e0 unknown :-1 s=CLOSED pgs=256 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.284+0000 7f66f1c83640 1 --2- 10.20.193.58:0/3947682134 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f66ec15d4a0 0x7f66ec1fe7d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.284+0000 7f66f1c83640 1 --2- 10.20.193.58:0/3947682134 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f66ec0b6690 0x7f66ec13b080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.284+0000 7f66f1c83640 1 -- 10.20.193.58:0/3947682134 >> 10.20.193.58:0/3947682134 conn(0x7f66ec0b3c20 msgr2=0x7f66ec15b950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:09.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.284+0000 7f66f1c83640 1 -- 10.20.193.58:0/3947682134 shutdown_connections 2026-02-23T06:39:09.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.285+0000 7f66f1c83640 1 -- 10.20.193.58:0/3947682134 wait complete. 2026-02-23T06:39:09.292 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:39:09.292 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:39:09.293 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:39:09.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.418+0000 7fb951c83640 1 -- 10.20.193.58:0/600603752 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb94c15d4a0 msgr2=0x7fb94c0affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.418+0000 7fb951c83640 1 --2- 10.20.193.58:0/600603752 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb94c15d4a0 0x7fb94c0affb0 secure :-1 s=READY pgs=38 gs=3 cs=0 l=1 c_cookie=16697853175621559526 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb94c0b1b90 tx=0x7fb93c02f1f0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.418+0000 7fb951c83640 1 -- 10.20.193.58:0/600603752 shutdown_connections 2026-02-23T06:39:09.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.418+0000 7fb951c83640 1 --2- 10.20.193.58:0/600603752 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb94c15d4a0 0x7fb94c0affb0 unknown :-1 s=CLOSED pgs=38 gs=3 cs=0 l=1 c_cookie=16697853175621559526 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.418+0000 7fb951c83640 1 -- 10.20.193.58:0/600603752 >> 10.20.193.58:0/600603752 conn(0x7fb94c0b3c20 msgr2=0x7fb94c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:09.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.418+0000 7fb951c83640 1 -- 10.20.193.58:0/600603752 shutdown_connections 2026-02-23T06:39:09.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.419+0000 7fb951c83640 1 -- 10.20.193.58:0/600603752 wait complete. 2026-02-23T06:39:09.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.420+0000 7fb951c83640 1 Processor -- start 2026-02-23T06:39:09.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.420+0000 7fb951c83640 1 -- start start 2026-02-23T06:39:09.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.421+0000 7fb951c83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb94c0b6690 0x7fb94c13fbb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:09.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.421+0000 7fb951c83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb94c15d4a0 0x7fb94c15de70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:09.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.421+0000 7fb951c83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb94c15d870 0x7fb94c13da80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:09.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.421+0000 7fb950c81640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb94c0b6690 0x7fb94c13fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:09.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.421+0000 7fb951c83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb94c1401f0 con 0x7fb94c0b6690 2026-02-23T06:39:09.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.421+0000 7fb950c81640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb94c0b6690 0x7fb94c13fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50038/0 (socket says 10.20.193.58:50038) 2026-02-23T06:39:09.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.421+0000 7fb950c81640 1 -- 10.20.193.58:0/2116243371 learned_addr learned my addr 10.20.193.58:0/2116243371 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:39:09.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.421+0000 7fb951c83640 1 -- 10.20.193.58:0/2116243371 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb94c160540 con 0x7fb94c15d870 2026-02-23T06:39:09.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.421+0000 7fb951c83640 1 -- 10.20.193.58:0/2116243371 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb94c13d5f0 con 0x7fb94c15d4a0 2026-02-23T06:39:09.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.421+0000 7fb943fff640 1 --2- 10.20.193.58:0/2116243371 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb94c15d4a0 0x7fb94c15de70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:09.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.422+0000 7fb951482640 1 --2- 10.20.193.58:0/2116243371 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb94c15d870 0x7fb94c13da80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:09.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.422+0000 7fb950c81640 1 -- 10.20.193.58:0/2116243371 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb94c15d4a0 msgr2=0x7fb94c15de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.422+0000 7fb950c81640 1 --2- 10.20.193.58:0/2116243371 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb94c15d4a0 0x7fb94c15de70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.422+0000 7fb950c81640 1 -- 10.20.193.58:0/2116243371 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb94c15d870 msgr2=0x7fb94c13da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.422+0000 7fb950c81640 1 --2- 10.20.193.58:0/2116243371 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb94c15d870 0x7fb94c13da80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.422+0000 7fb950c81640 1 -- 10.20.193.58:0/2116243371 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb93c009570 con 0x7fb94c0b6690 2026-02-23T06:39:09.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.423+0000 7fb950c81640 1 --2- 10.20.193.58:0/2116243371 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb94c0b6690 0x7fb94c13fbb0 secure :-1 s=READY pgs=258 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb93c004740 tx=0x7fb93c0028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:09.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.423+0000 7fb9417fa640 1 -- 10.20.193.58:0/2116243371 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb93c03d070 con 0x7fb94c0b6690 2026-02-23T06:39:09.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.423+0000 7fb9417fa640 1 -- 10.20.193.58:0/2116243371 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb93c038470 con 0x7fb94c0b6690 2026-02-23T06:39:09.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.423+0000 7fb9417fa640 1 -- 10.20.193.58:0/2116243371 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb93c0388a0 con 0x7fb94c0b6690 2026-02-23T06:39:09.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.423+0000 7fb951c83640 1 -- 10.20.193.58:0/2116243371 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb94c15fca0 con 0x7fb94c0b6690 2026-02-23T06:39:09.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.423+0000 7fb951c83640 1 -- 10.20.193.58:0/2116243371 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb94c160260 con 0x7fb94c0b6690 2026-02-23T06:39:09.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.425+0000 7fb951c83640 1 --2- 10.20.193.58:0/2116243371 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb94c15e3b0 0x7fb94c13dfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:09.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.425+0000 7fb951c83640 1 -- 10.20.193.58:0/2116243371 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb94c0609c0 con 0x7fb94c15e3b0 2026-02-23T06:39:09.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.425+0000 7fb9417fa640 1 -- 10.20.193.58:0/2116243371 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fb93c038a00 con 0x7fb94c0b6690 2026-02-23T06:39:09.421 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.426+0000 7fb943fff640 1 --2- 10.20.193.58:0/2116243371 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb94c15e3b0 0x7fb94c13dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:09.421 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.426+0000 7fb943fff640 1 -- 10.20.193.58:0/2116243371 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb94c164250 con 0x7fb94c15e3b0 2026-02-23T06:39:09.421 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.426+0000 7fb943fff640 1 --2- 10.20.193.58:0/2116243371 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb94c15e3b0 0x7fb94c13dfc0 secure :-1 s=READY pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb934007fd0 tx=0x7fb93400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:09.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.427+0000 7fb9417fa640 1 --2- 10.20.193.58:0/2116243371 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb91c07a810 0x7fb91c09acc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:09.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.427+0000 7fb9417fa640 1 -- 10.20.193.58:0/2116243371 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fb93c0c2170 con 0x7fb94c0b6690 2026-02-23T06:39:09.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.427+0000 7fb951482640 1 --2- 10.20.193.58:0/2116243371 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb91c07a810 0x7fb91c09acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:09.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.427+0000 7fb9417fa640 1 -- 10.20.193.58:0/2116243371 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb93400ca60 con 0x7fb94c15e3b0 2026-02-23T06:39:09.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.427+0000 7fb9417fa640 1 -- 10.20.193.58:0/2116243371 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fb93400ee90 con 0x7fb94c15e3b0 2026-02-23T06:39:09.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.427+0000 7fb9417fa640 1 -- 10.20.193.58:0/2116243371 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb94c15e3b0 msgr2=0x7fb94c13dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.427+0000 7fb9417fa640 1 --2- 10.20.193.58:0/2116243371 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb94c15e3b0 0x7fb94c13dfc0 secure :-1 s=READY pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb934007fd0 tx=0x7fb93400ec30 comp rx=0 tx=0).stop 2026-02-23T06:39:09.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.427+0000 7fb9417fa640 1 -- 10.20.193.58:0/2116243371 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb94c15e3b0 msgr2=0x7fb94c13dfc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:39:09.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.427+0000 7fb9417fa640 1 --2- 10.20.193.58:0/2116243371 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb94c15e3b0 0x7fb94c13dfc0 secure :-1 s=CLOSED pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb934007fd0 tx=0x7fb93400ec30 comp rx=0 tx=0).stop 2026-02-23T06:39:09.423 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.428+0000 7fb951482640 1 --2- 10.20.193.58:0/2116243371 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb91c07a810 0x7fb91c09acc0 secure :-1 s=READY pgs=397 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb948004850 tx=0x7fb94800a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:09.426 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.432+0000 7fb951c83640 1 --2- 10.20.193.58:0/2116243371 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb94c15f4c0 0x7fb94c13af70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:09.426 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.432+0000 7fb951c83640 1 -- 10.20.193.58:0/2116243371 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb94c05b0e0 con 0x7fb94c15f4c0 2026-02-23T06:39:09.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.432+0000 7fb943fff640 1 --2- 10.20.193.58:0/2116243371 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb94c15f4c0 0x7fb94c13af70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:09.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.432+0000 7fb943fff640 1 -- 10.20.193.58:0/2116243371 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb94c13d730 con 0x7fb94c15f4c0 2026-02-23T06:39:09.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.433+0000 7fb943fff640 1 --2- 10.20.193.58:0/2116243371 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb94c15f4c0 0x7fb94c13af70 secure :-1 s=READY pgs=260 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb934007fd0 tx=0x7fb9340026a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:09.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.433+0000 7fb9417fa640 1 -- 10.20.193.58:0/2116243371 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb934015430 con 0x7fb94c15f4c0 2026-02-23T06:39:09.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.433+0000 7fb9417fa640 1 -- 10.20.193.58:0/2116243371 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5558 (secure 0 0 0) 0x7fb934023070 con 0x7fb94c15f4c0 2026-02-23T06:39:09.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.433+0000 7fb9417fa640 1 -- 10.20.193.58:0/2116243371 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb94c15f4c0 msgr2=0x7fb94c13af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.433+0000 7fb9417fa640 1 --2- 10.20.193.58:0/2116243371 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb94c15f4c0 0x7fb94c13af70 secure :-1 s=READY pgs=260 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb934007fd0 tx=0x7fb9340026a0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.428 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:39:09.428 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:39:09.428 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:39:09.428 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:39:09.428 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 148, 2026-02-23T06:39:09.428 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 356944, 2026-02-23T06:39:09.428 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:39:09.428 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:39:09.428 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:39:09.428 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:39:09.428 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:09.428 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:39:09.428 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:39:09.429 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:09.430 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:09.431 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:39:09.432 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:39:09.433 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:39:09.433 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.433 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.433 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:09.433 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:09.433 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:39:09.433 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:09.433 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:09.433 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:39:09.433 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.433 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:09.433 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:09.433 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:39:09.433 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:09.433 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:09.433 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.433 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:39:09.433 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:39:09.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.433+0000 7fb9417fa640 1 -- 10.20.193.58:0/2116243371 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb94c15f4c0 msgr2=0x7fb94c13af70 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:39:09.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.433+0000 7fb9417fa640 1 --2- 10.20.193.58:0/2116243371 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb94c15f4c0 0x7fb94c13af70 secure :-1 s=CLOSED pgs=260 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb934007fd0 tx=0x7fb9340026a0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.434+0000 7fb951c83640 1 -- 10.20.193.58:0/2116243371 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb91c07a810 msgr2=0x7fb91c09acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.434+0000 7fb951c83640 1 --2- 10.20.193.58:0/2116243371 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb91c07a810 0x7fb91c09acc0 secure :-1 s=READY pgs=397 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb948004850 tx=0x7fb94800a040 comp rx=0 tx=0).stop 2026-02-23T06:39:09.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.434+0000 7fb951c83640 1 -- 10.20.193.58:0/2116243371 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb94c0b6690 msgr2=0x7fb94c13fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.434+0000 7fb951c83640 1 --2- 10.20.193.58:0/2116243371 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb94c0b6690 0x7fb94c13fbb0 secure :-1 s=READY pgs=258 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb93c004740 tx=0x7fb93c0028d0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.434+0000 7fb951482640 1 -- 10.20.193.58:0/2116243371 reap_dead start 2026-02-23T06:39:09.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.434+0000 7fb951482640 1 -- 10.20.193.58:0/2116243371 reap_dead start 2026-02-23T06:39:09.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.434+0000 7fb951c83640 1 -- 10.20.193.58:0/2116243371 shutdown_connections 2026-02-23T06:39:09.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.434+0000 7fb951c83640 1 -- 10.20.193.58:0/2116243371 >> 10.20.193.58:0/2116243371 conn(0x7fb94c0b3c20 msgr2=0x7fb94c15b370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:09.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.434+0000 7fb951c83640 1 -- 10.20.193.58:0/2116243371 shutdown_connections 2026-02-23T06:39:09.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.434+0000 7fb951c83640 1 -- 10.20.193.58:0/2116243371 wait complete. 2026-02-23T06:39:09.438 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:39:09.439 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:39:09.439 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:39:09.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.564+0000 7f90815d2640 1 -- 10.20.193.58:0/2541294811 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f907c15d870 msgr2=0x7f907c0587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.564+0000 7f90815d2640 1 --2- 10.20.193.58:0/2541294811 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f907c15d870 0x7f907c0587b0 secure :-1 s=READY pgs=261 gs=2 cs=0 l=1 c_cookie=10562500613324122364 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f906c004740 tx=0x7f906c02f200 comp rx=0 tx=0).stop 2026-02-23T06:39:09.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.564+0000 7f90815d2640 1 -- 10.20.193.58:0/2541294811 shutdown_connections 2026-02-23T06:39:09.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.564+0000 7f90815d2640 1 --2- 10.20.193.58:0/2541294811 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f907c15d870 0x7f907c0587b0 unknown :-1 s=CLOSED pgs=261 gs=2 cs=0 l=1 c_cookie=10562500613324122364 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.564+0000 7f90815d2640 1 --2- 10.20.193.58:0/2541294811 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f907c15d4a0 0x7f907c0affb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.564+0000 7f90815d2640 1 -- 10.20.193.58:0/2541294811 >> 10.20.193.58:0/2541294811 conn(0x7f907c0b3c20 msgr2=0x7f907c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:09.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.564+0000 7f90815d2640 1 -- 10.20.193.58:0/2541294811 shutdown_connections 2026-02-23T06:39:09.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.564+0000 7f90815d2640 1 -- 10.20.193.58:0/2541294811 wait complete. 2026-02-23T06:39:09.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.565+0000 7f90815d2640 1 Processor -- start 2026-02-23T06:39:09.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.565+0000 7f90815d2640 1 -- start start 2026-02-23T06:39:09.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.566+0000 7f90815d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f907c0b6690 0x7f907c0587e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:09.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.566+0000 7f90815d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f907c15d4a0 0x7f907c13f040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:09.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.566+0000 7f90815d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f907c15d870 0x7f907c13f580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:09.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.566+0000 7f90815d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f907c057f60 con 0x7f907c15d4a0 2026-02-23T06:39:09.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.566+0000 7f90815d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f907c058240 con 0x7f907c15d870 2026-02-23T06:39:09.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.566+0000 7f90815d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f907c13c020 con 0x7f907c0b6690 2026-02-23T06:39:09.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.566+0000 7f907b7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f907c15d4a0 0x7f907c13f040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:09.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.566+0000 7f907b7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f907c15d4a0 0x7f907c13f040 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50080/0 (socket says 10.20.193.58:50080) 2026-02-23T06:39:09.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.566+0000 7f907b7fe640 1 -- 10.20.193.58:0/2033689410 learned_addr learned my addr 10.20.193.58:0/2033689410 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:39:09.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.566+0000 7f907bfff640 1 --2- 10.20.193.58:0/2033689410 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f907c0b6690 0x7f907c0587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:09.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.566+0000 7f9080dd1640 1 --2- 10.20.193.58:0/2033689410 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f907c15d870 0x7f907c13f580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:09.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.566+0000 7f907b7fe640 1 -- 10.20.193.58:0/2033689410 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f907c0b6690 msgr2=0x7f907c0587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.566+0000 7f907b7fe640 1 --2- 10.20.193.58:0/2033689410 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f907c0b6690 0x7f907c0587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.566+0000 7f907b7fe640 1 -- 10.20.193.58:0/2033689410 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f907c15d870 msgr2=0x7f907c13f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.566+0000 7f907b7fe640 1 --2- 10.20.193.58:0/2033689410 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f907c15d870 0x7f907c13f580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.566+0000 7f907b7fe640 1 -- 10.20.193.58:0/2033689410 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f906c0094b0 con 0x7f907c15d4a0 2026-02-23T06:39:09.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.566+0000 7f907b7fe640 1 --2- 10.20.193.58:0/2033689410 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f907c15d4a0 0x7f907c13f040 secure :-1 s=READY pgs=262 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f906c009230 tx=0x7f906c0028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:09.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.566+0000 7f9078ff9640 1 -- 10.20.193.58:0/2033689410 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f906c038470 con 0x7f907c15d4a0 2026-02-23T06:39:09.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.566+0000 7f9078ff9640 1 -- 10.20.193.58:0/2033689410 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f906c0386c0 con 0x7f907c15d4a0 2026-02-23T06:39:09.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.566+0000 7f9078ff9640 1 -- 10.20.193.58:0/2033689410 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f906c038ad0 con 0x7f907c15d4a0 2026-02-23T06:39:09.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.567+0000 7f90815d2640 1 -- 10.20.193.58:0/2033689410 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f907c13c300 con 0x7f907c15d4a0 2026-02-23T06:39:09.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.567+0000 7f90815d2640 1 -- 10.20.193.58:0/2033689410 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f907c13c8c0 con 0x7f907c15d4a0 2026-02-23T06:39:09.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.567+0000 7f90815d2640 1 --2- 10.20.193.58:0/2033689410 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f907c160f90 0x7f907c150310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:09.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.567+0000 7f90815d2640 1 -- 10.20.193.58:0/2033689410 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f907c13e9c0 con 0x7f907c160f90 2026-02-23T06:39:09.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.567+0000 7f907bfff640 1 --2- 10.20.193.58:0/2033689410 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f907c160f90 0x7f907c150310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:09.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.568+0000 7f907bfff640 1 -- 10.20.193.58:0/2033689410 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f907c0b6330 con 0x7f907c160f90 2026-02-23T06:39:09.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.568+0000 7f907bfff640 1 --2- 10.20.193.58:0/2033689410 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f907c160f90 0x7f907c150310 secure :-1 s=READY pgs=8 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9068002fa0 tx=0x7f90680099f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:09.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.568+0000 7f9078ff9640 1 -- 10.20.193.58:0/2033689410 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9068010a70 con 0x7f907c160f90 2026-02-23T06:39:09.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.568+0000 7f9078ff9640 1 -- 10.20.193.58:0/2033689410 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f906c038c30 con 0x7f907c15d4a0 2026-02-23T06:39:09.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.569+0000 7f9078ff9640 1 --2- 10.20.193.58:0/2033689410 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f904c07a660 0x7f904c09ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:09.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.569+0000 7f9078ff9640 1 -- 10.20.193.58:0/2033689410 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f906c0c2c20 con 0x7f907c15d4a0 2026-02-23T06:39:09.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.569+0000 7f9078ff9640 1 -- 10.20.193.58:0/2033689410 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f9068010bd0 con 0x7f907c160f90 2026-02-23T06:39:09.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.569+0000 7f9078ff9640 1 -- 10.20.193.58:0/2033689410 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f907c160f90 msgr2=0x7f907c150310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.569+0000 7f9078ff9640 1 --2- 10.20.193.58:0/2033689410 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f907c160f90 0x7f907c150310 secure :-1 s=READY pgs=8 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9068002fa0 tx=0x7f90680099f0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.569+0000 7f9078ff9640 1 -- 10.20.193.58:0/2033689410 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f907c160f90 msgr2=0x7f907c150310 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:39:09.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.569+0000 7f9078ff9640 1 --2- 10.20.193.58:0/2033689410 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f907c160f90 0x7f907c150310 secure :-1 s=CLOSED pgs=8 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9068002fa0 tx=0x7f90680099f0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.570+0000 7f9080dd1640 1 --2- 10.20.193.58:0/2033689410 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f904c07a660 0x7f904c09ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:09.565 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.570+0000 7f9080dd1640 1 --2- 10.20.193.58:0/2033689410 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f904c07a660 0x7f904c09ab10 secure :-1 s=READY pgs=398 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f907c11af70 tx=0x7f907000a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:09.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.573+0000 7f90815d2640 1 --2- 10.20.193.58:0/2033689410 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f907c150850 0x7f907c150c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:09.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.573+0000 7f90815d2640 1 -- 10.20.193.58:0/2033689410 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f907c0b5e10 con 0x7f907c150850 2026-02-23T06:39:09.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.574+0000 7f907bfff640 1 --2- 10.20.193.58:0/2033689410 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f907c150850 0x7f907c150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:09.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.574+0000 7f907bfff640 1 -- 10.20.193.58:0/2033689410 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f907c164250 con 0x7f907c150850 2026-02-23T06:39:09.569 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.574+0000 7f907bfff640 1 --2- 10.20.193.58:0/2033689410 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f907c150850 0x7f907c150c20 secure :-1 s=READY pgs=9 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9068016000 tx=0x7f9068004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:09.569 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.574+0000 7f9078ff9640 1 -- 10.20.193.58:0/2033689410 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f906801e030 con 0x7f907c150850 2026-02-23T06:39:09.569 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.575+0000 7f9078ff9640 1 -- 10.20.193.58:0/2033689410 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4911 (secure 0 0 0) 0x7f906801a690 con 0x7f907c150850 2026-02-23T06:39:09.569 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.575+0000 7f9078ff9640 1 -- 10.20.193.58:0/2033689410 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f907c150850 msgr2=0x7f907c150c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.569 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.575+0000 7f9078ff9640 1 --2- 10.20.193.58:0/2033689410 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f907c150850 0x7f907c150c20 secure :-1 s=READY pgs=9 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9068016000 tx=0x7f9068004770 comp rx=0 tx=0).stop 2026-02-23T06:39:09.569 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.575+0000 7f9078ff9640 1 -- 10.20.193.58:0/2033689410 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f907c150850 msgr2=0x7f907c150c20 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:39:09.569 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.575+0000 7f9078ff9640 1 --2- 10.20.193.58:0/2033689410 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f907c150850 0x7f907c150c20 secure :-1 s=CLOSED pgs=9 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9068016000 tx=0x7f9068004770 comp rx=0 tx=0).stop 2026-02-23T06:39:09.569 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:39:09.569 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 148, 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 15524, 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:39:09.570 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:09.571 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:39:09.572 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:39:09.573 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.574 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:09.574 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:09.574 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:39:09.574 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:09.574 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:09.574 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:39:09.574 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.574 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:09.574 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:09.574 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:39:09.574 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:09.574 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:09.574 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.574 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:39:09.574 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:39:09.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.575+0000 7f90815d2640 1 -- 10.20.193.58:0/2033689410 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f904c07a660 msgr2=0x7f904c09ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.575+0000 7f90815d2640 1 --2- 10.20.193.58:0/2033689410 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f904c07a660 0x7f904c09ab10 secure :-1 s=READY pgs=398 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f907c11af70 tx=0x7f907000a040 comp rx=0 tx=0).stop 2026-02-23T06:39:09.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.575+0000 7f90815d2640 1 -- 10.20.193.58:0/2033689410 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f907c15d4a0 msgr2=0x7f907c13f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.575+0000 7f90815d2640 1 --2- 10.20.193.58:0/2033689410 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f907c15d4a0 0x7f907c13f040 secure :-1 s=READY pgs=262 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f906c009230 tx=0x7f906c0028d0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.575+0000 7f9080dd1640 1 -- 10.20.193.58:0/2033689410 reap_dead start 2026-02-23T06:39:09.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.575+0000 7f9080dd1640 1 -- 10.20.193.58:0/2033689410 reap_dead start 2026-02-23T06:39:09.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.575+0000 7f90815d2640 1 -- 10.20.193.58:0/2033689410 shutdown_connections 2026-02-23T06:39:09.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.575+0000 7f90815d2640 1 -- 10.20.193.58:0/2033689410 >> 10.20.193.58:0/2033689410 conn(0x7f907c0b3c20 msgr2=0x7f907c05cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:09.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.575+0000 7f90815d2640 1 -- 10.20.193.58:0/2033689410 shutdown_connections 2026-02-23T06:39:09.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.575+0000 7f90815d2640 1 -- 10.20.193.58:0/2033689410 wait complete. 2026-02-23T06:39:09.580 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:39:09.580 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:39:09.580 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:39:09.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.704+0000 7f03a890b640 1 -- 10.20.193.58:0/3452151877 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f03a415d4a0 msgr2=0x7f03a40affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.704+0000 7f03a890b640 1 --2- 10.20.193.58:0/3452151877 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f03a415d4a0 0x7f03a40affb0 secure :-1 s=READY pgs=263 gs=2 cs=0 l=1 c_cookie=12172906186566398570 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0398005e70 tx=0x7f039802f2d0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.705+0000 7f03a890b640 1 -- 10.20.193.58:0/3452151877 shutdown_connections 2026-02-23T06:39:09.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.705+0000 7f03a890b640 1 --2- 10.20.193.58:0/3452151877 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f03a415d870 0x7f03a40587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.705+0000 7f03a890b640 1 --2- 10.20.193.58:0/3452151877 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f03a415d4a0 0x7f03a40affb0 unknown :-1 s=CLOSED pgs=263 gs=2 cs=0 l=1 c_cookie=12172906186566398570 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.705+0000 7f03a890b640 1 -- 10.20.193.58:0/3452151877 >> 10.20.193.58:0/3452151877 conn(0x7f03a40b3c20 msgr2=0x7f03a40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:09.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.705+0000 7f03a890b640 1 -- 10.20.193.58:0/3452151877 shutdown_connections 2026-02-23T06:39:09.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.705+0000 7f03a890b640 1 -- 10.20.193.58:0/3452151877 wait complete. 2026-02-23T06:39:09.703 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.706+0000 7f03a890b640 1 Processor -- start 2026-02-23T06:39:09.703 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.706+0000 7f03a890b640 1 -- start start 2026-02-23T06:39:09.703 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.706+0000 7f03a890b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f03a40b6690 0x7f03a4122ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:09.703 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.706+0000 7f03a890b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f03a415d4a0 0x7f03a411fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:09.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.706+0000 7f03a890b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f03a415d870 0x7f03a4120210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:09.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.706+0000 7f03a890b640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f03a41210c0 con 0x7f03a415d870 2026-02-23T06:39:09.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.706+0000 7f03a890b640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f03a414ebf0 con 0x7f03a40b6690 2026-02-23T06:39:09.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.706+0000 7f03a890b640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f03a414eed0 con 0x7f03a415d4a0 2026-02-23T06:39:09.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.706+0000 7f03a3577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f03a415d870 0x7f03a4120210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:09.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.706+0000 7f03a2575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f03a415d4a0 0x7f03a411fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:09.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.706+0000 7f03a2575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f03a415d4a0 0x7f03a411fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:33512/0 (socket says 10.20.193.58:33512) 2026-02-23T06:39:09.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.707+0000 7f03a2575640 1 -- 10.20.193.58:0/4289676885 learned_addr learned my addr 10.20.193.58:0/4289676885 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:39:09.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.707+0000 7f03a2d76640 1 --2- 10.20.193.58:0/4289676885 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f03a40b6690 0x7f03a4122ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:09.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.707+0000 7f03a3577640 1 -- 10.20.193.58:0/4289676885 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f03a415d4a0 msgr2=0x7f03a411fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.707+0000 7f03a3577640 1 --2- 10.20.193.58:0/4289676885 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f03a415d4a0 0x7f03a411fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.707+0000 7f03a3577640 1 -- 10.20.193.58:0/4289676885 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f03a40b6690 msgr2=0x7f03a4122ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.707+0000 7f03a3577640 1 --2- 10.20.193.58:0/4289676885 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f03a40b6690 0x7f03a4122ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.707+0000 7f03a3577640 1 -- 10.20.193.58:0/4289676885 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0398009570 con 0x7f03a415d870 2026-02-23T06:39:09.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.707+0000 7f03a3577640 1 --2- 10.20.193.58:0/4289676885 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f03a415d870 0x7f03a4120210 secure :-1 s=READY pgs=264 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0394003810 tx=0x7f039400d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:09.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.707+0000 7f03837fe640 1 -- 10.20.193.58:0/4289676885 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f03940064a0 con 0x7f03a415d870 2026-02-23T06:39:09.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.707+0000 7f03837fe640 1 -- 10.20.193.58:0/4289676885 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0394006600 con 0x7f03a415d870 2026-02-23T06:39:09.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.707+0000 7f03837fe640 1 -- 10.20.193.58:0/4289676885 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0394004a10 con 0x7f03a415d870 2026-02-23T06:39:09.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.707+0000 7f03a890b640 1 -- 10.20.193.58:0/4289676885 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03a414f1b0 con 0x7f03a415d870 2026-02-23T06:39:09.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.707+0000 7f03a890b640 1 -- 10.20.193.58:0/4289676885 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03a41212a0 con 0x7f03a415d870 2026-02-23T06:39:09.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.708+0000 7f03a890b640 1 --2- 10.20.193.58:0/4289676885 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f03a4161b10 0x7f03a41217c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:09.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.708+0000 7f03a890b640 1 -- 10.20.193.58:0/4289676885 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f03a40b6330 con 0x7f03a4161b10 2026-02-23T06:39:09.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.708+0000 7f03a2d76640 1 --2- 10.20.193.58:0/4289676885 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f03a4161b10 0x7f03a41217c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:09.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.709+0000 7f03a2d76640 1 -- 10.20.193.58:0/4289676885 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f03a40b5e10 con 0x7f03a4161b10 2026-02-23T06:39:09.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.709+0000 7f03a2d76640 1 --2- 10.20.193.58:0/4289676885 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f03a4161b10 0x7f03a41217c0 secure :-1 s=READY pgs=39 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0398004740 tx=0x7f0398004660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:09.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.709+0000 7f03837fe640 1 -- 10.20.193.58:0/4289676885 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0398002c90 con 0x7f03a4161b10 2026-02-23T06:39:09.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.709+0000 7f03837fe640 1 -- 10.20.193.58:0/4289676885 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f039401a020 con 0x7f03a415d870 2026-02-23T06:39:09.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.710+0000 7f03837fe640 1 --2- 10.20.193.58:0/4289676885 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f037007a660 0x7f037009ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:09.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.710+0000 7f03837fe640 1 -- 10.20.193.58:0/4289676885 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f039409def0 con 0x7f03a415d870 2026-02-23T06:39:09.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.710+0000 7f03837fe640 1 -- 10.20.193.58:0/4289676885 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f0398038470 con 0x7f03a4161b10 2026-02-23T06:39:09.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.710+0000 7f03837fe640 1 -- 10.20.193.58:0/4289676885 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f03a4161b10 msgr2=0x7f03a41217c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.710+0000 7f03837fe640 1 --2- 10.20.193.58:0/4289676885 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f03a4161b10 0x7f03a41217c0 secure :-1 s=READY pgs=39 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0398004740 tx=0x7f0398004660 comp rx=0 tx=0).stop 2026-02-23T06:39:09.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.710+0000 7f03837fe640 1 -- 10.20.193.58:0/4289676885 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f03a4161b10 msgr2=0x7f03a41217c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:39:09.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.710+0000 7f03837fe640 1 --2- 10.20.193.58:0/4289676885 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f03a4161b10 0x7f03a41217c0 secure :-1 s=CLOSED pgs=39 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0398004740 tx=0x7f0398004660 comp rx=0 tx=0).stop 2026-02-23T06:39:09.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.711+0000 7f03a2575640 1 --2- 10.20.193.58:0/4289676885 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f037007a660 0x7f037009ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:09.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.711+0000 7f03a2575640 1 --2- 10.20.193.58:0/4289676885 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f037007a660 0x7f037009ab10 secure :-1 s=READY pgs=399 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f03a4160e20 tx=0x7f038c005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:09.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.714+0000 7f03a890b640 1 --2- 10.20.193.58:0/4289676885 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f03a414e700 0x7f03a4121d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:09.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.714+0000 7f03a890b640 1 -- 10.20.193.58:0/4289676885 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f03a40b6d50 con 0x7f03a414e700 2026-02-23T06:39:09.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.715+0000 7f03a2d76640 1 --2- 10.20.193.58:0/4289676885 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f03a414e700 0x7f03a4121d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:09.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.715+0000 7f03a2d76640 1 -- 10.20.193.58:0/4289676885 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f03a41214c0 con 0x7f03a414e700 2026-02-23T06:39:09.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.716+0000 7f03a2d76640 1 --2- 10.20.193.58:0/4289676885 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f03a414e700 0x7f03a4121d00 secure :-1 s=READY pgs=40 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0398004740 tx=0x7f0398009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:09.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.716+0000 7f03837fe640 1 -- 10.20.193.58:0/4289676885 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0398054630 con 0x7f03a414e700 2026-02-23T06:39:09.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.716+0000 7f03837fe640 1 -- 10.20.193.58:0/4289676885 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5412 (secure 0 0 0) 0x7f0398003ee0 con 0x7f03a414e700 2026-02-23T06:39:09.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.716+0000 7f03837fe640 1 -- 10.20.193.58:0/4289676885 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f03a414e700 msgr2=0x7f03a4121d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.716+0000 7f03837fe640 1 --2- 10.20.193.58:0/4289676885 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f03a414e700 0x7f03a4121d00 secure :-1 s=READY pgs=40 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0398004740 tx=0x7f0398009310 comp rx=0 tx=0).stop 2026-02-23T06:39:09.712 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.716+0000 7f03837fe640 1 -- 10.20.193.58:0/4289676885 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f03a414e700 msgr2=0x7f03a4121d00 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:39:09.712 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.716+0000 7f03837fe640 1 --2- 10.20.193.58:0/4289676885 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f03a414e700 0x7f03a4121d00 secure :-1 s=CLOSED pgs=40 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0398004740 tx=0x7f0398009310 comp rx=0 tx=0).stop 2026-02-23T06:39:09.712 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:39:09.712 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:39:09.712 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:39:09.712 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:39:09.713 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 148, 2026-02-23T06:39:09.713 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 74232, 2026-02-23T06:39:09.713 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:39:09.713 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:39:09.713 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:39:09.713 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:39:09.713 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:09.713 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:39:09.713 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:39:09.713 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:39:09.713 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:39:09.713 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:39:09.714 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:39:09.714 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:39:09.714 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:39:09.714 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:39:09.714 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:39:09.714 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:39:09.714 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:39:09.714 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:39:09.714 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:39:09.714 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:39:09.714 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:39:09.714 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:39:09.715 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:09.715 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:39:09.715 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:39:09.715 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:39:09.715 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:39:09.715 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:39:09.715 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:39:09.715 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:39:09.715 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:39:09.715 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:39:09.715 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:39:09.716 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:39:09.716 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:39:09.716 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:39:09.716 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:39:09.716 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:39:09.716 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:09.716 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.716 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:39:09.716 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:39:09.716 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:39:09.716 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:39:09.717 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:39:09.717 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:39:09.717 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:39:09.717 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:39:09.717 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:39:09.717 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:39:09.717 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:39:09.717 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:39:09.717 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:39:09.717 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:39:09.717 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:39:09.717 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:39:09.718 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:39:09.718 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:39:09.718 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:39:09.718 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:39:09.718 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:39:09.718 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:39:09.718 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:39:09.718 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:39:09.718 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:39:09.718 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:39:09.718 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:39:09.718 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:39:09.719 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:39:09.719 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:39:09.719 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:09.719 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:39:09.719 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.719 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:39:09.719 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.719 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:39:09.719 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:39:09.719 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:39:09.719 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:39:09.719 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.720 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:39:09.720 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:39:09.720 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:09.720 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.720 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.720 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:39:09.720 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:39:09.720 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:09.720 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:09.720 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:09.720 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.720 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:39:09.721 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:39:09.721 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:39:09.721 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:39:09.721 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:39:09.721 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:39:09.721 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.721 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.721 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:39:09.721 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:39:09.721 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:39:09.721 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:39:09.721 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.721 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:39:09.722 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:39:09.722 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:09.722 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.722 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.722 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:39:09.722 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:39:09.722 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:09.722 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:09.722 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:09.722 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.722 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:39:09.722 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:39:09.723 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:39:09.723 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:39:09.723 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:39:09.723 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:39:09.723 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.723 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.723 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:39:09.723 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:39:09.723 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:39:09.723 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:39:09.723 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.723 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:39:09.724 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:39:09.724 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:09.724 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.724 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.724 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:39:09.724 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:39:09.724 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:09.724 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:09.724 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:09.724 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.724 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:39:09.724 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:39:09.725 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:39:09.725 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:39:09.725 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:39:09.725 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:39:09.725 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:09.725 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:09.725 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.725 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:39:09.725 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:39:09.725 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.725 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:09.725 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:09.725 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:39:09.726 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:09.726 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:09.726 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:39:09.726 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.726 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:09.726 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:09.726 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:39:09.726 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:09.726 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:09.726 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:39:09.726 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.726 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:09.726 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:09.727 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:39:09.727 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:09.727 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:09.727 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:39:09.727 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.727 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:09.727 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:09.727 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:39:09.727 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:09.727 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:09.727 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:39:09.727 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:09.728 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:09.728 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:09.728 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:39:09.728 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:09.728 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:09.728 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:09.728 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:39:09.728 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:39:09.734 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.716+0000 7f03a890b640 1 -- 10.20.193.58:0/4289676885 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f037007a660 msgr2=0x7f037009ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.734 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.716+0000 7f03a890b640 1 --2- 10.20.193.58:0/4289676885 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f037007a660 0x7f037009ab10 secure :-1 s=READY pgs=399 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f03a4160e20 tx=0x7f038c005f90 comp rx=0 tx=0).stop 2026-02-23T06:39:09.734 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.716+0000 7f03a3577640 1 -- 10.20.193.58:0/4289676885 reap_dead start 2026-02-23T06:39:09.734 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.716+0000 7f03a890b640 1 -- 10.20.193.58:0/4289676885 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f03a415d870 msgr2=0x7f03a4120210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.734 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.716+0000 7f03a890b640 1 --2- 10.20.193.58:0/4289676885 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f03a415d870 0x7f03a4120210 secure :-1 s=READY pgs=264 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0394003810 tx=0x7f039400d8f0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.734 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.716+0000 7f03a890b640 1 -- 10.20.193.58:0/4289676885 shutdown_connections 2026-02-23T06:39:09.734 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.716+0000 7f03a890b640 1 --2- 10.20.193.58:0/4289676885 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f03a415d870 0x7f03a4120210 unknown :-1 s=CLOSED pgs=264 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.734 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.716+0000 7f03a890b640 1 -- 10.20.193.58:0/4289676885 >> 10.20.193.58:0/4289676885 conn(0x7f03a40b3c20 msgr2=0x7f03a41633e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:09.734 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.716+0000 7f03a890b640 1 -- 10.20.193.58:0/4289676885 shutdown_connections 2026-02-23T06:39:09.735 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.716+0000 7f03a890b640 1 -- 10.20.193.58:0/4289676885 wait complete. 2026-02-23T06:39:09.735 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:39:09.735 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:39:09.735 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:39:09.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.862+0000 7fb181643640 1 -- 10.20.193.58:0/4175940317 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb17c15d4a0 msgr2=0x7fb17c0affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.862+0000 7fb181643640 1 --2- 10.20.193.58:0/4175940317 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb17c15d4a0 0x7fb17c0affb0 secure :-1 s=READY pgs=266 gs=1 cs=0 l=1 c_cookie=11801187144714629151 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb160005e70 tx=0x7fb16002f290 comp rx=0 tx=0).stop 2026-02-23T06:39:09.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.862+0000 7fb181643640 1 -- 10.20.193.58:0/4175940317 shutdown_connections 2026-02-23T06:39:09.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.862+0000 7fb181643640 1 --2- 10.20.193.58:0/4175940317 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb17c15d4a0 0x7fb17c0affb0 unknown :-1 s=CLOSED pgs=266 gs=1 cs=0 l=1 c_cookie=11801187144714629151 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.862+0000 7fb181643640 1 -- 10.20.193.58:0/4175940317 >> 10.20.193.58:0/4175940317 conn(0x7fb17c0b3c20 msgr2=0x7fb17c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:09.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.862+0000 7fb181643640 1 -- 10.20.193.58:0/4175940317 shutdown_connections 2026-02-23T06:39:09.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.862+0000 7fb181643640 1 -- 10.20.193.58:0/4175940317 wait complete. 2026-02-23T06:39:09.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.864+0000 7fb181643640 1 Processor -- start 2026-02-23T06:39:09.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.864+0000 7fb181643640 1 -- start start 2026-02-23T06:39:09.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.864+0000 7fb181643640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb17c0b6690 0x7fb17c11dfb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:09.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.864+0000 7fb181643640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb17c15d4a0 0x7fb17c13c3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:09.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.864+0000 7fb181643640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb17c15d870 0x7fb17c14c850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:09.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.864+0000 7fb181643640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb17c120f00 con 0x7fb17c15d870 2026-02-23T06:39:09.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.864+0000 7fb181643640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb17c161990 con 0x7fb17c15d4a0 2026-02-23T06:39:09.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.864+0000 7fb181643640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb17c162cb0 con 0x7fb17c0b6690 2026-02-23T06:39:09.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.864+0000 7fb180e42640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb17c15d870 0x7fb17c14c850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:09.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.864+0000 7fb180e42640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb17c15d870 0x7fb17c14c850 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50108/0 (socket says 10.20.193.58:50108) 2026-02-23T06:39:09.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.864+0000 7fb180e42640 1 -- 10.20.193.58:0/3541569081 learned_addr learned my addr 10.20.193.58:0/3541569081 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:39:09.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.865+0000 7fb17bfff640 1 --2- 10.20.193.58:0/3541569081 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb17c0b6690 0x7fb17c11dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:09.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.865+0000 7fb17b7fe640 1 --2- 10.20.193.58:0/3541569081 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb17c15d4a0 0x7fb17c13c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:09.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.865+0000 7fb180e42640 1 -- 10.20.193.58:0/3541569081 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb17c0b6690 msgr2=0x7fb17c11dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.865+0000 7fb180e42640 1 --2- 10.20.193.58:0/3541569081 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb17c0b6690 0x7fb17c11dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.865+0000 7fb180e42640 1 -- 10.20.193.58:0/3541569081 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb17c15d4a0 msgr2=0x7fb17c13c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:09.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.865+0000 7fb180e42640 1 --2- 10.20.193.58:0/3541569081 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb17c15d4a0 0x7fb17c13c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:09.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.865+0000 7fb180e42640 1 -- 10.20.193.58:0/3541569081 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb160009570 con 0x7fb17c15d870 2026-02-23T06:39:09.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.865+0000 7fb180e42640 1 --2- 10.20.193.58:0/3541569081 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb17c15d870 0x7fb17c14c850 secure :-1 s=READY pgs=267 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb170008fd0 tx=0x7fb17000d970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:09.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.865+0000 7fb178ff9640 1 -- 10.20.193.58:0/3541569081 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb170007b90 con 0x7fb17c15d870 2026-02-23T06:39:09.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.865+0000 7fb178ff9640 1 -- 10.20.193.58:0/3541569081 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb170007de0 con 0x7fb17c15d870 2026-02-23T06:39:09.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.865+0000 7fb178ff9640 1 -- 10.20.193.58:0/3541569081 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb1700052b0 con 0x7fb17c15d870 2026-02-23T06:39:09.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.865+0000 7fb181643640 1 -- 10.20.193.58:0/3541569081 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb17c120c20 con 0x7fb17c15d870 2026-02-23T06:39:09.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.865+0000 7fb181643640 1 -- 10.20.193.58:0/3541569081 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb17c11e4f0 con 0x7fb17c15d870 2026-02-23T06:39:09.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.866+0000 7fb181643640 1 -- 10.20.193.58:0/3541569081 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb17c161020 con 0x7fb17c15d870 2026-02-23T06:39:09.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.867+0000 7fb178ff9640 1 -- 10.20.193.58:0/3541569081 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fb170024070 con 0x7fb17c15d870 2026-02-23T06:39:09.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.868+0000 7fb178ff9640 1 --2- 10.20.193.58:0/3541569081 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb14807a6c0 0x7fb14809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:09.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.868+0000 7fb178ff9640 1 -- 10.20.193.58:0/3541569081 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fb17009e6f0 con 0x7fb17c15d870 2026-02-23T06:39:09.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.868+0000 7fb17bfff640 1 --2- 10.20.193.58:0/3541569081 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb14807a6c0 0x7fb14809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:09.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.869+0000 7fb178ff9640 1 -- 10.20.193.58:0/3541569081 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fb170061910 con 0x7fb17c15d870 2026-02-23T06:39:09.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:09.869+0000 7fb17bfff640 1 --2- 10.20.193.58:0/3541569081 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb14807a6c0 0x7fb14809ab70 secure :-1 s=READY pgs=400 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1600023d0 tx=0x7fb160031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:10.021 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:10.026+0000 7fb181643640 1 -- 10.20.193.58:0/3541569081 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fb17c161020 con 0x7fb17c15d870 2026-02-23T06:39:10.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:10.026+0000 7fb178ff9640 1 -- 10.20.193.58:0/3541569081 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fb17c161020 con 0x7fb17c15d870 2026-02-23T06:39:10.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:10.029+0000 7fb181643640 1 -- 10.20.193.58:0/3541569081 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb14807a6c0 msgr2=0x7fb14809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:10.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:10.029+0000 7fb181643640 1 --2- 10.20.193.58:0/3541569081 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb14807a6c0 0x7fb14809ab70 secure :-1 s=READY pgs=400 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1600023d0 tx=0x7fb160031040 comp rx=0 tx=0).stop 2026-02-23T06:39:10.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:10.029+0000 7fb181643640 1 -- 10.20.193.58:0/3541569081 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb17c15d870 msgr2=0x7fb17c14c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:10.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:10.029+0000 7fb181643640 1 --2- 10.20.193.58:0/3541569081 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb17c15d870 0x7fb17c14c850 secure :-1 s=READY pgs=267 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb170008fd0 tx=0x7fb17000d970 comp rx=0 tx=0).stop 2026-02-23T06:39:10.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:10.030+0000 7fb181643640 1 -- 10.20.193.58:0/3541569081 shutdown_connections 2026-02-23T06:39:10.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:10.030+0000 7fb181643640 1 --2- 10.20.193.58:0/3541569081 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb14807a6c0 0x7fb14809ab70 unknown :-1 s=CLOSED pgs=400 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:10.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:10.030+0000 7fb181643640 1 --2- 10.20.193.58:0/3541569081 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb17c15d870 0x7fb17c14c850 unknown :-1 s=CLOSED pgs=267 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:10.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:10.030+0000 7fb181643640 1 --2- 10.20.193.58:0/3541569081 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb17c15d4a0 0x7fb17c13c3e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:10.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:10.030+0000 7fb181643640 1 --2- 10.20.193.58:0/3541569081 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb17c0b6690 0x7fb17c11dfb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:10.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:10.030+0000 7fb181643640 1 -- 10.20.193.58:0/3541569081 >> 10.20.193.58:0/3541569081 conn(0x7fb17c0b3c20 msgr2=0x7fb17c15b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:10.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:10.030+0000 7fb181643640 1 -- 10.20.193.58:0/3541569081 shutdown_connections 2026-02-23T06:39:10.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:10.030+0000 7fb181643640 1 -- 10.20.193.58:0/3541569081 wait complete. 2026-02-23T06:39:10.038 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:39:14.178 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:39:14.182 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:39:20.039 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:39:20.039 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:39:20.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.169+0000 7fa7dd70c640 1 -- 10.20.193.58:0/4173431216 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa7c4003cb0 msgr2=0x7fa7c40040a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:20.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.169+0000 7fa7dd70c640 1 --2- 10.20.193.58:0/4173431216 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa7c4003cb0 0x7fa7c40040a0 secure :-1 s=READY pgs=269 gs=4 cs=0 l=1 c_cookie=2893204345235670072 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7cc009b40 tx=0x7fa7cc02fc50 comp rx=0 tx=0).stop 2026-02-23T06:39:20.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.169+0000 7fa7d77fe640 1 -- 10.20.193.58:0/4173431216 reap_dead start 2026-02-23T06:39:20.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.169+0000 7fa7dd70c640 1 -- 10.20.193.58:0/4173431216 shutdown_connections 2026-02-23T06:39:20.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.169+0000 7fa7dd70c640 1 -- 10.20.193.58:0/4173431216 >> 10.20.193.58:0/4173431216 conn(0x7fa7d80561f0 msgr2=0x7fa7d80565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:20.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.169+0000 7fa7dd70c640 1 -- 10.20.193.58:0/4173431216 shutdown_connections 2026-02-23T06:39:20.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.169+0000 7fa7dd70c640 1 -- 10.20.193.58:0/4173431216 wait complete. 2026-02-23T06:39:20.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.170+0000 7fa7dd70c640 1 Processor -- start 2026-02-23T06:39:20.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.170+0000 7fa7dd70c640 1 -- start start 2026-02-23T06:39:20.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.171+0000 7fa7dd70c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa7c4003cb0 0x7fa7d813f400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:20.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.171+0000 7fa7dd70c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa7d813d8c0 0x7fa7d80b0210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:20.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.171+0000 7fa7dd70c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa7d80b0750 0x7fa7d813ff30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:20.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.171+0000 7fa7dd70c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d815c990 con 0x7fa7d813d8c0 2026-02-23T06:39:20.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.171+0000 7fa7dd70c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d80afd80 con 0x7fa7c4003cb0 2026-02-23T06:39:20.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.171+0000 7fa7dd70c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa7d80b0bc0 con 0x7fa7d80b0750 2026-02-23T06:39:20.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.171+0000 7fa7d67fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa7d813d8c0 0x7fa7d80b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:20.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.171+0000 7fa7d6ffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa7c4003cb0 0x7fa7d813f400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:20.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.171+0000 7fa7d67fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa7d813d8c0 0x7fa7d80b0210 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:46710/0 (socket says 10.20.193.58:46710) 2026-02-23T06:39:20.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.171+0000 7fa7d67fc640 1 -- 10.20.193.58:0/3295966835 learned_addr learned my addr 10.20.193.58:0/3295966835 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:39:20.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.171+0000 7fa7d77fe640 1 --2- 10.20.193.58:0/3295966835 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa7d80b0750 0x7fa7d813ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:20.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.171+0000 7fa7d67fc640 1 -- 10.20.193.58:0/3295966835 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa7d80b0750 msgr2=0x7fa7d813ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:20.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.171+0000 7fa7d67fc640 1 --2- 10.20.193.58:0/3295966835 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa7d80b0750 0x7fa7d813ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.171+0000 7fa7d67fc640 1 -- 10.20.193.58:0/3295966835 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa7c4003cb0 msgr2=0x7fa7d813f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:20.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.171+0000 7fa7d67fc640 1 --2- 10.20.193.58:0/3295966835 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa7c4003cb0 0x7fa7d813f400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.171+0000 7fa7d67fc640 1 -- 10.20.193.58:0/3295966835 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d80b39b0 con 0x7fa7d813d8c0 2026-02-23T06:39:20.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.171+0000 7fa7d67fc640 1 --2- 10.20.193.58:0/3295966835 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa7d813d8c0 0x7fa7d80b0210 secure :-1 s=READY pgs=270 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7c000d960 tx=0x7fa7c000de30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:20.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.172+0000 7fa7b77fe640 1 -- 10.20.193.58:0/3295966835 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa7c000bd20 con 0x7fa7d813d8c0 2026-02-23T06:39:20.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.172+0000 7fa7b77fe640 1 -- 10.20.193.58:0/3295966835 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7c0010450 con 0x7fa7d813d8c0 2026-02-23T06:39:20.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.172+0000 7fa7b77fe640 1 -- 10.20.193.58:0/3295966835 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa7c0010880 con 0x7fa7d813d8c0 2026-02-23T06:39:20.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.172+0000 7fa7dd70c640 1 -- 10.20.193.58:0/3295966835 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7d80afa30 con 0x7fa7d813d8c0 2026-02-23T06:39:20.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.172+0000 7fa7dd70c640 1 -- 10.20.193.58:0/3295966835 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7d815cbe0 con 0x7fa7d813d8c0 2026-02-23T06:39:20.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.172+0000 7fa7b57fa640 1 -- 10.20.193.58:0/3295966835 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7a0005300 con 0x7fa7d813d8c0 2026-02-23T06:39:20.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.173+0000 7fa7b77fe640 1 -- 10.20.193.58:0/3295966835 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fa7c00109e0 con 0x7fa7d813d8c0 2026-02-23T06:39:20.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.174+0000 7fa7b77fe640 1 --2- 10.20.193.58:0/3295966835 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa7a407a6c0 0x7fa7a409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:20.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.175+0000 7fa7b77fe640 1 -- 10.20.193.58:0/3295966835 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fa7c009e640 con 0x7fa7d813d8c0 2026-02-23T06:39:20.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.175+0000 7fa7d6ffd640 1 --2- 10.20.193.58:0/3295966835 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa7a407a6c0 0x7fa7a409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:20.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.175+0000 7fa7d6ffd640 1 --2- 10.20.193.58:0/3295966835 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa7a407a6c0 0x7fa7a409ab70 secure :-1 s=READY pgs=401 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7cc004740 tx=0x7fa7cc03e040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:20.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.177+0000 7fa7b77fe640 1 -- 10.20.193.58:0/3295966835 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fa7c0061840 con 0x7fa7d813d8c0 2026-02-23T06:39:20.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.337+0000 7fa7b57fa640 1 -- 10.20.193.58:0/3295966835 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa7a0005b30 con 0x7fa7d813d8c0 2026-02-23T06:39:20.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.338+0000 7fa7b77fe640 1 -- 10.20.193.58:0/3295966835 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7fa7c0064960 con 0x7fa7d813d8c0 2026-02-23T06:39:20.332 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":148,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:39:20.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.340+0000 7fa7b57fa640 1 -- 10.20.193.58:0/3295966835 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa7a407a6c0 msgr2=0x7fa7a409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:20.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.340+0000 7fa7b57fa640 1 --2- 10.20.193.58:0/3295966835 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa7a407a6c0 0x7fa7a409ab70 secure :-1 s=READY pgs=401 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7cc004740 tx=0x7fa7cc03e040 comp rx=0 tx=0).stop 2026-02-23T06:39:20.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.340+0000 7fa7b57fa640 1 -- 10.20.193.58:0/3295966835 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa7d813d8c0 msgr2=0x7fa7d80b0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:20.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.340+0000 7fa7b57fa640 1 --2- 10.20.193.58:0/3295966835 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa7d813d8c0 0x7fa7d80b0210 secure :-1 s=READY pgs=270 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7c000d960 tx=0x7fa7c000de30 comp rx=0 tx=0).stop 2026-02-23T06:39:20.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.340+0000 7fa7b57fa640 1 -- 10.20.193.58:0/3295966835 shutdown_connections 2026-02-23T06:39:20.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.340+0000 7fa7b57fa640 1 --2- 10.20.193.58:0/3295966835 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa7a407a6c0 0x7fa7a409ab70 unknown :-1 s=CLOSED pgs=401 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.340+0000 7fa7b57fa640 1 --2- 10.20.193.58:0/3295966835 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa7d80b0750 0x7fa7d813ff30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.340+0000 7fa7b57fa640 1 --2- 10.20.193.58:0/3295966835 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa7d813d8c0 0x7fa7d80b0210 unknown :-1 s=CLOSED pgs=270 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.340+0000 7fa7b57fa640 1 --2- 10.20.193.58:0/3295966835 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa7c4003cb0 0x7fa7d813f400 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.340+0000 7fa7b57fa640 1 -- 10.20.193.58:0/3295966835 >> 10.20.193.58:0/3295966835 conn(0x7fa7d80561f0 msgr2=0x7fa7d80b28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:20.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.340+0000 7fa7b57fa640 1 -- 10.20.193.58:0/3295966835 shutdown_connections 2026-02-23T06:39:20.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.340+0000 7fa7b57fa640 1 -- 10.20.193.58:0/3295966835 wait complete. 2026-02-23T06:39:20.348 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:39:20.348 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:39:20.349 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:39:20.349 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:39:20.470 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.475+0000 7ff90d5d2640 1 -- 10.20.193.58:0/3903079367 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff90815d870 msgr2=0x7ff9080587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:20.470 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.475+0000 7ff90d5d2640 1 --2- 10.20.193.58:0/3903079367 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff90815d870 0x7ff9080587b0 secure :-1 s=READY pgs=41 gs=2 cs=0 l=1 c_cookie=12032201619719645971 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8f8005e70 tx=0x7ff8f802f290 comp rx=0 tx=0).stop 2026-02-23T06:39:20.470 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.475+0000 7ff90d5d2640 1 -- 10.20.193.58:0/3903079367 shutdown_connections 2026-02-23T06:39:20.470 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.475+0000 7ff90d5d2640 1 --2- 10.20.193.58:0/3903079367 >> v2:10.20.193.93:3300/0 conn(0x7ff9080b6690 0x7ff908058cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.470 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.475+0000 7ff90d5d2640 1 --2- 10.20.193.58:0/3903079367 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff90815d870 0x7ff9080587b0 unknown :-1 s=CLOSED pgs=41 gs=2 cs=0 l=1 c_cookie=12032201619719645971 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.470 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.475+0000 7ff90d5d2640 1 -- 10.20.193.58:0/3903079367 >> 10.20.193.58:0/3903079367 conn(0x7ff9080b3c20 msgr2=0x7ff9080b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:20.471 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.475+0000 7ff90d5d2640 1 -- 10.20.193.58:0/3903079367 shutdown_connections 2026-02-23T06:39:20.471 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.475+0000 7ff90d5d2640 1 -- 10.20.193.58:0/3903079367 wait complete. 2026-02-23T06:39:20.471 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.476+0000 7ff90d5d2640 1 Processor -- start 2026-02-23T06:39:20.471 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.476+0000 7ff90d5d2640 1 -- start start 2026-02-23T06:39:20.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.477+0000 7ff90d5d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff9080b6690 0x7ff90813fb00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:20.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.477+0000 7ff90d5d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff90815d4a0 0x7ff9081fdba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:20.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.477+0000 7ff90d5d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff90815d870 0x7ff908057750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:20.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.477+0000 7ff90d5d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff9082018e0 con 0x7ff90815d870 2026-02-23T06:39:20.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.477+0000 7ff90d5d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff908140120 con 0x7ff90815d4a0 2026-02-23T06:39:20.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.477+0000 7ff90d5d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7ff908140400 con 0x7ff9080b6690 2026-02-23T06:39:20.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.477+0000 7ff90cdd1640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff90815d870 0x7ff908057750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:20.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.477+0000 7ff907fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff9080b6690 0x7ff90813fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:20.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.477+0000 7ff90cdd1640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff90815d870 0x7ff908057750 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:46716/0 (socket says 10.20.193.58:46716) 2026-02-23T06:39:20.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.477+0000 7ff90cdd1640 1 -- 10.20.193.58:0/1309919416 learned_addr learned my addr 10.20.193.58:0/1309919416 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:39:20.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.477+0000 7ff9077fe640 1 --2- 10.20.193.58:0/1309919416 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff90815d4a0 0x7ff9081fdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:20.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.478+0000 7ff90cdd1640 1 -- 10.20.193.58:0/1309919416 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff9080b6690 msgr2=0x7ff90813fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:20.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.478+0000 7ff90cdd1640 1 --2- 10.20.193.58:0/1309919416 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff9080b6690 0x7ff90813fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.478+0000 7ff90cdd1640 1 -- 10.20.193.58:0/1309919416 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff90815d4a0 msgr2=0x7ff9081fdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:20.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.478+0000 7ff90cdd1640 1 --2- 10.20.193.58:0/1309919416 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff90815d4a0 0x7ff9081fdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.478+0000 7ff90cdd1640 1 -- 10.20.193.58:0/1309919416 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f8009570 con 0x7ff90815d870 2026-02-23T06:39:20.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.478+0000 7ff90cdd1640 1 --2- 10.20.193.58:0/1309919416 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff90815d870 0x7ff908057750 secure :-1 s=READY pgs=272 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8fc00f8d0 tx=0x7ff8fc00fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:20.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.478+0000 7ff904ff9640 1 -- 10.20.193.58:0/1309919416 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8fc00dce0 con 0x7ff90815d870 2026-02-23T06:39:20.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.478+0000 7ff904ff9640 1 -- 10.20.193.58:0/1309919416 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8fc005930 con 0x7ff90815d870 2026-02-23T06:39:20.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.478+0000 7ff904ff9640 1 -- 10.20.193.58:0/1309919416 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8fc005d60 con 0x7ff90815d870 2026-02-23T06:39:20.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.478+0000 7ff90d5d2640 1 -- 10.20.193.58:0/1309919416 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff908201290 con 0x7ff90815d870 2026-02-23T06:39:20.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.478+0000 7ff90d5d2640 1 -- 10.20.193.58:0/1309919416 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9081fe0e0 con 0x7ff90815d870 2026-02-23T06:39:20.474 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.479+0000 7ff8e27fc640 1 --2- 10.20.193.58:0/1309919416 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff90815df00 0x7ff90815a100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:20.475 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.479+0000 7ff8e27fc640 1 -- 10.20.193.58:0/1309919416 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff908201420 con 0x7ff90815df00 2026-02-23T06:39:20.475 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.479+0000 7ff907fff640 1 --2- 10.20.193.58:0/1309919416 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff90815df00 0x7ff90815a100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:20.476 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.480+0000 7ff907fff640 1 -- 10.20.193.58:0/1309919416 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9080b6330 con 0x7ff90815df00 2026-02-23T06:39:20.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.480+0000 7ff904ff9640 1 -- 10.20.193.58:0/1309919416 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7ff8fc005ec0 con 0x7ff90815d870 2026-02-23T06:39:20.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.480+0000 7ff907fff640 1 --2- 10.20.193.58:0/1309919416 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff90815df00 0x7ff90815a100 secure :-1 s=READY pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8f40027d0 tx=0x7ff8f400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:20.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.481+0000 7ff904ff9640 1 --2- 10.20.193.58:0/1309919416 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff8d807a6c0 0x7ff8d809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:20.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.481+0000 7ff904ff9640 1 -- 10.20.193.58:0/1309919416 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7ff8fc0a7860 con 0x7ff90815d870 2026-02-23T06:39:20.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.481+0000 7ff9077fe640 1 --2- 10.20.193.58:0/1309919416 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff8d807a6c0 0x7ff8d809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:20.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.481+0000 7ff904ff9640 1 -- 10.20.193.58:0/1309919416 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8f4019070 con 0x7ff90815df00 2026-02-23T06:39:20.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.481+0000 7ff904ff9640 1 -- 10.20.193.58:0/1309919416 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7ff8f4006ab0 con 0x7ff90815df00 2026-02-23T06:39:20.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.481+0000 7ff904ff9640 1 -- 10.20.193.58:0/1309919416 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff90815df00 msgr2=0x7ff90815a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:20.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.481+0000 7ff904ff9640 1 --2- 10.20.193.58:0/1309919416 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff90815df00 0x7ff90815a100 secure :-1 s=READY pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8f40027d0 tx=0x7ff8f400eb80 comp rx=0 tx=0).stop 2026-02-23T06:39:20.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.481+0000 7ff904ff9640 1 -- 10.20.193.58:0/1309919416 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff90815df00 msgr2=0x7ff90815a100 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:39:20.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.481+0000 7ff904ff9640 1 --2- 10.20.193.58:0/1309919416 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff90815df00 0x7ff90815a100 secure :-1 s=CLOSED pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8f40027d0 tx=0x7ff8f400eb80 comp rx=0 tx=0).stop 2026-02-23T06:39:20.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.481+0000 7ff9077fe640 1 --2- 10.20.193.58:0/1309919416 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff8d807a6c0 0x7ff8d809ab70 secure :-1 s=READY pgs=402 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8f80023d0 tx=0x7ff8f803a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:20.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.486+0000 7ff8e27fc640 1 --2- 10.20.193.58:0/1309919416 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff908201d50 0x7ff90815a640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:20.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.486+0000 7ff8e27fc640 1 -- 10.20.193.58:0/1309919416 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff908164250 con 0x7ff908201d50 2026-02-23T06:39:20.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.486+0000 7ff907fff640 1 --2- 10.20.193.58:0/1309919416 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff908201d50 0x7ff90815a640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:20.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.486+0000 7ff907fff640 1 -- 10.20.193.58:0/1309919416 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff9080b6d50 con 0x7ff908201d50 2026-02-23T06:39:20.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.487+0000 7ff907fff640 1 --2- 10.20.193.58:0/1309919416 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff908201d50 0x7ff90815a640 secure :-1 s=READY pgs=274 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8f4017040 tx=0x7ff8f40028f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:20.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.487+0000 7ff904ff9640 1 -- 10.20.193.58:0/1309919416 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8f4002a20 con 0x7ff908201d50 2026-02-23T06:39:20.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.488+0000 7ff904ff9640 1 -- 10.20.193.58:0/1309919416 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5559 (secure 0 0 0) 0x7ff8f4022070 con 0x7ff908201d50 2026-02-23T06:39:20.483 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:39:20.483 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:39:20.483 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:39:20.484 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:39:20.484 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 148, 2026-02-23T06:39:20.484 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 367998, 2026-02-23T06:39:20.484 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:39:20.484 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:39:20.484 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:39:20.484 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:39:20.484 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:20.484 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:39:20.484 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:39:20.484 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:39:20.485 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:39:20.485 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:39:20.485 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:39:20.485 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:39:20.485 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:39:20.485 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:39:20.485 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:39:20.485 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:39:20.485 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:39:20.485 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:39:20.486 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:39:20.486 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:39:20.486 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:39:20.486 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:39:20.486 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:20.486 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:39:20.486 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:39:20.486 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:39:20.486 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:39:20.486 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:39:20.487 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:39:20.487 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:39:20.487 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:39:20.487 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:39:20.487 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:39:20.487 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:39:20.487 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:39:20.487 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:39:20.487 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:39:20.487 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:39:20.488 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:20.488 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.488 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:39:20.488 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:39:20.488 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:39:20.488 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:39:20.488 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:39:20.488 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:39:20.488 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:39:20.488 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:39:20.488 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:39:20.489 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:39:20.489 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:39:20.489 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:39:20.489 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:39:20.489 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:39:20.489 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:39:20.489 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:39:20.489 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:39:20.489 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:39:20.489 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:39:20.489 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:39:20.489 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:39:20.490 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:39:20.490 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:39:20.490 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:39:20.490 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:39:20.490 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:39:20.490 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:39:20.490 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:39:20.490 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:39:20.490 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:39:20.490 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:20.490 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:39:20.490 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.491 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:39:20.491 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.491 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:39:20.491 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:39:20.491 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:39:20.491 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:39:20.491 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.491 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:39:20.491 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:39:20.491 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:20.491 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.491 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.492 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:39:20.492 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:39:20.492 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:20.492 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:20.492 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:20.492 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.492 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:39:20.492 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:39:20.492 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:39:20.492 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:39:20.492 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:39:20.493 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:39:20.493 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.493 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.493 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:39:20.493 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:39:20.493 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:39:20.493 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:39:20.493 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.493 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:39:20.493 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:39:20.493 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:20.493 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.494 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.494 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:39:20.494 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:39:20.494 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:20.494 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:20.494 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:20.494 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.494 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:39:20.494 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:39:20.494 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:39:20.494 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:39:20.494 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:39:20.494 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:39:20.495 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.495 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.495 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:39:20.495 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:39:20.495 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:39:20.495 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:39:20.495 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.495 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:39:20.495 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:39:20.495 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:20.495 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.495 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.496 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:39:20.496 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:39:20.496 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:20.496 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:20.496 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:20.496 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.496 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:39:20.496 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:39:20.496 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:39:20.496 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:39:20.496 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:39:20.496 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:39:20.497 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:20.497 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:20.497 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.497 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:39:20.497 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:39:20.497 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.497 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:20.497 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:20.497 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:39:20.497 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:20.497 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:20.497 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:39:20.497 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.498 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:20.498 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:20.498 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:39:20.498 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:20.498 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:20.498 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:39:20.498 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.498 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:20.498 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:20.498 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:39:20.498 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:20.498 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:20.499 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:39:20.499 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.499 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:39:20.499 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:39:20.499 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:39:20.499 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.499 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.499 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:20.499 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:20.499 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:39:20.499 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:20.499 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:20.500 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:39:20.500 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.500 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:20.500 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:20.500 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:39:20.500 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:20.500 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:20.500 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.500 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:39:20.500 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:39:20.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.488+0000 7ff904ff9640 1 -- 10.20.193.58:0/1309919416 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff908201d50 msgr2=0x7ff90815a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:20.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.488+0000 7ff904ff9640 1 --2- 10.20.193.58:0/1309919416 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff908201d50 0x7ff90815a640 secure :-1 s=READY pgs=274 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8f4017040 tx=0x7ff8f40028f0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.488+0000 7ff904ff9640 1 -- 10.20.193.58:0/1309919416 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff908201d50 msgr2=0x7ff90815a640 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:39:20.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.488+0000 7ff904ff9640 1 --2- 10.20.193.58:0/1309919416 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff908201d50 0x7ff90815a640 unknown :-1 s=CLOSED pgs=274 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.488+0000 7ff8e27fc640 1 -- 10.20.193.58:0/1309919416 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff8d807a6c0 msgr2=0x7ff8d809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:20.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.488+0000 7ff8e27fc640 1 --2- 10.20.193.58:0/1309919416 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff8d807a6c0 0x7ff8d809ab70 secure :-1 s=READY pgs=402 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8f80023d0 tx=0x7ff8f803a040 comp rx=0 tx=0).stop 2026-02-23T06:39:20.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.488+0000 7ff8e27fc640 1 -- 10.20.193.58:0/1309919416 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff90815d870 msgr2=0x7ff908057750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:20.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.488+0000 7ff8e27fc640 1 --2- 10.20.193.58:0/1309919416 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff90815d870 0x7ff908057750 secure :-1 s=READY pgs=272 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8fc00f8d0 tx=0x7ff8fc00fda0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.488+0000 7ff90cdd1640 1 -- 10.20.193.58:0/1309919416 reap_dead start 2026-02-23T06:39:20.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.488+0000 7ff90cdd1640 1 -- 10.20.193.58:0/1309919416 reap_dead start 2026-02-23T06:39:20.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.488+0000 7ff8e27fc640 1 -- 10.20.193.58:0/1309919416 shutdown_connections 2026-02-23T06:39:20.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.488+0000 7ff8e27fc640 1 -- 10.20.193.58:0/1309919416 >> 10.20.193.58:0/1309919416 conn(0x7ff9080b3c20 msgr2=0x7ff9080aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:20.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.488+0000 7ff8e27fc640 1 -- 10.20.193.58:0/1309919416 shutdown_connections 2026-02-23T06:39:20.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.488+0000 7ff8e27fc640 1 -- 10.20.193.58:0/1309919416 wait complete. 2026-02-23T06:39:20.504 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:39:20.504 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:39:20.504 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:39:20.632 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.637+0000 7fbd93283640 1 -- 10.20.193.58:0/3378956738 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd78003bc0 msgr2=0x7fbd78003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:20.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.637+0000 7fbd93283640 1 --2- 10.20.193.58:0/3378956738 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd78003bc0 0x7fbd78003f90 secure :-1 s=READY pgs=276 gs=5 cs=0 l=1 c_cookie=1005538454555304142 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd8800bc00 tx=0x7fbd8802f850 comp rx=0 tx=0).stop 2026-02-23T06:39:20.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.637+0000 7fbd92a82640 1 -- 10.20.193.58:0/3378956738 reap_dead start 2026-02-23T06:39:20.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.637+0000 7fbd93283640 1 -- 10.20.193.58:0/3378956738 shutdown_connections 2026-02-23T06:39:20.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.637+0000 7fbd93283640 1 -- 10.20.193.58:0/3378956738 >> 10.20.193.58:0/3378956738 conn(0x7fbd8400a260 msgr2=0x7fbd8400b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:20.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.637+0000 7fbd93283640 1 -- 10.20.193.58:0/3378956738 shutdown_connections 2026-02-23T06:39:20.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.637+0000 7fbd93283640 1 -- 10.20.193.58:0/3378956738 wait complete. 2026-02-23T06:39:20.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.641+0000 7fbd93283640 1 Processor -- start 2026-02-23T06:39:20.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.641+0000 7fbd93283640 1 -- start start 2026-02-23T06:39:20.637 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.642+0000 7fbd93283640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd840478c0 0x7fbd84047c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:20.637 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.642+0000 7fbd93283640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd840f6760 0x7fbd84196990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:20.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.642+0000 7fbd93283640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd84032590 0x7fbd840d6af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:20.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.642+0000 7fbd93283640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fbd840f5c20 con 0x7fbd84032590 2026-02-23T06:39:20.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.642+0000 7fbd93283640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fbd840f4490 con 0x7fbd840f6760 2026-02-23T06:39:20.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.642+0000 7fbd93283640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fbd840489d0 con 0x7fbd840478c0 2026-02-23T06:39:20.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.643+0000 7fbd92a82640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd84032590 0x7fbd840d6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:20.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.643+0000 7fbd92a82640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd84032590 0x7fbd840d6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:46758/0 (socket says 10.20.193.58:46758) 2026-02-23T06:39:20.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.643+0000 7fbd92a82640 1 -- 10.20.193.58:0/3028663243 learned_addr learned my addr 10.20.193.58:0/3028663243 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:39:20.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.643+0000 7fbd92a82640 1 -- 10.20.193.58:0/3028663243 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd840478c0 msgr2=0x7fbd84047c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:20.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.643+0000 7fbd92a82640 1 --2- 10.20.193.58:0/3028663243 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd840478c0 0x7fbd84047c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.644+0000 7fbd92a82640 1 -- 10.20.193.58:0/3028663243 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd840f6760 msgr2=0x7fbd84196990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:20.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.644+0000 7fbd92a82640 1 --2- 10.20.193.58:0/3028663243 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd840f6760 0x7fbd84196990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.644+0000 7fbd92a82640 1 -- 10.20.193.58:0/3028663243 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd84048410 con 0x7fbd84032590 2026-02-23T06:39:20.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.644+0000 7fbd92a82640 1 --2- 10.20.193.58:0/3028663243 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd84032590 0x7fbd840d6af0 secure :-1 s=READY pgs=277 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd8c060260 tx=0x7fbd8c04c020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:20.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.644+0000 7fbd72ffd640 1 -- 10.20.193.58:0/3028663243 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd8c038ad0 con 0x7fbd84032590 2026-02-23T06:39:20.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.644+0000 7fbd72ffd640 1 -- 10.20.193.58:0/3028663243 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd8c07f070 con 0x7fbd84032590 2026-02-23T06:39:20.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.644+0000 7fbd72ffd640 1 -- 10.20.193.58:0/3028663243 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd8c062940 con 0x7fbd84032590 2026-02-23T06:39:20.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.644+0000 7fbd93283640 1 -- 10.20.193.58:0/3028663243 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd840486f0 con 0x7fbd84032590 2026-02-23T06:39:20.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.644+0000 7fbd93283640 1 -- 10.20.193.58:0/3028663243 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd84196470 con 0x7fbd84032590 2026-02-23T06:39:20.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.645+0000 7fbd93283640 1 --2- 10.20.193.58:0/3028663243 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd840d7030 0x7fbd841995f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:20.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.645+0000 7fbd93283640 1 -- 10.20.193.58:0/3028663243 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fbd84048880 con 0x7fbd840d7030 2026-02-23T06:39:20.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.646+0000 7fbd92281640 1 --2- 10.20.193.58:0/3028663243 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd840d7030 0x7fbd841995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:20.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.646+0000 7fbd72ffd640 1 -- 10.20.193.58:0/3028663243 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fbd8c0609c0 con 0x7fbd84032590 2026-02-23T06:39:20.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.647+0000 7fbd92281640 1 -- 10.20.193.58:0/3028663243 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd840fa510 con 0x7fbd840d7030 2026-02-23T06:39:20.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.647+0000 7fbd72ffd640 1 --2- 10.20.193.58:0/3028663243 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbd5c07a720 0x7fbd5c09abd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:20.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.647+0000 7fbd72ffd640 1 -- 10.20.193.58:0/3028663243 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fbd8c106650 con 0x7fbd84032590 2026-02-23T06:39:20.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.647+0000 7fbd92281640 1 --2- 10.20.193.58:0/3028663243 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd840d7030 0x7fbd841995f0 secure :-1 s=READY pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd8c05f940 tx=0x7fbd8800b9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:20.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.648+0000 7fbd91a80640 1 --2- 10.20.193.58:0/3028663243 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbd5c07a720 0x7fbd5c09abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:20.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.648+0000 7fbd72ffd640 1 -- 10.20.193.58:0/3028663243 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd88002d00 con 0x7fbd840d7030 2026-02-23T06:39:20.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.648+0000 7fbd72ffd640 1 -- 10.20.193.58:0/3028663243 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fbd88002e60 con 0x7fbd840d7030 2026-02-23T06:39:20.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.648+0000 7fbd72ffd640 1 -- 10.20.193.58:0/3028663243 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd840d7030 msgr2=0x7fbd841995f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:20.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.648+0000 7fbd72ffd640 1 --2- 10.20.193.58:0/3028663243 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd840d7030 0x7fbd841995f0 secure :-1 s=READY pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd8c05f940 tx=0x7fbd8800b9e0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.648+0000 7fbd72ffd640 1 -- 10.20.193.58:0/3028663243 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd840d7030 msgr2=0x7fbd841995f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:39:20.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.648+0000 7fbd72ffd640 1 --2- 10.20.193.58:0/3028663243 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd840d7030 0x7fbd841995f0 secure :-1 s=CLOSED pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd8c05f940 tx=0x7fbd8800b9e0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.648+0000 7fbd91a80640 1 --2- 10.20.193.58:0/3028663243 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbd5c07a720 0x7fbd5c09abd0 secure :-1 s=READY pgs=403 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd840d43c0 tx=0x7fbd800028e0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:20.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.656+0000 7fbd93283640 1 --2- 10.20.193.58:0/3028663243 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd84199b30 0x7fbd84199f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:20.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.656+0000 7fbd93283640 1 -- 10.20.193.58:0/3028663243 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fbd840d7400 con 0x7fbd84199b30 2026-02-23T06:39:20.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.658+0000 7fbd92281640 1 --2- 10.20.193.58:0/3028663243 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd84199b30 0x7fbd84199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:20.654 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.659+0000 7fbd92281640 1 -- 10.20.193.58:0/3028663243 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbd84050c50 con 0x7fbd84199b30 2026-02-23T06:39:20.656 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.661+0000 7fbd92281640 1 --2- 10.20.193.58:0/3028663243 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd84199b30 0x7fbd84199f30 secure :-1 s=READY pgs=15 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd8800bbd0 tx=0x7fbd8800b360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:20.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.661+0000 7fbd72ffd640 1 -- 10.20.193.58:0/3028663243 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd88005040 con 0x7fbd84199b30 2026-02-23T06:39:20.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.662+0000 7fbd72ffd640 1 -- 10.20.193.58:0/3028663243 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4912 (secure 0 0 0) 0x7fbd880051a0 con 0x7fbd84199b30 2026-02-23T06:39:20.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.662+0000 7fbd72ffd640 1 -- 10.20.193.58:0/3028663243 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd84199b30 msgr2=0x7fbd84199f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:20.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.662+0000 7fbd72ffd640 1 --2- 10.20.193.58:0/3028663243 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd84199b30 0x7fbd84199f30 secure :-1 s=READY pgs=15 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd8800bbd0 tx=0x7fbd8800b360 comp rx=0 tx=0).stop 2026-02-23T06:39:20.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.662+0000 7fbd72ffd640 1 -- 10.20.193.58:0/3028663243 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd84199b30 msgr2=0x7fbd84199f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:39:20.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.662+0000 7fbd72ffd640 1 --2- 10.20.193.58:0/3028663243 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd84199b30 0x7fbd84199f30 secure :-1 s=CLOSED pgs=15 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd8800bbd0 tx=0x7fbd8800b360 comp rx=0 tx=0).stop 2026-02-23T06:39:20.675 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:39:20.675 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:39:20.675 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:39:20.675 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:39:20.675 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 148, 2026-02-23T06:39:20.675 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 26612, 2026-02-23T06:39:20.675 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:39:20.675 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:39:20.675 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:39:20.676 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:39:20.677 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:20.678 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:39:20.679 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:20.680 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:20.680 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.680 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:39:20.680 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:39:20.680 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.680 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:20.680 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:20.680 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:39:20.680 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:20.680 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:20.680 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:39:20.680 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.680 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:20.680 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:20.680 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:39:20.680 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:20.680 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:20.680 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.680 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:39:20.680 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:39:20.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.663+0000 7fbd93283640 1 -- 10.20.193.58:0/3028663243 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbd5c07a720 msgr2=0x7fbd5c09abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:20.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.663+0000 7fbd93283640 1 --2- 10.20.193.58:0/3028663243 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbd5c07a720 0x7fbd5c09abd0 secure :-1 s=READY pgs=403 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd840d43c0 tx=0x7fbd800028e0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.663+0000 7fbd93283640 1 -- 10.20.193.58:0/3028663243 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd84032590 msgr2=0x7fbd840d6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:20.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.663+0000 7fbd93283640 1 --2- 10.20.193.58:0/3028663243 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd84032590 0x7fbd840d6af0 secure :-1 s=READY pgs=277 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd8c060260 tx=0x7fbd8c04c020 comp rx=0 tx=0).stop 2026-02-23T06:39:20.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.663+0000 7fbd92a82640 1 -- 10.20.193.58:0/3028663243 reap_dead start 2026-02-23T06:39:20.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.663+0000 7fbd92a82640 1 -- 10.20.193.58:0/3028663243 reap_dead start 2026-02-23T06:39:20.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.663+0000 7fbd93283640 1 -- 10.20.193.58:0/3028663243 shutdown_connections 2026-02-23T06:39:20.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.663+0000 7fbd93283640 1 -- 10.20.193.58:0/3028663243 >> 10.20.193.58:0/3028663243 conn(0x7fbd8400a260 msgr2=0x7fbd840d4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:20.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.664+0000 7fbd93283640 1 -- 10.20.193.58:0/3028663243 shutdown_connections 2026-02-23T06:39:20.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.664+0000 7fbd93283640 1 -- 10.20.193.58:0/3028663243 wait complete. 2026-02-23T06:39:20.681 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:39:20.681 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:39:20.681 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:39:20.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.815+0000 7f0873d8d640 1 -- 10.20.193.58:0/1819035471 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f086c0b1910 msgr2=0x7f086c157bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:20.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.815+0000 7f0873d8d640 1 --2- 10.20.193.58:0/1819035471 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f086c0b1910 0x7f086c157bb0 secure :-1 s=READY pgs=17 gs=2 cs=0 l=1 c_cookie=11230046157716512667 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f086c0b4d10 tx=0x7f086002f200 comp rx=0 tx=0).stop 2026-02-23T06:39:20.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.815+0000 7f0873d8d640 1 -- 10.20.193.58:0/1819035471 shutdown_connections 2026-02-23T06:39:20.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.815+0000 7f0873d8d640 1 --2- 10.20.193.58:0/1819035471 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f086c0b1910 0x7f086c157bb0 unknown :-1 s=CLOSED pgs=17 gs=2 cs=0 l=1 c_cookie=11230046157716512667 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.815+0000 7f0873d8d640 1 --2- 10.20.193.58:0/1819035471 >> v2:10.20.193.58:3300/0 conn(0x7f086c161d50 0x7f086c157670 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.815+0000 7f0873d8d640 1 -- 10.20.193.58:0/1819035471 >> 10.20.193.58:0/1819035471 conn(0x7f086c058e50 msgr2=0x7f086c059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:20.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.815+0000 7f0873d8d640 1 -- 10.20.193.58:0/1819035471 shutdown_connections 2026-02-23T06:39:20.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.815+0000 7f0873d8d640 1 -- 10.20.193.58:0/1819035471 wait complete. 2026-02-23T06:39:20.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.817+0000 7f0873d8d640 1 Processor -- start 2026-02-23T06:39:20.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.817+0000 7f0873d8d640 1 -- start start 2026-02-23T06:39:20.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.818+0000 7f0873d8d640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f086c0b1540 0x7f086c1590b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:20.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.818+0000 7f0873d8d640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f086c0b1910 0x7f086c0b43a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:20.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.818+0000 7f0871301640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f086c0b1910 0x7f086c0b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:20.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.818+0000 7f0871301640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f086c0b1910 0x7f086c0b43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:40250/0 (socket says 10.20.193.58:40250) 2026-02-23T06:39:20.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.818+0000 7f0871301640 1 -- 10.20.193.58:0/950928599 learned_addr learned my addr 10.20.193.58:0/950928599 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:39:20.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.818+0000 7f0871b02640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f086c0b1540 0x7f086c1590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:20.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.818+0000 7f0873d8d640 1 --2- 10.20.193.58:0/950928599 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f086c161d50 0x7f086c13b410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:20.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.818+0000 7f0873d8d640 1 -- 10.20.193.58:0/950928599 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f086c158520 con 0x7f086c161d50 2026-02-23T06:39:20.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.819+0000 7f0872303640 1 --2- 10.20.193.58:0/950928599 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f086c161d50 0x7f086c13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:20.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.819+0000 7f0873d8d640 1 -- 10.20.193.58:0/950928599 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f086c156bb0 con 0x7f086c0b1910 2026-02-23T06:39:20.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.819+0000 7f0873d8d640 1 -- 10.20.193.58:0/950928599 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f086c157040 con 0x7f086c0b1540 2026-02-23T06:39:20.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.819+0000 7f0871b02640 1 -- 10.20.193.58:0/950928599 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f086c0b1910 msgr2=0x7f086c0b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:20.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.819+0000 7f0871b02640 1 --2- 10.20.193.58:0/950928599 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f086c0b1910 0x7f086c0b43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.819+0000 7f0871b02640 1 -- 10.20.193.58:0/950928599 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f086c161d50 msgr2=0x7f086c13b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:20.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.819+0000 7f0871b02640 1 --2- 10.20.193.58:0/950928599 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f086c161d50 0x7f086c13b410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.819+0000 7f0871b02640 1 -- 10.20.193.58:0/950928599 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0860009570 con 0x7f086c0b1540 2026-02-23T06:39:20.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.819+0000 7f0871b02640 1 --2- 10.20.193.58:0/950928599 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f086c0b1540 0x7f086c1590b0 secure :-1 s=READY pgs=42 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f086800d700 tx=0x7f086800dbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:20.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.820+0000 7f085a7fc640 1 -- 10.20.193.58:0/950928599 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0868007b70 con 0x7f086c0b1540 2026-02-23T06:39:20.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.820+0000 7f085a7fc640 1 -- 10.20.193.58:0/950928599 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0868007dc0 con 0x7f086c0b1540 2026-02-23T06:39:20.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.820+0000 7f085a7fc640 1 -- 10.20.193.58:0/950928599 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f08680062f0 con 0x7f086c0b1540 2026-02-23T06:39:20.816 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.820+0000 7f0873d8d640 1 -- 10.20.193.58:0/950928599 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f086c13d480 con 0x7f086c0b1540 2026-02-23T06:39:20.816 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.820+0000 7f0873d8d640 1 -- 10.20.193.58:0/950928599 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f086c1563d0 con 0x7f086c0b1540 2026-02-23T06:39:20.818 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.822+0000 7f085a7fc640 1 -- 10.20.193.58:0/950928599 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f0868006450 con 0x7f086c0b1540 2026-02-23T06:39:20.818 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.823+0000 7f085a7fc640 1 --2- 10.20.193.58:0/950928599 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f083c07a6c0 0x7f083c09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:20.818 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.823+0000 7f085a7fc640 1 -- 10.20.193.58:0/950928599 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f0868014e30 con 0x7f086c0b1540 2026-02-23T06:39:20.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.824+0000 7f0871301640 1 --2- 10.20.193.58:0/950928599 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f083c07a6c0 0x7f083c09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:20.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.825+0000 7f0833fff640 1 --2- 10.20.193.58:0/950928599 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f086c1558c0 0x7f086c200f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:20.822 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.825+0000 7f0833fff640 1 -- 10.20.193.58:0/950928599 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f086c156d20 con 0x7f086c1558c0 2026-02-23T06:39:20.822 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.825+0000 7f0871301640 1 --2- 10.20.193.58:0/950928599 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f083c07a6c0 0x7f083c09ab70 secure :-1 s=READY pgs=404 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f086c15b460 tx=0x7f085c00b4a0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:20.822 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.826+0000 7f0872303640 1 --2- 10.20.193.58:0/950928599 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f086c1558c0 0x7f086c200f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:20.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.828+0000 7f0872303640 1 -- 10.20.193.58:0/950928599 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f086c13d6c0 con 0x7f086c1558c0 2026-02-23T06:39:20.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.830+0000 7f0872303640 1 --2- 10.20.193.58:0/950928599 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f086c1558c0 0x7f086c200f30 secure :-1 s=READY pgs=43 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f086c0b4d10 tx=0x7f08600028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:20.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.830+0000 7f085a7fc640 1 -- 10.20.193.58:0/950928599 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f086003d050 con 0x7f086c1558c0 2026-02-23T06:39:20.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.830+0000 7f085a7fc640 1 -- 10.20.193.58:0/950928599 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f086003e040 con 0x7f086c1558c0 2026-02-23T06:39:20.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.830+0000 7f085a7fc640 1 -- 10.20.193.58:0/950928599 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f086c1558c0 msgr2=0x7f086c200f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:20.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.830+0000 7f085a7fc640 1 --2- 10.20.193.58:0/950928599 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f086c1558c0 0x7f086c200f30 secure :-1 s=READY pgs=43 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f086c0b4d10 tx=0x7f08600028d0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.830+0000 7f085a7fc640 1 -- 10.20.193.58:0/950928599 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f086c1558c0 msgr2=0x7f086c200f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:39:20.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.830+0000 7f085a7fc640 1 --2- 10.20.193.58:0/950928599 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f086c1558c0 0x7f086c200f30 secure :-1 s=CLOSED pgs=43 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f086c0b4d10 tx=0x7f08600028d0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.835+0000 7f0833fff640 1 --2- 10.20.193.58:0/950928599 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f086c155c90 0x7f086c201470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:20.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.835+0000 7f0833fff640 1 -- 10.20.193.58:0/950928599 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f086c0b7260 con 0x7f086c155c90 2026-02-23T06:39:20.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.835+0000 7f0872303640 1 --2- 10.20.193.58:0/950928599 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f086c155c90 0x7f086c201470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:20.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.835+0000 7f0872303640 1 -- 10.20.193.58:0/950928599 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f086c0aecb0 con 0x7f086c155c90 2026-02-23T06:39:20.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.835+0000 7f0872303640 1 --2- 10.20.193.58:0/950928599 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f086c155c90 0x7f086c201470 secure :-1 s=READY pgs=44 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f086c055a60 tx=0x7f0860009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:20.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.836+0000 7f085a7fc640 1 -- 10.20.193.58:0/950928599 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0860052070 con 0x7f086c155c90 2026-02-23T06:39:20.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.836+0000 7f085a7fc640 1 -- 10.20.193.58:0/950928599 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5413 (secure 0 0 0) 0x7f0860038c60 con 0x7f086c155c90 2026-02-23T06:39:20.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.836+0000 7f085a7fc640 1 -- 10.20.193.58:0/950928599 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f086c155c90 msgr2=0x7f086c201470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:20.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.836+0000 7f085a7fc640 1 --2- 10.20.193.58:0/950928599 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f086c155c90 0x7f086c201470 secure :-1 s=READY pgs=44 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f086c055a60 tx=0x7f0860009310 comp rx=0 tx=0).stop 2026-02-23T06:39:20.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.836+0000 7f085a7fc640 1 -- 10.20.193.58:0/950928599 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f086c155c90 msgr2=0x7f086c201470 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:39:20.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.836+0000 7f085a7fc640 1 --2- 10.20.193.58:0/950928599 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f086c155c90 0x7f086c201470 secure :-1 s=CLOSED pgs=44 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f086c055a60 tx=0x7f0860009310 comp rx=0 tx=0).stop 2026-02-23T06:39:20.832 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:39:20.833 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:39:20.833 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:39:20.833 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:39:20.833 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 148, 2026-02-23T06:39:20.833 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 85353, 2026-02-23T06:39:20.834 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:39:20.834 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:39:20.834 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:39:20.834 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:39:20.834 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:20.834 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:39:20.834 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:39:20.834 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:39:20.835 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:39:20.835 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:39:20.835 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:39:20.835 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:39:20.835 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:39:20.835 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:39:20.835 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:39:20.836 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:39:20.836 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:39:20.836 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:39:20.836 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:39:20.836 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:39:20.836 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:39:20.836 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:39:20.837 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:20.837 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:39:20.837 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:39:20.837 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:39:20.837 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:39:20.837 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:39:20.837 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:39:20.838 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:39:20.838 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:39:20.838 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:39:20.838 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:39:20.838 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:39:20.838 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:39:20.838 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:39:20.838 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:39:20.839 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:39:20.839 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:20.839 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.839 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:39:20.839 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:39:20.839 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:39:20.839 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:39:20.839 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:39:20.840 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:39:20.840 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:39:20.840 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:39:20.840 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:39:20.840 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:39:20.840 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:39:20.840 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:39:20.840 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:39:20.840 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:39:20.840 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:39:20.840 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:39:20.841 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:39:20.841 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:39:20.841 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:39:20.841 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:39:20.841 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:39:20.841 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:39:20.841 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:39:20.841 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:39:20.841 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:39:20.841 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:39:20.841 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:39:20.841 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:39:20.841 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:39:20.842 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:39:20.842 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:20.842 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:39:20.842 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.842 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:39:20.842 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.842 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:39:20.842 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:39:20.842 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:39:20.842 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:39:20.842 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.843 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:39:20.843 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:39:20.843 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:20.843 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.843 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.843 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:39:20.843 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:39:20.843 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:20.843 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:20.843 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:20.844 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.844 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:39:20.844 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:39:20.844 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:39:20.844 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:39:20.844 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:39:20.844 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:39:20.844 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.844 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.844 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:39:20.844 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:39:20.845 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:39:20.845 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:39:20.845 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.845 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:39:20.845 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:39:20.845 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:20.845 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.845 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.845 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:39:20.845 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:39:20.845 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:20.845 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:20.845 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:20.845 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.846 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:39:20.846 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:39:20.846 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:39:20.846 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:39:20.846 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:39:20.846 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:39:20.846 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.846 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.846 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:39:20.846 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:39:20.846 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:39:20.846 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:39:20.846 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.846 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:39:20.847 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:39:20.847 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:20.847 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.847 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.847 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:39:20.847 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:39:20.847 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:20.847 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:20.847 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:20.847 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.847 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:39:20.848 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:39:20.848 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:39:20.848 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:39:20.848 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:39:20.848 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:39:20.848 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:20.848 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:20.848 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.848 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:39:20.848 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:39:20.849 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.849 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:20.849 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:20.849 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:39:20.849 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:20.849 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:20.849 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:39:20.849 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.849 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:20.849 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:20.849 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:39:20.849 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:20.850 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:20.850 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:39:20.850 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.850 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:20.850 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:20.850 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:39:20.850 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:20.850 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:20.850 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:39:20.850 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.850 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:20.850 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:20.850 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:39:20.850 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:20.850 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:20.850 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:39:20.850 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:20.851 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:20.851 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:20.851 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:39:20.851 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:20.851 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:20.851 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:20.851 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:39:20.851 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:39:20.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.836+0000 7f0833fff640 1 -- 10.20.193.58:0/950928599 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f083c07a6c0 msgr2=0x7f083c09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:20.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.836+0000 7f0833fff640 1 --2- 10.20.193.58:0/950928599 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f083c07a6c0 0x7f083c09ab70 secure :-1 s=READY pgs=404 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f086c15b460 tx=0x7f085c00b4a0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.836+0000 7f0833fff640 1 -- 10.20.193.58:0/950928599 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f086c0b1540 msgr2=0x7f086c1590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:20.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.836+0000 7f0833fff640 1 --2- 10.20.193.58:0/950928599 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f086c0b1540 0x7f086c1590b0 secure :-1 s=READY pgs=42 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f086800d700 tx=0x7f086800dbd0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.837+0000 7f0872303640 1 -- 10.20.193.58:0/950928599 reap_dead start 2026-02-23T06:39:20.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.837+0000 7f0833fff640 1 -- 10.20.193.58:0/950928599 shutdown_connections 2026-02-23T06:39:20.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.837+0000 7f0833fff640 1 -- 10.20.193.58:0/950928599 >> 10.20.193.58:0/950928599 conn(0x7f086c058e50 msgr2=0x7f086c0b7830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:20.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.838+0000 7f0833fff640 1 -- 10.20.193.58:0/950928599 shutdown_connections 2026-02-23T06:39:20.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.839+0000 7f0833fff640 1 -- 10.20.193.58:0/950928599 wait complete. 2026-02-23T06:39:20.854 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:39:20.855 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-23T06:39:20.855 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-23T06:39:20.855 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-23T06:39:20.855 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-23T06:39:20.855 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-23T06:39:20.855 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:39:20.864 INFO:tasks.ceph.mon.b:Stopped 2026-02-23T06:39:20.864 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:39:20.865 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:39:20.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.994+0000 7ff203fff640 1 -- 10.20.193.58:0/31973980 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff2040b5d90 msgr2=0x7ff20415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:20.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.994+0000 7ff203fff640 1 --2- 10.20.193.58:0/31973980 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff2040b5d90 0x7ff20415abd0 secure :-1 s=READY pgs=279 gs=3 cs=0 l=1 c_cookie=7770513464193203839 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2040b5040 tx=0x7ff1f4030180 comp rx=0 tx=0).stop 2026-02-23T06:39:20.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.994+0000 7ff203fff640 1 -- 10.20.193.58:0/31973980 shutdown_connections 2026-02-23T06:39:20.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.994+0000 7ff203fff640 1 --2- 10.20.193.58:0/31973980 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff2040b5d90 0x7ff20415abd0 unknown :-1 s=CLOSED pgs=279 gs=3 cs=0 l=1 c_cookie=7770513464193203839 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.994+0000 7ff203fff640 1 --2- 10.20.193.58:0/31973980 >> v2:10.20.193.93:3300/0 conn(0x7ff20405d080 0x7ff20405b0e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.994+0000 7ff203fff640 1 -- 10.20.193.58:0/31973980 >> 10.20.193.58:0/31973980 conn(0x7ff2040b3c20 msgr2=0x7ff2040b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:20.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.994+0000 7ff203fff640 1 -- 10.20.193.58:0/31973980 shutdown_connections 2026-02-23T06:39:20.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.994+0000 7ff203fff640 1 -- 10.20.193.58:0/31973980 wait complete. 2026-02-23T06:39:20.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.996+0000 7ff203fff640 1 Processor -- start 2026-02-23T06:39:20.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.996+0000 7ff203fff640 1 -- start start 2026-02-23T06:39:20.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.997+0000 7ff203fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff20405d080 0x7ff204157c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:20.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.998+0000 7ff203fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff20405d450 0x7ff204131e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:20.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.998+0000 7ff203fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff2040b5d90 0x7ff204132370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:20.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.998+0000 7ff203fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff2041527e0 con 0x7ff20405d080 2026-02-23T06:39:20.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.998+0000 7ff2027fc640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff20405d450 msgr2=0x7ff204131e30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:39:20.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.998+0000 7ff2027fc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff20405d450 0x7ff204131e30 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:39:20.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.998+0000 7ff203fff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff204153900 con 0x7ff20405d450 2026-02-23T06:39:20.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.998+0000 7ff203fff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7ff204152bf0 con 0x7ff2040b5d90 2026-02-23T06:39:20.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.998+0000 7ff2037fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff2040b5d90 0x7ff204132370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:20.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.998+0000 7ff2037fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff2040b5d90 0x7ff204132370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:47710/0 (socket says 10.20.193.58:47710) 2026-02-23T06:39:20.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.998+0000 7ff2037fe640 1 -- 10.20.193.58:0/4184472623 learned_addr learned my addr 10.20.193.58:0/4184472623 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:39:20.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.998+0000 7ff202ffd640 1 --2- 10.20.193.58:0/4184472623 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff20405d080 0x7ff204157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:20.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.999+0000 7ff2037fe640 1 -- 10.20.193.58:0/4184472623 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff20405d450 msgr2=0x7ff204131e30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:39:20.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.999+0000 7ff2037fe640 1 --2- 10.20.193.58:0/4184472623 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff20405d450 0x7ff204131e30 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.999+0000 7ff2037fe640 1 -- 10.20.193.58:0/4184472623 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff20405d080 msgr2=0x7ff204157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:20.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.999+0000 7ff2037fe640 1 --2- 10.20.193.58:0/4184472623 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff20405d080 0x7ff204157c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:20.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.999+0000 7ff2037fe640 1 -- 10.20.193.58:0/4184472623 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f400a590 con 0x7ff2040b5d90 2026-02-23T06:39:20.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.999+0000 7ff202ffd640 1 --2- 10.20.193.58:0/4184472623 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff20405d080 0x7ff204157c50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:39:20.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:20.999+0000 7ff2037fe640 1 --2- 10.20.193.58:0/4184472623 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff2040b5d90 0x7ff204132370 secure :-1 s=READY pgs=46 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1f4003d50 tx=0x7ff1f4003d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:20.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:21.000+0000 7ff1e37fe640 1 -- 10.20.193.58:0/4184472623 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff1f4047070 con 0x7ff2040b5d90 2026-02-23T06:39:20.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:21.000+0000 7ff203fff640 1 -- 10.20.193.58:0/4184472623 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff204153bc0 con 0x7ff2040b5d90 2026-02-23T06:39:20.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:21.000+0000 7ff203fff640 1 -- 10.20.193.58:0/4184472623 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff204154180 con 0x7ff2040b5d90 2026-02-23T06:39:20.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:21.000+0000 7ff1e37fe640 1 -- 10.20.193.58:0/4184472623 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1f4005b50 con 0x7ff2040b5d90 2026-02-23T06:39:20.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:21.000+0000 7ff1e37fe640 1 -- 10.20.193.58:0/4184472623 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff1f403d040 con 0x7ff2040b5d90 2026-02-23T06:39:20.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:21.001+0000 7ff1e17fa640 1 -- 10.20.193.58:0/4184472623 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2040b63c0 con 0x7ff2040b5d90 2026-02-23T06:39:20.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:21.002+0000 7ff1e37fe640 1 -- 10.20.193.58:0/4184472623 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7ff1f4039680 con 0x7ff2040b5d90 2026-02-23T06:39:20.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:21.003+0000 7ff1e37fe640 1 --2- 10.20.193.58:0/4184472623 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff1d007a630 0x7ff1d009aae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:20.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:21.003+0000 7ff1e37fe640 1 -- 10.20.193.58:0/4184472623 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7ff1f40c4860 con 0x7ff2040b5d90 2026-02-23T06:39:20.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:21.003+0000 7ff202ffd640 1 --2- 10.20.193.58:0/4184472623 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff1d007a630 0x7ff1d009aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:20.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:21.004+0000 7ff1e37fe640 1 -- 10.20.193.58:0/4184472623 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7ff1f4087a80 con 0x7ff2040b5d90 2026-02-23T06:39:21.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:21.008+0000 7ff202ffd640 1 --2- 10.20.193.58:0/4184472623 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff1d007a630 0x7ff1d009aae0 secure :-1 s=READY pgs=405 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1ec002820 tx=0x7ff1ec008040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:21.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:21.172+0000 7ff1e17fa640 1 -- 10.20.193.58:0/4184472623 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff2040b6dc0 con 0x7ff2040b5d90 2026-02-23T06:39:21.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:21.172+0000 7ff1e37fe640 1 -- 10.20.193.58:0/4184472623 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7ff1f408aba0 con 0x7ff2040b5d90 2026-02-23T06:39:21.168 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":148,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:39:21.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:21.175+0000 7ff1e17fa640 1 -- 10.20.193.58:0/4184472623 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff1d007a630 msgr2=0x7ff1d009aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:21.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:21.175+0000 7ff1e17fa640 1 --2- 10.20.193.58:0/4184472623 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff1d007a630 0x7ff1d009aae0 secure :-1 s=READY pgs=405 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1ec002820 tx=0x7ff1ec008040 comp rx=0 tx=0).stop 2026-02-23T06:39:21.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:21.175+0000 7ff1e17fa640 1 -- 10.20.193.58:0/4184472623 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff2040b5d90 msgr2=0x7ff204132370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:21.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:21.175+0000 7ff1e17fa640 1 --2- 10.20.193.58:0/4184472623 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff2040b5d90 0x7ff204132370 secure :-1 s=READY pgs=46 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1f4003d50 tx=0x7ff1f4003d80 comp rx=0 tx=0).stop 2026-02-23T06:39:21.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:21.175+0000 7ff1e17fa640 1 -- 10.20.193.58:0/4184472623 shutdown_connections 2026-02-23T06:39:21.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:21.175+0000 7ff1e17fa640 1 --2- 10.20.193.58:0/4184472623 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff1d007a630 0x7ff1d009aae0 unknown :-1 s=CLOSED pgs=405 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:21.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:21.175+0000 7ff1e17fa640 1 --2- 10.20.193.58:0/4184472623 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff2040b5d90 0x7ff204132370 unknown :-1 s=CLOSED pgs=46 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:21.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:21.175+0000 7ff1e17fa640 1 --2- 10.20.193.58:0/4184472623 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff20405d450 0x7ff204131e30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:21.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:21.175+0000 7ff1e17fa640 1 --2- 10.20.193.58:0/4184472623 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff20405d080 0x7ff204157c50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:21.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:21.175+0000 7ff1e17fa640 1 -- 10.20.193.58:0/4184472623 >> 10.20.193.58:0/4184472623 conn(0x7ff2040b3c20 msgr2=0x7ff204163430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:21.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:21.175+0000 7ff1e17fa640 1 -- 10.20.193.58:0/4184472623 shutdown_connections 2026-02-23T06:39:21.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:21.175+0000 7ff1e17fa640 1 -- 10.20.193.58:0/4184472623 wait complete. 2026-02-23T06:39:24.186 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:39:24.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.314+0000 7f649b083640 1 -- 10.20.193.58:0/3089217046 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f647c003a80 msgr2=0x7f647c003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:24.309 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.314+0000 7f649b083640 1 --2- 10.20.193.58:0/3089217046 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f647c003a80 0x7f647c003e90 secure :-1 s=READY pgs=282 gs=2 cs=0 l=1 c_cookie=4918505552165167076 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6484009870 tx=0x7f648402efe0 comp rx=0 tx=0).stop 2026-02-23T06:39:24.309 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.314+0000 7f649a882640 1 -- 10.20.193.58:0/3089217046 reap_dead start 2026-02-23T06:39:24.309 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.314+0000 7f649b083640 1 -- 10.20.193.58:0/3089217046 shutdown_connections 2026-02-23T06:39:24.309 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.314+0000 7f649b083640 1 -- 10.20.193.58:0/3089217046 >> 10.20.193.58:0/3089217046 conn(0x7f64940b3c20 msgr2=0x7f64940b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:24.309 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.314+0000 7f649b083640 1 -- 10.20.193.58:0/3089217046 shutdown_connections 2026-02-23T06:39:24.309 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.314+0000 7f649b083640 1 -- 10.20.193.58:0/3089217046 wait complete. 2026-02-23T06:39:24.312 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.315+0000 7f649b083640 1 Processor -- start 2026-02-23T06:39:24.312 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.315+0000 7f649b083640 1 -- start start 2026-02-23T06:39:24.312 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.315+0000 7f649b083640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f647c003a80 0x7f6494140b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:24.312 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.315+0000 7f649b083640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6494162a00 0x7f6494155650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:24.312 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.315+0000 7f649b083640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6494162e50 0x7f6494155b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:24.313 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.315+0000 7f649b083640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f6494058210 con 0x7f6494162a00 2026-02-23T06:39:24.313 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.315+0000 7f649b083640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f6494161780 con 0x7f647c003a80 2026-02-23T06:39:24.313 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.315+0000 7f649b083640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f6494057c90 con 0x7f6494162e50 2026-02-23T06:39:24.313 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.315+0000 7f6499880640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6494162a00 0x7f6494155650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:24.313 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.315+0000 7f649a882640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6494162e50 0x7f6494155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:24.313 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.316+0000 7f649a081640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f647c003a80 msgr2=0x7f6494140b90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:39:24.313 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.316+0000 7f649a081640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f647c003a80 0x7f6494140b90 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:39:24.313 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.316+0000 7f649a882640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6494162e50 0x7f6494155b90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:47742/0 (socket says 10.20.193.58:47742) 2026-02-23T06:39:24.313 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.316+0000 7f6499880640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6494162a00 0x7f6494155650 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:46808/0 (socket says 10.20.193.58:46808) 2026-02-23T06:39:24.313 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.316+0000 7f649a882640 1 -- 10.20.193.58:0/3998632029 learned_addr learned my addr 10.20.193.58:0/3998632029 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:39:24.313 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.316+0000 7f6499880640 1 -- 10.20.193.58:0/3998632029 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6494162e50 msgr2=0x7f6494155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:24.313 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.316+0000 7f6499880640 1 --2- 10.20.193.58:0/3998632029 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6494162e50 0x7f6494155b90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:24.314 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.316+0000 7f6499880640 1 -- 10.20.193.58:0/3998632029 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f647c003a80 msgr2=0x7f6494140b90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:39:24.314 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.316+0000 7f6499880640 1 --2- 10.20.193.58:0/3998632029 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f647c003a80 0x7f6494140b90 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:24.314 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.316+0000 7f6499880640 1 -- 10.20.193.58:0/3998632029 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6494057f30 con 0x7f6494162a00 2026-02-23T06:39:24.314 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.316+0000 7f6499880640 1 --2- 10.20.193.58:0/3998632029 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6494162a00 0x7f6494155650 secure :-1 s=READY pgs=283 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6488002b30 tx=0x7f648800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:24.314 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.316+0000 7f647affd640 1 -- 10.20.193.58:0/3998632029 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6488004050 con 0x7f6494162a00 2026-02-23T06:39:24.314 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.316+0000 7f647affd640 1 -- 10.20.193.58:0/3998632029 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6488007d50 con 0x7f6494162a00 2026-02-23T06:39:24.314 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.316+0000 7f647affd640 1 -- 10.20.193.58:0/3998632029 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f64880146b0 con 0x7f6494162a00 2026-02-23T06:39:24.314 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.317+0000 7f649b083640 1 -- 10.20.193.58:0/3998632029 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6494161130 con 0x7f6494162a00 2026-02-23T06:39:24.314 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.317+0000 7f649b083640 1 -- 10.20.193.58:0/3998632029 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6494125ee0 con 0x7f6494162a00 2026-02-23T06:39:24.315 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.317+0000 7f649b083640 1 -- 10.20.193.58:0/3998632029 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64940b6d50 con 0x7f6494162a00 2026-02-23T06:39:24.316 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.319+0000 7f647affd640 1 -- 10.20.193.58:0/3998632029 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f648801d3b0 con 0x7f6494162a00 2026-02-23T06:39:24.316 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.320+0000 7f647affd640 1 --2- 10.20.193.58:0/3998632029 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f646407a680 0x7f646409ab30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:24.316 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.320+0000 7f647affd640 1 -- 10.20.193.58:0/3998632029 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f648809d6e0 con 0x7f6494162a00 2026-02-23T06:39:24.316 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.320+0000 7f649a081640 1 --2- 10.20.193.58:0/3998632029 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f646407a680 0x7f646409ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:24.316 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.320+0000 7f649a081640 1 --2- 10.20.193.58:0/3998632029 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f646407a680 0x7f646409ab30 secure :-1 s=READY pgs=406 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64840023d0 tx=0x7f6484004820 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:24.316 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.322+0000 7f647affd640 1 -- 10.20.193.58:0/3998632029 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f6488060920 con 0x7f6494162a00 2026-02-23T06:39:24.493 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.498+0000 7f649b083640 1 -- 10.20.193.58:0/3998632029 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f64941615b0 con 0x7f6494162a00 2026-02-23T06:39:24.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.502+0000 7f647affd640 1 -- 10.20.193.58:0/3998632029 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f6488063a40 con 0x7f6494162a00 2026-02-23T06:39:24.497 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":148,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:39:24.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.505+0000 7f649b083640 1 -- 10.20.193.58:0/3998632029 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f646407a680 msgr2=0x7f646409ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:24.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.505+0000 7f649b083640 1 --2- 10.20.193.58:0/3998632029 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f646407a680 0x7f646409ab30 secure :-1 s=READY pgs=406 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64840023d0 tx=0x7f6484004820 comp rx=0 tx=0).stop 2026-02-23T06:39:24.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.505+0000 7f649b083640 1 -- 10.20.193.58:0/3998632029 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6494162a00 msgr2=0x7f6494155650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:24.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.505+0000 7f649b083640 1 --2- 10.20.193.58:0/3998632029 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6494162a00 0x7f6494155650 secure :-1 s=READY pgs=283 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6488002b30 tx=0x7f648800cf80 comp rx=0 tx=0).stop 2026-02-23T06:39:24.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.505+0000 7f649b083640 1 -- 10.20.193.58:0/3998632029 shutdown_connections 2026-02-23T06:39:24.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.505+0000 7f649b083640 1 --2- 10.20.193.58:0/3998632029 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f646407a680 0x7f646409ab30 unknown :-1 s=CLOSED pgs=406 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:24.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.505+0000 7f649b083640 1 --2- 10.20.193.58:0/3998632029 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6494162e50 0x7f6494155b90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:24.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.505+0000 7f649b083640 1 --2- 10.20.193.58:0/3998632029 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6494162a00 0x7f6494155650 unknown :-1 s=CLOSED pgs=283 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:24.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.505+0000 7f649b083640 1 --2- 10.20.193.58:0/3998632029 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f647c003a80 0x7f6494140b90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:24.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.505+0000 7f649b083640 1 -- 10.20.193.58:0/3998632029 >> 10.20.193.58:0/3998632029 conn(0x7f64940b3c20 msgr2=0x7f64940b7480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:24.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.505+0000 7f649b083640 1 -- 10.20.193.58:0/3998632029 shutdown_connections 2026-02-23T06:39:24.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:24.507+0000 7f649b083640 1 -- 10.20.193.58:0/3998632029 wait complete. 2026-02-23T06:39:27.523 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:39:27.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.652+0000 7f734b577640 1 -- 10.20.193.58:0/2664471308 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f734c0b6690 msgr2=0x7f734c058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:27.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.652+0000 7f734b577640 1 --2- 10.20.193.58:0/2664471308 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f734c0b6690 0x7f734c058cf0 secure :-1 s=READY pgs=285 gs=2 cs=0 l=1 c_cookie=11103883207650601781 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f734c059740 tx=0x7f733c030290 comp rx=0 tx=0).stop 2026-02-23T06:39:27.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.652+0000 7f734b577640 1 -- 10.20.193.58:0/2664471308 shutdown_connections 2026-02-23T06:39:27.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.652+0000 7f734b577640 1 --2- 10.20.193.58:0/2664471308 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f734c0b6690 0x7f734c058cf0 unknown :-1 s=CLOSED pgs=285 gs=2 cs=0 l=1 c_cookie=11103883207650601781 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:27.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.652+0000 7f734b577640 1 --2- 10.20.193.58:0/2664471308 >> v2:10.20.193.93:3300/0 conn(0x7f734c15d870 0x7f734c0587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:27.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.652+0000 7f734b577640 1 -- 10.20.193.58:0/2664471308 >> 10.20.193.58:0/2664471308 conn(0x7f734c0b3c20 msgr2=0x7f734c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:27.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.652+0000 7f734b577640 1 -- 10.20.193.58:0/2664471308 shutdown_connections 2026-02-23T06:39:27.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.652+0000 7f734b577640 1 -- 10.20.193.58:0/2664471308 wait complete. 2026-02-23T06:39:27.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.653+0000 7f734b577640 1 Processor -- start 2026-02-23T06:39:27.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.653+0000 7f734b577640 1 -- start start 2026-02-23T06:39:27.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.654+0000 7f734b577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f734c0b6690 0x7f734c1603e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:27.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.654+0000 7f734b577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f734c15d4a0 0x7f734c0561f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:27.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.654+0000 7f734b577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f734c15d870 0x7f734c162390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:27.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.654+0000 7f734b577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f734c142af0 con 0x7f734c0b6690 2026-02-23T06:39:27.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.654+0000 7f734b577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f734c142e70 con 0x7f734c15d870 2026-02-23T06:39:27.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.654+0000 7f734b577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f734c143130 con 0x7f734c15d4a0 2026-02-23T06:39:27.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.654+0000 7f734ad76640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f734c15d870 msgr2=0x7f734c162390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:39:27.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.654+0000 7f734a575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f734c0b6690 0x7f734c1603e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:27.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.654+0000 7f734ad76640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f734c15d870 0x7f734c162390 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:39:27.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.654+0000 7f734a575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f734c0b6690 0x7f734c1603e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:46838/0 (socket says 10.20.193.58:46838) 2026-02-23T06:39:27.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.654+0000 7f734a575640 1 -- 10.20.193.58:0/1823434966 learned_addr learned my addr 10.20.193.58:0/1823434966 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:39:27.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.654+0000 7f7349d74640 1 --2- 10.20.193.58:0/1823434966 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f734c15d4a0 0x7f734c0561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:27.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.654+0000 7f734a575640 1 -- 10.20.193.58:0/1823434966 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f734c15d4a0 msgr2=0x7f734c0561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:27.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.654+0000 7f734a575640 1 --2- 10.20.193.58:0/1823434966 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f734c15d4a0 0x7f734c0561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:27.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.654+0000 7f734a575640 1 -- 10.20.193.58:0/1823434966 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f734c15d870 msgr2=0x7f734c162390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:39:27.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.654+0000 7f734a575640 1 --2- 10.20.193.58:0/1823434966 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f734c15d870 0x7f734c162390 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:27.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.654+0000 7f734a575640 1 -- 10.20.193.58:0/1823434966 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f733c00a590 con 0x7f734c0b6690 2026-02-23T06:39:27.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.655+0000 7f734a575640 1 --2- 10.20.193.58:0/1823434966 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f734c0b6690 0x7f734c1603e0 secure :-1 s=READY pgs=286 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7340007fd0 tx=0x7f734000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:27.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.655+0000 7f7332ffd640 1 -- 10.20.193.58:0/1823434966 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7340012850 con 0x7f734c0b6690 2026-02-23T06:39:27.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.655+0000 7f734b577640 1 -- 10.20.193.58:0/1823434966 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f734c161570 con 0x7f734c0b6690 2026-02-23T06:39:27.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.655+0000 7f734b577640 1 -- 10.20.193.58:0/1823434966 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f734c141140 con 0x7f734c0b6690 2026-02-23T06:39:27.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.655+0000 7f7332ffd640 1 -- 10.20.193.58:0/1823434966 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7340012aa0 con 0x7f734c0b6690 2026-02-23T06:39:27.654 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.655+0000 7f7332ffd640 1 -- 10.20.193.58:0/1823434966 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7340012e50 con 0x7f734c0b6690 2026-02-23T06:39:27.654 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.655+0000 7f7330ff9640 1 -- 10.20.193.58:0/1823434966 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f734c0b6d50 con 0x7f734c0b6690 2026-02-23T06:39:27.654 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.657+0000 7f7332ffd640 1 -- 10.20.193.58:0/1823434966 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f734001b400 con 0x7f734c0b6690 2026-02-23T06:39:27.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.657+0000 7f7332ffd640 1 --2- 10.20.193.58:0/1823434966 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f731807a5a0 0x7f731809aa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:27.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.657+0000 7f7332ffd640 1 -- 10.20.193.58:0/1823434966 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f734009d840 con 0x7f734c0b6690 2026-02-23T06:39:27.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.658+0000 7f7349d74640 1 --2- 10.20.193.58:0/1823434966 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f731807a5a0 0x7f731809aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:27.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.658+0000 7f7349d74640 1 --2- 10.20.193.58:0/1823434966 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f731807a5a0 0x7f731809aa50 secure :-1 s=READY pgs=407 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7334006fd0 tx=0x7f7334008040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:27.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.659+0000 7f7332ffd640 1 -- 10.20.193.58:0/1823434966 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f7340064320 con 0x7f734c0b6690 2026-02-23T06:39:27.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.819+0000 7f7330ff9640 1 -- 10.20.193.58:0/1823434966 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f734c0b06c0 con 0x7f734c0b6690 2026-02-23T06:39:27.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.820+0000 7f7332ffd640 1 -- 10.20.193.58:0/1823434966 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f734c0b06c0 con 0x7f734c0b6690 2026-02-23T06:39:27.816 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":148,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:39:27.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.824+0000 7f7330ff9640 1 -- 10.20.193.58:0/1823434966 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f731807a5a0 msgr2=0x7f731809aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:27.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.824+0000 7f7330ff9640 1 --2- 10.20.193.58:0/1823434966 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f731807a5a0 0x7f731809aa50 secure :-1 s=READY pgs=407 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7334006fd0 tx=0x7f7334008040 comp rx=0 tx=0).stop 2026-02-23T06:39:27.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.824+0000 7f7330ff9640 1 -- 10.20.193.58:0/1823434966 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f734c0b6690 msgr2=0x7f734c1603e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:27.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.824+0000 7f7330ff9640 1 --2- 10.20.193.58:0/1823434966 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f734c0b6690 0x7f734c1603e0 secure :-1 s=READY pgs=286 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7340007fd0 tx=0x7f734000c970 comp rx=0 tx=0).stop 2026-02-23T06:39:27.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.824+0000 7f7330ff9640 1 -- 10.20.193.58:0/1823434966 shutdown_connections 2026-02-23T06:39:27.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.824+0000 7f7330ff9640 1 --2- 10.20.193.58:0/1823434966 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f731807a5a0 0x7f731809aa50 unknown :-1 s=CLOSED pgs=407 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:27.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.824+0000 7f7330ff9640 1 --2- 10.20.193.58:0/1823434966 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f734c15d870 0x7f734c162390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:27.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.824+0000 7f7330ff9640 1 --2- 10.20.193.58:0/1823434966 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f734c15d4a0 0x7f734c0561f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:27.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.824+0000 7f7330ff9640 1 --2- 10.20.193.58:0/1823434966 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f734c0b6690 0x7f734c1603e0 unknown :-1 s=CLOSED pgs=286 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:27.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.824+0000 7f7330ff9640 1 -- 10.20.193.58:0/1823434966 >> 10.20.193.58:0/1823434966 conn(0x7f734c0b3c20 msgr2=0x7f734c0b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:27.822 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.827+0000 7f7330ff9640 1 -- 10.20.193.58:0/1823434966 shutdown_connections 2026-02-23T06:39:27.822 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:27.827+0000 7f7330ff9640 1 -- 10.20.193.58:0/1823434966 wait complete. 2026-02-23T06:39:30.838 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:39:35.363 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.367+0000 7f0742b14640 1 -- 10.20.193.58:0/2318181193 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f07200241c0 msgr2=0x7f0720044670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:35.363 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.367+0000 7f0742b14640 1 --2- 10.20.193.58:0/2318181193 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f07200241c0 0x7f0720044670 secure :-1 s=READY pgs=53 gs=25 cs=0 l=1 c_cookie=10847193492107995181 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0724004710 tx=0x7f0724030d50 comp rx=0 tx=0).stop 2026-02-23T06:39:35.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.367+0000 7f0742313640 1 -- 10.20.193.58:0/2318181193 reap_dead start 2026-02-23T06:39:35.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.368+0000 7f0742b14640 1 -- 10.20.193.58:0/2318181193 shutdown_connections 2026-02-23T06:39:35.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.368+0000 7f0742b14640 1 -- 10.20.193.58:0/2318181193 >> 10.20.193.58:0/2318181193 conn(0x7f073c0b3c20 msgr2=0x7f073c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:35.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.368+0000 7f0742b14640 1 -- 10.20.193.58:0/2318181193 shutdown_connections 2026-02-23T06:39:35.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.368+0000 7f0742b14640 1 -- 10.20.193.58:0/2318181193 wait complete. 2026-02-23T06:39:35.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.369+0000 7f0742b14640 1 Processor -- start 2026-02-23T06:39:35.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.369+0000 7f0742b14640 1 -- start start 2026-02-23T06:39:35.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.369+0000 7f0742b14640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07200241c0 0x7f073c13f970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:35.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.370+0000 7f0742b14640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f073c13d760 0x7f073c11ccb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:35.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.370+0000 7f0742b14640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f073c057370 0x7f073c0577e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:35.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.370+0000 7f0742b14640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f073c11d1f0 con 0x7f07200241c0 2026-02-23T06:39:35.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.370+0000 7f0742b14640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f073c057f90 con 0x7f073c13d760 2026-02-23T06:39:35.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.370+0000 7f0742b14640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f073c0581e0 con 0x7f073c057370 2026-02-23T06:39:35.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.370+0000 7f0741311640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f073c13d760 msgr2=0x7f073c11ccb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:39:35.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.370+0000 7f0741311640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f073c13d760 0x7f073c11ccb0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:39:35.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.370+0000 7f0741b12640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07200241c0 0x7f073c13f970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:35.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.370+0000 7f0741b12640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07200241c0 0x7f073c13f970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:48404/0 (socket says 10.20.193.58:48404) 2026-02-23T06:39:35.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.370+0000 7f0741b12640 1 -- 10.20.193.58:0/4099872007 learned_addr learned my addr 10.20.193.58:0/4099872007 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:39:35.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.370+0000 7f0742313640 1 --2- 10.20.193.58:0/4099872007 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f073c057370 0x7f073c0577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:35.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.370+0000 7f0741b12640 1 -- 10.20.193.58:0/4099872007 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f073c057370 msgr2=0x7f073c0577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:35.368 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.370+0000 7f0741b12640 1 --2- 10.20.193.58:0/4099872007 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f073c057370 0x7f073c0577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:35.368 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.370+0000 7f0741b12640 1 -- 10.20.193.58:0/4099872007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f073c13d760 msgr2=0x7f073c11ccb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:39:35.368 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.370+0000 7f0741b12640 1 --2- 10.20.193.58:0/4099872007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f073c13d760 0x7f073c11ccb0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:35.368 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.370+0000 7f0741b12640 1 -- 10.20.193.58:0/4099872007 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07240044f0 con 0x7f07200241c0 2026-02-23T06:39:35.368 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.370+0000 7f0741b12640 1 --2- 10.20.193.58:0/4099872007 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07200241c0 0x7f073c13f970 secure :-1 s=READY pgs=288 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f072c00b880 tx=0x7f072c00bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:35.368 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.371+0000 7f07327fc640 1 -- 10.20.193.58:0/4099872007 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f072c00c960 con 0x7f07200241c0 2026-02-23T06:39:35.368 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.371+0000 7f07327fc640 1 -- 10.20.193.58:0/4099872007 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f072c00a040 con 0x7f07200241c0 2026-02-23T06:39:35.368 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.371+0000 7f07327fc640 1 -- 10.20.193.58:0/4099872007 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f072c015470 con 0x7f07200241c0 2026-02-23T06:39:35.368 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.371+0000 7f0742b14640 1 -- 10.20.193.58:0/4099872007 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f073c058bf0 con 0x7f07200241c0 2026-02-23T06:39:35.368 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.371+0000 7f0742b14640 1 -- 10.20.193.58:0/4099872007 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f073c13cf60 con 0x7f07200241c0 2026-02-23T06:39:35.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.372+0000 7f0742b14640 1 -- 10.20.193.58:0/4099872007 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f073c0b6d50 con 0x7f07200241c0 2026-02-23T06:39:35.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.373+0000 7f07327fc640 1 -- 10.20.193.58:0/4099872007 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f072c01d070 con 0x7f07200241c0 2026-02-23T06:39:35.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.374+0000 7f07327fc640 1 --2- 10.20.193.58:0/4099872007 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f070c07a5b0 0x7f070c09aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:35.370 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.374+0000 7f07327fc640 1 -- 10.20.193.58:0/4099872007 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f072c09cf20 con 0x7f07200241c0 2026-02-23T06:39:35.370 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.375+0000 7f0741311640 1 --2- 10.20.193.58:0/4099872007 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f070c07a5b0 0x7f070c09aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:35.370 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.375+0000 7f0741311640 1 --2- 10.20.193.58:0/4099872007 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f070c07a5b0 0x7f070c09aa60 secure :-1 s=READY pgs=408 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0724002790 tx=0x7f07240047e0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:35.371 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.376+0000 7f07327fc640 1 -- 10.20.193.58:0/4099872007 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f072c0600c0 con 0x7f07200241c0 2026-02-23T06:39:35.536 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.541+0000 7f0742b14640 1 -- 10.20.193.58:0/4099872007 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f073c13cdc0 con 0x7f07200241c0 2026-02-23T06:39:35.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.542+0000 7f07327fc640 1 -- 10.20.193.58:0/4099872007 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1749 (secure 0 0 0) 0x7f073c13cdc0 con 0x7f07200241c0 2026-02-23T06:39:35.537 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":152,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:39:35.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.544+0000 7f0742b14640 1 -- 10.20.193.58:0/4099872007 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f070c07a5b0 msgr2=0x7f070c09aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:35.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.544+0000 7f0742b14640 1 --2- 10.20.193.58:0/4099872007 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f070c07a5b0 0x7f070c09aa60 secure :-1 s=READY pgs=408 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0724002790 tx=0x7f07240047e0 comp rx=0 tx=0).stop 2026-02-23T06:39:35.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.544+0000 7f0742b14640 1 -- 10.20.193.58:0/4099872007 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07200241c0 msgr2=0x7f073c13f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:35.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.544+0000 7f0742b14640 1 --2- 10.20.193.58:0/4099872007 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07200241c0 0x7f073c13f970 secure :-1 s=READY pgs=288 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f072c00b880 tx=0x7f072c00bd50 comp rx=0 tx=0).stop 2026-02-23T06:39:35.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.544+0000 7f0742b14640 1 -- 10.20.193.58:0/4099872007 shutdown_connections 2026-02-23T06:39:35.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.544+0000 7f0742b14640 1 --2- 10.20.193.58:0/4099872007 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f070c07a5b0 0x7f070c09aa60 unknown :-1 s=CLOSED pgs=408 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:35.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.544+0000 7f0742b14640 1 --2- 10.20.193.58:0/4099872007 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f073c057370 0x7f073c0577e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:35.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.544+0000 7f0742b14640 1 --2- 10.20.193.58:0/4099872007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f073c13d760 0x7f073c11ccb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:35.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.544+0000 7f0742b14640 1 --2- 10.20.193.58:0/4099872007 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07200241c0 0x7f073c13f970 unknown :-1 s=CLOSED pgs=288 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:35.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.544+0000 7f0742b14640 1 -- 10.20.193.58:0/4099872007 >> 10.20.193.58:0/4099872007 conn(0x7f073c0b3c20 msgr2=0x7f073c0b7480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:35.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.544+0000 7f0742b14640 1 -- 10.20.193.58:0/4099872007 shutdown_connections 2026-02-23T06:39:35.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.544+0000 7f0742b14640 1 -- 10.20.193.58:0/4099872007 wait complete. 2026-02-23T06:39:35.551 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:39:35.551 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-23T06:39:35.551 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:39:35.673 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.677+0000 7f6caa843640 1 -- 10.20.193.58:0/1810153839 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ca4056960 msgr2=0x7f6ca4058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:35.673 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.677+0000 7f6caa843640 1 --2- 10.20.193.58:0/1810153839 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ca4056960 0x7f6ca4058200 secure :-1 s=READY pgs=290 gs=3 cs=0 l=1 c_cookie=16101657378146762198 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c98004740 tx=0x7f6c9802f1d0 comp rx=0 tx=0).stop 2026-02-23T06:39:35.673 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.678+0000 7f6caa843640 1 -- 10.20.193.58:0/1810153839 shutdown_connections 2026-02-23T06:39:35.673 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.678+0000 7f6caa843640 1 --2- 10.20.193.58:0/1810153839 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ca4056960 0x7f6ca4058200 unknown :-1 s=CLOSED pgs=290 gs=3 cs=0 l=1 c_cookie=16101657378146762198 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:35.673 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.678+0000 7f6caa843640 1 -- 10.20.193.58:0/1810153839 >> 10.20.193.58:0/1810153839 conn(0x7f6ca40b3c20 msgr2=0x7f6ca40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:35.673 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.678+0000 7f6caa843640 1 -- 10.20.193.58:0/1810153839 shutdown_connections 2026-02-23T06:39:35.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.678+0000 7f6caa843640 1 -- 10.20.193.58:0/1810153839 wait complete. 2026-02-23T06:39:35.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.679+0000 7f6caa843640 1 Processor -- start 2026-02-23T06:39:35.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.679+0000 7f6caa843640 1 -- start start 2026-02-23T06:39:35.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.679+0000 7f6caa843640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ca4056960 0x7f6ca4160960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:35.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.680+0000 7f6caa843640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6ca415c4b0 0x7f6ca4200c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:35.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.680+0000 7f6caa843640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6ca4162ca0 0x7f6ca41614b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:35.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.680+0000 7f6caa843640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca415aed0 con 0x7f6ca4056960 2026-02-23T06:39:35.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.680+0000 7f6caa843640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca4160ea0 con 0x7f6ca415c4b0 2026-02-23T06:39:35.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.680+0000 7f6caa843640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f6ca40af5b0 con 0x7f6ca4162ca0 2026-02-23T06:39:35.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.680+0000 7f6ca9040640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6ca415c4b0 msgr2=0x7f6ca4200c70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:39:35.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.680+0000 7f6ca9040640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6ca415c4b0 0x7f6ca4200c70 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:39:35.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.680+0000 7f6ca9841640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ca4056960 0x7f6ca4160960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:35.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.680+0000 7f6ca9841640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ca4056960 0x7f6ca4160960 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:48412/0 (socket says 10.20.193.58:48412) 2026-02-23T06:39:35.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.680+0000 7f6ca9841640 1 -- 10.20.193.58:0/2542874217 learned_addr learned my addr 10.20.193.58:0/2542874217 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:39:35.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.680+0000 7f6caa042640 1 --2- 10.20.193.58:0/2542874217 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6ca4162ca0 0x7f6ca41614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:35.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.680+0000 7f6ca9841640 1 -- 10.20.193.58:0/2542874217 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6ca4162ca0 msgr2=0x7f6ca41614b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:35.676 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.680+0000 7f6ca9841640 1 --2- 10.20.193.58:0/2542874217 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6ca4162ca0 0x7f6ca41614b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:35.676 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.680+0000 7f6ca9841640 1 -- 10.20.193.58:0/2542874217 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6ca415c4b0 msgr2=0x7f6ca4200c70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:39:35.676 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.680+0000 7f6ca9841640 1 --2- 10.20.193.58:0/2542874217 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6ca415c4b0 0x7f6ca4200c70 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:35.676 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.680+0000 7f6ca9841640 1 -- 10.20.193.58:0/2542874217 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c980094b0 con 0x7f6ca4056960 2026-02-23T06:39:35.676 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.680+0000 7f6ca9841640 1 --2- 10.20.193.58:0/2542874217 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ca4056960 0x7f6ca4160960 secure :-1 s=READY pgs=291 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c9400b520 tx=0x7f6c9400b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:35.676 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.680+0000 7f6c927fc640 1 -- 10.20.193.58:0/2542874217 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c94002c80 con 0x7f6ca4056960 2026-02-23T06:39:35.676 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.680+0000 7f6c927fc640 1 -- 10.20.193.58:0/2542874217 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c94004070 con 0x7f6ca4056960 2026-02-23T06:39:35.677 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.680+0000 7f6c927fc640 1 -- 10.20.193.58:0/2542874217 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c94004460 con 0x7f6ca4056960 2026-02-23T06:39:35.677 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.680+0000 7f6caa843640 1 -- 10.20.193.58:0/2542874217 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca40af030 con 0x7f6ca4056960 2026-02-23T06:39:35.677 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.681+0000 7f6caa843640 1 -- 10.20.193.58:0/2542874217 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ca415b0e0 con 0x7f6ca4056960 2026-02-23T06:39:35.677 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.681+0000 7f6caa843640 1 --2- 10.20.193.58:0/2542874217 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ca415a780 0x7f6ca415b300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:35.677 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.681+0000 7f6caa843640 1 -- 10.20.193.58:0/2542874217 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca415ab50 con 0x7f6ca415a780 2026-02-23T06:39:35.677 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.681+0000 7f6ca9040640 1 --2- 10.20.193.58:0/2542874217 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ca415a780 0x7f6ca415b300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:35.677 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.682+0000 7f6ca9040640 1 -- 10.20.193.58:0/2542874217 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ca4059690 con 0x7f6ca415a780 2026-02-23T06:39:35.677 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.682+0000 7f6ca9040640 1 --2- 10.20.193.58:0/2542874217 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ca415a780 0x7f6ca415b300 secure :-1 s=READY pgs=292 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c98004740 tx=0x7f6c98005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:35.677 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.682+0000 7f6c927fc640 1 -- 10.20.193.58:0/2542874217 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c9803e070 con 0x7f6ca415a780 2026-02-23T06:39:35.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.682+0000 7f6c927fc640 1 -- 10.20.193.58:0/2542874217 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f6c98043470 con 0x7f6ca415a780 2026-02-23T06:39:35.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.682+0000 7f6c927fc640 1 -- 10.20.193.58:0/2542874217 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ca415a780 msgr2=0x7f6ca415b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:35.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.682+0000 7f6c927fc640 1 --2- 10.20.193.58:0/2542874217 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ca415a780 0x7f6ca415b300 secure :-1 s=READY pgs=292 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c98004740 tx=0x7f6c98005e10 comp rx=0 tx=0).stop 2026-02-23T06:39:35.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.682+0000 7f6c927fc640 1 -- 10.20.193.58:0/2542874217 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ca415a780 msgr2=0x7f6ca415b300 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:39:35.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.682+0000 7f6c927fc640 1 --2- 10.20.193.58:0/2542874217 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ca415a780 0x7f6ca415b300 unknown :-1 s=CLOSED pgs=292 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:35.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.683+0000 7f6c927fc640 1 -- 10.20.193.58:0/2542874217 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f6c94018410 con 0x7f6ca4056960 2026-02-23T06:39:35.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.684+0000 7f6c927fc640 1 --2- 10.20.193.58:0/2542874217 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6c7407a3c0 0x7f6c7409a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:35.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.684+0000 7f6c927fc640 1 -- 10.20.193.58:0/2542874217 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f6c9409cff0 con 0x7f6ca4056960 2026-02-23T06:39:35.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.684+0000 7f6ca9040640 1 --2- 10.20.193.58:0/2542874217 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6c7407a3c0 0x7f6c7409a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:35.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.684+0000 7f6ca9040640 1 --2- 10.20.193.58:0/2542874217 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6c7407a3c0 0x7f6c7409a870 secure :-1 s=READY pgs=409 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c980023d0 tx=0x7f6c9803b000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:35.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.686+0000 7f6caa843640 1 --2- 10.20.193.58:0/2542874217 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ca41590b0 0x7f6ca4159480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:35.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.686+0000 7f6caa843640 1 -- 10.20.193.58:0/2542874217 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca415c880 con 0x7f6ca41590b0 2026-02-23T06:39:35.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.686+0000 7f6caa042640 1 --2- 10.20.193.58:0/2542874217 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ca41590b0 0x7f6ca4159480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:35.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.687+0000 7f6caa042640 1 -- 10.20.193.58:0/2542874217 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6ca413bce0 con 0x7f6ca41590b0 2026-02-23T06:39:35.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.687+0000 7f6caa042640 1 --2- 10.20.193.58:0/2542874217 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ca41590b0 0x7f6ca4159480 secure :-1 s=READY pgs=293 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ca0003a80 tx=0x7f6ca0010c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:35.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.687+0000 7f6c927fc640 1 -- 10.20.193.58:0/2542874217 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ca0005a80 con 0x7f6ca41590b0 2026-02-23T06:39:35.682 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:39:35.682 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:39:35.682 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:39:35.682 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:39:35.682 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 152, 2026-02-23T06:39:35.683 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 383198, 2026-02-23T06:39:35.683 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:39:35.683 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:39:35.683 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:39:35.683 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:35.683 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:39:35.683 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:39:35.683 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:39:35.683 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:39:35.683 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:39:35.683 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:39:35.683 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:39:35.683 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:39:35.683 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:39:35.683 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:39:35.683 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:39:35.683 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:39:35.683 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:39:35.683 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:39:35.684 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:39:35.684 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:39:35.684 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:39:35.684 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:35.684 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:39:35.684 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:39:35.684 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:39:35.684 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:39:35.684 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:39:35.684 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:39:35.684 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:39:35.684 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:39:35.684 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:39:35.684 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:39:35.684 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:39:35.684 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:39:35.684 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:39:35.684 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:39:35.684 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:39:35.684 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:35.685 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:35.685 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:39:35.685 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:39:35.685 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:39:35.685 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:39:35.685 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:39:35.685 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:39:35.685 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:39:35.685 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:39:35.685 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:39:35.685 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:39:35.685 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:39:35.685 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:39:35.685 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:39:35.685 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:39:35.685 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:39:35.685 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:39:35.685 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:39:35.685 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:39:35.685 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:39:35.686 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:39:35.686 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:39:35.686 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:39:35.686 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:39:35.686 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:39:35.686 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:39:35.686 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:39:35.686 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:39:35.686 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:39:35.686 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:39:35.686 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:39:35.686 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:35.686 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:39:35.686 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:35.686 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:39:35.686 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.686 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:39:35.686 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:39:35.686 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:39:35.686 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:39:35.686 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.686 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:39:35.687 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:39:35.687 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:35.687 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:35.687 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.687 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:39:35.687 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:39:35.687 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:35.687 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:35.687 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:35.687 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:35.687 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:39:35.687 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:39:35.687 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:39:35.687 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:39:35.687 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:39:35.687 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:39:35.687 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:35.687 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.687 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:39:35.687 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:39:35.687 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:39:35.687 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:39:35.687 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.688 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:39:35.688 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:39:35.688 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:35.688 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:35.688 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.688 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:39:35.688 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:39:35.688 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:35.688 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:35.688 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:35.688 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:35.688 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:39:35.688 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:39:35.688 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:39:35.688 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:39:35.688 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:39:35.688 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:39:35.688 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:35.688 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.688 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:39:35.688 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:39:35.688 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:39:35.689 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:39:35.689 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.689 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:39:35.689 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:39:35.689 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:35.689 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:35.689 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.689 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:39:35.689 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:39:35.689 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:35.689 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:35.689 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:35.689 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:35.689 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:39:35.689 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:39:35.689 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:39:35.689 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:39:35.689 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:39:35.689 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:39:35.689 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:35.689 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:35.689 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:35.690 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:39:35.690 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:39:35.690 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.690 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:35.690 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:35.690 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:39:35.690 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:35.690 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:35.690 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:39:35.690 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.690 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:35.690 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:35.690 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:39:35.690 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:35.690 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:35.690 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:39:35.690 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.690 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:35.690 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:35.690 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:39:35.690 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:35.690 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:35.691 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:39:35.691 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.691 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:39:35.691 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:39:35.691 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:39:35.691 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:35.691 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.691 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:35.691 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:35.691 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:39:35.691 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:35.691 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:35.691 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:39:35.691 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.691 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:35.691 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:35.691 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:39:35.691 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:35.691 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:35.691 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:35.691 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:39:35.691 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:39:35.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.687+0000 7f6c927fc640 1 -- 10.20.193.58:0/2542874217 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5547 (secure 0 0 0) 0x7f6ca0010e70 con 0x7f6ca41590b0 2026-02-23T06:39:35.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.687+0000 7f6c927fc640 1 -- 10.20.193.58:0/2542874217 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ca41590b0 msgr2=0x7f6ca4159480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:35.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.687+0000 7f6c927fc640 1 --2- 10.20.193.58:0/2542874217 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ca41590b0 0x7f6ca4159480 secure :-1 s=READY pgs=293 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ca0003a80 tx=0x7f6ca0010c10 comp rx=0 tx=0).stop 2026-02-23T06:39:35.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.687+0000 7f6c927fc640 1 -- 10.20.193.58:0/2542874217 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ca41590b0 msgr2=0x7f6ca4159480 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:39:35.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.687+0000 7f6c927fc640 1 --2- 10.20.193.58:0/2542874217 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ca41590b0 0x7f6ca4159480 unknown :-1 s=CLOSED pgs=293 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:35.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.687+0000 7f6caa843640 1 -- 10.20.193.58:0/2542874217 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6c7407a3c0 msgr2=0x7f6c7409a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:35.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.687+0000 7f6caa843640 1 --2- 10.20.193.58:0/2542874217 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6c7407a3c0 0x7f6c7409a870 secure :-1 s=READY pgs=409 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c980023d0 tx=0x7f6c9803b000 comp rx=0 tx=0).stop 2026-02-23T06:39:35.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.688+0000 7f6caa843640 1 -- 10.20.193.58:0/2542874217 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ca4056960 msgr2=0x7f6ca4160960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:35.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.688+0000 7f6caa843640 1 --2- 10.20.193.58:0/2542874217 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6ca4056960 0x7f6ca4160960 secure :-1 s=READY pgs=291 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c9400b520 tx=0x7f6c9400b9f0 comp rx=0 tx=0).stop 2026-02-23T06:39:35.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.688+0000 7f6caa042640 1 -- 10.20.193.58:0/2542874217 reap_dead start 2026-02-23T06:39:35.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.688+0000 7f6caa843640 1 -- 10.20.193.58:0/2542874217 shutdown_connections 2026-02-23T06:39:35.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.688+0000 7f6caa843640 1 -- 10.20.193.58:0/2542874217 >> 10.20.193.58:0/2542874217 conn(0x7f6ca40b3c20 msgr2=0x7f6ca40b40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:35.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.688+0000 7f6caa843640 1 -- 10.20.193.58:0/2542874217 shutdown_connections 2026-02-23T06:39:35.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.688+0000 7f6caa843640 1 -- 10.20.193.58:0/2542874217 wait complete. 2026-02-23T06:39:35.693 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:39:35.694 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-23T06:39:35.694 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:39:35.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.820+0000 7f1737577640 1 -- 10.20.193.58:0/2846721385 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f173815d870 msgr2=0x7f17380587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:35.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.820+0000 7f1737577640 1 --2- 10.20.193.58:0/2846721385 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f173815d870 0x7f17380587b0 secure :-1 s=READY pgs=295 gs=2 cs=0 l=1 c_cookie=6861164900739374378 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17380afed0 tx=0x7f172002f1b0 comp rx=0 tx=0).stop 2026-02-23T06:39:35.816 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.820+0000 7f1737577640 1 -- 10.20.193.58:0/2846721385 shutdown_connections 2026-02-23T06:39:35.816 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.820+0000 7f1737577640 1 --2- 10.20.193.58:0/2846721385 >> v2:10.20.193.93:3300/0 conn(0x7f17380b6690 0x7f1738058cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:35.816 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.820+0000 7f1737577640 1 --2- 10.20.193.58:0/2846721385 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f173815d870 0x7f17380587b0 unknown :-1 s=CLOSED pgs=295 gs=2 cs=0 l=1 c_cookie=6861164900739374378 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:35.816 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.820+0000 7f1737577640 1 -- 10.20.193.58:0/2846721385 >> 10.20.193.58:0/2846721385 conn(0x7f17380b3c20 msgr2=0x7f17380b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:35.816 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.820+0000 7f1737577640 1 -- 10.20.193.58:0/2846721385 shutdown_connections 2026-02-23T06:39:35.816 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.820+0000 7f1737577640 1 -- 10.20.193.58:0/2846721385 wait complete. 2026-02-23T06:39:35.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.821+0000 7f1737577640 1 Processor -- start 2026-02-23T06:39:35.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.821+0000 7f1737577640 1 -- start start 2026-02-23T06:39:35.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.822+0000 7f1737577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f17380b6690 0x7f173815e2e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:35.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.822+0000 7f1737577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f173815d4a0 0x7f1738057750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:35.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.822+0000 7f1737577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f173815d870 0x7f173815a280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:35.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.822+0000 7f1737577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f1738162de0 con 0x7f17380b6690 2026-02-23T06:39:35.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.822+0000 7f1737577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f173815e820 con 0x7f173815d870 2026-02-23T06:39:35.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.822+0000 7f1737577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f1738162130 con 0x7f173815d4a0 2026-02-23T06:39:35.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.822+0000 7f1736d76640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f173815d870 msgr2=0x7f173815a280 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:39:35.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.822+0000 7f1736575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f17380b6690 0x7f173815e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:35.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.822+0000 7f1736d76640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f173815d870 0x7f173815a280 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:39:35.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.822+0000 7f1736575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f17380b6690 0x7f173815e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:48426/0 (socket says 10.20.193.58:48426) 2026-02-23T06:39:35.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.822+0000 7f1736575640 1 -- 10.20.193.58:0/1672426540 learned_addr learned my addr 10.20.193.58:0/1672426540 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:39:35.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.822+0000 7f1735d74640 1 --2- 10.20.193.58:0/1672426540 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f173815d4a0 0x7f1738057750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:35.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.822+0000 7f1736575640 1 -- 10.20.193.58:0/1672426540 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f173815d4a0 msgr2=0x7f1738057750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:35.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.822+0000 7f1736575640 1 --2- 10.20.193.58:0/1672426540 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f173815d4a0 0x7f1738057750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:35.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.822+0000 7f1736575640 1 -- 10.20.193.58:0/1672426540 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f173815d870 msgr2=0x7f173815a280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:39:35.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.822+0000 7f1736575640 1 --2- 10.20.193.58:0/1672426540 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f173815d870 0x7f173815a280 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:35.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.822+0000 7f1736575640 1 -- 10.20.193.58:0/1672426540 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17200094b0 con 0x7f17380b6690 2026-02-23T06:39:35.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.822+0000 7f1736575640 1 --2- 10.20.193.58:0/1672426540 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f17380b6690 0x7f173815e2e0 secure :-1 s=READY pgs=296 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f172c00c700 tx=0x7f172c00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:35.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.822+0000 7f171effd640 1 -- 10.20.193.58:0/1672426540 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f172c00a860 con 0x7f17380b6690 2026-02-23T06:39:35.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.822+0000 7f171effd640 1 -- 10.20.193.58:0/1672426540 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f172c00aab0 con 0x7f17380b6690 2026-02-23T06:39:35.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.822+0000 7f171effd640 1 -- 10.20.193.58:0/1672426540 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f172c00ce50 con 0x7f17380b6690 2026-02-23T06:39:35.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.822+0000 7f1737577640 1 -- 10.20.193.58:0/1672426540 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1738161f40 con 0x7f17380b6690 2026-02-23T06:39:35.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.823+0000 7f1737577640 1 -- 10.20.193.58:0/1672426540 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17381619a0 con 0x7f17380b6690 2026-02-23T06:39:35.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.823+0000 7f1737577640 1 --2- 10.20.193.58:0/1672426540 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1738162860 0x7f173815a7c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:35.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.823+0000 7f1737577640 1 -- 10.20.193.58:0/1672426540 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f17380b6330 con 0x7f1738162860 2026-02-23T06:39:35.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.824+0000 7f1735d74640 1 --2- 10.20.193.58:0/1672426540 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1738162860 0x7f173815a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:35.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.824+0000 7f1735d74640 1 -- 10.20.193.58:0/1672426540 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f17380b5e10 con 0x7f1738162860 2026-02-23T06:39:35.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.824+0000 7f1735d74640 1 --2- 10.20.193.58:0/1672426540 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1738162860 0x7f173815a7c0 secure :-1 s=READY pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1720009230 tx=0x7f17200026c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:35.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.824+0000 7f171effd640 1 -- 10.20.193.58:0/1672426540 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f172c012420 con 0x7f17380b6690 2026-02-23T06:39:35.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.825+0000 7f171effd640 1 --2- 10.20.193.58:0/1672426540 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f170407a570 0x7f170409aa20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:35.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.825+0000 7f171effd640 1 -- 10.20.193.58:0/1672426540 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f172c09d450 con 0x7f17380b6690 2026-02-23T06:39:35.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.825+0000 7f171effd640 1 -- 10.20.193.58:0/1672426540 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1720047070 con 0x7f1738162860 2026-02-23T06:39:35.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.825+0000 7f171effd640 1 -- 10.20.193.58:0/1672426540 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f172003e040 con 0x7f1738162860 2026-02-23T06:39:35.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.825+0000 7f171effd640 1 -- 10.20.193.58:0/1672426540 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1738162860 msgr2=0x7f173815a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:35.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.825+0000 7f171effd640 1 --2- 10.20.193.58:0/1672426540 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1738162860 0x7f173815a7c0 secure :-1 s=READY pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1720009230 tx=0x7f17200026c0 comp rx=0 tx=0).stop 2026-02-23T06:39:35.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.825+0000 7f171effd640 1 -- 10.20.193.58:0/1672426540 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1738162860 msgr2=0x7f173815a7c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:39:35.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.825+0000 7f171effd640 1 --2- 10.20.193.58:0/1672426540 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1738162860 0x7f173815a7c0 unknown :-1 s=CLOSED pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:35.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.825+0000 7f1736d76640 1 --2- 10.20.193.58:0/1672426540 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f170407a570 0x7f170409aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:35.824 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.826+0000 7f1736d76640 1 --2- 10.20.193.58:0/1672426540 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f170407a570 0x7f170409aa20 secure :-1 s=READY pgs=410 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1728003900 tx=0x7f1728007d80 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:35.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.829+0000 7f1737577640 1 --2- 10.20.193.58:0/1672426540 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f173815b7c0 0x7f173815eca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:35.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.829+0000 7f1737577640 1 -- 10.20.193.58:0/1672426540 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f17380b6d50 con 0x7f173815b7c0 2026-02-23T06:39:35.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.830+0000 7f1735d74640 1 --2- 10.20.193.58:0/1672426540 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f173815b7c0 0x7f173815eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:35.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.830+0000 7f1735d74640 1 -- 10.20.193.58:0/1672426540 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f17380b06c0 con 0x7f173815b7c0 2026-02-23T06:39:35.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.830+0000 7f1735d74640 1 --2- 10.20.193.58:0/1672426540 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f173815b7c0 0x7f173815eca0 secure :-1 s=READY pgs=55 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f172002f6e0 tx=0x7f1720005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:35.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.831+0000 7f171effd640 1 -- 10.20.193.58:0/1672426540 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f172003d050 con 0x7f173815b7c0 2026-02-23T06:39:35.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.831+0000 7f171effd640 1 -- 10.20.193.58:0/1672426540 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5402 (secure 0 0 0) 0x7f172004c880 con 0x7f173815b7c0 2026-02-23T06:39:35.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.831+0000 7f171effd640 1 -- 10.20.193.58:0/1672426540 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f173815b7c0 msgr2=0x7f173815eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:35.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.831+0000 7f171effd640 1 --2- 10.20.193.58:0/1672426540 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f173815b7c0 0x7f173815eca0 secure :-1 s=READY pgs=55 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f172002f6e0 tx=0x7f1720005f90 comp rx=0 tx=0).stop 2026-02-23T06:39:35.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.831+0000 7f171effd640 1 -- 10.20.193.58:0/1672426540 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f173815b7c0 msgr2=0x7f173815eca0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:39:35.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.831+0000 7f171effd640 1 --2- 10.20.193.58:0/1672426540 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f173815b7c0 0x7f173815eca0 secure :-1 s=CLOSED pgs=55 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f172002f6e0 tx=0x7f1720005f90 comp rx=0 tx=0).stop 2026-02-23T06:39:35.827 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:39:35.827 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:39:35.827 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:39:35.827 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:39:35.827 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 152, 2026-02-23T06:39:35.827 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 100347, 2026-02-23T06:39:35.827 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:39:35.828 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:39:35.828 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:39:35.828 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:35.828 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:39:35.828 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:39:35.828 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:39:35.828 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:39:35.828 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:39:35.828 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:39:35.828 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:39:35.828 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:39:35.828 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:39:35.829 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:39:35.829 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:39:35.829 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:39:35.829 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:39:35.829 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:39:35.829 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:39:35.829 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:39:35.829 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:39:35.829 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:35.829 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:39:35.829 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:39:35.829 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:39:35.830 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:39:35.830 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:39:35.830 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:39:35.830 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:39:35.830 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:39:35.830 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:39:35.830 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:39:35.830 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:39:35.830 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:39:35.830 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:39:35.830 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:39:35.830 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:39:35.831 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:35.831 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:35.831 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:39:35.831 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:39:35.831 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:39:35.831 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:39:35.831 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:39:35.831 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:39:35.831 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:39:35.831 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:39:35.831 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:39:35.831 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:39:35.832 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:39:35.832 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:39:35.832 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:39:35.832 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:39:35.832 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:39:35.832 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:39:35.832 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:39:35.832 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:39:35.832 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:39:35.832 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:39:35.832 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:39:35.832 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:39:35.833 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:39:35.833 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:39:35.833 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:39:35.833 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:39:35.833 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:39:35.833 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:39:35.833 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:39:35.833 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:39:35.833 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:35.833 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:39:35.833 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:35.833 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:39:35.834 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.834 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:39:35.834 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:39:35.834 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:39:35.834 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:39:35.834 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.834 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:39:35.834 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:39:35.834 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:35.834 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:35.834 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.834 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:39:35.834 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:39:35.835 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:35.835 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:35.835 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:35.835 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:35.835 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:39:35.835 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:39:35.835 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:39:35.835 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:39:35.835 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:39:35.835 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:39:35.835 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:35.835 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.836 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:39:35.836 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:39:35.836 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:39:35.836 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:39:35.836 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.836 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:39:35.836 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:39:35.836 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:35.836 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:35.836 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.836 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:39:35.836 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:39:35.836 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:35.837 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:35.837 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:35.837 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:35.837 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:39:35.837 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:39:35.837 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:39:35.837 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:39:35.837 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:39:35.837 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:39:35.837 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:35.837 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.837 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:39:35.838 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:39:35.838 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:39:35.838 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:39:35.838 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.838 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:39:35.838 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:39:35.838 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:35.838 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:35.838 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.838 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:39:35.838 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:39:35.838 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:35.839 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:35.839 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:35.839 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:35.839 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:39:35.839 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:39:35.839 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:39:35.839 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:39:35.839 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:39:35.839 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:39:35.839 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:35.839 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:35.839 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:35.839 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:39:35.840 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:39:35.840 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.840 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:35.840 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:35.840 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:39:35.840 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:35.840 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:35.840 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:39:35.840 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.840 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:35.840 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:35.840 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:39:35.841 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:35.841 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:35.841 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:39:35.841 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.841 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:35.841 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:35.841 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:39:35.841 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:35.841 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:35.841 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:39:35.841 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.841 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:35.841 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:35.841 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:39:35.842 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:35.842 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:35.842 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:39:35.842 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:35.842 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:35.842 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:35.842 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:39:35.842 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:35.842 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:35.842 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:35.842 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:39:35.842 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:39:35.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.831+0000 7f1737577640 1 -- 10.20.193.58:0/1672426540 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f170407a570 msgr2=0x7f170409aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:35.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.831+0000 7f1737577640 1 --2- 10.20.193.58:0/1672426540 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f170407a570 0x7f170409aa20 secure :-1 s=READY pgs=410 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1728003900 tx=0x7f1728007d80 comp rx=0 tx=0).stop 2026-02-23T06:39:35.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.831+0000 7f1737577640 1 -- 10.20.193.58:0/1672426540 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f17380b6690 msgr2=0x7f173815e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:35.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.831+0000 7f1737577640 1 --2- 10.20.193.58:0/1672426540 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f17380b6690 0x7f173815e2e0 secure :-1 s=READY pgs=296 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f172c00c700 tx=0x7f172c00cb00 comp rx=0 tx=0).stop 2026-02-23T06:39:35.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.831+0000 7f1736d76640 1 -- 10.20.193.58:0/1672426540 reap_dead start 2026-02-23T06:39:35.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.831+0000 7f1736d76640 1 -- 10.20.193.58:0/1672426540 reap_dead start 2026-02-23T06:39:35.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.831+0000 7f1737577640 1 -- 10.20.193.58:0/1672426540 shutdown_connections 2026-02-23T06:39:35.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.831+0000 7f1737577640 1 -- 10.20.193.58:0/1672426540 >> 10.20.193.58:0/1672426540 conn(0x7f17380b3c20 msgr2=0x7f17380585b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:35.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.831+0000 7f1737577640 1 -- 10.20.193.58:0/1672426540 shutdown_connections 2026-02-23T06:39:35.844 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:35.831+0000 7f1737577640 1 -- 10.20.193.58:0/1672426540 wait complete. 2026-02-23T06:39:35.845 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:39:35.845 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:39:44.241 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:39:44.245 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:39:55.846 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-23T06:39:55.846 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-23T06:39:55.846 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-23T06:39:55.846 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-23T06:39:55.849 INFO:tasks.ceph.mon.b:Started 2026-02-23T06:39:55.849 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:39:55.849 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:39:55.985 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.990+0000 7f5821be5640 1 -- 10.20.193.58:0/1723911551 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f581c05b2d0 msgr2=0x7f581c0b1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:55.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.990+0000 7f581a7fc640 1 -- 10.20.193.58:0/1723911551 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5808004290 con 0x7f581c05b2d0 2026-02-23T06:39:55.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.990+0000 7f5821be5640 1 --2- 10.20.193.58:0/1723911551 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f581c05b2d0 0x7f581c0b1540 secure :-1 s=READY pgs=301 gs=3 cs=0 l=1 c_cookie=7313696856415496164 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5808005e70 tx=0x7f5808030520 comp rx=0 tx=0).stop 2026-02-23T06:39:55.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.990+0000 7f5821be5640 1 -- 10.20.193.58:0/1723911551 shutdown_connections 2026-02-23T06:39:55.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.990+0000 7f5821be5640 1 --2- 10.20.193.58:0/1723911551 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f581c05b2d0 0x7f581c0b1540 unknown :-1 s=CLOSED pgs=301 gs=3 cs=0 l=1 c_cookie=7313696856415496164 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:55.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.990+0000 7f5821be5640 1 -- 10.20.193.58:0/1723911551 >> 10.20.193.58:0/1723911551 conn(0x7f581c058e50 msgr2=0x7f581c059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:55.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.990+0000 7f5821be5640 1 -- 10.20.193.58:0/1723911551 shutdown_connections 2026-02-23T06:39:55.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.990+0000 7f5821be5640 1 -- 10.20.193.58:0/1723911551 wait complete. 2026-02-23T06:39:55.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.991+0000 7f5821be5640 1 Processor -- start 2026-02-23T06:39:55.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.991+0000 7f5821be5640 1 -- start start 2026-02-23T06:39:55.987 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.992+0000 7f5821be5640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f581c05b2d0 0x7f581c0adf10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:55.988 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.992+0000 7f5821be5640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f581c157d80 0x7f581c140fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:55.988 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.992+0000 7f5821be5640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f581c161d50 0x7f581c204d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:55.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.992+0000 7f581affd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f581c157d80 0x7f581c140fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:55.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.992+0000 7f581affd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f581c157d80 0x7f581c140fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:40570/0 (socket says 10.20.193.58:40570) 2026-02-23T06:39:55.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.992+0000 7f581affd640 1 -- 10.20.193.58:0/897398651 learned_addr learned my addr 10.20.193.58:0/897398651 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:39:55.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.992+0000 7f581b7fe640 1 --2- 10.20.193.58:0/897398651 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f581c05b2d0 0x7f581c0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:55.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.992+0000 7f581bfff640 1 --2- 10.20.193.58:0/897398651 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f581c161d50 0x7f581c204d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:55.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.992+0000 7f5821be5640 1 -- 10.20.193.58:0/897398651 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f581c13bcc0 con 0x7f581c05b2d0 2026-02-23T06:39:55.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.993+0000 7f5821be5640 1 -- 10.20.193.58:0/897398651 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f581c15b400 con 0x7f581c157d80 2026-02-23T06:39:55.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.993+0000 7f5821be5640 1 -- 10.20.193.58:0/897398651 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f581c13bea0 con 0x7f581c161d50 2026-02-23T06:39:55.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.993+0000 7f581affd640 1 -- 10.20.193.58:0/897398651 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f581c157d80 msgr2=0x7f581c140fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-23T06:39:55.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.993+0000 7f581affd640 1 -- 10.20.193.58:0/897398651 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f581c157d80 msgr2=0x7f581c140fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:39:55.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.993+0000 7f581affd640 1 --2- 10.20.193.58:0/897398651 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f581c157d80 0x7f581c140fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:39:55.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.993+0000 7f581affd640 1 --2- 10.20.193.58:0/897398651 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f581c157d80 0x7f581c140fa0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:39:55.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.993+0000 7f581b7fe640 1 -- 10.20.193.58:0/897398651 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f581c161d50 msgr2=0x7f581c204d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:55.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.993+0000 7f581b7fe640 1 --2- 10.20.193.58:0/897398651 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f581c161d50 0x7f581c204d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:55.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.993+0000 7f581b7fe640 1 -- 10.20.193.58:0/897398651 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f581c157d80 msgr2=0x7f581c140fa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:39:55.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.993+0000 7f581b7fe640 1 --2- 10.20.193.58:0/897398651 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f581c157d80 0x7f581c140fa0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:55.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.993+0000 7f581b7fe640 1 -- 10.20.193.58:0/897398651 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5808009570 con 0x7f581c05b2d0 2026-02-23T06:39:55.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.993+0000 7f581b7fe640 1 --2- 10.20.193.58:0/897398651 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f581c05b2d0 0x7f581c0adf10 secure :-1 s=READY pgs=302 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f581c0b1270 tx=0x7f5808002950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:55.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.993+0000 7f5807fff640 1 -- 10.20.193.58:0/897398651 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f58080045a0 con 0x7f581c05b2d0 2026-02-23T06:39:55.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.993+0000 7f5807fff640 1 -- 10.20.193.58:0/897398651 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5808002c30 con 0x7f581c05b2d0 2026-02-23T06:39:55.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.993+0000 7f5807fff640 1 -- 10.20.193.58:0/897398651 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5808038430 con 0x7f581c05b2d0 2026-02-23T06:39:55.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.993+0000 7f5821be5640 1 -- 10.20.193.58:0/897398651 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f581c156900 con 0x7f581c05b2d0 2026-02-23T06:39:55.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.994+0000 7f5821be5640 1 -- 10.20.193.58:0/897398651 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f581c13e1a0 con 0x7f581c05b2d0 2026-02-23T06:39:55.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.996+0000 7f5807fff640 1 -- 10.20.193.58:0/897398651 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f5808038590 con 0x7f581c05b2d0 2026-02-23T06:39:55.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.997+0000 7f5807fff640 1 --2- 10.20.193.58:0/897398651 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f57e807a740 0x7f57e809abf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:55.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.997+0000 7f5807fff640 1 -- 10.20.193.58:0/897398651 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f58080c2fa0 con 0x7f581c05b2d0 2026-02-23T06:39:55.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.997+0000 7f5821be5640 1 -- 10.20.193.58:0/897398651 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57e4005300 con 0x7f581c05b2d0 2026-02-23T06:39:55.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.997+0000 7f581affd640 1 --2- 10.20.193.58:0/897398651 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f57e807a740 0x7f57e809abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:55.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:55.998+0000 7f581affd640 1 --2- 10.20.193.58:0/897398651 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f57e807a740 0x7f57e809abf0 secure :-1 s=READY pgs=412 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f581c05ea50 tx=0x7f580c009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:55.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.000+0000 7f5807fff640 1 -- 10.20.193.58:0/897398651 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f5808089b10 con 0x7f581c05b2d0 2026-02-23T06:39:56.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.165+0000 7f5821be5640 1 -- 10.20.193.58:0/897398651 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f57e4005b30 con 0x7f581c05b2d0 2026-02-23T06:39:56.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.166+0000 7f5807fff640 1 -- 10.20.193.58:0/897398651 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f5808046080 con 0x7f581c05b2d0 2026-02-23T06:39:56.162 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":158,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:39:56.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.170+0000 7f5821be5640 1 -- 10.20.193.58:0/897398651 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f57e807a740 msgr2=0x7f57e809abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:56.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.170+0000 7f5821be5640 1 --2- 10.20.193.58:0/897398651 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f57e807a740 0x7f57e809abf0 secure :-1 s=READY pgs=412 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f581c05ea50 tx=0x7f580c009040 comp rx=0 tx=0).stop 2026-02-23T06:39:56.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.170+0000 7f5821be5640 1 -- 10.20.193.58:0/897398651 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f581c05b2d0 msgr2=0x7f581c0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:56.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.170+0000 7f5821be5640 1 --2- 10.20.193.58:0/897398651 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f581c05b2d0 0x7f581c0adf10 secure :-1 s=READY pgs=302 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f581c0b1270 tx=0x7f5808002950 comp rx=0 tx=0).stop 2026-02-23T06:39:56.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.171+0000 7f5821be5640 1 -- 10.20.193.58:0/897398651 shutdown_connections 2026-02-23T06:39:56.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.171+0000 7f5821be5640 1 --2- 10.20.193.58:0/897398651 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f57e807a740 0x7f57e809abf0 unknown :-1 s=CLOSED pgs=412 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:56.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.171+0000 7f5821be5640 1 --2- 10.20.193.58:0/897398651 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f581c161d50 0x7f581c204d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:56.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.171+0000 7f5821be5640 1 --2- 10.20.193.58:0/897398651 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f581c157d80 0x7f581c140fa0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:56.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.171+0000 7f5821be5640 1 --2- 10.20.193.58:0/897398651 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f581c05b2d0 0x7f581c0adf10 unknown :-1 s=CLOSED pgs=302 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:56.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.171+0000 7f5821be5640 1 -- 10.20.193.58:0/897398651 >> 10.20.193.58:0/897398651 conn(0x7f581c058e50 msgr2=0x7f581c151280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:56.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.171+0000 7f5821be5640 1 -- 10.20.193.58:0/897398651 shutdown_connections 2026-02-23T06:39:56.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.171+0000 7f5821be5640 1 -- 10.20.193.58:0/897398651 wait complete. 2026-02-23T06:39:56.183 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:39:56.183 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:39:56.184 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:39:56.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.368+0000 7f95ae9b5640 1 -- 10.20.193.58:0/2729749607 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f95a815d870 msgr2=0x7f95a80587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:56.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.368+0000 7f95ae9b5640 1 --2- 10.20.193.58:0/2729749607 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f95a815d870 0x7f95a80587b0 secure :-1 s=READY pgs=59 gs=3 cs=0 l=1 c_cookie=3873455030612635576 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f959c004740 tx=0x7f959c02f1d0 comp rx=0 tx=0).stop 2026-02-23T06:39:56.365 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.368+0000 7f95ae9b5640 1 -- 10.20.193.58:0/2729749607 shutdown_connections 2026-02-23T06:39:56.365 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.368+0000 7f95ae9b5640 1 --2- 10.20.193.58:0/2729749607 >> v2:10.20.193.93:3300/0 conn(0x7f95a80b6690 0x7f95a8058cf0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:56.365 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.368+0000 7f95ae9b5640 1 --2- 10.20.193.58:0/2729749607 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f95a815d870 0x7f95a80587b0 unknown :-1 s=CLOSED pgs=59 gs=3 cs=0 l=1 c_cookie=3873455030612635576 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:56.365 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.368+0000 7f95ae9b5640 1 -- 10.20.193.58:0/2729749607 >> 10.20.193.58:0/2729749607 conn(0x7f95a80b3c20 msgr2=0x7f95a80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:56.365 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.368+0000 7f95ae9b5640 1 -- 10.20.193.58:0/2729749607 shutdown_connections 2026-02-23T06:39:56.365 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.368+0000 7f95ae9b5640 1 -- 10.20.193.58:0/2729749607 wait complete. 2026-02-23T06:39:56.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.370+0000 7f95ae9b5640 1 Processor -- start 2026-02-23T06:39:56.368 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.370+0000 7f95ae9b5640 1 -- start start 2026-02-23T06:39:56.368 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.370+0000 7f95ae9b5640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f95a80b6690 0x7f95a813b530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:56.368 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.370+0000 7f95ae9b5640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f95a815d4a0 0x7f95a81ff060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:56.368 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.370+0000 7f95ae9b5640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f95a815d870 0x7f95a81ff5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:56.368 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.370+0000 7f95ae9b5640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f95a80b0550 con 0x7f95a815d4a0 2026-02-23T06:39:56.368 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.370+0000 7f95ae9b5640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f95a813d1f0 con 0x7f95a80b6690 2026-02-23T06:39:56.368 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.370+0000 7f95ae9b5640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f95a815aae0 con 0x7f95a815d870 2026-02-23T06:39:56.368 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.371+0000 7f95ad1b2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f95a815d4a0 0x7f95a81ff060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:56.368 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.371+0000 7f95ad1b2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f95a815d4a0 0x7f95a81ff060 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:59012/0 (socket says 10.20.193.58:59012) 2026-02-23T06:39:56.368 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.371+0000 7f95ad1b2640 1 -- 10.20.193.58:0/3860723957 learned_addr learned my addr 10.20.193.58:0/3860723957 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:39:56.368 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.371+0000 7f95ad9b3640 1 --2- 10.20.193.58:0/3860723957 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f95a80b6690 0x7f95a813b530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:56.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.371+0000 7f95ad1b2640 1 -- 10.20.193.58:0/3860723957 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f95a815d870 msgr2=0x7f95a81ff5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:56.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.371+0000 7f95ad1b2640 1 --2- 10.20.193.58:0/3860723957 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f95a815d870 0x7f95a81ff5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:56.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.371+0000 7f95ad1b2640 1 -- 10.20.193.58:0/3860723957 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f95a80b6690 msgr2=0x7f95a813b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:56.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.371+0000 7f95ad1b2640 1 --2- 10.20.193.58:0/3860723957 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f95a80b6690 0x7f95a813b530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:56.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.371+0000 7f95ad1b2640 1 -- 10.20.193.58:0/3860723957 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959c0094b0 con 0x7f95a815d4a0 2026-02-23T06:39:56.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.371+0000 7f95ad1b2640 1 --2- 10.20.193.58:0/3860723957 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f95a815d4a0 0x7f95a81ff060 secure :-1 s=READY pgs=304 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f959c009960 tx=0x7f959c002a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:56.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.372+0000 7f95967fc640 1 -- 10.20.193.58:0/3860723957 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f959c02fea0 con 0x7f95a815d4a0 2026-02-23T06:39:56.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.372+0000 7f95967fc640 1 -- 10.20.193.58:0/3860723957 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f959c038780 con 0x7f95a815d4a0 2026-02-23T06:39:56.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.372+0000 7f95967fc640 1 -- 10.20.193.58:0/3860723957 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f959c038b50 con 0x7f95a815d4a0 2026-02-23T06:39:56.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.372+0000 7f95ae9b5640 1 -- 10.20.193.58:0/3860723957 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a80b0270 con 0x7f95a815d4a0 2026-02-23T06:39:56.371 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.374+0000 7f95ae9b5640 1 -- 10.20.193.58:0/3860723957 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a813d440 con 0x7f95a815d4a0 2026-02-23T06:39:56.371 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.374+0000 7f95967fc640 1 -- 10.20.193.58:0/3860723957 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f959c038cb0 con 0x7f95a815d4a0 2026-02-23T06:39:56.371 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.375+0000 7f956ffff640 1 --2- 10.20.193.58:0/3860723957 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f95a8162670 0x7f95a813d600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:56.371 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.375+0000 7f956ffff640 1 -- 10.20.193.58:0/3860723957 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f95a80609c0 con 0x7f95a8162670 2026-02-23T06:39:56.371 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.375+0000 7f95ad9b3640 1 --2- 10.20.193.58:0/3860723957 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f95a8162670 0x7f95a813d600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:56.371 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.375+0000 7f95967fc640 1 --2- 10.20.193.58:0/3860723957 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f957807a790 0x7f957809ac40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:56.371 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.375+0000 7f95967fc640 1 -- 10.20.193.58:0/3860723957 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f959c0c2420 con 0x7f95a815d4a0 2026-02-23T06:39:56.371 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.375+0000 7f95ae1b4640 1 --2- 10.20.193.58:0/3860723957 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f957807a790 0x7f957809ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:56.372 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.375+0000 7f95ad9b3640 1 -- 10.20.193.58:0/3860723957 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f95a80b6330 con 0x7f95a8162670 2026-02-23T06:39:56.372 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.376+0000 7f95ad9b3640 1 --2- 10.20.193.58:0/3860723957 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f95a8162670 0x7f95a813d600 secure :-1 s=READY pgs=305 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f959800e4d0 tx=0x7f959800e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:56.372 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.376+0000 7f95967fc640 1 -- 10.20.193.58:0/3860723957 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9598006cc0 con 0x7f95a8162670 2026-02-23T06:39:56.372 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.376+0000 7f95ae1b4640 1 --2- 10.20.193.58:0/3860723957 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f957807a790 0x7f957809ac40 secure :-1 s=READY pgs=413 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95a4005820 tx=0x7f95a4006bb0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:56.372 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.376+0000 7f95967fc640 1 -- 10.20.193.58:0/3860723957 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f9598006e20 con 0x7f95a8162670 2026-02-23T06:39:56.372 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.376+0000 7f95967fc640 1 -- 10.20.193.58:0/3860723957 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f95a8162670 msgr2=0x7f95a813d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:56.372 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.376+0000 7f95967fc640 1 --2- 10.20.193.58:0/3860723957 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f95a8162670 0x7f95a813d600 secure :-1 s=READY pgs=305 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f959800e4d0 tx=0x7f959800e9a0 comp rx=0 tx=0).stop 2026-02-23T06:39:56.372 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.376+0000 7f95967fc640 1 -- 10.20.193.58:0/3860723957 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f95a8162670 msgr2=0x7f95a813d600 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:39:56.372 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.376+0000 7f95967fc640 1 --2- 10.20.193.58:0/3860723957 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f95a8162670 0x7f95a813d600 secure :-1 s=CLOSED pgs=305 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f959800e4d0 tx=0x7f959800e9a0 comp rx=0 tx=0).stop 2026-02-23T06:39:56.379 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.385+0000 7f956ffff640 1 --2- 10.20.193.58:0/3860723957 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f95a815be40 0x7f95a8201f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:56.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.385+0000 7f956ffff640 1 -- 10.20.193.58:0/3860723957 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f95a80b5e10 con 0x7f95a815be40 2026-02-23T06:39:56.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.385+0000 7f95ad9b3640 1 --2- 10.20.193.58:0/3860723957 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f95a815be40 0x7f95a8201f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:56.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.385+0000 7f95ad9b3640 1 -- 10.20.193.58:0/3860723957 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f95a8164250 con 0x7f95a815be40 2026-02-23T06:39:56.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.386+0000 7f95ad9b3640 1 --2- 10.20.193.58:0/3860723957 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f95a815be40 0x7f95a8201f40 secure :-1 s=READY pgs=306 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9598015000 tx=0x7f9598003810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:56.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.386+0000 7f95967fc640 1 -- 10.20.193.58:0/3860723957 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9598013420 con 0x7f95a815be40 2026-02-23T06:39:56.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.386+0000 7f95967fc640 1 -- 10.20.193.58:0/3860723957 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5558 (secure 0 0 0) 0x7f9598013580 con 0x7f95a815be40 2026-02-23T06:39:56.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.386+0000 7f95967fc640 1 -- 10.20.193.58:0/3860723957 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f95a815be40 msgr2=0x7f95a8201f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:56.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.386+0000 7f95967fc640 1 --2- 10.20.193.58:0/3860723957 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f95a815be40 0x7f95a8201f40 secure :-1 s=READY pgs=306 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9598015000 tx=0x7f9598003810 comp rx=0 tx=0).stop 2026-02-23T06:39:56.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.386+0000 7f95967fc640 1 -- 10.20.193.58:0/3860723957 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f95a815be40 msgr2=0x7f95a8201f40 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:39:56.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.386+0000 7f95967fc640 1 --2- 10.20.193.58:0/3860723957 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f95a815be40 0x7f95a8201f40 secure :-1 s=CLOSED pgs=306 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9598015000 tx=0x7f9598003810 comp rx=0 tx=0).stop 2026-02-23T06:39:56.381 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:39:56.381 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:39:56.381 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:39:56.382 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:39:56.382 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 158, 2026-02-23T06:39:56.382 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 403897, 2026-02-23T06:39:56.382 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:39:56.382 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:39:56.382 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:39:56.382 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:39:56.382 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:56.382 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:39:56.382 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:39:56.382 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:39:56.382 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:39:56.382 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:39:56.382 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:39:56.382 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:39:56.382 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:39:56.382 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:39:56.382 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:39:56.383 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:39:56.383 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:39:56.383 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:39:56.383 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:39:56.383 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:39:56.383 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:39:56.383 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:39:56.383 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:56.383 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:39:56.383 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:39:56.383 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:39:56.383 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:39:56.383 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:39:56.383 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:39:56.383 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:39:56.383 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:39:56.383 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:39:56.383 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:39:56.383 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:39:56.383 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:39:56.384 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:39:56.384 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:39:56.384 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:39:56.384 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:56.384 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:56.384 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:39:56.384 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:39:56.384 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:39:56.384 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:39:56.384 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:39:56.384 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:39:56.384 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:39:56.384 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:39:56.384 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:39:56.384 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:39:56.384 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:39:56.384 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:39:56.384 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:39:56.384 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:39:56.385 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:39:56.385 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:39:56.385 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:39:56.385 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:39:56.385 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:39:56.385 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:39:56.385 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:39:56.385 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:39:56.385 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:39:56.385 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:39:56.385 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:39:56.385 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:39:56.385 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:39:56.385 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:39:56.385 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:39:56.385 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:39:56.385 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:56.385 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:39:56.385 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:56.385 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:39:56.385 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:56.386 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:39:56.386 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:39:56.386 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:39:56.386 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:39:56.386 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:56.386 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:39:56.386 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:39:56.386 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:56.386 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:56.386 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:56.386 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:39:56.386 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:39:56.386 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:56.386 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:56.386 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:56.386 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:56.386 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:39:56.386 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:39:56.386 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:39:56.386 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:39:56.387 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:39:56.387 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:39:56.387 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:56.387 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:56.387 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:39:56.387 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:39:56.387 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:39:56.387 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:39:56.387 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:56.387 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:39:56.387 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:39:56.387 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:56.387 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:56.387 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:56.387 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:39:56.387 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:39:56.387 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:56.387 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:56.387 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:56.387 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:56.388 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:39:56.388 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:39:56.388 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:39:56.388 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:39:56.388 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:39:56.388 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:39:56.388 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:56.388 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:56.388 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:39:56.388 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:39:56.388 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:39:56.388 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:39:56.388 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:56.388 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:39:56.388 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:39:56.388 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:56.388 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:56.388 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:56.388 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:39:56.388 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:39:56.389 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:39:56.389 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:56.389 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:56.389 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:56.389 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:39:56.389 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:39:56.389 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:39:56.389 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:39:56.389 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:39:56.389 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:39:56.389 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:56.389 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:56.389 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:56.389 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:39:56.389 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:39:56.389 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:56.389 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:56.389 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:56.389 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:39:56.389 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:56.390 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:56.390 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:39:56.390 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:56.390 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:56.390 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:56.390 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:39:56.390 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:56.390 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:56.390 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:39:56.390 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:56.390 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:56.390 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:56.390 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:39:56.390 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:56.390 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:56.390 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:39:56.390 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:56.390 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:39:56.390 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:39:56.390 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:39:56.391 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:56.391 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:56.391 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:56.391 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:56.391 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:39:56.391 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:56.391 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:39:56.391 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:39:56.391 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:39:56.391 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:39:56.391 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:39:56.391 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:39:56.391 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:39:56.391 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:39:56.391 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:39:56.391 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:39:56.391 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:39:56.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.387+0000 7f956ffff640 1 -- 10.20.193.58:0/3860723957 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f957807a790 msgr2=0x7f957809ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:56.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.387+0000 7f956ffff640 1 --2- 10.20.193.58:0/3860723957 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f957807a790 0x7f957809ac40 secure :-1 s=READY pgs=413 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95a4005820 tx=0x7f95a4006bb0 comp rx=0 tx=0).stop 2026-02-23T06:39:56.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.387+0000 7f956ffff640 1 -- 10.20.193.58:0/3860723957 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f95a815d4a0 msgr2=0x7f95a81ff060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:56.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.387+0000 7f956ffff640 1 --2- 10.20.193.58:0/3860723957 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f95a815d4a0 0x7f95a81ff060 secure :-1 s=READY pgs=304 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f959c009960 tx=0x7f959c002a10 comp rx=0 tx=0).stop 2026-02-23T06:39:56.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.387+0000 7f95ae1b4640 1 -- 10.20.193.58:0/3860723957 reap_dead start 2026-02-23T06:39:56.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.387+0000 7f95ae1b4640 1 -- 10.20.193.58:0/3860723957 reap_dead start 2026-02-23T06:39:56.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.387+0000 7f956ffff640 1 -- 10.20.193.58:0/3860723957 shutdown_connections 2026-02-23T06:39:56.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.387+0000 7f956ffff640 1 -- 10.20.193.58:0/3860723957 >> 10.20.193.58:0/3860723957 conn(0x7f95a80b3c20 msgr2=0x7f95a815ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:56.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.387+0000 7f956ffff640 1 -- 10.20.193.58:0/3860723957 shutdown_connections 2026-02-23T06:39:56.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.388+0000 7f956ffff640 1 -- 10.20.193.58:0/3860723957 wait complete. 2026-02-23T06:39:56.394 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:39:56.394 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:39:56.395 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:39:56.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.522+0000 7f3f57577640 1 -- 10.20.193.58:0/4164836543 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3f44003a30 msgr2=0x7f3f44003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:56.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.522+0000 7f3f57577640 1 --2- 10.20.193.58:0/4164836543 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3f44003a30 0x7f3f44003e20 secure :-1 s=READY pgs=308 gs=3 cs=0 l=1 c_cookie=15998362984311222870 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f4c00c260 tx=0x7f3f4c02f940 comp rx=0 tx=0).stop 2026-02-23T06:39:56.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.523+0000 7f3f56d76640 1 -- 10.20.193.58:0/4164836543 reap_dead start 2026-02-23T06:39:56.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.524+0000 7f3f57577640 1 -- 10.20.193.58:0/4164836543 shutdown_connections 2026-02-23T06:39:56.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.524+0000 7f3f57577640 1 -- 10.20.193.58:0/4164836543 >> 10.20.193.58:0/4164836543 conn(0x7f3f580b3c20 msgr2=0x7f3f580b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:39:56.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.524+0000 7f3f57577640 1 -- 10.20.193.58:0/4164836543 shutdown_connections 2026-02-23T06:39:56.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.524+0000 7f3f57577640 1 -- 10.20.193.58:0/4164836543 wait complete. 2026-02-23T06:39:56.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.525+0000 7f3f57577640 1 Processor -- start 2026-02-23T06:39:56.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.526+0000 7f3f57577640 1 -- start start 2026-02-23T06:39:56.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.526+0000 7f3f57577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3f581292b0 0x7f3f5813bed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:56.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.526+0000 7f3f57577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3f58129680 0x7f3f58155250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:56.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.526+0000 7f3f57577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f5813a8b0 0x7f3f58155790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:56.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.526+0000 7f3f57577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f3f580568e0 con 0x7f3f581292b0 2026-02-23T06:39:56.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.526+0000 7f3f57577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f3f58057c00 con 0x7f3f5813a8b0 2026-02-23T06:39:56.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.526+0000 7f3f57577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f3f5813c690 con 0x7f3f58129680 2026-02-23T06:39:56.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.526+0000 7f3f55d74640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3f58129680 0x7f3f58155250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:56.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.526+0000 7f3f55d74640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3f58129680 0x7f3f58155250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:44396/0 (socket says 10.20.193.58:44396) 2026-02-23T06:39:56.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.526+0000 7f3f55d74640 1 -- 10.20.193.58:0/2782817897 learned_addr learned my addr 10.20.193.58:0/2782817897 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:39:56.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.526+0000 7f3f56575640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3f581292b0 0x7f3f5813bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:56.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.527+0000 7f3f55d74640 1 -- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f5813a8b0 msgr2=0x7f3f58155790 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-23T06:39:56.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.527+0000 7f3f55d74640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f5813a8b0 0x7f3f58155790 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:56.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.527+0000 7f3f55d74640 1 -- 10.20.193.58:0/2782817897 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3f581292b0 msgr2=0x7f3f5813bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:39:56.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.527+0000 7f3f55d74640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3f581292b0 0x7f3f5813bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:39:56.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.527+0000 7f3f55d74640 1 -- 10.20.193.58:0/2782817897 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f5813c950 con 0x7f3f58129680 2026-02-23T06:39:56.523 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.527+0000 7f3f56575640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3f581292b0 0x7f3f5813bed0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:39:56.523 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.527+0000 7f3f55d74640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3f58129680 0x7f3f58155250 secure :-1 s=READY pgs=60 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f4000b550 tx=0x7f3f4000ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:56.523 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.528+0000 7f3f3effd640 1 -- 10.20.193.58:0/2782817897 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f400044a0 con 0x7f3f58129680 2026-02-23T06:39:56.523 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.528+0000 7f3f3effd640 1 -- 10.20.193.58:0/2782817897 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f40002760 con 0x7f3f58129680 2026-02-23T06:39:56.523 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.528+0000 7f3f3effd640 1 -- 10.20.193.58:0/2782817897 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f40002b90 con 0x7f3f58129680 2026-02-23T06:39:56.523 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.528+0000 7f3f57577640 1 -- 10.20.193.58:0/2782817897 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f5813cc30 con 0x7f3f58129680 2026-02-23T06:39:56.523 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.528+0000 7f3f57577640 1 -- 10.20.193.58:0/2782817897 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f58056570 con 0x7f3f58129680 2026-02-23T06:39:56.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.529+0000 7f3f57577640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 0x7f3f5813ad80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:56.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.529+0000 7f3f57577640 1 -- 10.20.193.58:0/2782817897 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f3f580582d0 con 0x7f3f58057f00 2026-02-23T06:39:56.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.530+0000 7f3f56575640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 0x7f3f5813ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:56.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.530+0000 7f3f56575640 1 -- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 msgr2=0x7f3f5813ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-23T06:39:56.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.530+0000 7f3f56575640 1 -- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 msgr2=0x7f3f5813ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:39:56.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.530+0000 7f3f56575640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 0x7f3f5813ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:39:56.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.530+0000 7f3f56575640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 0x7f3f5813ad80 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:39:56.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.531+0000 7f3f3effd640 1 -- 10.20.193.58:0/2782817897 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f3f4000d040 con 0x7f3f58129680 2026-02-23T06:39:56.526 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.532+0000 7f3f3effd640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3f2407a6d0 0x7f3f2409ab80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:39:56.527 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.532+0000 7f3f3effd640 1 -- 10.20.193.58:0/2782817897 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f3f4009d340 con 0x7f3f58129680 2026-02-23T06:39:56.527 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.532+0000 7f3f56d76640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3f2407a6d0 0x7f3f2409ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:56.527 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.533+0000 7f3f56d76640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3f2407a6d0 0x7f3f2409ab80 secure :-1 s=READY pgs=414 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f580b5230 tx=0x7f3f48008ae0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:39:56.727 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.731+0000 7f3f56575640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 0x7f3f5813ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:56.727 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.731+0000 7f3f56575640 1 -- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 msgr2=0x7f3f5813ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:39:56.727 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.731+0000 7f3f56575640 1 -- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 msgr2=0x7f3f5813ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:39:56.727 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.731+0000 7f3f56575640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 0x7f3f5813ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:39:56.728 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:56.731+0000 7f3f56575640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 0x7f3f5813ad80 unknown :-1 s=START_CONNECT pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-23T06:39:57.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:57.132+0000 7f3f56575640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 0x7f3f5813ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:57.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:57.132+0000 7f3f56575640 1 -- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 msgr2=0x7f3f5813ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:39:57.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:57.132+0000 7f3f56575640 1 -- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 msgr2=0x7f3f5813ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:39:57.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:57.132+0000 7f3f56575640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 0x7f3f5813ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:39:57.128 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:57.132+0000 7f3f56575640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 0x7f3f5813ad80 unknown :-1 s=START_CONNECT pgs=0 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-23T06:39:57.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:57.933+0000 7f3f56575640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 0x7f3f5813ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=10 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:57.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:57.933+0000 7f3f56575640 1 -- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 msgr2=0x7f3f5813ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:39:57.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:57.933+0000 7f3f56575640 1 -- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 msgr2=0x7f3f5813ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:39:57.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:57.933+0000 7f3f56575640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 0x7f3f5813ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=10 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:39:57.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:57.933+0000 7f3f56575640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 0x7f3f5813ad80 unknown :-1 s=START_CONNECT pgs=0 gs=11 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-23T06:39:59.531 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:59.535+0000 7f3f56575640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 0x7f3f5813ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=12 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:39:59.531 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:59.535+0000 7f3f56575640 1 -- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 msgr2=0x7f3f5813ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:39:59.531 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:59.535+0000 7f3f56575640 1 -- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 msgr2=0x7f3f5813ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:39:59.531 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:59.535+0000 7f3f56575640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 0x7f3f5813ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=12 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:39:59.531 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:39:59.535+0000 7f3f56575640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 0x7f3f5813ad80 unknown :-1 s=START_CONNECT pgs=0 gs=13 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2026-02-23T06:40:00.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:00.526+0000 7f3f3dffb640 1 -- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 msgr2=0x7f3f5813ad80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:40:00.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:00.526+0000 7f3f3dffb640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 0x7f3f5813ad80 unknown :-1 s=START_CONNECT pgs=0 gs=13 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:00.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:00.526+0000 7f3f3dffb640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f1c003600 0x7f3f1c023a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:00.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:00.526+0000 7f3f3dffb640 1 -- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 msgr2=0x7f3f5813ad80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:40:00.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:00.526+0000 7f3f3dffb640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f58057f00 0x7f3f5813ad80 unknown :-1 s=CLOSED pgs=0 gs=13 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:00.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:00.526+0000 7f3f3dffb640 1 -- 10.20.193.58:0/2782817897 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f3f580582d0 con 0x7f3f1c003600 2026-02-23T06:40:00.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:00.527+0000 7f3f56575640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f1c003600 0x7f3f1c023a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=14 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:00.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:00.527+0000 7f3f56575640 1 -- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f1c003600 msgr2=0x7f3f1c023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:40:00.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:00.527+0000 7f3f56575640 1 -- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f1c003600 msgr2=0x7f3f1c023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:40:00.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:00.527+0000 7f3f56575640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f1c003600 0x7f3f1c023a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=14 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:40:00.522 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:00.527+0000 7f3f56575640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f1c003600 0x7f3f1c023a80 unknown :-1 s=START_CONNECT pgs=0 gs=15 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:40:00.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:00.727+0000 7f3f56575640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f1c003600 0x7f3f1c023a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=16 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:00.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:00.728+0000 7f3f56575640 1 -- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f1c003600 msgr2=0x7f3f1c023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:40:00.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:00.728+0000 7f3f56575640 1 -- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f1c003600 msgr2=0x7f3f1c023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:40:00.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:00.728+0000 7f3f56575640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f1c003600 0x7f3f1c023a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=16 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:40:00.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:00.728+0000 7f3f56575640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f1c003600 0x7f3f1c023a80 unknown :-1 s=START_CONNECT pgs=0 gs=17 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-23T06:40:01.123 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.128+0000 7f3f56575640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f1c003600 0x7f3f1c023a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=18 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:01.124 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.129+0000 7f3f56575640 1 -- 10.20.193.58:0/2782817897 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3f1c024160 con 0x7f3f1c003600 2026-02-23T06:40:01.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.130+0000 7f3f56575640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f1c003600 0x7f3f1c023a80 secure :-1 s=READY pgs=4 gs=18 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f4c00c260 tx=0x7f3f4c0036c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:01.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.130+0000 7f3f3effd640 1 -- 10.20.193.58:0/2782817897 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f4c003790 con 0x7f3f1c003600 2026-02-23T06:40:01.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.130+0000 7f3f3effd640 1 -- 10.20.193.58:0/2782817897 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f3f4c05d070 con 0x7f3f1c003600 2026-02-23T06:40:01.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.130+0000 7f3f3effd640 1 -- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f1c003600 msgr2=0x7f3f1c023a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:01.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.130+0000 7f3f3effd640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f1c003600 0x7f3f1c023a80 secure :-1 s=READY pgs=4 gs=18 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f4c00c260 tx=0x7f3f4c0036c0 comp rx=0 tx=0).stop 2026-02-23T06:40:01.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.130+0000 7f3f3effd640 1 -- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f1c003600 msgr2=0x7f3f1c023a80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:40:01.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.130+0000 7f3f3effd640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f1c003600 0x7f3f1c023a80 secure :-1 s=CLOSED pgs=4 gs=18 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f4c00c260 tx=0x7f3f4c0036c0 comp rx=0 tx=0).stop 2026-02-23T06:40:01.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.134+0000 7f3f57577640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f5813b2c0 0x7f3f5813b690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:01.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.134+0000 7f3f57577640 1 -- 10.20.193.58:0/2782817897 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f3f580b5b30 con 0x7f3f5813b2c0 2026-02-23T06:40:01.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.135+0000 7f3f56575640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f5813b2c0 0x7f3f5813b690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=19 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:01.130 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.135+0000 7f3f56575640 1 -- 10.20.193.58:0/2782817897 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3f580b6330 con 0x7f3f5813b2c0 2026-02-23T06:40:01.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.136+0000 7f3f56575640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f5813b2c0 0x7f3f5813b690 secure :-1 s=READY pgs=5 gs=19 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f4c002b30 tx=0x7f3f4c02f940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:01.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.136+0000 7f3f3effd640 1 -- 10.20.193.58:0/2782817897 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f4c06f070 con 0x7f3f5813b2c0 2026-02-23T06:40:01.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.136+0000 7f3f3effd640 1 -- 10.20.193.58:0/2782817897 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4910 (secure 0 0 0) 0x7f3f4c067040 con 0x7f3f5813b2c0 2026-02-23T06:40:01.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.136+0000 7f3f3effd640 1 -- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f5813b2c0 msgr2=0x7f3f5813b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:01.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.136+0000 7f3f3effd640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f5813b2c0 0x7f3f5813b690 secure :-1 s=READY pgs=5 gs=19 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f4c002b30 tx=0x7f3f4c02f940 comp rx=0 tx=0).stop 2026-02-23T06:40:01.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.136+0000 7f3f3effd640 1 -- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f5813b2c0 msgr2=0x7f3f5813b690 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:40:01.132 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.136+0000 7f3f3effd640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3f5813b2c0 0x7f3f5813b690 secure :-1 s=CLOSED pgs=5 gs=19 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f4c002b30 tx=0x7f3f4c02f940 comp rx=0 tx=0).stop 2026-02-23T06:40:01.132 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:40:01.132 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:40:01.132 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:40:01.132 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:40:01.132 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 158, 2026-02-23T06:40:01.132 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 5226, 2026-02-23T06:40:01.132 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:40:01.132 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:40:01.132 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:40:01.132 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:40:01.132 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:01.132 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 5, 2026-02-23T06:40:01.133 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:40:01.133 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:40:01.133 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:40:01.133 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:01.133 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:01.133 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:01.133 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:01.133 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:01.133 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:01.133 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:01.133 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:01.133 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:01.134 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:01.134 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:01.134 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:01.134 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:01.134 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:01.134 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:40:01.134 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:40:01.134 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:01.134 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:01.134 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:01.134 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:01.134 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:01.135 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:01.135 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:01.135 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:01.135 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:01.135 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:01.135 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:01.135 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:01.135 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:01.135 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:01.135 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:01.135 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:40:01.135 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:40:01.136 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:40:01.136 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:40:01.136 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:40:01.136 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:40:01.136 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:40:01.136 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:40:01.136 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:40:01.136 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:40:01.136 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:40:01.136 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:40:01.136 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:40:01.136 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:40:01.137 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:40:01.137 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:40:01.137 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:40:01.137 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:01.137 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:01.137 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:01.137 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:01.137 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:01.137 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:01.137 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:01.137 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:01.137 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:01.137 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:01.138 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:01.138 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:01.138 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:01.138 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:01.138 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:40:01.138 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:01.138 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:40:01.138 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:01.138 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:40:01.138 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:40:01.138 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:01.138 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:01.139 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:01.139 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:01.139 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:40:01.139 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:01.139 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:01.139 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:01.139 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:01.139 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:40:01.139 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:01.139 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:01.139 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:01.139 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:01.140 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:40:01.140 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:40:01.140 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:01.140 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:01.140 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:40:01.140 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:01.140 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:01.140 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:01.140 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:40:01.140 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:40:01.140 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:01.140 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:01.141 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:01.141 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:01.141 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:40:01.141 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:01.141 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:01.141 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:01.141 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:01.141 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:40:01.141 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:01.141 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:01.141 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:01.141 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:01.141 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:40:01.141 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:40:01.142 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:01.142 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:01.142 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:40:01.142 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:01.142 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:01.142 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:01.142 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:40:01.142 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:40:01.142 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:01.142 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:01.142 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:01.142 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:01.143 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:40:01.143 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:01.143 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:01.143 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:01.143 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:01.143 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:40:01.143 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:01.143 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:01.143 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:01.143 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:01.143 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:40:01.143 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:40:01.143 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:01.144 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:01.144 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:40:01.144 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:01.144 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:01.144 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:01.144 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:01.144 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:40:01.144 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:40:01.144 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:01.144 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:01.144 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:01.144 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:40:01.145 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:01.145 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:01.145 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:40:01.145 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:01.145 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:01.145 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:01.145 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:40:01.145 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:01.145 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:01.145 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:01.145 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:40:01.145 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:40:01.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.137+0000 7f3f56d76640 1 -- 10.20.193.58:0/2782817897 reap_dead start 2026-02-23T06:40:01.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.137+0000 7f3f57577640 1 -- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3f2407a6d0 msgr2=0x7f3f2409ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:01.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.137+0000 7f3f57577640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3f2407a6d0 0x7f3f2409ab80 secure :-1 s=READY pgs=414 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f580b5230 tx=0x7f3f48008ae0 comp rx=0 tx=0).stop 2026-02-23T06:40:01.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.137+0000 7f3f57577640 1 -- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3f58129680 msgr2=0x7f3f58155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:01.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.137+0000 7f3f57577640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3f58129680 0x7f3f58155250 secure :-1 s=READY pgs=60 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f4000b550 tx=0x7f3f4000ba20 comp rx=0 tx=0).stop 2026-02-23T06:40:01.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.137+0000 7f3f57577640 1 -- 10.20.193.58:0/2782817897 shutdown_connections 2026-02-23T06:40:01.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.137+0000 7f3f57577640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3f2407a6d0 0x7f3f2409ab80 unknown :-1 s=CLOSED pgs=414 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:01.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.137+0000 7f3f57577640 1 --2- 10.20.193.58:0/2782817897 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3f58129680 0x7f3f58155250 unknown :-1 s=CLOSED pgs=60 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:01.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.137+0000 7f3f57577640 1 -- 10.20.193.58:0/2782817897 >> 10.20.193.58:0/2782817897 conn(0x7f3f580b3c20 msgr2=0x7f3f580b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:01.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.137+0000 7f3f57577640 1 -- 10.20.193.58:0/2782817897 shutdown_connections 2026-02-23T06:40:01.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.137+0000 7f3f57577640 1 -- 10.20.193.58:0/2782817897 wait complete. 2026-02-23T06:40:01.148 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:40:01.149 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:40:01.149 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:40:01.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.304+0000 7f0459175640 1 -- 10.20.193.58:0/2401549041 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f04541638d0 msgr2=0x7f045416a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:01.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.304+0000 7f0459175640 1 --2- 10.20.193.58:0/2401549041 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f04541638d0 0x7f045416a150 secure :-1 s=READY pgs=61 gs=3 cs=0 l=1 c_cookie=16524516205509232829 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0444009890 tx=0x7f044402f1f0 comp rx=0 tx=0).stop 2026-02-23T06:40:01.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.304+0000 7f0459175640 1 -- 10.20.193.58:0/2401549041 shutdown_connections 2026-02-23T06:40:01.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.304+0000 7f0459175640 1 --2- 10.20.193.58:0/2401549041 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f04541638d0 0x7f045416a150 unknown :-1 s=CLOSED pgs=61 gs=3 cs=0 l=1 c_cookie=16524516205509232829 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:01.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.304+0000 7f0459175640 1 -- 10.20.193.58:0/2401549041 >> 10.20.193.58:0/2401549041 conn(0x7f04540583c0 msgr2=0x7f0454054390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:01.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.305+0000 7f0459175640 1 -- 10.20.193.58:0/2401549041 shutdown_connections 2026-02-23T06:40:01.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.305+0000 7f0459175640 1 -- 10.20.193.58:0/2401549041 wait complete. 2026-02-23T06:40:01.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.310+0000 7f0459175640 1 Processor -- start 2026-02-23T06:40:01.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.310+0000 7f0459175640 1 -- start start 2026-02-23T06:40:01.306 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.311+0000 7f0459175640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0454059350 0x7f0454140ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:01.306 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.311+0000 7f0459175640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f04540b6f80 0x7f0454144330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:01.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.311+0000 7f0453fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0454059350 0x7f0454140ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:01.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.311+0000 7f0453fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0454059350 0x7f0454140ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:52198/0 (socket says 10.20.193.58:52198) 2026-02-23T06:40:01.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.312+0000 7f04537fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f04540b6f80 0x7f0454144330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:01.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.312+0000 7f0453fff640 1 -- 10.20.193.58:0/3490009034 learned_addr learned my addr 10.20.193.58:0/3490009034 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:40:01.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.312+0000 7f0459175640 1 --2- 10.20.193.58:0/3490009034 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f04541638d0 0x7f0454144870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:01.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.312+0000 7f0459175640 1 -- 10.20.193.58:0/3490009034 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f04541613c0 con 0x7f04540b6f80 2026-02-23T06:40:01.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.312+0000 7f0459175640 1 -- 10.20.193.58:0/3490009034 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f0454161eb0 con 0x7f04541638d0 2026-02-23T06:40:01.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.312+0000 7f0459175640 1 -- 10.20.193.58:0/3490009034 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f0454164160 con 0x7f0454059350 2026-02-23T06:40:01.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.312+0000 7f0458974640 1 --2- 10.20.193.58:0/3490009034 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f04541638d0 0x7f0454144870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:01.309 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.313+0000 7f0453fff640 1 -- 10.20.193.58:0/3490009034 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f04541638d0 msgr2=0x7f0454144870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:01.309 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.313+0000 7f0453fff640 1 --2- 10.20.193.58:0/3490009034 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f04541638d0 0x7f0454144870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:01.309 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.313+0000 7f0453fff640 1 -- 10.20.193.58:0/3490009034 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f04540b6f80 msgr2=0x7f0454144330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:01.309 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.313+0000 7f0453fff640 1 --2- 10.20.193.58:0/3490009034 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f04540b6f80 0x7f0454144330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:01.309 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.313+0000 7f0453fff640 1 -- 10.20.193.58:0/3490009034 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04440094b0 con 0x7f0454059350 2026-02-23T06:40:01.309 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.313+0000 7f0453fff640 1 --2- 10.20.193.58:0/3490009034 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0454059350 0x7f0454140ed0 secure :-1 s=READY pgs=62 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f044800d750 tx=0x7f044800dc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:01.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.313+0000 7f0450ff9640 1 -- 10.20.193.58:0/3490009034 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0448007c50 con 0x7f0454059350 2026-02-23T06:40:01.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.313+0000 7f0450ff9640 1 -- 10.20.193.58:0/3490009034 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f04480057e0 con 0x7f0454059350 2026-02-23T06:40:01.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.313+0000 7f0450ff9640 1 -- 10.20.193.58:0/3490009034 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0448007ea0 con 0x7f0454059350 2026-02-23T06:40:01.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.313+0000 7f0459175640 1 -- 10.20.193.58:0/3490009034 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04540bbaf0 con 0x7f0454059350 2026-02-23T06:40:01.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.314+0000 7f0459175640 1 -- 10.20.193.58:0/3490009034 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f04541618f0 con 0x7f0454059350 2026-02-23T06:40:01.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.315+0000 7f042e7fc640 1 --2- 10.20.193.58:0/3490009034 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f04540bff80 0x7f0454165220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:01.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.315+0000 7f042e7fc640 1 -- 10.20.193.58:0/3490009034 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f0454059720 con 0x7f04540bff80 2026-02-23T06:40:01.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.315+0000 7f04537fe640 1 --2- 10.20.193.58:0/3490009034 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f04540bff80 0x7f0454165220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:01.311 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.315+0000 7f04537fe640 1 -- 10.20.193.58:0/3490009034 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f04541611a0 con 0x7f04540bff80 2026-02-23T06:40:01.311 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.316+0000 7f04537fe640 1 --2- 10.20.193.58:0/3490009034 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f04540bff80 0x7f0454165220 secure :-1 s=READY pgs=63 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0454167340 tx=0x7f044000fc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:01.311 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.316+0000 7f0450ff9640 1 -- 10.20.193.58:0/3490009034 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0440006ab0 con 0x7f04540bff80 2026-02-23T06:40:01.311 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.316+0000 7f0450ff9640 1 -- 10.20.193.58:0/3490009034 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f044801a030 con 0x7f0454059350 2026-02-23T06:40:01.312 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.317+0000 7f0450ff9640 1 --2- 10.20.193.58:0/3490009034 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f042407a6b0 0x7f042409ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:01.312 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.317+0000 7f0450ff9640 1 -- 10.20.193.58:0/3490009034 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f044809dd10 con 0x7f0454059350 2026-02-23T06:40:01.318 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.318+0000 7f0450ff9640 1 -- 10.20.193.58:0/3490009034 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f0440006c10 con 0x7f04540bff80 2026-02-23T06:40:01.318 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.318+0000 7f0450ff9640 1 -- 10.20.193.58:0/3490009034 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f04540bff80 msgr2=0x7f0454165220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:01.318 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.318+0000 7f0450ff9640 1 --2- 10.20.193.58:0/3490009034 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f04540bff80 0x7f0454165220 secure :-1 s=READY pgs=63 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0454167340 tx=0x7f044000fc10 comp rx=0 tx=0).stop 2026-02-23T06:40:01.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.318+0000 7f0450ff9640 1 -- 10.20.193.58:0/3490009034 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f04540bff80 msgr2=0x7f0454165220 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:40:01.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.318+0000 7f0450ff9640 1 --2- 10.20.193.58:0/3490009034 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f04540bff80 0x7f0454165220 secure :-1 s=CLOSED pgs=63 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0454167340 tx=0x7f044000fc10 comp rx=0 tx=0).stop 2026-02-23T06:40:01.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.318+0000 7f0458974640 1 --2- 10.20.193.58:0/3490009034 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f042407a6b0 0x7f042409ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:01.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.323+0000 7f042e7fc640 1 --2- 10.20.193.58:0/3490009034 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0454142df0 0x7f04541431c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:01.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.323+0000 7f042e7fc640 1 -- 10.20.193.58:0/3490009034 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f0454145ac0 con 0x7f0454142df0 2026-02-23T06:40:01.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.323+0000 7f0458974640 1 --2- 10.20.193.58:0/3490009034 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f042407a6b0 0x7f042409ab60 secure :-1 s=READY pgs=415 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04440097e0 tx=0x7f0444031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:01.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.323+0000 7f04537fe640 1 --2- 10.20.193.58:0/3490009034 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0454142df0 0x7f04541431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:01.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.324+0000 7f04537fe640 1 -- 10.20.193.58:0/3490009034 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0454143f90 con 0x7f0454142df0 2026-02-23T06:40:01.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.324+0000 7f04537fe640 1 --2- 10.20.193.58:0/3490009034 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0454142df0 0x7f04541431c0 secure :-1 s=READY pgs=64 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0454167340 tx=0x7f04400026a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:01.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.324+0000 7f0450ff9640 1 -- 10.20.193.58:0/3490009034 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0440023070 con 0x7f0454142df0 2026-02-23T06:40:01.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.325+0000 7f0450ff9640 1 -- 10.20.193.58:0/3490009034 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5413 (secure 0 0 0) 0x7f0440002c80 con 0x7f0454142df0 2026-02-23T06:40:01.321 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.325+0000 7f0450ff9640 1 -- 10.20.193.58:0/3490009034 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0454142df0 msgr2=0x7f04541431c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:01.321 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.325+0000 7f0450ff9640 1 --2- 10.20.193.58:0/3490009034 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0454142df0 0x7f04541431c0 secure :-1 s=READY pgs=64 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0454167340 tx=0x7f04400026a0 comp rx=0 tx=0).stop 2026-02-23T06:40:01.321 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.325+0000 7f0450ff9640 1 -- 10.20.193.58:0/3490009034 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0454142df0 msgr2=0x7f04541431c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:40:01.321 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.325+0000 7f0450ff9640 1 --2- 10.20.193.58:0/3490009034 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0454142df0 0x7f04541431c0 secure :-1 s=CLOSED pgs=64 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0454167340 tx=0x7f04400026a0 comp rx=0 tx=0).stop 2026-02-23T06:40:01.321 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:40:01.321 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:40:01.321 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:40:01.322 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:40:01.322 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 158, 2026-02-23T06:40:01.322 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 125842, 2026-02-23T06:40:01.322 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:40:01.322 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:40:01.322 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:40:01.322 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:40:01.322 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:01.322 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 5, 2026-02-23T06:40:01.322 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:40:01.322 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:40:01.323 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:40:01.323 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:01.323 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:01.323 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:01.323 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:01.323 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:01.323 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:01.323 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:01.323 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:01.323 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:01.323 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:01.323 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:01.324 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:01.324 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:01.324 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:01.324 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:40:01.324 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:40:01.324 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:01.324 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:01.324 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:01.324 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:01.324 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:01.324 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:01.324 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:01.325 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:01.325 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:01.325 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:01.325 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:01.325 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:01.325 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:01.325 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:01.325 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:01.325 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:40:01.325 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:40:01.325 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:40:01.325 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:40:01.325 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:40:01.326 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:40:01.326 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:40:01.326 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:40:01.326 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:40:01.326 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:40:01.326 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:40:01.326 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:40:01.326 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:40:01.326 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:40:01.326 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:40:01.326 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:40:01.326 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:40:01.327 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:01.327 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:01.327 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:01.327 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:01.327 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:01.327 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:01.327 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:01.327 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:01.327 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:01.327 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:01.327 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:01.327 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:01.328 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:01.328 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:01.328 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:40:01.328 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:01.328 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:40:01.328 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:01.328 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:40:01.328 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:40:01.328 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:01.328 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:01.328 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:01.328 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:01.329 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:40:01.329 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:01.329 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:01.329 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:01.329 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:01.329 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:40:01.329 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:01.329 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:01.329 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:01.329 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:01.329 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:40:01.329 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:40:01.330 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:01.330 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:01.330 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:40:01.330 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:01.330 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:01.330 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:01.330 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:40:01.330 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:40:01.330 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:01.330 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:01.330 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:01.330 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:01.330 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:40:01.331 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:01.331 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:01.331 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:01.331 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:01.331 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:40:01.331 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:01.331 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:01.331 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:01.331 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:01.331 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:40:01.331 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:40:01.331 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:01.332 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:01.332 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:40:01.332 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:01.332 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:01.332 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:01.332 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:40:01.332 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:40:01.332 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:01.332 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:01.332 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:01.332 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:01.332 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:40:01.332 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:01.333 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:01.333 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:01.333 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:01.333 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:40:01.333 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:01.333 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:01.333 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:01.333 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:01.333 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:40:01.333 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:40:01.333 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:01.333 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:01.333 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:40:01.334 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:01.334 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:01.334 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:01.334 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:01.334 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:40:01.334 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:40:01.334 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:01.334 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:01.334 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:01.334 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:40:01.334 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:01.334 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:01.335 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:40:01.335 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:01.335 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:01.335 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:01.335 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:40:01.335 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:01.335 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:01.335 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:40:01.335 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:01.335 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:01.335 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:01.335 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:40:01.336 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:01.336 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:01.336 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:40:01.336 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:01.336 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:01.336 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:01.336 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:40:01.336 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:01.336 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:01.336 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:40:01.336 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:01.336 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:01.336 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:01.337 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:40:01.337 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:01.337 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:01.337 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:01.337 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:40:01.337 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:40:01.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.325+0000 7f042e7fc640 1 -- 10.20.193.58:0/3490009034 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f042407a6b0 msgr2=0x7f042409ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:01.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.325+0000 7f042e7fc640 1 --2- 10.20.193.58:0/3490009034 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f042407a6b0 0x7f042409ab60 secure :-1 s=READY pgs=415 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04440097e0 tx=0x7f0444031040 comp rx=0 tx=0).stop 2026-02-23T06:40:01.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.325+0000 7f042e7fc640 1 -- 10.20.193.58:0/3490009034 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0454059350 msgr2=0x7f0454140ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:01.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.325+0000 7f042e7fc640 1 --2- 10.20.193.58:0/3490009034 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0454059350 0x7f0454140ed0 secure :-1 s=READY pgs=62 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f044800d750 tx=0x7f044800dc20 comp rx=0 tx=0).stop 2026-02-23T06:40:01.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.325+0000 7f0458974640 1 -- 10.20.193.58:0/3490009034 reap_dead start 2026-02-23T06:40:01.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.325+0000 7f042e7fc640 1 -- 10.20.193.58:0/3490009034 shutdown_connections 2026-02-23T06:40:01.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.325+0000 7f042e7fc640 1 --2- 10.20.193.58:0/3490009034 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0454059350 0x7f0454140ed0 unknown :-1 s=CLOSED pgs=62 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:01.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.325+0000 7f042e7fc640 1 -- 10.20.193.58:0/3490009034 >> 10.20.193.58:0/3490009034 conn(0x7f04540583c0 msgr2=0x7f0454162f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:01.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.325+0000 7f042e7fc640 1 -- 10.20.193.58:0/3490009034 shutdown_connections 2026-02-23T06:40:01.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.326+0000 7f042e7fc640 1 -- 10.20.193.58:0/3490009034 wait complete. 2026-02-23T06:40:01.340 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:40:01.340 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:40:01.340 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:40:01.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.484+0000 7fa9ed283640 1 -- 10.20.193.58:0/3220046889 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa9cc003a80 msgr2=0x7fa9cc003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:01.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.484+0000 7fa9ed283640 1 --2- 10.20.193.58:0/3220046889 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa9cc003a80 0x7fa9cc003e90 secure :-1 s=READY pgs=311 gs=4 cs=0 l=1 c_cookie=4963522758048983778 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9d400c360 tx=0x7fa9d402f940 comp rx=0 tx=0).stop 2026-02-23T06:40:01.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.484+0000 7fa9eca82640 1 -- 10.20.193.58:0/3220046889 reap_dead start 2026-02-23T06:40:01.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.484+0000 7fa9ed283640 1 -- 10.20.193.58:0/3220046889 shutdown_connections 2026-02-23T06:40:01.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.484+0000 7fa9ed283640 1 -- 10.20.193.58:0/3220046889 >> 10.20.193.58:0/3220046889 conn(0x7fa9e80b3c20 msgr2=0x7fa9e80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:01.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.484+0000 7fa9ed283640 1 -- 10.20.193.58:0/3220046889 shutdown_connections 2026-02-23T06:40:01.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.484+0000 7fa9ed283640 1 -- 10.20.193.58:0/3220046889 wait complete. 2026-02-23T06:40:01.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.485+0000 7fa9ed283640 1 Processor -- start 2026-02-23T06:40:01.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.485+0000 7fa9ed283640 1 -- start start 2026-02-23T06:40:01.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.486+0000 7fa9ed283640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa9cc003a80 0x7fa9e8058810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:01.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.486+0000 7fa9ed283640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa9e80b03a0 0x7fa9e80aeab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:01.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.486+0000 7fa9ed283640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa9e815fe90 0x7fa9e8124dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:01.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.486+0000 7fa9ed283640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e8160370 con 0x7fa9e80b03a0 2026-02-23T06:40:01.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.486+0000 7fa9ed283640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e8157840 con 0x7fa9e815fe90 2026-02-23T06:40:01.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.486+0000 7fa9ed283640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa9e8155cc0 con 0x7fa9cc003a80 2026-02-23T06:40:01.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.486+0000 7fa9e77fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa9e80b03a0 0x7fa9e80aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:01.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.486+0000 7fa9e77fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa9e80b03a0 0x7fa9e80aeab0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:41106/0 (socket says 10.20.193.58:41106) 2026-02-23T06:40:01.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.486+0000 7fa9e77fe640 1 -- 10.20.193.58:0/3295847858 learned_addr learned my addr 10.20.193.58:0/3295847858 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:40:01.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.486+0000 7fa9e7fff640 1 --2- 10.20.193.58:0/3295847858 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa9cc003a80 0x7fa9e8058810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:01.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.486+0000 7fa9eca82640 1 --2- 10.20.193.58:0/3295847858 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa9e815fe90 0x7fa9e8124dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:01.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.486+0000 7fa9e77fe640 1 -- 10.20.193.58:0/3295847858 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa9cc003a80 msgr2=0x7fa9e8058810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:01.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.486+0000 7fa9e77fe640 1 --2- 10.20.193.58:0/3295847858 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa9cc003a80 0x7fa9e8058810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:01.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.486+0000 7fa9e77fe640 1 -- 10.20.193.58:0/3295847858 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa9e815fe90 msgr2=0x7fa9e8124dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:01.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.486+0000 7fa9e77fe640 1 --2- 10.20.193.58:0/3295847858 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa9e815fe90 0x7fa9e8124dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:01.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.486+0000 7fa9e77fe640 1 -- 10.20.193.58:0/3295847858 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9e8157b20 con 0x7fa9e80b03a0 2026-02-23T06:40:01.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.486+0000 7fa9e77fe640 1 --2- 10.20.193.58:0/3295847858 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa9e80b03a0 0x7fa9e80aeab0 secure :-1 s=READY pgs=312 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9d800e9c0 tx=0x7fa9d800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:01.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.487+0000 7fa9e4ff9640 1 -- 10.20.193.58:0/3295847858 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9d8004500 con 0x7fa9e80b03a0 2026-02-23T06:40:01.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.487+0000 7fa9e4ff9640 1 -- 10.20.193.58:0/3295847858 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9d800a8f0 con 0x7fa9e80b03a0 2026-02-23T06:40:01.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.487+0000 7fa9e4ff9640 1 -- 10.20.193.58:0/3295847858 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9d800aca0 con 0x7fa9e80b03a0 2026-02-23T06:40:01.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.487+0000 7fa9ed283640 1 -- 10.20.193.58:0/3295847858 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9e8155fa0 con 0x7fa9e80b03a0 2026-02-23T06:40:01.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.487+0000 7fa9ed283640 1 -- 10.20.193.58:0/3295847858 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9e815f980 con 0x7fa9e80b03a0 2026-02-23T06:40:01.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.487+0000 7fa9ed283640 1 -- 10.20.193.58:0/3295847858 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9e805b0e0 con 0x7fa9e80b03a0 2026-02-23T06:40:01.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.488+0000 7fa9e4ff9640 1 -- 10.20.193.58:0/3295847858 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fa9d8016020 con 0x7fa9e80b03a0 2026-02-23T06:40:01.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.489+0000 7fa9e4ff9640 1 --2- 10.20.193.58:0/3295847858 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa9b807a6c0 0x7fa9b809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:01.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.489+0000 7fa9e4ff9640 1 -- 10.20.193.58:0/3295847858 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fa9d809dc50 con 0x7fa9e80b03a0 2026-02-23T06:40:01.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.490+0000 7fa9e7fff640 1 --2- 10.20.193.58:0/3295847858 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa9b807a6c0 0x7fa9b809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:01.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.491+0000 7fa9e7fff640 1 --2- 10.20.193.58:0/3295847858 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa9b807a6c0 0x7fa9b809ab70 secure :-1 s=READY pgs=416 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9d40023d0 tx=0x7fa9d40031a0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:01.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.491+0000 7fa9e4ff9640 1 -- 10.20.193.58:0/3295847858 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fa9d8060cd0 con 0x7fa9e80b03a0 2026-02-23T06:40:01.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.646+0000 7fa9ed283640 1 -- 10.20.193.58:0/3295847858 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fa9e80b1d90 con 0x7fa9e80b03a0 2026-02-23T06:40:01.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.646+0000 7fa9e4ff9640 1 -- 10.20.193.58:0/3295847858 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fa9d8063e80 con 0x7fa9e80b03a0 2026-02-23T06:40:01.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.647+0000 7fa9ed283640 1 -- 10.20.193.58:0/3295847858 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa9b807a6c0 msgr2=0x7fa9b809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:01.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.647+0000 7fa9ed283640 1 --2- 10.20.193.58:0/3295847858 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa9b807a6c0 0x7fa9b809ab70 secure :-1 s=READY pgs=416 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9d40023d0 tx=0x7fa9d40031a0 comp rx=0 tx=0).stop 2026-02-23T06:40:01.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.647+0000 7fa9ed283640 1 -- 10.20.193.58:0/3295847858 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa9e80b03a0 msgr2=0x7fa9e80aeab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:01.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.647+0000 7fa9ed283640 1 --2- 10.20.193.58:0/3295847858 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa9e80b03a0 0x7fa9e80aeab0 secure :-1 s=READY pgs=312 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9d800e9c0 tx=0x7fa9d800ee90 comp rx=0 tx=0).stop 2026-02-23T06:40:01.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.647+0000 7fa9ed283640 1 -- 10.20.193.58:0/3295847858 shutdown_connections 2026-02-23T06:40:01.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.647+0000 7fa9ed283640 1 --2- 10.20.193.58:0/3295847858 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa9b807a6c0 0x7fa9b809ab70 unknown :-1 s=CLOSED pgs=416 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:01.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.647+0000 7fa9ed283640 1 --2- 10.20.193.58:0/3295847858 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa9e815fe90 0x7fa9e8124dd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:01.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.647+0000 7fa9ed283640 1 --2- 10.20.193.58:0/3295847858 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa9e80b03a0 0x7fa9e80aeab0 unknown :-1 s=CLOSED pgs=312 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:01.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.647+0000 7fa9ed283640 1 --2- 10.20.193.58:0/3295847858 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa9cc003a80 0x7fa9e8058810 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:01.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.647+0000 7fa9ed283640 1 -- 10.20.193.58:0/3295847858 >> 10.20.193.58:0/3295847858 conn(0x7fa9e80b3c20 msgr2=0x7fa9e8156830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:01.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.648+0000 7fa9ed283640 1 -- 10.20.193.58:0/3295847858 shutdown_connections 2026-02-23T06:40:01.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:01.648+0000 7fa9ed283640 1 -- 10.20.193.58:0/3295847858 wait complete. 2026-02-23T06:40:01.654 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:40:11.655 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:40:11.655 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:40:11.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.861+0000 7f68742c3640 1 -- 10.20.193.58:0/3014206186 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6864044c50 msgr2=0x7f6864045070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:11.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.861+0000 7f68742c3640 1 --2- 10.20.193.58:0/3014206186 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6864044c50 0x7f6864045070 secure :-1 s=READY pgs=7 gs=2 cs=0 l=1 c_cookie=693893487299415493 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f686404a3b0 tx=0x7f6868030300 comp rx=0 tx=0).stop 2026-02-23T06:40:11.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.862+0000 7f68742c3640 1 -- 10.20.193.58:0/3014206186 shutdown_connections 2026-02-23T06:40:11.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.862+0000 7f68742c3640 1 --2- 10.20.193.58:0/3014206186 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6864044c50 0x7f6864045070 unknown :-1 s=CLOSED pgs=7 gs=2 cs=0 l=1 c_cookie=693893487299415493 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:11.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.862+0000 7f68742c3640 1 --2- 10.20.193.58:0/3014206186 >> v2:10.20.193.58:3300/0 conn(0x7f686400ddf0 0x7f686404f470 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:11.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.862+0000 7f68742c3640 1 -- 10.20.193.58:0/3014206186 >> 10.20.193.58:0/3014206186 conn(0x7f686400a260 msgr2=0x7f686400b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:11.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.862+0000 7f68742c3640 1 -- 10.20.193.58:0/3014206186 shutdown_connections 2026-02-23T06:40:11.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.862+0000 7f68742c3640 1 -- 10.20.193.58:0/3014206186 wait complete. 2026-02-23T06:40:11.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.863+0000 7f68742c3640 1 Processor -- start 2026-02-23T06:40:11.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.864+0000 7f68742c3640 1 -- start start 2026-02-23T06:40:11.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.864+0000 7f68742c3640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f686400ddf0 0x7f686404c2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:11.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.864+0000 7f68742c3640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6864044c50 0x7f68640b5650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:11.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.864+0000 7f6872038640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f686400ddf0 0x7f686404c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:11.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.864+0000 7f6872038640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f686400ddf0 0x7f686404c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:46624/0 (socket says 10.20.193.58:46624) 2026-02-23T06:40:11.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.865+0000 7f6872038640 1 -- 10.20.193.58:0/145977975 learned_addr learned my addr 10.20.193.58:0/145977975 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:40:11.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.865+0000 7f6871837640 1 --2- 10.20.193.58:0/145977975 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6864044c50 0x7f68640b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:11.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.865+0000 7f68742c3640 1 --2- 10.20.193.58:0/145977975 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f68640e2c90 0x7f6864034140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:11.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.865+0000 7f68742c3640 1 -- 10.20.193.58:0/145977975 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f68640336f0 con 0x7f68640e2c90 2026-02-23T06:40:11.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.865+0000 7f68742c3640 1 -- 10.20.193.58:0/145977975 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f6864035ce0 con 0x7f686400ddf0 2026-02-23T06:40:11.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.865+0000 7f68742c3640 1 -- 10.20.193.58:0/145977975 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f6864035f40 con 0x7f6864044c50 2026-02-23T06:40:11.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.865+0000 7f6872839640 1 --2- 10.20.193.58:0/145977975 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f68640e2c90 0x7f6864034140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:11.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.865+0000 7f6872839640 1 -- 10.20.193.58:0/145977975 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6864044c50 msgr2=0x7f68640b5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:11.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.865+0000 7f6872839640 1 --2- 10.20.193.58:0/145977975 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6864044c50 0x7f68640b5650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:11.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.866+0000 7f6872839640 1 -- 10.20.193.58:0/145977975 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f686400ddf0 msgr2=0x7f686404c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:11.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.866+0000 7f6872839640 1 --2- 10.20.193.58:0/145977975 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f686400ddf0 0x7f686404c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:11.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.866+0000 7f6872839640 1 -- 10.20.193.58:0/145977975 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f686800a590 con 0x7f68640e2c90 2026-02-23T06:40:11.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.866+0000 7f6871837640 1 --2- 10.20.193.58:0/145977975 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6864044c50 0x7f68640b5650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:40:11.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.866+0000 7f6872839640 1 --2- 10.20.193.58:0/145977975 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f68640e2c90 0x7f6864034140 secure :-1 s=READY pgs=315 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f686404aaf0 tx=0x7f6868003d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:11.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.866+0000 7f6852ffd640 1 -- 10.20.193.58:0/145977975 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f686803e070 con 0x7f68640e2c90 2026-02-23T06:40:11.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.866+0000 7f6852ffd640 1 -- 10.20.193.58:0/145977975 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68680398a0 con 0x7f68640e2c90 2026-02-23T06:40:11.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.866+0000 7f6852ffd640 1 -- 10.20.193.58:0/145977975 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6868039cb0 con 0x7f68640e2c90 2026-02-23T06:40:11.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.866+0000 7f68742c3640 1 -- 10.20.193.58:0/145977975 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6864034f90 con 0x7f68640e2c90 2026-02-23T06:40:11.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.867+0000 7f68742c3640 1 -- 10.20.193.58:0/145977975 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68640330a0 con 0x7f68640e2c90 2026-02-23T06:40:11.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.868+0000 7f68742c3640 1 -- 10.20.193.58:0/145977975 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6864033860 con 0x7f68640e2c90 2026-02-23T06:40:11.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.869+0000 7f6852ffd640 1 -- 10.20.193.58:0/145977975 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f6868042410 con 0x7f68640e2c90 2026-02-23T06:40:11.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.870+0000 7f6852ffd640 1 --2- 10.20.193.58:0/145977975 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f683c07a810 0x7f683c09acc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:11.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.870+0000 7f6852ffd640 1 -- 10.20.193.58:0/145977975 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f68680c3a20 con 0x7f68640e2c90 2026-02-23T06:40:11.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.871+0000 7f6872038640 1 --2- 10.20.193.58:0/145977975 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f683c07a810 0x7f683c09acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:11.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.872+0000 7f6852ffd640 1 -- 10.20.193.58:0/145977975 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f6868086d70 con 0x7f68640e2c90 2026-02-23T06:40:11.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:11.872+0000 7f6872038640 1 --2- 10.20.193.58:0/145977975 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f683c07a810 0x7f683c09acc0 secure :-1 s=READY pgs=417 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f685c007c00 tx=0x7f685c0026d0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:12.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.064+0000 7f68742c3640 1 -- 10.20.193.58:0/145977975 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6864045020 con 0x7f68640e2c90 2026-02-23T06:40:12.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.065+0000 7f6852ffd640 1 -- 10.20.193.58:0/145977975 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f6868089e90 con 0x7f68640e2c90 2026-02-23T06:40:12.063 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":158,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:40:12.065 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.070+0000 7f68742c3640 1 -- 10.20.193.58:0/145977975 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f683c07a810 msgr2=0x7f683c09acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:12.065 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.070+0000 7f68742c3640 1 --2- 10.20.193.58:0/145977975 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f683c07a810 0x7f683c09acc0 secure :-1 s=READY pgs=417 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f685c007c00 tx=0x7f685c0026d0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.065 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.070+0000 7f68742c3640 1 -- 10.20.193.58:0/145977975 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f68640e2c90 msgr2=0x7f6864034140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:12.065 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.070+0000 7f68742c3640 1 --2- 10.20.193.58:0/145977975 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f68640e2c90 0x7f6864034140 secure :-1 s=READY pgs=315 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f686404aaf0 tx=0x7f6868003d20 comp rx=0 tx=0).stop 2026-02-23T06:40:12.065 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.070+0000 7f68742c3640 1 -- 10.20.193.58:0/145977975 shutdown_connections 2026-02-23T06:40:12.072 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.070+0000 7f68742c3640 1 --2- 10.20.193.58:0/145977975 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f683c07a810 0x7f683c09acc0 unknown :-1 s=CLOSED pgs=417 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.072 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.070+0000 7f68742c3640 1 --2- 10.20.193.58:0/145977975 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f68640e2c90 0x7f6864034140 unknown :-1 s=CLOSED pgs=315 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.072 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.070+0000 7f68742c3640 1 --2- 10.20.193.58:0/145977975 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6864044c50 0x7f68640b5650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.072 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.070+0000 7f68742c3640 1 --2- 10.20.193.58:0/145977975 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f686400ddf0 0x7f686404c2b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.073 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.070+0000 7f68742c3640 1 -- 10.20.193.58:0/145977975 >> 10.20.193.58:0/145977975 conn(0x7f686400a260 msgr2=0x7f68640f7770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:12.073 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.070+0000 7f68742c3640 1 -- 10.20.193.58:0/145977975 shutdown_connections 2026-02-23T06:40:12.073 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.070+0000 7f68742c3640 1 -- 10.20.193.58:0/145977975 wait complete. 2026-02-23T06:40:12.081 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:40:12.082 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:40:12.082 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:40:12.082 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:40:12.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.304+0000 7f9f5effd640 1 -- 10.20.193.58:0/1110370554 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f500026a0 con 0x7f9f600b16d0 2026-02-23T06:40:12.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.304+0000 7f9f65043640 1 -- 10.20.193.58:0/1110370554 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f600b16d0 msgr2=0x7f9f600561f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:12.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.304+0000 7f9f65043640 1 --2- 10.20.193.58:0/1110370554 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f600b16d0 0x7f9f600561f0 secure :-1 s=READY pgs=316 gs=1 cs=0 l=1 c_cookie=11583283527198561482 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f600b7370 tx=0x7f9f50030760 comp rx=0 tx=0).stop 2026-02-23T06:40:12.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.305+0000 7f9f65043640 1 -- 10.20.193.58:0/1110370554 shutdown_connections 2026-02-23T06:40:12.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.305+0000 7f9f65043640 1 --2- 10.20.193.58:0/1110370554 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9f6005d740 0x7f9f60056730 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.305+0000 7f9f65043640 1 --2- 10.20.193.58:0/1110370554 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f600b16d0 0x7f9f600561f0 unknown :-1 s=CLOSED pgs=316 gs=1 cs=0 l=1 c_cookie=11583283527198561482 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.305+0000 7f9f65043640 1 --2- 10.20.193.58:0/1110370554 >> v2:10.20.193.93:3300/0 conn(0x7f9f6015bb70 0x7f9f60057830 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.305+0000 7f9f65043640 1 -- 10.20.193.58:0/1110370554 >> 10.20.193.58:0/1110370554 conn(0x7f9f600b3c20 msgr2=0x7f9f600b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:12.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.305+0000 7f9f65043640 1 -- 10.20.193.58:0/1110370554 shutdown_connections 2026-02-23T06:40:12.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.305+0000 7f9f65043640 1 -- 10.20.193.58:0/1110370554 wait complete. 2026-02-23T06:40:12.302 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.306+0000 7f9f65043640 1 Processor -- start 2026-02-23T06:40:12.302 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.306+0000 7f9f65043640 1 -- start start 2026-02-23T06:40:12.302 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.307+0000 7f9f65043640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9f6005d740 0x7f9f602025f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:12.303 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.307+0000 7f9f65043640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f600b16d0 0x7f9f60137b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:12.303 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.307+0000 7f9f65043640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9f6015bb70 0x7f9f6013b810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:12.303 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.308+0000 7f9f5f7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f600b16d0 0x7f9f60137b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:12.303 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.308+0000 7f9f5f7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f600b16d0 0x7f9f60137b60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:34964/0 (socket says 10.20.193.58:34964) 2026-02-23T06:40:12.303 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.308+0000 7f9f5f7fe640 1 -- 10.20.193.58:0/1406589595 learned_addr learned my addr 10.20.193.58:0/1406589595 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:40:12.303 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.308+0000 7f9f65043640 1 -- 10.20.193.58:0/1406589595 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6013c940 con 0x7f9f600b16d0 2026-02-23T06:40:12.303 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.308+0000 7f9f65043640 1 -- 10.20.193.58:0/1406589595 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9f60137300 con 0x7f9f6005d740 2026-02-23T06:40:12.303 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.308+0000 7f9f65043640 1 -- 10.20.193.58:0/1406589595 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f9f6013cdb0 con 0x7f9f6015bb70 2026-02-23T06:40:12.304 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.308+0000 7f9f5f7fe640 1 -- 10.20.193.58:0/1406589595 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9f6015bb70 msgr2=0x7f9f6013b810 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-23T06:40:12.304 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.308+0000 7f9f5f7fe640 1 --2- 10.20.193.58:0/1406589595 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9f6015bb70 0x7f9f6013b810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.304 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.308+0000 7f9f5f7fe640 1 -- 10.20.193.58:0/1406589595 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9f6005d740 msgr2=0x7f9f602025f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:12.304 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.308+0000 7f9f5f7fe640 1 --2- 10.20.193.58:0/1406589595 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9f6005d740 0x7f9f602025f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.304 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.308+0000 7f9f5f7fe640 1 -- 10.20.193.58:0/1406589595 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f5000a6c0 con 0x7f9f600b16d0 2026-02-23T06:40:12.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.308+0000 7f9f5f7fe640 1 --2- 10.20.193.58:0/1406589595 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f600b16d0 0x7f9f60137b60 secure :-1 s=READY pgs=317 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f50030c70 tx=0x7f9f50002950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:12.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.309+0000 7f9f5cff9640 1 -- 10.20.193.58:0/1406589595 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f50004590 con 0x7f9f600b16d0 2026-02-23T06:40:12.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.309+0000 7f9f5cff9640 1 -- 10.20.193.58:0/1406589595 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f50002c30 con 0x7f9f600b16d0 2026-02-23T06:40:12.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.309+0000 7f9f5cff9640 1 -- 10.20.193.58:0/1406589595 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f50004850 con 0x7f9f600b16d0 2026-02-23T06:40:12.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.309+0000 7f9f65043640 1 -- 10.20.193.58:0/1406589595 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f60138580 con 0x7f9f600b16d0 2026-02-23T06:40:12.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.309+0000 7f9f65043640 1 -- 10.20.193.58:0/1406589595 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f6015e6c0 con 0x7f9f600b16d0 2026-02-23T06:40:12.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.310+0000 7f9f65043640 1 --2- 10.20.193.58:0/1406589595 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f60136e60 0x7f9f6013bd50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:12.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.310+0000 7f9f65043640 1 -- 10.20.193.58:0/1406589595 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6005ba20 con 0x7f9f60136e60 2026-02-23T06:40:12.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.310+0000 7f9f5ffff640 1 --2- 10.20.193.58:0/1406589595 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f60136e60 0x7f9f6013bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:12.306 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.310+0000 7f9f5ffff640 1 -- 10.20.193.58:0/1406589595 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9f6005b740 con 0x7f9f60136e60 2026-02-23T06:40:12.306 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.310+0000 7f9f5ffff640 1 --2- 10.20.193.58:0/1406589595 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f60136e60 0x7f9f6013bd50 secure :-1 s=READY pgs=318 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f4c00b380 tx=0x7f9f4c00b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:12.306 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.311+0000 7f9f5cff9640 1 -- 10.20.193.58:0/1406589595 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f9f50038430 con 0x7f9f600b16d0 2026-02-23T06:40:12.306 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.311+0000 7f9f5cff9640 1 --2- 10.20.193.58:0/1406589595 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9f3007a600 0x7f9f3009aab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:12.306 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.312+0000 7f9f5cff9640 1 -- 10.20.193.58:0/1406589595 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f9f500c2b90 con 0x7f9f600b16d0 2026-02-23T06:40:12.306 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.312+0000 7f9f5cff9640 1 -- 10.20.193.58:0/1406589595 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f4c0044a0 con 0x7f9f60136e60 2026-02-23T06:40:12.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.312+0000 7f9f5cff9640 1 -- 10.20.193.58:0/1406589595 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f9f4c002740 con 0x7f9f60136e60 2026-02-23T06:40:12.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.312+0000 7f9f5cff9640 1 -- 10.20.193.58:0/1406589595 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f60136e60 msgr2=0x7f9f6013bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:12.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.312+0000 7f9f5cff9640 1 --2- 10.20.193.58:0/1406589595 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f60136e60 0x7f9f6013bd50 secure :-1 s=READY pgs=318 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f4c00b380 tx=0x7f9f4c00b850 comp rx=0 tx=0).stop 2026-02-23T06:40:12.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.312+0000 7f9f5cff9640 1 -- 10.20.193.58:0/1406589595 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f60136e60 msgr2=0x7f9f6013bd50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:40:12.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.312+0000 7f9f5cff9640 1 --2- 10.20.193.58:0/1406589595 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f60136e60 0x7f9f6013bd50 secure :-1 s=CLOSED pgs=318 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f4c00b380 tx=0x7f9f4c00b850 comp rx=0 tx=0).stop 2026-02-23T06:40:12.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.312+0000 7f9f64842640 1 --2- 10.20.193.58:0/1406589595 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9f3007a600 0x7f9f3009aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:12.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.312+0000 7f9f64842640 1 --2- 10.20.193.58:0/1406589595 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9f3007a600 0x7f9f3009aab0 secure :-1 s=READY pgs=418 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f54005840 tx=0x7f9f54007dd0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:12.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.315+0000 7f9f65043640 1 --2- 10.20.193.58:0/1406589595 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f60204f50 0x7f9f60205320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:12.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.315+0000 7f9f65043640 1 -- 10.20.193.58:0/1406589595 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6013cef0 con 0x7f9f60204f50 2026-02-23T06:40:12.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.315+0000 7f9f5ffff640 1 --2- 10.20.193.58:0/1406589595 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f60204f50 0x7f9f60205320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:12.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.316+0000 7f9f5ffff640 1 -- 10.20.193.58:0/1406589595 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9f6013cbe0 con 0x7f9f60204f50 2026-02-23T06:40:12.310 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.316+0000 7f9f5ffff640 1 --2- 10.20.193.58:0/1406589595 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f60204f50 0x7f9f60205320 secure :-1 s=READY pgs=319 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f4c0023d0 tx=0x7f9f4c004800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:12.311 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.316+0000 7f9f5cff9640 1 -- 10.20.193.58:0/1406589595 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f4c01e070 con 0x7f9f60204f50 2026-02-23T06:40:12.311 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.316+0000 7f9f5cff9640 1 -- 10.20.193.58:0/1406589595 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5559 (secure 0 0 0) 0x7f9f4c022630 con 0x7f9f60204f50 2026-02-23T06:40:12.311 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.316+0000 7f9f5cff9640 1 -- 10.20.193.58:0/1406589595 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f60204f50 msgr2=0x7f9f60205320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:12.311 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.316+0000 7f9f5cff9640 1 --2- 10.20.193.58:0/1406589595 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f60204f50 0x7f9f60205320 secure :-1 s=READY pgs=319 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f4c0023d0 tx=0x7f9f4c004800 comp rx=0 tx=0).stop 2026-02-23T06:40:12.311 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:40:12.311 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:40:12.311 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:40:12.311 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:40:12.311 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 158, 2026-02-23T06:40:12.311 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 419827, 2026-02-23T06:40:12.311 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:40:12.311 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:40:12.311 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:40:12.311 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:40:12.311 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:12.311 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 16, 2026-02-23T06:40:12.311 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:40:12.311 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:40:12.311 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:40:12.311 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:12.311 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:12.311 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:40:12.312 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:40:12.313 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:40:12.314 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:12.315 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:40:12.316 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.316 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:12.316 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:12.316 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:40:12.316 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:12.316 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:12.316 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:40:12.316 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.316 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:40:12.316 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:40:12.316 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:40:12.316 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.316 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.316 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:12.316 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:12.316 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:40:12.316 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:12.316 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:12.316 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:40:12.316 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.316 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:12.316 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:12.316 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:40:12.316 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:12.316 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:12.316 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.316 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:40:12.316 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:40:12.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.316+0000 7f9f5cff9640 1 -- 10.20.193.58:0/1406589595 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f60204f50 msgr2=0x7f9f60205320 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:40:12.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.316+0000 7f9f5cff9640 1 --2- 10.20.193.58:0/1406589595 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f60204f50 0x7f9f60205320 unknown :-1 s=CLOSED pgs=319 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.316+0000 7f9f65043640 1 -- 10.20.193.58:0/1406589595 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9f3007a600 msgr2=0x7f9f3009aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:12.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.316+0000 7f9f65043640 1 --2- 10.20.193.58:0/1406589595 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9f3007a600 0x7f9f3009aab0 secure :-1 s=READY pgs=418 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f54005840 tx=0x7f9f54007dd0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.316+0000 7f9f65043640 1 -- 10.20.193.58:0/1406589595 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f600b16d0 msgr2=0x7f9f60137b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:12.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.316+0000 7f9f65043640 1 --2- 10.20.193.58:0/1406589595 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f600b16d0 0x7f9f60137b60 secure :-1 s=READY pgs=317 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f50030c70 tx=0x7f9f50002950 comp rx=0 tx=0).stop 2026-02-23T06:40:12.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.316+0000 7f9f64842640 1 -- 10.20.193.58:0/1406589595 reap_dead start 2026-02-23T06:40:12.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.316+0000 7f9f64842640 1 -- 10.20.193.58:0/1406589595 reap_dead start 2026-02-23T06:40:12.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.317+0000 7f9f65043640 1 -- 10.20.193.58:0/1406589595 shutdown_connections 2026-02-23T06:40:12.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.317+0000 7f9f65043640 1 -- 10.20.193.58:0/1406589595 >> 10.20.193.58:0/1406589595 conn(0x7f9f600b3c20 msgr2=0x7f9f600b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:12.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.317+0000 7f9f65043640 1 -- 10.20.193.58:0/1406589595 shutdown_connections 2026-02-23T06:40:12.317 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.317+0000 7f9f65043640 1 -- 10.20.193.58:0/1406589595 wait complete. 2026-02-23T06:40:12.319 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:40:12.319 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:40:12.319 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:40:12.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.506+0000 7ff9e754c640 1 -- 10.20.193.58:0/1147107193 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9e0056fa0 msgr2=0x7ff9e0163790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:12.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.506+0000 7ff9e754c640 1 --2- 10.20.193.58:0/1147107193 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9e0056fa0 0x7ff9e0163790 secure :-1 s=READY pgs=10 gs=3 cs=0 l=1 c_cookie=7771551952462315997 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9d0005820 tx=0x7ff9d0030340 comp rx=0 tx=0).stop 2026-02-23T06:40:12.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.506+0000 7ff9e754c640 1 -- 10.20.193.58:0/1147107193 shutdown_connections 2026-02-23T06:40:12.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.506+0000 7ff9e754c640 1 --2- 10.20.193.58:0/1147107193 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9e0056fa0 0x7ff9e0163790 unknown :-1 s=CLOSED pgs=10 gs=3 cs=0 l=1 c_cookie=7771551952462315997 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.506+0000 7ff9e754c640 1 -- 10.20.193.58:0/1147107193 >> 10.20.193.58:0/1147107193 conn(0x7ff9e00b7b80 msgr2=0x7ff9e00b7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:12.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.506+0000 7ff9e754c640 1 -- 10.20.193.58:0/1147107193 shutdown_connections 2026-02-23T06:40:12.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.506+0000 7ff9e754c640 1 -- 10.20.193.58:0/1147107193 wait complete. 2026-02-23T06:40:12.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.507+0000 7ff9e754c640 1 Processor -- start 2026-02-23T06:40:12.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.508+0000 7ff9e754c640 1 -- start start 2026-02-23T06:40:12.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.509+0000 7ff9e754c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff9e0056bd0 0x7ff9e015cb90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:12.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.509+0000 7ff9e754c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff9e0056fa0 0x7ff9e0160110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:12.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.509+0000 7ff9e754c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9e015c760 0x7ff9e01fd780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:12.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.509+0000 7ff9e754c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e013df40 con 0x7ff9e0056fa0 2026-02-23T06:40:12.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.509+0000 7ff9e52c1640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9e015c760 0x7ff9e01fd780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:12.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.509+0000 7ff9e52c1640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9e015c760 0x7ff9e01fd780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:46674/0 (socket says 10.20.193.58:46674) 2026-02-23T06:40:12.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.509+0000 7ff9e52c1640 1 -- 10.20.193.58:0/3442313093 learned_addr learned my addr 10.20.193.58:0/3442313093 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:40:12.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.509+0000 7ff9e754c640 1 -- 10.20.193.58:0/3442313093 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e01faa60 con 0x7ff9e015c760 2026-02-23T06:40:12.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.509+0000 7ff9e754c640 1 -- 10.20.193.58:0/3442313093 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e015d0d0 con 0x7ff9e0056bd0 2026-02-23T06:40:12.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.509+0000 7ff9e62c3640 1 --2- 10.20.193.58:0/3442313093 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff9e0056bd0 0x7ff9e015cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:12.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.510+0000 7ff9e52c1640 1 -- 10.20.193.58:0/3442313093 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff9e0056bd0 msgr2=0x7ff9e015cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:12.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.510+0000 7ff9e52c1640 1 --2- 10.20.193.58:0/3442313093 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff9e0056bd0 0x7ff9e015cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.510+0000 7ff9e52c1640 1 -- 10.20.193.58:0/3442313093 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff9e0056fa0 msgr2=0x7ff9e0160110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:12.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.510+0000 7ff9e52c1640 1 --2- 10.20.193.58:0/3442313093 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff9e0056fa0 0x7ff9e0160110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.510+0000 7ff9e52c1640 1 -- 10.20.193.58:0/3442313093 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d000a590 con 0x7ff9e015c760 2026-02-23T06:40:12.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.510+0000 7ff9e62c3640 1 --2- 10.20.193.58:0/3442313093 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff9e0056bd0 0x7ff9e015cb90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:40:12.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.510+0000 7ff9e52c1640 1 --2- 10.20.193.58:0/3442313093 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9e015c760 0x7ff9e01fd780 secure :-1 s=READY pgs=11 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9d0003d20 tx=0x7ff9d0003d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:12.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.510+0000 7ff9cdffb640 1 -- 10.20.193.58:0/3442313093 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff9d00398a0 con 0x7ff9e015c760 2026-02-23T06:40:12.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.510+0000 7ff9e754c640 1 -- 10.20.193.58:0/3442313093 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e015c370 con 0x7ff9e015c760 2026-02-23T06:40:12.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.510+0000 7ff9cdffb640 1 -- 10.20.193.58:0/3442313093 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9d0039af0 con 0x7ff9e015c760 2026-02-23T06:40:12.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.510+0000 7ff9cdffb640 1 -- 10.20.193.58:0/3442313093 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff9d003f460 con 0x7ff9e015c760 2026-02-23T06:40:12.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.511+0000 7ff9e754c640 1 -- 10.20.193.58:0/3442313093 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e013dbd0 con 0x7ff9e015c760 2026-02-23T06:40:12.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.512+0000 7ff9e754c640 1 --2- 10.20.193.58:0/3442313093 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9e0140590 0x7ff9e01fdcc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:12.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.512+0000 7ff9e754c640 1 -- 10.20.193.58:0/3442313093 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e013ddf0 con 0x7ff9e0140590 2026-02-23T06:40:12.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.512+0000 7ff9e62c3640 1 --2- 10.20.193.58:0/3442313093 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9e0140590 0x7ff9e01fdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:12.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.512+0000 7ff9e62c3640 1 -- 10.20.193.58:0/3442313093 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9e00b75a0 con 0x7ff9e0140590 2026-02-23T06:40:12.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.512+0000 7ff9cdffb640 1 -- 10.20.193.58:0/3442313093 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7ff9d003d040 con 0x7ff9e015c760 2026-02-23T06:40:12.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.513+0000 7ff9e62c3640 1 --2- 10.20.193.58:0/3442313093 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9e0140590 0x7ff9e01fdcc0 secure :-1 s=READY pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9d8000b60 tx=0x7ff9d800f4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:12.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.513+0000 7ff9cdffb640 1 --2- 10.20.193.58:0/3442313093 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff9b407a6c0 0x7ff9b409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:12.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.513+0000 7ff9cdffb640 1 -- 10.20.193.58:0/3442313093 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff9d800fe40 con 0x7ff9e0140590 2026-02-23T06:40:12.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.513+0000 7ff9cdffb640 1 -- 10.20.193.58:0/3442313093 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7ff9d8005030 con 0x7ff9e0140590 2026-02-23T06:40:12.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.513+0000 7ff9cdffb640 1 -- 10.20.193.58:0/3442313093 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9e0140590 msgr2=0x7ff9e01fdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:12.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.513+0000 7ff9cdffb640 1 --2- 10.20.193.58:0/3442313093 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9e0140590 0x7ff9e01fdcc0 secure :-1 s=READY pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9d8000b60 tx=0x7ff9d800f4a0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.513+0000 7ff9cdffb640 1 -- 10.20.193.58:0/3442313093 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9e0140590 msgr2=0x7ff9e01fdcc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:40:12.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.513+0000 7ff9cdffb640 1 --2- 10.20.193.58:0/3442313093 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9e0140590 0x7ff9e01fdcc0 secure :-1 s=CLOSED pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9d8000b60 tx=0x7ff9d800f4a0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.513+0000 7ff9cdffb640 1 -- 10.20.193.58:0/3442313093 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7ff9d0006c40 con 0x7ff9e015c760 2026-02-23T06:40:12.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.513+0000 7ff9e4ac0640 1 --2- 10.20.193.58:0/3442313093 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff9b407a6c0 0x7ff9b409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:12.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.514+0000 7ff9e4ac0640 1 --2- 10.20.193.58:0/3442313093 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff9b407a6c0 0x7ff9b409ab70 secure :-1 s=READY pgs=419 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9e00b4120 tx=0x7ff9d4009180 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:12.512 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.518+0000 7ff9e754c640 1 --2- 10.20.193.58:0/3442313093 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9e015b660 0x7ff9e015ba60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:12.512 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.518+0000 7ff9e754c640 1 -- 10.20.193.58:0/3442313093 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e005b560 con 0x7ff9e015b660 2026-02-23T06:40:12.513 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.518+0000 7ff9e62c3640 1 --2- 10.20.193.58:0/3442313093 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9e015b660 0x7ff9e015ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:12.513 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.518+0000 7ff9e62c3640 1 -- 10.20.193.58:0/3442313093 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff9e013da30 con 0x7ff9e015b660 2026-02-23T06:40:12.513 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.519+0000 7ff9e62c3640 1 --2- 10.20.193.58:0/3442313093 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9e015b660 0x7ff9e015ba60 secure :-1 s=READY pgs=13 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9d8000b60 tx=0x7ff9d8003840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:12.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.519+0000 7ff9cdffb640 1 -- 10.20.193.58:0/3442313093 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff9d8029620 con 0x7ff9e015b660 2026-02-23T06:40:12.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.519+0000 7ff9cdffb640 1 -- 10.20.193.58:0/3442313093 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5079 (secure 0 0 0) 0x7ff9d8004e80 con 0x7ff9e015b660 2026-02-23T06:40:12.514 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:40:12.514 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:40:12.514 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:40:12.514 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:40:12.514 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 158, 2026-02-23T06:40:12.514 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 16609, 2026-02-23T06:40:12.514 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:40:12.514 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:40:12.514 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:40:12.515 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:40:12.515 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:12.515 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 16, 2026-02-23T06:40:12.515 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:40:12.515 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:40:12.515 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:40:12.515 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:12.515 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:12.515 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:12.515 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:12.515 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:12.515 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:12.515 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:12.515 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:12.515 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:12.515 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:12.515 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:12.515 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:12.515 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:12.515 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:12.515 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:40:12.515 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:40:12.515 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:12.516 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:12.516 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:12.516 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:12.516 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:12.516 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:12.516 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:12.516 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:12.516 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:12.516 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:12.516 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:12.516 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:12.516 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:12.516 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:12.516 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.516 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:40:12.516 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:40:12.516 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:40:12.516 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:40:12.516 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:40:12.516 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:40:12.516 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:40:12.516 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:40:12.516 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:40:12.517 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:40:12.517 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:40:12.517 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:40:12.517 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:40:12.517 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:40:12.517 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:40:12.517 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:40:12.517 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:40:12.517 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:12.517 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:12.517 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:12.517 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:12.517 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:12.517 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:12.517 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:12.517 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:12.517 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:12.517 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:12.517 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:12.517 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:12.517 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:12.517 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:12.517 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:40:12.518 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.518 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:40:12.518 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.518 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:40:12.518 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:40:12.518 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:12.518 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:12.518 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.518 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:12.518 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:40:12.518 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:12.518 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.518 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.518 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:12.518 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:40:12.518 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:12.518 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:12.518 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:12.518 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.518 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:40:12.518 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:40:12.518 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:12.518 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:12.518 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:40:12.519 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:12.519 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.519 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.519 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:40:12.519 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:40:12.519 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:12.519 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:12.519 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.519 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:12.519 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:40:12.519 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:12.519 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.519 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.519 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:12.519 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:40:12.519 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:12.519 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:12.519 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:12.519 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.519 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:40:12.519 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:40:12.519 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:12.519 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:12.520 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:40:12.520 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:12.520 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.520 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.520 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:40:12.520 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:40:12.520 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:12.520 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:12.520 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.520 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:12.520 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:40:12.520 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:12.520 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.520 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.520 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:12.520 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:40:12.520 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:12.520 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:12.520 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:12.520 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.520 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:40:12.520 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:40:12.520 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:12.521 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:12.521 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:40:12.521 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:12.521 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:12.521 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:12.521 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.521 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:40:12.521 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:40:12.521 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.521 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:12.521 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:12.521 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:40:12.521 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:12.522 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:12.522 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:40:12.522 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.522 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:12.522 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:12.522 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:40:12.522 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:12.522 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:12.522 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:40:12.522 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.522 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:12.522 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:12.523 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:40:12.523 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:12.523 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:12.523 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.523 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:40:12.523 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:40:12.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.519+0000 7ff9cdffb640 1 -- 10.20.193.58:0/3442313093 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9e015b660 msgr2=0x7ff9e015ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:12.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.519+0000 7ff9cdffb640 1 --2- 10.20.193.58:0/3442313093 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9e015b660 0x7ff9e015ba60 secure :-1 s=READY pgs=13 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9d8000b60 tx=0x7ff9d8003840 comp rx=0 tx=0).stop 2026-02-23T06:40:12.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.519+0000 7ff9cdffb640 1 -- 10.20.193.58:0/3442313093 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9e015b660 msgr2=0x7ff9e015ba60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:40:12.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.519+0000 7ff9cdffb640 1 --2- 10.20.193.58:0/3442313093 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9e015b660 0x7ff9e015ba60 unknown :-1 s=CLOSED pgs=13 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.521+0000 7ff9e754c640 1 -- 10.20.193.58:0/3442313093 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff9b407a6c0 msgr2=0x7ff9b409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:12.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.521+0000 7ff9e754c640 1 --2- 10.20.193.58:0/3442313093 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff9b407a6c0 0x7ff9b409ab70 secure :-1 s=READY pgs=419 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9e00b4120 tx=0x7ff9d4009180 comp rx=0 tx=0).stop 2026-02-23T06:40:12.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.521+0000 7ff9e52c1640 1 -- 10.20.193.58:0/3442313093 reap_dead start 2026-02-23T06:40:12.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.521+0000 7ff9e754c640 1 -- 10.20.193.58:0/3442313093 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9e015c760 msgr2=0x7ff9e01fd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:12.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.521+0000 7ff9e754c640 1 --2- 10.20.193.58:0/3442313093 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9e015c760 0x7ff9e01fd780 secure :-1 s=READY pgs=11 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9d0003d20 tx=0x7ff9d0003d50 comp rx=0 tx=0).stop 2026-02-23T06:40:12.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.521+0000 7ff9e754c640 1 -- 10.20.193.58:0/3442313093 shutdown_connections 2026-02-23T06:40:12.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.521+0000 7ff9e754c640 1 --2- 10.20.193.58:0/3442313093 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff9e015c760 0x7ff9e01fd780 unknown :-1 s=CLOSED pgs=11 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.521+0000 7ff9e754c640 1 -- 10.20.193.58:0/3442313093 >> 10.20.193.58:0/3442313093 conn(0x7ff9e00b7b80 msgr2=0x7ff9e0160e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:12.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.521+0000 7ff9e754c640 1 -- 10.20.193.58:0/3442313093 shutdown_connections 2026-02-23T06:40:12.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.521+0000 7ff9e754c640 1 -- 10.20.193.58:0/3442313093 wait complete. 2026-02-23T06:40:12.530 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:40:12.530 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:40:12.530 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:40:12.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.722+0000 7f478e5dd640 1 -- 10.20.193.58:0/1807342022 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4788059960 msgr2=0x7f47880b4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:12.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.722+0000 7f478e5dd640 1 --2- 10.20.193.58:0/1807342022 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4788059960 0x7f47880b4c00 secure :-1 s=READY pgs=322 gs=2 cs=0 l=1 c_cookie=6492266572815282630 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47880586a0 tx=0x7f47840303a0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.722+0000 7f478e5dd640 1 -- 10.20.193.58:0/1807342022 shutdown_connections 2026-02-23T06:40:12.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.722+0000 7f478e5dd640 1 --2- 10.20.193.58:0/1807342022 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4788059960 0x7f47880b4c00 unknown :-1 s=CLOSED pgs=322 gs=2 cs=0 l=1 c_cookie=6492266572815282630 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.722+0000 7f478e5dd640 1 --2- 10.20.193.58:0/1807342022 >> v2:10.20.193.93:3300/0 conn(0x7f47880b3e70 0x7f47880b46c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.722+0000 7f478e5dd640 1 -- 10.20.193.58:0/1807342022 >> 10.20.193.58:0/1807342022 conn(0x7f4788058e50 msgr2=0x7f4788059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:12.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.722+0000 7f478e5dd640 1 -- 10.20.193.58:0/1807342022 shutdown_connections 2026-02-23T06:40:12.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.722+0000 7f478e5dd640 1 -- 10.20.193.58:0/1807342022 wait complete. 2026-02-23T06:40:12.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.724+0000 7f478e5dd640 1 Processor -- start 2026-02-23T06:40:12.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.724+0000 7f478e5dd640 1 -- start start 2026-02-23T06:40:12.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.725+0000 7f478e5dd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4788059960 0x7f478805da90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:12.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.726+0000 7f477ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4788059960 0x7f478805da90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:12.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.726+0000 7f478e5dd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f47880b3e70 0x7f478805b760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:12.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.726+0000 7f478e5dd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f478815b4c0 0x7f478805bca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:12.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.726+0000 7f478e5dd640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f478805d490 con 0x7f4788059960 2026-02-23T06:40:12.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.726+0000 7f478e5dd640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f478805b2d0 con 0x7f47880b3e70 2026-02-23T06:40:12.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.726+0000 7f478e5dd640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f4788125760 con 0x7f478815b4c0 2026-02-23T06:40:12.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.726+0000 7f477ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4788059960 0x7f478805da90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:34994/0 (socket says 10.20.193.58:34994) 2026-02-23T06:40:12.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.726+0000 7f477ffff640 1 -- 10.20.193.58:0/3351568239 learned_addr learned my addr 10.20.193.58:0/3351568239 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:40:12.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.726+0000 7f478cb53640 1 --2- 10.20.193.58:0/3351568239 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f478815b4c0 0x7f478805bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:12.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.727+0000 7f477f7fe640 1 --2- 10.20.193.58:0/3351568239 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f47880b3e70 0x7f478805b760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:12.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.727+0000 7f477ffff640 1 -- 10.20.193.58:0/3351568239 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f478815b4c0 msgr2=0x7f478805bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:12.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.727+0000 7f477ffff640 1 --2- 10.20.193.58:0/3351568239 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f478815b4c0 0x7f478805bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.727+0000 7f477ffff640 1 -- 10.20.193.58:0/3351568239 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f47880b3e70 msgr2=0x7f478805b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:12.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.727+0000 7f477ffff640 1 --2- 10.20.193.58:0/3351568239 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f47880b3e70 0x7f478805b760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.727+0000 7f477ffff640 1 -- 10.20.193.58:0/3351568239 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f478400a650 con 0x7f4788059960 2026-02-23T06:40:12.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.727+0000 7f477ffff640 1 --2- 10.20.193.58:0/3351568239 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4788059960 0x7f478805da90 secure :-1 s=READY pgs=323 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f477800c700 tx=0x7f477800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:12.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.728+0000 7f477cff9640 1 -- 10.20.193.58:0/3351568239 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4778006ab0 con 0x7f4788059960 2026-02-23T06:40:12.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.728+0000 7f477cff9640 1 -- 10.20.193.58:0/3351568239 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4778006d00 con 0x7f4788059960 2026-02-23T06:40:12.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.728+0000 7f477cff9640 1 -- 10.20.193.58:0/3351568239 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f47780072b0 con 0x7f4788059960 2026-02-23T06:40:12.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.730+0000 7f478e5dd640 1 -- 10.20.193.58:0/3351568239 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4788164640 con 0x7f4788059960 2026-02-23T06:40:12.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.730+0000 7f478e5dd640 1 -- 10.20.193.58:0/3351568239 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4788125ce0 con 0x7f4788059960 2026-02-23T06:40:12.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.730+0000 7f478e5dd640 1 --2- 10.20.193.58:0/3351568239 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f47500041f0 0x7f47500246a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:12.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.730+0000 7f478e5dd640 1 -- 10.20.193.58:0/3351568239 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f4750025f20 con 0x7f47500041f0 2026-02-23T06:40:12.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.731+0000 7f477f7fe640 1 --2- 10.20.193.58:0/3351568239 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f47500041f0 0x7f47500246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:12.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.732+0000 7f477f7fe640 1 -- 10.20.193.58:0/3351568239 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f47500260e0 con 0x7f47500041f0 2026-02-23T06:40:12.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.732+0000 7f477cff9640 1 -- 10.20.193.58:0/3351568239 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f4778019070 con 0x7f4788059960 2026-02-23T06:40:12.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.733+0000 7f477cff9640 1 --2- 10.20.193.58:0/3351568239 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f475807a790 0x7f475809ac40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:12.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.733+0000 7f477cff9640 1 -- 10.20.193.58:0/3351568239 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f477800ce30 con 0x7f4788059960 2026-02-23T06:40:12.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.733+0000 7f477f7fe640 1 --2- 10.20.193.58:0/3351568239 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f47500041f0 0x7f47500246a0 secure :-1 s=READY pgs=66 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4788120000 tx=0x7f4770002eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:12.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.733+0000 7f478cb53640 1 --2- 10.20.193.58:0/3351568239 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f475807a790 0x7f475809ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:12.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.733+0000 7f477cff9640 1 -- 10.20.193.58:0/3351568239 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4770009d50 con 0x7f47500041f0 2026-02-23T06:40:12.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.733+0000 7f477cff9640 1 -- 10.20.193.58:0/3351568239 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f4770015040 con 0x7f47500041f0 2026-02-23T06:40:12.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.733+0000 7f477cff9640 1 -- 10.20.193.58:0/3351568239 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f47500041f0 msgr2=0x7f47500246a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:12.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.733+0000 7f477cff9640 1 --2- 10.20.193.58:0/3351568239 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f47500041f0 0x7f47500246a0 secure :-1 s=READY pgs=66 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4788120000 tx=0x7f4770002eb0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.734+0000 7f477cff9640 1 -- 10.20.193.58:0/3351568239 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f47500041f0 msgr2=0x7f47500246a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:40:12.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.734+0000 7f477cff9640 1 --2- 10.20.193.58:0/3351568239 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f47500041f0 0x7f47500246a0 unknown :-1 s=CLOSED pgs=66 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.734+0000 7f478cb53640 1 --2- 10.20.193.58:0/3351568239 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f475807a790 0x7f475809ac40 secure :-1 s=READY pgs=420 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f478400a9d0 tx=0x7f478403d040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:12.733 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.739+0000 7f478e5dd640 1 --2- 10.20.193.58:0/3351568239 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4750025080 0x7f4750025500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:12.733 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.739+0000 7f478e5dd640 1 -- 10.20.193.58:0/3351568239 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f4750025b60 con 0x7f4750025080 2026-02-23T06:40:12.734 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.739+0000 7f477f7fe640 1 --2- 10.20.193.58:0/3351568239 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4750025080 0x7f4750025500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:12.735 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.740+0000 7f477f7fe640 1 -- 10.20.193.58:0/3351568239 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4750025d20 con 0x7f4750025080 2026-02-23T06:40:12.735 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.740+0000 7f477f7fe640 1 --2- 10.20.193.58:0/3351568239 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4750025080 0x7f4750025500 secure :-1 s=READY pgs=67 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4788192ab0 tx=0x7f4770004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:12.736 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.740+0000 7f477cff9640 1 -- 10.20.193.58:0/3351568239 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4770026070 con 0x7f4750025080 2026-02-23T06:40:12.736 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.740+0000 7f477cff9640 1 -- 10.20.193.58:0/3351568239 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5414 (secure 0 0 0) 0x7f4770018390 con 0x7f4750025080 2026-02-23T06:40:12.736 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.741+0000 7f477cff9640 1 -- 10.20.193.58:0/3351568239 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4750025080 msgr2=0x7f4750025500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:12.736 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:40:12.736 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:40:12.736 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:40:12.736 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:40:12.737 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 158, 2026-02-23T06:40:12.737 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 137257, 2026-02-23T06:40:12.737 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:40:12.737 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:40:12.737 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:40:12.737 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:40:12.737 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:12.737 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 16, 2026-02-23T06:40:12.737 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:40:12.737 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:40:12.737 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:40:12.737 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:12.737 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:12.737 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:12.737 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:12.737 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:12.737 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:12.737 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:12.737 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:12.738 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:12.738 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:12.738 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:12.738 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:12.738 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:12.738 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:12.738 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:40:12.738 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:40:12.738 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:12.738 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:12.738 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:12.738 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:12.738 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:12.738 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:12.738 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:12.738 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:12.738 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:12.738 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:12.738 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:12.738 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:12.739 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:12.739 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:12.739 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.739 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:40:12.739 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:40:12.739 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:40:12.739 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:40:12.739 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:40:12.739 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:40:12.739 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:40:12.739 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:40:12.739 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:40:12.739 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:40:12.739 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:40:12.739 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:40:12.739 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:40:12.739 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:40:12.739 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:40:12.739 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:40:12.739 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:40:12.740 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:12.740 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:12.740 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:12.740 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:12.740 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:12.740 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:12.740 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:12.740 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:12.740 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:12.740 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:12.740 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:12.740 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:12.740 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:12.740 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:12.740 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:40:12.740 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.740 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:40:12.740 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.740 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:40:12.740 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:40:12.740 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:12.741 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:12.741 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.741 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:12.741 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:40:12.741 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:12.741 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.741 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.741 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:12.741 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:40:12.741 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:12.741 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:12.741 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:12.741 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.741 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:40:12.741 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:40:12.741 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:12.741 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:12.741 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:40:12.741 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:12.741 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.741 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.741 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:40:12.742 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:40:12.742 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:12.742 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:12.742 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.742 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:12.742 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:40:12.742 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:12.742 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.742 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.742 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:12.742 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:40:12.742 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:12.742 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:12.742 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:12.742 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.742 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:40:12.742 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:40:12.742 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:12.742 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:12.742 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:40:12.742 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:12.742 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.743 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.743 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:40:12.743 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:40:12.743 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:12.743 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:12.743 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.743 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:12.743 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:40:12.743 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:12.743 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.743 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.743 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:12.743 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:40:12.743 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:12.743 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:12.743 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:12.743 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.743 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:40:12.743 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:40:12.743 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:12.743 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:12.743 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:40:12.744 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:12.744 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:12.744 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:12.744 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.744 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:40:12.744 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:40:12.744 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.744 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:12.744 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:12.744 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:40:12.744 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:12.744 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:12.744 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:40:12.744 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.744 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:12.744 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:12.744 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:40:12.744 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:12.744 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:12.744 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:40:12.744 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.744 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:12.744 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:12.744 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:40:12.745 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:12.745 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:12.745 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:40:12.745 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.745 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:12.745 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:12.745 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:40:12.745 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:12.745 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:12.745 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:40:12.745 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:12.745 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:12.745 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:12.745 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:40:12.745 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:12.745 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:12.745 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:12.745 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:40:12.745 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:40:12.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.741+0000 7f477cff9640 1 --2- 10.20.193.58:0/3351568239 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4750025080 0x7f4750025500 secure :-1 s=READY pgs=67 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4788192ab0 tx=0x7f4770004770 comp rx=0 tx=0).stop 2026-02-23T06:40:12.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.741+0000 7f477cff9640 1 -- 10.20.193.58:0/3351568239 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4750025080 msgr2=0x7f4750025500 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:40:12.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.742+0000 7f477cff9640 1 --2- 10.20.193.58:0/3351568239 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4750025080 0x7f4750025500 secure :-1 s=CLOSED pgs=67 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4788192ab0 tx=0x7f4770004770 comp rx=0 tx=0).stop 2026-02-23T06:40:12.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.742+0000 7f478e5dd640 1 -- 10.20.193.58:0/3351568239 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f475807a790 msgr2=0x7f475809ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:12.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.742+0000 7f478e5dd640 1 --2- 10.20.193.58:0/3351568239 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f475807a790 0x7f475809ac40 secure :-1 s=READY pgs=420 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f478400a9d0 tx=0x7f478403d040 comp rx=0 tx=0).stop 2026-02-23T06:40:12.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.742+0000 7f478e5dd640 1 -- 10.20.193.58:0/3351568239 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4788059960 msgr2=0x7f478805da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:12.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.742+0000 7f478e5dd640 1 --2- 10.20.193.58:0/3351568239 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4788059960 0x7f478805da90 secure :-1 s=READY pgs=323 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f477800c700 tx=0x7f477800cbd0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.742+0000 7f478cb53640 1 -- 10.20.193.58:0/3351568239 reap_dead start 2026-02-23T06:40:12.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.742+0000 7f478cb53640 1 -- 10.20.193.58:0/3351568239 reap_dead start 2026-02-23T06:40:12.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.742+0000 7f478e5dd640 1 -- 10.20.193.58:0/3351568239 shutdown_connections 2026-02-23T06:40:12.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.742+0000 7f478e5dd640 1 -- 10.20.193.58:0/3351568239 >> 10.20.193.58:0/3351568239 conn(0x7f4788058e50 msgr2=0x7f478815a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:12.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.742+0000 7f478e5dd640 1 -- 10.20.193.58:0/3351568239 shutdown_connections 2026-02-23T06:40:12.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.742+0000 7f478e5dd640 1 -- 10.20.193.58:0/3351568239 wait complete. 2026-02-23T06:40:12.760 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:40:12.760 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-23T06:40:12.760 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-23T06:40:12.760 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-23T06:40:12.760 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-23T06:40:12.761 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-23T06:40:12.761 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:40:12.771 INFO:tasks.ceph.mon.c:Stopped 2026-02-23T06:40:12.772 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:40:12.772 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:40:12.964 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.969+0000 7fc3e3403640 1 -- 10.20.193.58:0/1201166462 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc3cc004c50 msgr2=0x7fc3cc0050c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:12.964 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.969+0000 7fc3e3403640 1 --2- 10.20.193.58:0/1201166462 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc3cc004c50 0x7fc3cc0050c0 secure :-1 s=READY pgs=25 gs=5 cs=0 l=1 c_cookie=9341904378788227872 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3d0003270 tx=0x7fc3d0030250 comp rx=0 tx=0).stop 2026-02-23T06:40:12.964 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.969+0000 7fc3e2c02640 1 -- 10.20.193.58:0/1201166462 reap_dead start 2026-02-23T06:40:12.964 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.969+0000 7fc3e3403640 1 -- 10.20.193.58:0/1201166462 shutdown_connections 2026-02-23T06:40:12.964 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.969+0000 7fc3e3403640 1 -- 10.20.193.58:0/1201166462 >> 10.20.193.58:0/1201166462 conn(0x7fc3dc0b3c20 msgr2=0x7fc3dc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:12.964 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.969+0000 7fc3e3403640 1 -- 10.20.193.58:0/1201166462 shutdown_connections 2026-02-23T06:40:12.964 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.969+0000 7fc3e3403640 1 -- 10.20.193.58:0/1201166462 wait complete. 2026-02-23T06:40:12.966 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.971+0000 7fc3e3403640 1 Processor -- start 2026-02-23T06:40:12.966 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.971+0000 7fc3e3403640 1 -- start start 2026-02-23T06:40:12.966 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.972+0000 7fc3e3403640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc3cc004c50 0x7fc3dc181f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:12.969 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.972+0000 7fc3e3403640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc3dc185dc0 0x7fc3dc140400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:12.969 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.972+0000 7fc3e3403640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc3dc182f30 0x7fc3dc184c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:12.969 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.972+0000 7fc3e1c00640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc3dc185dc0 msgr2=0x7fc3dc140400 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:40:12.969 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.972+0000 7fc3e1c00640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc3dc185dc0 0x7fc3dc140400 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:40:12.969 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.972+0000 7fc3e3403640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc3dc187270 con 0x7fc3dc182f30 2026-02-23T06:40:12.969 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.972+0000 7fc3e3403640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc3dc186db0 con 0x7fc3cc004c50 2026-02-23T06:40:12.969 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.972+0000 7fc3e3403640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc3dc140940 con 0x7fc3dc185dc0 2026-02-23T06:40:12.970 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.972+0000 7fc3e2401640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc3cc004c50 0x7fc3dc181f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:12.970 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.972+0000 7fc3e2401640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc3cc004c50 0x7fc3dc181f80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:46738/0 (socket says 10.20.193.58:46738) 2026-02-23T06:40:12.970 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.973+0000 7fc3e2401640 1 -- 10.20.193.58:0/1661664478 learned_addr learned my addr 10.20.193.58:0/1661664478 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:40:12.970 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.973+0000 7fc3e2c02640 1 --2- 10.20.193.58:0/1661664478 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc3dc182f30 0x7fc3dc184c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:12.970 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.973+0000 7fc3e2401640 1 -- 10.20.193.58:0/1661664478 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc3dc185dc0 msgr2=0x7fc3dc140400 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:40:12.970 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.973+0000 7fc3e2401640 1 --2- 10.20.193.58:0/1661664478 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc3dc185dc0 0x7fc3dc140400 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.970 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.973+0000 7fc3e2401640 1 -- 10.20.193.58:0/1661664478 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc3dc182f30 msgr2=0x7fc3dc184c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:12.970 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.973+0000 7fc3e2401640 1 --2- 10.20.193.58:0/1661664478 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc3dc182f30 0x7fc3dc184c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:12.970 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.973+0000 7fc3e2401640 1 -- 10.20.193.58:0/1661664478 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3dc186230 con 0x7fc3cc004c50 2026-02-23T06:40:12.970 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.973+0000 7fc3e2c02640 1 --2- 10.20.193.58:0/1661664478 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc3dc182f30 0x7fc3dc184c50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:40:12.970 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.973+0000 7fc3e2401640 1 --2- 10.20.193.58:0/1661664478 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc3cc004c50 0x7fc3dc181f80 secure :-1 s=READY pgs=26 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3d8005db0 tx=0x7fc3d8009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:12.970 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.974+0000 7fc3c6ffd640 1 -- 10.20.193.58:0/1661664478 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc3d8011a20 con 0x7fc3cc004c50 2026-02-23T06:40:12.971 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.974+0000 7fc3c6ffd640 1 -- 10.20.193.58:0/1661664478 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3d8011b80 con 0x7fc3cc004c50 2026-02-23T06:40:12.971 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.974+0000 7fc3c6ffd640 1 -- 10.20.193.58:0/1661664478 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc3d801a440 con 0x7fc3cc004c50 2026-02-23T06:40:12.971 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.974+0000 7fc3e3403640 1 -- 10.20.193.58:0/1661664478 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3dc186510 con 0x7fc3cc004c50 2026-02-23T06:40:12.971 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.974+0000 7fc3e3403640 1 -- 10.20.193.58:0/1661664478 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3dc186ad0 con 0x7fc3cc004c50 2026-02-23T06:40:12.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.976+0000 7fc3c6ffd640 1 -- 10.20.193.58:0/1661664478 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fc3d8021060 con 0x7fc3cc004c50 2026-02-23T06:40:12.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.976+0000 7fc3e3403640 1 -- 10.20.193.58:0/1661664478 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3a0005300 con 0x7fc3cc004c50 2026-02-23T06:40:12.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.977+0000 7fc3c6ffd640 1 --2- 10.20.193.58:0/1661664478 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc3ac07a740 0x7fc3ac09abf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:12.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.977+0000 7fc3c6ffd640 1 -- 10.20.193.58:0/1661664478 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fc3d809e1f0 con 0x7fc3cc004c50 2026-02-23T06:40:12.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.977+0000 7fc3e1c00640 1 --2- 10.20.193.58:0/1661664478 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc3ac07a740 0x7fc3ac09abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:12.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.978+0000 7fc3e1c00640 1 --2- 10.20.193.58:0/1661664478 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc3ac07a740 0x7fc3ac09abf0 secure :-1 s=READY pgs=421 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3dc1835c0 tx=0x7fc3d400a270 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:12.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:12.979+0000 7fc3c6ffd640 1 -- 10.20.193.58:0/1661664478 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fc3d8061400 con 0x7fc3cc004c50 2026-02-23T06:40:13.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:13.352+0000 7fc3e3403640 1 -- 10.20.193.58:0/1661664478 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc3a0005b30 con 0x7fc3cc004c50 2026-02-23T06:40:13.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:13.352+0000 7fc3c6ffd640 1 -- 10.20.193.58:0/1661664478 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7fc3d8064520 con 0x7fc3cc004c50 2026-02-23T06:40:13.351 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":158,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:40:13.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:13.357+0000 7fc3e3403640 1 -- 10.20.193.58:0/1661664478 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc3ac07a740 msgr2=0x7fc3ac09abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:13.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:13.357+0000 7fc3e3403640 1 --2- 10.20.193.58:0/1661664478 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc3ac07a740 0x7fc3ac09abf0 secure :-1 s=READY pgs=421 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3dc1835c0 tx=0x7fc3d400a270 comp rx=0 tx=0).stop 2026-02-23T06:40:13.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:13.357+0000 7fc3e3403640 1 -- 10.20.193.58:0/1661664478 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc3cc004c50 msgr2=0x7fc3dc181f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:13.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:13.357+0000 7fc3e3403640 1 --2- 10.20.193.58:0/1661664478 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc3cc004c50 0x7fc3dc181f80 secure :-1 s=READY pgs=26 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3d8005db0 tx=0x7fc3d8009b20 comp rx=0 tx=0).stop 2026-02-23T06:40:13.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:13.357+0000 7fc3e3403640 1 -- 10.20.193.58:0/1661664478 shutdown_connections 2026-02-23T06:40:13.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:13.357+0000 7fc3e3403640 1 --2- 10.20.193.58:0/1661664478 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc3ac07a740 0x7fc3ac09abf0 unknown :-1 s=CLOSED pgs=421 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:13.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:13.357+0000 7fc3e3403640 1 --2- 10.20.193.58:0/1661664478 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc3dc182f30 0x7fc3dc184c50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:13.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:13.357+0000 7fc3e3403640 1 --2- 10.20.193.58:0/1661664478 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc3dc185dc0 0x7fc3dc140400 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:13.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:13.357+0000 7fc3e3403640 1 --2- 10.20.193.58:0/1661664478 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc3cc004c50 0x7fc3dc181f80 unknown :-1 s=CLOSED pgs=26 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:13.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:13.357+0000 7fc3e3403640 1 -- 10.20.193.58:0/1661664478 >> 10.20.193.58:0/1661664478 conn(0x7fc3dc0b3c20 msgr2=0x7fc3dc05d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:13.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:13.357+0000 7fc3e3403640 1 -- 10.20.193.58:0/1661664478 shutdown_connections 2026-02-23T06:40:13.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:13.357+0000 7fc3e3403640 1 -- 10.20.193.58:0/1661664478 wait complete. 2026-02-23T06:40:14.302 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:40:14.309 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:40:16.366 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:40:16.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.545+0000 7f61ceccc640 1 -- 10.20.193.58:0/3948630551 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f61c8163820 msgr2=0x7f61c815d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:16.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.545+0000 7f61ceccc640 1 --2- 10.20.193.58:0/3948630551 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f61c8163820 0x7f61c815d380 secure :-1 s=READY pgs=31 gs=3 cs=0 l=1 c_cookie=12197421710286770277 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61c4005820 tx=0x7f61c40302d0 comp rx=0 tx=0).stop 2026-02-23T06:40:16.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.546+0000 7f61ceccc640 1 -- 10.20.193.58:0/3948630551 shutdown_connections 2026-02-23T06:40:16.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.546+0000 7f61ceccc640 1 --2- 10.20.193.58:0/3948630551 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f61c8163820 0x7f61c815d380 unknown :-1 s=CLOSED pgs=31 gs=3 cs=0 l=1 c_cookie=12197421710286770277 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:16.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.546+0000 7f61ceccc640 1 --2- 10.20.193.58:0/3948630551 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f61c80b1170 0x7f61c815ce40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:16.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.546+0000 7f61ceccc640 1 -- 10.20.193.58:0/3948630551 >> 10.20.193.58:0/3948630551 conn(0x7f61c8058e50 msgr2=0x7f61c8059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:16.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.546+0000 7f61ceccc640 1 -- 10.20.193.58:0/3948630551 shutdown_connections 2026-02-23T06:40:16.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.546+0000 7f61ceccc640 1 -- 10.20.193.58:0/3948630551 wait complete. 2026-02-23T06:40:16.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.547+0000 7f61ceccc640 1 Processor -- start 2026-02-23T06:40:16.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.547+0000 7f61ceccc640 1 -- start start 2026-02-23T06:40:16.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.548+0000 7f61ceccc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f61c80b1170 0x7f61c8132360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:16.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.548+0000 7f61ceccc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61c80b1540 0x7f61c8157450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:16.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.548+0000 7f61ceccc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f61c8163820 0x7f61c8157990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:16.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.548+0000 7f61ceccc640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f61c80b84e0 con 0x7f61c80b1540 2026-02-23T06:40:16.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.548+0000 7f61ceccc640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f61c81650d0 con 0x7f61c80b1170 2026-02-23T06:40:16.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.548+0000 7f61ceccc640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f61c815c280 con 0x7f61c8163820 2026-02-23T06:40:16.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.548+0000 7f61cd242640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f61c8163820 msgr2=0x7f61c8157990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:40:16.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.548+0000 7f61cd242640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f61c8163820 0x7f61c8157990 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:40:16.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.548+0000 7f61bffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61c80b1540 0x7f61c8157450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:16.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.548+0000 7f61bffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61c80b1540 0x7f61c8157450 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:35022/0 (socket says 10.20.193.58:35022) 2026-02-23T06:40:16.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.548+0000 7f61bffff640 1 -- 10.20.193.58:0/1348236249 learned_addr learned my addr 10.20.193.58:0/1348236249 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:40:16.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.548+0000 7f61cca41640 1 --2- 10.20.193.58:0/1348236249 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f61c80b1170 0x7f61c8132360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:16.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.548+0000 7f61bffff640 1 -- 10.20.193.58:0/1348236249 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f61c8163820 msgr2=0x7f61c8157990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:40:16.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.548+0000 7f61bffff640 1 --2- 10.20.193.58:0/1348236249 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f61c8163820 0x7f61c8157990 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:16.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.548+0000 7f61bffff640 1 -- 10.20.193.58:0/1348236249 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f61c80b1170 msgr2=0x7f61c8132360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:16.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.548+0000 7f61bffff640 1 --2- 10.20.193.58:0/1348236249 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f61c80b1170 0x7f61c8132360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:16.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.548+0000 7f61bffff640 1 -- 10.20.193.58:0/1348236249 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c400a590 con 0x7f61c80b1540 2026-02-23T06:40:16.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.549+0000 7f61bffff640 1 --2- 10.20.193.58:0/1348236249 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61c80b1540 0x7f61c8157450 secure :-1 s=READY pgs=327 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61b0007fd0 tx=0x7f61b000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:16.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.549+0000 7f61bd7fa640 1 -- 10.20.193.58:0/1348236249 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61b000a640 con 0x7f61c80b1540 2026-02-23T06:40:16.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.549+0000 7f61bd7fa640 1 -- 10.20.193.58:0/1348236249 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61b000a890 con 0x7f61c80b1540 2026-02-23T06:40:16.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.549+0000 7f61bd7fa640 1 -- 10.20.193.58:0/1348236249 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61b000aca0 con 0x7f61c80b1540 2026-02-23T06:40:16.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.549+0000 7f61ceccc640 1 -- 10.20.193.58:0/1348236249 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61c8159330 con 0x7f61c80b1540 2026-02-23T06:40:16.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.549+0000 7f61ceccc640 1 -- 10.20.193.58:0/1348236249 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61c8159050 con 0x7f61c80b1540 2026-02-23T06:40:16.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.550+0000 7f61ceccc640 1 -- 10.20.193.58:0/1348236249 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61c805b2d0 con 0x7f61c80b1540 2026-02-23T06:40:16.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.551+0000 7f61bd7fa640 1 -- 10.20.193.58:0/1348236249 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f61b0012420 con 0x7f61c80b1540 2026-02-23T06:40:16.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.552+0000 7f61bd7fa640 1 --2- 10.20.193.58:0/1348236249 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f619807a5a0 0x7f619809aa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:16.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.552+0000 7f61bd7fa640 1 -- 10.20.193.58:0/1348236249 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f61b009d930 con 0x7f61c80b1540 2026-02-23T06:40:16.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.553+0000 7f61cca41640 1 --2- 10.20.193.58:0/1348236249 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f619807a5a0 0x7f619809aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:16.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.554+0000 7f61cca41640 1 --2- 10.20.193.58:0/1348236249 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f619807a5a0 0x7f619809aa50 secure :-1 s=READY pgs=423 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61b8002820 tx=0x7f61b8006f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:16.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.554+0000 7f61bd7fa640 1 -- 10.20.193.58:0/1348236249 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f61b00644a0 con 0x7f61c80b1540 2026-02-23T06:40:16.724 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":158,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:40:16.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.727+0000 7f61ceccc640 1 -- 10.20.193.58:0/1348236249 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f61c8059610 con 0x7f61c80b1540 2026-02-23T06:40:16.725 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.727+0000 7f61bd7fa640 1 -- 10.20.193.58:0/1348236249 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f61b0063bf0 con 0x7f61c80b1540 2026-02-23T06:40:16.727 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.732+0000 7f61ceccc640 1 -- 10.20.193.58:0/1348236249 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f619807a5a0 msgr2=0x7f619809aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:16.727 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.732+0000 7f61ceccc640 1 --2- 10.20.193.58:0/1348236249 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f619807a5a0 0x7f619809aa50 secure :-1 s=READY pgs=423 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61b8002820 tx=0x7f61b8006f90 comp rx=0 tx=0).stop 2026-02-23T06:40:16.727 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.732+0000 7f61ceccc640 1 -- 10.20.193.58:0/1348236249 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61c80b1540 msgr2=0x7f61c8157450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:16.727 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.732+0000 7f61ceccc640 1 --2- 10.20.193.58:0/1348236249 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61c80b1540 0x7f61c8157450 secure :-1 s=READY pgs=327 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61b0007fd0 tx=0x7f61b000cb80 comp rx=0 tx=0).stop 2026-02-23T06:40:16.728 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.733+0000 7f61ceccc640 1 -- 10.20.193.58:0/1348236249 shutdown_connections 2026-02-23T06:40:16.728 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.733+0000 7f61ceccc640 1 --2- 10.20.193.58:0/1348236249 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f619807a5a0 0x7f619809aa50 unknown :-1 s=CLOSED pgs=423 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:16.728 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.733+0000 7f61ceccc640 1 --2- 10.20.193.58:0/1348236249 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f61c8163820 0x7f61c8157990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:16.728 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.733+0000 7f61ceccc640 1 --2- 10.20.193.58:0/1348236249 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61c80b1540 0x7f61c8157450 unknown :-1 s=CLOSED pgs=327 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:16.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.733+0000 7f61ceccc640 1 --2- 10.20.193.58:0/1348236249 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f61c80b1170 0x7f61c8132360 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:16.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.733+0000 7f61ceccc640 1 -- 10.20.193.58:0/1348236249 >> 10.20.193.58:0/1348236249 conn(0x7f61c8058e50 msgr2=0x7f61c8133910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:16.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.733+0000 7f61ceccc640 1 -- 10.20.193.58:0/1348236249 shutdown_connections 2026-02-23T06:40:16.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:16.733+0000 7f61ceccc640 1 -- 10.20.193.58:0/1348236249 wait complete. 2026-02-23T06:40:19.742 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:40:19.891 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.895+0000 7f617b7fe640 1 -- 10.20.193.58:0/3795855698 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6180030e00 con 0x7f61840b39f0 2026-02-23T06:40:19.892 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.896+0000 7f618abb9640 1 -- 10.20.193.58:0/3795855698 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61840b39f0 msgr2=0x7f61840b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:19.892 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.896+0000 7f618abb9640 1 --2- 10.20.193.58:0/3795855698 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61840b39f0 0x7f61840b1850 secure :-1 s=READY pgs=328 gs=1 cs=0 l=1 c_cookie=11898263384415623204 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61840b4eb0 tx=0x7f6180030380 comp rx=0 tx=0).stop 2026-02-23T06:40:19.892 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.896+0000 7f618abb9640 1 -- 10.20.193.58:0/3795855698 shutdown_connections 2026-02-23T06:40:19.892 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.896+0000 7f618abb9640 1 --2- 10.20.193.58:0/3795855698 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f61840b39f0 0x7f61840b1850 unknown :-1 s=CLOSED pgs=328 gs=1 cs=0 l=1 c_cookie=11898263384415623204 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:19.892 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.896+0000 7f618abb9640 1 --2- 10.20.193.58:0/3795855698 >> v2:10.20.193.93:3300/0 conn(0x7f618415be70 0x7f61840b1310 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:19.892 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.896+0000 7f618abb9640 1 --2- 10.20.193.58:0/3795855698 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f618415baa0 0x7f61840b5610 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:19.892 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.896+0000 7f618abb9640 1 -- 10.20.193.58:0/3795855698 >> 10.20.193.58:0/3795855698 conn(0x7f6184058e50 msgr2=0x7f6184059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:19.892 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.896+0000 7f618abb9640 1 -- 10.20.193.58:0/3795855698 shutdown_connections 2026-02-23T06:40:19.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.896+0000 7f618abb9640 1 -- 10.20.193.58:0/3795855698 wait complete. 2026-02-23T06:40:19.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.897+0000 7f618abb9640 1 Processor -- start 2026-02-23T06:40:19.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.897+0000 7f618abb9640 1 -- start start 2026-02-23T06:40:19.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.898+0000 7f618abb9640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f61840b39f0 0x7f618413b5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:19.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.898+0000 7f618abb9640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f618415baa0 0x7f618413bb20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:19.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.898+0000 7f618abb9640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f618415be70 0x7f618413d810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:19.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.898+0000 7f618abb9640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f6184155760 con 0x7f618415be70 2026-02-23T06:40:19.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.898+0000 7f618abb9640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f61841548d0 con 0x7f61840b39f0 2026-02-23T06:40:19.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.898+0000 7f618abb9640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f618413f7c0 con 0x7f618415baa0 2026-02-23T06:40:19.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.898+0000 7f618892e640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f61840b39f0 0x7f618413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:19.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.898+0000 7f618892e640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f61840b39f0 0x7f618413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:51598/0 (socket says 10.20.193.58:51598) 2026-02-23T06:40:19.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.898+0000 7f618892e640 1 -- 10.20.193.58:0/867380444 learned_addr learned my addr 10.20.193.58:0/867380444 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:40:19.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.899+0000 7f617bfff640 1 -- 10.20.193.58:0/867380444 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f618415baa0 msgr2=0x7f618413bb20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:40:19.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.899+0000 7f617bfff640 1 --2- 10.20.193.58:0/867380444 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f618415baa0 0x7f618413bb20 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:40:19.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.899+0000 7f618912f640 1 --2- 10.20.193.58:0/867380444 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f618415be70 0x7f618413d810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:19.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.899+0000 7f618892e640 1 -- 10.20.193.58:0/867380444 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f618415baa0 msgr2=0x7f618413bb20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:40:19.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.899+0000 7f618892e640 1 --2- 10.20.193.58:0/867380444 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f618415baa0 0x7f618413bb20 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:19.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.899+0000 7f618892e640 1 -- 10.20.193.58:0/867380444 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f618415be70 msgr2=0x7f618413d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:19.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.899+0000 7f618892e640 1 --2- 10.20.193.58:0/867380444 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f618415be70 0x7f618413d810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:19.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.899+0000 7f618892e640 1 -- 10.20.193.58:0/867380444 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618000a650 con 0x7f61840b39f0 2026-02-23T06:40:19.897 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.902+0000 7f618892e640 1 --2- 10.20.193.58:0/867380444 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f61840b39f0 0x7f618413b5e0 secure :-1 s=READY pgs=33 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f616c006fd0 tx=0x7f616c00bbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:19.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.904+0000 7f61797fa640 1 -- 10.20.193.58:0/867380444 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f616c002cd0 con 0x7f61840b39f0 2026-02-23T06:40:19.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.904+0000 7f61797fa640 1 -- 10.20.193.58:0/867380444 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f616c004070 con 0x7f61840b39f0 2026-02-23T06:40:19.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.904+0000 7f61797fa640 1 -- 10.20.193.58:0/867380444 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f616c004460 con 0x7f61840b39f0 2026-02-23T06:40:19.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.904+0000 7f618abb9640 1 -- 10.20.193.58:0/867380444 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f618413c100 con 0x7f61840b39f0 2026-02-23T06:40:19.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.904+0000 7f618abb9640 1 -- 10.20.193.58:0/867380444 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6184154dc0 con 0x7f61840b39f0 2026-02-23T06:40:19.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.905+0000 7f618abb9640 1 -- 10.20.193.58:0/867380444 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f618415f790 con 0x7f61840b39f0 2026-02-23T06:40:19.901 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.906+0000 7f61797fa640 1 -- 10.20.193.58:0/867380444 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f616c0045c0 con 0x7f61840b39f0 2026-02-23T06:40:19.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.907+0000 7f61797fa640 1 --2- 10.20.193.58:0/867380444 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f615807a6f0 0x7f615809aba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:19.902 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.907+0000 7f61797fa640 1 -- 10.20.193.58:0/867380444 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f616c09d5f0 con 0x7f61840b39f0 2026-02-23T06:40:19.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.908+0000 7f617bfff640 1 --2- 10.20.193.58:0/867380444 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f615807a6f0 0x7f615809aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:19.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.909+0000 7f61797fa640 1 -- 10.20.193.58:0/867380444 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f616c060770 con 0x7f61840b39f0 2026-02-23T06:40:19.905 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:19.910+0000 7f617bfff640 1 --2- 10.20.193.58:0/867380444 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f615807a6f0 0x7f615809aba0 secure :-1 s=READY pgs=424 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6184163c50 tx=0x7f6174005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:20.064 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:20.070+0000 7f618abb9640 1 -- 10.20.193.58:0/867380444 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f618405e830 con 0x7f61840b39f0 2026-02-23T06:40:20.071 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:20.077+0000 7f61797fa640 1 -- 10.20.193.58:0/867380444 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f616c063920 con 0x7f61840b39f0 2026-02-23T06:40:20.071 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":158,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:40:20.073 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:20.078+0000 7f618abb9640 1 -- 10.20.193.58:0/867380444 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f615807a6f0 msgr2=0x7f615809aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:20.073 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:20.078+0000 7f618abb9640 1 --2- 10.20.193.58:0/867380444 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f615807a6f0 0x7f615809aba0 secure :-1 s=READY pgs=424 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6184163c50 tx=0x7f6174005f90 comp rx=0 tx=0).stop 2026-02-23T06:40:20.073 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:20.078+0000 7f618abb9640 1 -- 10.20.193.58:0/867380444 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f61840b39f0 msgr2=0x7f618413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:20.073 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:20.078+0000 7f618abb9640 1 --2- 10.20.193.58:0/867380444 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f61840b39f0 0x7f618413b5e0 secure :-1 s=READY pgs=33 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f616c006fd0 tx=0x7f616c00bbf0 comp rx=0 tx=0).stop 2026-02-23T06:40:20.073 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:20.078+0000 7f618abb9640 1 -- 10.20.193.58:0/867380444 shutdown_connections 2026-02-23T06:40:20.073 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:20.078+0000 7f618abb9640 1 --2- 10.20.193.58:0/867380444 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f615807a6f0 0x7f615809aba0 unknown :-1 s=CLOSED pgs=424 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:20.074 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:20.078+0000 7f618abb9640 1 --2- 10.20.193.58:0/867380444 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f618415be70 0x7f618413d810 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:20.074 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:20.078+0000 7f618abb9640 1 --2- 10.20.193.58:0/867380444 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f618415baa0 0x7f618413bb20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:20.074 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:20.078+0000 7f618abb9640 1 --2- 10.20.193.58:0/867380444 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f61840b39f0 0x7f618413b5e0 unknown :-1 s=CLOSED pgs=33 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:20.074 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:20.078+0000 7f618abb9640 1 -- 10.20.193.58:0/867380444 >> 10.20.193.58:0/867380444 conn(0x7f6184058e50 msgr2=0x7f6184059220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:20.074 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:20.079+0000 7f618abb9640 1 -- 10.20.193.58:0/867380444 shutdown_connections 2026-02-23T06:40:20.074 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:20.079+0000 7f618abb9640 1 -- 10.20.193.58:0/867380444 wait complete. 2026-02-23T06:40:23.087 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:40:27.613 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.618+0000 7f6fea3d2640 1 -- 10.20.193.58:0/3287257160 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6fc8024270 msgr2=0x7f6fc8044700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:27.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.618+0000 7f6fea3d2640 1 --2- 10.20.193.58:0/3287257160 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6fc8024270 0x7f6fc8044700 secure :-1 s=READY pgs=36 gs=19 cs=0 l=1 c_cookie=4790681935703849548 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fc8024240 tx=0x7f6fd80300e0 comp rx=0 tx=0).stop 2026-02-23T06:40:27.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.618+0000 7f6fe9bd1640 1 -- 10.20.193.58:0/3287257160 reap_dead start 2026-02-23T06:40:27.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.618+0000 7f6fea3d2640 1 -- 10.20.193.58:0/3287257160 shutdown_connections 2026-02-23T06:40:27.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.618+0000 7f6fea3d2640 1 --2- 10.20.193.58:0/3287257160 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6fc8024270 0x7f6fc8044700 unknown :-1 s=CLOSED pgs=36 gs=19 cs=0 l=1 c_cookie=4790681935703849548 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:27.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.618+0000 7f6fea3d2640 1 -- 10.20.193.58:0/3287257160 >> 10.20.193.58:0/3287257160 conn(0x7f6fe40b3c20 msgr2=0x7f6fe40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:27.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.618+0000 7f6fea3d2640 1 -- 10.20.193.58:0/3287257160 shutdown_connections 2026-02-23T06:40:27.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.618+0000 7f6fea3d2640 1 -- 10.20.193.58:0/3287257160 wait complete. 2026-02-23T06:40:27.616 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.619+0000 7f6fea3d2640 1 Processor -- start 2026-02-23T06:40:27.616 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.619+0000 7f6fea3d2640 1 -- start start 2026-02-23T06:40:27.616 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.620+0000 7f6fea3d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6fc8024270 0x7f6fe41551e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:27.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.620+0000 7f6fea3d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6fe4155dc0 0x7f6fe4058660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:27.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.620+0000 7f6fea3d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6fe40afde0 0x7f6fe40b0260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:27.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.620+0000 7f6fea3d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe4153420 con 0x7f6fe4155dc0 2026-02-23T06:40:27.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.620+0000 7f6fea3d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe4155b00 con 0x7f6fc8024270 2026-02-23T06:40:27.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.620+0000 7f6fea3d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f6fe4155720 con 0x7f6fe40afde0 2026-02-23T06:40:27.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.620+0000 7f6fe9bd1640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6fe40afde0 msgr2=0x7f6fe40b0260 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:40:27.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.620+0000 7f6fe9bd1640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6fe40afde0 0x7f6fe40b0260 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:40:27.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.620+0000 7f6fe8bcf640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6fe4155dc0 0x7f6fe4058660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:27.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.620+0000 7f6fe93d0640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6fc8024270 0x7f6fe41551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:27.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.620+0000 7f6fe8bcf640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6fe4155dc0 0x7f6fe4058660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:34204/0 (socket says 10.20.193.58:34204) 2026-02-23T06:40:27.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.620+0000 7f6fe8bcf640 1 -- 10.20.193.58:0/971663407 learned_addr learned my addr 10.20.193.58:0/971663407 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:40:27.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.620+0000 7f6fe8bcf640 1 -- 10.20.193.58:0/971663407 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6fe40afde0 msgr2=0x7f6fe40b0260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:40:27.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.620+0000 7f6fe8bcf640 1 --2- 10.20.193.58:0/971663407 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6fe40afde0 0x7f6fe40b0260 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:27.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.620+0000 7f6fe8bcf640 1 -- 10.20.193.58:0/971663407 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6fc8024270 msgr2=0x7f6fe41551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:27.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.620+0000 7f6fe8bcf640 1 --2- 10.20.193.58:0/971663407 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6fc8024270 0x7f6fe41551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:27.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.620+0000 7f6fe8bcf640 1 -- 10.20.193.58:0/971663407 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe41655c0 con 0x7f6fe4155dc0 2026-02-23T06:40:27.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.620+0000 7f6fe8bcf640 1 --2- 10.20.193.58:0/971663407 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6fe4155dc0 0x7f6fe4058660 secure :-1 s=READY pgs=330 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fd8003930 tx=0x7f6fd8003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:27.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.621+0000 7f6fd1ffb640 1 -- 10.20.193.58:0/971663407 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6fd8004640 con 0x7f6fe4155dc0 2026-02-23T06:40:27.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.621+0000 7f6fd1ffb640 1 -- 10.20.193.58:0/971663407 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6fd8006be0 con 0x7f6fe4155dc0 2026-02-23T06:40:27.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.621+0000 7f6fea3d2640 1 -- 10.20.193.58:0/971663407 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fe4152680 con 0x7f6fe4155dc0 2026-02-23T06:40:27.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.621+0000 7f6fd1ffb640 1 -- 10.20.193.58:0/971663407 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6fd80446b0 con 0x7f6fe4155dc0 2026-02-23T06:40:27.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.621+0000 7f6fea3d2640 1 -- 10.20.193.58:0/971663407 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fe41546c0 con 0x7f6fe4155dc0 2026-02-23T06:40:27.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.622+0000 7f6fb37fe640 1 -- 10.20.193.58:0/971663407 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fa0005300 con 0x7f6fe4155dc0 2026-02-23T06:40:27.620 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.623+0000 7f6fd1ffb640 1 -- 10.20.193.58:0/971663407 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f6fd8038030 con 0x7f6fe4155dc0 2026-02-23T06:40:27.620 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.623+0000 7f6fd1ffb640 1 --2- 10.20.193.58:0/971663407 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6fb407a5b0 0x7f6fb409aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:27.620 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.623+0000 7f6fd1ffb640 1 -- 10.20.193.58:0/971663407 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f6fd80c3870 con 0x7f6fe4155dc0 2026-02-23T06:40:27.620 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.624+0000 7f6fe93d0640 1 --2- 10.20.193.58:0/971663407 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6fb407a5b0 0x7f6fb409aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:27.620 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.625+0000 7f6fe93d0640 1 --2- 10.20.193.58:0/971663407 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6fb407a5b0 0x7f6fb409aa60 secure :-1 s=READY pgs=425 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fe4163df0 tx=0x7f6fd4002e60 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:27.620 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.626+0000 7f6fd1ffb640 1 -- 10.20.193.58:0/971663407 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f6fd8086aa0 con 0x7f6fe4155dc0 2026-02-23T06:40:27.778 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.783+0000 7f6fb37fe640 1 -- 10.20.193.58:0/971663407 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6fa0005b30 con 0x7f6fe4155dc0 2026-02-23T06:40:27.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.783+0000 7f6fd1ffb640 1 -- 10.20.193.58:0/971663407 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1749 (secure 0 0 0) 0x7f6fd8089bc0 con 0x7f6fe4155dc0 2026-02-23T06:40:27.780 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":162,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:40:27.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.788+0000 7f6fb37fe640 1 -- 10.20.193.58:0/971663407 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6fb407a5b0 msgr2=0x7f6fb409aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:27.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.788+0000 7f6fb37fe640 1 --2- 10.20.193.58:0/971663407 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6fb407a5b0 0x7f6fb409aa60 secure :-1 s=READY pgs=425 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fe4163df0 tx=0x7f6fd4002e60 comp rx=0 tx=0).stop 2026-02-23T06:40:27.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.788+0000 7f6fb37fe640 1 -- 10.20.193.58:0/971663407 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6fe4155dc0 msgr2=0x7f6fe4058660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:27.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.788+0000 7f6fb37fe640 1 --2- 10.20.193.58:0/971663407 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6fe4155dc0 0x7f6fe4058660 secure :-1 s=READY pgs=330 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fd8003930 tx=0x7f6fd8003960 comp rx=0 tx=0).stop 2026-02-23T06:40:27.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.788+0000 7f6fb37fe640 1 -- 10.20.193.58:0/971663407 shutdown_connections 2026-02-23T06:40:27.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.788+0000 7f6fb37fe640 1 --2- 10.20.193.58:0/971663407 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6fb407a5b0 0x7f6fb409aa60 unknown :-1 s=CLOSED pgs=425 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:27.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.788+0000 7f6fb37fe640 1 --2- 10.20.193.58:0/971663407 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6fe40afde0 0x7f6fe40b0260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:27.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.788+0000 7f6fb37fe640 1 --2- 10.20.193.58:0/971663407 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6fe4155dc0 0x7f6fe4058660 unknown :-1 s=CLOSED pgs=330 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:27.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.788+0000 7f6fb37fe640 1 --2- 10.20.193.58:0/971663407 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6fc8024270 0x7f6fe41551e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:27.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.788+0000 7f6fb37fe640 1 -- 10.20.193.58:0/971663407 >> 10.20.193.58:0/971663407 conn(0x7f6fe40b3c20 msgr2=0x7f6fe40b6240 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:27.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.788+0000 7f6fb37fe640 1 -- 10.20.193.58:0/971663407 shutdown_connections 2026-02-23T06:40:27.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.789+0000 7f6fb37fe640 1 -- 10.20.193.58:0/971663407 wait complete. 2026-02-23T06:40:27.797 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:40:27.798 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-23T06:40:27.798 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:40:27.919 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.924+0000 7faa41043640 1 -- 10.20.193.58:0/4050138359 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa3c15d4a0 msgr2=0x7faa3c0affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:27.920 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.924+0000 7faa41043640 1 --2- 10.20.193.58:0/4050138359 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa3c15d4a0 0x7faa3c0affb0 secure :-1 s=READY pgs=331 gs=1 cs=0 l=1 c_cookie=18281562294550777726 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa3c160f40 tx=0x7faa2802f1b0 comp rx=0 tx=0).stop 2026-02-23T06:40:27.920 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.925+0000 7faa41043640 1 -- 10.20.193.58:0/4050138359 shutdown_connections 2026-02-23T06:40:27.920 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.925+0000 7faa41043640 1 --2- 10.20.193.58:0/4050138359 >> v2:10.20.193.93:3300/0 conn(0x7faa3c0b6690 0x7faa3c058cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:27.920 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.925+0000 7faa41043640 1 --2- 10.20.193.58:0/4050138359 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa3c15d870 0x7faa3c0587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:27.920 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.925+0000 7faa41043640 1 --2- 10.20.193.58:0/4050138359 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa3c15d4a0 0x7faa3c0affb0 unknown :-1 s=CLOSED pgs=331 gs=1 cs=0 l=1 c_cookie=18281562294550777726 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:27.920 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.925+0000 7faa41043640 1 -- 10.20.193.58:0/4050138359 >> 10.20.193.58:0/4050138359 conn(0x7faa3c0b3c20 msgr2=0x7faa3c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:27.920 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.925+0000 7faa41043640 1 -- 10.20.193.58:0/4050138359 shutdown_connections 2026-02-23T06:40:27.920 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.925+0000 7faa41043640 1 -- 10.20.193.58:0/4050138359 wait complete. 2026-02-23T06:40:27.921 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.926+0000 7faa41043640 1 Processor -- start 2026-02-23T06:40:27.921 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.926+0000 7faa41043640 1 -- start start 2026-02-23T06:40:27.921 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.926+0000 7faa41043640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa3c0b6690 0x7faa3c13aff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:27.921 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.927+0000 7faa41043640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa3c15d4a0 0x7faa3c14b530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:27.921 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.927+0000 7faa41043640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa3c15d870 0x7faa3c15fec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:27.921 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.927+0000 7faa41043640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c14d790 con 0x7faa3c15d4a0 2026-02-23T06:40:27.921 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.927+0000 7faa41043640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c15ed70 con 0x7faa3c0b6690 2026-02-23T06:40:27.921 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.927+0000 7faa41043640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7faa3c15f050 con 0x7faa3c15d870 2026-02-23T06:40:27.922 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.927+0000 7faa3bfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa3c0b6690 0x7faa3c13aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:27.922 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.927+0000 7faa3bfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa3c0b6690 0x7faa3c13aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:51632/0 (socket says 10.20.193.58:51632) 2026-02-23T06:40:27.922 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.927+0000 7faa3bfff640 1 -- 10.20.193.58:0/2904639829 learned_addr learned my addr 10.20.193.58:0/2904639829 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:40:27.922 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.927+0000 7faa3b7fe640 1 --2- 10.20.193.58:0/2904639829 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa3c15d4a0 0x7faa3c14b530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:27.922 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.927+0000 7faa40842640 1 -- 10.20.193.58:0/2904639829 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa3c15d870 msgr2=0x7faa3c15fec0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:40:27.922 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.927+0000 7faa40842640 1 --2- 10.20.193.58:0/2904639829 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa3c15d870 0x7faa3c15fec0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:40:27.922 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.927+0000 7faa3bfff640 1 -- 10.20.193.58:0/2904639829 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa3c15d870 msgr2=0x7faa3c15fec0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:40:27.922 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.927+0000 7faa3bfff640 1 --2- 10.20.193.58:0/2904639829 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa3c15d870 0x7faa3c15fec0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:27.922 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.927+0000 7faa3bfff640 1 -- 10.20.193.58:0/2904639829 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa3c15d4a0 msgr2=0x7faa3c14b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:27.922 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.927+0000 7faa3bfff640 1 --2- 10.20.193.58:0/2904639829 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa3c15d4a0 0x7faa3c14b530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:27.922 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.927+0000 7faa3bfff640 1 -- 10.20.193.58:0/2904639829 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa3000a650 con 0x7faa3c0b6690 2026-02-23T06:40:27.922 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.928+0000 7faa3bfff640 1 --2- 10.20.193.58:0/2904639829 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa3c0b6690 0x7faa3c13aff0 secure :-1 s=READY pgs=37 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa280023d0 tx=0x7faa280028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:27.922 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.928+0000 7faa38ff9640 1 -- 10.20.193.58:0/2904639829 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa2803d070 con 0x7faa3c0b6690 2026-02-23T06:40:27.922 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.928+0000 7faa41043640 1 -- 10.20.193.58:0/2904639829 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa280094b0 con 0x7faa3c0b6690 2026-02-23T06:40:27.922 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.928+0000 7faa38ff9640 1 -- 10.20.193.58:0/2904639829 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa28002e70 con 0x7faa3c0b6690 2026-02-23T06:40:27.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.928+0000 7faa38ff9640 1 -- 10.20.193.58:0/2904639829 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa28004a90 con 0x7faa3c0b6690 2026-02-23T06:40:27.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.928+0000 7faa41043640 1 -- 10.20.193.58:0/2904639829 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa3c15f610 con 0x7faa3c0b6690 2026-02-23T06:40:27.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.928+0000 7faa167fc640 1 --2- 10.20.193.58:0/2904639829 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa000041f0 0x7faa000246a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:27.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.928+0000 7faa167fc640 1 -- 10.20.193.58:0/2904639829 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7faa00025f20 con 0x7faa000041f0 2026-02-23T06:40:27.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.929+0000 7faa3b7fe640 1 --2- 10.20.193.58:0/2904639829 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa000041f0 0x7faa000246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:27.923 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.929+0000 7faa3b7fe640 1 -- 10.20.193.58:0/2904639829 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faa000260e0 con 0x7faa000041f0 2026-02-23T06:40:27.924 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.929+0000 7faa3b7fe640 1 --2- 10.20.193.58:0/2904639829 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa000041f0 0x7faa000246a0 secure :-1 s=READY pgs=332 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa3c0b1b20 tx=0x7faa2c009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:27.924 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.929+0000 7faa38ff9640 1 -- 10.20.193.58:0/2904639829 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa2c00e8d0 con 0x7faa000041f0 2026-02-23T06:40:27.924 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.929+0000 7faa38ff9640 1 -- 10.20.193.58:0/2904639829 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7faa2c00ea30 con 0x7faa000041f0 2026-02-23T06:40:27.924 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.929+0000 7faa38ff9640 1 -- 10.20.193.58:0/2904639829 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa000041f0 msgr2=0x7faa000246a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:27.924 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.929+0000 7faa38ff9640 1 --2- 10.20.193.58:0/2904639829 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa000041f0 0x7faa000246a0 secure :-1 s=READY pgs=332 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa3c0b1b20 tx=0x7faa2c009a20 comp rx=0 tx=0).stop 2026-02-23T06:40:27.924 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.929+0000 7faa38ff9640 1 -- 10.20.193.58:0/2904639829 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa000041f0 msgr2=0x7faa000246a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:40:27.924 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.929+0000 7faa38ff9640 1 --2- 10.20.193.58:0/2904639829 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa000041f0 0x7faa000246a0 secure :-1 s=CLOSED pgs=332 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa3c0b1b20 tx=0x7faa2c009a20 comp rx=0 tx=0).stop 2026-02-23T06:40:27.924 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.930+0000 7faa38ff9640 1 -- 10.20.193.58:0/2904639829 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7faa28038470 con 0x7faa3c0b6690 2026-02-23T06:40:27.925 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.931+0000 7faa38ff9640 1 --2- 10.20.193.58:0/2904639829 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa0c07a430 0x7faa0c09a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:27.925 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.931+0000 7faa38ff9640 1 -- 10.20.193.58:0/2904639829 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7faa280c20a0 con 0x7faa3c0b6690 2026-02-23T06:40:27.925 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.931+0000 7faa3b7fe640 1 --2- 10.20.193.58:0/2904639829 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa0c07a430 0x7faa0c09a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:27.926 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.931+0000 7faa3b7fe640 1 --2- 10.20.193.58:0/2904639829 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa0c07a430 0x7faa0c09a8e0 secure :-1 s=READY pgs=426 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa3c0b1b20 tx=0x7faa2c008030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:27.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.933+0000 7faa167fc640 1 --2- 10.20.193.58:0/2904639829 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa00024fb0 0x7faa00025430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:27.927 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.933+0000 7faa167fc640 1 -- 10.20.193.58:0/2904639829 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7faa00025a90 con 0x7faa00024fb0 2026-02-23T06:40:27.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.933+0000 7faa40842640 1 --2- 10.20.193.58:0/2904639829 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa00024fb0 0x7faa00025430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:27.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.933+0000 7faa40842640 1 -- 10.20.193.58:0/2904639829 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faa00025c50 con 0x7faa00024fb0 2026-02-23T06:40:27.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.934+0000 7faa40842640 1 --2- 10.20.193.58:0/2904639829 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa00024fb0 0x7faa00025430 secure :-1 s=READY pgs=333 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa30006f50 tx=0x7faa30003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:27.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.934+0000 7faa38ff9640 1 -- 10.20.193.58:0/2904639829 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa3000fd20 con 0x7faa00024fb0 2026-02-23T06:40:27.928 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.934+0000 7faa38ff9640 1 -- 10.20.193.58:0/2904639829 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5547 (secure 0 0 0) 0x7faa3000fe80 con 0x7faa00024fb0 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.934+0000 7faa38ff9640 1 -- 10.20.193.58:0/2904639829 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa00024fb0 msgr2=0x7faa00025430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.934+0000 7faa38ff9640 1 --2- 10.20.193.58:0/2904639829 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa00024fb0 0x7faa00025430 secure :-1 s=READY pgs=333 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa30006f50 tx=0x7faa30003c20 comp rx=0 tx=0).stop 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.934+0000 7faa38ff9640 1 -- 10.20.193.58:0/2904639829 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa00024fb0 msgr2=0x7faa00025430 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 162, 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 435445, 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: 1 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:40:27.929 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:27.930 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:40:27.931 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:27.932 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:40:27.933 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:40:27.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.934+0000 7faa38ff9640 1 --2- 10.20.193.58:0/2904639829 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa00024fb0 0x7faa00025430 unknown :-1 s=CLOSED pgs=333 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:27.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.934+0000 7faa167fc640 1 -- 10.20.193.58:0/2904639829 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa0c07a430 msgr2=0x7faa0c09a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:27.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.934+0000 7faa167fc640 1 --2- 10.20.193.58:0/2904639829 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa0c07a430 0x7faa0c09a8e0 secure :-1 s=READY pgs=426 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa3c0b1b20 tx=0x7faa2c008030 comp rx=0 tx=0).stop 2026-02-23T06:40:27.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.934+0000 7faa167fc640 1 -- 10.20.193.58:0/2904639829 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa3c0b6690 msgr2=0x7faa3c13aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:27.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.934+0000 7faa167fc640 1 --2- 10.20.193.58:0/2904639829 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa3c0b6690 0x7faa3c13aff0 secure :-1 s=READY pgs=37 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa280023d0 tx=0x7faa280028d0 comp rx=0 tx=0).stop 2026-02-23T06:40:27.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.934+0000 7faa40842640 1 -- 10.20.193.58:0/2904639829 reap_dead start 2026-02-23T06:40:27.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.934+0000 7faa167fc640 1 -- 10.20.193.58:0/2904639829 shutdown_connections 2026-02-23T06:40:27.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.934+0000 7faa167fc640 1 --2- 10.20.193.58:0/2904639829 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa3c0b6690 0x7faa3c13aff0 unknown :-1 s=CLOSED pgs=37 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:27.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.934+0000 7faa167fc640 1 -- 10.20.193.58:0/2904639829 >> 10.20.193.58:0/2904639829 conn(0x7faa3c0b3c20 msgr2=0x7faa3c15b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:27.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.934+0000 7faa167fc640 1 -- 10.20.193.58:0/2904639829 shutdown_connections 2026-02-23T06:40:27.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:27.934+0000 7faa167fc640 1 -- 10.20.193.58:0/2904639829 wait complete. 2026-02-23T06:40:27.935 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:40:27.935 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-23T06:40:27.935 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:40:28.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.060+0000 7f9cf49be640 1 -- 10.20.193.58:0/3494303895 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9cf015c040 msgr2=0x7f9cf005b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:28.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.060+0000 7f9cf49be640 1 --2- 10.20.193.58:0/3494303895 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9cf015c040 0x7f9cf005b0e0 secure :-1 s=READY pgs=336 gs=2 cs=0 l=1 c_cookie=12528688013370350683 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cf0059aa0 tx=0x7f9cdc02f190 comp rx=0 tx=0).stop 2026-02-23T06:40:28.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.060+0000 7f9cf49be640 1 -- 10.20.193.58:0/3494303895 shutdown_connections 2026-02-23T06:40:28.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.060+0000 7f9cf49be640 1 --2- 10.20.193.58:0/3494303895 >> v2:10.20.193.93:3300/0 conn(0x7f9cf0056550 0x7f9cf005ce30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:28.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.060+0000 7f9cf49be640 1 --2- 10.20.193.58:0/3494303895 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9cf015c040 0x7f9cf005b0e0 unknown :-1 s=CLOSED pgs=336 gs=2 cs=0 l=1 c_cookie=12528688013370350683 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:28.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.060+0000 7f9cf49be640 1 -- 10.20.193.58:0/3494303895 >> 10.20.193.58:0/3494303895 conn(0x7f9cf00b3c20 msgr2=0x7f9cf00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:28.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.060+0000 7f9cf49be640 1 -- 10.20.193.58:0/3494303895 shutdown_connections 2026-02-23T06:40:28.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.060+0000 7f9cf49be640 1 -- 10.20.193.58:0/3494303895 wait complete. 2026-02-23T06:40:28.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.062+0000 7f9cf49be640 1 Processor -- start 2026-02-23T06:40:28.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.062+0000 7f9cf49be640 1 -- start start 2026-02-23T06:40:28.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.062+0000 7f9cf49be640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9cf0056550 0x7f9cf00a9870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:28.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.062+0000 7f9cf49be640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9cf005d370 0x7f9cf00b14b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:28.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.062+0000 7f9cf49be640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9cf015c040 0x7f9cf0058430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:28.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.062+0000 7f9cf49be640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf0200e40 con 0x7f9cf0056550 2026-02-23T06:40:28.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.062+0000 7f9cf49be640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf01fe6f0 con 0x7f9cf015c040 2026-02-23T06:40:28.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.062+0000 7f9cf49be640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f9cf01625c0 con 0x7f9cf005d370 2026-02-23T06:40:28.058 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.062+0000 7f9ceeffd640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9cf005d370 msgr2=0x7f9cf00b14b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:40:28.058 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.062+0000 7f9ceeffd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9cf005d370 0x7f9cf00b14b0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:40:28.058 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.062+0000 7f9cef7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9cf0056550 0x7f9cf00a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:28.058 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.062+0000 7f9cef7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9cf0056550 0x7f9cf00a9870 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:34262/0 (socket says 10.20.193.58:34262) 2026-02-23T06:40:28.058 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.062+0000 7f9cef7fe640 1 -- 10.20.193.58:0/1826134301 learned_addr learned my addr 10.20.193.58:0/1826134301 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:40:28.058 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.063+0000 7f9ceffff640 1 --2- 10.20.193.58:0/1826134301 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9cf015c040 0x7f9cf0058430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:28.058 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.063+0000 7f9cef7fe640 1 -- 10.20.193.58:0/1826134301 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9cf005d370 msgr2=0x7f9cf00b14b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:40:28.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.063+0000 7f9cef7fe640 1 --2- 10.20.193.58:0/1826134301 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9cf005d370 0x7f9cf00b14b0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:28.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.063+0000 7f9cef7fe640 1 -- 10.20.193.58:0/1826134301 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9cf015c040 msgr2=0x7f9cf0058430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:28.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.063+0000 7f9cef7fe640 1 --2- 10.20.193.58:0/1826134301 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9cf015c040 0x7f9cf0058430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:28.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.063+0000 7f9cef7fe640 1 -- 10.20.193.58:0/1826134301 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cdc0094b0 con 0x7f9cf0056550 2026-02-23T06:40:28.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.063+0000 7f9cef7fe640 1 --2- 10.20.193.58:0/1826134301 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9cf0056550 0x7f9cf00a9870 secure :-1 s=READY pgs=337 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cdc0023d0 tx=0x7f9cdc002950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:28.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.063+0000 7f9ccbfff640 1 -- 10.20.193.58:0/1826134301 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9cdc038470 con 0x7f9cf0056550 2026-02-23T06:40:28.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.063+0000 7f9ccbfff640 1 -- 10.20.193.58:0/1826134301 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9cdc0386c0 con 0x7f9cf0056550 2026-02-23T06:40:28.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.063+0000 7f9ccbfff640 1 -- 10.20.193.58:0/1826134301 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9cdc038ab0 con 0x7f9cf0056550 2026-02-23T06:40:28.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.063+0000 7f9cf49be640 1 -- 10.20.193.58:0/1826134301 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cf01628a0 con 0x7f9cf0056550 2026-02-23T06:40:28.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.063+0000 7f9cf49be640 1 -- 10.20.193.58:0/1826134301 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cf0162e60 con 0x7f9cf0056550 2026-02-23T06:40:28.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.064+0000 7f9cf49be640 1 --2- 10.20.193.58:0/1826134301 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9cf00b19f0 0x7f9cf0058970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:28.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.064+0000 7f9cf49be640 1 -- 10.20.193.58:0/1826134301 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf005b620 con 0x7f9cf00b19f0 2026-02-23T06:40:28.059 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.064+0000 7f9ceeffd640 1 --2- 10.20.193.58:0/1826134301 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9cf00b19f0 0x7f9cf0058970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:28.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.064+0000 7f9ceeffd640 1 -- 10.20.193.58:0/1826134301 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9cf005d9c0 con 0x7f9cf00b19f0 2026-02-23T06:40:28.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.064+0000 7f9ceeffd640 1 --2- 10.20.193.58:0/1826134301 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9cf00b19f0 0x7f9cf0058970 secure :-1 s=READY pgs=38 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cf0163160 tx=0x7f9ce000ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:28.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.065+0000 7f9ccbfff640 1 -- 10.20.193.58:0/1826134301 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ce000cd20 con 0x7f9cf00b19f0 2026-02-23T06:40:28.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.065+0000 7f9ccbfff640 1 -- 10.20.193.58:0/1826134301 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f9ce000ce80 con 0x7f9cf00b19f0 2026-02-23T06:40:28.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.065+0000 7f9ccbfff640 1 -- 10.20.193.58:0/1826134301 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9cf00b19f0 msgr2=0x7f9cf0058970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:28.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.065+0000 7f9ccbfff640 1 --2- 10.20.193.58:0/1826134301 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9cf00b19f0 0x7f9cf0058970 secure :-1 s=READY pgs=38 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cf0163160 tx=0x7f9ce000ed90 comp rx=0 tx=0).stop 2026-02-23T06:40:28.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.065+0000 7f9ccbfff640 1 -- 10.20.193.58:0/1826134301 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9cf00b19f0 msgr2=0x7f9cf0058970 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:40:28.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.065+0000 7f9ccbfff640 1 --2- 10.20.193.58:0/1826134301 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9cf00b19f0 0x7f9cf0058970 secure :-1 s=CLOSED pgs=38 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cf0163160 tx=0x7f9ce000ed90 comp rx=0 tx=0).stop 2026-02-23T06:40:28.060 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.065+0000 7f9ccbfff640 1 -- 10.20.193.58:0/1826134301 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f9cdc038c10 con 0x7f9cf0056550 2026-02-23T06:40:28.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.066+0000 7f9ccbfff640 1 --2- 10.20.193.58:0/1826134301 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9cc007a430 0x7f9cc009a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:28.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.066+0000 7f9ccbfff640 1 -- 10.20.193.58:0/1826134301 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f9cdc0c2b10 con 0x7f9cf0056550 2026-02-23T06:40:28.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.066+0000 7f9ceeffd640 1 --2- 10.20.193.58:0/1826134301 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9cc007a430 0x7f9cc009a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:28.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.067+0000 7f9ceeffd640 1 --2- 10.20.193.58:0/1826134301 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9cc007a430 0x7f9cc009a8e0 secure :-1 s=READY pgs=427 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ce000edd0 tx=0x7f9ce0014000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:28.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.069+0000 7f9cf49be640 1 --2- 10.20.193.58:0/1826134301 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9cf015c410 0x7f9cf0201320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:28.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.069+0000 7f9cf49be640 1 -- 10.20.193.58:0/1826134301 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf015c7e0 con 0x7f9cf015c410 2026-02-23T06:40:28.064 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.069+0000 7f9ceffff640 1 --2- 10.20.193.58:0/1826134301 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9cf015c410 0x7f9cf0201320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:28.064 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.069+0000 7f9ceffff640 1 -- 10.20.193.58:0/1826134301 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9cf005ce30 con 0x7f9cf015c410 2026-02-23T06:40:28.064 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.070+0000 7f9ceffff640 1 --2- 10.20.193.58:0/1826134301 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9cf015c410 0x7f9cf0201320 secure :-1 s=READY pgs=39 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ce4003890 tx=0x7f9ce400fba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:28.064 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.070+0000 7f9ccbfff640 1 -- 10.20.193.58:0/1826134301 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ce4018070 con 0x7f9cf015c410 2026-02-23T06:40:28.065 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.070+0000 7f9ccbfff640 1 -- 10.20.193.58:0/1826134301 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5401 (secure 0 0 0) 0x7f9ce4003d70 con 0x7f9cf015c410 2026-02-23T06:40:28.065 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:40:28.065 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:40:28.065 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:40:28.065 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:40:28.065 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 162, 2026-02-23T06:40:28.065 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 32160, 2026-02-23T06:40:28.065 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:40:28.065 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:40:28.065 INFO:teuthology.orchestra.run.trial058.stdout: 1 2026-02-23T06:40:28.065 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:28.065 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:40:28.065 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:40:28.065 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:40:28.065 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:40:28.065 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:28.065 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:28.065 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:28.065 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:28.065 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:28.065 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:28.065 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:28.065 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:28.065 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:28.065 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:28.065 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:28.065 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:28.066 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:28.067 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:28.068 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:40:28.069 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:40:28.070 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.070+0000 7f9ccbfff640 1 -- 10.20.193.58:0/1826134301 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9cf015c410 msgr2=0x7f9cf0201320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:28.070 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.070+0000 7f9ccbfff640 1 --2- 10.20.193.58:0/1826134301 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9cf015c410 0x7f9cf0201320 secure :-1 s=READY pgs=39 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ce4003890 tx=0x7f9ce400fba0 comp rx=0 tx=0).stop 2026-02-23T06:40:28.070 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.070+0000 7f9ccbfff640 1 -- 10.20.193.58:0/1826134301 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9cf015c410 msgr2=0x7f9cf0201320 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:40:28.070 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.070+0000 7f9ccbfff640 1 --2- 10.20.193.58:0/1826134301 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9cf015c410 0x7f9cf0201320 secure :-1 s=CLOSED pgs=39 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ce4003890 tx=0x7f9ce400fba0 comp rx=0 tx=0).stop 2026-02-23T06:40:28.070 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.070+0000 7f9cf49be640 1 -- 10.20.193.58:0/1826134301 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9cc007a430 msgr2=0x7f9cc009a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:28.070 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.070+0000 7f9cf49be640 1 --2- 10.20.193.58:0/1826134301 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9cc007a430 0x7f9cc009a8e0 secure :-1 s=READY pgs=427 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ce000edd0 tx=0x7f9ce0014000 comp rx=0 tx=0).stop 2026-02-23T06:40:28.070 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.070+0000 7f9cf49be640 1 -- 10.20.193.58:0/1826134301 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9cf0056550 msgr2=0x7f9cf00a9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:28.070 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.070+0000 7f9cf49be640 1 --2- 10.20.193.58:0/1826134301 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9cf0056550 0x7f9cf00a9870 secure :-1 s=READY pgs=337 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cdc0023d0 tx=0x7f9cdc002950 comp rx=0 tx=0).stop 2026-02-23T06:40:28.070 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.070+0000 7f9ceffff640 1 -- 10.20.193.58:0/1826134301 reap_dead start 2026-02-23T06:40:28.070 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.070+0000 7f9ceffff640 1 -- 10.20.193.58:0/1826134301 reap_dead start 2026-02-23T06:40:28.070 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.070+0000 7f9cf49be640 1 -- 10.20.193.58:0/1826134301 shutdown_connections 2026-02-23T06:40:28.070 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.070+0000 7f9cf49be640 1 -- 10.20.193.58:0/1826134301 >> 10.20.193.58:0/1826134301 conn(0x7f9cf00b3c20 msgr2=0x7f9cf00b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:28.070 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.071+0000 7f9cf49be640 1 -- 10.20.193.58:0/1826134301 shutdown_connections 2026-02-23T06:40:28.070 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:28.071+0000 7f9cf49be640 1 -- 10.20.193.58:0/1826134301 wait complete. 2026-02-23T06:40:28.072 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:40:28.072 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:40:44.367 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:40:44.371 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:40:48.073 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-23T06:40:48.073 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-23T06:40:48.073 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-23T06:40:48.073 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-23T06:40:48.075 INFO:tasks.ceph.mon.c:Started 2026-02-23T06:40:48.075 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:40:48.075 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:40:48.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.205+0000 7f7e71803640 1 -- 10.20.193.58:0/3430371382 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7e6c15d4a0 msgr2=0x7f7e6c0affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:48.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.205+0000 7f7e71803640 1 --2- 10.20.193.58:0/3430371382 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7e6c15d4a0 0x7f7e6c0affb0 secure :-1 s=READY pgs=341 gs=2 cs=0 l=1 c_cookie=6166249239731771363 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e6c0afed0 tx=0x7f7e5c02f260 comp rx=0 tx=0).stop 2026-02-23T06:40:48.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.205+0000 7f7e71803640 1 -- 10.20.193.58:0/3430371382 shutdown_connections 2026-02-23T06:40:48.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.205+0000 7f7e71803640 1 --2- 10.20.193.58:0/3430371382 >> v2:10.20.193.93:3300/0 conn(0x7f7e6c0b6690 0x7f7e6c058ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:48.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.205+0000 7f7e71803640 1 --2- 10.20.193.58:0/3430371382 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7e6c15d4a0 0x7f7e6c0affb0 unknown :-1 s=CLOSED pgs=341 gs=2 cs=0 l=1 c_cookie=6166249239731771363 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:48.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.205+0000 7f7e71803640 1 -- 10.20.193.58:0/3430371382 >> 10.20.193.58:0/3430371382 conn(0x7f7e6c0b3c20 msgr2=0x7f7e6c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:48.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.205+0000 7f7e71803640 1 -- 10.20.193.58:0/3430371382 shutdown_connections 2026-02-23T06:40:48.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.205+0000 7f7e71803640 1 -- 10.20.193.58:0/3430371382 wait complete. 2026-02-23T06:40:48.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.207+0000 7f7e71803640 1 Processor -- start 2026-02-23T06:40:48.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.207+0000 7f7e71803640 1 -- start start 2026-02-23T06:40:48.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.207+0000 7f7e71803640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7e6c0b6690 0x7f7e6c143e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:48.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.207+0000 7f7e71803640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e6c15d4a0 0x7f7e6c1614b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:48.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.207+0000 7f7e71803640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7e6c15d870 0x7f7e6c1619f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:48.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.207+0000 7f7e71803640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6c11ddc0 con 0x7f7e6c0b6690 2026-02-23T06:40:48.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.207+0000 7f7e71803640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6c11d840 con 0x7f7e6c15d870 2026-02-23T06:40:48.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.207+0000 7f7e71803640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f7e6c057ba0 con 0x7f7e6c15d4a0 2026-02-23T06:40:48.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.207+0000 7f7e71002640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7e6c15d870 0x7f7e6c1619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:48.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.207+0000 7f7e70801640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7e6c0b6690 0x7f7e6c143e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:48.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.207+0000 7f7e63fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e6c15d4a0 0x7f7e6c1614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:48.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.207+0000 7f7e70801640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7e6c0b6690 0x7f7e6c143e90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:59696/0 (socket says 10.20.193.58:59696) 2026-02-23T06:40:48.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.207+0000 7f7e70801640 1 -- 10.20.193.58:0/2695191300 learned_addr learned my addr 10.20.193.58:0/2695191300 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:40:48.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.208+0000 7f7e63fff640 1 -- 10.20.193.58:0/2695191300 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e6c15d4a0 msgr2=0x7f7e6c1614b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-23T06:40:48.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.208+0000 7f7e63fff640 1 -- 10.20.193.58:0/2695191300 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e6c15d4a0 msgr2=0x7f7e6c1614b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:40:48.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.208+0000 7f7e63fff640 1 --2- 10.20.193.58:0/2695191300 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e6c15d4a0 0x7f7e6c1614b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:40:48.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.208+0000 7f7e70801640 1 -- 10.20.193.58:0/2695191300 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e6c15d4a0 msgr2=0x7f7e6c1614b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:48.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.208+0000 7f7e63fff640 1 --2- 10.20.193.58:0/2695191300 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e6c15d4a0 0x7f7e6c1614b0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:40:48.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.208+0000 7f7e70801640 1 --2- 10.20.193.58:0/2695191300 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e6c15d4a0 0x7f7e6c1614b0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:48.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.208+0000 7f7e70801640 1 -- 10.20.193.58:0/2695191300 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7e6c15d870 msgr2=0x7f7e6c1619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:48.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.208+0000 7f7e70801640 1 --2- 10.20.193.58:0/2695191300 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7e6c15d870 0x7f7e6c1619f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:48.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.208+0000 7f7e70801640 1 -- 10.20.193.58:0/2695191300 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e5c009570 con 0x7f7e6c0b6690 2026-02-23T06:40:48.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.208+0000 7f7e70801640 1 --2- 10.20.193.58:0/2695191300 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7e6c0b6690 0x7f7e6c143e90 secure :-1 s=READY pgs=342 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e5c004740 tx=0x7f7e5c0028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:48.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.208+0000 7f7e617fa640 1 -- 10.20.193.58:0/2695191300 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7e5c03d070 con 0x7f7e6c0b6690 2026-02-23T06:40:48.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.208+0000 7f7e617fa640 1 -- 10.20.193.58:0/2695191300 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e5c038470 con 0x7f7e6c0b6690 2026-02-23T06:40:48.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.208+0000 7f7e617fa640 1 -- 10.20.193.58:0/2695191300 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7e5c038880 con 0x7f7e6c0b6690 2026-02-23T06:40:48.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.208+0000 7f7e71803640 1 -- 10.20.193.58:0/2695191300 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e6c11dae0 con 0x7f7e6c0b6690 2026-02-23T06:40:48.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.208+0000 7f7e71803640 1 -- 10.20.193.58:0/2695191300 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e6c160f90 con 0x7f7e6c0b6690 2026-02-23T06:40:48.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.209+0000 7f7e71803640 1 -- 10.20.193.58:0/2695191300 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e6c0b6d50 con 0x7f7e6c0b6690 2026-02-23T06:40:48.205 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.210+0000 7f7e617fa640 1 -- 10.20.193.58:0/2695191300 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f7e5c066b20 con 0x7f7e6c0b6690 2026-02-23T06:40:48.206 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.211+0000 7f7e617fa640 1 --2- 10.20.193.58:0/2695191300 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7e3c07a6c0 0x7f7e3c09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:48.206 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.211+0000 7f7e617fa640 1 -- 10.20.193.58:0/2695191300 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f7e5c0c2290 con 0x7f7e6c0b6690 2026-02-23T06:40:48.206 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.211+0000 7f7e63fff640 1 --2- 10.20.193.58:0/2695191300 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7e3c07a6c0 0x7f7e3c09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:48.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.212+0000 7f7e63fff640 1 --2- 10.20.193.58:0/2695191300 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7e3c07a6c0 0x7f7e3c09ab70 secure :-1 s=READY pgs=429 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e6c057990 tx=0x7f7e54009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:48.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.212+0000 7f7e617fa640 1 -- 10.20.193.58:0/2695191300 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f7e5c085560 con 0x7f7e6c0b6690 2026-02-23T06:40:48.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.368+0000 7f7e71803640 1 -- 10.20.193.58:0/2695191300 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7e6c057a00 con 0x7f7e6c0b6690 2026-02-23T06:40:48.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.368+0000 7f7e617fa640 1 -- 10.20.193.58:0/2695191300 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f7e6c057a00 con 0x7f7e6c0b6690 2026-02-23T06:40:48.364 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":166,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:40:48.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.371+0000 7f7e71803640 1 -- 10.20.193.58:0/2695191300 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7e3c07a6c0 msgr2=0x7f7e3c09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:48.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.371+0000 7f7e71803640 1 --2- 10.20.193.58:0/2695191300 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7e3c07a6c0 0x7f7e3c09ab70 secure :-1 s=READY pgs=429 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e6c057990 tx=0x7f7e54009040 comp rx=0 tx=0).stop 2026-02-23T06:40:48.366 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.371+0000 7f7e71803640 1 -- 10.20.193.58:0/2695191300 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7e6c0b6690 msgr2=0x7f7e6c143e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:48.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.371+0000 7f7e71803640 1 --2- 10.20.193.58:0/2695191300 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7e6c0b6690 0x7f7e6c143e90 secure :-1 s=READY pgs=342 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e5c004740 tx=0x7f7e5c0028d0 comp rx=0 tx=0).stop 2026-02-23T06:40:48.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.371+0000 7f7e71803640 1 -- 10.20.193.58:0/2695191300 shutdown_connections 2026-02-23T06:40:48.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.371+0000 7f7e71803640 1 --2- 10.20.193.58:0/2695191300 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7e3c07a6c0 0x7f7e3c09ab70 unknown :-1 s=CLOSED pgs=429 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:48.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.371+0000 7f7e71803640 1 --2- 10.20.193.58:0/2695191300 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7e6c15d870 0x7f7e6c1619f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:48.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.371+0000 7f7e71803640 1 --2- 10.20.193.58:0/2695191300 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7e6c15d4a0 0x7f7e6c1614b0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:48.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.371+0000 7f7e71803640 1 --2- 10.20.193.58:0/2695191300 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7e6c0b6690 0x7f7e6c143e90 unknown :-1 s=CLOSED pgs=342 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:48.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.371+0000 7f7e71803640 1 -- 10.20.193.58:0/2695191300 >> 10.20.193.58:0/2695191300 conn(0x7f7e6c0b3c20 msgr2=0x7f7e6c1633a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:48.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.371+0000 7f7e71803640 1 -- 10.20.193.58:0/2695191300 shutdown_connections 2026-02-23T06:40:48.367 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.371+0000 7f7e71803640 1 -- 10.20.193.58:0/2695191300 wait complete. 2026-02-23T06:40:48.378 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:40:48.378 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:40:48.379 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:40:48.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.505+0000 7fadfd575640 1 -- 10.20.193.58:0/3432179990 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faddc003e80 msgr2=0x7faddc0042f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:48.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.505+0000 7fadfd575640 1 --2- 10.20.193.58:0/3432179990 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faddc003e80 0x7faddc0042f0 secure :-1 s=READY pgs=344 gs=5 cs=0 l=1 c_cookie=13609072132978388624 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fadec007fd0 tx=0x7fadec030980 comp rx=0 tx=0).stop 2026-02-23T06:40:48.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.505+0000 7fadfcd74640 1 -- 10.20.193.58:0/3432179990 reap_dead start 2026-02-23T06:40:48.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.505+0000 7fadfd575640 1 -- 10.20.193.58:0/3432179990 shutdown_connections 2026-02-23T06:40:48.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.505+0000 7fadfd575640 1 -- 10.20.193.58:0/3432179990 >> 10.20.193.58:0/3432179990 conn(0x7fadf80b3c20 msgr2=0x7fadf80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:48.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.505+0000 7fadfd575640 1 -- 10.20.193.58:0/3432179990 shutdown_connections 2026-02-23T06:40:48.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.505+0000 7fadfd575640 1 -- 10.20.193.58:0/3432179990 wait complete. 2026-02-23T06:40:48.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.507+0000 7fadfd575640 1 Processor -- start 2026-02-23T06:40:48.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.507+0000 7fadfd575640 1 -- start start 2026-02-23T06:40:48.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.507+0000 7fadfd575640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fadf811c0e0 0x7fadf8121e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:48.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.507+0000 7fadfd575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fadf811c4b0 0x7fadf8151d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:48.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.507+0000 7fadfd575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fadf80add90 0x7fadf813cfa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:48.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.507+0000 7fadfd575640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fadf8152270 con 0x7fadf80add90 2026-02-23T06:40:48.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.507+0000 7fadfd575640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fadf811ccb0 con 0x7fadf811c0e0 2026-02-23T06:40:48.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.507+0000 7fadfd575640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fadf81219d0 con 0x7fadf811c4b0 2026-02-23T06:40:48.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.508+0000 7fadf7fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fadf811c0e0 0x7fadf8121e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:48.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.508+0000 7fadf77fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fadf811c4b0 0x7fadf8151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:48.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.508+0000 7fadfcd74640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fadf80add90 0x7fadf813cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:48.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.508+0000 7fadf77fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fadf811c4b0 0x7fadf8151d30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:48156/0 (socket says 10.20.193.58:48156) 2026-02-23T06:40:48.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.508+0000 7fadf7fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fadf811c0e0 0x7fadf8121e60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:50572/0 (socket says 10.20.193.58:50572) 2026-02-23T06:40:48.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.508+0000 7fadf77fe640 1 -- 10.20.193.58:0/183847719 learned_addr learned my addr 10.20.193.58:0/183847719 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:40:48.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.508+0000 7fadf77fe640 1 -- 10.20.193.58:0/183847719 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fadf811c4b0 msgr2=0x7fadf8151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-23T06:40:48.507 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.508+0000 7fadf77fe640 1 -- 10.20.193.58:0/183847719 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fadf811c4b0 msgr2=0x7fadf8151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:40:48.507 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.508+0000 7fadf77fe640 1 --2- 10.20.193.58:0/183847719 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fadf811c4b0 0x7fadf8151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:40:48.507 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.508+0000 7fadf77fe640 1 --2- 10.20.193.58:0/183847719 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fadf811c4b0 0x7fadf8151d30 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:40:48.507 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.508+0000 7fadfcd74640 1 -- 10.20.193.58:0/183847719 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fadf811c4b0 msgr2=0x7fadf8151d30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:40:48.507 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.508+0000 7fadfcd74640 1 --2- 10.20.193.58:0/183847719 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fadf811c4b0 0x7fadf8151d30 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:48.507 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.508+0000 7fadfcd74640 1 -- 10.20.193.58:0/183847719 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fadf811c0e0 msgr2=0x7fadf8121e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:48.507 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.508+0000 7fadfcd74640 1 --2- 10.20.193.58:0/183847719 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fadf811c0e0 0x7fadf8121e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:48.507 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.508+0000 7fadfcd74640 1 -- 10.20.193.58:0/183847719 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf80ae690 con 0x7fadf80add90 2026-02-23T06:40:48.507 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.508+0000 7fadfcd74640 1 --2- 10.20.193.58:0/183847719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fadf80add90 0x7fadf813cfa0 secure :-1 s=READY pgs=345 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fadec007fd0 tx=0x7fadec004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:48.507 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.508+0000 7fadf4ff9640 1 -- 10.20.193.58:0/183847719 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fadec003d00 con 0x7fadf80add90 2026-02-23T06:40:48.507 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.508+0000 7fadf4ff9640 1 -- 10.20.193.58:0/183847719 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fadec003e80 con 0x7fadf80add90 2026-02-23T06:40:48.507 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.508+0000 7fadf4ff9640 1 -- 10.20.193.58:0/183847719 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fadec007340 con 0x7fadf80add90 2026-02-23T06:40:48.507 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.508+0000 7fadfd575640 1 -- 10.20.193.58:0/183847719 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadf811ebf0 con 0x7fadf80add90 2026-02-23T06:40:48.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.508+0000 7fadfd575640 1 -- 10.20.193.58:0/183847719 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadf80b10b0 con 0x7fadf80add90 2026-02-23T06:40:48.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.509+0000 7fadfd575640 1 --2- 10.20.193.58:0/183847719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fadb80041f0 0x7fadb80246a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:48.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.509+0000 7fadfd575640 1 -- 10.20.193.58:0/183847719 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fadb8025f20 con 0x7fadb80041f0 2026-02-23T06:40:48.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.509+0000 7fadf7fff640 1 --2- 10.20.193.58:0/183847719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fadb80041f0 0x7fadb80246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:48.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.509+0000 7fadf7fff640 1 -- 10.20.193.58:0/183847719 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fadb80260e0 con 0x7fadb80041f0 2026-02-23T06:40:48.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.509+0000 7fadf7fff640 1 --2- 10.20.193.58:0/183847719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fadb80041f0 0x7fadb80246a0 secure :-1 s=READY pgs=346 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fade40028d0 tx=0x7fade4002da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:48.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.509+0000 7fadf4ff9640 1 -- 10.20.193.58:0/183847719 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fade400dd40 con 0x7fadb80041f0 2026-02-23T06:40:48.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.509+0000 7fadf4ff9640 1 -- 10.20.193.58:0/183847719 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fade4015040 con 0x7fadb80041f0 2026-02-23T06:40:48.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.509+0000 7fadf4ff9640 1 -- 10.20.193.58:0/183847719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fadb80041f0 msgr2=0x7fadb80246a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:48.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.509+0000 7fadf4ff9640 1 --2- 10.20.193.58:0/183847719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fadb80041f0 0x7fadb80246a0 secure :-1 s=READY pgs=346 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fade40028d0 tx=0x7fade4002da0 comp rx=0 tx=0).stop 2026-02-23T06:40:48.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.509+0000 7fadf4ff9640 1 -- 10.20.193.58:0/183847719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fadb80041f0 msgr2=0x7fadb80246a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:40:48.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.509+0000 7fadf4ff9640 1 --2- 10.20.193.58:0/183847719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fadb80041f0 0x7fadb80246a0 unknown :-1 s=CLOSED pgs=346 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:48.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.509+0000 7fadf4ff9640 1 -- 10.20.193.58:0/183847719 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fadec0074a0 con 0x7fadf80add90 2026-02-23T06:40:48.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.509+0000 7fadf4ff9640 1 --2- 10.20.193.58:0/183847719 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fadc807a3c0 0x7fadc809a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:48.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.509+0000 7fadf4ff9640 1 -- 10.20.193.58:0/183847719 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fadec0c2f00 con 0x7fadf80add90 2026-02-23T06:40:48.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.509+0000 7fadfd575640 1 --2- 10.20.193.58:0/183847719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fadb8025050 0x7fadb80254d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:48.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.509+0000 7fadfd575640 1 -- 10.20.193.58:0/183847719 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fadb8025ab0 con 0x7fadb8025050 2026-02-23T06:40:48.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.509+0000 7fadf77fe640 1 --2- 10.20.193.58:0/183847719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fadb8025050 0x7fadb80254d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:48.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.514+0000 7fadf77fe640 1 -- 10.20.193.58:0/183847719 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fadb8025c70 con 0x7fadb8025050 2026-02-23T06:40:48.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.514+0000 7fadf77fe640 1 --2- 10.20.193.58:0/183847719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fadb8025050 0x7fadb80254d0 secure :-1 s=READY pgs=347 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fade80023d0 tx=0x7fade8010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:48.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.514+0000 7fadf4ff9640 1 -- 10.20.193.58:0/183847719 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fade800e9e0 con 0x7fadb8025050 2026-02-23T06:40:48.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.514+0000 7fadf4ff9640 1 -- 10.20.193.58:0/183847719 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5558 (secure 0 0 0) 0x7fade800eb40 con 0x7fadb8025050 2026-02-23T06:40:48.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.514+0000 7fadf4ff9640 1 -- 10.20.193.58:0/183847719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fadb8025050 msgr2=0x7fadb80254d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:48.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.514+0000 7fadf4ff9640 1 --2- 10.20.193.58:0/183847719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fadb8025050 0x7fadb80254d0 secure :-1 s=READY pgs=347 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fade80023d0 tx=0x7fade8010da0 comp rx=0 tx=0).stop 2026-02-23T06:40:48.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.514+0000 7fadf4ff9640 1 -- 10.20.193.58:0/183847719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fadb8025050 msgr2=0x7fadb80254d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:40:48.512 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.514+0000 7fadf4ff9640 1 --2- 10.20.193.58:0/183847719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fadb8025050 0x7fadb80254d0 secure :-1 s=CLOSED pgs=347 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fade80023d0 tx=0x7fade8010da0 comp rx=0 tx=0).stop 2026-02-23T06:40:48.512 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:40:48.512 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:40:48.512 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:40:48.512 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:40:48.512 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 166, 2026-02-23T06:40:48.512 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 456025, 2026-02-23T06:40:48.513 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:40:48.513 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:40:48.513 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:40:48.513 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:40:48.513 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:48.513 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:40:48.513 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:40:48.513 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:40:48.513 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:40:48.513 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:48.513 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:48.513 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:48.514 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:48.514 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:48.514 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:48.514 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:48.514 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:48.514 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:48.514 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:48.514 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:48.514 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:48.514 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:48.514 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:48.514 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:40:48.515 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:40:48.515 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:48.515 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:48.515 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:48.515 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:48.515 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:48.515 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:48.515 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:48.515 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:48.515 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:48.515 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:48.515 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:48.515 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:48.516 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:48.516 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:48.516 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:48.516 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:40:48.516 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:40:48.516 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:40:48.516 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:40:48.516 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:40:48.516 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:40:48.516 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:40:48.516 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:40:48.517 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:40:48.517 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:40:48.517 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:40:48.517 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:40:48.517 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:40:48.517 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:40:48.517 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:40:48.517 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:40:48.517 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:40:48.517 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:48.517 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:48.517 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:48.517 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:48.518 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:48.518 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:48.518 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:48.518 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:48.518 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:48.518 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:48.518 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:48.518 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:48.518 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:48.518 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:48.518 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:40:48.518 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:48.519 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:40:48.519 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.519 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:40:48.519 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:40:48.519 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:48.519 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:48.519 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.519 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:48.519 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:40:48.519 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:48.519 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:48.519 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.519 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:48.520 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:40:48.520 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:48.520 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:48.520 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:48.520 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:48.520 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:40:48.520 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:40:48.520 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:48.520 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:48.520 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:40:48.520 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:48.520 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:48.521 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.521 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:40:48.521 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:40:48.521 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:48.521 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:48.521 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.521 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:48.521 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:40:48.521 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:48.521 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:48.521 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.521 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:48.521 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:40:48.522 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:48.522 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:48.522 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:48.522 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:48.522 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:40:48.522 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:40:48.522 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:48.522 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:48.522 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:40:48.522 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:48.522 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:48.522 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.522 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:40:48.523 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:40:48.523 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:48.523 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:48.523 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.523 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:48.523 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:40:48.523 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:48.523 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:48.523 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.523 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:48.523 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:40:48.523 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:48.524 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:48.524 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:48.524 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:48.524 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:40:48.524 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:40:48.524 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:48.524 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:48.524 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:40:48.524 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:48.524 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:48.524 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:48.524 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:48.524 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:40:48.525 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:40:48.525 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.525 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:48.525 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:48.525 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:40:48.525 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:48.525 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:48.525 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:40:48.525 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.525 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:48.525 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:48.525 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:40:48.526 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:48.526 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:48.526 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:40:48.526 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.526 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:48.526 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:48.526 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:40:48.526 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:48.526 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:48.526 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:40:48.526 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.526 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:40:48.526 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:40:48.526 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:40:48.527 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:48.527 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.527 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:48.527 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:48.527 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:40:48.527 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:48.527 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:48.527 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:40:48.527 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.527 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:48.527 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:48.527 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:40:48.528 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:48.528 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:48.528 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:48.528 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:40:48.528 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:40:48.529 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.514+0000 7fadfd575640 1 -- 10.20.193.58:0/183847719 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fadc807a3c0 msgr2=0x7fadc809a870 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-23T06:40:48.530 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.514+0000 7fadfd575640 1 --2- 10.20.193.58:0/183847719 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fadc807a3c0 0x7fadc809a870 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:48.530 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.514+0000 7fadfd575640 1 -- 10.20.193.58:0/183847719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fadf80add90 msgr2=0x7fadf813cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:48.530 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.514+0000 7fadfd575640 1 --2- 10.20.193.58:0/183847719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fadf80add90 0x7fadf813cfa0 secure :-1 s=READY pgs=345 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fadec007fd0 tx=0x7fadec004620 comp rx=0 tx=0).stop 2026-02-23T06:40:48.530 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.514+0000 7fadfcd74640 1 -- 10.20.193.58:0/183847719 reap_dead start 2026-02-23T06:40:48.530 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.514+0000 7fadfcd74640 1 -- 10.20.193.58:0/183847719 reap_dead start 2026-02-23T06:40:48.530 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.514+0000 7fadfd575640 1 -- 10.20.193.58:0/183847719 shutdown_connections 2026-02-23T06:40:48.530 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.514+0000 7fadfd575640 1 -- 10.20.193.58:0/183847719 >> 10.20.193.58:0/183847719 conn(0x7fadf80b3c20 msgr2=0x7fadf80b13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:48.530 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.514+0000 7fadfd575640 1 -- 10.20.193.58:0/183847719 shutdown_connections 2026-02-23T06:40:48.530 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.514+0000 7fadfd575640 1 -- 10.20.193.58:0/183847719 wait complete. 2026-02-23T06:40:48.531 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:40:48.531 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:40:48.531 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:40:48.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.657+0000 7f388f683640 1 -- 10.20.193.58:0/1531884509 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f388815d4a0 msgr2=0x7f3878003a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:48.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.657+0000 7f388f683640 1 --2- 10.20.193.58:0/1531884509 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f388815d4a0 0x7f3878003a80 secure :-1 s=READY pgs=3 gs=5 cs=0 l=1 c_cookie=9548662488280057378 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3880004740 tx=0x7f388002f6e0 comp rx=0 tx=0).stop 2026-02-23T06:40:48.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.657+0000 7f388ee82640 1 -- 10.20.193.58:0/1531884509 reap_dead start 2026-02-23T06:40:48.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.657+0000 7f388f683640 1 -- 10.20.193.58:0/1531884509 shutdown_connections 2026-02-23T06:40:48.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.657+0000 7f388f683640 1 -- 10.20.193.58:0/1531884509 >> 10.20.193.58:0/1531884509 conn(0x7f38880b3c20 msgr2=0x7f38880b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:48.654 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.657+0000 7f388f683640 1 -- 10.20.193.58:0/1531884509 shutdown_connections 2026-02-23T06:40:48.654 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.658+0000 7f388f683640 1 -- 10.20.193.58:0/1531884509 wait complete. 2026-02-23T06:40:48.656 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.659+0000 7f388f683640 1 Processor -- start 2026-02-23T06:40:48.656 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.659+0000 7f388f683640 1 -- start start 2026-02-23T06:40:48.657 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.659+0000 7f388f683640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f388815d4a0 0x7f3888142b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:48.657 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.659+0000 7f388f683640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f38881631b0 0x7f388813fc20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:48.657 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.659+0000 7f388f683640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3888145250 0x7f3888140160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:48.657 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.659+0000 7f388f683640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f388813f790 con 0x7f388815d4a0 2026-02-23T06:40:48.657 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.659+0000 7f388f683640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f388813f1d0 con 0x7f3888145250 2026-02-23T06:40:48.657 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.659+0000 7f388f683640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f3888144bc0 con 0x7f38881631b0 2026-02-23T06:40:48.657 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.660+0000 7f388e681640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f388815d4a0 0x7f3888142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:48.657 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.660+0000 7f388e681640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f388815d4a0 0x7f3888142b90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:59748/0 (socket says 10.20.193.58:59748) 2026-02-23T06:40:48.657 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.660+0000 7f388e681640 1 -- 10.20.193.58:0/2642674248 learned_addr learned my addr 10.20.193.58:0/2642674248 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:40:48.657 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.660+0000 7f388ee82640 1 --2- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3888145250 0x7f3888140160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:48.657 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.660+0000 7f388de80640 1 --2- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f38881631b0 0x7f388813fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:48.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.660+0000 7f388de80640 1 -- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f38881631b0 msgr2=0x7f388813fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-23T06:40:48.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.660+0000 7f388e681640 1 -- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f38881631b0 msgr2=0x7f388813fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:48.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.660+0000 7f388de80640 1 -- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f38881631b0 msgr2=0x7f388813fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:40:48.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.660+0000 7f388de80640 1 --2- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f38881631b0 0x7f388813fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:40:48.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.660+0000 7f388de80640 1 --2- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f38881631b0 0x7f388813fc20 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:40:48.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.660+0000 7f388e681640 1 --2- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f38881631b0 0x7f388813fc20 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:48.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.660+0000 7f388e681640 1 -- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3888145250 msgr2=0x7f3888140160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:48.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.660+0000 7f388e681640 1 --2- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3888145250 0x7f3888140160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:48.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.660+0000 7f388e681640 1 -- 10.20.193.58:0/2642674248 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3888162690 con 0x7f388815d4a0 2026-02-23T06:40:48.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.660+0000 7f388ee82640 1 --2- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3888145250 0x7f3888140160 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:40:48.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.660+0000 7f388e681640 1 --2- 10.20.193.58:0/2642674248 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f388815d4a0 0x7f3888142b90 secure :-1 s=READY pgs=349 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f388000b580 tx=0x7f3880005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:48.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.660+0000 7f3872ffd640 1 -- 10.20.193.58:0/2642674248 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38800028c0 con 0x7f388815d4a0 2026-02-23T06:40:48.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.660+0000 7f3872ffd640 1 -- 10.20.193.58:0/2642674248 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3880002b10 con 0x7f388815d4a0 2026-02-23T06:40:48.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.660+0000 7f3872ffd640 1 -- 10.20.193.58:0/2642674248 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3880040460 con 0x7f388815d4a0 2026-02-23T06:40:48.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.660+0000 7f388f683640 1 -- 10.20.193.58:0/2642674248 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3888162970 con 0x7f388815d4a0 2026-02-23T06:40:48.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.661+0000 7f388f683640 1 -- 10.20.193.58:0/2642674248 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38881381b0 con 0x7f388815d4a0 2026-02-23T06:40:48.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.661+0000 7f388f683640 1 --2- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3888201720 0x7f3888201af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:48.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.661+0000 7f388f683640 1 -- 10.20.193.58:0/2642674248 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f38880b6330 con 0x7f3888201720 2026-02-23T06:40:48.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.661+0000 7f388de80640 1 --2- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3888201720 0x7f3888201af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:48.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.662+0000 7f388de80640 1 -- 10.20.193.58:0/2642674248 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f38880b5e10 con 0x7f3888201720 2026-02-23T06:40:48.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.662+0000 7f388de80640 1 --2- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3888201720 0x7f3888201af0 secure :-1 s=READY pgs=44 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3888057e80 tx=0x7f3874009a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:48.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.662+0000 7f3872ffd640 1 -- 10.20.193.58:0/2642674248 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3874015070 con 0x7f3888201720 2026-02-23T06:40:48.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.662+0000 7f3872ffd640 1 -- 10.20.193.58:0/2642674248 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f388003e040 con 0x7f388815d4a0 2026-02-23T06:40:48.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.663+0000 7f3872ffd640 1 --2- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f385807a660 0x7f385809ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:48.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.663+0000 7f3872ffd640 1 -- 10.20.193.58:0/2642674248 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f38800c2cc0 con 0x7f388815d4a0 2026-02-23T06:40:48.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.664+0000 7f3872ffd640 1 -- 10.20.193.58:0/2642674248 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f3874004a70 con 0x7f3888201720 2026-02-23T06:40:48.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.664+0000 7f3872ffd640 1 -- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3888201720 msgr2=0x7f3888201af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:48.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.664+0000 7f3872ffd640 1 --2- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3888201720 0x7f3888201af0 secure :-1 s=READY pgs=44 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3888057e80 tx=0x7f3874009a30 comp rx=0 tx=0).stop 2026-02-23T06:40:48.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.664+0000 7f3872ffd640 1 -- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3888201720 msgr2=0x7f3888201af0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:40:48.662 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.664+0000 7f3872ffd640 1 --2- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3888201720 0x7f3888201af0 secure :-1 s=CLOSED pgs=44 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3888057e80 tx=0x7f3874009a30 comp rx=0 tx=0).stop 2026-02-23T06:40:48.662 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.664+0000 7f388ee82640 1 --2- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f385807a660 0x7f385809ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:48.662 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.665+0000 7f388ee82640 1 --2- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f385807a660 0x7f385809ab10 secure :-1 s=READY pgs=430 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f387c003c10 tx=0x7f387c0078c0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:48.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.668+0000 7f388f683640 1 --2- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3888202030 0x7f388815ad90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:48.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.668+0000 7f388f683640 1 -- 10.20.193.58:0/2642674248 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f38880b6d50 con 0x7f3888202030 2026-02-23T06:40:48.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.668+0000 7f388de80640 1 --2- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3888202030 0x7f388815ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:48.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.669+0000 7f388de80640 1 -- 10.20.193.58:0/2642674248 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f388813f5c0 con 0x7f3888202030 2026-02-23T06:40:48.664 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.669+0000 7f388de80640 1 --2- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3888202030 0x7f388815ad90 secure :-1 s=READY pgs=45 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3874002fd0 tx=0x7f38740047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:48.665 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.669+0000 7f3872ffd640 1 -- 10.20.193.58:0/2642674248 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3874025070 con 0x7f3888202030 2026-02-23T06:40:48.665 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.669+0000 7f3872ffd640 1 -- 10.20.193.58:0/2642674248 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5412 (secure 0 0 0) 0x7f387401f050 con 0x7f3888202030 2026-02-23T06:40:48.665 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.669+0000 7f3872ffd640 1 -- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3888202030 msgr2=0x7f388815ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:48.665 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.669+0000 7f3872ffd640 1 --2- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3888202030 0x7f388815ad90 secure :-1 s=READY pgs=45 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3874002fd0 tx=0x7f38740047e0 comp rx=0 tx=0).stop 2026-02-23T06:40:48.665 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.669+0000 7f3872ffd640 1 -- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3888202030 msgr2=0x7f388815ad90 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:40:48.665 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.669+0000 7f3872ffd640 1 --2- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f3888202030 0x7f388815ad90 secure :-1 s=CLOSED pgs=45 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3874002fd0 tx=0x7f38740047e0 comp rx=0 tx=0).stop 2026-02-23T06:40:48.665 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:40:48.665 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:40:48.666 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:40:48.666 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:40:48.666 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 166, 2026-02-23T06:40:48.666 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 52759, 2026-02-23T06:40:48.666 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:40:48.666 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:40:48.666 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:40:48.666 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:40:48.666 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:48.666 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:40:48.666 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:40:48.667 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:40:48.667 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:40:48.667 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:48.667 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:48.667 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:48.667 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:48.667 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:48.667 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:48.667 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:48.667 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:48.667 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:48.667 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:48.668 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:48.668 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:48.668 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:48.668 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:48.668 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:40:48.668 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:40:48.668 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:48.668 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:48.668 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:48.668 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:48.668 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:48.668 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:48.669 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:48.669 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:48.669 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:48.669 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:48.669 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:48.669 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:48.669 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:48.669 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:48.669 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:48.669 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:40:48.669 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:40:48.669 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:40:48.670 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:40:48.670 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:40:48.670 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:40:48.670 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:40:48.670 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:40:48.670 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:40:48.670 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:40:48.670 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:40:48.670 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:40:48.670 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:40:48.670 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:40:48.670 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:40:48.671 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:40:48.671 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:40:48.671 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:48.671 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:48.671 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:48.671 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:48.671 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:48.671 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:48.671 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:48.671 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:48.671 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:48.671 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:48.671 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:48.672 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:48.672 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:48.672 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:48.672 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:40:48.672 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:48.672 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:40:48.672 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.672 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:40:48.672 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:40:48.672 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:48.672 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:48.672 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.673 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:48.673 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:40:48.673 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:48.673 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:48.673 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.673 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:48.673 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:40:48.673 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:48.673 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:48.673 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:48.673 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:48.673 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:40:48.674 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:40:48.674 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:48.674 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:48.674 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:40:48.674 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:48.674 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:48.674 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.674 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:40:48.674 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:40:48.674 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:48.674 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:48.674 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.674 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:48.675 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:40:48.675 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:48.675 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:48.675 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.675 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:48.675 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:40:48.675 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:48.675 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:48.675 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:48.675 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:48.675 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:40:48.675 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:40:48.676 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:48.676 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:48.676 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:40:48.676 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:48.676 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:48.676 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.676 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:40:48.676 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:40:48.676 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:48.676 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:48.676 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.676 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:48.677 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:40:48.677 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:48.677 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:48.677 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.677 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:48.677 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:40:48.677 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:48.677 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:48.677 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:48.677 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:48.677 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:40:48.677 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:40:48.677 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:48.678 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:48.678 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:40:48.678 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:48.678 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:48.678 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:48.678 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:48.678 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:40:48.678 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:40:48.678 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.678 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:48.678 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:48.678 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:40:48.679 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:48.679 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:48.679 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:40:48.679 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.679 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:48.679 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:48.679 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:40:48.679 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:48.679 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:48.679 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:40:48.679 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.679 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:48.679 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:48.680 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:40:48.680 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:48.680 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:48.680 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:40:48.680 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.680 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:48.680 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:48.680 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:40:48.680 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:48.680 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:48.680 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:40:48.680 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:48.680 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:48.681 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:48.681 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:40:48.681 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:48.681 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:48.681 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:48.681 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:40:48.681 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:40:48.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.669+0000 7f388f683640 1 -- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f385807a660 msgr2=0x7f385809ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:48.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.669+0000 7f388f683640 1 --2- 10.20.193.58:0/2642674248 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f385807a660 0x7f385809ab10 secure :-1 s=READY pgs=430 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f387c003c10 tx=0x7f387c0078c0 comp rx=0 tx=0).stop 2026-02-23T06:40:48.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.669+0000 7f388f683640 1 -- 10.20.193.58:0/2642674248 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f388815d4a0 msgr2=0x7f3888142b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:48.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.669+0000 7f388f683640 1 --2- 10.20.193.58:0/2642674248 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f388815d4a0 0x7f3888142b90 secure :-1 s=READY pgs=349 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f388000b580 tx=0x7f3880005900 comp rx=0 tx=0).stop 2026-02-23T06:40:48.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.669+0000 7f388ee82640 1 -- 10.20.193.58:0/2642674248 reap_dead start 2026-02-23T06:40:48.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.669+0000 7f388ee82640 1 -- 10.20.193.58:0/2642674248 reap_dead start 2026-02-23T06:40:48.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.670+0000 7f388f683640 1 -- 10.20.193.58:0/2642674248 shutdown_connections 2026-02-23T06:40:48.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.670+0000 7f388f683640 1 -- 10.20.193.58:0/2642674248 >> 10.20.193.58:0/2642674248 conn(0x7f38880b3c20 msgr2=0x7f388815a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:48.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.670+0000 7f388f683640 1 -- 10.20.193.58:0/2642674248 shutdown_connections 2026-02-23T06:40:48.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.670+0000 7f388f683640 1 -- 10.20.193.58:0/2642674248 wait complete. 2026-02-23T06:40:48.684 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:40:48.684 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:40:48.685 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:40:48.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.810+0000 7f158b043640 1 -- 10.20.193.58:0/658061528 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f158415d4a0 msgr2=0x7f15840affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:48.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.810+0000 7f158b043640 1 --2- 10.20.193.58:0/658061528 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f158415d4a0 0x7f15840affb0 secure :-1 s=READY pgs=350 gs=3 cs=0 l=1 c_cookie=3780298151038654853 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1574004740 tx=0x7f157402f1d0 comp rx=0 tx=0).stop 2026-02-23T06:40:48.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.810+0000 7f158b043640 1 -- 10.20.193.58:0/658061528 shutdown_connections 2026-02-23T06:40:48.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.810+0000 7f158b043640 1 --2- 10.20.193.58:0/658061528 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158415d870 0x7f15840587b0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:48.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.810+0000 7f158b043640 1 --2- 10.20.193.58:0/658061528 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f158415d4a0 0x7f15840affb0 unknown :-1 s=CLOSED pgs=350 gs=3 cs=0 l=1 c_cookie=3780298151038654853 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:48.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.810+0000 7f158b043640 1 -- 10.20.193.58:0/658061528 >> 10.20.193.58:0/658061528 conn(0x7f15840b3c20 msgr2=0x7f15840b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:48.807 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.810+0000 7f158b043640 1 -- 10.20.193.58:0/658061528 shutdown_connections 2026-02-23T06:40:48.807 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.810+0000 7f158b043640 1 -- 10.20.193.58:0/658061528 wait complete. 2026-02-23T06:40:48.810 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.811+0000 7f158b043640 1 Processor -- start 2026-02-23T06:40:48.810 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.812+0000 7f158b043640 1 -- start start 2026-02-23T06:40:48.810 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.812+0000 7f158b043640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f15840b6690 0x7f158414da40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:48.810 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.812+0000 7f158b043640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f158415d4a0 0x7f158411f0e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:48.810 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.812+0000 7f158b043640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158415d870 0x7f158411f620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:48.810 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.812+0000 7f158b043640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f1584120880 con 0x7f15840b6690 2026-02-23T06:40:48.810 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.812+0000 7f158b043640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f1584120db0 con 0x7f158415d4a0 2026-02-23T06:40:48.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.812+0000 7f158b043640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f15841402c0 con 0x7f158415d870 2026-02-23T06:40:48.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.812+0000 7f158a041640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f15840b6690 0x7f158414da40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:48.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.812+0000 7f158a041640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f15840b6690 0x7f158414da40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:39986/0 (socket says 10.20.193.58:39986) 2026-02-23T06:40:48.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.812+0000 7f158a041640 1 -- 10.20.193.58:0/189296355 learned_addr learned my addr 10.20.193.58:0/189296355 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:40:48.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.812+0000 7f1589840640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f158415d4a0 0x7f158411f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:48.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.812+0000 7f158a842640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158415d870 0x7f158411f620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:48.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.812+0000 7f158a041640 1 -- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158415d870 msgr2=0x7f158411f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:48.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.812+0000 7f158a041640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158415d870 0x7f158411f620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:48.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.812+0000 7f158a041640 1 -- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f158415d4a0 msgr2=0x7f158411f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:48.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.812+0000 7f158a041640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f158415d4a0 0x7f158411f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:48.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.812+0000 7f158a041640 1 -- 10.20.193.58:0/189296355 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15740094b0 con 0x7f15840b6690 2026-02-23T06:40:48.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.813+0000 7f158a041640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f15840b6690 0x7f158414da40 secure :-1 s=READY pgs=351 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1574002a10 tx=0x7f1574002a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:48.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.813+0000 7f156affd640 1 -- 10.20.193.58:0/189296355 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1574038690 con 0x7f15840b6690 2026-02-23T06:40:48.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.813+0000 7f156affd640 1 -- 10.20.193.58:0/189296355 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15740388e0 con 0x7f15840b6690 2026-02-23T06:40:48.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.813+0000 7f156affd640 1 -- 10.20.193.58:0/189296355 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1574038cb0 con 0x7f15840b6690 2026-02-23T06:40:48.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.813+0000 7f158b043640 1 -- 10.20.193.58:0/189296355 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1584120ad0 con 0x7f15840b6690 2026-02-23T06:40:48.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.813+0000 7f158b043640 1 -- 10.20.193.58:0/189296355 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f158413ff50 con 0x7f15840b6690 2026-02-23T06:40:48.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.813+0000 7f158b043640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 0x7f158413deb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:48.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.813+0000 7f158b043640 1 -- 10.20.193.58:0/189296355 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f158413fb20 con 0x7f158413d8c0 2026-02-23T06:40:48.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.814+0000 7f1589840640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 0x7f158413deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:48.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.814+0000 7f1589840640 1 -- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 msgr2=0x7f158413deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-23T06:40:48.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.814+0000 7f1589840640 1 -- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 msgr2=0x7f158413deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:40:48.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.814+0000 7f1589840640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 0x7f158413deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:40:48.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.814+0000 7f1589840640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 0x7f158413deb0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:40:48.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.815+0000 7f156affd640 1 -- 10.20.193.58:0/189296355 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f1574040420 con 0x7f15840b6690 2026-02-23T06:40:48.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.816+0000 7f156affd640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f155407a6c0 0x7f155409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:48.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.816+0000 7f156affd640 1 -- 10.20.193.58:0/189296355 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f15740c2db0 con 0x7f15840b6690 2026-02-23T06:40:48.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.816+0000 7f158a842640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f155407a6c0 0x7f155409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:48.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:48.817+0000 7f158a842640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f155407a6c0 0x7f155409ab70 secure :-1 s=READY pgs=431 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1580005850 tx=0x7f158000a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:49.010 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:49.014+0000 7f1589840640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 0x7f158413deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:49.010 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:49.015+0000 7f1589840640 1 -- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 msgr2=0x7f158413deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:40:49.010 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:49.015+0000 7f1589840640 1 -- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 msgr2=0x7f158413deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:40:49.010 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:49.015+0000 7f1589840640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 0x7f158413deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:40:49.010 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:49.015+0000 7f1589840640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 0x7f158413deb0 unknown :-1 s=START_CONNECT pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-23T06:40:49.411 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:49.415+0000 7f1589840640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 0x7f158413deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:49.411 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:49.416+0000 7f1589840640 1 -- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 msgr2=0x7f158413deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:40:49.411 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:49.416+0000 7f1589840640 1 -- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 msgr2=0x7f158413deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:40:49.411 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:49.416+0000 7f1589840640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 0x7f158413deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:40:49.411 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:49.416+0000 7f1589840640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 0x7f158413deb0 unknown :-1 s=START_CONNECT pgs=0 gs=10 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-23T06:40:50.212 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:50.217+0000 7f1589840640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 0x7f158413deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=11 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:50.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:50.217+0000 7f1589840640 1 -- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 msgr2=0x7f158413deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:40:50.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:50.217+0000 7f1589840640 1 -- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 msgr2=0x7f158413deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:40:50.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:50.217+0000 7f1589840640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 0x7f158413deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=11 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:40:50.213 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:50.217+0000 7f1589840640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 0x7f158413deb0 unknown :-1 s=START_CONNECT pgs=0 gs=12 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-23T06:40:51.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:51.819+0000 7f1589840640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 0x7f158413deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=13 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:51.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:51.820+0000 7f1589840640 1 -- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 msgr2=0x7f158413deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:40:51.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:51.820+0000 7f1589840640 1 -- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 msgr2=0x7f158413deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:40:51.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:51.820+0000 7f1589840640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 0x7f158413deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=13 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:40:51.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:51.820+0000 7f1589840640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 0x7f158413deb0 unknown :-1 s=START_CONNECT pgs=0 gs=14 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2026-02-23T06:40:52.808 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:52.812+0000 7f1569ffb640 1 -- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 msgr2=0x7f158413deb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:40:52.808 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:52.812+0000 7f1569ffb640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 0x7f158413deb0 unknown :-1 s=START_CONNECT pgs=0 gs=14 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:52.808 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:52.812+0000 7f1569ffb640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f154c003600 0x7f154c023a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:52.808 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:52.812+0000 7f1569ffb640 1 -- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 msgr2=0x7f158413deb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:40:52.808 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:52.812+0000 7f1569ffb640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f158413d8c0 0x7f158413deb0 unknown :-1 s=CLOSED pgs=0 gs=14 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:52.808 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:52.812+0000 7f1569ffb640 1 -- 10.20.193.58:0/189296355 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f154c024130 con 0x7f154c003600 2026-02-23T06:40:52.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:52.820+0000 7f1589840640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f154c003600 0x7f154c023a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=15 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:52.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:52.820+0000 7f1589840640 1 -- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f154c003600 msgr2=0x7f154c023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:40:52.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:52.820+0000 7f1589840640 1 -- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f154c003600 msgr2=0x7f154c023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:40:52.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:52.820+0000 7f1589840640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f154c003600 0x7f154c023a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=15 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:40:52.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:52.820+0000 7f1589840640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f154c003600 0x7f154c023a80 unknown :-1 s=START_CONNECT pgs=0 gs=16 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:40:53.016 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.021+0000 7f1589840640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f154c003600 0x7f154c023a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=17 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:53.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.021+0000 7f1589840640 1 -- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f154c003600 msgr2=0x7f154c023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:40:53.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.021+0000 7f1589840640 1 -- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f154c003600 msgr2=0x7f154c023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:40:53.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.021+0000 7f1589840640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f154c003600 0x7f154c023a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=17 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:40:53.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.021+0000 7f1589840640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f154c003600 0x7f154c023a80 unknown :-1 s=START_CONNECT pgs=0 gs=18 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-23T06:40:53.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.422+0000 7f1589840640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f154c003600 0x7f154c023a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=19 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:53.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.422+0000 7f1589840640 1 -- 10.20.193.58:0/189296355 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f154c0242a0 con 0x7f154c003600 2026-02-23T06:40:53.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.422+0000 7f1589840640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f154c003600 0x7f154c023a80 secure :-1 s=READY pgs=4 gs=19 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15841424b0 tx=0x7f1578012e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:53.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.423+0000 7f156affd640 1 -- 10.20.193.58:0/189296355 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1578002ea0 con 0x7f154c003600 2026-02-23T06:40:53.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.423+0000 7f156affd640 1 -- 10.20.193.58:0/189296355 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f1578018040 con 0x7f154c003600 2026-02-23T06:40:53.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.423+0000 7f156affd640 1 -- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f154c003600 msgr2=0x7f154c023a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:53.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.423+0000 7f156affd640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f154c003600 0x7f154c023a80 secure :-1 s=READY pgs=4 gs=19 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15841424b0 tx=0x7f1578012e90 comp rx=0 tx=0).stop 2026-02-23T06:40:53.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.423+0000 7f156affd640 1 -- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f154c003600 msgr2=0x7f154c023a80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:40:53.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.423+0000 7f156affd640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f154c003600 0x7f154c023a80 unknown :-1 s=CLOSED pgs=4 gs=19 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:53.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.427+0000 7f158b043640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1584140730 0x7f158413e3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:53.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.427+0000 7f158b043640 1 -- 10.20.193.58:0/189296355 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f15840b5e10 con 0x7f1584140730 2026-02-23T06:40:53.422 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.427+0000 7f1589840640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1584140730 0x7f158413e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=20 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:53.423 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.427+0000 7f1589840640 1 -- 10.20.193.58:0/189296355 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1584164250 con 0x7f1584140730 2026-02-23T06:40:53.423 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.427+0000 7f1589840640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1584140730 0x7f158413e3f0 secure :-1 s=READY pgs=5 gs=20 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1578003000 tx=0x7f15780047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:53.423 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.428+0000 7f156affd640 1 -- 10.20.193.58:0/189296355 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f157802a070 con 0x7f1584140730 2026-02-23T06:40:53.423 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.428+0000 7f156affd640 1 -- 10.20.193.58:0/189296355 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4910 (secure 0 0 0) 0x7f1578005450 con 0x7f1584140730 2026-02-23T06:40:53.423 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.428+0000 7f156affd640 1 -- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1584140730 msgr2=0x7f158413e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:53.423 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.428+0000 7f156affd640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1584140730 0x7f158413e3f0 secure :-1 s=READY pgs=5 gs=20 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1578003000 tx=0x7f15780047e0 comp rx=0 tx=0).stop 2026-02-23T06:40:53.423 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.428+0000 7f156affd640 1 -- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1584140730 msgr2=0x7f158413e3f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:40:53.423 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.428+0000 7f156affd640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1584140730 0x7f158413e3f0 secure :-1 s=CLOSED pgs=5 gs=20 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1578003000 tx=0x7f15780047e0 comp rx=0 tx=0).stop 2026-02-23T06:40:53.424 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:40:53.424 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:40:53.424 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:40:53.424 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:40:53.424 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 166, 2026-02-23T06:40:53.424 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 5288, 2026-02-23T06:40:53.425 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:40:53.425 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:40:53.425 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:40:53.425 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:40:53.425 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:53.425 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 5, 2026-02-23T06:40:53.425 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:40:53.425 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:40:53.425 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:40:53.425 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:53.425 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:53.426 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:53.426 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:53.426 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:53.426 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:53.426 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:53.426 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:53.426 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:53.426 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:53.426 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:53.426 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:53.426 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:53.426 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:53.427 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:40:53.427 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:40:53.427 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:53.427 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:53.427 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:53.427 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:53.427 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:53.427 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:53.427 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:53.427 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:53.427 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:53.427 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:53.428 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:53.428 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:53.428 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:53.428 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:53.428 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:53.428 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:40:53.428 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:40:53.428 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:40:53.428 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:40:53.428 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:40:53.428 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:40:53.428 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:40:53.429 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:40:53.429 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:40:53.429 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:40:53.429 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:40:53.429 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:40:53.429 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:40:53.429 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:40:53.429 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:40:53.429 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:40:53.429 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:40:53.429 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:40:53.430 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:40:53.430 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:40:53.430 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:40:53.430 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:40:53.430 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:40:53.430 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:40:53.430 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:40:53.430 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:40:53.430 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:40:53.430 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:40:53.430 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:40:53.430 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:40:53.431 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:53.431 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:40:53.431 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:53.431 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:40:53.431 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:53.431 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:40:53.431 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:40:53.431 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:53.431 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:53.431 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:53.431 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:53.431 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:40:53.431 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:53.432 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:53.432 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:53.432 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:53.432 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:40:53.432 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:53.432 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:53.432 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:53.432 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:53.432 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:40:53.432 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:40:53.432 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:53.432 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:53.433 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:40:53.433 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:53.433 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:53.433 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:53.433 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:40:53.433 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:40:53.433 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:53.433 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:53.433 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:53.433 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:53.433 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:40:53.433 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:53.434 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:53.434 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:53.434 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:53.434 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:40:53.434 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:53.434 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:53.434 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:53.434 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:53.434 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:40:53.434 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:40:53.434 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:53.434 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:53.434 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:40:53.435 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:53.435 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:53.435 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:53.435 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:40:53.435 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:40:53.435 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:40:53.435 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:40:53.435 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:53.435 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:40:53.435 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:40:53.435 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:53.435 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:53.436 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:53.436 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:40:53.436 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:40:53.436 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:40:53.436 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:53.436 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:53.436 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:53.436 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:40:53.436 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:40:53.436 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:40:53.436 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:40:53.436 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:40:53.437 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:40:53.437 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:53.437 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:53.437 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:53.437 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:40:53.437 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:40:53.437 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:53.437 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:53.437 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:53.437 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:40:53.437 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:53.437 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:40:53.438 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:40:53.438 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:40:53.438 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:40:53.438 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:40:53.438 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:40:53.438 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:40:53.438 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:40:53.438 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:40:53.438 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:40:53.438 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:40:53.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.428+0000 7f158a842640 1 -- 10.20.193.58:0/189296355 reap_dead start 2026-02-23T06:40:53.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.428+0000 7f158b043640 1 -- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f155407a6c0 msgr2=0x7f155409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:53.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.428+0000 7f158b043640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f155407a6c0 0x7f155409ab70 secure :-1 s=READY pgs=431 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1580005850 tx=0x7f158000a040 comp rx=0 tx=0).stop 2026-02-23T06:40:53.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.428+0000 7f158b043640 1 -- 10.20.193.58:0/189296355 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f15840b6690 msgr2=0x7f158414da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:53.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.428+0000 7f158b043640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f15840b6690 0x7f158414da40 secure :-1 s=READY pgs=351 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1574002a10 tx=0x7f1574002a40 comp rx=0 tx=0).stop 2026-02-23T06:40:53.441 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.428+0000 7f158b043640 1 -- 10.20.193.58:0/189296355 shutdown_connections 2026-02-23T06:40:53.441 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.428+0000 7f158b043640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f155407a6c0 0x7f155409ab70 unknown :-1 s=CLOSED pgs=431 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:53.441 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.428+0000 7f158b043640 1 --2- 10.20.193.58:0/189296355 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f15840b6690 0x7f158414da40 unknown :-1 s=CLOSED pgs=351 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:53.441 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.428+0000 7f158b043640 1 -- 10.20.193.58:0/189296355 >> 10.20.193.58:0/189296355 conn(0x7f15840b3c20 msgr2=0x7f15840b1160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:53.441 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.428+0000 7f158b043640 1 -- 10.20.193.58:0/189296355 shutdown_connections 2026-02-23T06:40:53.441 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.428+0000 7f158b043640 1 -- 10.20.193.58:0/189296355 wait complete. 2026-02-23T06:40:53.441 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:40:53.442 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:40:53.442 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:40:53.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.568+0000 7fc66770c640 1 -- 10.20.193.58:0/77963003 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc660163de0 msgr2=0x7fc6600b6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:53.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.568+0000 7fc66770c640 1 --2- 10.20.193.58:0/77963003 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc660163de0 0x7fc6600b6cb0 secure :-1 s=READY pgs=6 gs=3 cs=0 l=1 c_cookie=6217900388050374547 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc65c005820 tx=0x7fc65c0302b0 comp rx=0 tx=0).stop 2026-02-23T06:40:53.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.569+0000 7fc66770c640 1 -- 10.20.193.58:0/77963003 shutdown_connections 2026-02-23T06:40:53.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.569+0000 7fc66770c640 1 --2- 10.20.193.58:0/77963003 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc660163de0 0x7fc6600b6cb0 unknown :-1 s=CLOSED pgs=6 gs=3 cs=0 l=1 c_cookie=6217900388050374547 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:53.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.569+0000 7fc66770c640 1 --2- 10.20.193.58:0/77963003 >> v2:10.20.193.93:3300/0 conn(0x7fc660158b40 0x7fc6600b6770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:53.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.569+0000 7fc66770c640 1 -- 10.20.193.58:0/77963003 >> 10.20.193.58:0/77963003 conn(0x7fc6600561f0 msgr2=0x7fc6600565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:53.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.569+0000 7fc66770c640 1 -- 10.20.193.58:0/77963003 shutdown_connections 2026-02-23T06:40:53.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.569+0000 7fc66770c640 1 -- 10.20.193.58:0/77963003 wait complete. 2026-02-23T06:40:53.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.570+0000 7fc66770c640 1 Processor -- start 2026-02-23T06:40:53.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.570+0000 7fc66770c640 1 -- start start 2026-02-23T06:40:53.565 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.570+0000 7fc66770c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc6600b2b20 0x7fc660157900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:53.565 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.570+0000 7fc66770c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc660158b40 0x7fc66005c950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:53.565 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.570+0000 7fc66770c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc660163de0 0x7fc66005d5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:53.565 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.570+0000 7fc66770c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc66005bf50 con 0x7fc660158b40 2026-02-23T06:40:53.565 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.570+0000 7fc66770c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc66005e300 con 0x7fc660163de0 2026-02-23T06:40:53.565 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.570+0000 7fc66770c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc66005e5a0 con 0x7fc6600b2b20 2026-02-23T06:40:53.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.571+0000 7fc664c80640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc660158b40 0x7fc66005c950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:53.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.571+0000 7fc664c80640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc660158b40 0x7fc66005c950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:39990/0 (socket says 10.20.193.58:39990) 2026-02-23T06:40:53.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.571+0000 7fc664c80640 1 -- 10.20.193.58:0/2674695234 learned_addr learned my addr 10.20.193.58:0/2674695234 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:40:53.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.571+0000 7fc665481640 1 --2- 10.20.193.58:0/2674695234 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc6600b2b20 0x7fc660157900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:53.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.571+0000 7fc665c82640 1 --2- 10.20.193.58:0/2674695234 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc660163de0 0x7fc66005d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:53.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.571+0000 7fc664c80640 1 -- 10.20.193.58:0/2674695234 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc6600b2b20 msgr2=0x7fc660157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:53.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.571+0000 7fc664c80640 1 --2- 10.20.193.58:0/2674695234 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc6600b2b20 0x7fc660157900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:53.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.571+0000 7fc664c80640 1 -- 10.20.193.58:0/2674695234 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc660163de0 msgr2=0x7fc66005d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:53.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.571+0000 7fc664c80640 1 --2- 10.20.193.58:0/2674695234 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc660163de0 0x7fc66005d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:53.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.571+0000 7fc664c80640 1 -- 10.20.193.58:0/2674695234 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6500094b0 con 0x7fc660158b40 2026-02-23T06:40:53.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.571+0000 7fc664c80640 1 --2- 10.20.193.58:0/2674695234 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc660158b40 0x7fc66005c950 secure :-1 s=READY pgs=352 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc654007fd0 tx=0x7fc65400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:53.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.571+0000 7fc64dffb640 1 -- 10.20.193.58:0/2674695234 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc654012850 con 0x7fc660158b40 2026-02-23T06:40:53.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.571+0000 7fc64dffb640 1 -- 10.20.193.58:0/2674695234 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc654012aa0 con 0x7fc660158b40 2026-02-23T06:40:53.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.571+0000 7fc64dffb640 1 -- 10.20.193.58:0/2674695234 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc654012e70 con 0x7fc660158b40 2026-02-23T06:40:53.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.571+0000 7fc66770c640 1 -- 10.20.193.58:0/2674695234 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc65c00a590 con 0x7fc660158b40 2026-02-23T06:40:53.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.572+0000 7fc66770c640 1 -- 10.20.193.58:0/2674695234 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc66005bc70 con 0x7fc660158b40 2026-02-23T06:40:53.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.572+0000 7fc66770c640 1 -- 10.20.193.58:0/2674695234 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc660058640 con 0x7fc660158b40 2026-02-23T06:40:53.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.573+0000 7fc64dffb640 1 -- 10.20.193.58:0/2674695234 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fc65401b400 con 0x7fc660158b40 2026-02-23T06:40:53.569 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.574+0000 7fc64dffb640 1 --2- 10.20.193.58:0/2674695234 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc63007a640 0x7fc63009aaf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:40:53.569 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.574+0000 7fc64dffb640 1 -- 10.20.193.58:0/2674695234 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fc65409d920 con 0x7fc660158b40 2026-02-23T06:40:53.569 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.575+0000 7fc665481640 1 --2- 10.20.193.58:0/2674695234 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc63007a640 0x7fc63009aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:40:53.570 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.575+0000 7fc665481640 1 --2- 10.20.193.58:0/2674695234 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc63007a640 0x7fc63009aaf0 secure :-1 s=READY pgs=433 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc650004740 tx=0x7fc650005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:40:53.570 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.576+0000 7fc64dffb640 1 -- 10.20.193.58:0/2674695234 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fc654064520 con 0x7fc660158b40 2026-02-23T06:40:53.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.731+0000 7fc66770c640 1 -- 10.20.193.58:0/2674695234 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fc66015c760 con 0x7fc660158b40 2026-02-23T06:40:53.727 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.731+0000 7fc64dffb640 1 -- 10.20.193.58:0/2674695234 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fc654063c70 con 0x7fc660158b40 2026-02-23T06:40:53.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.732+0000 7fc66770c640 1 -- 10.20.193.58:0/2674695234 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc63007a640 msgr2=0x7fc63009aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:53.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.732+0000 7fc66770c640 1 --2- 10.20.193.58:0/2674695234 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc63007a640 0x7fc63009aaf0 secure :-1 s=READY pgs=433 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc650004740 tx=0x7fc650005f90 comp rx=0 tx=0).stop 2026-02-23T06:40:53.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.733+0000 7fc66770c640 1 -- 10.20.193.58:0/2674695234 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc660158b40 msgr2=0x7fc66005c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:40:53.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.733+0000 7fc66770c640 1 --2- 10.20.193.58:0/2674695234 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc660158b40 0x7fc66005c950 secure :-1 s=READY pgs=352 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc654007fd0 tx=0x7fc65400c970 comp rx=0 tx=0).stop 2026-02-23T06:40:53.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.733+0000 7fc66770c640 1 -- 10.20.193.58:0/2674695234 shutdown_connections 2026-02-23T06:40:53.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.733+0000 7fc66770c640 1 --2- 10.20.193.58:0/2674695234 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc63007a640 0x7fc63009aaf0 unknown :-1 s=CLOSED pgs=433 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:53.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.733+0000 7fc66770c640 1 --2- 10.20.193.58:0/2674695234 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc660163de0 0x7fc66005d5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:53.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.733+0000 7fc66770c640 1 --2- 10.20.193.58:0/2674695234 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc660158b40 0x7fc66005c950 unknown :-1 s=CLOSED pgs=352 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:53.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.733+0000 7fc66770c640 1 --2- 10.20.193.58:0/2674695234 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc6600b2b20 0x7fc660157900 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:40:53.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.733+0000 7fc66770c640 1 -- 10.20.193.58:0/2674695234 >> 10.20.193.58:0/2674695234 conn(0x7fc6600561f0 msgr2=0x7fc6601636b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:40:53.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.733+0000 7fc66770c640 1 -- 10.20.193.58:0/2674695234 shutdown_connections 2026-02-23T06:40:53.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:40:53.733+0000 7fc66770c640 1 -- 10.20.193.58:0/2674695234 wait complete. 2026-02-23T06:40:53.741 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:41:03.742 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:41:03.742 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:41:03.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.872+0000 7fba37577640 1 -- 10.20.193.58:0/270636627 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba3815d4a0 msgr2=0x7fba380affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:03.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.872+0000 7fba37577640 1 --2- 10.20.193.58:0/270636627 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba3815d4a0 0x7fba380affb0 secure :-1 s=READY pgs=49 gs=3 cs=0 l=1 c_cookie=14788611438083610754 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba2c004740 tx=0x7fba2c02f1e0 comp rx=0 tx=0).stop 2026-02-23T06:41:03.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.872+0000 7fba37577640 1 -- 10.20.193.58:0/270636627 shutdown_connections 2026-02-23T06:41:03.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.872+0000 7fba37577640 1 --2- 10.20.193.58:0/270636627 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fba380b6690 0x7fba38058ec0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:03.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.872+0000 7fba37577640 1 --2- 10.20.193.58:0/270636627 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba3815d4a0 0x7fba380affb0 unknown :-1 s=CLOSED pgs=49 gs=3 cs=0 l=1 c_cookie=14788611438083610754 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:03.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.872+0000 7fba37577640 1 -- 10.20.193.58:0/270636627 >> 10.20.193.58:0/270636627 conn(0x7fba380b3c20 msgr2=0x7fba380b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:03.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.872+0000 7fba37577640 1 -- 10.20.193.58:0/270636627 shutdown_connections 2026-02-23T06:41:03.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.872+0000 7fba37577640 1 -- 10.20.193.58:0/270636627 wait complete. 2026-02-23T06:41:03.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.873+0000 7fba37577640 1 Processor -- start 2026-02-23T06:41:03.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.874+0000 7fba37577640 1 -- start start 2026-02-23T06:41:03.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.874+0000 7fba37577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fba380b6690 0x7fba38162c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:03.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.874+0000 7fba37577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba3815d4a0 0x7fba380561f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:03.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.874+0000 7fba37577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba3815d870 0x7fba3811af10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:03.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.874+0000 7fba37577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fba38162020 con 0x7fba3815d4a0 2026-02-23T06:41:03.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.874+0000 7fba37577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fba38161150 con 0x7fba3815d870 2026-02-23T06:41:03.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.874+0000 7fba37577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fba38161410 con 0x7fba380b6690 2026-02-23T06:41:03.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.874+0000 7fba36575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fba380b6690 0x7fba38162c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:03.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.874+0000 7fba36575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fba380b6690 0x7fba38162c10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:48168/0 (socket says 10.20.193.58:48168) 2026-02-23T06:41:03.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.874+0000 7fba36575640 1 -- 10.20.193.58:0/4121542620 learned_addr learned my addr 10.20.193.58:0/4121542620 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:41:03.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.874+0000 7fba35d74640 1 --2- 10.20.193.58:0/4121542620 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba3815d4a0 0x7fba380561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:03.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.874+0000 7fba36d76640 1 --2- 10.20.193.58:0/4121542620 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba3815d870 0x7fba3811af10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:03.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.874+0000 7fba36575640 1 -- 10.20.193.58:0/4121542620 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba3815d870 msgr2=0x7fba3811af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:03.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.874+0000 7fba36575640 1 --2- 10.20.193.58:0/4121542620 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba3815d870 0x7fba3811af10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:03.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.874+0000 7fba36575640 1 -- 10.20.193.58:0/4121542620 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba3815d4a0 msgr2=0x7fba380561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:03.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.874+0000 7fba36575640 1 --2- 10.20.193.58:0/4121542620 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba3815d4a0 0x7fba380561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:03.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.874+0000 7fba36575640 1 -- 10.20.193.58:0/4121542620 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba2c0094b0 con 0x7fba380b6690 2026-02-23T06:41:03.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.875+0000 7fba35d74640 1 --2- 10.20.193.58:0/4121542620 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba3815d4a0 0x7fba380561f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:41:03.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.875+0000 7fba36575640 1 --2- 10.20.193.58:0/4121542620 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fba380b6690 0x7fba38162c10 secure :-1 s=READY pgs=7 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba2c009960 tx=0x7fba2c0028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:03.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.875+0000 7fba1effd640 1 -- 10.20.193.58:0/4121542620 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba2c038470 con 0x7fba380b6690 2026-02-23T06:41:03.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.875+0000 7fba1effd640 1 -- 10.20.193.58:0/4121542620 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba2c0386c0 con 0x7fba380b6690 2026-02-23T06:41:03.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.875+0000 7fba1effd640 1 -- 10.20.193.58:0/4121542620 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba2c038a90 con 0x7fba380b6690 2026-02-23T06:41:03.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.875+0000 7fba37577640 1 -- 10.20.193.58:0/4121542620 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba381616f0 con 0x7fba380b6690 2026-02-23T06:41:03.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.875+0000 7fba37577640 1 -- 10.20.193.58:0/4121542620 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fba38161cb0 con 0x7fba380b6690 2026-02-23T06:41:03.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.876+0000 7fba37577640 1 -- 10.20.193.58:0/4121542620 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba38161e70 con 0x7fba380b6690 2026-02-23T06:41:03.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.877+0000 7fba1effd640 1 -- 10.20.193.58:0/4121542620 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fba2c038bf0 con 0x7fba380b6690 2026-02-23T06:41:03.873 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.878+0000 7fba1effd640 1 --2- 10.20.193.58:0/4121542620 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fba0407a6c0 0x7fba0409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:03.873 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.878+0000 7fba1effd640 1 -- 10.20.193.58:0/4121542620 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fba2c0c2ff0 con 0x7fba380b6690 2026-02-23T06:41:03.873 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.878+0000 7fba35d74640 1 --2- 10.20.193.58:0/4121542620 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fba0407a6c0 0x7fba0409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:03.873 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.879+0000 7fba1effd640 1 -- 10.20.193.58:0/4121542620 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fba2c086330 con 0x7fba380b6690 2026-02-23T06:41:03.874 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:03.879+0000 7fba35d74640 1 --2- 10.20.193.58:0/4121542620 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fba0407a6c0 0x7fba0409ab70 secure :-1 s=READY pgs=434 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba38058450 tx=0x7fba20009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:04.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.033+0000 7fba37577640 1 -- 10.20.193.58:0/4121542620 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fba380b6d50 con 0x7fba380b6690 2026-02-23T06:41:04.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.033+0000 7fba1effd640 1 -- 10.20.193.58:0/4121542620 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7fba2c089450 con 0x7fba380b6690 2026-02-23T06:41:04.028 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":166,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:41:04.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.034+0000 7fba37577640 1 -- 10.20.193.58:0/4121542620 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fba0407a6c0 msgr2=0x7fba0409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:04.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.034+0000 7fba37577640 1 --2- 10.20.193.58:0/4121542620 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fba0407a6c0 0x7fba0409ab70 secure :-1 s=READY pgs=434 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba38058450 tx=0x7fba20009040 comp rx=0 tx=0).stop 2026-02-23T06:41:04.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.034+0000 7fba37577640 1 -- 10.20.193.58:0/4121542620 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fba380b6690 msgr2=0x7fba38162c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:04.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.034+0000 7fba37577640 1 --2- 10.20.193.58:0/4121542620 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fba380b6690 0x7fba38162c10 secure :-1 s=READY pgs=7 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba2c009960 tx=0x7fba2c0028d0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.034+0000 7fba37577640 1 -- 10.20.193.58:0/4121542620 shutdown_connections 2026-02-23T06:41:04.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.034+0000 7fba37577640 1 --2- 10.20.193.58:0/4121542620 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fba0407a6c0 0x7fba0409ab70 unknown :-1 s=CLOSED pgs=434 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.034+0000 7fba37577640 1 --2- 10.20.193.58:0/4121542620 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba3815d870 0x7fba3811af10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.034+0000 7fba37577640 1 --2- 10.20.193.58:0/4121542620 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba3815d4a0 0x7fba380561f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.034+0000 7fba37577640 1 --2- 10.20.193.58:0/4121542620 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fba380b6690 0x7fba38162c10 unknown :-1 s=CLOSED pgs=7 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.034+0000 7fba37577640 1 -- 10.20.193.58:0/4121542620 >> 10.20.193.58:0/4121542620 conn(0x7fba380b3c20 msgr2=0x7fba380b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:04.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.034+0000 7fba37577640 1 -- 10.20.193.58:0/4121542620 shutdown_connections 2026-02-23T06:41:04.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.034+0000 7fba37577640 1 -- 10.20.193.58:0/4121542620 wait complete. 2026-02-23T06:41:04.040 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:41:04.040 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:41:04.040 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:41:04.040 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:41:04.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.168+0000 7fc799283640 1 -- 10.20.193.58:0/1171289618 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc79415c040 msgr2=0x7fc79405b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:04.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.168+0000 7fc799283640 1 --2- 10.20.193.58:0/1171289618 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc79415c040 0x7fc79405b0e0 secure :-1 s=READY pgs=51 gs=3 cs=0 l=1 c_cookie=17993715865038967256 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc780005e70 tx=0x7fc78002f290 comp rx=0 tx=0).stop 2026-02-23T06:41:04.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.168+0000 7fc799283640 1 -- 10.20.193.58:0/1171289618 shutdown_connections 2026-02-23T06:41:04.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.168+0000 7fc799283640 1 --2- 10.20.193.58:0/1171289618 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc79415c040 0x7fc79405b0e0 unknown :-1 s=CLOSED pgs=51 gs=3 cs=0 l=1 c_cookie=17993715865038967256 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.168+0000 7fc799283640 1 -- 10.20.193.58:0/1171289618 >> 10.20.193.58:0/1171289618 conn(0x7fc7940b3c20 msgr2=0x7fc7940b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:04.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.168+0000 7fc799283640 1 -- 10.20.193.58:0/1171289618 shutdown_connections 2026-02-23T06:41:04.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.168+0000 7fc799283640 1 -- 10.20.193.58:0/1171289618 wait complete. 2026-02-23T06:41:04.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.169+0000 7fc799283640 1 Processor -- start 2026-02-23T06:41:04.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.169+0000 7fc799283640 1 -- start start 2026-02-23T06:41:04.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.170+0000 7fc799283640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc794056550 0x7fc7940b1740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:04.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.170+0000 7fc799283640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc7940b5680 0x7fc794157890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:04.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.170+0000 7fc799283640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc79415c040 0x7fc7941fdb60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:04.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.170+0000 7fc799283640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc7940af2d0 con 0x7fc794056550 2026-02-23T06:41:04.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.170+0000 7fc799283640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc794201920 con 0x7fc7940b5680 2026-02-23T06:41:04.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.170+0000 7fc799283640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc7940b0bd0 con 0x7fc79415c040 2026-02-23T06:41:04.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.170+0000 7fc793fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc794056550 0x7fc7940b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:04.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.170+0000 7fc793fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc794056550 0x7fc7940b1740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:60862/0 (socket says 10.20.193.58:60862) 2026-02-23T06:41:04.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.170+0000 7fc793fff640 1 -- 10.20.193.58:0/562735935 learned_addr learned my addr 10.20.193.58:0/562735935 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:41:04.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.170+0000 7fc7937fe640 1 --2- 10.20.193.58:0/562735935 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc7940b5680 0x7fc794157890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:04.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.170+0000 7fc798a82640 1 --2- 10.20.193.58:0/562735935 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc79415c040 0x7fc7941fdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:04.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.170+0000 7fc793fff640 1 -- 10.20.193.58:0/562735935 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc79415c040 msgr2=0x7fc7941fdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:04.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.170+0000 7fc793fff640 1 --2- 10.20.193.58:0/562735935 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc79415c040 0x7fc7941fdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.170+0000 7fc793fff640 1 -- 10.20.193.58:0/562735935 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc7940b5680 msgr2=0x7fc794157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:04.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.170+0000 7fc793fff640 1 --2- 10.20.193.58:0/562735935 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc7940b5680 0x7fc794157890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.170+0000 7fc793fff640 1 -- 10.20.193.58:0/562735935 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc780009570 con 0x7fc794056550 2026-02-23T06:41:04.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.170+0000 7fc793fff640 1 --2- 10.20.193.58:0/562735935 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc794056550 0x7fc7940b1740 secure :-1 s=READY pgs=354 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc780004740 tx=0x7fc780002a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:04.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.171+0000 7fc790ff9640 1 -- 10.20.193.58:0/562735935 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc78003d070 con 0x7fc794056550 2026-02-23T06:41:04.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.171+0000 7fc790ff9640 1 -- 10.20.193.58:0/562735935 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc780038690 con 0x7fc794056550 2026-02-23T06:41:04.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.171+0000 7fc799283640 1 -- 10.20.193.58:0/562735935 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc794161960 con 0x7fc794056550 2026-02-23T06:41:04.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.171+0000 7fc799283640 1 -- 10.20.193.58:0/562735935 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc794161c00 con 0x7fc794056550 2026-02-23T06:41:04.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.171+0000 7fc790ff9640 1 -- 10.20.193.58:0/562735935 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc780038aa0 con 0x7fc794056550 2026-02-23T06:41:04.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.171+0000 7fc799283640 1 --2- 10.20.193.58:0/562735935 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc79415f840 0x7fc7941fe0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:04.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.171+0000 7fc799283640 1 -- 10.20.193.58:0/562735935 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc79415c410 con 0x7fc79415f840 2026-02-23T06:41:04.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.171+0000 7fc7937fe640 1 --2- 10.20.193.58:0/562735935 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc79415f840 0x7fc7941fe0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:04.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.172+0000 7fc7937fe640 1 -- 10.20.193.58:0/562735935 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc79405b620 con 0x7fc79415f840 2026-02-23T06:41:04.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.172+0000 7fc7937fe640 1 --2- 10.20.193.58:0/562735935 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc79415f840 0x7fc7941fe0a0 secure :-1 s=READY pgs=355 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7941562b0 tx=0x7fc78400eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:04.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.172+0000 7fc790ff9640 1 -- 10.20.193.58:0/562735935 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc78400c880 con 0x7fc79415f840 2026-02-23T06:41:04.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.172+0000 7fc790ff9640 1 -- 10.20.193.58:0/562735935 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fc78400c9e0 con 0x7fc79415f840 2026-02-23T06:41:04.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.172+0000 7fc790ff9640 1 -- 10.20.193.58:0/562735935 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc79415f840 msgr2=0x7fc7941fe0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:04.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.172+0000 7fc790ff9640 1 --2- 10.20.193.58:0/562735935 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc79415f840 0x7fc7941fe0a0 secure :-1 s=READY pgs=355 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7941562b0 tx=0x7fc78400eba0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.172+0000 7fc790ff9640 1 -- 10.20.193.58:0/562735935 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc79415f840 msgr2=0x7fc7941fe0a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:41:04.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.172+0000 7fc790ff9640 1 --2- 10.20.193.58:0/562735935 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc79415f840 0x7fc7941fe0a0 secure :-1 s=CLOSED pgs=355 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7941562b0 tx=0x7fc78400eba0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.173+0000 7fc790ff9640 1 -- 10.20.193.58:0/562735935 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fc780038c00 con 0x7fc794056550 2026-02-23T06:41:04.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.174+0000 7fc790ff9640 1 --2- 10.20.193.58:0/562735935 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc76407a430 0x7fc76409a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:04.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.174+0000 7fc790ff9640 1 -- 10.20.193.58:0/562735935 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fc78008ebd0 con 0x7fc794056550 2026-02-23T06:41:04.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.174+0000 7fc7937fe640 1 --2- 10.20.193.58:0/562735935 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc76407a430 0x7fc76409a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:04.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.175+0000 7fc7937fe640 1 --2- 10.20.193.58:0/562735935 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc76407a430 0x7fc76409a8e0 secure :-1 s=READY pgs=435 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc784017040 tx=0x7fc784014000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:04.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.176+0000 7fc799283640 1 --2- 10.20.193.58:0/562735935 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7940aeab0 0x7fc7941512d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:04.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.176+0000 7fc799283640 1 -- 10.20.193.58:0/562735935 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc794161e10 con 0x7fc7940aeab0 2026-02-23T06:41:04.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.176+0000 7fc798a82640 1 --2- 10.20.193.58:0/562735935 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7940aeab0 0x7fc7941512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:04.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.176+0000 7fc798a82640 1 -- 10.20.193.58:0/562735935 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc794163680 con 0x7fc7940aeab0 2026-02-23T06:41:04.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.176+0000 7fc798a82640 1 --2- 10.20.193.58:0/562735935 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7940aeab0 0x7fc7941512d0 secure :-1 s=READY pgs=356 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc788004850 tx=0x7fc78800f990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:04.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.176+0000 7fc790ff9640 1 -- 10.20.193.58:0/562735935 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc788007da0 con 0x7fc7940aeab0 2026-02-23T06:41:04.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.177+0000 7fc790ff9640 1 -- 10.20.193.58:0/562735935 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5559 (secure 0 0 0) 0x7fc788008030 con 0x7fc7940aeab0 2026-02-23T06:41:04.174 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:41:04.175 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:41:04.175 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:41:04.175 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:41:04.175 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 166, 2026-02-23T06:41:04.175 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 471687, 2026-02-23T06:41:04.175 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:41:04.175 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:41:04.175 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:41:04.175 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:41:04.175 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:04.175 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 16, 2026-02-23T06:41:04.176 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:41:04.176 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:41:04.176 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:41:04.176 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:04.176 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:04.176 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:04.176 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:04.176 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:04.176 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:04.176 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:04.176 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:04.176 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:04.177 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:04.177 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:04.177 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:04.177 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:04.177 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:04.177 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:41:04.177 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:41:04.177 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:04.177 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:04.177 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:04.177 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:04.177 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:04.178 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:04.178 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:04.178 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:04.178 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:04.178 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:04.178 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:04.178 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:04.178 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:04.178 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:04.178 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.178 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:41:04.178 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:41:04.179 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:41:04.179 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:41:04.179 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:41:04.179 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:41:04.179 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:41:04.179 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:41:04.179 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:41:04.179 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:41:04.179 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:41:04.179 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:41:04.179 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:41:04.180 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:41:04.180 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:41:04.180 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:41:04.180 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:41:04.180 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:04.180 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:04.180 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:04.180 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:04.180 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:04.180 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:04.180 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:04.180 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:04.181 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:04.181 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:04.181 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:04.181 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:04.181 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:04.181 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:04.181 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:41:04.181 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.181 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:41:04.181 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.181 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:41:04.181 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:41:04.182 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:04.182 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:04.182 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.182 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:04.182 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:41:04.182 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:04.182 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.182 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.182 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:04.182 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:41:04.182 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:04.182 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:04.182 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:04.183 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.183 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:41:04.183 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:41:04.183 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:04.183 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:04.183 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:41:04.183 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:04.183 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.183 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.183 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:41:04.183 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:41:04.183 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:04.184 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:04.184 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.184 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:04.184 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:41:04.184 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:04.184 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.184 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.184 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:04.184 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:41:04.184 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:04.184 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:04.184 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:04.185 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.185 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:41:04.185 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:41:04.185 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:04.185 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:04.185 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:41:04.185 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:04.185 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.185 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.185 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:41:04.185 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:41:04.185 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:04.185 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:04.186 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.186 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:04.186 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:41:04.186 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:04.186 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.186 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.186 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:04.186 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:41:04.186 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:04.186 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:04.186 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:04.186 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.187 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:41:04.187 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:41:04.187 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:04.187 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:04.187 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:41:04.187 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:04.187 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:04.187 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:04.187 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.187 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:41:04.187 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:41:04.187 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.187 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:04.188 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:04.188 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:41:04.188 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:04.188 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:04.188 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:41:04.188 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.188 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:04.188 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:04.188 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:41:04.188 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:04.188 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:04.188 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:41:04.188 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.189 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:04.189 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:04.189 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:41:04.189 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:04.189 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:04.189 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:41:04.189 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.189 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:41:04.189 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:41:04.189 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:41:04.189 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.189 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.190 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:04.190 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:04.190 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:41:04.190 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:04.190 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:04.190 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:41:04.190 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.190 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:04.190 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:04.190 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:41:04.190 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:04.190 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:04.190 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.191 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:41:04.191 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:41:04.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.177+0000 7fc790ff9640 1 -- 10.20.193.58:0/562735935 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7940aeab0 msgr2=0x7fc7941512d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:04.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.177+0000 7fc790ff9640 1 --2- 10.20.193.58:0/562735935 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7940aeab0 0x7fc7941512d0 secure :-1 s=READY pgs=356 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc788004850 tx=0x7fc78800f990 comp rx=0 tx=0).stop 2026-02-23T06:41:04.193 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.177+0000 7fc790ff9640 1 -- 10.20.193.58:0/562735935 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7940aeab0 msgr2=0x7fc7941512d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:41:04.193 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.177+0000 7fc790ff9640 1 --2- 10.20.193.58:0/562735935 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7940aeab0 0x7fc7941512d0 unknown :-1 s=CLOSED pgs=356 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.193 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.177+0000 7fc799283640 1 -- 10.20.193.58:0/562735935 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc76407a430 msgr2=0x7fc76409a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:04.193 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.177+0000 7fc799283640 1 --2- 10.20.193.58:0/562735935 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc76407a430 0x7fc76409a8e0 secure :-1 s=READY pgs=435 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc784017040 tx=0x7fc784014000 comp rx=0 tx=0).stop 2026-02-23T06:41:04.193 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.177+0000 7fc799283640 1 -- 10.20.193.58:0/562735935 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc794056550 msgr2=0x7fc7940b1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:04.193 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.177+0000 7fc799283640 1 --2- 10.20.193.58:0/562735935 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc794056550 0x7fc7940b1740 secure :-1 s=READY pgs=354 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc780004740 tx=0x7fc780002a10 comp rx=0 tx=0).stop 2026-02-23T06:41:04.193 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.177+0000 7fc798a82640 1 -- 10.20.193.58:0/562735935 reap_dead start 2026-02-23T06:41:04.193 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.177+0000 7fc799283640 1 -- 10.20.193.58:0/562735935 shutdown_connections 2026-02-23T06:41:04.193 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.177+0000 7fc799283640 1 --2- 10.20.193.58:0/562735935 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc794056550 0x7fc7940b1740 unknown :-1 s=CLOSED pgs=354 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.193 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.177+0000 7fc799283640 1 -- 10.20.193.58:0/562735935 >> 10.20.193.58:0/562735935 conn(0x7fc7940b3c20 msgr2=0x7fc79415a550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:04.193 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.177+0000 7fc799283640 1 -- 10.20.193.58:0/562735935 shutdown_connections 2026-02-23T06:41:04.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.177+0000 7fc799283640 1 -- 10.20.193.58:0/562735935 wait complete. 2026-02-23T06:41:04.194 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:41:04.194 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:41:04.195 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:41:04.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.322+0000 7f2f41c83640 1 -- 10.20.193.58:0/2241846762 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2f3c15d870 msgr2=0x7f2f3c0587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:04.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.322+0000 7f2f41c83640 1 --2- 10.20.193.58:0/2241846762 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2f3c15d870 0x7f2f3c0587b0 secure :-1 s=READY pgs=357 gs=2 cs=0 l=1 c_cookie=7577971848503616852 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f3c0b1b90 tx=0x7f2f2402f250 comp rx=0 tx=0).stop 2026-02-23T06:41:04.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.322+0000 7f2f41c83640 1 -- 10.20.193.58:0/2241846762 shutdown_connections 2026-02-23T06:41:04.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.322+0000 7f2f41c83640 1 --2- 10.20.193.58:0/2241846762 >> v2:10.20.193.93:3300/0 conn(0x7f2f3c0b6690 0x7f2f3c058cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.322+0000 7f2f41c83640 1 --2- 10.20.193.58:0/2241846762 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2f3c15d870 0x7f2f3c0587b0 unknown :-1 s=CLOSED pgs=357 gs=2 cs=0 l=1 c_cookie=7577971848503616852 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.322+0000 7f2f41c83640 1 --2- 10.20.193.58:0/2241846762 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f3c15d4a0 0x7f2f3c0affb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.322+0000 7f2f41c83640 1 -- 10.20.193.58:0/2241846762 >> 10.20.193.58:0/2241846762 conn(0x7f2f3c0b3c20 msgr2=0x7f2f3c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:04.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.322+0000 7f2f41c83640 1 -- 10.20.193.58:0/2241846762 shutdown_connections 2026-02-23T06:41:04.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.322+0000 7f2f41c83640 1 -- 10.20.193.58:0/2241846762 wait complete. 2026-02-23T06:41:04.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.323+0000 7f2f41c83640 1 Processor -- start 2026-02-23T06:41:04.320 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.324+0000 7f2f41c83640 1 -- start start 2026-02-23T06:41:04.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.324+0000 7f2f41c83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f3c0b6690 0x7f2f3c13d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:04.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.324+0000 7f2f41c83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2f3c15d4a0 0x7f2f3c122880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:04.325 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.324+0000 7f2f41c83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2f3c15d870 0x7f2f3c122dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:04.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.324+0000 7f2f41c83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f2f3c11ec20 con 0x7f2f3c15d870 2026-02-23T06:41:04.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.324+0000 7f2f41c83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f2f3c0567c0 con 0x7f2f3c15d4a0 2026-02-23T06:41:04.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.324+0000 7f2f41c83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f2f3c13cda0 con 0x7f2f3c0b6690 2026-02-23T06:41:04.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.324+0000 7f2f41482640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2f3c15d870 0x7f2f3c122dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:04.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.324+0000 7f2f40c81640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f3c0b6690 0x7f2f3c13d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:04.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.324+0000 7f2f41482640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2f3c15d870 0x7f2f3c122dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:60894/0 (socket says 10.20.193.58:60894) 2026-02-23T06:41:04.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.324+0000 7f2f41482640 1 -- 10.20.193.58:0/2865661164 learned_addr learned my addr 10.20.193.58:0/2865661164 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:41:04.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.324+0000 7f2f33fff640 1 --2- 10.20.193.58:0/2865661164 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2f3c15d4a0 0x7f2f3c122880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:04.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.325+0000 7f2f41482640 1 -- 10.20.193.58:0/2865661164 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f3c0b6690 msgr2=0x7f2f3c13d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:04.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.325+0000 7f2f41482640 1 --2- 10.20.193.58:0/2865661164 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2f3c0b6690 0x7f2f3c13d920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.325+0000 7f2f41482640 1 -- 10.20.193.58:0/2865661164 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2f3c15d4a0 msgr2=0x7f2f3c122880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:04.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.325+0000 7f2f41482640 1 --2- 10.20.193.58:0/2865661164 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2f3c15d4a0 0x7f2f3c122880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.325+0000 7f2f41482640 1 -- 10.20.193.58:0/2865661164 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f24009570 con 0x7f2f3c15d870 2026-02-23T06:41:04.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.325+0000 7f2f41482640 1 --2- 10.20.193.58:0/2865661164 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2f3c15d870 0x7f2f3c122dc0 secure :-1 s=READY pgs=358 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f3800f940 tx=0x7f2f3800fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:04.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.325+0000 7f2f317fa640 1 -- 10.20.193.58:0/2865661164 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f3800dce0 con 0x7f2f3c15d870 2026-02-23T06:41:04.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.325+0000 7f2f41c83640 1 -- 10.20.193.58:0/2865661164 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f3c11e0e0 con 0x7f2f3c15d870 2026-02-23T06:41:04.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.325+0000 7f2f41c83640 1 -- 10.20.193.58:0/2865661164 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f3c11e380 con 0x7f2f3c15d870 2026-02-23T06:41:04.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.325+0000 7f2f317fa640 1 -- 10.20.193.58:0/2865661164 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f3800de40 con 0x7f2f3c15d870 2026-02-23T06:41:04.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.325+0000 7f2f317fa640 1 -- 10.20.193.58:0/2865661164 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f38005bb0 con 0x7f2f3c15d870 2026-02-23T06:41:04.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.325+0000 7f2f41c83640 1 --2- 10.20.193.58:0/2865661164 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2efc0041f0 0x7f2efc0246a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:04.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.326+0000 7f2f41c83640 1 -- 10.20.193.58:0/2865661164 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc025f20 con 0x7f2efc0041f0 2026-02-23T06:41:04.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.326+0000 7f2f40c81640 1 --2- 10.20.193.58:0/2865661164 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2efc0041f0 0x7f2efc0246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:04.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.326+0000 7f2f40c81640 1 -- 10.20.193.58:0/2865661164 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2efc0260e0 con 0x7f2efc0041f0 2026-02-23T06:41:04.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.327+0000 7f2f40c81640 1 --2- 10.20.193.58:0/2865661164 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2efc0041f0 0x7f2efc0246a0 secure :-1 s=READY pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f2c002fc0 tx=0x7f2f2c009ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:04.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.327+0000 7f2f317fa640 1 -- 10.20.193.58:0/2865661164 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f2f38020060 con 0x7f2f3c15d870 2026-02-23T06:41:04.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.327+0000 7f2f317fa640 1 --2- 10.20.193.58:0/2865661164 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2f0c07a5f0 0x7f2f0c09aaa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:04.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.327+0000 7f2f317fa640 1 -- 10.20.193.58:0/2865661164 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f2c011030 con 0x7f2efc0041f0 2026-02-23T06:41:04.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.327+0000 7f2f317fa640 1 -- 10.20.193.58:0/2865661164 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f2f2c011190 con 0x7f2efc0041f0 2026-02-23T06:41:04.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.327+0000 7f2f317fa640 1 -- 10.20.193.58:0/2865661164 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2efc0041f0 msgr2=0x7f2efc0246a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:04.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.327+0000 7f2f317fa640 1 --2- 10.20.193.58:0/2865661164 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2efc0041f0 0x7f2efc0246a0 secure :-1 s=READY pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f2c002fc0 tx=0x7f2f2c009ac0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.328+0000 7f2f317fa640 1 -- 10.20.193.58:0/2865661164 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2efc0041f0 msgr2=0x7f2efc0246a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:41:04.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.328+0000 7f2f317fa640 1 --2- 10.20.193.58:0/2865661164 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2efc0041f0 0x7f2efc0246a0 secure :-1 s=CLOSED pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f2c002fc0 tx=0x7f2f2c009ac0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.328+0000 7f2f317fa640 1 -- 10.20.193.58:0/2865661164 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f2f38015070 con 0x7f2f3c15d870 2026-02-23T06:41:04.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.328+0000 7f2f33fff640 1 --2- 10.20.193.58:0/2865661164 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2f0c07a5f0 0x7f2f0c09aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:04.329 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.328+0000 7f2f33fff640 1 --2- 10.20.193.58:0/2865661164 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2f0c07a5f0 0x7f2f0c09aaa0 secure :-1 s=READY pgs=436 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f24004740 tx=0x7f2f24031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:04.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.331+0000 7f2f41c83640 1 --2- 10.20.193.58:0/2865661164 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2efc024fe0 0x7f2efc025430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:04.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.331+0000 7f2f41c83640 1 -- 10.20.193.58:0/2865661164 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc025b30 con 0x7f2efc024fe0 2026-02-23T06:41:04.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.331+0000 7f2f40c81640 1 --2- 10.20.193.58:0/2865661164 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2efc024fe0 0x7f2efc025430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:04.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.332+0000 7f2f40c81640 1 -- 10.20.193.58:0/2865661164 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2efc025cf0 con 0x7f2efc024fe0 2026-02-23T06:41:04.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.332+0000 7f2f40c81640 1 --2- 10.20.193.58:0/2865661164 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2efc024fe0 0x7f2efc025430 secure :-1 s=READY pgs=53 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f2c011000 tx=0x7f2f2c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:04.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.332+0000 7f2f317fa640 1 -- 10.20.193.58:0/2865661164 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f2c024070 con 0x7f2efc024fe0 2026-02-23T06:41:04.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.332+0000 7f2f317fa640 1 -- 10.20.193.58:0/2865661164 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5413 (secure 0 0 0) 0x7f2f2c01e050 con 0x7f2efc024fe0 2026-02-23T06:41:04.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.332+0000 7f2f317fa640 1 -- 10.20.193.58:0/2865661164 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2efc024fe0 msgr2=0x7f2efc025430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:04.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.332+0000 7f2f317fa640 1 --2- 10.20.193.58:0/2865661164 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2efc024fe0 0x7f2efc025430 secure :-1 s=READY pgs=53 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f2c011000 tx=0x7f2f2c004770 comp rx=0 tx=0).stop 2026-02-23T06:41:04.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.332+0000 7f2f317fa640 1 -- 10.20.193.58:0/2865661164 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2efc024fe0 msgr2=0x7f2efc025430 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:41:04.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.332+0000 7f2f317fa640 1 --2- 10.20.193.58:0/2865661164 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2efc024fe0 0x7f2efc025430 secure :-1 s=CLOSED pgs=53 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f2c011000 tx=0x7f2f2c004770 comp rx=0 tx=0).stop 2026-02-23T06:41:04.331 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:41:04.331 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:41:04.331 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:41:04.332 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:41:04.332 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 166, 2026-02-23T06:41:04.332 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 68422, 2026-02-23T06:41:04.332 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:41:04.332 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:41:04.332 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:41:04.332 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:41:04.332 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:04.332 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 16, 2026-02-23T06:41:04.332 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:41:04.332 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:41:04.333 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:41:04.333 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:04.333 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:04.333 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:04.333 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:04.333 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:04.333 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:04.333 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:04.333 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:04.333 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:04.333 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:04.333 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:04.334 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:04.334 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:04.334 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:04.334 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:41:04.334 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:41:04.334 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:04.334 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:04.334 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:04.334 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:04.334 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:04.334 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:04.334 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:04.335 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:04.335 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:04.335 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:04.335 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:04.335 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:04.335 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:04.335 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:04.335 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.335 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:41:04.335 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:41:04.335 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:41:04.335 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:41:04.336 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:41:04.336 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:41:04.336 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:41:04.336 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:41:04.336 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:41:04.336 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:41:04.336 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:41:04.336 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:41:04.336 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:41:04.336 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:41:04.336 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:41:04.336 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:41:04.337 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:41:04.337 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:04.337 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:04.337 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:04.337 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:04.337 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:04.337 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:04.337 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:04.337 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:04.337 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:04.337 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:04.337 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:04.337 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:04.338 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:04.338 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:04.338 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:41:04.338 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.338 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:41:04.338 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.338 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:41:04.338 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:41:04.338 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:04.338 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:04.338 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.338 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:04.338 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:41:04.339 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:04.339 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.339 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.339 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:04.339 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:41:04.339 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:04.339 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:04.339 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:04.339 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.339 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:41:04.339 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:41:04.339 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:04.340 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:04.340 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:41:04.340 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:04.340 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.340 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.340 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:41:04.340 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:41:04.340 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:04.340 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:04.340 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.340 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:04.340 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:41:04.341 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:04.341 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.341 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.341 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:04.341 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:41:04.341 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:04.341 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:04.341 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:04.341 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.341 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:41:04.341 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:41:04.341 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:04.341 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:04.342 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:41:04.342 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:04.342 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.342 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.342 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:41:04.342 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:41:04.342 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:04.342 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:04.342 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.342 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:04.342 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:41:04.342 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:04.342 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.343 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.343 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:04.343 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:41:04.343 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:04.343 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:04.343 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:04.343 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.343 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:41:04.343 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:41:04.343 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:04.343 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:04.343 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:41:04.343 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:04.344 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:04.344 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:04.344 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.344 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:41:04.344 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:41:04.344 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.344 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:04.344 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:04.344 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:41:04.344 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:04.344 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:04.344 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:41:04.345 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.345 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:04.345 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:04.345 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:41:04.345 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:04.345 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:04.345 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:41:04.345 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.345 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:04.345 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:04.345 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:41:04.345 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:04.346 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:04.346 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:41:04.346 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.346 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:04.346 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:04.346 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:41:04.346 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:04.346 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:04.346 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:41:04.346 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.346 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:04.346 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:04.346 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:41:04.347 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:04.347 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:04.347 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.347 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:41:04.347 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:41:04.348 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.333+0000 7f2f41c83640 1 -- 10.20.193.58:0/2865661164 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2f0c07a5f0 msgr2=0x7f2f0c09aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:04.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.333+0000 7f2f41c83640 1 --2- 10.20.193.58:0/2865661164 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2f0c07a5f0 0x7f2f0c09aaa0 secure :-1 s=READY pgs=436 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f24004740 tx=0x7f2f24031040 comp rx=0 tx=0).stop 2026-02-23T06:41:04.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.333+0000 7f2f41c83640 1 -- 10.20.193.58:0/2865661164 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2f3c15d870 msgr2=0x7f2f3c122dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:04.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.333+0000 7f2f41c83640 1 --2- 10.20.193.58:0/2865661164 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2f3c15d870 0x7f2f3c122dc0 secure :-1 s=READY pgs=358 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f3800f940 tx=0x7f2f3800fe10 comp rx=0 tx=0).stop 2026-02-23T06:41:04.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.333+0000 7f2f41482640 1 -- 10.20.193.58:0/2865661164 reap_dead start 2026-02-23T06:41:04.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.333+0000 7f2f41482640 1 -- 10.20.193.58:0/2865661164 reap_dead start 2026-02-23T06:41:04.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.333+0000 7f2f41c83640 1 -- 10.20.193.58:0/2865661164 shutdown_connections 2026-02-23T06:41:04.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.333+0000 7f2f41c83640 1 -- 10.20.193.58:0/2865661164 >> 10.20.193.58:0/2865661164 conn(0x7f2f3c0b3c20 msgr2=0x7f2f3c15bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:04.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.333+0000 7f2f41c83640 1 -- 10.20.193.58:0/2865661164 shutdown_connections 2026-02-23T06:41:04.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.333+0000 7f2f41c83640 1 -- 10.20.193.58:0/2865661164 wait complete. 2026-02-23T06:41:04.350 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:41:04.350 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:41:04.350 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:41:04.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.477+0000 7faa9f1d2640 1 -- 10.20.193.58:0/1083658768 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa9815d4a0 msgr2=0x7faa980affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:04.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.477+0000 7faa9f1d2640 1 --2- 10.20.193.58:0/1083658768 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa9815d4a0 0x7faa980affb0 secure :-1 s=READY pgs=8 gs=3 cs=0 l=1 c_cookie=9250819796349017990 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa980b5230 tx=0x7faa8802f170 comp rx=0 tx=0).stop 2026-02-23T06:41:04.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.477+0000 7faa9f1d2640 1 -- 10.20.193.58:0/1083658768 shutdown_connections 2026-02-23T06:41:04.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.477+0000 7faa9f1d2640 1 --2- 10.20.193.58:0/1083658768 >> v2:10.20.193.93:3300/0 conn(0x7faa9815d870 0x7faa980587b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.477+0000 7faa9f1d2640 1 --2- 10.20.193.58:0/1083658768 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa9815d4a0 0x7faa980affb0 unknown :-1 s=CLOSED pgs=8 gs=3 cs=0 l=1 c_cookie=9250819796349017990 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.477+0000 7faa9f1d2640 1 -- 10.20.193.58:0/1083658768 >> 10.20.193.58:0/1083658768 conn(0x7faa980b3c20 msgr2=0x7faa980b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:04.474 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.477+0000 7faa9f1d2640 1 -- 10.20.193.58:0/1083658768 shutdown_connections 2026-02-23T06:41:04.474 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.477+0000 7faa9f1d2640 1 -- 10.20.193.58:0/1083658768 wait complete. 2026-02-23T06:41:04.476 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.478+0000 7faa9f1d2640 1 Processor -- start 2026-02-23T06:41:04.476 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.479+0000 7faa9f1d2640 1 -- start start 2026-02-23T06:41:04.476 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.479+0000 7faa9f1d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa980b6690 0x7faa98160610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:04.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.479+0000 7faa9f1d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa9815d4a0 0x7faa98142480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:04.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.479+0000 7faa9f1d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa9815d870 0x7faa98140af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:04.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.479+0000 7faa9f1d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7faa98161680 con 0x7faa9815d4a0 2026-02-23T06:41:04.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.479+0000 7faa9f1d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7faa98142e20 con 0x7faa9815d870 2026-02-23T06:41:04.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.479+0000 7faa9f1d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7faa98141700 con 0x7faa980b6690 2026-02-23T06:41:04.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.479+0000 7faa9d9cf640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa9815d4a0 0x7faa98142480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:04.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.479+0000 7faa9d9cf640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa9815d4a0 0x7faa98142480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:60896/0 (socket says 10.20.193.58:60896) 2026-02-23T06:41:04.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.479+0000 7faa9d9cf640 1 -- 10.20.193.58:0/70656762 learned_addr learned my addr 10.20.193.58:0/70656762 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:41:04.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.479+0000 7faa9e1d0640 1 --2- 10.20.193.58:0/70656762 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa980b6690 0x7faa98160610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:04.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.480+0000 7faa9e9d1640 1 --2- 10.20.193.58:0/70656762 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa9815d870 0x7faa98140af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:04.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.480+0000 7faa9d9cf640 1 -- 10.20.193.58:0/70656762 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa980b6690 msgr2=0x7faa98160610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:04.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.480+0000 7faa9d9cf640 1 --2- 10.20.193.58:0/70656762 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa980b6690 0x7faa98160610 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.480+0000 7faa9d9cf640 1 -- 10.20.193.58:0/70656762 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa9815d870 msgr2=0x7faa98140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:04.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.480+0000 7faa9d9cf640 1 --2- 10.20.193.58:0/70656762 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa9815d870 0x7faa98140af0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.480+0000 7faa9d9cf640 1 -- 10.20.193.58:0/70656762 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa880094b0 con 0x7faa9815d4a0 2026-02-23T06:41:04.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.480+0000 7faa9d9cf640 1 --2- 10.20.193.58:0/70656762 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa9815d4a0 0x7faa98142480 secure :-1 s=READY pgs=360 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa8c00e9c0 tx=0x7faa8c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:04.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.480+0000 7faa7effd640 1 -- 10.20.193.58:0/70656762 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa8c00ccb0 con 0x7faa9815d4a0 2026-02-23T06:41:04.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.480+0000 7faa9f1d2640 1 -- 10.20.193.58:0/70656762 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa981430e0 con 0x7faa9815d4a0 2026-02-23T06:41:04.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.480+0000 7faa7effd640 1 -- 10.20.193.58:0/70656762 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa8c00ce10 con 0x7faa9815d4a0 2026-02-23T06:41:04.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.480+0000 7faa9f1d2640 1 -- 10.20.193.58:0/70656762 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa98161310 con 0x7faa9815d4a0 2026-02-23T06:41:04.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.480+0000 7faa7effd640 1 -- 10.20.193.58:0/70656762 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa8c00ccb0 con 0x7faa9815d4a0 2026-02-23T06:41:04.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.481+0000 7faa9f1d2640 1 --2- 10.20.193.58:0/70656762 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa9813e430 0x7faa98141030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:04.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.481+0000 7faa9f1d2640 1 -- 10.20.193.58:0/70656762 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7faa980b6330 con 0x7faa9813e430 2026-02-23T06:41:04.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.481+0000 7faa9e1d0640 1 --2- 10.20.193.58:0/70656762 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa9813e430 0x7faa98141030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:04.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.481+0000 7faa9e1d0640 1 -- 10.20.193.58:0/70656762 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faa980b5e10 con 0x7faa9813e430 2026-02-23T06:41:04.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.481+0000 7faa9e1d0640 1 --2- 10.20.193.58:0/70656762 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa9813e430 0x7faa98141030 secure :-1 s=READY pgs=9 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa980b5230 tx=0x7faa8802feb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:04.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.482+0000 7faa7effd640 1 -- 10.20.193.58:0/70656762 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa8803d040 con 0x7faa9813e430 2026-02-23T06:41:04.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.482+0000 7faa7effd640 1 -- 10.20.193.58:0/70656762 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7faa8c01f060 con 0x7faa9815d4a0 2026-02-23T06:41:04.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.483+0000 7faa7effd640 1 --2- 10.20.193.58:0/70656762 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa6807a660 0x7faa6809ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:04.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.483+0000 7faa7effd640 1 -- 10.20.193.58:0/70656762 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7faa8c014070 con 0x7faa9815d4a0 2026-02-23T06:41:04.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.483+0000 7faa7effd640 1 -- 10.20.193.58:0/70656762 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7faa88038470 con 0x7faa9813e430 2026-02-23T06:41:04.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.483+0000 7faa7effd640 1 -- 10.20.193.58:0/70656762 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa9813e430 msgr2=0x7faa98141030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:04.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.483+0000 7faa7effd640 1 --2- 10.20.193.58:0/70656762 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa9813e430 0x7faa98141030 secure :-1 s=READY pgs=9 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa980b5230 tx=0x7faa8802feb0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.483+0000 7faa7effd640 1 -- 10.20.193.58:0/70656762 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa9813e430 msgr2=0x7faa98141030 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:41:04.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.483+0000 7faa7effd640 1 --2- 10.20.193.58:0/70656762 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa9813e430 0x7faa98141030 unknown :-1 s=CLOSED pgs=9 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.483+0000 7faa9e9d1640 1 --2- 10.20.193.58:0/70656762 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa6807a660 0x7faa6809ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:04.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.484+0000 7faa9e9d1640 1 --2- 10.20.193.58:0/70656762 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa6807a660 0x7faa6809ab10 secure :-1 s=READY pgs=437 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa98140260 tx=0x7faa9400a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:04.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.487+0000 7faa9f1d2640 1 --2- 10.20.193.58:0/70656762 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa98161b10 0x7faa98161f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:04.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.487+0000 7faa9f1d2640 1 -- 10.20.193.58:0/70656762 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7faa980b6d50 con 0x7faa98161b10 2026-02-23T06:41:04.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.487+0000 7faa9e1d0640 1 --2- 10.20.193.58:0/70656762 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa98161b10 0x7faa98161f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:04.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.487+0000 7faa9e1d0640 1 -- 10.20.193.58:0/70656762 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faa98142a20 con 0x7faa98161b10 2026-02-23T06:41:04.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.488+0000 7faa9e1d0640 1 --2- 10.20.193.58:0/70656762 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa98161b10 0x7faa98161f10 secure :-1 s=READY pgs=10 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa88042000 tx=0x7faa88005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:04.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.488+0000 7faa7effd640 1 -- 10.20.193.58:0/70656762 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa88038ad0 con 0x7faa98161b10 2026-02-23T06:41:04.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.488+0000 7faa7effd640 1 -- 10.20.193.58:0/70656762 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4912 (secure 0 0 0) 0x7faa88038c30 con 0x7faa98161b10 2026-02-23T06:41:04.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.488+0000 7faa7effd640 1 -- 10.20.193.58:0/70656762 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa98161b10 msgr2=0x7faa98161f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:04.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.488+0000 7faa7effd640 1 --2- 10.20.193.58:0/70656762 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa98161b10 0x7faa98161f10 secure :-1 s=READY pgs=10 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa88042000 tx=0x7faa88005f90 comp rx=0 tx=0).stop 2026-02-23T06:41:04.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.488+0000 7faa7effd640 1 -- 10.20.193.58:0/70656762 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa98161b10 msgr2=0x7faa98161f10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:41:04.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.488+0000 7faa7effd640 1 --2- 10.20.193.58:0/70656762 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa98161b10 0x7faa98161f10 unknown :-1 s=CLOSED pgs=10 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.484 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:41:04.484 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:41:04.484 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:41:04.485 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:41:04.485 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 166, 2026-02-23T06:41:04.485 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 16349, 2026-02-23T06:41:04.485 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:41:04.485 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:41:04.485 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:41:04.485 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:41:04.485 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:04.485 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 16, 2026-02-23T06:41:04.485 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:41:04.485 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:41:04.486 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:41:04.486 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:04.486 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:04.486 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:04.486 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:04.486 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:04.486 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:04.486 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:04.486 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:04.486 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:04.486 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:04.486 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:04.487 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:04.487 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:04.487 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:04.487 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:41:04.487 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:41:04.487 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:04.487 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:04.487 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:04.487 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:04.487 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:04.487 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:04.487 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:04.488 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:04.488 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:04.488 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:04.488 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:04.488 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:04.488 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:04.488 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:04.488 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.488 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:41:04.488 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:41:04.488 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:41:04.488 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:41:04.489 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:41:04.489 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:41:04.489 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:41:04.489 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:41:04.489 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:41:04.489 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:41:04.489 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:41:04.489 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:41:04.489 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:41:04.489 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:41:04.489 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:41:04.489 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:41:04.490 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:41:04.490 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:04.490 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:04.490 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:04.490 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:04.490 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:04.490 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:04.490 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:04.490 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:04.490 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:04.490 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:04.490 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:04.490 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:04.491 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:04.491 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:04.491 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:41:04.491 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.491 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:41:04.491 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.491 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:41:04.491 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:41:04.491 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:04.491 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:04.491 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.491 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:04.492 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:41:04.492 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:04.492 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.492 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.492 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:04.492 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:41:04.492 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:04.492 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:04.492 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:04.492 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.492 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:41:04.492 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:41:04.493 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:04.493 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:04.493 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:41:04.493 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:04.493 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.493 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.493 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:41:04.493 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:41:04.493 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:04.493 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:04.493 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.493 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:04.494 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:41:04.494 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:04.494 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.494 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.494 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:04.494 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:41:04.494 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:04.494 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:04.494 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:04.494 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.494 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:41:04.495 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:41:04.495 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:04.495 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:04.495 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:41:04.495 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:04.495 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.495 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.495 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:41:04.496 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:41:04.496 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:04.496 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:04.496 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.496 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:04.496 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:41:04.496 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:04.496 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.496 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.497 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:04.497 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:41:04.497 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:04.497 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:04.497 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:04.497 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.497 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:41:04.497 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:41:04.498 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:04.498 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:04.498 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:41:04.498 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:04.498 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:04.498 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:04.498 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.498 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:41:04.499 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:41:04.499 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.499 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:04.499 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:04.499 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:41:04.499 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:04.499 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:04.499 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:41:04.500 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:04.500 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:04.500 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:04.500 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:41:04.500 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:04.500 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:04.500 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:04.500 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:41:04.500 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:41:04.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.488+0000 7faa9f1d2640 1 -- 10.20.193.58:0/70656762 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa6807a660 msgr2=0x7faa6809ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:04.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.488+0000 7faa9f1d2640 1 --2- 10.20.193.58:0/70656762 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa6807a660 0x7faa6809ab10 secure :-1 s=READY pgs=437 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa98140260 tx=0x7faa9400a040 comp rx=0 tx=0).stop 2026-02-23T06:41:04.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.488+0000 7faa9f1d2640 1 -- 10.20.193.58:0/70656762 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa9815d4a0 msgr2=0x7faa98142480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:04.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.488+0000 7faa9f1d2640 1 --2- 10.20.193.58:0/70656762 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa9815d4a0 0x7faa98142480 secure :-1 s=READY pgs=360 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa8c00e9c0 tx=0x7faa8c00ee90 comp rx=0 tx=0).stop 2026-02-23T06:41:04.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.488+0000 7faa9e9d1640 1 -- 10.20.193.58:0/70656762 reap_dead start 2026-02-23T06:41:04.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.488+0000 7faa9e9d1640 1 -- 10.20.193.58:0/70656762 reap_dead start 2026-02-23T06:41:04.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.488+0000 7faa9f1d2640 1 -- 10.20.193.58:0/70656762 shutdown_connections 2026-02-23T06:41:04.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.488+0000 7faa9f1d2640 1 -- 10.20.193.58:0/70656762 >> 10.20.193.58:0/70656762 conn(0x7faa980b3c20 msgr2=0x7faa9815b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:04.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.488+0000 7faa9f1d2640 1 -- 10.20.193.58:0/70656762 shutdown_connections 2026-02-23T06:41:04.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.488+0000 7faa9f1d2640 1 -- 10.20.193.58:0/70656762 wait complete. 2026-02-23T06:41:04.505 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:41:04.505 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-23T06:41:04.505 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-23T06:41:04.506 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-23T06:41:04.506 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-23T06:41:04.506 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-23T06:41:04.506 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:41:04.537 INFO:tasks.ceph.mon.a:Stopped 2026-02-23T06:41:04.537 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:41:04.538 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:41:04.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.711+0000 7fa018e83640 1 -- 10.20.193.58:0/219337370 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa01415d870 msgr2=0x7fa0140587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:04.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.711+0000 7fa018e83640 1 --2- 10.20.193.58:0/219337370 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa01415d870 0x7fa0140587b0 secure :-1 s=READY pgs=17 gs=3 cs=0 l=1 c_cookie=5118820874680032989 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa004005e70 tx=0x7fa00402f2b0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.711+0000 7fa018e83640 1 -- 10.20.193.58:0/219337370 shutdown_connections 2026-02-23T06:41:04.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.711+0000 7fa018e83640 1 --2- 10.20.193.58:0/219337370 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa01415d870 0x7fa0140587b0 unknown :-1 s=CLOSED pgs=17 gs=3 cs=0 l=1 c_cookie=5118820874680032989 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.711+0000 7fa018e83640 1 --2- 10.20.193.58:0/219337370 >> v2:10.20.193.58:3300/0 conn(0x7fa01415d4a0 0x7fa0140affb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.711+0000 7fa018e83640 1 -- 10.20.193.58:0/219337370 >> 10.20.193.58:0/219337370 conn(0x7fa0140b3c20 msgr2=0x7fa0140b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:04.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.711+0000 7fa018e83640 1 -- 10.20.193.58:0/219337370 shutdown_connections 2026-02-23T06:41:04.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.711+0000 7fa018e83640 1 -- 10.20.193.58:0/219337370 wait complete. 2026-02-23T06:41:04.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.713+0000 7fa018e83640 1 Processor -- start 2026-02-23T06:41:04.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.713+0000 7fa018e83640 1 -- start start 2026-02-23T06:41:04.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.714+0000 7fa018e83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa0140b6690 0x7fa01413f5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:04.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.714+0000 7fa018e83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa01415d4a0 0x7fa01413b740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:04.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.714+0000 7fa018e83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa01415d870 0x7fa014057520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:04.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.714+0000 7fa018e83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa01413fb00 con 0x7fa0140b6690 2026-02-23T06:41:04.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.714+0000 7fa018e83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fa0141fe880 con 0x7fa01415d870 2026-02-23T06:41:04.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.714+0000 7fa018e83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa0141606b0 con 0x7fa01415d4a0 2026-02-23T06:41:04.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.714+0000 7fa0137fe640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa0140b6690 msgr2=0x7fa01413f5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:41:04.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.714+0000 7fa0137fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa0140b6690 0x7fa01413f5c0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:41:04.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.714+0000 7fa012ffd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa01415d4a0 0x7fa01413b740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:04.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.714+0000 7fa013fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa01415d870 0x7fa014057520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:04.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.714+0000 7fa013fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa01415d870 0x7fa014057520 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:47720/0 (socket says 10.20.193.58:47720) 2026-02-23T06:41:04.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.714+0000 7fa013fff640 1 -- 10.20.193.58:0/2851457389 learned_addr learned my addr 10.20.193.58:0/2851457389 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:41:04.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.714+0000 7fa013fff640 1 -- 10.20.193.58:0/2851457389 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa01415d4a0 msgr2=0x7fa01413b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:04.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.714+0000 7fa013fff640 1 --2- 10.20.193.58:0/2851457389 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa01415d4a0 0x7fa01413b740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.714+0000 7fa013fff640 1 -- 10.20.193.58:0/2851457389 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa0140b6690 msgr2=0x7fa01413f5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:41:04.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.714+0000 7fa013fff640 1 --2- 10.20.193.58:0/2851457389 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa0140b6690 0x7fa01413f5c0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.714+0000 7fa013fff640 1 -- 10.20.193.58:0/2851457389 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa004009570 con 0x7fa01415d870 2026-02-23T06:41:04.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.714+0000 7fa012ffd640 1 --2- 10.20.193.58:0/2851457389 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa01415d4a0 0x7fa01413b740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:41:04.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.715+0000 7fa013fff640 1 --2- 10.20.193.58:0/2851457389 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa01415d870 0x7fa014057520 secure :-1 s=READY pgs=61 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa00800d700 tx=0x7fa00800dbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:04.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.715+0000 7f9feffff640 1 -- 10.20.193.58:0/2851457389 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa008007b90 con 0x7fa01415d870 2026-02-23T06:41:04.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.715+0000 7f9feffff640 1 -- 10.20.193.58:0/2851457389 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa008007de0 con 0x7fa01415d870 2026-02-23T06:41:04.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.715+0000 7f9feffff640 1 -- 10.20.193.58:0/2851457389 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa00800b8c0 con 0x7fa01415d870 2026-02-23T06:41:04.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.715+0000 7fa018e83640 1 -- 10.20.193.58:0/2851457389 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa01413ff90 con 0x7fa01415d870 2026-02-23T06:41:04.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.715+0000 7fa018e83640 1 -- 10.20.193.58:0/2851457389 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0141fe550 con 0x7fa01415d870 2026-02-23T06:41:04.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.716+0000 7fa018e83640 1 -- 10.20.193.58:0/2851457389 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0140b6d50 con 0x7fa01415d870 2026-02-23T06:41:04.712 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.717+0000 7f9feffff640 1 -- 10.20.193.58:0/2851457389 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fa00801a070 con 0x7fa01415d870 2026-02-23T06:41:04.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.718+0000 7f9feffff640 1 --2- 10.20.193.58:0/2851457389 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9fe407a5b0 0x7f9fe409aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:04.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.718+0000 7f9feffff640 1 -- 10.20.193.58:0/2851457389 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fa00809e630 con 0x7fa01415d870 2026-02-23T06:41:04.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.719+0000 7fa0137fe640 1 --2- 10.20.193.58:0/2851457389 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9fe407a5b0 0x7f9fe409aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:04.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.719+0000 7f9feffff640 1 -- 10.20.193.58:0/2851457389 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fa0080617c0 con 0x7fa01415d870 2026-02-23T06:41:04.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.719+0000 7fa0137fe640 1 --2- 10.20.193.58:0/2851457389 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9fe407a5b0 0x7f9fe409aa60 secure :-1 s=READY pgs=438 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa000002870 tx=0x7fa000006e10 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:04.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.873+0000 7fa018e83640 1 -- 10.20.193.58:0/2851457389 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa0141fe9c0 con 0x7fa01415d870 2026-02-23T06:41:04.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.874+0000 7f9feffff640 1 -- 10.20.193.58:0/2851457389 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7fa0141fe9c0 con 0x7fa01415d870 2026-02-23T06:41:04.869 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":166,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:41:04.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.875+0000 7fa018e83640 1 -- 10.20.193.58:0/2851457389 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9fe407a5b0 msgr2=0x7f9fe409aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:04.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.875+0000 7fa018e83640 1 --2- 10.20.193.58:0/2851457389 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9fe407a5b0 0x7f9fe409aa60 secure :-1 s=READY pgs=438 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa000002870 tx=0x7fa000006e10 comp rx=0 tx=0).stop 2026-02-23T06:41:04.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.875+0000 7fa018e83640 1 -- 10.20.193.58:0/2851457389 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa01415d870 msgr2=0x7fa014057520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:04.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.875+0000 7fa018e83640 1 --2- 10.20.193.58:0/2851457389 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa01415d870 0x7fa014057520 secure :-1 s=READY pgs=61 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa00800d700 tx=0x7fa00800dbd0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.875+0000 7fa018e83640 1 -- 10.20.193.58:0/2851457389 shutdown_connections 2026-02-23T06:41:04.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.875+0000 7fa018e83640 1 --2- 10.20.193.58:0/2851457389 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9fe407a5b0 0x7f9fe409aa60 unknown :-1 s=CLOSED pgs=438 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.875+0000 7fa018e83640 1 --2- 10.20.193.58:0/2851457389 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa01415d870 0x7fa014057520 unknown :-1 s=CLOSED pgs=61 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.875+0000 7fa018e83640 1 --2- 10.20.193.58:0/2851457389 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa01415d4a0 0x7fa01413b740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.875+0000 7fa018e83640 1 --2- 10.20.193.58:0/2851457389 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa0140b6690 0x7fa01413f5c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:04.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.875+0000 7fa018e83640 1 -- 10.20.193.58:0/2851457389 >> 10.20.193.58:0/2851457389 conn(0x7fa0140b3c20 msgr2=0x7fa0140b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:04.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.875+0000 7fa018e83640 1 -- 10.20.193.58:0/2851457389 shutdown_connections 2026-02-23T06:41:04.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:04.875+0000 7fa018e83640 1 -- 10.20.193.58:0/2851457389 wait complete. 2026-02-23T06:41:07.885 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:41:08.010 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.014+0000 7f616303a640 1 -- 10.20.193.58:0/266752509 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f615c056960 msgr2=0x7f615c058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:08.010 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.014+0000 7f616303a640 1 --2- 10.20.193.58:0/266752509 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f615c056960 0x7f615c058200 secure :-1 s=READY pgs=22 gs=2 cs=0 l=1 c_cookie=6940314841752833581 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6150004740 tx=0x7f615002f1a0 comp rx=0 tx=0).stop 2026-02-23T06:41:08.010 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.014+0000 7f616303a640 1 -- 10.20.193.58:0/266752509 shutdown_connections 2026-02-23T06:41:08.010 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.014+0000 7f616303a640 1 --2- 10.20.193.58:0/266752509 >> v2:10.20.193.58:3300/0 conn(0x7f615c162ca0 0x7f615c056fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:08.010 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.014+0000 7f616303a640 1 --2- 10.20.193.58:0/266752509 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f615c056960 0x7f615c058200 unknown :-1 s=CLOSED pgs=22 gs=2 cs=0 l=1 c_cookie=6940314841752833581 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:08.010 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.014+0000 7f616303a640 1 -- 10.20.193.58:0/266752509 >> 10.20.193.58:0/266752509 conn(0x7f615c0b3c20 msgr2=0x7f615c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:08.010 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.014+0000 7f616303a640 1 -- 10.20.193.58:0/266752509 shutdown_connections 2026-02-23T06:41:08.010 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.014+0000 7f616303a640 1 -- 10.20.193.58:0/266752509 wait complete. 2026-02-23T06:41:08.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.015+0000 7f616303a640 1 Processor -- start 2026-02-23T06:41:08.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.016+0000 7f616303a640 1 -- start start 2026-02-23T06:41:08.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.016+0000 7f616303a640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f615c056960 0x7f615c1633e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:08.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.016+0000 7f616303a640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f615c15c4b0 0x7f615c1417f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:08.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.016+0000 7f616303a640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f615c162ca0 0x7f615c200bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:08.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.016+0000 7f616303a640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f615c13f560 con 0x7f615c15c4b0 2026-02-23T06:41:08.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.016+0000 7f616303a640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f615c163ea0 con 0x7f615c162ca0 2026-02-23T06:41:08.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.016+0000 7f616303a640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f615c13d1d0 con 0x7f615c056960 2026-02-23T06:41:08.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.016+0000 7f6161837640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f615c15c4b0 msgr2=0x7f615c1417f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:41:08.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.016+0000 7f6161837640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f615c15c4b0 0x7f615c1417f0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:41:08.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.016+0000 7f6162839640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f615c162ca0 0x7f615c200bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:08.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.016+0000 7f6162839640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f615c162ca0 0x7f615c200bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:47724/0 (socket says 10.20.193.58:47724) 2026-02-23T06:41:08.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.016+0000 7f6162839640 1 -- 10.20.193.58:0/4194519349 learned_addr learned my addr 10.20.193.58:0/4194519349 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:41:08.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.016+0000 7f6162038640 1 --2- 10.20.193.58:0/4194519349 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f615c056960 0x7f615c1633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:08.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.017+0000 7f6162839640 1 -- 10.20.193.58:0/4194519349 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f615c056960 msgr2=0x7f615c1633e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:08.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.017+0000 7f6162839640 1 --2- 10.20.193.58:0/4194519349 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f615c056960 0x7f615c1633e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:08.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.017+0000 7f6162839640 1 -- 10.20.193.58:0/4194519349 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f615c15c4b0 msgr2=0x7f615c1417f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:41:08.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.017+0000 7f6162839640 1 --2- 10.20.193.58:0/4194519349 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f615c15c4b0 0x7f615c1417f0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:08.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.017+0000 7f6162839640 1 -- 10.20.193.58:0/4194519349 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61500094b0 con 0x7f615c162ca0 2026-02-23T06:41:08.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.017+0000 7f6162839640 1 --2- 10.20.193.58:0/4194519349 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f615c162ca0 0x7f615c200bb0 secure :-1 s=READY pgs=67 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f615800c580 tx=0x7f615800ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:08.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.017+0000 7f6142ffd640 1 -- 10.20.193.58:0/4194519349 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6158003db0 con 0x7f615c162ca0 2026-02-23T06:41:08.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.017+0000 7f6142ffd640 1 -- 10.20.193.58:0/4194519349 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6158005070 con 0x7f615c162ca0 2026-02-23T06:41:08.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.017+0000 7f6142ffd640 1 -- 10.20.193.58:0/4194519349 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61580054a0 con 0x7f615c162ca0 2026-02-23T06:41:08.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.017+0000 7f616303a640 1 -- 10.20.193.58:0/4194519349 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f615c13d660 con 0x7f615c162ca0 2026-02-23T06:41:08.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.017+0000 7f616303a640 1 -- 10.20.193.58:0/4194519349 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f615c13fa20 con 0x7f615c162ca0 2026-02-23T06:41:08.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.018+0000 7f616303a640 1 -- 10.20.193.58:0/4194519349 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f615c13d310 con 0x7f615c162ca0 2026-02-23T06:41:08.016 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.019+0000 7f6142ffd640 1 -- 10.20.193.58:0/4194519349 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f6158005600 con 0x7f615c162ca0 2026-02-23T06:41:08.016 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.020+0000 7f6142ffd640 1 --2- 10.20.193.58:0/4194519349 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f612c07a5b0 0x7f612c09aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:08.016 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.020+0000 7f6142ffd640 1 -- 10.20.193.58:0/4194519349 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f615809ebf0 con 0x7f615c162ca0 2026-02-23T06:41:08.016 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.020+0000 7f6162038640 1 --2- 10.20.193.58:0/4194519349 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f612c07a5b0 0x7f612c09aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:08.016 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.021+0000 7f6142ffd640 1 -- 10.20.193.58:0/4194519349 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f6158061db0 con 0x7f615c162ca0 2026-02-23T06:41:08.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.021+0000 7f6162038640 1 --2- 10.20.193.58:0/4194519349 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f612c07a5b0 0x7f612c09aa60 secure :-1 s=READY pgs=439 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f614c0027d0 tx=0x7f614c007ee0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:08.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.176+0000 7f616303a640 1 -- 10.20.193.58:0/4194519349 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f615c05d910 con 0x7f615c162ca0 2026-02-23T06:41:08.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.176+0000 7f6142ffd640 1 -- 10.20.193.58:0/4194519349 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f6158064f60 con 0x7f615c162ca0 2026-02-23T06:41:08.171 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":166,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:41:08.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.177+0000 7f616303a640 1 -- 10.20.193.58:0/4194519349 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f612c07a5b0 msgr2=0x7f612c09aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:08.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.177+0000 7f616303a640 1 --2- 10.20.193.58:0/4194519349 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f612c07a5b0 0x7f612c09aa60 secure :-1 s=READY pgs=439 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f614c0027d0 tx=0x7f614c007ee0 comp rx=0 tx=0).stop 2026-02-23T06:41:08.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.177+0000 7f616303a640 1 -- 10.20.193.58:0/4194519349 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f615c162ca0 msgr2=0x7f615c200bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:08.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.177+0000 7f616303a640 1 --2- 10.20.193.58:0/4194519349 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f615c162ca0 0x7f615c200bb0 secure :-1 s=READY pgs=67 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f615800c580 tx=0x7f615800ca50 comp rx=0 tx=0).stop 2026-02-23T06:41:08.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.177+0000 7f616303a640 1 -- 10.20.193.58:0/4194519349 shutdown_connections 2026-02-23T06:41:08.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.177+0000 7f616303a640 1 --2- 10.20.193.58:0/4194519349 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f612c07a5b0 0x7f612c09aa60 unknown :-1 s=CLOSED pgs=439 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:08.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.177+0000 7f616303a640 1 --2- 10.20.193.58:0/4194519349 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f615c162ca0 0x7f615c200bb0 unknown :-1 s=CLOSED pgs=67 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:08.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.177+0000 7f616303a640 1 --2- 10.20.193.58:0/4194519349 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f615c15c4b0 0x7f615c1417f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:08.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.177+0000 7f616303a640 1 --2- 10.20.193.58:0/4194519349 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f615c056960 0x7f615c1633e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:08.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.177+0000 7f616303a640 1 -- 10.20.193.58:0/4194519349 >> 10.20.193.58:0/4194519349 conn(0x7f615c0b3c20 msgr2=0x7f615c15b140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:08.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.177+0000 7f616303a640 1 -- 10.20.193.58:0/4194519349 shutdown_connections 2026-02-23T06:41:08.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:08.177+0000 7f616303a640 1 -- 10.20.193.58:0/4194519349 wait complete. 2026-02-23T06:41:11.185 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:41:11.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.312+0000 7f6b7f7fe640 1 -- 10.20.193.58:0/3267106655 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6b70004480 con 0x7f6b8815d870 2026-02-23T06:41:11.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.312+0000 7f6b8dbbe640 1 -- 10.20.193.58:0/3267106655 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6b8815d870 msgr2=0x7f6b880587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:11.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.312+0000 7f6b8dbbe640 1 --2- 10.20.193.58:0/3267106655 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6b8815d870 0x7f6b880587b0 secure :-1 s=READY pgs=24 gs=3 cs=0 l=1 c_cookie=17504499378902268576 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b70004740 tx=0x7f6b7002f200 comp rx=0 tx=0).stop 2026-02-23T06:41:11.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.312+0000 7f6b8dbbe640 1 -- 10.20.193.58:0/3267106655 shutdown_connections 2026-02-23T06:41:11.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.312+0000 7f6b8dbbe640 1 --2- 10.20.193.58:0/3267106655 >> v2:10.20.193.58:3300/0 conn(0x7f6b880b6690 0x7f6b88058cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:11.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.312+0000 7f6b8dbbe640 1 --2- 10.20.193.58:0/3267106655 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6b8815d870 0x7f6b880587b0 unknown :-1 s=CLOSED pgs=24 gs=3 cs=0 l=1 c_cookie=17504499378902268576 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:11.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.312+0000 7f6b8dbbe640 1 -- 10.20.193.58:0/3267106655 >> 10.20.193.58:0/3267106655 conn(0x7f6b880b3c20 msgr2=0x7f6b880b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:11.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.313+0000 7f6b8dbbe640 1 -- 10.20.193.58:0/3267106655 shutdown_connections 2026-02-23T06:41:11.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.313+0000 7f6b8dbbe640 1 -- 10.20.193.58:0/3267106655 wait complete. 2026-02-23T06:41:11.309 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.314+0000 7f6b8dbbe640 1 Processor -- start 2026-02-23T06:41:11.309 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.314+0000 7f6b8dbbe640 1 -- start start 2026-02-23T06:41:11.311 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.315+0000 7f6b8dbbe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6b880b6690 0x7f6b880568c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:11.311 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.315+0000 7f6b8dbbe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6b8815d4a0 0x7f6b8813b460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:11.311 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.315+0000 7f6b8dbbe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6b8815d870 0x7f6b881618c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:11.311 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.315+0000 7f6b8dbbe640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f6b88162e70 con 0x7f6b8815d4a0 2026-02-23T06:41:11.311 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.315+0000 7f6b8dbbe640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8811db50 con 0x7f6b8815d870 2026-02-23T06:41:11.312 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.315+0000 7f6b8dbbe640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f6b88057fd0 con 0x7f6b880b6690 2026-02-23T06:41:11.312 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.315+0000 7f6b8cbbc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6b880b6690 0x7f6b880568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:11.312 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.315+0000 7f6b8d3bd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6b8815d870 0x7f6b881618c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:11.312 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.315+0000 7f6b8cbbc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6b880b6690 0x7f6b880568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:57276/0 (socket says 10.20.193.58:57276) 2026-02-23T06:41:11.312 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.315+0000 7f6b8cbbc640 1 -- 10.20.193.58:0/22761808 learned_addr learned my addr 10.20.193.58:0/22761808 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:41:11.312 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.315+0000 7f6b8d3bd640 1 -- 10.20.193.58:0/22761808 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6b880b6690 msgr2=0x7f6b880568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:11.312 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.315+0000 7f6b8d3bd640 1 --2- 10.20.193.58:0/22761808 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6b880b6690 0x7f6b880568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:11.312 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.315+0000 7f6b8d3bd640 1 -- 10.20.193.58:0/22761808 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6b8815d4a0 msgr2=0x7f6b8813b460 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-23T06:41:11.312 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.315+0000 7f6b8d3bd640 1 --2- 10.20.193.58:0/22761808 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6b8815d4a0 0x7f6b8813b460 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:11.312 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.315+0000 7f6b8d3bd640 1 -- 10.20.193.58:0/22761808 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b700094b0 con 0x7f6b8815d870 2026-02-23T06:41:11.312 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.315+0000 7f6b8d3bd640 1 --2- 10.20.193.58:0/22761808 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6b8815d870 0x7f6b881618c0 secure :-1 s=READY pgs=70 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b8400c450 tx=0x7f6b8400c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:11.313 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.316+0000 7f6b7d7fa640 1 -- 10.20.193.58:0/22761808 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6b84003db0 con 0x7f6b8815d870 2026-02-23T06:41:11.313 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.316+0000 7f6b7d7fa640 1 -- 10.20.193.58:0/22761808 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b84005070 con 0x7f6b8815d870 2026-02-23T06:41:11.313 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.316+0000 7f6b7d7fa640 1 -- 10.20.193.58:0/22761808 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6b840054a0 con 0x7f6b8815d870 2026-02-23T06:41:11.313 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.316+0000 7f6b8dbbe640 1 -- 10.20.193.58:0/22761808 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b88057330 con 0x7f6b8815d870 2026-02-23T06:41:11.313 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.316+0000 7f6b8dbbe640 1 -- 10.20.193.58:0/22761808 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b8811cff0 con 0x7f6b8815d870 2026-02-23T06:41:11.313 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.316+0000 7f6b8dbbe640 1 -- 10.20.193.58:0/22761808 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b880b6d50 con 0x7f6b8815d870 2026-02-23T06:41:11.314 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.317+0000 7f6b7d7fa640 1 -- 10.20.193.58:0/22761808 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f6b84005600 con 0x7f6b8815d870 2026-02-23T06:41:11.314 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.318+0000 7f6b7d7fa640 1 --2- 10.20.193.58:0/22761808 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6b5807a6c0 0x7f6b5809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:11.314 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.319+0000 7f6b7d7fa640 1 -- 10.20.193.58:0/22761808 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f6b8409e530 con 0x7f6b8815d870 2026-02-23T06:41:11.314 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.319+0000 7f6b8cbbc640 1 --2- 10.20.193.58:0/22761808 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6b5807a6c0 0x7f6b5809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:11.314 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.319+0000 7f6b7d7fa640 1 -- 10.20.193.58:0/22761808 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f6b84061750 con 0x7f6b8815d870 2026-02-23T06:41:11.315 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.319+0000 7f6b8cbbc640 1 --2- 10.20.193.58:0/22761808 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6b5807a6c0 0x7f6b5809ab70 secure :-1 s=READY pgs=440 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b78007d70 tx=0x7f6b780028f0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:11.469 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.474+0000 7f6b8dbbe640 1 -- 10.20.193.58:0/22761808 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6b88057330 con 0x7f6b8815d870 2026-02-23T06:41:11.470 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.474+0000 7f6b7d7fa640 1 -- 10.20.193.58:0/22761808 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f6b88057330 con 0x7f6b8815d870 2026-02-23T06:41:11.470 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":166,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:41:11.471 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.475+0000 7f6b8dbbe640 1 -- 10.20.193.58:0/22761808 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6b5807a6c0 msgr2=0x7f6b5809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:11.471 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.475+0000 7f6b8dbbe640 1 --2- 10.20.193.58:0/22761808 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6b5807a6c0 0x7f6b5809ab70 secure :-1 s=READY pgs=440 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b78007d70 tx=0x7f6b780028f0 comp rx=0 tx=0).stop 2026-02-23T06:41:11.471 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.475+0000 7f6b8dbbe640 1 -- 10.20.193.58:0/22761808 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6b8815d870 msgr2=0x7f6b881618c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:11.471 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.475+0000 7f6b8dbbe640 1 --2- 10.20.193.58:0/22761808 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6b8815d870 0x7f6b881618c0 secure :-1 s=READY pgs=70 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b8400c450 tx=0x7f6b8400c920 comp rx=0 tx=0).stop 2026-02-23T06:41:11.471 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.475+0000 7f6b8dbbe640 1 -- 10.20.193.58:0/22761808 shutdown_connections 2026-02-23T06:41:11.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.475+0000 7f6b8dbbe640 1 --2- 10.20.193.58:0/22761808 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6b5807a6c0 0x7f6b5809ab70 unknown :-1 s=CLOSED pgs=440 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:11.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.475+0000 7f6b8dbbe640 1 --2- 10.20.193.58:0/22761808 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6b8815d870 0x7f6b881618c0 unknown :-1 s=CLOSED pgs=70 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:11.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.475+0000 7f6b8dbbe640 1 --2- 10.20.193.58:0/22761808 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6b8815d4a0 0x7f6b8813b460 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:11.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.475+0000 7f6b8dbbe640 1 --2- 10.20.193.58:0/22761808 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6b880b6690 0x7f6b880568c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:11.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.475+0000 7f6b8dbbe640 1 -- 10.20.193.58:0/22761808 >> 10.20.193.58:0/22761808 conn(0x7f6b880b3c20 msgr2=0x7f6b880b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:11.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.475+0000 7f6b8dbbe640 1 -- 10.20.193.58:0/22761808 shutdown_connections 2026-02-23T06:41:11.472 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:11.475+0000 7f6b8dbbe640 1 -- 10.20.193.58:0/22761808 wait complete. 2026-02-23T06:41:14.429 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:41:14.433 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:41:14.483 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:41:19.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.256+0000 7f9958992640 1 -- 10.20.193.58:0/981095449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9938003a30 msgr2=0x7f9938003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:19.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.256+0000 7f9958992640 1 --2- 10.20.193.58:0/981095449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9938003a30 0x7f9938003e20 secure :-1 s=READY pgs=26 gs=28 cs=0 l=1 c_cookie=12617305553731504270 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f994000a5c0 tx=0x7f994002f8e0 comp rx=0 tx=0).stop 2026-02-23T06:41:19.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.256+0000 7f9958992640 1 -- 10.20.193.58:0/981095449 shutdown_connections 2026-02-23T06:41:19.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.256+0000 7f9958992640 1 --2- 10.20.193.58:0/981095449 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9938005320 0x7f9938065a10 unknown :-1 s=CLOSED pgs=0 gs=29 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:19.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.256+0000 7f9958992640 1 --2- 10.20.193.58:0/981095449 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9938004850 0x7f9938004cc0 unknown :-1 s=CLOSED pgs=0 gs=27 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:19.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.256+0000 7f9958992640 1 --2- 10.20.193.58:0/981095449 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9938003a30 0x7f9938003e20 unknown :-1 s=CLOSED pgs=26 gs=28 cs=0 l=1 c_cookie=12617305553731504270 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:19.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.256+0000 7f9958992640 1 -- 10.20.193.58:0/981095449 >> 10.20.193.58:0/981095449 conn(0x7f99540b3c20 msgr2=0x7f99540b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:19.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.256+0000 7f9958992640 1 -- 10.20.193.58:0/981095449 shutdown_connections 2026-02-23T06:41:19.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.256+0000 7f9958992640 1 -- 10.20.193.58:0/981095449 wait complete. 2026-02-23T06:41:19.252 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.257+0000 7f9958992640 1 Processor -- start 2026-02-23T06:41:19.252 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.257+0000 7f9958992640 1 -- start start 2026-02-23T06:41:19.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.258+0000 7f9958992640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9938003a30 0x7f99540566d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:19.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.258+0000 7f9958992640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9938004850 0x7f9954138080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:19.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.258+0000 7f9958992640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9938005320 0x7f9954135db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:19.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.258+0000 7f9958992640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f9954138c50 con 0x7f9938003a30 2026-02-23T06:41:19.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.258+0000 7f9958992640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9954057700 con 0x7f9938004850 2026-02-23T06:41:19.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.258+0000 7f9958992640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f99540570d0 con 0x7f9938005320 2026-02-23T06:41:19.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.258+0000 7f99537fe640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9938003a30 msgr2=0x7f99540566d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:41:19.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.258+0000 7f99537fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9938003a30 0x7f99540566d0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:41:19.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.258+0000 7f9953fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9938005320 0x7f9954135db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:19.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.258+0000 7f9953fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9938005320 0x7f9954135db0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:57914/0 (socket says 10.20.193.58:57914) 2026-02-23T06:41:19.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.258+0000 7f9953fff640 1 -- 10.20.193.58:0/573917753 learned_addr learned my addr 10.20.193.58:0/573917753 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:41:19.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.258+0000 7f9952ffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9938004850 0x7f9954138080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:19.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.259+0000 7f9953fff640 1 -- 10.20.193.58:0/573917753 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9938004850 msgr2=0x7f9954138080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:19.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.259+0000 7f9953fff640 1 --2- 10.20.193.58:0/573917753 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9938004850 0x7f9954138080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:19.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.259+0000 7f9953fff640 1 -- 10.20.193.58:0/573917753 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9938003a30 msgr2=0x7f99540566d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:41:19.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.259+0000 7f9953fff640 1 --2- 10.20.193.58:0/573917753 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9938003a30 0x7f99540566d0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:19.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.259+0000 7f9953fff640 1 -- 10.20.193.58:0/573917753 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9954057420 con 0x7f9938005320 2026-02-23T06:41:19.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.259+0000 7f9953fff640 1 --2- 10.20.193.58:0/573917753 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9938005320 0x7f9954135db0 secure :-1 s=READY pgs=27 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9930025370 tx=0x7f99480136f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:19.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.259+0000 7f992ffff640 1 -- 10.20.193.58:0/573917753 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9948021070 con 0x7f9938005320 2026-02-23T06:41:19.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.259+0000 7f992ffff640 1 -- 10.20.193.58:0/573917753 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9948019040 con 0x7f9938005320 2026-02-23T06:41:19.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.259+0000 7f992ffff640 1 -- 10.20.193.58:0/573917753 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9948018070 con 0x7f9938005320 2026-02-23T06:41:19.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.259+0000 7f9958992640 1 -- 10.20.193.58:0/573917753 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99540add60 con 0x7f9938005320 2026-02-23T06:41:19.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.259+0000 7f9958992640 1 -- 10.20.193.58:0/573917753 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f995413b6e0 con 0x7f9938005320 2026-02-23T06:41:19.255 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.260+0000 7f9958992640 1 -- 10.20.193.58:0/573917753 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99540b6d50 con 0x7f9938005320 2026-02-23T06:41:19.255 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.261+0000 7f992ffff640 1 -- 10.20.193.58:0/573917753 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f994801d680 con 0x7f9938005320 2026-02-23T06:41:19.256 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.262+0000 7f992ffff640 1 --2- 10.20.193.58:0/573917753 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f992407a5b0 0x7f992409aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:19.257 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.262+0000 7f992ffff640 1 -- 10.20.193.58:0/573917753 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f994809eb70 con 0x7f9938005320 2026-02-23T06:41:19.257 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.262+0000 7f99537fe640 1 --2- 10.20.193.58:0/573917753 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f992407a5b0 0x7f992409aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:19.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.263+0000 7f99537fe640 1 --2- 10.20.193.58:0/573917753 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f992407a5b0 0x7f992409aa60 secure :-1 s=READY pgs=441 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9940004020 tx=0x7f9940032040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:19.258 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.264+0000 7f992ffff640 1 -- 10.20.193.58:0/573917753 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f9948061d10 con 0x7f9938005320 2026-02-23T06:41:19.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.422+0000 7f9958992640 1 -- 10.20.193.58:0/573917753 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f995405b0e0 con 0x7f9938005320 2026-02-23T06:41:19.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.423+0000 7f992ffff640 1 -- 10.20.193.58:0/573917753 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1749 (secure 0 0 0) 0x7f9948064e30 con 0x7f9938005320 2026-02-23T06:41:19.417 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":168,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:41:19.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.424+0000 7f9958992640 1 -- 10.20.193.58:0/573917753 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f992407a5b0 msgr2=0x7f992409aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:19.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.424+0000 7f9958992640 1 --2- 10.20.193.58:0/573917753 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f992407a5b0 0x7f992409aa60 secure :-1 s=READY pgs=441 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9940004020 tx=0x7f9940032040 comp rx=0 tx=0).stop 2026-02-23T06:41:19.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.424+0000 7f9958992640 1 -- 10.20.193.58:0/573917753 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9938005320 msgr2=0x7f9954135db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:19.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.424+0000 7f9958992640 1 --2- 10.20.193.58:0/573917753 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9938005320 0x7f9954135db0 secure :-1 s=READY pgs=27 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9930025370 tx=0x7f99480136f0 comp rx=0 tx=0).stop 2026-02-23T06:41:19.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.424+0000 7f9958992640 1 -- 10.20.193.58:0/573917753 shutdown_connections 2026-02-23T06:41:19.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.424+0000 7f9958992640 1 --2- 10.20.193.58:0/573917753 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f992407a5b0 0x7f992409aa60 unknown :-1 s=CLOSED pgs=441 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:19.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.424+0000 7f9958992640 1 --2- 10.20.193.58:0/573917753 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9938005320 0x7f9954135db0 unknown :-1 s=CLOSED pgs=27 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:19.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.424+0000 7f9958992640 1 --2- 10.20.193.58:0/573917753 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9938004850 0x7f9954138080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:19.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.424+0000 7f9958992640 1 --2- 10.20.193.58:0/573917753 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9938003a30 0x7f99540566d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:19.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.424+0000 7f9958992640 1 -- 10.20.193.58:0/573917753 >> 10.20.193.58:0/573917753 conn(0x7f99540b3c20 msgr2=0x7f995415a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:19.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.424+0000 7f9958992640 1 -- 10.20.193.58:0/573917753 shutdown_connections 2026-02-23T06:41:19.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.424+0000 7f9958992640 1 -- 10.20.193.58:0/573917753 wait complete. 2026-02-23T06:41:19.432 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:41:19.432 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-23T06:41:19.432 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:41:19.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.560+0000 7f5449c83640 1 -- 10.20.193.58:0/2341860527 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5444162ca0 msgr2=0x7f5444056fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:19.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.560+0000 7f5449c83640 1 --2- 10.20.193.58:0/2341860527 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5444162ca0 0x7f5444056fc0 secure :-1 s=READY pgs=73 gs=2 cs=0 l=1 c_cookie=16433243581487823296 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f544405e310 tx=0x7f5440030360 comp rx=0 tx=0).stop 2026-02-23T06:41:19.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.560+0000 7f5449c83640 1 -- 10.20.193.58:0/2341860527 shutdown_connections 2026-02-23T06:41:19.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.560+0000 7f5449c83640 1 --2- 10.20.193.58:0/2341860527 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5444162ca0 0x7f5444056fc0 unknown :-1 s=CLOSED pgs=73 gs=2 cs=0 l=1 c_cookie=16433243581487823296 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:19.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.560+0000 7f5449c83640 1 --2- 10.20.193.58:0/2341860527 >> v2:10.20.193.58:3300/0 conn(0x7f5444056960 0x7f5444058200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:19.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.560+0000 7f5449c83640 1 -- 10.20.193.58:0/2341860527 >> 10.20.193.58:0/2341860527 conn(0x7f54440b3c20 msgr2=0x7f54440b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:19.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.560+0000 7f5449c83640 1 -- 10.20.193.58:0/2341860527 shutdown_connections 2026-02-23T06:41:19.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.560+0000 7f5449c83640 1 -- 10.20.193.58:0/2341860527 wait complete. 2026-02-23T06:41:19.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.562+0000 7f5449c83640 1 Processor -- start 2026-02-23T06:41:19.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.562+0000 7f5449c83640 1 -- start start 2026-02-23T06:41:19.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.562+0000 7f5449c83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5444056960 0x7f54440adf80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:19.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.562+0000 7f5449c83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f544415c4b0 0x7f544413d710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:19.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.562+0000 7f5449c83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5444162ca0 0x7f544415ce10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:19.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.562+0000 7f5449c83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f54440b0f20 con 0x7f5444056960 2026-02-23T06:41:19.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.562+0000 7f5449c83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f54440ae5c0 con 0x7f5444162ca0 2026-02-23T06:41:19.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.562+0000 7f5449c83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f5444163510 con 0x7f544415c4b0 2026-02-23T06:41:19.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.562+0000 7f5448c81640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5444056960 msgr2=0x7f54440adf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:41:19.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.562+0000 7f5448c81640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5444056960 0x7f54440adf80 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:41:19.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.563+0000 7f543bfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f544415c4b0 0x7f544413d710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:19.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.563+0000 7f5449482640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5444162ca0 0x7f544415ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:19.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.563+0000 7f543bfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f544415c4b0 0x7f544413d710 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:57916/0 (socket says 10.20.193.58:57916) 2026-02-23T06:41:19.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.563+0000 7f543bfff640 1 -- 10.20.193.58:0/3710866280 learned_addr learned my addr 10.20.193.58:0/3710866280 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:41:19.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.563+0000 7f543bfff640 1 -- 10.20.193.58:0/3710866280 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5444162ca0 msgr2=0x7f544415ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:19.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.563+0000 7f543bfff640 1 --2- 10.20.193.58:0/3710866280 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5444162ca0 0x7f544415ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:19.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.563+0000 7f543bfff640 1 -- 10.20.193.58:0/3710866280 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5444056960 msgr2=0x7f54440adf80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:41:19.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.563+0000 7f543bfff640 1 --2- 10.20.193.58:0/3710866280 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5444056960 0x7f54440adf80 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:19.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.563+0000 7f543bfff640 1 -- 10.20.193.58:0/3710866280 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f544000a650 con 0x7f544415c4b0 2026-02-23T06:41:19.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.563+0000 7f543bfff640 1 --2- 10.20.193.58:0/3710866280 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f544415c4b0 0x7f544413d710 secure :-1 s=READY pgs=28 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f542c00b550 tx=0x7f542c00ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:19.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.563+0000 7f54397fa640 1 -- 10.20.193.58:0/3710866280 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f542c002ca0 con 0x7f544415c4b0 2026-02-23T06:41:19.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.563+0000 7f54397fa640 1 -- 10.20.193.58:0/3710866280 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f542c004070 con 0x7f544415c4b0 2026-02-23T06:41:19.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.563+0000 7f54397fa640 1 -- 10.20.193.58:0/3710866280 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f542c004460 con 0x7f544415c4b0 2026-02-23T06:41:19.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.563+0000 7f5449c83640 1 -- 10.20.193.58:0/3710866280 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54441637f0 con 0x7f544415c4b0 2026-02-23T06:41:19.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.564+0000 7f5449c83640 1 -- 10.20.193.58:0/3710866280 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f54441641e0 con 0x7f544415c4b0 2026-02-23T06:41:19.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.564+0000 7f5449c83640 1 --2- 10.20.193.58:0/3710866280 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f544415d350 0x7f54441651a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:19.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.564+0000 7f5449c83640 1 -- 10.20.193.58:0/3710866280 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f5444059690 con 0x7f544415d350 2026-02-23T06:41:19.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.564+0000 7f5448c81640 1 --2- 10.20.193.58:0/3710866280 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f544415d350 0x7f54441651a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:19.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.565+0000 7f5448c81640 1 -- 10.20.193.58:0/3710866280 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f54440593b0 con 0x7f544415d350 2026-02-23T06:41:19.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.565+0000 7f5448c81640 1 --2- 10.20.193.58:0/3710866280 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f544415d350 0x7f54441651a0 secure :-1 s=READY pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f543400b450 tx=0x7f543400b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:19.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.565+0000 7f54397fa640 1 -- 10.20.193.58:0/3710866280 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5434005070 con 0x7f544415d350 2026-02-23T06:41:19.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.565+0000 7f54397fa640 1 -- 10.20.193.58:0/3710866280 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f54340051d0 con 0x7f544415d350 2026-02-23T06:41:19.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.565+0000 7f54397fa640 1 -- 10.20.193.58:0/3710866280 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f544415d350 msgr2=0x7f54441651a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:19.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.565+0000 7f54397fa640 1 --2- 10.20.193.58:0/3710866280 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f544415d350 0x7f54441651a0 secure :-1 s=READY pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f543400b450 tx=0x7f543400b920 comp rx=0 tx=0).stop 2026-02-23T06:41:19.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.565+0000 7f54397fa640 1 -- 10.20.193.58:0/3710866280 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f544415d350 msgr2=0x7f54441651a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:41:19.565 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.565+0000 7f54397fa640 1 --2- 10.20.193.58:0/3710866280 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f544415d350 0x7f54441651a0 unknown :-1 s=CLOSED pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:19.565 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.565+0000 7f54397fa640 1 -- 10.20.193.58:0/3710866280 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f542c00d040 con 0x7f544415c4b0 2026-02-23T06:41:19.565 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.567+0000 7f54397fa640 1 --2- 10.20.193.58:0/3710866280 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f541407a3c0 0x7f541409a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:19.565 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.567+0000 7f54397fa640 1 -- 10.20.193.58:0/3710866280 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f542c09d3e0 con 0x7f544415c4b0 2026-02-23T06:41:19.565 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.567+0000 7f5448c81640 1 --2- 10.20.193.58:0/3710866280 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f541407a3c0 0x7f541409a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:19.565 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.567+0000 7f5448c81640 1 --2- 10.20.193.58:0/3710866280 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f541407a3c0 0x7f541409a870 secure :-1 s=READY pgs=442 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f543400bfd0 tx=0x7f543400f000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:19.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.569+0000 7f5449c83640 1 --2- 10.20.193.58:0/3710866280 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f54441656e0 0x7f5444200f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:19.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.569+0000 7f5449c83640 1 -- 10.20.193.58:0/3710866280 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f54440b09a0 con 0x7f54441656e0 2026-02-23T06:41:19.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.570+0000 7f5449482640 1 --2- 10.20.193.58:0/3710866280 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f54441656e0 0x7f5444200f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:19.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.570+0000 7f5449482640 1 -- 10.20.193.58:0/3710866280 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f544415d720 con 0x7f54441656e0 2026-02-23T06:41:19.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.570+0000 7f5449482640 1 --2- 10.20.193.58:0/3710866280 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f54441656e0 0x7f5444200f80 secure :-1 s=READY pgs=75 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f544000a230 tx=0x7f5440003a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:19.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.571+0000 7f54397fa640 1 -- 10.20.193.58:0/3710866280 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f544003e040 con 0x7f54441656e0 2026-02-23T06:41:19.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.571+0000 7f54397fa640 1 -- 10.20.193.58:0/3710866280 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5403 (secure 0 0 0) 0x7f5440039470 con 0x7f54441656e0 2026-02-23T06:41:19.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.571+0000 7f54397fa640 1 -- 10.20.193.58:0/3710866280 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f54441656e0 msgr2=0x7f5444200f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:19.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.571+0000 7f54397fa640 1 --2- 10.20.193.58:0/3710866280 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f54441656e0 0x7f5444200f80 secure :-1 s=READY pgs=75 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f544000a230 tx=0x7f5440003a20 comp rx=0 tx=0).stop 2026-02-23T06:41:19.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.571+0000 7f54397fa640 1 -- 10.20.193.58:0/3710866280 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f54441656e0 msgr2=0x7f5444200f80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:41:19.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.571+0000 7f54397fa640 1 --2- 10.20.193.58:0/3710866280 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f54441656e0 0x7f5444200f80 unknown :-1 s=CLOSED pgs=75 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:19.568 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:41:19.568 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:41:19.568 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:41:19.568 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:41:19.568 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 168, 2026-02-23T06:41:19.568 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 83660, 2026-02-23T06:41:19.568 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:41:19.568 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:41:19.569 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:41:19.569 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:19.569 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:41:19.569 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:41:19.569 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:41:19.569 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:41:19.569 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:19.569 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:19.569 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:19.569 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:19.569 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:19.569 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:19.570 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:19.570 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:19.570 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:19.570 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:19.570 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:19.570 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:19.570 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:19.570 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:19.570 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:41:19.570 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:41:19.570 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:19.570 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:19.571 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:19.571 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:19.571 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:19.571 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:19.571 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:19.571 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:19.571 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:19.571 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:19.571 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:19.571 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:19.571 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:19.571 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:19.572 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:19.572 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:41:19.572 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:41:19.572 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:41:19.572 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:41:19.572 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:41:19.572 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:41:19.572 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:41:19.572 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:41:19.572 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:41:19.572 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:41:19.572 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:41:19.573 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:41:19.573 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:41:19.573 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:41:19.573 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:41:19.573 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:41:19.573 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:41:19.573 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:19.573 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:19.573 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:19.573 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:19.573 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:19.573 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:19.573 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:19.574 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:19.574 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:19.574 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:19.574 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:19.574 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:19.574 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:19.574 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:19.574 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:41:19.574 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:19.574 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:41:19.574 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:19.574 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:41:19.575 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:41:19.575 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:19.575 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:19.575 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:19.575 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:19.575 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:41:19.575 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:19.575 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:19.575 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:19.575 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:19.575 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:41:19.575 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:19.575 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:19.576 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:19.576 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:19.576 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:41:19.576 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:41:19.576 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:19.576 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:19.576 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:41:19.576 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:19.576 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:19.576 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:19.576 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:41:19.576 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:41:19.577 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:19.577 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:19.577 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:19.577 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:19.577 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:41:19.577 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:19.577 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:19.577 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:19.577 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:19.577 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:41:19.577 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:19.577 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:19.578 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:19.578 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:19.578 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:41:19.578 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:41:19.578 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:19.578 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:19.578 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:41:19.578 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:19.578 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:19.578 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:19.578 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:41:19.578 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:41:19.578 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:19.579 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:19.579 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:19.579 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:19.579 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:41:19.579 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:19.579 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:19.579 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:19.579 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:19.579 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:41:19.579 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:19.579 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:19.579 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:19.579 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:19.580 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:41:19.580 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:41:19.580 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:19.580 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:19.580 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:41:19.580 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:19.580 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:19.580 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:19.580 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:19.580 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:41:19.580 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:41:19.580 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:19.581 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:19.581 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:19.581 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:41:19.581 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:19.581 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:19.581 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:41:19.581 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:19.581 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:19.581 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:19.581 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:41:19.581 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:19.581 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:19.581 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:41:19.582 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:19.582 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:19.582 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:19.582 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:41:19.582 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:19.582 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:19.582 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:41:19.582 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:19.582 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:19.582 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:19.582 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:41:19.582 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:19.582 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:19.583 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:41:19.583 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:19.583 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:19.583 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:19.583 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:41:19.583 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:19.583 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:19.583 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:19.583 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:41:19.583 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:41:19.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.571+0000 7f5449c83640 1 -- 10.20.193.58:0/3710866280 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f541407a3c0 msgr2=0x7f541409a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:19.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.571+0000 7f5449c83640 1 --2- 10.20.193.58:0/3710866280 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f541407a3c0 0x7f541409a870 secure :-1 s=READY pgs=442 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f543400bfd0 tx=0x7f543400f000 comp rx=0 tx=0).stop 2026-02-23T06:41:19.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.571+0000 7f5449c83640 1 -- 10.20.193.58:0/3710866280 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f544415c4b0 msgr2=0x7f544413d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:19.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.571+0000 7f5449c83640 1 --2- 10.20.193.58:0/3710866280 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f544415c4b0 0x7f544413d710 secure :-1 s=READY pgs=28 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f542c00b550 tx=0x7f542c00ba20 comp rx=0 tx=0).stop 2026-02-23T06:41:19.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.571+0000 7f5449482640 1 -- 10.20.193.58:0/3710866280 reap_dead start 2026-02-23T06:41:19.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.571+0000 7f5449482640 1 -- 10.20.193.58:0/3710866280 reap_dead start 2026-02-23T06:41:19.586 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.571+0000 7f5449c83640 1 -- 10.20.193.58:0/3710866280 shutdown_connections 2026-02-23T06:41:19.586 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.571+0000 7f5449c83640 1 -- 10.20.193.58:0/3710866280 >> 10.20.193.58:0/3710866280 conn(0x7f54440b3c20 msgr2=0x7f544413e550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:19.586 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.571+0000 7f5449c83640 1 -- 10.20.193.58:0/3710866280 shutdown_connections 2026-02-23T06:41:19.586 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.571+0000 7f5449c83640 1 -- 10.20.193.58:0/3710866280 wait complete. 2026-02-23T06:41:19.586 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:41:19.586 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-23T06:41:19.587 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:41:19.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.714+0000 7fd57425b640 1 -- 10.20.193.58:0/3945111704 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd56c158740 msgr2=0x7fd56c0b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:19.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.714+0000 7fd57425b640 1 --2- 10.20.193.58:0/3945111704 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd56c158740 0x7fd56c0b72c0 secure :-1 s=READY pgs=76 gs=2 cs=0 l=1 c_cookie=14079435098451944745 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd56c0b4110 tx=0x7fd55c02f280 comp rx=0 tx=0).stop 2026-02-23T06:41:19.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.714+0000 7fd57425b640 1 -- 10.20.193.58:0/3945111704 shutdown_connections 2026-02-23T06:41:19.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.714+0000 7fd57425b640 1 --2- 10.20.193.58:0/3945111704 >> v2:10.20.193.58:3300/0 conn(0x7fd56c161ee0 0x7fd56c165c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:19.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.714+0000 7fd57425b640 1 --2- 10.20.193.58:0/3945111704 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd56c158740 0x7fd56c0b72c0 unknown :-1 s=CLOSED pgs=76 gs=2 cs=0 l=1 c_cookie=14079435098451944745 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:19.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.714+0000 7fd57425b640 1 -- 10.20.193.58:0/3945111704 >> 10.20.193.58:0/3945111704 conn(0x7fd56c058e50 msgr2=0x7fd56c059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:19.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.714+0000 7fd57425b640 1 -- 10.20.193.58:0/3945111704 shutdown_connections 2026-02-23T06:41:19.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.714+0000 7fd57425b640 1 -- 10.20.193.58:0/3945111704 wait complete. 2026-02-23T06:41:19.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.715+0000 7fd57425b640 1 Processor -- start 2026-02-23T06:41:19.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.715+0000 7fd57425b640 1 -- start start 2026-02-23T06:41:19.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.715+0000 7fd57425b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd56c158740 0x7fd56c0b04a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:19.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.716+0000 7fd57425b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd56c161ee0 0x7fd56c15b760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:19.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.716+0000 7fd57425b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd56c166180 0x7fd56c154960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:19.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.716+0000 7fd57425b640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fd56c05e8d0 con 0x7fd56c161ee0 2026-02-23T06:41:19.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.716+0000 7fd57425b640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fd56c0b0010 con 0x7fd56c166180 2026-02-23T06:41:19.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.716+0000 7fd57425b640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fd56c05e630 con 0x7fd56c158740 2026-02-23T06:41:19.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.716+0000 7fd5717cf640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd56c161ee0 msgr2=0x7fd56c15b760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:41:19.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.716+0000 7fd5717cf640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd56c161ee0 0x7fd56c15b760 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:41:19.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.716+0000 7fd571fd0640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd56c158740 0x7fd56c0b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:19.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.716+0000 7fd571fd0640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd56c158740 0x7fd56c0b04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:57920/0 (socket says 10.20.193.58:57920) 2026-02-23T06:41:19.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.716+0000 7fd571fd0640 1 -- 10.20.193.58:0/1996087329 learned_addr learned my addr 10.20.193.58:0/1996087329 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:41:19.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.716+0000 7fd5727d1640 1 --2- 10.20.193.58:0/1996087329 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd56c166180 0x7fd56c154960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:19.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.716+0000 7fd571fd0640 1 -- 10.20.193.58:0/1996087329 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd56c166180 msgr2=0x7fd56c154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:19.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.716+0000 7fd571fd0640 1 --2- 10.20.193.58:0/1996087329 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd56c166180 0x7fd56c154960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:19.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.716+0000 7fd571fd0640 1 -- 10.20.193.58:0/1996087329 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd56c161ee0 msgr2=0x7fd56c15b760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:41:19.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.716+0000 7fd571fd0640 1 --2- 10.20.193.58:0/1996087329 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd56c161ee0 0x7fd56c15b760 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:19.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.716+0000 7fd571fd0640 1 -- 10.20.193.58:0/1996087329 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd55c009570 con 0x7fd56c158740 2026-02-23T06:41:19.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.717+0000 7fd571fd0640 1 --2- 10.20.193.58:0/1996087329 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd56c158740 0x7fd56c0b04a0 secure :-1 s=READY pgs=29 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd55c005e70 tx=0x7fd55c0028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:19.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.717+0000 7fd55a7fc640 1 -- 10.20.193.58:0/1996087329 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd55c03d070 con 0x7fd56c158740 2026-02-23T06:41:19.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.717+0000 7fd57425b640 1 -- 10.20.193.58:0/1996087329 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd56c158cb0 con 0x7fd56c158740 2026-02-23T06:41:19.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.717+0000 7fd55a7fc640 1 -- 10.20.193.58:0/1996087329 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd55c004850 con 0x7fd56c158740 2026-02-23T06:41:19.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.717+0000 7fd55a7fc640 1 -- 10.20.193.58:0/1996087329 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd55c004c80 con 0x7fd56c158740 2026-02-23T06:41:19.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.717+0000 7fd57425b640 1 -- 10.20.193.58:0/1996087329 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd56c159270 con 0x7fd56c158740 2026-02-23T06:41:19.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.717+0000 7fd57425b640 1 --2- 10.20.193.58:0/1996087329 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd56c1fe630 0x7fd56c154ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:19.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.717+0000 7fd57425b640 1 -- 10.20.193.58:0/1996087329 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fd56c165720 con 0x7fd56c1fe630 2026-02-23T06:41:19.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.718+0000 7fd5717cf640 1 --2- 10.20.193.58:0/1996087329 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd56c1fe630 0x7fd56c154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:19.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.718+0000 7fd5717cf640 1 -- 10.20.193.58:0/1996087329 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd56c162c30 con 0x7fd56c1fe630 2026-02-23T06:41:19.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.718+0000 7fd5717cf640 1 --2- 10.20.193.58:0/1996087329 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd56c1fe630 0x7fd56c154ea0 secure :-1 s=READY pgs=30 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5600026f0 tx=0x7fd56000b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:19.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.719+0000 7fd55a7fc640 1 -- 10.20.193.58:0/1996087329 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd560003e80 con 0x7fd56c1fe630 2026-02-23T06:41:19.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.719+0000 7fd55a7fc640 1 -- 10.20.193.58:0/1996087329 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fd5600050f0 con 0x7fd56c1fe630 2026-02-23T06:41:19.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.719+0000 7fd55a7fc640 1 -- 10.20.193.58:0/1996087329 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd56c1fe630 msgr2=0x7fd56c154ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:19.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.719+0000 7fd55a7fc640 1 --2- 10.20.193.58:0/1996087329 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd56c1fe630 0x7fd56c154ea0 secure :-1 s=READY pgs=30 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5600026f0 tx=0x7fd56000b8f0 comp rx=0 tx=0).stop 2026-02-23T06:41:19.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.719+0000 7fd55a7fc640 1 -- 10.20.193.58:0/1996087329 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd56c1fe630 msgr2=0x7fd56c154ea0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:41:19.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.719+0000 7fd55a7fc640 1 --2- 10.20.193.58:0/1996087329 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd56c1fe630 0x7fd56c154ea0 secure :-1 s=CLOSED pgs=30 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5600026f0 tx=0x7fd56000b8f0 comp rx=0 tx=0).stop 2026-02-23T06:41:19.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.719+0000 7fd55a7fc640 1 -- 10.20.193.58:0/1996087329 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fd55c004de0 con 0x7fd56c158740 2026-02-23T06:41:19.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.720+0000 7fd55a7fc640 1 --2- 10.20.193.58:0/1996087329 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd53c07a430 0x7fd53c09a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:19.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.720+0000 7fd55a7fc640 1 -- 10.20.193.58:0/1996087329 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fd55c0c2580 con 0x7fd56c158740 2026-02-23T06:41:19.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.721+0000 7fd5717cf640 1 --2- 10.20.193.58:0/1996087329 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd53c07a430 0x7fd53c09a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:19.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.721+0000 7fd5717cf640 1 --2- 10.20.193.58:0/1996087329 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd53c07a430 0x7fd53c09a8e0 secure :-1 s=READY pgs=443 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd560012040 tx=0x7fd560008030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:19.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.722+0000 7fd57425b640 1 --2- 10.20.193.58:0/1996087329 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd56c2006f0 0x7fd56c200ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:19.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.722+0000 7fd57425b640 1 -- 10.20.193.58:0/1996087329 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fd56c0b0150 con 0x7fd56c2006f0 2026-02-23T06:41:19.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.722+0000 7fd5727d1640 1 --2- 10.20.193.58:0/1996087329 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd56c2006f0 0x7fd56c200ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:19.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.723+0000 7fd5727d1640 1 -- 10.20.193.58:0/1996087329 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd56c1553e0 con 0x7fd56c2006f0 2026-02-23T06:41:19.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.723+0000 7fd5727d1640 1 --2- 10.20.193.58:0/1996087329 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd56c2006f0 0x7fd56c200ac0 secure :-1 s=READY pgs=31 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd568003950 tx=0x7fd56800a990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:19.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.723+0000 7fd55a7fc640 1 -- 10.20.193.58:0/1996087329 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd568006d40 con 0x7fd56c2006f0 2026-02-23T06:41:19.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.724+0000 7fd55a7fc640 1 -- 10.20.193.58:0/1996087329 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5377 (secure 0 0 0) 0x7fd568013600 con 0x7fd56c2006f0 2026-02-23T06:41:19.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.724+0000 7fd55a7fc640 1 -- 10.20.193.58:0/1996087329 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd56c2006f0 msgr2=0x7fd56c200ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:19.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.724+0000 7fd55a7fc640 1 --2- 10.20.193.58:0/1996087329 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd56c2006f0 0x7fd56c200ac0 secure :-1 s=READY pgs=31 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd568003950 tx=0x7fd56800a990 comp rx=0 tx=0).stop 2026-02-23T06:41:19.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.724+0000 7fd55a7fc640 1 -- 10.20.193.58:0/1996087329 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd56c2006f0 msgr2=0x7fd56c200ac0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:41:19.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.724+0000 7fd55a7fc640 1 --2- 10.20.193.58:0/1996087329 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd56c2006f0 0x7fd56c200ac0 unknown :-1 s=CLOSED pgs=31 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:19.720 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:41:19.720 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:41:19.721 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:41:19.721 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:41:19.721 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 168, 2026-02-23T06:41:19.721 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 31584, 2026-02-23T06:41:19.721 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:41:19.721 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:41:19.721 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:41:19.721 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:19.721 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:41:19.721 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:41:19.721 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:41:19.722 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:41:19.722 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:19.722 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:19.722 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:19.722 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:19.722 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:19.722 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:19.722 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:19.722 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:19.722 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:19.722 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:19.722 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:19.723 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:19.723 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:19.723 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:19.723 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:41:19.723 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:41:19.723 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:19.723 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:19.723 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:19.723 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:19.723 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:19.723 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:19.723 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:19.724 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:19.724 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:19.724 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:19.724 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:19.724 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:19.724 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:19.724 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:19.724 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:19.724 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:41:19.724 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:41:19.724 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:41:19.724 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:41:19.724 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:41:19.725 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:41:19.725 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:41:19.725 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:41:19.725 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:41:19.725 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:41:19.725 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:41:19.725 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:41:19.725 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:41:19.725 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:41:19.725 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:41:19.725 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:41:19.725 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:41:19.726 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:19.726 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:19.726 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:19.726 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:19.726 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:19.726 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:19.726 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:19.726 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:19.726 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:19.726 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:19.726 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:19.726 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:19.726 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:19.727 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:19.727 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:41:19.727 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:19.727 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:41:19.727 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:19.727 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:41:19.727 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:41:19.727 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:19.727 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:19.727 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:19.727 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:19.727 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:41:19.728 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:19.728 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:19.728 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:19.728 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:19.728 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:41:19.728 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:19.728 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:19.728 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:19.728 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:19.728 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:41:19.728 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:41:19.728 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:19.729 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:19.729 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:41:19.729 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:19.729 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:19.729 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:19.729 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:41:19.729 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:41:19.729 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:19.729 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:19.729 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:19.729 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:19.729 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:41:19.729 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:19.730 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:19.730 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:19.730 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:19.730 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:41:19.730 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:19.730 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:19.730 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:19.730 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:19.730 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:41:19.730 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:41:19.730 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:19.730 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:19.731 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:41:19.731 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:19.731 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:19.731 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:19.731 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:41:19.731 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:41:19.731 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:19.731 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:19.731 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:19.731 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:19.731 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:41:19.731 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:19.731 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:19.732 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:19.732 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:19.732 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:41:19.732 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:19.732 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:19.732 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:19.732 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:19.732 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:41:19.732 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:41:19.732 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:19.732 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:19.732 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:41:19.733 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:19.733 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:19.733 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:19.733 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:19.733 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:41:19.733 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:41:19.733 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:19.733 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:19.733 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:19.733 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:41:19.733 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:19.733 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:19.734 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:41:19.734 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:19.734 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:19.734 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:19.734 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:41:19.734 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:19.734 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:19.734 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:41:19.734 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:19.734 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:19.734 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:19.734 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:41:19.734 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:19.735 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:19.735 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:41:19.735 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:19.735 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:41:19.735 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:41:19.735 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:41:19.735 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:19.735 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:19.735 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:19.735 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:19.735 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:41:19.735 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:19.735 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:19.735 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:19.736 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:41:19.736 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:41:19.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.724+0000 7fd57425b640 1 -- 10.20.193.58:0/1996087329 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd53c07a430 msgr2=0x7fd53c09a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:19.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.724+0000 7fd57425b640 1 --2- 10.20.193.58:0/1996087329 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd53c07a430 0x7fd53c09a8e0 secure :-1 s=READY pgs=443 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd560012040 tx=0x7fd560008030 comp rx=0 tx=0).stop 2026-02-23T06:41:19.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.724+0000 7fd57425b640 1 -- 10.20.193.58:0/1996087329 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd56c158740 msgr2=0x7fd56c0b04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:19.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.724+0000 7fd57425b640 1 --2- 10.20.193.58:0/1996087329 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd56c158740 0x7fd56c0b04a0 secure :-1 s=READY pgs=29 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd55c005e70 tx=0x7fd55c0028d0 comp rx=0 tx=0).stop 2026-02-23T06:41:19.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.724+0000 7fd5727d1640 1 -- 10.20.193.58:0/1996087329 reap_dead start 2026-02-23T06:41:19.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.724+0000 7fd57425b640 1 -- 10.20.193.58:0/1996087329 shutdown_connections 2026-02-23T06:41:19.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.724+0000 7fd57425b640 1 -- 10.20.193.58:0/1996087329 >> 10.20.193.58:0/1996087329 conn(0x7fd56c058e50 msgr2=0x7fd56c1565c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:19.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.724+0000 7fd57425b640 1 -- 10.20.193.58:0/1996087329 shutdown_connections 2026-02-23T06:41:19.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:19.724+0000 7fd57425b640 1 -- 10.20.193.58:0/1996087329 wait complete. 2026-02-23T06:41:19.738 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:41:19.738 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:41:39.739 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-23T06:41:39.740 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-23T06:41:39.740 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-23T06:41:39.740 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-23T06:41:39.746 INFO:tasks.ceph.mon.a:Started 2026-02-23T06:41:39.747 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:41:39.747 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:41:39.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.904+0000 7f94e2283640 1 -- 10.20.193.58:0/1065295376 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f94c4003a80 msgr2=0x7f94c4003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:39.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.904+0000 7f94e2283640 1 --2- 10.20.193.58:0/1065295376 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f94c4003a80 0x7f94c4003eb0 secure :-1 s=READY pgs=4 gs=6 cs=0 l=1 c_cookie=17278231277186251263 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94cc00bad0 tx=0x7f94cc02f6a0 comp rx=0 tx=0).stop 2026-02-23T06:41:39.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.904+0000 7f94e1a82640 1 -- 10.20.193.58:0/1065295376 reap_dead start 2026-02-23T06:41:39.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.904+0000 7f94e2283640 1 -- 10.20.193.58:0/1065295376 shutdown_connections 2026-02-23T06:41:39.901 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.904+0000 7f94e2283640 1 -- 10.20.193.58:0/1065295376 >> 10.20.193.58:0/1065295376 conn(0x7f94dc0b3c20 msgr2=0x7f94dc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:39.901 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.904+0000 7f94e2283640 1 -- 10.20.193.58:0/1065295376 shutdown_connections 2026-02-23T06:41:39.901 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.904+0000 7f94e2283640 1 -- 10.20.193.58:0/1065295376 wait complete. 2026-02-23T06:41:39.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.906+0000 7f94e2283640 1 Processor -- start 2026-02-23T06:41:39.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.906+0000 7f94e2283640 1 -- start start 2026-02-23T06:41:39.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.906+0000 7f94e2283640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f94dc058810 0x7f94dc162140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:39.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.906+0000 7f94e2283640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f94dc0b0050 0x7f94dc1610a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:39.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.906+0000 7f94e2283640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94dc162680 0x7f94dc1615e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:39.903 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.906+0000 7f94e2283640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f94dc0b0b10 con 0x7f94dc058810 2026-02-23T06:41:39.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.906+0000 7f94e2283640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f94dc0b08a0 con 0x7f94dc0b0050 2026-02-23T06:41:39.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.906+0000 7f94e2283640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f94dc162cc0 con 0x7f94dc162680 2026-02-23T06:41:39.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.907+0000 7f94e1281640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f94dc058810 0x7f94dc162140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:39.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.907+0000 7f94e1a82640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94dc162680 0x7f94dc1615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:39.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.907+0000 7f94e0a80640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f94dc0b0050 0x7f94dc1610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:39.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.907+0000 7f94e0a80640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f94dc0b0050 0x7f94dc1610a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:54656/0 (socket says 10.20.193.58:54656) 2026-02-23T06:41:39.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.907+0000 7f94e0a80640 1 -- 10.20.193.58:0/605004415 learned_addr learned my addr 10.20.193.58:0/605004415 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:41:39.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.907+0000 7f94e1281640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f94dc058810 0x7f94dc162140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:34212/0 (socket says 10.20.193.58:34212) 2026-02-23T06:41:39.904 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.907+0000 7f94e1281640 1 -- 10.20.193.58:0/605004415 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94dc162680 msgr2=0x7f94dc1615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:39.905 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.907+0000 7f94e1281640 1 --2- 10.20.193.58:0/605004415 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94dc162680 0x7f94dc1615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:39.905 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.907+0000 7f94e1281640 1 -- 10.20.193.58:0/605004415 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f94dc0b0050 msgr2=0x7f94dc1610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:39.905 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.907+0000 7f94e1281640 1 --2- 10.20.193.58:0/605004415 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f94dc0b0050 0x7f94dc1610a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:39.905 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.907+0000 7f94e1281640 1 -- 10.20.193.58:0/605004415 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94dc0b1760 con 0x7f94dc058810 2026-02-23T06:41:39.905 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.907+0000 7f94e1281640 1 --2- 10.20.193.58:0/605004415 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f94dc058810 0x7f94dc162140 secure :-1 s=READY pgs=5 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94cc0046d0 tx=0x7f94cc004a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:39.905 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.908+0000 7f94c9ffb640 1 -- 10.20.193.58:0/605004415 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94cc005160 con 0x7f94dc058810 2026-02-23T06:41:39.905 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.908+0000 7f94c9ffb640 1 -- 10.20.193.58:0/605004415 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94cc005410 con 0x7f94dc058810 2026-02-23T06:41:39.905 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.908+0000 7f94c9ffb640 1 -- 10.20.193.58:0/605004415 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94cc0026a0 con 0x7f94dc058810 2026-02-23T06:41:39.905 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.908+0000 7f94e2283640 1 -- 10.20.193.58:0/605004415 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94dc0b1a40 con 0x7f94dc058810 2026-02-23T06:41:39.905 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.908+0000 7f94e2283640 1 -- 10.20.193.58:0/605004415 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94dc160b80 con 0x7f94dc058810 2026-02-23T06:41:39.906 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.908+0000 7f94e2283640 1 -- 10.20.193.58:0/605004415 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94dc0b5b00 con 0x7f94dc058810 2026-02-23T06:41:39.906 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.911+0000 7f94c9ffb640 1 -- 10.20.193.58:0/605004415 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f94cc03e040 con 0x7f94dc058810 2026-02-23T06:41:39.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.912+0000 7f94c9ffb640 1 --2- 10.20.193.58:0/605004415 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f94ac07a6c0 0x7f94ac09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:39.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.912+0000 7f94c9ffb640 1 -- 10.20.193.58:0/605004415 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f94cc0c3460 con 0x7f94dc058810 2026-02-23T06:41:39.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.912+0000 7f94e0a80640 1 --2- 10.20.193.58:0/605004415 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f94ac07a6c0 0x7f94ac09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:39.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.913+0000 7f94c9ffb640 1 -- 10.20.193.58:0/605004415 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f94cc0866a0 con 0x7f94dc058810 2026-02-23T06:41:39.907 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:39.913+0000 7f94e0a80640 1 --2- 10.20.193.58:0/605004415 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f94ac07a6c0 0x7f94ac09ab70 secure :-1 s=READY pgs=445 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94dc155750 tx=0x7f94d0002f40 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:40.062 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.067+0000 7f94e2283640 1 -- 10.20.193.58:0/605004415 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f94dc057090 con 0x7f94dc058810 2026-02-23T06:41:40.062 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.067+0000 7f94c9ffb640 1 -- 10.20.193.58:0/605004415 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f94cc002800 con 0x7f94dc058810 2026-02-23T06:41:40.062 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":172,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:41:40.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.068+0000 7f94e2283640 1 -- 10.20.193.58:0/605004415 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f94ac07a6c0 msgr2=0x7f94ac09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:40.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.068+0000 7f94e2283640 1 --2- 10.20.193.58:0/605004415 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f94ac07a6c0 0x7f94ac09ab70 secure :-1 s=READY pgs=445 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94dc155750 tx=0x7f94d0002f40 comp rx=0 tx=0).stop 2026-02-23T06:41:40.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.068+0000 7f94e2283640 1 -- 10.20.193.58:0/605004415 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f94dc058810 msgr2=0x7f94dc162140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:40.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.068+0000 7f94e2283640 1 --2- 10.20.193.58:0/605004415 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f94dc058810 0x7f94dc162140 secure :-1 s=READY pgs=5 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94cc0046d0 tx=0x7f94cc004a80 comp rx=0 tx=0).stop 2026-02-23T06:41:40.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.068+0000 7f94e2283640 1 -- 10.20.193.58:0/605004415 shutdown_connections 2026-02-23T06:41:40.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.068+0000 7f94e2283640 1 --2- 10.20.193.58:0/605004415 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f94ac07a6c0 0x7f94ac09ab70 unknown :-1 s=CLOSED pgs=445 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.068+0000 7f94e2283640 1 --2- 10.20.193.58:0/605004415 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94dc162680 0x7f94dc1615e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.068+0000 7f94e2283640 1 --2- 10.20.193.58:0/605004415 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f94dc0b0050 0x7f94dc1610a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.068+0000 7f94e2283640 1 --2- 10.20.193.58:0/605004415 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f94dc058810 0x7f94dc162140 unknown :-1 s=CLOSED pgs=5 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.068+0000 7f94e2283640 1 -- 10.20.193.58:0/605004415 >> 10.20.193.58:0/605004415 conn(0x7f94dc0b3c20 msgr2=0x7f94dc15a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:40.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.068+0000 7f94e2283640 1 -- 10.20.193.58:0/605004415 shutdown_connections 2026-02-23T06:41:40.063 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.068+0000 7f94e2283640 1 -- 10.20.193.58:0/605004415 wait complete. 2026-02-23T06:41:40.074 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:41:40.074 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:41:40.074 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:41:40.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.201+0000 7fba63577640 1 -- 10.20.193.58:0/3142406514 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fba64056960 msgr2=0x7fba64058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:40.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.201+0000 7fba63577640 1 --2- 10.20.193.58:0/3142406514 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fba64056960 0x7fba64058200 secure :-1 s=READY pgs=34 gs=3 cs=0 l=1 c_cookie=11784614071962648557 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba4c009890 tx=0x7fba4c02f200 comp rx=0 tx=0).stop 2026-02-23T06:41:40.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.201+0000 7fba63577640 1 -- 10.20.193.58:0/3142406514 shutdown_connections 2026-02-23T06:41:40.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.201+0000 7fba63577640 1 --2- 10.20.193.58:0/3142406514 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fba64056960 0x7fba64058200 unknown :-1 s=CLOSED pgs=34 gs=3 cs=0 l=1 c_cookie=11784614071962648557 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.201+0000 7fba63577640 1 -- 10.20.193.58:0/3142406514 >> 10.20.193.58:0/3142406514 conn(0x7fba640b3c20 msgr2=0x7fba640b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:40.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.201+0000 7fba63577640 1 -- 10.20.193.58:0/3142406514 shutdown_connections 2026-02-23T06:41:40.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.201+0000 7fba63577640 1 -- 10.20.193.58:0/3142406514 wait complete. 2026-02-23T06:41:40.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.202+0000 7fba63577640 1 Processor -- start 2026-02-23T06:41:40.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.202+0000 7fba63577640 1 -- start start 2026-02-23T06:41:40.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.203+0000 7fba63577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fba64056960 0x7fba6413d070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:40.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.203+0000 7fba63577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba6415c4b0 0x7fba640b02d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:40.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.203+0000 7fba63577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba64162ca0 0x7fba6405b6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:40.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.203+0000 7fba63577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fba6413cbe0 con 0x7fba64162ca0 2026-02-23T06:41:40.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.203+0000 7fba63577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fba641fd770 con 0x7fba6415c4b0 2026-02-23T06:41:40.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.203+0000 7fba63577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fba641fda30 con 0x7fba64056960 2026-02-23T06:41:40.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.203+0000 7fba62575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fba64056960 0x7fba6413d070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:40.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.203+0000 7fba61d74640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba6415c4b0 0x7fba640b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:40.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.203+0000 7fba62d76640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba64162ca0 0x7fba6405b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:40.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.203+0000 7fba61d74640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba6415c4b0 0x7fba640b02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:54672/0 (socket says 10.20.193.58:54672) 2026-02-23T06:41:40.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.203+0000 7fba61d74640 1 -- 10.20.193.58:0/2788027557 learned_addr learned my addr 10.20.193.58:0/2788027557 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:41:40.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.203+0000 7fba61d74640 1 -- 10.20.193.58:0/2788027557 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fba64056960 msgr2=0x7fba6413d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:40.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.203+0000 7fba61d74640 1 --2- 10.20.193.58:0/2788027557 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fba64056960 0x7fba6413d070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.203+0000 7fba61d74640 1 -- 10.20.193.58:0/2788027557 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba64162ca0 msgr2=0x7fba6405b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:40.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.203+0000 7fba61d74640 1 --2- 10.20.193.58:0/2788027557 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba64162ca0 0x7fba6405b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.203+0000 7fba61d74640 1 -- 10.20.193.58:0/2788027557 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba4c0094b0 con 0x7fba6415c4b0 2026-02-23T06:41:40.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.203+0000 7fba62d76640 1 --2- 10.20.193.58:0/2788027557 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba64162ca0 0x7fba6405b6c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:41:40.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.204+0000 7fba61d74640 1 --2- 10.20.193.58:0/2788027557 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba6415c4b0 0x7fba640b02d0 secure :-1 s=READY pgs=80 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba4c0023d0 tx=0x7fba4c002950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:40.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.204+0000 7fba4affd640 1 -- 10.20.193.58:0/2788027557 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba4c038470 con 0x7fba6415c4b0 2026-02-23T06:41:40.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.204+0000 7fba4affd640 1 -- 10.20.193.58:0/2788027557 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba4c0386c0 con 0x7fba6415c4b0 2026-02-23T06:41:40.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.204+0000 7fba4affd640 1 -- 10.20.193.58:0/2788027557 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba4c038ad0 con 0x7fba6415c4b0 2026-02-23T06:41:40.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.204+0000 7fba63577640 1 -- 10.20.193.58:0/2788027557 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba6413bfd0 con 0x7fba6415c4b0 2026-02-23T06:41:40.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.204+0000 7fba63577640 1 -- 10.20.193.58:0/2788027557 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba6413c590 con 0x7fba6415c4b0 2026-02-23T06:41:40.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.204+0000 7fba48ff9640 1 --2- 10.20.193.58:0/2788027557 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba200041f0 0x7fba200246a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:40.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.204+0000 7fba48ff9640 1 -- 10.20.193.58:0/2788027557 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fba20025f20 con 0x7fba200041f0 2026-02-23T06:41:40.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.205+0000 7fba62575640 1 --2- 10.20.193.58:0/2788027557 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba200041f0 0x7fba200246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:40.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.205+0000 7fba62575640 1 -- 10.20.193.58:0/2788027557 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fba200260e0 con 0x7fba200041f0 2026-02-23T06:41:40.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.205+0000 7fba62575640 1 --2- 10.20.193.58:0/2788027557 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba200041f0 0x7fba200246a0 secure :-1 s=READY pgs=7 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba5800f770 tx=0x7fba5800fc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:40.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.205+0000 7fba4affd640 1 -- 10.20.193.58:0/2788027557 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba5800d920 con 0x7fba200041f0 2026-02-23T06:41:40.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.206+0000 7fba4affd640 1 -- 10.20.193.58:0/2788027557 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fba4c038c30 con 0x7fba6415c4b0 2026-02-23T06:41:40.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.207+0000 7fba4affd640 1 --2- 10.20.193.58:0/2788027557 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fba3007eb70 0x7fba3009f020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:40.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.207+0000 7fba4affd640 1 -- 10.20.193.58:0/2788027557 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fba4c0c2ab0 con 0x7fba6415c4b0 2026-02-23T06:41:40.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.207+0000 7fba4affd640 1 -- 10.20.193.58:0/2788027557 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fba5800da80 con 0x7fba200041f0 2026-02-23T06:41:40.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.207+0000 7fba4affd640 1 -- 10.20.193.58:0/2788027557 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba200041f0 msgr2=0x7fba200246a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:40.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.207+0000 7fba4affd640 1 --2- 10.20.193.58:0/2788027557 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba200041f0 0x7fba200246a0 secure :-1 s=READY pgs=7 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba5800f770 tx=0x7fba5800fc40 comp rx=0 tx=0).stop 2026-02-23T06:41:40.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.207+0000 7fba4affd640 1 -- 10.20.193.58:0/2788027557 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba200041f0 msgr2=0x7fba200246a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:41:40.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.207+0000 7fba4affd640 1 --2- 10.20.193.58:0/2788027557 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba200041f0 0x7fba200246a0 unknown :-1 s=CLOSED pgs=7 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.207+0000 7fba62d76640 1 --2- 10.20.193.58:0/2788027557 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fba3007eb70 0x7fba3009f020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:40.204 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.207+0000 7fba62d76640 1 --2- 10.20.193.58:0/2788027557 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fba3007eb70 0x7fba3009f020 secure :-1 s=READY pgs=446 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba54008bf0 tx=0x7fba54008b40 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:40.205 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.210+0000 7fba48ff9640 1 --2- 10.20.193.58:0/2788027557 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba200250a0 0x7fba200254f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:40.205 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.210+0000 7fba48ff9640 1 -- 10.20.193.58:0/2788027557 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fba20025ba0 con 0x7fba200250a0 2026-02-23T06:41:40.205 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.210+0000 7fba62575640 1 --2- 10.20.193.58:0/2788027557 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba200250a0 0x7fba200254f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:40.206 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.211+0000 7fba62575640 1 -- 10.20.193.58:0/2788027557 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fba20025d30 con 0x7fba200250a0 2026-02-23T06:41:40.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.211+0000 7fba62575640 1 --2- 10.20.193.58:0/2788027557 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba200250a0 0x7fba200254f0 secure :-1 s=READY pgs=8 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba5800f770 tx=0x7fba58002960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:40.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.211+0000 7fba4affd640 1 -- 10.20.193.58:0/2788027557 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba58014bf0 con 0x7fba200250a0 2026-02-23T06:41:40.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.212+0000 7fba4affd640 1 -- 10.20.193.58:0/2788027557 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4911 (secure 0 0 0) 0x7fba58014d50 con 0x7fba200250a0 2026-02-23T06:41:40.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.212+0000 7fba4affd640 1 -- 10.20.193.58:0/2788027557 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba200250a0 msgr2=0x7fba200254f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:40.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.212+0000 7fba4affd640 1 --2- 10.20.193.58:0/2788027557 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba200250a0 0x7fba200254f0 secure :-1 s=READY pgs=8 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba5800f770 tx=0x7fba58002960 comp rx=0 tx=0).stop 2026-02-23T06:41:40.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.212+0000 7fba4affd640 1 -- 10.20.193.58:0/2788027557 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba200250a0 msgr2=0x7fba200254f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:41:40.207 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.212+0000 7fba4affd640 1 --2- 10.20.193.58:0/2788027557 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fba200250a0 0x7fba200254f0 unknown :-1 s=CLOSED pgs=8 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.208 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:41:40.208 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:41:40.208 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:41:40.208 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:41:40.208 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 172, 2026-02-23T06:41:40.208 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 331, 2026-02-23T06:41:40.208 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:41:40.208 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:41:40.208 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:41:40.208 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:41:40.209 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:40.209 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:41:40.209 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:41:40.209 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:41:40.209 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:41:40.209 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:40.209 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:40.209 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:40.209 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:40.209 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:40.209 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:40.210 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:40.210 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:40.210 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:40.210 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:40.210 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:40.210 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:40.210 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:40.210 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:40.210 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:41:40.210 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:41:40.210 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:40.210 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:40.211 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:40.211 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:40.211 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:40.211 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:40.211 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:40.211 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:40.211 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:40.211 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:40.211 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:40.211 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:40.211 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:40.211 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:40.212 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.212 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:41:40.212 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:41:40.212 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:41:40.212 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:41:40.212 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:41:40.212 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:41:40.212 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:41:40.212 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:41:40.212 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:41:40.212 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:41:40.212 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:41:40.213 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:41:40.213 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:41:40.213 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:41:40.213 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:41:40.213 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:41:40.213 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:41:40.213 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:40.213 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:40.213 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:40.213 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:40.213 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:40.213 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:40.213 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:40.214 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:40.214 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:40.214 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:40.214 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:40.214 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:40.214 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:40.214 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:40.214 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:41:40.214 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.214 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:41:40.214 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.215 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:41:40.215 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:41:40.215 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:40.215 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:40.215 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.215 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:40.215 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:41:40.215 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:40.215 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.215 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.215 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:40.215 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:41:40.215 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:40.216 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:40.216 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:40.216 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.216 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:41:40.216 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:41:40.216 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:40.216 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:40.216 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:41:40.216 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:40.216 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.216 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.216 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:41:40.217 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:41:40.217 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:40.217 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:40.217 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.217 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:40.217 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:41:40.217 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:40.217 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.217 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.217 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:40.217 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:41:40.217 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:40.218 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:40.218 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:40.218 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.218 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:41:40.218 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:41:40.218 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:40.218 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:40.218 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:41:40.218 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:40.218 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.218 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.218 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:41:40.219 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:41:40.219 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:40.219 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:40.219 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.219 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:40.219 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:41:40.219 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:40.219 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.219 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.219 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:40.219 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:41:40.219 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:40.219 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:40.220 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:40.220 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.220 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:41:40.220 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:41:40.220 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:40.220 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:40.220 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:41:40.220 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:40.220 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:40.220 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:40.220 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.220 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:41:40.221 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:41:40.221 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.221 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:40.221 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:40.221 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:41:40.221 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:40.221 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:40.221 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:41:40.221 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.221 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:40.221 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:40.221 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:41:40.221 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:40.222 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:40.222 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.222 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:41:40.222 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:41:40.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.212+0000 7fba48ff9640 1 -- 10.20.193.58:0/2788027557 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fba3007eb70 msgr2=0x7fba3009f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:40.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.212+0000 7fba48ff9640 1 --2- 10.20.193.58:0/2788027557 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fba3007eb70 0x7fba3009f020 secure :-1 s=READY pgs=446 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba54008bf0 tx=0x7fba54008b40 comp rx=0 tx=0).stop 2026-02-23T06:41:40.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.212+0000 7fba48ff9640 1 -- 10.20.193.58:0/2788027557 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba6415c4b0 msgr2=0x7fba640b02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:40.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.212+0000 7fba48ff9640 1 --2- 10.20.193.58:0/2788027557 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fba6415c4b0 0x7fba640b02d0 secure :-1 s=READY pgs=80 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba4c0023d0 tx=0x7fba4c002950 comp rx=0 tx=0).stop 2026-02-23T06:41:40.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.212+0000 7fba62d76640 1 -- 10.20.193.58:0/2788027557 reap_dead start 2026-02-23T06:41:40.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.212+0000 7fba62d76640 1 -- 10.20.193.58:0/2788027557 reap_dead start 2026-02-23T06:41:40.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.212+0000 7fba48ff9640 1 -- 10.20.193.58:0/2788027557 shutdown_connections 2026-02-23T06:41:40.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.212+0000 7fba48ff9640 1 -- 10.20.193.58:0/2788027557 >> 10.20.193.58:0/2788027557 conn(0x7fba640b3c20 msgr2=0x7fba64159d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:40.224 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.212+0000 7fba48ff9640 1 -- 10.20.193.58:0/2788027557 shutdown_connections 2026-02-23T06:41:40.225 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.212+0000 7fba48ff9640 1 -- 10.20.193.58:0/2788027557 wait complete. 2026-02-23T06:41:40.225 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:41:40.225 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:41:40.225 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:41:40.346 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.351+0000 7f8c12954640 1 -- 10.20.193.58:0/3652066036 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8c0c0b6690 msgr2=0x7f8c0c058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:40.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.351+0000 7f8c12954640 1 --2- 10.20.193.58:0/3652066036 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8c0c0b6690 0x7f8c0c058cf0 secure :-1 s=READY pgs=9 gs=2 cs=0 l=1 c_cookie=4472394532648865995 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c0c0b5040 tx=0x7f8c08030340 comp rx=0 tx=0).stop 2026-02-23T06:41:40.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.351+0000 7f8c12954640 1 -- 10.20.193.58:0/3652066036 shutdown_connections 2026-02-23T06:41:40.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.351+0000 7f8c12954640 1 --2- 10.20.193.58:0/3652066036 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8c0c0b6690 0x7f8c0c058cf0 unknown :-1 s=CLOSED pgs=9 gs=2 cs=0 l=1 c_cookie=4472394532648865995 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.351+0000 7f8c12954640 1 --2- 10.20.193.58:0/3652066036 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8c0c15d870 0x7f8c0c0587b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.351+0000 7f8c12954640 1 --2- 10.20.193.58:0/3652066036 >> v2:10.20.193.93:3300/0 conn(0x7f8c0c15d4a0 0x7f8c0c0affb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.351+0000 7f8c12954640 1 -- 10.20.193.58:0/3652066036 >> 10.20.193.58:0/3652066036 conn(0x7f8c0c0b3c20 msgr2=0x7f8c0c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:40.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.351+0000 7f8c12954640 1 -- 10.20.193.58:0/3652066036 shutdown_connections 2026-02-23T06:41:40.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.351+0000 7f8c12954640 1 -- 10.20.193.58:0/3652066036 wait complete. 2026-02-23T06:41:40.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.352+0000 7f8c12954640 1 Processor -- start 2026-02-23T06:41:40.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.352+0000 7f8c12954640 1 -- start start 2026-02-23T06:41:40.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.353+0000 7f8c12954640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8c0c0b6690 0x7f8c0c13d240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:40.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.353+0000 7f8c12954640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8c0c15d4a0 0x7f8c0c123410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:40.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.353+0000 7f8c12954640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8c0c15d870 0x7f8c0c14d880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:40.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.353+0000 7f8c12954640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0c13eb70 con 0x7f8c0c0b6690 2026-02-23T06:41:40.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.353+0000 7f8c12954640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0c120c10 con 0x7f8c0c15d4a0 2026-02-23T06:41:40.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.353+0000 7f8c12954640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f8c0c120ed0 con 0x7f8c0c15d870 2026-02-23T06:41:40.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.353+0000 7f8c11952640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8c0c0b6690 0x7f8c0c13d240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:40.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.353+0000 7f8c11952640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8c0c0b6690 0x7f8c0c13d240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:34244/0 (socket says 10.20.193.58:34244) 2026-02-23T06:41:40.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.353+0000 7f8c11952640 1 -- 10.20.193.58:0/1593548738 learned_addr learned my addr 10.20.193.58:0/1593548738 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:41:40.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.353+0000 7f8c12153640 1 --2- 10.20.193.58:0/1593548738 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8c0c15d870 0x7f8c0c14d880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:40.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.353+0000 7f8c11952640 1 -- 10.20.193.58:0/1593548738 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8c0c15d870 msgr2=0x7f8c0c14d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:40.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.353+0000 7f8c11952640 1 --2- 10.20.193.58:0/1593548738 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8c0c15d870 0x7f8c0c14d880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.353+0000 7f8c11952640 1 -- 10.20.193.58:0/1593548738 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8c0c15d4a0 msgr2=0x7f8c0c123410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:40.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.353+0000 7f8c11952640 1 --2- 10.20.193.58:0/1593548738 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8c0c15d4a0 0x7f8c0c123410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.353+0000 7f8c11952640 1 -- 10.20.193.58:0/1593548738 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c0800a650 con 0x7f8c0c0b6690 2026-02-23T06:41:40.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.353+0000 7f8c11952640 1 --2- 10.20.193.58:0/1593548738 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8c0c0b6690 0x7f8c0c13d240 secure :-1 s=READY pgs=10 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8bfc00d950 tx=0x7f8bfc00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:40.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.353+0000 7f8bfa7fc640 1 -- 10.20.193.58:0/1593548738 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8bfc005d00 con 0x7f8c0c0b6690 2026-02-23T06:41:40.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.353+0000 7f8bfa7fc640 1 -- 10.20.193.58:0/1593548738 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8bfc009820 con 0x7f8c0c0b6690 2026-02-23T06:41:40.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.353+0000 7f8bfa7fc640 1 -- 10.20.193.58:0/1593548738 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8bfc009c50 con 0x7f8c0c0b6690 2026-02-23T06:41:40.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.353+0000 7f8c12954640 1 -- 10.20.193.58:0/1593548738 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c0c13e1d0 con 0x7f8c0c0b6690 2026-02-23T06:41:40.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.354+0000 7f8c12954640 1 -- 10.20.193.58:0/1593548738 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c0c13e790 con 0x7f8c0c0b6690 2026-02-23T06:41:40.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.354+0000 7f8c12954640 1 --2- 10.20.193.58:0/1593548738 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8c0c162060 0x7f8c0c14ddc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:40.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.354+0000 7f8c12954640 1 -- 10.20.193.58:0/1593548738 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0c164250 con 0x7f8c0c162060 2026-02-23T06:41:40.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.354+0000 7f8c11151640 1 --2- 10.20.193.58:0/1593548738 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8c0c162060 0x7f8c0c14ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:40.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.355+0000 7f8c11151640 1 -- 10.20.193.58:0/1593548738 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8c0c0b6330 con 0x7f8c0c162060 2026-02-23T06:41:40.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.355+0000 7f8c11151640 1 --2- 10.20.193.58:0/1593548738 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8c0c162060 0x7f8c0c14ddc0 secure :-1 s=READY pgs=81 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c0c11dbc0 tx=0x7f8c0000ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:40.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.355+0000 7f8bfa7fc640 1 -- 10.20.193.58:0/1593548738 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c0000cca0 con 0x7f8c0c162060 2026-02-23T06:41:40.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.356+0000 7f8bfa7fc640 1 -- 10.20.193.58:0/1593548738 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f8bfc0026a0 con 0x7f8c0c0b6690 2026-02-23T06:41:40.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.357+0000 7f8bfa7fc640 1 --2- 10.20.193.58:0/1593548738 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8be407a660 0x7f8be409ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:40.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.357+0000 7f8bfa7fc640 1 -- 10.20.193.58:0/1593548738 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f8bfc09dae0 con 0x7f8c0c0b6690 2026-02-23T06:41:40.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.357+0000 7f8bfa7fc640 1 -- 10.20.193.58:0/1593548738 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f8c0000ce00 con 0x7f8c0c162060 2026-02-23T06:41:40.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.357+0000 7f8bfa7fc640 1 -- 10.20.193.58:0/1593548738 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8c0c162060 msgr2=0x7f8c0c14ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:40.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.357+0000 7f8bfa7fc640 1 --2- 10.20.193.58:0/1593548738 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8c0c162060 0x7f8c0c14ddc0 secure :-1 s=READY pgs=81 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c0c11dbc0 tx=0x7f8c0000ed90 comp rx=0 tx=0).stop 2026-02-23T06:41:40.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.357+0000 7f8bfa7fc640 1 -- 10.20.193.58:0/1593548738 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8c0c162060 msgr2=0x7f8c0c14ddc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:41:40.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.357+0000 7f8bfa7fc640 1 --2- 10.20.193.58:0/1593548738 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8c0c162060 0x7f8c0c14ddc0 secure :-1 s=CLOSED pgs=81 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c0c11dbc0 tx=0x7f8c0000ed90 comp rx=0 tx=0).stop 2026-02-23T06:41:40.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.357+0000 7f8c12153640 1 --2- 10.20.193.58:0/1593548738 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8be407a660 0x7f8be409ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:40.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.357+0000 7f8c12153640 1 --2- 10.20.193.58:0/1593548738 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8be407a660 0x7f8be409ab10 secure :-1 s=READY pgs=447 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c0800a980 tx=0x7f8c0803b040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:40.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.361+0000 7f8c12954640 1 --2- 10.20.193.58:0/1593548738 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8c0c1201e0 0x7f8c0c14e300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:40.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.361+0000 7f8c12954640 1 -- 10.20.193.58:0/1593548738 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0c1205b0 con 0x7f8c0c1201e0 2026-02-23T06:41:40.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.361+0000 7f8c11151640 1 --2- 10.20.193.58:0/1593548738 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8c0c1201e0 0x7f8c0c14e300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:40.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.361+0000 7f8c11151640 1 -- 10.20.193.58:0/1593548738 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8c0c13ede0 con 0x7f8c0c1201e0 2026-02-23T06:41:40.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.362+0000 7f8c11151640 1 --2- 10.20.193.58:0/1593548738 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8c0c1201e0 0x7f8c0c14e300 secure :-1 s=READY pgs=82 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c0c11dbc0 tx=0x7f8c00004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:40.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.362+0000 7f8bfa7fc640 1 -- 10.20.193.58:0/1593548738 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c00022070 con 0x7f8c0c1201e0 2026-02-23T06:41:40.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.362+0000 7f8bfa7fc640 1 -- 10.20.193.58:0/1593548738 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5413 (secure 0 0 0) 0x7f8c0001d790 con 0x7f8c0c1201e0 2026-02-23T06:41:40.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.362+0000 7f8bfa7fc640 1 -- 10.20.193.58:0/1593548738 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8c0c1201e0 msgr2=0x7f8c0c14e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:40.358 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:41:40.358 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:41:40.358 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:41:40.358 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:41:40.358 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 172, 2026-02-23T06:41:40.358 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 104451, 2026-02-23T06:41:40.358 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:41:40.358 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:41:40.359 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:41:40.359 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:41:40.359 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:40.359 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:41:40.359 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:41:40.359 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:41:40.359 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:41:40.359 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:40.359 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:40.359 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:40.359 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:40.360 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:40.360 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:40.360 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:40.360 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:40.360 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:40.360 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:40.360 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:40.360 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:40.360 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:40.360 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:40.360 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:41:40.360 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:41:40.361 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:40.361 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:40.361 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:40.361 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:40.361 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:40.361 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:40.361 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:40.361 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:40.361 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:40.361 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:40.361 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:40.361 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:40.362 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:40.362 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:40.362 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.362 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:41:40.362 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:41:40.362 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:41:40.362 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:41:40.362 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:41:40.362 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:41:40.362 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:41:40.362 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:41:40.363 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:41:40.363 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:41:40.363 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:41:40.363 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:41:40.363 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:41:40.363 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:41:40.363 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:41:40.363 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:41:40.363 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:41:40.363 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:40.363 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:40.363 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:40.364 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:40.364 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:40.364 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:40.364 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:40.364 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:40.364 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:40.364 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:40.364 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:40.364 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:40.364 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:40.364 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:40.364 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:41:40.364 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.365 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:41:40.365 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.365 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:41:40.365 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:41:40.365 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:40.365 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:40.365 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.365 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:40.365 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:41:40.365 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:40.365 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.365 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.366 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:40.366 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:41:40.366 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:40.366 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:40.366 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:40.366 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.366 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:41:40.366 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:41:40.366 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:40.366 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:40.366 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:41:40.366 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:40.367 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.367 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.367 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:41:40.367 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:41:40.367 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:40.367 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:40.367 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.367 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:40.367 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:41:40.367 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:40.367 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.367 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.368 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:40.368 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:41:40.368 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:40.368 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:40.368 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:40.368 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.368 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:41:40.368 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:41:40.368 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:40.368 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:40.368 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:41:40.368 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:40.369 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.369 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.369 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:41:40.369 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:41:40.369 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:40.369 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:40.369 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.369 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:40.369 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:41:40.369 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:40.369 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.369 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.370 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:40.370 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:41:40.370 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:40.370 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:40.370 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:40.370 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.370 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:41:40.370 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:41:40.370 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:40.370 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:40.370 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:41:40.370 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:40.371 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:40.371 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:40.371 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.371 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:41:40.371 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:41:40.371 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.371 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:40.371 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:40.371 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:41:40.371 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:40.371 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:40.371 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:41:40.372 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.372 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:40.372 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:40.372 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:41:40.372 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:40.372 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:40.372 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:41:40.372 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.372 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:40.372 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:40.373 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:41:40.373 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:40.373 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:40.373 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:41:40.373 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.373 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:40.373 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:40.373 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:41:40.373 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:40.373 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:40.373 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:41:40.373 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.374 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:40.374 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:40.374 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:41:40.374 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:40.374 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:40.374 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.374 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:41:40.374 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:41:40.376 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.362+0000 7f8bfa7fc640 1 --2- 10.20.193.58:0/1593548738 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8c0c1201e0 0x7f8c0c14e300 secure :-1 s=READY pgs=82 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c0c11dbc0 tx=0x7f8c00004770 comp rx=0 tx=0).stop 2026-02-23T06:41:40.376 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.362+0000 7f8bfa7fc640 1 -- 10.20.193.58:0/1593548738 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8c0c1201e0 msgr2=0x7f8c0c14e300 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:41:40.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.362+0000 7f8bfa7fc640 1 --2- 10.20.193.58:0/1593548738 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8c0c1201e0 0x7f8c0c14e300 secure :-1 s=CLOSED pgs=82 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c0c11dbc0 tx=0x7f8c00004770 comp rx=0 tx=0).stop 2026-02-23T06:41:40.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.362+0000 7f8c12954640 1 -- 10.20.193.58:0/1593548738 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8be407a660 msgr2=0x7f8be409ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:40.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.362+0000 7f8c12954640 1 --2- 10.20.193.58:0/1593548738 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8be407a660 0x7f8be409ab10 secure :-1 s=READY pgs=447 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c0800a980 tx=0x7f8c0803b040 comp rx=0 tx=0).stop 2026-02-23T06:41:40.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.362+0000 7f8c12954640 1 -- 10.20.193.58:0/1593548738 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8c0c0b6690 msgr2=0x7f8c0c13d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:40.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.362+0000 7f8c12954640 1 --2- 10.20.193.58:0/1593548738 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8c0c0b6690 0x7f8c0c13d240 secure :-1 s=READY pgs=10 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8bfc00d950 tx=0x7f8bfc00de20 comp rx=0 tx=0).stop 2026-02-23T06:41:40.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.362+0000 7f8c12153640 1 -- 10.20.193.58:0/1593548738 reap_dead start 2026-02-23T06:41:40.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.362+0000 7f8c12153640 1 -- 10.20.193.58:0/1593548738 reap_dead start 2026-02-23T06:41:40.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.362+0000 7f8c12954640 1 -- 10.20.193.58:0/1593548738 shutdown_connections 2026-02-23T06:41:40.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.362+0000 7f8c12954640 1 -- 10.20.193.58:0/1593548738 >> 10.20.193.58:0/1593548738 conn(0x7f8c0c0b3c20 msgr2=0x7f8c0c15ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:40.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.362+0000 7f8c12954640 1 -- 10.20.193.58:0/1593548738 shutdown_connections 2026-02-23T06:41:40.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.362+0000 7f8c12954640 1 -- 10.20.193.58:0/1593548738 wait complete. 2026-02-23T06:41:40.378 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:41:40.378 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:41:40.378 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:41:40.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.505+0000 7f5ed8d30640 1 -- 10.20.193.58:0/2297444796 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ed40b6690 msgr2=0x7f5ed4058ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:40.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.505+0000 7f5ed8d30640 1 --2- 10.20.193.58:0/2297444796 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ed40b6690 0x7f5ed4058ec0 secure :-1 s=READY pgs=12 gs=2 cs=0 l=1 c_cookie=6745463177005823670 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ed40b5040 tx=0x7f5ec8030340 comp rx=0 tx=0).stop 2026-02-23T06:41:40.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.505+0000 7f5ed8d30640 1 -- 10.20.193.58:0/2297444796 shutdown_connections 2026-02-23T06:41:40.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.505+0000 7f5ed8d30640 1 --2- 10.20.193.58:0/2297444796 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ed40b6690 0x7f5ed4058ec0 unknown :-1 s=CLOSED pgs=12 gs=2 cs=0 l=1 c_cookie=6745463177005823670 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.505+0000 7f5ed8d30640 1 --2- 10.20.193.58:0/2297444796 >> v2:10.20.193.93:3300/0 conn(0x7f5ed415d4a0 0x7f5ed40affb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.505+0000 7f5ed8d30640 1 -- 10.20.193.58:0/2297444796 >> 10.20.193.58:0/2297444796 conn(0x7f5ed40b3c20 msgr2=0x7f5ed40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:40.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.505+0000 7f5ed8d30640 1 -- 10.20.193.58:0/2297444796 shutdown_connections 2026-02-23T06:41:40.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.505+0000 7f5ed8d30640 1 -- 10.20.193.58:0/2297444796 wait complete. 2026-02-23T06:41:40.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.506+0000 7f5ed8d30640 1 Processor -- start 2026-02-23T06:41:40.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.507+0000 7f5ed8d30640 1 -- start start 2026-02-23T06:41:40.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.507+0000 7f5ed8d30640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ed40b6690 0x7f5ed411a8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:40.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.507+0000 7f5ed8d30640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5ed415d4a0 0x7f5ed413f180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:40.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.507+0000 7f5ed8d30640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ed415d870 0x7f5ed40b7a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:40.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.507+0000 7f5ed8d30640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed411a4d0 con 0x7f5ed40b6690 2026-02-23T06:41:40.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.507+0000 7f5ed8d30640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed4162bd0 con 0x7f5ed415d4a0 2026-02-23T06:41:40.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.507+0000 7f5ed8d30640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f5ed41295b0 con 0x7f5ed415d870 2026-02-23T06:41:40.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.507+0000 7f5ed37fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ed40b6690 0x7f5ed411a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:40.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.507+0000 7f5ed37fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ed40b6690 0x7f5ed411a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:34250/0 (socket says 10.20.193.58:34250) 2026-02-23T06:41:40.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.507+0000 7f5ed37fe640 1 -- 10.20.193.58:0/3759877008 learned_addr learned my addr 10.20.193.58:0/3759877008 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:41:40.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.507+0000 7f5ed2ffd640 1 --2- 10.20.193.58:0/3759877008 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5ed415d4a0 0x7f5ed413f180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:40.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.507+0000 7f5ed3fff640 1 --2- 10.20.193.58:0/3759877008 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ed415d870 0x7f5ed40b7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:40.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.507+0000 7f5ed37fe640 1 -- 10.20.193.58:0/3759877008 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ed415d870 msgr2=0x7f5ed40b7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:40.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.507+0000 7f5ed37fe640 1 --2- 10.20.193.58:0/3759877008 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ed415d870 0x7f5ed40b7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.507+0000 7f5ed37fe640 1 -- 10.20.193.58:0/3759877008 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5ed415d4a0 msgr2=0x7f5ed413f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:40.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.507+0000 7f5ed37fe640 1 --2- 10.20.193.58:0/3759877008 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5ed415d4a0 0x7f5ed413f180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.507+0000 7f5ed37fe640 1 -- 10.20.193.58:0/3759877008 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec800a650 con 0x7f5ed40b6690 2026-02-23T06:41:40.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.508+0000 7f5ed3fff640 1 --2- 10.20.193.58:0/3759877008 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ed415d870 0x7f5ed40b7a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:41:40.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.508+0000 7f5ed37fe640 1 --2- 10.20.193.58:0/3759877008 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ed40b6690 0x7f5ed411a8f0 secure :-1 s=READY pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ec000e9c0 tx=0x7f5ec000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:40.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.508+0000 7f5eaffff640 1 -- 10.20.193.58:0/3759877008 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ec000cd70 con 0x7f5ed40b6690 2026-02-23T06:41:40.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.508+0000 7f5eaffff640 1 -- 10.20.193.58:0/3759877008 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ec0004850 con 0x7f5ed40b6690 2026-02-23T06:41:40.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.508+0000 7f5eaffff640 1 -- 10.20.193.58:0/3759877008 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ec0004c80 con 0x7f5ed40b6690 2026-02-23T06:41:40.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.508+0000 7f5ed8d30640 1 -- 10.20.193.58:0/3759877008 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ed40578f0 con 0x7f5ed40b6690 2026-02-23T06:41:40.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.508+0000 7f5ed8d30640 1 -- 10.20.193.58:0/3759877008 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ed411a0f0 con 0x7f5ed40b6690 2026-02-23T06:41:40.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.508+0000 7f5eadffb640 1 --2- 10.20.193.58:0/3759877008 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ed413eb40 0x7f5ed411d2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:40.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.508+0000 7f5eadffb640 1 -- 10.20.193.58:0/3759877008 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f5ed40b6330 con 0x7f5ed413eb40 2026-02-23T06:41:40.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.509+0000 7f5ed2ffd640 1 --2- 10.20.193.58:0/3759877008 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ed413eb40 0x7f5ed411d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:40.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.509+0000 7f5ed2ffd640 1 -- 10.20.193.58:0/3759877008 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ed40b5e10 con 0x7f5ed413eb40 2026-02-23T06:41:40.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.509+0000 7f5ed2ffd640 1 --2- 10.20.193.58:0/3759877008 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ed413eb40 0x7f5ed411d2f0 secure :-1 s=READY pgs=35 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ed4145900 tx=0x7f5ec400eba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:40.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.509+0000 7f5eaffff640 1 -- 10.20.193.58:0/3759877008 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ec400c880 con 0x7f5ed413eb40 2026-02-23T06:41:40.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.509+0000 7f5eaffff640 1 -- 10.20.193.58:0/3759877008 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f5ec001f060 con 0x7f5ed40b6690 2026-02-23T06:41:40.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.510+0000 7f5eaffff640 1 --2- 10.20.193.58:0/3759877008 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5ea407a660 0x7f5ea409ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:40.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.511+0000 7f5eaffff640 1 -- 10.20.193.58:0/3759877008 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f5ec0014070 con 0x7f5ed40b6690 2026-02-23T06:41:40.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.511+0000 7f5eaffff640 1 -- 10.20.193.58:0/3759877008 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f5ec400c9e0 con 0x7f5ed413eb40 2026-02-23T06:41:40.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.511+0000 7f5eaffff640 1 -- 10.20.193.58:0/3759877008 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ed413eb40 msgr2=0x7f5ed411d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:40.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.511+0000 7f5eaffff640 1 --2- 10.20.193.58:0/3759877008 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ed413eb40 0x7f5ed411d2f0 secure :-1 s=READY pgs=35 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ed4145900 tx=0x7f5ec400eba0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.511+0000 7f5eaffff640 1 -- 10.20.193.58:0/3759877008 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ed413eb40 msgr2=0x7f5ed411d2f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:41:40.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.511+0000 7f5eaffff640 1 --2- 10.20.193.58:0/3759877008 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ed413eb40 0x7f5ed411d2f0 secure :-1 s=CLOSED pgs=35 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ed4145900 tx=0x7f5ec400eba0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.511+0000 7f5ed3fff640 1 --2- 10.20.193.58:0/3759877008 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5ea407a660 0x7f5ea409ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:40.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.511+0000 7f5ed3fff640 1 --2- 10.20.193.58:0/3759877008 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5ea407a660 0x7f5ea409ab10 secure :-1 s=READY pgs=448 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ec800a980 tx=0x7f5ec80058c0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:40.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.514+0000 7f5eadffb640 1 --2- 10.20.193.58:0/3759877008 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ed411d830 0x7f5ed411dc00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:40.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.514+0000 7f5eadffb640 1 -- 10.20.193.58:0/3759877008 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f5ed40b6d50 con 0x7f5ed411d830 2026-02-23T06:41:40.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.514+0000 7f5ed2ffd640 1 --2- 10.20.193.58:0/3759877008 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ed411d830 0x7f5ed411dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:40.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.515+0000 7f5ed2ffd640 1 -- 10.20.193.58:0/3759877008 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5ed411e140 con 0x7f5ed411d830 2026-02-23T06:41:40.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.515+0000 7f5ed2ffd640 1 --2- 10.20.193.58:0/3759877008 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ed411d830 0x7f5ed411dc00 secure :-1 s=READY pgs=36 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ed40513d0 tx=0x7f5ec40026a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:40.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.515+0000 7f5eaffff640 1 -- 10.20.193.58:0/3759877008 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ec4015430 con 0x7f5ed411d830 2026-02-23T06:41:40.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.515+0000 7f5eaffff640 1 -- 10.20.193.58:0/3759877008 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5388 (secure 0 0 0) 0x7f5ec4023070 con 0x7f5ed411d830 2026-02-23T06:41:40.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.515+0000 7f5eaffff640 1 -- 10.20.193.58:0/3759877008 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ed411d830 msgr2=0x7f5ed411dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:40.510 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:41:40.510 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:41:40.511 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:41:40.511 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:41:40.511 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 172, 2026-02-23T06:41:40.511 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 52376, 2026-02-23T06:41:40.511 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:41:40.511 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:41:40.511 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:41:40.511 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:41:40.511 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:40.511 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:41:40.511 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:41:40.511 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:41:40.511 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:41:40.511 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:40.511 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:40.511 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:40.511 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:40.511 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:40.511 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:40.511 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:40.511 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:40.511 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:40.511 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:40.511 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:40.511 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:40.511 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:40.511 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:40.511 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:41:40.512 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:40.513 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:41:40.514 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:40.514 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.514 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.514 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:40.514 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:41:40.514 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:40.514 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:40.514 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:40.514 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.514 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:41:40.514 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:41:40.514 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:40.514 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:40.514 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:41:40.514 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:40.514 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.514 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.514 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:41:40.514 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:41:40.514 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:40.514 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:40.514 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.514 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:40.514 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:41:40.514 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:40.514 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.515 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.515 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:40.515 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:41:40.515 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:40.515 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:40.515 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:40.515 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.515 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:41:40.515 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:41:40.515 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:40.515 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:40.515 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:41:40.515 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:40.515 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.515 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.515 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:41:40.515 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:41:40.515 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:40.515 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:40.515 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.515 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:40.515 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:41:40.515 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:40.515 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.515 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.515 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:40.515 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:41:40.515 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.516 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:40.517 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:40.517 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:41:40.517 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:40.517 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:40.517 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:41:40.517 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.517 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:41:40.517 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:41:40.517 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:41:40.517 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.517 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:40.517 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:40.517 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:40.517 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:41:40.517 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:40.517 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:40.517 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:40.517 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:41:40.517 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:41:40.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.515+0000 7f5eaffff640 1 --2- 10.20.193.58:0/3759877008 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ed411d830 0x7f5ed411dc00 secure :-1 s=READY pgs=36 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ed40513d0 tx=0x7f5ec40026a0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.515+0000 7f5eaffff640 1 -- 10.20.193.58:0/3759877008 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ed411d830 msgr2=0x7f5ed411dc00 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:41:40.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.515+0000 7f5eaffff640 1 --2- 10.20.193.58:0/3759877008 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ed411d830 0x7f5ed411dc00 secure :-1 s=CLOSED pgs=36 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ed40513d0 tx=0x7f5ec40026a0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.515+0000 7f5eadffb640 1 -- 10.20.193.58:0/3759877008 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5ea407a660 msgr2=0x7f5ea409ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:40.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.515+0000 7f5eadffb640 1 --2- 10.20.193.58:0/3759877008 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5ea407a660 0x7f5ea409ab10 secure :-1 s=READY pgs=448 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ec800a980 tx=0x7f5ec80058c0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.515+0000 7f5eadffb640 1 -- 10.20.193.58:0/3759877008 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ed40b6690 msgr2=0x7f5ed411a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:40.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.515+0000 7f5eadffb640 1 --2- 10.20.193.58:0/3759877008 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ed40b6690 0x7f5ed411a8f0 secure :-1 s=READY pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ec000e9c0 tx=0x7f5ec000ee90 comp rx=0 tx=0).stop 2026-02-23T06:41:40.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.515+0000 7f5ed3fff640 1 -- 10.20.193.58:0/3759877008 reap_dead start 2026-02-23T06:41:40.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.516+0000 7f5ed3fff640 1 -- 10.20.193.58:0/3759877008 reap_dead start 2026-02-23T06:41:40.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.516+0000 7f5eadffb640 1 -- 10.20.193.58:0/3759877008 shutdown_connections 2026-02-23T06:41:40.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.516+0000 7f5eadffb640 1 -- 10.20.193.58:0/3759877008 >> 10.20.193.58:0/3759877008 conn(0x7f5ed40b3c20 msgr2=0x7f5ed405cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:40.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.516+0000 7f5eadffb640 1 -- 10.20.193.58:0/3759877008 shutdown_connections 2026-02-23T06:41:40.519 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.516+0000 7f5eadffb640 1 -- 10.20.193.58:0/3759877008 wait complete. 2026-02-23T06:41:40.519 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:41:40.519 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:41:40.519 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:41:40.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.644+0000 7f9037fff640 1 -- 10.20.193.58:0/182111905 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f903815c040 msgr2=0x7f903805b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:40.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.644+0000 7f9037fff640 1 --2- 10.20.193.58:0/182111905 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f903815c040 0x7f903805b0e0 secure :-1 s=READY pgs=15 gs=3 cs=0 l=1 c_cookie=7499658144166606267 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f902c004740 tx=0x7f902c02f230 comp rx=0 tx=0).stop 2026-02-23T06:41:40.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.644+0000 7f9037fff640 1 -- 10.20.193.58:0/182111905 shutdown_connections 2026-02-23T06:41:40.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.644+0000 7f9037fff640 1 --2- 10.20.193.58:0/182111905 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f903815c040 0x7f903805b0e0 unknown :-1 s=CLOSED pgs=15 gs=3 cs=0 l=1 c_cookie=7499658144166606267 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.644+0000 7f9037fff640 1 -- 10.20.193.58:0/182111905 >> 10.20.193.58:0/182111905 conn(0x7f90380b3c20 msgr2=0x7f90380b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:40.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.644+0000 7f9037fff640 1 -- 10.20.193.58:0/182111905 shutdown_connections 2026-02-23T06:41:40.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.644+0000 7f9037fff640 1 -- 10.20.193.58:0/182111905 wait complete. 2026-02-23T06:41:40.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.645+0000 7f9037fff640 1 Processor -- start 2026-02-23T06:41:40.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.645+0000 7f9037fff640 1 -- start start 2026-02-23T06:41:40.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.645+0000 7f9037fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9038056550 0x7f9038160ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:40.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.645+0000 7f9037fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f90380b5680 0x7f90382015c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:40.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.645+0000 7f9037fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f903815c040 0x7f9038201b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:40.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.646+0000 7f9037fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f9038162450 con 0x7f903815c040 2026-02-23T06:41:40.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.646+0000 7f9037fff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f903815f410 con 0x7f90380b5680 2026-02-23T06:41:40.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.646+0000 7f9037fff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f903815e390 con 0x7f9038056550 2026-02-23T06:41:40.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.646+0000 7f90377fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f903815c040 0x7f9038201b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:40.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.646+0000 7f90367fc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f90380b5680 0x7f90382015c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:40.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.646+0000 7f90367fc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f90380b5680 0x7f90382015c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:54724/0 (socket says 10.20.193.58:54724) 2026-02-23T06:41:40.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.646+0000 7f90367fc640 1 -- 10.20.193.58:0/427445958 learned_addr learned my addr 10.20.193.58:0/427445958 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:41:40.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.646+0000 7f9036ffd640 1 --2- 10.20.193.58:0/427445958 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9038056550 0x7f9038160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:40.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.646+0000 7f90367fc640 1 -- 10.20.193.58:0/427445958 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9038056550 msgr2=0x7f9038160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:40.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.646+0000 7f90367fc640 1 --2- 10.20.193.58:0/427445958 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9038056550 0x7f9038160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.646+0000 7f90367fc640 1 -- 10.20.193.58:0/427445958 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f903815c040 msgr2=0x7f9038201b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:40.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.646+0000 7f90367fc640 1 --2- 10.20.193.58:0/427445958 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f903815c040 0x7f9038201b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.646+0000 7f90367fc640 1 -- 10.20.193.58:0/427445958 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f902c0094b0 con 0x7f90380b5680 2026-02-23T06:41:40.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.646+0000 7f90367fc640 1 --2- 10.20.193.58:0/427445958 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f90380b5680 0x7f90382015c0 secure :-1 s=READY pgs=84 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f902000c4f0 tx=0x7f902000c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:40.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.647+0000 7f90177fe640 1 -- 10.20.193.58:0/427445958 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9020006ab0 con 0x7f90380b5680 2026-02-23T06:41:40.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.647+0000 7f90177fe640 1 -- 10.20.193.58:0/427445958 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9020006d00 con 0x7f90380b5680 2026-02-23T06:41:40.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.647+0000 7f90177fe640 1 -- 10.20.193.58:0/427445958 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90200072b0 con 0x7f90380b5680 2026-02-23T06:41:40.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.647+0000 7f9037fff640 1 -- 10.20.193.58:0/427445958 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9038202180 con 0x7f90380b5680 2026-02-23T06:41:40.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.647+0000 7f9037fff640 1 -- 10.20.193.58:0/427445958 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f903815e930 con 0x7f90380b5680 2026-02-23T06:41:40.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.647+0000 7f9037fff640 1 -- 10.20.193.58:0/427445958 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f903805b0e0 con 0x7f90380b5680 2026-02-23T06:41:40.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.649+0000 7f90177fe640 1 -- 10.20.193.58:0/427445958 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f9020019070 con 0x7f90380b5680 2026-02-23T06:41:40.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.650+0000 7f90177fe640 1 --2- 10.20.193.58:0/427445958 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f900407a6c0 0x7f900409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:40.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.650+0000 7f90177fe640 1 -- 10.20.193.58:0/427445958 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f902009d200 con 0x7f90380b5680 2026-02-23T06:41:40.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.650+0000 7f9036ffd640 1 --2- 10.20.193.58:0/427445958 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f900407a6c0 0x7f900409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:40.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.650+0000 7f90177fe640 1 -- 10.20.193.58:0/427445958 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f9020060440 con 0x7f90380b5680 2026-02-23T06:41:40.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.651+0000 7f9036ffd640 1 --2- 10.20.193.58:0/427445958 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f900407a6c0 0x7f900409ab70 secure :-1 s=READY pgs=449 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f902c0097e0 tx=0x7f902c031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:40.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.806+0000 7f9037fff640 1 -- 10.20.193.58:0/427445958 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f90380592d0 con 0x7f90380b5680 2026-02-23T06:41:40.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.808+0000 7f90177fe640 1 -- 10.20.193.58:0/427445958 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f9020063560 con 0x7f90380b5680 2026-02-23T06:41:40.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.809+0000 7f9037fff640 1 -- 10.20.193.58:0/427445958 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f900407a6c0 msgr2=0x7f900409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:40.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.809+0000 7f9037fff640 1 --2- 10.20.193.58:0/427445958 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f900407a6c0 0x7f900409ab70 secure :-1 s=READY pgs=449 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f902c0097e0 tx=0x7f902c031040 comp rx=0 tx=0).stop 2026-02-23T06:41:40.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.809+0000 7f9037fff640 1 -- 10.20.193.58:0/427445958 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f90380b5680 msgr2=0x7f90382015c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:40.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.809+0000 7f9037fff640 1 --2- 10.20.193.58:0/427445958 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f90380b5680 0x7f90382015c0 secure :-1 s=READY pgs=84 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f902000c4f0 tx=0x7f902000c9c0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.809+0000 7f9037fff640 1 -- 10.20.193.58:0/427445958 shutdown_connections 2026-02-23T06:41:40.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.809+0000 7f9037fff640 1 --2- 10.20.193.58:0/427445958 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f900407a6c0 0x7f900409ab70 unknown :-1 s=CLOSED pgs=449 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.809+0000 7f9037fff640 1 --2- 10.20.193.58:0/427445958 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f903815c040 0x7f9038201b00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.809+0000 7f9037fff640 1 --2- 10.20.193.58:0/427445958 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f90380b5680 0x7f90382015c0 unknown :-1 s=CLOSED pgs=84 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.809+0000 7f9037fff640 1 --2- 10.20.193.58:0/427445958 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9038056550 0x7f9038160ac0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:40.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.809+0000 7f9037fff640 1 -- 10.20.193.58:0/427445958 >> 10.20.193.58:0/427445958 conn(0x7f90380b3c20 msgr2=0x7f90380b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:40.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.809+0000 7f9037fff640 1 -- 10.20.193.58:0/427445958 shutdown_connections 2026-02-23T06:41:40.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:40.809+0000 7f9037fff640 1 -- 10.20.193.58:0/427445958 wait complete. 2026-02-23T06:41:40.816 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:41:44.490 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:41:44.494 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:41:50.817 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:41:50.817 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:41:50.941 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.945+0000 7f65a5843640 1 -- 10.20.193.58:0/1089694795 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f65a0162ca0 msgr2=0x7f65a0056fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:50.941 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.945+0000 7f65a5843640 1 --2- 10.20.193.58:0/1089694795 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f65a0162ca0 0x7f65a0056fc0 secure :-1 s=READY pgs=17 gs=3 cs=0 l=1 c_cookie=10410900758763413803 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65a0059b80 tx=0x7f659c030270 comp rx=0 tx=0).stop 2026-02-23T06:41:50.941 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.945+0000 7f65a5843640 1 -- 10.20.193.58:0/1089694795 shutdown_connections 2026-02-23T06:41:50.941 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.945+0000 7f65a5843640 1 --2- 10.20.193.58:0/1089694795 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f65a0162ca0 0x7f65a0056fc0 unknown :-1 s=CLOSED pgs=17 gs=3 cs=0 l=1 c_cookie=10410900758763413803 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:50.941 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.945+0000 7f65a5843640 1 --2- 10.20.193.58:0/1089694795 >> v2:10.20.193.93:3300/0 conn(0x7f65a015c4b0 0x7f65a0058200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:50.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.945+0000 7f65a5843640 1 -- 10.20.193.58:0/1089694795 >> 10.20.193.58:0/1089694795 conn(0x7f65a00b3c20 msgr2=0x7f65a00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:50.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.945+0000 7f65a5843640 1 -- 10.20.193.58:0/1089694795 shutdown_connections 2026-02-23T06:41:50.942 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.945+0000 7f65a5843640 1 -- 10.20.193.58:0/1089694795 wait complete. 2026-02-23T06:41:50.944 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.946+0000 7f65a5843640 1 Processor -- start 2026-02-23T06:41:50.944 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.947+0000 7f65a5843640 1 -- start start 2026-02-23T06:41:50.944 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.947+0000 7f65a5843640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f65a0056960 0x7f65a015f300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:50.945 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.947+0000 7f65a5843640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f65a015c4b0 0x7f65a0200d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:50.945 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.947+0000 7f65a5843640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f65a0162ca0 0x7f65a013d8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:50.945 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.947+0000 7f65a5843640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f65a00b0250 con 0x7f65a0162ca0 2026-02-23T06:41:50.945 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.947+0000 7f65a5843640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f65a015cbb0 con 0x7f65a0056960 2026-02-23T06:41:50.945 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.947+0000 7f65a5843640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f65a00b0800 con 0x7f65a015c4b0 2026-02-23T06:41:50.945 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.947+0000 7f65a5042640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f65a0162ca0 0x7f65a013d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:50.945 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.947+0000 7f65a4841640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f65a0056960 0x7f65a015f300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:50.945 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.947+0000 7f65a5042640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f65a0162ca0 0x7f65a013d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:51926/0 (socket says 10.20.193.58:51926) 2026-02-23T06:41:50.945 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.947+0000 7f65a5042640 1 -- 10.20.193.58:0/293332857 learned_addr learned my addr 10.20.193.58:0/293332857 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:41:50.945 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.947+0000 7f6597fff640 1 --2- 10.20.193.58:0/293332857 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f65a015c4b0 0x7f65a0200d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:50.945 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.948+0000 7f65a5042640 1 -- 10.20.193.58:0/293332857 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f65a015c4b0 msgr2=0x7f65a0200d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:50.945 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.948+0000 7f65a5042640 1 --2- 10.20.193.58:0/293332857 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f65a015c4b0 0x7f65a0200d70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:50.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.948+0000 7f65a5042640 1 -- 10.20.193.58:0/293332857 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f65a0056960 msgr2=0x7f65a015f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:50.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.948+0000 7f65a5042640 1 --2- 10.20.193.58:0/293332857 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f65a0056960 0x7f65a015f300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:50.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.948+0000 7f65a5042640 1 -- 10.20.193.58:0/293332857 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f659c00a590 con 0x7f65a0162ca0 2026-02-23T06:41:50.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.948+0000 7f65a5042640 1 --2- 10.20.193.58:0/293332857 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f65a0162ca0 0x7f65a013d8e0 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f659c003d20 tx=0x7f659c003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:50.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.948+0000 7f65957fa640 1 -- 10.20.193.58:0/293332857 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f659c03e070 con 0x7f65a0162ca0 2026-02-23T06:41:50.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.948+0000 7f65957fa640 1 -- 10.20.193.58:0/293332857 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f659c0398a0 con 0x7f65a0162ca0 2026-02-23T06:41:50.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.948+0000 7f65957fa640 1 -- 10.20.193.58:0/293332857 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f659c039c50 con 0x7f65a0162ca0 2026-02-23T06:41:50.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.948+0000 7f65a5843640 1 -- 10.20.193.58:0/293332857 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65a015d0e0 con 0x7f65a0162ca0 2026-02-23T06:41:50.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.948+0000 7f65a5843640 1 -- 10.20.193.58:0/293332857 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65a00b0c60 con 0x7f65a0162ca0 2026-02-23T06:41:50.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.949+0000 7f65a5843640 1 -- 10.20.193.58:0/293332857 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65a00b0980 con 0x7f65a0162ca0 2026-02-23T06:41:50.947 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.950+0000 7f65957fa640 1 -- 10.20.193.58:0/293332857 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f659c04c440 con 0x7f65a0162ca0 2026-02-23T06:41:50.947 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.951+0000 7f65957fa640 1 --2- 10.20.193.58:0/293332857 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f657007a6c0 0x7f657009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:50.947 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.951+0000 7f65957fa640 1 -- 10.20.193.58:0/293332857 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f659c0c3800 con 0x7f65a0162ca0 2026-02-23T06:41:50.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.951+0000 7f65a4841640 1 --2- 10.20.193.58:0/293332857 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f657007a6c0 0x7f657009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:50.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.952+0000 7f65a4841640 1 --2- 10.20.193.58:0/293332857 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f657007a6c0 0x7f657009ab70 secure :-1 s=READY pgs=450 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6590005b30 tx=0x7f6590009310 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:50.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:50.954+0000 7f65957fa640 1 -- 10.20.193.58:0/293332857 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f65a00b0980 con 0x7f65a0162ca0 2026-02-23T06:41:51.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.114+0000 7f65a5843640 1 -- 10.20.193.58:0/293332857 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f65a015ce80 con 0x7f65a0162ca0 2026-02-23T06:41:51.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.114+0000 7f65957fa640 1 -- 10.20.193.58:0/293332857 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f659c086ad0 con 0x7f65a0162ca0 2026-02-23T06:41:51.110 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":172,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:41:51.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.115+0000 7f65a5843640 1 -- 10.20.193.58:0/293332857 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f657007a6c0 msgr2=0x7f657009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:51.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.115+0000 7f65a5843640 1 --2- 10.20.193.58:0/293332857 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f657007a6c0 0x7f657009ab70 secure :-1 s=READY pgs=450 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6590005b30 tx=0x7f6590009310 comp rx=0 tx=0).stop 2026-02-23T06:41:51.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.115+0000 7f65a5843640 1 -- 10.20.193.58:0/293332857 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f65a0162ca0 msgr2=0x7f65a013d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:51.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.115+0000 7f65a5843640 1 --2- 10.20.193.58:0/293332857 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f65a0162ca0 0x7f65a013d8e0 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f659c003d20 tx=0x7f659c003d50 comp rx=0 tx=0).stop 2026-02-23T06:41:51.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.115+0000 7f65a5843640 1 -- 10.20.193.58:0/293332857 shutdown_connections 2026-02-23T06:41:51.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.115+0000 7f65a5843640 1 --2- 10.20.193.58:0/293332857 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f657007a6c0 0x7f657009ab70 unknown :-1 s=CLOSED pgs=450 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.115+0000 7f65a5843640 1 --2- 10.20.193.58:0/293332857 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f65a0162ca0 0x7f65a013d8e0 unknown :-1 s=CLOSED pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.115+0000 7f65a5843640 1 --2- 10.20.193.58:0/293332857 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f65a015c4b0 0x7f65a0200d70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.115+0000 7f65a5843640 1 --2- 10.20.193.58:0/293332857 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f65a0056960 0x7f65a015f300 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.115+0000 7f65a5843640 1 -- 10.20.193.58:0/293332857 >> 10.20.193.58:0/293332857 conn(0x7f65a00b3c20 msgr2=0x7f65a013bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:51.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.115+0000 7f65a5843640 1 -- 10.20.193.58:0/293332857 shutdown_connections 2026-02-23T06:41:51.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.115+0000 7f65a5843640 1 -- 10.20.193.58:0/293332857 wait complete. 2026-02-23T06:41:51.123 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:41:51.123 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:41:51.123 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:41:51.123 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:41:51.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.251+0000 7f738dd0b640 1 -- 10.20.193.58:0/2056786707 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f73880b6690 msgr2=0x7f7388058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:51.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.251+0000 7f738dd0b640 1 --2- 10.20.193.58:0/2056786707 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f73880b6690 0x7f7388058cf0 secure :-1 s=READY pgs=85 gs=3 cs=0 l=1 c_cookie=6664642598752337740 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7384005820 tx=0x7f73840302b0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.251+0000 7f738dd0b640 1 -- 10.20.193.58:0/2056786707 shutdown_connections 2026-02-23T06:41:51.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.251+0000 7f738dd0b640 1 --2- 10.20.193.58:0/2056786707 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f73880b6690 0x7f7388058cf0 unknown :-1 s=CLOSED pgs=85 gs=3 cs=0 l=1 c_cookie=6664642598752337740 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.251+0000 7f738dd0b640 1 --2- 10.20.193.58:0/2056786707 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f738815d870 0x7f73880587b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.251+0000 7f738dd0b640 1 -- 10.20.193.58:0/2056786707 >> 10.20.193.58:0/2056786707 conn(0x7f73880b3c20 msgr2=0x7f73880b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:51.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.251+0000 7f738dd0b640 1 -- 10.20.193.58:0/2056786707 shutdown_connections 2026-02-23T06:41:51.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.251+0000 7f738dd0b640 1 -- 10.20.193.58:0/2056786707 wait complete. 2026-02-23T06:41:51.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.252+0000 7f738dd0b640 1 Processor -- start 2026-02-23T06:41:51.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.252+0000 7f738dd0b640 1 -- start start 2026-02-23T06:41:51.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.253+0000 7f738dd0b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f73880b6690 0x7f738813cf80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:51.251 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.253+0000 7f738dd0b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f738815d4a0 0x7f738815afc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:51.252 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.253+0000 7f738dd0b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f738815d870 0x7f7388160050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:51.252 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.253+0000 7f738dd0b640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f738815fbc0 con 0x7f738815d4a0 2026-02-23T06:41:51.252 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.253+0000 7f738dd0b640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f738813d4c0 con 0x7f738815d870 2026-02-23T06:41:51.252 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.253+0000 7f738dd0b640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f738813db30 con 0x7f73880b6690 2026-02-23T06:41:51.252 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.253+0000 7f737ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f738815d4a0 0x7f738815afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:51.252 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.253+0000 7f737ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f738815d4a0 0x7f738815afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:51936/0 (socket says 10.20.193.58:51936) 2026-02-23T06:41:51.252 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.253+0000 7f737ffff640 1 -- 10.20.193.58:0/225683518 learned_addr learned my addr 10.20.193.58:0/225683518 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:41:51.252 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.253+0000 7f738d50a640 1 --2- 10.20.193.58:0/225683518 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f738815d870 0x7f7388160050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:51.252 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.253+0000 7f738cd09640 1 --2- 10.20.193.58:0/225683518 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f73880b6690 0x7f738813cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:51.252 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.253+0000 7f737ffff640 1 -- 10.20.193.58:0/225683518 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f73880b6690 msgr2=0x7f738813cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:51.252 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.253+0000 7f737ffff640 1 --2- 10.20.193.58:0/225683518 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f73880b6690 0x7f738813cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.253+0000 7f737ffff640 1 -- 10.20.193.58:0/225683518 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f738815d870 msgr2=0x7f7388160050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:51.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.253+0000 7f737ffff640 1 --2- 10.20.193.58:0/225683518 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f738815d870 0x7f7388160050 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.253+0000 7f737ffff640 1 -- 10.20.193.58:0/225683518 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f738400a590 con 0x7f738815d4a0 2026-02-23T06:41:51.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.254+0000 7f737ffff640 1 --2- 10.20.193.58:0/225683518 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f738815d4a0 0x7f738815afc0 secure :-1 s=READY pgs=20 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f737000e9c0 tx=0x7f737000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:51.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.254+0000 7f737d7fa640 1 -- 10.20.193.58:0/225683518 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f737000cd70 con 0x7f738815d4a0 2026-02-23T06:41:51.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.254+0000 7f737d7fa640 1 -- 10.20.193.58:0/225683518 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7370004850 con 0x7f738815d4a0 2026-02-23T06:41:51.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.254+0000 7f737d7fa640 1 -- 10.20.193.58:0/225683518 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7370004c80 con 0x7f738815d4a0 2026-02-23T06:41:51.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.254+0000 7f738dd0b640 1 -- 10.20.193.58:0/225683518 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73881fe550 con 0x7f738815d4a0 2026-02-23T06:41:51.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.254+0000 7f738dd0b640 1 -- 10.20.193.58:0/225683518 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f738815f570 con 0x7f738815d4a0 2026-02-23T06:41:51.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.254+0000 7f7356ffd640 1 --2- 10.20.193.58:0/225683518 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7388142150 0x7f7388200f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:51.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.254+0000 7f7356ffd640 1 -- 10.20.193.58:0/225683518 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f73880b6330 con 0x7f7388142150 2026-02-23T06:41:51.253 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.255+0000 7f738cd09640 1 --2- 10.20.193.58:0/225683518 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7388142150 0x7f7388200f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:51.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.255+0000 7f738cd09640 1 -- 10.20.193.58:0/225683518 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f73880b5e10 con 0x7f7388142150 2026-02-23T06:41:51.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.255+0000 7f738cd09640 1 --2- 10.20.193.58:0/225683518 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7388142150 0x7f7388200f30 secure :-1 s=READY pgs=21 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f737800e4d0 tx=0x7f737800e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:51.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.255+0000 7f737d7fa640 1 -- 10.20.193.58:0/225683518 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7378006b70 con 0x7f7388142150 2026-02-23T06:41:51.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.255+0000 7f737d7fa640 1 -- 10.20.193.58:0/225683518 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f7378006cd0 con 0x7f7388142150 2026-02-23T06:41:51.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.255+0000 7f737d7fa640 1 -- 10.20.193.58:0/225683518 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7388142150 msgr2=0x7f7388200f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:51.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.255+0000 7f737d7fa640 1 --2- 10.20.193.58:0/225683518 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7388142150 0x7f7388200f30 secure :-1 s=READY pgs=21 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f737800e4d0 tx=0x7f737800e9a0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.255+0000 7f737d7fa640 1 -- 10.20.193.58:0/225683518 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7388142150 msgr2=0x7f7388200f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:41:51.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.255+0000 7f737d7fa640 1 --2- 10.20.193.58:0/225683518 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7388142150 0x7f7388200f30 secure :-1 s=CLOSED pgs=21 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f737800e4d0 tx=0x7f737800e9a0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.254 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.256+0000 7f737d7fa640 1 -- 10.20.193.58:0/225683518 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f737001f060 con 0x7f738815d4a0 2026-02-23T06:41:51.256 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.257+0000 7f737d7fa640 1 --2- 10.20.193.58:0/225683518 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f735807a430 0x7f735809a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:51.256 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.257+0000 7f737d7fa640 1 -- 10.20.193.58:0/225683518 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f7370014070 con 0x7f738815d4a0 2026-02-23T06:41:51.256 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.257+0000 7f738cd09640 1 --2- 10.20.193.58:0/225683518 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f735807a430 0x7f735809a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:51.256 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.258+0000 7f738cd09640 1 --2- 10.20.193.58:0/225683518 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f735807a430 0x7f735809a8e0 secure :-1 s=READY pgs=451 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73780026a0 tx=0x7f7378013000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:51.257 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.259+0000 7f7356ffd640 1 --2- 10.20.193.58:0/225683518 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f738815f790 0x7f738815a0c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:51.257 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.259+0000 7f7356ffd640 1 -- 10.20.193.58:0/225683518 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f73880b6d50 con 0x7f738815f790 2026-02-23T06:41:51.257 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.259+0000 7f738d50a640 1 --2- 10.20.193.58:0/225683518 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f738815f790 0x7f738815a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:51.257 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.259+0000 7f738d50a640 1 -- 10.20.193.58:0/225683518 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f738805b0e0 con 0x7f738815f790 2026-02-23T06:41:51.257 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.260+0000 7f738d50a640 1 --2- 10.20.193.58:0/225683518 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f738815f790 0x7f738815a0c0 secure :-1 s=READY pgs=22 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7384005820 tx=0x7f7384006cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:51.257 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.260+0000 7f737d7fa640 1 -- 10.20.193.58:0/225683518 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7384047070 con 0x7f738815f790 2026-02-23T06:41:51.257 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.260+0000 7f737d7fa640 1 -- 10.20.193.58:0/225683518 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4914 (secure 0 0 0) 0x7f738403f040 con 0x7f738815f790 2026-02-23T06:41:51.257 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.260+0000 7f737d7fa640 1 -- 10.20.193.58:0/225683518 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f738815f790 msgr2=0x7f738815a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:51.257 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.260+0000 7f737d7fa640 1 --2- 10.20.193.58:0/225683518 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f738815f790 0x7f738815a0c0 secure :-1 s=READY pgs=22 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7384005820 tx=0x7f7384006cd0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.257 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.260+0000 7f737d7fa640 1 -- 10.20.193.58:0/225683518 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f738815f790 msgr2=0x7f738815a0c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:41:51.257 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.260+0000 7f737d7fa640 1 --2- 10.20.193.58:0/225683518 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f738815f790 0x7f738815a0c0 secure :-1 s=CLOSED pgs=22 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7384005820 tx=0x7f7384006cd0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.258 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:41:51.258 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:41:51.258 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:41:51.258 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:41:51.258 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 172, 2026-02-23T06:41:51.258 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 11380, 2026-02-23T06:41:51.259 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:41:51.259 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:41:51.259 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:41:51.259 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:41:51.259 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:51.259 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:41:51.259 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:41:51.259 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:41:51.259 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:41:51.259 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:51.259 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:51.259 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:51.260 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:51.260 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:51.260 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:51.260 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:51.260 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:51.260 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:51.260 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:51.260 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:51.260 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:51.260 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:51.260 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:51.260 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:41:51.261 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:41:51.261 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:51.261 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:51.261 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:51.261 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:51.261 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:51.261 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:51.261 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:51.261 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:51.261 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:51.261 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:51.261 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:51.262 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:51.262 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:51.262 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:51.262 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.262 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:41:51.262 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:41:51.262 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:41:51.262 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:41:51.262 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:41:51.262 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:41:51.262 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:41:51.262 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:41:51.263 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:41:51.263 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:41:51.263 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:41:51.263 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:41:51.263 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:41:51.263 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:41:51.263 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:41:51.263 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:41:51.263 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:41:51.263 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:51.263 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:51.263 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:51.264 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:51.264 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:51.264 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:51.264 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:51.264 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:51.264 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:51.264 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:51.264 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:51.264 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:51.264 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:51.265 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:51.265 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:41:51.265 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.265 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:41:51.265 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.265 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:41:51.265 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:41:51.265 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:51.265 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:51.265 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.266 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:51.266 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:41:51.266 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:51.266 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.266 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.266 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:51.266 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:41:51.266 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:51.266 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:51.266 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:51.266 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.266 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:41:51.267 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:41:51.267 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:51.267 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:51.267 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:41:51.267 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:51.267 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.267 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.267 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:41:51.267 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:41:51.267 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:51.267 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:51.267 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.267 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:51.268 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:41:51.268 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:51.268 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.268 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.268 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:51.268 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:41:51.268 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:51.268 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:51.268 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:51.268 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.268 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:41:51.268 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:41:51.268 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:51.269 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:51.269 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:41:51.269 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:51.269 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.269 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.269 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:41:51.269 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:41:51.269 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:51.269 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:51.269 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.269 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:51.269 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:41:51.270 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:51.270 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.270 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.270 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:51.270 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:41:51.270 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:51.270 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:51.270 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:51.270 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.270 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:41:51.270 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:41:51.270 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:51.271 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:51.271 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:41:51.271 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:51.271 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:51.271 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:51.271 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.271 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:41:51.271 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:41:51.271 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.271 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:51.271 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:51.271 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:41:51.271 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:51.272 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:51.272 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:41:51.272 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.272 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:51.272 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:51.272 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:41:51.272 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:51.272 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:51.272 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.272 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:41:51.272 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:41:51.274 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.260+0000 7f7356ffd640 1 -- 10.20.193.58:0/225683518 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f735807a430 msgr2=0x7f735809a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:51.274 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.260+0000 7f7356ffd640 1 --2- 10.20.193.58:0/225683518 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f735807a430 0x7f735809a8e0 secure :-1 s=READY pgs=451 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73780026a0 tx=0x7f7378013000 comp rx=0 tx=0).stop 2026-02-23T06:41:51.274 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.260+0000 7f7356ffd640 1 -- 10.20.193.58:0/225683518 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f738815d4a0 msgr2=0x7f738815afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:51.274 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.260+0000 7f7356ffd640 1 --2- 10.20.193.58:0/225683518 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f738815d4a0 0x7f738815afc0 secure :-1 s=READY pgs=20 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f737000e9c0 tx=0x7f737000ee90 comp rx=0 tx=0).stop 2026-02-23T06:41:51.274 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.260+0000 7f738d50a640 1 -- 10.20.193.58:0/225683518 reap_dead start 2026-02-23T06:41:51.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.260+0000 7f7356ffd640 1 -- 10.20.193.58:0/225683518 shutdown_connections 2026-02-23T06:41:51.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.260+0000 7f7356ffd640 1 -- 10.20.193.58:0/225683518 >> 10.20.193.58:0/225683518 conn(0x7f73880b3c20 msgr2=0x7f73880aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:51.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.260+0000 7f7356ffd640 1 -- 10.20.193.58:0/225683518 shutdown_connections 2026-02-23T06:41:51.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.260+0000 7f7356ffd640 1 -- 10.20.193.58:0/225683518 wait complete. 2026-02-23T06:41:51.275 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:41:51.276 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:41:51.276 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:41:51.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.403+0000 7f1081e83640 1 -- 10.20.193.58:0/3034883748 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f107c0b6690 msgr2=0x7f107c058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:51.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.403+0000 7f1081e83640 1 --2- 10.20.193.58:0/3034883748 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f107c0b6690 0x7f107c058cf0 secure :-1 s=READY pgs=86 gs=3 cs=0 l=1 c_cookie=6632362001158508167 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1078005820 tx=0x7f10780302b0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.403+0000 7f1081e83640 1 -- 10.20.193.58:0/3034883748 shutdown_connections 2026-02-23T06:41:51.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.403+0000 7f1081e83640 1 --2- 10.20.193.58:0/3034883748 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f107c0b6690 0x7f107c058cf0 unknown :-1 s=CLOSED pgs=86 gs=3 cs=0 l=1 c_cookie=6632362001158508167 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.403+0000 7f1081e83640 1 --2- 10.20.193.58:0/3034883748 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f107c15d870 0x7f107c0587b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.403+0000 7f1081e83640 1 -- 10.20.193.58:0/3034883748 >> 10.20.193.58:0/3034883748 conn(0x7f107c0b3c20 msgr2=0x7f107c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:51.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.403+0000 7f1081e83640 1 -- 10.20.193.58:0/3034883748 shutdown_connections 2026-02-23T06:41:51.398 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.403+0000 7f1081e83640 1 -- 10.20.193.58:0/3034883748 wait complete. 2026-02-23T06:41:51.399 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.404+0000 7f1081e83640 1 Processor -- start 2026-02-23T06:41:51.399 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.404+0000 7f1081e83640 1 -- start start 2026-02-23T06:41:51.399 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.405+0000 7f1081e83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f107c0b6690 0x7f107c0b76f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:51.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.405+0000 7f1081e83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f107c15d4a0 0x7f107c0b7c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:51.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.405+0000 7f1081e83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f107c15d870 0x7f107c164f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:51.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.405+0000 7f1081e83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f107c166e40 con 0x7f107c15d4a0 2026-02-23T06:41:51.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.405+0000 7f1081e83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f107c14a2b0 con 0x7f107c15d870 2026-02-23T06:41:51.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.405+0000 7f1081e83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f107c167830 con 0x7f107c0b6690 2026-02-23T06:41:51.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.405+0000 7f1073fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f107c15d4a0 0x7f107c0b7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:51.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.405+0000 7f1073fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f107c15d4a0 0x7f107c0b7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:51958/0 (socket says 10.20.193.58:51958) 2026-02-23T06:41:51.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.405+0000 7f1073fff640 1 -- 10.20.193.58:0/450088403 learned_addr learned my addr 10.20.193.58:0/450088403 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:41:51.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.405+0000 7f1080e81640 1 --2- 10.20.193.58:0/450088403 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f107c0b6690 0x7f107c0b76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:51.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.405+0000 7f1081682640 1 --2- 10.20.193.58:0/450088403 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f107c15d870 0x7f107c164f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:51.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.405+0000 7f1073fff640 1 -- 10.20.193.58:0/450088403 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f107c0b6690 msgr2=0x7f107c0b76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:51.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.405+0000 7f1073fff640 1 --2- 10.20.193.58:0/450088403 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f107c0b6690 0x7f107c0b76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.405+0000 7f1073fff640 1 -- 10.20.193.58:0/450088403 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f107c15d870 msgr2=0x7f107c164f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:51.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.405+0000 7f1073fff640 1 --2- 10.20.193.58:0/450088403 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f107c15d870 0x7f107c164f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.405+0000 7f1073fff640 1 -- 10.20.193.58:0/450088403 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f107800a590 con 0x7f107c15d4a0 2026-02-23T06:41:51.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.406+0000 7f1073fff640 1 --2- 10.20.193.58:0/450088403 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f107c15d4a0 0x7f107c0b7c30 secure :-1 s=READY pgs=24 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f106400e9f0 tx=0x7f106400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:51.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.406+0000 7f10717fa640 1 -- 10.20.193.58:0/450088403 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f106400cda0 con 0x7f107c15d4a0 2026-02-23T06:41:51.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.406+0000 7f10717fa640 1 -- 10.20.193.58:0/450088403 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1064004850 con 0x7f107c15d4a0 2026-02-23T06:41:51.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.406+0000 7f10717fa640 1 -- 10.20.193.58:0/450088403 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1064004c80 con 0x7f107c15d4a0 2026-02-23T06:41:51.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.406+0000 7f1081e83640 1 -- 10.20.193.58:0/450088403 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f107c15c2e0 con 0x7f107c15d4a0 2026-02-23T06:41:51.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.406+0000 7f1081e83640 1 -- 10.20.193.58:0/450088403 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f107c14d620 con 0x7f107c15d4a0 2026-02-23T06:41:51.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.406+0000 7f104affd640 1 --2- 10.20.193.58:0/450088403 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f103c0041f0 0x7f103c0246a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:51.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.407+0000 7f104affd640 1 -- 10.20.193.58:0/450088403 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f103c025f20 con 0x7f103c0041f0 2026-02-23T06:41:51.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.408+0000 7f10717fa640 1 -- 10.20.193.58:0/450088403 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f106401f060 con 0x7f107c15d4a0 2026-02-23T06:41:51.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.408+0000 7f1080e81640 1 --2- 10.20.193.58:0/450088403 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f103c0041f0 0x7f103c0246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:51.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.408+0000 7f1080e81640 1 -- 10.20.193.58:0/450088403 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f103c0260e0 con 0x7f103c0041f0 2026-02-23T06:41:51.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.409+0000 7f1080e81640 1 --2- 10.20.193.58:0/450088403 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f103c0041f0 0x7f103c0246a0 secure :-1 s=READY pgs=87 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f107c15ad40 tx=0x7f106c00ef80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:51.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.409+0000 7f10717fa640 1 --2- 10.20.193.58:0/450088403 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f104c07a6c0 0x7f104c09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:51.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.409+0000 7f10717fa640 1 -- 10.20.193.58:0/450088403 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f1064014070 con 0x7f107c15d4a0 2026-02-23T06:41:51.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.409+0000 7f10717fa640 1 -- 10.20.193.58:0/450088403 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f106c00cc50 con 0x7f103c0041f0 2026-02-23T06:41:51.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.409+0000 7f1081682640 1 --2- 10.20.193.58:0/450088403 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f104c07a6c0 0x7f104c09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:51.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.409+0000 7f10717fa640 1 -- 10.20.193.58:0/450088403 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f106c00cdb0 con 0x7f103c0041f0 2026-02-23T06:41:51.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.409+0000 7f10717fa640 1 -- 10.20.193.58:0/450088403 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f103c0041f0 msgr2=0x7f103c0246a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:51.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.409+0000 7f10717fa640 1 --2- 10.20.193.58:0/450088403 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f103c0041f0 0x7f103c0246a0 secure :-1 s=READY pgs=87 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f107c15ad40 tx=0x7f106c00ef80 comp rx=0 tx=0).stop 2026-02-23T06:41:51.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.409+0000 7f10717fa640 1 -- 10.20.193.58:0/450088403 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f103c0041f0 msgr2=0x7f103c0246a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:41:51.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.409+0000 7f10717fa640 1 --2- 10.20.193.58:0/450088403 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f103c0041f0 0x7f103c0246a0 unknown :-1 s=CLOSED pgs=87 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.410+0000 7f1081682640 1 --2- 10.20.193.58:0/450088403 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f104c07a6c0 0x7f104c09ab70 secure :-1 s=READY pgs=452 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f107800a8c0 tx=0x7f107803b040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:51.408 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.413+0000 7f104affd640 1 --2- 10.20.193.58:0/450088403 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f103c025080 0x7f103c025500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:51.408 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.413+0000 7f104affd640 1 -- 10.20.193.58:0/450088403 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f103c025ae0 con 0x7f103c025080 2026-02-23T06:41:51.408 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.413+0000 7f1080e81640 1 --2- 10.20.193.58:0/450088403 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f103c025080 0x7f103c025500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:51.408 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.414+0000 7f1080e81640 1 -- 10.20.193.58:0/450088403 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f103c025ca0 con 0x7f103c025080 2026-02-23T06:41:51.409 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.414+0000 7f1080e81640 1 --2- 10.20.193.58:0/450088403 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f103c025080 0x7f103c025500 secure :-1 s=READY pgs=88 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f106c002780 tx=0x7f106c0154e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:51.409 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.414+0000 7f10717fa640 1 -- 10.20.193.58:0/450088403 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f106c015b10 con 0x7f103c025080 2026-02-23T06:41:51.409 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.414+0000 7f10717fa640 1 -- 10.20.193.58:0/450088403 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5414 (secure 0 0 0) 0x7f106c023070 con 0x7f103c025080 2026-02-23T06:41:51.409 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:41:51.409 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:41:51.409 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:41:51.409 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:41:51.409 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 172, 2026-02-23T06:41:51.409 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 115504, 2026-02-23T06:41:51.409 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:41:51.409 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:41:51.409 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:41:51.410 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:51.411 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.412 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:51.413 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:41:51.414 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.414 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:51.414 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:51.414 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:41:51.414 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:51.414 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:51.414 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:41:51.414 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.414 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:51.414 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:51.414 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:41:51.414 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:51.414 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:51.414 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:41:51.414 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.414 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:51.414 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:51.414 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:41:51.414 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:51.414 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:51.414 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.414 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:41:51.414 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:41:51.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.414+0000 7f10717fa640 1 -- 10.20.193.58:0/450088403 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f103c025080 msgr2=0x7f103c025500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:51.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.414+0000 7f10717fa640 1 --2- 10.20.193.58:0/450088403 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f103c025080 0x7f103c025500 secure :-1 s=READY pgs=88 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f106c002780 tx=0x7f106c0154e0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.414+0000 7f10717fa640 1 -- 10.20.193.58:0/450088403 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f103c025080 msgr2=0x7f103c025500 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:41:51.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.414+0000 7f10717fa640 1 --2- 10.20.193.58:0/450088403 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f103c025080 0x7f103c025500 secure :-1 s=CLOSED pgs=88 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f106c002780 tx=0x7f106c0154e0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.415+0000 7f104affd640 1 -- 10.20.193.58:0/450088403 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f104c07a6c0 msgr2=0x7f104c09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:51.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.415+0000 7f104affd640 1 --2- 10.20.193.58:0/450088403 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f104c07a6c0 0x7f104c09ab70 secure :-1 s=READY pgs=452 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f107800a8c0 tx=0x7f107803b040 comp rx=0 tx=0).stop 2026-02-23T06:41:51.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.415+0000 7f104affd640 1 -- 10.20.193.58:0/450088403 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f107c15d4a0 msgr2=0x7f107c0b7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:51.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.415+0000 7f104affd640 1 --2- 10.20.193.58:0/450088403 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f107c15d4a0 0x7f107c0b7c30 secure :-1 s=READY pgs=24 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f106400e9f0 tx=0x7f106400eec0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.415+0000 7f1081682640 1 -- 10.20.193.58:0/450088403 reap_dead start 2026-02-23T06:41:51.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.415+0000 7f1081682640 1 -- 10.20.193.58:0/450088403 reap_dead start 2026-02-23T06:41:51.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.415+0000 7f104affd640 1 -- 10.20.193.58:0/450088403 shutdown_connections 2026-02-23T06:41:51.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.415+0000 7f104affd640 1 -- 10.20.193.58:0/450088403 >> 10.20.193.58:0/450088403 conn(0x7f107c0b3c20 msgr2=0x7f107c05ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:51.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.415+0000 7f104affd640 1 -- 10.20.193.58:0/450088403 shutdown_connections 2026-02-23T06:41:51.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.415+0000 7f104affd640 1 -- 10.20.193.58:0/450088403 wait complete. 2026-02-23T06:41:51.416 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:41:51.416 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:41:51.416 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:41:51.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.543+0000 7feb4643a640 1 -- 10.20.193.58:0/947179347 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feb40056550 msgr2=0x7feb4005ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:51.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.543+0000 7feb4643a640 1 --2- 10.20.193.58:0/947179347 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feb40056550 0x7feb4005ce30 secure :-1 s=READY pgs=89 gs=1 cs=0 l=1 c_cookie=11539633164550654703 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb400b6900 tx=0x7feb3402f250 comp rx=0 tx=0).stop 2026-02-23T06:41:51.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.543+0000 7feb4643a640 1 -- 10.20.193.58:0/947179347 shutdown_connections 2026-02-23T06:41:51.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.543+0000 7feb4643a640 1 --2- 10.20.193.58:0/947179347 >> v2:10.20.193.58:3300/0 conn(0x7feb4005d370 0x7feb400b5680 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.543+0000 7feb4643a640 1 --2- 10.20.193.58:0/947179347 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feb40056550 0x7feb4005ce30 unknown :-1 s=CLOSED pgs=89 gs=1 cs=0 l=1 c_cookie=11539633164550654703 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.543+0000 7feb4643a640 1 --2- 10.20.193.58:0/947179347 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb4015c040 0x7feb4005b0e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.543+0000 7feb4643a640 1 -- 10.20.193.58:0/947179347 >> 10.20.193.58:0/947179347 conn(0x7feb400b3c20 msgr2=0x7feb400b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:51.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.543+0000 7feb4643a640 1 -- 10.20.193.58:0/947179347 shutdown_connections 2026-02-23T06:41:51.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.543+0000 7feb4643a640 1 -- 10.20.193.58:0/947179347 wait complete. 2026-02-23T06:41:51.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.544+0000 7feb4643a640 1 Processor -- start 2026-02-23T06:41:51.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.544+0000 7feb4643a640 1 -- start start 2026-02-23T06:41:51.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.545+0000 7feb4643a640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb40056550 0x7feb400a9aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:51.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.545+0000 7feb4643a640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feb4005d370 0x7feb40058660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:51.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.545+0000 7feb4643a640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feb4015c040 0x7feb401619e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:51.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.545+0000 7feb4643a640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7feb40161550 con 0x7feb4015c040 2026-02-23T06:41:51.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.545+0000 7feb4643a640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7feb40201da0 con 0x7feb4005d370 2026-02-23T06:41:51.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.545+0000 7feb4643a640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7feb40162830 con 0x7feb40056550 2026-02-23T06:41:51.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.545+0000 7feb45c39640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feb4015c040 0x7feb401619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:51.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.545+0000 7feb45438640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb40056550 0x7feb400a9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:51.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.545+0000 7feb45c39640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feb4015c040 0x7feb401619e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:51976/0 (socket says 10.20.193.58:51976) 2026-02-23T06:41:51.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.545+0000 7feb45c39640 1 -- 10.20.193.58:0/2944664422 learned_addr learned my addr 10.20.193.58:0/2944664422 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:41:51.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.545+0000 7feb44c37640 1 --2- 10.20.193.58:0/2944664422 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feb4005d370 0x7feb40058660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:51.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.545+0000 7feb45c39640 1 -- 10.20.193.58:0/2944664422 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb40056550 msgr2=0x7feb400a9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:51.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.545+0000 7feb45c39640 1 --2- 10.20.193.58:0/2944664422 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb40056550 0x7feb400a9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.545+0000 7feb45c39640 1 -- 10.20.193.58:0/2944664422 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feb4005d370 msgr2=0x7feb40058660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:51.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.545+0000 7feb45c39640 1 --2- 10.20.193.58:0/2944664422 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feb4005d370 0x7feb40058660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.545+0000 7feb45c39640 1 -- 10.20.193.58:0/2944664422 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb34009570 con 0x7feb4015c040 2026-02-23T06:41:51.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.545+0000 7feb45438640 1 --2- 10.20.193.58:0/2944664422 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb40056550 0x7feb400a9aa0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:41:51.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.546+0000 7feb45c39640 1 --2- 10.20.193.58:0/2944664422 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feb4015c040 0x7feb401619e0 secure :-1 s=READY pgs=25 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb3c00f940 tx=0x7feb3c00fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:51.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.546+0000 7feb2dffb640 1 -- 10.20.193.58:0/2944664422 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb3c00dce0 con 0x7feb4015c040 2026-02-23T06:41:51.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.546+0000 7feb2dffb640 1 -- 10.20.193.58:0/2944664422 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb3c00de40 con 0x7feb4015c040 2026-02-23T06:41:51.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.546+0000 7feb2dffb640 1 -- 10.20.193.58:0/2944664422 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb3c005bb0 con 0x7feb4015c040 2026-02-23T06:41:51.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.546+0000 7feb4643a640 1 -- 10.20.193.58:0/2944664422 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb40162b10 con 0x7feb4015c040 2026-02-23T06:41:51.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.546+0000 7feb4643a640 1 -- 10.20.193.58:0/2944664422 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb401611e0 con 0x7feb4015c040 2026-02-23T06:41:51.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.546+0000 7feb4643a640 1 --2- 10.20.193.58:0/2944664422 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb40162380 0x7feb400b14d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:51.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.546+0000 7feb4643a640 1 -- 10.20.193.58:0/2944664422 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7feb400609c0 con 0x7feb40162380 2026-02-23T06:41:51.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.547+0000 7feb45438640 1 --2- 10.20.193.58:0/2944664422 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb40162380 0x7feb400b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:51.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.547+0000 7feb45438640 1 -- 10.20.193.58:0/2944664422 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb4005b620 con 0x7feb40162380 2026-02-23T06:41:51.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.547+0000 7feb45438640 1 --2- 10.20.193.58:0/2944664422 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb40162380 0x7feb400b14d0 secure :-1 s=READY pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb3000bea0 tx=0x7feb3000e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:51.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.548+0000 7feb2dffb640 1 -- 10.20.193.58:0/2944664422 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb30004500 con 0x7feb40162380 2026-02-23T06:41:51.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.548+0000 7feb2dffb640 1 -- 10.20.193.58:0/2944664422 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7feb3000ee50 con 0x7feb40162380 2026-02-23T06:41:51.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.548+0000 7feb2dffb640 1 -- 10.20.193.58:0/2944664422 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb40162380 msgr2=0x7feb400b14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:51.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.548+0000 7feb2dffb640 1 --2- 10.20.193.58:0/2944664422 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb40162380 0x7feb400b14d0 secure :-1 s=READY pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb3000bea0 tx=0x7feb3000e720 comp rx=0 tx=0).stop 2026-02-23T06:41:51.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.548+0000 7feb2dffb640 1 -- 10.20.193.58:0/2944664422 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb40162380 msgr2=0x7feb400b14d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:41:51.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.548+0000 7feb2dffb640 1 --2- 10.20.193.58:0/2944664422 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb40162380 0x7feb400b14d0 secure :-1 s=CLOSED pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb3000bea0 tx=0x7feb3000e720 comp rx=0 tx=0).stop 2026-02-23T06:41:51.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.548+0000 7feb2dffb640 1 -- 10.20.193.58:0/2944664422 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7feb3c020060 con 0x7feb4015c040 2026-02-23T06:41:51.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.549+0000 7feb2dffb640 1 --2- 10.20.193.58:0/2944664422 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7feb1007a430 0x7feb1009a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:51.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.549+0000 7feb2dffb640 1 -- 10.20.193.58:0/2944664422 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7feb3c015070 con 0x7feb4015c040 2026-02-23T06:41:51.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.549+0000 7feb45438640 1 --2- 10.20.193.58:0/2944664422 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7feb1007a430 0x7feb1009a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:51.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.549+0000 7feb45438640 1 --2- 10.20.193.58:0/2944664422 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7feb1007a430 0x7feb1009a8e0 secure :-1 s=READY pgs=453 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb3000ecd0 tx=0x7feb30014000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:51.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.551+0000 7feb4643a640 1 --2- 10.20.193.58:0/2944664422 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb40161f20 0x7feb400b1a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:51.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.551+0000 7feb4643a640 1 -- 10.20.193.58:0/2944664422 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7feb40162ca0 con 0x7feb40161f20 2026-02-23T06:41:51.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.551+0000 7feb44c37640 1 --2- 10.20.193.58:0/2944664422 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb40161f20 0x7feb400b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:51.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.552+0000 7feb44c37640 1 -- 10.20.193.58:0/2944664422 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7feb4005d9c0 con 0x7feb40161f20 2026-02-23T06:41:51.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.552+0000 7feb44c37640 1 --2- 10.20.193.58:0/2944664422 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb40161f20 0x7feb400b1a10 secure :-1 s=READY pgs=38 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb400b6900 tx=0x7feb340028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:51.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.552+0000 7feb2dffb640 1 -- 10.20.193.58:0/2944664422 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb3403d050 con 0x7feb40161f20 2026-02-23T06:41:51.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.552+0000 7feb2dffb640 1 -- 10.20.193.58:0/2944664422 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5389 (secure 0 0 0) 0x7feb3403e040 con 0x7feb40161f20 2026-02-23T06:41:51.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.552+0000 7feb2dffb640 1 -- 10.20.193.58:0/2944664422 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb40161f20 msgr2=0x7feb400b1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:51.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.552+0000 7feb2dffb640 1 --2- 10.20.193.58:0/2944664422 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb40161f20 0x7feb400b1a10 secure :-1 s=READY pgs=38 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb400b6900 tx=0x7feb340028d0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.552+0000 7feb2dffb640 1 -- 10.20.193.58:0/2944664422 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb40161f20 msgr2=0x7feb400b1a10 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:41:51.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.552+0000 7feb2dffb640 1 --2- 10.20.193.58:0/2944664422 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb40161f20 0x7feb400b1a10 secure :-1 s=CLOSED pgs=38 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb400b6900 tx=0x7feb340028d0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.550 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:41:51.550 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:41:51.550 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:41:51.550 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:41:51.550 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 172, 2026-02-23T06:41:51.550 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 63413, 2026-02-23T06:41:51.550 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:41:51.550 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:41:51.551 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:41:51.551 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:41:51.551 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:51.551 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:41:51.551 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:41:51.551 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:41:51.551 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:41:51.551 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:51.551 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:51.551 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:51.551 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:51.552 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:51.552 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:51.552 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:51.552 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:51.552 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:51.552 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:51.552 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:51.552 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:51.552 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:51.552 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:51.552 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:41:51.552 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:41:51.553 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:51.553 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:51.553 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:51.553 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:51.553 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:51.553 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:51.553 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:51.553 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:51.553 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:51.553 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:51.553 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:51.553 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:51.554 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:51.554 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:51.554 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.554 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:41:51.554 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:41:51.554 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:41:51.554 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:41:51.554 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:41:51.554 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:41:51.554 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:41:51.554 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:41:51.554 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:41:51.555 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:41:51.555 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:41:51.555 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:41:51.555 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:41:51.555 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:41:51.555 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:41:51.555 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:41:51.555 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:41:51.555 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:41:51.555 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:41:51.555 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:41:51.555 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:41:51.556 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:41:51.556 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:41:51.556 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:41:51.556 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:41:51.556 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:41:51.556 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:41:51.556 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:41:51.556 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:41:51.556 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:41:51.556 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:51.556 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:41:51.556 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.557 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:41:51.557 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.557 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:41:51.557 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:41:51.557 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:51.557 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:51.557 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.557 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:51.557 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:41:51.557 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:51.557 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.557 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.558 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:51.558 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:41:51.558 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:51.558 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:51.558 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:51.558 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.558 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:41:51.558 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:41:51.558 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:51.558 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:51.558 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:41:51.559 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:51.559 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.559 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.559 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:41:51.559 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:41:51.559 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:51.559 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:51.559 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.559 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:51.559 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:41:51.559 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:51.559 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.559 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.560 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:51.560 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:41:51.560 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:51.560 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:51.560 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:51.560 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.560 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:41:51.560 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:41:51.560 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:51.560 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:51.560 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:41:51.560 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:51.560 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.561 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.561 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:41:51.561 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:41:51.561 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:41:51.561 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:41:51.561 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.561 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:41:51.561 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:41:51.561 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:51.561 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.561 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.561 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:41:51.562 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:41:51.562 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:41:51.562 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:51.562 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:51.562 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.562 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:41:51.562 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:41:51.562 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:41:51.562 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:41:51.562 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:41:51.562 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:41:51.562 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:51.563 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:51.563 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.563 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:41:51.563 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:41:51.563 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.563 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:51.563 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:51.563 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:41:51.563 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:51.563 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:51.563 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:41:51.563 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.563 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:51.563 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:51.564 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:41:51.564 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:51.564 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:51.564 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:41:51.564 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.564 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:51.564 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:51.564 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:41:51.564 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:51.564 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:41:51.564 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:41:51.564 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.564 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:41:51.564 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:41:51.565 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:41:51.565 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.565 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:41:51.565 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:41:51.565 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:41:51.565 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:41:51.565 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:41:51.565 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:41:51.565 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:41:51.565 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:41:51.565 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:41:51.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.553+0000 7feb4643a640 1 -- 10.20.193.58:0/2944664422 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7feb1007a430 msgr2=0x7feb1009a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:51.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.553+0000 7feb4643a640 1 --2- 10.20.193.58:0/2944664422 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7feb1007a430 0x7feb1009a8e0 secure :-1 s=READY pgs=453 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb3000ecd0 tx=0x7feb30014000 comp rx=0 tx=0).stop 2026-02-23T06:41:51.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.553+0000 7feb4643a640 1 -- 10.20.193.58:0/2944664422 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feb4015c040 msgr2=0x7feb401619e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:51.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.553+0000 7feb4643a640 1 --2- 10.20.193.58:0/2944664422 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feb4015c040 0x7feb401619e0 secure :-1 s=READY pgs=25 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb3c00f940 tx=0x7feb3c00fe10 comp rx=0 tx=0).stop 2026-02-23T06:41:51.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.553+0000 7feb45c39640 1 -- 10.20.193.58:0/2944664422 reap_dead start 2026-02-23T06:41:51.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.553+0000 7feb45c39640 1 -- 10.20.193.58:0/2944664422 reap_dead start 2026-02-23T06:41:51.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.553+0000 7feb4643a640 1 -- 10.20.193.58:0/2944664422 shutdown_connections 2026-02-23T06:41:51.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.553+0000 7feb4643a640 1 -- 10.20.193.58:0/2944664422 >> 10.20.193.58:0/2944664422 conn(0x7feb400b3c20 msgr2=0x7feb40163200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:51.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.553+0000 7feb4643a640 1 -- 10.20.193.58:0/2944664422 shutdown_connections 2026-02-23T06:41:51.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.553+0000 7feb4643a640 1 -- 10.20.193.58:0/2944664422 wait complete. 2026-02-23T06:41:51.568 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:41:51.568 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-23T06:41:51.568 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-23T06:41:51.568 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-23T06:41:51.568 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-23T06:41:51.568 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-23T06:41:51.569 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:41:51.578 INFO:tasks.ceph.mon.c:Stopped 2026-02-23T06:41:51.578 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:41:51.578 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:41:51.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.704+0000 7f89142cc640 1 -- 10.20.193.58:0/1698730172 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f890c168cb0 msgr2=0x7f890c0b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:51.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.704+0000 7f89142cc640 1 --2- 10.20.193.58:0/1698730172 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f890c168cb0 0x7f890c0b2120 secure :-1 s=READY pgs=30 gs=2 cs=0 l=1 c_cookie=10005512689407351332 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f890c0b0a00 tx=0x7f88fc02f2e0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.704+0000 7f89142cc640 1 -- 10.20.193.58:0/1698730172 shutdown_connections 2026-02-23T06:41:51.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.704+0000 7f89142cc640 1 --2- 10.20.193.58:0/1698730172 >> v2:10.20.193.93:3300/0 conn(0x7f890c0af0f0 0x7f890c15f280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.704+0000 7f89142cc640 1 --2- 10.20.193.58:0/1698730172 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f890c168cb0 0x7f890c0b2120 unknown :-1 s=CLOSED pgs=30 gs=2 cs=0 l=1 c_cookie=10005512689407351332 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.704+0000 7f89142cc640 1 -- 10.20.193.58:0/1698730172 >> 10.20.193.58:0/1698730172 conn(0x7f890c0561f0 msgr2=0x7f890c0565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:51.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.704+0000 7f89142cc640 1 -- 10.20.193.58:0/1698730172 shutdown_connections 2026-02-23T06:41:51.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.704+0000 7f89142cc640 1 -- 10.20.193.58:0/1698730172 wait complete. 2026-02-23T06:41:51.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.705+0000 7f89142cc640 1 Processor -- start 2026-02-23T06:41:51.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.705+0000 7f89142cc640 1 -- start start 2026-02-23T06:41:51.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.706+0000 7f89142cc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f890c0aecd0 0x7f890c14e130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:51.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.706+0000 7f89142cc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f890c0af0f0 0x7f890c11ef90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:51.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.706+0000 7f89142cc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f890c168cb0 0x7f890c11d0c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:51.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.706+0000 7f89142cc640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f890c11dba0 con 0x7f890c0af0f0 2026-02-23T06:41:51.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.706+0000 7f89142cc640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f890c14dca0 con 0x7f890c0aecd0 2026-02-23T06:41:51.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.706+0000 7f89142cc640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f890c11e0d0 con 0x7f890c168cb0 2026-02-23T06:41:51.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.706+0000 7f8912842640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f890c168cb0 msgr2=0x7f890c11d0c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:41:51.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.706+0000 7f8912842640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f890c168cb0 0x7f890c11d0c0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:41:51.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.706+0000 7f8912041640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f890c0aecd0 0x7f890c14e130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:51.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.706+0000 7f8912041640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f890c0aecd0 0x7f890c14e130 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:57006/0 (socket says 10.20.193.58:57006) 2026-02-23T06:41:51.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.706+0000 7f8912041640 1 -- 10.20.193.58:0/2964452991 learned_addr learned my addr 10.20.193.58:0/2964452991 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:41:51.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.706+0000 7f8911840640 1 --2- 10.20.193.58:0/2964452991 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f890c0af0f0 0x7f890c11ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:51.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.706+0000 7f8911840640 1 -- 10.20.193.58:0/2964452991 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f890c168cb0 msgr2=0x7f890c11d0c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:41:51.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.706+0000 7f8911840640 1 --2- 10.20.193.58:0/2964452991 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f890c168cb0 0x7f890c11d0c0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.706+0000 7f8911840640 1 -- 10.20.193.58:0/2964452991 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f890c0aecd0 msgr2=0x7f890c14e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:51.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.706+0000 7f8911840640 1 --2- 10.20.193.58:0/2964452991 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f890c0aecd0 0x7f890c14e130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.706+0000 7f8911840640 1 -- 10.20.193.58:0/2964452991 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88fc009570 con 0x7f890c0af0f0 2026-02-23T06:41:51.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.707+0000 7f8911840640 1 --2- 10.20.193.58:0/2964452991 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f890c0af0f0 0x7f890c11ef90 secure :-1 s=READY pgs=31 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f890000c410 tx=0x7f890000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:51.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.707+0000 7f88f2ffd640 1 -- 10.20.193.58:0/2964452991 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8900006ab0 con 0x7f890c0af0f0 2026-02-23T06:41:51.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.707+0000 7f88f2ffd640 1 -- 10.20.193.58:0/2964452991 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8900006d00 con 0x7f890c0af0f0 2026-02-23T06:41:51.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.707+0000 7f88f2ffd640 1 -- 10.20.193.58:0/2964452991 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f89000072b0 con 0x7f890c0af0f0 2026-02-23T06:41:51.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.707+0000 7f89142cc640 1 -- 10.20.193.58:0/2964452991 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f890c11ddf0 con 0x7f890c0af0f0 2026-02-23T06:41:51.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.707+0000 7f89142cc640 1 -- 10.20.193.58:0/2964452991 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f890c14d930 con 0x7f890c0af0f0 2026-02-23T06:41:51.702 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.707+0000 7f89142cc640 1 -- 10.20.193.58:0/2964452991 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f890c169770 con 0x7f890c0af0f0 2026-02-23T06:41:51.703 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.709+0000 7f88f2ffd640 1 -- 10.20.193.58:0/2964452991 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f8900007410 con 0x7f890c0af0f0 2026-02-23T06:41:51.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.710+0000 7f88f2ffd640 1 --2- 10.20.193.58:0/2964452991 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f88dc07a5a0 0x7f88dc09aa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:51.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.710+0000 7f88f2ffd640 1 -- 10.20.193.58:0/2964452991 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f890009cc50 con 0x7f890c0af0f0 2026-02-23T06:41:51.704 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.710+0000 7f8912041640 1 --2- 10.20.193.58:0/2964452991 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f88dc07a5a0 0x7f88dc09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:51.705 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.711+0000 7f8912041640 1 --2- 10.20.193.58:0/2964452991 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f88dc07a5a0 0x7f88dc09aa50 secure :-1 s=READY pgs=454 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88fc0098a0 tx=0x7f88fc03a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:51.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.712+0000 7f88f2ffd640 1 -- 10.20.193.58:0/2964452991 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f890c169770 con 0x7f890c0af0f0 2026-02-23T06:41:51.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.866+0000 7f89142cc640 1 -- 10.20.193.58:0/2964452991 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f890c169770 con 0x7f890c0af0f0 2026-02-23T06:41:51.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.867+0000 7f88f2ffd640 1 -- 10.20.193.58:0/2964452991 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f890c169770 con 0x7f890c0af0f0 2026-02-23T06:41:51.862 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":172,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:41:51.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.868+0000 7f89142cc640 1 -- 10.20.193.58:0/2964452991 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f88dc07a5a0 msgr2=0x7f88dc09aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:51.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.868+0000 7f89142cc640 1 --2- 10.20.193.58:0/2964452991 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f88dc07a5a0 0x7f88dc09aa50 secure :-1 s=READY pgs=454 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88fc0098a0 tx=0x7f88fc03a040 comp rx=0 tx=0).stop 2026-02-23T06:41:51.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.868+0000 7f89142cc640 1 -- 10.20.193.58:0/2964452991 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f890c0af0f0 msgr2=0x7f890c11ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:51.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.868+0000 7f89142cc640 1 --2- 10.20.193.58:0/2964452991 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f890c0af0f0 0x7f890c11ef90 secure :-1 s=READY pgs=31 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f890000c410 tx=0x7f890000c8e0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.868+0000 7f89142cc640 1 -- 10.20.193.58:0/2964452991 shutdown_connections 2026-02-23T06:41:51.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.868+0000 7f89142cc640 1 --2- 10.20.193.58:0/2964452991 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f88dc07a5a0 0x7f88dc09aa50 unknown :-1 s=CLOSED pgs=454 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.868+0000 7f89142cc640 1 --2- 10.20.193.58:0/2964452991 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f890c168cb0 0x7f890c11d0c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.868+0000 7f89142cc640 1 --2- 10.20.193.58:0/2964452991 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f890c0af0f0 0x7f890c11ef90 unknown :-1 s=CLOSED pgs=31 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.868+0000 7f89142cc640 1 --2- 10.20.193.58:0/2964452991 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f890c0aecd0 0x7f890c14e130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:51.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.868+0000 7f89142cc640 1 -- 10.20.193.58:0/2964452991 >> 10.20.193.58:0/2964452991 conn(0x7f890c0561f0 msgr2=0x7f890c166660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:51.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.868+0000 7f89142cc640 1 -- 10.20.193.58:0/2964452991 shutdown_connections 2026-02-23T06:41:51.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:51.868+0000 7f89142cc640 1 -- 10.20.193.58:0/2964452991 wait complete. 2026-02-23T06:41:54.875 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:41:54.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.001+0000 7f7b952c3640 1 -- 10.20.193.58:0/2492125114 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7b9015c4b0 msgr2=0x7f7b90058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:54.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.001+0000 7f7b952c3640 1 --2- 10.20.193.58:0/2492125114 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7b9015c4b0 0x7f7b90058200 secure :-1 s=READY pgs=96 gs=2 cs=0 l=1 c_cookie=5286169756676345207 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b7c004740 tx=0x7f7b7c02f200 comp rx=0 tx=0).stop 2026-02-23T06:41:54.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.001+0000 7f7b952c3640 1 -- 10.20.193.58:0/2492125114 shutdown_connections 2026-02-23T06:41:54.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.001+0000 7f7b952c3640 1 --2- 10.20.193.58:0/2492125114 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7b90056960 0x7f7b900b6720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:54.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.001+0000 7f7b952c3640 1 --2- 10.20.193.58:0/2492125114 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7b9015c4b0 0x7f7b90058200 unknown :-1 s=CLOSED pgs=96 gs=2 cs=0 l=1 c_cookie=5286169756676345207 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:54.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.001+0000 7f7b952c3640 1 -- 10.20.193.58:0/2492125114 >> 10.20.193.58:0/2492125114 conn(0x7f7b900b3c20 msgr2=0x7f7b900b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:54.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.001+0000 7f7b952c3640 1 -- 10.20.193.58:0/2492125114 shutdown_connections 2026-02-23T06:41:54.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.001+0000 7f7b952c3640 1 -- 10.20.193.58:0/2492125114 wait complete. 2026-02-23T06:41:54.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.002+0000 7f7b952c3640 1 Processor -- start 2026-02-23T06:41:54.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.002+0000 7f7b952c3640 1 -- start start 2026-02-23T06:41:54.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.003+0000 7f7b952c3640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7b90056960 0x7f7b9013d1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:54.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.003+0000 7f7b952c3640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b9015c4b0 0x7f7b90200e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:54.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.003+0000 7f7b952c3640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7b90162ca0 0x7f7b90160d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:54.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.003+0000 7f7b952c3640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f7b900affc0 con 0x7f7b9015c4b0 2026-02-23T06:41:54.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.003+0000 7f7b952c3640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f7b900b0280 con 0x7f7b90162ca0 2026-02-23T06:41:54.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.003+0000 7f7b952c3640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f7b90160790 con 0x7f7b90056960 2026-02-23T06:41:55.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.003+0000 7f7b8ffff640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7b90056960 msgr2=0x7f7b9013d1c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:41:55.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.003+0000 7f7b8ffff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7b90056960 0x7f7b9013d1c0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:41:55.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.003+0000 7f7b8f7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b9015c4b0 0x7f7b90200e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:55.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.003+0000 7f7b94ac2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7b90162ca0 0x7f7b90160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:55.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.003+0000 7f7b8f7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b9015c4b0 0x7f7b90200e10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:52024/0 (socket says 10.20.193.58:52024) 2026-02-23T06:41:55.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.003+0000 7f7b8f7fe640 1 -- 10.20.193.58:0/387990121 learned_addr learned my addr 10.20.193.58:0/387990121 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:41:55.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.003+0000 7f7b8f7fe640 1 -- 10.20.193.58:0/387990121 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7b90056960 msgr2=0x7f7b9013d1c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:41:55.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.003+0000 7f7b8f7fe640 1 --2- 10.20.193.58:0/387990121 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7b90056960 0x7f7b9013d1c0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:55.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.003+0000 7f7b8f7fe640 1 -- 10.20.193.58:0/387990121 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7b90162ca0 msgr2=0x7f7b90160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:55.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.003+0000 7f7b8f7fe640 1 --2- 10.20.193.58:0/387990121 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7b90162ca0 0x7f7b90160d90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:55.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.003+0000 7f7b8f7fe640 1 -- 10.20.193.58:0/387990121 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b7c0094b0 con 0x7f7b9015c4b0 2026-02-23T06:41:55.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.004+0000 7f7b8f7fe640 1 --2- 10.20.193.58:0/387990121 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b9015c4b0 0x7f7b90200e10 secure :-1 s=READY pgs=38 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b80006fd0 tx=0x7f7b8000bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:55.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.004+0000 7f7b8cff9640 1 -- 10.20.193.58:0/387990121 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7b80002cd0 con 0x7f7b9015c4b0 2026-02-23T06:41:55.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.004+0000 7f7b952c3640 1 -- 10.20.193.58:0/387990121 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b900b0c00 con 0x7f7b9015c4b0 2026-02-23T06:41:55.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.004+0000 7f7b8cff9640 1 -- 10.20.193.58:0/387990121 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b80004070 con 0x7f7b9015c4b0 2026-02-23T06:41:55.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.004+0000 7f7b8cff9640 1 -- 10.20.193.58:0/387990121 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7b80002cd0 con 0x7f7b9015c4b0 2026-02-23T06:41:55.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.004+0000 7f7b952c3640 1 -- 10.20.193.58:0/387990121 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b9015ff90 con 0x7f7b9015c4b0 2026-02-23T06:41:55.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.004+0000 7f7b952c3640 1 -- 10.20.193.58:0/387990121 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b900ae550 con 0x7f7b9015c4b0 2026-02-23T06:41:55.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.006+0000 7f7b8cff9640 1 -- 10.20.193.58:0/387990121 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f7b800041e0 con 0x7f7b9015c4b0 2026-02-23T06:41:55.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.007+0000 7f7b8cff9640 1 --2- 10.20.193.58:0/387990121 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7b6007a670 0x7f7b6009ab20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:55.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.007+0000 7f7b8cff9640 1 -- 10.20.193.58:0/387990121 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f7b8009cb70 con 0x7f7b9015c4b0 2026-02-23T06:41:55.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.007+0000 7f7b8ffff640 1 --2- 10.20.193.58:0/387990121 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7b6007a670 0x7f7b6009ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:55.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.007+0000 7f7b8ffff640 1 --2- 10.20.193.58:0/387990121 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7b6007a670 0x7f7b6009ab20 secure :-1 s=READY pgs=455 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b7c009230 tx=0x7f7b7c031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:55.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.009+0000 7f7b8cff9640 1 -- 10.20.193.58:0/387990121 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f7b8005fda0 con 0x7f7b9015c4b0 2026-02-23T06:41:55.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.164+0000 7f7b952c3640 1 -- 10.20.193.58:0/387990121 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7b90160390 con 0x7f7b9015c4b0 2026-02-23T06:41:55.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.164+0000 7f7b8cff9640 1 -- 10.20.193.58:0/387990121 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f7b80062ec0 con 0x7f7b9015c4b0 2026-02-23T06:41:55.160 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":172,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:41:55.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.166+0000 7f7b952c3640 1 -- 10.20.193.58:0/387990121 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7b6007a670 msgr2=0x7f7b6009ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:55.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.166+0000 7f7b952c3640 1 --2- 10.20.193.58:0/387990121 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7b6007a670 0x7f7b6009ab20 secure :-1 s=READY pgs=455 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b7c009230 tx=0x7f7b7c031040 comp rx=0 tx=0).stop 2026-02-23T06:41:55.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.166+0000 7f7b952c3640 1 -- 10.20.193.58:0/387990121 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b9015c4b0 msgr2=0x7f7b90200e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:55.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.166+0000 7f7b952c3640 1 --2- 10.20.193.58:0/387990121 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b9015c4b0 0x7f7b90200e10 secure :-1 s=READY pgs=38 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b80006fd0 tx=0x7f7b8000bbf0 comp rx=0 tx=0).stop 2026-02-23T06:41:55.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.166+0000 7f7b952c3640 1 -- 10.20.193.58:0/387990121 shutdown_connections 2026-02-23T06:41:55.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.166+0000 7f7b952c3640 1 --2- 10.20.193.58:0/387990121 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7b6007a670 0x7f7b6009ab20 unknown :-1 s=CLOSED pgs=455 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:55.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.166+0000 7f7b952c3640 1 --2- 10.20.193.58:0/387990121 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7b90162ca0 0x7f7b90160d90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:55.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.166+0000 7f7b952c3640 1 --2- 10.20.193.58:0/387990121 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b9015c4b0 0x7f7b90200e10 unknown :-1 s=CLOSED pgs=38 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:55.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.166+0000 7f7b952c3640 1 --2- 10.20.193.58:0/387990121 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7b90056960 0x7f7b9013d1c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:55.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.166+0000 7f7b952c3640 1 -- 10.20.193.58:0/387990121 >> 10.20.193.58:0/387990121 conn(0x7f7b900b3c20 msgr2=0x7f7b90162290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:55.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.166+0000 7f7b952c3640 1 -- 10.20.193.58:0/387990121 shutdown_connections 2026-02-23T06:41:55.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:55.166+0000 7f7b952c3640 1 -- 10.20.193.58:0/387990121 wait complete. 2026-02-23T06:41:58.174 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:41:58.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.300+0000 7f0458a03640 1 -- 10.20.193.58:0/4005190115 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f04540b6690 msgr2=0x7f0454058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:58.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.300+0000 7f0458a03640 1 --2- 10.20.193.58:0/4005190115 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f04540b6690 0x7f0454058cf0 secure :-1 s=READY pgs=99 gs=2 cs=0 l=1 c_cookie=6830759146203630496 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0448006f50 tx=0x7f04480303a0 comp rx=0 tx=0).stop 2026-02-23T06:41:58.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.300+0000 7f0458a03640 1 -- 10.20.193.58:0/4005190115 shutdown_connections 2026-02-23T06:41:58.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.300+0000 7f0458a03640 1 --2- 10.20.193.58:0/4005190115 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f04540b6690 0x7f0454058cf0 unknown :-1 s=CLOSED pgs=99 gs=2 cs=0 l=1 c_cookie=6830759146203630496 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:58.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.300+0000 7f0458a03640 1 --2- 10.20.193.58:0/4005190115 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f045415d870 0x7f04540587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:58.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.300+0000 7f0458a03640 1 -- 10.20.193.58:0/4005190115 >> 10.20.193.58:0/4005190115 conn(0x7f04540b3c20 msgr2=0x7f04540b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:58.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.301+0000 7f0458a03640 1 -- 10.20.193.58:0/4005190115 shutdown_connections 2026-02-23T06:41:58.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.301+0000 7f0458a03640 1 -- 10.20.193.58:0/4005190115 wait complete. 2026-02-23T06:41:58.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.302+0000 7f0458a03640 1 Processor -- start 2026-02-23T06:41:58.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.302+0000 7f0458a03640 1 -- start start 2026-02-23T06:41:58.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.303+0000 7f0458a03640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f04540b6690 0x7f0454164f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:58.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.303+0000 7f0458a03640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f045415d4a0 0x7f045413d230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:58.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.304+0000 7f0458a03640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f045415d870 0x7f045413d770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:58.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.304+0000 7f0452ffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f045415d4a0 0x7f045413d230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:58.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.304+0000 7f04537fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f04540b6690 0x7f0454164f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:58.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.304+0000 7f0452ffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f045415d4a0 0x7f045413d230 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:57040/0 (socket says 10.20.193.58:57040) 2026-02-23T06:41:58.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.304+0000 7f04537fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f04540b6690 0x7f0454164f20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:52040/0 (socket says 10.20.193.58:52040) 2026-02-23T06:41:58.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.304+0000 7f0458a03640 1 -- 10.20.193.58:0/2212168483 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f0454057b20 con 0x7f04540b6690 2026-02-23T06:41:58.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.304+0000 7f0452ffd640 1 -- 10.20.193.58:0/2212168483 learned_addr learned my addr 10.20.193.58:0/2212168483 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:41:58.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.304+0000 7f0458a03640 1 -- 10.20.193.58:0/2212168483 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f0454163020 con 0x7f045415d4a0 2026-02-23T06:41:58.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.304+0000 7f0458a03640 1 -- 10.20.193.58:0/2212168483 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f0454163300 con 0x7f045415d870 2026-02-23T06:41:58.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.304+0000 7f0453fff640 1 -- 10.20.193.58:0/2212168483 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f045415d870 msgr2=0x7f045413d770 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:41:58.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.304+0000 7f0453fff640 1 --2- 10.20.193.58:0/2212168483 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f045415d870 0x7f045413d770 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:41:58.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.305+0000 7f04537fe640 1 -- 10.20.193.58:0/2212168483 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f045415d870 msgr2=0x7f045413d770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:41:58.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.305+0000 7f04537fe640 1 --2- 10.20.193.58:0/2212168483 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f045415d870 0x7f045413d770 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:58.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.305+0000 7f04537fe640 1 -- 10.20.193.58:0/2212168483 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f045415d4a0 msgr2=0x7f045413d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:58.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.305+0000 7f04537fe640 1 --2- 10.20.193.58:0/2212168483 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f045415d4a0 0x7f045413d230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:58.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.305+0000 7f04537fe640 1 -- 10.20.193.58:0/2212168483 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044800a650 con 0x7f04540b6690 2026-02-23T06:41:58.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.305+0000 7f04537fe640 1 --2- 10.20.193.58:0/2212168483 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f04540b6690 0x7f0454164f20 secure :-1 s=READY pgs=40 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0440002730 tx=0x7f044000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:58.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.306+0000 7f042ffff640 1 -- 10.20.193.58:0/2212168483 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0440006ab0 con 0x7f04540b6690 2026-02-23T06:41:58.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.306+0000 7f042ffff640 1 -- 10.20.193.58:0/2212168483 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0440006d00 con 0x7f04540b6690 2026-02-23T06:41:58.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.306+0000 7f042ffff640 1 -- 10.20.193.58:0/2212168483 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04400072b0 con 0x7f04540b6690 2026-02-23T06:41:58.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.306+0000 7f0458a03640 1 -- 10.20.193.58:0/2212168483 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0454057d70 con 0x7f04540b6690 2026-02-23T06:41:58.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.306+0000 7f0458a03640 1 -- 10.20.193.58:0/2212168483 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0454166380 con 0x7f04540b6690 2026-02-23T06:41:58.302 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.306+0000 7f0458a03640 1 -- 10.20.193.58:0/2212168483 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0414005300 con 0x7f04540b6690 2026-02-23T06:41:58.302 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.308+0000 7f042ffff640 1 -- 10.20.193.58:0/2212168483 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f0440007410 con 0x7f04540b6690 2026-02-23T06:41:58.303 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.309+0000 7f042ffff640 1 --2- 10.20.193.58:0/2212168483 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f042407a680 0x7f042409ab30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:41:58.304 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.309+0000 7f042ffff640 1 -- 10.20.193.58:0/2212168483 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f044009c920 con 0x7f04540b6690 2026-02-23T06:41:58.304 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.309+0000 7f0452ffd640 1 --2- 10.20.193.58:0/2212168483 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f042407a680 0x7f042409ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:41:58.304 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.310+0000 7f0452ffd640 1 --2- 10.20.193.58:0/2212168483 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f042407a680 0x7f042409ab30 secure :-1 s=READY pgs=456 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f045413b5f0 tx=0x7f0444009290 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:41:58.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.311+0000 7f042ffff640 1 -- 10.20.193.58:0/2212168483 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f044005fbf0 con 0x7f04540b6690 2026-02-23T06:41:58.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.468+0000 7f0458a03640 1 -- 10.20.193.58:0/2212168483 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0414005b30 con 0x7f04540b6690 2026-02-23T06:41:58.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.469+0000 7f042ffff640 1 -- 10.20.193.58:0/2212168483 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f0440062d10 con 0x7f04540b6690 2026-02-23T06:41:58.464 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":172,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:41:58.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.472+0000 7f0458a03640 1 -- 10.20.193.58:0/2212168483 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f042407a680 msgr2=0x7f042409ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:58.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.472+0000 7f0458a03640 1 --2- 10.20.193.58:0/2212168483 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f042407a680 0x7f042409ab30 secure :-1 s=READY pgs=456 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f045413b5f0 tx=0x7f0444009290 comp rx=0 tx=0).stop 2026-02-23T06:41:58.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.472+0000 7f0458a03640 1 -- 10.20.193.58:0/2212168483 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f04540b6690 msgr2=0x7f0454164f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:41:58.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.472+0000 7f0458a03640 1 --2- 10.20.193.58:0/2212168483 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f04540b6690 0x7f0454164f20 secure :-1 s=READY pgs=40 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0440002730 tx=0x7f044000c8b0 comp rx=0 tx=0).stop 2026-02-23T06:41:58.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.472+0000 7f0458a03640 1 -- 10.20.193.58:0/2212168483 shutdown_connections 2026-02-23T06:41:58.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.472+0000 7f0458a03640 1 --2- 10.20.193.58:0/2212168483 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f042407a680 0x7f042409ab30 unknown :-1 s=CLOSED pgs=456 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:58.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.472+0000 7f0458a03640 1 --2- 10.20.193.58:0/2212168483 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f045415d870 0x7f045413d770 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:58.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.472+0000 7f0458a03640 1 --2- 10.20.193.58:0/2212168483 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f045415d4a0 0x7f045413d230 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:58.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.472+0000 7f0458a03640 1 --2- 10.20.193.58:0/2212168483 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f04540b6690 0x7f0454164f20 unknown :-1 s=CLOSED pgs=40 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:41:58.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.472+0000 7f0458a03640 1 -- 10.20.193.58:0/2212168483 >> 10.20.193.58:0/2212168483 conn(0x7f04540b3c20 msgr2=0x7f04540aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:41:58.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.472+0000 7f0458a03640 1 -- 10.20.193.58:0/2212168483 shutdown_connections 2026-02-23T06:41:58.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:41:58.472+0000 7f0458a03640 1 -- 10.20.193.58:0/2212168483 wait complete. 2026-02-23T06:42:01.482 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:42:05.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:05.989+0000 7fdf9ce43640 1 -- 10.20.193.58:0/3166338662 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdf7c004140 msgr2=0x7fdf7c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:05.985 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:05.990+0000 7fdf9ce43640 1 --2- 10.20.193.58:0/3166338662 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdf7c004140 0x7fdf7c004850 secure :-1 s=READY pgs=103 gs=24 cs=0 l=1 c_cookie=7179889453281571516 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf980b1d30 tx=0x7fdf88030530 comp rx=0 tx=0).stop 2026-02-23T06:42:05.987 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:05.990+0000 7fdf9ce43640 1 -- 10.20.193.58:0/3166338662 shutdown_connections 2026-02-23T06:42:05.987 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:05.990+0000 7fdf9ce43640 1 --2- 10.20.193.58:0/3166338662 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdf7c004eb0 0x7fdf7c005320 unknown :-1 s=CLOSED pgs=0 gs=25 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:05.987 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:05.990+0000 7fdf9ce43640 1 --2- 10.20.193.58:0/3166338662 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdf7c004140 0x7fdf7c004850 unknown :-1 s=CLOSED pgs=103 gs=24 cs=0 l=1 c_cookie=7179889453281571516 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:05.987 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:05.990+0000 7fdf9ce43640 1 --2- 10.20.193.58:0/3166338662 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdf9815d4a0 0x7fdf7c003a30 unknown :-1 s=CLOSED pgs=0 gs=23 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:05.987 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:05.990+0000 7fdf9ce43640 1 -- 10.20.193.58:0/3166338662 >> 10.20.193.58:0/3166338662 conn(0x7fdf980b3c20 msgr2=0x7fdf980b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:05.987 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:05.992+0000 7fdf9ce43640 1 -- 10.20.193.58:0/3166338662 shutdown_connections 2026-02-23T06:42:05.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:05.994+0000 7fdf9ce43640 1 -- 10.20.193.58:0/3166338662 wait complete. 2026-02-23T06:42:05.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:05.994+0000 7fdf9ce43640 1 Processor -- start 2026-02-23T06:42:05.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:05.994+0000 7fdf9ce43640 1 -- start start 2026-02-23T06:42:05.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:05.994+0000 7fdf9ce43640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdf7c004140 0x7fdf981fd1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:05.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:05.994+0000 7fdf9ce43640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdf7c004eb0 0x7fdf981368f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:05.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:05.994+0000 7fdf9ce43640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdf9815d4a0 0x7fdf9815a040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:05.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:05.994+0000 7fdf9ce43640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fdf98136e30 con 0x7fdf9815d4a0 2026-02-23T06:42:05.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:05.994+0000 7fdf9ce43640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fdf981383e0 con 0x7fdf7c004eb0 2026-02-23T06:42:05.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:05.994+0000 7fdf9ce43640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fdf981386a0 con 0x7fdf7c004140 2026-02-23T06:42:05.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:05.999+0000 7fdf97fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdf9815d4a0 0x7fdf9815a040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:05.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:05.999+0000 7fdf97fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdf9815d4a0 0x7fdf9815a040 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:34112/0 (socket says 10.20.193.58:34112) 2026-02-23T06:42:05.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:05.999+0000 7fdf97fff640 1 -- 10.20.193.58:0/143414380 learned_addr learned my addr 10.20.193.58:0/143414380 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:42:05.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.001+0000 7fdf97fff640 1 -- 10.20.193.58:0/143414380 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdf7c004140 msgr2=0x7fdf981fd1b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-23T06:42:05.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.001+0000 7fdf97fff640 1 --2- 10.20.193.58:0/143414380 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdf7c004140 0x7fdf981fd1b0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:05.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.001+0000 7fdf97fff640 1 -- 10.20.193.58:0/143414380 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdf7c004eb0 msgr2=0x7fdf981368f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-23T06:42:05.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.001+0000 7fdf97fff640 1 --2- 10.20.193.58:0/143414380 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdf7c004eb0 0x7fdf981368f0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:05.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.001+0000 7fdf97fff640 1 -- 10.20.193.58:0/143414380 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf98138980 con 0x7fdf9815d4a0 2026-02-23T06:42:05.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.001+0000 7fdf97fff640 1 --2- 10.20.193.58:0/143414380 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdf9815d4a0 0x7fdf9815a040 secure :-1 s=READY pgs=43 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf74047040 tx=0x7fdf8c0134c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:05.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.002+0000 7fdf73fff640 1 -- 10.20.193.58:0/143414380 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdf8c018070 con 0x7fdf9815d4a0 2026-02-23T06:42:05.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.002+0000 7fdf9ce43640 1 -- 10.20.193.58:0/143414380 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf98138c60 con 0x7fdf9815d4a0 2026-02-23T06:42:05.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.002+0000 7fdf9ce43640 1 -- 10.20.193.58:0/143414380 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf981360f0 con 0x7fdf9815d4a0 2026-02-23T06:42:05.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.002+0000 7fdf73fff640 1 -- 10.20.193.58:0/143414380 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf8c013cf0 con 0x7fdf9815d4a0 2026-02-23T06:42:05.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.002+0000 7fdf73fff640 1 -- 10.20.193.58:0/143414380 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdf8c013ea0 con 0x7fdf9815d4a0 2026-02-23T06:42:06.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.006+0000 7fdf9ce43640 1 -- 10.20.193.58:0/143414380 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf980b6d50 con 0x7fdf9815d4a0 2026-02-23T06:42:06.005 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.008+0000 7fdf73fff640 1 -- 10.20.193.58:0/143414380 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fdf8c025070 con 0x7fdf9815d4a0 2026-02-23T06:42:06.006 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.009+0000 7fdf73fff640 1 --2- 10.20.193.58:0/143414380 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdf6007a6b0 0x7fdf6009ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:06.006 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.009+0000 7fdf73fff640 1 -- 10.20.193.58:0/143414380 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fdf8c09e800 con 0x7fdf9815d4a0 2026-02-23T06:42:06.006 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.009+0000 7fdf977fe640 1 --2- 10.20.193.58:0/143414380 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdf6007a6b0 0x7fdf6009ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:06.006 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.010+0000 7fdf977fe640 1 --2- 10.20.193.58:0/143414380 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdf6007a6b0 0x7fdf6009ab60 secure :-1 s=READY pgs=457 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf84007fd0 tx=0x7fdf84002800 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:06.006 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.011+0000 7fdf73fff640 1 -- 10.20.193.58:0/143414380 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fdf8c061a60 con 0x7fdf9815d4a0 2026-02-23T06:42:06.186 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.191+0000 7fdf9ce43640 1 -- 10.20.193.58:0/143414380 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fdf98163f70 con 0x7fdf9815d4a0 2026-02-23T06:42:06.186 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.191+0000 7fdf73fff640 1 -- 10.20.193.58:0/143414380 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1749 (secure 0 0 0) 0x7fdf8c064b80 con 0x7fdf9815d4a0 2026-02-23T06:42:06.186 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":176,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:42:06.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.194+0000 7fdf9ce43640 1 -- 10.20.193.58:0/143414380 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdf6007a6b0 msgr2=0x7fdf6009ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:06.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.194+0000 7fdf9ce43640 1 --2- 10.20.193.58:0/143414380 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdf6007a6b0 0x7fdf6009ab60 secure :-1 s=READY pgs=457 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf84007fd0 tx=0x7fdf84002800 comp rx=0 tx=0).stop 2026-02-23T06:42:06.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.194+0000 7fdf9ce43640 1 -- 10.20.193.58:0/143414380 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdf9815d4a0 msgr2=0x7fdf9815a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:06.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.194+0000 7fdf9ce43640 1 --2- 10.20.193.58:0/143414380 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdf9815d4a0 0x7fdf9815a040 secure :-1 s=READY pgs=43 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf74047040 tx=0x7fdf8c0134c0 comp rx=0 tx=0).stop 2026-02-23T06:42:06.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.194+0000 7fdf9ce43640 1 -- 10.20.193.58:0/143414380 shutdown_connections 2026-02-23T06:42:06.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.194+0000 7fdf9ce43640 1 --2- 10.20.193.58:0/143414380 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdf6007a6b0 0x7fdf6009ab60 unknown :-1 s=CLOSED pgs=457 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:06.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.194+0000 7fdf9ce43640 1 --2- 10.20.193.58:0/143414380 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdf9815d4a0 0x7fdf9815a040 unknown :-1 s=CLOSED pgs=43 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:06.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.194+0000 7fdf9ce43640 1 --2- 10.20.193.58:0/143414380 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdf7c004eb0 0x7fdf981368f0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:06.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.194+0000 7fdf9ce43640 1 --2- 10.20.193.58:0/143414380 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdf7c004140 0x7fdf981fd1b0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:06.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.194+0000 7fdf9ce43640 1 -- 10.20.193.58:0/143414380 >> 10.20.193.58:0/143414380 conn(0x7fdf980b3c20 msgr2=0x7fdf9815c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:06.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.194+0000 7fdf9ce43640 1 -- 10.20.193.58:0/143414380 shutdown_connections 2026-02-23T06:42:06.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.194+0000 7fdf9ce43640 1 -- 10.20.193.58:0/143414380 wait complete. 2026-02-23T06:42:06.200 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:42:06.200 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-23T06:42:06.200 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:42:06.321 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.325+0000 7f6573544640 1 -- 10.20.193.58:0/969838612 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f656c056960 msgr2=0x7f656c058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:06.321 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.325+0000 7f6573544640 1 --2- 10.20.193.58:0/969838612 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f656c056960 0x7f656c058200 secure :-1 s=READY pgs=45 gs=2 cs=0 l=1 c_cookie=17615359599371735977 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6560004740 tx=0x7f656002f200 comp rx=0 tx=0).stop 2026-02-23T06:42:06.321 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.325+0000 7f6573544640 1 -- 10.20.193.58:0/969838612 shutdown_connections 2026-02-23T06:42:06.321 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.325+0000 7f6573544640 1 --2- 10.20.193.58:0/969838612 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f656c162ca0 0x7f656c056fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:06.321 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.325+0000 7f6573544640 1 --2- 10.20.193.58:0/969838612 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f656c056960 0x7f656c058200 unknown :-1 s=CLOSED pgs=45 gs=2 cs=0 l=1 c_cookie=17615359599371735977 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:06.321 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.325+0000 7f6573544640 1 -- 10.20.193.58:0/969838612 >> 10.20.193.58:0/969838612 conn(0x7f656c0b3c20 msgr2=0x7f656c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:06.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.325+0000 7f6573544640 1 -- 10.20.193.58:0/969838612 shutdown_connections 2026-02-23T06:42:06.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.325+0000 7f6573544640 1 -- 10.20.193.58:0/969838612 wait complete. 2026-02-23T06:42:06.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.326+0000 7f6573544640 1 Processor -- start 2026-02-23T06:42:06.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.327+0000 7f6573544640 1 -- start start 2026-02-23T06:42:06.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.328+0000 7f6573544640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f656c056960 0x7f656c11e5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:06.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.328+0000 7f6573544640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f656c15c4b0 0x7f656c145a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:06.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.328+0000 7f6573544640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f656c162ca0 0x7f656c145f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:06.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.328+0000 7f6573544640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f656c0afb10 con 0x7f656c15c4b0 2026-02-23T06:42:06.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.328+0000 7f6573544640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f656c13a810 con 0x7f656c056960 2026-02-23T06:42:06.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.328+0000 7f6573544640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f656c0aef20 con 0x7f656c162ca0 2026-02-23T06:42:06.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.329+0000 7f6571d41640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f656c15c4b0 0x7f656c145a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:06.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.329+0000 7f6572d43640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f656c162ca0 msgr2=0x7f656c145f70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:42:06.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.329+0000 7f6572d43640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f656c162ca0 0x7f656c145f70 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:42:06.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.329+0000 7f6571d41640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f656c15c4b0 0x7f656c145a30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:34136/0 (socket says 10.20.193.58:34136) 2026-02-23T06:42:06.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.329+0000 7f6571d41640 1 -- 10.20.193.58:0/2978681119 learned_addr learned my addr 10.20.193.58:0/2978681119 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:42:06.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.329+0000 7f6572542640 1 --2- 10.20.193.58:0/2978681119 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f656c056960 0x7f656c11e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:06.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.329+0000 7f6571d41640 1 -- 10.20.193.58:0/2978681119 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f656c162ca0 msgr2=0x7f656c145f70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:42:06.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.329+0000 7f6571d41640 1 --2- 10.20.193.58:0/2978681119 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f656c162ca0 0x7f656c145f70 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:06.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.329+0000 7f6571d41640 1 -- 10.20.193.58:0/2978681119 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f656c056960 msgr2=0x7f656c11e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:06.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.329+0000 7f6571d41640 1 --2- 10.20.193.58:0/2978681119 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f656c056960 0x7f656c11e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:06.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.329+0000 7f6571d41640 1 -- 10.20.193.58:0/2978681119 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65600094b0 con 0x7f656c15c4b0 2026-02-23T06:42:06.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.329+0000 7f6571d41640 1 --2- 10.20.193.58:0/2978681119 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f656c15c4b0 0x7f656c145a30 secure :-1 s=READY pgs=46 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65600023d0 tx=0x7f6560004680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:06.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.329+0000 7f6552ffd640 1 -- 10.20.193.58:0/2978681119 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f656003c040 con 0x7f656c15c4b0 2026-02-23T06:42:06.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.329+0000 7f6552ffd640 1 -- 10.20.193.58:0/2978681119 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6560004a70 con 0x7f656c15c4b0 2026-02-23T06:42:06.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.329+0000 7f6552ffd640 1 -- 10.20.193.58:0/2978681119 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6560004e20 con 0x7f656c15c4b0 2026-02-23T06:42:06.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.329+0000 7f6573544640 1 -- 10.20.193.58:0/2978681119 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f656c11b810 con 0x7f656c15c4b0 2026-02-23T06:42:06.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.330+0000 7f6573544640 1 -- 10.20.193.58:0/2978681119 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f656c0af4c0 con 0x7f656c15c4b0 2026-02-23T06:42:06.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.330+0000 7f6573544640 1 --2- 10.20.193.58:0/2978681119 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f656c13ce20 0x7f656c11f110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:06.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.330+0000 7f6573544640 1 -- 10.20.193.58:0/2978681119 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f656c059690 con 0x7f656c13ce20 2026-02-23T06:42:06.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.330+0000 7f6572542640 1 --2- 10.20.193.58:0/2978681119 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f656c13ce20 0x7f656c11f110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:06.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.330+0000 7f6572542640 1 -- 10.20.193.58:0/2978681119 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f656c0593b0 con 0x7f656c13ce20 2026-02-23T06:42:06.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.331+0000 7f6572542640 1 --2- 10.20.193.58:0/2978681119 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f656c13ce20 0x7f656c11f110 secure :-1 s=READY pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f655c002730 tx=0x7f655c00e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:06.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.331+0000 7f6552ffd640 1 -- 10.20.193.58:0/2978681119 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f655c005250 con 0x7f656c13ce20 2026-02-23T06:42:06.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.331+0000 7f6552ffd640 1 -- 10.20.193.58:0/2978681119 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f655c0053b0 con 0x7f656c13ce20 2026-02-23T06:42:06.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.331+0000 7f6552ffd640 1 -- 10.20.193.58:0/2978681119 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f656c13ce20 msgr2=0x7f656c11f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:06.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.331+0000 7f6552ffd640 1 --2- 10.20.193.58:0/2978681119 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f656c13ce20 0x7f656c11f110 secure :-1 s=READY pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f655c002730 tx=0x7f655c00e970 comp rx=0 tx=0).stop 2026-02-23T06:42:06.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.331+0000 7f6552ffd640 1 -- 10.20.193.58:0/2978681119 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f656c13ce20 msgr2=0x7f656c11f110 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:42:06.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.331+0000 7f6552ffd640 1 --2- 10.20.193.58:0/2978681119 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f656c13ce20 0x7f656c11f110 unknown :-1 s=CLOSED pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:06.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.331+0000 7f6552ffd640 1 -- 10.20.193.58:0/2978681119 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f6560004f80 con 0x7f656c15c4b0 2026-02-23T06:42:06.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.332+0000 7f6552ffd640 1 --2- 10.20.193.58:0/2978681119 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f653c07a3c0 0x7f653c09a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:06.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.332+0000 7f6552ffd640 1 -- 10.20.193.58:0/2978681119 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f65600c2b80 con 0x7f656c15c4b0 2026-02-23T06:42:06.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.332+0000 7f6572542640 1 --2- 10.20.193.58:0/2978681119 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f653c07a3c0 0x7f653c09a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:06.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.333+0000 7f6572542640 1 --2- 10.20.193.58:0/2978681119 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f653c07a3c0 0x7f653c09a870 secure :-1 s=READY pgs=458 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f655c0027a0 tx=0x7f655c014000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:06.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.335+0000 7f6573544640 1 --2- 10.20.193.58:0/2978681119 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f656c11f650 0x7f656c11fa20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:06.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.335+0000 7f6573544640 1 -- 10.20.193.58:0/2978681119 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f656c11ff60 con 0x7f656c11f650 2026-02-23T06:42:06.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.335+0000 7f6572d43640 1 --2- 10.20.193.58:0/2978681119 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f656c11f650 0x7f656c11fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:06.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.335+0000 7f6572d43640 1 -- 10.20.193.58:0/2978681119 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f656c0b71d0 con 0x7f656c11f650 2026-02-23T06:42:06.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.335+0000 7f6572d43640 1 --2- 10.20.193.58:0/2978681119 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f656c11f650 0x7f656c11fa20 secure :-1 s=READY pgs=48 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65680038b0 tx=0x7f656800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:06.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.336+0000 7f6552ffd640 1 -- 10.20.193.58:0/2978681119 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f65680060f0 con 0x7f656c11f650 2026-02-23T06:42:06.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.336+0000 7f6552ffd640 1 -- 10.20.193.58:0/2978681119 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5379 (secure 0 0 0) 0x7f6568006250 con 0x7f656c11f650 2026-02-23T06:42:06.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.336+0000 7f6552ffd640 1 -- 10.20.193.58:0/2978681119 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f656c11f650 msgr2=0x7f656c11fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:06.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.336+0000 7f6552ffd640 1 --2- 10.20.193.58:0/2978681119 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f656c11f650 0x7f656c11fa20 secure :-1 s=READY pgs=48 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65680038b0 tx=0x7f656800c8f0 comp rx=0 tx=0).stop 2026-02-23T06:42:06.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.336+0000 7f6552ffd640 1 -- 10.20.193.58:0/2978681119 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f656c11f650 msgr2=0x7f656c11fa20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:42:06.333 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:42:06.333 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:42:06.333 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:42:06.333 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:42:06.333 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 176, 2026-02-23T06:42:06.334 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 26456, 2026-02-23T06:42:06.334 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:42:06.334 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:42:06.334 INFO:teuthology.orchestra.run.trial058.stdout: 1 2026-02-23T06:42:06.334 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:06.334 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:42:06.334 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:42:06.334 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:42:06.334 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:42:06.334 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:06.334 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:06.335 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:06.335 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:06.335 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:06.335 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:06.335 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:06.335 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:06.335 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:06.335 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:06.335 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:06.335 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:06.335 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:06.336 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:06.336 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:42:06.336 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:42:06.336 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:06.336 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:06.336 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:06.336 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:06.336 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:06.336 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:06.336 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:06.337 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:06.337 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:06.337 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:06.337 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:06.337 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:06.337 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:06.337 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:06.338 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:06.338 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:42:06.338 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:42:06.338 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:42:06.338 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:42:06.338 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:42:06.339 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:42:06.339 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:42:06.339 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:42:06.339 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:42:06.339 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:42:06.339 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:42:06.339 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:42:06.339 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:42:06.339 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:42:06.340 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:42:06.340 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:42:06.340 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:42:06.340 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:06.340 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:06.340 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:06.341 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:06.341 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:06.341 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:06.341 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:06.341 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:06.341 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:06.341 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:06.341 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:06.341 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:06.341 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:06.341 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:06.342 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:42:06.342 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:06.342 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:42:06.342 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:06.342 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:42:06.342 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:42:06.342 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:06.342 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:06.342 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:06.342 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:06.342 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:42:06.342 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:06.343 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:06.343 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:06.343 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:06.343 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:42:06.343 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:06.343 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:06.343 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:06.343 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:06.343 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:42:06.343 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:42:06.343 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:06.343 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:06.343 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:42:06.344 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:06.344 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:06.344 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:06.344 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:42:06.344 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:42:06.344 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:06.344 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:06.344 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:06.344 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:06.344 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:42:06.344 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:06.344 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:06.345 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:06.345 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:06.345 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:42:06.345 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:06.345 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:06.345 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:06.345 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:06.345 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:42:06.345 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:42:06.345 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:06.345 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:06.346 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:42:06.346 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:06.346 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:06.346 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:06.346 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:42:06.346 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:42:06.346 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:06.346 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:06.346 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:06.346 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:06.346 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:42:06.346 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:06.347 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:06.347 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:06.347 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:06.347 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:42:06.347 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:06.347 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:06.347 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:06.347 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:06.347 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:42:06.347 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:42:06.347 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:06.347 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:06.347 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:42:06.348 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:06.348 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:06.348 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:06.348 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:06.348 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:42:06.348 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:42:06.348 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:06.348 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:06.348 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:06.348 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:42:06.348 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:06.348 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:06.349 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:42:06.349 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:06.349 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:06.349 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:06.349 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:42:06.349 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:06.349 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:06.349 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:42:06.349 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:06.349 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:06.349 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:06.349 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:42:06.349 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:06.350 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:06.350 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:42:06.350 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:06.350 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:42:06.350 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:42:06.350 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:42:06.350 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:06.350 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:06.350 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:06.350 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:06.350 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:42:06.350 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:06.351 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:06.351 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:06.351 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:42:06.351 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:42:06.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.336+0000 7f6552ffd640 1 --2- 10.20.193.58:0/2978681119 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f656c11f650 0x7f656c11fa20 unknown :-1 s=CLOSED pgs=48 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:06.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.336+0000 7f6573544640 1 -- 10.20.193.58:0/2978681119 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f653c07a3c0 msgr2=0x7f653c09a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:06.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.336+0000 7f6573544640 1 --2- 10.20.193.58:0/2978681119 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f653c07a3c0 0x7f653c09a870 secure :-1 s=READY pgs=458 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f655c0027a0 tx=0x7f655c014000 comp rx=0 tx=0).stop 2026-02-23T06:42:06.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.336+0000 7f6573544640 1 -- 10.20.193.58:0/2978681119 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f656c15c4b0 msgr2=0x7f656c145a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:06.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.336+0000 7f6573544640 1 --2- 10.20.193.58:0/2978681119 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f656c15c4b0 0x7f656c145a30 secure :-1 s=READY pgs=46 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65600023d0 tx=0x7f6560004680 comp rx=0 tx=0).stop 2026-02-23T06:42:06.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.336+0000 7f6572d43640 1 -- 10.20.193.58:0/2978681119 reap_dead start 2026-02-23T06:42:06.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.336+0000 7f6573544640 1 -- 10.20.193.58:0/2978681119 shutdown_connections 2026-02-23T06:42:06.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.336+0000 7f6573544640 1 --2- 10.20.193.58:0/2978681119 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f656c15c4b0 0x7f656c145a30 unknown :-1 s=CLOSED pgs=46 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:06.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.336+0000 7f6573544640 1 -- 10.20.193.58:0/2978681119 >> 10.20.193.58:0/2978681119 conn(0x7f656c0b3c20 msgr2=0x7f656c0b5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:06.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.336+0000 7f6573544640 1 -- 10.20.193.58:0/2978681119 shutdown_connections 2026-02-23T06:42:06.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.336+0000 7f6573544640 1 -- 10.20.193.58:0/2978681119 wait complete. 2026-02-23T06:42:06.354 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:42:06.354 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-23T06:42:06.355 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:42:06.474 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.479+0000 7fcd32883640 1 -- 10.20.193.58:0/331010376 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcd2c0b6690 msgr2=0x7fcd2c058ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:06.475 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.479+0000 7fcd32883640 1 --2- 10.20.193.58:0/331010376 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcd2c0b6690 0x7fcd2c058ec0 secure :-1 s=READY pgs=104 gs=2 cs=0 l=1 c_cookie=1380699400610820530 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd28006f50 tx=0x7fcd28030380 comp rx=0 tx=0).stop 2026-02-23T06:42:06.475 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.479+0000 7fcd32883640 1 -- 10.20.193.58:0/331010376 shutdown_connections 2026-02-23T06:42:06.475 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.479+0000 7fcd32883640 1 --2- 10.20.193.58:0/331010376 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcd2c0b6690 0x7fcd2c058ec0 unknown :-1 s=CLOSED pgs=104 gs=2 cs=0 l=1 c_cookie=1380699400610820530 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:06.475 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.479+0000 7fcd32883640 1 --2- 10.20.193.58:0/331010376 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcd2c15d4a0 0x7fcd2c0affb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:06.475 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.479+0000 7fcd32883640 1 -- 10.20.193.58:0/331010376 >> 10.20.193.58:0/331010376 conn(0x7fcd2c0b3c20 msgr2=0x7fcd2c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:06.475 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.479+0000 7fcd32883640 1 -- 10.20.193.58:0/331010376 shutdown_connections 2026-02-23T06:42:06.475 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.479+0000 7fcd32883640 1 -- 10.20.193.58:0/331010376 wait complete. 2026-02-23T06:42:06.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.480+0000 7fcd32883640 1 Processor -- start 2026-02-23T06:42:06.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.480+0000 7fcd32883640 1 -- start start 2026-02-23T06:42:06.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.481+0000 7fcd32883640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcd2c0b6690 0x7fcd2c1210c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:06.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.481+0000 7fcd32883640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcd2c15d4a0 0x7fcd2c0b7900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:06.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.481+0000 7fcd32883640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcd2c15d870 0x7fcd2c1220d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:06.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.481+0000 7fcd32883640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2c1206f0 con 0x7fcd2c15d870 2026-02-23T06:42:06.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.481+0000 7fcd32883640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2c121600 con 0x7fcd2c0b6690 2026-02-23T06:42:06.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.481+0000 7fcd32883640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fcd2c121c60 con 0x7fcd2c15d4a0 2026-02-23T06:42:06.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.481+0000 7fcd32082640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcd2c15d870 0x7fcd2c1220d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:06.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.481+0000 7fcd32082640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcd2c15d870 0x7fcd2c1220d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:34162/0 (socket says 10.20.193.58:34162) 2026-02-23T06:42:06.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.481+0000 7fcd32082640 1 -- 10.20.193.58:0/2687201850 learned_addr learned my addr 10.20.193.58:0/2687201850 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:42:06.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.481+0000 7fcd31080640 1 -- 10.20.193.58:0/2687201850 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcd2c15d4a0 msgr2=0x7fcd2c0b7900 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:42:06.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.481+0000 7fcd31080640 1 --2- 10.20.193.58:0/2687201850 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcd2c15d4a0 0x7fcd2c0b7900 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:42:06.479 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.481+0000 7fcd32082640 1 -- 10.20.193.58:0/2687201850 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcd2c15d4a0 msgr2=0x7fcd2c0b7900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:42:06.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.481+0000 7fcd32082640 1 --2- 10.20.193.58:0/2687201850 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcd2c15d4a0 0x7fcd2c0b7900 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:06.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.481+0000 7fcd32082640 1 -- 10.20.193.58:0/2687201850 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcd2c0b6690 msgr2=0x7fcd2c1210c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:06.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.481+0000 7fcd31881640 1 --2- 10.20.193.58:0/2687201850 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcd2c0b6690 0x7fcd2c1210c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:06.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.481+0000 7fcd32082640 1 --2- 10.20.193.58:0/2687201850 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcd2c0b6690 0x7fcd2c1210c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:06.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.481+0000 7fcd32082640 1 -- 10.20.193.58:0/2687201850 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd2800a650 con 0x7fcd2c15d870 2026-02-23T06:42:06.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.481+0000 7fcd31881640 1 --2- 10.20.193.58:0/2687201850 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcd2c0b6690 0x7fcd2c1210c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:42:06.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.482+0000 7fcd32082640 1 --2- 10.20.193.58:0/2687201850 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcd2c15d870 0x7fcd2c1220d0 secure :-1 s=READY pgs=50 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd2800a230 tx=0x7fcd28003d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:06.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.482+0000 7fcd1a7fc640 1 -- 10.20.193.58:0/2687201850 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd28045070 con 0x7fcd2c15d870 2026-02-23T06:42:06.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.482+0000 7fcd1a7fc640 1 -- 10.20.193.58:0/2687201850 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd28005b50 con 0x7fcd2c15d870 2026-02-23T06:42:06.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.482+0000 7fcd32883640 1 -- 10.20.193.58:0/2687201850 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd2c120150 con 0x7fcd2c15d870 2026-02-23T06:42:06.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.482+0000 7fcd32883640 1 -- 10.20.193.58:0/2687201850 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd2c120410 con 0x7fcd2c15d870 2026-02-23T06:42:06.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.482+0000 7fcd1a7fc640 1 -- 10.20.193.58:0/2687201850 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd28006020 con 0x7fcd2c15d870 2026-02-23T06:42:06.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.482+0000 7fcd32883640 1 --2- 10.20.193.58:0/2687201850 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcd2c1622e0 0x7fcd2c122610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:06.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.482+0000 7fcd32883640 1 -- 10.20.193.58:0/2687201850 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2c1626b0 con 0x7fcd2c1622e0 2026-02-23T06:42:06.481 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.483+0000 7fcd31881640 1 --2- 10.20.193.58:0/2687201850 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcd2c1622e0 0x7fcd2c122610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:06.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.483+0000 7fcd31881640 1 -- 10.20.193.58:0/2687201850 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcd2c0b6330 con 0x7fcd2c1622e0 2026-02-23T06:42:06.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.484+0000 7fcd1a7fc640 1 -- 10.20.193.58:0/2687201850 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fcd28006180 con 0x7fcd2c15d870 2026-02-23T06:42:06.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.484+0000 7fcd31881640 1 --2- 10.20.193.58:0/2687201850 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcd2c1622e0 0x7fcd2c122610 secure :-1 s=READY pgs=105 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd1c00c6f0 tx=0x7fcd1c00cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:06.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.484+0000 7fcd1a7fc640 1 --2- 10.20.193.58:0/2687201850 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fccfc07a5b0 0x7fccfc09aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:06.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.485+0000 7fcd1a7fc640 1 -- 10.20.193.58:0/2687201850 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fcd280c3f40 con 0x7fcd2c15d870 2026-02-23T06:42:06.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.485+0000 7fcd1a7fc640 1 -- 10.20.193.58:0/2687201850 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd1c002ac0 con 0x7fcd2c1622e0 2026-02-23T06:42:06.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.485+0000 7fcd1a7fc640 1 -- 10.20.193.58:0/2687201850 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fcd1c002c20 con 0x7fcd2c1622e0 2026-02-23T06:42:06.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.485+0000 7fcd1a7fc640 1 -- 10.20.193.58:0/2687201850 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcd2c1622e0 msgr2=0x7fcd2c122610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:06.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.485+0000 7fcd1a7fc640 1 --2- 10.20.193.58:0/2687201850 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcd2c1622e0 0x7fcd2c122610 secure :-1 s=READY pgs=105 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd1c00c6f0 tx=0x7fcd1c00cbc0 comp rx=0 tx=0).stop 2026-02-23T06:42:06.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.485+0000 7fcd1a7fc640 1 -- 10.20.193.58:0/2687201850 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcd2c1622e0 msgr2=0x7fcd2c122610 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:42:06.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.485+0000 7fcd1a7fc640 1 --2- 10.20.193.58:0/2687201850 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcd2c1622e0 0x7fcd2c122610 secure :-1 s=CLOSED pgs=105 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd1c00c6f0 tx=0x7fcd1c00cbc0 comp rx=0 tx=0).stop 2026-02-23T06:42:06.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.485+0000 7fcd31080640 1 --2- 10.20.193.58:0/2687201850 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fccfc07a5b0 0x7fccfc09aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:06.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.486+0000 7fcd31080640 1 --2- 10.20.193.58:0/2687201850 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fccfc07a5b0 0x7fccfc09aa60 secure :-1 s=READY pgs=459 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd2c0ae510 tx=0x7fcd200079e0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:06.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.488+0000 7fcd32883640 1 --2- 10.20.193.58:0/2687201850 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcd2c162ac0 0x7fcd2c13d240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:06.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.488+0000 7fcd32883640 1 -- 10.20.193.58:0/2687201850 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2c164250 con 0x7fcd2c162ac0 2026-02-23T06:42:06.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.488+0000 7fcd31881640 1 --2- 10.20.193.58:0/2687201850 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcd2c162ac0 0x7fcd2c13d240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:06.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.489+0000 7fcd31881640 1 -- 10.20.193.58:0/2687201850 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcd2c0b6d50 con 0x7fcd2c162ac0 2026-02-23T06:42:06.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.489+0000 7fcd31881640 1 --2- 10.20.193.58:0/2687201850 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcd2c162ac0 0x7fcd2c13d240 secure :-1 s=READY pgs=106 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd1c012000 tx=0x7fcd1c0048c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:06.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.489+0000 7fcd1a7fc640 1 -- 10.20.193.58:0/2687201850 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd1c021070 con 0x7fcd2c162ac0 2026-02-23T06:42:06.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.489+0000 7fcd1a7fc640 1 -- 10.20.193.58:0/2687201850 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5402 (secure 0 0 0) 0x7fcd1c007690 con 0x7fcd2c162ac0 2026-02-23T06:42:06.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.489+0000 7fcd1a7fc640 1 -- 10.20.193.58:0/2687201850 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcd2c162ac0 msgr2=0x7fcd2c13d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:06.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.489+0000 7fcd1a7fc640 1 --2- 10.20.193.58:0/2687201850 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcd2c162ac0 0x7fcd2c13d240 secure :-1 s=READY pgs=106 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd1c012000 tx=0x7fcd1c0048c0 comp rx=0 tx=0).stop 2026-02-23T06:42:06.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.489+0000 7fcd1a7fc640 1 -- 10.20.193.58:0/2687201850 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcd2c162ac0 msgr2=0x7fcd2c13d240 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:42:06.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.489+0000 7fcd1a7fc640 1 --2- 10.20.193.58:0/2687201850 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcd2c162ac0 0x7fcd2c13d240 secure :-1 s=CLOSED pgs=106 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd1c012000 tx=0x7fcd1c0048c0 comp rx=0 tx=0).stop 2026-02-23T06:42:06.486 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:42:06.486 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:42:06.486 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:42:06.487 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:42:06.487 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 176, 2026-02-23T06:42:06.487 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 130579, 2026-02-23T06:42:06.487 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:42:06.487 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:42:06.487 INFO:teuthology.orchestra.run.trial058.stdout: 1 2026-02-23T06:42:06.487 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:06.487 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:42:06.487 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:42:06.487 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:42:06.487 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:42:06.488 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:06.488 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:06.488 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:06.488 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:06.488 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:06.488 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:06.488 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:06.488 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:06.488 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:06.488 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:06.488 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:06.488 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:06.489 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:06.489 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:06.489 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:42:06.489 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:42:06.489 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:06.489 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:06.489 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:06.489 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:06.489 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:06.489 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:06.490 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:06.490 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:06.490 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:06.490 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:06.490 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:06.490 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:06.490 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:06.490 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:06.490 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:06.490 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:42:06.490 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:42:06.490 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:42:06.491 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:42:06.491 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:42:06.491 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:42:06.491 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:42:06.491 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:42:06.491 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:42:06.491 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:42:06.491 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:42:06.491 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:42:06.491 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:42:06.491 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:42:06.491 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:42:06.492 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:42:06.492 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:42:06.492 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:06.492 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:06.492 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:06.492 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:06.492 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:06.492 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:06.492 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:06.492 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:06.492 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:06.492 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:06.493 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:06.493 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:06.493 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:06.493 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:06.493 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:42:06.493 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:06.493 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:42:06.493 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:06.493 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:42:06.493 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:42:06.493 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:06.493 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:06.493 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:06.494 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:06.494 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:42:06.494 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:06.494 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:06.494 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:06.494 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:06.494 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:42:06.494 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:06.494 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:06.494 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:06.494 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:06.494 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:42:06.495 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:42:06.495 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:06.495 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:06.495 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:42:06.495 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:06.495 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:06.495 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:06.495 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:42:06.495 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:42:06.495 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:06.495 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:06.495 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:06.495 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:06.496 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:42:06.496 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:06.496 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:06.496 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:06.496 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:06.496 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:42:06.496 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:06.496 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:06.496 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:06.496 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:06.496 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:42:06.496 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:42:06.497 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:06.497 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:06.497 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:42:06.497 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:06.497 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:06.497 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:06.497 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:42:06.497 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:42:06.497 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:06.497 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:06.497 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:06.497 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:06.497 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:42:06.498 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:06.498 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:06.498 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:06.498 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:06.498 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:42:06.498 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:06.498 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:06.498 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:06.498 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:06.498 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:42:06.498 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:42:06.498 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:06.499 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:06.499 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:42:06.499 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:06.499 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:06.499 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:06.499 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:06.499 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:42:06.499 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:42:06.499 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:06.499 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:06.499 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:06.499 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:42:06.499 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:06.500 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:06.500 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:42:06.500 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:06.500 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:06.500 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:06.500 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:42:06.500 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:06.500 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:06.500 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:42:06.500 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:06.500 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:06.500 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:06.501 INFO:teuthology.orchestra.run.trial058.stdout: "num": 7 2026-02-23T06:42:06.501 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:06.501 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:06.501 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:42:06.501 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:06.501 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:06.501 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:06.501 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:42:06.501 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:06.501 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:06.501 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:42:06.501 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:06.502 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:06.502 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:06.502 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:42:06.502 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:06.502 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:06.502 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:06.502 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:42:06.502 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:42:06.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.490+0000 7fcd32883640 1 -- 10.20.193.58:0/2687201850 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fccfc07a5b0 msgr2=0x7fccfc09aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:06.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.490+0000 7fcd32883640 1 --2- 10.20.193.58:0/2687201850 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fccfc07a5b0 0x7fccfc09aa60 secure :-1 s=READY pgs=459 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd2c0ae510 tx=0x7fcd200079e0 comp rx=0 tx=0).stop 2026-02-23T06:42:06.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.490+0000 7fcd32883640 1 -- 10.20.193.58:0/2687201850 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcd2c15d870 msgr2=0x7fcd2c1220d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:06.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.490+0000 7fcd32883640 1 --2- 10.20.193.58:0/2687201850 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcd2c15d870 0x7fcd2c1220d0 secure :-1 s=READY pgs=50 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd2800a230 tx=0x7fcd28003d20 comp rx=0 tx=0).stop 2026-02-23T06:42:06.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.490+0000 7fcd32082640 1 -- 10.20.193.58:0/2687201850 reap_dead start 2026-02-23T06:42:06.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.490+0000 7fcd32082640 1 -- 10.20.193.58:0/2687201850 reap_dead start 2026-02-23T06:42:06.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.490+0000 7fcd32883640 1 -- 10.20.193.58:0/2687201850 shutdown_connections 2026-02-23T06:42:06.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.490+0000 7fcd32883640 1 -- 10.20.193.58:0/2687201850 >> 10.20.193.58:0/2687201850 conn(0x7fcd2c0b3c20 msgr2=0x7fcd2c13f930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:06.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.490+0000 7fcd32883640 1 -- 10.20.193.58:0/2687201850 shutdown_connections 2026-02-23T06:42:06.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:06.490+0000 7fcd32883640 1 -- 10.20.193.58:0/2687201850 wait complete. 2026-02-23T06:42:06.505 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:42:06.505 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:42:14.551 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:42:14.556 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:42:26.506 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-23T06:42:26.506 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-23T06:42:26.506 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-23T06:42:26.506 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-23T06:42:26.509 INFO:tasks.ceph.mon.c:Started 2026-02-23T06:42:26.509 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:42:26.509 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:42:26.632 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.637+0000 7f6816083640 1 -- 10.20.193.58:0/553304762 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f681005d370 msgr2=0x7f68100b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:26.632 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.637+0000 7f6816083640 1 --2- 10.20.193.58:0/553304762 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f681005d370 0x7f68100b5680 secure :-1 s=READY pgs=53 gs=2 cs=0 l=1 c_cookie=8427936099474616390 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f680c005820 tx=0x7f680c0302b0 comp rx=0 tx=0).stop 2026-02-23T06:42:26.632 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.637+0000 7f6816083640 1 -- 10.20.193.58:0/553304762 shutdown_connections 2026-02-23T06:42:26.632 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.637+0000 7f6816083640 1 --2- 10.20.193.58:0/553304762 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f681005d370 0x7f68100b5680 unknown :-1 s=CLOSED pgs=53 gs=2 cs=0 l=1 c_cookie=8427936099474616390 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:26.632 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.637+0000 7f6816083640 1 --2- 10.20.193.58:0/553304762 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6810056550 0x7f681005ce30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:26.632 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.637+0000 7f6816083640 1 -- 10.20.193.58:0/553304762 >> 10.20.193.58:0/553304762 conn(0x7f68100b3c20 msgr2=0x7f68100b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:26.632 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.637+0000 7f6816083640 1 -- 10.20.193.58:0/553304762 shutdown_connections 2026-02-23T06:42:26.632 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.637+0000 7f6816083640 1 -- 10.20.193.58:0/553304762 wait complete. 2026-02-23T06:42:26.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.638+0000 7f6816083640 1 Processor -- start 2026-02-23T06:42:26.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.638+0000 7f6816083640 1 -- start start 2026-02-23T06:42:26.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.638+0000 7f6816083640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6810056550 0x7f68101fd8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:26.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.639+0000 7f6816083640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f681005d370 0x7f6810153720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:26.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.639+0000 7f6816083640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f681015c040 0x7f6810162820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:26.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.639+0000 7f6816083640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f681015e780 con 0x7f681015c040 2026-02-23T06:42:26.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.639+0000 7f6816083640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f6810201ec0 con 0x7f681005d370 2026-02-23T06:42:26.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.639+0000 7f6816083640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f6810201380 con 0x7f6810056550 2026-02-23T06:42:26.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.639+0000 7f6815882640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f681015c040 0x7f6810162820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:26.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.639+0000 7f6814880640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f681005d370 0x7f6810153720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:26.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.639+0000 7f6815081640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6810056550 0x7f68101fd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:26.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.639+0000 7f6815882640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f681015c040 0x7f6810162820 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:32890/0 (socket says 10.20.193.58:32890) 2026-02-23T06:42:26.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.639+0000 7f6815882640 1 -- 10.20.193.58:0/1447015127 learned_addr learned my addr 10.20.193.58:0/1447015127 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:42:26.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.639+0000 7f6815081640 1 -- 10.20.193.58:0/1447015127 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6810056550 msgr2=0x7f68101fd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-23T06:42:26.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.639+0000 7f6815081640 1 -- 10.20.193.58:0/1447015127 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6810056550 msgr2=0x7f68101fd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:42:26.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.639+0000 7f6815081640 1 --2- 10.20.193.58:0/1447015127 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6810056550 0x7f68101fd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:42:26.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.639+0000 7f6815882640 1 -- 10.20.193.58:0/1447015127 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6810056550 msgr2=0x7f68101fd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:26.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.639+0000 7f6815081640 1 --2- 10.20.193.58:0/1447015127 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6810056550 0x7f68101fd8f0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:42:26.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.639+0000 7f6815882640 1 --2- 10.20.193.58:0/1447015127 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6810056550 0x7f68101fd8f0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:26.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.639+0000 7f6815882640 1 -- 10.20.193.58:0/1447015127 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f681005d370 msgr2=0x7f6810153720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:26.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.639+0000 7f6815882640 1 --2- 10.20.193.58:0/1447015127 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f681005d370 0x7f6810153720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:26.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.639+0000 7f6815882640 1 -- 10.20.193.58:0/1447015127 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f680c00a590 con 0x7f681015c040 2026-02-23T06:42:26.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.639+0000 7f6815882640 1 --2- 10.20.193.58:0/1447015127 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f681015c040 0x7f6810162820 secure :-1 s=READY pgs=54 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f680c003d00 tx=0x7f680c003d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:26.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.639+0000 7f67fdffb640 1 -- 10.20.193.58:0/1447015127 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f680c03e070 con 0x7f681015c040 2026-02-23T06:42:26.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.639+0000 7f67fdffb640 1 -- 10.20.193.58:0/1447015127 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f680c0398a0 con 0x7f681015c040 2026-02-23T06:42:26.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.639+0000 7f67fdffb640 1 -- 10.20.193.58:0/1447015127 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f680c039c30 con 0x7f681015c040 2026-02-23T06:42:26.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.639+0000 7f6816083640 1 -- 10.20.193.58:0/1447015127 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6810201620 con 0x7f681015c040 2026-02-23T06:42:26.634 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.640+0000 7f6816083640 1 -- 10.20.193.58:0/1447015127 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6810201be0 con 0x7f681015c040 2026-02-23T06:42:26.635 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.640+0000 7f6816083640 1 -- 10.20.193.58:0/1447015127 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f681005ce30 con 0x7f681015c040 2026-02-23T06:42:26.636 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.641+0000 7f67fdffb640 1 -- 10.20.193.58:0/1447015127 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f680c0413b0 con 0x7f681015c040 2026-02-23T06:42:26.637 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.642+0000 7f67fdffb640 1 --2- 10.20.193.58:0/1447015127 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f67e007a790 0x7f67e009ac40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:26.637 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.642+0000 7f67fdffb640 1 -- 10.20.193.58:0/1447015127 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f680c0c36d0 con 0x7f681015c040 2026-02-23T06:42:26.637 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.642+0000 7f6815081640 1 --2- 10.20.193.58:0/1447015127 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f67e007a790 0x7f67e009ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:26.638 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.643+0000 7f6815081640 1 --2- 10.20.193.58:0/1447015127 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f67e007a790 0x7f67e009ac40 secure :-1 s=READY pgs=461 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68000027d0 tx=0x7f6800009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:26.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.644+0000 7f67fdffb640 1 -- 10.20.193.58:0/1447015127 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f680c086990 con 0x7f681015c040 2026-02-23T06:42:26.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.799+0000 7f6816083640 1 -- 10.20.193.58:0/1447015127 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6810056330 con 0x7f681015c040 2026-02-23T06:42:26.795 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.800+0000 7f67fdffb640 1 -- 10.20.193.58:0/1447015127 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f680c089ab0 con 0x7f681015c040 2026-02-23T06:42:26.795 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":180,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:42:26.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.801+0000 7f6816083640 1 -- 10.20.193.58:0/1447015127 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f67e007a790 msgr2=0x7f67e009ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:26.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.801+0000 7f6816083640 1 --2- 10.20.193.58:0/1447015127 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f67e007a790 0x7f67e009ac40 secure :-1 s=READY pgs=461 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68000027d0 tx=0x7f6800009040 comp rx=0 tx=0).stop 2026-02-23T06:42:26.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.801+0000 7f6816083640 1 -- 10.20.193.58:0/1447015127 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f681015c040 msgr2=0x7f6810162820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:26.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.801+0000 7f6816083640 1 --2- 10.20.193.58:0/1447015127 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f681015c040 0x7f6810162820 secure :-1 s=READY pgs=54 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f680c003d00 tx=0x7f680c003d30 comp rx=0 tx=0).stop 2026-02-23T06:42:26.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.801+0000 7f6816083640 1 -- 10.20.193.58:0/1447015127 shutdown_connections 2026-02-23T06:42:26.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.801+0000 7f6816083640 1 --2- 10.20.193.58:0/1447015127 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f67e007a790 0x7f67e009ac40 unknown :-1 s=CLOSED pgs=461 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:26.797 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.801+0000 7f6816083640 1 --2- 10.20.193.58:0/1447015127 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f681015c040 0x7f6810162820 unknown :-1 s=CLOSED pgs=54 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:26.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.801+0000 7f6816083640 1 --2- 10.20.193.58:0/1447015127 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f681005d370 0x7f6810153720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:26.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.801+0000 7f6816083640 1 --2- 10.20.193.58:0/1447015127 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6810056550 0x7f68101fd8f0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:26.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.801+0000 7f6816083640 1 -- 10.20.193.58:0/1447015127 >> 10.20.193.58:0/1447015127 conn(0x7f68100b3c20 msgr2=0x7f68100b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:26.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.803+0000 7f6816083640 1 -- 10.20.193.58:0/1447015127 shutdown_connections 2026-02-23T06:42:26.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.803+0000 7f6816083640 1 -- 10.20.193.58:0/1447015127 wait complete. 2026-02-23T06:42:26.809 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:42:26.810 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:42:26.810 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:42:26.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.957+0000 7fb913bcd640 1 -- 10.20.193.58:0/3311639737 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb90c0b1910 msgr2=0x7fb90c0b6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:26.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.957+0000 7fb913bcd640 1 --2- 10.20.193.58:0/3311639737 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb90c0b1910 0x7fb90c0b6a00 secure :-1 s=READY pgs=111 gs=3 cs=0 l=1 c_cookie=3744333634529976605 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb90c0b1230 tx=0x7fb90002f310 comp rx=0 tx=0).stop 2026-02-23T06:42:26.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.957+0000 7fb913bcd640 1 -- 10.20.193.58:0/3311639737 shutdown_connections 2026-02-23T06:42:26.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.957+0000 7fb913bcd640 1 --2- 10.20.193.58:0/3311639737 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb90c0b1910 0x7fb90c0b6a00 unknown :-1 s=CLOSED pgs=111 gs=3 cs=0 l=1 c_cookie=3744333634529976605 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:26.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.957+0000 7fb913bcd640 1 --2- 10.20.193.58:0/3311639737 >> v2:10.20.193.58:3300/0 conn(0x7fb90c0b1540 0x7fb90c0b5610 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:26.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.957+0000 7fb913bcd640 1 -- 10.20.193.58:0/3311639737 >> 10.20.193.58:0/3311639737 conn(0x7fb90c058e50 msgr2=0x7fb90c059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:26.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.958+0000 7fb913bcd640 1 -- 10.20.193.58:0/3311639737 shutdown_connections 2026-02-23T06:42:26.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.958+0000 7fb913bcd640 1 -- 10.20.193.58:0/3311639737 wait complete. 2026-02-23T06:42:26.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.959+0000 7fb913bcd640 1 Processor -- start 2026-02-23T06:42:26.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.959+0000 7fb913bcd640 1 -- start start 2026-02-23T06:42:26.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.960+0000 7fb913bcd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb90c0b1540 0x7fb90c12ef50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:26.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.960+0000 7fb913bcd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb90c0b1910 0x7fb90c05c360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:26.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.960+0000 7fb911942640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb90c0b1540 0x7fb90c12ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:26.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.960+0000 7fb911942640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb90c0b1540 0x7fb90c12ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:52824/0 (socket says 10.20.193.58:52824) 2026-02-23T06:42:26.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.961+0000 7fb911942640 1 -- 10.20.193.58:0/912503431 learned_addr learned my addr 10.20.193.58:0/912503431 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:42:26.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.961+0000 7fb911141640 1 --2- 10.20.193.58:0/912503431 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb90c0b1910 0x7fb90c05c360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:26.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.961+0000 7fb913bcd640 1 --2- 10.20.193.58:0/912503431 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb90c0b39f0 0x7fb90c05b2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:26.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.961+0000 7fb912143640 1 --2- 10.20.193.58:0/912503431 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb90c0b39f0 0x7fb90c05b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:26.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.961+0000 7fb913bcd640 1 -- 10.20.193.58:0/912503431 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb90c12e230 con 0x7fb90c0b39f0 2026-02-23T06:42:26.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.961+0000 7fb913bcd640 1 -- 10.20.193.58:0/912503431 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb90c05d6e0 con 0x7fb90c0b1910 2026-02-23T06:42:26.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.961+0000 7fb913bcd640 1 -- 10.20.193.58:0/912503431 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb90c12e720 con 0x7fb90c0b1540 2026-02-23T06:42:26.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.963+0000 7fb911942640 1 -- 10.20.193.58:0/912503431 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb90c0b1540 msgr2=0x7fb90c12ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-23T06:42:26.959 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.963+0000 7fb911942640 1 -- 10.20.193.58:0/912503431 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb90c0b1540 msgr2=0x7fb90c12ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:42:26.959 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.963+0000 7fb911942640 1 --2- 10.20.193.58:0/912503431 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb90c0b1540 0x7fb90c12ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:42:26.959 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.963+0000 7fb911942640 1 --2- 10.20.193.58:0/912503431 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb90c0b1540 0x7fb90c12ef50 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:42:26.959 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.963+0000 7fb912143640 1 -- 10.20.193.58:0/912503431 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb90c0b1540 msgr2=0x7fb90c12ef50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:42:26.959 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.963+0000 7fb912143640 1 --2- 10.20.193.58:0/912503431 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb90c0b1540 0x7fb90c12ef50 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:26.959 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.963+0000 7fb912143640 1 -- 10.20.193.58:0/912503431 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb90c0b1910 msgr2=0x7fb90c05c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:26.959 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.963+0000 7fb912143640 1 --2- 10.20.193.58:0/912503431 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb90c0b1910 0x7fb90c05c360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:26.959 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.963+0000 7fb912143640 1 -- 10.20.193.58:0/912503431 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb900009570 con 0x7fb90c0b39f0 2026-02-23T06:42:26.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.963+0000 7fb912143640 1 --2- 10.20.193.58:0/912503431 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb90c0b39f0 0x7fb90c05b2d0 secure :-1 s=READY pgs=56 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb908008fd0 tx=0x7fb90800d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:26.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.964+0000 7fb8fa7fc640 1 -- 10.20.193.58:0/912503431 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9080064a0 con 0x7fb90c0b39f0 2026-02-23T06:42:26.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.964+0000 7fb8fa7fc640 1 -- 10.20.193.58:0/912503431 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb908004790 con 0x7fb90c0b39f0 2026-02-23T06:42:26.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.964+0000 7fb8fa7fc640 1 -- 10.20.193.58:0/912503431 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb908004b80 con 0x7fb90c0b39f0 2026-02-23T06:42:26.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.964+0000 7fb913bcd640 1 -- 10.20.193.58:0/912503431 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb90c12eba0 con 0x7fb90c0b39f0 2026-02-23T06:42:26.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.964+0000 7fb913bcd640 1 -- 10.20.193.58:0/912503431 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb90c05d370 con 0x7fb90c0b39f0 2026-02-23T06:42:26.961 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.965+0000 7fb913bcd640 1 --2- 10.20.193.58:0/912503431 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb90c05c8a0 0x7fb90c05b810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:26.961 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.965+0000 7fb913bcd640 1 -- 10.20.193.58:0/912503431 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb90c060aa0 con 0x7fb90c05c8a0 2026-02-23T06:42:26.962 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.966+0000 7fb911942640 1 --2- 10.20.193.58:0/912503431 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb90c05c8a0 0x7fb90c05b810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:26.962 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.966+0000 7fb8fa7fc640 1 -- 10.20.193.58:0/912503431 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fb908004ce0 con 0x7fb90c0b39f0 2026-02-23T06:42:26.962 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.967+0000 7fb911942640 1 -- 10.20.193.58:0/912503431 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb90c166010 con 0x7fb90c05c8a0 2026-02-23T06:42:26.962 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.967+0000 7fb8fa7fc640 1 --2- 10.20.193.58:0/912503431 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb8e807a6c0 0x7fb8e809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:26.962 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.967+0000 7fb8fa7fc640 1 -- 10.20.193.58:0/912503431 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fb90809dc50 con 0x7fb90c0b39f0 2026-02-23T06:42:26.963 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.967+0000 7fb911942640 1 --2- 10.20.193.58:0/912503431 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb90c05c8a0 0x7fb90c05b810 secure :-1 s=READY pgs=57 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8fc00b2c0 tx=0x7fb8fc00fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:26.963 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.967+0000 7fb8fa7fc640 1 -- 10.20.193.58:0/912503431 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8fc00bb60 con 0x7fb90c05c8a0 2026-02-23T06:42:26.963 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.967+0000 7fb8fa7fc640 1 -- 10.20.193.58:0/912503431 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fb8fc00bcc0 con 0x7fb90c05c8a0 2026-02-23T06:42:26.964 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.967+0000 7fb8fa7fc640 1 -- 10.20.193.58:0/912503431 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb90c05c8a0 msgr2=0x7fb90c05b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:26.964 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.967+0000 7fb8fa7fc640 1 --2- 10.20.193.58:0/912503431 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb90c05c8a0 0x7fb90c05b810 secure :-1 s=READY pgs=57 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8fc00b2c0 tx=0x7fb8fc00fda0 comp rx=0 tx=0).stop 2026-02-23T06:42:26.964 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.967+0000 7fb8fa7fc640 1 -- 10.20.193.58:0/912503431 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb90c05c8a0 msgr2=0x7fb90c05b810 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:42:26.965 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.967+0000 7fb8fa7fc640 1 --2- 10.20.193.58:0/912503431 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb90c05c8a0 0x7fb90c05b810 secure :-1 s=CLOSED pgs=57 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8fc00b2c0 tx=0x7fb8fc00fda0 comp rx=0 tx=0).stop 2026-02-23T06:42:26.965 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.969+0000 7fb911141640 1 --2- 10.20.193.58:0/912503431 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb8e807a6c0 0x7fb8e809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:26.966 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.971+0000 7fb913bcd640 1 --2- 10.20.193.58:0/912503431 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb90c0ae600 0x7fb90c130c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:26.966 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.971+0000 7fb913bcd640 1 -- 10.20.193.58:0/912503431 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb90c0ae9d0 con 0x7fb90c0ae600 2026-02-23T06:42:26.967 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.972+0000 7fb911942640 1 --2- 10.20.193.58:0/912503431 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb90c0ae600 0x7fb90c130c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:26.967 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.972+0000 7fb911942640 1 -- 10.20.193.58:0/912503431 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb90c15f7e0 con 0x7fb90c0ae600 2026-02-23T06:42:26.967 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.972+0000 7fb911141640 1 --2- 10.20.193.58:0/912503431 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb8e807a6c0 0x7fb8e809ab70 secure :-1 s=READY pgs=462 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9000098a0 tx=0x7fb90003a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:26.967 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.972+0000 7fb911942640 1 --2- 10.20.193.58:0/912503431 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb90c0ae600 0x7fb90c130c50 secure :-1 s=READY pgs=58 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8fc015000 tx=0x7fb8fc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:26.967 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.973+0000 7fb8fa7fc640 1 -- 10.20.193.58:0/912503431 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8fc00bb60 con 0x7fb90c0ae600 2026-02-23T06:42:26.967 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.973+0000 7fb8fa7fc640 1 -- 10.20.193.58:0/912503431 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5390 (secure 0 0 0) 0x7fb8fc004850 con 0x7fb90c0ae600 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.973+0000 7fb8fa7fc640 1 -- 10.20.193.58:0/912503431 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb90c0ae600 msgr2=0x7fb90c130c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.973+0000 7fb8fa7fc640 1 --2- 10.20.193.58:0/912503431 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb90c0ae600 0x7fb90c130c50 secure :-1 s=READY pgs=58 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8fc015000 tx=0x7fb8fc004770 comp rx=0 tx=0).stop 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.973+0000 7fb8fa7fc640 1 -- 10.20.193.58:0/912503431 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb90c0ae600 msgr2=0x7fb90c130c50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.973+0000 7fb8fa7fc640 1 --2- 10.20.193.58:0/912503431 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb90c0ae600 0x7fb90c130c50 unknown :-1 s=CLOSED pgs=58 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 180, 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 47093, 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:26.968 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:26.969 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:26.970 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:42:26.971 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.973+0000 7fb913bcd640 1 -- 10.20.193.58:0/912503431 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb8e807a6c0 msgr2=0x7fb8e809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:26.972 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.973+0000 7fb913bcd640 1 --2- 10.20.193.58:0/912503431 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb8e807a6c0 0x7fb8e809ab70 secure :-1 s=READY pgs=462 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9000098a0 tx=0x7fb90003a040 comp rx=0 tx=0).stop 2026-02-23T06:42:26.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.973+0000 7fb913bcd640 1 -- 10.20.193.58:0/912503431 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb90c0b39f0 msgr2=0x7fb90c05b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:26.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.973+0000 7fb913bcd640 1 --2- 10.20.193.58:0/912503431 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb90c0b39f0 0x7fb90c05b2d0 secure :-1 s=READY pgs=56 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb908008fd0 tx=0x7fb90800d950 comp rx=0 tx=0).stop 2026-02-23T06:42:26.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.973+0000 7fb912143640 1 -- 10.20.193.58:0/912503431 reap_dead start 2026-02-23T06:42:26.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.973+0000 7fb912143640 1 -- 10.20.193.58:0/912503431 reap_dead start 2026-02-23T06:42:26.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.973+0000 7fb913bcd640 1 -- 10.20.193.58:0/912503431 shutdown_connections 2026-02-23T06:42:26.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.973+0000 7fb913bcd640 1 -- 10.20.193.58:0/912503431 >> 10.20.193.58:0/912503431 conn(0x7fb90c058e50 msgr2=0x7fb90c164550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:26.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.974+0000 7fb913bcd640 1 -- 10.20.193.58:0/912503431 shutdown_connections 2026-02-23T06:42:26.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:26.974+0000 7fb913bcd640 1 -- 10.20.193.58:0/912503431 wait complete. 2026-02-23T06:42:26.980 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:42:26.980 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:42:26.980 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:42:27.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.108+0000 7fbf2d57e640 1 -- 10.20.193.58:0/3654650283 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf0c003ad0 msgr2=0x7fbf0c003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:27.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.108+0000 7fbf2d57e640 1 --2- 10.20.193.58:0/3654650283 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf0c003ad0 0x7fbf0c003ee0 secure :-1 s=READY pgs=60 gs=5 cs=0 l=1 c_cookie=15680460973835068763 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf1400bad0 tx=0x7fbf1402f700 comp rx=0 tx=0).stop 2026-02-23T06:42:27.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.108+0000 7fbf2cd7d640 1 -- 10.20.193.58:0/3654650283 reap_dead start 2026-02-23T06:42:27.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.108+0000 7fbf2d57e640 1 -- 10.20.193.58:0/3654650283 shutdown_connections 2026-02-23T06:42:27.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.108+0000 7fbf2d57e640 1 -- 10.20.193.58:0/3654650283 >> 10.20.193.58:0/3654650283 conn(0x7fbf280b3c20 msgr2=0x7fbf280b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:27.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.108+0000 7fbf2d57e640 1 -- 10.20.193.58:0/3654650283 shutdown_connections 2026-02-23T06:42:27.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.108+0000 7fbf2d57e640 1 -- 10.20.193.58:0/3654650283 wait complete. 2026-02-23T06:42:27.108 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.110+0000 7fbf2d57e640 1 Processor -- start 2026-02-23T06:42:27.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.110+0000 7fbf2d57e640 1 -- start start 2026-02-23T06:42:27.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.110+0000 7fbf2d57e640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf0c003ad0 0x7fbf281627e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:27.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.110+0000 7fbf2d57e640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbf281606f0 0x7fbf28058810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:27.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.110+0000 7fbf2d57e640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf28160bd0 0x7fbf280aeab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:27.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.110+0000 7fbf2d57e640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fbf280b06b0 con 0x7fbf0c003ad0 2026-02-23T06:42:27.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.110+0000 7fbf2d57e640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fbf281604e0 con 0x7fbf28160bd0 2026-02-23T06:42:27.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.110+0000 7fbf2d57e640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fbf28146a20 con 0x7fbf281606f0 2026-02-23T06:42:27.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.110+0000 7fbf27fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf0c003ad0 0x7fbf281627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:27.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.110+0000 7fbf27fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf0c003ad0 0x7fbf281627e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:32950/0 (socket says 10.20.193.58:32950) 2026-02-23T06:42:27.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.110+0000 7fbf27fff640 1 -- 10.20.193.58:0/3380059970 learned_addr learned my addr 10.20.193.58:0/3380059970 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:42:27.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.111+0000 7fbf27fff640 1 -- 10.20.193.58:0/3380059970 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbf281606f0 msgr2=0x7fbf28058810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:27.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.111+0000 7fbf27fff640 1 --2- 10.20.193.58:0/3380059970 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbf281606f0 0x7fbf28058810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:27.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.111+0000 7fbf27fff640 1 -- 10.20.193.58:0/3380059970 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf28160bd0 msgr2=0x7fbf280aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:27.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.111+0000 7fbf2cd7d640 1 --2- 10.20.193.58:0/3380059970 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf28160bd0 0x7fbf280aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:27.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.111+0000 7fbf27fff640 1 --2- 10.20.193.58:0/3380059970 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf28160bd0 0x7fbf280aeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:27.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.111+0000 7fbf27fff640 1 -- 10.20.193.58:0/3380059970 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf280b00f0 con 0x7fbf0c003ad0 2026-02-23T06:42:27.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.111+0000 7fbf2cd7d640 1 --2- 10.20.193.58:0/3380059970 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf28160bd0 0x7fbf280aeab0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:42:27.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.111+0000 7fbf27fff640 1 --2- 10.20.193.58:0/3380059970 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf0c003ad0 0x7fbf281627e0 secure :-1 s=READY pgs=61 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf1400b580 tx=0x7fbf14004b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:27.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.111+0000 7fbf24ff9640 1 -- 10.20.193.58:0/3380059970 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf140028c0 con 0x7fbf0c003ad0 2026-02-23T06:42:27.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.111+0000 7fbf24ff9640 1 -- 10.20.193.58:0/3380059970 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf14002b30 con 0x7fbf0c003ad0 2026-02-23T06:42:27.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.111+0000 7fbf24ff9640 1 -- 10.20.193.58:0/3380059970 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf14004f00 con 0x7fbf0c003ad0 2026-02-23T06:42:27.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.111+0000 7fbf2d57e640 1 -- 10.20.193.58:0/3380059970 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf280b03d0 con 0x7fbf0c003ad0 2026-02-23T06:42:27.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.111+0000 7fbf2d57e640 1 -- 10.20.193.58:0/3380059970 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf28059210 con 0x7fbf0c003ad0 2026-02-23T06:42:27.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.112+0000 7fbf2d57e640 1 --2- 10.20.193.58:0/3380059970 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf28160fa0 0x7fbf2812f060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:27.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.112+0000 7fbf2d57e640 1 -- 10.20.193.58:0/3380059970 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fbf280b0560 con 0x7fbf28160fa0 2026-02-23T06:42:27.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.112+0000 7fbf277fe640 1 --2- 10.20.193.58:0/3380059970 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf28160fa0 0x7fbf2812f060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:27.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.113+0000 7fbf277fe640 1 -- 10.20.193.58:0/3380059970 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbf2805d9c0 con 0x7fbf28160fa0 2026-02-23T06:42:27.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.113+0000 7fbf277fe640 1 --2- 10.20.193.58:0/3380059970 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf28160fa0 0x7fbf2812f060 secure :-1 s=READY pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf28059aa0 tx=0x7fbf1800c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:27.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.113+0000 7fbf24ff9640 1 -- 10.20.193.58:0/3380059970 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fbf1403e040 con 0x7fbf0c003ad0 2026-02-23T06:42:27.112 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.114+0000 7fbf24ff9640 1 --2- 10.20.193.58:0/3380059970 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbef807a600 0x7fbef809aab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:27.112 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.114+0000 7fbf24ff9640 1 -- 10.20.193.58:0/3380059970 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fbf140c3270 con 0x7fbf0c003ad0 2026-02-23T06:42:27.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.114+0000 7fbf24ff9640 1 -- 10.20.193.58:0/3380059970 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf180052e0 con 0x7fbf28160fa0 2026-02-23T06:42:27.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.114+0000 7fbf24ff9640 1 -- 10.20.193.58:0/3380059970 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fbf18005440 con 0x7fbf28160fa0 2026-02-23T06:42:27.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.114+0000 7fbf24ff9640 1 -- 10.20.193.58:0/3380059970 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf28160fa0 msgr2=0x7fbf2812f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:27.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.114+0000 7fbf24ff9640 1 --2- 10.20.193.58:0/3380059970 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf28160fa0 0x7fbf2812f060 secure :-1 s=READY pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf28059aa0 tx=0x7fbf1800c820 comp rx=0 tx=0).stop 2026-02-23T06:42:27.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.114+0000 7fbf24ff9640 1 -- 10.20.193.58:0/3380059970 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf28160fa0 msgr2=0x7fbf2812f060 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:42:27.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.114+0000 7fbf24ff9640 1 --2- 10.20.193.58:0/3380059970 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf28160fa0 0x7fbf2812f060 secure :-1 s=CLOSED pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf28059aa0 tx=0x7fbf1800c820 comp rx=0 tx=0).stop 2026-02-23T06:42:27.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.114+0000 7fbf2cd7d640 1 --2- 10.20.193.58:0/3380059970 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbef807a600 0x7fbef809aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:27.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.115+0000 7fbf2cd7d640 1 --2- 10.20.193.58:0/3380059970 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbef807a600 0x7fbef809aab0 secure :-1 s=READY pgs=463 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf1c0039c0 tx=0x7fbf28056b50 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:27.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.118+0000 7fbf2d57e640 1 --2- 10.20.193.58:0/3380059970 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf2812f5a0 0x7fbf2812f970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:27.115 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.118+0000 7fbf2d57e640 1 -- 10.20.193.58:0/3380059970 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2815c410 con 0x7fbf2812f5a0 2026-02-23T06:42:27.115 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.118+0000 7fbf277fe640 1 --2- 10.20.193.58:0/3380059970 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf2812f5a0 0x7fbf2812f970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:27.115 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.119+0000 7fbf277fe640 1 -- 10.20.193.58:0/3380059970 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbf2805d540 con 0x7fbf2812f5a0 2026-02-23T06:42:27.115 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.119+0000 7fbf277fe640 1 --2- 10.20.193.58:0/3380059970 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf2812f5a0 0x7fbf2812f970 secure :-1 s=READY pgs=114 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf18002780 tx=0x7fbf18002960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:27.115 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.119+0000 7fbf24ff9640 1 -- 10.20.193.58:0/3380059970 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf18020070 con 0x7fbf2812f5a0 2026-02-23T06:42:27.115 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.120+0000 7fbf24ff9640 1 -- 10.20.193.58:0/3380059970 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5413 (secure 0 0 0) 0x7fbf18019680 con 0x7fbf2812f5a0 2026-02-23T06:42:27.115 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:42:27.116 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:42:27.116 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:42:27.116 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:42:27.116 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 180, 2026-02-23T06:42:27.116 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 151209, 2026-02-23T06:42:27.116 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:42:27.116 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:42:27.116 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:42:27.116 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:42:27.116 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:27.117 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:42:27.117 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:42:27.117 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:42:27.117 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:42:27.117 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:27.117 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:27.117 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:27.117 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:27.117 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:27.117 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:27.117 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:27.117 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:27.118 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:27.118 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:27.118 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:27.118 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:27.118 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:27.118 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:27.118 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:42:27.118 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:42:27.118 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:27.118 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:27.118 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:27.118 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:27.119 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:27.119 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:27.119 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:27.119 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:27.119 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:27.119 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:27.119 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:27.119 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:27.119 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:27.119 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:27.119 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:27.119 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:42:27.120 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:42:27.120 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:42:27.120 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:42:27.120 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:42:27.120 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:42:27.120 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:42:27.120 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:42:27.120 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:42:27.120 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:42:27.120 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:42:27.120 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:42:27.120 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:42:27.121 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:42:27.121 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:42:27.121 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:42:27.121 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:42:27.121 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:27.121 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:27.121 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:27.121 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:27.121 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:27.121 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:27.121 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:27.121 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:27.121 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:27.122 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:27.122 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:27.122 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:27.122 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:27.122 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:27.122 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:42:27.122 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:27.122 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:42:27.122 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:27.122 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:42:27.122 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:42:27.122 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:27.123 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:27.123 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:27.123 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:27.123 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:42:27.123 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:27.123 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:27.123 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:27.123 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:27.123 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:42:27.123 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:27.123 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:27.123 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:27.124 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:27.124 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:42:27.124 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:42:27.124 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:27.124 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:27.124 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:42:27.124 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:27.124 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:27.124 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:27.124 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:42:27.125 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:42:27.125 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:27.125 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:27.125 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:27.125 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:27.125 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:42:27.125 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:27.126 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:27.126 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:27.126 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:27.126 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:42:27.126 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:27.126 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:27.126 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:27.126 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:27.126 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:42:27.127 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:42:27.127 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:27.127 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:27.127 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:42:27.127 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:27.127 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:27.127 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:27.127 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:42:27.127 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:42:27.127 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:27.127 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:27.127 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:27.128 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:27.128 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:42:27.128 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:27.128 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:27.128 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:27.128 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:27.128 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:42:27.128 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:27.128 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:27.128 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:27.128 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:27.128 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:42:27.128 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:42:27.129 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:27.129 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:27.129 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:42:27.129 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:27.129 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:27.129 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:27.129 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:27.129 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:42:27.129 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:42:27.129 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:27.129 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:27.129 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:27.130 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:42:27.130 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:27.130 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:27.130 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:42:27.130 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:27.130 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:27.130 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:27.130 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:42:27.130 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:27.130 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:27.130 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:42:27.130 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:27.130 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:27.131 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:27.131 INFO:teuthology.orchestra.run.trial058.stdout: "num": 7 2026-02-23T06:42:27.131 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:27.131 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:27.131 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:42:27.131 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:27.131 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:27.131 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:27.131 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:42:27.131 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:27.131 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:27.131 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:42:27.131 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:27.132 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:27.132 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:27.132 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:42:27.132 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:27.132 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:27.132 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:27.132 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:42:27.132 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:42:27.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.120+0000 7fbf24ff9640 1 -- 10.20.193.58:0/3380059970 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf2812f5a0 msgr2=0x7fbf2812f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:27.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.120+0000 7fbf24ff9640 1 --2- 10.20.193.58:0/3380059970 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf2812f5a0 0x7fbf2812f970 secure :-1 s=READY pgs=114 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf18002780 tx=0x7fbf18002960 comp rx=0 tx=0).stop 2026-02-23T06:42:27.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.120+0000 7fbf24ff9640 1 -- 10.20.193.58:0/3380059970 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf2812f5a0 msgr2=0x7fbf2812f970 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:42:27.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.120+0000 7fbf24ff9640 1 --2- 10.20.193.58:0/3380059970 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbf2812f5a0 0x7fbf2812f970 unknown :-1 s=CLOSED pgs=114 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:27.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.120+0000 7fbf2d57e640 1 -- 10.20.193.58:0/3380059970 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbef807a600 msgr2=0x7fbef809aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:27.134 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.120+0000 7fbf2d57e640 1 --2- 10.20.193.58:0/3380059970 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbef807a600 0x7fbef809aab0 secure :-1 s=READY pgs=463 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf1c0039c0 tx=0x7fbf28056b50 comp rx=0 tx=0).stop 2026-02-23T06:42:27.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.120+0000 7fbf2d57e640 1 -- 10.20.193.58:0/3380059970 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf0c003ad0 msgr2=0x7fbf281627e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:27.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.120+0000 7fbf2d57e640 1 --2- 10.20.193.58:0/3380059970 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbf0c003ad0 0x7fbf281627e0 secure :-1 s=READY pgs=61 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf1400b580 tx=0x7fbf14004b00 comp rx=0 tx=0).stop 2026-02-23T06:42:27.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.120+0000 7fbf2cd7d640 1 -- 10.20.193.58:0/3380059970 reap_dead start 2026-02-23T06:42:27.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.120+0000 7fbf2cd7d640 1 -- 10.20.193.58:0/3380059970 reap_dead start 2026-02-23T06:42:27.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.120+0000 7fbf2d57e640 1 -- 10.20.193.58:0/3380059970 shutdown_connections 2026-02-23T06:42:27.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.120+0000 7fbf2d57e640 1 -- 10.20.193.58:0/3380059970 >> 10.20.193.58:0/3380059970 conn(0x7fbf280b3c20 msgr2=0x7fbf280b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:27.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.120+0000 7fbf2d57e640 1 -- 10.20.193.58:0/3380059970 shutdown_connections 2026-02-23T06:42:27.135 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.120+0000 7fbf2d57e640 1 -- 10.20.193.58:0/3380059970 wait complete. 2026-02-23T06:42:27.136 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:42:27.136 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:42:27.136 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:42:27.259 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.264+0000 7f54a2c83640 1 -- 10.20.193.58:0/1706118798 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5484004d90 msgr2=0x7f5484005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:27.259 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.264+0000 7f54a2c83640 1 --2- 10.20.193.58:0/1706118798 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5484004d90 0x7f5484005200 secure :-1 s=READY pgs=63 gs=6 cs=0 l=1 c_cookie=115030732921976341 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f549800cbb0 tx=0x7f54980307d0 comp rx=0 tx=0).stop 2026-02-23T06:42:27.259 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.264+0000 7f54a2482640 1 -- 10.20.193.58:0/1706118798 reap_dead start 2026-02-23T06:42:27.259 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.264+0000 7f54a2c83640 1 -- 10.20.193.58:0/1706118798 shutdown_connections 2026-02-23T06:42:27.259 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.264+0000 7f54a2c83640 1 -- 10.20.193.58:0/1706118798 >> 10.20.193.58:0/1706118798 conn(0x7f549c0b3c20 msgr2=0x7f549c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:27.259 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.264+0000 7f54a2c83640 1 -- 10.20.193.58:0/1706118798 shutdown_connections 2026-02-23T06:42:27.259 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.264+0000 7f54a2c83640 1 -- 10.20.193.58:0/1706118798 wait complete. 2026-02-23T06:42:27.260 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.266+0000 7f54a2c83640 1 Processor -- start 2026-02-23T06:42:27.260 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.266+0000 7f54a2c83640 1 -- start start 2026-02-23T06:42:27.261 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.266+0000 7f54a2c83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5484004d90 0x7f549c0561f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:27.261 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.266+0000 7f54a2c83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f549c160100 0x7f549c1624f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:27.261 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.266+0000 7f54a2c83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c0573d0 0x7f549c159160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:27.261 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.266+0000 7f54a2c83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f549c15e560 con 0x7f5484004d90 2026-02-23T06:42:27.261 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.266+0000 7f54a2c83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f549c15fa00 con 0x7f549c160100 2026-02-23T06:42:27.261 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.266+0000 7f54a2c83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f549c15fc70 con 0x7f549c0573d0 2026-02-23T06:42:27.261 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.267+0000 7f54a1c81640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5484004d90 0x7f549c0561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:27.261 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.267+0000 7f54a1c81640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5484004d90 0x7f549c0561f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:32970/0 (socket says 10.20.193.58:32970) 2026-02-23T06:42:27.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.267+0000 7f54a1c81640 1 -- 10.20.193.58:0/1715789711 learned_addr learned my addr 10.20.193.58:0/1715789711 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:42:27.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.267+0000 7f54a2482640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c0573d0 0x7f549c159160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:27.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.267+0000 7f54a1c81640 1 -- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c0573d0 msgr2=0x7f549c159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:27.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.267+0000 7f54a1c81640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c0573d0 0x7f549c159160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:27.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.267+0000 7f54a1c81640 1 -- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f549c160100 msgr2=0x7f549c1624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:27.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.267+0000 7f54a1c81640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f549c160100 0x7f549c1624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:27.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.267+0000 7f54a1c81640 1 -- 10.20.193.58:0/1715789711 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f549c056730 con 0x7f5484004d90 2026-02-23T06:42:27.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.267+0000 7f54a1c81640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5484004d90 0x7f549c0561f0 secure :-1 s=READY pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f548c00d5b0 tx=0x7f548c00da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:27.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.267+0000 7f548a7fc640 1 -- 10.20.193.58:0/1715789711 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f548c00f8a0 con 0x7f5484004d90 2026-02-23T06:42:27.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.267+0000 7f548a7fc640 1 -- 10.20.193.58:0/1715789711 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f548c00faf0 con 0x7f5484004d90 2026-02-23T06:42:27.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.267+0000 7f548a7fc640 1 -- 10.20.193.58:0/1715789711 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f548c010450 con 0x7f5484004d90 2026-02-23T06:42:27.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.267+0000 7f54a2c83640 1 -- 10.20.193.58:0/1715789711 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f549c056e80 con 0x7f5484004d90 2026-02-23T06:42:27.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.267+0000 7f54a2c83640 1 -- 10.20.193.58:0/1715789711 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f549c15dfa0 con 0x7f5484004d90 2026-02-23T06:42:27.262 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.268+0000 7f54a2c83640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 0x7f549c1596a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:27.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.268+0000 7f54a2c83640 1 -- 10.20.193.58:0/1715789711 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f549c15fde0 con 0x7f549c15e160 2026-02-23T06:42:27.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.268+0000 7f54a1480640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 0x7f549c1596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:27.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.268+0000 7f54a1480640 1 -- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 msgr2=0x7f549c1596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-23T06:42:27.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.268+0000 7f54a1480640 1 -- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 msgr2=0x7f549c1596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:42:27.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.268+0000 7f54a1480640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 0x7f549c1596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:42:27.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.268+0000 7f54a1480640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 0x7f549c1596a0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:42:27.264 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.269+0000 7f548a7fc640 1 -- 10.20.193.58:0/1715789711 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f548c0105b0 con 0x7f5484004d90 2026-02-23T06:42:27.265 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.270+0000 7f548a7fc640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f546c07a6b0 0x7f546c09ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:27.265 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.270+0000 7f548a7fc640 1 -- 10.20.193.58:0/1715789711 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f548c09d8b0 con 0x7f5484004d90 2026-02-23T06:42:27.266 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.271+0000 7f54a2482640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f546c07a6b0 0x7f546c09ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:27.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.274+0000 7f54a2482640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f546c07a6b0 0x7f546c09ab60 secure :-1 s=READY pgs=464 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5498005820 tx=0x7f5498005850 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:27.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.469+0000 7f54a1480640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 0x7f549c1596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:27.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.469+0000 7f54a1480640 1 -- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 msgr2=0x7f549c1596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:42:27.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.469+0000 7f54a1480640 1 -- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 msgr2=0x7f549c1596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:42:27.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.469+0000 7f54a1480640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 0x7f549c1596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:42:27.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.469+0000 7f54a1480640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 0x7f549c1596a0 unknown :-1 s=START_CONNECT pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-23T06:42:27.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.870+0000 7f54a1480640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 0x7f549c1596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:27.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.870+0000 7f54a1480640 1 -- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 msgr2=0x7f549c1596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:42:27.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.870+0000 7f54a1480640 1 -- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 msgr2=0x7f549c1596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:42:27.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.870+0000 7f54a1480640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 0x7f549c1596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:42:27.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:27.870+0000 7f54a1480640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 0x7f549c1596a0 unknown :-1 s=START_CONNECT pgs=0 gs=10 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-23T06:42:28.668 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:28.673+0000 7f54a1480640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 0x7f549c1596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=11 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:28.669 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:28.674+0000 7f54a1480640 1 -- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 msgr2=0x7f549c1596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:42:28.669 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:28.674+0000 7f54a1480640 1 -- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 msgr2=0x7f549c1596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:42:28.669 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:28.674+0000 7f54a1480640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 0x7f549c1596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=11 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:42:28.669 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:28.674+0000 7f54a1480640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 0x7f549c1596a0 unknown :-1 s=START_CONNECT pgs=0 gs=12 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-23T06:42:30.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:30.275+0000 7f54a1480640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 0x7f549c1596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=13 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:30.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:30.275+0000 7f54a1480640 1 -- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 msgr2=0x7f549c1596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:42:30.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:30.275+0000 7f54a1480640 1 -- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 msgr2=0x7f549c1596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:42:30.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:30.275+0000 7f54a1480640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 0x7f549c1596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=13 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:42:30.271 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:30.275+0000 7f54a1480640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 0x7f549c1596a0 unknown :-1 s=START_CONNECT pgs=0 gs=14 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2026-02-23T06:42:31.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.267+0000 7f54897fa640 1 -- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 msgr2=0x7f549c1596a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:42:31.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.267+0000 7f54897fa640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 0x7f549c1596a0 unknown :-1 s=START_CONNECT pgs=0 gs=14 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:31.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.267+0000 7f54897fa640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5464003600 0x7f5464023a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:31.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.267+0000 7f54897fa640 1 -- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 msgr2=0x7f549c1596a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:42:31.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.267+0000 7f54897fa640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c15e160 0x7f549c1596a0 unknown :-1 s=CLOSED pgs=0 gs=14 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:31.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.267+0000 7f54897fa640 1 -- 10.20.193.58:0/1715789711 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f5464024130 con 0x7f5464003600 2026-02-23T06:42:31.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.267+0000 7f54a1480640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5464003600 0x7f5464023a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=15 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:31.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.267+0000 7f54a1480640 1 -- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5464003600 msgr2=0x7f5464023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:42:31.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.267+0000 7f54a1480640 1 -- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5464003600 msgr2=0x7f5464023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:42:31.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.267+0000 7f54a1480640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5464003600 0x7f5464023a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=15 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:42:31.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.267+0000 7f54a1480640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5464003600 0x7f5464023a80 unknown :-1 s=START_CONNECT pgs=0 gs=16 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:42:31.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.468+0000 7f54a1480640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5464003600 0x7f5464023a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=17 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:31.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.468+0000 7f54a1480640 1 -- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5464003600 msgr2=0x7f5464023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:42:31.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.468+0000 7f54a1480640 1 -- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5464003600 msgr2=0x7f5464023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:42:31.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.468+0000 7f54a1480640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5464003600 0x7f5464023a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=17 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:42:31.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.468+0000 7f54a1480640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5464003600 0x7f5464023a80 unknown :-1 s=START_CONNECT pgs=0 gs=18 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-23T06:42:31.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.869+0000 7f54a1480640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5464003600 0x7f5464023a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=19 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:31.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.869+0000 7f54a1480640 1 -- 10.20.193.58:0/1715789711 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f54640242a0 con 0x7f5464003600 2026-02-23T06:42:31.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.869+0000 7f54a1480640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5464003600 0x7f5464023a80 secure :-1 s=READY pgs=3 gs=19 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54900029c0 tx=0x7f5490013e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:31.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.870+0000 7f548a7fc640 1 -- 10.20.193.58:0/1715789711 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5490012d40 con 0x7f5464003600 2026-02-23T06:42:31.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.870+0000 7f548a7fc640 1 -- 10.20.193.58:0/1715789711 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f5490019070 con 0x7f5464003600 2026-02-23T06:42:31.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.870+0000 7f548a7fc640 1 -- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5464003600 msgr2=0x7f5464023a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:31.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.870+0000 7f548a7fc640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5464003600 0x7f5464023a80 secure :-1 s=READY pgs=3 gs=19 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54900029c0 tx=0x7f5490013e90 comp rx=0 tx=0).stop 2026-02-23T06:42:31.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.870+0000 7f548a7fc640 1 -- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5464003600 msgr2=0x7f5464023a80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:42:31.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.870+0000 7f548a7fc640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5464003600 0x7f5464023a80 unknown :-1 s=CLOSED pgs=3 gs=19 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:31.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.874+0000 7f54a2c83640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c162ee0 0x7f549c13f1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:31.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.874+0000 7f54a2c83640 1 -- 10.20.193.58:0/1715789711 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f549c0b6330 con 0x7f549c162ee0 2026-02-23T06:42:31.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.874+0000 7f54a1480640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c162ee0 0x7f549c13f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=20 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:31.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.874+0000 7f54a1480640 1 -- 10.20.193.58:0/1715789711 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f549c0b6d50 con 0x7f549c162ee0 2026-02-23T06:42:31.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.874+0000 7f54a1480640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c162ee0 0x7f549c13f1e0 secure :-1 s=READY pgs=4 gs=20 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54900029c0 tx=0x7f5490003330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:31.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.875+0000 7f548a7fc640 1 -- 10.20.193.58:0/1715789711 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5490004250 con 0x7f549c162ee0 2026-02-23T06:42:31.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.875+0000 7f548a7fc640 1 -- 10.20.193.58:0/1715789711 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4910 (secure 0 0 0) 0x7f54900043b0 con 0x7f549c162ee0 2026-02-23T06:42:31.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.875+0000 7f548a7fc640 1 -- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c162ee0 msgr2=0x7f549c13f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:31.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.875+0000 7f548a7fc640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c162ee0 0x7f549c13f1e0 secure :-1 s=READY pgs=4 gs=20 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54900029c0 tx=0x7f5490003330 comp rx=0 tx=0).stop 2026-02-23T06:42:31.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.875+0000 7f548a7fc640 1 -- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c162ee0 msgr2=0x7f549c13f1e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:42:31.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.875+0000 7f548a7fc640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f549c162ee0 0x7f549c13f1e0 secure :-1 s=CLOSED pgs=4 gs=20 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54900029c0 tx=0x7f5490003330 comp rx=0 tx=0).stop 2026-02-23T06:42:31.871 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:42:31.871 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:42:31.871 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:42:31.871 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:42:31.871 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 180, 2026-02-23T06:42:31.872 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 5303, 2026-02-23T06:42:31.872 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:42:31.872 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:42:31.872 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:42:31.872 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:42:31.872 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:31.872 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 5, 2026-02-23T06:42:31.872 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:42:31.872 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:42:31.872 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:42:31.872 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:31.872 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:31.872 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:31.872 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:31.872 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:31.872 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:31.872 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:31.872 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:31.872 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:31.872 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:31.872 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:31.872 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:31.872 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:31.872 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:31.873 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:42:31.873 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:42:31.873 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:31.873 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:31.873 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:31.873 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:31.873 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:31.873 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:31.873 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:31.873 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:31.873 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:31.873 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:31.873 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:31.873 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:31.873 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:31.873 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:31.873 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:31.873 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:42:31.873 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:42:31.873 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:42:31.873 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:42:31.873 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:42:31.873 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:42:31.873 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:42:31.873 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:42:31.874 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:42:31.874 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:42:31.874 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:42:31.874 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:42:31.874 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:42:31.874 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:42:31.874 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:42:31.874 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:42:31.874 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:42:31.874 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:31.874 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:31.874 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:31.874 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:31.874 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:31.874 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:31.874 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:31.874 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:31.874 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:31.874 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:31.874 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:31.874 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:31.874 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:31.874 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:31.874 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:42:31.874 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:31.874 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:42:31.875 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:31.875 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:42:31.875 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:42:31.875 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:31.875 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:31.875 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:31.875 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:31.875 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:42:31.875 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:31.875 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:31.875 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:31.875 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:31.875 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:42:31.875 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:31.875 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:31.875 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:31.875 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:31.875 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:42:31.875 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:42:31.875 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:31.875 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:31.875 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:42:31.875 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:31.875 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:31.875 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:31.875 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:42:31.876 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:42:31.876 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:31.876 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:31.876 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:31.876 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:31.876 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:42:31.876 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:31.876 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:31.876 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:31.876 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:31.876 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:42:31.876 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:31.876 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:31.876 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:31.876 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:31.876 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:42:31.876 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:42:31.876 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:31.876 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:31.876 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:42:31.876 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:31.876 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:31.876 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:31.876 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:42:31.876 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:42:31.876 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:31.877 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:31.877 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:31.877 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:31.877 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:42:31.877 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:31.877 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:31.877 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:31.877 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:31.877 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:42:31.877 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:31.877 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:31.877 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:31.877 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:31.877 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:42:31.877 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:42:31.877 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:31.877 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:31.877 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:42:31.877 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:31.877 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:31.877 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:31.877 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:31.877 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:42:31.877 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:42:31.877 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:31.877 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:31.878 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:31.878 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:42:31.878 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:31.878 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:31.878 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:42:31.878 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:31.878 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:31.878 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:31.878 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:42:31.878 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:31.878 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:31.878 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:31.878 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:42:31.878 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:42:31.879 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.875+0000 7f54a2482640 1 -- 10.20.193.58:0/1715789711 reap_dead start 2026-02-23T06:42:31.879 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.875+0000 7f54a2c83640 1 -- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f546c07a6b0 msgr2=0x7f546c09ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:31.879 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.875+0000 7f54a2c83640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f546c07a6b0 0x7f546c09ab60 secure :-1 s=READY pgs=464 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5498005820 tx=0x7f5498005850 comp rx=0 tx=0).stop 2026-02-23T06:42:31.879 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.875+0000 7f54a2c83640 1 -- 10.20.193.58:0/1715789711 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5484004d90 msgr2=0x7f549c0561f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:31.879 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.875+0000 7f54a2c83640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5484004d90 0x7f549c0561f0 secure :-1 s=READY pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f548c00d5b0 tx=0x7f548c00da80 comp rx=0 tx=0).stop 2026-02-23T06:42:31.879 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.875+0000 7f54a2c83640 1 -- 10.20.193.58:0/1715789711 shutdown_connections 2026-02-23T06:42:31.879 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.875+0000 7f54a2c83640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f546c07a6b0 0x7f546c09ab60 unknown :-1 s=CLOSED pgs=464 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:31.879 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.875+0000 7f54a2c83640 1 --2- 10.20.193.58:0/1715789711 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5484004d90 0x7f549c0561f0 unknown :-1 s=CLOSED pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:31.879 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.875+0000 7f54a2c83640 1 -- 10.20.193.58:0/1715789711 >> 10.20.193.58:0/1715789711 conn(0x7f549c0b3c20 msgr2=0x7f549c05c610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:31.879 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.875+0000 7f54a2c83640 1 -- 10.20.193.58:0/1715789711 shutdown_connections 2026-02-23T06:42:31.879 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:31.875+0000 7f54a2c83640 1 -- 10.20.193.58:0/1715789711 wait complete. 2026-02-23T06:42:31.880 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:42:31.880 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:42:31.880 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:42:32.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.005+0000 7fc85bfff640 1 -- 10.20.193.58:0/1986126667 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc85c15d4a0 msgr2=0x7fc85c0affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:32.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.005+0000 7fc85bfff640 1 --2- 10.20.193.58:0/1986126667 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc85c15d4a0 0x7fc85c0affb0 secure :-1 s=READY pgs=66 gs=3 cs=0 l=1 c_cookie=3121835863542867812 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc850005e70 tx=0x7fc85002f290 comp rx=0 tx=0).stop 2026-02-23T06:42:32.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.005+0000 7fc85bfff640 1 -- 10.20.193.58:0/1986126667 shutdown_connections 2026-02-23T06:42:32.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.005+0000 7fc85bfff640 1 --2- 10.20.193.58:0/1986126667 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc85c15d4a0 0x7fc85c0affb0 unknown :-1 s=CLOSED pgs=66 gs=3 cs=0 l=1 c_cookie=3121835863542867812 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:32.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.005+0000 7fc85bfff640 1 -- 10.20.193.58:0/1986126667 >> 10.20.193.58:0/1986126667 conn(0x7fc85c0b3c20 msgr2=0x7fc85c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:32.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.005+0000 7fc85bfff640 1 -- 10.20.193.58:0/1986126667 shutdown_connections 2026-02-23T06:42:32.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.005+0000 7fc85bfff640 1 -- 10.20.193.58:0/1986126667 wait complete. 2026-02-23T06:42:32.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.007+0000 7fc85bfff640 1 Processor -- start 2026-02-23T06:42:32.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.007+0000 7fc85bfff640 1 -- start start 2026-02-23T06:42:32.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.007+0000 7fc85bfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc85c0b6690 0x7fc85c13b3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:32.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.007+0000 7fc85bfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc85c15d4a0 0x7fc85c1613c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:32.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.007+0000 7fc85bfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc85c15d870 0x7fc85c161900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:32.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.007+0000 7fc85bfff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c1624e0 con 0x7fc85c0b6690 2026-02-23T06:42:32.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.007+0000 7fc85bfff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c11efd0 con 0x7fc85c15d870 2026-02-23T06:42:32.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.007+0000 7fc85bfff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc85c0ae570 con 0x7fc85c15d4a0 2026-02-23T06:42:32.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.007+0000 7fc85affd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc85c0b6690 0x7fc85c13b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:32.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.007+0000 7fc85affd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc85c0b6690 0x7fc85c13b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:47648/0 (socket says 10.20.193.58:47648) 2026-02-23T06:42:32.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.007+0000 7fc85affd640 1 -- 10.20.193.58:0/1872319058 learned_addr learned my addr 10.20.193.58:0/1872319058 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:42:32.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.008+0000 7fc85affd640 1 -- 10.20.193.58:0/1872319058 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc85c15d4a0 msgr2=0x7fc85c1613c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:32.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.008+0000 7fc85a7fc640 1 --2- 10.20.193.58:0/1872319058 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc85c15d4a0 0x7fc85c1613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:32.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.008+0000 7fc85affd640 1 --2- 10.20.193.58:0/1872319058 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc85c15d4a0 0x7fc85c1613c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:32.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.008+0000 7fc85affd640 1 -- 10.20.193.58:0/1872319058 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc85c15d870 msgr2=0x7fc85c161900 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-23T06:42:32.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.008+0000 7fc85affd640 1 --2- 10.20.193.58:0/1872319058 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc85c15d870 0x7fc85c161900 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:32.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.008+0000 7fc85affd640 1 -- 10.20.193.58:0/1872319058 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc850009570 con 0x7fc85c0b6690 2026-02-23T06:42:32.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.008+0000 7fc85a7fc640 1 --2- 10.20.193.58:0/1872319058 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc85c15d4a0 0x7fc85c1613c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:42:32.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.008+0000 7fc85affd640 1 --2- 10.20.193.58:0/1872319058 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc85c0b6690 0x7fc85c13b3d0 secure :-1 s=READY pgs=67 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc850004740 tx=0x7fc850002a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:32.004 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.008+0000 7fc83b7fe640 1 -- 10.20.193.58:0/1872319058 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc85003d070 con 0x7fc85c0b6690 2026-02-23T06:42:32.004 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.008+0000 7fc83b7fe640 1 -- 10.20.193.58:0/1872319058 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc850038690 con 0x7fc85c0b6690 2026-02-23T06:42:32.004 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.008+0000 7fc83b7fe640 1 -- 10.20.193.58:0/1872319058 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc850038aa0 con 0x7fc85c0b6690 2026-02-23T06:42:32.004 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.008+0000 7fc85bfff640 1 -- 10.20.193.58:0/1872319058 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc85c160f90 con 0x7fc85c0b6690 2026-02-23T06:42:32.004 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.009+0000 7fc85bfff640 1 -- 10.20.193.58:0/1872319058 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc85c0ae810 con 0x7fc85c0b6690 2026-02-23T06:42:32.004 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.009+0000 7fc85bfff640 1 -- 10.20.193.58:0/1872319058 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc85c0b7260 con 0x7fc85c0b6690 2026-02-23T06:42:32.005 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.010+0000 7fc83b7fe640 1 -- 10.20.193.58:0/1872319058 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fc850038c00 con 0x7fc85c0b6690 2026-02-23T06:42:32.006 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.011+0000 7fc83b7fe640 1 --2- 10.20.193.58:0/1872319058 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc82807a790 0x7fc82809ac40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:32.006 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.011+0000 7fc83b7fe640 1 -- 10.20.193.58:0/1872319058 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fc8500c24a0 con 0x7fc85c0b6690 2026-02-23T06:42:32.006 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.012+0000 7fc85a7fc640 1 --2- 10.20.193.58:0/1872319058 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc82807a790 0x7fc82809ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:32.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.012+0000 7fc85a7fc640 1 --2- 10.20.193.58:0/1872319058 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc82807a790 0x7fc82809ac40 secure :-1 s=READY pgs=465 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc85c15c3c0 tx=0x7fc844009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:32.008 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.013+0000 7fc83b7fe640 1 -- 10.20.193.58:0/1872319058 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fc850085790 con 0x7fc85c0b6690 2026-02-23T06:42:32.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.168+0000 7fc85bfff640 1 -- 10.20.193.58:0/1872319058 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fc85c0b84f0 con 0x7fc85c0b6690 2026-02-23T06:42:32.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.169+0000 7fc83b7fe640 1 -- 10.20.193.58:0/1872319058 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fc8500888b0 con 0x7fc85c0b6690 2026-02-23T06:42:32.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.170+0000 7fc85bfff640 1 -- 10.20.193.58:0/1872319058 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc82807a790 msgr2=0x7fc82809ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:32.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.170+0000 7fc85bfff640 1 --2- 10.20.193.58:0/1872319058 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc82807a790 0x7fc82809ac40 secure :-1 s=READY pgs=465 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc85c15c3c0 tx=0x7fc844009040 comp rx=0 tx=0).stop 2026-02-23T06:42:32.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.170+0000 7fc85bfff640 1 -- 10.20.193.58:0/1872319058 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc85c0b6690 msgr2=0x7fc85c13b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:32.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.170+0000 7fc85bfff640 1 --2- 10.20.193.58:0/1872319058 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc85c0b6690 0x7fc85c13b3d0 secure :-1 s=READY pgs=67 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc850004740 tx=0x7fc850002a10 comp rx=0 tx=0).stop 2026-02-23T06:42:32.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.170+0000 7fc85bfff640 1 -- 10.20.193.58:0/1872319058 shutdown_connections 2026-02-23T06:42:32.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.170+0000 7fc85bfff640 1 --2- 10.20.193.58:0/1872319058 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc82807a790 0x7fc82809ac40 unknown :-1 s=CLOSED pgs=465 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:32.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.170+0000 7fc85bfff640 1 --2- 10.20.193.58:0/1872319058 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc85c15d870 0x7fc85c161900 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:32.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.170+0000 7fc85bfff640 1 --2- 10.20.193.58:0/1872319058 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc85c15d4a0 0x7fc85c1613c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:32.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.170+0000 7fc85bfff640 1 --2- 10.20.193.58:0/1872319058 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc85c0b6690 0x7fc85c13b3d0 unknown :-1 s=CLOSED pgs=67 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:32.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.170+0000 7fc85bfff640 1 -- 10.20.193.58:0/1872319058 >> 10.20.193.58:0/1872319058 conn(0x7fc85c0b3c20 msgr2=0x7fc85c0b7480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:32.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.170+0000 7fc85bfff640 1 -- 10.20.193.58:0/1872319058 shutdown_connections 2026-02-23T06:42:32.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:32.170+0000 7fc85bfff640 1 -- 10.20.193.58:0/1872319058 wait complete. 2026-02-23T06:42:32.176 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:42:42.177 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:42:42.177 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:42:42.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.302+0000 7f0a68d14640 1 -- 10.20.193.58:0/787379669 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0a640b6690 msgr2=0x7f0a64058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:42.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.302+0000 7f0a68d14640 1 --2- 10.20.193.58:0/787379669 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0a640b6690 0x7f0a64058cf0 secure :-1 s=READY pgs=5 gs=3 cs=0 l=1 c_cookie=4071213146095425536 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a58005820 tx=0x7f0a580302d0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.302+0000 7f0a68d14640 1 -- 10.20.193.58:0/787379669 shutdown_connections 2026-02-23T06:42:42.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.302+0000 7f0a68d14640 1 --2- 10.20.193.58:0/787379669 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0a640b6690 0x7f0a64058cf0 unknown :-1 s=CLOSED pgs=5 gs=3 cs=0 l=1 c_cookie=4071213146095425536 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.302+0000 7f0a68d14640 1 --2- 10.20.193.58:0/787379669 >> v2:10.20.193.93:3300/0 conn(0x7f0a6415d870 0x7f0a640587b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.302+0000 7f0a68d14640 1 -- 10.20.193.58:0/787379669 >> 10.20.193.58:0/787379669 conn(0x7f0a640b3c20 msgr2=0x7f0a640b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:42.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.303+0000 7f0a68d14640 1 -- 10.20.193.58:0/787379669 shutdown_connections 2026-02-23T06:42:42.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.303+0000 7f0a68d14640 1 -- 10.20.193.58:0/787379669 wait complete. 2026-02-23T06:42:42.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.304+0000 7f0a68d14640 1 Processor -- start 2026-02-23T06:42:42.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.304+0000 7f0a68d14640 1 -- start start 2026-02-23T06:42:42.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.305+0000 7f0a68d14640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0a640b6690 0x7f0a642019b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:42.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.305+0000 7f0a68d14640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0a6415d4a0 0x7f0a64056b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:42.302 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.305+0000 7f0a68d14640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0a6415d870 0x7f0a6415a050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:42.302 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.305+0000 7f0a68d14640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6415fb30 con 0x7f0a6415d870 2026-02-23T06:42:42.302 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.305+0000 7f0a68d14640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f0a64057e10 con 0x7f0a640b6690 2026-02-23T06:42:42.302 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.305+0000 7f0a68d14640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f0a641609d0 con 0x7f0a6415d4a0 2026-02-23T06:42:42.302 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.305+0000 7f0a62ffd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0a6415d4a0 0x7f0a64056b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:42.302 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.305+0000 7f0a62ffd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0a6415d4a0 0x7f0a64056b00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:48134/0 (socket says 10.20.193.58:48134) 2026-02-23T06:42:42.302 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.305+0000 7f0a62ffd640 1 -- 10.20.193.58:0/4189593896 learned_addr learned my addr 10.20.193.58:0/4189593896 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:42:42.302 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.305+0000 7f0a637fe640 1 --2- 10.20.193.58:0/4189593896 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0a640b6690 0x7f0a642019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:42.302 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.305+0000 7f0a63fff640 1 --2- 10.20.193.58:0/4189593896 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0a6415d870 0x7f0a6415a050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:42.302 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.305+0000 7f0a62ffd640 1 -- 10.20.193.58:0/4189593896 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0a640b6690 msgr2=0x7f0a642019b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:42.302 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.305+0000 7f0a62ffd640 1 --2- 10.20.193.58:0/4189593896 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0a640b6690 0x7f0a642019b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.302 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.305+0000 7f0a62ffd640 1 -- 10.20.193.58:0/4189593896 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0a6415d870 msgr2=0x7f0a6415a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:42.303 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.305+0000 7f0a62ffd640 1 --2- 10.20.193.58:0/4189593896 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0a6415d870 0x7f0a6415a050 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.303 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.305+0000 7f0a62ffd640 1 -- 10.20.193.58:0/4189593896 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a540094b0 con 0x7f0a6415d4a0 2026-02-23T06:42:42.303 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.305+0000 7f0a63fff640 1 --2- 10.20.193.58:0/4189593896 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0a6415d870 0x7f0a6415a050 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:42:42.303 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.306+0000 7f0a62ffd640 1 --2- 10.20.193.58:0/4189593896 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0a6415d4a0 0x7f0a64056b00 secure :-1 s=READY pgs=6 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a54009fd0 tx=0x7f0a54002bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:42.303 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.306+0000 7f0a3ffff640 1 -- 10.20.193.58:0/4189593896 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0a5400ed60 con 0x7f0a6415d4a0 2026-02-23T06:42:42.303 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.306+0000 7f0a3ffff640 1 -- 10.20.193.58:0/4189593896 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a54002e20 con 0x7f0a6415d4a0 2026-02-23T06:42:42.303 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.306+0000 7f0a3ffff640 1 -- 10.20.193.58:0/4189593896 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0a540106b0 con 0x7f0a6415d4a0 2026-02-23T06:42:42.303 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.306+0000 7f0a68d14640 1 -- 10.20.193.58:0/4189593896 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a5800a590 con 0x7f0a6415d4a0 2026-02-23T06:42:42.303 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.306+0000 7f0a68d14640 1 -- 10.20.193.58:0/4189593896 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a64057850 con 0x7f0a6415d4a0 2026-02-23T06:42:42.303 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.306+0000 7f0a68d14640 1 -- 10.20.193.58:0/4189593896 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a640b6d50 con 0x7f0a6415d4a0 2026-02-23T06:42:42.304 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.308+0000 7f0a3ffff640 1 -- 10.20.193.58:0/4189593896 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f0a54016020 con 0x7f0a6415d4a0 2026-02-23T06:42:42.304 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.309+0000 7f0a3ffff640 1 --2- 10.20.193.58:0/4189593896 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0a3407a6c0 0x7f0a3409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:42.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.309+0000 7f0a3ffff640 1 -- 10.20.193.58:0/4189593896 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f0a5409e1b0 con 0x7f0a6415d4a0 2026-02-23T06:42:42.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.309+0000 7f0a637fe640 1 --2- 10.20.193.58:0/4189593896 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0a3407a6c0 0x7f0a3409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:42.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.309+0000 7f0a3ffff640 1 -- 10.20.193.58:0/4189593896 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f0a540614f0 con 0x7f0a6415d4a0 2026-02-23T06:42:42.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.310+0000 7f0a637fe640 1 --2- 10.20.193.58:0/4189593896 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0a3407a6c0 0x7f0a3409ab70 secure :-1 s=READY pgs=467 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a500026a0 tx=0x7f0a50009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:42.458 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.464+0000 7f0a68d14640 1 -- 10.20.193.58:0/4189593896 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0a6405b0e0 con 0x7f0a6415d4a0 2026-02-23T06:42:42.459 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.464+0000 7f0a3ffff640 1 -- 10.20.193.58:0/4189593896 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f0a54064610 con 0x7f0a6415d4a0 2026-02-23T06:42:42.459 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":180,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:42:42.460 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.465+0000 7f0a68d14640 1 -- 10.20.193.58:0/4189593896 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0a3407a6c0 msgr2=0x7f0a3409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:42.460 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.465+0000 7f0a68d14640 1 --2- 10.20.193.58:0/4189593896 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0a3407a6c0 0x7f0a3409ab70 secure :-1 s=READY pgs=467 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a500026a0 tx=0x7f0a50009040 comp rx=0 tx=0).stop 2026-02-23T06:42:42.460 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.465+0000 7f0a68d14640 1 -- 10.20.193.58:0/4189593896 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0a6415d4a0 msgr2=0x7f0a64056b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:42.460 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.465+0000 7f0a68d14640 1 --2- 10.20.193.58:0/4189593896 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0a6415d4a0 0x7f0a64056b00 secure :-1 s=READY pgs=6 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a54009fd0 tx=0x7f0a54002bc0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.461 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.466+0000 7f0a68d14640 1 -- 10.20.193.58:0/4189593896 shutdown_connections 2026-02-23T06:42:42.461 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.466+0000 7f0a68d14640 1 --2- 10.20.193.58:0/4189593896 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0a3407a6c0 0x7f0a3409ab70 unknown :-1 s=CLOSED pgs=467 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.461 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.466+0000 7f0a68d14640 1 --2- 10.20.193.58:0/4189593896 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0a6415d870 0x7f0a6415a050 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.461 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.466+0000 7f0a68d14640 1 --2- 10.20.193.58:0/4189593896 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0a6415d4a0 0x7f0a64056b00 unknown :-1 s=CLOSED pgs=6 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.461 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.466+0000 7f0a68d14640 1 --2- 10.20.193.58:0/4189593896 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0a640b6690 0x7f0a642019b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.461 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.466+0000 7f0a68d14640 1 -- 10.20.193.58:0/4189593896 >> 10.20.193.58:0/4189593896 conn(0x7f0a640b3c20 msgr2=0x7f0a640aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:42.461 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.466+0000 7f0a68d14640 1 -- 10.20.193.58:0/4189593896 shutdown_connections 2026-02-23T06:42:42.461 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.466+0000 7f0a68d14640 1 -- 10.20.193.58:0/4189593896 wait complete. 2026-02-23T06:42:42.474 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:42:42.474 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:42:42.475 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:42:42.475 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:42:42.596 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.601+0000 7fa45ffff640 1 -- 10.20.193.58:0/2435093076 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa4600b6690 msgr2=0x7fa460058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:42.597 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.601+0000 7fa45ffff640 1 --2- 10.20.193.58:0/2435093076 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa4600b6690 0x7fa460058cf0 secure :-1 s=READY pgs=7 gs=3 cs=0 l=1 c_cookie=1746145870666548848 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa450006f50 tx=0x7fa450030360 comp rx=0 tx=0).stop 2026-02-23T06:42:42.597 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.601+0000 7fa45ffff640 1 -- 10.20.193.58:0/2435093076 shutdown_connections 2026-02-23T06:42:42.597 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.601+0000 7fa45ffff640 1 --2- 10.20.193.58:0/2435093076 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa4600b6690 0x7fa460058cf0 unknown :-1 s=CLOSED pgs=7 gs=3 cs=0 l=1 c_cookie=1746145870666548848 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.597 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.601+0000 7fa45ffff640 1 --2- 10.20.193.58:0/2435093076 >> v2:10.20.193.58:3300/0 conn(0x7fa46015d870 0x7fa4600587b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.597 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.601+0000 7fa45ffff640 1 -- 10.20.193.58:0/2435093076 >> 10.20.193.58:0/2435093076 conn(0x7fa4600b3c20 msgr2=0x7fa4600b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:42.597 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.602+0000 7fa45ffff640 1 -- 10.20.193.58:0/2435093076 shutdown_connections 2026-02-23T06:42:42.597 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.602+0000 7fa45ffff640 1 -- 10.20.193.58:0/2435093076 wait complete. 2026-02-23T06:42:42.597 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.603+0000 7fa45ffff640 1 Processor -- start 2026-02-23T06:42:42.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.603+0000 7fa45ffff640 1 -- start start 2026-02-23T06:42:42.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.604+0000 7fa45ffff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa4600b6690 0x7fa46015dd40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:42.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.604+0000 7fa45ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa46015d4a0 0x7fa460166f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:42.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.604+0000 7fa45ffff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa46015d870 0x7fa46013b2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:42.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.604+0000 7fa45ffff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa460056500 con 0x7fa46015d4a0 2026-02-23T06:42:42.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.604+0000 7fa45ffff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fa460057b70 con 0x7fa4600b6690 2026-02-23T06:42:42.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.604+0000 7fa45ffff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa460056290 con 0x7fa46015d870 2026-02-23T06:42:42.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.604+0000 7fa45e7fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa46015d4a0 0x7fa460166f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:42.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.604+0000 7fa45e7fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa46015d4a0 0x7fa460166f10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:56366/0 (socket says 10.20.193.58:56366) 2026-02-23T06:42:42.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.604+0000 7fa45e7fc640 1 -- 10.20.193.58:0/3768112014 learned_addr learned my addr 10.20.193.58:0/3768112014 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:42:42.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.604+0000 7fa45effd640 1 --2- 10.20.193.58:0/3768112014 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa4600b6690 0x7fa46015dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:42.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.604+0000 7fa45f7fe640 1 --2- 10.20.193.58:0/3768112014 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa46015d870 0x7fa46013b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:42.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.604+0000 7fa45e7fc640 1 -- 10.20.193.58:0/3768112014 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa46015d870 msgr2=0x7fa46013b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:42.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.604+0000 7fa45e7fc640 1 --2- 10.20.193.58:0/3768112014 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa46015d870 0x7fa46013b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.604+0000 7fa45e7fc640 1 -- 10.20.193.58:0/3768112014 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa4600b6690 msgr2=0x7fa46015dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:42.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.604+0000 7fa45e7fc640 1 --2- 10.20.193.58:0/3768112014 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa4600b6690 0x7fa46015dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.604+0000 7fa45e7fc640 1 -- 10.20.193.58:0/3768112014 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa45000a650 con 0x7fa46015d4a0 2026-02-23T06:42:42.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.604+0000 7fa45effd640 1 --2- 10.20.193.58:0/3768112014 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa4600b6690 0x7fa46015dd40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:42:42.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.604+0000 7fa45e7fc640 1 --2- 10.20.193.58:0/3768112014 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa46015d4a0 0x7fa460166f10 secure :-1 s=READY pgs=70 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa44800e9c0 tx=0x7fa44800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:42.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.604+0000 7fa437fff640 1 -- 10.20.193.58:0/3768112014 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa44800cd70 con 0x7fa46015d4a0 2026-02-23T06:42:42.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.604+0000 7fa437fff640 1 -- 10.20.193.58:0/3768112014 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa448004850 con 0x7fa46015d4a0 2026-02-23T06:42:42.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.604+0000 7fa437fff640 1 -- 10.20.193.58:0/3768112014 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa448004c80 con 0x7fa46015d4a0 2026-02-23T06:42:42.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.604+0000 7fa45ffff640 1 -- 10.20.193.58:0/3768112014 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa460167450 con 0x7fa46015d4a0 2026-02-23T06:42:42.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.605+0000 7fa45ffff640 1 -- 10.20.193.58:0/3768112014 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa460057520 con 0x7fa46015d4a0 2026-02-23T06:42:42.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.606+0000 7fa45ffff640 1 --2- 10.20.193.58:0/3768112014 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa4600576e0 0x7fa46015e5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:42.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.606+0000 7fa45ffff640 1 -- 10.20.193.58:0/3768112014 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa4600609c0 con 0x7fa4600576e0 2026-02-23T06:42:42.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.606+0000 7fa45effd640 1 --2- 10.20.193.58:0/3768112014 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa4600576e0 0x7fa46015e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:42.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.606+0000 7fa437fff640 1 -- 10.20.193.58:0/3768112014 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fa44801f060 con 0x7fa46015d4a0 2026-02-23T06:42:42.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.606+0000 7fa45effd640 1 -- 10.20.193.58:0/3768112014 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa4600b6330 con 0x7fa4600576e0 2026-02-23T06:42:42.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.606+0000 7fa45effd640 1 --2- 10.20.193.58:0/3768112014 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa4600576e0 0x7fa46015e5c0 secure :-1 s=READY pgs=71 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa454007fd0 tx=0x7fa45400eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:42.602 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.607+0000 7fa437fff640 1 --2- 10.20.193.58:0/3768112014 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa43007a6c0 0x7fa43009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:42.602 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.607+0000 7fa437fff640 1 -- 10.20.193.58:0/3768112014 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fa448014070 con 0x7fa46015d4a0 2026-02-23T06:42:42.602 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.607+0000 7fa437fff640 1 -- 10.20.193.58:0/3768112014 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa45400cae0 con 0x7fa4600576e0 2026-02-23T06:42:42.602 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.608+0000 7fa45f7fe640 1 --2- 10.20.193.58:0/3768112014 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa43007a6c0 0x7fa43009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:42.602 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.608+0000 7fa437fff640 1 -- 10.20.193.58:0/3768112014 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fa45400ee60 con 0x7fa4600576e0 2026-02-23T06:42:42.602 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.608+0000 7fa437fff640 1 -- 10.20.193.58:0/3768112014 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa4600576e0 msgr2=0x7fa46015e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:42.602 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.608+0000 7fa437fff640 1 --2- 10.20.193.58:0/3768112014 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa4600576e0 0x7fa46015e5c0 secure :-1 s=READY pgs=71 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa454007fd0 tx=0x7fa45400eba0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.602 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.608+0000 7fa437fff640 1 -- 10.20.193.58:0/3768112014 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa4600576e0 msgr2=0x7fa46015e5c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:42:42.602 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.608+0000 7fa437fff640 1 --2- 10.20.193.58:0/3768112014 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa4600576e0 0x7fa46015e5c0 unknown :-1 s=CLOSED pgs=71 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.603 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.608+0000 7fa45f7fe640 1 --2- 10.20.193.58:0/3768112014 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa43007a6c0 0x7fa43009ab70 secure :-1 s=READY pgs=468 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa450006f50 tx=0x7fa45003b040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:42.606 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.611+0000 7fa45ffff640 1 --2- 10.20.193.58:0/3768112014 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa46015eb00 0x7fa46005ba90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:42.606 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.611+0000 7fa45ffff640 1 -- 10.20.193.58:0/3768112014 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa4600b5e10 con 0x7fa46015eb00 2026-02-23T06:42:42.606 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.611+0000 7fa45effd640 1 --2- 10.20.193.58:0/3768112014 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa46015eb00 0x7fa46005ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:42.606 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.611+0000 7fa45effd640 1 -- 10.20.193.58:0/3768112014 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa460164250 con 0x7fa46015eb00 2026-02-23T06:42:42.606 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.612+0000 7fa45effd640 1 --2- 10.20.193.58:0/3768112014 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa46015eb00 0x7fa46005ba90 secure :-1 s=READY pgs=72 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa454014000 tx=0x7fa454002850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:42.606 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.612+0000 7fa437fff640 1 -- 10.20.193.58:0/3768112014 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa454022070 con 0x7fa46015eb00 2026-02-23T06:42:42.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.612+0000 7fa437fff640 1 -- 10.20.193.58:0/3768112014 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5391 (secure 0 0 0) 0x7fa454013960 con 0x7fa46015eb00 2026-02-23T06:42:42.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.612+0000 7fa437fff640 1 -- 10.20.193.58:0/3768112014 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa46015eb00 msgr2=0x7fa46005ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:42.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.612+0000 7fa437fff640 1 --2- 10.20.193.58:0/3768112014 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa46015eb00 0x7fa46005ba90 secure :-1 s=READY pgs=72 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa454014000 tx=0x7fa454002850 comp rx=0 tx=0).stop 2026-02-23T06:42:42.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.612+0000 7fa437fff640 1 -- 10.20.193.58:0/3768112014 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa46015eb00 msgr2=0x7fa46005ba90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:42:42.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.612+0000 7fa437fff640 1 --2- 10.20.193.58:0/3768112014 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa46015eb00 0x7fa46005ba90 unknown :-1 s=CLOSED pgs=72 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.607 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:42:42.607 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:42:42.607 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:42:42.607 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:42:42.607 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 180, 2026-02-23T06:42:42.607 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 62732, 2026-02-23T06:42:42.607 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:42:42.607 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:42:42.607 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:42:42.607 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:42:42.607 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:42.607 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 16, 2026-02-23T06:42:42.607 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:42:42.607 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:42:42.607 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:42:42.607 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:42.607 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:42.607 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:42:42.608 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:42.609 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:42:42.610 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:42.611 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:42:42.612 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.612 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:42.612 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:42.612 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:42:42.612 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:42.612 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:42.612 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:42:42.612 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.612 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:42:42.612 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:42:42.612 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:42:42.612 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.612 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.612 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:42.612 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:42.612 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:42:42.612 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:42.612 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:42.612 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.612 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:42:42.612 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:42:42.612 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.612+0000 7fa45ffff640 1 -- 10.20.193.58:0/3768112014 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa43007a6c0 msgr2=0x7fa43009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:42.612 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.612+0000 7fa45ffff640 1 --2- 10.20.193.58:0/3768112014 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa43007a6c0 0x7fa43009ab70 secure :-1 s=READY pgs=468 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa450006f50 tx=0x7fa45003b040 comp rx=0 tx=0).stop 2026-02-23T06:42:42.612 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.612+0000 7fa45ffff640 1 -- 10.20.193.58:0/3768112014 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa46015d4a0 msgr2=0x7fa460166f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:42.612 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.612+0000 7fa45ffff640 1 --2- 10.20.193.58:0/3768112014 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa46015d4a0 0x7fa460166f10 secure :-1 s=READY pgs=70 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa44800e9c0 tx=0x7fa44800ee90 comp rx=0 tx=0).stop 2026-02-23T06:42:42.612 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.612+0000 7fa45f7fe640 1 -- 10.20.193.58:0/3768112014 reap_dead start 2026-02-23T06:42:42.612 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.612+0000 7fa45f7fe640 1 -- 10.20.193.58:0/3768112014 reap_dead start 2026-02-23T06:42:42.613 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.612+0000 7fa45ffff640 1 -- 10.20.193.58:0/3768112014 shutdown_connections 2026-02-23T06:42:42.613 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.612+0000 7fa45ffff640 1 -- 10.20.193.58:0/3768112014 >> 10.20.193.58:0/3768112014 conn(0x7fa4600b3c20 msgr2=0x7fa46005d100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:42.613 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.612+0000 7fa45ffff640 1 -- 10.20.193.58:0/3768112014 shutdown_connections 2026-02-23T06:42:42.613 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.612+0000 7fa45ffff640 1 -- 10.20.193.58:0/3768112014 wait complete. 2026-02-23T06:42:42.613 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:42:42.614 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:42:42.614 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:42:42.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.741+0000 7fb95bfff640 1 -- 10.20.193.58:0/2718911508 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb95c0ba270 msgr2=0x7fb95c0b9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:42.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.741+0000 7fb95bfff640 1 --2- 10.20.193.58:0/2718911508 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb95c0ba270 0x7fb95c0b9020 secure :-1 s=READY pgs=73 gs=3 cs=0 l=1 c_cookie=1602396944899925446 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb95c05d4f0 tx=0x7fb94c0303d0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.741+0000 7fb95bfff640 1 -- 10.20.193.58:0/2718911508 shutdown_connections 2026-02-23T06:42:42.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.741+0000 7fb95bfff640 1 --2- 10.20.193.58:0/2718911508 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb95c0ba270 0x7fb95c0b9020 unknown :-1 s=CLOSED pgs=73 gs=3 cs=0 l=1 c_cookie=1602396944899925446 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.741+0000 7fb95bfff640 1 --2- 10.20.193.58:0/2718911508 >> v2:10.20.193.93:3300/0 conn(0x7fb95c0b2080 0x7fb95c167200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.741+0000 7fb95bfff640 1 --2- 10.20.193.58:0/2718911508 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb95c0b9ea0 0x7fb95c163c30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.741+0000 7fb95bfff640 1 -- 10.20.193.58:0/2718911508 >> 10.20.193.58:0/2718911508 conn(0x7fb95c0b65c0 msgr2=0x7fb95c0b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:42.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.741+0000 7fb95bfff640 1 -- 10.20.193.58:0/2718911508 shutdown_connections 2026-02-23T06:42:42.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.741+0000 7fb95bfff640 1 -- 10.20.193.58:0/2718911508 wait complete. 2026-02-23T06:42:42.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.742+0000 7fb95bfff640 1 Processor -- start 2026-02-23T06:42:42.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.743+0000 7fb95bfff640 1 -- start start 2026-02-23T06:42:42.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.743+0000 7fb95bfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb95c0b2080 0x7fb95c057340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:42.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.743+0000 7fb95bfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb95c0b9ea0 0x7fb95c1291d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:42.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.743+0000 7fb95bfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb95c0ba270 0x7fb95c1253d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:42.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.743+0000 7fb95bfff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c153020 con 0x7fb95c0ba270 2026-02-23T06:42:42.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.743+0000 7fb95bfff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c1264e0 con 0x7fb95c0b2080 2026-02-23T06:42:42.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.743+0000 7fb95bfff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb95c142430 con 0x7fb95c0b9ea0 2026-02-23T06:42:42.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.743+0000 7fb95b7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb95c0ba270 0x7fb95c1253d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:42.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.743+0000 7fb95affd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb95c0b2080 0x7fb95c057340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:42.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.743+0000 7fb95b7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb95c0ba270 0x7fb95c1253d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:56398/0 (socket says 10.20.193.58:56398) 2026-02-23T06:42:42.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.743+0000 7fb95b7fe640 1 -- 10.20.193.58:0/4149880104 learned_addr learned my addr 10.20.193.58:0/4149880104 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:42:42.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.743+0000 7fb95a7fc640 1 --2- 10.20.193.58:0/4149880104 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb95c0b9ea0 0x7fb95c1291d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:42.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.743+0000 7fb95b7fe640 1 -- 10.20.193.58:0/4149880104 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb95c0b9ea0 msgr2=0x7fb95c1291d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:42.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.743+0000 7fb95b7fe640 1 --2- 10.20.193.58:0/4149880104 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb95c0b9ea0 0x7fb95c1291d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.743+0000 7fb95b7fe640 1 -- 10.20.193.58:0/4149880104 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb95c0b2080 msgr2=0x7fb95c057340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:42.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.743+0000 7fb95b7fe640 1 --2- 10.20.193.58:0/4149880104 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb95c0b2080 0x7fb95c057340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.743+0000 7fb95b7fe640 1 -- 10.20.193.58:0/4149880104 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb94c00a650 con 0x7fb95c0ba270 2026-02-23T06:42:42.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.743+0000 7fb95a7fc640 1 --2- 10.20.193.58:0/4149880104 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb95c0b9ea0 0x7fb95c1291d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:42:42.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.744+0000 7fb95b7fe640 1 --2- 10.20.193.58:0/4149880104 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb95c0ba270 0x7fb95c1253d0 secure :-1 s=READY pgs=74 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb94c00a230 tx=0x7fb94c003c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:42.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.744+0000 7fb93b7fe640 1 -- 10.20.193.58:0/4149880104 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb94c0398a0 con 0x7fb95c0ba270 2026-02-23T06:42:42.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.744+0000 7fb93b7fe640 1 -- 10.20.193.58:0/4149880104 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb94c039af0 con 0x7fb95c0ba270 2026-02-23T06:42:42.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.744+0000 7fb93b7fe640 1 -- 10.20.193.58:0/4149880104 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb94c003e60 con 0x7fb95c0ba270 2026-02-23T06:42:42.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.744+0000 7fb95bfff640 1 -- 10.20.193.58:0/4149880104 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb95c153880 con 0x7fb95c0ba270 2026-02-23T06:42:42.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.744+0000 7fb95bfff640 1 -- 10.20.193.58:0/4149880104 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb95c126710 con 0x7fb95c0ba270 2026-02-23T06:42:42.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.744+0000 7fb9397fa640 1 --2- 10.20.193.58:0/4149880104 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb95c153cf0 0x7fb95c125910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:42.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.744+0000 7fb9397fa640 1 -- 10.20.193.58:0/4149880104 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c0b86c0 con 0x7fb95c153cf0 2026-02-23T06:42:42.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.745+0000 7fb95affd640 1 --2- 10.20.193.58:0/4149880104 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb95c153cf0 0x7fb95c125910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:42.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.745+0000 7fb95affd640 1 -- 10.20.193.58:0/4149880104 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb95c167740 con 0x7fb95c153cf0 2026-02-23T06:42:42.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.745+0000 7fb95affd640 1 --2- 10.20.193.58:0/4149880104 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb95c153cf0 0x7fb95c125910 secure :-1 s=READY pgs=117 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb950002fc0 tx=0x7fb950009ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:42.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.745+0000 7fb93b7fe640 1 -- 10.20.193.58:0/4149880104 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb950011030 con 0x7fb95c153cf0 2026-02-23T06:42:42.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.746+0000 7fb93b7fe640 1 -- 10.20.193.58:0/4149880104 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fb950011190 con 0x7fb95c153cf0 2026-02-23T06:42:42.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.746+0000 7fb93b7fe640 1 -- 10.20.193.58:0/4149880104 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb95c153cf0 msgr2=0x7fb95c125910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:42.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.746+0000 7fb93b7fe640 1 --2- 10.20.193.58:0/4149880104 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb95c153cf0 0x7fb95c125910 secure :-1 s=READY pgs=117 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb950002fc0 tx=0x7fb950009ac0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.746+0000 7fb93b7fe640 1 -- 10.20.193.58:0/4149880104 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb95c153cf0 msgr2=0x7fb95c125910 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:42:42.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.746+0000 7fb93b7fe640 1 --2- 10.20.193.58:0/4149880104 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb95c153cf0 0x7fb95c125910 secure :-1 s=CLOSED pgs=117 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb950002fc0 tx=0x7fb950009ac0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.746+0000 7fb93b7fe640 1 -- 10.20.193.58:0/4149880104 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fb94c04b460 con 0x7fb95c0ba270 2026-02-23T06:42:42.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.747+0000 7fb93b7fe640 1 --2- 10.20.193.58:0/4149880104 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb92807a430 0x7fb92809a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:42.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.747+0000 7fb93b7fe640 1 -- 10.20.193.58:0/4149880104 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fb94c0c41e0 con 0x7fb95c0ba270 2026-02-23T06:42:42.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.747+0000 7fb95affd640 1 --2- 10.20.193.58:0/4149880104 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb92807a430 0x7fb92809a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:42.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.748+0000 7fb95affd640 1 --2- 10.20.193.58:0/4149880104 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb92807a430 0x7fb92809a8e0 secure :-1 s=READY pgs=469 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9500046d0 tx=0x7fb95001d040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:42.744 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.749+0000 7fb9397fa640 1 --2- 10.20.193.58:0/4149880104 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb95c143ee0 0x7fb95c153190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:42.744 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.749+0000 7fb9397fa640 1 -- 10.20.193.58:0/4149880104 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c153a10 con 0x7fb95c143ee0 2026-02-23T06:42:42.744 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.749+0000 7fb95a7fc640 1 --2- 10.20.193.58:0/4149880104 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb95c143ee0 0x7fb95c153190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:42.745 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.749+0000 7fb95a7fc640 1 -- 10.20.193.58:0/4149880104 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb95c1442b0 con 0x7fb95c143ee0 2026-02-23T06:42:42.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.750+0000 7fb95a7fc640 1 --2- 10.20.193.58:0/4149880104 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb95c143ee0 0x7fb95c153190 secure :-1 s=READY pgs=118 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb95c150b80 tx=0x7fb9440099f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:42.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.750+0000 7fb93b7fe640 1 -- 10.20.193.58:0/4149880104 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb944004a70 con 0x7fb95c143ee0 2026-02-23T06:42:42.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.750+0000 7fb93b7fe640 1 -- 10.20.193.58:0/4149880104 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5414 (secure 0 0 0) 0x7fb944010850 con 0x7fb95c143ee0 2026-02-23T06:42:42.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.750+0000 7fb93b7fe640 1 -- 10.20.193.58:0/4149880104 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb95c143ee0 msgr2=0x7fb95c153190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:42.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.750+0000 7fb93b7fe640 1 --2- 10.20.193.58:0/4149880104 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb95c143ee0 0x7fb95c153190 secure :-1 s=READY pgs=118 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb95c150b80 tx=0x7fb9440099f0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.750+0000 7fb93b7fe640 1 -- 10.20.193.58:0/4149880104 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb95c143ee0 msgr2=0x7fb95c153190 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:42:42.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.750+0000 7fb93b7fe640 1 --2- 10.20.193.58:0/4149880104 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb95c143ee0 0x7fb95c153190 secure :-1 s=CLOSED pgs=118 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb95c150b80 tx=0x7fb9440099f0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.747 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:42:42.747 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:42:42.747 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:42:42.747 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:42:42.747 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 180, 2026-02-23T06:42:42.747 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 166840, 2026-02-23T06:42:42.747 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:42:42.747 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:42:42.747 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:42:42.747 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:42:42.748 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:42.748 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 16, 2026-02-23T06:42:42.748 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:42:42.748 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:42:42.748 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:42:42.748 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:42.748 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:42.748 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:42.748 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:42.748 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:42.748 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:42.749 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:42.749 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:42.749 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:42.749 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:42.749 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:42.749 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:42.749 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:42.749 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:42.749 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:42:42.749 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:42:42.749 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:42.749 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:42.749 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:42.750 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:42.750 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:42.750 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:42.750 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:42.750 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:42.750 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:42.750 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:42.750 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:42.750 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:42.750 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:42.750 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:42.750 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.751 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:42:42.751 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:42:42.751 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:42:42.751 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:42:42.751 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:42:42.751 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:42:42.751 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:42:42.751 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:42:42.751 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:42:42.751 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:42:42.751 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:42:42.752 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:42:42.752 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:42:42.752 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:42:42.752 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:42:42.752 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:42:42.752 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:42:42.752 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:42.752 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:42.752 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:42.752 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:42.752 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:42.752 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:42.753 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:42.753 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:42.753 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:42.753 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:42.753 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:42.753 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:42.753 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:42.753 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:42.753 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:42:42.753 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.753 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:42:42.753 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.753 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:42:42.754 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:42:42.754 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:42.754 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:42.754 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.754 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:42.754 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:42:42.754 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:42.754 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.754 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.754 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:42.754 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:42:42.754 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:42.755 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:42.755 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:42.755 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.755 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:42:42.755 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:42:42.755 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:42.755 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:42.755 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:42:42.755 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:42.755 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.755 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.755 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:42:42.755 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:42:42.756 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:42.756 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:42.756 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.756 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:42.756 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:42:42.756 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:42.756 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.756 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.756 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:42.756 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:42:42.756 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:42.756 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:42.757 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:42.757 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.757 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:42:42.757 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:42:42.757 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:42.757 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:42.757 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:42:42.757 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:42.757 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.757 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.757 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:42:42.757 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:42:42.758 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:42.758 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:42.758 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.758 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:42.758 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:42:42.758 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:42.758 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.758 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.758 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:42.758 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:42:42.758 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:42.758 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:42.758 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:42.758 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.759 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:42:42.759 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:42:42.759 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:42.759 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:42.759 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:42:42.759 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:42.759 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:42.759 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:42.759 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.759 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:42:42.759 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:42:42.759 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.759 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:42.759 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:42.760 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:42:42.760 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:42.760 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:42.760 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:42:42.760 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.760 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:42.760 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:42.760 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:42:42.760 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:42.760 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:42.760 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:42:42.760 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.760 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:42.760 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:42.761 INFO:teuthology.orchestra.run.trial058.stdout: "num": 7 2026-02-23T06:42:42.761 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:42.761 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:42.761 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:42:42.761 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.761 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:42.761 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:42.761 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:42:42.761 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:42.761 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:42.761 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:42:42.761 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.761 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:42.762 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:42.762 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:42:42.762 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:42.762 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:42.762 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.762 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:42:42.762 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:42:42.763 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.750+0000 7fb9397fa640 1 -- 10.20.193.58:0/4149880104 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb92807a430 msgr2=0x7fb92809a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:42.764 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.750+0000 7fb9397fa640 1 --2- 10.20.193.58:0/4149880104 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb92807a430 0x7fb92809a8e0 secure :-1 s=READY pgs=469 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9500046d0 tx=0x7fb95001d040 comp rx=0 tx=0).stop 2026-02-23T06:42:42.764 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.750+0000 7fb9397fa640 1 -- 10.20.193.58:0/4149880104 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb95c0ba270 msgr2=0x7fb95c1253d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:42.764 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.750+0000 7fb9397fa640 1 --2- 10.20.193.58:0/4149880104 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb95c0ba270 0x7fb95c1253d0 secure :-1 s=READY pgs=74 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb94c00a230 tx=0x7fb94c003c70 comp rx=0 tx=0).stop 2026-02-23T06:42:42.764 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.750+0000 7fb95b7fe640 1 -- 10.20.193.58:0/4149880104 reap_dead start 2026-02-23T06:42:42.764 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.750+0000 7fb95b7fe640 1 -- 10.20.193.58:0/4149880104 reap_dead start 2026-02-23T06:42:42.764 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.750+0000 7fb9397fa640 1 -- 10.20.193.58:0/4149880104 shutdown_connections 2026-02-23T06:42:42.764 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.750+0000 7fb9397fa640 1 -- 10.20.193.58:0/4149880104 >> 10.20.193.58:0/4149880104 conn(0x7fb95c0b65c0 msgr2=0x7fb95c0b6990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:42.764 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.751+0000 7fb9397fa640 1 -- 10.20.193.58:0/4149880104 shutdown_connections 2026-02-23T06:42:42.764 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.751+0000 7fb9397fa640 1 -- 10.20.193.58:0/4149880104 wait complete. 2026-02-23T06:42:42.765 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:42:42.765 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:42:42.765 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:42:42.890 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.894+0000 7f37d7fff640 1 -- 10.20.193.58:0/1152503066 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f37d80b6690 msgr2=0x7f37d8058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:42.890 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.894+0000 7f37d7fff640 1 --2- 10.20.193.58:0/1152503066 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f37d80b6690 0x7f37d8058cf0 secure :-1 s=READY pgs=120 gs=3 cs=0 l=1 c_cookie=5363228919166135051 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37c8005820 tx=0x7f37c80302b0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.890 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.894+0000 7f37d7fff640 1 -- 10.20.193.58:0/1152503066 shutdown_connections 2026-02-23T06:42:42.890 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.894+0000 7f37d7fff640 1 --2- 10.20.193.58:0/1152503066 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f37d80b6690 0x7f37d8058cf0 unknown :-1 s=CLOSED pgs=120 gs=3 cs=0 l=1 c_cookie=5363228919166135051 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.891 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.894+0000 7f37d7fff640 1 --2- 10.20.193.58:0/1152503066 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f37d815d870 0x7f37d80587b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.891 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.894+0000 7f37d7fff640 1 -- 10.20.193.58:0/1152503066 >> 10.20.193.58:0/1152503066 conn(0x7f37d80b3c20 msgr2=0x7f37d80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:42.891 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.894+0000 7f37d7fff640 1 -- 10.20.193.58:0/1152503066 shutdown_connections 2026-02-23T06:42:42.891 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.894+0000 7f37d7fff640 1 -- 10.20.193.58:0/1152503066 wait complete. 2026-02-23T06:42:42.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.895+0000 7f37d7fff640 1 Processor -- start 2026-02-23T06:42:42.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.896+0000 7f37d7fff640 1 -- start start 2026-02-23T06:42:42.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.896+0000 7f37d7fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f37d80b6690 0x7f37d81653c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:42.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.896+0000 7f37d7fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f37d815d4a0 0x7f37d8200c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:42.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.896+0000 7f37d7fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f37d815d870 0x7f37d8139260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:42.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.896+0000 7f37d7fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f37d813f410 con 0x7f37d80b6690 2026-02-23T06:42:42.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.896+0000 7f37d7fff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f37d8056550 con 0x7f37d815d4a0 2026-02-23T06:42:42.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.896+0000 7f37d7fff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f37d813ed10 con 0x7f37d815d870 2026-02-23T06:42:42.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.896+0000 7f37d6ffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f37d80b6690 0x7f37d81653c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:42.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.896+0000 7f37d6ffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f37d80b6690 0x7f37d81653c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:56402/0 (socket says 10.20.193.58:56402) 2026-02-23T06:42:42.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.896+0000 7f37d6ffd640 1 -- 10.20.193.58:0/2012662778 learned_addr learned my addr 10.20.193.58:0/2012662778 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:42:42.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.897+0000 7f37d67fc640 1 --2- 10.20.193.58:0/2012662778 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f37d815d4a0 0x7f37d8200c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:42.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.897+0000 7f37d77fe640 1 --2- 10.20.193.58:0/2012662778 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f37d815d870 0x7f37d8139260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:42.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.897+0000 7f37d6ffd640 1 -- 10.20.193.58:0/2012662778 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f37d815d870 msgr2=0x7f37d8139260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:42.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.897+0000 7f37d6ffd640 1 --2- 10.20.193.58:0/2012662778 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f37d815d870 0x7f37d8139260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.897+0000 7f37d6ffd640 1 -- 10.20.193.58:0/2012662778 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f37d815d4a0 msgr2=0x7f37d8200c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:42.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.897+0000 7f37d6ffd640 1 --2- 10.20.193.58:0/2012662778 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f37d815d4a0 0x7f37d8200c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.897+0000 7f37d6ffd640 1 -- 10.20.193.58:0/2012662778 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c00094b0 con 0x7f37d80b6690 2026-02-23T06:42:42.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.897+0000 7f37d6ffd640 1 --2- 10.20.193.58:0/2012662778 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f37d80b6690 0x7f37d81653c0 secure :-1 s=READY pgs=75 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37cc00c730 tx=0x7f37cc00cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:42.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.897+0000 7f37b77fe640 1 -- 10.20.193.58:0/2012662778 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f37cc005290 con 0x7f37d80b6690 2026-02-23T06:42:42.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.897+0000 7f37b77fe640 1 -- 10.20.193.58:0/2012662778 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37cc0054e0 con 0x7f37d80b6690 2026-02-23T06:42:42.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.897+0000 7f37d7fff640 1 -- 10.20.193.58:0/2012662778 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37c800a590 con 0x7f37d80b6690 2026-02-23T06:42:42.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.897+0000 7f37b77fe640 1 -- 10.20.193.58:0/2012662778 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f37cc0038d0 con 0x7f37d80b6690 2026-02-23T06:42:42.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.897+0000 7f37d7fff640 1 -- 10.20.193.58:0/2012662778 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37d813f130 con 0x7f37d80b6690 2026-02-23T06:42:42.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.898+0000 7f37d7fff640 1 --2- 10.20.193.58:0/2012662778 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f37d813e890 0x7f37d80b76f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:42.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.898+0000 7f37d7fff640 1 -- 10.20.193.58:0/2012662778 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f37d80b6330 con 0x7f37d813e890 2026-02-23T06:42:42.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.898+0000 7f37d67fc640 1 --2- 10.20.193.58:0/2012662778 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f37d813e890 0x7f37d80b76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:42.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.899+0000 7f37d67fc640 1 -- 10.20.193.58:0/2012662778 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f37d80b5e10 con 0x7f37d813e890 2026-02-23T06:42:42.896 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.899+0000 7f37b77fe640 1 -- 10.20.193.58:0/2012662778 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f37cc003a30 con 0x7f37d80b6690 2026-02-23T06:42:42.897 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.899+0000 7f37d67fc640 1 --2- 10.20.193.58:0/2012662778 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f37d813e890 0x7f37d80b76f0 secure :-1 s=READY pgs=8 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37d813e820 tx=0x7f37c0002b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:42.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.899+0000 7f37b77fe640 1 --2- 10.20.193.58:0/2012662778 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f37a407a6b0 0x7f37a409ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:42.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.900+0000 7f37b77fe640 1 -- 10.20.193.58:0/2012662778 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f37cc09cce0 con 0x7f37d80b6690 2026-02-23T06:42:42.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.900+0000 7f37b77fe640 1 -- 10.20.193.58:0/2012662778 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f37c0011c20 con 0x7f37d813e890 2026-02-23T06:42:42.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.900+0000 7f37d77fe640 1 --2- 10.20.193.58:0/2012662778 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f37a407a6b0 0x7f37a409ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:42.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.900+0000 7f37b77fe640 1 -- 10.20.193.58:0/2012662778 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f37c0011d80 con 0x7f37d813e890 2026-02-23T06:42:42.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.900+0000 7f37b77fe640 1 -- 10.20.193.58:0/2012662778 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f37d813e890 msgr2=0x7f37d80b76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:42.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.900+0000 7f37b77fe640 1 --2- 10.20.193.58:0/2012662778 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f37d813e890 0x7f37d80b76f0 secure :-1 s=READY pgs=8 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37d813e820 tx=0x7f37c0002b40 comp rx=0 tx=0).stop 2026-02-23T06:42:42.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.900+0000 7f37b77fe640 1 -- 10.20.193.58:0/2012662778 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f37d813e890 msgr2=0x7f37d80b76f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:42:42.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.900+0000 7f37b77fe640 1 --2- 10.20.193.58:0/2012662778 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f37d813e890 0x7f37d80b76f0 unknown :-1 s=CLOSED pgs=8 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:42.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.903+0000 7f37d77fe640 1 --2- 10.20.193.58:0/2012662778 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f37a407a6b0 0x7f37a409ab60 secure :-1 s=READY pgs=470 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37c800a8c0 tx=0x7f37c8032040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:42.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.904+0000 7f37d7fff640 1 --2- 10.20.193.58:0/2012662778 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f37d80b7c30 0x7f37d80b8030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:42.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.904+0000 7f37d7fff640 1 -- 10.20.193.58:0/2012662778 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f37d80b6d50 con 0x7f37d80b7c30 2026-02-23T06:42:42.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.904+0000 7f37d67fc640 1 --2- 10.20.193.58:0/2012662778 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f37d80b7c30 0x7f37d80b8030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:42.901 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.905+0000 7f37d67fc640 1 -- 10.20.193.58:0/2012662778 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f37d80b8570 con 0x7f37d80b7c30 2026-02-23T06:42:42.901 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.905+0000 7f37d67fc640 1 --2- 10.20.193.58:0/2012662778 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f37d80b7c30 0x7f37d80b8030 secure :-1 s=READY pgs=9 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37d813e820 tx=0x7f37c0004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:42.901 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.905+0000 7f37b77fe640 1 -- 10.20.193.58:0/2012662778 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f37c001b980 con 0x7f37d80b7c30 2026-02-23T06:42:42.901 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.905+0000 7f37b77fe640 1 -- 10.20.193.58:0/2012662778 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4912 (secure 0 0 0) 0x7f37c001bae0 con 0x7f37d80b7c30 2026-02-23T06:42:42.901 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.905+0000 7f37b77fe640 1 -- 10.20.193.58:0/2012662778 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f37d80b7c30 msgr2=0x7f37d80b8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:42.901 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.905+0000 7f37b77fe640 1 --2- 10.20.193.58:0/2012662778 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f37d80b7c30 0x7f37d80b8030 secure :-1 s=READY pgs=9 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37d813e820 tx=0x7f37c0004770 comp rx=0 tx=0).stop 2026-02-23T06:42:42.901 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.905+0000 7f37b77fe640 1 -- 10.20.193.58:0/2012662778 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f37d80b7c30 msgr2=0x7f37d80b8030 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:42:42.901 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.905+0000 7f37b77fe640 1 --2- 10.20.193.58:0/2012662778 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f37d80b7c30 0x7f37d80b8030 secure :-1 s=CLOSED pgs=9 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37d813e820 tx=0x7f37c0004770 comp rx=0 tx=0).stop 2026-02-23T06:42:42.901 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:42:42.902 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:42:42.902 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:42:42.902 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:42:42.902 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 180, 2026-02-23T06:42:42.902 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 16334, 2026-02-23T06:42:42.902 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:42:42.902 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:42:42.902 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:42:42.902 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:42:42.902 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:42.903 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 16, 2026-02-23T06:42:42.903 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:42:42.903 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:42:42.903 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:42:42.903 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:42.903 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:42.903 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:42.903 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:42.903 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:42.903 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:42.903 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:42.904 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:42.904 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:42.904 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:42.904 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:42.904 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:42.904 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:42.904 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:42.904 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:42:42.904 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:42:42.904 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:42.904 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:42.904 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:42.905 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:42.905 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:42.905 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:42.905 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:42.905 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:42.905 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:42.905 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:42.905 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:42.905 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:42.905 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:42.905 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:42.905 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.906 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:42:42.906 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:42:42.906 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:42:42.906 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:42:42.906 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:42:42.906 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:42:42.906 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:42:42.906 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:42:42.906 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:42:42.906 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:42:42.906 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:42:42.906 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:42:42.907 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:42:42.907 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:42:42.907 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:42:42.907 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:42:42.907 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:42:42.907 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:42.907 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:42.907 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:42.907 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:42.907 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:42.907 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:42.907 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:42.907 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:42.908 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:42.908 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:42.908 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:42.908 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:42.908 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:42.908 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:42.908 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:42:42.908 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.908 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:42:42.908 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.908 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:42:42.908 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:42:42.909 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:42.909 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:42.909 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.909 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:42.909 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:42:42.909 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:42.909 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.909 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.909 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:42.909 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:42:42.909 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:42.909 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:42.910 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:42.910 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.910 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:42:42.910 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:42:42.910 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:42.910 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:42.910 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:42:42.910 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:42.910 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.910 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.910 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:42:42.911 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:42:42.911 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:42.911 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:42.911 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.911 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:42.911 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:42:42.911 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:42.911 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.911 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.911 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:42.911 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:42:42.911 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:42.911 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:42.911 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:42.911 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.911 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:42:42.911 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:42:42.911 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:42.911 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:42.911 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:42:42.911 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:42.911 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:42.912 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:42:42.913 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:42:42.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.907+0000 7f37d7fff640 1 -- 10.20.193.58:0/2012662778 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f37a407a6b0 msgr2=0x7f37a409ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:42.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.907+0000 7f37d7fff640 1 --2- 10.20.193.58:0/2012662778 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f37a407a6b0 0x7f37a409ab60 secure :-1 s=READY pgs=470 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37c800a8c0 tx=0x7f37c8032040 comp rx=0 tx=0).stop 2026-02-23T06:42:42.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.907+0000 7f37d7fff640 1 -- 10.20.193.58:0/2012662778 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f37d80b6690 msgr2=0x7f37d81653c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:42.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.907+0000 7f37d7fff640 1 --2- 10.20.193.58:0/2012662778 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f37d80b6690 0x7f37d81653c0 secure :-1 s=READY pgs=75 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37cc00c730 tx=0x7f37cc00cb30 comp rx=0 tx=0).stop 2026-02-23T06:42:42.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.907+0000 7f37d77fe640 1 -- 10.20.193.58:0/2012662778 reap_dead start 2026-02-23T06:42:42.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.907+0000 7f37d77fe640 1 -- 10.20.193.58:0/2012662778 reap_dead start 2026-02-23T06:42:42.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.907+0000 7f37d7fff640 1 -- 10.20.193.58:0/2012662778 shutdown_connections 2026-02-23T06:42:42.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.907+0000 7f37d7fff640 1 -- 10.20.193.58:0/2012662778 >> 10.20.193.58:0/2012662778 conn(0x7f37d80b3c20 msgr2=0x7f37d80aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:42.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.907+0000 7f37d7fff640 1 -- 10.20.193.58:0/2012662778 shutdown_connections 2026-02-23T06:42:42.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:42.907+0000 7f37d7fff640 1 -- 10.20.193.58:0/2012662778 wait complete. 2026-02-23T06:42:42.914 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:42:42.914 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-23T06:42:42.914 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-23T06:42:42.914 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-23T06:42:42.914 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-23T06:42:42.914 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-23T06:42:42.914 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:42:42.924 INFO:tasks.ceph.mon.b:Stopped 2026-02-23T06:42:42.924 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:42:42.924 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:42:43.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.050+0000 7f9b4bfff640 1 -- 10.20.193.58:0/3421556517 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b4c0b6690 msgr2=0x7f9b4c058ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:43.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.050+0000 7f9b4bfff640 1 --2- 10.20.193.58:0/3421556517 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b4c0b6690 0x7f9b4c058ec0 secure :-1 s=READY pgs=83 gs=3 cs=0 l=1 c_cookie=18187306906217490336 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b4c0b5040 tx=0x7f9b3c030360 comp rx=0 tx=0).stop 2026-02-23T06:42:43.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.050+0000 7f9b4bfff640 1 -- 10.20.193.58:0/3421556517 shutdown_connections 2026-02-23T06:42:43.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.050+0000 7f9b4bfff640 1 --2- 10.20.193.58:0/3421556517 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b4c0b6690 0x7f9b4c058ec0 unknown :-1 s=CLOSED pgs=83 gs=3 cs=0 l=1 c_cookie=18187306906217490336 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:43.046 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.050+0000 7f9b4bfff640 1 --2- 10.20.193.58:0/3421556517 >> v2:10.20.193.93:3300/0 conn(0x7f9b4c15d4a0 0x7f9b4c0affb0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:43.046 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.050+0000 7f9b4bfff640 1 -- 10.20.193.58:0/3421556517 >> 10.20.193.58:0/3421556517 conn(0x7f9b4c0b3c20 msgr2=0x7f9b4c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:43.046 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.050+0000 7f9b4bfff640 1 -- 10.20.193.58:0/3421556517 shutdown_connections 2026-02-23T06:42:43.046 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.051+0000 7f9b4bfff640 1 -- 10.20.193.58:0/3421556517 wait complete. 2026-02-23T06:42:43.046 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.052+0000 7f9b4bfff640 1 Processor -- start 2026-02-23T06:42:43.046 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.052+0000 7f9b4bfff640 1 -- start start 2026-02-23T06:42:43.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.052+0000 7f9b4bfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9b4c0b6690 0x7f9b4c13bdd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:43.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.052+0000 7f9b4bfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b4c15d4a0 0x7f9b4c162550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:43.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.052+0000 7f9b4bfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b4c15d870 0x7f9b4c15fa90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:43.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.052+0000 7f9b4bfff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c13b050 con 0x7f9b4c15d870 2026-02-23T06:42:43.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.052+0000 7f9b4bfff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c1fe540 con 0x7f9b4c15d4a0 2026-02-23T06:42:43.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.052+0000 7f9b4bfff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f9b4c13b2f0 con 0x7f9b4c0b6690 2026-02-23T06:42:43.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.052+0000 7f9b4a7fc640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b4c15d4a0 msgr2=0x7f9b4c162550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:42:43.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.052+0000 7f9b4a7fc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b4c15d4a0 0x7f9b4c162550 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:42:43.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.052+0000 7f9b4b7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b4c15d870 0x7f9b4c15fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:43.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.052+0000 7f9b4affd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9b4c0b6690 0x7f9b4c13bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:43.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.052+0000 7f9b4b7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b4c15d870 0x7f9b4c15fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:56478/0 (socket says 10.20.193.58:56478) 2026-02-23T06:42:43.047 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.053+0000 7f9b4b7fe640 1 -- 10.20.193.58:0/2367001267 learned_addr learned my addr 10.20.193.58:0/2367001267 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:42:43.048 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.053+0000 7f9b4b7fe640 1 -- 10.20.193.58:0/2367001267 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9b4c0b6690 msgr2=0x7f9b4c13bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:43.048 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.053+0000 7f9b4b7fe640 1 --2- 10.20.193.58:0/2367001267 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9b4c0b6690 0x7f9b4c13bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:43.048 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.053+0000 7f9b4b7fe640 1 -- 10.20.193.58:0/2367001267 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b4c15d4a0 msgr2=0x7f9b4c162550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:42:43.048 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.053+0000 7f9b4b7fe640 1 --2- 10.20.193.58:0/2367001267 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b4c15d4a0 0x7f9b4c162550 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:43.048 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.053+0000 7f9b4b7fe640 1 -- 10.20.193.58:0/2367001267 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3c00a650 con 0x7f9b4c15d870 2026-02-23T06:42:43.048 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.053+0000 7f9b4b7fe640 1 --2- 10.20.193.58:0/2367001267 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b4c15d870 0x7f9b4c15fa90 secure :-1 s=READY pgs=84 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b3c00a230 tx=0x7f9b3c0039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:43.048 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.053+0000 7f9b2b7fe640 1 -- 10.20.193.58:0/2367001267 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9b3c045070 con 0x7f9b4c15d870 2026-02-23T06:42:43.048 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.053+0000 7f9b2b7fe640 1 -- 10.20.193.58:0/2367001267 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b3c005c40 con 0x7f9b4c15d870 2026-02-23T06:42:43.048 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.053+0000 7f9b2b7fe640 1 -- 10.20.193.58:0/2367001267 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9b3c003e70 con 0x7f9b4c15d870 2026-02-23T06:42:43.048 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.053+0000 7f9b4bfff640 1 -- 10.20.193.58:0/2367001267 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b4c13b5d0 con 0x7f9b4c15d870 2026-02-23T06:42:43.048 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.053+0000 7f9b4bfff640 1 -- 10.20.193.58:0/2367001267 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b4c13c310 con 0x7f9b4c15d870 2026-02-23T06:42:43.050 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.055+0000 7f9b2b7fe640 1 -- 10.20.193.58:0/2367001267 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f9b3c006020 con 0x7f9b4c15d870 2026-02-23T06:42:43.050 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.055+0000 7f9b4bfff640 1 -- 10.20.193.58:0/2367001267 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b14005300 con 0x7f9b4c15d870 2026-02-23T06:42:43.051 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.056+0000 7f9b2b7fe640 1 --2- 10.20.193.58:0/2367001267 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9b1807a5b0 0x7f9b1809aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:43.051 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.056+0000 7f9b2b7fe640 1 -- 10.20.193.58:0/2367001267 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f9b3c0c3b60 con 0x7f9b4c15d870 2026-02-23T06:42:43.051 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.056+0000 7f9b4affd640 1 --2- 10.20.193.58:0/2367001267 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9b1807a5b0 0x7f9b1809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:43.052 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.057+0000 7f9b4affd640 1 --2- 10.20.193.58:0/2367001267 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9b1807a5b0 0x7f9b1809aa60 secure :-1 s=READY pgs=471 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b40002820 tx=0x7f9b40006f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:43.053 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.058+0000 7f9b2b7fe640 1 -- 10.20.193.58:0/2367001267 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f9b3c086e10 con 0x7f9b4c15d870 2026-02-23T06:42:43.217 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.222+0000 7f9b4bfff640 1 -- 10.20.193.58:0/2367001267 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9b14005b30 con 0x7f9b4c15d870 2026-02-23T06:42:43.217 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.222+0000 7f9b2b7fe640 1 -- 10.20.193.58:0/2367001267 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f9b3c089f30 con 0x7f9b4c15d870 2026-02-23T06:42:43.218 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":180,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:42:43.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.224+0000 7f9b4bfff640 1 -- 10.20.193.58:0/2367001267 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9b1807a5b0 msgr2=0x7f9b1809aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:43.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.224+0000 7f9b4bfff640 1 --2- 10.20.193.58:0/2367001267 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9b1807a5b0 0x7f9b1809aa60 secure :-1 s=READY pgs=471 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b40002820 tx=0x7f9b40006f90 comp rx=0 tx=0).stop 2026-02-23T06:42:43.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.224+0000 7f9b4bfff640 1 -- 10.20.193.58:0/2367001267 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b4c15d870 msgr2=0x7f9b4c15fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:43.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.224+0000 7f9b4bfff640 1 --2- 10.20.193.58:0/2367001267 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b4c15d870 0x7f9b4c15fa90 secure :-1 s=READY pgs=84 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b3c00a230 tx=0x7f9b3c0039b0 comp rx=0 tx=0).stop 2026-02-23T06:42:43.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.225+0000 7f9b4bfff640 1 -- 10.20.193.58:0/2367001267 shutdown_connections 2026-02-23T06:42:43.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.225+0000 7f9b4bfff640 1 --2- 10.20.193.58:0/2367001267 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9b1807a5b0 0x7f9b1809aa60 unknown :-1 s=CLOSED pgs=471 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:43.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.225+0000 7f9b4bfff640 1 --2- 10.20.193.58:0/2367001267 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b4c15d870 0x7f9b4c15fa90 unknown :-1 s=CLOSED pgs=84 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:43.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.225+0000 7f9b4bfff640 1 --2- 10.20.193.58:0/2367001267 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b4c15d4a0 0x7f9b4c162550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:43.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.225+0000 7f9b4bfff640 1 --2- 10.20.193.58:0/2367001267 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9b4c0b6690 0x7f9b4c13bdd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:43.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.225+0000 7f9b4bfff640 1 -- 10.20.193.58:0/2367001267 >> 10.20.193.58:0/2367001267 conn(0x7f9b4c0b3c20 msgr2=0x7f9b4c15bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:43.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.225+0000 7f9b4bfff640 1 -- 10.20.193.58:0/2367001267 shutdown_connections 2026-02-23T06:42:43.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:43.225+0000 7f9b4bfff640 1 -- 10.20.193.58:0/2367001267 wait complete. 2026-02-23T06:42:44.619 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:42:44.624 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:42:46.232 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:42:46.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.359+0000 7fd137243640 1 -- 10.20.193.58:0/2536280821 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd13015d4a0 msgr2=0x7fd1300affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:46.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.359+0000 7fd137243640 1 --2- 10.20.193.58:0/2536280821 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd13015d4a0 0x7fd1300affb0 secure :-1 s=READY pgs=90 gs=2 cs=0 l=1 c_cookie=10502593728081025809 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd1300afed0 tx=0x7fd12002f270 comp rx=0 tx=0).stop 2026-02-23T06:42:46.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.359+0000 7fd137243640 1 -- 10.20.193.58:0/2536280821 shutdown_connections 2026-02-23T06:42:46.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.359+0000 7fd137243640 1 --2- 10.20.193.58:0/2536280821 >> v2:10.20.193.93:3300/0 conn(0x7fd1300b6690 0x7fd130058ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:46.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.359+0000 7fd137243640 1 --2- 10.20.193.58:0/2536280821 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd13015d4a0 0x7fd1300affb0 unknown :-1 s=CLOSED pgs=90 gs=2 cs=0 l=1 c_cookie=10502593728081025809 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:46.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.359+0000 7fd137243640 1 -- 10.20.193.58:0/2536280821 >> 10.20.193.58:0/2536280821 conn(0x7fd1300b3c20 msgr2=0x7fd1300b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:46.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.359+0000 7fd137243640 1 -- 10.20.193.58:0/2536280821 shutdown_connections 2026-02-23T06:42:46.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.359+0000 7fd137243640 1 -- 10.20.193.58:0/2536280821 wait complete. 2026-02-23T06:42:46.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.361+0000 7fd137243640 1 Processor -- start 2026-02-23T06:42:46.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.361+0000 7fd137243640 1 -- start start 2026-02-23T06:42:46.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.361+0000 7fd137243640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd1300b6690 0x7fd130127440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:46.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.361+0000 7fd137243640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd13015d4a0 0x7fd13015fe00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:46.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.361+0000 7fd137243640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd13015d870 0x7fd130128f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:46.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.361+0000 7fd137243640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fd130160340 con 0x7fd13015d4a0 2026-02-23T06:42:46.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.361+0000 7fd137243640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fd1301610c0 con 0x7fd13015d870 2026-02-23T06:42:46.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.361+0000 7fd137243640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fd130057f10 con 0x7fd1300b6690 2026-02-23T06:42:46.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.361+0000 7fd136a42640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd13015d870 msgr2=0x7fd130128f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:42:46.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.361+0000 7fd136a42640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd13015d870 0x7fd130128f60 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:42:46.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.361+0000 7fd135a40640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd13015d4a0 0x7fd13015fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:46.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.361+0000 7fd135a40640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd13015d4a0 0x7fd13015fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:56506/0 (socket says 10.20.193.58:56506) 2026-02-23T06:42:46.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.361+0000 7fd135a40640 1 -- 10.20.193.58:0/896741401 learned_addr learned my addr 10.20.193.58:0/896741401 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:42:46.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.361+0000 7fd136241640 1 --2- 10.20.193.58:0/896741401 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd1300b6690 0x7fd130127440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:46.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.362+0000 7fd135a40640 1 -- 10.20.193.58:0/896741401 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd1300b6690 msgr2=0x7fd130127440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:46.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.362+0000 7fd135a40640 1 --2- 10.20.193.58:0/896741401 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd1300b6690 0x7fd130127440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:46.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.362+0000 7fd135a40640 1 -- 10.20.193.58:0/896741401 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd13015d870 msgr2=0x7fd130128f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:42:46.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.362+0000 7fd135a40640 1 --2- 10.20.193.58:0/896741401 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd13015d870 0x7fd130128f60 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:46.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.362+0000 7fd135a40640 1 -- 10.20.193.58:0/896741401 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd120009570 con 0x7fd13015d4a0 2026-02-23T06:42:46.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.362+0000 7fd135a40640 1 --2- 10.20.193.58:0/896741401 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd13015d4a0 0x7fd13015fe00 secure :-1 s=READY pgs=91 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd12400c500 tx=0x7fd12400c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:46.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.362+0000 7fd116ffd640 1 -- 10.20.193.58:0/896741401 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd124004250 con 0x7fd13015d4a0 2026-02-23T06:42:46.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.362+0000 7fd116ffd640 1 -- 10.20.193.58:0/896741401 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1240044a0 con 0x7fd13015d4a0 2026-02-23T06:42:46.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.362+0000 7fd137243640 1 -- 10.20.193.58:0/896741401 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd130058140 con 0x7fd13015d4a0 2026-02-23T06:42:46.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.362+0000 7fd116ffd640 1 -- 10.20.193.58:0/896741401 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd124006b10 con 0x7fd13015d4a0 2026-02-23T06:42:46.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.362+0000 7fd137243640 1 -- 10.20.193.58:0/896741401 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd13015f040 con 0x7fd13015d4a0 2026-02-23T06:42:46.358 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.363+0000 7fd137243640 1 -- 10.20.193.58:0/896741401 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1300b6d50 con 0x7fd13015d4a0 2026-02-23T06:42:46.359 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.364+0000 7fd116ffd640 1 -- 10.20.193.58:0/896741401 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fd124003670 con 0x7fd13015d4a0 2026-02-23T06:42:46.360 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.365+0000 7fd116ffd640 1 --2- 10.20.193.58:0/896741401 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd10007a5a0 0x7fd10009aa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:46.360 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.365+0000 7fd116ffd640 1 -- 10.20.193.58:0/896741401 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fd12409ca90 con 0x7fd13015d4a0 2026-02-23T06:42:46.360 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.365+0000 7fd136241640 1 --2- 10.20.193.58:0/896741401 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd10007a5a0 0x7fd10009aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:46.360 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.366+0000 7fd136241640 1 --2- 10.20.193.58:0/896741401 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd10007a5a0 0x7fd10009aa50 secure :-1 s=READY pgs=472 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd1200098a0 tx=0x7fd12003a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:46.362 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.367+0000 7fd116ffd640 1 -- 10.20.193.58:0/896741401 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fd12405fce0 con 0x7fd13015d4a0 2026-02-23T06:42:46.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.524+0000 7fd137243640 1 -- 10.20.193.58:0/896741401 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd130161230 con 0x7fd13015d4a0 2026-02-23T06:42:46.518 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.524+0000 7fd116ffd640 1 -- 10.20.193.58:0/896741401 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7fd130161230 con 0x7fd13015d4a0 2026-02-23T06:42:46.519 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":180,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:42:46.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.525+0000 7fd137243640 1 -- 10.20.193.58:0/896741401 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd10007a5a0 msgr2=0x7fd10009aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:46.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.525+0000 7fd137243640 1 --2- 10.20.193.58:0/896741401 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd10007a5a0 0x7fd10009aa50 secure :-1 s=READY pgs=472 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd1200098a0 tx=0x7fd12003a040 comp rx=0 tx=0).stop 2026-02-23T06:42:46.520 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.525+0000 7fd137243640 1 -- 10.20.193.58:0/896741401 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd13015d4a0 msgr2=0x7fd13015fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:46.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.525+0000 7fd137243640 1 --2- 10.20.193.58:0/896741401 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd13015d4a0 0x7fd13015fe00 secure :-1 s=READY pgs=91 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd12400c500 tx=0x7fd12400c9d0 comp rx=0 tx=0).stop 2026-02-23T06:42:46.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.525+0000 7fd137243640 1 -- 10.20.193.58:0/896741401 shutdown_connections 2026-02-23T06:42:46.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.525+0000 7fd137243640 1 --2- 10.20.193.58:0/896741401 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd10007a5a0 0x7fd10009aa50 unknown :-1 s=CLOSED pgs=472 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:46.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.525+0000 7fd137243640 1 --2- 10.20.193.58:0/896741401 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd13015d870 0x7fd130128f60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:46.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.525+0000 7fd137243640 1 --2- 10.20.193.58:0/896741401 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd13015d4a0 0x7fd13015fe00 unknown :-1 s=CLOSED pgs=91 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:46.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.525+0000 7fd137243640 1 --2- 10.20.193.58:0/896741401 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd1300b6690 0x7fd130127440 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:46.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.525+0000 7fd137243640 1 -- 10.20.193.58:0/896741401 >> 10.20.193.58:0/896741401 conn(0x7fd1300b3c20 msgr2=0x7fd1301633c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:46.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.525+0000 7fd137243640 1 -- 10.20.193.58:0/896741401 shutdown_connections 2026-02-23T06:42:46.521 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:46.525+0000 7fd137243640 1 -- 10.20.193.58:0/896741401 wait complete. 2026-02-23T06:42:49.534 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:42:49.656 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.661+0000 7fb92dbd2640 1 -- 10.20.193.58:0/2516643554 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb928162ca0 msgr2=0x7fb9280b6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:49.656 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.661+0000 7fb92dbd2640 1 --2- 10.20.193.58:0/2516643554 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb928162ca0 0x7fb9280b6c60 secure :-1 s=READY pgs=93 gs=1 cs=0 l=1 c_cookie=12596270524798036748 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb928059b80 tx=0x7fb924030320 comp rx=0 tx=0).stop 2026-02-23T06:42:49.657 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.661+0000 7fb92dbd2640 1 -- 10.20.193.58:0/2516643554 shutdown_connections 2026-02-23T06:42:49.657 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.661+0000 7fb92dbd2640 1 --2- 10.20.193.58:0/2516643554 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb928162ca0 0x7fb9280b6c60 unknown :-1 s=CLOSED pgs=93 gs=1 cs=0 l=1 c_cookie=12596270524798036748 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:49.657 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.661+0000 7fb92dbd2640 1 --2- 10.20.193.58:0/2516643554 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb928056960 0x7fb9280b6720 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:49.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.661+0000 7fb92dbd2640 1 --2- 10.20.193.58:0/2516643554 >> v2:10.20.193.93:3300/0 conn(0x7fb92815c4b0 0x7fb928058200 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:49.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.661+0000 7fb92dbd2640 1 -- 10.20.193.58:0/2516643554 >> 10.20.193.58:0/2516643554 conn(0x7fb9280b3c20 msgr2=0x7fb9280b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:49.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.661+0000 7fb92dbd2640 1 -- 10.20.193.58:0/2516643554 shutdown_connections 2026-02-23T06:42:49.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.661+0000 7fb92dbd2640 1 -- 10.20.193.58:0/2516643554 wait complete. 2026-02-23T06:42:49.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.662+0000 7fb92dbd2640 1 Processor -- start 2026-02-23T06:42:49.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.662+0000 7fb92dbd2640 1 -- start start 2026-02-23T06:42:49.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.662+0000 7fb92dbd2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb928056960 0x7fb92814df90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:49.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.662+0000 7fb92dbd2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb92815c4b0 0x7fb92813d3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:49.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.662+0000 7fb92dbd2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb928162ca0 0x7fb92813dfb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:49.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.662+0000 7fb92dbd2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb92814db70 con 0x7fb92815c4b0 2026-02-23T06:42:49.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.662+0000 7fb92dbd2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb92814af70 con 0x7fb928162ca0 2026-02-23T06:42:49.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.662+0000 7fb92dbd2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb928149f50 con 0x7fb928056960 2026-02-23T06:42:49.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.662+0000 7fb91ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb92815c4b0 0x7fb92813d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:49.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.662+0000 7fb91ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb92815c4b0 0x7fb92813d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:49782/0 (socket says 10.20.193.58:49782) 2026-02-23T06:42:49.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.662+0000 7fb91ffff640 1 -- 10.20.193.58:0/2487999309 learned_addr learned my addr 10.20.193.58:0/2487999309 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:42:49.662 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.662+0000 7fb91ffff640 1 -- 10.20.193.58:0/2487999309 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb928056960 msgr2=0x7fb92814df90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-23T06:42:49.662 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.662+0000 7fb91ffff640 1 --2- 10.20.193.58:0/2487999309 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb928056960 0x7fb92814df90 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:49.662 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.662+0000 7fb91ffff640 1 -- 10.20.193.58:0/2487999309 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb928162ca0 msgr2=0x7fb92813dfb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-23T06:42:49.662 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.662+0000 7fb91ffff640 1 --2- 10.20.193.58:0/2487999309 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb928162ca0 0x7fb92813dfb0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:49.662 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.662+0000 7fb91ffff640 1 -- 10.20.193.58:0/2487999309 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb92400a650 con 0x7fb92815c4b0 2026-02-23T06:42:49.662 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.662+0000 7fb91ffff640 1 --2- 10.20.193.58:0/2487999309 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb92815c4b0 0x7fb92813d3f0 secure :-1 s=READY pgs=94 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb91000b520 tx=0x7fb91000b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:49.662 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.662+0000 7fb91d7fa640 1 -- 10.20.193.58:0/2487999309 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9100044a0 con 0x7fb92815c4b0 2026-02-23T06:42:49.662 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.662+0000 7fb91d7fa640 1 -- 10.20.193.58:0/2487999309 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb910002740 con 0x7fb92815c4b0 2026-02-23T06:42:49.662 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.662+0000 7fb91d7fa640 1 -- 10.20.193.58:0/2487999309 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb910002b70 con 0x7fb92815c4b0 2026-02-23T06:42:49.662 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.662+0000 7fb92dbd2640 1 -- 10.20.193.58:0/2487999309 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb92814e4d0 con 0x7fb92815c4b0 2026-02-23T06:42:49.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.662+0000 7fb92dbd2640 1 -- 10.20.193.58:0/2487999309 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb928124ca0 con 0x7fb92815c4b0 2026-02-23T06:42:49.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.664+0000 7fb92dbd2640 1 -- 10.20.193.58:0/2487999309 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb92814dcb0 con 0x7fb92815c4b0 2026-02-23T06:42:49.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.665+0000 7fb91d7fa640 1 -- 10.20.193.58:0/2487999309 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fb91001f020 con 0x7fb92815c4b0 2026-02-23T06:42:49.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.666+0000 7fb91d7fa640 1 --2- 10.20.193.58:0/2487999309 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb8f807a6c0 0x7fb8f809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:49.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.666+0000 7fb91d7fa640 1 -- 10.20.193.58:0/2487999309 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fb91009ce00 con 0x7fb92815c4b0 2026-02-23T06:42:49.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.666+0000 7fb92cbd0640 1 --2- 10.20.193.58:0/2487999309 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb8f807a6c0 0x7fb8f809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:49.664 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.667+0000 7fb92cbd0640 1 --2- 10.20.193.58:0/2487999309 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb8f807a6c0 0x7fb8f809ab70 secure :-1 s=READY pgs=473 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb918004760 tx=0x7fb918006c80 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:49.664 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.668+0000 7fb91d7fa640 1 -- 10.20.193.58:0/2487999309 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fb92814dcb0 con 0x7fb92815c4b0 2026-02-23T06:42:49.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.828+0000 7fb92dbd2640 1 -- 10.20.193.58:0/2487999309 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb92814e4d0 con 0x7fb92815c4b0 2026-02-23T06:42:49.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.829+0000 7fb91d7fa640 1 -- 10.20.193.58:0/2487999309 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7fb92814e4d0 con 0x7fb92815c4b0 2026-02-23T06:42:49.825 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":180,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:42:49.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.832+0000 7fb92dbd2640 1 -- 10.20.193.58:0/2487999309 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb8f807a6c0 msgr2=0x7fb8f809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:49.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.832+0000 7fb92dbd2640 1 --2- 10.20.193.58:0/2487999309 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb8f807a6c0 0x7fb8f809ab70 secure :-1 s=READY pgs=473 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb918004760 tx=0x7fb918006c80 comp rx=0 tx=0).stop 2026-02-23T06:42:49.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.832+0000 7fb92dbd2640 1 -- 10.20.193.58:0/2487999309 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb92815c4b0 msgr2=0x7fb92813d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:49.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.832+0000 7fb92dbd2640 1 --2- 10.20.193.58:0/2487999309 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb92815c4b0 0x7fb92813d3f0 secure :-1 s=READY pgs=94 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb91000b520 tx=0x7fb91000b9f0 comp rx=0 tx=0).stop 2026-02-23T06:42:49.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.832+0000 7fb92dbd2640 1 -- 10.20.193.58:0/2487999309 shutdown_connections 2026-02-23T06:42:49.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.832+0000 7fb92dbd2640 1 --2- 10.20.193.58:0/2487999309 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb8f807a6c0 0x7fb8f809ab70 unknown :-1 s=CLOSED pgs=473 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:49.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.832+0000 7fb92dbd2640 1 --2- 10.20.193.58:0/2487999309 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb928162ca0 0x7fb92813dfb0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:49.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.832+0000 7fb92dbd2640 1 --2- 10.20.193.58:0/2487999309 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb92815c4b0 0x7fb92813d3f0 unknown :-1 s=CLOSED pgs=94 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:49.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.832+0000 7fb92dbd2640 1 --2- 10.20.193.58:0/2487999309 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb928056960 0x7fb92814df90 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:49.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.832+0000 7fb92dbd2640 1 -- 10.20.193.58:0/2487999309 >> 10.20.193.58:0/2487999309 conn(0x7fb9280b3c20 msgr2=0x7fb928159d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:49.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.832+0000 7fb92dbd2640 1 -- 10.20.193.58:0/2487999309 shutdown_connections 2026-02-23T06:42:49.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:49.832+0000 7fb92dbd2640 1 -- 10.20.193.58:0/2487999309 wait complete. 2026-02-23T06:42:52.841 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:42:57.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.372+0000 7fe9157d2640 1 -- 10.20.193.58:0/3501844819 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe8ec003750 msgr2=0x7fe8ec023b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:57.369 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.372+0000 7fe9157d2640 1 --2- 10.20.193.58:0/3501844819 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe8ec003750 0x7fe8ec023b90 secure :-1 s=READY pgs=28 gs=25 cs=0 l=1 c_cookie=3974812739819527366 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8fc0096a0 tx=0x7fe8fc02fab0 comp rx=0 tx=0).stop 2026-02-23T06:42:57.370 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.372+0000 7fe914fd1640 1 -- 10.20.193.58:0/3501844819 reap_dead start 2026-02-23T06:42:57.370 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.373+0000 7fe9157d2640 1 -- 10.20.193.58:0/3501844819 shutdown_connections 2026-02-23T06:42:57.370 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.373+0000 7fe9157d2640 1 -- 10.20.193.58:0/3501844819 >> 10.20.193.58:0/3501844819 conn(0x7fe9100b3c20 msgr2=0x7fe9100b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:57.370 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.373+0000 7fe9157d2640 1 -- 10.20.193.58:0/3501844819 shutdown_connections 2026-02-23T06:42:57.370 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.373+0000 7fe9157d2640 1 -- 10.20.193.58:0/3501844819 wait complete. 2026-02-23T06:42:57.370 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.374+0000 7fe9157d2640 1 Processor -- start 2026-02-23T06:42:57.370 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.374+0000 7fe9157d2640 1 -- start start 2026-02-23T06:42:57.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.375+0000 7fe9157d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe910058780 0x7fe9100aee90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:57.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.375+0000 7fe9157d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe9100b1090 0x7fe9100af3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:57.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.375+0000 7fe9157d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe910058b50 0x7fe910124dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:57.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.375+0000 7fe9157d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe910155d10 con 0x7fe9100b1090 2026-02-23T06:42:57.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.375+0000 7fe9157d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe910155a50 con 0x7fe910058b50 2026-02-23T06:42:57.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.375+0000 7fe9157d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe910155610 con 0x7fe910058780 2026-02-23T06:42:57.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.375+0000 7fe914fd1640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe910058b50 msgr2=0x7fe910124dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:42:57.373 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.375+0000 7fe914fd1640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe910058b50 0x7fe910124dd0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:42:57.374 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.375+0000 7fe90f7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe9100b1090 0x7fe9100af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:57.374 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.375+0000 7fe90f7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe9100b1090 0x7fe9100af3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:49828/0 (socket says 10.20.193.58:49828) 2026-02-23T06:42:57.374 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.375+0000 7fe90f7fe640 1 -- 10.20.193.58:0/1010792321 learned_addr learned my addr 10.20.193.58:0/1010792321 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:42:57.374 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.375+0000 7fe90ffff640 1 --2- 10.20.193.58:0/1010792321 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe910058780 0x7fe9100aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:57.374 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.375+0000 7fe90f7fe640 1 -- 10.20.193.58:0/1010792321 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe910058780 msgr2=0x7fe9100aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:57.374 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.375+0000 7fe90f7fe640 1 --2- 10.20.193.58:0/1010792321 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe910058780 0x7fe9100aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:57.374 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.375+0000 7fe90f7fe640 1 -- 10.20.193.58:0/1010792321 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe910058b50 msgr2=0x7fe910124dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:42:57.374 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.375+0000 7fe90f7fe640 1 --2- 10.20.193.58:0/1010792321 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe910058b50 0x7fe910124dd0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:57.374 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.375+0000 7fe90f7fe640 1 -- 10.20.193.58:0/1010792321 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8fc009170 con 0x7fe9100b1090 2026-02-23T06:42:57.374 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.375+0000 7fe90ffff640 1 --2- 10.20.193.58:0/1010792321 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe910058780 0x7fe9100aee90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:42:57.374 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.375+0000 7fe90f7fe640 1 --2- 10.20.193.58:0/1010792321 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe9100b1090 0x7fe9100af3d0 secure :-1 s=READY pgs=97 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe900013740 tx=0x7fe900004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:57.375 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.375+0000 7fe90cff9640 1 -- 10.20.193.58:0/1010792321 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe900011d90 con 0x7fe9100b1090 2026-02-23T06:42:57.375 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.375+0000 7fe90cff9640 1 -- 10.20.193.58:0/1010792321 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe900013e00 con 0x7fe9100b1090 2026-02-23T06:42:57.375 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.375+0000 7fe90cff9640 1 -- 10.20.193.58:0/1010792321 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe90001b670 con 0x7fe9100b1090 2026-02-23T06:42:57.375 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.376+0000 7fe9157d2640 1 -- 10.20.193.58:0/1010792321 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9100b0ce0 con 0x7fe9100b1090 2026-02-23T06:42:57.375 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.376+0000 7fe9157d2640 1 -- 10.20.193.58:0/1010792321 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9100ae220 con 0x7fe9100b1090 2026-02-23T06:42:57.375 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.377+0000 7fe9157d2640 1 -- 10.20.193.58:0/1010792321 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe910155390 con 0x7fe9100b1090 2026-02-23T06:42:57.375 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.378+0000 7fe90cff9640 1 -- 10.20.193.58:0/1010792321 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fe90002b080 con 0x7fe9100b1090 2026-02-23T06:42:57.376 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.379+0000 7fe90cff9640 1 --2- 10.20.193.58:0/1010792321 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe8e007a5b0 0x7fe8e009aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:57.376 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.379+0000 7fe90cff9640 1 -- 10.20.193.58:0/1010792321 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fe90009eb20 con 0x7fe9100b1090 2026-02-23T06:42:57.376 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.379+0000 7fe90ffff640 1 --2- 10.20.193.58:0/1010792321 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe8e007a5b0 0x7fe8e009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:57.376 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.380+0000 7fe90cff9640 1 -- 10.20.193.58:0/1010792321 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fe900061c20 con 0x7fe9100b1090 2026-02-23T06:42:57.376 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.380+0000 7fe90ffff640 1 --2- 10.20.193.58:0/1010792321 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe8e007a5b0 0x7fe8e009aa60 secure :-1 s=READY pgs=474 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8fc002b50 tx=0x7fe8fc041040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:57.534 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.538+0000 7fe9157d2640 1 -- 10.20.193.58:0/1010792321 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe910155390 con 0x7fe9100b1090 2026-02-23T06:42:57.534 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.539+0000 7fe90cff9640 1 -- 10.20.193.58:0/1010792321 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1749 (secure 0 0 0) 0x7fe90009ae60 con 0x7fe9100b1090 2026-02-23T06:42:57.534 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":184,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:42:57.536 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.541+0000 7fe9157d2640 1 -- 10.20.193.58:0/1010792321 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe8e007a5b0 msgr2=0x7fe8e009aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:57.536 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.541+0000 7fe9157d2640 1 --2- 10.20.193.58:0/1010792321 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe8e007a5b0 0x7fe8e009aa60 secure :-1 s=READY pgs=474 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8fc002b50 tx=0x7fe8fc041040 comp rx=0 tx=0).stop 2026-02-23T06:42:57.536 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.541+0000 7fe9157d2640 1 -- 10.20.193.58:0/1010792321 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe9100b1090 msgr2=0x7fe9100af3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:57.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.541+0000 7fe9157d2640 1 --2- 10.20.193.58:0/1010792321 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe9100b1090 0x7fe9100af3d0 secure :-1 s=READY pgs=97 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe900013740 tx=0x7fe900004700 comp rx=0 tx=0).stop 2026-02-23T06:42:57.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.541+0000 7fe9157d2640 1 -- 10.20.193.58:0/1010792321 shutdown_connections 2026-02-23T06:42:57.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.541+0000 7fe9157d2640 1 --2- 10.20.193.58:0/1010792321 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe8e007a5b0 0x7fe8e009aa60 unknown :-1 s=CLOSED pgs=474 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:57.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.541+0000 7fe9157d2640 1 --2- 10.20.193.58:0/1010792321 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe910058b50 0x7fe910124dd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:57.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.541+0000 7fe9157d2640 1 --2- 10.20.193.58:0/1010792321 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe9100b1090 0x7fe9100af3d0 unknown :-1 s=CLOSED pgs=97 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:57.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.541+0000 7fe9157d2640 1 --2- 10.20.193.58:0/1010792321 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe910058780 0x7fe9100aee90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:57.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.541+0000 7fe9157d2640 1 -- 10.20.193.58:0/1010792321 >> 10.20.193.58:0/1010792321 conn(0x7fe9100b3c20 msgr2=0x7fe91015a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:57.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.541+0000 7fe9157d2640 1 -- 10.20.193.58:0/1010792321 shutdown_connections 2026-02-23T06:42:57.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.541+0000 7fe9157d2640 1 -- 10.20.193.58:0/1010792321 wait complete. 2026-02-23T06:42:57.549 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:42:57.549 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-23T06:42:57.549 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:42:57.673 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.677+0000 7f5ce3577640 1 -- 10.20.193.58:0/510105551 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ce415d870 msgr2=0x7f5ce40587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:57.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.677+0000 7f5ce3577640 1 --2- 10.20.193.58:0/510105551 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ce415d870 0x7f5ce40587b0 secure :-1 s=READY pgs=98 gs=1 cs=0 l=1 c_cookie=7361241784150169129 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ce40b1b90 tx=0x7f5ccc02f270 comp rx=0 tx=0).stop 2026-02-23T06:42:57.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.677+0000 7f5ce3577640 1 -- 10.20.193.58:0/510105551 shutdown_connections 2026-02-23T06:42:57.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.677+0000 7f5ce3577640 1 --2- 10.20.193.58:0/510105551 >> v2:10.20.193.93:3300/0 conn(0x7f5ce40b6690 0x7f5ce4058cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:57.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.677+0000 7f5ce3577640 1 --2- 10.20.193.58:0/510105551 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ce415d870 0x7f5ce40587b0 unknown :-1 s=CLOSED pgs=98 gs=1 cs=0 l=1 c_cookie=7361241784150169129 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:57.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.677+0000 7f5ce3577640 1 --2- 10.20.193.58:0/510105551 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ce415d4a0 0x7f5ce40affb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:57.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.677+0000 7f5ce3577640 1 -- 10.20.193.58:0/510105551 >> 10.20.193.58:0/510105551 conn(0x7f5ce40b3c20 msgr2=0x7f5ce40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:57.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.677+0000 7f5ce3577640 1 -- 10.20.193.58:0/510105551 shutdown_connections 2026-02-23T06:42:57.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.677+0000 7f5ce3577640 1 -- 10.20.193.58:0/510105551 wait complete. 2026-02-23T06:42:57.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.678+0000 7f5ce3577640 1 Processor -- start 2026-02-23T06:42:57.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.678+0000 7f5ce3577640 1 -- start start 2026-02-23T06:42:57.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.679+0000 7f5ce3577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ce40b6690 0x7f5ce41397e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:57.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.679+0000 7f5ce3577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ce415d4a0 0x7f5ce411d4e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:57.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.679+0000 7f5ce3577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5ce415d870 0x7f5ce411e900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:57.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.679+0000 7f5ce3577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce41615f0 con 0x7f5ce40b6690 2026-02-23T06:42:57.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.679+0000 7f5ce3577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce411ae20 con 0x7f5ce415d870 2026-02-23T06:42:57.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.679+0000 7f5ce3577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f5ce411b290 con 0x7f5ce415d4a0 2026-02-23T06:42:57.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.679+0000 7f5ce1d74640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ce415d4a0 0x7f5ce411d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:57.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.679+0000 7f5ce2575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ce40b6690 0x7f5ce41397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:57.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.679+0000 7f5ce1d74640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ce415d4a0 0x7f5ce411d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:60984/0 (socket says 10.20.193.58:60984) 2026-02-23T06:42:57.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.679+0000 7f5ce1d74640 1 -- 10.20.193.58:0/990472360 learned_addr learned my addr 10.20.193.58:0/990472360 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:42:57.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.679+0000 7f5ce2d76640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5ce415d870 msgr2=0x7f5ce411e900 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:42:57.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.679+0000 7f5ce2d76640 1 --2- 10.20.193.58:0/990472360 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5ce415d870 0x7f5ce411e900 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:42:57.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.679+0000 7f5ce2575640 1 -- 10.20.193.58:0/990472360 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ce415d4a0 msgr2=0x7f5ce411d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:57.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.679+0000 7f5ce2575640 1 --2- 10.20.193.58:0/990472360 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ce415d4a0 0x7f5ce411d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:57.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.679+0000 7f5ce2575640 1 -- 10.20.193.58:0/990472360 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5ce415d870 msgr2=0x7f5ce411e900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:42:57.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.679+0000 7f5ce2575640 1 --2- 10.20.193.58:0/990472360 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5ce415d870 0x7f5ce411e900 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:57.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.679+0000 7f5ce2575640 1 -- 10.20.193.58:0/990472360 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ccc009570 con 0x7f5ce40b6690 2026-02-23T06:42:57.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.680+0000 7f5ce2575640 1 --2- 10.20.193.58:0/990472360 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ce40b6690 0x7f5ce41397e0 secure :-1 s=READY pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cd800d700 tx=0x7f5cd800dbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:57.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.680+0000 7f5ccaffd640 1 -- 10.20.193.58:0/990472360 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5cd8004500 con 0x7f5ce40b6690 2026-02-23T06:42:57.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.680+0000 7f5ccaffd640 1 -- 10.20.193.58:0/990472360 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5cd8004850 con 0x7f5ce40b6690 2026-02-23T06:42:57.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.680+0000 7f5ccaffd640 1 -- 10.20.193.58:0/990472360 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5cd8004c40 con 0x7f5ce40b6690 2026-02-23T06:42:57.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.680+0000 7f5ce3577640 1 -- 10.20.193.58:0/990472360 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ce4161030 con 0x7f5ce40b6690 2026-02-23T06:42:57.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.680+0000 7f5ce3577640 1 -- 10.20.193.58:0/990472360 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ce411da20 con 0x7f5ce40b6690 2026-02-23T06:42:57.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.680+0000 7f5ce3577640 1 --2- 10.20.193.58:0/990472360 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ce4162f40 0x7f5ce4161fe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:57.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.680+0000 7f5ce3577640 1 -- 10.20.193.58:0/990472360 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce40609c0 con 0x7f5ce4162f40 2026-02-23T06:42:57.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.681+0000 7f5ce1d74640 1 --2- 10.20.193.58:0/990472360 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ce4162f40 0x7f5ce4161fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:57.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.681+0000 7f5ce1d74640 1 -- 10.20.193.58:0/990472360 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ce4164250 con 0x7f5ce4162f40 2026-02-23T06:42:57.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.681+0000 7f5ce1d74640 1 --2- 10.20.193.58:0/990472360 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ce4162f40 0x7f5ce4161fe0 secure :-1 s=READY pgs=100 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ccc0023d0 tx=0x7f5ccc0028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:57.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.681+0000 7f5ccaffd640 1 -- 10.20.193.58:0/990472360 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ccc03d050 con 0x7f5ce4162f40 2026-02-23T06:42:57.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.681+0000 7f5ccaffd640 1 -- 10.20.193.58:0/990472360 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f5cd8009820 con 0x7f5ce40b6690 2026-02-23T06:42:57.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.682+0000 7f5ccaffd640 1 --2- 10.20.193.58:0/990472360 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5cb007a660 0x7f5cb009ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:57.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.682+0000 7f5ccaffd640 1 -- 10.20.193.58:0/990472360 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f5cd809d690 con 0x7f5ce40b6690 2026-02-23T06:42:57.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.682+0000 7f5ccaffd640 1 -- 10.20.193.58:0/990472360 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f5ccc03e040 con 0x7f5ce4162f40 2026-02-23T06:42:57.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.682+0000 7f5ccaffd640 1 -- 10.20.193.58:0/990472360 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ce4162f40 msgr2=0x7f5ce4161fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:57.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.682+0000 7f5ccaffd640 1 --2- 10.20.193.58:0/990472360 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ce4162f40 0x7f5ce4161fe0 secure :-1 s=READY pgs=100 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ccc0023d0 tx=0x7f5ccc0028d0 comp rx=0 tx=0).stop 2026-02-23T06:42:57.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.682+0000 7f5ccaffd640 1 -- 10.20.193.58:0/990472360 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ce4162f40 msgr2=0x7f5ce4161fe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:42:57.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.682+0000 7f5ccaffd640 1 --2- 10.20.193.58:0/990472360 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ce4162f40 0x7f5ce4161fe0 secure :-1 s=CLOSED pgs=100 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ccc0023d0 tx=0x7f5ccc0028d0 comp rx=0 tx=0).stop 2026-02-23T06:42:57.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.683+0000 7f5ce2d76640 1 --2- 10.20.193.58:0/990472360 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5cb007a660 0x7f5cb009ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:57.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.683+0000 7f5ce2d76640 1 --2- 10.20.193.58:0/990472360 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5cb007a660 0x7f5cb009ab10 secure :-1 s=READY pgs=475 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cd4003900 tx=0x7f5cd4007d80 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:57.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.686+0000 7f5ce3577640 1 --2- 10.20.193.58:0/990472360 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ce4162520 0x7f5ce414b990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:57.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.686+0000 7f5ce3577640 1 -- 10.20.193.58:0/990472360 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce405b0e0 con 0x7f5ce4162520 2026-02-23T06:42:57.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.686+0000 7f5ce1d74640 1 --2- 10.20.193.58:0/990472360 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ce4162520 0x7f5ce414b990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:57.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.686+0000 7f5ce1d74640 1 -- 10.20.193.58:0/990472360 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5ce40b7260 con 0x7f5ce4162520 2026-02-23T06:42:57.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.686+0000 7f5ce1d74640 1 --2- 10.20.193.58:0/990472360 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ce4162520 0x7f5ce414b990 secure :-1 s=READY pgs=101 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ccc005b30 tx=0x7f5ccc009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:57.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.687+0000 7f5ccaffd640 1 -- 10.20.193.58:0/990472360 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ccc052070 con 0x7f5ce4162520 2026-02-23T06:42:57.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.687+0000 7f5ccaffd640 1 -- 10.20.193.58:0/990472360 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5546 (secure 0 0 0) 0x7f5ccc038c60 con 0x7f5ce4162520 2026-02-23T06:42:57.684 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:42:57.684 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:42:57.684 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:42:57.684 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:42:57.684 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 184, 2026-02-23T06:42:57.684 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 77807, 2026-02-23T06:42:57.685 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:42:57.685 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:42:57.685 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:42:57.685 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:57.685 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:42:57.685 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:42:57.685 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:42:57.685 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:42:57.685 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:57.685 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:57.685 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:57.685 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:57.686 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:57.686 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:57.686 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:57.686 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:57.686 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:57.686 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:57.686 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:57.686 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:57.686 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:57.686 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:57.686 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:42:57.686 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:42:57.687 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:57.687 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:57.687 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:57.687 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:57.687 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:57.687 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:57.687 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:57.687 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:57.687 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:57.687 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:57.687 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:57.687 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:57.688 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:57.688 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:57.688 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:57.688 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:42:57.688 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:42:57.688 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:42:57.688 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:42:57.688 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:42:57.688 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:42:57.688 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:42:57.688 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:42:57.688 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:42:57.689 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:42:57.689 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:42:57.689 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:42:57.689 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:42:57.689 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:42:57.689 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:42:57.689 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:42:57.689 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:42:57.689 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:57.689 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:57.689 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:57.689 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:57.689 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:57.690 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:57.690 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:57.690 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:57.690 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:57.690 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:57.690 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:57.690 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:57.690 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:57.690 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:57.690 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:42:57.690 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:57.690 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:42:57.691 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.691 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:42:57.691 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:42:57.691 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:57.691 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:57.691 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.691 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:57.691 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:42:57.691 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:57.691 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:57.691 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.691 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:57.691 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:42:57.692 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:57.692 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:57.692 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:57.692 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:57.692 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:42:57.692 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:42:57.692 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:57.692 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:57.692 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:42:57.692 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:57.692 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:57.692 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.693 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:42:57.693 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:42:57.693 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:57.693 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:57.693 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.693 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:57.693 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:42:57.693 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:57.693 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:57.693 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.693 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:57.693 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:42:57.693 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:57.694 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:57.694 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:57.694 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:57.694 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:42:57.694 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:42:57.694 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:57.694 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:57.694 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:42:57.694 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:57.694 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:57.694 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.694 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:42:57.694 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:42:57.695 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:57.695 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:57.695 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.695 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:57.695 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:42:57.695 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:57.695 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:57.695 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.695 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:57.695 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:42:57.695 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:57.695 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:57.695 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:57.696 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:57.696 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:42:57.696 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:42:57.696 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:57.696 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:57.696 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:42:57.696 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:57.696 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:57.696 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:57.696 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:57.696 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:42:57.696 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:57.697 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:42:57.698 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:57.698 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:57.698 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:42:57.698 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.698 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:57.698 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:57.698 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:42:57.698 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:57.698 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:57.698 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:57.698 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:42:57.698 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:42:57.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.687+0000 7f5ccaffd640 1 -- 10.20.193.58:0/990472360 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ce4162520 msgr2=0x7f5ce414b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:57.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.687+0000 7f5ccaffd640 1 --2- 10.20.193.58:0/990472360 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ce4162520 0x7f5ce414b990 secure :-1 s=READY pgs=101 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ccc005b30 tx=0x7f5ccc009310 comp rx=0 tx=0).stop 2026-02-23T06:42:57.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.687+0000 7f5ccaffd640 1 -- 10.20.193.58:0/990472360 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ce4162520 msgr2=0x7f5ce414b990 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:42:57.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.687+0000 7f5ccaffd640 1 --2- 10.20.193.58:0/990472360 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ce4162520 0x7f5ce414b990 secure :-1 s=CLOSED pgs=101 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ccc005b30 tx=0x7f5ccc009310 comp rx=0 tx=0).stop 2026-02-23T06:42:57.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.687+0000 7f5ce3577640 1 -- 10.20.193.58:0/990472360 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5cb007a660 msgr2=0x7f5cb009ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:57.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.687+0000 7f5ce3577640 1 --2- 10.20.193.58:0/990472360 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5cb007a660 0x7f5cb009ab10 secure :-1 s=READY pgs=475 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cd4003900 tx=0x7f5cd4007d80 comp rx=0 tx=0).stop 2026-02-23T06:42:57.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.687+0000 7f5ce3577640 1 -- 10.20.193.58:0/990472360 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ce40b6690 msgr2=0x7f5ce41397e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:57.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.687+0000 7f5ce3577640 1 --2- 10.20.193.58:0/990472360 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ce40b6690 0x7f5ce41397e0 secure :-1 s=READY pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cd800d700 tx=0x7f5cd800dbd0 comp rx=0 tx=0).stop 2026-02-23T06:42:57.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.687+0000 7f5ce2d76640 1 -- 10.20.193.58:0/990472360 reap_dead start 2026-02-23T06:42:57.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.687+0000 7f5ce2d76640 1 -- 10.20.193.58:0/990472360 reap_dead start 2026-02-23T06:42:57.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.687+0000 7f5ce3577640 1 -- 10.20.193.58:0/990472360 shutdown_connections 2026-02-23T06:42:57.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.687+0000 7f5ce3577640 1 -- 10.20.193.58:0/990472360 >> 10.20.193.58:0/990472360 conn(0x7f5ce40b3c20 msgr2=0x7f5ce413c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:57.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.687+0000 7f5ce3577640 1 -- 10.20.193.58:0/990472360 shutdown_connections 2026-02-23T06:42:57.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.687+0000 7f5ce3577640 1 -- 10.20.193.58:0/990472360 wait complete. 2026-02-23T06:42:57.699 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:42:57.699 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-23T06:42:57.699 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:42:57.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.825+0000 7f402d083640 1 -- 10.20.193.58:0/1203498231 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f400c003a30 msgr2=0x7f400c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:57.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.825+0000 7f402d083640 1 --2- 10.20.193.58:0/1203498231 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f400c003a30 0x7f400c003e20 secure :-1 s=READY pgs=103 gs=5 cs=0 l=1 c_cookie=5012857386891299149 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4028062070 tx=0x7f401402f500 comp rx=0 tx=0).stop 2026-02-23T06:42:57.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.826+0000 7f402d083640 1 -- 10.20.193.58:0/1203498231 shutdown_connections 2026-02-23T06:42:57.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.826+0000 7f402d083640 1 --2- 10.20.193.58:0/1203498231 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f400c003a30 0x7f400c003e20 unknown :-1 s=CLOSED pgs=103 gs=5 cs=0 l=1 c_cookie=5012857386891299149 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:57.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.826+0000 7f402d083640 1 -- 10.20.193.58:0/1203498231 >> 10.20.193.58:0/1203498231 conn(0x7f40280b3c20 msgr2=0x7f40280b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:57.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.826+0000 7f402d083640 1 -- 10.20.193.58:0/1203498231 shutdown_connections 2026-02-23T06:42:57.822 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.826+0000 7f402d083640 1 -- 10.20.193.58:0/1203498231 wait complete. 2026-02-23T06:42:57.822 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.827+0000 7f402d083640 1 Processor -- start 2026-02-23T06:42:57.822 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.827+0000 7f402d083640 1 -- start start 2026-02-23T06:42:57.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.828+0000 7f402d083640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f400c003a30 0x7f40280aef20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:57.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.828+0000 7f402d083640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f40280af460 0x7f4028160220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:57.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.828+0000 7f402d083640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f402813da70 0x7f4028160760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:57.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.828+0000 7f402d083640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f402813c470 con 0x7f400c003a30 2026-02-23T06:42:57.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.828+0000 7f402d083640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f40281614b0 con 0x7f402813da70 2026-02-23T06:42:57.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.828+0000 7f402d083640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f402813d770 con 0x7f40280af460 2026-02-23T06:42:57.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.828+0000 7f402c882640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f402813da70 msgr2=0x7f4028160760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:42:57.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.828+0000 7f402c882640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f402813da70 0x7f4028160760 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:42:57.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.828+0000 7f4027fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f400c003a30 0x7f40280aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:57.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.828+0000 7f4027fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f400c003a30 0x7f40280aef20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:49876/0 (socket says 10.20.193.58:49876) 2026-02-23T06:42:57.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.828+0000 7f4027fff640 1 -- 10.20.193.58:0/4220659084 learned_addr learned my addr 10.20.193.58:0/4220659084 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:42:57.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.828+0000 7f40277fe640 1 --2- 10.20.193.58:0/4220659084 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f40280af460 0x7f4028160220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:57.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.829+0000 7f4027fff640 1 -- 10.20.193.58:0/4220659084 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f40280af460 msgr2=0x7f4028160220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:57.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.829+0000 7f4027fff640 1 --2- 10.20.193.58:0/4220659084 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f40280af460 0x7f4028160220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:57.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.829+0000 7f4027fff640 1 -- 10.20.193.58:0/4220659084 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f402813da70 msgr2=0x7f4028160760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:42:57.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.829+0000 7f4027fff640 1 --2- 10.20.193.58:0/4220659084 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f402813da70 0x7f4028160760 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:57.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.829+0000 7f4027fff640 1 -- 10.20.193.58:0/4220659084 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f402813bc10 con 0x7f400c003a30 2026-02-23T06:42:57.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.829+0000 7f4027fff640 1 --2- 10.20.193.58:0/4220659084 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f400c003a30 0x7f40280aef20 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4014003130 tx=0x7f40140062c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:57.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.829+0000 7f4024ff9640 1 -- 10.20.193.58:0/4220659084 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f401403e040 con 0x7f400c003a30 2026-02-23T06:42:57.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.829+0000 7f4024ff9640 1 -- 10.20.193.58:0/4220659084 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4014003690 con 0x7f400c003a30 2026-02-23T06:42:57.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.829+0000 7f4024ff9640 1 -- 10.20.193.58:0/4220659084 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4014003a80 con 0x7f400c003a30 2026-02-23T06:42:57.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.829+0000 7f402d083640 1 -- 10.20.193.58:0/4220659084 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4028161940 con 0x7f400c003a30 2026-02-23T06:42:57.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.829+0000 7f402d083640 1 -- 10.20.193.58:0/4220659084 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f402813c190 con 0x7f400c003a30 2026-02-23T06:42:57.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.830+0000 7f402d083640 1 --2- 10.20.193.58:0/4220659084 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4028160dc0 0x7f4028148610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:57.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.830+0000 7f402d083640 1 -- 10.20.193.58:0/4220659084 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f40280609c0 con 0x7f4028160dc0 2026-02-23T06:42:57.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.830+0000 7f40277fe640 1 --2- 10.20.193.58:0/4220659084 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4028160dc0 0x7f4028148610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:57.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.830+0000 7f40277fe640 1 -- 10.20.193.58:0/4220659084 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f402813c880 con 0x7f4028160dc0 2026-02-23T06:42:57.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.831+0000 7f40277fe640 1 --2- 10.20.193.58:0/4220659084 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4028160dc0 0x7f4028148610 secure :-1 s=READY pgs=29 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f402815ff80 tx=0x7f401800d990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:57.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.831+0000 7f4024ff9640 1 -- 10.20.193.58:0/4220659084 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4018002cc0 con 0x7f4028160dc0 2026-02-23T06:42:57.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.831+0000 7f4024ff9640 1 -- 10.20.193.58:0/4220659084 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f4014003be0 con 0x7f400c003a30 2026-02-23T06:42:57.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.832+0000 7f4024ff9640 1 --2- 10.20.193.58:0/4220659084 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3ff807a660 0x7f3ff809ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:57.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.832+0000 7f4024ff9640 1 -- 10.20.193.58:0/4220659084 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f4018002e20 con 0x7f4028160dc0 2026-02-23T06:42:57.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.832+0000 7f4024ff9640 1 -- 10.20.193.58:0/4220659084 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4028160dc0 msgr2=0x7f4028148610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:57.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.832+0000 7f4024ff9640 1 --2- 10.20.193.58:0/4220659084 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4028160dc0 0x7f4028148610 secure :-1 s=READY pgs=29 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f402815ff80 tx=0x7f401800d990 comp rx=0 tx=0).stop 2026-02-23T06:42:57.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.832+0000 7f4024ff9640 1 -- 10.20.193.58:0/4220659084 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4028160dc0 msgr2=0x7f4028148610 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:42:57.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.832+0000 7f4024ff9640 1 --2- 10.20.193.58:0/4220659084 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4028160dc0 0x7f4028148610 secure :-1 s=CLOSED pgs=29 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f402815ff80 tx=0x7f401800d990 comp rx=0 tx=0).stop 2026-02-23T06:42:57.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.832+0000 7f4024ff9640 1 -- 10.20.193.58:0/4220659084 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f40140c1e10 con 0x7f400c003a30 2026-02-23T06:42:57.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.833+0000 7f402c882640 1 --2- 10.20.193.58:0/4220659084 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3ff807a660 0x7f3ff809ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:57.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.834+0000 7f402c882640 1 --2- 10.20.193.58:0/4220659084 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3ff807a660 0x7f3ff809ab10 secure :-1 s=READY pgs=476 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f401c0034b0 tx=0x7f401c00a1e0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:57.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.838+0000 7f402d083640 1 --2- 10.20.193.58:0/4220659084 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4028148b50 0x7f4028148f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:42:57.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.838+0000 7f402d083640 1 -- 10.20.193.58:0/4220659084 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f4028059690 con 0x7f4028148b50 2026-02-23T06:42:57.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.839+0000 7f40277fe640 1 --2- 10.20.193.58:0/4220659084 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4028148b50 0x7f4028148f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:42:57.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.841+0000 7f40277fe640 1 -- 10.20.193.58:0/4220659084 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f40280593b0 con 0x7f4028148b50 2026-02-23T06:42:57.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.843+0000 7f40277fe640 1 --2- 10.20.193.58:0/4220659084 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4028148b50 0x7f4028148f20 secure :-1 s=READY pgs=30 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f402815ff80 tx=0x7f40180048b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:42:57.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.844+0000 7f4024ff9640 1 -- 10.20.193.58:0/4220659084 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4018021070 con 0x7f4028148b50 2026-02-23T06:42:57.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.844+0000 7f4024ff9640 1 -- 10.20.193.58:0/4220659084 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5401 (secure 0 0 0) 0x7f4018012420 con 0x7f4028148b50 2026-02-23T06:42:57.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.844+0000 7f4024ff9640 1 -- 10.20.193.58:0/4220659084 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4028148b50 msgr2=0x7f4028148f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:57.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.844+0000 7f4024ff9640 1 --2- 10.20.193.58:0/4220659084 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4028148b50 0x7f4028148f20 secure :-1 s=READY pgs=30 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f402815ff80 tx=0x7f40180048b0 comp rx=0 tx=0).stop 2026-02-23T06:42:57.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.844+0000 7f4024ff9640 1 -- 10.20.193.58:0/4220659084 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4028148b50 msgr2=0x7f4028148f20 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:42:57.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.844+0000 7f4024ff9640 1 --2- 10.20.193.58:0/4220659084 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4028148b50 0x7f4028148f20 secure :-1 s=CLOSED pgs=30 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f402815ff80 tx=0x7f40180048b0 comp rx=0 tx=0).stop 2026-02-23T06:42:57.840 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:42:57.840 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:42:57.840 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:42:57.840 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:42:57.841 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 184, 2026-02-23T06:42:57.841 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 31272, 2026-02-23T06:42:57.841 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:42:57.841 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:42:57.841 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:42:57.841 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:57.841 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:42:57.841 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:42:57.841 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:42:57.841 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:42:57.841 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:57.841 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:57.842 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:57.842 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:57.842 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:57.842 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:57.842 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:57.842 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:57.842 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:57.842 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:57.842 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:57.842 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:57.842 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:57.842 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:57.843 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:42:57.843 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:42:57.843 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:57.843 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:57.843 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:57.843 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:57.843 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:57.843 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:57.843 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:57.843 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:57.843 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:57.843 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:57.843 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:57.844 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:57.844 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:57.844 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:57.844 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:57.844 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:42:57.844 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:42:57.844 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:42:57.844 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:42:57.844 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:42:57.844 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:42:57.844 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:42:57.845 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:42:57.845 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:42:57.845 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:42:57.845 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:42:57.845 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:42:57.845 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:42:57.845 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:42:57.845 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:42:57.845 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:42:57.845 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:42:57.845 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:42:57.845 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:42:57.846 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:42:57.846 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:42:57.846 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:42:57.846 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:42:57.846 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:42:57.846 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:42:57.846 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:42:57.846 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:42:57.846 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:42:57.846 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:42:57.846 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:42:57.846 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:57.846 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:42:57.847 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:57.847 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:42:57.847 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.847 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:42:57.847 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:42:57.847 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:57.847 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:57.847 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.847 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:57.847 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:42:57.847 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:57.847 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:57.848 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.848 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:57.848 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:42:57.848 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:57.848 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:57.848 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:57.848 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:57.848 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:42:57.848 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:42:57.848 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:57.848 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:57.848 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:42:57.849 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:57.849 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:57.849 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.849 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:42:57.849 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:42:57.849 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:57.849 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:57.849 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.849 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:57.849 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:42:57.849 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:57.849 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:57.849 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.850 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:57.850 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:42:57.850 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:57.850 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:57.850 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:57.850 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:57.850 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:42:57.850 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:42:57.850 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:57.850 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:57.850 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:42:57.850 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:57.851 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:57.851 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.851 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:42:57.851 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:42:57.851 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:42:57.851 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:42:57.851 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.851 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:42:57.851 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:42:57.851 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:57.851 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:57.851 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.851 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:42:57.852 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:42:57.852 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:42:57.852 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:57.852 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:57.852 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:57.852 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:42:57.852 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:42:57.852 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:42:57.852 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:42:57.852 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:42:57.852 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:42:57.852 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:57.853 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:57.853 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:57.853 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:42:57.853 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:42:57.853 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.853 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:57.853 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:57.853 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:42:57.853 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:57.853 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:57.853 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:42:57.853 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.854 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:57.854 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:57.854 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:42:57.854 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:57.854 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:57.854 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:42:57.854 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.854 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:57.854 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:57.854 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:42:57.854 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:57.854 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:57.854 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:42:57.855 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.855 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:57.855 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:57.855 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:42:57.855 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:57.855 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:42:57.855 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:42:57.855 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:42:57.855 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:42:57.855 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:42:57.855 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:42:57.855 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:42:57.855 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:42:57.856 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:42:57.856 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:42:57.856 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:42:57.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.845+0000 7f402d083640 1 -- 10.20.193.58:0/4220659084 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3ff807a660 msgr2=0x7f3ff809ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:57.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.845+0000 7f402d083640 1 --2- 10.20.193.58:0/4220659084 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f3ff807a660 0x7f3ff809ab10 secure :-1 s=READY pgs=476 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f401c0034b0 tx=0x7f401c00a1e0 comp rx=0 tx=0).stop 2026-02-23T06:42:57.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.845+0000 7f402c882640 1 -- 10.20.193.58:0/4220659084 reap_dead start 2026-02-23T06:42:57.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.845+0000 7f402d083640 1 -- 10.20.193.58:0/4220659084 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f400c003a30 msgr2=0x7f40280aef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:42:57.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.845+0000 7f402d083640 1 --2- 10.20.193.58:0/4220659084 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f400c003a30 0x7f40280aef20 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4014003130 tx=0x7f40140062c0 comp rx=0 tx=0).stop 2026-02-23T06:42:57.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.845+0000 7f402d083640 1 -- 10.20.193.58:0/4220659084 shutdown_connections 2026-02-23T06:42:57.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.845+0000 7f402d083640 1 --2- 10.20.193.58:0/4220659084 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f400c003a30 0x7f40280aef20 unknown :-1 s=CLOSED pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:42:57.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.845+0000 7f402d083640 1 -- 10.20.193.58:0/4220659084 >> 10.20.193.58:0/4220659084 conn(0x7f40280b3c20 msgr2=0x7f40280b5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:42:57.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.845+0000 7f402d083640 1 -- 10.20.193.58:0/4220659084 shutdown_connections 2026-02-23T06:42:57.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:42:57.845+0000 7f402d083640 1 -- 10.20.193.58:0/4220659084 wait complete. 2026-02-23T06:42:57.859 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:42:57.859 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:43:14.782 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:43:14.785 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:43:17.860 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-23T06:43:17.860 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-23T06:43:17.860 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-23T06:43:17.860 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-23T06:43:17.861 INFO:tasks.ceph.mon.b:Started 2026-02-23T06:43:17.861 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:43:17.861 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:43:17.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.989+0000 7fcd6a443640 1 -- 10.20.193.58:0/4072267846 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcd6415d4a0 msgr2=0x7fcd640affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:17.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.989+0000 7fcd6a443640 1 --2- 10.20.193.58:0/4072267846 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcd6415d4a0 0x7fcd640affb0 secure :-1 s=READY pgs=33 gs=3 cs=0 l=1 c_cookie=3517752002042822198 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd54009950 tx=0x7fcd5402f2b0 comp rx=0 tx=0).stop 2026-02-23T06:43:17.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.989+0000 7fcd6a443640 1 -- 10.20.193.58:0/4072267846 shutdown_connections 2026-02-23T06:43:17.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.989+0000 7fcd6a443640 1 --2- 10.20.193.58:0/4072267846 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcd6415d4a0 0x7fcd640affb0 unknown :-1 s=CLOSED pgs=33 gs=3 cs=0 l=1 c_cookie=3517752002042822198 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:17.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.989+0000 7fcd6a443640 1 -- 10.20.193.58:0/4072267846 >> 10.20.193.58:0/4072267846 conn(0x7fcd640b3c20 msgr2=0x7fcd640b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:43:17.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.989+0000 7fcd6a443640 1 -- 10.20.193.58:0/4072267846 shutdown_connections 2026-02-23T06:43:17.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.989+0000 7fcd6a443640 1 -- 10.20.193.58:0/4072267846 wait complete. 2026-02-23T06:43:17.985 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.990+0000 7fcd6a443640 1 Processor -- start 2026-02-23T06:43:17.985 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.990+0000 7fcd6a443640 1 -- start start 2026-02-23T06:43:17.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.991+0000 7fcd6a443640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcd640b6690 0x7fcd6413aff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:17.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.991+0000 7fcd6a443640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcd6415d4a0 0x7fcd6413b530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:17.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.991+0000 7fcd6a443640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcd6415d870 0x7fcd641fda30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:17.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.991+0000 7fcd6a443640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6413ee60 con 0x7fcd6415d870 2026-02-23T06:43:17.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.991+0000 7fcd6a443640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6413ead0 con 0x7fcd640b6690 2026-02-23T06:43:17.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.991+0000 7fcd6a443640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fcd6413e640 con 0x7fcd6415d4a0 2026-02-23T06:43:17.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.991+0000 7fcd69441640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcd640b6690 0x7fcd6413aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:17.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.991+0000 7fcd69c42640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcd6415d870 0x7fcd641fda30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:17.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.991+0000 7fcd69441640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcd640b6690 0x7fcd6413aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:54392/0 (socket says 10.20.193.58:54392) 2026-02-23T06:43:17.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.991+0000 7fcd69441640 1 -- 10.20.193.58:0/3857871432 learned_addr learned my addr 10.20.193.58:0/3857871432 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:43:17.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.991+0000 7fcd68c40640 1 --2- 10.20.193.58:0/3857871432 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcd6415d4a0 0x7fcd6413b530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:17.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.992+0000 7fcd69c42640 1 -- 10.20.193.58:0/3857871432 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcd6415d4a0 msgr2=0x7fcd6413b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:17.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.992+0000 7fcd69c42640 1 --2- 10.20.193.58:0/3857871432 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcd6415d4a0 0x7fcd6413b530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:17.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.992+0000 7fcd69c42640 1 -- 10.20.193.58:0/3857871432 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcd640b6690 msgr2=0x7fcd6413aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:17.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.992+0000 7fcd69c42640 1 --2- 10.20.193.58:0/3857871432 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcd640b6690 0x7fcd6413aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:17.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.992+0000 7fcd69c42640 1 -- 10.20.193.58:0/3857871432 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd54009570 con 0x7fcd6415d870 2026-02-23T06:43:17.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.992+0000 7fcd69c42640 1 --2- 10.20.193.58:0/3857871432 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcd6415d870 0x7fcd641fda30 secure :-1 s=READY pgs=108 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd6000d4d0 tx=0x7fcd6000d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:17.987 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.992+0000 7fcd51ffb640 1 -- 10.20.193.58:0/3857871432 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd60007b90 con 0x7fcd6415d870 2026-02-23T06:43:17.987 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.992+0000 7fcd51ffb640 1 -- 10.20.193.58:0/3857871432 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd60007de0 con 0x7fcd6415d870 2026-02-23T06:43:17.987 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.992+0000 7fcd6a443640 1 -- 10.20.193.58:0/3857871432 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd64140080 con 0x7fcd6415d870 2026-02-23T06:43:17.987 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.992+0000 7fcd51ffb640 1 -- 10.20.193.58:0/3857871432 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd60008290 con 0x7fcd6415d870 2026-02-23T06:43:17.987 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.992+0000 7fcd6a443640 1 -- 10.20.193.58:0/3857871432 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd6413dff0 con 0x7fcd6415d870 2026-02-23T06:43:17.987 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.993+0000 7fcd6a443640 1 -- 10.20.193.58:0/3857871432 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd6413e780 con 0x7fcd6415d870 2026-02-23T06:43:17.988 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.994+0000 7fcd51ffb640 1 -- 10.20.193.58:0/3857871432 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fcd6001a070 con 0x7fcd6415d870 2026-02-23T06:43:17.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.995+0000 7fcd51ffb640 1 --2- 10.20.193.58:0/3857871432 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcd3407a6c0 0x7fcd3409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:17.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.995+0000 7fcd51ffb640 1 -- 10.20.193.58:0/3857871432 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fcd6009e460 con 0x7fcd6415d870 2026-02-23T06:43:17.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.995+0000 7fcd69441640 1 --2- 10.20.193.58:0/3857871432 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcd3407a6c0 0x7fcd3409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:17.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.996+0000 7fcd69441640 1 --2- 10.20.193.58:0/3857871432 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcd3407a6c0 0x7fcd3409ab70 secure :-1 s=READY pgs=478 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd540098a0 tx=0x7fcd5403a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:17.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:17.997+0000 7fcd51ffb640 1 -- 10.20.193.58:0/3857871432 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fcd600616b0 con 0x7fcd6415d870 2026-02-23T06:43:18.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.153+0000 7fcd6a443640 1 -- 10.20.193.58:0/3857871432 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fcd6413c0a0 con 0x7fcd6415d870 2026-02-23T06:43:18.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.154+0000 7fcd51ffb640 1 -- 10.20.193.58:0/3857871432 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7fcd600647d0 con 0x7fcd6415d870 2026-02-23T06:43:18.148 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":190,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:43:18.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.155+0000 7fcd6a443640 1 -- 10.20.193.58:0/3857871432 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcd3407a6c0 msgr2=0x7fcd3409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:18.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.155+0000 7fcd6a443640 1 --2- 10.20.193.58:0/3857871432 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcd3407a6c0 0x7fcd3409ab70 secure :-1 s=READY pgs=478 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd540098a0 tx=0x7fcd5403a040 comp rx=0 tx=0).stop 2026-02-23T06:43:18.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.155+0000 7fcd6a443640 1 -- 10.20.193.58:0/3857871432 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcd6415d870 msgr2=0x7fcd641fda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:18.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.155+0000 7fcd6a443640 1 --2- 10.20.193.58:0/3857871432 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcd6415d870 0x7fcd641fda30 secure :-1 s=READY pgs=108 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd6000d4d0 tx=0x7fcd6000d9a0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.156+0000 7fcd6a443640 1 -- 10.20.193.58:0/3857871432 shutdown_connections 2026-02-23T06:43:18.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.156+0000 7fcd6a443640 1 --2- 10.20.193.58:0/3857871432 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcd3407a6c0 0x7fcd3409ab70 unknown :-1 s=CLOSED pgs=478 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.156+0000 7fcd6a443640 1 --2- 10.20.193.58:0/3857871432 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcd6415d870 0x7fcd641fda30 unknown :-1 s=CLOSED pgs=108 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.156+0000 7fcd6a443640 1 --2- 10.20.193.58:0/3857871432 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcd6415d4a0 0x7fcd6413b530 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.156+0000 7fcd6a443640 1 --2- 10.20.193.58:0/3857871432 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcd640b6690 0x7fcd6413aff0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.156+0000 7fcd6a443640 1 -- 10.20.193.58:0/3857871432 >> 10.20.193.58:0/3857871432 conn(0x7fcd640b3c20 msgr2=0x7fcd6415bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:43:18.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.156+0000 7fcd6a443640 1 -- 10.20.193.58:0/3857871432 shutdown_connections 2026-02-23T06:43:18.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.156+0000 7fcd6a443640 1 -- 10.20.193.58:0/3857871432 wait complete. 2026-02-23T06:43:18.162 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:43:18.162 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:43:18.162 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:43:18.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.289+0000 7f8ff8846640 1 -- 10.20.193.58:0/2637558964 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ff415d4a0 msgr2=0x7f8ff40affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:18.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.289+0000 7f8ff8846640 1 --2- 10.20.193.58:0/2637558964 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ff415d4a0 0x7f8ff40affb0 secure :-1 s=READY pgs=34 gs=2 cs=0 l=1 c_cookie=10796249429788597195 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fe8005e70 tx=0x7f8fe802f290 comp rx=0 tx=0).stop 2026-02-23T06:43:18.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.289+0000 7f8ff8846640 1 -- 10.20.193.58:0/2637558964 shutdown_connections 2026-02-23T06:43:18.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.289+0000 7f8ff8846640 1 --2- 10.20.193.58:0/2637558964 >> v2:10.20.193.93:3300/0 conn(0x7f8ff40b6690 0x7f8ff4058ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.289+0000 7f8ff8846640 1 --2- 10.20.193.58:0/2637558964 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ff415d4a0 0x7f8ff40affb0 unknown :-1 s=CLOSED pgs=34 gs=2 cs=0 l=1 c_cookie=10796249429788597195 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.289+0000 7f8ff8846640 1 -- 10.20.193.58:0/2637558964 >> 10.20.193.58:0/2637558964 conn(0x7f8ff40b3c20 msgr2=0x7f8ff40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:43:18.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.289+0000 7f8ff8846640 1 -- 10.20.193.58:0/2637558964 shutdown_connections 2026-02-23T06:43:18.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.289+0000 7f8ff8846640 1 -- 10.20.193.58:0/2637558964 wait complete. 2026-02-23T06:43:18.285 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.290+0000 7f8ff8846640 1 Processor -- start 2026-02-23T06:43:18.285 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.291+0000 7f8ff8846640 1 -- start start 2026-02-23T06:43:18.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.291+0000 7f8ff8846640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ff40b6690 0x7f8ff4057750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:18.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.291+0000 7f8ff8846640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8ff415d4a0 0x7f8ff41402b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:18.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.291+0000 7f8ff8846640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ff415d870 0x7f8ff413ef30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:18.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.291+0000 7f8ff8846640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff413e700 con 0x7f8ff40b6690 2026-02-23T06:43:18.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.291+0000 7f8ff8846640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff4161a40 con 0x7f8ff415d4a0 2026-02-23T06:43:18.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.291+0000 7f8ff8846640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f8ff415ab40 con 0x7f8ff415d870 2026-02-23T06:43:18.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.291+0000 7f8ff2d76640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ff40b6690 0x7f8ff4057750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:18.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.291+0000 7f8ff2d76640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ff40b6690 0x7f8ff4057750 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:48812/0 (socket says 10.20.193.58:48812) 2026-02-23T06:43:18.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.291+0000 7f8ff2d76640 1 -- 10.20.193.58:0/1100329375 learned_addr learned my addr 10.20.193.58:0/1100329375 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:43:18.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.291+0000 7f8ff3577640 1 --2- 10.20.193.58:0/1100329375 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ff415d870 0x7f8ff413ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:18.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.291+0000 7f8ff2575640 1 --2- 10.20.193.58:0/1100329375 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8ff415d4a0 0x7f8ff41402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:18.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.292+0000 7f8ff2d76640 1 -- 10.20.193.58:0/1100329375 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ff415d870 msgr2=0x7f8ff413ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:18.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.292+0000 7f8ff2d76640 1 --2- 10.20.193.58:0/1100329375 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8ff415d870 0x7f8ff413ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.292+0000 7f8ff2d76640 1 -- 10.20.193.58:0/1100329375 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8ff415d4a0 msgr2=0x7f8ff41402b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:18.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.292+0000 7f8ff2d76640 1 --2- 10.20.193.58:0/1100329375 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8ff415d4a0 0x7f8ff41402b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.292+0000 7f8ff2d76640 1 -- 10.20.193.58:0/1100329375 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe400a590 con 0x7f8ff40b6690 2026-02-23T06:43:18.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.292+0000 7f8ff2d76640 1 --2- 10.20.193.58:0/1100329375 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ff40b6690 0x7f8ff4057750 secure :-1 s=READY pgs=109 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fe8004740 tx=0x7f8fe80028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:18.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.292+0000 7f8fd37fe640 1 -- 10.20.193.58:0/1100329375 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fe803d070 con 0x7f8ff40b6690 2026-02-23T06:43:18.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.292+0000 7f8fd37fe640 1 -- 10.20.193.58:0/1100329375 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8fe8038470 con 0x7f8ff40b6690 2026-02-23T06:43:18.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.292+0000 7f8fd37fe640 1 -- 10.20.193.58:0/1100329375 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fe80388a0 con 0x7f8ff40b6690 2026-02-23T06:43:18.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.292+0000 7f8ff8846640 1 -- 10.20.193.58:0/1100329375 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fe8009570 con 0x7f8ff40b6690 2026-02-23T06:43:18.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.292+0000 7f8ff8846640 1 -- 10.20.193.58:0/1100329375 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff4161cb0 con 0x7f8ff40b6690 2026-02-23T06:43:18.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.293+0000 7f8ff8846640 1 --2- 10.20.193.58:0/1100329375 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ff40ae080 0x7f8ff413f470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:18.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.293+0000 7f8ff8846640 1 -- 10.20.193.58:0/1100329375 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff40b6330 con 0x7f8ff40ae080 2026-02-23T06:43:18.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.293+0000 7f8ff2575640 1 --2- 10.20.193.58:0/1100329375 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ff40ae080 0x7f8ff413f470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:18.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.293+0000 7f8ff2575640 1 -- 10.20.193.58:0/1100329375 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ff40b5e10 con 0x7f8ff40ae080 2026-02-23T06:43:18.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.293+0000 7f8ff2575640 1 --2- 10.20.193.58:0/1100329375 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ff40ae080 0x7f8ff413f470 secure :-1 s=READY pgs=110 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ff415c2c0 tx=0x7f8fdc00e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:18.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.293+0000 7f8fd37fe640 1 -- 10.20.193.58:0/1100329375 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fdc002d20 con 0x7f8ff40ae080 2026-02-23T06:43:18.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.294+0000 7f8fd37fe640 1 -- 10.20.193.58:0/1100329375 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f8fdc002e80 con 0x7f8ff40ae080 2026-02-23T06:43:18.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.294+0000 7f8fd37fe640 1 -- 10.20.193.58:0/1100329375 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ff40ae080 msgr2=0x7f8ff413f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:18.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.294+0000 7f8fd37fe640 1 --2- 10.20.193.58:0/1100329375 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ff40ae080 0x7f8ff413f470 secure :-1 s=READY pgs=110 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ff415c2c0 tx=0x7f8fdc00e970 comp rx=0 tx=0).stop 2026-02-23T06:43:18.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.294+0000 7f8fd37fe640 1 -- 10.20.193.58:0/1100329375 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ff40ae080 msgr2=0x7f8ff413f470 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:43:18.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.294+0000 7f8fd37fe640 1 --2- 10.20.193.58:0/1100329375 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ff40ae080 0x7f8ff413f470 secure :-1 s=CLOSED pgs=110 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ff415c2c0 tx=0x7f8fdc00e970 comp rx=0 tx=0).stop 2026-02-23T06:43:18.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.294+0000 7f8fd37fe640 1 -- 10.20.193.58:0/1100329375 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f8fe8038a00 con 0x7f8ff40b6690 2026-02-23T06:43:18.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.295+0000 7f8fd37fe640 1 --2- 10.20.193.58:0/1100329375 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8fc007a430 0x7f8fc009a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:18.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.295+0000 7f8fd37fe640 1 -- 10.20.193.58:0/1100329375 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f8fe80c2170 con 0x7f8ff40b6690 2026-02-23T06:43:18.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.295+0000 7f8ff2575640 1 --2- 10.20.193.58:0/1100329375 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8fc007a430 0x7f8fc009a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:18.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.296+0000 7f8ff2575640 1 --2- 10.20.193.58:0/1100329375 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8fc007a430 0x7f8fc009a8e0 secure :-1 s=READY pgs=479 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fdc0027a0 tx=0x7f8fdc004000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:18.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.297+0000 7f8ff8846640 1 --2- 10.20.193.58:0/1100329375 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ff4162a80 0x7f8ff413f9b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:18.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.297+0000 7f8ff8846640 1 -- 10.20.193.58:0/1100329375 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff40b6d50 con 0x7f8ff4162a80 2026-02-23T06:43:18.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.297+0000 7f8ff3577640 1 --2- 10.20.193.58:0/1100329375 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ff4162a80 0x7f8ff413f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:18.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.298+0000 7f8ff3577640 1 -- 10.20.193.58:0/1100329375 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8ff413e870 con 0x7f8ff4162a80 2026-02-23T06:43:18.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.298+0000 7f8ff3577640 1 --2- 10.20.193.58:0/1100329375 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ff4162a80 0x7f8ff413f9b0 secure :-1 s=READY pgs=111 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fe4003780 tx=0x7f8fe4003c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:18.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.298+0000 7f8fd37fe640 1 -- 10.20.193.58:0/1100329375 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fe4012de0 con 0x7f8ff4162a80 2026-02-23T06:43:18.293 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.298+0000 7f8fd37fe640 1 -- 10.20.193.58:0/1100329375 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5557 (secure 0 0 0) 0x7f8fe4013450 con 0x7f8ff4162a80 2026-02-23T06:43:18.293 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.298+0000 7f8fd37fe640 1 -- 10.20.193.58:0/1100329375 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ff4162a80 msgr2=0x7f8ff413f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:18.293 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.298+0000 7f8fd37fe640 1 --2- 10.20.193.58:0/1100329375 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ff4162a80 0x7f8ff413f9b0 secure :-1 s=READY pgs=111 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fe4003780 tx=0x7f8fe4003c50 comp rx=0 tx=0).stop 2026-02-23T06:43:18.293 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.298+0000 7f8fd37fe640 1 -- 10.20.193.58:0/1100329375 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ff4162a80 msgr2=0x7f8ff413f9b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:43:18.293 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.298+0000 7f8fd37fe640 1 --2- 10.20.193.58:0/1100329375 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ff4162a80 0x7f8ff413f9b0 unknown :-1 s=CLOSED pgs=111 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.293 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:43:18.293 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:43:18.293 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:43:18.293 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:43:18.293 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 190, 2026-02-23T06:43:18.293 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 98418, 2026-02-23T06:43:18.293 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:43:18.293 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:43:18.293 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:43:18.293 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:43:18.293 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:18.293 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:43:18.293 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:43:18.293 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:43:18.293 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:43:18.293 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:43:18.293 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:43:18.293 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:43:18.293 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:43:18.293 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:43:18.293 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:43:18.294 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:43:18.295 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:18.296 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.297 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:43:18.298 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:43:18.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.298+0000 7f8ff8846640 1 -- 10.20.193.58:0/1100329375 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8fc007a430 msgr2=0x7f8fc009a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:18.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.298+0000 7f8ff8846640 1 --2- 10.20.193.58:0/1100329375 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8fc007a430 0x7f8fc009a8e0 secure :-1 s=READY pgs=479 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fdc0027a0 tx=0x7f8fdc004000 comp rx=0 tx=0).stop 2026-02-23T06:43:18.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.298+0000 7f8ff8846640 1 -- 10.20.193.58:0/1100329375 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ff40b6690 msgr2=0x7f8ff4057750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:18.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.298+0000 7f8ff8846640 1 --2- 10.20.193.58:0/1100329375 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8ff40b6690 0x7f8ff4057750 secure :-1 s=READY pgs=109 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fe8004740 tx=0x7f8fe80028d0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.298+0000 7f8ff3577640 1 -- 10.20.193.58:0/1100329375 reap_dead start 2026-02-23T06:43:18.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.299+0000 7f8ff8846640 1 -- 10.20.193.58:0/1100329375 shutdown_connections 2026-02-23T06:43:18.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.299+0000 7f8ff8846640 1 -- 10.20.193.58:0/1100329375 >> 10.20.193.58:0/1100329375 conn(0x7f8ff40b3c20 msgr2=0x7f8ff405d100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:43:18.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.299+0000 7f8ff8846640 1 -- 10.20.193.58:0/1100329375 shutdown_connections 2026-02-23T06:43:18.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.299+0000 7f8ff8846640 1 -- 10.20.193.58:0/1100329375 wait complete. 2026-02-23T06:43:18.300 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:43:18.300 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:43:18.300 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:43:18.425 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.430+0000 7fe287fff640 1 -- 10.20.193.58:0/453622630 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe28805b860 msgr2=0x7fe28805d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:18.425 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.430+0000 7fe287fff640 1 --2- 10.20.193.58:0/453622630 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe28805b860 0x7fe28805d690 secure :-1 s=READY pgs=112 gs=1 cs=0 l=1 c_cookie=4444625245091934196 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2880b6900 tx=0x7fe278030340 comp rx=0 tx=0).stop 2026-02-23T06:43:18.425 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.430+0000 7fe287fff640 1 -- 10.20.193.58:0/453622630 shutdown_connections 2026-02-23T06:43:18.425 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.430+0000 7fe287fff640 1 --2- 10.20.193.58:0/453622630 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe28805b860 0x7fe28805d690 unknown :-1 s=CLOSED pgs=112 gs=1 cs=0 l=1 c_cookie=4444625245091934196 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.426 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.430+0000 7fe287fff640 1 --2- 10.20.193.58:0/453622630 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe28805b0e0 0x7fe28805c7f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.426 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.430+0000 7fe287fff640 1 --2- 10.20.193.58:0/453622630 >> v2:10.20.193.93:3300/0 conn(0x7fe2880b1970 0x7fe2880b60e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.426 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.431+0000 7fe287fff640 1 -- 10.20.193.58:0/453622630 >> 10.20.193.58:0/453622630 conn(0x7fe2880b3c20 msgr2=0x7fe2880b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:43:18.426 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.431+0000 7fe287fff640 1 -- 10.20.193.58:0/453622630 shutdown_connections 2026-02-23T06:43:18.426 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.431+0000 7fe287fff640 1 -- 10.20.193.58:0/453622630 wait complete. 2026-02-23T06:43:18.426 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.432+0000 7fe287fff640 1 Processor -- start 2026-02-23T06:43:18.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.432+0000 7fe287fff640 1 -- start start 2026-02-23T06:43:18.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.432+0000 7fe287fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe28805b0e0 0x7fe2881382c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:18.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.432+0000 7fe287fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe28805b860 0x7fe28813d860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:18.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.432+0000 7fe287fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2880b1970 0x7fe28813b710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:18.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.432+0000 7fe287fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe288172c50 con 0x7fe28805b860 2026-02-23T06:43:18.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.432+0000 7fe287fff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe288139e50 con 0x7fe2880b1970 2026-02-23T06:43:18.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.432+0000 7fe287fff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe2881408a0 con 0x7fe28805b0e0 2026-02-23T06:43:18.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.433+0000 7fe2867fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe28805b860 0x7fe28813d860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:18.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.433+0000 7fe2867fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe28805b860 0x7fe28813d860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:48844/0 (socket says 10.20.193.58:48844) 2026-02-23T06:43:18.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.433+0000 7fe2867fc640 1 -- 10.20.193.58:0/2018753007 learned_addr learned my addr 10.20.193.58:0/2018753007 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:43:18.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.433+0000 7fe2877fe640 1 --2- 10.20.193.58:0/2018753007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2880b1970 0x7fe28813b710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:18.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.433+0000 7fe286ffd640 1 --2- 10.20.193.58:0/2018753007 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe28805b0e0 0x7fe2881382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:18.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.433+0000 7fe2867fc640 1 -- 10.20.193.58:0/2018753007 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe28805b0e0 msgr2=0x7fe2881382c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:18.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.433+0000 7fe2867fc640 1 --2- 10.20.193.58:0/2018753007 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe28805b0e0 0x7fe2881382c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.433+0000 7fe2867fc640 1 -- 10.20.193.58:0/2018753007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2880b1970 msgr2=0x7fe28813b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:18.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.433+0000 7fe2867fc640 1 --2- 10.20.193.58:0/2018753007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2880b1970 0x7fe28813b710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.433+0000 7fe2867fc640 1 -- 10.20.193.58:0/2018753007 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe27800a650 con 0x7fe28805b860 2026-02-23T06:43:18.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.433+0000 7fe2877fe640 1 --2- 10.20.193.58:0/2018753007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2880b1970 0x7fe28813b710 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:43:18.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.433+0000 7fe2867fc640 1 --2- 10.20.193.58:0/2018753007 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe28805b860 0x7fe28813d860 secure :-1 s=READY pgs=113 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe27000d980 tx=0x7fe27000de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:18.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.433+0000 7fe2677fe640 1 -- 10.20.193.58:0/2018753007 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe270004500 con 0x7fe28805b860 2026-02-23T06:43:18.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.433+0000 7fe2677fe640 1 -- 10.20.193.58:0/2018753007 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe270004850 con 0x7fe28805b860 2026-02-23T06:43:18.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.433+0000 7fe2677fe640 1 -- 10.20.193.58:0/2018753007 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe270004c60 con 0x7fe28805b860 2026-02-23T06:43:18.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.433+0000 7fe287fff640 1 -- 10.20.193.58:0/2018753007 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe288140320 con 0x7fe28805b860 2026-02-23T06:43:18.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.433+0000 7fe287fff640 1 -- 10.20.193.58:0/2018753007 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2881405c0 con 0x7fe28805b860 2026-02-23T06:43:18.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.434+0000 7fe287fff640 1 --2- 10.20.193.58:0/2018753007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2880ae570 0x7fe28813bc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:18.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.434+0000 7fe287fff640 1 -- 10.20.193.58:0/2018753007 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe2880b58e0 con 0x7fe2880ae570 2026-02-23T06:43:18.429 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.434+0000 7fe286ffd640 1 --2- 10.20.193.58:0/2018753007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2880ae570 0x7fe28813bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:18.429 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.434+0000 7fe286ffd640 1 -- 10.20.193.58:0/2018753007 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe2880b5600 con 0x7fe2880ae570 2026-02-23T06:43:18.429 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.435+0000 7fe286ffd640 1 --2- 10.20.193.58:0/2018753007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2880ae570 0x7fe28813bc50 secure :-1 s=READY pgs=5 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe27c00f900 tx=0x7fe27c00fdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:18.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.435+0000 7fe2677fe640 1 -- 10.20.193.58:0/2018753007 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe27c00db50 con 0x7fe2880ae570 2026-02-23T06:43:18.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.435+0000 7fe2677fe640 1 -- 10.20.193.58:0/2018753007 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fe270009820 con 0x7fe28805b860 2026-02-23T06:43:18.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.436+0000 7fe2677fe640 1 --2- 10.20.193.58:0/2018753007 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe25407a660 0x7fe25409ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:18.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.436+0000 7fe2677fe640 1 -- 10.20.193.58:0/2018753007 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fe27009d6f0 con 0x7fe28805b860 2026-02-23T06:43:18.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.436+0000 7fe2677fe640 1 -- 10.20.193.58:0/2018753007 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fe27c00dcb0 con 0x7fe2880ae570 2026-02-23T06:43:18.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.436+0000 7fe2677fe640 1 -- 10.20.193.58:0/2018753007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2880ae570 msgr2=0x7fe28813bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:18.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.436+0000 7fe2677fe640 1 --2- 10.20.193.58:0/2018753007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2880ae570 0x7fe28813bc50 secure :-1 s=READY pgs=5 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe27c00f900 tx=0x7fe27c00fdd0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.436+0000 7fe2677fe640 1 -- 10.20.193.58:0/2018753007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2880ae570 msgr2=0x7fe28813bc50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:43:18.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.436+0000 7fe2677fe640 1 --2- 10.20.193.58:0/2018753007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2880ae570 0x7fe28813bc50 unknown :-1 s=CLOSED pgs=5 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.436+0000 7fe2877fe640 1 --2- 10.20.193.58:0/2018753007 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe25407a660 0x7fe25409ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:18.432 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.437+0000 7fe2877fe640 1 --2- 10.20.193.58:0/2018753007 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe25407a660 0x7fe25409ab10 secure :-1 s=READY pgs=480 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2880b6900 tx=0x7fe2780058c0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:18.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.440+0000 7fe287fff640 1 --2- 10.20.193.58:0/2018753007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe288138800 0x7fe288139790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:18.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.440+0000 7fe287fff640 1 -- 10.20.193.58:0/2018753007 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe28805c7f0 con 0x7fe288138800 2026-02-23T06:43:18.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.440+0000 7fe286ffd640 1 --2- 10.20.193.58:0/2018753007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe288138800 0x7fe288139790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:18.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.440+0000 7fe286ffd640 1 -- 10.20.193.58:0/2018753007 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe28813c230 con 0x7fe288138800 2026-02-23T06:43:18.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.441+0000 7fe286ffd640 1 --2- 10.20.193.58:0/2018753007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe288138800 0x7fe288139790 secure :-1 s=READY pgs=6 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe27c015000 tx=0x7fe27c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:18.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.441+0000 7fe2677fe640 1 -- 10.20.193.58:0/2018753007 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe27c011930 con 0x7fe288138800 2026-02-23T06:43:18.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.441+0000 7fe2677fe640 1 -- 10.20.193.58:0/2018753007 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4909 (secure 0 0 0) 0x7fe27c011a90 con 0x7fe288138800 2026-02-23T06:43:18.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.441+0000 7fe2677fe640 1 -- 10.20.193.58:0/2018753007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe288138800 msgr2=0x7fe288139790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:18.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.441+0000 7fe2677fe640 1 --2- 10.20.193.58:0/2018753007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe288138800 0x7fe288139790 secure :-1 s=READY pgs=6 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe27c015000 tx=0x7fe27c004770 comp rx=0 tx=0).stop 2026-02-23T06:43:18.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.441+0000 7fe2677fe640 1 -- 10.20.193.58:0/2018753007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe288138800 msgr2=0x7fe288139790 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:43:18.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.441+0000 7fe2677fe640 1 --2- 10.20.193.58:0/2018753007 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe288138800 0x7fe288139790 secure :-1 s=CLOSED pgs=6 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe27c015000 tx=0x7fe27c004770 comp rx=0 tx=0).stop 2026-02-23T06:43:18.438 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:43:18.438 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:43:18.438 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:43:18.438 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:43:18.438 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 190, 2026-02-23T06:43:18.438 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 515, 2026-02-23T06:43:18.439 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:43:18.439 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:43:18.439 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:43:18.439 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:43:18.439 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:18.439 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:43:18.439 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:43:18.439 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:43:18.439 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:43:18.440 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:43:18.440 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:43:18.440 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:43:18.440 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:43:18.440 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:43:18.440 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:43:18.440 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:43:18.440 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:43:18.440 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:43:18.441 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:43:18.441 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:43:18.441 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:43:18.441 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:43:18.441 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:18.441 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:43:18.441 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:43:18.441 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:43:18.441 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:43:18.442 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:43:18.442 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:43:18.442 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:43:18.442 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:43:18.442 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:43:18.442 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:43:18.442 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:43:18.442 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:43:18.442 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:43:18.442 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:43:18.442 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:43:18.442 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:18.442 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.442 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:43:18.443 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:43:18.443 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:43:18.443 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:43:18.443 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:43:18.443 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:43:18.443 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:43:18.443 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:43:18.443 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:43:18.443 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:43:18.443 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:43:18.443 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:43:18.443 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:43:18.443 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:43:18.443 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:43:18.443 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:43:18.443 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:43:18.444 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:43:18.444 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:43:18.444 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:43:18.444 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:43:18.444 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:43:18.444 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:43:18.444 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:43:18.444 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:43:18.444 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:43:18.444 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:43:18.444 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:43:18.444 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:43:18.444 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:43:18.444 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:18.444 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:43:18.444 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.444 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:43:18.445 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.445 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:43:18.445 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:43:18.445 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:43:18.445 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:43:18.445 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.445 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:43:18.445 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:43:18.445 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:18.445 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.445 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.445 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:43:18.445 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:43:18.445 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:18.445 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:18.445 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:18.445 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.446 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:43:18.446 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:43:18.446 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:43:18.446 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:43:18.446 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:43:18.446 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:43:18.446 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.446 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.446 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:43:18.446 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:43:18.446 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:43:18.446 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:43:18.446 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.446 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:43:18.446 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:43:18.446 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:18.446 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.446 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.447 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:43:18.447 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:43:18.447 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:18.447 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:18.447 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:18.447 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.447 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:43:18.447 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:43:18.447 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:43:18.447 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:43:18.447 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:43:18.447 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:43:18.447 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.447 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.447 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:43:18.447 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:43:18.447 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:43:18.448 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:43:18.448 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.448 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:43:18.448 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:43:18.448 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:18.448 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.448 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.448 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:43:18.448 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:43:18.448 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:18.448 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:18.448 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:18.448 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.448 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:43:18.448 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:43:18.448 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:43:18.448 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:43:18.448 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:43:18.449 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:43:18.449 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:18.449 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:18.449 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.449 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:43:18.449 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:43:18.449 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.449 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:18.449 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:18.449 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:43:18.449 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:18.449 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:18.449 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:43:18.449 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.449 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:18.449 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:18.449 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:43:18.450 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:18.450 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:18.450 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.450 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:43:18.450 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:43:18.451 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.441+0000 7fe287fff640 1 -- 10.20.193.58:0/2018753007 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe25407a660 msgr2=0x7fe25409ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:18.451 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.441+0000 7fe287fff640 1 --2- 10.20.193.58:0/2018753007 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe25407a660 0x7fe25409ab10 secure :-1 s=READY pgs=480 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2880b6900 tx=0x7fe2780058c0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.451 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.441+0000 7fe287fff640 1 -- 10.20.193.58:0/2018753007 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe28805b860 msgr2=0x7fe28813d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:18.451 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.441+0000 7fe287fff640 1 --2- 10.20.193.58:0/2018753007 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe28805b860 0x7fe28813d860 secure :-1 s=READY pgs=113 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe27000d980 tx=0x7fe27000de50 comp rx=0 tx=0).stop 2026-02-23T06:43:18.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.441+0000 7fe2877fe640 1 -- 10.20.193.58:0/2018753007 reap_dead start 2026-02-23T06:43:18.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.441+0000 7fe2877fe640 1 -- 10.20.193.58:0/2018753007 reap_dead start 2026-02-23T06:43:18.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.441+0000 7fe287fff640 1 -- 10.20.193.58:0/2018753007 shutdown_connections 2026-02-23T06:43:18.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.441+0000 7fe287fff640 1 -- 10.20.193.58:0/2018753007 >> 10.20.193.58:0/2018753007 conn(0x7fe2880b3c20 msgr2=0x7fe2880af450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:43:18.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.441+0000 7fe287fff640 1 -- 10.20.193.58:0/2018753007 shutdown_connections 2026-02-23T06:43:18.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.441+0000 7fe287fff640 1 -- 10.20.193.58:0/2018753007 wait complete. 2026-02-23T06:43:18.452 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:43:18.452 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:43:18.453 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:43:18.575 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.580+0000 7f53fcbd2640 1 -- 10.20.193.58:0/1351187904 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f53f8162ca0 msgr2=0x7f53f80b6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:18.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.580+0000 7f53fcbd2640 1 --2- 10.20.193.58:0/1351187904 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f53f8162ca0 0x7f53f80b6c60 secure :-1 s=READY pgs=114 gs=2 cs=0 l=1 c_cookie=888721825896504918 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53f80b50a0 tx=0x7f53ec0302e0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.580+0000 7f53fcbd2640 1 -- 10.20.193.58:0/1351187904 shutdown_connections 2026-02-23T06:43:18.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.580+0000 7f53fcbd2640 1 --2- 10.20.193.58:0/1351187904 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f53f8162ca0 0x7f53f80b6c60 unknown :-1 s=CLOSED pgs=114 gs=2 cs=0 l=1 c_cookie=888721825896504918 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.580+0000 7f53fcbd2640 1 --2- 10.20.193.58:0/1351187904 >> v2:10.20.193.93:3300/0 conn(0x7f53f8056960 0x7f53f80b6720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.580+0000 7f53fcbd2640 1 --2- 10.20.193.58:0/1351187904 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f53f815c4b0 0x7f53f8058200 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.580+0000 7f53fcbd2640 1 -- 10.20.193.58:0/1351187904 >> 10.20.193.58:0/1351187904 conn(0x7f53f80b3c20 msgr2=0x7f53f80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:43:18.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.580+0000 7f53fcbd2640 1 -- 10.20.193.58:0/1351187904 shutdown_connections 2026-02-23T06:43:18.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.580+0000 7f53fcbd2640 1 -- 10.20.193.58:0/1351187904 wait complete. 2026-02-23T06:43:18.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.581+0000 7f53fcbd2640 1 Processor -- start 2026-02-23T06:43:18.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.581+0000 7f53fcbd2640 1 -- start start 2026-02-23T06:43:18.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.582+0000 7f53fcbd2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f53f8056960 0x7f53f813f940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:18.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.582+0000 7f53fcbd2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f53f815c4b0 0x7f53f813de30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:18.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.582+0000 7f53fcbd2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f53f8162ca0 0x7f53f8159160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:18.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.582+0000 7f53fcbd2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f53f815f850 con 0x7f53f8162ca0 2026-02-23T06:43:18.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.582+0000 7f53fcbd2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f53f815fb30 con 0x7f53f815c4b0 2026-02-23T06:43:18.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.582+0000 7f53fcbd2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f53f813e830 con 0x7f53f8056960 2026-02-23T06:43:18.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.582+0000 7f53f7fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f53f8162ca0 0x7f53f8159160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:18.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.582+0000 7f53f7fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f53f8162ca0 0x7f53f8159160 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:48870/0 (socket says 10.20.193.58:48870) 2026-02-23T06:43:18.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.582+0000 7f53f7fff640 1 -- 10.20.193.58:0/30751318 learned_addr learned my addr 10.20.193.58:0/30751318 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:43:18.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.582+0000 7f53f6ffd640 1 --2- 10.20.193.58:0/30751318 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f53f815c4b0 0x7f53f813de30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:18.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.582+0000 7f53f77fe640 1 --2- 10.20.193.58:0/30751318 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f53f8056960 0x7f53f813f940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:18.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.582+0000 7f53f7fff640 1 -- 10.20.193.58:0/30751318 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f53f8056960 msgr2=0x7f53f813f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:18.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.582+0000 7f53f7fff640 1 --2- 10.20.193.58:0/30751318 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f53f8056960 0x7f53f813f940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.582+0000 7f53f7fff640 1 -- 10.20.193.58:0/30751318 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f53f815c4b0 msgr2=0x7f53f813de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:18.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.582+0000 7f53f7fff640 1 --2- 10.20.193.58:0/30751318 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f53f815c4b0 0x7f53f813de30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.582+0000 7f53f7fff640 1 -- 10.20.193.58:0/30751318 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ec00a650 con 0x7f53f8162ca0 2026-02-23T06:43:18.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.582+0000 7f53f7fff640 1 --2- 10.20.193.58:0/30751318 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f53f8162ca0 0x7f53f8159160 secure :-1 s=READY pgs=115 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53ec00a230 tx=0x7f53ec0039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:18.582 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.583+0000 7f53d3fff640 1 -- 10.20.193.58:0/30751318 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53ec039470 con 0x7f53f8162ca0 2026-02-23T06:43:18.582 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.583+0000 7f53d3fff640 1 -- 10.20.193.58:0/30751318 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53ec0396c0 con 0x7f53f8162ca0 2026-02-23T06:43:18.582 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.583+0000 7f53d3fff640 1 -- 10.20.193.58:0/30751318 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53ec039a90 con 0x7f53f8162ca0 2026-02-23T06:43:18.582 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.583+0000 7f53fcbd2640 1 -- 10.20.193.58:0/30751318 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53f813eb10 con 0x7f53f8162ca0 2026-02-23T06:43:18.582 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.583+0000 7f53fcbd2640 1 -- 10.20.193.58:0/30751318 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53f813f0d0 con 0x7f53f8162ca0 2026-02-23T06:43:18.582 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.583+0000 7f53fcbd2640 1 --2- 10.20.193.58:0/30751318 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f53f815eef0 0x7f53f81596a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:18.582 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.583+0000 7f53fcbd2640 1 -- 10.20.193.58:0/30751318 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f53f80609c0 con 0x7f53f815eef0 2026-02-23T06:43:18.582 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.584+0000 7f53f77fe640 1 --2- 10.20.193.58:0/30751318 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f53f815eef0 0x7f53f81596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:18.582 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.584+0000 7f53f77fe640 1 -- 10.20.193.58:0/30751318 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f53f8059690 con 0x7f53f815eef0 2026-02-23T06:43:18.582 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.584+0000 7f53f77fe640 1 --2- 10.20.193.58:0/30751318 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f53f815eef0 0x7f53f81596a0 secure :-1 s=READY pgs=35 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53e4002fc0 tx=0x7f53e4009ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:18.582 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.584+0000 7f53d3fff640 1 -- 10.20.193.58:0/30751318 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53e4011030 con 0x7f53f815eef0 2026-02-23T06:43:18.582 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.585+0000 7f53d3fff640 1 -- 10.20.193.58:0/30751318 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f53e4011190 con 0x7f53f815eef0 2026-02-23T06:43:18.583 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.585+0000 7f53d3fff640 1 -- 10.20.193.58:0/30751318 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f53f815eef0 msgr2=0x7f53f81596a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:18.583 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.585+0000 7f53d3fff640 1 --2- 10.20.193.58:0/30751318 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f53f815eef0 0x7f53f81596a0 secure :-1 s=READY pgs=35 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53e4002fc0 tx=0x7f53e4009ac0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.583 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.585+0000 7f53d3fff640 1 -- 10.20.193.58:0/30751318 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f53f815eef0 msgr2=0x7f53f81596a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:43:18.583 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.585+0000 7f53d3fff640 1 --2- 10.20.193.58:0/30751318 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f53f815eef0 0x7f53f81596a0 unknown :-1 s=CLOSED pgs=35 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.583 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.585+0000 7f53d3fff640 1 -- 10.20.193.58:0/30751318 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f53ec039bf0 con 0x7f53f8162ca0 2026-02-23T06:43:18.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.586+0000 7f53d3fff640 1 --2- 10.20.193.58:0/30751318 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f53c807a3c0 0x7f53c809a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:18.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.586+0000 7f53d3fff640 1 -- 10.20.193.58:0/30751318 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f53ec0c3e30 con 0x7f53f8162ca0 2026-02-23T06:43:18.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.586+0000 7f53f77fe640 1 --2- 10.20.193.58:0/30751318 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f53c807a3c0 0x7f53c809a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:18.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.586+0000 7f53f77fe640 1 --2- 10.20.193.58:0/30751318 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f53c807a3c0 0x7f53c809a870 secure :-1 s=READY pgs=481 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53e40046d0 tx=0x7f53e401d040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:18.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.588+0000 7f53fcbd2640 1 --2- 10.20.193.58:0/30751318 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f53f815d3a0 0x7f53f815d770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:18.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.588+0000 7f53fcbd2640 1 -- 10.20.193.58:0/30751318 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f53f815c880 con 0x7f53f815d3a0 2026-02-23T06:43:18.585 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.588+0000 7f53f6ffd640 1 --2- 10.20.193.58:0/30751318 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f53f815d3a0 0x7f53f815d770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:18.586 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.589+0000 7f53f6ffd640 1 -- 10.20.193.58:0/30751318 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f53f813f290 con 0x7f53f815d3a0 2026-02-23T06:43:18.586 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.589+0000 7f53f6ffd640 1 --2- 10.20.193.58:0/30751318 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f53f815d3a0 0x7f53f815d770 secure :-1 s=READY pgs=36 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53f81faf60 tx=0x7f53e80099d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:18.586 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.589+0000 7f53d3fff640 1 -- 10.20.193.58:0/30751318 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53e80118d0 con 0x7f53f815d3a0 2026-02-23T06:43:18.586 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.589+0000 7f53d3fff640 1 -- 10.20.193.58:0/30751318 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5412 (secure 0 0 0) 0x7f53e8011a30 con 0x7f53f815d3a0 2026-02-23T06:43:18.586 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.589+0000 7f53d3fff640 1 -- 10.20.193.58:0/30751318 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f53f815d3a0 msgr2=0x7f53f815d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:18.586 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.589+0000 7f53d3fff640 1 --2- 10.20.193.58:0/30751318 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f53f815d3a0 0x7f53f815d770 secure :-1 s=READY pgs=36 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53f81faf60 tx=0x7f53e80099d0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.586 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.589+0000 7f53d3fff640 1 -- 10.20.193.58:0/30751318 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f53f815d3a0 msgr2=0x7f53f815d770 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:43:18.586 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.589+0000 7f53d3fff640 1 --2- 10.20.193.58:0/30751318 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f53f815d3a0 0x7f53f815d770 secure :-1 s=CLOSED pgs=36 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53f81faf60 tx=0x7f53e80099d0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.586 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:43:18.587 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:43:18.587 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:43:18.587 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:43:18.587 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 190, 2026-02-23T06:43:18.587 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 52018, 2026-02-23T06:43:18.587 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:43:18.587 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:43:18.587 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:43:18.587 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:43:18.587 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:18.588 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:43:18.588 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:43:18.588 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:43:18.588 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:43:18.588 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:43:18.588 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:43:18.588 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:43:18.588 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:43:18.588 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:43:18.588 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:43:18.589 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:43:18.589 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:43:18.589 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:43:18.589 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:43:18.589 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:43:18.589 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:43:18.589 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:43:18.589 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:18.589 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:43:18.590 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:43:18.590 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:43:18.590 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:43:18.590 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:43:18.590 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:43:18.590 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:43:18.590 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:43:18.590 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:43:18.590 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:43:18.590 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:43:18.590 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:43:18.590 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:43:18.591 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:43:18.591 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:43:18.591 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:18.591 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.591 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:43:18.591 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:43:18.591 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:43:18.591 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:43:18.591 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:43:18.591 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:43:18.591 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:43:18.592 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:43:18.592 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:43:18.592 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:43:18.592 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:43:18.592 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:43:18.592 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:43:18.592 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:43:18.592 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:43:18.592 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:43:18.592 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:43:18.592 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:43:18.592 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:43:18.593 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:43:18.593 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:43:18.593 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:43:18.593 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:43:18.593 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:43:18.593 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:43:18.593 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:43:18.593 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:43:18.593 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:43:18.593 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:43:18.593 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:43:18.593 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:18.593 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:43:18.594 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.594 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:43:18.594 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.594 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:43:18.594 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:43:18.594 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:43:18.594 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:43:18.594 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.594 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:43:18.594 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:43:18.594 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:18.594 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.595 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.595 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:43:18.595 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:43:18.595 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:18.595 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:18.595 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:18.595 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.595 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:43:18.595 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:43:18.595 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:43:18.595 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:43:18.595 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:43:18.596 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:43:18.596 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.596 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.596 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:43:18.596 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:43:18.596 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:43:18.596 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:43:18.596 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.596 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:43:18.597 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:43:18.597 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:18.597 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.597 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.597 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:43:18.597 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:43:18.597 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:18.597 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:18.597 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:18.597 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.597 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:43:18.597 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:43:18.598 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:43:18.598 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:43:18.598 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:43:18.598 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:43:18.598 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.598 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.598 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:43:18.598 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:43:18.598 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:43:18.598 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:43:18.598 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.598 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:43:18.599 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:43:18.599 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:18.599 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.599 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.599 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:43:18.599 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:43:18.599 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:18.599 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:18.599 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:18.599 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.599 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:43:18.599 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:43:18.599 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:43:18.600 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:43:18.600 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:43:18.600 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:43:18.600 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:18.600 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:18.600 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.600 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:43:18.600 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:43:18.600 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.600 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:18.600 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:18.600 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:43:18.601 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:18.601 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:18.601 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:43:18.601 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.601 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:18.601 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:18.601 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:43:18.601 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:18.601 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:18.601 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:43:18.601 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.601 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:18.602 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:18.602 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:43:18.602 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:18.602 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:18.602 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:43:18.602 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.602 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:18.602 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:18.602 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:43:18.602 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:18.602 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:18.602 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:43:18.603 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:18.603 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:18.603 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:18.603 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:43:18.603 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:18.603 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:18.603 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:18.603 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:43:18.603 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:43:18.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.590+0000 7f53fcbd2640 1 -- 10.20.193.58:0/30751318 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f53c807a3c0 msgr2=0x7f53c809a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:18.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.590+0000 7f53fcbd2640 1 --2- 10.20.193.58:0/30751318 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f53c807a3c0 0x7f53c809a870 secure :-1 s=READY pgs=481 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53e40046d0 tx=0x7f53e401d040 comp rx=0 tx=0).stop 2026-02-23T06:43:18.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.590+0000 7f53fcbd2640 1 -- 10.20.193.58:0/30751318 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f53f8162ca0 msgr2=0x7f53f8159160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:18.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.590+0000 7f53fcbd2640 1 --2- 10.20.193.58:0/30751318 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f53f8162ca0 0x7f53f8159160 secure :-1 s=READY pgs=115 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53ec00a230 tx=0x7f53ec0039b0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.590+0000 7f53f7fff640 1 -- 10.20.193.58:0/30751318 reap_dead start 2026-02-23T06:43:18.605 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.590+0000 7f53f7fff640 1 -- 10.20.193.58:0/30751318 reap_dead start 2026-02-23T06:43:18.606 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.590+0000 7f53fcbd2640 1 -- 10.20.193.58:0/30751318 shutdown_connections 2026-02-23T06:43:18.606 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.590+0000 7f53fcbd2640 1 -- 10.20.193.58:0/30751318 >> 10.20.193.58:0/30751318 conn(0x7f53f80b3c20 msgr2=0x7f53f80b7680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:43:18.606 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.590+0000 7f53fcbd2640 1 -- 10.20.193.58:0/30751318 shutdown_connections 2026-02-23T06:43:18.606 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.590+0000 7f53fcbd2640 1 -- 10.20.193.58:0/30751318 wait complete. 2026-02-23T06:43:18.606 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:43:18.607 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:43:18.607 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:43:18.728 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.732+0000 7f9efe243640 1 -- 10.20.193.58:0/1297044141 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9ef815c040 msgr2=0x7f9ef805b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:18.728 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.732+0000 7f9efe243640 1 --2- 10.20.193.58:0/1297044141 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9ef815c040 0x7f9ef805b0e0 secure :-1 s=READY pgs=117 gs=3 cs=0 l=1 c_cookie=1192037536549891741 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ee8004740 tx=0x7f9ee802f220 comp rx=0 tx=0).stop 2026-02-23T06:43:18.728 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.732+0000 7f9efe243640 1 -- 10.20.193.58:0/1297044141 shutdown_connections 2026-02-23T06:43:18.728 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.732+0000 7f9efe243640 1 --2- 10.20.193.58:0/1297044141 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9ef815c040 0x7f9ef805b0e0 unknown :-1 s=CLOSED pgs=117 gs=3 cs=0 l=1 c_cookie=1192037536549891741 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.728 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.732+0000 7f9efe243640 1 -- 10.20.193.58:0/1297044141 >> 10.20.193.58:0/1297044141 conn(0x7f9ef80b3c20 msgr2=0x7f9ef80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:43:18.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.732+0000 7f9efe243640 1 -- 10.20.193.58:0/1297044141 shutdown_connections 2026-02-23T06:43:18.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.732+0000 7f9efe243640 1 -- 10.20.193.58:0/1297044141 wait complete. 2026-02-23T06:43:18.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.733+0000 7f9efe243640 1 Processor -- start 2026-02-23T06:43:18.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.734+0000 7f9efe243640 1 -- start start 2026-02-23T06:43:18.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.734+0000 7f9efe243640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9ef8056550 0x7f9ef8154fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:18.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.734+0000 7f9efe243640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9ef80b5680 0x7f9ef8160c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:18.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.734+0000 7f9efe243640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9ef815c040 0x7f9ef81611d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:18.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.734+0000 7f9efe243640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef815c590 con 0x7f9ef8056550 2026-02-23T06:43:18.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.734+0000 7f9efe243640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef80591e0 con 0x7f9ef815c040 2026-02-23T06:43:18.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.734+0000 7f9efe243640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f9ef81617b0 con 0x7f9ef80b5680 2026-02-23T06:43:18.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.734+0000 7f9efd241640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9ef8056550 0x7f9ef8154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:18.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.734+0000 7f9efd241640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9ef8056550 0x7f9ef8154fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:48902/0 (socket says 10.20.193.58:48902) 2026-02-23T06:43:18.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.734+0000 7f9efd241640 1 -- 10.20.193.58:0/608722486 learned_addr learned my addr 10.20.193.58:0/608722486 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:43:18.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.734+0000 7f9efca40640 1 --2- 10.20.193.58:0/608722486 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9ef80b5680 0x7f9ef8160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:18.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.735+0000 7f9efda42640 1 --2- 10.20.193.58:0/608722486 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9ef815c040 0x7f9ef81611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:18.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.735+0000 7f9efd241640 1 -- 10.20.193.58:0/608722486 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9ef80b5680 msgr2=0x7f9ef8160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:18.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.735+0000 7f9efd241640 1 --2- 10.20.193.58:0/608722486 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9ef80b5680 0x7f9ef8160c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.735+0000 7f9efd241640 1 -- 10.20.193.58:0/608722486 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9ef815c040 msgr2=0x7f9ef81611d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:18.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.735+0000 7f9efd241640 1 --2- 10.20.193.58:0/608722486 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9ef815c040 0x7f9ef81611d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.735+0000 7f9efd241640 1 -- 10.20.193.58:0/608722486 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee80094b0 con 0x7f9ef8056550 2026-02-23T06:43:18.733 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.735+0000 7f9efd241640 1 --2- 10.20.193.58:0/608722486 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9ef8056550 0x7f9ef8154fd0 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ee80097e0 tx=0x7f9ee80028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:18.733 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.735+0000 7f9ee5ffb640 1 -- 10.20.193.58:0/608722486 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ee8038470 con 0x7f9ef8056550 2026-02-23T06:43:18.733 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.735+0000 7f9ee5ffb640 1 -- 10.20.193.58:0/608722486 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ee80386c0 con 0x7f9ef8056550 2026-02-23T06:43:18.733 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.735+0000 7f9ee5ffb640 1 -- 10.20.193.58:0/608722486 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ee8038ab0 con 0x7f9ef8056550 2026-02-23T06:43:18.733 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.735+0000 7f9efe243640 1 -- 10.20.193.58:0/608722486 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ef81547d0 con 0x7f9ef8056550 2026-02-23T06:43:18.733 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.735+0000 7f9efe243640 1 -- 10.20.193.58:0/608722486 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ef81650e0 con 0x7f9ef8056550 2026-02-23T06:43:18.734 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.737+0000 7f9efe243640 1 -- 10.20.193.58:0/608722486 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ef8154c00 con 0x7f9ef8056550 2026-02-23T06:43:18.734 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.737+0000 7f9ee5ffb640 1 -- 10.20.193.58:0/608722486 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f9ee8038c10 con 0x7f9ef8056550 2026-02-23T06:43:18.734 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.738+0000 7f9ee5ffb640 1 --2- 10.20.193.58:0/608722486 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9ec807a6c0 0x7f9ec809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:18.734 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.738+0000 7f9ee5ffb640 1 -- 10.20.193.58:0/608722486 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f9ee80c2ba0 con 0x7f9ef8056550 2026-02-23T06:43:18.735 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.738+0000 7f9efca40640 1 --2- 10.20.193.58:0/608722486 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9ec807a6c0 0x7f9ec809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:18.735 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.739+0000 7f9efca40640 1 --2- 10.20.193.58:0/608722486 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9ec807a6c0 0x7f9ec809ab70 secure :-1 s=READY pgs=482 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ef80b61a0 tx=0x7f9eec007db0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:18.735 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.739+0000 7f9ee5ffb640 1 -- 10.20.193.58:0/608722486 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f9ee8085dd0 con 0x7f9ef8056550 2026-02-23T06:43:18.890 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.895+0000 7f9efe243640 1 -- 10.20.193.58:0/608722486 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f9ef805b0e0 con 0x7f9ef8056550 2026-02-23T06:43:18.891 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.895+0000 7f9ee5ffb640 1 -- 10.20.193.58:0/608722486 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f9ee8088ef0 con 0x7f9ef8056550 2026-02-23T06:43:18.892 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.897+0000 7f9efe243640 1 -- 10.20.193.58:0/608722486 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9ec807a6c0 msgr2=0x7f9ec809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:18.893 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.897+0000 7f9efe243640 1 --2- 10.20.193.58:0/608722486 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9ec807a6c0 0x7f9ec809ab70 secure :-1 s=READY pgs=482 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ef80b61a0 tx=0x7f9eec007db0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.893 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.897+0000 7f9efe243640 1 -- 10.20.193.58:0/608722486 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9ef8056550 msgr2=0x7f9ef8154fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:18.893 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.897+0000 7f9efe243640 1 --2- 10.20.193.58:0/608722486 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9ef8056550 0x7f9ef8154fd0 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ee80097e0 tx=0x7f9ee80028d0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.893 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.897+0000 7f9efe243640 1 -- 10.20.193.58:0/608722486 shutdown_connections 2026-02-23T06:43:18.893 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.897+0000 7f9efe243640 1 --2- 10.20.193.58:0/608722486 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9ec807a6c0 0x7f9ec809ab70 unknown :-1 s=CLOSED pgs=482 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.893 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.897+0000 7f9efe243640 1 --2- 10.20.193.58:0/608722486 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9ef815c040 0x7f9ef81611d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.893 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.897+0000 7f9efe243640 1 --2- 10.20.193.58:0/608722486 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9ef80b5680 0x7f9ef8160c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.893 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.897+0000 7f9efe243640 1 --2- 10.20.193.58:0/608722486 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9ef8056550 0x7f9ef8154fd0 unknown :-1 s=CLOSED pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:18.893 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.897+0000 7f9efe243640 1 -- 10.20.193.58:0/608722486 >> 10.20.193.58:0/608722486 conn(0x7f9ef80b3c20 msgr2=0x7f9ef805cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:43:18.893 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.897+0000 7f9efe243640 1 -- 10.20.193.58:0/608722486 shutdown_connections 2026-02-23T06:43:18.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:18.897+0000 7f9efe243640 1 -- 10.20.193.58:0/608722486 wait complete. 2026-02-23T06:43:18.905 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:43:28.906 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:43:28.907 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:43:29.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.034+0000 7fbc65683640 1 -- 10.20.193.58:0/2032266385 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbc6015d870 msgr2=0x7fbc600587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:29.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.034+0000 7fbc65683640 1 --2- 10.20.193.58:0/2032266385 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbc6015d870 0x7fbc600587b0 secure :-1 s=READY pgs=119 gs=3 cs=0 l=1 c_cookie=8631689430627407530 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc600b5040 tx=0x7fbc5002f250 comp rx=0 tx=0).stop 2026-02-23T06:43:29.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.034+0000 7fbc65683640 1 -- 10.20.193.58:0/2032266385 shutdown_connections 2026-02-23T06:43:29.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.034+0000 7fbc65683640 1 --2- 10.20.193.58:0/2032266385 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbc6015d870 0x7fbc600587b0 unknown :-1 s=CLOSED pgs=119 gs=3 cs=0 l=1 c_cookie=8631689430627407530 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.034+0000 7fbc65683640 1 --2- 10.20.193.58:0/2032266385 >> v2:10.20.193.93:3300/0 conn(0x7fbc6015d4a0 0x7fbc600affb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.034+0000 7fbc65683640 1 -- 10.20.193.58:0/2032266385 >> 10.20.193.58:0/2032266385 conn(0x7fbc600b3c20 msgr2=0x7fbc600b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:43:29.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.034+0000 7fbc65683640 1 -- 10.20.193.58:0/2032266385 shutdown_connections 2026-02-23T06:43:29.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.034+0000 7fbc65683640 1 -- 10.20.193.58:0/2032266385 wait complete. 2026-02-23T06:43:29.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.035+0000 7fbc65683640 1 Processor -- start 2026-02-23T06:43:29.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.035+0000 7fbc65683640 1 -- start start 2026-02-23T06:43:29.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.036+0000 7fbc65683640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbc600b6690 0x7fbc60140590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:29.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.036+0000 7fbc65683640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbc6015d4a0 0x7fbc60161090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:29.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.036+0000 7fbc65683640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbc6015d870 0x7fbc601615d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:29.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.036+0000 7fbc65683640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fbc60129540 con 0x7fbc6015d4a0 2026-02-23T06:43:29.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.036+0000 7fbc65683640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fbc60129280 con 0x7fbc6015d870 2026-02-23T06:43:29.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.036+0000 7fbc65683640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fbc600577b0 con 0x7fbc600b6690 2026-02-23T06:43:29.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.036+0000 7fbc5f7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbc6015d4a0 0x7fbc60161090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:29.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.036+0000 7fbc5f7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbc6015d4a0 0x7fbc60161090 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:43692/0 (socket says 10.20.193.58:43692) 2026-02-23T06:43:29.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.036+0000 7fbc5f7fe640 1 -- 10.20.193.58:0/2770212272 learned_addr learned my addr 10.20.193.58:0/2770212272 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:43:29.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.036+0000 7fbc5ffff640 1 --2- 10.20.193.58:0/2770212272 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbc600b6690 0x7fbc60140590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:29.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.036+0000 7fbc64e82640 1 --2- 10.20.193.58:0/2770212272 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbc6015d870 0x7fbc601615d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:29.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.036+0000 7fbc5f7fe640 1 -- 10.20.193.58:0/2770212272 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbc600b6690 msgr2=0x7fbc60140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:29.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.036+0000 7fbc5f7fe640 1 --2- 10.20.193.58:0/2770212272 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbc600b6690 0x7fbc60140590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.036+0000 7fbc5f7fe640 1 -- 10.20.193.58:0/2770212272 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbc6015d870 msgr2=0x7fbc601615d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:29.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.036+0000 7fbc5f7fe640 1 --2- 10.20.193.58:0/2770212272 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbc6015d870 0x7fbc601615d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.036+0000 7fbc5f7fe640 1 -- 10.20.193.58:0/2770212272 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc50009570 con 0x7fbc6015d4a0 2026-02-23T06:43:29.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.036+0000 7fbc5f7fe640 1 --2- 10.20.193.58:0/2770212272 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbc6015d4a0 0x7fbc60161090 secure :-1 s=READY pgs=120 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc50004740 tx=0x7fbc500028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:29.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.037+0000 7fbc5cff9640 1 -- 10.20.193.58:0/2770212272 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc5003d070 con 0x7fbc6015d4a0 2026-02-23T06:43:29.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.037+0000 7fbc5cff9640 1 -- 10.20.193.58:0/2770212272 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc50038470 con 0x7fbc6015d4a0 2026-02-23T06:43:29.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.037+0000 7fbc5cff9640 1 -- 10.20.193.58:0/2770212272 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc50038880 con 0x7fbc6015d4a0 2026-02-23T06:43:29.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.037+0000 7fbc65683640 1 -- 10.20.193.58:0/2770212272 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc60057a90 con 0x7fbc6015d4a0 2026-02-23T06:43:29.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.037+0000 7fbc65683640 1 -- 10.20.193.58:0/2770212272 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc60058050 con 0x7fbc6015d4a0 2026-02-23T06:43:29.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.037+0000 7fbc65683640 1 -- 10.20.193.58:0/2770212272 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc600b6d50 con 0x7fbc6015d4a0 2026-02-23T06:43:29.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.038+0000 7fbc5cff9640 1 -- 10.20.193.58:0/2770212272 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fbc500389e0 con 0x7fbc6015d4a0 2026-02-23T06:43:29.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.039+0000 7fbc5cff9640 1 --2- 10.20.193.58:0/2770212272 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbc3007a6b0 0x7fbc3009ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:29.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.039+0000 7fbc5cff9640 1 -- 10.20.193.58:0/2770212272 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fbc500c21d0 con 0x7fbc6015d4a0 2026-02-23T06:43:29.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.039+0000 7fbc5ffff640 1 --2- 10.20.193.58:0/2770212272 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbc3007a6b0 0x7fbc3009ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:29.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.040+0000 7fbc5ffff640 1 --2- 10.20.193.58:0/2770212272 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbc3007a6b0 0x7fbc3009ab60 secure :-1 s=READY pgs=483 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc4c004740 tx=0x7fbc4c005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:29.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.041+0000 7fbc5cff9640 1 -- 10.20.193.58:0/2770212272 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fbc50085390 con 0x7fbc6015d4a0 2026-02-23T06:43:29.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.199+0000 7fbc65683640 1 -- 10.20.193.58:0/2770212272 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fbc60129040 con 0x7fbc6015d4a0 2026-02-23T06:43:29.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.199+0000 7fbc5cff9640 1 -- 10.20.193.58:0/2770212272 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7fbc60129040 con 0x7fbc6015d4a0 2026-02-23T06:43:29.195 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":190,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:43:29.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.201+0000 7fbc65683640 1 -- 10.20.193.58:0/2770212272 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbc3007a6b0 msgr2=0x7fbc3009ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:29.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.201+0000 7fbc65683640 1 --2- 10.20.193.58:0/2770212272 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbc3007a6b0 0x7fbc3009ab60 secure :-1 s=READY pgs=483 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc4c004740 tx=0x7fbc4c005f90 comp rx=0 tx=0).stop 2026-02-23T06:43:29.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.201+0000 7fbc65683640 1 -- 10.20.193.58:0/2770212272 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbc6015d4a0 msgr2=0x7fbc60161090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:29.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.201+0000 7fbc65683640 1 --2- 10.20.193.58:0/2770212272 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbc6015d4a0 0x7fbc60161090 secure :-1 s=READY pgs=120 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc50004740 tx=0x7fbc500028d0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.201+0000 7fbc65683640 1 -- 10.20.193.58:0/2770212272 shutdown_connections 2026-02-23T06:43:29.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.201+0000 7fbc65683640 1 --2- 10.20.193.58:0/2770212272 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbc3007a6b0 0x7fbc3009ab60 unknown :-1 s=CLOSED pgs=483 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.201+0000 7fbc65683640 1 --2- 10.20.193.58:0/2770212272 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbc6015d870 0x7fbc601615d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.201+0000 7fbc65683640 1 --2- 10.20.193.58:0/2770212272 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbc6015d4a0 0x7fbc60161090 unknown :-1 s=CLOSED pgs=120 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.201+0000 7fbc65683640 1 --2- 10.20.193.58:0/2770212272 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbc600b6690 0x7fbc60140590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.201+0000 7fbc65683640 1 -- 10.20.193.58:0/2770212272 >> 10.20.193.58:0/2770212272 conn(0x7fbc600b3c20 msgr2=0x7fbc60141410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:43:29.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.201+0000 7fbc65683640 1 -- 10.20.193.58:0/2770212272 shutdown_connections 2026-02-23T06:43:29.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.201+0000 7fbc65683640 1 -- 10.20.193.58:0/2770212272 wait complete. 2026-02-23T06:43:29.209 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:43:29.209 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:43:29.209 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:43:29.209 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:43:29.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.337+0000 7f7acf577640 1 -- 10.20.193.58:0/1438567743 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7ad0056550 msgr2=0x7f7ad005ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:29.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.337+0000 7f7acf577640 1 --2- 10.20.193.58:0/1438567743 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7ad0056550 0x7f7ad005ce30 secure :-1 s=READY pgs=121 gs=2 cs=0 l=1 c_cookie=17550794843628292145 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ab8005e70 tx=0x7f7ab802f290 comp rx=0 tx=0).stop 2026-02-23T06:43:29.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.337+0000 7f7acf577640 1 -- 10.20.193.58:0/1438567743 shutdown_connections 2026-02-23T06:43:29.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.337+0000 7f7acf577640 1 --2- 10.20.193.58:0/1438567743 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7ad005d370 0x7f7ad00b5680 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.337+0000 7f7acf577640 1 --2- 10.20.193.58:0/1438567743 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7ad0056550 0x7f7ad005ce30 unknown :-1 s=CLOSED pgs=121 gs=2 cs=0 l=1 c_cookie=17550794843628292145 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.337+0000 7f7acf577640 1 -- 10.20.193.58:0/1438567743 >> 10.20.193.58:0/1438567743 conn(0x7f7ad00b3c20 msgr2=0x7f7ad00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:43:29.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.338+0000 7f7acf577640 1 -- 10.20.193.58:0/1438567743 shutdown_connections 2026-02-23T06:43:29.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.338+0000 7f7acf577640 1 -- 10.20.193.58:0/1438567743 wait complete. 2026-02-23T06:43:29.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.339+0000 7f7acf577640 1 Processor -- start 2026-02-23T06:43:29.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.339+0000 7f7acf577640 1 -- start start 2026-02-23T06:43:29.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.339+0000 7f7acf577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7ad0056550 0x7f7ad0058810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:29.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.339+0000 7f7acf577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7ad005d370 0x7f7ad015cfa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:29.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.339+0000 7f7acf577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7ad015c040 0x7f7ad015e6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:29.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.339+0000 7f7acf577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad0154420 con 0x7f7ad0056550 2026-02-23T06:43:29.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.339+0000 7f7acf577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad0155150 con 0x7f7ad005d370 2026-02-23T06:43:29.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.339+0000 7f7acf577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad015c940 con 0x7f7ad015c040 2026-02-23T06:43:29.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.339+0000 7f7ace575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7ad0056550 0x7f7ad0058810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:29.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.339+0000 7f7acdd74640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7ad005d370 0x7f7ad015cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:29.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.340+0000 7f7acdd74640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7ad005d370 0x7f7ad015cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:51104/0 (socket says 10.20.193.58:51104) 2026-02-23T06:43:29.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.340+0000 7f7acdd74640 1 -- 10.20.193.58:0/1416607991 learned_addr learned my addr 10.20.193.58:0/1416607991 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:43:29.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.340+0000 7f7aced76640 1 --2- 10.20.193.58:0/1416607991 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7ad015c040 0x7f7ad015e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:29.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.340+0000 7f7ace575640 1 -- 10.20.193.58:0/1416607991 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7ad015c040 msgr2=0x7f7ad015e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:29.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.340+0000 7f7ace575640 1 --2- 10.20.193.58:0/1416607991 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7ad015c040 0x7f7ad015e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.340+0000 7f7ace575640 1 -- 10.20.193.58:0/1416607991 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7ad005d370 msgr2=0x7f7ad015cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:29.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.340+0000 7f7ace575640 1 --2- 10.20.193.58:0/1416607991 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7ad005d370 0x7f7ad015cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.340+0000 7f7ace575640 1 -- 10.20.193.58:0/1416607991 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ab8009570 con 0x7f7ad0056550 2026-02-23T06:43:29.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.340+0000 7f7ace575640 1 --2- 10.20.193.58:0/1416607991 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7ad0056550 0x7f7ad0058810 secure :-1 s=READY pgs=122 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ac4003770 tx=0x7f7ac400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:29.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.340+0000 7f7ab6ffd640 1 -- 10.20.193.58:0/1416607991 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7ac4006ab0 con 0x7f7ad0056550 2026-02-23T06:43:29.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.340+0000 7f7ab6ffd640 1 -- 10.20.193.58:0/1416607991 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ac4006d00 con 0x7f7ad0056550 2026-02-23T06:43:29.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.340+0000 7f7ab6ffd640 1 -- 10.20.193.58:0/1416607991 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7ac40072b0 con 0x7f7ad0056550 2026-02-23T06:43:29.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.340+0000 7f7acf577640 1 -- 10.20.193.58:0/1416607991 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ad015cc20 con 0x7f7ad0056550 2026-02-23T06:43:29.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.340+0000 7f7acf577640 1 -- 10.20.193.58:0/1416607991 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ad0154950 con 0x7f7ad0056550 2026-02-23T06:43:29.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.341+0000 7f7acf577640 1 --2- 10.20.193.58:0/1416607991 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7a980041f0 0x7f7a980246a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:29.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.341+0000 7f7acf577640 1 -- 10.20.193.58:0/1416607991 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f7a98025f20 con 0x7f7a980041f0 2026-02-23T06:43:29.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.341+0000 7f7acdd74640 1 --2- 10.20.193.58:0/1416607991 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7a980041f0 0x7f7a980246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:29.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.341+0000 7f7acdd74640 1 -- 10.20.193.58:0/1416607991 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7a980260e0 con 0x7f7a980041f0 2026-02-23T06:43:29.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.342+0000 7f7acdd74640 1 --2- 10.20.193.58:0/1416607991 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7a980041f0 0x7f7a980246a0 secure :-1 s=READY pgs=123 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ad0164e30 tx=0x7f7ab80028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:29.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.342+0000 7f7ab6ffd640 1 -- 10.20.193.58:0/1416607991 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7ab803d050 con 0x7f7a980041f0 2026-02-23T06:43:29.342 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.342+0000 7f7ab6ffd640 1 -- 10.20.193.58:0/1416607991 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f7ab803e040 con 0x7f7a980041f0 2026-02-23T06:43:29.342 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.342+0000 7f7ab6ffd640 1 -- 10.20.193.58:0/1416607991 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7a980041f0 msgr2=0x7f7a980246a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:29.342 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.342+0000 7f7ab6ffd640 1 --2- 10.20.193.58:0/1416607991 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7a980041f0 0x7f7a980246a0 secure :-1 s=READY pgs=123 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ad0164e30 tx=0x7f7ab80028d0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.343 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.342+0000 7f7ab6ffd640 1 -- 10.20.193.58:0/1416607991 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7a980041f0 msgr2=0x7f7a980246a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:43:29.343 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.342+0000 7f7ab6ffd640 1 --2- 10.20.193.58:0/1416607991 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7a980041f0 0x7f7a980246a0 secure :-1 s=CLOSED pgs=123 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ad0164e30 tx=0x7f7ab80028d0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.343 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.342+0000 7f7ab6ffd640 1 -- 10.20.193.58:0/1416607991 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f7ac4007410 con 0x7f7ad0056550 2026-02-23T06:43:29.343 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.343+0000 7f7ab6ffd640 1 --2- 10.20.193.58:0/1416607991 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7a9c07a430 0x7f7a9c09a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:29.343 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.343+0000 7f7ab6ffd640 1 -- 10.20.193.58:0/1416607991 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f7ac409cc30 con 0x7f7ad0056550 2026-02-23T06:43:29.343 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.343+0000 7f7acdd74640 1 --2- 10.20.193.58:0/1416607991 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7a9c07a430 0x7f7a9c09a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:29.343 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.344+0000 7f7acdd74640 1 --2- 10.20.193.58:0/1416607991 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7a9c07a430 0x7f7a9c09a8e0 secure :-1 s=READY pgs=484 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ad0164e30 tx=0x7f7ab8031030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:29.343 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.346+0000 7f7acf577640 1 --2- 10.20.193.58:0/1416607991 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7a98025080 0x7f7a98025500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:29.343 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.346+0000 7f7acf577640 1 -- 10.20.193.58:0/1416607991 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f7a98025a70 con 0x7f7a98025080 2026-02-23T06:43:29.343 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.346+0000 7f7aced76640 1 --2- 10.20.193.58:0/1416607991 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7a98025080 0x7f7a98025500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:29.343 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.346+0000 7f7aced76640 1 -- 10.20.193.58:0/1416607991 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7a98025c30 con 0x7f7a98025080 2026-02-23T06:43:29.343 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.346+0000 7f7aced76640 1 --2- 10.20.193.58:0/1416607991 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7a98025080 0x7f7a98025500 secure :-1 s=READY pgs=124 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ac0011970 tx=0x7f7ac0011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:29.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.346+0000 7f7ab6ffd640 1 -- 10.20.193.58:0/1416607991 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7ac000fe10 con 0x7f7a98025080 2026-02-23T06:43:29.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.347+0000 7f7ab6ffd640 1 -- 10.20.193.58:0/1416607991 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5559 (secure 0 0 0) 0x7f7ac00050d0 con 0x7f7a98025080 2026-02-23T06:43:29.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.347+0000 7f7ab6ffd640 1 -- 10.20.193.58:0/1416607991 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7a98025080 msgr2=0x7f7a98025500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:29.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.347+0000 7f7ab6ffd640 1 --2- 10.20.193.58:0/1416607991 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7a98025080 0x7f7a98025500 secure :-1 s=READY pgs=124 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ac0011970 tx=0x7f7ac0011e40 comp rx=0 tx=0).stop 2026-02-23T06:43:29.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.347+0000 7f7ab6ffd640 1 -- 10.20.193.58:0/1416607991 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7a98025080 msgr2=0x7f7a98025500 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:43:29.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.347+0000 7f7ab6ffd640 1 --2- 10.20.193.58:0/1416607991 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7a98025080 0x7f7a98025500 unknown :-1 s=CLOSED pgs=124 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.344 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:43:29.345 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:43:29.345 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:43:29.345 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:43:29.345 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 190, 2026-02-23T06:43:29.345 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 109466, 2026-02-23T06:43:29.345 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:43:29.345 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:43:29.345 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:43:29.345 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:43:29.345 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:29.345 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:43:29.346 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:43:29.346 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:43:29.346 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:43:29.346 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:43:29.346 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:43:29.346 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:43:29.346 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:43:29.346 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:43:29.346 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:43:29.346 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:43:29.346 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:43:29.346 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:43:29.347 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:43:29.347 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:43:29.347 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:43:29.347 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:43:29.347 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:29.347 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:43:29.347 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:43:29.347 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:43:29.347 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:43:29.347 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:43:29.347 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:43:29.347 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:43:29.348 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:43:29.348 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:43:29.348 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:43:29.348 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:43:29.348 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:43:29.348 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:43:29.348 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:43:29.348 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:43:29.348 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:29.348 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.348 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:43:29.348 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:43:29.349 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:43:29.349 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:43:29.349 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:43:29.349 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:43:29.349 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:43:29.349 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:43:29.349 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:43:29.349 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:43:29.349 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:43:29.349 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:43:29.349 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:43:29.349 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:43:29.350 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:43:29.350 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:43:29.350 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:43:29.350 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:43:29.350 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:43:29.350 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:43:29.350 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:43:29.350 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:43:29.350 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:43:29.350 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:43:29.350 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:43:29.350 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:43:29.350 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:43:29.351 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:43:29.351 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:43:29.351 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:43:29.351 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:29.351 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:43:29.351 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.351 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:43:29.351 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.351 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:43:29.351 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:43:29.351 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:43:29.351 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:43:29.352 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.352 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:43:29.352 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:43:29.352 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:29.352 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.352 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.352 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:43:29.352 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:43:29.352 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:29.352 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:29.352 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:29.352 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.353 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:43:29.353 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:43:29.353 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:43:29.353 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:43:29.353 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:43:29.353 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:43:29.353 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.353 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.353 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:43:29.353 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:43:29.353 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:43:29.353 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:43:29.353 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.354 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:43:29.354 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:43:29.354 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:29.354 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.354 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.354 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:43:29.354 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:43:29.354 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:29.354 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:29.354 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:29.354 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.354 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:43:29.355 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:43:29.355 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:43:29.355 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:43:29.355 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:43:29.355 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:43:29.355 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.355 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.355 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:43:29.355 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:43:29.355 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:43:29.355 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:43:29.355 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.356 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:43:29.356 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:43:29.356 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:29.356 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.356 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.356 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:43:29.356 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:43:29.356 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:29.356 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:29.356 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:29.356 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.356 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:43:29.356 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:43:29.357 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:43:29.357 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:43:29.357 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:43:29.357 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:43:29.357 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:29.357 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:29.357 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.357 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:43:29.357 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:43:29.357 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.357 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:29.357 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:29.358 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:43:29.358 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:29.358 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:29.358 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:43:29.358 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.358 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:29.358 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:29.358 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:43:29.358 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:29.358 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:29.358 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:43:29.358 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.358 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:29.359 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:29.359 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:43:29.359 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:29.359 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:29.359 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:43:29.359 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.359 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:43:29.359 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:43:29.359 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:43:29.359 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.359 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.359 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:29.359 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:29.360 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:43:29.360 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:29.360 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:29.360 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:43:29.360 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.360 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:29.360 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:29.360 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:43:29.360 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:29.360 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:29.360 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.360 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:43:29.361 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:43:29.362 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.347+0000 7f7acf577640 1 -- 10.20.193.58:0/1416607991 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7a9c07a430 msgr2=0x7f7a9c09a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:29.362 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.347+0000 7f7acf577640 1 --2- 10.20.193.58:0/1416607991 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7a9c07a430 0x7f7a9c09a8e0 secure :-1 s=READY pgs=484 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ad0164e30 tx=0x7f7ab8031030 comp rx=0 tx=0).stop 2026-02-23T06:43:29.362 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.347+0000 7f7acf577640 1 -- 10.20.193.58:0/1416607991 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7ad0056550 msgr2=0x7f7ad0058810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:29.362 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.347+0000 7f7acf577640 1 --2- 10.20.193.58:0/1416607991 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7ad0056550 0x7f7ad0058810 secure :-1 s=READY pgs=122 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ac4003770 tx=0x7f7ac400c8f0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.362 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.347+0000 7f7aced76640 1 -- 10.20.193.58:0/1416607991 reap_dead start 2026-02-23T06:43:29.362 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.347+0000 7f7aced76640 1 -- 10.20.193.58:0/1416607991 reap_dead start 2026-02-23T06:43:29.363 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.347+0000 7f7acf577640 1 -- 10.20.193.58:0/1416607991 shutdown_connections 2026-02-23T06:43:29.363 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.347+0000 7f7acf577640 1 -- 10.20.193.58:0/1416607991 >> 10.20.193.58:0/1416607991 conn(0x7f7ad00b3c20 msgr2=0x7f7ad015a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:43:29.363 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.347+0000 7f7acf577640 1 -- 10.20.193.58:0/1416607991 shutdown_connections 2026-02-23T06:43:29.363 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.347+0000 7f7acf577640 1 -- 10.20.193.58:0/1416607991 wait complete. 2026-02-23T06:43:29.363 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:43:29.363 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:43:29.364 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:43:29.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.491+0000 7fb3e6dc9640 1 -- 10.20.193.58:0/552018167 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3e0056960 msgr2=0x7fb3e0058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:29.487 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.491+0000 7fb3e6dc9640 1 --2- 10.20.193.58:0/552018167 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3e0056960 0x7fb3e0058200 secure :-1 s=READY pgs=11 gs=3 cs=0 l=1 c_cookie=3156126807178400082 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3d4004740 tx=0x7fb3d402f230 comp rx=0 tx=0).stop 2026-02-23T06:43:29.487 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.491+0000 7fb3e6dc9640 1 -- 10.20.193.58:0/552018167 shutdown_connections 2026-02-23T06:43:29.487 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.491+0000 7fb3e6dc9640 1 --2- 10.20.193.58:0/552018167 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3e0056960 0x7fb3e0058200 unknown :-1 s=CLOSED pgs=11 gs=3 cs=0 l=1 c_cookie=3156126807178400082 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.487 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.491+0000 7fb3e6dc9640 1 -- 10.20.193.58:0/552018167 >> 10.20.193.58:0/552018167 conn(0x7fb3e00b3c20 msgr2=0x7fb3e00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:43:29.487 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.491+0000 7fb3e6dc9640 1 -- 10.20.193.58:0/552018167 shutdown_connections 2026-02-23T06:43:29.487 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.491+0000 7fb3e6dc9640 1 -- 10.20.193.58:0/552018167 wait complete. 2026-02-23T06:43:29.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.492+0000 7fb3e6dc9640 1 Processor -- start 2026-02-23T06:43:29.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.492+0000 7fb3e6dc9640 1 -- start start 2026-02-23T06:43:29.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.492+0000 7fb3e6dc9640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3e0056960 0x7fb3e015b7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:29.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.493+0000 7fb3e6dc9640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3e015c4b0 0x7fb3e01183c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:29.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.493+0000 7fb3e6dc9640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3e0162ca0 0x7fb3e0119670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:29.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.493+0000 7fb3e6dc9640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e015bd10 con 0x7fb3e0056960 2026-02-23T06:43:29.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.493+0000 7fb3e6dc9640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e01191e0 con 0x7fb3e0162ca0 2026-02-23T06:43:29.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.493+0000 7fb3e6dc9640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb3e0133550 con 0x7fb3e015c4b0 2026-02-23T06:43:29.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.493+0000 7fb3e5dc7640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3e0056960 0x7fb3e015b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:29.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.493+0000 7fb3e5dc7640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3e0056960 0x7fb3e015b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:43736/0 (socket says 10.20.193.58:43736) 2026-02-23T06:43:29.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.493+0000 7fb3e5dc7640 1 -- 10.20.193.58:0/2953172609 learned_addr learned my addr 10.20.193.58:0/2953172609 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:43:29.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.493+0000 7fb3e65c8640 1 --2- 10.20.193.58:0/2953172609 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3e0162ca0 0x7fb3e0119670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:29.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.493+0000 7fb3e55c6640 1 --2- 10.20.193.58:0/2953172609 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3e015c4b0 0x7fb3e01183c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:29.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.493+0000 7fb3e5dc7640 1 -- 10.20.193.58:0/2953172609 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3e015c4b0 msgr2=0x7fb3e01183c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:29.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.493+0000 7fb3e5dc7640 1 --2- 10.20.193.58:0/2953172609 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb3e015c4b0 0x7fb3e01183c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.493+0000 7fb3e5dc7640 1 -- 10.20.193.58:0/2953172609 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3e0162ca0 msgr2=0x7fb3e0119670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:29.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.493+0000 7fb3e5dc7640 1 --2- 10.20.193.58:0/2953172609 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3e0162ca0 0x7fb3e0119670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.493+0000 7fb3e5dc7640 1 -- 10.20.193.58:0/2953172609 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d40094b0 con 0x7fb3e0056960 2026-02-23T06:43:29.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.493+0000 7fb3e5dc7640 1 --2- 10.20.193.58:0/2953172609 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3e0056960 0x7fb3e015b7d0 secure :-1 s=READY pgs=126 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3d000c520 tx=0x7fb3d000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:29.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.493+0000 7fb3ce7fc640 1 -- 10.20.193.58:0/2953172609 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3d0006ab0 con 0x7fb3e0056960 2026-02-23T06:43:29.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.493+0000 7fb3ce7fc640 1 -- 10.20.193.58:0/2953172609 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3d0006d00 con 0x7fb3e0056960 2026-02-23T06:43:29.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.494+0000 7fb3ce7fc640 1 -- 10.20.193.58:0/2953172609 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3d00072b0 con 0x7fb3e0056960 2026-02-23T06:43:29.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.494+0000 7fb3e6dc9640 1 -- 10.20.193.58:0/2953172609 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3e015ffe0 con 0x7fb3e0056960 2026-02-23T06:43:29.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.494+0000 7fb3e6dc9640 1 -- 10.20.193.58:0/2953172609 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3e01605a0 con 0x7fb3e0056960 2026-02-23T06:43:29.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.494+0000 7fb3e6dc9640 1 --2- 10.20.193.58:0/2953172609 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3e0160790 0x7fb3e014a530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:29.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.494+0000 7fb3e6dc9640 1 -- 10.20.193.58:0/2953172609 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e0059690 con 0x7fb3e0160790 2026-02-23T06:43:29.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.495+0000 7fb3e55c6640 1 --2- 10.20.193.58:0/2953172609 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3e0160790 0x7fb3e014a530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:29.493 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.495+0000 7fb3e55c6640 1 -- 10.20.193.58:0/2953172609 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb3e00593b0 con 0x7fb3e0160790 2026-02-23T06:43:29.493 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.495+0000 7fb3e55c6640 1 --2- 10.20.193.58:0/2953172609 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3e0160790 0x7fb3e014a530 secure :-1 s=READY pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3d4009230 tx=0x7fb3d40028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:29.493 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.495+0000 7fb3ce7fc640 1 -- 10.20.193.58:0/2953172609 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3d403d050 con 0x7fb3e0160790 2026-02-23T06:43:29.493 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.495+0000 7fb3ce7fc640 1 -- 10.20.193.58:0/2953172609 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fb3d0019070 con 0x7fb3e0056960 2026-02-23T06:43:29.493 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.496+0000 7fb3ce7fc640 1 --2- 10.20.193.58:0/2953172609 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb3b007a660 0x7fb3b009ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:29.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.496+0000 7fb3ce7fc640 1 -- 10.20.193.58:0/2953172609 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fb3d009cfd0 con 0x7fb3e0056960 2026-02-23T06:43:29.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.496+0000 7fb3ce7fc640 1 -- 10.20.193.58:0/2953172609 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fb3d403e040 con 0x7fb3e0160790 2026-02-23T06:43:29.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.496+0000 7fb3ce7fc640 1 -- 10.20.193.58:0/2953172609 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3e0160790 msgr2=0x7fb3e014a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:29.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.496+0000 7fb3ce7fc640 1 --2- 10.20.193.58:0/2953172609 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3e0160790 0x7fb3e014a530 secure :-1 s=READY pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3d4009230 tx=0x7fb3d40028d0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.496+0000 7fb3ce7fc640 1 -- 10.20.193.58:0/2953172609 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3e0160790 msgr2=0x7fb3e014a530 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:43:29.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.496+0000 7fb3ce7fc640 1 --2- 10.20.193.58:0/2953172609 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3e0160790 0x7fb3e014a530 unknown :-1 s=CLOSED pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.497+0000 7fb3e65c8640 1 --2- 10.20.193.58:0/2953172609 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb3b007a660 0x7fb3b009ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:29.494 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.497+0000 7fb3e65c8640 1 --2- 10.20.193.58:0/2953172609 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb3b007a660 0x7fb3b009ab10 secure :-1 s=READY pgs=485 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3e013cb90 tx=0x7fb3dc008e10 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:29.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.500+0000 7fb3e6dc9640 1 --2- 10.20.193.58:0/2953172609 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3e0119bb0 0x7fb3e014aa70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:29.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.500+0000 7fb3e6dc9640 1 -- 10.20.193.58:0/2953172609 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e0119320 con 0x7fb3e0119bb0 2026-02-23T06:43:29.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.501+0000 7fb3e55c6640 1 --2- 10.20.193.58:0/2953172609 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3e0119bb0 0x7fb3e014aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:29.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.501+0000 7fb3e55c6640 1 -- 10.20.193.58:0/2953172609 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb3e013d220 con 0x7fb3e0119bb0 2026-02-23T06:43:29.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.501+0000 7fb3e55c6640 1 --2- 10.20.193.58:0/2953172609 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3e0119bb0 0x7fb3e014aa70 secure :-1 s=READY pgs=13 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3d4004740 tx=0x7fb3d4005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:29.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.501+0000 7fb3ce7fc640 1 -- 10.20.193.58:0/2953172609 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3d4043890 con 0x7fb3e0119bb0 2026-02-23T06:43:29.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.501+0000 7fb3ce7fc640 1 -- 10.20.193.58:0/2953172609 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4912 (secure 0 0 0) 0x7fb3d4038e70 con 0x7fb3e0119bb0 2026-02-23T06:43:29.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.501+0000 7fb3ce7fc640 1 -- 10.20.193.58:0/2953172609 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3e0119bb0 msgr2=0x7fb3e014aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:29.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.501+0000 7fb3ce7fc640 1 --2- 10.20.193.58:0/2953172609 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3e0119bb0 0x7fb3e014aa70 secure :-1 s=READY pgs=13 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3d4004740 tx=0x7fb3d4005f90 comp rx=0 tx=0).stop 2026-02-23T06:43:29.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.501+0000 7fb3ce7fc640 1 -- 10.20.193.58:0/2953172609 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3e0119bb0 msgr2=0x7fb3e014aa70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:43:29.497 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.501+0000 7fb3ce7fc640 1 --2- 10.20.193.58:0/2953172609 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3e0119bb0 0x7fb3e014aa70 unknown :-1 s=CLOSED pgs=13 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.498 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:43:29.498 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:43:29.498 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:43:29.498 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:43:29.498 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 190, 2026-02-23T06:43:29.498 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 11576, 2026-02-23T06:43:29.498 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:43:29.498 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:43:29.499 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:43:29.499 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:43:29.499 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:29.499 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:43:29.499 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:43:29.499 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:43:29.499 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:43:29.499 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:43:29.499 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:43:29.499 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:43:29.499 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:43:29.499 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:43:29.500 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:43:29.500 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:43:29.500 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:43:29.500 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:43:29.500 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:43:29.500 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:43:29.500 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:43:29.500 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:43:29.500 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:29.500 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:43:29.500 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:43:29.500 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:43:29.501 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:43:29.501 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:43:29.501 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:43:29.501 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:43:29.501 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:43:29.501 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:43:29.501 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:43:29.501 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:43:29.501 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:43:29.501 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:43:29.501 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:43:29.501 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:43:29.502 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:29.502 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.502 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:43:29.502 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:43:29.502 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:43:29.502 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:43:29.502 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:43:29.502 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:43:29.502 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:43:29.502 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:43:29.502 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:43:29.502 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:43:29.503 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:43:29.503 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:43:29.503 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:43:29.503 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:43:29.503 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:43:29.503 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:43:29.503 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:43:29.503 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:43:29.503 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:43:29.503 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:43:29.503 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:43:29.503 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:43:29.504 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:43:29.504 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:43:29.504 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:43:29.504 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:43:29.504 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:43:29.504 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:43:29.504 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:43:29.504 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:43:29.504 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:29.504 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:43:29.504 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.504 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:43:29.504 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.505 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:43:29.505 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:43:29.505 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:43:29.505 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:43:29.505 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.505 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:43:29.505 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:43:29.505 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:29.505 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.505 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.505 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:43:29.505 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:43:29.506 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:29.506 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:29.506 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:29.506 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.506 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:43:29.506 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:43:29.506 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:43:29.506 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:43:29.506 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:43:29.506 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:43:29.506 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.506 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.507 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:43:29.507 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:43:29.507 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:43:29.507 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:43:29.507 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.507 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:43:29.507 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:43:29.507 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:29.507 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.507 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.507 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:43:29.507 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:43:29.508 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:29.508 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:29.508 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:29.508 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.508 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:43:29.508 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:43:29.508 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:43:29.508 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:43:29.508 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:43:29.508 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:43:29.508 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.508 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.508 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:43:29.509 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:43:29.509 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:43:29.509 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:43:29.509 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.509 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:43:29.509 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:43:29.509 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:29.509 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.509 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.509 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:43:29.509 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:43:29.509 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:29.509 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:29.510 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:29.510 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.510 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:43:29.510 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:43:29.510 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:43:29.510 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:43:29.510 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:43:29.510 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:43:29.510 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:29.510 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:29.510 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.510 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:43:29.510 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:43:29.511 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.511 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:29.511 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:29.511 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:43:29.511 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:29.511 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:29.511 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:43:29.511 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.511 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:29.511 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:29.511 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:43:29.511 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:29.511 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:29.511 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.512 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:43:29.512 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:43:29.513 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.502+0000 7fb3e6dc9640 1 -- 10.20.193.58:0/2953172609 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb3b007a660 msgr2=0x7fb3b009ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:29.513 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.502+0000 7fb3e6dc9640 1 --2- 10.20.193.58:0/2953172609 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb3b007a660 0x7fb3b009ab10 secure :-1 s=READY pgs=485 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3e013cb90 tx=0x7fb3dc008e10 comp rx=0 tx=0).stop 2026-02-23T06:43:29.513 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.502+0000 7fb3e6dc9640 1 -- 10.20.193.58:0/2953172609 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3e0056960 msgr2=0x7fb3e015b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:29.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.502+0000 7fb3e6dc9640 1 --2- 10.20.193.58:0/2953172609 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3e0056960 0x7fb3e015b7d0 secure :-1 s=READY pgs=126 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3d000c520 tx=0x7fb3d000c9f0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.502+0000 7fb3e65c8640 1 -- 10.20.193.58:0/2953172609 reap_dead start 2026-02-23T06:43:29.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.502+0000 7fb3e65c8640 1 -- 10.20.193.58:0/2953172609 reap_dead start 2026-02-23T06:43:29.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.502+0000 7fb3e6dc9640 1 -- 10.20.193.58:0/2953172609 shutdown_connections 2026-02-23T06:43:29.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.502+0000 7fb3e6dc9640 1 -- 10.20.193.58:0/2953172609 >> 10.20.193.58:0/2953172609 conn(0x7fb3e00b3c20 msgr2=0x7fb3e013f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:43:29.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.502+0000 7fb3e6dc9640 1 -- 10.20.193.58:0/2953172609 shutdown_connections 2026-02-23T06:43:29.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.502+0000 7fb3e6dc9640 1 -- 10.20.193.58:0/2953172609 wait complete. 2026-02-23T06:43:29.514 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:43:29.515 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:43:29.515 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:43:29.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.643+0000 7fd75abd2640 1 -- 10.20.193.58:0/2828446402 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd73c003a30 msgr2=0x7fd73c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:29.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.643+0000 7fd75abd2640 1 --2- 10.20.193.58:0/2828446402 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd73c003a30 0x7fd73c003e20 secure :-1 s=READY pgs=128 gs=4 cs=0 l=1 c_cookie=6000470322301732879 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd74400c260 tx=0x7fd74402f930 comp rx=0 tx=0).stop 2026-02-23T06:43:29.639 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.643+0000 7fd75a3d1640 1 -- 10.20.193.58:0/2828446402 reap_dead start 2026-02-23T06:43:29.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.643+0000 7fd75abd2640 1 -- 10.20.193.58:0/2828446402 shutdown_connections 2026-02-23T06:43:29.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.643+0000 7fd75abd2640 1 -- 10.20.193.58:0/2828446402 >> 10.20.193.58:0/2828446402 conn(0x7fd7540b3c20 msgr2=0x7fd7540b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:43:29.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.644+0000 7fd75abd2640 1 -- 10.20.193.58:0/2828446402 shutdown_connections 2026-02-23T06:43:29.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.644+0000 7fd75abd2640 1 -- 10.20.193.58:0/2828446402 wait complete. 2026-02-23T06:43:29.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.645+0000 7fd75abd2640 1 Processor -- start 2026-02-23T06:43:29.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.645+0000 7fd75abd2640 1 -- start start 2026-02-23T06:43:29.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.645+0000 7fd75abd2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd73c003a30 0x7fd7540b1090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:29.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.645+0000 7fd75abd2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd75414e600 0x7fd754161b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:29.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.645+0000 7fd75abd2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd7541245d0 0x7fd754124a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:29.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.645+0000 7fd75abd2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fd754124f80 con 0x7fd7541245d0 2026-02-23T06:43:29.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.645+0000 7fd75abd2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fd75414bf30 con 0x7fd75414e600 2026-02-23T06:43:29.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.645+0000 7fd75abd2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fd754122690 con 0x7fd73c003a30 2026-02-23T06:43:29.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.646+0000 7fd75a3d1640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd7541245d0 0x7fd754124a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:29.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.646+0000 7fd75a3d1640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd7541245d0 0x7fd754124a40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:43754/0 (socket says 10.20.193.58:43754) 2026-02-23T06:43:29.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.646+0000 7fd75a3d1640 1 -- 10.20.193.58:0/2826341806 learned_addr learned my addr 10.20.193.58:0/2826341806 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:43:29.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.646+0000 7fd759bd0640 1 --2- 10.20.193.58:0/2826341806 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd73c003a30 0x7fd7540b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:29.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.646+0000 7fd75a3d1640 1 -- 10.20.193.58:0/2826341806 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd73c003a30 msgr2=0x7fd7540b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:29.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.646+0000 7fd75a3d1640 1 --2- 10.20.193.58:0/2826341806 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd73c003a30 0x7fd7540b1090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.646+0000 7fd75a3d1640 1 -- 10.20.193.58:0/2826341806 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd75414e600 msgr2=0x7fd754161b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:29.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.646+0000 7fd75a3d1640 1 --2- 10.20.193.58:0/2826341806 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd75414e600 0x7fd754161b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.646+0000 7fd75a3d1640 1 -- 10.20.193.58:0/2826341806 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd75414bc50 con 0x7fd7541245d0 2026-02-23T06:43:29.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.646+0000 7fd759bd0640 1 --2- 10.20.193.58:0/2826341806 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd73c003a30 0x7fd7540b1090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:43:29.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.646+0000 7fd75a3d1640 1 --2- 10.20.193.58:0/2826341806 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd7541245d0 0x7fd754124a40 secure :-1 s=READY pgs=129 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd750005820 tx=0x7fd750003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:29.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.646+0000 7fd7427fc640 1 -- 10.20.193.58:0/2826341806 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd75000aca0 con 0x7fd7541245d0 2026-02-23T06:43:29.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.646+0000 7fd7427fc640 1 -- 10.20.193.58:0/2826341806 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd75001b470 con 0x7fd7541245d0 2026-02-23T06:43:29.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.646+0000 7fd7427fc640 1 -- 10.20.193.58:0/2826341806 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd75001b880 con 0x7fd7541245d0 2026-02-23T06:43:29.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.646+0000 7fd75abd2640 1 -- 10.20.193.58:0/2826341806 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd754121d60 con 0x7fd7541245d0 2026-02-23T06:43:29.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.646+0000 7fd75abd2640 1 -- 10.20.193.58:0/2826341806 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd754122320 con 0x7fd7541245d0 2026-02-23T06:43:29.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.647+0000 7fd71bfff640 1 --2- 10.20.193.58:0/2826341806 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd7140041f0 0x7fd7140246a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:29.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.647+0000 7fd71bfff640 1 -- 10.20.193.58:0/2826341806 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fd714025f20 con 0x7fd7140041f0 2026-02-23T06:43:29.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.647+0000 7fd759bd0640 1 --2- 10.20.193.58:0/2826341806 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd7140041f0 0x7fd7140246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:29.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.648+0000 7fd759bd0640 1 -- 10.20.193.58:0/2826341806 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd7140260e0 con 0x7fd7140041f0 2026-02-23T06:43:29.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.648+0000 7fd759bd0640 1 --2- 10.20.193.58:0/2826341806 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd7140041f0 0x7fd7140246a0 secure :-1 s=READY pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd744003130 tx=0x7fd7440035b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:29.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.648+0000 7fd7427fc640 1 -- 10.20.193.58:0/2826341806 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd7440038b0 con 0x7fd7140041f0 2026-02-23T06:43:29.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.648+0000 7fd7427fc640 1 -- 10.20.193.58:0/2826341806 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fd750024020 con 0x7fd7541245d0 2026-02-23T06:43:29.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.649+0000 7fd7427fc640 1 --2- 10.20.193.58:0/2826341806 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd72407a660 0x7fd72409ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:29.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.649+0000 7fd7427fc640 1 -- 10.20.193.58:0/2826341806 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fd75009e920 con 0x7fd7541245d0 2026-02-23T06:43:29.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.649+0000 7fd7427fc640 1 -- 10.20.193.58:0/2826341806 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fd744003a10 con 0x7fd7140041f0 2026-02-23T06:43:29.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.649+0000 7fd7427fc640 1 -- 10.20.193.58:0/2826341806 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd7140041f0 msgr2=0x7fd7140246a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:29.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.649+0000 7fd7427fc640 1 --2- 10.20.193.58:0/2826341806 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd7140041f0 0x7fd7140246a0 secure :-1 s=READY pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd744003130 tx=0x7fd7440035b0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.649+0000 7fd7427fc640 1 -- 10.20.193.58:0/2826341806 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd7140041f0 msgr2=0x7fd7140246a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:43:29.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.649+0000 7fd7427fc640 1 --2- 10.20.193.58:0/2826341806 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd7140041f0 0x7fd7140246a0 unknown :-1 s=CLOSED pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.650+0000 7fd7593cf640 1 --2- 10.20.193.58:0/2826341806 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd72407a660 0x7fd72409ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:29.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.653+0000 7fd71bfff640 1 --2- 10.20.193.58:0/2826341806 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd7140250a0 0x7fd7140254f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:29.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.653+0000 7fd71bfff640 1 -- 10.20.193.58:0/2826341806 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fd714025ba0 con 0x7fd7140250a0 2026-02-23T06:43:29.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.653+0000 7fd759bd0640 1 --2- 10.20.193.58:0/2826341806 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd7140250a0 0x7fd7140254f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:29.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.654+0000 7fd759bd0640 1 -- 10.20.193.58:0/2826341806 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd714025d30 con 0x7fd7140250a0 2026-02-23T06:43:29.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.654+0000 7fd759bd0640 1 --2- 10.20.193.58:0/2826341806 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd7140250a0 0x7fd7140254f0 secure :-1 s=READY pgs=38 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd744003130 tx=0x7fd7440067e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:29.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.654+0000 7fd7593cf640 1 --2- 10.20.193.58:0/2826341806 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd72407a660 0x7fd72409ab10 secure :-1 s=READY pgs=486 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd75415ad40 tx=0x7fd748006ba0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:29.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.654+0000 7fd7427fc640 1 -- 10.20.193.58:0/2826341806 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd744052070 con 0x7fd7140250a0 2026-02-23T06:43:29.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.654+0000 7fd7427fc640 1 -- 10.20.193.58:0/2826341806 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5413 (secure 0 0 0) 0x7fd744039ba0 con 0x7fd7140250a0 2026-02-23T06:43:29.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.654+0000 7fd7427fc640 1 -- 10.20.193.58:0/2826341806 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd7140250a0 msgr2=0x7fd7140254f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:29.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.654+0000 7fd7427fc640 1 --2- 10.20.193.58:0/2826341806 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd7140250a0 0x7fd7140254f0 secure :-1 s=READY pgs=38 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd744003130 tx=0x7fd7440067e0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.654+0000 7fd7427fc640 1 -- 10.20.193.58:0/2826341806 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd7140250a0 msgr2=0x7fd7140254f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:43:29.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.654+0000 7fd7427fc640 1 --2- 10.20.193.58:0/2826341806 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd7140250a0 0x7fd7140254f0 secure :-1 s=CLOSED pgs=38 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd744003130 tx=0x7fd7440067e0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.651 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:43:29.651 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:43:29.651 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:43:29.651 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:43:29.651 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 190, 2026-02-23T06:43:29.651 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 63083, 2026-02-23T06:43:29.651 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:43:29.652 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:43:29.652 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:43:29.652 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:43:29.652 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:29.652 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:43:29.652 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:43:29.652 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:43:29.652 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:43:29.652 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:43:29.652 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:43:29.652 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:43:29.652 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:43:29.653 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:43:29.653 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:43:29.653 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:43:29.653 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:43:29.653 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:43:29.653 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:43:29.653 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:43:29.653 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:43:29.653 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:43:29.653 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:29.653 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:43:29.653 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:43:29.654 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:43:29.654 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:43:29.654 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:43:29.654 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:43:29.654 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:43:29.654 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:43:29.654 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:43:29.654 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:43:29.654 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:43:29.654 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:43:29.654 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:43:29.654 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:43:29.654 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:43:29.655 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:29.655 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.655 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:43:29.655 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:43:29.655 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:43:29.655 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:43:29.655 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:43:29.655 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:43:29.655 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:43:29.655 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:43:29.655 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:43:29.656 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:43:29.656 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:43:29.656 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:43:29.656 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:43:29.656 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:43:29.656 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:43:29.656 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:43:29.656 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:43:29.656 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:43:29.656 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:43:29.656 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:43:29.656 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:43:29.657 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:43:29.657 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:43:29.657 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:43:29.657 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:43:29.657 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:43:29.657 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:43:29.657 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:43:29.657 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:43:29.657 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:43:29.657 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:29.657 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:43:29.657 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.658 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:43:29.658 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.658 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:43:29.658 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:43:29.658 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:43:29.658 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:43:29.658 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.658 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:43:29.658 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:43:29.658 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:29.658 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.658 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.659 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:43:29.659 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:43:29.659 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:29.659 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:29.659 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:29.659 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.659 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:43:29.659 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:43:29.659 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:43:29.659 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:43:29.659 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:43:29.659 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:43:29.660 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.660 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.660 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:43:29.660 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:43:29.660 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:43:29.660 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:43:29.660 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.660 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:43:29.660 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:43:29.660 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:29.660 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.660 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.660 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:43:29.661 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:43:29.661 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:29.661 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:29.661 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:29.661 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.661 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:43:29.661 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:43:29.661 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:43:29.661 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:43:29.661 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:43:29.661 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:43:29.661 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.662 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.662 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:43:29.662 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:43:29.662 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:43:29.662 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:43:29.662 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.662 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:43:29.662 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:43:29.662 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:29.662 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.662 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.662 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:43:29.663 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:43:29.663 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:29.663 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:29.663 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:29.663 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.663 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:43:29.663 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:43:29.663 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:43:29.663 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:43:29.663 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:43:29.663 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:43:29.663 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:29.663 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:29.664 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.664 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:43:29.664 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:43:29.664 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.664 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:29.664 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:29.664 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:43:29.664 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:29.664 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:29.664 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:43:29.664 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.664 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:29.665 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:29.665 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:43:29.665 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:29.665 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:29.665 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:43:29.665 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.665 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:29.665 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:29.665 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:43:29.665 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:29.665 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:29.665 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:43:29.665 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.666 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:29.666 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:29.666 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:43:29.666 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:29.666 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:29.666 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:43:29.666 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:29.666 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:29.666 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:29.666 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:43:29.666 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:29.666 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:29.667 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:29.667 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:43:29.667 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:43:29.668 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.655+0000 7fd71bfff640 1 -- 10.20.193.58:0/2826341806 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd72407a660 msgr2=0x7fd72409ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:29.669 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.655+0000 7fd71bfff640 1 --2- 10.20.193.58:0/2826341806 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd72407a660 0x7fd72409ab10 secure :-1 s=READY pgs=486 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd75415ad40 tx=0x7fd748006ba0 comp rx=0 tx=0).stop 2026-02-23T06:43:29.669 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.655+0000 7fd71bfff640 1 -- 10.20.193.58:0/2826341806 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd7541245d0 msgr2=0x7fd754124a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:29.669 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.655+0000 7fd71bfff640 1 --2- 10.20.193.58:0/2826341806 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd7541245d0 0x7fd754124a40 secure :-1 s=READY pgs=129 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd750005820 tx=0x7fd750003f30 comp rx=0 tx=0).stop 2026-02-23T06:43:29.669 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.655+0000 7fd75a3d1640 1 -- 10.20.193.58:0/2826341806 reap_dead start 2026-02-23T06:43:29.669 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.655+0000 7fd75a3d1640 1 -- 10.20.193.58:0/2826341806 reap_dead start 2026-02-23T06:43:29.669 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.655+0000 7fd71bfff640 1 -- 10.20.193.58:0/2826341806 shutdown_connections 2026-02-23T06:43:29.669 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.655+0000 7fd71bfff640 1 -- 10.20.193.58:0/2826341806 >> 10.20.193.58:0/2826341806 conn(0x7fd7540b3c20 msgr2=0x7fd75413ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:43:29.669 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.655+0000 7fd71bfff640 1 -- 10.20.193.58:0/2826341806 shutdown_connections 2026-02-23T06:43:29.669 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:29.655+0000 7fd71bfff640 1 -- 10.20.193.58:0/2826341806 wait complete. 2026-02-23T06:43:29.670 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:43:29.670 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-23T06:43:29.670 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2026-02-23T06:43:29.670 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-23T06:43:29.670 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-23T06:43:29.671 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-23T06:43:29.671 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:43:29.700 INFO:tasks.ceph.mon.a:Stopped 2026-02-23T06:43:29.700 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.b 2026-02-23T06:43:29.701 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-23T06:43:29.701 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-23T06:43:29.701 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-23T06:43:44.702 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.b 2026-02-23T06:43:44.702 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-23T06:43:44.703 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-23T06:43:44.703 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:43:44.703 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:43:44.847 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:43:44.851 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:43:49.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.718+0000 7fdd63fff640 1 -- 10.20.193.58:0/1196243908 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdd50004850 msgr2=0x7fdd50004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:49.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.718+0000 7fdd63fff640 1 --2- 10.20.193.58:0/1196243908 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdd50004850 0x7fdd50004cc0 secure :-1 s=READY pgs=26 gs=28 cs=0 l=1 c_cookie=17588977652942521180 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd4c00c390 tx=0x7fdd4c02fa30 comp rx=0 tx=0).stop 2026-02-23T06:43:49.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.718+0000 7fdd63fff640 1 -- 10.20.193.58:0/1196243908 shutdown_connections 2026-02-23T06:43:49.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.718+0000 7fdd63fff640 1 --2- 10.20.193.58:0/1196243908 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdd6415c040 0x7fdd50065a10 unknown :-1 s=CLOSED pgs=0 gs=29 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:49.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.718+0000 7fdd63fff640 1 --2- 10.20.193.58:0/1196243908 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdd50004850 0x7fdd50004cc0 unknown :-1 s=CLOSED pgs=26 gs=28 cs=0 l=1 c_cookie=17588977652942521180 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:49.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.718+0000 7fdd63fff640 1 --2- 10.20.193.58:0/1196243908 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdd50003a30 0x7fdd50003e20 unknown :-1 s=CLOSED pgs=0 gs=27 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:49.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.718+0000 7fdd63fff640 1 -- 10.20.193.58:0/1196243908 >> 10.20.193.58:0/1196243908 conn(0x7fdd640b3c20 msgr2=0x7fdd640b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:43:49.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.718+0000 7fdd63fff640 1 -- 10.20.193.58:0/1196243908 shutdown_connections 2026-02-23T06:43:49.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.718+0000 7fdd63fff640 1 -- 10.20.193.58:0/1196243908 wait complete. 2026-02-23T06:43:49.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.720+0000 7fdd63fff640 1 Processor -- start 2026-02-23T06:43:49.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.720+0000 7fdd63fff640 1 -- start start 2026-02-23T06:43:49.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.720+0000 7fdd63fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdd50003a30 0x7fdd641371e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:49.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.720+0000 7fdd63fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdd50004850 0x7fdd641499f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:49.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.720+0000 7fdd63fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdd6415c040 0x7fdd64149f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:49.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.720+0000 7fdd63fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6411bb20 con 0x7fdd6415c040 2026-02-23T06:43:49.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.720+0000 7fdd63fff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6411afd0 con 0x7fdd50003a30 2026-02-23T06:43:49.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.720+0000 7fdd63fff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fdd64057450 con 0x7fdd50004850 2026-02-23T06:43:49.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.720+0000 7fdd637fe640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdd6415c040 msgr2=0x7fdd64149f30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:43:49.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.721+0000 7fdd637fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdd6415c040 0x7fdd64149f30 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:43:49.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.721+0000 7fdd627fc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdd50004850 0x7fdd641499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:49.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.721+0000 7fdd62ffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdd50003a30 0x7fdd641371e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:49.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.721+0000 7fdd627fc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdd50004850 0x7fdd641499f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:57968/0 (socket says 10.20.193.58:57968) 2026-02-23T06:43:49.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.721+0000 7fdd627fc640 1 -- 10.20.193.58:0/2564322803 learned_addr learned my addr 10.20.193.58:0/2564322803 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:43:49.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.721+0000 7fdd62ffd640 1 -- 10.20.193.58:0/2564322803 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdd50004850 msgr2=0x7fdd641499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:49.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.721+0000 7fdd62ffd640 1 --2- 10.20.193.58:0/2564322803 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdd50004850 0x7fdd641499f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:49.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.721+0000 7fdd62ffd640 1 -- 10.20.193.58:0/2564322803 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdd6415c040 msgr2=0x7fdd64149f30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:43:49.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.721+0000 7fdd62ffd640 1 --2- 10.20.193.58:0/2564322803 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdd6415c040 0x7fdd64149f30 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:49.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.721+0000 7fdd62ffd640 1 -- 10.20.193.58:0/2564322803 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd64057730 con 0x7fdd50003a30 2026-02-23T06:43:49.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.721+0000 7fdd627fc640 1 --2- 10.20.193.58:0/2564322803 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdd50004850 0x7fdd641499f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:43:49.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.721+0000 7fdd62ffd640 1 --2- 10.20.193.58:0/2564322803 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdd50003a30 0x7fdd641371e0 secure :-1 s=READY pgs=27 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd58002740 tx=0x7fdd580139d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:49.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.722+0000 7fdd437fe640 1 -- 10.20.193.58:0/2564322803 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd58011a30 con 0x7fdd50003a30 2026-02-23T06:43:49.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.722+0000 7fdd63fff640 1 -- 10.20.193.58:0/2564322803 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd6411b1e0 con 0x7fdd50003a30 2026-02-23T06:43:49.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.722+0000 7fdd437fe640 1 -- 10.20.193.58:0/2564322803 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd58011c80 con 0x7fdd50003a30 2026-02-23T06:43:49.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.722+0000 7fdd437fe640 1 -- 10.20.193.58:0/2564322803 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd5801b670 con 0x7fdd50003a30 2026-02-23T06:43:49.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.722+0000 7fdd63fff640 1 -- 10.20.193.58:0/2564322803 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd64137c00 con 0x7fdd50003a30 2026-02-23T06:43:49.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.722+0000 7fdd63fff640 1 -- 10.20.193.58:0/2564322803 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd64057970 con 0x7fdd50003a30 2026-02-23T06:43:49.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.724+0000 7fdd437fe640 1 -- 10.20.193.58:0/2564322803 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fdd58042b80 con 0x7fdd50003a30 2026-02-23T06:43:49.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.724+0000 7fdd437fe640 1 --2- 10.20.193.58:0/2564322803 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdd3007a5b0 0x7fdd3009aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:49.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.724+0000 7fdd437fe640 1 -- 10.20.193.58:0/2564322803 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fdd5809e8e0 con 0x7fdd50003a30 2026-02-23T06:43:49.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.725+0000 7fdd627fc640 1 --2- 10.20.193.58:0/2564322803 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdd3007a5b0 0x7fdd3009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:49.725 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.725+0000 7fdd627fc640 1 --2- 10.20.193.58:0/2564322803 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdd3007a5b0 0x7fdd3009aa60 secure :-1 s=READY pgs=487 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd4c006b70 tx=0x7fdd4c005320 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:49.725 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.726+0000 7fdd437fe640 1 -- 10.20.193.58:0/2564322803 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fdd58061a90 con 0x7fdd50003a30 2026-02-23T06:43:49.876 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.881+0000 7fdd63fff640 1 -- 10.20.193.58:0/2564322803 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fdd640b5aa0 con 0x7fdd50003a30 2026-02-23T06:43:49.877 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.881+0000 7fdd437fe640 1 -- 10.20.193.58:0/2564322803 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1749 (secure 0 0 0) 0x7fdd58042e60 con 0x7fdd50003a30 2026-02-23T06:43:49.877 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":192,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:43:49.879 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.882+0000 7fdd63fff640 1 -- 10.20.193.58:0/2564322803 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdd3007a5b0 msgr2=0x7fdd3009aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:49.879 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.882+0000 7fdd63fff640 1 --2- 10.20.193.58:0/2564322803 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdd3007a5b0 0x7fdd3009aa60 secure :-1 s=READY pgs=487 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd4c006b70 tx=0x7fdd4c005320 comp rx=0 tx=0).stop 2026-02-23T06:43:49.879 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.882+0000 7fdd63fff640 1 -- 10.20.193.58:0/2564322803 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdd50003a30 msgr2=0x7fdd641371e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:49.879 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.882+0000 7fdd63fff640 1 --2- 10.20.193.58:0/2564322803 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdd50003a30 0x7fdd641371e0 secure :-1 s=READY pgs=27 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd58002740 tx=0x7fdd580139d0 comp rx=0 tx=0).stop 2026-02-23T06:43:49.879 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.882+0000 7fdd63fff640 1 -- 10.20.193.58:0/2564322803 shutdown_connections 2026-02-23T06:43:49.879 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.882+0000 7fdd63fff640 1 --2- 10.20.193.58:0/2564322803 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdd3007a5b0 0x7fdd3009aa60 unknown :-1 s=CLOSED pgs=487 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:49.880 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.882+0000 7fdd63fff640 1 --2- 10.20.193.58:0/2564322803 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdd6415c040 0x7fdd64149f30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:49.880 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.882+0000 7fdd63fff640 1 --2- 10.20.193.58:0/2564322803 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdd50004850 0x7fdd641499f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:49.880 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.882+0000 7fdd63fff640 1 --2- 10.20.193.58:0/2564322803 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdd50003a30 0x7fdd641371e0 unknown :-1 s=CLOSED pgs=27 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:49.880 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.882+0000 7fdd63fff640 1 -- 10.20.193.58:0/2564322803 >> 10.20.193.58:0/2564322803 conn(0x7fdd640b3c20 msgr2=0x7fdd640b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:43:49.880 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.882+0000 7fdd63fff640 1 -- 10.20.193.58:0/2564322803 shutdown_connections 2026-02-23T06:43:49.880 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:49.882+0000 7fdd63fff640 1 -- 10.20.193.58:0/2564322803 wait complete. 2026-02-23T06:43:49.890 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:43:49.890 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-23T06:43:49.891 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:43:50.016 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.021+0000 7f7663243640 1 -- 10.20.193.58:0/1599389669 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7644003a80 msgr2=0x7f7644003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:50.016 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.021+0000 7f7663243640 1 --2- 10.20.193.58:0/1599389669 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7644003a80 0x7f7644003e70 secure :-1 s=READY pgs=52 gs=6 cs=0 l=1 c_cookie=6956818009070068119 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f764c006f80 tx=0x7f764c02f8c0 comp rx=0 tx=0).stop 2026-02-23T06:43:50.016 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.021+0000 7f7663243640 1 -- 10.20.193.58:0/1599389669 shutdown_connections 2026-02-23T06:43:50.016 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.021+0000 7f7663243640 1 --2- 10.20.193.58:0/1599389669 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7644003a80 0x7f7644003e70 unknown :-1 s=CLOSED pgs=52 gs=6 cs=0 l=1 c_cookie=6956818009070068119 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:50.016 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.021+0000 7f7663243640 1 -- 10.20.193.58:0/1599389669 >> 10.20.193.58:0/1599389669 conn(0x7f765c0b3c20 msgr2=0x7f765c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:43:50.016 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.021+0000 7f7663243640 1 -- 10.20.193.58:0/1599389669 shutdown_connections 2026-02-23T06:43:50.016 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.021+0000 7f7663243640 1 -- 10.20.193.58:0/1599389669 wait complete. 2026-02-23T06:43:50.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.022+0000 7f7663243640 1 Processor -- start 2026-02-23T06:43:50.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.022+0000 7f7663243640 1 -- start start 2026-02-23T06:43:50.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.022+0000 7f7663243640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7644003a80 0x7f765c13a030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:50.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.022+0000 7f7663243640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f765c15b360 0x7f765c11e8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:50.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.022+0000 7f7663243640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f765c11ee30 0x7f765c12a0e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:50.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.022+0000 7f7663243640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f765c163030 con 0x7f765c15b360 2026-02-23T06:43:50.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.022+0000 7f7663243640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f765c13ba00 con 0x7f765c11ee30 2026-02-23T06:43:50.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.022+0000 7f7663243640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f765c13b5c0 con 0x7f7644003a80 2026-02-23T06:43:50.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.023+0000 7f7661a40640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f765c15b360 msgr2=0x7f765c11e8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:43:50.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.023+0000 7f7661a40640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f765c15b360 0x7f765c11e8f0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:43:50.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.023+0000 7f7662241640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7644003a80 0x7f765c13a030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:50.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.023+0000 7f7662241640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7644003a80 0x7f765c13a030 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:57986/0 (socket says 10.20.193.58:57986) 2026-02-23T06:43:50.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.023+0000 7f7662241640 1 -- 10.20.193.58:0/2233280836 learned_addr learned my addr 10.20.193.58:0/2233280836 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:43:50.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.023+0000 7f7662a42640 1 --2- 10.20.193.58:0/2233280836 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f765c11ee30 0x7f765c12a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:50.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.023+0000 7f7662241640 1 -- 10.20.193.58:0/2233280836 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f765c11ee30 msgr2=0x7f765c12a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:50.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.023+0000 7f7662241640 1 --2- 10.20.193.58:0/2233280836 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f765c11ee30 0x7f765c12a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:50.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.023+0000 7f7662241640 1 -- 10.20.193.58:0/2233280836 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f765c15b360 msgr2=0x7f765c11e8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:43:50.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.023+0000 7f7662241640 1 --2- 10.20.193.58:0/2233280836 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f765c15b360 0x7f765c11e8f0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:50.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.023+0000 7f7662241640 1 -- 10.20.193.58:0/2233280836 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f765c162a70 con 0x7f7644003a80 2026-02-23T06:43:50.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.023+0000 7f7662241640 1 --2- 10.20.193.58:0/2233280836 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7644003a80 0x7f765c13a030 secure :-1 s=READY pgs=53 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f764c002910 tx=0x7f764c002940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:50.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.023+0000 7f7642ffd640 1 -- 10.20.193.58:0/2233280836 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f764c03e040 con 0x7f7644003a80 2026-02-23T06:43:50.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.024+0000 7f7642ffd640 1 -- 10.20.193.58:0/2233280836 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f764c006630 con 0x7f7644003a80 2026-02-23T06:43:50.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.024+0000 7f7642ffd640 1 -- 10.20.193.58:0/2233280836 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f764c003930 con 0x7f7644003a80 2026-02-23T06:43:50.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.024+0000 7f7663243640 1 -- 10.20.193.58:0/2233280836 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f765c162d50 con 0x7f7644003a80 2026-02-23T06:43:50.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.024+0000 7f7663243640 1 -- 10.20.193.58:0/2233280836 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f765c13f200 con 0x7f7644003a80 2026-02-23T06:43:50.019 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.024+0000 7f7663243640 1 --2- 10.20.193.58:0/2233280836 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f765c12a620 0x7f765c12a9f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:50.019 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.024+0000 7f7663243640 1 -- 10.20.193.58:0/2233280836 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f765c0609c0 con 0x7f765c12a620 2026-02-23T06:43:50.019 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.024+0000 7f7661a40640 1 --2- 10.20.193.58:0/2233280836 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f765c12a620 0x7f765c12a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:50.019 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.025+0000 7f7661a40640 1 -- 10.20.193.58:0/2233280836 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f765c0b5e10 con 0x7f765c12a620 2026-02-23T06:43:50.019 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.025+0000 7f7661a40640 1 --2- 10.20.193.58:0/2233280836 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f765c12a620 0x7f765c12a9f0 secure :-1 s=READY pgs=29 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f765c160f10 tx=0x7f76500046a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:50.020 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.025+0000 7f7642ffd640 1 -- 10.20.193.58:0/2233280836 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7650010650 con 0x7f765c12a620 2026-02-23T06:43:50.020 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.025+0000 7f7642ffd640 1 -- 10.20.193.58:0/2233280836 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f76500107b0 con 0x7f765c12a620 2026-02-23T06:43:50.020 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.025+0000 7f7642ffd640 1 -- 10.20.193.58:0/2233280836 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f765c12a620 msgr2=0x7f765c12a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:50.020 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.025+0000 7f7642ffd640 1 --2- 10.20.193.58:0/2233280836 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f765c12a620 0x7f765c12a9f0 secure :-1 s=READY pgs=29 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f765c160f10 tx=0x7f76500046a0 comp rx=0 tx=0).stop 2026-02-23T06:43:50.020 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.025+0000 7f7642ffd640 1 -- 10.20.193.58:0/2233280836 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f765c12a620 msgr2=0x7f765c12a9f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:43:50.020 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.025+0000 7f7642ffd640 1 --2- 10.20.193.58:0/2233280836 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f765c12a620 0x7f765c12a9f0 secure :-1 s=CLOSED pgs=29 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f765c160f10 tx=0x7f76500046a0 comp rx=0 tx=0).stop 2026-02-23T06:43:50.020 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.025+0000 7f7642ffd640 1 -- 10.20.193.58:0/2233280836 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f764c003a90 con 0x7f7644003a80 2026-02-23T06:43:50.021 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.026+0000 7f7642ffd640 1 --2- 10.20.193.58:0/2233280836 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f762c07e940 0x7f762c09edf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:50.021 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.026+0000 7f7642ffd640 1 -- 10.20.193.58:0/2233280836 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f764c0c1c50 con 0x7f7644003a80 2026-02-23T06:43:50.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.027+0000 7f7661a40640 1 --2- 10.20.193.58:0/2233280836 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f762c07e940 0x7f762c09edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:50.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.027+0000 7f7661a40640 1 --2- 10.20.193.58:0/2233280836 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f762c07e940 0x7f762c09edf0 secure :-1 s=READY pgs=488 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7650009b60 tx=0x7f7650012000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:50.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.029+0000 7f7663243640 1 --2- 10.20.193.58:0/2233280836 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f765c160f70 0x7f765c161340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:50.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.029+0000 7f7663243640 1 -- 10.20.193.58:0/2233280836 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f765c0b5b30 con 0x7f765c160f70 2026-02-23T06:43:50.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.035+0000 7f7662a42640 1 --2- 10.20.193.58:0/2233280836 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f765c160f70 0x7f765c161340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:50.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.035+0000 7f7662a42640 1 -- 10.20.193.58:0/2233280836 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f765c0b6330 con 0x7f765c160f70 2026-02-23T06:43:50.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.036+0000 7f7662a42640 1 --2- 10.20.193.58:0/2233280836 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f765c160f70 0x7f765c161340 secure :-1 s=READY pgs=30 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f765c0b5010 tx=0x7f765800a5c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:50.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.036+0000 7f7642ffd640 1 -- 10.20.193.58:0/2233280836 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f765800adb0 con 0x7f765c160f70 2026-02-23T06:43:50.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.036+0000 7f7642ffd640 1 -- 10.20.193.58:0/2233280836 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5236 (secure 0 0 0) 0x7f76580133f0 con 0x7f765c160f70 2026-02-23T06:43:50.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.036+0000 7f7642ffd640 1 -- 10.20.193.58:0/2233280836 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f765c160f70 msgr2=0x7f765c161340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:50.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.036+0000 7f7642ffd640 1 --2- 10.20.193.58:0/2233280836 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f765c160f70 0x7f765c161340 secure :-1 s=READY pgs=30 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f765c0b5010 tx=0x7f765800a5c0 comp rx=0 tx=0).stop 2026-02-23T06:43:50.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.036+0000 7f7642ffd640 1 -- 10.20.193.58:0/2233280836 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f765c160f70 msgr2=0x7f765c161340 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:43:50.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.036+0000 7f7642ffd640 1 --2- 10.20.193.58:0/2233280836 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f765c160f70 0x7f765c161340 secure :-1 s=CLOSED pgs=30 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f765c0b5010 tx=0x7f765800a5c0 comp rx=0 tx=0).stop 2026-02-23T06:43:50.031 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:43:50.031 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:43:50.032 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:43:50.032 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:43:50.032 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 192, 2026-02-23T06:43:50.032 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 32112, 2026-02-23T06:43:50.032 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:43:50.032 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:43:50.032 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:43:50.032 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:50.032 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:43:50.032 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:43:50.032 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:43:50.032 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:43:50.032 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:43:50.032 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:43:50.032 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:43:50.032 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:43:50.032 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:43:50.033 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:43:50.033 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:43:50.033 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:43:50.033 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:43:50.033 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:43:50.033 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:43:50.033 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:43:50.033 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:43:50.033 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:50.033 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:43:50.033 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:43:50.033 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:43:50.033 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:43:50.033 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:43:50.033 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:43:50.033 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:43:50.033 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:43:50.033 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:43:50.033 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:43:50.033 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:43:50.034 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:43:50.034 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:43:50.034 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:43:50.034 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:43:50.034 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:50.034 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:50.034 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:43:50.034 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:43:50.034 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:43:50.034 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:43:50.034 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:43:50.034 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:43:50.034 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:43:50.034 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:43:50.034 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:43:50.034 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:43:50.034 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:43:50.034 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:43:50.034 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:43:50.034 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:43:50.035 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:43:50.035 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:43:50.035 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:43:50.035 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:43:50.035 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:43:50.035 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:43:50.035 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:43:50.035 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:43:50.035 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:43:50.035 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:43:50.035 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:43:50.035 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:43:50.035 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:43:50.035 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:43:50.035 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:43:50.035 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:43:50.035 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:50.035 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:43:50.035 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:50.035 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:43:50.036 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:50.036 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:43:50.036 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:43:50.036 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:43:50.036 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:43:50.036 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:50.036 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:43:50.036 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:43:50.036 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:50.036 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:50.036 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:50.036 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:43:50.036 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:43:50.036 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:50.036 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:50.036 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:50.036 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:50.036 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:43:50.036 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:43:50.036 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:43:50.037 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:43:50.037 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:43:50.037 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:43:50.037 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:50.037 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:50.037 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:43:50.037 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:43:50.037 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:43:50.037 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:43:50.037 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:50.037 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:43:50.037 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:43:50.037 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:50.037 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:50.037 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:50.037 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:43:50.037 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:43:50.037 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:50.038 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:50.038 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:50.038 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:50.038 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:43:50.038 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:43:50.038 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:43:50.038 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:43:50.038 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:43:50.038 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:43:50.038 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:50.038 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:50.038 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:43:50.038 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:43:50.038 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:43:50.038 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:43:50.038 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:50.038 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:43:50.038 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:43:50.039 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:50.039 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:50.039 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:50.039 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:43:50.039 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:43:50.039 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:50.039 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:50.039 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:50.039 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:50.039 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:43:50.039 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:43:50.039 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:43:50.039 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:43:50.039 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:43:50.039 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:43:50.039 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:50.039 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:50.039 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:50.040 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:43:50.040 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:43:50.040 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:50.040 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:50.040 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:50.040 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:43:50.040 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:50.040 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:50.040 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:43:50.040 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:50.040 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:50.040 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:50.040 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:43:50.040 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:50.040 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:50.040 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:43:50.040 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:50.040 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:50.040 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:50.041 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:43:50.041 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:50.041 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:50.041 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:43:50.041 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:50.041 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:50.041 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:50.041 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:43:50.041 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:50.041 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:50.041 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:50.041 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:43:50.041 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:43:50.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.036+0000 7f7663243640 1 -- 10.20.193.58:0/2233280836 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f762c07e940 msgr2=0x7f762c09edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:50.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.036+0000 7f7663243640 1 --2- 10.20.193.58:0/2233280836 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f762c07e940 0x7f762c09edf0 secure :-1 s=READY pgs=488 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7650009b60 tx=0x7f7650012000 comp rx=0 tx=0).stop 2026-02-23T06:43:50.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.036+0000 7f7663243640 1 -- 10.20.193.58:0/2233280836 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7644003a80 msgr2=0x7f765c13a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:50.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.036+0000 7f7663243640 1 --2- 10.20.193.58:0/2233280836 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7644003a80 0x7f765c13a030 secure :-1 s=READY pgs=53 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f764c002910 tx=0x7f764c002940 comp rx=0 tx=0).stop 2026-02-23T06:43:50.043 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.036+0000 7f7662a42640 1 -- 10.20.193.58:0/2233280836 reap_dead start 2026-02-23T06:43:50.043 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.036+0000 7f7663243640 1 -- 10.20.193.58:0/2233280836 shutdown_connections 2026-02-23T06:43:50.043 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.036+0000 7f7663243640 1 -- 10.20.193.58:0/2233280836 >> 10.20.193.58:0/2233280836 conn(0x7f765c0b3c20 msgr2=0x7f765c0b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:43:50.043 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.036+0000 7f7663243640 1 -- 10.20.193.58:0/2233280836 shutdown_connections 2026-02-23T06:43:50.043 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.036+0000 7f7663243640 1 -- 10.20.193.58:0/2233280836 wait complete. 2026-02-23T06:43:50.043 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:43:50.043 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-23T06:43:50.043 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:43:50.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.172+0000 7fe2e9b54640 1 -- 10.20.193.58:0/1500245891 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2e40576d0 msgr2=0x7fe2e4058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:50.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.172+0000 7fe2e9b54640 1 --2- 10.20.193.58:0/1500245891 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2e40576d0 0x7fe2e4058200 secure :-1 s=READY pgs=32 gs=4 cs=0 l=1 c_cookie=3304435851372217042 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2e0005820 tx=0x7fe2e00302b0 comp rx=0 tx=0).stop 2026-02-23T06:43:50.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.172+0000 7fe2e9b54640 1 -- 10.20.193.58:0/1500245891 shutdown_connections 2026-02-23T06:43:50.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.172+0000 7fe2e9b54640 1 --2- 10.20.193.58:0/1500245891 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2e40576d0 0x7fe2e4058200 unknown :-1 s=CLOSED pgs=32 gs=4 cs=0 l=1 c_cookie=3304435851372217042 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:50.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.172+0000 7fe2e9b54640 1 -- 10.20.193.58:0/1500245891 >> 10.20.193.58:0/1500245891 conn(0x7fe2e40b3c20 msgr2=0x7fe2e40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:43:50.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.172+0000 7fe2e9b54640 1 -- 10.20.193.58:0/1500245891 shutdown_connections 2026-02-23T06:43:50.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.172+0000 7fe2e9b54640 1 -- 10.20.193.58:0/1500245891 wait complete. 2026-02-23T06:43:50.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.173+0000 7fe2e9b54640 1 Processor -- start 2026-02-23T06:43:50.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.173+0000 7fe2e9b54640 1 -- start start 2026-02-23T06:43:50.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.173+0000 7fe2e9b54640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2e4056960 0x7fe2e411e520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:50.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.173+0000 7fe2e9b54640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe2e40576d0 0x7fe2e4149e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:50.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.173+0000 7fe2e9b54640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe2e415c4b0 0x7fe2e40aff30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:50.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.173+0000 7fe2e9b54640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e414dd60 con 0x7fe2e40576d0 2026-02-23T06:43:50.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.173+0000 7fe2e9b54640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e415a320 con 0x7fe2e4056960 2026-02-23T06:43:50.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.173+0000 7fe2e9b54640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe2e415a600 con 0x7fe2e415c4b0 2026-02-23T06:43:50.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.173+0000 7fe2dbfff640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe2e40576d0 msgr2=0x7fe2e4149e40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:43:50.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.173+0000 7fe2dbfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe2e40576d0 0x7fe2e4149e40 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:43:50.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.174+0000 7fe2e8b52640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2e4056960 0x7fe2e411e520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:50.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.174+0000 7fe2e8b52640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2e4056960 0x7fe2e411e520 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:55942/0 (socket says 10.20.193.58:55942) 2026-02-23T06:43:50.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.174+0000 7fe2e8b52640 1 -- 10.20.193.58:0/611552835 learned_addr learned my addr 10.20.193.58:0/611552835 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:43:50.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.174+0000 7fe2e9353640 1 --2- 10.20.193.58:0/611552835 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe2e415c4b0 0x7fe2e40aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:50.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.174+0000 7fe2e9353640 1 -- 10.20.193.58:0/611552835 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2e4056960 msgr2=0x7fe2e411e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:50.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.174+0000 7fe2e9353640 1 --2- 10.20.193.58:0/611552835 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2e4056960 0x7fe2e411e520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:50.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.174+0000 7fe2e9353640 1 -- 10.20.193.58:0/611552835 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe2e40576d0 msgr2=0x7fe2e4149e40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:43:50.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.174+0000 7fe2e9353640 1 --2- 10.20.193.58:0/611552835 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe2e40576d0 0x7fe2e4149e40 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:50.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.174+0000 7fe2e9353640 1 -- 10.20.193.58:0/611552835 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e000a590 con 0x7fe2e415c4b0 2026-02-23T06:43:50.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.174+0000 7fe2e8b52640 1 --2- 10.20.193.58:0/611552835 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe2e4056960 0x7fe2e411e520 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:43:50.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.175+0000 7fe2e9353640 1 --2- 10.20.193.58:0/611552835 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe2e415c4b0 0x7fe2e40aff30 secure :-1 s=READY pgs=54 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2e40b5270 tx=0x7fe2e0003e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:50.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.175+0000 7fe2d97fa640 1 -- 10.20.193.58:0/611552835 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe2e003e070 con 0x7fe2e415c4b0 2026-02-23T06:43:50.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.175+0000 7fe2e9b54640 1 -- 10.20.193.58:0/611552835 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2e414d430 con 0x7fe2e415c4b0 2026-02-23T06:43:50.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.175+0000 7fe2e9b54640 1 -- 10.20.193.58:0/611552835 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2e414d9f0 con 0x7fe2e415c4b0 2026-02-23T06:43:50.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.175+0000 7fe2d97fa640 1 -- 10.20.193.58:0/611552835 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2e0039960 con 0x7fe2e415c4b0 2026-02-23T06:43:50.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.175+0000 7fe2d97fa640 1 -- 10.20.193.58:0/611552835 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe2e0039d70 con 0x7fe2e415c4b0 2026-02-23T06:43:50.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.175+0000 7fe2e9b54640 1 --2- 10.20.193.58:0/611552835 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe2e413ff20 0x7fe2e40b0470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:50.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.175+0000 7fe2e9b54640 1 -- 10.20.193.58:0/611552835 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe2e4059690 con 0x7fe2e413ff20 2026-02-23T06:43:50.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.176+0000 7fe2e8b52640 1 --2- 10.20.193.58:0/611552835 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe2e413ff20 0x7fe2e40b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:50.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.176+0000 7fe2e8b52640 1 -- 10.20.193.58:0/611552835 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe2e40593b0 con 0x7fe2e413ff20 2026-02-23T06:43:50.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.176+0000 7fe2e8b52640 1 --2- 10.20.193.58:0/611552835 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe2e413ff20 0x7fe2e40b0470 secure :-1 s=READY pgs=55 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2d40043c0 tx=0x7fe2d400e1d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:50.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.176+0000 7fe2d97fa640 1 -- 10.20.193.58:0/611552835 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe2d400eda0 con 0x7fe2e413ff20 2026-02-23T06:43:50.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.177+0000 7fe2d97fa640 1 -- 10.20.193.58:0/611552835 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fe2d401b450 con 0x7fe2e413ff20 2026-02-23T06:43:50.173 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.177+0000 7fe2d97fa640 1 -- 10.20.193.58:0/611552835 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe2e413ff20 msgr2=0x7fe2e40b0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:50.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.177+0000 7fe2d97fa640 1 --2- 10.20.193.58:0/611552835 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe2e413ff20 0x7fe2e40b0470 secure :-1 s=READY pgs=55 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2d40043c0 tx=0x7fe2d400e1d0 comp rx=0 tx=0).stop 2026-02-23T06:43:50.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.177+0000 7fe2d97fa640 1 -- 10.20.193.58:0/611552835 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe2e413ff20 msgr2=0x7fe2e40b0470 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:43:50.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.177+0000 7fe2d97fa640 1 --2- 10.20.193.58:0/611552835 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe2e413ff20 0x7fe2e40b0470 unknown :-1 s=CLOSED pgs=55 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:50.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.177+0000 7fe2d97fa640 1 -- 10.20.193.58:0/611552835 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fe2e004b3b0 con 0x7fe2e415c4b0 2026-02-23T06:43:50.175 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.178+0000 7fe2d97fa640 1 --2- 10.20.193.58:0/611552835 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe2b407a3c0 0x7fe2b409a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:50.175 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.178+0000 7fe2d97fa640 1 -- 10.20.193.58:0/611552835 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fe2e00c3be0 con 0x7fe2e415c4b0 2026-02-23T06:43:50.175 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.178+0000 7fe2e8b52640 1 --2- 10.20.193.58:0/611552835 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe2b407a3c0 0x7fe2b409a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:50.175 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.179+0000 7fe2e8b52640 1 --2- 10.20.193.58:0/611552835 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe2b407a3c0 0x7fe2b409a870 secure :-1 s=READY pgs=489 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2d400e750 tx=0x7fe2d4008030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:50.177 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.180+0000 7fe2e9b54640 1 --2- 10.20.193.58:0/611552835 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe2e415b980 0x7fe2e411f070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:43:50.177 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.180+0000 7fe2e9b54640 1 -- 10.20.193.58:0/611552835 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe2e4058070 con 0x7fe2e415b980 2026-02-23T06:43:50.177 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.181+0000 7fe2dbfff640 1 --2- 10.20.193.58:0/611552835 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe2e415b980 0x7fe2e411f070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:43:50.177 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.181+0000 7fe2dbfff640 1 -- 10.20.193.58:0/611552835 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe2e414ded0 con 0x7fe2e415b980 2026-02-23T06:43:50.178 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.181+0000 7fe2dbfff640 1 --2- 10.20.193.58:0/611552835 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe2e415b980 0x7fe2e411f070 secure :-1 s=READY pgs=56 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2e41446e0 tx=0x7fe2cc00c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:43:50.178 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.181+0000 7fe2d97fa640 1 -- 10.20.193.58:0/611552835 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe2cc005d70 con 0x7fe2e415b980 2026-02-23T06:43:50.178 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.182+0000 7fe2d97fa640 1 -- 10.20.193.58:0/611552835 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5544 (secure 0 0 0) 0x7fe2cc0070d0 con 0x7fe2e415b980 2026-02-23T06:43:50.178 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.182+0000 7fe2d97fa640 1 -- 10.20.193.58:0/611552835 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe2e415b980 msgr2=0x7fe2e411f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:50.178 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.182+0000 7fe2d97fa640 1 --2- 10.20.193.58:0/611552835 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe2e415b980 0x7fe2e411f070 secure :-1 s=READY pgs=56 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2e41446e0 tx=0x7fe2cc00c8d0 comp rx=0 tx=0).stop 2026-02-23T06:43:50.178 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.182+0000 7fe2d97fa640 1 -- 10.20.193.58:0/611552835 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe2e415b980 msgr2=0x7fe2e411f070 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:43:50.178 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.182+0000 7fe2d97fa640 1 --2- 10.20.193.58:0/611552835 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe2e415b980 0x7fe2e411f070 unknown :-1 s=CLOSED pgs=56 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:43:50.179 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:43:50.179 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:43:50.179 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:43:50.179 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:43:50.179 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 192, 2026-02-23T06:43:50.180 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 83611, 2026-02-23T06:43:50.180 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:43:50.180 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:43:50.180 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:43:50.180 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:50.180 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:43:50.180 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:43:50.181 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:43:50.181 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:43:50.181 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:43:50.181 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:43:50.181 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:43:50.181 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:43:50.181 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:43:50.181 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:43:50.182 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:43:50.182 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:43:50.182 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:43:50.182 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:43:50.182 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:43:50.182 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:43:50.182 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:43:50.182 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:50.183 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:43:50.183 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:43:50.183 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:43:50.183 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:43:50.183 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:43:50.183 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:43:50.183 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:43:50.183 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:43:50.184 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:43:50.184 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:43:50.184 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:43:50.184 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:43:50.184 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:43:50.184 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:43:50.184 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:43:50.184 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:50.184 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:50.185 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:43:50.185 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:43:50.185 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:43:50.185 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:43:50.185 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:43:50.185 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:43:50.185 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:43:50.186 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:43:50.186 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:43:50.186 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:43:50.186 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:43:50.186 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:43:50.186 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:43:50.186 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:43:50.186 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:43:50.187 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:43:50.187 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:43:50.187 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:43:50.187 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:43:50.187 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:43:50.187 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:43:50.187 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:43:50.187 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:43:50.187 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:43:50.188 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:43:50.188 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:43:50.188 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:43:50.188 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:43:50.188 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:43:50.188 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:43:50.188 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:50.188 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:43:50.189 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:50.189 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:43:50.189 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:50.189 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:43:50.189 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:43:50.189 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:43:50.189 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:43:50.190 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:50.190 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:43:50.190 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:43:50.190 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:50.190 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:50.190 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:50.190 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:43:50.190 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:43:50.190 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:50.191 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:50.191 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:50.191 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:50.191 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:43:50.191 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:43:50.191 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:43:50.191 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:43:50.191 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:43:50.192 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:43:50.192 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:50.192 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:50.192 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:43:50.192 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:43:50.192 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:43:50.192 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:43:50.192 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:50.193 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:43:50.193 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:43:50.193 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:50.193 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:50.193 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:50.193 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:43:50.193 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:43:50.193 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:50.194 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:50.194 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:50.194 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:50.194 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:43:50.194 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:43:50.194 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:43:50.194 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:43:50.194 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:43:50.195 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:43:50.195 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:50.195 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:50.195 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:43:50.195 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:43:50.195 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:43:50.195 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:43:50.195 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:50.195 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:43:50.196 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:43:50.196 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:50.196 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:50.196 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:50.196 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:43:50.196 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:43:50.196 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:43:50.196 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:50.196 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:50.196 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:50.197 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:43:50.197 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:43:50.197 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:43:50.197 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:43:50.197 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:43:50.197 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:43:50.197 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:50.197 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:50.197 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:50.197 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:43:50.198 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:43:50.198 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:50.198 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:50.198 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:50.198 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:43:50.198 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:50.198 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:50.198 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:43:50.198 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:50.198 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:50.198 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:50.198 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:43:50.198 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:50.198 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:50.199 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:43:50.199 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:50.199 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:50.199 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:50.199 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:43:50.199 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:50.199 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:50.199 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:43:50.199 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:50.199 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:43:50.199 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:43:50.199 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:43:50.199 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:50.199 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:50.199 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:50.200 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:50.200 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:43:50.200 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:50.200 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:43:50.200 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:43:50.200 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:43:50.200 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:43:50.200 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:43:50.200 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:43:50.200 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:43:50.200 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:43:50.200 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:43:50.200 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:43:50.200 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:43:50.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.182+0000 7fe2e9b54640 1 -- 10.20.193.58:0/611552835 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe2b407a3c0 msgr2=0x7fe2b409a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:50.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.182+0000 7fe2e9b54640 1 --2- 10.20.193.58:0/611552835 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe2b407a3c0 0x7fe2b409a870 secure :-1 s=READY pgs=489 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2d400e750 tx=0x7fe2d4008030 comp rx=0 tx=0).stop 2026-02-23T06:43:50.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.182+0000 7fe2e9b54640 1 -- 10.20.193.58:0/611552835 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe2e415c4b0 msgr2=0x7fe2e40aff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:43:50.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.182+0000 7fe2e9b54640 1 --2- 10.20.193.58:0/611552835 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe2e415c4b0 0x7fe2e40aff30 secure :-1 s=READY pgs=54 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2e40b5270 tx=0x7fe2e0003e60 comp rx=0 tx=0).stop 2026-02-23T06:43:50.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.182+0000 7fe2e9353640 1 -- 10.20.193.58:0/611552835 reap_dead start 2026-02-23T06:43:50.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.182+0000 7fe2e9353640 1 -- 10.20.193.58:0/611552835 reap_dead start 2026-02-23T06:43:50.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.182+0000 7fe2e9b54640 1 -- 10.20.193.58:0/611552835 shutdown_connections 2026-02-23T06:43:50.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.182+0000 7fe2e9b54640 1 -- 10.20.193.58:0/611552835 >> 10.20.193.58:0/611552835 conn(0x7fe2e40b3c20 msgr2=0x7fe2e40b6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:43:50.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.182+0000 7fe2e9b54640 1 -- 10.20.193.58:0/611552835 shutdown_connections 2026-02-23T06:43:50.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:43:50.182+0000 7fe2e9b54640 1 -- 10.20.193.58:0/611552835 wait complete. 2026-02-23T06:43:50.203 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:43:50.203 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:44:10.204 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-23T06:44:10.205 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-23T06:44:10.205 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-23T06:44:10.205 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-23T06:44:10.210 INFO:tasks.ceph.mon.a:Started 2026-02-23T06:44:10.210 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.b 2026-02-23T06:44:10.210 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-23T06:44:10.211 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-23T06:44:10.211 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-23T06:44:14.909 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:44:14.913 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:44:25.211 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.b 2026-02-23T06:44:25.212 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-23T06:44:25.212 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-23T06:44:25.212 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:44:25.212 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:44:25.346 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.351+0000 7f7299f6d640 1 -- 10.20.193.58:0/2554606086 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f72940b6690 msgr2=0x7f7294058ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:25.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.351+0000 7f7299f6d640 1 --2- 10.20.193.58:0/2554606086 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f72940b6690 0x7f7294058ec0 secure :-1 s=READY pgs=39 gs=3 cs=0 l=1 c_cookie=13797748773989951312 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72940afed0 tx=0x7f7290030270 comp rx=0 tx=0).stop 2026-02-23T06:44:25.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.351+0000 7f7299f6d640 1 -- 10.20.193.58:0/2554606086 shutdown_connections 2026-02-23T06:44:25.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.351+0000 7f7299f6d640 1 --2- 10.20.193.58:0/2554606086 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f72940b6690 0x7f7294058ec0 unknown :-1 s=CLOSED pgs=39 gs=3 cs=0 l=1 c_cookie=13797748773989951312 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:25.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.351+0000 7f7299f6d640 1 --2- 10.20.193.58:0/2554606086 >> v2:10.20.193.58:3300/0 conn(0x7f729415d4a0 0x7f72940affb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:25.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.351+0000 7f7299f6d640 1 -- 10.20.193.58:0/2554606086 >> 10.20.193.58:0/2554606086 conn(0x7f72940b3c20 msgr2=0x7f72940b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:25.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.351+0000 7f7299f6d640 1 -- 10.20.193.58:0/2554606086 shutdown_connections 2026-02-23T06:44:25.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.351+0000 7f7299f6d640 1 -- 10.20.193.58:0/2554606086 wait complete. 2026-02-23T06:44:25.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.352+0000 7f7299f6d640 1 Processor -- start 2026-02-23T06:44:25.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.352+0000 7f7299f6d640 1 -- start start 2026-02-23T06:44:25.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.352+0000 7f7299f6d640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f72940b6690 0x7f7294126cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:25.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.352+0000 7f7299f6d640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f729415d4a0 0x7f7294120460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:25.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.352+0000 7f7299f6d640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f729415d870 0x7f7294124230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:25.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.353+0000 7f7299f6d640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f72941201a0 con 0x7f729415d4a0 2026-02-23T06:44:25.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.353+0000 7f7299f6d640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f7294123630 con 0x7f729415d870 2026-02-23T06:44:25.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.353+0000 7f7299f6d640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f7294058200 con 0x7f72940b6690 2026-02-23T06:44:25.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.353+0000 7f728bfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f729415d4a0 0x7f7294120460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:25.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.353+0000 7f728bfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f729415d4a0 0x7f7294120460 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:49858/0 (socket says 10.20.193.58:49858) 2026-02-23T06:44:25.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.353+0000 7f728bfff640 1 -- 10.20.193.58:0/343148204 learned_addr learned my addr 10.20.193.58:0/343148204 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:44:25.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.353+0000 7f7298f6b640 1 --2- 10.20.193.58:0/343148204 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f72940b6690 0x7f7294126cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:25.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.353+0000 7f729976c640 1 --2- 10.20.193.58:0/343148204 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f729415d870 0x7f7294124230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:25.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.353+0000 7f728bfff640 1 -- 10.20.193.58:0/343148204 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f72940b6690 msgr2=0x7f7294126cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:25.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.353+0000 7f728bfff640 1 --2- 10.20.193.58:0/343148204 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f72940b6690 0x7f7294126cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:25.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.353+0000 7f728bfff640 1 -- 10.20.193.58:0/343148204 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f729415d870 msgr2=0x7f7294124230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:25.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.353+0000 7f728bfff640 1 --2- 10.20.193.58:0/343148204 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f729415d870 0x7f7294124230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:25.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.353+0000 7f728bfff640 1 -- 10.20.193.58:0/343148204 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f729000a590 con 0x7f729415d4a0 2026-02-23T06:44:25.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.353+0000 7f729976c640 1 --2- 10.20.193.58:0/343148204 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f729415d870 0x7f7294124230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:44:25.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.353+0000 7f728bfff640 1 --2- 10.20.193.58:0/343148204 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f729415d4a0 0x7f7294120460 secure :-1 s=READY pgs=5 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f727c007fd0 tx=0x7f727c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:25.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.353+0000 7f72897fa640 1 -- 10.20.193.58:0/343148204 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f727c012850 con 0x7f729415d4a0 2026-02-23T06:44:25.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.353+0000 7f72897fa640 1 -- 10.20.193.58:0/343148204 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f727c012aa0 con 0x7f729415d4a0 2026-02-23T06:44:25.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.353+0000 7f72897fa640 1 -- 10.20.193.58:0/343148204 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f727c012e50 con 0x7f729415d4a0 2026-02-23T06:44:25.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.353+0000 7f7299f6d640 1 -- 10.20.193.58:0/343148204 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7294122ef0 con 0x7f729415d4a0 2026-02-23T06:44:25.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.353+0000 7f7299f6d640 1 -- 10.20.193.58:0/343148204 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7294057ce0 con 0x7f729415d4a0 2026-02-23T06:44:25.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.354+0000 7f7299f6d640 1 -- 10.20.193.58:0/343148204 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72940b6d50 con 0x7f729415d4a0 2026-02-23T06:44:25.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.356+0000 7f72897fa640 1 -- 10.20.193.58:0/343148204 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f727c01b400 con 0x7f729415d4a0 2026-02-23T06:44:25.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.356+0000 7f72897fa640 1 --2- 10.20.193.58:0/343148204 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f726407a630 0x7f726409aae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:25.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.357+0000 7f72897fa640 1 -- 10.20.193.58:0/343148204 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f727c09dbc0 con 0x7f729415d4a0 2026-02-23T06:44:25.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.357+0000 7f7298f6b640 1 --2- 10.20.193.58:0/343148204 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f726407a630 0x7f726409aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:25.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.357+0000 7f7298f6b640 1 --2- 10.20.193.58:0/343148204 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f726407a630 0x7f726409aae0 secure :-1 s=READY pgs=491 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7284004740 tx=0x7f7284005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:25.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.358+0000 7f72897fa640 1 -- 10.20.193.58:0/343148204 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f727c060cd0 con 0x7f729415d4a0 2026-02-23T06:44:25.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.514+0000 7f7299f6d640 1 -- 10.20.193.58:0/343148204 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f729405b0e0 con 0x7f729415d4a0 2026-02-23T06:44:25.509 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.514+0000 7f72897fa640 1 -- 10.20.193.58:0/343148204 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f727c09d080 con 0x7f729415d4a0 2026-02-23T06:44:25.509 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":202,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:44:25.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.515+0000 7f7299f6d640 1 -- 10.20.193.58:0/343148204 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f726407a630 msgr2=0x7f726409aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:25.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.515+0000 7f7299f6d640 1 --2- 10.20.193.58:0/343148204 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f726407a630 0x7f726409aae0 secure :-1 s=READY pgs=491 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7284004740 tx=0x7f7284005f90 comp rx=0 tx=0).stop 2026-02-23T06:44:25.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.515+0000 7f7299f6d640 1 -- 10.20.193.58:0/343148204 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f729415d4a0 msgr2=0x7f7294120460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:25.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.515+0000 7f7299f6d640 1 --2- 10.20.193.58:0/343148204 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f729415d4a0 0x7f7294120460 secure :-1 s=READY pgs=5 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f727c007fd0 tx=0x7f727c00c970 comp rx=0 tx=0).stop 2026-02-23T06:44:25.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.515+0000 7f7299f6d640 1 -- 10.20.193.58:0/343148204 shutdown_connections 2026-02-23T06:44:25.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.515+0000 7f7299f6d640 1 --2- 10.20.193.58:0/343148204 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f726407a630 0x7f726409aae0 unknown :-1 s=CLOSED pgs=491 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:25.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.515+0000 7f7299f6d640 1 --2- 10.20.193.58:0/343148204 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f729415d870 0x7f7294124230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:25.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.515+0000 7f7299f6d640 1 --2- 10.20.193.58:0/343148204 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f729415d4a0 0x7f7294120460 unknown :-1 s=CLOSED pgs=5 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:25.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.515+0000 7f7299f6d640 1 --2- 10.20.193.58:0/343148204 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f72940b6690 0x7f7294126cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:25.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.515+0000 7f7299f6d640 1 -- 10.20.193.58:0/343148204 >> 10.20.193.58:0/343148204 conn(0x7f72940b3c20 msgr2=0x7f7294162a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:25.512 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.515+0000 7f7299f6d640 1 -- 10.20.193.58:0/343148204 shutdown_connections 2026-02-23T06:44:25.512 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.515+0000 7f7299f6d640 1 -- 10.20.193.58:0/343148204 wait complete. 2026-02-23T06:44:25.521 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:44:25.522 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:44:25.522 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:44:25.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.649+0000 7fb77b1a5640 1 -- 10.20.193.58:0/2608068148 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7740b1170 msgr2=0x7fb77415ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:25.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.649+0000 7fb77b1a5640 1 --2- 10.20.193.58:0/2608068148 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7740b1170 0x7fb77415ce40 secure :-1 s=READY pgs=6 gs=2 cs=0 l=1 c_cookie=17032451946285785215 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb774164170 tx=0x7fb76402f260 comp rx=0 tx=0).stop 2026-02-23T06:44:25.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.649+0000 7fb77b1a5640 1 -- 10.20.193.58:0/2608068148 shutdown_connections 2026-02-23T06:44:25.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.649+0000 7fb77b1a5640 1 --2- 10.20.193.58:0/2608068148 >> v2:10.20.193.93:3300/0 conn(0x7fb774163820 0x7fb77415d380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:25.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.649+0000 7fb77b1a5640 1 --2- 10.20.193.58:0/2608068148 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7740b1170 0x7fb77415ce40 unknown :-1 s=CLOSED pgs=6 gs=2 cs=0 l=1 c_cookie=17032451946285785215 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:25.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.649+0000 7fb77b1a5640 1 -- 10.20.193.58:0/2608068148 >> 10.20.193.58:0/2608068148 conn(0x7fb774058e50 msgr2=0x7fb774059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:25.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.649+0000 7fb77b1a5640 1 -- 10.20.193.58:0/2608068148 shutdown_connections 2026-02-23T06:44:25.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.649+0000 7fb77b1a5640 1 -- 10.20.193.58:0/2608068148 wait complete. 2026-02-23T06:44:25.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.650+0000 7fb77b1a5640 1 Processor -- start 2026-02-23T06:44:25.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.650+0000 7fb77b1a5640 1 -- start start 2026-02-23T06:44:25.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.651+0000 7fb77b1a5640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb7740b1170 0x7fb7741641d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:25.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.651+0000 7fb77b1a5640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7740b1540 0x7fb774164ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:25.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.651+0000 7fb77b1a5640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb774163820 0x7fb77415ae90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:25.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.651+0000 7fb77b1a5640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb774132b40 con 0x7fb7740b1540 2026-02-23T06:44:25.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.651+0000 7fb77b1a5640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb774166360 con 0x7fb7740b1170 2026-02-23T06:44:25.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.651+0000 7fb77b1a5640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb774134010 con 0x7fb774163820 2026-02-23T06:44:25.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.651+0000 7fb76bfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7740b1540 0x7fb774164ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:25.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.651+0000 7fb76bfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7740b1540 0x7fb774164ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:49874/0 (socket says 10.20.193.58:49874) 2026-02-23T06:44:25.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.651+0000 7fb76bfff640 1 -- 10.20.193.58:0/1594531681 learned_addr learned my addr 10.20.193.58:0/1594531681 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:44:25.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.651+0000 7fb778f1a640 1 --2- 10.20.193.58:0/1594531681 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb7740b1170 0x7fb7741641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:25.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.651+0000 7fb76bfff640 1 -- 10.20.193.58:0/1594531681 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb774163820 msgr2=0x7fb77415ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:25.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.651+0000 7fb76bfff640 1 --2- 10.20.193.58:0/1594531681 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb774163820 0x7fb77415ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:25.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.651+0000 7fb76bfff640 1 -- 10.20.193.58:0/1594531681 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb7740b1170 msgr2=0x7fb7741641d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:25.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.651+0000 7fb76bfff640 1 --2- 10.20.193.58:0/1594531681 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb7740b1170 0x7fb7741641d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:25.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.651+0000 7fb76bfff640 1 -- 10.20.193.58:0/1594531681 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb764009570 con 0x7fb7740b1540 2026-02-23T06:44:25.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.652+0000 7fb76bfff640 1 --2- 10.20.193.58:0/1594531681 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7740b1540 0x7fb774164ca0 secure :-1 s=READY pgs=7 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb75c00c4b0 tx=0x7fb75c00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:25.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.652+0000 7fb7697fa640 1 -- 10.20.193.58:0/1594531681 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb75c006ab0 con 0x7fb7740b1540 2026-02-23T06:44:25.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.652+0000 7fb7697fa640 1 -- 10.20.193.58:0/1594531681 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb75c006d00 con 0x7fb7740b1540 2026-02-23T06:44:25.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.652+0000 7fb7697fa640 1 -- 10.20.193.58:0/1594531681 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb75c0072b0 con 0x7fb7740b1540 2026-02-23T06:44:25.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.652+0000 7fb77b1a5640 1 -- 10.20.193.58:0/1594531681 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb774130a00 con 0x7fb7740b1540 2026-02-23T06:44:25.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.652+0000 7fb77b1a5640 1 -- 10.20.193.58:0/1594531681 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb774134590 con 0x7fb7740b1540 2026-02-23T06:44:25.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.652+0000 7fb77b1a5640 1 --2- 10.20.193.58:0/1594531681 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb77415b3d0 0x7fb774132f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:25.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.652+0000 7fb77b1a5640 1 -- 10.20.193.58:0/1594531681 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb774166fe0 con 0x7fb77415b3d0 2026-02-23T06:44:25.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.653+0000 7fb778f1a640 1 --2- 10.20.193.58:0/1594531681 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb77415b3d0 0x7fb774132f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:25.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.653+0000 7fb778f1a640 1 -- 10.20.193.58:0/1594531681 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb774166d00 con 0x7fb77415b3d0 2026-02-23T06:44:25.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.653+0000 7fb778f1a640 1 --2- 10.20.193.58:0/1594531681 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb77415b3d0 0x7fb774132f60 secure :-1 s=READY pgs=8 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb764004740 tx=0x7fb7640028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:25.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.653+0000 7fb7697fa640 1 -- 10.20.193.58:0/1594531681 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb764038470 con 0x7fb77415b3d0 2026-02-23T06:44:25.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.653+0000 7fb7697fa640 1 -- 10.20.193.58:0/1594531681 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fb7640385d0 con 0x7fb77415b3d0 2026-02-23T06:44:25.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.653+0000 7fb7697fa640 1 -- 10.20.193.58:0/1594531681 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb77415b3d0 msgr2=0x7fb774132f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:25.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.653+0000 7fb7697fa640 1 --2- 10.20.193.58:0/1594531681 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb77415b3d0 0x7fb774132f60 secure :-1 s=READY pgs=8 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb764004740 tx=0x7fb7640028d0 comp rx=0 tx=0).stop 2026-02-23T06:44:25.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.653+0000 7fb7697fa640 1 -- 10.20.193.58:0/1594531681 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb77415b3d0 msgr2=0x7fb774132f60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:44:25.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.653+0000 7fb7697fa640 1 --2- 10.20.193.58:0/1594531681 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb77415b3d0 0x7fb774132f60 unknown :-1 s=CLOSED pgs=8 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:25.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.653+0000 7fb7697fa640 1 -- 10.20.193.58:0/1594531681 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fb75c019070 con 0x7fb7740b1540 2026-02-23T06:44:25.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.654+0000 7fb7697fa640 1 --2- 10.20.193.58:0/1594531681 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb74407a3c0 0x7fb74409a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:25.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.655+0000 7fb7697fa640 1 -- 10.20.193.58:0/1594531681 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fb75c09d6e0 con 0x7fb7740b1540 2026-02-23T06:44:25.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.655+0000 7fb778f1a640 1 --2- 10.20.193.58:0/1594531681 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb74407a3c0 0x7fb74409a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:25.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.656+0000 7fb778f1a640 1 --2- 10.20.193.58:0/1594531681 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb74407a3c0 0x7fb74409a870 secure :-1 s=READY pgs=492 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb764004740 tx=0x7fb76403a030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:25.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.657+0000 7fb77b1a5640 1 --2- 10.20.193.58:0/1594531681 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb77415a8d0 0x7fb7741334a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:25.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.657+0000 7fb77b1a5640 1 -- 10.20.193.58:0/1594531681 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb77405b2d0 con 0x7fb77415a8d0 2026-02-23T06:44:25.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.658+0000 7fb77971b640 1 --2- 10.20.193.58:0/1594531681 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb77415a8d0 0x7fb7741334a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:25.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.658+0000 7fb77971b640 1 -- 10.20.193.58:0/1594531681 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb7740b3a20 con 0x7fb77415a8d0 2026-02-23T06:44:25.654 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.658+0000 7fb77971b640 1 --2- 10.20.193.58:0/1594531681 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb77415a8d0 0x7fb7741334a0 secure :-1 s=READY pgs=9 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb770005820 tx=0x7fb77000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:25.654 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.658+0000 7fb7697fa640 1 -- 10.20.193.58:0/1594531681 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb770005540 con 0x7fb77415a8d0 2026-02-23T06:44:25.654 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.658+0000 7fb7697fa640 1 -- 10.20.193.58:0/1594531681 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4913 (secure 0 0 0) 0x7fb770008810 con 0x7fb77415a8d0 2026-02-23T06:44:25.654 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.658+0000 7fb7697fa640 1 -- 10.20.193.58:0/1594531681 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb77415a8d0 msgr2=0x7fb7741334a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:25.654 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.658+0000 7fb7697fa640 1 --2- 10.20.193.58:0/1594531681 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb77415a8d0 0x7fb7741334a0 secure :-1 s=READY pgs=9 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb770005820 tx=0x7fb77000dd10 comp rx=0 tx=0).stop 2026-02-23T06:44:25.654 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.658+0000 7fb7697fa640 1 -- 10.20.193.58:0/1594531681 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb77415a8d0 msgr2=0x7fb7741334a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:44:25.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.658+0000 7fb7697fa640 1 --2- 10.20.193.58:0/1594531681 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb77415a8d0 0x7fb7741334a0 unknown :-1 s=CLOSED pgs=9 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:25.655 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:44:25.655 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:44:25.655 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:44:25.655 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:44:25.655 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 202, 2026-02-23T06:44:25.655 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 15330, 2026-02-23T06:44:25.656 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:44:25.656 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:44:25.656 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:44:25.656 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:44:25.656 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:25.656 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:44:25.656 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:44:25.656 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:44:25.656 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:44:25.656 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:44:25.656 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:44:25.657 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:44:25.657 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:44:25.657 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:44:25.657 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:44:25.657 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:44:25.657 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:44:25.657 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:44:25.657 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:44:25.657 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:44:25.657 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:44:25.657 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:44:25.657 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:25.658 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:44:25.658 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:44:25.658 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:44:25.658 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:44:25.658 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:44:25.658 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:44:25.658 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:44:25.658 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:44:25.658 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:44:25.658 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:44:25.658 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:44:25.658 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:44:25.658 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:44:25.659 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:44:25.659 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:44:25.659 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:25.659 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.659 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:44:25.659 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:44:25.659 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:44:25.659 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:44:25.659 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:44:25.659 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:44:25.659 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:44:25.660 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:44:25.660 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:44:25.660 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:44:25.660 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:44:25.660 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:44:25.660 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:44:25.660 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:44:25.660 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:44:25.660 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:44:25.660 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:44:25.660 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:44:25.660 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:44:25.660 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:44:25.661 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:44:25.661 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:44:25.661 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:44:25.661 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:44:25.661 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:44:25.661 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:44:25.661 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:44:25.661 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:44:25.661 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:44:25.661 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:44:25.662 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:25.662 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:44:25.662 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.662 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:44:25.662 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.662 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:44:25.662 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:44:25.662 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:44:25.662 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:44:25.662 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.662 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:44:25.662 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:44:25.663 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:25.663 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.663 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.663 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:44:25.663 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:44:25.663 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:25.663 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:25.663 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:25.663 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.663 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:44:25.663 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:44:25.663 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:44:25.664 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:44:25.664 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:44:25.664 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:44:25.664 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.664 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.664 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:44:25.664 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:44:25.664 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:44:25.664 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:44:25.664 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.664 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:44:25.664 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:44:25.665 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:25.665 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.665 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.665 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:44:25.665 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:44:25.665 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:25.665 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:25.665 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:25.665 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.665 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:44:25.665 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:44:25.665 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:44:25.666 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:44:25.666 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:44:25.666 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:44:25.666 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.666 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.666 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:44:25.666 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:44:25.666 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:44:25.666 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:44:25.666 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.666 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:44:25.666 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:44:25.666 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:25.667 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.667 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.667 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:44:25.667 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:44:25.667 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:25.667 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:25.667 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:25.667 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.667 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:44:25.667 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:44:25.667 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:44:25.667 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:44:25.667 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:44:25.668 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:44:25.668 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:25.668 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:25.668 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.668 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:44:25.668 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:44:25.668 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.668 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:25.668 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:25.668 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:44:25.668 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:25.668 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:25.669 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:44:25.669 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.669 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:25.669 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:25.669 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:44:25.669 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:25.669 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:25.669 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.669 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:44:25.669 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:44:25.671 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.659+0000 7fb77b1a5640 1 -- 10.20.193.58:0/1594531681 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb74407a3c0 msgr2=0x7fb74409a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:25.671 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.659+0000 7fb77b1a5640 1 --2- 10.20.193.58:0/1594531681 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb74407a3c0 0x7fb74409a870 secure :-1 s=READY pgs=492 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb764004740 tx=0x7fb76403a030 comp rx=0 tx=0).stop 2026-02-23T06:44:25.671 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.659+0000 7fb77b1a5640 1 -- 10.20.193.58:0/1594531681 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7740b1540 msgr2=0x7fb774164ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:25.671 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.659+0000 7fb77b1a5640 1 --2- 10.20.193.58:0/1594531681 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7740b1540 0x7fb774164ca0 secure :-1 s=READY pgs=7 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb75c00c4b0 tx=0x7fb75c00c980 comp rx=0 tx=0).stop 2026-02-23T06:44:25.671 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.659+0000 7fb77971b640 1 -- 10.20.193.58:0/1594531681 reap_dead start 2026-02-23T06:44:25.671 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.659+0000 7fb77971b640 1 -- 10.20.193.58:0/1594531681 reap_dead start 2026-02-23T06:44:25.672 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.659+0000 7fb77b1a5640 1 -- 10.20.193.58:0/1594531681 shutdown_connections 2026-02-23T06:44:25.672 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.659+0000 7fb77b1a5640 1 -- 10.20.193.58:0/1594531681 >> 10.20.193.58:0/1594531681 conn(0x7fb774058e50 msgr2=0x7fb774161360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:25.672 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.659+0000 7fb77b1a5640 1 -- 10.20.193.58:0/1594531681 shutdown_connections 2026-02-23T06:44:25.672 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.659+0000 7fb77b1a5640 1 -- 10.20.193.58:0/1594531681 wait complete. 2026-02-23T06:44:25.672 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:44:25.672 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:44:25.673 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:44:25.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.802+0000 7f286ae5b640 1 -- 10.20.193.58:0/3780853099 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f286415d4d0 msgr2=0x7f28640b1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:25.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.802+0000 7f286ae5b640 1 --2- 10.20.193.58:0/3780853099 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f286415d4d0 0x7f28640b1480 secure :-1 s=READY pgs=41 gs=2 cs=0 l=1 c_cookie=6693026958356565046 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28640623e0 tx=0x7f284c02f300 comp rx=0 tx=0).stop 2026-02-23T06:44:25.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.803+0000 7f286ae5b640 1 -- 10.20.193.58:0/3780853099 shutdown_connections 2026-02-23T06:44:25.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.803+0000 7f286ae5b640 1 --2- 10.20.193.58:0/3780853099 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f28640b58a0 0x7f2864163360 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:25.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.803+0000 7f286ae5b640 1 --2- 10.20.193.58:0/3780853099 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f286415d4d0 0x7f28640b1480 unknown :-1 s=CLOSED pgs=41 gs=2 cs=0 l=1 c_cookie=6693026958356565046 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:25.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.803+0000 7f286ae5b640 1 --2- 10.20.193.58:0/3780853099 >> v2:10.20.193.58:3300/0 conn(0x7f286415d100 0x7f28640b0f40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:25.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.803+0000 7f286ae5b640 1 -- 10.20.193.58:0/3780853099 >> 10.20.193.58:0/3780853099 conn(0x7f2864058e50 msgr2=0x7f2864059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:25.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.803+0000 7f286ae5b640 1 -- 10.20.193.58:0/3780853099 shutdown_connections 2026-02-23T06:44:25.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.803+0000 7f286ae5b640 1 -- 10.20.193.58:0/3780853099 wait complete. 2026-02-23T06:44:25.800 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.804+0000 7f286ae5b640 1 Processor -- start 2026-02-23T06:44:25.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.804+0000 7f286ae5b640 1 -- start start 2026-02-23T06:44:25.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.804+0000 7f286ae5b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f28640b58a0 0x7f28640aecb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:25.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.804+0000 7f286ae5b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f286415d100 0x7f28640b7360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:25.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.804+0000 7f286ae5b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f286415d4d0 0x7f286415c1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:25.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.804+0000 7f286ae5b640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f286405cd20 con 0x7f286415d4d0 2026-02-23T06:44:25.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.804+0000 7f286ae5b640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f2864157800 con 0x7f286415d100 2026-02-23T06:44:25.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.804+0000 7f286ae5b640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f286405ca40 con 0x7f28640b58a0 2026-02-23T06:44:25.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.805+0000 7f2868bd0640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f28640b58a0 0x7f28640aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:25.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.805+0000 7f2868bd0640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f28640b58a0 0x7f28640aecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:49700/0 (socket says 10.20.193.58:49700) 2026-02-23T06:44:25.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.805+0000 7f285bfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f286415d100 0x7f28640b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:25.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.805+0000 7f2868bd0640 1 -- 10.20.193.58:0/2141346750 learned_addr learned my addr 10.20.193.58:0/2141346750 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:44:25.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.805+0000 7f28693d1640 1 --2- 10.20.193.58:0/2141346750 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f286415d4d0 0x7f286415c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:25.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.805+0000 7f2868bd0640 1 -- 10.20.193.58:0/2141346750 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f286415d100 msgr2=0x7f28640b7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:25.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.805+0000 7f2868bd0640 1 --2- 10.20.193.58:0/2141346750 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f286415d100 0x7f28640b7360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:25.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.805+0000 7f2868bd0640 1 -- 10.20.193.58:0/2141346750 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f286415d4d0 msgr2=0x7f286415c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:25.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.805+0000 7f2868bd0640 1 --2- 10.20.193.58:0/2141346750 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f286415d4d0 0x7f286415c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:25.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.805+0000 7f2868bd0640 1 -- 10.20.193.58:0/2141346750 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28540094b0 con 0x7f28640b58a0 2026-02-23T06:44:25.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.805+0000 7f2868bd0640 1 --2- 10.20.193.58:0/2141346750 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f28640b58a0 0x7f28640aecb0 secure :-1 s=READY pgs=60 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2854009fd0 tx=0x7f2854002bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:25.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.805+0000 7f28597fa640 1 -- 10.20.193.58:0/2141346750 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f285400ed60 con 0x7f28640b58a0 2026-02-23T06:44:25.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.805+0000 7f28597fa640 1 -- 10.20.193.58:0/2141346750 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2854002e20 con 0x7f28640b58a0 2026-02-23T06:44:25.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.805+0000 7f286ae5b640 1 -- 10.20.193.58:0/2141346750 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f284c009570 con 0x7f28640b58a0 2026-02-23T06:44:25.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.805+0000 7f28597fa640 1 -- 10.20.193.58:0/2141346750 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f28540106b0 con 0x7f28640b58a0 2026-02-23T06:44:25.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.805+0000 7f286ae5b640 1 -- 10.20.193.58:0/2141346750 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f286405e710 con 0x7f28640b58a0 2026-02-23T06:44:25.804 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.806+0000 7f286ae5b640 1 --2- 10.20.193.58:0/2141346750 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f28240041f0 0x7f28240246a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:25.804 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.806+0000 7f286ae5b640 1 -- 10.20.193.58:0/2141346750 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f2824025f20 con 0x7f28240041f0 2026-02-23T06:44:25.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.806+0000 7f285bfff640 1 --2- 10.20.193.58:0/2141346750 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f28240041f0 0x7f28240246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:25.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.807+0000 7f285bfff640 1 -- 10.20.193.58:0/2141346750 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f28240260e0 con 0x7f28240041f0 2026-02-23T06:44:25.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.807+0000 7f285bfff640 1 --2- 10.20.193.58:0/2141346750 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f28240041f0 0x7f28240246a0 secure :-1 s=READY pgs=42 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f286415d8d0 tx=0x7f284c005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:25.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.807+0000 7f28597fa640 1 -- 10.20.193.58:0/2141346750 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f284c03c040 con 0x7f28240041f0 2026-02-23T06:44:25.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.807+0000 7f28597fa640 1 -- 10.20.193.58:0/2141346750 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f2854016020 con 0x7f28640b58a0 2026-02-23T06:44:25.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.808+0000 7f28597fa640 1 --2- 10.20.193.58:0/2141346750 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f283407a660 0x7f283409ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:25.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.808+0000 7f28597fa640 1 -- 10.20.193.58:0/2141346750 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f285409dc50 con 0x7f28640b58a0 2026-02-23T06:44:25.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.808+0000 7f28693d1640 1 --2- 10.20.193.58:0/2141346750 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f283407a660 0x7f283409ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:25.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.808+0000 7f28597fa640 1 -- 10.20.193.58:0/2141346750 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f284c004850 con 0x7f28240041f0 2026-02-23T06:44:25.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.808+0000 7f28597fa640 1 -- 10.20.193.58:0/2141346750 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f28240041f0 msgr2=0x7f28240246a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:25.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.808+0000 7f28597fa640 1 --2- 10.20.193.58:0/2141346750 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f28240041f0 0x7f28240246a0 secure :-1 s=READY pgs=42 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f286415d8d0 tx=0x7f284c005bd0 comp rx=0 tx=0).stop 2026-02-23T06:44:25.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.808+0000 7f28597fa640 1 -- 10.20.193.58:0/2141346750 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f28240041f0 msgr2=0x7f28240246a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:44:25.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.808+0000 7f28597fa640 1 --2- 10.20.193.58:0/2141346750 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f28240041f0 0x7f28240246a0 unknown :-1 s=CLOSED pgs=42 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:25.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.809+0000 7f28693d1640 1 --2- 10.20.193.58:0/2141346750 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f283407a660 0x7f283409ab10 secure :-1 s=READY pgs=493 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f285c005820 tx=0x7f285c00a310 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:25.807 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.812+0000 7f286ae5b640 1 --2- 10.20.193.58:0/2141346750 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2824002e40 0x7f28240032c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:25.807 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.812+0000 7f286ae5b640 1 -- 10.20.193.58:0/2141346750 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f28240039c0 con 0x7f2824002e40 2026-02-23T06:44:25.807 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.812+0000 7f285bfff640 1 --2- 10.20.193.58:0/2141346750 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2824002e40 0x7f28240032c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:25.807 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.812+0000 7f285bfff640 1 -- 10.20.193.58:0/2141346750 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2824003b80 con 0x7f2824002e40 2026-02-23T06:44:25.808 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.813+0000 7f285bfff640 1 --2- 10.20.193.58:0/2141346750 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2824002e40 0x7f28240032c0 secure :-1 s=READY pgs=43 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28640623e0 tx=0x7f284c009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:25.808 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.813+0000 7f28597fa640 1 -- 10.20.193.58:0/2141346750 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f284c045e40 con 0x7f2824002e40 2026-02-23T06:44:25.808 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.813+0000 7f28597fa640 1 -- 10.20.193.58:0/2141346750 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5245 (secure 0 0 0) 0x7f284c050070 con 0x7f2824002e40 2026-02-23T06:44:25.808 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.813+0000 7f28597fa640 1 -- 10.20.193.58:0/2141346750 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2824002e40 msgr2=0x7f28240032c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:25.809 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.813+0000 7f28597fa640 1 --2- 10.20.193.58:0/2141346750 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2824002e40 0x7f28240032c0 secure :-1 s=READY pgs=43 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28640623e0 tx=0x7f284c009310 comp rx=0 tx=0).stop 2026-02-23T06:44:25.809 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.813+0000 7f28597fa640 1 -- 10.20.193.58:0/2141346750 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2824002e40 msgr2=0x7f28240032c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:44:25.809 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.813+0000 7f28597fa640 1 --2- 10.20.193.58:0/2141346750 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2824002e40 0x7f28240032c0 secure :-1 s=CLOSED pgs=43 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28640623e0 tx=0x7f284c009310 comp rx=0 tx=0).stop 2026-02-23T06:44:25.809 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:44:25.809 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:44:25.809 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:44:25.809 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:44:25.810 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 202, 2026-02-23T06:44:25.810 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 67887, 2026-02-23T06:44:25.810 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:44:25.810 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:44:25.810 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:44:25.810 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:44:25.810 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:25.810 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:44:25.810 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:44:25.810 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:44:25.810 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:44:25.811 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:44:25.811 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:44:25.811 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:44:25.811 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:44:25.811 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:44:25.811 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:44:25.811 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:44:25.811 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:44:25.811 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:44:25.811 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:44:25.811 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:44:25.811 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:44:25.812 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:44:25.812 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:25.812 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:44:25.812 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:44:25.812 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:44:25.812 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:44:25.812 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:44:25.812 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:44:25.812 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:44:25.812 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:44:25.812 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:44:25.812 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:44:25.813 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:44:25.813 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:44:25.813 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:44:25.813 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:44:25.813 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:44:25.813 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:25.813 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.813 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:44:25.813 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:44:25.813 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:44:25.813 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:44:25.813 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:44:25.814 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:44:25.814 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:44:25.814 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:44:25.814 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:44:25.814 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:44:25.814 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:44:25.814 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:44:25.814 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:44:25.814 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:44:25.814 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:44:25.814 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:44:25.814 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:44:25.815 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:44:25.815 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:44:25.815 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:44:25.815 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:44:25.815 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:44:25.815 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:44:25.815 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:44:25.815 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:44:25.815 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:44:25.815 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:44:25.815 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:44:25.815 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:44:25.816 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:44:25.816 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:25.816 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:44:25.816 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.816 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:44:25.816 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.816 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:44:25.816 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:44:25.816 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:44:25.816 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:44:25.816 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.816 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:44:25.816 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:44:25.817 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:25.817 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.817 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.817 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:44:25.817 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:44:25.817 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:25.817 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:25.817 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:25.817 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.817 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:44:25.817 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:44:25.817 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:44:25.817 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:44:25.818 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:44:25.818 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:44:25.818 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.818 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.818 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:44:25.818 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:44:25.818 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:44:25.818 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:44:25.818 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.818 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:44:25.818 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:44:25.818 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:25.818 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.819 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.819 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:44:25.819 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:44:25.819 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:25.819 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:25.819 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:25.819 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.819 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:44:25.819 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:44:25.819 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:44:25.819 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:44:25.819 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:44:25.820 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:44:25.820 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.820 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.820 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:44:25.820 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:44:25.820 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:44:25.820 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:44:25.820 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.820 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:44:25.820 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:44:25.820 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:25.820 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.820 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.821 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:44:25.821 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:44:25.821 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:25.821 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:25.821 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:25.821 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.821 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:44:25.821 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:44:25.821 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:44:25.821 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:44:25.821 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:44:25.821 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:44:25.822 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:25.822 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:25.822 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.822 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:44:25.822 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:44:25.822 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.822 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:25.822 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:25.822 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:44:25.822 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:25.822 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:25.822 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:44:25.822 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.823 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:25.823 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:25.823 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:44:25.823 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:25.823 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:25.823 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:44:25.823 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.823 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:25.823 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:25.823 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:44:25.823 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:25.823 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:25.824 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:44:25.824 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.824 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:25.824 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:25.824 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:44:25.824 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:25.824 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:25.824 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.824 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:44:25.824 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:44:25.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.813+0000 7f286ae5b640 1 -- 10.20.193.58:0/2141346750 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f283407a660 msgr2=0x7f283409ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:25.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.813+0000 7f286ae5b640 1 --2- 10.20.193.58:0/2141346750 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f283407a660 0x7f283409ab10 secure :-1 s=READY pgs=493 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f285c005820 tx=0x7f285c00a310 comp rx=0 tx=0).stop 2026-02-23T06:44:25.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.813+0000 7f286ae5b640 1 -- 10.20.193.58:0/2141346750 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f28640b58a0 msgr2=0x7f28640aecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:25.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.813+0000 7f286ae5b640 1 --2- 10.20.193.58:0/2141346750 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f28640b58a0 0x7f28640aecb0 secure :-1 s=READY pgs=60 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2854009fd0 tx=0x7f2854002bc0 comp rx=0 tx=0).stop 2026-02-23T06:44:25.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.813+0000 7f28693d1640 1 -- 10.20.193.58:0/2141346750 reap_dead start 2026-02-23T06:44:25.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.813+0000 7f28693d1640 1 -- 10.20.193.58:0/2141346750 reap_dead start 2026-02-23T06:44:25.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.813+0000 7f286ae5b640 1 -- 10.20.193.58:0/2141346750 shutdown_connections 2026-02-23T06:44:25.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.813+0000 7f286ae5b640 1 -- 10.20.193.58:0/2141346750 >> 10.20.193.58:0/2141346750 conn(0x7f2864058e50 msgr2=0x7f28640ae1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:25.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.813+0000 7f286ae5b640 1 -- 10.20.193.58:0/2141346750 shutdown_connections 2026-02-23T06:44:25.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.813+0000 7f286ae5b640 1 -- 10.20.193.58:0/2141346750 wait complete. 2026-02-23T06:44:25.827 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:44:25.827 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:44:25.827 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:44:25.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.955+0000 7f308ac43640 1 -- 10.20.193.58:0/1028533016 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f308415c4b0 msgr2=0x7f3084058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:25.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.955+0000 7f308ac43640 1 --2- 10.20.193.58:0/1028533016 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f308415c4b0 0x7f3084058200 secure :-1 s=READY pgs=11 gs=2 cs=0 l=1 c_cookie=8612011104432694059 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3074005e70 tx=0x7f307402f290 comp rx=0 tx=0).stop 2026-02-23T06:44:25.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.955+0000 7f308ac43640 1 -- 10.20.193.58:0/1028533016 shutdown_connections 2026-02-23T06:44:25.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.955+0000 7f308ac43640 1 --2- 10.20.193.58:0/1028533016 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3084056960 0x7f30840b6720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:25.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.955+0000 7f308ac43640 1 --2- 10.20.193.58:0/1028533016 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f308415c4b0 0x7f3084058200 unknown :-1 s=CLOSED pgs=11 gs=2 cs=0 l=1 c_cookie=8612011104432694059 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:25.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.955+0000 7f308ac43640 1 -- 10.20.193.58:0/1028533016 >> 10.20.193.58:0/1028533016 conn(0x7f30840b3c20 msgr2=0x7f30840b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:25.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.955+0000 7f308ac43640 1 -- 10.20.193.58:0/1028533016 shutdown_connections 2026-02-23T06:44:25.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.955+0000 7f308ac43640 1 -- 10.20.193.58:0/1028533016 wait complete. 2026-02-23T06:44:25.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.956+0000 7f308ac43640 1 Processor -- start 2026-02-23T06:44:25.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.956+0000 7f308ac43640 1 -- start start 2026-02-23T06:44:25.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.957+0000 7f308ac43640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3084056960 0x7f30840b0250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:25.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.957+0000 7f308ac43640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f308415c4b0 0x7f3084142190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:25.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.957+0000 7f308ac43640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3084162ca0 0x7f308415b590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:25.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.957+0000 7f308ac43640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f30841fe360 con 0x7f3084162ca0 2026-02-23T06:44:25.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.957+0000 7f308ac43640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f30840b0790 con 0x7f308415c4b0 2026-02-23T06:44:25.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.957+0000 7f308ac43640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f30840af680 con 0x7f3084056960 2026-02-23T06:44:25.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.957+0000 7f308a442640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3084162ca0 0x7f308415b590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:25.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.957+0000 7f308a442640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3084162ca0 0x7f308415b590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:49942/0 (socket says 10.20.193.58:49942) 2026-02-23T06:44:25.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.957+0000 7f308a442640 1 -- 10.20.193.58:0/3599382954 learned_addr learned my addr 10.20.193.58:0/3599382954 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:44:25.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.957+0000 7f3089c41640 1 --2- 10.20.193.58:0/3599382954 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3084056960 0x7f30840b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:25.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.958+0000 7f3089440640 1 --2- 10.20.193.58:0/3599382954 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f308415c4b0 0x7f3084142190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:25.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.958+0000 7f308a442640 1 -- 10.20.193.58:0/3599382954 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3084056960 msgr2=0x7f30840b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:25.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.958+0000 7f308a442640 1 --2- 10.20.193.58:0/3599382954 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f3084056960 0x7f30840b0250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:25.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.958+0000 7f308a442640 1 -- 10.20.193.58:0/3599382954 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f308415c4b0 msgr2=0x7f3084142190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:25.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.958+0000 7f308a442640 1 --2- 10.20.193.58:0/3599382954 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f308415c4b0 0x7f3084142190 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:25.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.958+0000 7f308a442640 1 -- 10.20.193.58:0/3599382954 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3074009570 con 0x7f3084162ca0 2026-02-23T06:44:25.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.958+0000 7f308a442640 1 --2- 10.20.193.58:0/3599382954 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3084162ca0 0x7f308415b590 secure :-1 s=READY pgs=12 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f308000d550 tx=0x7f308000da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:25.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.958+0000 7f30727fc640 1 -- 10.20.193.58:0/3599382954 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3080007b90 con 0x7f3084162ca0 2026-02-23T06:44:25.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.958+0000 7f308ac43640 1 -- 10.20.193.58:0/3599382954 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30840b0af0 con 0x7f3084162ca0 2026-02-23T06:44:25.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.958+0000 7f308ac43640 1 -- 10.20.193.58:0/3599382954 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30840b0d40 con 0x7f3084162ca0 2026-02-23T06:44:25.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.958+0000 7f30727fc640 1 -- 10.20.193.58:0/3599382954 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3080007de0 con 0x7f3084162ca0 2026-02-23T06:44:25.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.958+0000 7f30727fc640 1 -- 10.20.193.58:0/3599382954 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3080006260 con 0x7f3084162ca0 2026-02-23T06:44:25.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.959+0000 7f308ac43640 1 --2- 10.20.193.58:0/3599382954 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f308415bad0 0x7f30840aefd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:25.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.959+0000 7f308ac43640 1 -- 10.20.193.58:0/3599382954 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f30840af510 con 0x7f308415bad0 2026-02-23T06:44:25.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.959+0000 7f3089c41640 1 --2- 10.20.193.58:0/3599382954 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f308415bad0 0x7f30840aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:25.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.960+0000 7f3089c41640 1 -- 10.20.193.58:0/3599382954 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3084059690 con 0x7f308415bad0 2026-02-23T06:44:25.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.960+0000 7f3089c41640 1 --2- 10.20.193.58:0/3599382954 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f308415bad0 0x7f30840aefd0 secure :-1 s=READY pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3074004740 tx=0x7f3074004660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:25.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.960+0000 7f30727fc640 1 -- 10.20.193.58:0/3599382954 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3074002c90 con 0x7f308415bad0 2026-02-23T06:44:25.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.960+0000 7f30727fc640 1 -- 10.20.193.58:0/3599382954 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f308001a030 con 0x7f3084162ca0 2026-02-23T06:44:25.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.961+0000 7f30727fc640 1 --2- 10.20.193.58:0/3599382954 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f305407a660 0x7f305409ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:25.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.962+0000 7f30727fc640 1 -- 10.20.193.58:0/3599382954 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f308009ddb0 con 0x7f3084162ca0 2026-02-23T06:44:25.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.962+0000 7f30727fc640 1 -- 10.20.193.58:0/3599382954 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f3074038470 con 0x7f308415bad0 2026-02-23T06:44:25.959 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.962+0000 7f30727fc640 1 -- 10.20.193.58:0/3599382954 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f308415bad0 msgr2=0x7f30840aefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:25.959 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.962+0000 7f30727fc640 1 --2- 10.20.193.58:0/3599382954 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f308415bad0 0x7f30840aefd0 secure :-1 s=READY pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3074004740 tx=0x7f3074004660 comp rx=0 tx=0).stop 2026-02-23T06:44:25.959 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.962+0000 7f30727fc640 1 -- 10.20.193.58:0/3599382954 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f308415bad0 msgr2=0x7f30840aefd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:44:25.959 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.962+0000 7f30727fc640 1 --2- 10.20.193.58:0/3599382954 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f308415bad0 0x7f30840aefd0 unknown :-1 s=CLOSED pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:25.959 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.962+0000 7f3089440640 1 --2- 10.20.193.58:0/3599382954 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f305407a660 0x7f305409ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:25.959 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.963+0000 7f3089440640 1 --2- 10.20.193.58:0/3599382954 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f305407a660 0x7f305409ab10 secure :-1 s=READY pgs=494 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30841fafd0 tx=0x7f3078005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:25.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.965+0000 7f308ac43640 1 --2- 10.20.193.58:0/3599382954 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f308413f050 0x7f30841414b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:25.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.965+0000 7f308ac43640 1 -- 10.20.193.58:0/3599382954 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f308415c880 con 0x7f308413f050 2026-02-23T06:44:25.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.965+0000 7f3089c41640 1 --2- 10.20.193.58:0/3599382954 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f308413f050 0x7f30841414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:25.961 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.966+0000 7f3089c41640 1 -- 10.20.193.58:0/3599382954 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f30841fe080 con 0x7f308413f050 2026-02-23T06:44:25.962 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.966+0000 7f3089c41640 1 --2- 10.20.193.58:0/3599382954 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f308413f050 0x7f30841414b0 secure :-1 s=READY pgs=62 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3074004740 tx=0x7f3074009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:25.962 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.967+0000 7f30727fc640 1 -- 10.20.193.58:0/3599382954 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3074054410 con 0x7f308413f050 2026-02-23T06:44:25.962 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.967+0000 7f30727fc640 1 -- 10.20.193.58:0/3599382954 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5556 (secure 0 0 0) 0x7f3074043400 con 0x7f308413f050 2026-02-23T06:44:25.962 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.967+0000 7f30727fc640 1 -- 10.20.193.58:0/3599382954 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f308413f050 msgr2=0x7f30841414b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:25.962 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.967+0000 7f30727fc640 1 --2- 10.20.193.58:0/3599382954 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f308413f050 0x7f30841414b0 secure :-1 s=READY pgs=62 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3074004740 tx=0x7f3074009310 comp rx=0 tx=0).stop 2026-02-23T06:44:25.962 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.967+0000 7f30727fc640 1 -- 10.20.193.58:0/3599382954 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f308413f050 msgr2=0x7f30841414b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:44:25.963 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.967+0000 7f30727fc640 1 --2- 10.20.193.58:0/3599382954 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f308413f050 0x7f30841414b0 secure :-1 s=CLOSED pgs=62 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3074004740 tx=0x7f3074009310 comp rx=0 tx=0).stop 2026-02-23T06:44:25.963 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:44:25.963 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:44:25.963 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:44:25.963 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:44:25.963 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 202, 2026-02-23T06:44:25.963 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 119395, 2026-02-23T06:44:25.964 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:44:25.964 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:44:25.964 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:44:25.964 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:44:25.964 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:25.964 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:44:25.964 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:44:25.964 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:44:25.964 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:44:25.964 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:44:25.964 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:44:25.964 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:44:25.965 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:44:25.965 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:44:25.965 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:44:25.965 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:44:25.965 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:44:25.965 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:44:25.965 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:44:25.965 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:44:25.965 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:44:25.965 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:44:25.965 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:25.966 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:44:25.966 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:44:25.966 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:44:25.966 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:44:25.966 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:44:25.966 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:44:25.966 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:44:25.966 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:44:25.966 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:44:25.966 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:44:25.966 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:44:25.966 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:44:25.966 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:44:25.967 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:44:25.967 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:44:25.967 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:25.967 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.967 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:44:25.967 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:44:25.967 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:44:25.967 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:44:25.967 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:44:25.967 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:44:25.967 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:44:25.967 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:44:25.968 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:44:25.968 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:44:25.968 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:44:25.968 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:44:25.968 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:44:25.968 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:44:25.968 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:44:25.968 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:44:25.968 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:44:25.968 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:44:25.968 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:44:25.968 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:44:25.969 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:44:25.969 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:44:25.969 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:44:25.969 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:44:25.969 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:44:25.969 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:44:25.969 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:44:25.969 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:44:25.969 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:44:25.969 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:44:25.969 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:25.969 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:44:25.970 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.970 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:44:25.970 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.970 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:44:25.970 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:44:25.970 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:44:25.970 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:44:25.970 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.970 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:44:25.970 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:44:25.970 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:25.970 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.970 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.971 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:44:25.971 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:44:25.971 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:25.971 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:25.971 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:25.971 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.971 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:44:25.971 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:44:25.971 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:44:25.971 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:44:25.971 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:44:25.971 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:44:25.972 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.972 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.972 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:44:25.972 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:44:25.972 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:44:25.972 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:44:25.972 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.972 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:44:25.972 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:44:25.972 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:25.972 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.972 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.973 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:44:25.973 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:44:25.973 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:25.973 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:25.973 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:25.973 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.973 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:44:25.973 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:44:25.973 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:44:25.973 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:44:25.973 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:44:25.973 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:44:25.973 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.974 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.974 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:44:25.974 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:44:25.974 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:44:25.974 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:44:25.974 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.974 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:44:25.974 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:44:25.974 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:25.974 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.974 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.974 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:44:25.975 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:44:25.975 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:25.975 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:25.975 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:25.975 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.975 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:44:25.975 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:44:25.975 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:44:25.975 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:44:25.975 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:44:25.975 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:44:25.975 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:25.975 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:25.976 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.976 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:44:25.976 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:44:25.976 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.976 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:25.976 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:25.976 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:44:25.976 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:25.976 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:25.976 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:44:25.976 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.976 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:25.977 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:25.977 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:44:25.977 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:25.977 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:25.977 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:44:25.977 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.977 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:25.977 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:25.977 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:44:25.977 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:25.977 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:25.977 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:44:25.977 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.978 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:44:25.978 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:44:25.978 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:44:25.978 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.978 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.978 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:25.978 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:25.978 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:44:25.978 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:25.978 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:25.978 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:44:25.979 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:25.979 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:25.979 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:25.979 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:44:25.979 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:25.979 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:25.979 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:25.979 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:44:25.979 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:44:25.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.967+0000 7f308ac43640 1 -- 10.20.193.58:0/3599382954 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f305407a660 msgr2=0x7f305409ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:25.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.967+0000 7f308ac43640 1 --2- 10.20.193.58:0/3599382954 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f305407a660 0x7f305409ab10 secure :-1 s=READY pgs=494 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30841fafd0 tx=0x7f3078005f90 comp rx=0 tx=0).stop 2026-02-23T06:44:25.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.967+0000 7f308ac43640 1 -- 10.20.193.58:0/3599382954 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3084162ca0 msgr2=0x7f308415b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:25.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.967+0000 7f308ac43640 1 --2- 10.20.193.58:0/3599382954 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f3084162ca0 0x7f308415b590 secure :-1 s=READY pgs=12 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f308000d550 tx=0x7f308000da20 comp rx=0 tx=0).stop 2026-02-23T06:44:25.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.967+0000 7f308a442640 1 -- 10.20.193.58:0/3599382954 reap_dead start 2026-02-23T06:44:25.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.967+0000 7f308a442640 1 -- 10.20.193.58:0/3599382954 reap_dead start 2026-02-23T06:44:25.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.967+0000 7f308ac43640 1 -- 10.20.193.58:0/3599382954 shutdown_connections 2026-02-23T06:44:25.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.967+0000 7f308ac43640 1 -- 10.20.193.58:0/3599382954 >> 10.20.193.58:0/3599382954 conn(0x7f30840b3c20 msgr2=0x7f30840b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:25.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.967+0000 7f308ac43640 1 -- 10.20.193.58:0/3599382954 shutdown_connections 2026-02-23T06:44:25.982 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:25.967+0000 7f308ac43640 1 -- 10.20.193.58:0/3599382954 wait complete. 2026-02-23T06:44:25.982 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:44:25.982 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:44:25.982 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:44:26.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.111+0000 7f13c3fff640 1 -- 10.20.193.58:0/1556649499 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f13c4056550 msgr2=0x7f13c405ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:26.107 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.111+0000 7f13c3fff640 1 --2- 10.20.193.58:0/1556649499 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f13c4056550 0x7f13c405ce30 secure :-1 s=READY pgs=63 gs=3 cs=0 l=1 c_cookie=3387544587063508014 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13ac009890 tx=0x7f13ac02f200 comp rx=0 tx=0).stop 2026-02-23T06:44:26.107 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.111+0000 7f13c3fff640 1 -- 10.20.193.58:0/1556649499 shutdown_connections 2026-02-23T06:44:26.107 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.111+0000 7f13c3fff640 1 --2- 10.20.193.58:0/1556649499 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f13c4056550 0x7f13c405ce30 unknown :-1 s=CLOSED pgs=63 gs=3 cs=0 l=1 c_cookie=3387544587063508014 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:26.107 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.111+0000 7f13c3fff640 1 -- 10.20.193.58:0/1556649499 >> 10.20.193.58:0/1556649499 conn(0x7f13c40b3c20 msgr2=0x7f13c40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:26.107 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.111+0000 7f13c3fff640 1 -- 10.20.193.58:0/1556649499 shutdown_connections 2026-02-23T06:44:26.107 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.111+0000 7f13c3fff640 1 -- 10.20.193.58:0/1556649499 wait complete. 2026-02-23T06:44:26.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.112+0000 7f13c3fff640 1 Processor -- start 2026-02-23T06:44:26.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.113+0000 7f13c3fff640 1 -- start start 2026-02-23T06:44:26.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.113+0000 7f13c3fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f13c4056550 0x7f13c413acd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:26.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.113+0000 7f13c3fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f13c405d370 0x7f13c4138940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:26.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.113+0000 7f13c3fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f13c415c040 0x7f13c4138e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:26.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.113+0000 7f13c3fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f13c41382d0 con 0x7f13c405d370 2026-02-23T06:44:26.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.113+0000 7f13c3fff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f13c4137d50 con 0x7f13c415c040 2026-02-23T06:44:26.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.113+0000 7f13c3fff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f13c4137ff0 con 0x7f13c4056550 2026-02-23T06:44:26.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.113+0000 7f13c27fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f13c405d370 0x7f13c4138940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:26.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.113+0000 7f13c2ffd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f13c4056550 0x7f13c413acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:26.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.113+0000 7f13c27fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f13c405d370 0x7f13c4138940 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:49958/0 (socket says 10.20.193.58:49958) 2026-02-23T06:44:26.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.113+0000 7f13c27fc640 1 -- 10.20.193.58:0/2034514846 learned_addr learned my addr 10.20.193.58:0/2034514846 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:44:26.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.113+0000 7f13c37fe640 1 --2- 10.20.193.58:0/2034514846 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f13c415c040 0x7f13c4138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:26.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.114+0000 7f13c27fc640 1 -- 10.20.193.58:0/2034514846 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f13c4056550 msgr2=0x7f13c413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:26.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.114+0000 7f13c27fc640 1 --2- 10.20.193.58:0/2034514846 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f13c4056550 0x7f13c413acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:26.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.114+0000 7f13c27fc640 1 -- 10.20.193.58:0/2034514846 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f13c415c040 msgr2=0x7f13c4138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:26.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.114+0000 7f13c27fc640 1 --2- 10.20.193.58:0/2034514846 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f13c415c040 0x7f13c4138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:26.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.114+0000 7f13c27fc640 1 -- 10.20.193.58:0/2034514846 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13ac0094b0 con 0x7f13c405d370 2026-02-23T06:44:26.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.114+0000 7f13c27fc640 1 --2- 10.20.193.58:0/2034514846 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f13c405d370 0x7f13c4138940 secure :-1 s=READY pgs=14 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13ac0023d0 tx=0x7f13ac002950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:26.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.114+0000 7f13a37fe640 1 -- 10.20.193.58:0/2034514846 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f13ac005d40 con 0x7f13c405d370 2026-02-23T06:44:26.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.114+0000 7f13a37fe640 1 -- 10.20.193.58:0/2034514846 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13ac038560 con 0x7f13c405d370 2026-02-23T06:44:26.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.114+0000 7f13a37fe640 1 -- 10.20.193.58:0/2034514846 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f13ac038990 con 0x7f13c405d370 2026-02-23T06:44:26.112 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.114+0000 7f13c3fff640 1 -- 10.20.193.58:0/2034514846 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c41363b0 con 0x7f13c405d370 2026-02-23T06:44:26.112 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.114+0000 7f13c3fff640 1 -- 10.20.193.58:0/2034514846 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c40592a0 con 0x7f13c405d370 2026-02-23T06:44:26.112 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.115+0000 7f13c3fff640 1 -- 10.20.193.58:0/2034514846 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13c41361f0 con 0x7f13c405d370 2026-02-23T06:44:26.112 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.116+0000 7f13a37fe640 1 -- 10.20.193.58:0/2034514846 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f13ac038af0 con 0x7f13c405d370 2026-02-23T06:44:26.112 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.117+0000 7f13a37fe640 1 --2- 10.20.193.58:0/2034514846 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f139007a6c0 0x7f139009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:26.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.117+0000 7f13a37fe640 1 -- 10.20.193.58:0/2034514846 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f13ac0c3650 con 0x7f13c405d370 2026-02-23T06:44:26.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.118+0000 7f13c2ffd640 1 --2- 10.20.193.58:0/2034514846 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f139007a6c0 0x7f139009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:26.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.118+0000 7f13a37fe640 1 -- 10.20.193.58:0/2034514846 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f13ac0869b0 con 0x7f13c405d370 2026-02-23T06:44:26.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.118+0000 7f13c2ffd640 1 --2- 10.20.193.58:0/2034514846 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f139007a6c0 0x7f139009ab70 secure :-1 s=READY pgs=495 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13b80026a0 tx=0x7f13b80026d0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:26.273 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.278+0000 7f13c3fff640 1 -- 10.20.193.58:0/2034514846 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f13c405ce30 con 0x7f13c405d370 2026-02-23T06:44:26.274 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.279+0000 7f13a37fe640 1 -- 10.20.193.58:0/2034514846 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f13ac089ad0 con 0x7f13c405d370 2026-02-23T06:44:26.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.281+0000 7f13c3fff640 1 -- 10.20.193.58:0/2034514846 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f139007a6c0 msgr2=0x7f139009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:26.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.281+0000 7f13c3fff640 1 --2- 10.20.193.58:0/2034514846 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f139007a6c0 0x7f139009ab70 secure :-1 s=READY pgs=495 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13b80026a0 tx=0x7f13b80026d0 comp rx=0 tx=0).stop 2026-02-23T06:44:26.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.281+0000 7f13c3fff640 1 -- 10.20.193.58:0/2034514846 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f13c405d370 msgr2=0x7f13c4138940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:26.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.281+0000 7f13c3fff640 1 --2- 10.20.193.58:0/2034514846 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f13c405d370 0x7f13c4138940 secure :-1 s=READY pgs=14 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13ac0023d0 tx=0x7f13ac002950 comp rx=0 tx=0).stop 2026-02-23T06:44:26.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.282+0000 7f13c3fff640 1 -- 10.20.193.58:0/2034514846 shutdown_connections 2026-02-23T06:44:26.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.282+0000 7f13c3fff640 1 --2- 10.20.193.58:0/2034514846 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f139007a6c0 0x7f139009ab70 unknown :-1 s=CLOSED pgs=495 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:26.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.282+0000 7f13c3fff640 1 --2- 10.20.193.58:0/2034514846 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f13c415c040 0x7f13c4138e80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:26.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.282+0000 7f13c3fff640 1 --2- 10.20.193.58:0/2034514846 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f13c405d370 0x7f13c4138940 unknown :-1 s=CLOSED pgs=14 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:26.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.282+0000 7f13c3fff640 1 --2- 10.20.193.58:0/2034514846 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f13c4056550 0x7f13c413acd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:26.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.282+0000 7f13c3fff640 1 -- 10.20.193.58:0/2034514846 >> 10.20.193.58:0/2034514846 conn(0x7f13c40b3c20 msgr2=0x7f13c4159c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:26.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.282+0000 7f13c3fff640 1 -- 10.20.193.58:0/2034514846 shutdown_connections 2026-02-23T06:44:26.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:26.282+0000 7f13c3fff640 1 -- 10.20.193.58:0/2034514846 wait complete. 2026-02-23T06:44:26.289 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:44:36.289 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:44:36.290 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:44:36.413 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.417+0000 7f52d7483640 1 -- 10.20.193.58:0/3362937707 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f52d00b6690 msgr2=0x7f52d0058ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:36.413 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.417+0000 7f52d7483640 1 --2- 10.20.193.58:0/3362937707 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f52d00b6690 0x7f52d0058ec0 secure :-1 s=READY pgs=15 gs=3 cs=0 l=1 c_cookie=6518315676001752892 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52cc005820 tx=0x7f52cc0302b0 comp rx=0 tx=0).stop 2026-02-23T06:44:36.413 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.417+0000 7f52d7483640 1 -- 10.20.193.58:0/3362937707 shutdown_connections 2026-02-23T06:44:36.413 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.417+0000 7f52d7483640 1 --2- 10.20.193.58:0/3362937707 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f52d00b6690 0x7f52d0058ec0 unknown :-1 s=CLOSED pgs=15 gs=3 cs=0 l=1 c_cookie=6518315676001752892 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:36.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.417+0000 7f52d7483640 1 --2- 10.20.193.58:0/3362937707 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f52d015d4a0 0x7f52d00affb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:36.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.417+0000 7f52d7483640 1 -- 10.20.193.58:0/3362937707 >> 10.20.193.58:0/3362937707 conn(0x7f52d00b3c20 msgr2=0x7f52d00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:36.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.417+0000 7f52d7483640 1 -- 10.20.193.58:0/3362937707 shutdown_connections 2026-02-23T06:44:36.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.417+0000 7f52d7483640 1 -- 10.20.193.58:0/3362937707 wait complete. 2026-02-23T06:44:36.416 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.418+0000 7f52d7483640 1 Processor -- start 2026-02-23T06:44:36.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.419+0000 7f52d7483640 1 -- start start 2026-02-23T06:44:36.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.419+0000 7f52d7483640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52d00b6690 0x7f52d0123910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:36.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.419+0000 7f52d7483640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f52d015d4a0 0x7f52d0122fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:36.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.419+0000 7f52d7483640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f52d015d870 0x7f52d01249a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:36.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.419+0000 7f52d7483640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f52d00ae570 con 0x7f52d015d4a0 2026-02-23T06:44:36.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.419+0000 7f52d7483640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f52d01283c0 con 0x7f52d00b6690 2026-02-23T06:44:36.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.419+0000 7f52d7483640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f52d00ae7a0 con 0x7f52d015d870 2026-02-23T06:44:36.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.419+0000 7f52d5c80640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f52d015d4a0 0x7f52d0122fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:36.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.419+0000 7f52d6481640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52d00b6690 0x7f52d0123910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:36.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.419+0000 7f52d5c80640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f52d015d4a0 0x7f52d0122fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:38108/0 (socket says 10.20.193.58:38108) 2026-02-23T06:44:36.417 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.419+0000 7f52d5c80640 1 -- 10.20.193.58:0/613066680 learned_addr learned my addr 10.20.193.58:0/613066680 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:44:36.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.419+0000 7f52d6c82640 1 --2- 10.20.193.58:0/613066680 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f52d015d870 0x7f52d01249a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:36.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.419+0000 7f52d5c80640 1 -- 10.20.193.58:0/613066680 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f52d015d870 msgr2=0x7f52d01249a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:36.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.419+0000 7f52d5c80640 1 --2- 10.20.193.58:0/613066680 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f52d015d870 0x7f52d01249a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:36.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.419+0000 7f52d5c80640 1 -- 10.20.193.58:0/613066680 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52d00b6690 msgr2=0x7f52d0123910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:36.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.419+0000 7f52d5c80640 1 --2- 10.20.193.58:0/613066680 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52d00b6690 0x7f52d0123910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:36.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.419+0000 7f52d5c80640 1 -- 10.20.193.58:0/613066680 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52cc00a590 con 0x7f52d015d4a0 2026-02-23T06:44:36.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.420+0000 7f52d5c80640 1 --2- 10.20.193.58:0/613066680 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f52d015d4a0 0x7f52d0122fd0 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52c400c4d0 tx=0x7f52c400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:36.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.420+0000 7f52b6ffd640 1 -- 10.20.193.58:0/613066680 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f52c40052f0 con 0x7f52d015d4a0 2026-02-23T06:44:36.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.420+0000 7f52b6ffd640 1 -- 10.20.193.58:0/613066680 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52c4005450 con 0x7f52d015d4a0 2026-02-23T06:44:36.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.420+0000 7f52b6ffd640 1 -- 10.20.193.58:0/613066680 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f52c4003910 con 0x7f52d015d4a0 2026-02-23T06:44:36.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.420+0000 7f52d7483640 1 -- 10.20.193.58:0/613066680 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52d0122770 con 0x7f52d015d4a0 2026-02-23T06:44:36.418 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.420+0000 7f52d7483640 1 -- 10.20.193.58:0/613066680 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52d01241a0 con 0x7f52d015d4a0 2026-02-23T06:44:36.419 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.420+0000 7f52d7483640 1 -- 10.20.193.58:0/613066680 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52d00b6d50 con 0x7f52d015d4a0 2026-02-23T06:44:36.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.422+0000 7f52b6ffd640 1 -- 10.20.193.58:0/613066680 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f52c4019020 con 0x7f52d015d4a0 2026-02-23T06:44:36.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.423+0000 7f52b6ffd640 1 --2- 10.20.193.58:0/613066680 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f52a007a6c0 0x7f52a009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:36.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.423+0000 7f52b6ffd640 1 -- 10.20.193.58:0/613066680 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f52c409d720 con 0x7f52d015d4a0 2026-02-23T06:44:36.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.423+0000 7f52d6481640 1 --2- 10.20.193.58:0/613066680 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f52a007a6c0 0x7f52a009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:36.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.424+0000 7f52d6481640 1 --2- 10.20.193.58:0/613066680 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f52a007a6c0 0x7f52a009ab70 secure :-1 s=READY pgs=496 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52c0004740 tx=0x7f52c0005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:36.420 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.424+0000 7f52b6ffd640 1 -- 10.20.193.58:0/613066680 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f52c4060960 con 0x7f52d015d4a0 2026-02-23T06:44:36.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.578+0000 7f52d7483640 1 -- 10.20.193.58:0/613066680 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f52d0122bf0 con 0x7f52d015d4a0 2026-02-23T06:44:36.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.579+0000 7f52b6ffd640 1 -- 10.20.193.58:0/613066680 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f52c4063a80 con 0x7f52d015d4a0 2026-02-23T06:44:36.574 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":202,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:44:36.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.580+0000 7f52d7483640 1 -- 10.20.193.58:0/613066680 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f52a007a6c0 msgr2=0x7f52a009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:36.575 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.580+0000 7f52d7483640 1 --2- 10.20.193.58:0/613066680 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f52a007a6c0 0x7f52a009ab70 secure :-1 s=READY pgs=496 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52c0004740 tx=0x7f52c0005f90 comp rx=0 tx=0).stop 2026-02-23T06:44:36.575 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.580+0000 7f52d7483640 1 -- 10.20.193.58:0/613066680 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f52d015d4a0 msgr2=0x7f52d0122fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:36.575 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.580+0000 7f52d7483640 1 --2- 10.20.193.58:0/613066680 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f52d015d4a0 0x7f52d0122fd0 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52c400c4d0 tx=0x7f52c400c9a0 comp rx=0 tx=0).stop 2026-02-23T06:44:36.575 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.580+0000 7f52d7483640 1 -- 10.20.193.58:0/613066680 shutdown_connections 2026-02-23T06:44:36.575 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.580+0000 7f52d7483640 1 --2- 10.20.193.58:0/613066680 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f52a007a6c0 0x7f52a009ab70 unknown :-1 s=CLOSED pgs=496 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:36.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.580+0000 7f52d7483640 1 --2- 10.20.193.58:0/613066680 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f52d015d870 0x7f52d01249a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:36.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.580+0000 7f52d7483640 1 --2- 10.20.193.58:0/613066680 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f52d015d4a0 0x7f52d0122fd0 unknown :-1 s=CLOSED pgs=16 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:36.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.580+0000 7f52d7483640 1 --2- 10.20.193.58:0/613066680 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f52d00b6690 0x7f52d0123910 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:36.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.580+0000 7f52d7483640 1 -- 10.20.193.58:0/613066680 >> 10.20.193.58:0/613066680 conn(0x7f52d00b3c20 msgr2=0x7f52d01634e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:36.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.580+0000 7f52d7483640 1 -- 10.20.193.58:0/613066680 shutdown_connections 2026-02-23T06:44:36.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.580+0000 7f52d7483640 1 -- 10.20.193.58:0/613066680 wait complete. 2026-02-23T06:44:36.587 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:44:36.587 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:44:36.588 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:44:36.588 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:44:36.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.717+0000 7f07f3577640 1 -- 10.20.193.58:0/3641378420 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07e0004850 msgr2=0x7f07e0004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:36.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.717+0000 7f07f3577640 1 --2- 10.20.193.58:0/3641378420 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07e0004850 0x7f07e0004cc0 secure :-1 s=READY pgs=18 gs=4 cs=0 l=1 c_cookie=15421442027760993043 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07dc009b70 tx=0x7f07dc02fc50 comp rx=0 tx=0).stop 2026-02-23T06:44:36.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.717+0000 7f07f2d76640 1 -- 10.20.193.58:0/3641378420 reap_dead start 2026-02-23T06:44:36.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.717+0000 7f07f3577640 1 -- 10.20.193.58:0/3641378420 shutdown_connections 2026-02-23T06:44:36.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.717+0000 7f07f3577640 1 -- 10.20.193.58:0/3641378420 >> 10.20.193.58:0/3641378420 conn(0x7f07f40b3c20 msgr2=0x7f07f40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:36.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.717+0000 7f07f3577640 1 -- 10.20.193.58:0/3641378420 shutdown_connections 2026-02-23T06:44:36.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.717+0000 7f07f3577640 1 -- 10.20.193.58:0/3641378420 wait complete. 2026-02-23T06:44:36.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.718+0000 7f07f3577640 1 Processor -- start 2026-02-23T06:44:36.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.718+0000 7f07f3577640 1 -- start start 2026-02-23T06:44:36.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.719+0000 7f07f3577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07e0004850 0x7f07f4158ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:36.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.719+0000 7f07f3577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f07f41609d0 0x7f07f41fdac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:36.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.719+0000 7f07f3577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f07f41fe000 0x7f07f413ac50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:36.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.719+0000 7f07f3577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f07f40aef30 con 0x7f07e0004850 2026-02-23T06:44:36.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.719+0000 7f07f3577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f07f40af210 con 0x7f07f41609d0 2026-02-23T06:44:36.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.719+0000 7f07f3577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f07f40af4f0 con 0x7f07f41fe000 2026-02-23T06:44:36.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.719+0000 7f07f2575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07e0004850 0x7f07f4158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:36.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.719+0000 7f07f2575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07e0004850 0x7f07f4158ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:38128/0 (socket says 10.20.193.58:38128) 2026-02-23T06:44:36.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.719+0000 7f07f2575640 1 -- 10.20.193.58:0/1815578778 learned_addr learned my addr 10.20.193.58:0/1815578778 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:44:36.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.719+0000 7f07f1d74640 1 --2- 10.20.193.58:0/1815578778 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f07f41609d0 0x7f07f41fdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:36.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.719+0000 7f07f2d76640 1 --2- 10.20.193.58:0/1815578778 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f07f41fe000 0x7f07f413ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:36.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.719+0000 7f07f2575640 1 -- 10.20.193.58:0/1815578778 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f07f41fe000 msgr2=0x7f07f413ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:36.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.719+0000 7f07f2575640 1 --2- 10.20.193.58:0/1815578778 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f07f41fe000 0x7f07f413ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:36.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.719+0000 7f07f2575640 1 -- 10.20.193.58:0/1815578778 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f07f41609d0 msgr2=0x7f07f41fdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:36.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.719+0000 7f07f2575640 1 --2- 10.20.193.58:0/1815578778 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f07f41609d0 0x7f07f41fdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:36.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.719+0000 7f07f2575640 1 -- 10.20.193.58:0/1815578778 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07f41612b0 con 0x7f07e0004850 2026-02-23T06:44:36.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.719+0000 7f07f2575640 1 --2- 10.20.193.58:0/1815578778 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07e0004850 0x7f07f4158ed0 secure :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07e8009480 tx=0x7f07e8010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:36.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.720+0000 7f07daffd640 1 -- 10.20.193.58:0/1815578778 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f07e8004560 con 0x7f07e0004850 2026-02-23T06:44:36.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.720+0000 7f07daffd640 1 -- 10.20.193.58:0/1815578778 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07e800e9c0 con 0x7f07e0004850 2026-02-23T06:44:36.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.720+0000 7f07daffd640 1 -- 10.20.193.58:0/1815578778 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f07e800edb0 con 0x7f07e0004850 2026-02-23T06:44:36.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.720+0000 7f07f3577640 1 -- 10.20.193.58:0/1815578778 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07f4161590 con 0x7f07e0004850 2026-02-23T06:44:36.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.720+0000 7f07f3577640 1 -- 10.20.193.58:0/1815578778 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07f4161fa0 con 0x7f07e0004850 2026-02-23T06:44:36.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.721+0000 7f07f3577640 1 --2- 10.20.193.58:0/1815578778 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07f4132610 0x7f07f413b190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:36.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.721+0000 7f07f3577640 1 -- 10.20.193.58:0/1815578778 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f07f4161780 con 0x7f07f4132610 2026-02-23T06:44:36.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.721+0000 7f07f1d74640 1 --2- 10.20.193.58:0/1815578778 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07f4132610 0x7f07f413b190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:36.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.721+0000 7f07f1d74640 1 -- 10.20.193.58:0/1815578778 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f07f4059690 con 0x7f07f4132610 2026-02-23T06:44:36.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.721+0000 7f07daffd640 1 -- 10.20.193.58:0/1815578778 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f07e8018020 con 0x7f07e0004850 2026-02-23T06:44:36.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.722+0000 7f07f1d74640 1 --2- 10.20.193.58:0/1815578778 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07f4132610 0x7f07f413b190 secure :-1 s=READY pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07dc009230 tx=0x7f07dc0055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:36.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.722+0000 7f07daffd640 1 --2- 10.20.193.58:0/1815578778 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f07c007a6b0 0x7f07c009ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:36.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.722+0000 7f07daffd640 1 -- 10.20.193.58:0/1815578778 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f07e809df80 con 0x7f07e0004850 2026-02-23T06:44:36.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.722+0000 7f07daffd640 1 -- 10.20.193.58:0/1815578778 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f07dc041070 con 0x7f07f4132610 2026-02-23T06:44:36.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.723+0000 7f07f2d76640 1 --2- 10.20.193.58:0/1815578778 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f07c007a6b0 0x7f07c009ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:36.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.723+0000 7f07daffd640 1 -- 10.20.193.58:0/1815578778 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f07dc042040 con 0x7f07f4132610 2026-02-23T06:44:36.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.723+0000 7f07daffd640 1 -- 10.20.193.58:0/1815578778 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07f4132610 msgr2=0x7f07f413b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:36.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.723+0000 7f07daffd640 1 --2- 10.20.193.58:0/1815578778 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07f4132610 0x7f07f413b190 secure :-1 s=READY pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07dc009230 tx=0x7f07dc0055d0 comp rx=0 tx=0).stop 2026-02-23T06:44:36.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.723+0000 7f07daffd640 1 -- 10.20.193.58:0/1815578778 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07f4132610 msgr2=0x7f07f413b190 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:44:36.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.723+0000 7f07daffd640 1 --2- 10.20.193.58:0/1815578778 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07f4132610 0x7f07f413b190 secure :-1 s=CLOSED pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07dc009230 tx=0x7f07dc0055d0 comp rx=0 tx=0).stop 2026-02-23T06:44:36.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.723+0000 7f07f2d76640 1 --2- 10.20.193.58:0/1815578778 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f07c007a6b0 0x7f07c009ab60 secure :-1 s=READY pgs=497 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07e4003860 tx=0x7f07e4003d40 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:36.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.726+0000 7f07f3577640 1 --2- 10.20.193.58:0/1815578778 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07f415b700 0x7f07f42010b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:36.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.726+0000 7f07f3577640 1 -- 10.20.193.58:0/1815578778 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f07f415bad0 con 0x7f07f415b700 2026-02-23T06:44:36.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.727+0000 7f07f1d74640 1 --2- 10.20.193.58:0/1815578778 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07f415b700 0x7f07f42010b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:36.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.727+0000 7f07f1d74640 1 -- 10.20.193.58:0/1815578778 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f07f415c880 con 0x7f07f415b700 2026-02-23T06:44:36.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.727+0000 7f07f1d74640 1 --2- 10.20.193.58:0/1815578778 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07f415b700 0x7f07f42010b0 secure :-1 s=READY pgs=21 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07dc005870 tx=0x7f07dc005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:36.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.727+0000 7f07daffd640 1 -- 10.20.193.58:0/1815578778 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f07dc005d80 con 0x7f07f415b700 2026-02-23T06:44:36.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.727+0000 7f07daffd640 1 -- 10.20.193.58:0/1815578778 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4914 (secure 0 0 0) 0x7f07dc04f880 con 0x7f07f415b700 2026-02-23T06:44:36.724 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:44:36.725 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:44:36.725 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:44:36.725 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:44:36.725 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 202, 2026-02-23T06:44:36.725 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 26399, 2026-02-23T06:44:36.725 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:44:36.725 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:44:36.725 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:44:36.725 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:44:36.726 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:36.726 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:44:36.726 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:44:36.726 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:44:36.726 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:44:36.726 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:44:36.726 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:44:36.726 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:44:36.726 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:44:36.727 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:44:36.727 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:44:36.727 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:44:36.727 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:44:36.727 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:44:36.727 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:44:36.727 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:44:36.727 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:44:36.728 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:44:36.728 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:36.728 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:44:36.728 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:44:36.728 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:44:36.728 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:44:36.728 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:44:36.728 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:44:36.728 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:44:36.728 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:44:36.728 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:44:36.728 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:44:36.729 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:44:36.729 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:44:36.729 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:44:36.729 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:44:36.729 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:44:36.729 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:36.729 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:36.729 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:44:36.729 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:44:36.729 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:44:36.729 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:44:36.730 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:44:36.730 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:44:36.730 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:44:36.730 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:44:36.730 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:44:36.730 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:44:36.730 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:44:36.730 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:44:36.730 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:44:36.730 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:44:36.730 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:44:36.730 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:44:36.731 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:44:36.731 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:44:36.731 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:44:36.731 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:44:36.731 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:44:36.731 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:44:36.731 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:44:36.731 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:44:36.731 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:44:36.731 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:44:36.731 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:44:36.731 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:44:36.732 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:44:36.732 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:44:36.732 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:36.732 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:44:36.732 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:36.732 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:44:36.732 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:36.732 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:44:36.733 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:44:36.733 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:44:36.733 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:44:36.733 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:36.733 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:44:36.733 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:44:36.733 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:36.733 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:36.733 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:36.733 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:44:36.733 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:44:36.734 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:36.734 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:36.734 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:36.734 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:36.734 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:44:36.734 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:44:36.734 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:44:36.734 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:44:36.734 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:44:36.734 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:44:36.734 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:36.734 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:36.734 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:44:36.735 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:44:36.735 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:44:36.735 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:44:36.735 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:36.735 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:44:36.735 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:44:36.735 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:36.735 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:36.735 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:36.735 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:44:36.735 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:44:36.735 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:36.736 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:36.736 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:36.736 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:36.736 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:44:36.736 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:44:36.736 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:44:36.736 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:44:36.736 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:44:36.736 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:44:36.736 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:36.736 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:36.736 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:44:36.737 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:44:36.737 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:44:36.737 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:44:36.737 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:36.737 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:44:36.737 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:44:36.737 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:36.737 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:36.737 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:36.737 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:44:36.737 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:44:36.737 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:36.737 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:36.738 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:36.738 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:36.738 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:44:36.738 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:44:36.738 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:44:36.738 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:44:36.738 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:44:36.738 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:44:36.738 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:36.738 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:36.738 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:36.738 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:44:36.739 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:44:36.739 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:36.739 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:36.739 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:36.739 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:44:36.739 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:36.739 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:36.739 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:44:36.739 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:36.739 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:36.739 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:36.739 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:44:36.739 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:36.740 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:36.740 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:36.740 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:44:36.740 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:44:36.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.727+0000 7f07daffd640 1 -- 10.20.193.58:0/1815578778 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07f415b700 msgr2=0x7f07f42010b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:36.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.727+0000 7f07daffd640 1 --2- 10.20.193.58:0/1815578778 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07f415b700 0x7f07f42010b0 secure :-1 s=READY pgs=21 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07dc005870 tx=0x7f07dc005f90 comp rx=0 tx=0).stop 2026-02-23T06:44:36.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.727+0000 7f07daffd640 1 -- 10.20.193.58:0/1815578778 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07f415b700 msgr2=0x7f07f42010b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:44:36.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.727+0000 7f07daffd640 1 --2- 10.20.193.58:0/1815578778 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07f415b700 0x7f07f42010b0 unknown :-1 s=CLOSED pgs=21 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:36.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.728+0000 7f07f3577640 1 -- 10.20.193.58:0/1815578778 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f07c007a6b0 msgr2=0x7f07c009ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:36.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.728+0000 7f07f3577640 1 --2- 10.20.193.58:0/1815578778 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f07c007a6b0 0x7f07c009ab60 secure :-1 s=READY pgs=497 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07e4003860 tx=0x7f07e4003d40 comp rx=0 tx=0).stop 2026-02-23T06:44:36.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.728+0000 7f07f3577640 1 -- 10.20.193.58:0/1815578778 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07e0004850 msgr2=0x7f07f4158ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:36.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.728+0000 7f07f3577640 1 --2- 10.20.193.58:0/1815578778 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f07e0004850 0x7f07f4158ed0 secure :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07e8009480 tx=0x7f07e8010e80 comp rx=0 tx=0).stop 2026-02-23T06:44:36.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.728+0000 7f07f2d76640 1 -- 10.20.193.58:0/1815578778 reap_dead start 2026-02-23T06:44:36.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.728+0000 7f07f2d76640 1 -- 10.20.193.58:0/1815578778 reap_dead start 2026-02-23T06:44:36.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.728+0000 7f07f3577640 1 -- 10.20.193.58:0/1815578778 shutdown_connections 2026-02-23T06:44:36.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.728+0000 7f07f3577640 1 -- 10.20.193.58:0/1815578778 >> 10.20.193.58:0/1815578778 conn(0x7f07f40b3c20 msgr2=0x7f07f4162360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:36.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.728+0000 7f07f3577640 1 -- 10.20.193.58:0/1815578778 shutdown_connections 2026-02-23T06:44:36.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.728+0000 7f07f3577640 1 -- 10.20.193.58:0/1815578778 wait complete. 2026-02-23T06:44:36.744 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:44:36.744 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:44:36.744 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:44:36.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.870+0000 7f573e243640 1 -- 10.20.193.58:0/11968113 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f573815d4a0 msgr2=0x7f57380affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:36.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.870+0000 7f573e243640 1 --2- 10.20.193.58:0/11968113 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f573815d4a0 0x7f57380affb0 secure :-1 s=READY pgs=46 gs=2 cs=0 l=1 c_cookie=7632681226447516766 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5728004740 tx=0x7f572802f1e0 comp rx=0 tx=0).stop 2026-02-23T06:44:36.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.870+0000 7f573e243640 1 -- 10.20.193.58:0/11968113 shutdown_connections 2026-02-23T06:44:36.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.870+0000 7f573e243640 1 --2- 10.20.193.58:0/11968113 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f573815d870 0x7f57380587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:36.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.870+0000 7f573e243640 1 --2- 10.20.193.58:0/11968113 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f573815d4a0 0x7f57380affb0 unknown :-1 s=CLOSED pgs=46 gs=2 cs=0 l=1 c_cookie=7632681226447516766 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:36.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.870+0000 7f573e243640 1 -- 10.20.193.58:0/11968113 >> 10.20.193.58:0/11968113 conn(0x7f57380b3c20 msgr2=0x7f57380b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:36.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.870+0000 7f573e243640 1 -- 10.20.193.58:0/11968113 shutdown_connections 2026-02-23T06:44:36.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.870+0000 7f573e243640 1 -- 10.20.193.58:0/11968113 wait complete. 2026-02-23T06:44:36.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.872+0000 7f573e243640 1 Processor -- start 2026-02-23T06:44:36.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.872+0000 7f573e243640 1 -- start start 2026-02-23T06:44:36.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.872+0000 7f573e243640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f57380b6690 0x7f573813eb60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:36.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.872+0000 7f573e243640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f573815d4a0 0x7f5738121360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:36.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.872+0000 7f573e243640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f573815d870 0x7f573811d1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:36.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.872+0000 7f573e243640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f573811bd70 con 0x7f57380b6690 2026-02-23T06:44:36.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.872+0000 7f573e243640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f573811cd40 con 0x7f573815d870 2026-02-23T06:44:36.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.872+0000 7f573e243640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f573811c8f0 con 0x7f573815d4a0 2026-02-23T06:44:36.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.872+0000 7f573d241640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f57380b6690 0x7f573813eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:36.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.872+0000 7f573ca40640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f573815d4a0 0x7f5738121360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:36.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.872+0000 7f573ca40640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f573815d4a0 0x7f5738121360 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:47576/0 (socket says 10.20.193.58:47576) 2026-02-23T06:44:36.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.872+0000 7f573ca40640 1 -- 10.20.193.58:0/646300359 learned_addr learned my addr 10.20.193.58:0/646300359 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:44:36.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.872+0000 7f573da42640 1 --2- 10.20.193.58:0/646300359 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f573815d870 0x7f573811d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:36.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.873+0000 7f573d241640 1 -- 10.20.193.58:0/646300359 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f573815d4a0 msgr2=0x7f5738121360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:36.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.873+0000 7f573d241640 1 --2- 10.20.193.58:0/646300359 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f573815d4a0 0x7f5738121360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:36.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.873+0000 7f573d241640 1 -- 10.20.193.58:0/646300359 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f573815d870 msgr2=0x7f573811d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:36.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.873+0000 7f573d241640 1 --2- 10.20.193.58:0/646300359 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f573815d870 0x7f573811d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:36.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.873+0000 7f573d241640 1 -- 10.20.193.58:0/646300359 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57280094b0 con 0x7f57380b6690 2026-02-23T06:44:36.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.873+0000 7f573d241640 1 --2- 10.20.193.58:0/646300359 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f57380b6690 0x7f573813eb60 secure :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5728009230 tx=0x7f5728002950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:36.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.873+0000 7f5725ffb640 1 -- 10.20.193.58:0/646300359 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5728038470 con 0x7f57380b6690 2026-02-23T06:44:36.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.873+0000 7f5725ffb640 1 -- 10.20.193.58:0/646300359 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f57280386c0 con 0x7f57380b6690 2026-02-23T06:44:36.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.873+0000 7f5725ffb640 1 -- 10.20.193.58:0/646300359 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5728038a90 con 0x7f57380b6690 2026-02-23T06:44:36.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.873+0000 7f573e243640 1 -- 10.20.193.58:0/646300359 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f573813db70 con 0x7f57380b6690 2026-02-23T06:44:36.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.873+0000 7f573e243640 1 -- 10.20.193.58:0/646300359 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f573813e130 con 0x7f57380b6690 2026-02-23T06:44:36.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.874+0000 7f573e243640 1 --2- 10.20.193.58:0/646300359 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f573811d710 0x7f573814b110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:36.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.874+0000 7f573e243640 1 -- 10.20.193.58:0/646300359 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f57380b6330 con 0x7f573811d710 2026-02-23T06:44:36.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.874+0000 7f573ca40640 1 --2- 10.20.193.58:0/646300359 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f573811d710 0x7f573814b110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:36.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.874+0000 7f573ca40640 1 -- 10.20.193.58:0/646300359 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f57380b5e10 con 0x7f573811d710 2026-02-23T06:44:36.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.874+0000 7f573ca40640 1 --2- 10.20.193.58:0/646300359 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f573811d710 0x7f573814b110 secure :-1 s=READY pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5738163860 tx=0x7f572c002d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:36.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.875+0000 7f5725ffb640 1 -- 10.20.193.58:0/646300359 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f572c009e20 con 0x7f573811d710 2026-02-23T06:44:36.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.875+0000 7f5725ffb640 1 -- 10.20.193.58:0/646300359 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f5728038bf0 con 0x7f57380b6690 2026-02-23T06:44:36.874 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.876+0000 7f5725ffb640 1 --2- 10.20.193.58:0/646300359 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f570807a660 0x7f570809ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:36.874 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.876+0000 7f5725ffb640 1 -- 10.20.193.58:0/646300359 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f57280c2fd0 con 0x7f57380b6690 2026-02-23T06:44:36.874 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.876+0000 7f5725ffb640 1 -- 10.20.193.58:0/646300359 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f572c011c70 con 0x7f573811d710 2026-02-23T06:44:36.874 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.876+0000 7f5725ffb640 1 -- 10.20.193.58:0/646300359 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f573811d710 msgr2=0x7f573814b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:36.874 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.876+0000 7f5725ffb640 1 --2- 10.20.193.58:0/646300359 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f573811d710 0x7f573814b110 secure :-1 s=READY pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5738163860 tx=0x7f572c002d70 comp rx=0 tx=0).stop 2026-02-23T06:44:36.874 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.876+0000 7f5725ffb640 1 -- 10.20.193.58:0/646300359 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f573811d710 msgr2=0x7f573814b110 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:44:36.875 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.876+0000 7f5725ffb640 1 --2- 10.20.193.58:0/646300359 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f573811d710 0x7f573814b110 secure :-1 s=CLOSED pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5738163860 tx=0x7f572c002d70 comp rx=0 tx=0).stop 2026-02-23T06:44:36.875 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.876+0000 7f573da42640 1 --2- 10.20.193.58:0/646300359 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f570807a660 0x7f570809ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:36.875 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.876+0000 7f573da42640 1 --2- 10.20.193.58:0/646300359 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f570807a660 0x7f570809ab10 secure :-1 s=READY pgs=498 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5734003780 tx=0x7f5734008e10 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:36.875 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.879+0000 7f573e243640 1 --2- 10.20.193.58:0/646300359 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f573814b650 0x7f573814ba20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:36.875 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.879+0000 7f573e243640 1 -- 10.20.193.58:0/646300359 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f57380b6d50 con 0x7f573814b650 2026-02-23T06:44:36.875 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.879+0000 7f573ca40640 1 --2- 10.20.193.58:0/646300359 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f573814b650 0x7f573814ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:36.876 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.880+0000 7f573ca40640 1 -- 10.20.193.58:0/646300359 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f573815b4a0 con 0x7f573814b650 2026-02-23T06:44:36.876 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.880+0000 7f573ca40640 1 --2- 10.20.193.58:0/646300359 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f573814b650 0x7f573814ba20 secure :-1 s=READY pgs=48 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f572c002db0 tx=0x7f572c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:36.876 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.880+0000 7f5725ffb640 1 -- 10.20.193.58:0/646300359 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f572c024070 con 0x7f573814b650 2026-02-23T06:44:36.876 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.880+0000 7f5725ffb640 1 -- 10.20.193.58:0/646300359 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5246 (secure 0 0 0) 0x7f572c019600 con 0x7f573814b650 2026-02-23T06:44:36.876 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.880+0000 7f5725ffb640 1 -- 10.20.193.58:0/646300359 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f573814b650 msgr2=0x7f573814ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:36.876 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.880+0000 7f5725ffb640 1 --2- 10.20.193.58:0/646300359 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f573814b650 0x7f573814ba20 secure :-1 s=READY pgs=48 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f572c002db0 tx=0x7f572c004770 comp rx=0 tx=0).stop 2026-02-23T06:44:36.877 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.880+0000 7f5725ffb640 1 -- 10.20.193.58:0/646300359 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f573814b650 msgr2=0x7f573814ba20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:44:36.877 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.880+0000 7f5725ffb640 1 --2- 10.20.193.58:0/646300359 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f573814b650 0x7f573814ba20 unknown :-1 s=CLOSED pgs=48 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:36.877 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:44:36.877 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:44:36.877 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:44:36.877 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:44:36.877 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 202, 2026-02-23T06:44:36.878 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 78956, 2026-02-23T06:44:36.878 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:44:36.878 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:44:36.878 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:44:36.878 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:44:36.878 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:36.878 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:44:36.878 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:44:36.878 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:44:36.878 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:44:36.878 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:44:36.878 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:44:36.879 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:44:36.879 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:44:36.879 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:44:36.879 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:44:36.879 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:44:36.879 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:44:36.879 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:44:36.879 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:44:36.879 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:44:36.879 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:44:36.879 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:44:36.879 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:36.880 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:44:36.880 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:44:36.880 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:44:36.880 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:44:36.880 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:44:36.880 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:44:36.880 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:44:36.880 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:44:36.880 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:44:36.880 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:44:36.880 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:44:36.880 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:44:36.881 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:44:36.881 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:44:36.881 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:44:36.881 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:36.881 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:36.881 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:44:36.881 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:44:36.881 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:44:36.881 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:44:36.881 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:44:36.881 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:44:36.881 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:44:36.882 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:44:36.882 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:44:36.882 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:44:36.882 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:44:36.882 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:44:36.882 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:44:36.882 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:44:36.882 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:44:36.882 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:44:36.882 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:44:36.882 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:44:36.882 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:44:36.883 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:44:36.883 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:44:36.883 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:44:36.883 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:44:36.883 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:44:36.883 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:44:36.883 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:44:36.883 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:44:36.883 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:44:36.883 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:44:36.883 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:44:36.883 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:36.883 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:44:36.884 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:36.884 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:44:36.884 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:36.884 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:44:36.884 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:44:36.884 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:44:36.884 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:44:36.884 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:36.884 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:44:36.884 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:44:36.884 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:36.884 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:36.885 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:36.885 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:44:36.885 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:44:36.885 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:36.885 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:36.885 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:36.885 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:36.885 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:44:36.885 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:44:36.885 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:44:36.885 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:44:36.885 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:44:36.885 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:44:36.886 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:36.886 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:36.886 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:44:36.886 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:44:36.886 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:44:36.886 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:44:36.886 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:36.886 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:44:36.886 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:44:36.886 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:36.886 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:36.886 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:36.887 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:44:36.887 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:44:36.887 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:36.887 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:36.887 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:36.887 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:36.887 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:44:36.887 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:44:36.887 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:44:36.887 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:44:36.887 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:44:36.887 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:44:36.887 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:36.888 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:36.888 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:44:36.888 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:44:36.888 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:44:36.888 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:44:36.888 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:36.888 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:44:36.888 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:44:36.888 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:36.888 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:36.888 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:36.888 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:44:36.889 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:44:36.889 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:36.889 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:36.889 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:36.889 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:36.889 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:44:36.889 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:44:36.889 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:44:36.889 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:44:36.889 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:44:36.889 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:44:36.889 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:36.889 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:36.890 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:36.890 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:44:36.890 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:44:36.890 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:36.890 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:36.890 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:36.890 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:44:36.890 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:36.890 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:36.890 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:44:36.890 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:36.890 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:36.891 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:36.891 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:44:36.891 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:36.891 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:36.891 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:44:36.891 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:36.891 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:36.891 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:36.891 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:44:36.891 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:36.891 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:36.891 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:44:36.891 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:36.892 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:36.892 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:36.892 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:44:36.892 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:36.892 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:36.892 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:36.892 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:44:36.892 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:44:36.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.880+0000 7f573e243640 1 -- 10.20.193.58:0/646300359 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f570807a660 msgr2=0x7f570809ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:36.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.880+0000 7f573e243640 1 --2- 10.20.193.58:0/646300359 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f570807a660 0x7f570809ab10 secure :-1 s=READY pgs=498 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5734003780 tx=0x7f5734008e10 comp rx=0 tx=0).stop 2026-02-23T06:44:36.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.880+0000 7f573e243640 1 -- 10.20.193.58:0/646300359 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f57380b6690 msgr2=0x7f573813eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:36.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.880+0000 7f573e243640 1 --2- 10.20.193.58:0/646300359 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f57380b6690 0x7f573813eb60 secure :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5728009230 tx=0x7f5728002950 comp rx=0 tx=0).stop 2026-02-23T06:44:36.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.880+0000 7f573da42640 1 -- 10.20.193.58:0/646300359 reap_dead start 2026-02-23T06:44:36.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.880+0000 7f573da42640 1 -- 10.20.193.58:0/646300359 reap_dead start 2026-02-23T06:44:36.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.880+0000 7f573e243640 1 -- 10.20.193.58:0/646300359 shutdown_connections 2026-02-23T06:44:36.894 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.880+0000 7f573e243640 1 -- 10.20.193.58:0/646300359 >> 10.20.193.58:0/646300359 conn(0x7f57380b3c20 msgr2=0x7f573815ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:36.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.881+0000 7f573e243640 1 -- 10.20.193.58:0/646300359 shutdown_connections 2026-02-23T06:44:36.895 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:36.881+0000 7f573e243640 1 -- 10.20.193.58:0/646300359 wait complete. 2026-02-23T06:44:36.895 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:44:36.895 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:44:36.896 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:44:37.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.022+0000 7f7dcadad640 1 -- 10.20.193.58:0/4242222100 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7dac004eb0 msgr2=0x7f7dac005320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:37.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.022+0000 7f7dcadad640 1 --2- 10.20.193.58:0/4242222100 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7dac004eb0 0x7f7dac005320 secure :-1 s=READY pgs=25 gs=4 cs=0 l=1 c_cookie=5367480682298283245 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dc0004780 tx=0x7f7dc0030980 comp rx=0 tx=0).stop 2026-02-23T06:44:37.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.022+0000 7f7dca5ac640 1 -- 10.20.193.58:0/4242222100 reap_dead start 2026-02-23T06:44:37.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.022+0000 7f7dcadad640 1 -- 10.20.193.58:0/4242222100 shutdown_connections 2026-02-23T06:44:37.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.022+0000 7f7dcadad640 1 -- 10.20.193.58:0/4242222100 >> 10.20.193.58:0/4242222100 conn(0x7f7dc4054e40 msgr2=0x7f7dc4057b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:37.019 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.023+0000 7f7dcadad640 1 -- 10.20.193.58:0/4242222100 shutdown_connections 2026-02-23T06:44:37.019 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.024+0000 7f7dcadad640 1 -- 10.20.193.58:0/4242222100 wait complete. 2026-02-23T06:44:37.019 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.025+0000 7f7dcadad640 1 Processor -- start 2026-02-23T06:44:37.020 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.025+0000 7f7dcadad640 1 -- start start 2026-02-23T06:44:37.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.025+0000 7f7dcadad640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7dac004eb0 0x7f7dc4137e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:37.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.025+0000 7f7dcadad640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7dc413deb0 0x7f7dc4145810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:37.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.025+0000 7f7dcadad640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7dc411c3a0 0x7f7dc4119100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:37.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.025+0000 7f7dcadad640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc4139290 con 0x7f7dc411c3a0 2026-02-23T06:44:37.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.025+0000 7f7dcadad640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc4139810 con 0x7f7dac004eb0 2026-02-23T06:44:37.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.025+0000 7f7dcadad640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f7dc411a210 con 0x7f7dc413deb0 2026-02-23T06:44:37.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.025+0000 7f7dca5ac640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7dc411c3a0 0x7f7dc4119100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:37.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.025+0000 7f7dca5ac640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7dc411c3a0 0x7f7dc4119100 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:38168/0 (socket says 10.20.193.58:38168) 2026-02-23T06:44:37.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.025+0000 7f7dca5ac640 1 -- 10.20.193.58:0/3063545425 learned_addr learned my addr 10.20.193.58:0/3063545425 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:44:37.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.025+0000 7f7dc95aa640 1 --2- 10.20.193.58:0/3063545425 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7dc413deb0 0x7f7dc4145810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:37.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.026+0000 7f7dc9dab640 1 --2- 10.20.193.58:0/3063545425 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7dac004eb0 0x7f7dc4137e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:37.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.026+0000 7f7dca5ac640 1 -- 10.20.193.58:0/3063545425 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7dc413deb0 msgr2=0x7f7dc4145810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:37.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.026+0000 7f7dca5ac640 1 --2- 10.20.193.58:0/3063545425 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7dc413deb0 0x7f7dc4145810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:37.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.026+0000 7f7dca5ac640 1 -- 10.20.193.58:0/3063545425 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7dac004eb0 msgr2=0x7f7dc4137e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:37.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.026+0000 7f7dca5ac640 1 --2- 10.20.193.58:0/3063545425 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7dac004eb0 0x7f7dc4137e00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:37.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.026+0000 7f7dca5ac640 1 -- 10.20.193.58:0/3063545425 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc411b3a0 con 0x7f7dc411c3a0 2026-02-23T06:44:37.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.026+0000 7f7dc9dab640 1 --2- 10.20.193.58:0/3063545425 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7dac004eb0 0x7f7dc4137e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:44:37.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.026+0000 7f7dca5ac640 1 --2- 10.20.193.58:0/3063545425 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7dc411c3a0 0x7f7dc4119100 secure :-1 s=READY pgs=26 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dc0030e90 tx=0x7f7dc00037c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:37.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.026+0000 7f7db27fc640 1 -- 10.20.193.58:0/3063545425 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7dc0040040 con 0x7f7dc411c3a0 2026-02-23T06:44:37.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.026+0000 7f7db27fc640 1 -- 10.20.193.58:0/3063545425 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7dc0003ee0 con 0x7f7dc411c3a0 2026-02-23T06:44:37.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.026+0000 7f7dcadad640 1 -- 10.20.193.58:0/3063545425 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dc411a480 con 0x7f7dc411c3a0 2026-02-23T06:44:37.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.026+0000 7f7db27fc640 1 -- 10.20.193.58:0/3063545425 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7dc0004c20 con 0x7f7dc411c3a0 2026-02-23T06:44:37.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.026+0000 7f7dcadad640 1 -- 10.20.193.58:0/3063545425 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dc411ad40 con 0x7f7dc411c3a0 2026-02-23T06:44:37.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.027+0000 7f7d8bfff640 1 --2- 10.20.193.58:0/3063545425 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7d840041f0 0x7f7d840246a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:37.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.027+0000 7f7d8bfff640 1 -- 10.20.193.58:0/3063545425 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f7d84025f20 con 0x7f7d840041f0 2026-02-23T06:44:37.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.027+0000 7f7dc9dab640 1 --2- 10.20.193.58:0/3063545425 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7d840041f0 0x7f7d840246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:37.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.027+0000 7f7dc9dab640 1 -- 10.20.193.58:0/3063545425 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7d840260e0 con 0x7f7d840041f0 2026-02-23T06:44:37.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.027+0000 7f7dc9dab640 1 --2- 10.20.193.58:0/3063545425 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7d840041f0 0x7f7d840246a0 secure :-1 s=READY pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7db400c6f0 tx=0x7f7db400cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:37.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.028+0000 7f7db27fc640 1 -- 10.20.193.58:0/3063545425 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f7dc0039430 con 0x7f7dc411c3a0 2026-02-23T06:44:37.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.029+0000 7f7db27fc640 1 --2- 10.20.193.58:0/3063545425 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7d9407a600 0x7f7d9409aab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:37.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.029+0000 7f7db27fc640 1 -- 10.20.193.58:0/3063545425 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f7dc00c3160 con 0x7f7dc411c3a0 2026-02-23T06:44:37.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.029+0000 7f7db27fc640 1 -- 10.20.193.58:0/3063545425 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7db4004290 con 0x7f7d840041f0 2026-02-23T06:44:37.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.029+0000 7f7db27fc640 1 -- 10.20.193.58:0/3063545425 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f7db40043f0 con 0x7f7d840041f0 2026-02-23T06:44:37.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.029+0000 7f7db27fc640 1 -- 10.20.193.58:0/3063545425 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7d840041f0 msgr2=0x7f7d840246a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:37.026 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.029+0000 7f7db27fc640 1 --2- 10.20.193.58:0/3063545425 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7d840041f0 0x7f7d840246a0 secure :-1 s=READY pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7db400c6f0 tx=0x7f7db400cbc0 comp rx=0 tx=0).stop 2026-02-23T06:44:37.026 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.029+0000 7f7db27fc640 1 -- 10.20.193.58:0/3063545425 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7d840041f0 msgr2=0x7f7d840246a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:44:37.026 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.029+0000 7f7db27fc640 1 --2- 10.20.193.58:0/3063545425 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7d840041f0 0x7f7d840246a0 unknown :-1 s=CLOSED pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:37.026 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.029+0000 7f7dc95aa640 1 --2- 10.20.193.58:0/3063545425 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7d9407a600 0x7f7d9409aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:37.026 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.029+0000 7f7dc95aa640 1 --2- 10.20.193.58:0/3063545425 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7d9407a600 0x7f7d9409aab0 secure :-1 s=READY pgs=499 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dc4119c00 tx=0x7f7db8008040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:37.027 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.032+0000 7f7d8bfff640 1 --2- 10.20.193.58:0/3063545425 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7d84025050 0x7f7d840254d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:37.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.032+0000 7f7d8bfff640 1 -- 10.20.193.58:0/3063545425 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f7d84025b30 con 0x7f7d84025050 2026-02-23T06:44:37.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.033+0000 7f7dc9dab640 1 --2- 10.20.193.58:0/3063545425 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7d84025050 0x7f7d840254d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:37.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.033+0000 7f7dc9dab640 1 -- 10.20.193.58:0/3063545425 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7d84025cf0 con 0x7f7d84025050 2026-02-23T06:44:37.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.033+0000 7f7dc9dab640 1 --2- 10.20.193.58:0/3063545425 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7d84025050 0x7f7d840254d0 secure :-1 s=READY pgs=65 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7db400c6f0 tx=0x7f7db4004800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:37.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.033+0000 7f7db27fc640 1 -- 10.20.193.58:0/3063545425 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7db4021070 con 0x7f7d84025050 2026-02-23T06:44:37.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.034+0000 7f7db27fc640 1 -- 10.20.193.58:0/3063545425 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5557 (secure 0 0 0) 0x7f7db4004560 con 0x7f7d84025050 2026-02-23T06:44:37.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.034+0000 7f7db27fc640 1 -- 10.20.193.58:0/3063545425 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7d84025050 msgr2=0x7f7d840254d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:37.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.034+0000 7f7db27fc640 1 --2- 10.20.193.58:0/3063545425 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7d84025050 0x7f7d840254d0 secure :-1 s=READY pgs=65 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7db400c6f0 tx=0x7f7db4004800 comp rx=0 tx=0).stop 2026-02-23T06:44:37.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.034+0000 7f7db27fc640 1 -- 10.20.193.58:0/3063545425 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7d84025050 msgr2=0x7f7d840254d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:44:37.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.034+0000 7f7db27fc640 1 --2- 10.20.193.58:0/3063545425 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7d84025050 0x7f7d840254d0 secure :-1 s=CLOSED pgs=65 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7db400c6f0 tx=0x7f7db4004800 comp rx=0 tx=0).stop 2026-02-23T06:44:37.030 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:44:37.031 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:44:37.031 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:44:37.031 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:44:37.031 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 202, 2026-02-23T06:44:37.031 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 130463, 2026-02-23T06:44:37.031 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:44:37.031 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:44:37.031 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:44:37.032 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:44:37.032 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:37.032 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:44:37.032 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:44:37.032 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:44:37.032 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:44:37.032 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:44:37.033 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:44:37.033 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:44:37.033 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:44:37.033 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:44:37.033 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:44:37.033 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:44:37.033 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:44:37.033 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:44:37.033 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:44:37.034 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:44:37.034 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:44:37.034 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:44:37.034 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:37.034 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:44:37.034 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:44:37.034 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:44:37.035 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:44:37.035 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:44:37.035 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:44:37.035 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:44:37.035 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:44:37.035 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:44:37.035 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:44:37.035 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:44:37.036 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:44:37.036 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:44:37.036 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:44:37.036 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:44:37.036 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:37.036 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:37.036 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:44:37.036 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:44:37.037 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:44:37.037 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:44:37.037 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:44:37.037 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:44:37.037 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:44:37.037 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:44:37.037 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:44:37.037 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:44:37.038 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:44:37.038 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:44:37.038 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:44:37.038 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:44:37.038 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:44:37.038 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:44:37.038 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:44:37.038 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:44:37.038 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:44:37.039 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:44:37.039 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:44:37.039 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:44:37.039 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:44:37.039 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:44:37.039 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:44:37.039 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:44:37.039 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:44:37.040 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:44:37.040 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:44:37.040 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:44:37.040 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:37.040 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:44:37.040 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:37.040 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:44:37.040 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:37.041 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:44:37.041 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:44:37.041 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:44:37.041 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:44:37.041 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:37.041 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:44:37.041 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:44:37.041 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:37.042 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:37.042 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:37.042 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:44:37.042 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:44:37.042 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:37.042 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:37.042 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:37.042 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:37.043 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:44:37.043 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:44:37.043 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:44:37.043 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:44:37.043 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:44:37.043 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:44:37.043 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:37.043 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:37.043 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:44:37.044 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:44:37.044 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:44:37.044 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:44:37.044 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:37.044 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:44:37.044 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:44:37.044 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:37.044 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:37.044 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:37.045 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:44:37.045 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:44:37.045 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:37.045 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:37.045 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:37.045 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:37.045 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:44:37.045 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:44:37.045 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:44:37.046 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:44:37.046 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:44:37.046 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:44:37.046 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:37.046 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:37.046 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:44:37.046 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:44:37.046 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:44:37.046 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:44:37.046 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:37.047 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:44:37.047 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:44:37.047 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:37.047 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:37.047 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:37.047 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:44:37.047 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:44:37.047 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:37.047 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:37.048 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:37.048 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:37.048 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:44:37.048 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:44:37.048 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:44:37.048 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:44:37.048 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:44:37.048 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:44:37.048 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:37.048 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:37.049 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:37.049 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:44:37.049 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:44:37.049 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:37.049 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:37.049 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:37.049 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:44:37.049 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:37.049 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:37.049 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:44:37.049 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:37.050 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:37.050 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:37.050 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:44:37.050 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:37.050 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:37.050 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:44:37.050 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:37.050 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:37.050 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:37.050 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:44:37.050 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:37.051 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:37.051 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:44:37.051 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:37.051 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:44:37.051 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:44:37.051 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:44:37.051 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:37.051 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:37.051 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:37.051 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:37.051 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:44:37.052 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:37.052 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:37.052 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:44:37.052 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:37.052 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:37.052 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:37.052 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:44:37.052 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:37.052 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:37.052 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:37.052 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:44:37.053 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:44:37.054 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.034+0000 7f7d8bfff640 1 -- 10.20.193.58:0/3063545425 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7d9407a600 msgr2=0x7f7d9409aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:37.054 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.034+0000 7f7d8bfff640 1 --2- 10.20.193.58:0/3063545425 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7d9407a600 0x7f7d9409aab0 secure :-1 s=READY pgs=499 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dc4119c00 tx=0x7f7db8008040 comp rx=0 tx=0).stop 2026-02-23T06:44:37.054 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.034+0000 7f7d8bfff640 1 -- 10.20.193.58:0/3063545425 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7dc411c3a0 msgr2=0x7f7dc4119100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:37.054 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.034+0000 7f7d8bfff640 1 --2- 10.20.193.58:0/3063545425 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7dc411c3a0 0x7f7dc4119100 secure :-1 s=READY pgs=26 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dc0030e90 tx=0x7f7dc00037c0 comp rx=0 tx=0).stop 2026-02-23T06:44:37.054 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.034+0000 7f7dca5ac640 1 -- 10.20.193.58:0/3063545425 reap_dead start 2026-02-23T06:44:37.054 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.034+0000 7f7dca5ac640 1 -- 10.20.193.58:0/3063545425 reap_dead start 2026-02-23T06:44:37.054 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.034+0000 7f7d8bfff640 1 -- 10.20.193.58:0/3063545425 shutdown_connections 2026-02-23T06:44:37.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.034+0000 7f7d8bfff640 1 -- 10.20.193.58:0/3063545425 >> 10.20.193.58:0/3063545425 conn(0x7f7dc4054e40 msgr2=0x7f7dc413a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:37.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.034+0000 7f7d8bfff640 1 -- 10.20.193.58:0/3063545425 shutdown_connections 2026-02-23T06:44:37.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.034+0000 7f7d8bfff640 1 -- 10.20.193.58:0/3063545425 wait complete. 2026-02-23T06:44:37.055 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:44:37.055 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-23T06:44:37.055 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-23T06:44:37.055 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-23T06:44:37.055 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-23T06:44:37.056 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-23T06:44:37.056 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:44:37.064 INFO:tasks.ceph.mon.b:Stopped 2026-02-23T06:44:37.064 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:44:37.064 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:44:37.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.188+0000 7f29c163f640 1 -- 10.20.193.58:0/457101045 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f29b40042b0 con 0x7f29bc158b40 2026-02-23T06:44:37.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.189+0000 7f29c48cc640 1 -- 10.20.193.58:0/457101045 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f29bc158b40 msgr2=0x7f29bc0b6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:37.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.189+0000 7f29c48cc640 1 --2- 10.20.193.58:0/457101045 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f29bc158b40 0x7f29bc0b6770 secure :-1 s=READY pgs=67 gs=3 cs=0 l=1 c_cookie=10739828889123621991 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29b4009890 tx=0x7f29b402f1b0 comp rx=0 tx=0).stop 2026-02-23T06:44:37.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.189+0000 7f29c48cc640 1 -- 10.20.193.58:0/457101045 shutdown_connections 2026-02-23T06:44:37.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.189+0000 7f29c48cc640 1 --2- 10.20.193.58:0/457101045 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f29bc158b40 0x7f29bc0b6770 unknown :-1 s=CLOSED pgs=67 gs=3 cs=0 l=1 c_cookie=10739828889123621991 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:37.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.189+0000 7f29c48cc640 1 -- 10.20.193.58:0/457101045 >> 10.20.193.58:0/457101045 conn(0x7f29bc0561f0 msgr2=0x7f29bc0565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:37.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.189+0000 7f29c48cc640 1 -- 10.20.193.58:0/457101045 shutdown_connections 2026-02-23T06:44:37.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.189+0000 7f29c48cc640 1 -- 10.20.193.58:0/457101045 wait complete. 2026-02-23T06:44:37.187 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.190+0000 7f29c48cc640 1 Processor -- start 2026-02-23T06:44:37.187 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.190+0000 7f29c48cc640 1 -- start start 2026-02-23T06:44:37.187 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.191+0000 7f29c48cc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f29bc0b2b20 0x7f29bc154a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:37.187 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.191+0000 7f29c48cc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f29bc158b40 0x7f29bc15d7c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:37.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.191+0000 7f29c48cc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f29bc163de0 0x7f29bc146b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:37.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.191+0000 7f29c48cc640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f29bc15cfe0 con 0x7f29bc163de0 2026-02-23T06:44:37.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.191+0000 7f29c48cc640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f29bc149580 con 0x7f29bc158b40 2026-02-23T06:44:37.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.191+0000 7f29c48cc640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f29bc15ca40 con 0x7f29bc0b2b20 2026-02-23T06:44:37.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.191+0000 7f29c2e42640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f29bc163de0 0x7f29bc146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:37.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.191+0000 7f29c1e40640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f29bc158b40 msgr2=0x7f29bc15d7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:44:37.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.191+0000 7f29c2641640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f29bc0b2b20 0x7f29bc154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:37.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.191+0000 7f29c2e42640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f29bc163de0 0x7f29bc146b50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:38210/0 (socket says 10.20.193.58:38210) 2026-02-23T06:44:37.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.191+0000 7f29c2e42640 1 -- 10.20.193.58:0/2789644536 learned_addr learned my addr 10.20.193.58:0/2789644536 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:44:37.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.191+0000 7f29c1e40640 1 --2- 10.20.193.58:0/2789644536 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f29bc158b40 0x7f29bc15d7c0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:44:37.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.191+0000 7f29c2e42640 1 -- 10.20.193.58:0/2789644536 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f29bc0b2b20 msgr2=0x7f29bc154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:37.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.191+0000 7f29c2e42640 1 --2- 10.20.193.58:0/2789644536 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f29bc0b2b20 0x7f29bc154a00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:37.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.191+0000 7f29c2e42640 1 -- 10.20.193.58:0/2789644536 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f29bc158b40 msgr2=0x7f29bc15d7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:44:37.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.191+0000 7f29c2e42640 1 --2- 10.20.193.58:0/2789644536 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f29bc158b40 0x7f29bc15d7c0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:37.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.191+0000 7f29c2e42640 1 -- 10.20.193.58:0/2789644536 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b40094b0 con 0x7f29bc163de0 2026-02-23T06:44:37.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.191+0000 7f29c2e42640 1 --2- 10.20.193.58:0/2789644536 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f29bc163de0 0x7f29bc146b50 secure :-1 s=READY pgs=31 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29b000d4d0 tx=0x7f29b000d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:37.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.192+0000 7f29a6ffd640 1 -- 10.20.193.58:0/2789644536 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f29b0005a80 con 0x7f29bc163de0 2026-02-23T06:44:37.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.192+0000 7f29a6ffd640 1 -- 10.20.193.58:0/2789644536 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29b0005cd0 con 0x7f29bc163de0 2026-02-23T06:44:37.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.192+0000 7f29a6ffd640 1 -- 10.20.193.58:0/2789644536 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f29b0006280 con 0x7f29bc163de0 2026-02-23T06:44:37.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.192+0000 7f29c48cc640 1 -- 10.20.193.58:0/2789644536 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29bc148bf0 con 0x7f29bc163de0 2026-02-23T06:44:37.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.192+0000 7f29c48cc640 1 -- 10.20.193.58:0/2789644536 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29bc148ec0 con 0x7f29bc163de0 2026-02-23T06:44:37.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.193+0000 7f29c48cc640 1 -- 10.20.193.58:0/2789644536 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29bc1496c0 con 0x7f29bc163de0 2026-02-23T06:44:37.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.194+0000 7f29a6ffd640 1 -- 10.20.193.58:0/2789644536 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f29b00063e0 con 0x7f29bc163de0 2026-02-23T06:44:37.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.195+0000 7f29a6ffd640 1 --2- 10.20.193.58:0/2789644536 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f298c07a5b0 0x7f298c09aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:37.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.195+0000 7f29a6ffd640 1 -- 10.20.193.58:0/2789644536 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f29b009e690 con 0x7f29bc163de0 2026-02-23T06:44:37.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.195+0000 7f29c2641640 1 --2- 10.20.193.58:0/2789644536 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f298c07a5b0 0x7f298c09aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:37.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.196+0000 7f29c2641640 1 --2- 10.20.193.58:0/2789644536 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f298c07a5b0 0x7f298c09aa60 secure :-1 s=READY pgs=500 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29b40023d0 tx=0x7f29b403a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:37.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.197+0000 7f29a6ffd640 1 -- 10.20.193.58:0/2789644536 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f29bc1496c0 con 0x7f29bc163de0 2026-02-23T06:44:37.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.352+0000 7f29c48cc640 1 -- 10.20.193.58:0/2789644536 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f29bc1496c0 con 0x7f29bc163de0 2026-02-23T06:44:37.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.352+0000 7f29a6ffd640 1 -- 10.20.193.58:0/2789644536 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f29bc1496c0 con 0x7f29bc163de0 2026-02-23T06:44:37.348 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":202,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:44:37.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.353+0000 7f29c48cc640 1 -- 10.20.193.58:0/2789644536 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f298c07a5b0 msgr2=0x7f298c09aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:37.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.353+0000 7f29c48cc640 1 --2- 10.20.193.58:0/2789644536 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f298c07a5b0 0x7f298c09aa60 secure :-1 s=READY pgs=500 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29b40023d0 tx=0x7f29b403a040 comp rx=0 tx=0).stop 2026-02-23T06:44:37.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.353+0000 7f29c48cc640 1 -- 10.20.193.58:0/2789644536 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f29bc163de0 msgr2=0x7f29bc146b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:37.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.353+0000 7f29c48cc640 1 --2- 10.20.193.58:0/2789644536 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f29bc163de0 0x7f29bc146b50 secure :-1 s=READY pgs=31 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29b000d4d0 tx=0x7f29b000d9a0 comp rx=0 tx=0).stop 2026-02-23T06:44:37.349 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.353+0000 7f29c48cc640 1 -- 10.20.193.58:0/2789644536 shutdown_connections 2026-02-23T06:44:37.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.353+0000 7f29c48cc640 1 --2- 10.20.193.58:0/2789644536 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f298c07a5b0 0x7f298c09aa60 unknown :-1 s=CLOSED pgs=500 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:37.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.353+0000 7f29c48cc640 1 --2- 10.20.193.58:0/2789644536 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f29bc163de0 0x7f29bc146b50 unknown :-1 s=CLOSED pgs=31 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:37.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.353+0000 7f29c48cc640 1 --2- 10.20.193.58:0/2789644536 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f29bc158b40 0x7f29bc15d7c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:37.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.353+0000 7f29c48cc640 1 --2- 10.20.193.58:0/2789644536 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f29bc0b2b20 0x7f29bc154a00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:37.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.353+0000 7f29c48cc640 1 -- 10.20.193.58:0/2789644536 >> 10.20.193.58:0/2789644536 conn(0x7f29bc0561f0 msgr2=0x7f29bc164730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:37.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.353+0000 7f29c48cc640 1 -- 10.20.193.58:0/2789644536 shutdown_connections 2026-02-23T06:44:37.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:37.353+0000 7f29c48cc640 1 -- 10.20.193.58:0/2789644536 wait complete. 2026-02-23T06:44:40.362 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:44:40.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.488+0000 7f1f9df89640 1 -- 10.20.193.58:0/3604559443 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1f84003a80 msgr2=0x7f1f84003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:40.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.488+0000 7f1f9df89640 1 --2- 10.20.193.58:0/3604559443 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1f84003a80 0x7f1f84003e90 secure :-1 s=READY pgs=38 gs=4 cs=0 l=1 c_cookie=1577843968771653419 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f88003680 tx=0x7f1f8802f870 comp rx=0 tx=0).stop 2026-02-23T06:44:40.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.488+0000 7f1f9d788640 1 -- 10.20.193.58:0/3604559443 reap_dead start 2026-02-23T06:44:40.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.488+0000 7f1f9df89640 1 -- 10.20.193.58:0/3604559443 shutdown_connections 2026-02-23T06:44:40.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.488+0000 7f1f9df89640 1 -- 10.20.193.58:0/3604559443 >> 10.20.193.58:0/3604559443 conn(0x7f1f98054390 msgr2=0x7f1f98054760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:40.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.489+0000 7f1f9df89640 1 -- 10.20.193.58:0/3604559443 shutdown_connections 2026-02-23T06:44:40.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.489+0000 7f1f9df89640 1 -- 10.20.193.58:0/3604559443 wait complete. 2026-02-23T06:44:40.487 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.490+0000 7f1f9df89640 1 Processor -- start 2026-02-23T06:44:40.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.490+0000 7f1f9df89640 1 -- start start 2026-02-23T06:44:40.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.490+0000 7f1f9df89640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1f84003a80 0x7f1f98058a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:40.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.490+0000 7f1f9df89640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1f981405d0 0x7f1f9813a6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:40.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.490+0000 7f1f9df89640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1f98140a00 0x7f1f9813ac30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:40.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.490+0000 7f1f9df89640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f1f981fd9d0 con 0x7f1f981405d0 2026-02-23T06:44:40.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.490+0000 7f1f9df89640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f1f98058fb0 con 0x7f1f84003a80 2026-02-23T06:44:40.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.490+0000 7f1f9df89640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f1f98162030 con 0x7f1f98140a00 2026-02-23T06:44:40.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.490+0000 7f1f9cf87640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1f84003a80 msgr2=0x7f1f98058a70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:44:40.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.490+0000 7f1f9cf87640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1f84003a80 0x7f1f98058a70 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:44:40.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.491+0000 7f1f8ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1f981405d0 0x7f1f9813a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:40.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.491+0000 7f1f8ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1f981405d0 0x7f1f9813a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:59964/0 (socket says 10.20.193.58:59964) 2026-02-23T06:44:40.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.491+0000 7f1f8ffff640 1 -- 10.20.193.58:0/69467974 learned_addr learned my addr 10.20.193.58:0/69467974 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:44:40.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.491+0000 7f1f9d788640 1 --2- 10.20.193.58:0/69467974 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1f98140a00 0x7f1f9813ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:40.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.491+0000 7f1f8ffff640 1 -- 10.20.193.58:0/69467974 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1f98140a00 msgr2=0x7f1f9813ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:40.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.491+0000 7f1f8ffff640 1 --2- 10.20.193.58:0/69467974 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1f98140a00 0x7f1f9813ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:40.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.491+0000 7f1f8ffff640 1 -- 10.20.193.58:0/69467974 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1f84003a80 msgr2=0x7f1f98058a70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:44:40.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.491+0000 7f1f8ffff640 1 --2- 10.20.193.58:0/69467974 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1f84003a80 0x7f1f98058a70 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:40.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.491+0000 7f1f8ffff640 1 -- 10.20.193.58:0/69467974 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f98059240 con 0x7f1f981405d0 2026-02-23T06:44:40.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.491+0000 7f1f8ffff640 1 --2- 10.20.193.58:0/69467974 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1f981405d0 0x7f1f9813a6f0 secure :-1 s=READY pgs=39 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f80011a60 tx=0x7f1f80011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:40.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.491+0000 7f1f8d7fa640 1 -- 10.20.193.58:0/69467974 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1f8000fe00 con 0x7f1f981405d0 2026-02-23T06:44:40.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.491+0000 7f1f8d7fa640 1 -- 10.20.193.58:0/69467974 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f800040d0 con 0x7f1f981405d0 2026-02-23T06:44:40.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.491+0000 7f1f8d7fa640 1 -- 10.20.193.58:0/69467974 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1f80004480 con 0x7f1f981405d0 2026-02-23T06:44:40.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.491+0000 7f1f9df89640 1 -- 10.20.193.58:0/69467974 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f981fdc50 con 0x7f1f981405d0 2026-02-23T06:44:40.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.491+0000 7f1f9df89640 1 -- 10.20.193.58:0/69467974 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f981fe210 con 0x7f1f981405d0 2026-02-23T06:44:40.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.492+0000 7f1f9df89640 1 -- 10.20.193.58:0/69467974 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f980b8270 con 0x7f1f981405d0 2026-02-23T06:44:40.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.493+0000 7f1f8d7fa640 1 -- 10.20.193.58:0/69467974 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f1f800026a0 con 0x7f1f981405d0 2026-02-23T06:44:40.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.494+0000 7f1f8d7fa640 1 --2- 10.20.193.58:0/69467974 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1f6807a5b0 0x7f1f6809aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:40.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.494+0000 7f1f8d7fa640 1 -- 10.20.193.58:0/69467974 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f1f8009e380 con 0x7f1f981405d0 2026-02-23T06:44:40.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.495+0000 7f1f9cf87640 1 --2- 10.20.193.58:0/69467974 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1f6807a5b0 0x7f1f6809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:40.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.495+0000 7f1f9cf87640 1 --2- 10.20.193.58:0/69467974 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1f6807a5b0 0x7f1f6809aa60 secure :-1 s=READY pgs=501 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f88002b30 tx=0x7f1f880030e0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:40.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.496+0000 7f1f8d7fa640 1 -- 10.20.193.58:0/69467974 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f1f80061490 con 0x7f1f981405d0 2026-02-23T06:44:40.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.651+0000 7f1f9df89640 1 -- 10.20.193.58:0/69467974 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1f980b2e80 con 0x7f1f981405d0 2026-02-23T06:44:40.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.652+0000 7f1f8d7fa640 1 -- 10.20.193.58:0/69467974 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f1f800645b0 con 0x7f1f981405d0 2026-02-23T06:44:40.647 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":202,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:44:40.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.653+0000 7f1f9df89640 1 -- 10.20.193.58:0/69467974 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1f6807a5b0 msgr2=0x7f1f6809aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:40.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.653+0000 7f1f9df89640 1 --2- 10.20.193.58:0/69467974 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1f6807a5b0 0x7f1f6809aa60 secure :-1 s=READY pgs=501 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f88002b30 tx=0x7f1f880030e0 comp rx=0 tx=0).stop 2026-02-23T06:44:40.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.653+0000 7f1f9df89640 1 -- 10.20.193.58:0/69467974 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1f981405d0 msgr2=0x7f1f9813a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:40.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.653+0000 7f1f9df89640 1 --2- 10.20.193.58:0/69467974 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1f981405d0 0x7f1f9813a6f0 secure :-1 s=READY pgs=39 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f80011a60 tx=0x7f1f80011f30 comp rx=0 tx=0).stop 2026-02-23T06:44:40.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.653+0000 7f1f9df89640 1 -- 10.20.193.58:0/69467974 shutdown_connections 2026-02-23T06:44:40.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.653+0000 7f1f9df89640 1 --2- 10.20.193.58:0/69467974 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1f6807a5b0 0x7f1f6809aa60 unknown :-1 s=CLOSED pgs=501 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:40.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.653+0000 7f1f9df89640 1 --2- 10.20.193.58:0/69467974 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1f98140a00 0x7f1f9813ac30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:40.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.653+0000 7f1f9df89640 1 --2- 10.20.193.58:0/69467974 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1f981405d0 0x7f1f9813a6f0 unknown :-1 s=CLOSED pgs=39 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:40.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.653+0000 7f1f9df89640 1 --2- 10.20.193.58:0/69467974 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1f84003a80 0x7f1f98058a70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:40.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.653+0000 7f1f9df89640 1 -- 10.20.193.58:0/69467974 >> 10.20.193.58:0/69467974 conn(0x7f1f98054390 msgr2=0x7f1f981611b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:40.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.653+0000 7f1f9df89640 1 -- 10.20.193.58:0/69467974 shutdown_connections 2026-02-23T06:44:40.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:40.653+0000 7f1f9df89640 1 -- 10.20.193.58:0/69467974 wait complete. 2026-02-23T06:44:43.661 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:44:43.782 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.787+0000 7f523e843640 1 -- 10.20.193.58:0/4035878923 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f523815d470 msgr2=0x7f52380b2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:43.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.787+0000 7f523e843640 1 --2- 10.20.193.58:0/4035878923 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f523815d470 0x7f52380b2c80 secure :-1 s=READY pgs=74 gs=3 cs=0 l=1 c_cookie=11958102520314428515 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5228009890 tx=0x7f522802f200 comp rx=0 tx=0).stop 2026-02-23T06:44:43.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.787+0000 7f523e843640 1 -- 10.20.193.58:0/4035878923 shutdown_connections 2026-02-23T06:44:43.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.787+0000 7f523e843640 1 --2- 10.20.193.58:0/4035878923 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f523815d470 0x7f52380b2c80 unknown :-1 s=CLOSED pgs=74 gs=3 cs=0 l=1 c_cookie=11958102520314428515 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:43.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.787+0000 7f523e843640 1 -- 10.20.193.58:0/4035878923 >> 10.20.193.58:0/4035878923 conn(0x7f5238057d10 msgr2=0x7f5238058110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:43.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.787+0000 7f523e843640 1 -- 10.20.193.58:0/4035878923 shutdown_connections 2026-02-23T06:44:43.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.787+0000 7f523e843640 1 -- 10.20.193.58:0/4035878923 wait complete. 2026-02-23T06:44:43.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.788+0000 7f523e843640 1 Processor -- start 2026-02-23T06:44:43.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.788+0000 7f523e843640 1 -- start start 2026-02-23T06:44:43.786 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.789+0000 7f523e843640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f523805a190 0x7f52381645f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:43.786 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.789+0000 7f523e843640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f52380aeed0 0x7f52380b39c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:43.786 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.789+0000 7f523e843640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f523815d470 0x7f5238165420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:43.786 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.789+0000 7f523e843640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f5238165000 con 0x7f523815d470 2026-02-23T06:44:43.786 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.789+0000 7f523e843640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f52380b4560 con 0x7f523805a190 2026-02-23T06:44:43.786 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.789+0000 7f523e843640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f52382023c0 con 0x7f52380aeed0 2026-02-23T06:44:43.786 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.789+0000 7f523d841640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f523805a190 msgr2=0x7f52381645f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:44:43.786 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.789+0000 7f523d841640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f523805a190 0x7f52381645f0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:44:43.786 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.789+0000 7f523e042640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f523815d470 0x7f5238165420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:43.786 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.789+0000 7f523e042640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f523815d470 0x7f5238165420 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:59970/0 (socket says 10.20.193.58:59970) 2026-02-23T06:44:43.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.789+0000 7f523d040640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f52380aeed0 0x7f52380b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:43.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.789+0000 7f523e042640 1 -- 10.20.193.58:0/3574103094 learned_addr learned my addr 10.20.193.58:0/3574103094 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:44:43.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.789+0000 7f523e042640 1 -- 10.20.193.58:0/3574103094 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f52380aeed0 msgr2=0x7f52380b39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:43.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.789+0000 7f523e042640 1 --2- 10.20.193.58:0/3574103094 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f52380aeed0 0x7f52380b39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:43.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.789+0000 7f523e042640 1 -- 10.20.193.58:0/3574103094 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f523805a190 msgr2=0x7f52381645f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:44:43.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.789+0000 7f523e042640 1 --2- 10.20.193.58:0/3574103094 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f523805a190 0x7f52381645f0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:43.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.789+0000 7f523e042640 1 -- 10.20.193.58:0/3574103094 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52280094b0 con 0x7f523815d470 2026-02-23T06:44:43.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.789+0000 7f523e042640 1 --2- 10.20.193.58:0/3574103094 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f523815d470 0x7f5238165420 secure :-1 s=READY pgs=42 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f523400c520 tx=0x7f523400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:43.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.790+0000 7f52267fc640 1 -- 10.20.193.58:0/3574103094 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5234003d60 con 0x7f523815d470 2026-02-23T06:44:43.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.790+0000 7f523e843640 1 -- 10.20.193.58:0/3574103094 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52381661e0 con 0x7f523815d470 2026-02-23T06:44:43.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.790+0000 7f52267fc640 1 -- 10.20.193.58:0/3574103094 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5234005070 con 0x7f523815d470 2026-02-23T06:44:43.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.790+0000 7f52267fc640 1 -- 10.20.193.58:0/3574103094 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5234003d60 con 0x7f523815d470 2026-02-23T06:44:43.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.790+0000 7f523e843640 1 -- 10.20.193.58:0/3574103094 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5238164c20 con 0x7f523815d470 2026-02-23T06:44:43.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.790+0000 7f523e843640 1 -- 10.20.193.58:0/3574103094 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5238165140 con 0x7f523815d470 2026-02-23T06:44:43.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.791+0000 7f52267fc640 1 -- 10.20.193.58:0/3574103094 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f523400e040 con 0x7f523815d470 2026-02-23T06:44:43.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.792+0000 7f52267fc640 1 --2- 10.20.193.58:0/3574103094 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f520807a610 0x7f520809aac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:43.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.792+0000 7f52267fc640 1 -- 10.20.193.58:0/3574103094 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f523409df20 con 0x7f523815d470 2026-02-23T06:44:43.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.793+0000 7f523d841640 1 --2- 10.20.193.58:0/3574103094 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f520807a610 0x7f520809aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:43.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.793+0000 7f523d841640 1 --2- 10.20.193.58:0/3574103094 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f520807a610 0x7f520809aac0 secure :-1 s=READY pgs=502 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5228004740 tx=0x7f5228031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:43.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.795+0000 7f52267fc640 1 -- 10.20.193.58:0/3574103094 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f5238165140 con 0x7f523815d470 2026-02-23T06:44:43.947 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.952+0000 7f523e843640 1 -- 10.20.193.58:0/3574103094 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5238165140 con 0x7f523815d470 2026-02-23T06:44:43.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.952+0000 7f52267fc640 1 -- 10.20.193.58:0/3574103094 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f5238165140 con 0x7f523815d470 2026-02-23T06:44:43.948 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":202,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:44:43.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.953+0000 7f523e843640 1 -- 10.20.193.58:0/3574103094 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f520807a610 msgr2=0x7f520809aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:43.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.953+0000 7f523e843640 1 --2- 10.20.193.58:0/3574103094 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f520807a610 0x7f520809aac0 secure :-1 s=READY pgs=502 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5228004740 tx=0x7f5228031040 comp rx=0 tx=0).stop 2026-02-23T06:44:43.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.953+0000 7f523e843640 1 -- 10.20.193.58:0/3574103094 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f523815d470 msgr2=0x7f5238165420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:43.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.953+0000 7f523e843640 1 --2- 10.20.193.58:0/3574103094 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f523815d470 0x7f5238165420 secure :-1 s=READY pgs=42 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f523400c520 tx=0x7f523400c9f0 comp rx=0 tx=0).stop 2026-02-23T06:44:43.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.954+0000 7f523e843640 1 -- 10.20.193.58:0/3574103094 shutdown_connections 2026-02-23T06:44:43.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.954+0000 7f523e843640 1 --2- 10.20.193.58:0/3574103094 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f520807a610 0x7f520809aac0 unknown :-1 s=CLOSED pgs=502 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:43.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.954+0000 7f523e843640 1 --2- 10.20.193.58:0/3574103094 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f523815d470 0x7f5238165420 unknown :-1 s=CLOSED pgs=42 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:43.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.954+0000 7f523e843640 1 --2- 10.20.193.58:0/3574103094 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f52380aeed0 0x7f52380b39c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:43.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.954+0000 7f523e843640 1 --2- 10.20.193.58:0/3574103094 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f523805a190 0x7f52381645f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:43.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.954+0000 7f523e843640 1 -- 10.20.193.58:0/3574103094 >> 10.20.193.58:0/3574103094 conn(0x7f5238057d10 msgr2=0x7f523813c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:43.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.954+0000 7f523e843640 1 -- 10.20.193.58:0/3574103094 shutdown_connections 2026-02-23T06:44:43.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:43.954+0000 7f523e843640 1 -- 10.20.193.58:0/3574103094 wait complete. 2026-02-23T06:44:44.973 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:44:44.978 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:44:46.961 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:44:53.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.088+0000 7fe56eecc640 1 -- 10.20.193.58:0/1939732086 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe54c0246d0 msgr2=0x7fe54c003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:53.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.088+0000 7fe56eecc640 1 --2- 10.20.193.58:0/1939732086 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe54c0246d0 0x7fe54c003b50 secure :-1 s=READY pgs=46 gs=28 cs=0 l=1 c_cookie=4140701486865250435 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe54c024620 tx=0x7fe55802fe10 comp rx=0 tx=0).stop 2026-02-23T06:44:53.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.088+0000 7fe56eecc640 1 -- 10.20.193.58:0/1939732086 shutdown_connections 2026-02-23T06:44:53.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.088+0000 7fe56eecc640 1 --2- 10.20.193.58:0/1939732086 >> v2:10.20.193.93:3300/0 conn(0x7fe54c004090 0x7fe54c0044e0 unknown :-1 s=CLOSED pgs=0 gs=29 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:53.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.088+0000 7fe56eecc640 1 --2- 10.20.193.58:0/1939732086 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe54c0246d0 0x7fe54c003b50 unknown :-1 s=CLOSED pgs=46 gs=28 cs=0 l=1 c_cookie=4140701486865250435 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:53.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.088+0000 7fe56eecc640 1 -- 10.20.193.58:0/1939732086 >> 10.20.193.58:0/1939732086 conn(0x7fe5680561f0 msgr2=0x7fe5680565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:53.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.088+0000 7fe56eecc640 1 -- 10.20.193.58:0/1939732086 shutdown_connections 2026-02-23T06:44:53.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.088+0000 7fe56eecc640 1 -- 10.20.193.58:0/1939732086 wait complete. 2026-02-23T06:44:53.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.089+0000 7fe56eecc640 1 Processor -- start 2026-02-23T06:44:53.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.090+0000 7fe56eecc640 1 -- start start 2026-02-23T06:44:53.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.090+0000 7fe56eecc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe54c004090 0x7fe568164400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:53.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.090+0000 7fe56eecc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe54c004a50 0x7fe5680b3080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:53.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.090+0000 7fe56eecc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe54c0246d0 0x7fe568139be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:53.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.090+0000 7fe56eecc640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe568138e50 con 0x7fe54c004a50 2026-02-23T06:44:53.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.090+0000 7fe56eecc640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe568165c20 con 0x7fe54c0246d0 2026-02-23T06:44:53.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.090+0000 7fe56eecc640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe568165680 con 0x7fe54c004090 2026-02-23T06:44:53.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.090+0000 7fe56d442640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe54c0246d0 msgr2=0x7fe568139be0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:44:53.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.090+0000 7fe56d442640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe54c0246d0 0x7fe568139be0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:44:53.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.090+0000 7fe55ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe54c004a50 0x7fe5680b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:53.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.090+0000 7fe56cc41640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe54c004090 0x7fe568164400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:53.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.090+0000 7fe55ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe54c004a50 0x7fe5680b3080 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:59844/0 (socket says 10.20.193.58:59844) 2026-02-23T06:44:53.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.090+0000 7fe55ffff640 1 -- 10.20.193.58:0/3322711122 learned_addr learned my addr 10.20.193.58:0/3322711122 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:44:53.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.091+0000 7fe55ffff640 1 -- 10.20.193.58:0/3322711122 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe54c004090 msgr2=0x7fe568164400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:53.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.091+0000 7fe55ffff640 1 --2- 10.20.193.58:0/3322711122 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe54c004090 0x7fe568164400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:53.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.091+0000 7fe55ffff640 1 -- 10.20.193.58:0/3322711122 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe54c0246d0 msgr2=0x7fe568139be0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:44:53.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.091+0000 7fe55ffff640 1 --2- 10.20.193.58:0/3322711122 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe54c0246d0 0x7fe568139be0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:53.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.091+0000 7fe55ffff640 1 -- 10.20.193.58:0/3322711122 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe558002d60 con 0x7fe54c004a50 2026-02-23T06:44:53.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.091+0000 7fe55ffff640 1 --2- 10.20.193.58:0/3322711122 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe54c004a50 0x7fe5680b3080 secure :-1 s=READY pgs=47 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe550010940 tx=0x7fe550010e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:53.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.091+0000 7fe55d7fa640 1 -- 10.20.193.58:0/3322711122 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe550017070 con 0x7fe54c004a50 2026-02-23T06:44:53.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.091+0000 7fe55d7fa640 1 -- 10.20.193.58:0/3322711122 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe55000e8d0 con 0x7fe54c004a50 2026-02-23T06:44:53.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.091+0000 7fe55d7fa640 1 -- 10.20.193.58:0/3322711122 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe55000ed00 con 0x7fe54c004a50 2026-02-23T06:44:53.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.091+0000 7fe56eecc640 1 -- 10.20.193.58:0/3322711122 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe568141ad0 con 0x7fe54c004a50 2026-02-23T06:44:53.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.091+0000 7fe56eecc640 1 -- 10.20.193.58:0/3322711122 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe568165940 con 0x7fe54c004a50 2026-02-23T06:44:53.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.092+0000 7fe56eecc640 1 -- 10.20.193.58:0/3322711122 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe568058640 con 0x7fe54c004a50 2026-02-23T06:44:53.088 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.093+0000 7fe55d7fa640 1 -- 10.20.193.58:0/3322711122 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fe550023060 con 0x7fe54c004a50 2026-02-23T06:44:53.089 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.094+0000 7fe55d7fa640 1 --2- 10.20.193.58:0/3322711122 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe53807a5a0 0x7fe53809aa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:53.089 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.094+0000 7fe55d7fa640 1 -- 10.20.193.58:0/3322711122 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fe55009daf0 con 0x7fe54c004a50 2026-02-23T06:44:53.089 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.094+0000 7fe56cc41640 1 --2- 10.20.193.58:0/3322711122 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe53807a5a0 0x7fe53809aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:53.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.095+0000 7fe56cc41640 1 --2- 10.20.193.58:0/3322711122 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe53807a5a0 0x7fe53809aa50 secure :-1 s=READY pgs=503 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe5580023d0 tx=0x7fe558009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:53.091 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.096+0000 7fe55d7fa640 1 -- 10.20.193.58:0/3322711122 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fe550060c00 con 0x7fe54c004a50 2026-02-23T06:44:53.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.251+0000 7fe56eecc640 1 -- 10.20.193.58:0/3322711122 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe5680b14b0 con 0x7fe54c004a50 2026-02-23T06:44:53.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.251+0000 7fe55d7fa640 1 -- 10.20.193.58:0/3322711122 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1749 (secure 0 0 0) 0x7fe550063d20 con 0x7fe54c004a50 2026-02-23T06:44:53.247 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":206,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:44:53.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.252+0000 7fe56eecc640 1 -- 10.20.193.58:0/3322711122 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe53807a5a0 msgr2=0x7fe53809aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:53.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.252+0000 7fe56eecc640 1 --2- 10.20.193.58:0/3322711122 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe53807a5a0 0x7fe53809aa50 secure :-1 s=READY pgs=503 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe5580023d0 tx=0x7fe558009040 comp rx=0 tx=0).stop 2026-02-23T06:44:53.249 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.252+0000 7fe56eecc640 1 -- 10.20.193.58:0/3322711122 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe54c004a50 msgr2=0x7fe5680b3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:53.249 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.252+0000 7fe56eecc640 1 --2- 10.20.193.58:0/3322711122 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe54c004a50 0x7fe5680b3080 secure :-1 s=READY pgs=47 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe550010940 tx=0x7fe550010e10 comp rx=0 tx=0).stop 2026-02-23T06:44:53.249 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.252+0000 7fe56eecc640 1 -- 10.20.193.58:0/3322711122 shutdown_connections 2026-02-23T06:44:53.249 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.252+0000 7fe56eecc640 1 --2- 10.20.193.58:0/3322711122 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe53807a5a0 0x7fe53809aa50 unknown :-1 s=CLOSED pgs=503 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:53.249 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.252+0000 7fe56eecc640 1 --2- 10.20.193.58:0/3322711122 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe54c0246d0 0x7fe568139be0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:53.249 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.252+0000 7fe56eecc640 1 --2- 10.20.193.58:0/3322711122 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe54c004a50 0x7fe5680b3080 unknown :-1 s=CLOSED pgs=47 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:53.249 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.252+0000 7fe56eecc640 1 --2- 10.20.193.58:0/3322711122 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe54c004090 0x7fe568164400 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:53.249 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.252+0000 7fe56eecc640 1 -- 10.20.193.58:0/3322711122 >> 10.20.193.58:0/3322711122 conn(0x7fe5680561f0 msgr2=0x7fe56805d430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:53.249 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.252+0000 7fe56eecc640 1 -- 10.20.193.58:0/3322711122 shutdown_connections 2026-02-23T06:44:53.249 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.252+0000 7fe56eecc640 1 -- 10.20.193.58:0/3322711122 wait complete. 2026-02-23T06:44:53.261 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:44:53.261 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-23T06:44:53.262 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:44:53.382 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.387+0000 7fc76ce83640 1 -- 10.20.193.58:0/3219516599 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7680b5680 msgr2=0x7fc7680b5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:53.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.387+0000 7fc76ce83640 1 --2- 10.20.193.58:0/3219516599 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7680b5680 0x7fc7680b5ac0 secure :-1 s=READY pgs=49 gs=2 cs=0 l=1 c_cookie=2332223066916277142 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7680b5010 tx=0x7fc75c030360 comp rx=0 tx=0).stop 2026-02-23T06:44:53.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.387+0000 7fc76ce83640 1 -- 10.20.193.58:0/3219516599 shutdown_connections 2026-02-23T06:44:53.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.387+0000 7fc76ce83640 1 --2- 10.20.193.58:0/3219516599 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7680b5680 0x7fc7680b5ac0 unknown :-1 s=CLOSED pgs=49 gs=2 cs=0 l=1 c_cookie=2332223066916277142 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:53.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.387+0000 7fc76ce83640 1 --2- 10.20.193.58:0/3219516599 >> v2:10.20.193.93:3300/0 conn(0x7fc76815c040 0x7fc76805b0e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:53.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.387+0000 7fc76ce83640 1 -- 10.20.193.58:0/3219516599 >> 10.20.193.58:0/3219516599 conn(0x7fc7680b3c20 msgr2=0x7fc7680b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:53.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.387+0000 7fc76ce83640 1 -- 10.20.193.58:0/3219516599 shutdown_connections 2026-02-23T06:44:53.383 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.387+0000 7fc76ce83640 1 -- 10.20.193.58:0/3219516599 wait complete. 2026-02-23T06:44:53.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.388+0000 7fc76ce83640 1 Processor -- start 2026-02-23T06:44:53.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.388+0000 7fc76ce83640 1 -- start start 2026-02-23T06:44:53.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.389+0000 7fc76ce83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc768056550 0x7fc7680b1600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:53.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.389+0000 7fc76ce83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc7680b5680 0x7fc7680b0010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:53.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.389+0000 7fc76ce83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc76815c040 0x7fc768201120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:53.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.389+0000 7fc76ce83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc7680b0ef0 con 0x7fc768056550 2026-02-23T06:44:53.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.389+0000 7fc76ce83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc7680b0920 con 0x7fc7680b5680 2026-02-23T06:44:53.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.389+0000 7fc76ce83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc768059000 con 0x7fc76815c040 2026-02-23T06:44:53.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.389+0000 7fc766ffd640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc7680b5680 msgr2=0x7fc7680b0010 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:44:53.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.389+0000 7fc766ffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc7680b5680 0x7fc7680b0010 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:44:53.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.389+0000 7fc7677fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc768056550 0x7fc7680b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:53.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.389+0000 7fc7677fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc768056550 0x7fc7680b1600 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:59862/0 (socket says 10.20.193.58:59862) 2026-02-23T06:44:53.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.389+0000 7fc7677fe640 1 -- 10.20.193.58:0/840553017 learned_addr learned my addr 10.20.193.58:0/840553017 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:44:53.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.389+0000 7fc767fff640 1 --2- 10.20.193.58:0/840553017 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc76815c040 0x7fc768201120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:53.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.389+0000 7fc7677fe640 1 -- 10.20.193.58:0/840553017 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc76815c040 msgr2=0x7fc768201120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:53.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.389+0000 7fc7677fe640 1 --2- 10.20.193.58:0/840553017 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc76815c040 0x7fc768201120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:53.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.389+0000 7fc7677fe640 1 -- 10.20.193.58:0/840553017 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc7680b5680 msgr2=0x7fc7680b0010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:44:53.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.389+0000 7fc7677fe640 1 --2- 10.20.193.58:0/840553017 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc7680b5680 0x7fc7680b0010 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:53.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.389+0000 7fc7677fe640 1 -- 10.20.193.58:0/840553017 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75c00a650 con 0x7fc768056550 2026-02-23T06:44:53.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.389+0000 7fc767fff640 1 --2- 10.20.193.58:0/840553017 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc76815c040 0x7fc768201120 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:44:53.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.389+0000 7fc7677fe640 1 --2- 10.20.193.58:0/840553017 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc768056550 0x7fc7680b1600 secure :-1 s=READY pgs=50 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc754006fd0 tx=0x7fc75400bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:53.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.389+0000 7fc743fff640 1 -- 10.20.193.58:0/840553017 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc754002cd0 con 0x7fc768056550 2026-02-23T06:44:53.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.389+0000 7fc743fff640 1 -- 10.20.193.58:0/840553017 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc754004070 con 0x7fc768056550 2026-02-23T06:44:53.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.389+0000 7fc743fff640 1 -- 10.20.193.58:0/840553017 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc754004460 con 0x7fc768056550 2026-02-23T06:44:53.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.389+0000 7fc76ce83640 1 -- 10.20.193.58:0/840553017 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc768155760 con 0x7fc768056550 2026-02-23T06:44:53.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.390+0000 7fc76ce83640 1 -- 10.20.193.58:0/840553017 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7680b1310 con 0x7fc768056550 2026-02-23T06:44:53.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.390+0000 7fc76ce83640 1 --2- 10.20.193.58:0/840553017 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc768201660 0x7fc768151b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:53.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.390+0000 7fc76ce83640 1 -- 10.20.193.58:0/840553017 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc76805b620 con 0x7fc768201660 2026-02-23T06:44:53.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.390+0000 7fc766ffd640 1 --2- 10.20.193.58:0/840553017 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc768201660 0x7fc768151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:53.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.390+0000 7fc766ffd640 1 -- 10.20.193.58:0/840553017 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc768166120 con 0x7fc768201660 2026-02-23T06:44:53.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.391+0000 7fc766ffd640 1 --2- 10.20.193.58:0/840553017 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc768201660 0x7fc768151b90 secure :-1 s=READY pgs=51 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7681fece0 tx=0x7fc75800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:53.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.391+0000 7fc743fff640 1 -- 10.20.193.58:0/840553017 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc758005cb0 con 0x7fc768201660 2026-02-23T06:44:53.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.391+0000 7fc743fff640 1 -- 10.20.193.58:0/840553017 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fc758005e10 con 0x7fc768201660 2026-02-23T06:44:53.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.391+0000 7fc743fff640 1 -- 10.20.193.58:0/840553017 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc768201660 msgr2=0x7fc768151b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:53.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.391+0000 7fc743fff640 1 --2- 10.20.193.58:0/840553017 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc768201660 0x7fc768151b90 secure :-1 s=READY pgs=51 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7681fece0 tx=0x7fc75800c7b0 comp rx=0 tx=0).stop 2026-02-23T06:44:53.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.391+0000 7fc743fff640 1 -- 10.20.193.58:0/840553017 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc768201660 msgr2=0x7fc768151b90 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:44:53.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.391+0000 7fc743fff640 1 --2- 10.20.193.58:0/840553017 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc768201660 0x7fc768151b90 secure :-1 s=CLOSED pgs=51 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7681fece0 tx=0x7fc75800c7b0 comp rx=0 tx=0).stop 2026-02-23T06:44:53.391 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.391+0000 7fc743fff640 1 -- 10.20.193.58:0/840553017 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fc7540045c0 con 0x7fc768056550 2026-02-23T06:44:53.391 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.392+0000 7fc743fff640 1 --2- 10.20.193.58:0/840553017 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc73807a430 0x7fc73809a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:53.391 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.392+0000 7fc743fff640 1 -- 10.20.193.58:0/840553017 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fc75409d0c0 con 0x7fc768056550 2026-02-23T06:44:53.391 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.392+0000 7fc766ffd640 1 --2- 10.20.193.58:0/840553017 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc73807a430 0x7fc73809a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:53.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.393+0000 7fc766ffd640 1 --2- 10.20.193.58:0/840553017 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc73807a430 0x7fc73809a8e0 secure :-1 s=READY pgs=504 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc75800c7f0 tx=0x7fc758007f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:53.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.394+0000 7fc76ce83640 1 --2- 10.20.193.58:0/840553017 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc768162c70 0x7fc7680aeab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:53.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.394+0000 7fc76ce83640 1 -- 10.20.193.58:0/840553017 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc768163040 con 0x7fc768162c70 2026-02-23T06:44:53.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.394+0000 7fc767fff640 1 --2- 10.20.193.58:0/840553017 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc768162c70 0x7fc7680aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:53.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.395+0000 7fc767fff640 1 -- 10.20.193.58:0/840553017 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc76805d9c0 con 0x7fc768162c70 2026-02-23T06:44:53.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.395+0000 7fc767fff640 1 --2- 10.20.193.58:0/840553017 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc768162c70 0x7fc7680aeab0 secure :-1 s=READY pgs=52 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc75c00a230 tx=0x7fc75c003d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:53.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.395+0000 7fc743fff640 1 -- 10.20.193.58:0/840553017 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc75c046070 con 0x7fc768162c70 2026-02-23T06:44:53.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.395+0000 7fc743fff640 1 -- 10.20.193.58:0/840553017 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5236 (secure 0 0 0) 0x7fc75c039680 con 0x7fc768162c70 2026-02-23T06:44:53.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.395+0000 7fc743fff640 1 -- 10.20.193.58:0/840553017 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc768162c70 msgr2=0x7fc7680aeab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:53.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.395+0000 7fc743fff640 1 --2- 10.20.193.58:0/840553017 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc768162c70 0x7fc7680aeab0 secure :-1 s=READY pgs=52 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc75c00a230 tx=0x7fc75c003d20 comp rx=0 tx=0).stop 2026-02-23T06:44:53.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.395+0000 7fc743fff640 1 -- 10.20.193.58:0/840553017 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc768162c70 msgr2=0x7fc7680aeab0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:44:53.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.395+0000 7fc743fff640 1 --2- 10.20.193.58:0/840553017 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc768162c70 0x7fc7680aeab0 secure :-1 s=CLOSED pgs=52 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc75c00a230 tx=0x7fc75c003d20 comp rx=0 tx=0).stop 2026-02-23T06:44:53.394 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:44:53.394 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:44:53.394 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:44:53.394 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:44:53.394 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 206, 2026-02-23T06:44:53.395 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 43067, 2026-02-23T06:44:53.395 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:44:53.395 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:44:53.395 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:44:53.395 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:53.395 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 1, 2026-02-23T06:44:53.395 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:44:53.395 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:44:53.395 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:44:53.395 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:44:53.395 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:44:53.395 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:44:53.396 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:44:53.396 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:44:53.396 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:44:53.396 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:44:53.396 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:44:53.396 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:44:53.396 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:44:53.396 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:44:53.397 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:44:53.397 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:44:53.397 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:53.397 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:44:53.397 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:44:53.397 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:44:53.398 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:44:53.398 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:44:53.398 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:44:53.398 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:44:53.398 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:44:53.398 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:44:53.398 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:44:53.399 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:44:53.399 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:44:53.399 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:44:53.399 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:44:53.399 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:44:53.399 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:53.399 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:53.399 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:44:53.399 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:44:53.399 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:44:53.400 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:44:53.400 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:44:53.400 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:44:53.400 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:44:53.400 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:44:53.400 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:44:53.400 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:44:53.400 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:44:53.400 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:44:53.400 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:44:53.400 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:44:53.401 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:44:53.401 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:44:53.401 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:44:53.401 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:44:53.401 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:44:53.401 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:44:53.401 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:44:53.401 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:44:53.401 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:44:53.401 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:44:53.401 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:44:53.402 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:44:53.402 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:44:53.402 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:44:53.402 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:44:53.402 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:44:53.402 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:53.402 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:44:53.402 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:53.402 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:44:53.402 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:53.402 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:44:53.402 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:44:53.403 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:44:53.403 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:44:53.403 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:53.403 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:44:53.403 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:44:53.403 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:53.403 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:53.403 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:53.403 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:44:53.403 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:44:53.403 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:53.403 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:53.404 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:53.404 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:53.404 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:44:53.404 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:44:53.404 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:44:53.404 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:44:53.404 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:44:53.404 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:44:53.404 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:53.404 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:53.404 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:44:53.405 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:44:53.405 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:44:53.405 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:44:53.405 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:53.405 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:44:53.405 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:44:53.405 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:53.405 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:53.405 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:53.405 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:44:53.405 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:44:53.405 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:53.406 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:53.406 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:53.406 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:53.406 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:44:53.406 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:44:53.406 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:44:53.406 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:44:53.406 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:44:53.406 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:44:53.406 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:53.406 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:53.406 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:44:53.406 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:44:53.407 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:44:53.407 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:44:53.407 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:53.407 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:44:53.407 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:44:53.407 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:53.407 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:53.407 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:53.407 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:44:53.407 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:44:53.407 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:53.407 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:53.408 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:53.408 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:53.408 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:44:53.408 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:44:53.408 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:44:53.408 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:44:53.408 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:44:53.408 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:44:53.408 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:53.408 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:53.408 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:53.408 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:44:53.409 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:44:53.409 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:53.409 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:53.409 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:53.409 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:44:53.409 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:53.409 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:53.409 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:44:53.409 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:53.409 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:53.409 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:53.410 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:44:53.410 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:53.410 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:53.410 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:44:53.410 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:53.410 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:53.410 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:53.410 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:44:53.410 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:53.410 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:53.410 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:44:53.410 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:53.410 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:53.411 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:53.411 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:44:53.411 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:53.411 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:53.411 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:53.411 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:44:53.411 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:44:53.413 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.395+0000 7fc76ce83640 1 -- 10.20.193.58:0/840553017 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc73807a430 msgr2=0x7fc73809a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:53.413 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.395+0000 7fc76ce83640 1 --2- 10.20.193.58:0/840553017 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc73807a430 0x7fc73809a8e0 secure :-1 s=READY pgs=504 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc75800c7f0 tx=0x7fc758007f90 comp rx=0 tx=0).stop 2026-02-23T06:44:53.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.395+0000 7fc76ce83640 1 -- 10.20.193.58:0/840553017 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc768056550 msgr2=0x7fc7680b1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:53.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.395+0000 7fc76ce83640 1 --2- 10.20.193.58:0/840553017 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc768056550 0x7fc7680b1600 secure :-1 s=READY pgs=50 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc754006fd0 tx=0x7fc75400bbf0 comp rx=0 tx=0).stop 2026-02-23T06:44:53.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.395+0000 7fc767fff640 1 -- 10.20.193.58:0/840553017 reap_dead start 2026-02-23T06:44:53.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.395+0000 7fc76ce83640 1 -- 10.20.193.58:0/840553017 shutdown_connections 2026-02-23T06:44:53.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.395+0000 7fc76ce83640 1 --2- 10.20.193.58:0/840553017 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc768056550 0x7fc7680b1600 unknown :-1 s=CLOSED pgs=50 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:53.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.395+0000 7fc76ce83640 1 -- 10.20.193.58:0/840553017 >> 10.20.193.58:0/840553017 conn(0x7fc7680b3c20 msgr2=0x7fc768164ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:53.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.396+0000 7fc76ce83640 1 -- 10.20.193.58:0/840553017 shutdown_connections 2026-02-23T06:44:53.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.396+0000 7fc76ce83640 1 -- 10.20.193.58:0/840553017 wait complete. 2026-02-23T06:44:53.415 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:44:53.415 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-23T06:44:53.415 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:44:53.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.541+0000 7f94bd883640 1 -- 10.20.193.58:0/4214080116 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94b80b9e50 msgr2=0x7f94b8165630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:53.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.541+0000 7f94bd883640 1 --2- 10.20.193.58:0/4214080116 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94b80b9e50 0x7f94b8165630 secure :-1 s=READY pgs=76 gs=2 cs=0 l=1 c_cookie=16680516919863540468 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94a8005e70 tx=0x7f94a802f340 comp rx=0 tx=0).stop 2026-02-23T06:44:53.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.541+0000 7f94bd883640 1 -- 10.20.193.58:0/4214080116 shutdown_connections 2026-02-23T06:44:53.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.541+0000 7f94bd883640 1 --2- 10.20.193.58:0/4214080116 >> v2:10.20.193.93:3300/0 conn(0x7f94b80b4220 0x7f94b8169700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:53.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.541+0000 7f94bd883640 1 --2- 10.20.193.58:0/4214080116 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94b80b9e50 0x7f94b8165630 unknown :-1 s=CLOSED pgs=76 gs=2 cs=0 l=1 c_cookie=16680516919863540468 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:53.538 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.541+0000 7f94bd883640 1 -- 10.20.193.58:0/4214080116 >> 10.20.193.58:0/4214080116 conn(0x7f94b80b65c0 msgr2=0x7f94b80b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:53.538 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.541+0000 7f94bd883640 1 -- 10.20.193.58:0/4214080116 shutdown_connections 2026-02-23T06:44:53.538 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.541+0000 7f94bd883640 1 -- 10.20.193.58:0/4214080116 wait complete. 2026-02-23T06:44:53.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.542+0000 7f94bd883640 1 Processor -- start 2026-02-23T06:44:53.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.543+0000 7f94bd883640 1 -- start start 2026-02-23T06:44:53.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.543+0000 7f94bd883640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f94b80b4220 0x7f94b81634a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:53.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.543+0000 7f94bd883640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f94b80b9e50 0x7f94b81667f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:53.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.543+0000 7f94bd883640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94b80ba220 0x7f94b8121270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:53.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.543+0000 7f94bd883640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f94b8165500 con 0x7f94b80b4220 2026-02-23T06:44:53.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.543+0000 7f94bd883640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f94b81406d0 con 0x7f94b80b9e50 2026-02-23T06:44:53.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.543+0000 7f94bd883640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f94b81419b0 con 0x7f94b80ba220 2026-02-23T06:44:53.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.543+0000 7f94affff640 1 -- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f94b80b9e50 msgr2=0x7f94b81667f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3300/0 2026-02-23T06:44:53.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.543+0000 7f94affff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f94b80b9e50 0x7f94b81667f0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:44:53.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.543+0000 7f94bc881640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f94b80b4220 0x7f94b81634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:53.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.543+0000 7f94bd082640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94b80ba220 0x7f94b8121270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:53.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.543+0000 7f94bc881640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f94b80b4220 0x7f94b81634a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:59904/0 (socket says 10.20.193.58:59904) 2026-02-23T06:44:53.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.543+0000 7f94bc881640 1 -- 10.20.193.58:0/1634278920 learned_addr learned my addr 10.20.193.58:0/1634278920 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:44:53.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.544+0000 7f94bc881640 1 -- 10.20.193.58:0/1634278920 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94b80ba220 msgr2=0x7f94b8121270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:53.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.544+0000 7f94bc881640 1 --2- 10.20.193.58:0/1634278920 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94b80ba220 0x7f94b8121270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:53.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.544+0000 7f94bc881640 1 -- 10.20.193.58:0/1634278920 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f94b80b9e50 msgr2=0x7f94b81667f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:44:53.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.544+0000 7f94bc881640 1 --2- 10.20.193.58:0/1634278920 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f94b80b9e50 0x7f94b81667f0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:53.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.544+0000 7f94bc881640 1 -- 10.20.193.58:0/1634278920 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94a8009570 con 0x7f94b80b4220 2026-02-23T06:44:53.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.544+0000 7f94bd082640 1 --2- 10.20.193.58:0/1634278920 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94b80ba220 0x7f94b8121270 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:44:53.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.544+0000 7f94bc881640 1 --2- 10.20.193.58:0/1634278920 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f94b80b4220 0x7f94b81634a0 secure :-1 s=READY pgs=53 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94a8009a20 tx=0x7f94a8002a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:53.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.544+0000 7f94ad7fa640 1 -- 10.20.193.58:0/1634278920 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94a803d070 con 0x7f94b80b4220 2026-02-23T06:44:53.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.544+0000 7f94ad7fa640 1 -- 10.20.193.58:0/1634278920 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94a8004a70 con 0x7f94b80b4220 2026-02-23T06:44:53.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.544+0000 7f94ad7fa640 1 -- 10.20.193.58:0/1634278920 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94a8004e60 con 0x7f94b80b4220 2026-02-23T06:44:53.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.544+0000 7f94bd883640 1 -- 10.20.193.58:0/1634278920 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b8168cd0 con 0x7f94b80b4220 2026-02-23T06:44:53.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.544+0000 7f94bd883640 1 -- 10.20.193.58:0/1634278920 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b8140110 con 0x7f94b80b4220 2026-02-23T06:44:53.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.545+0000 7f94bd883640 1 --2- 10.20.193.58:0/1634278920 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94b813f940 0x7f94b81217b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:53.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.545+0000 7f94bd883640 1 -- 10.20.193.58:0/1634278920 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f94b81691e0 con 0x7f94b813f940 2026-02-23T06:44:53.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.545+0000 7f94affff640 1 --2- 10.20.193.58:0/1634278920 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94b813f940 0x7f94b81217b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:53.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.545+0000 7f94affff640 1 -- 10.20.193.58:0/1634278920 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f94b80b8ac0 con 0x7f94b813f940 2026-02-23T06:44:53.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.545+0000 7f94affff640 1 --2- 10.20.193.58:0/1634278920 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94b813f940 0x7f94b81217b0 secure :-1 s=READY pgs=77 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94b81426c0 tx=0x7f94a000b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:53.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.545+0000 7f94ad7fa640 1 -- 10.20.193.58:0/1634278920 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94a0003e20 con 0x7f94b813f940 2026-02-23T06:44:53.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.546+0000 7f94ad7fa640 1 -- 10.20.193.58:0/1634278920 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f94a00050f0 con 0x7f94b813f940 2026-02-23T06:44:53.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.546+0000 7f94ad7fa640 1 -- 10.20.193.58:0/1634278920 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94b813f940 msgr2=0x7f94b81217b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:53.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.546+0000 7f94ad7fa640 1 --2- 10.20.193.58:0/1634278920 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94b813f940 0x7f94b81217b0 secure :-1 s=READY pgs=77 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94b81426c0 tx=0x7f94a000b8f0 comp rx=0 tx=0).stop 2026-02-23T06:44:53.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.546+0000 7f94ad7fa640 1 -- 10.20.193.58:0/1634278920 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94b813f940 msgr2=0x7f94b81217b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:44:53.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.546+0000 7f94ad7fa640 1 --2- 10.20.193.58:0/1634278920 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94b813f940 0x7f94b81217b0 secure :-1 s=CLOSED pgs=77 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94b81426c0 tx=0x7f94a000b8f0 comp rx=0 tx=0).stop 2026-02-23T06:44:53.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.547+0000 7f94ad7fa640 1 -- 10.20.193.58:0/1634278920 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f94a8004fc0 con 0x7f94b80b4220 2026-02-23T06:44:53.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.548+0000 7f94ad7fa640 1 --2- 10.20.193.58:0/1634278920 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f948807a430 0x7f948809a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:53.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.548+0000 7f94ad7fa640 1 -- 10.20.193.58:0/1634278920 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f94a80c27c0 con 0x7f94b80b4220 2026-02-23T06:44:53.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.548+0000 7f94affff640 1 --2- 10.20.193.58:0/1634278920 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f948807a430 0x7f948809a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:53.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.549+0000 7f94affff640 1 --2- 10.20.193.58:0/1634278920 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f948807a430 0x7f948809a8e0 secure :-1 s=READY pgs=505 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94a000bfd0 tx=0x7f94a0008030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:53.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.549+0000 7f94bd883640 1 --2- 10.20.193.58:0/1634278920 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94b814d5d0 0x7f94b814ca50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:44:53.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.549+0000 7f94bd883640 1 -- 10.20.193.58:0/1634278920 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f94b814d9a0 con 0x7f94b814d5d0 2026-02-23T06:44:53.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.549+0000 7f94bd082640 1 --2- 10.20.193.58:0/1634278920 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94b814d5d0 0x7f94b814ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:44:53.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.549+0000 7f94bd082640 1 -- 10.20.193.58:0/1634278920 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f94b815fc80 con 0x7f94b814d5d0 2026-02-23T06:44:53.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.550+0000 7f94bd082640 1 --2- 10.20.193.58:0/1634278920 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94b814d5d0 0x7f94b814ca50 secure :-1 s=READY pgs=78 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94b4003900 tx=0x7f94b4005720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:44:53.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.550+0000 7f94ad7fa640 1 -- 10.20.193.58:0/1634278920 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94b400fce0 con 0x7f94b814d5d0 2026-02-23T06:44:53.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.550+0000 7f94ad7fa640 1 -- 10.20.193.58:0/1634278920 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5545 (secure 0 0 0) 0x7f94b400fe40 con 0x7f94b814d5d0 2026-02-23T06:44:53.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.550+0000 7f94ad7fa640 1 -- 10.20.193.58:0/1634278920 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94b814d5d0 msgr2=0x7f94b814ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:53.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.550+0000 7f94ad7fa640 1 --2- 10.20.193.58:0/1634278920 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94b814d5d0 0x7f94b814ca50 secure :-1 s=READY pgs=78 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94b4003900 tx=0x7f94b4005720 comp rx=0 tx=0).stop 2026-02-23T06:44:53.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.550+0000 7f94ad7fa640 1 -- 10.20.193.58:0/1634278920 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94b814d5d0 msgr2=0x7f94b814ca50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:44:53.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.550+0000 7f94ad7fa640 1 --2- 10.20.193.58:0/1634278920 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f94b814d5d0 0x7f94b814ca50 secure :-1 s=CLOSED pgs=78 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94b4003900 tx=0x7f94b4005720 comp rx=0 tx=0).stop 2026-02-23T06:44:53.549 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:44:53.549 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:44:53.550 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:44:53.550 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:44:53.550 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 206, 2026-02-23T06:44:53.550 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 146978, 2026-02-23T06:44:53.550 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:44:53.550 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:44:53.550 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:44:53.551 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:53.551 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 1, 2026-02-23T06:44:53.551 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:44:53.551 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:44:53.551 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:44:53.551 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:44:53.552 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:44:53.552 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:44:53.552 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:44:53.552 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:44:53.552 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:44:53.552 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:44:53.552 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:44:53.553 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:44:53.553 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:44:53.553 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:44:53.553 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:44:53.553 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:44:53.553 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:53.553 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:44:53.553 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:44:53.553 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:44:53.553 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:44:53.553 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:44:53.554 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:44:53.554 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:44:53.554 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:44:53.554 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:44:53.554 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:44:53.554 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:44:53.554 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:44:53.554 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:44:53.554 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:44:53.554 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:44:53.554 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:53.554 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:53.555 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:44:53.555 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:44:53.555 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:44:53.555 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:44:53.555 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:44:53.555 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:44:53.555 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:44:53.555 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:44:53.555 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:44:53.555 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:44:53.555 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:44:53.556 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:44:53.556 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:44:53.556 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:44:53.556 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:44:53.556 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:44:53.556 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:44:53.556 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:44:53.557 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:44:53.557 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:44:53.557 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:44:53.557 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:44:53.557 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:44:53.557 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:44:53.557 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:44:53.557 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:44:53.557 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:44:53.557 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:44:53.557 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:44:53.557 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:44:53.558 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:53.558 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:44:53.558 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:53.558 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:44:53.558 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:53.558 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:44:53.558 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:44:53.558 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:44:53.558 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:44:53.558 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:53.558 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:44:53.558 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:44:53.559 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:53.559 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:53.559 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:53.559 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:44:53.559 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:44:53.559 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:53.559 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:53.559 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:53.559 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:53.559 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:44:53.559 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:44:53.559 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:44:53.560 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:44:53.560 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:44:53.560 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:44:53.560 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:53.560 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:53.560 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:44:53.560 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:44:53.560 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:44:53.560 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:44:53.560 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:53.560 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:44:53.560 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:44:53.561 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:53.561 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:53.561 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:53.561 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:44:53.561 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:44:53.561 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:53.562 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:53.562 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:53.562 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:53.562 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:44:53.562 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:44:53.562 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:44:53.563 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:44:53.563 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:44:53.563 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:44:53.563 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:53.563 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:53.563 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:44:53.564 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:44:53.564 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:44:53.564 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:44:53.564 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:53.564 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:44:53.564 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:44:53.565 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:53.565 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:53.565 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:53.565 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:44:53.565 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:44:53.565 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:44:53.566 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:53.566 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:53.566 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:53.566 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:44:53.566 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:44:53.567 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:44:53.567 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:44:53.567 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:44:53.567 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:44:53.567 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:53.567 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:53.568 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:53.568 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:44:53.568 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:44:53.568 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:53.568 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:53.569 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:53.569 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:44:53.569 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:53.569 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:53.569 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:44:53.569 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:53.570 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:53.570 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:53.570 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:44:53.570 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:53.570 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:53.570 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:44:53.571 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:53.571 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:53.571 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:53.571 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:44:53.571 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:53.571 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:53.571 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:44:53.572 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:53.572 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:44:53.572 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:44:53.572 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:44:53.572 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:53.572 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:53.572 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:53.572 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:53.573 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:44:53.573 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:53.573 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:44:53.573 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:44:53.573 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:44:53.573 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:44:53.573 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:44:53.573 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:44:53.573 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:44:53.573 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:44:53.573 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:44:53.573 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:44:53.573 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:44:53.575 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.550+0000 7f94bd883640 1 -- 10.20.193.58:0/1634278920 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f948807a430 msgr2=0x7f948809a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:53.575 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.550+0000 7f94bd883640 1 --2- 10.20.193.58:0/1634278920 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f948807a430 0x7f948809a8e0 secure :-1 s=READY pgs=505 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94a000bfd0 tx=0x7f94a0008030 comp rx=0 tx=0).stop 2026-02-23T06:44:53.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.550+0000 7f94bd883640 1 -- 10.20.193.58:0/1634278920 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f94b80b4220 msgr2=0x7f94b81634a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:44:53.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.550+0000 7f94bd883640 1 --2- 10.20.193.58:0/1634278920 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f94b80b4220 0x7f94b81634a0 secure :-1 s=READY pgs=53 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94a8009a20 tx=0x7f94a8002a10 comp rx=0 tx=0).stop 2026-02-23T06:44:53.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.550+0000 7f94bd082640 1 -- 10.20.193.58:0/1634278920 reap_dead start 2026-02-23T06:44:53.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.550+0000 7f94bd883640 1 -- 10.20.193.58:0/1634278920 shutdown_connections 2026-02-23T06:44:53.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.550+0000 7f94bd883640 1 --2- 10.20.193.58:0/1634278920 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f94b80b4220 0x7f94b81634a0 unknown :-1 s=CLOSED pgs=53 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:44:53.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.550+0000 7f94bd883640 1 -- 10.20.193.58:0/1634278920 >> 10.20.193.58:0/1634278920 conn(0x7f94b80b65c0 msgr2=0x7f94b815d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:44:53.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.550+0000 7f94bd883640 1 -- 10.20.193.58:0/1634278920 shutdown_connections 2026-02-23T06:44:53.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:44:53.550+0000 7f94bd883640 1 -- 10.20.193.58:0/1634278920 wait complete. 2026-02-23T06:44:53.577 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:44:53.577 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:45:13.578 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-23T06:45:13.578 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-23T06:45:13.578 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-23T06:45:13.578 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-23T06:45:13.581 INFO:tasks.ceph.mon.b:Started 2026-02-23T06:45:13.581 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:45:13.581 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:45:13.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.711+0000 7f987ef89640 1 -- 10.20.193.58:0/2876782495 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f987815d4a0 msgr2=0x7f98780affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:13.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.711+0000 7f987ef89640 1 --2- 10.20.193.58:0/2876782495 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f987815d4a0 0x7f98780affb0 secure :-1 s=READY pgs=81 gs=2 cs=0 l=1 c_cookie=16782960602869577958 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9868004740 tx=0x7f986802f1e0 comp rx=0 tx=0).stop 2026-02-23T06:45:13.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.711+0000 7f987ef89640 1 -- 10.20.193.58:0/2876782495 shutdown_connections 2026-02-23T06:45:13.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.711+0000 7f987ef89640 1 --2- 10.20.193.58:0/2876782495 >> v2:10.20.193.58:3300/0 conn(0x7f98780b6690 0x7f9878058ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:13.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.711+0000 7f987ef89640 1 --2- 10.20.193.58:0/2876782495 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f987815d4a0 0x7f98780affb0 unknown :-1 s=CLOSED pgs=81 gs=2 cs=0 l=1 c_cookie=16782960602869577958 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:13.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.711+0000 7f987ef89640 1 -- 10.20.193.58:0/2876782495 >> 10.20.193.58:0/2876782495 conn(0x7f98780b3c20 msgr2=0x7f98780b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:45:13.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.711+0000 7f987ef89640 1 -- 10.20.193.58:0/2876782495 shutdown_connections 2026-02-23T06:45:13.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.711+0000 7f987ef89640 1 -- 10.20.193.58:0/2876782495 wait complete. 2026-02-23T06:45:13.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.712+0000 7f987ef89640 1 Processor -- start 2026-02-23T06:45:13.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.712+0000 7f987ef89640 1 -- start start 2026-02-23T06:45:13.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.713+0000 7f987ef89640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f98780b6690 0x7f9878142170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:13.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.713+0000 7f987ef89640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f987815d4a0 0x7f98781417b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:13.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.713+0000 7f987ef89640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f987815d870 0x7f987813e250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:13.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.713+0000 7f987ef89640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f9878057840 con 0x7f987815d4a0 2026-02-23T06:45:13.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.713+0000 7f987ef89640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f98781427b0 con 0x7f987815d870 2026-02-23T06:45:13.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.713+0000 7f987ef89640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f9878057a90 con 0x7f98780b6690 2026-02-23T06:45:13.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.713+0000 7f987df87640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f98780b6690 0x7f9878142170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:13.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.713+0000 7f987d786640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f987815d4a0 0x7f98781417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:13.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.713+0000 7f987df87640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f98780b6690 0x7f9878142170 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:55592/0 (socket says 10.20.193.58:55592) 2026-02-23T06:45:13.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.713+0000 7f987df87640 1 -- 10.20.193.58:0/947109132 learned_addr learned my addr 10.20.193.58:0/947109132 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:45:13.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.713+0000 7f987e788640 1 --2- 10.20.193.58:0/947109132 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f987815d870 0x7f987813e250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:13.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.713+0000 7f987d786640 1 -- 10.20.193.58:0/947109132 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f98780b6690 msgr2=0x7f9878142170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:13.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.713+0000 7f987d786640 1 --2- 10.20.193.58:0/947109132 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f98780b6690 0x7f9878142170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:13.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.713+0000 7f987d786640 1 -- 10.20.193.58:0/947109132 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f987815d870 msgr2=0x7f987813e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:13.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.713+0000 7f987d786640 1 --2- 10.20.193.58:0/947109132 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f987815d870 0x7f987813e250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:13.709 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.713+0000 7f987d786640 1 -- 10.20.193.58:0/947109132 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98680094b0 con 0x7f987815d4a0 2026-02-23T06:45:13.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.713+0000 7f987e788640 1 --2- 10.20.193.58:0/947109132 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f987815d870 0x7f987813e250 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:45:13.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.713+0000 7f987d786640 1 --2- 10.20.193.58:0/947109132 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f987815d4a0 0x7f98781417b0 secure :-1 s=READY pgs=56 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f98780b1d30 tx=0x7f986c003640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:13.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.713+0000 7f98667fc640 1 -- 10.20.193.58:0/947109132 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f986c004250 con 0x7f987815d4a0 2026-02-23T06:45:13.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.714+0000 7f98667fc640 1 -- 10.20.193.58:0/947109132 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f986c0044a0 con 0x7f987815d4a0 2026-02-23T06:45:13.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.714+0000 7f98667fc640 1 -- 10.20.193.58:0/947109132 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f986c003930 con 0x7f987815d4a0 2026-02-23T06:45:13.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.714+0000 7f987ef89640 1 -- 10.20.193.58:0/947109132 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9878057d70 con 0x7f987815d4a0 2026-02-23T06:45:13.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.714+0000 7f987ef89640 1 -- 10.20.193.58:0/947109132 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9878141cf0 con 0x7f987815d4a0 2026-02-23T06:45:13.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.714+0000 7f987ef89640 1 -- 10.20.193.58:0/947109132 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98780b6d50 con 0x7f987815d4a0 2026-02-23T06:45:13.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.715+0000 7f98667fc640 1 -- 10.20.193.58:0/947109132 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f986c003a90 con 0x7f987815d4a0 2026-02-23T06:45:13.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.716+0000 7f98667fc640 1 --2- 10.20.193.58:0/947109132 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f984807a6c0 0x7f984809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:13.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.716+0000 7f98667fc640 1 -- 10.20.193.58:0/947109132 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f986c09cbd0 con 0x7f987815d4a0 2026-02-23T06:45:13.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.716+0000 7f987df87640 1 --2- 10.20.193.58:0/947109132 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f984807a6c0 0x7f984809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:13.712 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.717+0000 7f987df87640 1 --2- 10.20.193.58:0/947109132 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f984807a6c0 0x7f984809ab70 secure :-1 s=READY pgs=507 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f98680097e0 tx=0x7f9868031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:13.712 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.718+0000 7f98667fc640 1 -- 10.20.193.58:0/947109132 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f986c05fe20 con 0x7f987815d4a0 2026-02-23T06:45:13.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.872+0000 7f987ef89640 1 -- 10.20.193.58:0/947109132 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f98780581f0 con 0x7f987815d4a0 2026-02-23T06:45:13.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.872+0000 7f98667fc640 1 -- 10.20.193.58:0/947109132 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f986c011590 con 0x7f987815d4a0 2026-02-23T06:45:13.867 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":212,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:45:13.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.873+0000 7f987ef89640 1 -- 10.20.193.58:0/947109132 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f984807a6c0 msgr2=0x7f984809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:13.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.873+0000 7f987ef89640 1 --2- 10.20.193.58:0/947109132 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f984807a6c0 0x7f984809ab70 secure :-1 s=READY pgs=507 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f98680097e0 tx=0x7f9868031040 comp rx=0 tx=0).stop 2026-02-23T06:45:13.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.873+0000 7f987ef89640 1 -- 10.20.193.58:0/947109132 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f987815d4a0 msgr2=0x7f98781417b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:13.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.873+0000 7f987ef89640 1 --2- 10.20.193.58:0/947109132 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f987815d4a0 0x7f98781417b0 secure :-1 s=READY pgs=56 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f98780b1d30 tx=0x7f986c003640 comp rx=0 tx=0).stop 2026-02-23T06:45:13.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.873+0000 7f987ef89640 1 -- 10.20.193.58:0/947109132 shutdown_connections 2026-02-23T06:45:13.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.873+0000 7f987ef89640 1 --2- 10.20.193.58:0/947109132 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f984807a6c0 0x7f984809ab70 unknown :-1 s=CLOSED pgs=507 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:13.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.873+0000 7f987ef89640 1 --2- 10.20.193.58:0/947109132 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f987815d870 0x7f987813e250 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:13.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.873+0000 7f987ef89640 1 --2- 10.20.193.58:0/947109132 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f987815d4a0 0x7f98781417b0 unknown :-1 s=CLOSED pgs=56 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:13.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.873+0000 7f987ef89640 1 --2- 10.20.193.58:0/947109132 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f98780b6690 0x7f9878142170 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:13.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.873+0000 7f987ef89640 1 -- 10.20.193.58:0/947109132 >> 10.20.193.58:0/947109132 conn(0x7f98780b3c20 msgr2=0x7f987805d100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:45:13.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.873+0000 7f987ef89640 1 -- 10.20.193.58:0/947109132 shutdown_connections 2026-02-23T06:45:13.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:13.873+0000 7f987ef89640 1 -- 10.20.193.58:0/947109132 wait complete. 2026-02-23T06:45:13.879 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:45:13.880 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:45:13.880 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:45:13.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.004+0000 7f2c2557e640 1 -- 10.20.193.58:0/3097952153 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2c200b6440 msgr2=0x7f2c200ba2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:14.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.004+0000 7f2c2557e640 1 --2- 10.20.193.58:0/3097952153 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2c200b6440 0x7f2c200ba2d0 secure :-1 s=READY pgs=57 gs=2 cs=0 l=1 c_cookie=16205348385250997896 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c10005e70 tx=0x7f2c1002f290 comp rx=0 tx=0).stop 2026-02-23T06:45:14.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.004+0000 7f2c2557e640 1 -- 10.20.193.58:0/3097952153 shutdown_connections 2026-02-23T06:45:14.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.004+0000 7f2c2557e640 1 --2- 10.20.193.58:0/3097952153 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2c200b6440 0x7f2c200ba2d0 unknown :-1 s=CLOSED pgs=57 gs=2 cs=0 l=1 c_cookie=16205348385250997896 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.004+0000 7f2c2557e640 1 --2- 10.20.193.58:0/3097952153 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2c201688d0 0x7f2c20168ca0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.004+0000 7f2c2557e640 1 -- 10.20.193.58:0/3097952153 >> 10.20.193.58:0/3097952153 conn(0x7f2c20054e40 msgr2=0x7f2c20057b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:45:14.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.004+0000 7f2c2557e640 1 -- 10.20.193.58:0/3097952153 shutdown_connections 2026-02-23T06:45:14.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.005+0000 7f2c2557e640 1 -- 10.20.193.58:0/3097952153 wait complete. 2026-02-23T06:45:14.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.006+0000 7f2c2557e640 1 Processor -- start 2026-02-23T06:45:14.000 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.006+0000 7f2c2557e640 1 -- start start 2026-02-23T06:45:14.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.006+0000 7f2c2557e640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2c200b6440 0x7f2c2009ef60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:14.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.006+0000 7f2c2557e640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2c200bb0b0 0x7f2c20156070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:14.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.006+0000 7f2c2557e640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2c201688d0 0x7f2c201565b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:14.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.006+0000 7f2c2557e640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f2c20155c30 con 0x7f2c201688d0 2026-02-23T06:45:14.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.006+0000 7f2c2557e640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f2c20139ae0 con 0x7f2c200bb0b0 2026-02-23T06:45:14.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.006+0000 7f2c2557e640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f2c201591d0 con 0x7f2c200b6440 2026-02-23T06:45:14.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.006+0000 7f2c1ffff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2c200b6440 0x7f2c2009ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:14.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.006+0000 7f2c1ffff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2c200b6440 0x7f2c2009ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:55600/0 (socket says 10.20.193.58:55600) 2026-02-23T06:45:14.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.006+0000 7f2c1ffff640 1 -- 10.20.193.58:0/3007987498 learned_addr learned my addr 10.20.193.58:0/3007987498 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:45:14.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.006+0000 7f2c24d7d640 1 --2- 10.20.193.58:0/3007987498 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2c201688d0 0x7f2c201565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:14.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.006+0000 7f2c1f7fe640 1 --2- 10.20.193.58:0/3007987498 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2c200bb0b0 0x7f2c20156070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:14.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.007+0000 7f2c1ffff640 1 -- 10.20.193.58:0/3007987498 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2c200bb0b0 msgr2=0x7f2c20156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:14.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.007+0000 7f2c1ffff640 1 --2- 10.20.193.58:0/3007987498 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2c200bb0b0 0x7f2c20156070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.007+0000 7f2c1ffff640 1 -- 10.20.193.58:0/3007987498 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2c201688d0 msgr2=0x7f2c201565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:14.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.007+0000 7f2c1ffff640 1 --2- 10.20.193.58:0/3007987498 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2c201688d0 0x7f2c201565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.007+0000 7f2c1ffff640 1 -- 10.20.193.58:0/3007987498 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c10009570 con 0x7f2c200b6440 2026-02-23T06:45:14.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.007+0000 7f2c1ffff640 1 --2- 10.20.193.58:0/3007987498 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2c200b6440 0x7f2c2009ef60 secure :-1 s=READY pgs=82 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c0c009480 tx=0x7f2c0c00ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:14.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.007+0000 7f2c1cff9640 1 -- 10.20.193.58:0/3007987498 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2c0c00cd40 con 0x7f2c200b6440 2026-02-23T06:45:14.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.007+0000 7f2c1cff9640 1 -- 10.20.193.58:0/3007987498 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c0c004850 con 0x7f2c200b6440 2026-02-23T06:45:14.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.007+0000 7f2c1cff9640 1 -- 10.20.193.58:0/3007987498 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2c0c00cea0 con 0x7f2c200b6440 2026-02-23T06:45:14.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.007+0000 7f2c2557e640 1 -- 10.20.193.58:0/3007987498 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c20139cc0 con 0x7f2c200b6440 2026-02-23T06:45:14.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.007+0000 7f2c2557e640 1 -- 10.20.193.58:0/3007987498 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c2015a120 con 0x7f2c200b6440 2026-02-23T06:45:14.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.008+0000 7f2c2557e640 1 --2- 10.20.193.58:0/3007987498 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2c20159340 0x7f2c201220a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:14.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.008+0000 7f2c2557e640 1 -- 10.20.193.58:0/3007987498 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f2c200b9ad0 con 0x7f2c20159340 2026-02-23T06:45:14.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.008+0000 7f2c1f7fe640 1 --2- 10.20.193.58:0/3007987498 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2c20159340 0x7f2c201220a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:14.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.008+0000 7f2c1f7fe640 1 -- 10.20.193.58:0/3007987498 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2c200b15f0 con 0x7f2c20159340 2026-02-23T06:45:14.003 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.008+0000 7f2c1f7fe640 1 --2- 10.20.193.58:0/3007987498 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2c20159340 0x7f2c201220a0 secure :-1 s=READY pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c10005e70 tx=0x7f2c100028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:14.004 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.008+0000 7f2c1cff9640 1 -- 10.20.193.58:0/3007987498 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2c1003d050 con 0x7f2c20159340 2026-02-23T06:45:14.004 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.009+0000 7f2c1cff9640 1 -- 10.20.193.58:0/3007987498 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f2c1003e040 con 0x7f2c20159340 2026-02-23T06:45:14.004 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.009+0000 7f2c1cff9640 1 -- 10.20.193.58:0/3007987498 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2c20159340 msgr2=0x7f2c201220a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:14.004 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.009+0000 7f2c1cff9640 1 --2- 10.20.193.58:0/3007987498 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2c20159340 0x7f2c201220a0 secure :-1 s=READY pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c10005e70 tx=0x7f2c100028d0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.004 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.009+0000 7f2c1cff9640 1 -- 10.20.193.58:0/3007987498 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2c20159340 msgr2=0x7f2c201220a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:45:14.004 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.009+0000 7f2c1cff9640 1 --2- 10.20.193.58:0/3007987498 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2c20159340 0x7f2c201220a0 secure :-1 s=CLOSED pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c10005e70 tx=0x7f2c100028d0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.004 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.009+0000 7f2c1cff9640 1 -- 10.20.193.58:0/3007987498 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f2c0c01f060 con 0x7f2c200b6440 2026-02-23T06:45:14.005 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.010+0000 7f2c1cff9640 1 --2- 10.20.193.58:0/3007987498 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2bf007a3c0 0x7f2bf009a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:14.005 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.010+0000 7f2c1cff9640 1 -- 10.20.193.58:0/3007987498 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f2c0c014070 con 0x7f2c200b6440 2026-02-23T06:45:14.005 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.010+0000 7f2c1f7fe640 1 --2- 10.20.193.58:0/3007987498 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2bf007a3c0 0x7f2bf009a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:14.006 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.011+0000 7f2c1f7fe640 1 --2- 10.20.193.58:0/3007987498 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2bf007a3c0 0x7f2bf009a870 secure :-1 s=READY pgs=508 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c100023d0 tx=0x7f2c10031030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:14.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.012+0000 7f2c2557e640 1 --2- 10.20.193.58:0/3007987498 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2c201225e0 0x7f2c20166740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:14.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.012+0000 7f2c2557e640 1 -- 10.20.193.58:0/3007987498 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f2c20169270 con 0x7f2c201225e0 2026-02-23T06:45:14.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.012+0000 7f2c24d7d640 1 --2- 10.20.193.58:0/3007987498 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2c201225e0 0x7f2c20166740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:14.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.012+0000 7f2c24d7d640 1 -- 10.20.193.58:0/3007987498 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2c2013e070 con 0x7f2c201225e0 2026-02-23T06:45:14.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.013+0000 7f2c24d7d640 1 --2- 10.20.193.58:0/3007987498 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2c201225e0 0x7f2c20166740 secure :-1 s=READY pgs=59 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c14004850 tx=0x7f2c14010b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:14.008 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.013+0000 7f2c1cff9640 1 -- 10.20.193.58:0/3007987498 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2c1400e9c0 con 0x7f2c201225e0 2026-02-23T06:45:14.008 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.013+0000 7f2c1cff9640 1 -- 10.20.193.58:0/3007987498 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5247 (secure 0 0 0) 0x7f2c1400eb20 con 0x7f2c201225e0 2026-02-23T06:45:14.008 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:45:14.008 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:45:14.008 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:45:14.008 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:45:14.009 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 212, 2026-02-23T06:45:14.009 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 63685, 2026-02-23T06:45:14.009 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:45:14.009 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:45:14.009 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:45:14.009 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:45:14.009 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:14.009 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:45:14.009 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:45:14.009 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:45:14.009 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:45:14.009 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:45:14.009 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:45:14.009 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:45:14.009 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:45:14.009 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:45:14.010 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:45:14.010 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:45:14.010 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:45:14.010 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:45:14.010 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:45:14.010 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:45:14.010 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:45:14.010 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:45:14.010 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:14.010 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:45:14.010 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:45:14.010 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:45:14.010 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:45:14.010 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:45:14.010 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:45:14.010 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:45:14.010 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:45:14.010 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:45:14.011 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:45:14.011 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:45:14.011 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:45:14.011 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:45:14.011 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:45:14.011 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:45:14.011 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:14.011 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.011 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:45:14.011 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:45:14.011 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:45:14.011 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:45:14.011 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:45:14.011 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:45:14.011 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:45:14.011 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:45:14.011 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:45:14.011 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:45:14.011 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:45:14.011 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:45:14.011 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:45:14.011 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:45:14.012 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:45:14.012 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:45:14.012 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:45:14.012 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:45:14.012 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:45:14.012 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:45:14.012 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:45:14.012 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:45:14.012 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:45:14.012 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:45:14.012 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:45:14.012 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:45:14.012 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:45:14.012 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:45:14.012 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:45:14.012 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:45:14.012 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:14.012 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:45:14.012 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.012 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:45:14.012 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.012 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:45:14.013 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:45:14.013 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:45:14.013 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:45:14.013 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.013 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:45:14.013 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:45:14.013 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:14.013 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.013 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.013 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:45:14.013 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:45:14.013 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:14.013 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:14.013 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:14.013 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.013 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:45:14.013 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:45:14.013 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:45:14.013 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:45:14.013 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:45:14.013 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:45:14.013 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.014 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.014 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:45:14.014 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:45:14.014 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:45:14.014 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:45:14.014 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.014 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:45:14.014 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:45:14.014 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:14.014 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.014 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.014 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:45:14.014 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:45:14.014 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:14.014 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:14.014 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:14.014 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.014 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:45:14.014 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:45:14.014 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:45:14.014 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:45:14.014 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:45:14.014 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:45:14.015 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.015 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.015 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:45:14.015 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:45:14.015 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:45:14.015 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:45:14.015 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.015 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:45:14.015 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:45:14.015 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:14.015 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.015 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.015 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:45:14.015 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:45:14.015 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:14.015 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:14.015 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:14.015 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.015 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:45:14.015 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:45:14.015 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:45:14.015 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:45:14.016 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:45:14.016 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:45:14.016 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:14.016 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:14.016 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.016 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:45:14.016 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:45:14.016 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.016 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:14.016 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:14.016 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:45:14.016 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:14.016 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:14.016 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:45:14.016 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.016 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:14.016 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:14.016 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:45:14.016 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:14.016 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:14.016 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:45:14.016 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.017 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:14.017 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:14.017 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:45:14.017 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:14.017 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:14.017 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:45:14.017 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.017 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:14.017 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:14.017 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:45:14.017 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:14.017 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:14.017 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.017 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:45:14.017 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:45:14.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.013+0000 7f2c1cff9640 1 -- 10.20.193.58:0/3007987498 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2c201225e0 msgr2=0x7f2c20166740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:14.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.013+0000 7f2c1cff9640 1 --2- 10.20.193.58:0/3007987498 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2c201225e0 0x7f2c20166740 secure :-1 s=READY pgs=59 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c14004850 tx=0x7f2c14010b40 comp rx=0 tx=0).stop 2026-02-23T06:45:14.019 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.013+0000 7f2c1cff9640 1 -- 10.20.193.58:0/3007987498 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2c201225e0 msgr2=0x7f2c20166740 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:45:14.019 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.013+0000 7f2c1cff9640 1 --2- 10.20.193.58:0/3007987498 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2c201225e0 0x7f2c20166740 secure :-1 s=CLOSED pgs=59 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c14004850 tx=0x7f2c14010b40 comp rx=0 tx=0).stop 2026-02-23T06:45:14.019 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.013+0000 7f2c2557e640 1 -- 10.20.193.58:0/3007987498 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2bf007a3c0 msgr2=0x7f2bf009a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:14.019 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.013+0000 7f2c2557e640 1 --2- 10.20.193.58:0/3007987498 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2bf007a3c0 0x7f2bf009a870 secure :-1 s=READY pgs=508 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c100023d0 tx=0x7f2c10031030 comp rx=0 tx=0).stop 2026-02-23T06:45:14.019 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.013+0000 7f2c2557e640 1 -- 10.20.193.58:0/3007987498 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2c200b6440 msgr2=0x7f2c2009ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:14.019 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.013+0000 7f2c2557e640 1 --2- 10.20.193.58:0/3007987498 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2c200b6440 0x7f2c2009ef60 secure :-1 s=READY pgs=82 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c0c009480 tx=0x7f2c0c00ee60 comp rx=0 tx=0).stop 2026-02-23T06:45:14.019 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.013+0000 7f2c24d7d640 1 -- 10.20.193.58:0/3007987498 reap_dead start 2026-02-23T06:45:14.019 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.013+0000 7f2c2557e640 1 -- 10.20.193.58:0/3007987498 shutdown_connections 2026-02-23T06:45:14.019 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.013+0000 7f2c2557e640 1 --2- 10.20.193.58:0/3007987498 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2c200b6440 0x7f2c2009ef60 unknown :-1 s=CLOSED pgs=82 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.019 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.013+0000 7f2c2557e640 1 -- 10.20.193.58:0/3007987498 >> 10.20.193.58:0/3007987498 conn(0x7f2c20054e40 msgr2=0x7f2c2013aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:45:14.019 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.013+0000 7f2c2557e640 1 -- 10.20.193.58:0/3007987498 shutdown_connections 2026-02-23T06:45:14.019 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.013+0000 7f2c2557e640 1 -- 10.20.193.58:0/3007987498 wait complete. 2026-02-23T06:45:14.020 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:45:14.020 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:45:14.020 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:45:14.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.146+0000 7faf36389640 1 -- 10.20.193.58:0/2073789863 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faf3015c4b0 msgr2=0x7faf30058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:14.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.146+0000 7faf36389640 1 --2- 10.20.193.58:0/2073789863 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faf3015c4b0 0x7faf30058200 secure :-1 s=READY pgs=83 gs=3 cs=0 l=1 c_cookie=11678548816274930694 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf20005e70 tx=0x7faf2002f230 comp rx=0 tx=0).stop 2026-02-23T06:45:14.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.147+0000 7faf36389640 1 -- 10.20.193.58:0/2073789863 shutdown_connections 2026-02-23T06:45:14.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.147+0000 7faf36389640 1 --2- 10.20.193.58:0/2073789863 >> v2:10.20.193.93:3300/0 conn(0x7faf30056960 0x7faf300b6720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.147+0000 7faf36389640 1 --2- 10.20.193.58:0/2073789863 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faf3015c4b0 0x7faf30058200 unknown :-1 s=CLOSED pgs=83 gs=3 cs=0 l=1 c_cookie=11678548816274930694 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.147+0000 7faf36389640 1 -- 10.20.193.58:0/2073789863 >> 10.20.193.58:0/2073789863 conn(0x7faf300b3c20 msgr2=0x7faf300b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:45:14.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.147+0000 7faf36389640 1 -- 10.20.193.58:0/2073789863 shutdown_connections 2026-02-23T06:45:14.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.147+0000 7faf36389640 1 -- 10.20.193.58:0/2073789863 wait complete. 2026-02-23T06:45:14.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.148+0000 7faf36389640 1 Processor -- start 2026-02-23T06:45:14.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.148+0000 7faf36389640 1 -- start start 2026-02-23T06:45:14.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.148+0000 7faf36389640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faf30056960 0x7faf3013be20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:14.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.148+0000 7faf36389640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faf3015c4b0 0x7faf30121a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:14.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.149+0000 7faf36389640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faf30162ca0 0x7faf3011d190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:14.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.149+0000 7faf35387640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faf30056960 0x7faf3013be20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:14.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.149+0000 7faf36389640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7faf301215e0 con 0x7faf3015c4b0 2026-02-23T06:45:14.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.149+0000 7faf36389640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7faf300b08f0 con 0x7faf30056960 2026-02-23T06:45:14.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.149+0000 7faf36389640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7faf300af0a0 con 0x7faf30162ca0 2026-02-23T06:45:14.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.149+0000 7faf35387640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faf30056960 0x7faf3013be20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:60130/0 (socket says 10.20.193.58:60130) 2026-02-23T06:45:14.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.149+0000 7faf35387640 1 -- 10.20.193.58:0/564420952 learned_addr learned my addr 10.20.193.58:0/564420952 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:45:14.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.149+0000 7faf34b86640 1 --2- 10.20.193.58:0/564420952 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faf3015c4b0 0x7faf30121a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:14.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.149+0000 7faf35b88640 1 --2- 10.20.193.58:0/564420952 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faf30162ca0 0x7faf3011d190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:14.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.149+0000 7faf35387640 1 -- 10.20.193.58:0/564420952 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faf30162ca0 msgr2=0x7faf3011d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:14.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.149+0000 7faf35387640 1 --2- 10.20.193.58:0/564420952 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faf30162ca0 0x7faf3011d190 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.149+0000 7faf35387640 1 -- 10.20.193.58:0/564420952 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faf3015c4b0 msgr2=0x7faf30121a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:14.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.149+0000 7faf35387640 1 --2- 10.20.193.58:0/564420952 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faf3015c4b0 0x7faf30121a00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.149+0000 7faf35387640 1 -- 10.20.193.58:0/564420952 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf20009570 con 0x7faf30056960 2026-02-23T06:45:14.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.149+0000 7faf34b86640 1 --2- 10.20.193.58:0/564420952 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faf3015c4b0 0x7faf30121a00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:45:14.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.149+0000 7faf35b88640 1 --2- 10.20.193.58:0/564420952 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faf30162ca0 0x7faf3011d190 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:45:14.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.149+0000 7faf35387640 1 --2- 10.20.193.58:0/564420952 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faf30056960 0x7faf3013be20 secure :-1 s=READY pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf20004740 tx=0x7faf200028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:14.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.149+0000 7faf1dffb640 1 -- 10.20.193.58:0/564420952 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faf2003d070 con 0x7faf30056960 2026-02-23T06:45:14.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.149+0000 7faf36389640 1 -- 10.20.193.58:0/564420952 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf300b0b20 con 0x7faf30056960 2026-02-23T06:45:14.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.149+0000 7faf1dffb640 1 -- 10.20.193.58:0/564420952 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf20038470 con 0x7faf30056960 2026-02-23T06:45:14.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.149+0000 7faf1dffb640 1 -- 10.20.193.58:0/564420952 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faf20038880 con 0x7faf30056960 2026-02-23T06:45:14.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.150+0000 7faf36389640 1 -- 10.20.193.58:0/564420952 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf3011f3f0 con 0x7faf30056960 2026-02-23T06:45:14.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.150+0000 7faf36389640 1 --2- 10.20.193.58:0/564420952 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faf300afca0 0x7faf300b0070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:14.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.150+0000 7faf36389640 1 -- 10.20.193.58:0/564420952 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7faf30059690 con 0x7faf300afca0 2026-02-23T06:45:14.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.150+0000 7faf34b86640 1 --2- 10.20.193.58:0/564420952 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faf300afca0 0x7faf300b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:14.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.151+0000 7faf34b86640 1 -- 10.20.193.58:0/564420952 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faf300593b0 con 0x7faf300afca0 2026-02-23T06:45:14.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.151+0000 7faf34b86640 1 --2- 10.20.193.58:0/564420952 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faf300afca0 0x7faf300b0070 secure :-1 s=READY pgs=7 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf3013e470 tx=0x7faf24009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:14.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.151+0000 7faf1dffb640 1 -- 10.20.193.58:0/564420952 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faf24010c10 con 0x7faf300afca0 2026-02-23T06:45:14.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.151+0000 7faf1dffb640 1 -- 10.20.193.58:0/564420952 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7faf24010d70 con 0x7faf300afca0 2026-02-23T06:45:14.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.151+0000 7faf1dffb640 1 -- 10.20.193.58:0/564420952 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faf300afca0 msgr2=0x7faf300b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:14.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.151+0000 7faf1dffb640 1 --2- 10.20.193.58:0/564420952 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faf300afca0 0x7faf300b0070 secure :-1 s=READY pgs=7 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf3013e470 tx=0x7faf24009c20 comp rx=0 tx=0).stop 2026-02-23T06:45:14.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.151+0000 7faf1dffb640 1 -- 10.20.193.58:0/564420952 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faf300afca0 msgr2=0x7faf300b0070 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:45:14.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.151+0000 7faf1dffb640 1 --2- 10.20.193.58:0/564420952 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faf300afca0 0x7faf300b0070 unknown :-1 s=CLOSED pgs=7 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.151+0000 7faf1dffb640 1 -- 10.20.193.58:0/564420952 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7faf200389e0 con 0x7faf30056960 2026-02-23T06:45:14.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.152+0000 7faf1dffb640 1 --2- 10.20.193.58:0/564420952 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faf0007a3c0 0x7faf0009a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:14.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.152+0000 7faf1dffb640 1 -- 10.20.193.58:0/564420952 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7faf200c23b0 con 0x7faf30056960 2026-02-23T06:45:14.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.152+0000 7faf34b86640 1 --2- 10.20.193.58:0/564420952 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faf0007a3c0 0x7faf0009a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:14.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.153+0000 7faf34b86640 1 --2- 10.20.193.58:0/564420952 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faf0007a3c0 0x7faf0009a870 secure :-1 s=READY pgs=509 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf240040c0 tx=0x7faf24013000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:14.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.156+0000 7faf36389640 1 --2- 10.20.193.58:0/564420952 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faf3013d3b0 0x7faf3013d780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:14.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.156+0000 7faf36389640 1 -- 10.20.193.58:0/564420952 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7faf3013e4a0 con 0x7faf3013d3b0 2026-02-23T06:45:14.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.156+0000 7faf35b88640 1 --2- 10.20.193.58:0/564420952 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faf3013d3b0 0x7faf3013d780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:14.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.156+0000 7faf35b88640 1 -- 10.20.193.58:0/564420952 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faf3013e1c0 con 0x7faf3013d3b0 2026-02-23T06:45:14.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.156+0000 7faf35b88640 1 --2- 10.20.193.58:0/564420952 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faf3013d3b0 0x7faf3013d780 secure :-1 s=READY pgs=8 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf2c008fd0 tx=0x7faf2c00eb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:14.152 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.157+0000 7faf1dffb640 1 -- 10.20.193.58:0/564420952 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faf2c0062f0 con 0x7faf3013d3b0 2026-02-23T06:45:14.152 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.157+0000 7faf1dffb640 1 -- 10.20.193.58:0/564420952 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4909 (secure 0 0 0) 0x7faf2c006450 con 0x7faf3013d3b0 2026-02-23T06:45:14.152 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:45:14.152 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:45:14.152 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:45:14.152 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:45:14.152 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 212, 2026-02-23T06:45:14.152 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 515, 2026-02-23T06:45:14.152 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:45:14.153 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:45:14.153 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:45:14.153 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:45:14.153 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:14.153 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:45:14.153 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:45:14.153 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:45:14.153 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:45:14.153 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:45:14.153 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:45:14.153 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:45:14.153 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:45:14.153 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:45:14.153 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:45:14.153 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:45:14.153 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:45:14.153 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:45:14.153 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:45:14.154 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:45:14.154 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:45:14.154 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:45:14.154 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:14.154 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:45:14.154 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:45:14.154 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:45:14.154 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:45:14.154 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:45:14.154 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:45:14.154 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:45:14.154 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:45:14.154 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:45:14.154 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:45:14.154 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:45:14.154 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:45:14.154 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:45:14.154 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:45:14.154 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:45:14.154 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:14.154 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.155 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:45:14.155 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:45:14.155 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:45:14.155 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:45:14.155 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:45:14.155 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:45:14.155 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:45:14.155 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:45:14.155 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:45:14.155 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:45:14.155 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:45:14.155 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:45:14.155 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:45:14.155 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:45:14.155 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:45:14.155 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:45:14.155 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:45:14.155 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:45:14.155 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:45:14.155 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:45:14.155 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:45:14.155 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:45:14.155 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:45:14.156 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:45:14.156 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:45:14.156 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:45:14.156 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:45:14.156 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:45:14.156 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:45:14.156 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:45:14.156 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:14.156 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:45:14.156 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.156 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:45:14.156 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.156 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:45:14.156 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:45:14.156 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:45:14.156 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:45:14.156 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.156 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:45:14.156 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:45:14.156 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:14.156 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.157 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.157 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:45:14.157 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:45:14.157 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:14.157 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:14.157 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:14.157 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.157 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:45:14.157 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:45:14.157 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:45:14.157 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:45:14.157 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:45:14.157 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:45:14.157 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.157 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.157 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:45:14.157 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:45:14.157 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:45:14.157 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:45:14.157 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.157 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:45:14.157 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:45:14.157 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:14.158 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.158 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.158 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:45:14.158 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:45:14.158 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:14.158 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:14.158 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:14.158 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.158 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:45:14.158 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:45:14.158 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:45:14.158 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:45:14.158 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:45:14.158 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:45:14.158 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.158 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.158 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:45:14.158 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:45:14.158 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:45:14.158 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:45:14.158 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.158 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:45:14.158 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:45:14.159 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:14.159 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.159 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.159 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:45:14.159 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:45:14.159 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:14.159 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:14.159 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:14.159 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.159 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:45:14.159 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:45:14.159 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:45:14.159 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:45:14.159 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:45:14.159 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:45:14.159 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:14.159 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:14.159 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.159 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:45:14.159 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:45:14.159 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.159 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:14.159 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:14.160 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:45:14.160 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:14.160 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:14.160 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:45:14.160 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.160 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:14.160 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:14.160 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:45:14.160 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:14.160 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:14.160 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.160 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:45:14.160 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:45:14.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.157+0000 7faf1dffb640 1 -- 10.20.193.58:0/564420952 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faf3013d3b0 msgr2=0x7faf3013d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:14.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.157+0000 7faf1dffb640 1 --2- 10.20.193.58:0/564420952 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faf3013d3b0 0x7faf3013d780 secure :-1 s=READY pgs=8 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf2c008fd0 tx=0x7faf2c00eb90 comp rx=0 tx=0).stop 2026-02-23T06:45:14.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.157+0000 7faf1dffb640 1 -- 10.20.193.58:0/564420952 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faf3013d3b0 msgr2=0x7faf3013d780 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:45:14.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.157+0000 7faf1dffb640 1 --2- 10.20.193.58:0/564420952 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faf3013d3b0 0x7faf3013d780 secure :-1 s=CLOSED pgs=8 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf2c008fd0 tx=0x7faf2c00eb90 comp rx=0 tx=0).stop 2026-02-23T06:45:14.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.157+0000 7faf36389640 1 -- 10.20.193.58:0/564420952 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faf0007a3c0 msgr2=0x7faf0009a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:14.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.157+0000 7faf36389640 1 --2- 10.20.193.58:0/564420952 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faf0007a3c0 0x7faf0009a870 secure :-1 s=READY pgs=509 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf240040c0 tx=0x7faf24013000 comp rx=0 tx=0).stop 2026-02-23T06:45:14.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.157+0000 7faf36389640 1 -- 10.20.193.58:0/564420952 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faf30056960 msgr2=0x7faf3013be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:14.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.157+0000 7faf36389640 1 --2- 10.20.193.58:0/564420952 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faf30056960 0x7faf3013be20 secure :-1 s=READY pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf20004740 tx=0x7faf200028d0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.157+0000 7faf35b88640 1 -- 10.20.193.58:0/564420952 reap_dead start 2026-02-23T06:45:14.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.157+0000 7faf36389640 1 -- 10.20.193.58:0/564420952 shutdown_connections 2026-02-23T06:45:14.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.157+0000 7faf36389640 1 -- 10.20.193.58:0/564420952 >> 10.20.193.58:0/564420952 conn(0x7faf300b3c20 msgr2=0x7faf300b1260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:45:14.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.157+0000 7faf36389640 1 -- 10.20.193.58:0/564420952 shutdown_connections 2026-02-23T06:45:14.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.157+0000 7faf36389640 1 -- 10.20.193.58:0/564420952 wait complete. 2026-02-23T06:45:14.163 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:45:14.163 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:45:14.163 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:45:14.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.291+0000 7fa5ecb92640 1 -- 10.20.193.58:0/696813812 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5e815d870 msgr2=0x7fa5e80587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:14.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.291+0000 7fa5ecb92640 1 --2- 10.20.193.58:0/696813812 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5e815d870 0x7fa5e80587b0 secure :-1 s=READY pgs=60 gs=2 cs=0 l=1 c_cookie=4656579307092632372 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5d8004740 tx=0x7fa5d802f1e0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.291+0000 7fa5ecb92640 1 -- 10.20.193.58:0/696813812 shutdown_connections 2026-02-23T06:45:14.286 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.291+0000 7fa5ecb92640 1 --2- 10.20.193.58:0/696813812 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5e80b6690 0x7fa5e8058cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.291+0000 7fa5ecb92640 1 --2- 10.20.193.58:0/696813812 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5e815d870 0x7fa5e80587b0 unknown :-1 s=CLOSED pgs=60 gs=2 cs=0 l=1 c_cookie=4656579307092632372 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.291+0000 7fa5ecb92640 1 -- 10.20.193.58:0/696813812 >> 10.20.193.58:0/696813812 conn(0x7fa5e80b3c20 msgr2=0x7fa5e80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:45:14.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.291+0000 7fa5ecb92640 1 -- 10.20.193.58:0/696813812 shutdown_connections 2026-02-23T06:45:14.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.291+0000 7fa5ecb92640 1 -- 10.20.193.58:0/696813812 wait complete. 2026-02-23T06:45:14.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.292+0000 7fa5ecb92640 1 Processor -- start 2026-02-23T06:45:14.287 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.292+0000 7fa5ecb92640 1 -- start start 2026-02-23T06:45:14.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.293+0000 7fa5ecb92640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5e80b6690 0x7fa5e815e8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:14.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.293+0000 7fa5ecb92640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa5e815d4a0 0x7fa5e81fc360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:14.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.293+0000 7fa5ecb92640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5e815d870 0x7fa5e8166bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:14.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.293+0000 7fa5ecb92640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e813d590 con 0x7fa5e80b6690 2026-02-23T06:45:14.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.293+0000 7fa5ecb92640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e815ee20 con 0x7fa5e815d4a0 2026-02-23T06:45:14.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.293+0000 7fa5ecb92640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa5e815dcd0 con 0x7fa5e815d870 2026-02-23T06:45:14.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.293+0000 7fa5e7fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5e815d870 0x7fa5e8166bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:14.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.293+0000 7fa5e77fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5e80b6690 0x7fa5e815e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:14.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.293+0000 7fa5e7fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5e815d870 0x7fa5e8166bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:55630/0 (socket says 10.20.193.58:55630) 2026-02-23T06:45:14.288 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.293+0000 7fa5e7fff640 1 -- 10.20.193.58:0/3419072021 learned_addr learned my addr 10.20.193.58:0/3419072021 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:45:14.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.293+0000 7fa5e77fe640 1 -- 10.20.193.58:0/3419072021 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5e815d870 msgr2=0x7fa5e8166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:14.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.293+0000 7fa5e77fe640 1 --2- 10.20.193.58:0/3419072021 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5e815d870 0x7fa5e8166bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.293+0000 7fa5e77fe640 1 -- 10.20.193.58:0/3419072021 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa5e815d4a0 msgr2=0x7fa5e81fc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:14.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.293+0000 7fa5e77fe640 1 --2- 10.20.193.58:0/3419072021 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa5e815d4a0 0x7fa5e81fc360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.293+0000 7fa5e77fe640 1 -- 10.20.193.58:0/3419072021 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5d80094b0 con 0x7fa5e80b6690 2026-02-23T06:45:14.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.294+0000 7fa5e77fe640 1 --2- 10.20.193.58:0/3419072021 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5e80b6690 0x7fa5e815e8e0 secure :-1 s=READY pgs=61 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5d4007fd0 tx=0x7fa5d400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:14.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.294+0000 7fa5c3fff640 1 -- 10.20.193.58:0/3419072021 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5d4004250 con 0x7fa5e80b6690 2026-02-23T06:45:14.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.294+0000 7fa5c3fff640 1 -- 10.20.193.58:0/3419072021 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa5d40044a0 con 0x7fa5e80b6690 2026-02-23T06:45:14.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.294+0000 7fa5c3fff640 1 -- 10.20.193.58:0/3419072021 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5d40038b0 con 0x7fa5e80b6690 2026-02-23T06:45:14.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.294+0000 7fa5ecb92640 1 -- 10.20.193.58:0/3419072021 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5e813cfd0 con 0x7fa5e80b6690 2026-02-23T06:45:14.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.294+0000 7fa5ecb92640 1 -- 10.20.193.58:0/3419072021 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5e81fbb60 con 0x7fa5e80b6690 2026-02-23T06:45:14.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.294+0000 7fa5ecb92640 1 --2- 10.20.193.58:0/3419072021 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5e813c590 0x7fa5e8159a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:14.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.294+0000 7fa5ecb92640 1 -- 10.20.193.58:0/3419072021 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa5e80b6330 con 0x7fa5e813c590 2026-02-23T06:45:14.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.295+0000 7fa5e6ffd640 1 --2- 10.20.193.58:0/3419072021 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5e813c590 0x7fa5e8159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:14.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.295+0000 7fa5e6ffd640 1 -- 10.20.193.58:0/3419072021 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa5e80b5e10 con 0x7fa5e813c590 2026-02-23T06:45:14.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.295+0000 7fa5e6ffd640 1 --2- 10.20.193.58:0/3419072021 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5e813c590 0x7fa5e8159a20 secure :-1 s=READY pgs=84 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5d8009230 tx=0x7fa5d80028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:14.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.295+0000 7fa5c3fff640 1 -- 10.20.193.58:0/3419072021 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5d8044070 con 0x7fa5e813c590 2026-02-23T06:45:14.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.295+0000 7fa5c3fff640 1 -- 10.20.193.58:0/3419072021 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fa5d802fe00 con 0x7fa5e813c590 2026-02-23T06:45:14.290 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.295+0000 7fa5c3fff640 1 -- 10.20.193.58:0/3419072021 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5e813c590 msgr2=0x7fa5e8159a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:14.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.295+0000 7fa5c3fff640 1 --2- 10.20.193.58:0/3419072021 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5e813c590 0x7fa5e8159a20 secure :-1 s=READY pgs=84 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5d8009230 tx=0x7fa5d80028d0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.295+0000 7fa5c3fff640 1 -- 10.20.193.58:0/3419072021 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5e813c590 msgr2=0x7fa5e8159a20 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:45:14.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.295+0000 7fa5c3fff640 1 --2- 10.20.193.58:0/3419072021 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5e813c590 0x7fa5e8159a20 secure :-1 s=CLOSED pgs=84 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5d8009230 tx=0x7fa5d80028d0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.296+0000 7fa5c3fff640 1 -- 10.20.193.58:0/3419072021 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fa5d4003a10 con 0x7fa5e80b6690 2026-02-23T06:45:14.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.297+0000 7fa5c3fff640 1 --2- 10.20.193.58:0/3419072021 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa5b807a430 0x7fa5b809a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:14.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.297+0000 7fa5c3fff640 1 -- 10.20.193.58:0/3419072021 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fa5d409ca90 con 0x7fa5e80b6690 2026-02-23T06:45:14.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.297+0000 7fa5e6ffd640 1 --2- 10.20.193.58:0/3419072021 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa5b807a430 0x7fa5b809a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:14.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.298+0000 7fa5e6ffd640 1 --2- 10.20.193.58:0/3419072021 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa5b807a430 0x7fa5b809a8e0 secure :-1 s=READY pgs=510 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5d80023d0 tx=0x7fa5d8031030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:14.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.299+0000 7fa5ecb92640 1 --2- 10.20.193.58:0/3419072021 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5e81fbf00 0x7fa5e8159f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:14.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.299+0000 7fa5ecb92640 1 -- 10.20.193.58:0/3419072021 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa5e81fb9e0 con 0x7fa5e81fbf00 2026-02-23T06:45:14.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.299+0000 7fa5e7fff640 1 --2- 10.20.193.58:0/3419072021 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5e81fbf00 0x7fa5e8159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:14.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.300+0000 7fa5e7fff640 1 -- 10.20.193.58:0/3419072021 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa5e80b6d50 con 0x7fa5e81fbf00 2026-02-23T06:45:14.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.300+0000 7fa5e7fff640 1 --2- 10.20.193.58:0/3419072021 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5e81fbf00 0x7fa5e8159f60 secure :-1 s=READY pgs=85 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5dc00a690 tx=0x7fa5dc005750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:14.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.300+0000 7fa5c3fff640 1 -- 10.20.193.58:0/3419072021 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5dc012c20 con 0x7fa5e81fbf00 2026-02-23T06:45:14.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.300+0000 7fa5c3fff640 1 -- 10.20.193.58:0/3419072021 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5556 (secure 0 0 0) 0x7fa5dc012d80 con 0x7fa5e81fbf00 2026-02-23T06:45:14.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.300+0000 7fa5c3fff640 1 -- 10.20.193.58:0/3419072021 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5e81fbf00 msgr2=0x7fa5e8159f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:14.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.300+0000 7fa5c3fff640 1 --2- 10.20.193.58:0/3419072021 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5e81fbf00 0x7fa5e8159f60 secure :-1 s=READY pgs=85 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5dc00a690 tx=0x7fa5dc005750 comp rx=0 tx=0).stop 2026-02-23T06:45:14.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.300+0000 7fa5c3fff640 1 -- 10.20.193.58:0/3419072021 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5e81fbf00 msgr2=0x7fa5e8159f60 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:45:14.296 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.300+0000 7fa5c3fff640 1 --2- 10.20.193.58:0/3419072021 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5e81fbf00 0x7fa5e8159f60 secure :-1 s=CLOSED pgs=85 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5dc00a690 tx=0x7fa5dc005750 comp rx=0 tx=0).stop 2026-02-23T06:45:14.296 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:45:14.296 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:45:14.296 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:45:14.296 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:45:14.296 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 212, 2026-02-23T06:45:14.296 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 167730, 2026-02-23T06:45:14.296 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:45:14.296 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:45:14.297 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:45:14.297 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:45:14.297 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:14.297 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:45:14.297 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:45:14.297 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:45:14.297 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:45:14.297 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:45:14.297 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:45:14.297 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:45:14.297 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:45:14.297 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:45:14.297 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:45:14.297 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:45:14.297 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:45:14.297 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:45:14.297 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:45:14.297 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:45:14.298 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:45:14.298 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:45:14.298 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:14.298 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:45:14.298 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:45:14.298 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:45:14.298 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:45:14.298 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:45:14.298 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:45:14.298 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:45:14.298 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:45:14.298 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:45:14.298 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:45:14.298 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:45:14.298 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:45:14.298 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:45:14.298 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:45:14.298 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:45:14.298 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:14.298 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.298 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:45:14.299 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:45:14.299 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:45:14.299 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:45:14.299 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:45:14.299 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:45:14.299 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:45:14.299 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:45:14.299 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:45:14.299 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:45:14.299 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:45:14.299 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:45:14.299 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:45:14.299 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:45:14.299 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:45:14.299 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:45:14.299 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:45:14.299 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:45:14.299 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:45:14.299 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:45:14.299 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:45:14.299 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:45:14.299 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:45:14.300 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:45:14.300 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:45:14.300 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:45:14.300 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:45:14.300 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:45:14.300 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:45:14.300 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:45:14.300 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:14.300 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:45:14.300 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.300 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:45:14.300 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.300 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:45:14.300 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:45:14.300 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:45:14.300 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:45:14.300 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.300 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:45:14.300 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:45:14.300 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:14.300 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.300 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.301 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:45:14.301 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:45:14.301 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:14.301 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:14.301 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:14.301 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.301 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:45:14.301 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:45:14.301 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:45:14.301 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:45:14.301 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:45:14.301 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:45:14.301 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.301 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.301 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:45:14.301 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:45:14.301 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:45:14.301 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:45:14.301 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.301 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:45:14.301 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:45:14.302 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:14.302 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.302 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.302 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:45:14.302 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:45:14.302 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:14.302 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:14.302 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:14.302 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.302 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:45:14.302 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:45:14.302 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:45:14.302 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:45:14.302 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:45:14.302 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:45:14.302 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.302 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.302 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:45:14.302 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:45:14.302 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:45:14.302 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:45:14.302 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.302 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:45:14.303 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:45:14.303 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:14.303 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.303 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.303 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:45:14.303 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:45:14.303 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:14.303 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:14.303 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:14.303 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.303 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:45:14.303 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:45:14.303 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:45:14.303 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:45:14.303 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:45:14.303 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:45:14.303 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:14.303 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:14.303 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.303 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:45:14.303 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:45:14.303 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.303 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:14.304 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:14.304 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:45:14.304 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:14.304 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:14.304 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:45:14.304 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.304 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:14.304 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:14.304 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:45:14.304 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:14.304 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:14.304 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:45:14.304 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.304 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:14.304 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:14.304 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:45:14.304 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:14.304 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:14.304 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:45:14.304 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.304 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:45:14.304 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:45:14.305 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:45:14.305 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.305 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.305 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:14.305 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:14.305 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:45:14.305 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:14.305 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:14.305 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:45:14.305 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:14.305 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:14.305 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:14.305 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:45:14.305 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:14.305 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:14.305 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:14.306 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:45:14.306 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:45:14.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.301+0000 7fa5ecb92640 1 -- 10.20.193.58:0/3419072021 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa5b807a430 msgr2=0x7fa5b809a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:14.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.301+0000 7fa5ecb92640 1 --2- 10.20.193.58:0/3419072021 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa5b807a430 0x7fa5b809a8e0 secure :-1 s=READY pgs=510 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5d80023d0 tx=0x7fa5d8031030 comp rx=0 tx=0).stop 2026-02-23T06:45:14.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.301+0000 7fa5ecb92640 1 -- 10.20.193.58:0/3419072021 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5e80b6690 msgr2=0x7fa5e815e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:14.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.301+0000 7fa5ecb92640 1 --2- 10.20.193.58:0/3419072021 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5e80b6690 0x7fa5e815e8e0 secure :-1 s=READY pgs=61 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5d4007fd0 tx=0x7fa5d400c970 comp rx=0 tx=0).stop 2026-02-23T06:45:14.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.301+0000 7fa5e7fff640 1 -- 10.20.193.58:0/3419072021 reap_dead start 2026-02-23T06:45:14.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.301+0000 7fa5ecb92640 1 -- 10.20.193.58:0/3419072021 shutdown_connections 2026-02-23T06:45:14.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.301+0000 7fa5ecb92640 1 --2- 10.20.193.58:0/3419072021 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5e80b6690 0x7fa5e815e8e0 unknown :-1 s=CLOSED pgs=61 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.301+0000 7fa5ecb92640 1 -- 10.20.193.58:0/3419072021 >> 10.20.193.58:0/3419072021 conn(0x7fa5e80b3c20 msgr2=0x7fa5e805ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:45:14.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.301+0000 7fa5ecb92640 1 -- 10.20.193.58:0/3419072021 shutdown_connections 2026-02-23T06:45:14.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.301+0000 7fa5ecb92640 1 -- 10.20.193.58:0/3419072021 wait complete. 2026-02-23T06:45:14.308 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:45:14.308 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:45:14.308 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:45:14.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.432+0000 7ff3c5083640 1 -- 10.20.193.58:0/2639630626 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff3c0056550 msgr2=0x7ff3c005ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:14.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.432+0000 7ff3c5083640 1 --2- 10.20.193.58:0/2639630626 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff3c0056550 0x7ff3c005ce30 secure :-1 s=READY pgs=62 gs=2 cs=0 l=1 c_cookie=14903702728370844435 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3b0005e70 tx=0x7ff3b002f290 comp rx=0 tx=0).stop 2026-02-23T06:45:14.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.433+0000 7ff3c5083640 1 -- 10.20.193.58:0/2639630626 shutdown_connections 2026-02-23T06:45:14.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.433+0000 7ff3c5083640 1 --2- 10.20.193.58:0/2639630626 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff3c0056550 0x7ff3c005ce30 unknown :-1 s=CLOSED pgs=62 gs=2 cs=0 l=1 c_cookie=14903702728370844435 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.433+0000 7ff3c5083640 1 --2- 10.20.193.58:0/2639630626 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff3c015c040 0x7ff3c005b0e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.433+0000 7ff3c5083640 1 -- 10.20.193.58:0/2639630626 >> 10.20.193.58:0/2639630626 conn(0x7ff3c00b3c20 msgr2=0x7ff3c00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:45:14.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.433+0000 7ff3c5083640 1 -- 10.20.193.58:0/2639630626 shutdown_connections 2026-02-23T06:45:14.428 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.433+0000 7ff3c5083640 1 -- 10.20.193.58:0/2639630626 wait complete. 2026-02-23T06:45:14.429 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.434+0000 7ff3c5083640 1 Processor -- start 2026-02-23T06:45:14.429 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.434+0000 7ff3c5083640 1 -- start start 2026-02-23T06:45:14.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.434+0000 7ff3c5083640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff3c0056550 0x7ff3c0138de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:14.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.435+0000 7ff3c5083640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff3c005d370 0x7ff3c013b060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:14.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.435+0000 7ff3c5083640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff3c015c040 0x7ff3c0154520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:14.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.435+0000 7ff3c5083640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c0137dd0 con 0x7ff3c005d370 2026-02-23T06:45:14.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.435+0000 7ff3c5083640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c0138950 con 0x7ff3c015c040 2026-02-23T06:45:14.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.435+0000 7ff3c5083640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7ff3c0130a40 con 0x7ff3c0056550 2026-02-23T06:45:14.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.435+0000 7ff3bf7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff3c005d370 0x7ff3c013b060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:14.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.435+0000 7ff3bffff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff3c0056550 0x7ff3c0138de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:14.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.435+0000 7ff3bf7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff3c005d370 0x7ff3c013b060 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:42900/0 (socket says 10.20.193.58:42900) 2026-02-23T06:45:14.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.435+0000 7ff3bffff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff3c0056550 0x7ff3c0138de0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:55668/0 (socket says 10.20.193.58:55668) 2026-02-23T06:45:14.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.435+0000 7ff3bf7fe640 1 -- 10.20.193.58:0/478828314 learned_addr learned my addr 10.20.193.58:0/478828314 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:45:14.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.435+0000 7ff3c4882640 1 --2- 10.20.193.58:0/478828314 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff3c015c040 0x7ff3c0154520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:14.430 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.435+0000 7ff3bf7fe640 1 -- 10.20.193.58:0/478828314 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff3c0056550 msgr2=0x7ff3c0138de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:14.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.435+0000 7ff3bf7fe640 1 --2- 10.20.193.58:0/478828314 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff3c0056550 0x7ff3c0138de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.435+0000 7ff3bf7fe640 1 -- 10.20.193.58:0/478828314 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff3c015c040 msgr2=0x7ff3c0154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:14.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.435+0000 7ff3bf7fe640 1 --2- 10.20.193.58:0/478828314 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff3c015c040 0x7ff3c0154520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.435+0000 7ff3bf7fe640 1 -- 10.20.193.58:0/478828314 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b0009570 con 0x7ff3c005d370 2026-02-23T06:45:14.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.435+0000 7ff3bf7fe640 1 --2- 10.20.193.58:0/478828314 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff3c005d370 0x7ff3c013b060 secure :-1 s=READY pgs=63 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3b002f7f0 tx=0x7ff3b00028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:14.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.435+0000 7ff3bcff9640 1 -- 10.20.193.58:0/478828314 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff3b003d070 con 0x7ff3c005d370 2026-02-23T06:45:14.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.435+0000 7ff3bcff9640 1 -- 10.20.193.58:0/478828314 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3b0038470 con 0x7ff3c005d370 2026-02-23T06:45:14.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.435+0000 7ff3bcff9640 1 -- 10.20.193.58:0/478828314 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff3b00388a0 con 0x7ff3c005d370 2026-02-23T06:45:14.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.435+0000 7ff3c5083640 1 -- 10.20.193.58:0/478828314 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c0136790 con 0x7ff3c005d370 2026-02-23T06:45:14.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.435+0000 7ff3c5083640 1 -- 10.20.193.58:0/478828314 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c0138300 con 0x7ff3c005d370 2026-02-23T06:45:14.431 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.436+0000 7ff3c5083640 1 -- 10.20.193.58:0/478828314 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3c0138a90 con 0x7ff3c005d370 2026-02-23T06:45:14.432 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.437+0000 7ff3bcff9640 1 -- 10.20.193.58:0/478828314 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7ff3b0038a00 con 0x7ff3c005d370 2026-02-23T06:45:14.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.438+0000 7ff3bcff9640 1 --2- 10.20.193.58:0/478828314 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff39007a6b0 0x7ff39009ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:14.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.438+0000 7ff3bcff9640 1 -- 10.20.193.58:0/478828314 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7ff3b00c21f0 con 0x7ff3c005d370 2026-02-23T06:45:14.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.438+0000 7ff3bffff640 1 --2- 10.20.193.58:0/478828314 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff39007a6b0 0x7ff39009ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:14.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.439+0000 7ff3bffff640 1 --2- 10.20.193.58:0/478828314 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff39007a6b0 0x7ff39009ab60 secure :-1 s=READY pgs=511 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3ac004740 tx=0x7ff3ac005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:14.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.440+0000 7ff3bcff9640 1 -- 10.20.193.58:0/478828314 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7ff3b0085360 con 0x7ff3c005d370 2026-02-23T06:45:14.589 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.594+0000 7ff3c5083640 1 -- 10.20.193.58:0/478828314 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7ff3c005b5f0 con 0x7ff3c005d370 2026-02-23T06:45:14.589 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.595+0000 7ff3bcff9640 1 -- 10.20.193.58:0/478828314 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7ff3b0088510 con 0x7ff3c005d370 2026-02-23T06:45:14.590 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.596+0000 7ff3c5083640 1 -- 10.20.193.58:0/478828314 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff39007a6b0 msgr2=0x7ff39009ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:14.590 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.596+0000 7ff3c5083640 1 --2- 10.20.193.58:0/478828314 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff39007a6b0 0x7ff39009ab60 secure :-1 s=READY pgs=511 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3ac004740 tx=0x7ff3ac005f90 comp rx=0 tx=0).stop 2026-02-23T06:45:14.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.596+0000 7ff3c5083640 1 -- 10.20.193.58:0/478828314 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff3c005d370 msgr2=0x7ff3c013b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:14.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.596+0000 7ff3c5083640 1 --2- 10.20.193.58:0/478828314 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff3c005d370 0x7ff3c013b060 secure :-1 s=READY pgs=63 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3b002f7f0 tx=0x7ff3b00028d0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.596+0000 7ff3c5083640 1 -- 10.20.193.58:0/478828314 shutdown_connections 2026-02-23T06:45:14.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.596+0000 7ff3c5083640 1 --2- 10.20.193.58:0/478828314 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff39007a6b0 0x7ff39009ab60 unknown :-1 s=CLOSED pgs=511 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.596+0000 7ff3c5083640 1 --2- 10.20.193.58:0/478828314 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff3c015c040 0x7ff3c0154520 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.596+0000 7ff3c5083640 1 --2- 10.20.193.58:0/478828314 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff3c005d370 0x7ff3c013b060 unknown :-1 s=CLOSED pgs=63 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.596+0000 7ff3c5083640 1 --2- 10.20.193.58:0/478828314 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff3c0056550 0x7ff3c0138de0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:14.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.596+0000 7ff3c5083640 1 -- 10.20.193.58:0/478828314 >> 10.20.193.58:0/478828314 conn(0x7ff3c00b3c20 msgr2=0x7ff3c0163200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:45:14.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.596+0000 7ff3c5083640 1 -- 10.20.193.58:0/478828314 shutdown_connections 2026-02-23T06:45:14.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:14.596+0000 7ff3c5083640 1 -- 10.20.193.58:0/478828314 wait complete. 2026-02-23T06:45:14.603 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:45:15.035 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:45:15.038 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:45:24.603 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:45:24.604 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:45:24.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.730+0000 7fb626b7e640 1 -- 10.20.193.58:0/63006079 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb62015d4a0 msgr2=0x7fb6200affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:24.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.730+0000 7fb626b7e640 1 --2- 10.20.193.58:0/63006079 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb62015d4a0 0x7fb6200affb0 secure :-1 s=READY pgs=86 gs=2 cs=0 l=1 c_cookie=2678014594909724706 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb610004740 tx=0x7fb61002f1e0 comp rx=0 tx=0).stop 2026-02-23T06:45:24.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.730+0000 7fb626b7e640 1 -- 10.20.193.58:0/63006079 shutdown_connections 2026-02-23T06:45:24.726 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.730+0000 7fb626b7e640 1 --2- 10.20.193.58:0/63006079 >> v2:10.20.193.93:3300/0 conn(0x7fb6200b6690 0x7fb620058ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:24.727 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.730+0000 7fb626b7e640 1 --2- 10.20.193.58:0/63006079 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb62015d4a0 0x7fb6200affb0 unknown :-1 s=CLOSED pgs=86 gs=2 cs=0 l=1 c_cookie=2678014594909724706 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:24.727 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.730+0000 7fb626b7e640 1 -- 10.20.193.58:0/63006079 >> 10.20.193.58:0/63006079 conn(0x7fb6200b3c20 msgr2=0x7fb6200b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:45:24.727 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.730+0000 7fb626b7e640 1 -- 10.20.193.58:0/63006079 shutdown_connections 2026-02-23T06:45:24.727 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.730+0000 7fb626b7e640 1 -- 10.20.193.58:0/63006079 wait complete. 2026-02-23T06:45:24.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.731+0000 7fb626b7e640 1 Processor -- start 2026-02-23T06:45:24.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.732+0000 7fb626b7e640 1 -- start start 2026-02-23T06:45:24.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.732+0000 7fb626b7e640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb6200b6690 0x7fb6201624b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:24.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.732+0000 7fb626b7e640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb62015d4a0 0x7fb620142e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:24.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.732+0000 7fb626b7e640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb62015d870 0x7fb6201596b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:24.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.732+0000 7fb626b7e640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb6201629f0 con 0x7fb6200b6690 2026-02-23T06:45:24.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.732+0000 7fb626b7e640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb620161910 con 0x7fb62015d4a0 2026-02-23T06:45:24.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.732+0000 7fb626b7e640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb620141120 con 0x7fb62015d870 2026-02-23T06:45:24.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.732+0000 7fb625b7c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb6200b6690 0x7fb6201624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:24.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.732+0000 7fb62537b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb62015d4a0 0x7fb620142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:24.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.732+0000 7fb625b7c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb6200b6690 0x7fb6201624b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:47406/0 (socket says 10.20.193.58:47406) 2026-02-23T06:45:24.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.732+0000 7fb625b7c640 1 -- 10.20.193.58:0/1814653977 learned_addr learned my addr 10.20.193.58:0/1814653977 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:45:24.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.733+0000 7fb62637d640 1 --2- 10.20.193.58:0/1814653977 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb62015d870 0x7fb6201596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:24.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.733+0000 7fb625b7c640 1 -- 10.20.193.58:0/1814653977 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb62015d870 msgr2=0x7fb6201596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:24.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.733+0000 7fb625b7c640 1 --2- 10.20.193.58:0/1814653977 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb62015d870 0x7fb6201596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:24.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.733+0000 7fb625b7c640 1 -- 10.20.193.58:0/1814653977 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb62015d4a0 msgr2=0x7fb620142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:24.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.733+0000 7fb625b7c640 1 --2- 10.20.193.58:0/1814653977 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb62015d4a0 0x7fb620142e20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:24.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.733+0000 7fb625b7c640 1 -- 10.20.193.58:0/1814653977 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb61c00a590 con 0x7fb6200b6690 2026-02-23T06:45:24.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.733+0000 7fb625b7c640 1 --2- 10.20.193.58:0/1814653977 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb6200b6690 0x7fb6201624b0 secure :-1 s=READY pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb610009960 tx=0x7fb6100028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:24.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.733+0000 7fb60e7fc640 1 -- 10.20.193.58:0/1814653977 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb610038470 con 0x7fb6200b6690 2026-02-23T06:45:24.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.733+0000 7fb626b7e640 1 -- 10.20.193.58:0/1814653977 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6100094b0 con 0x7fb6200b6690 2026-02-23T06:45:24.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.733+0000 7fb60e7fc640 1 -- 10.20.193.58:0/1814653977 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6100386c0 con 0x7fb6200b6690 2026-02-23T06:45:24.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.733+0000 7fb60e7fc640 1 -- 10.20.193.58:0/1814653977 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb610038a90 con 0x7fb6200b6690 2026-02-23T06:45:24.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.733+0000 7fb626b7e640 1 -- 10.20.193.58:0/1814653977 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6201fe3c0 con 0x7fb6200b6690 2026-02-23T06:45:24.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.734+0000 7fb626b7e640 1 -- 10.20.193.58:0/1814653977 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6201fe220 con 0x7fb6200b6690 2026-02-23T06:45:24.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.735+0000 7fb60e7fc640 1 -- 10.20.193.58:0/1814653977 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fb610038bf0 con 0x7fb6200b6690 2026-02-23T06:45:24.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.736+0000 7fb60e7fc640 1 --2- 10.20.193.58:0/1814653977 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb5f007a630 0x7fb5f009aae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:24.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.736+0000 7fb60e7fc640 1 -- 10.20.193.58:0/1814653977 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fb6100c3670 con 0x7fb6200b6690 2026-02-23T06:45:24.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.737+0000 7fb62537b640 1 --2- 10.20.193.58:0/1814653977 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb5f007a630 0x7fb5f009aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:24.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.737+0000 7fb60e7fc640 1 -- 10.20.193.58:0/1814653977 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fb61008a300 con 0x7fb6200b6690 2026-02-23T06:45:24.733 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.737+0000 7fb62537b640 1 --2- 10.20.193.58:0/1814653977 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb5f007a630 0x7fb5f009aae0 secure :-1 s=READY pgs=512 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb62013ee60 tx=0x7fb614007ee0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:24.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.891+0000 7fb626b7e640 1 -- 10.20.193.58:0/1814653977 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb6201fe220 con 0x7fb6200b6690 2026-02-23T06:45:24.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.892+0000 7fb60e7fc640 1 -- 10.20.193.58:0/1814653977 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7fb6201fe220 con 0x7fb6200b6690 2026-02-23T06:45:24.887 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":212,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:45:24.888 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.893+0000 7fb626b7e640 1 -- 10.20.193.58:0/1814653977 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb5f007a630 msgr2=0x7fb5f009aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:24.888 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.893+0000 7fb626b7e640 1 --2- 10.20.193.58:0/1814653977 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb5f007a630 0x7fb5f009aae0 secure :-1 s=READY pgs=512 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb62013ee60 tx=0x7fb614007ee0 comp rx=0 tx=0).stop 2026-02-23T06:45:24.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.893+0000 7fb626b7e640 1 -- 10.20.193.58:0/1814653977 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb6200b6690 msgr2=0x7fb6201624b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:24.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.893+0000 7fb626b7e640 1 --2- 10.20.193.58:0/1814653977 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb6200b6690 0x7fb6201624b0 secure :-1 s=READY pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb610009960 tx=0x7fb6100028d0 comp rx=0 tx=0).stop 2026-02-23T06:45:24.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.893+0000 7fb626b7e640 1 -- 10.20.193.58:0/1814653977 shutdown_connections 2026-02-23T06:45:24.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.893+0000 7fb626b7e640 1 --2- 10.20.193.58:0/1814653977 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb5f007a630 0x7fb5f009aae0 unknown :-1 s=CLOSED pgs=512 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:24.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.893+0000 7fb626b7e640 1 --2- 10.20.193.58:0/1814653977 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb62015d870 0x7fb6201596b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:24.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.893+0000 7fb626b7e640 1 --2- 10.20.193.58:0/1814653977 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb62015d4a0 0x7fb620142e20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:24.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.893+0000 7fb626b7e640 1 --2- 10.20.193.58:0/1814653977 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb6200b6690 0x7fb6201624b0 unknown :-1 s=CLOSED pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:24.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.893+0000 7fb626b7e640 1 -- 10.20.193.58:0/1814653977 >> 10.20.193.58:0/1814653977 conn(0x7fb6200b3c20 msgr2=0x7fb6200586d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:45:24.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.893+0000 7fb626b7e640 1 -- 10.20.193.58:0/1814653977 shutdown_connections 2026-02-23T06:45:24.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:24.893+0000 7fb626b7e640 1 -- 10.20.193.58:0/1814653977 wait complete. 2026-02-23T06:45:24.901 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:45:24.901 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:45:24.901 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:45:24.901 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:45:25.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.029+0000 7f8d03683640 1 -- 10.20.193.58:0/1633262994 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8cfc15c040 msgr2=0x7f8cfc05b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:25.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.029+0000 7f8d03683640 1 --2- 10.20.193.58:0/1633262994 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8cfc15c040 0x7f8cfc05b0e0 secure :-1 s=READY pgs=13 gs=2 cs=0 l=1 c_cookie=12765076664094331095 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8cf4005e70 tx=0x7f8cf402f290 comp rx=0 tx=0).stop 2026-02-23T06:45:25.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.029+0000 7f8d03683640 1 -- 10.20.193.58:0/1633262994 shutdown_connections 2026-02-23T06:45:25.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.029+0000 7f8d03683640 1 --2- 10.20.193.58:0/1633262994 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8cfc0b5680 0x7f8cfc0b5b00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:25.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.029+0000 7f8d03683640 1 --2- 10.20.193.58:0/1633262994 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8cfc15c040 0x7f8cfc05b0e0 unknown :-1 s=CLOSED pgs=13 gs=2 cs=0 l=1 c_cookie=12765076664094331095 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:25.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.029+0000 7f8d03683640 1 -- 10.20.193.58:0/1633262994 >> 10.20.193.58:0/1633262994 conn(0x7f8cfc0b3c20 msgr2=0x7f8cfc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:45:25.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.029+0000 7f8d03683640 1 -- 10.20.193.58:0/1633262994 shutdown_connections 2026-02-23T06:45:25.025 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.029+0000 7f8d03683640 1 -- 10.20.193.58:0/1633262994 wait complete. 2026-02-23T06:45:25.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.030+0000 7f8d03683640 1 Processor -- start 2026-02-23T06:45:25.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.030+0000 7f8d03683640 1 -- start start 2026-02-23T06:45:25.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.031+0000 7f8d03683640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8cfc056550 0x7f8cfc1551f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:25.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.031+0000 7f8d03683640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8cfc0b5680 0x7f8cfc0585e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:25.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.031+0000 7f8d03683640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8cfc15c040 0x7f8cfc058b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:25.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.031+0000 7f8d03683640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f8cfc155ff0 con 0x7f8cfc056550 2026-02-23T06:45:25.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.031+0000 7f8d03683640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f8cfc153740 con 0x7f8cfc0b5680 2026-02-23T06:45:25.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.031+0000 7f8d03683640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f8cfc155d30 con 0x7f8cfc15c040 2026-02-23T06:45:25.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.031+0000 7f8d01e80640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8cfc0b5680 0x7f8cfc0585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:25.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.031+0000 7f8d02681640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8cfc056550 0x7f8cfc1551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:25.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.031+0000 7f8d01e80640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8cfc0b5680 0x7f8cfc0585e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:46374/0 (socket says 10.20.193.58:46374) 2026-02-23T06:45:25.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.031+0000 7f8d01e80640 1 -- 10.20.193.58:0/1023307719 learned_addr learned my addr 10.20.193.58:0/1023307719 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:45:25.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.031+0000 7f8d02e82640 1 --2- 10.20.193.58:0/1023307719 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8cfc15c040 0x7f8cfc058b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:25.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.031+0000 7f8d02e82640 1 -- 10.20.193.58:0/1023307719 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8cfc0b5680 msgr2=0x7f8cfc0585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:25.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.031+0000 7f8d02e82640 1 --2- 10.20.193.58:0/1023307719 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8cfc0b5680 0x7f8cfc0585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:25.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.031+0000 7f8d02e82640 1 -- 10.20.193.58:0/1023307719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8cfc056550 msgr2=0x7f8cfc1551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:25.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.031+0000 7f8d02e82640 1 --2- 10.20.193.58:0/1023307719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8cfc056550 0x7f8cfc1551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:25.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.031+0000 7f8d02e82640 1 -- 10.20.193.58:0/1023307719 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf4009570 con 0x7f8cfc15c040 2026-02-23T06:45:25.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.031+0000 7f8d02e82640 1 --2- 10.20.193.58:0/1023307719 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8cfc15c040 0x7f8cfc058b20 secure :-1 s=READY pgs=87 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8cf000f940 tx=0x7f8cf000fe10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:25.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.032+0000 7f8ce6ffd640 1 -- 10.20.193.58:0/1023307719 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8cf000dce0 con 0x7f8cfc15c040 2026-02-23T06:45:25.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.032+0000 7f8ce6ffd640 1 -- 10.20.193.58:0/1023307719 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8cf000de60 con 0x7f8cfc15c040 2026-02-23T06:45:25.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.032+0000 7f8ce6ffd640 1 -- 10.20.193.58:0/1023307719 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8cf0005b90 con 0x7f8cfc15c040 2026-02-23T06:45:25.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.032+0000 7f8d03683640 1 -- 10.20.193.58:0/1023307719 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cfc1fe490 con 0x7f8cfc15c040 2026-02-23T06:45:25.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.032+0000 7f8d03683640 1 -- 10.20.193.58:0/1023307719 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cfc155730 con 0x7f8cfc15c040 2026-02-23T06:45:25.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.032+0000 7f8d03683640 1 --2- 10.20.193.58:0/1023307719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8cfc151a50 0x7f8cfc153160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:25.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.032+0000 7f8d03683640 1 -- 10.20.193.58:0/1023307719 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f8cfc1fe620 con 0x7f8cfc151a50 2026-02-23T06:45:25.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.033+0000 7f8d02681640 1 --2- 10.20.193.58:0/1023307719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8cfc151a50 0x7f8cfc153160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:25.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.033+0000 7f8d02681640 1 -- 10.20.193.58:0/1023307719 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8cfc05b620 con 0x7f8cfc151a50 2026-02-23T06:45:25.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.033+0000 7f8d02681640 1 --2- 10.20.193.58:0/1023307719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8cfc151a50 0x7f8cfc153160 secure :-1 s=READY pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8cf4004740 tx=0x7f8cf40028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:25.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.033+0000 7f8ce6ffd640 1 -- 10.20.193.58:0/1023307719 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8cf403d050 con 0x7f8cfc151a50 2026-02-23T06:45:25.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.033+0000 7f8ce6ffd640 1 -- 10.20.193.58:0/1023307719 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f8cf403e040 con 0x7f8cfc151a50 2026-02-23T06:45:25.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.033+0000 7f8ce6ffd640 1 -- 10.20.193.58:0/1023307719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8cfc151a50 msgr2=0x7f8cfc153160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:25.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.033+0000 7f8ce6ffd640 1 --2- 10.20.193.58:0/1023307719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8cfc151a50 0x7f8cfc153160 secure :-1 s=READY pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8cf4004740 tx=0x7f8cf40028d0 comp rx=0 tx=0).stop 2026-02-23T06:45:25.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.033+0000 7f8ce6ffd640 1 -- 10.20.193.58:0/1023307719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8cfc151a50 msgr2=0x7f8cfc153160 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:45:25.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.033+0000 7f8ce6ffd640 1 --2- 10.20.193.58:0/1023307719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8cfc151a50 0x7f8cfc153160 unknown :-1 s=CLOSED pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:25.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.034+0000 7f8ce6ffd640 1 -- 10.20.193.58:0/1023307719 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f8cf0020060 con 0x7f8cfc15c040 2026-02-23T06:45:25.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.034+0000 7f8ce6ffd640 1 --2- 10.20.193.58:0/1023307719 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8ccc07a3c0 0x7f8ccc09a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:25.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.034+0000 7f8ce6ffd640 1 -- 10.20.193.58:0/1023307719 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f8cf0015070 con 0x7f8cfc15c040 2026-02-23T06:45:25.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.035+0000 7f8d02681640 1 --2- 10.20.193.58:0/1023307719 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8ccc07a3c0 0x7f8ccc09a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:25.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.035+0000 7f8d02681640 1 --2- 10.20.193.58:0/1023307719 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8ccc07a3c0 0x7f8ccc09a870 secure :-1 s=READY pgs=513 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8cf40098a0 tx=0x7f8cf4031030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:25.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.037+0000 7f8d03683640 1 --2- 10.20.193.58:0/1023307719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8cfc1629e0 0x7f8cfc153a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:25.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.037+0000 7f8d03683640 1 -- 10.20.193.58:0/1023307719 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f8cfc15c410 con 0x7f8cfc1629e0 2026-02-23T06:45:25.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.037+0000 7f8d01e80640 1 --2- 10.20.193.58:0/1023307719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8cfc1629e0 0x7f8cfc153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:25.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.037+0000 7f8d01e80640 1 -- 10.20.193.58:0/1023307719 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8cfc153880 con 0x7f8cfc1629e0 2026-02-23T06:45:25.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.037+0000 7f8d01e80640 1 --2- 10.20.193.58:0/1023307719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8cfc1629e0 0x7f8cfc153a60 secure :-1 s=READY pgs=66 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8cfc157cf0 tx=0x7f8ce800eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:25.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.038+0000 7f8ce6ffd640 1 -- 10.20.193.58:0/1023307719 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8ce8019070 con 0x7f8cfc1629e0 2026-02-23T06:45:25.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.038+0000 7f8ce6ffd640 1 -- 10.20.193.58:0/1023307719 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5248 (secure 0 0 0) 0x7f8ce800ee00 con 0x7f8cfc1629e0 2026-02-23T06:45:25.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.038+0000 7f8ce6ffd640 1 -- 10.20.193.58:0/1023307719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8cfc1629e0 msgr2=0x7f8cfc153a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:25.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.038+0000 7f8ce6ffd640 1 --2- 10.20.193.58:0/1023307719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8cfc1629e0 0x7f8cfc153a60 secure :-1 s=READY pgs=66 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8cfc157cf0 tx=0x7f8ce800eba0 comp rx=0 tx=0).stop 2026-02-23T06:45:25.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.038+0000 7f8ce6ffd640 1 -- 10.20.193.58:0/1023307719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8cfc1629e0 msgr2=0x7f8cfc153a60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:45:25.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.038+0000 7f8ce6ffd640 1 --2- 10.20.193.58:0/1023307719 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8cfc1629e0 0x7f8cfc153a60 unknown :-1 s=CLOSED pgs=66 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:25.035 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:45:25.035 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:45:25.036 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:45:25.036 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:45:25.036 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 212, 2026-02-23T06:45:25.036 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 74710, 2026-02-23T06:45:25.036 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:45:25.036 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:45:25.036 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:45:25.036 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:45:25.036 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:25.036 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:45:25.036 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:45:25.037 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:45:25.037 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:45:25.037 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:45:25.037 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:45:25.037 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:45:25.037 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:45:25.037 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:45:25.037 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:45:25.037 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:45:25.037 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:45:25.037 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:45:25.037 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:45:25.037 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:45:25.038 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:45:25.038 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:45:25.038 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:25.038 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:45:25.038 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:45:25.038 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:45:25.038 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:45:25.038 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:45:25.038 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:45:25.038 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:45:25.038 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:45:25.038 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:45:25.039 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:45:25.039 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:45:25.039 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:45:25.039 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:45:25.039 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:45:25.039 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:45:25.039 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:25.039 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.039 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:45:25.039 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:45:25.039 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:45:25.040 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:45:25.040 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:45:25.040 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:45:25.040 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:45:25.040 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:45:25.040 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:45:25.040 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:45:25.040 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:45:25.040 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:45:25.040 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:45:25.040 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:45:25.040 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:45:25.041 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:45:25.041 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:45:25.041 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:45:25.041 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:45:25.041 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:45:25.041 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:45:25.041 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:45:25.041 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:45:25.041 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:45:25.041 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:45:25.041 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:45:25.041 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:45:25.042 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:45:25.042 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:45:25.042 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:45:25.042 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:25.042 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:45:25.042 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.042 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:45:25.042 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.042 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:45:25.042 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:45:25.042 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:45:25.042 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:45:25.043 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.043 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:45:25.043 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:45:25.043 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:25.043 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.043 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.043 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:45:25.043 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:45:25.043 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:25.043 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:25.043 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:25.043 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.044 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:45:25.044 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:45:25.044 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:45:25.044 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:45:25.044 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:45:25.044 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:45:25.044 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.044 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.044 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:45:25.044 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:45:25.044 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:45:25.044 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:45:25.044 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.045 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:45:25.045 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:45:25.045 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:25.045 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.045 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.045 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:45:25.045 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:45:25.045 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:25.045 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:25.045 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:25.045 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.045 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:45:25.046 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:45:25.046 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:45:25.046 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:45:25.046 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:45:25.046 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:45:25.046 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.046 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.046 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:45:25.046 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:45:25.046 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:45:25.046 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:45:25.046 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.047 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:45:25.047 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:45:25.047 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:25.047 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.047 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.047 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:45:25.047 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:45:25.047 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:25.047 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:25.047 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:25.047 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.047 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:45:25.047 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:45:25.048 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:45:25.048 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:45:25.048 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:45:25.048 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:45:25.048 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:25.048 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:25.048 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.048 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:45:25.048 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:45:25.049 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.049 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:25.049 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:25.049 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:45:25.049 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:25.049 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:25.049 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:45:25.049 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.049 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:25.049 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:25.049 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:45:25.049 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:25.049 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:25.050 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:45:25.050 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.050 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:25.050 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:25.050 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:45:25.050 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:25.050 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:25.050 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:45:25.050 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.050 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:25.050 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:25.050 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:45:25.051 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:25.051 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:25.051 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.051 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:45:25.051 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:45:25.053 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.038+0000 7f8d03683640 1 -- 10.20.193.58:0/1023307719 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8ccc07a3c0 msgr2=0x7f8ccc09a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:25.053 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.038+0000 7f8d03683640 1 --2- 10.20.193.58:0/1023307719 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8ccc07a3c0 0x7f8ccc09a870 secure :-1 s=READY pgs=513 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8cf40098a0 tx=0x7f8cf4031030 comp rx=0 tx=0).stop 2026-02-23T06:45:25.053 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.038+0000 7f8d03683640 1 -- 10.20.193.58:0/1023307719 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8cfc15c040 msgr2=0x7f8cfc058b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:25.053 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.038+0000 7f8d03683640 1 --2- 10.20.193.58:0/1023307719 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8cfc15c040 0x7f8cfc058b20 secure :-1 s=READY pgs=87 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8cf000f940 tx=0x7f8cf000fe10 comp rx=0 tx=0).stop 2026-02-23T06:45:25.053 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.038+0000 7f8d02e82640 1 -- 10.20.193.58:0/1023307719 reap_dead start 2026-02-23T06:45:25.053 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.038+0000 7f8d02e82640 1 -- 10.20.193.58:0/1023307719 reap_dead start 2026-02-23T06:45:25.053 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.038+0000 7f8d03683640 1 -- 10.20.193.58:0/1023307719 shutdown_connections 2026-02-23T06:45:25.053 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.038+0000 7f8d03683640 1 -- 10.20.193.58:0/1023307719 >> 10.20.193.58:0/1023307719 conn(0x7f8cfc0b3c20 msgr2=0x7f8cfc163200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:45:25.053 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.038+0000 7f8d03683640 1 -- 10.20.193.58:0/1023307719 shutdown_connections 2026-02-23T06:45:25.054 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.038+0000 7f8d03683640 1 -- 10.20.193.58:0/1023307719 wait complete. 2026-02-23T06:45:25.054 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:45:25.054 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:45:25.054 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:45:25.178 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.182+0000 7fb385283640 1 -- 10.20.193.58:0/858046924 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3800b6690 msgr2=0x7fb380058ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:25.178 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.182+0000 7fb385283640 1 --2- 10.20.193.58:0/858046924 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3800b6690 0x7fb380058ec0 secure :-1 s=READY pgs=68 gs=3 cs=0 l=1 c_cookie=7039353175307835068 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb374005820 tx=0x7fb374030300 comp rx=0 tx=0).stop 2026-02-23T06:45:25.178 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.182+0000 7fb385283640 1 -- 10.20.193.58:0/858046924 shutdown_connections 2026-02-23T06:45:25.178 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.182+0000 7fb385283640 1 --2- 10.20.193.58:0/858046924 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb3800b6690 0x7fb380058ec0 unknown :-1 s=CLOSED pgs=68 gs=3 cs=0 l=1 c_cookie=7039353175307835068 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:25.178 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.182+0000 7fb385283640 1 -- 10.20.193.58:0/858046924 >> 10.20.193.58:0/858046924 conn(0x7fb3800b3c20 msgr2=0x7fb3800b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:45:25.178 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.182+0000 7fb385283640 1 -- 10.20.193.58:0/858046924 shutdown_connections 2026-02-23T06:45:25.179 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.182+0000 7fb385283640 1 -- 10.20.193.58:0/858046924 wait complete. 2026-02-23T06:45:25.183 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.183+0000 7fb385283640 1 Processor -- start 2026-02-23T06:45:25.183 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.183+0000 7fb385283640 1 -- start start 2026-02-23T06:45:25.183 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.184+0000 7fb385283640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3800b6690 0x7fb38013aff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:25.183 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.184+0000 7fb385283640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb38015d4a0 0x7fb38013d130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:25.183 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.184+0000 7fb385283640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb38015d870 0x7fb38015a250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:25.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.184+0000 7fb385283640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb38013dd00 con 0x7fb38015d4a0 2026-02-23T06:45:25.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.184+0000 7fb385283640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb38015de50 con 0x7fb3800b6690 2026-02-23T06:45:25.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.184+0000 7fb385283640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb38015e130 con 0x7fb38015d870 2026-02-23T06:45:25.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.184+0000 7fb37ffff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3800b6690 0x7fb38013aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:25.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.184+0000 7fb37ffff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3800b6690 0x7fb38013aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:46390/0 (socket says 10.20.193.58:46390) 2026-02-23T06:45:25.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.184+0000 7fb37f7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb38015d4a0 0x7fb38013d130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:25.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.184+0000 7fb37ffff640 1 -- 10.20.193.58:0/4201050421 learned_addr learned my addr 10.20.193.58:0/4201050421 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:45:25.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.184+0000 7fb384a82640 1 --2- 10.20.193.58:0/4201050421 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb38015d870 0x7fb38015a250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:25.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.184+0000 7fb37ffff640 1 -- 10.20.193.58:0/4201050421 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb38015d870 msgr2=0x7fb38015a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:25.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.184+0000 7fb37ffff640 1 --2- 10.20.193.58:0/4201050421 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb38015d870 0x7fb38015a250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:25.184 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.184+0000 7fb37ffff640 1 -- 10.20.193.58:0/4201050421 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb38015d4a0 msgr2=0x7fb38013d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:25.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.184+0000 7fb37ffff640 1 --2- 10.20.193.58:0/4201050421 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb38015d4a0 0x7fb38013d130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:25.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.184+0000 7fb37ffff640 1 -- 10.20.193.58:0/4201050421 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb37400a590 con 0x7fb3800b6690 2026-02-23T06:45:25.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.184+0000 7fb384a82640 1 --2- 10.20.193.58:0/4201050421 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb38015d870 0x7fb38015a250 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:45:25.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.185+0000 7fb37ffff640 1 --2- 10.20.193.58:0/4201050421 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3800b6690 0x7fb38013aff0 secure :-1 s=READY pgs=15 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb36c00c4d0 tx=0x7fb36c00c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:25.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.185+0000 7fb37cff9640 1 -- 10.20.193.58:0/4201050421 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb36c006b70 con 0x7fb3800b6690 2026-02-23T06:45:25.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.185+0000 7fb385283640 1 -- 10.20.193.58:0/4201050421 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb38015e410 con 0x7fb3800b6690 2026-02-23T06:45:25.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.185+0000 7fb37cff9640 1 -- 10.20.193.58:0/4201050421 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb36c006dc0 con 0x7fb3800b6690 2026-02-23T06:45:25.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.185+0000 7fb37cff9640 1 -- 10.20.193.58:0/4201050421 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb36c007270 con 0x7fb3800b6690 2026-02-23T06:45:25.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.185+0000 7fb385283640 1 -- 10.20.193.58:0/4201050421 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb380140120 con 0x7fb3800b6690 2026-02-23T06:45:25.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.185+0000 7fb385283640 1 --2- 10.20.193.58:0/4201050421 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb38013d670 0x7fb38015a790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:25.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.185+0000 7fb385283640 1 -- 10.20.193.58:0/4201050421 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb3800b5e10 con 0x7fb38013d670 2026-02-23T06:45:25.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.186+0000 7fb37f7fe640 1 --2- 10.20.193.58:0/4201050421 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb38013d670 0x7fb38015a790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:25.186 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.186+0000 7fb37f7fe640 1 -- 10.20.193.58:0/4201050421 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb3800b5b30 con 0x7fb38013d670 2026-02-23T06:45:25.186 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.186+0000 7fb37f7fe640 1 --2- 10.20.193.58:0/4201050421 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb38013d670 0x7fb38015a790 secure :-1 s=READY pgs=16 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb38015e950 tx=0x7fb37000eba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:25.186 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.187+0000 7fb37cff9640 1 -- 10.20.193.58:0/4201050421 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb37000c880 con 0x7fb38013d670 2026-02-23T06:45:25.186 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.187+0000 7fb37cff9640 1 -- 10.20.193.58:0/4201050421 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fb37000c9e0 con 0x7fb38013d670 2026-02-23T06:45:25.186 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.187+0000 7fb37cff9640 1 -- 10.20.193.58:0/4201050421 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb38013d670 msgr2=0x7fb38015a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:25.186 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.187+0000 7fb37cff9640 1 --2- 10.20.193.58:0/4201050421 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb38013d670 0x7fb38015a790 secure :-1 s=READY pgs=16 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb38015e950 tx=0x7fb37000eba0 comp rx=0 tx=0).stop 2026-02-23T06:45:25.186 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.187+0000 7fb37cff9640 1 -- 10.20.193.58:0/4201050421 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb38013d670 msgr2=0x7fb38015a790 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:45:25.186 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.187+0000 7fb37cff9640 1 --2- 10.20.193.58:0/4201050421 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb38013d670 0x7fb38015a790 unknown :-1 s=CLOSED pgs=16 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:25.186 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.187+0000 7fb37cff9640 1 -- 10.20.193.58:0/4201050421 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fb36c019070 con 0x7fb3800b6690 2026-02-23T06:45:25.186 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.188+0000 7fb37cff9640 1 --2- 10.20.193.58:0/4201050421 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb35007a3c0 0x7fb35009a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:25.186 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.188+0000 7fb37cff9640 1 -- 10.20.193.58:0/4201050421 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fb36c09d230 con 0x7fb3800b6690 2026-02-23T06:45:25.187 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.188+0000 7fb37f7fe640 1 --2- 10.20.193.58:0/4201050421 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb35007a3c0 0x7fb35009a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:25.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.188+0000 7fb37f7fe640 1 --2- 10.20.193.58:0/4201050421 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb35007a3c0 0x7fb35009a870 secure :-1 s=READY pgs=514 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb370017040 tx=0x7fb370014000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:25.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.190+0000 7fb385283640 1 --2- 10.20.193.58:0/4201050421 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb38015fe10 0x7fb3801601e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:25.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.190+0000 7fb385283640 1 -- 10.20.193.58:0/4201050421 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb3800b6d50 con 0x7fb38015fe10 2026-02-23T06:45:25.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.191+0000 7fb384a82640 1 --2- 10.20.193.58:0/4201050421 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb38015fe10 0x7fb3801601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:25.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.191+0000 7fb384a82640 1 -- 10.20.193.58:0/4201050421 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb3800b06c0 con 0x7fb38015fe10 2026-02-23T06:45:25.188 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.191+0000 7fb384a82640 1 --2- 10.20.193.58:0/4201050421 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb38015fe10 0x7fb3801601e0 secure :-1 s=READY pgs=17 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb37400a8c0 tx=0x7fb3740396a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:25.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.191+0000 7fb37cff9640 1 -- 10.20.193.58:0/4201050421 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb37403e050 con 0x7fb38015fe10 2026-02-23T06:45:25.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.192+0000 7fb37cff9640 1 -- 10.20.193.58:0/4201050421 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4912 (secure 0 0 0) 0x7fb37403f040 con 0x7fb38015fe10 2026-02-23T06:45:25.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.192+0000 7fb37cff9640 1 -- 10.20.193.58:0/4201050421 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb38015fe10 msgr2=0x7fb3801601e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:25.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.192+0000 7fb37cff9640 1 --2- 10.20.193.58:0/4201050421 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb38015fe10 0x7fb3801601e0 secure :-1 s=READY pgs=17 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb37400a8c0 tx=0x7fb3740396a0 comp rx=0 tx=0).stop 2026-02-23T06:45:25.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.192+0000 7fb37cff9640 1 -- 10.20.193.58:0/4201050421 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb38015fe10 msgr2=0x7fb3801601e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:45:25.189 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.192+0000 7fb37cff9640 1 --2- 10.20.193.58:0/4201050421 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb38015fe10 0x7fb3801601e0 secure :-1 s=CLOSED pgs=17 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb37400a8c0 tx=0x7fb3740396a0 comp rx=0 tx=0).stop 2026-02-23T06:45:25.189 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:45:25.189 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:45:25.190 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:45:25.190 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:45:25.190 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 212, 2026-02-23T06:45:25.190 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 11550, 2026-02-23T06:45:25.190 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:45:25.190 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:45:25.190 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:45:25.190 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:45:25.190 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:25.190 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:45:25.190 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:45:25.191 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:45:25.191 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:45:25.191 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:45:25.191 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:45:25.191 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:45:25.191 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:45:25.191 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:45:25.191 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:45:25.191 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:45:25.191 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:45:25.191 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:45:25.191 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:45:25.192 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:45:25.192 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:45:25.192 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:45:25.192 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:25.192 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:45:25.192 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:45:25.192 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:45:25.192 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:45:25.192 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:45:25.192 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:45:25.192 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:45:25.192 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:45:25.192 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:45:25.193 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:45:25.193 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:45:25.193 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:45:25.193 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:45:25.193 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:45:25.193 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:45:25.193 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:25.193 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.193 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:45:25.193 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:45:25.193 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:45:25.194 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:45:25.194 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:45:25.194 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:45:25.194 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:45:25.194 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:45:25.194 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:45:25.194 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:45:25.194 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:45:25.194 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:45:25.194 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:45:25.194 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:45:25.194 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:45:25.194 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:45:25.195 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:45:25.195 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:45:25.195 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:45:25.195 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:45:25.195 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:45:25.195 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:45:25.195 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:45:25.195 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:45:25.195 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:45:25.195 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:45:25.195 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:45:25.195 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:45:25.196 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:45:25.196 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:45:25.196 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:25.196 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:45:25.196 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.196 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:45:25.196 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.196 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:45:25.196 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:45:25.196 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:45:25.196 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:45:25.196 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.196 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:45:25.197 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:45:25.197 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:25.197 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.197 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.197 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:45:25.197 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:45:25.197 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:25.197 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:25.197 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:25.197 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.197 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:45:25.197 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:45:25.198 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:45:25.198 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:45:25.198 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:45:25.198 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:45:25.198 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.198 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.198 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:45:25.198 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:45:25.198 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:45:25.198 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:45:25.198 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.198 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:45:25.199 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:45:25.199 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:25.199 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.199 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.199 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:45:25.199 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:45:25.199 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:25.199 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:25.199 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:25.199 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.199 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:45:25.199 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:45:25.200 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:45:25.200 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:45:25.200 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:45:25.200 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:45:25.200 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.200 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.200 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:45:25.200 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:45:25.200 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:45:25.200 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:45:25.200 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.200 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:45:25.200 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:45:25.201 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:25.201 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.201 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.201 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:45:25.201 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:45:25.201 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:25.201 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:25.201 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:25.201 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.201 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:45:25.201 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:45:25.201 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:45:25.201 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:45:25.202 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:45:25.202 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:45:25.202 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:25.202 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:25.202 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.202 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:45:25.202 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:45:25.202 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.202 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:25.202 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:25.202 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:45:25.202 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:25.203 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:25.203 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:45:25.203 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.203 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:25.203 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:25.203 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:45:25.203 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:25.203 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:25.203 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.203 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:45:25.203 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:45:25.205 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.192+0000 7fb385283640 1 -- 10.20.193.58:0/4201050421 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb35007a3c0 msgr2=0x7fb35009a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:25.206 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.192+0000 7fb385283640 1 --2- 10.20.193.58:0/4201050421 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb35007a3c0 0x7fb35009a870 secure :-1 s=READY pgs=514 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb370017040 tx=0x7fb370014000 comp rx=0 tx=0).stop 2026-02-23T06:45:25.206 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.192+0000 7fb385283640 1 -- 10.20.193.58:0/4201050421 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3800b6690 msgr2=0x7fb38013aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:25.206 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.192+0000 7fb385283640 1 --2- 10.20.193.58:0/4201050421 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3800b6690 0x7fb38013aff0 secure :-1 s=READY pgs=15 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb36c00c4d0 tx=0x7fb36c00c9a0 comp rx=0 tx=0).stop 2026-02-23T06:45:25.206 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.192+0000 7fb384a82640 1 -- 10.20.193.58:0/4201050421 reap_dead start 2026-02-23T06:45:25.206 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.192+0000 7fb385283640 1 -- 10.20.193.58:0/4201050421 shutdown_connections 2026-02-23T06:45:25.206 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.192+0000 7fb385283640 1 --2- 10.20.193.58:0/4201050421 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb3800b6690 0x7fb38013aff0 unknown :-1 s=CLOSED pgs=15 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:25.206 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.192+0000 7fb385283640 1 -- 10.20.193.58:0/4201050421 >> 10.20.193.58:0/4201050421 conn(0x7fb3800b3c20 msgr2=0x7fb3801633c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:45:25.206 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.192+0000 7fb385283640 1 -- 10.20.193.58:0/4201050421 shutdown_connections 2026-02-23T06:45:25.206 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.192+0000 7fb385283640 1 -- 10.20.193.58:0/4201050421 wait complete. 2026-02-23T06:45:25.207 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:45:25.207 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:45:25.207 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:45:25.329 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.334+0000 7f876742f640 1 -- 10.20.193.58:0/3866958657 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f876015d430 msgr2=0x7f8760163dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:25.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.334+0000 7f876742f640 1 --2- 10.20.193.58:0/3866958657 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f876015d430 0x7f8760163dd0 secure :-1 s=READY pgs=18 gs=3 cs=0 l=1 c_cookie=9727836018876418068 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f87600b4cc0 tx=0x7f875002f2e0 comp rx=0 tx=0).stop 2026-02-23T06:45:25.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.334+0000 7f876742f640 1 -- 10.20.193.58:0/3866958657 shutdown_connections 2026-02-23T06:45:25.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.334+0000 7f876742f640 1 --2- 10.20.193.58:0/3866958657 >> v2:10.20.193.58:3300/0 conn(0x7f8760058b40 0x7f8760058f40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:25.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.334+0000 7f876742f640 1 --2- 10.20.193.58:0/3866958657 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f876015d430 0x7f8760163dd0 unknown :-1 s=CLOSED pgs=18 gs=3 cs=0 l=1 c_cookie=9727836018876418068 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:25.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.334+0000 7f876742f640 1 -- 10.20.193.58:0/3866958657 >> 10.20.193.58:0/3866958657 conn(0x7f87600b3c20 msgr2=0x7f87600b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:45:25.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.334+0000 7f876742f640 1 -- 10.20.193.58:0/3866958657 shutdown_connections 2026-02-23T06:45:25.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.334+0000 7f876742f640 1 -- 10.20.193.58:0/3866958657 wait complete. 2026-02-23T06:45:25.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.335+0000 7f876742f640 1 Processor -- start 2026-02-23T06:45:25.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.336+0000 7f876742f640 1 -- start start 2026-02-23T06:45:25.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.336+0000 7f876742f640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8760058b40 0x7f8760164e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:25.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.336+0000 7f876742f640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f876015d430 0x7f87601655c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:25.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.336+0000 7f876742f640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f876015d800 0x7f87601418b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:25.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.336+0000 7f876742f640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f87601664c0 con 0x7f876015d800 2026-02-23T06:45:25.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.336+0000 7f876742f640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f8760121480 con 0x7f876015d430 2026-02-23T06:45:25.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.336+0000 7f876742f640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f8760165f40 con 0x7f8760058b40 2026-02-23T06:45:25.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.336+0000 7f8766c2e640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f876015d800 0x7f87601418b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:25.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.336+0000 7f8765c2c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f876015d430 0x7f87601655c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:25.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.336+0000 7f8766c2e640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f876015d800 0x7f87601418b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:47462/0 (socket says 10.20.193.58:47462) 2026-02-23T06:45:25.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.336+0000 7f8766c2e640 1 -- 10.20.193.58:0/4015996543 learned_addr learned my addr 10.20.193.58:0/4015996543 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:45:25.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.336+0000 7f876642d640 1 --2- 10.20.193.58:0/4015996543 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8760058b40 0x7f8760164e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:25.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.336+0000 7f8766c2e640 1 -- 10.20.193.58:0/4015996543 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8760058b40 msgr2=0x7f8760164e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:25.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.336+0000 7f8766c2e640 1 --2- 10.20.193.58:0/4015996543 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8760058b40 0x7f8760164e80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:25.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.336+0000 7f8766c2e640 1 -- 10.20.193.58:0/4015996543 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f876015d430 msgr2=0x7f87601655c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:25.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.336+0000 7f8766c2e640 1 --2- 10.20.193.58:0/4015996543 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f876015d430 0x7f87601655c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:25.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.336+0000 7f8766c2e640 1 -- 10.20.193.58:0/4015996543 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8750009570 con 0x7f876015d800 2026-02-23T06:45:25.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.337+0000 7f8766c2e640 1 --2- 10.20.193.58:0/4015996543 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f876015d800 0x7f87601418b0 secure :-1 s=READY pgs=70 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f875c00f8d0 tx=0x7f875c00fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:25.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.337+0000 7f8746ffd640 1 -- 10.20.193.58:0/4015996543 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f875c00dce0 con 0x7f876015d800 2026-02-23T06:45:25.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.337+0000 7f8746ffd640 1 -- 10.20.193.58:0/4015996543 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f875c00de60 con 0x7f876015d800 2026-02-23T06:45:25.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.337+0000 7f8746ffd640 1 -- 10.20.193.58:0/4015996543 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f875c005b90 con 0x7f876015d800 2026-02-23T06:45:25.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.337+0000 7f876742f640 1 -- 10.20.193.58:0/4015996543 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f876014b390 con 0x7f876015d800 2026-02-23T06:45:25.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.337+0000 7f876742f640 1 -- 10.20.193.58:0/4015996543 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8760141df0 con 0x7f876015d800 2026-02-23T06:45:25.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.337+0000 7f876742f640 1 --2- 10.20.193.58:0/4015996543 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f876014dd60 0x7f876013d1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:25.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.337+0000 7f876742f640 1 -- 10.20.193.58:0/4015996543 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f87600609c0 con 0x7f876014dd60 2026-02-23T06:45:25.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.338+0000 7f8746ffd640 1 -- 10.20.193.58:0/4015996543 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f875c020060 con 0x7f876015d800 2026-02-23T06:45:25.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.339+0000 7f876642d640 1 --2- 10.20.193.58:0/4015996543 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f876014dd60 0x7f876013d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:25.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.339+0000 7f876642d640 1 -- 10.20.193.58:0/4015996543 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f87600b60f0 con 0x7f876014dd60 2026-02-23T06:45:25.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.339+0000 7f8746ffd640 1 --2- 10.20.193.58:0/4015996543 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f873007a6c0 0x7f873009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:25.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.339+0000 7f8746ffd640 1 -- 10.20.193.58:0/4015996543 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f875c015070 con 0x7f876015d800 2026-02-23T06:45:25.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.340+0000 7f8765c2c640 1 --2- 10.20.193.58:0/4015996543 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f873007a6c0 0x7f873009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:25.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.340+0000 7f876642d640 1 --2- 10.20.193.58:0/4015996543 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f876014dd60 0x7f876013d1c0 secure :-1 s=READY pgs=88 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8750004740 tx=0x7f87500028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:25.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.340+0000 7f8746ffd640 1 -- 10.20.193.58:0/4015996543 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8750005bb0 con 0x7f876014dd60 2026-02-23T06:45:25.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.340+0000 7f8765c2c640 1 --2- 10.20.193.58:0/4015996543 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f873007a6c0 0x7f873009ab70 secure :-1 s=READY pgs=515 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8760164870 tx=0x7f8754007ee0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:25.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.340+0000 7f8746ffd640 1 -- 10.20.193.58:0/4015996543 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f8750038470 con 0x7f876014dd60 2026-02-23T06:45:25.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.340+0000 7f8746ffd640 1 -- 10.20.193.58:0/4015996543 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f876014dd60 msgr2=0x7f876013d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:25.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.340+0000 7f8746ffd640 1 --2- 10.20.193.58:0/4015996543 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f876014dd60 0x7f876013d1c0 secure :-1 s=READY pgs=88 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8750004740 tx=0x7f87500028d0 comp rx=0 tx=0).stop 2026-02-23T06:45:25.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.340+0000 7f8746ffd640 1 -- 10.20.193.58:0/4015996543 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f876014dd60 msgr2=0x7f876013d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:45:25.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.340+0000 7f8746ffd640 1 --2- 10.20.193.58:0/4015996543 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f876014dd60 0x7f876013d1c0 secure :-1 s=CLOSED pgs=88 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8750004740 tx=0x7f87500028d0 comp rx=0 tx=0).stop 2026-02-23T06:45:25.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.344+0000 7f876742f640 1 --2- 10.20.193.58:0/4015996543 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f876014e130 0x7f876013d700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:25.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.344+0000 7f876742f640 1 -- 10.20.193.58:0/4015996543 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f876014e500 con 0x7f876014e130 2026-02-23T06:45:25.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.344+0000 7f876642d640 1 --2- 10.20.193.58:0/4015996543 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f876014e130 0x7f876013d700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:25.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.345+0000 7f876642d640 1 -- 10.20.193.58:0/4015996543 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f87600b7000 con 0x7f876014e130 2026-02-23T06:45:25.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.345+0000 7f876642d640 1 --2- 10.20.193.58:0/4015996543 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f876014e130 0x7f876013d700 secure :-1 s=READY pgs=89 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f87500098a0 tx=0x7f8750009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:25.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.345+0000 7f8746ffd640 1 -- 10.20.193.58:0/4015996543 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8750038dd0 con 0x7f876014e130 2026-02-23T06:45:25.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.345+0000 7f8746ffd640 1 -- 10.20.193.58:0/4015996543 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5557 (secure 0 0 0) 0x7f8750043400 con 0x7f876014e130 2026-02-23T06:45:25.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.345+0000 7f8746ffd640 1 -- 10.20.193.58:0/4015996543 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f876014e130 msgr2=0x7f876013d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:25.342 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.345+0000 7f8746ffd640 1 --2- 10.20.193.58:0/4015996543 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f876014e130 0x7f876013d700 secure :-1 s=READY pgs=89 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f87500098a0 tx=0x7f8750009310 comp rx=0 tx=0).stop 2026-02-23T06:45:25.342 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.345+0000 7f8746ffd640 1 -- 10.20.193.58:0/4015996543 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f876014e130 msgr2=0x7f876013d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:45:25.342 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.345+0000 7f8746ffd640 1 --2- 10.20.193.58:0/4015996543 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f876014e130 0x7f876013d700 secure :-1 s=CLOSED pgs=89 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f87500098a0 tx=0x7f8750009310 comp rx=0 tx=0).stop 2026-02-23T06:45:25.342 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:45:25.342 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:45:25.342 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:45:25.343 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:45:25.343 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 212, 2026-02-23T06:45:25.343 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 178774, 2026-02-23T06:45:25.343 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:45:25.343 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:45:25.343 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:45:25.343 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:45:25.343 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:25.343 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:45:25.343 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:45:25.343 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:45:25.344 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:45:25.344 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:45:25.344 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:45:25.344 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:45:25.344 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:45:25.344 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:45:25.344 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:45:25.344 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:45:25.344 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:45:25.344 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:45:25.344 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:45:25.344 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:45:25.344 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:45:25.345 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:45:25.345 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:25.345 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:45:25.345 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:45:25.345 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:45:25.345 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:45:25.345 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:45:25.345 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:45:25.345 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:45:25.345 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:45:25.345 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:45:25.345 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:45:25.346 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:45:25.346 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:45:25.346 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:45:25.346 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:45:25.346 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:45:25.346 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:25.346 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.346 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:45:25.346 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:45:25.346 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:45:25.346 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:45:25.346 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:45:25.347 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:45:25.347 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:45:25.347 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:45:25.347 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:45:25.347 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:45:25.347 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:45:25.347 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:45:25.347 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:45:25.347 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:45:25.347 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:45:25.347 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:45:25.347 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:45:25.348 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:45:25.348 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:45:25.348 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:45:25.348 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:45:25.348 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:45:25.348 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:45:25.348 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:45:25.348 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:45:25.348 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:45:25.348 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:45:25.348 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:45:25.348 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:45:25.349 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:45:25.349 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:25.349 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:45:25.349 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.349 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:45:25.349 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.349 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:45:25.349 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:45:25.349 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:45:25.349 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:45:25.349 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.349 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:45:25.349 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:45:25.350 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:25.350 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.350 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.350 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:45:25.350 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:45:25.350 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:25.350 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:25.350 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:25.350 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.350 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:45:25.351 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:45:25.351 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:45:25.351 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:45:25.351 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:45:25.351 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:45:25.351 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.351 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.351 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:45:25.351 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:45:25.351 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:45:25.351 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:45:25.351 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.351 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:45:25.352 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:45:25.352 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:25.352 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.352 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.352 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:45:25.352 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:45:25.352 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:25.352 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:25.352 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:25.352 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.352 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:45:25.352 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:45:25.353 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:45:25.353 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:45:25.353 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:45:25.353 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:45:25.353 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.353 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.353 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:45:25.353 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:45:25.353 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:45:25.353 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:45:25.353 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.353 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:45:25.354 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:45:25.354 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:25.354 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.354 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.354 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:45:25.354 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:45:25.354 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:25.354 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:25.354 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:25.354 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.354 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:45:25.354 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:45:25.355 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:45:25.355 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:45:25.355 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:45:25.355 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:45:25.355 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:25.355 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:25.355 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.355 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:45:25.355 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:45:25.355 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.355 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:25.355 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:25.356 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:45:25.356 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:25.356 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:25.356 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:45:25.356 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.356 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:25.356 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:25.356 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:45:25.356 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:25.356 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:25.356 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:45:25.356 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.356 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:25.357 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:25.357 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:45:25.357 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:25.357 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:25.357 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:45:25.357 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.357 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:45:25.357 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:45:25.357 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:45:25.357 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.357 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.357 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:25.357 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:25.358 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:45:25.358 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:25.358 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:25.358 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:45:25.358 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:25.358 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:25.358 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:25.358 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:45:25.358 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:25.358 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:25.358 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:25.358 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:45:25.359 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:45:25.360 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.346+0000 7f876742f640 1 -- 10.20.193.58:0/4015996543 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f873007a6c0 msgr2=0x7f873009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:25.360 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.346+0000 7f876742f640 1 --2- 10.20.193.58:0/4015996543 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f873007a6c0 0x7f873009ab70 secure :-1 s=READY pgs=515 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8760164870 tx=0x7f8754007ee0 comp rx=0 tx=0).stop 2026-02-23T06:45:25.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.346+0000 7f876742f640 1 -- 10.20.193.58:0/4015996543 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f876015d800 msgr2=0x7f87601418b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:25.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.346+0000 7f876742f640 1 --2- 10.20.193.58:0/4015996543 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f876015d800 0x7f87601418b0 secure :-1 s=READY pgs=70 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f875c00f8d0 tx=0x7f875c00fda0 comp rx=0 tx=0).stop 2026-02-23T06:45:25.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.346+0000 7f8766c2e640 1 -- 10.20.193.58:0/4015996543 reap_dead start 2026-02-23T06:45:25.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.346+0000 7f8766c2e640 1 -- 10.20.193.58:0/4015996543 reap_dead start 2026-02-23T06:45:25.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.346+0000 7f876742f640 1 -- 10.20.193.58:0/4015996543 shutdown_connections 2026-02-23T06:45:25.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.346+0000 7f876742f640 1 -- 10.20.193.58:0/4015996543 >> 10.20.193.58:0/4015996543 conn(0x7f87600b3c20 msgr2=0x7f876013df20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:45:25.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.346+0000 7f876742f640 1 -- 10.20.193.58:0/4015996543 shutdown_connections 2026-02-23T06:45:25.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:25.346+0000 7f876742f640 1 -- 10.20.193.58:0/4015996543 wait complete. 2026-02-23T06:45:25.362 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:45:25.362 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-23T06:45:25.362 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2026-02-23T06:45:25.362 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-23T06:45:25.362 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-23T06:45:25.362 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-23T06:45:25.363 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:45:25.373 INFO:tasks.ceph.mon.c:Stopped 2026-02-23T06:45:25.373 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.b 2026-02-23T06:45:25.373 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-23T06:45:25.373 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-23T06:45:25.373 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-23T06:45:40.374 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.b 2026-02-23T06:45:40.374 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-23T06:45:40.375 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-23T06:45:40.375 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:45:40.375 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:45:45.097 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:45:45.101 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:45:46.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.504+0000 7f2dbafd2640 1 -- 10.20.193.58:0/1478364925 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2d98005270 msgr2=0x7f2d980056e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:46.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.504+0000 7f2dbafd2640 1 --2- 10.20.193.58:0/1478364925 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2d98005270 0x7f2d980056e0 secure :-1 s=READY pgs=39 gs=25 cs=0 l=1 c_cookie=12680271755235143579 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2da8002930 tx=0x7f2da802f450 comp rx=0 tx=0).stop 2026-02-23T06:45:46.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.504+0000 7f2dbafd2640 1 -- 10.20.193.58:0/1478364925 shutdown_connections 2026-02-23T06:45:46.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.504+0000 7f2dbafd2640 1 --2- 10.20.193.58:0/1478364925 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2d98005270 0x7f2d980056e0 unknown :-1 s=CLOSED pgs=39 gs=25 cs=0 l=1 c_cookie=12680271755235143579 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:46.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.504+0000 7f2dbafd2640 1 -- 10.20.193.58:0/1478364925 >> 10.20.193.58:0/1478364925 conn(0x7f2db40b3c20 msgr2=0x7f2db40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:45:46.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.504+0000 7f2dbafd2640 1 -- 10.20.193.58:0/1478364925 shutdown_connections 2026-02-23T06:45:46.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.504+0000 7f2dbafd2640 1 -- 10.20.193.58:0/1478364925 wait complete. 2026-02-23T06:45:46.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.505+0000 7f2dbafd2640 1 Processor -- start 2026-02-23T06:45:46.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.505+0000 7f2dbafd2640 1 -- start start 2026-02-23T06:45:46.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.506+0000 7f2dbafd2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2d98005270 0x7f2db41275d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:46.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.506+0000 7f2dbafd2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2d98005d10 0x7f2db4057520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:46.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.506+0000 7f2dbafd2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2d98024670 0x7f2db4057a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:46.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.506+0000 7f2dbafd2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f2db40b81b0 con 0x7f2d98005d10 2026-02-23T06:45:46.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.506+0000 7f2dbafd2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f2db41613a0 con 0x7f2d98005270 2026-02-23T06:45:46.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.506+0000 7f2dbafd2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f2db4141b30 con 0x7f2d98024670 2026-02-23T06:45:46.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.506+0000 7f2db97cf640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2d98005d10 0x7f2db4057520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:46.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.506+0000 7f2dba7d1640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2d98024670 msgr2=0x7f2db4057a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:45:46.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.506+0000 7f2dba7d1640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2d98024670 0x7f2db4057a60 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:45:46.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.506+0000 7f2db97cf640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2d98005d10 0x7f2db4057520 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:39778/0 (socket says 10.20.193.58:39778) 2026-02-23T06:45:46.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.506+0000 7f2db97cf640 1 -- 10.20.193.58:0/2501394514 learned_addr learned my addr 10.20.193.58:0/2501394514 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:45:46.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.506+0000 7f2db9fd0640 1 --2- 10.20.193.58:0/2501394514 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2d98005270 0x7f2db41275d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:46.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.506+0000 7f2db97cf640 1 -- 10.20.193.58:0/2501394514 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2d98024670 msgr2=0x7f2db4057a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:45:46.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.506+0000 7f2db97cf640 1 --2- 10.20.193.58:0/2501394514 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2d98024670 0x7f2db4057a60 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:46.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.506+0000 7f2db97cf640 1 -- 10.20.193.58:0/2501394514 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2d98005270 msgr2=0x7f2db41275d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:46.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.506+0000 7f2db97cf640 1 --2- 10.20.193.58:0/2501394514 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2d98005270 0x7f2db41275d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:46.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.506+0000 7f2db97cf640 1 -- 10.20.193.58:0/2501394514 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db4059400 con 0x7f2d98005d10 2026-02-23T06:45:46.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.506+0000 7f2db97cf640 1 --2- 10.20.193.58:0/2501394514 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2d98005d10 0x7f2db4057520 secure :-1 s=READY pgs=86 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2da8003040 tx=0x7f2da80027e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:46.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.506+0000 7f2da27fc640 1 -- 10.20.193.58:0/2501394514 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2da80036b0 con 0x7f2d98005d10 2026-02-23T06:45:46.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.506+0000 7f2da27fc640 1 -- 10.20.193.58:0/2501394514 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2da8003900 con 0x7f2d98005d10 2026-02-23T06:45:46.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.506+0000 7f2dbafd2640 1 -- 10.20.193.58:0/2501394514 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2db4142110 con 0x7f2d98005d10 2026-02-23T06:45:46.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.506+0000 7f2da27fc640 1 -- 10.20.193.58:0/2501394514 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2da8003d10 con 0x7f2d98005d10 2026-02-23T06:45:46.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.507+0000 7f2dbafd2640 1 -- 10.20.193.58:0/2501394514 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2db40b83c0 con 0x7f2d98005d10 2026-02-23T06:45:46.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.507+0000 7f2dbafd2640 1 -- 10.20.193.58:0/2501394514 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2db40b6d50 con 0x7f2d98005d10 2026-02-23T06:45:46.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.508+0000 7f2da27fc640 1 -- 10.20.193.58:0/2501394514 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f2da804c460 con 0x7f2d98005d10 2026-02-23T06:45:46.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.509+0000 7f2da27fc640 1 --2- 10.20.193.58:0/2501394514 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2d8407a5a0 0x7f2d8409aa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:46.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.509+0000 7f2da27fc640 1 -- 10.20.193.58:0/2501394514 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f2da80c2c40 con 0x7f2d98005d10 2026-02-23T06:45:46.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.509+0000 7f2db9fd0640 1 --2- 10.20.193.58:0/2501394514 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2d8407a5a0 0x7f2d8409aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:46.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.510+0000 7f2db9fd0640 1 --2- 10.20.193.58:0/2501394514 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2d8407a5a0 0x7f2d8409aa50 secure :-1 s=READY pgs=516 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2da4007010 tx=0x7f2da4015040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:46.506 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.511+0000 7f2da27fc640 1 -- 10.20.193.58:0/2501394514 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f2da8085d80 con 0x7f2d98005d10 2026-02-23T06:45:46.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.668+0000 7f2dbafd2640 1 -- 10.20.193.58:0/2501394514 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2db40b6310 con 0x7f2d98005d10 2026-02-23T06:45:46.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.668+0000 7f2da27fc640 1 -- 10.20.193.58:0/2501394514 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1749 (secure 0 0 0) 0x7f2da8088f30 con 0x7f2d98005d10 2026-02-23T06:45:46.663 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":214,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:45:46.664 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.669+0000 7f2dbafd2640 1 -- 10.20.193.58:0/2501394514 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2d8407a5a0 msgr2=0x7f2d8409aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:46.664 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.669+0000 7f2dbafd2640 1 --2- 10.20.193.58:0/2501394514 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2d8407a5a0 0x7f2d8409aa50 secure :-1 s=READY pgs=516 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2da4007010 tx=0x7f2da4015040 comp rx=0 tx=0).stop 2026-02-23T06:45:46.664 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.669+0000 7f2dbafd2640 1 -- 10.20.193.58:0/2501394514 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2d98005d10 msgr2=0x7f2db4057520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:46.664 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.669+0000 7f2dbafd2640 1 --2- 10.20.193.58:0/2501394514 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2d98005d10 0x7f2db4057520 secure :-1 s=READY pgs=86 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2da8003040 tx=0x7f2da80027e0 comp rx=0 tx=0).stop 2026-02-23T06:45:46.664 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.669+0000 7f2dbafd2640 1 -- 10.20.193.58:0/2501394514 shutdown_connections 2026-02-23T06:45:46.664 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.669+0000 7f2dbafd2640 1 --2- 10.20.193.58:0/2501394514 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2d8407a5a0 0x7f2d8409aa50 unknown :-1 s=CLOSED pgs=516 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:46.664 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.669+0000 7f2dbafd2640 1 --2- 10.20.193.58:0/2501394514 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2d98024670 0x7f2db4057a60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:46.664 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.669+0000 7f2dbafd2640 1 --2- 10.20.193.58:0/2501394514 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2d98005d10 0x7f2db4057520 unknown :-1 s=CLOSED pgs=86 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:46.664 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.669+0000 7f2dbafd2640 1 --2- 10.20.193.58:0/2501394514 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2d98005270 0x7f2db41275d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:46.664 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.669+0000 7f2dbafd2640 1 -- 10.20.193.58:0/2501394514 >> 10.20.193.58:0/2501394514 conn(0x7f2db40b3c20 msgr2=0x7f2db415b440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:45:46.664 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.669+0000 7f2dbafd2640 1 -- 10.20.193.58:0/2501394514 shutdown_connections 2026-02-23T06:45:46.664 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.669+0000 7f2dbafd2640 1 -- 10.20.193.58:0/2501394514 wait complete. 2026-02-23T06:45:46.676 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:45:46.676 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-23T06:45:46.676 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:45:46.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.802+0000 7efd87514640 1 -- 10.20.193.58:0/3834473766 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efd8015d4a0 msgr2=0x7efd800affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:46.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.802+0000 7efd87514640 1 --2- 10.20.193.58:0/3834473766 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efd8015d4a0 0x7efd800affb0 secure :-1 s=READY pgs=88 gs=2 cs=0 l=1 c_cookie=12125860593489573518 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd800afed0 tx=0x7efd7002f250 comp rx=0 tx=0).stop 2026-02-23T06:45:46.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.802+0000 7efd87514640 1 -- 10.20.193.58:0/3834473766 shutdown_connections 2026-02-23T06:45:46.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.802+0000 7efd87514640 1 --2- 10.20.193.58:0/3834473766 >> v2:10.20.193.93:3300/0 conn(0x7efd800b6690 0x7efd80058ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:46.798 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.802+0000 7efd87514640 1 --2- 10.20.193.58:0/3834473766 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efd8015d4a0 0x7efd800affb0 unknown :-1 s=CLOSED pgs=88 gs=2 cs=0 l=1 c_cookie=12125860593489573518 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:46.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.802+0000 7efd87514640 1 -- 10.20.193.58:0/3834473766 >> 10.20.193.58:0/3834473766 conn(0x7efd800b3c20 msgr2=0x7efd800b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:45:46.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.802+0000 7efd87514640 1 -- 10.20.193.58:0/3834473766 shutdown_connections 2026-02-23T06:45:46.799 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.802+0000 7efd87514640 1 -- 10.20.193.58:0/3834473766 wait complete. 2026-02-23T06:45:46.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.803+0000 7efd87514640 1 Processor -- start 2026-02-23T06:45:46.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.804+0000 7efd87514640 1 -- start start 2026-02-23T06:45:46.801 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.804+0000 7efd87514640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efd800b6690 0x7efd80143120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:46.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.804+0000 7efd87514640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efd8015d4a0 0x7efd80057370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:46.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.804+0000 7efd87514640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efd8015d870 0x7efd800578b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:46.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.804+0000 7efd87514640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7efd80145600 con 0x7efd8015d870 2026-02-23T06:45:46.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.804+0000 7efd87514640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7efd80141c40 con 0x7efd8015d4a0 2026-02-23T06:45:46.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.804+0000 7efd87514640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7efd800580b0 con 0x7efd800b6690 2026-02-23T06:45:46.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.804+0000 7efd86512640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efd800b6690 msgr2=0x7efd80143120 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:45:46.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.804+0000 7efd86512640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efd800b6690 0x7efd80143120 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:45:46.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.804+0000 7efd85d11640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efd8015d4a0 0x7efd80057370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:46.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.804+0000 7efd85d11640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efd8015d4a0 0x7efd80057370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:47956/0 (socket says 10.20.193.58:47956) 2026-02-23T06:45:46.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.804+0000 7efd85d11640 1 -- 10.20.193.58:0/300683103 learned_addr learned my addr 10.20.193.58:0/300683103 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:45:46.802 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.804+0000 7efd86d13640 1 --2- 10.20.193.58:0/300683103 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efd8015d870 0x7efd800578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:46.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.805+0000 7efd85d11640 1 -- 10.20.193.58:0/300683103 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efd800b6690 msgr2=0x7efd80143120 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:45:46.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.805+0000 7efd85d11640 1 --2- 10.20.193.58:0/300683103 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efd800b6690 0x7efd80143120 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:46.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.805+0000 7efd85d11640 1 -- 10.20.193.58:0/300683103 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efd8015d870 msgr2=0x7efd800578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:46.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.805+0000 7efd85d11640 1 --2- 10.20.193.58:0/300683103 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efd8015d870 0x7efd800578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:46.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.805+0000 7efd85d11640 1 -- 10.20.193.58:0/300683103 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd70009570 con 0x7efd8015d4a0 2026-02-23T06:45:46.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.805+0000 7efd85d11640 1 --2- 10.20.193.58:0/300683103 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efd8015d4a0 0x7efd80057370 secure :-1 s=READY pgs=41 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd7400c4d0 tx=0x7efd7400c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:46.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.805+0000 7efd66ffd640 1 -- 10.20.193.58:0/300683103 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd74004250 con 0x7efd8015d4a0 2026-02-23T06:45:46.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.805+0000 7efd66ffd640 1 -- 10.20.193.58:0/300683103 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd740044a0 con 0x7efd8015d4a0 2026-02-23T06:45:46.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.805+0000 7efd66ffd640 1 -- 10.20.193.58:0/300683103 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd74006b10 con 0x7efd8015d4a0 2026-02-23T06:45:46.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.805+0000 7efd87514640 1 -- 10.20.193.58:0/300683103 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd80142700 con 0x7efd8015d4a0 2026-02-23T06:45:46.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.805+0000 7efd87514640 1 -- 10.20.193.58:0/300683103 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd801418d0 con 0x7efd8015d4a0 2026-02-23T06:45:46.803 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.805+0000 7efd87514640 1 --2- 10.20.193.58:0/300683103 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efd80143660 0x7efd80144010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:46.804 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.805+0000 7efd87514640 1 -- 10.20.193.58:0/300683103 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7efd80141db0 con 0x7efd80143660 2026-02-23T06:45:46.804 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.806+0000 7efd86512640 1 --2- 10.20.193.58:0/300683103 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efd80143660 0x7efd80144010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:46.804 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.806+0000 7efd86512640 1 -- 10.20.193.58:0/300683103 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd800b6330 con 0x7efd80143660 2026-02-23T06:45:46.804 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.806+0000 7efd86512640 1 --2- 10.20.193.58:0/300683103 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efd80143660 0x7efd80144010 secure :-1 s=READY pgs=89 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd700098a0 tx=0x7efd700028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:46.804 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.806+0000 7efd66ffd640 1 -- 10.20.193.58:0/300683103 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd7003f070 con 0x7efd80143660 2026-02-23T06:45:46.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.807+0000 7efd66ffd640 1 -- 10.20.193.58:0/300683103 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7efd70038470 con 0x7efd80143660 2026-02-23T06:45:46.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.807+0000 7efd66ffd640 1 -- 10.20.193.58:0/300683103 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efd80143660 msgr2=0x7efd80144010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:46.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.807+0000 7efd66ffd640 1 --2- 10.20.193.58:0/300683103 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efd80143660 0x7efd80144010 secure :-1 s=READY pgs=89 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd700098a0 tx=0x7efd700028d0 comp rx=0 tx=0).stop 2026-02-23T06:45:46.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.807+0000 7efd66ffd640 1 -- 10.20.193.58:0/300683103 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efd80143660 msgr2=0x7efd80144010 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:45:46.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.807+0000 7efd66ffd640 1 --2- 10.20.193.58:0/300683103 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efd80143660 0x7efd80144010 secure :-1 s=CLOSED pgs=89 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd700098a0 tx=0x7efd700028d0 comp rx=0 tx=0).stop 2026-02-23T06:45:46.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.807+0000 7efd66ffd640 1 -- 10.20.193.58:0/300683103 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7efd74003670 con 0x7efd8015d4a0 2026-02-23T06:45:46.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.808+0000 7efd66ffd640 1 --2- 10.20.193.58:0/300683103 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efd5007a430 0x7efd5009a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:46.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.808+0000 7efd66ffd640 1 -- 10.20.193.58:0/300683103 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7efd7409d1f0 con 0x7efd8015d4a0 2026-02-23T06:45:46.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.808+0000 7efd86512640 1 --2- 10.20.193.58:0/300683103 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efd5007a430 0x7efd5009a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:46.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.809+0000 7efd86512640 1 --2- 10.20.193.58:0/300683103 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efd5007a430 0x7efd5009a8e0 secure :-1 s=READY pgs=517 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd700098a0 tx=0x7efd70040000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:46.807 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.811+0000 7efd87514640 1 --2- 10.20.193.58:0/300683103 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efd801295f0 0x7efd80144550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:46.807 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.811+0000 7efd87514640 1 -- 10.20.193.58:0/300683103 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7efd800b5e10 con 0x7efd801295f0 2026-02-23T06:45:46.807 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.811+0000 7efd86d13640 1 --2- 10.20.193.58:0/300683103 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efd801295f0 0x7efd80144550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:46.808 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.811+0000 7efd86d13640 1 -- 10.20.193.58:0/300683103 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efd80164250 con 0x7efd801295f0 2026-02-23T06:45:46.808 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.811+0000 7efd86d13640 1 --2- 10.20.193.58:0/300683103 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efd801295f0 0x7efd80144550 secure :-1 s=READY pgs=90 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd7c003f40 tx=0x7efd7c00aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:46.808 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.811+0000 7efd66ffd640 1 -- 10.20.193.58:0/300683103 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd7c012a10 con 0x7efd801295f0 2026-02-23T06:45:46.808 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.811+0000 7efd66ffd640 1 -- 10.20.193.58:0/300683103 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5403 (secure 0 0 0) 0x7efd7c012b70 con 0x7efd801295f0 2026-02-23T06:45:46.808 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.811+0000 7efd66ffd640 1 -- 10.20.193.58:0/300683103 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efd801295f0 msgr2=0x7efd80144550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:46.808 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.811+0000 7efd66ffd640 1 --2- 10.20.193.58:0/300683103 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efd801295f0 0x7efd80144550 secure :-1 s=READY pgs=90 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd7c003f40 tx=0x7efd7c00aba0 comp rx=0 tx=0).stop 2026-02-23T06:45:46.808 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.811+0000 7efd66ffd640 1 -- 10.20.193.58:0/300683103 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efd801295f0 msgr2=0x7efd80144550 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:45:46.808 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.811+0000 7efd66ffd640 1 --2- 10.20.193.58:0/300683103 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efd801295f0 0x7efd80144550 unknown :-1 s=CLOSED pgs=90 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:46.809 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:45:46.809 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:45:46.809 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:45:46.809 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:45:46.809 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 214, 2026-02-23T06:45:46.809 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 96483, 2026-02-23T06:45:46.809 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:45:46.809 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:45:46.809 INFO:teuthology.orchestra.run.trial058.stdout: 1 2026-02-23T06:45:46.809 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:46.810 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 1, 2026-02-23T06:45:46.810 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:45:46.810 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:45:46.810 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:45:46.810 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:45:46.810 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:45:46.810 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:45:46.810 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:45:46.810 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:45:46.810 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:45:46.810 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:45:46.810 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:45:46.811 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:45:46.811 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:45:46.811 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:45:46.811 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:45:46.811 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:45:46.811 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:46.811 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:45:46.811 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:45:46.811 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:45:46.811 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:45:46.811 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:45:46.811 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:45:46.811 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:45:46.812 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:45:46.812 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:45:46.812 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:45:46.812 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:45:46.812 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:45:46.812 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:45:46.812 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:45:46.812 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:45:46.812 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:46.812 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:46.812 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:45:46.812 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:45:46.813 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:45:46.813 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:45:46.813 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:45:46.813 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:45:46.813 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:45:46.813 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:45:46.813 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:45:46.813 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:45:46.813 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:45:46.813 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:45:46.813 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:45:46.813 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:45:46.814 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:45:46.814 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:45:46.814 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:45:46.814 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:45:46.814 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:45:46.814 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:45:46.814 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:45:46.814 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:45:46.814 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:45:46.814 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:45:46.814 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:45:46.814 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:45:46.815 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:45:46.815 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:45:46.815 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:45:46.815 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:45:46.815 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:46.815 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:45:46.815 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:46.815 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:45:46.815 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:46.815 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:45:46.815 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:45:46.815 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:45:46.815 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:45:46.816 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:46.816 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:45:46.816 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:45:46.816 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:46.816 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:46.816 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:46.816 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:45:46.816 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:45:46.816 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:46.816 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:46.816 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:46.816 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:46.816 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:45:46.817 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:45:46.817 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:45:46.817 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:45:46.817 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:45:46.817 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:45:46.817 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:46.817 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:46.817 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:45:46.817 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:45:46.817 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:45:46.817 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:45:46.817 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:46.818 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:45:46.818 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:45:46.818 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:46.818 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:46.818 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:46.818 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:45:46.818 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:45:46.818 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:46.818 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:46.818 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:46.818 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:46.818 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:45:46.818 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:45:46.819 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:45:46.819 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:45:46.819 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:45:46.819 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:45:46.819 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:46.819 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:46.819 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:45:46.819 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:45:46.819 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:45:46.819 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:45:46.819 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:46.819 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:45:46.820 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:45:46.820 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:46.820 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:46.820 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:46.820 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:45:46.820 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:45:46.820 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:46.820 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:46.820 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:46.820 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:46.820 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:45:46.820 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:45:46.821 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:45:46.821 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:45:46.821 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:45:46.821 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:45:46.821 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:46.821 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:46.821 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:46.821 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:45:46.821 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:45:46.821 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:46.821 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:46.821 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:46.821 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:45:46.822 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:46.822 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:46.822 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:45:46.822 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:46.822 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:46.822 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:46.822 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:45:46.822 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:46.822 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:46.822 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:45:46.822 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:46.822 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:46.822 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:46.823 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:45:46.823 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:46.823 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:46.823 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:45:46.823 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:46.823 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:46.823 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:46.823 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:45:46.823 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:46.823 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:46.823 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:45:46.823 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:46.823 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:46.824 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:46.824 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:45:46.824 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:46.824 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:46.824 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:46.824 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:45:46.824 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:45:46.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.812+0000 7efd87514640 1 -- 10.20.193.58:0/300683103 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efd5007a430 msgr2=0x7efd5009a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:46.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.812+0000 7efd87514640 1 --2- 10.20.193.58:0/300683103 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efd5007a430 0x7efd5009a8e0 secure :-1 s=READY pgs=517 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd700098a0 tx=0x7efd70040000 comp rx=0 tx=0).stop 2026-02-23T06:45:46.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.812+0000 7efd87514640 1 -- 10.20.193.58:0/300683103 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efd8015d4a0 msgr2=0x7efd80057370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:46.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.812+0000 7efd87514640 1 --2- 10.20.193.58:0/300683103 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efd8015d4a0 0x7efd80057370 secure :-1 s=READY pgs=41 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd7400c4d0 tx=0x7efd7400c9a0 comp rx=0 tx=0).stop 2026-02-23T06:45:46.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.812+0000 7efd86d13640 1 -- 10.20.193.58:0/300683103 reap_dead start 2026-02-23T06:45:46.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.812+0000 7efd87514640 1 -- 10.20.193.58:0/300683103 shutdown_connections 2026-02-23T06:45:46.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.812+0000 7efd87514640 1 --2- 10.20.193.58:0/300683103 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efd8015d4a0 0x7efd80057370 unknown :-1 s=CLOSED pgs=41 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:46.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.812+0000 7efd87514640 1 -- 10.20.193.58:0/300683103 >> 10.20.193.58:0/300683103 conn(0x7efd800b3c20 msgr2=0x7efd8005d100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:45:46.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.812+0000 7efd87514640 1 -- 10.20.193.58:0/300683103 shutdown_connections 2026-02-23T06:45:46.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.812+0000 7efd87514640 1 -- 10.20.193.58:0/300683103 wait complete. 2026-02-23T06:45:46.827 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:45:46.827 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-23T06:45:46.827 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:45:46.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.953+0000 7fdccda83640 1 -- 10.20.193.58:0/2918235361 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdcc80b6690 msgr2=0x7fdcc8058ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:46.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.953+0000 7fdccda83640 1 --2- 10.20.193.58:0/2918235361 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdcc80b6690 0x7fdcc8058ec0 secure :-1 s=READY pgs=91 gs=2 cs=0 l=1 c_cookie=10939832884202798782 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcc4005820 tx=0x7fdcc40302c0 comp rx=0 tx=0).stop 2026-02-23T06:45:46.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.953+0000 7fdccda83640 1 -- 10.20.193.58:0/2918235361 shutdown_connections 2026-02-23T06:45:46.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.953+0000 7fdccda83640 1 --2- 10.20.193.58:0/2918235361 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdcc80b6690 0x7fdcc8058ec0 unknown :-1 s=CLOSED pgs=91 gs=2 cs=0 l=1 c_cookie=10939832884202798782 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:46.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.953+0000 7fdccda83640 1 --2- 10.20.193.58:0/2918235361 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdcc815d4a0 0x7fdcc80affb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:46.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.953+0000 7fdccda83640 1 -- 10.20.193.58:0/2918235361 >> 10.20.193.58:0/2918235361 conn(0x7fdcc80b3c20 msgr2=0x7fdcc80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:45:46.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.953+0000 7fdccda83640 1 -- 10.20.193.58:0/2918235361 shutdown_connections 2026-02-23T06:45:46.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.953+0000 7fdccda83640 1 -- 10.20.193.58:0/2918235361 wait complete. 2026-02-23T06:45:46.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.954+0000 7fdccda83640 1 Processor -- start 2026-02-23T06:45:46.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.955+0000 7fdccda83640 1 -- start start 2026-02-23T06:45:46.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.955+0000 7fdccda83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdcc80b6690 0x7fdcc8122c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:46.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.955+0000 7fdccda83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdcc815d4a0 0x7fdcc8121cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:46.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.955+0000 7fdccda83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdcc815d870 0x7fdcc80561f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:46.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.955+0000 7fdccda83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc814b2a0 con 0x7fdcc80b6690 2026-02-23T06:45:46.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.955+0000 7fdccda83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc80575a0 con 0x7fdcc815d4a0 2026-02-23T06:45:46.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.955+0000 7fdccda83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fdcc8122760 con 0x7fdcc815d870 2026-02-23T06:45:46.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.955+0000 7fdccd282640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdcc815d870 msgr2=0x7fdcc80561f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:45:46.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.955+0000 7fdccd282640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdcc815d870 0x7fdcc80561f0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:45:46.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.955+0000 7fdccca81640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdcc80b6690 0x7fdcc8122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:46.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.955+0000 7fdccca81640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdcc80b6690 0x7fdcc8122c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:39830/0 (socket says 10.20.193.58:39830) 2026-02-23T06:45:46.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.955+0000 7fdccca81640 1 -- 10.20.193.58:0/262165316 learned_addr learned my addr 10.20.193.58:0/262165316 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:45:46.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.955+0000 7fdccca81640 1 -- 10.20.193.58:0/262165316 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdcc815d870 msgr2=0x7fdcc80561f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:45:46.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.955+0000 7fdccca81640 1 --2- 10.20.193.58:0/262165316 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdcc815d870 0x7fdcc80561f0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:46.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.955+0000 7fdccca81640 1 -- 10.20.193.58:0/262165316 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdcc815d4a0 msgr2=0x7fdcc8121cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:46.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.955+0000 7fdcbffff640 1 --2- 10.20.193.58:0/262165316 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdcc815d4a0 0x7fdcc8121cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:46.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.955+0000 7fdccca81640 1 --2- 10.20.193.58:0/262165316 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdcc815d4a0 0x7fdcc8121cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:46.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.955+0000 7fdccca81640 1 -- 10.20.193.58:0/262165316 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc400a590 con 0x7fdcc80b6690 2026-02-23T06:45:46.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.955+0000 7fdcbffff640 1 --2- 10.20.193.58:0/262165316 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdcc815d4a0 0x7fdcc8121cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:45:46.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.956+0000 7fdccca81640 1 --2- 10.20.193.58:0/262165316 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdcc80b6690 0x7fdcc8122c90 secure :-1 s=READY pgs=92 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcb8006fd0 tx=0x7fdcb800bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:46.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.956+0000 7fdcbd7fa640 1 -- 10.20.193.58:0/262165316 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcb8002cd0 con 0x7fdcc80b6690 2026-02-23T06:45:46.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.956+0000 7fdcbd7fa640 1 -- 10.20.193.58:0/262165316 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdcb8004070 con 0x7fdcc80b6690 2026-02-23T06:45:46.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.956+0000 7fdcbd7fa640 1 -- 10.20.193.58:0/262165316 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcb8004460 con 0x7fdcc80b6690 2026-02-23T06:45:46.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.956+0000 7fdccda83640 1 -- 10.20.193.58:0/262165316 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcc8121840 con 0x7fdcc80b6690 2026-02-23T06:45:46.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.956+0000 7fdccda83640 1 -- 10.20.193.58:0/262165316 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcc81231d0 con 0x7fdcc80b6690 2026-02-23T06:45:46.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.956+0000 7fdccda83640 1 --2- 10.20.193.58:0/262165316 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdcc8122210 0x7fdcc8056730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:46.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.956+0000 7fdccda83640 1 -- 10.20.193.58:0/262165316 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc80b6330 con 0x7fdcc8122210 2026-02-23T06:45:46.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.957+0000 7fdcbffff640 1 --2- 10.20.193.58:0/262165316 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdcc8122210 0x7fdcc8056730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:46.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.957+0000 7fdcbffff640 1 -- 10.20.193.58:0/262165316 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdcc80b5e10 con 0x7fdcc8122210 2026-02-23T06:45:46.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.958+0000 7fdcbffff640 1 --2- 10.20.193.58:0/262165316 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdcc8122210 0x7fdcc8056730 secure :-1 s=READY pgs=43 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcc81226f0 tx=0x7fdcb000db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:46.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.958+0000 7fdcbd7fa640 1 -- 10.20.193.58:0/262165316 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcb0005290 con 0x7fdcc8122210 2026-02-23T06:45:46.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.958+0000 7fdcbd7fa640 1 -- 10.20.193.58:0/262165316 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fdcb80045c0 con 0x7fdcc80b6690 2026-02-23T06:45:46.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.959+0000 7fdcbd7fa640 1 --2- 10.20.193.58:0/262165316 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdc9807a660 0x7fdc9809ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:46.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.959+0000 7fdcbd7fa640 1 -- 10.20.193.58:0/262165316 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fdcb809d020 con 0x7fdcc80b6690 2026-02-23T06:45:46.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.959+0000 7fdcbd7fa640 1 -- 10.20.193.58:0/262165316 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fdcb00053f0 con 0x7fdcc8122210 2026-02-23T06:45:46.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.959+0000 7fdcbd7fa640 1 -- 10.20.193.58:0/262165316 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdcc8122210 msgr2=0x7fdcc8056730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:46.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.959+0000 7fdcbd7fa640 1 --2- 10.20.193.58:0/262165316 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdcc8122210 0x7fdcc8056730 secure :-1 s=READY pgs=43 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcc81226f0 tx=0x7fdcb000db90 comp rx=0 tx=0).stop 2026-02-23T06:45:46.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.959+0000 7fdcbd7fa640 1 -- 10.20.193.58:0/262165316 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdcc8122210 msgr2=0x7fdcc8056730 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:45:46.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.959+0000 7fdcbd7fa640 1 --2- 10.20.193.58:0/262165316 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdcc8122210 0x7fdcc8056730 secure :-1 s=CLOSED pgs=43 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcc81226f0 tx=0x7fdcb000db90 comp rx=0 tx=0).stop 2026-02-23T06:45:46.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.959+0000 7fdccd282640 1 --2- 10.20.193.58:0/262165316 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdc9807a660 0x7fdc9809ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:46.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.960+0000 7fdccd282640 1 --2- 10.20.193.58:0/262165316 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdc9807a660 0x7fdc9809ab10 secure :-1 s=READY pgs=518 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcc400a8c0 tx=0x7fdcc4032040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:46.958 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.962+0000 7fdccda83640 1 --2- 10.20.193.58:0/262165316 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdcc8123f80 0x7fdcc814c670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:45:46.959 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.962+0000 7fdccda83640 1 -- 10.20.193.58:0/262165316 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc80b6d50 con 0x7fdcc8123f80 2026-02-23T06:45:46.959 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.962+0000 7fdcbffff640 1 --2- 10.20.193.58:0/262165316 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdcc8123f80 0x7fdcc814c670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:45:46.959 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.963+0000 7fdcbffff640 1 -- 10.20.193.58:0/262165316 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdcc805b0e0 con 0x7fdcc8123f80 2026-02-23T06:45:46.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.963+0000 7fdcbffff640 1 --2- 10.20.193.58:0/262165316 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdcc8123f80 0x7fdcc814c670 secure :-1 s=READY pgs=44 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcb0002780 tx=0x7fdcb00026a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:45:46.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.963+0000 7fdcbd7fa640 1 -- 10.20.193.58:0/262165316 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcb0022070 con 0x7fdcc8123f80 2026-02-23T06:45:46.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.964+0000 7fdcbd7fa640 1 -- 10.20.193.58:0/262165316 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5401 (secure 0 0 0) 0x7fdcb0005560 con 0x7fdcc8123f80 2026-02-23T06:45:46.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.964+0000 7fdcbd7fa640 1 -- 10.20.193.58:0/262165316 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdcc8123f80 msgr2=0x7fdcc814c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:46.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.964+0000 7fdcbd7fa640 1 --2- 10.20.193.58:0/262165316 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdcc8123f80 0x7fdcc814c670 secure :-1 s=READY pgs=44 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcb0002780 tx=0x7fdcb00026a0 comp rx=0 tx=0).stop 2026-02-23T06:45:46.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.964+0000 7fdcbd7fa640 1 -- 10.20.193.58:0/262165316 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdcc8123f80 msgr2=0x7fdcc814c670 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:45:46.960 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.964+0000 7fdcbd7fa640 1 --2- 10.20.193.58:0/262165316 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdcc8123f80 0x7fdcc814c670 unknown :-1 s=CLOSED pgs=44 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:45:46.961 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:45:46.961 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:45:46.961 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:45:46.961 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:45:46.961 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 214, 2026-02-23T06:45:46.961 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 33322, 2026-02-23T06:45:46.961 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:45:46.962 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:45:46.962 INFO:teuthology.orchestra.run.trial058.stdout: 1 2026-02-23T06:45:46.962 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:46.962 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 1, 2026-02-23T06:45:46.962 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:45:46.962 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:45:46.962 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:45:46.962 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:45:46.962 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:45:46.962 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:45:46.962 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:45:46.962 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:45:46.963 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:45:46.963 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:45:46.963 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:45:46.963 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:45:46.963 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:45:46.963 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:45:46.963 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:45:46.963 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:45:46.963 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:46.963 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:45:46.963 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:45:46.963 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:45:46.964 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:45:46.964 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:45:46.964 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:45:46.964 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:45:46.964 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:45:46.964 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:45:46.964 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:45:46.964 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:45:46.964 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:45:46.964 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:45:46.964 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:45:46.964 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:45:46.965 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:46.965 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:46.965 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:45:46.965 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:45:46.965 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:45:46.965 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:45:46.965 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:45:46.965 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:45:46.965 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:45:46.965 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:45:46.965 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:45:46.966 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:45:46.966 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:45:46.966 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:45:46.966 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:45:46.966 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:45:46.966 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:45:46.966 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:45:46.966 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:45:46.966 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:45:46.966 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:45:46.966 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:45:46.966 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:45:46.967 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:45:46.967 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:45:46.967 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:45:46.967 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:45:46.967 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:45:46.967 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:45:46.967 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:45:46.967 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:45:46.967 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:45:46.967 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:46.967 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:45:46.967 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:46.967 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:45:46.968 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:46.968 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:45:46.968 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:45:46.968 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:45:46.968 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:45:46.968 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:46.968 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:45:46.968 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:45:46.968 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:46.968 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:46.968 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:46.968 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:45:46.969 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:45:46.969 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:46.969 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:46.969 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:46.969 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:46.969 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:45:46.969 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:45:46.969 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:45:46.969 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:45:46.970 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:45:46.970 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:45:46.970 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:46.970 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:46.970 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:45:46.970 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:45:46.970 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:45:46.970 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:45:46.970 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:46.970 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:45:46.970 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:45:46.970 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:46.971 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:46.971 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:46.971 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:45:46.971 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:45:46.971 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:46.971 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:46.971 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:46.971 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:46.971 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:45:46.971 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:45:46.971 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:45:46.971 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:45:46.971 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:45:46.972 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:45:46.972 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:46.972 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:46.972 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:45:46.972 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:45:46.972 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:45:46.972 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:45:46.972 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:46.972 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:45:46.972 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:45:46.972 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:46.972 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:46.973 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:46.973 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:45:46.973 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:45:46.973 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:45:46.973 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:46.973 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:46.973 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:46.973 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:45:46.973 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:45:46.973 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:45:46.973 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:45:46.973 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:45:46.974 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:45:46.974 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:46.974 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:46.974 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:46.974 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:45:46.974 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:45:46.974 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:46.974 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:46.974 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:46.974 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:45:46.974 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:46.974 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:46.975 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:45:46.975 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:46.975 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:46.975 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:46.975 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:45:46.975 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:46.975 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:46.975 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:45:46.975 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:46.975 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:46.975 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:46.975 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:45:46.975 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:46.976 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:46.976 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:45:46.976 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:46.976 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:46.976 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:46.976 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:45:46.976 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:46.976 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:45:46.976 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:45:46.976 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:45:46.976 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:45:46.976 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:45:46.977 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:45:46.977 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:45:46.977 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:45:46.977 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:45:46.977 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:45:46.977 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:45:46.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.964+0000 7fdccda83640 1 -- 10.20.193.58:0/262165316 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdc9807a660 msgr2=0x7fdc9809ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:46.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.964+0000 7fdccda83640 1 --2- 10.20.193.58:0/262165316 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdc9807a660 0x7fdc9809ab10 secure :-1 s=READY pgs=518 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcc400a8c0 tx=0x7fdcc4032040 comp rx=0 tx=0).stop 2026-02-23T06:45:46.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.964+0000 7fdccda83640 1 -- 10.20.193.58:0/262165316 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdcc80b6690 msgr2=0x7fdcc8122c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:45:46.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.964+0000 7fdccda83640 1 --2- 10.20.193.58:0/262165316 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdcc80b6690 0x7fdcc8122c90 secure :-1 s=READY pgs=92 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcb8006fd0 tx=0x7fdcb800bbf0 comp rx=0 tx=0).stop 2026-02-23T06:45:46.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.964+0000 7fdccd282640 1 -- 10.20.193.58:0/262165316 reap_dead start 2026-02-23T06:45:46.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.964+0000 7fdccd282640 1 -- 10.20.193.58:0/262165316 reap_dead start 2026-02-23T06:45:46.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.964+0000 7fdccda83640 1 -- 10.20.193.58:0/262165316 shutdown_connections 2026-02-23T06:45:46.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.964+0000 7fdccda83640 1 -- 10.20.193.58:0/262165316 >> 10.20.193.58:0/262165316 conn(0x7fdcc80b3c20 msgr2=0x7fdcc80b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:45:46.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.964+0000 7fdccda83640 1 -- 10.20.193.58:0/262165316 shutdown_connections 2026-02-23T06:45:46.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:45:46.964+0000 7fdccda83640 1 -- 10.20.193.58:0/262165316 wait complete. 2026-02-23T06:45:46.980 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:45:46.980 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:46:06.981 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-23T06:46:06.981 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-23T06:46:06.981 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-23T06:46:06.981 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-23T06:46:06.983 INFO:tasks.ceph.mon.c:Started 2026-02-23T06:46:06.983 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.b 2026-02-23T06:46:06.983 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-23T06:46:06.983 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-23T06:46:06.983 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-23T06:46:15.159 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:46:15.164 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:46:21.983 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.b 2026-02-23T06:46:21.984 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-23T06:46:21.984 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-23T06:46:21.984 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:46:21.984 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:46:22.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.111+0000 7feb05403640 1 -- 10.20.193.58:0/2146503095 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb000b6690 msgr2=0x7feb00058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.107 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.111+0000 7feb05403640 1 --2- 10.20.193.58:0/2146503095 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb000b6690 0x7feb00058cf0 secure :-1 s=READY pgs=6 gs=3 cs=0 l=1 c_cookie=4097481517668165716 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb000b5040 tx=0x7feaf4030270 comp rx=0 tx=0).stop 2026-02-23T06:46:22.107 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.111+0000 7feb05403640 1 -- 10.20.193.58:0/2146503095 shutdown_connections 2026-02-23T06:46:22.107 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.111+0000 7feb05403640 1 --2- 10.20.193.58:0/2146503095 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb000b6690 0x7feb00058cf0 unknown :-1 s=CLOSED pgs=6 gs=3 cs=0 l=1 c_cookie=4097481517668165716 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.107 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.111+0000 7feb05403640 1 --2- 10.20.193.58:0/2146503095 >> v2:10.20.193.58:3300/0 conn(0x7feb0015d870 0x7feb000587b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.107 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.111+0000 7feb05403640 1 --2- 10.20.193.58:0/2146503095 >> v2:10.20.193.93:3300/0 conn(0x7feb0015d4a0 0x7feb000affb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.107 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.111+0000 7feb05403640 1 -- 10.20.193.58:0/2146503095 >> 10.20.193.58:0/2146503095 conn(0x7feb000b3c20 msgr2=0x7feb000b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:22.107 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.111+0000 7feb05403640 1 -- 10.20.193.58:0/2146503095 shutdown_connections 2026-02-23T06:46:22.107 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.111+0000 7feb05403640 1 -- 10.20.193.58:0/2146503095 wait complete. 2026-02-23T06:46:22.109 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.112+0000 7feb05403640 1 Processor -- start 2026-02-23T06:46:22.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.112+0000 7feb05403640 1 -- start start 2026-02-23T06:46:22.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.113+0000 7feb05403640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feb000b6690 0x7feb001207f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:22.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.113+0000 7feb05403640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb0015d4a0 0x7feb0014a310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:22.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.113+0000 7feb05403640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feb0015d870 0x7feb000b7480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:22.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.113+0000 7feb05403640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7feb00120d30 con 0x7feb0015d870 2026-02-23T06:46:22.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.113+0000 7feb05403640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7feb0011de60 con 0x7feb000b6690 2026-02-23T06:46:22.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.113+0000 7feb05403640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7feb00122ea0 con 0x7feb0015d4a0 2026-02-23T06:46:22.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.113+0000 7feaff7fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb0015d4a0 0x7feb0014a310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:22.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.113+0000 7feb04c02640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feb0015d870 0x7feb000b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:22.110 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.113+0000 7feaff7fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb0015d4a0 0x7feb0014a310 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:46196/0 (socket says 10.20.193.58:46196) 2026-02-23T06:46:22.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.113+0000 7feaff7fe640 1 -- 10.20.193.58:0/860869847 learned_addr learned my addr 10.20.193.58:0/860869847 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:46:22.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.113+0000 7feafffff640 1 --2- 10.20.193.58:0/860869847 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feb000b6690 0x7feb001207f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:22.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.113+0000 7feaff7fe640 1 -- 10.20.193.58:0/860869847 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feb000b6690 msgr2=0x7feb001207f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.113+0000 7feaff7fe640 1 --2- 10.20.193.58:0/860869847 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feb000b6690 0x7feb001207f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.113+0000 7feaff7fe640 1 -- 10.20.193.58:0/860869847 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feb0015d870 msgr2=0x7feb000b7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.113+0000 7feaff7fe640 1 --2- 10.20.193.58:0/860869847 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feb0015d870 0x7feb000b7480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.113+0000 7feaff7fe640 1 -- 10.20.193.58:0/860869847 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaec009570 con 0x7feb0015d4a0 2026-02-23T06:46:22.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.113+0000 7feaff7fe640 1 --2- 10.20.193.58:0/860869847 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb0015d4a0 0x7feb0014a310 secure :-1 s=READY pgs=7 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feaf0009fd0 tx=0x7feaf0002bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:22.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.114+0000 7feafcff9640 1 -- 10.20.193.58:0/860869847 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feaf000ed60 con 0x7feb0015d4a0 2026-02-23T06:46:22.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.114+0000 7feafcff9640 1 -- 10.20.193.58:0/860869847 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feaf0002e20 con 0x7feb0015d4a0 2026-02-23T06:46:22.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.114+0000 7feafcff9640 1 -- 10.20.193.58:0/860869847 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feaf00106b0 con 0x7feb0015d4a0 2026-02-23T06:46:22.111 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.114+0000 7feb05403640 1 -- 10.20.193.58:0/860869847 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaf00094b0 con 0x7feb0015d4a0 2026-02-23T06:46:22.112 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.114+0000 7feb05403640 1 -- 10.20.193.58:0/860869847 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feaf400a590 con 0x7feb0015d4a0 2026-02-23T06:46:22.112 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.114+0000 7feb05403640 1 -- 10.20.193.58:0/860869847 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb000b7260 con 0x7feb0015d4a0 2026-02-23T06:46:22.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.115+0000 7feafcff9640 1 -- 10.20.193.58:0/860869847 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7feaf0016020 con 0x7feb0015d4a0 2026-02-23T06:46:22.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.116+0000 7feafcff9640 1 --2- 10.20.193.58:0/860869847 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fead007a790 0x7fead009ac40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:22.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.116+0000 7feafcff9640 1 -- 10.20.193.58:0/860869847 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7feaf009df50 con 0x7feb0015d4a0 2026-02-23T06:46:22.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.116+0000 7feafffff640 1 --2- 10.20.193.58:0/860869847 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fead007a790 0x7fead009ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:22.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.117+0000 7feafffff640 1 --2- 10.20.193.58:0/860869847 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fead007a790 0x7fead009ac40 secure :-1 s=READY pgs=520 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feaec005e70 tx=0x7feaec009310 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:22.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.117+0000 7feafcff9640 1 -- 10.20.193.58:0/860869847 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7feaf0061160 con 0x7feb0015d4a0 2026-02-23T06:46:22.267 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.272+0000 7feb05403640 1 -- 10.20.193.58:0/860869847 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7feb0011f270 con 0x7feb0015d4a0 2026-02-23T06:46:22.268 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.272+0000 7feafcff9640 1 -- 10.20.193.58:0/860869847 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7feaf0064280 con 0x7feb0015d4a0 2026-02-23T06:46:22.268 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":222,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:46:22.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.273+0000 7feb05403640 1 -- 10.20.193.58:0/860869847 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fead007a790 msgr2=0x7fead009ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.269 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.273+0000 7feb05403640 1 --2- 10.20.193.58:0/860869847 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fead007a790 0x7fead009ac40 secure :-1 s=READY pgs=520 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feaec005e70 tx=0x7feaec009310 comp rx=0 tx=0).stop 2026-02-23T06:46:22.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.273+0000 7feb05403640 1 -- 10.20.193.58:0/860869847 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb0015d4a0 msgr2=0x7feb0014a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.273+0000 7feb05403640 1 --2- 10.20.193.58:0/860869847 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb0015d4a0 0x7feb0014a310 secure :-1 s=READY pgs=7 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feaf0009fd0 tx=0x7feaf0002bc0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.273+0000 7feb05403640 1 -- 10.20.193.58:0/860869847 shutdown_connections 2026-02-23T06:46:22.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.273+0000 7feb05403640 1 --2- 10.20.193.58:0/860869847 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fead007a790 0x7fead009ac40 unknown :-1 s=CLOSED pgs=520 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.273+0000 7feb05403640 1 --2- 10.20.193.58:0/860869847 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feb0015d870 0x7feb000b7480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.273+0000 7feb05403640 1 --2- 10.20.193.58:0/860869847 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feb0015d4a0 0x7feb0014a310 unknown :-1 s=CLOSED pgs=7 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.273+0000 7feb05403640 1 --2- 10.20.193.58:0/860869847 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feb000b6690 0x7feb001207f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.273+0000 7feb05403640 1 -- 10.20.193.58:0/860869847 >> 10.20.193.58:0/860869847 conn(0x7feb000b3c20 msgr2=0x7feb000b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:22.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.273+0000 7feb05403640 1 -- 10.20.193.58:0/860869847 shutdown_connections 2026-02-23T06:46:22.270 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.273+0000 7feb05403640 1 -- 10.20.193.58:0/860869847 wait complete. 2026-02-23T06:46:22.280 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:46:22.280 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:46:22.281 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:46:22.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.408+0000 7f6891d30640 1 -- 10.20.193.58:0/621693237 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f688c15d4a0 msgr2=0x7f688c0affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.408+0000 7f6891d30640 1 --2- 10.20.193.58:0/621693237 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f688c15d4a0 0x7f688c0affb0 secure :-1 s=READY pgs=49 gs=2 cs=0 l=1 c_cookie=16971481623113296742 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f687c004740 tx=0x7f687c02f1e0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.408+0000 7f6891d30640 1 -- 10.20.193.58:0/621693237 shutdown_connections 2026-02-23T06:46:22.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.408+0000 7f6891d30640 1 --2- 10.20.193.58:0/621693237 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f688c0b6690 0x7f688c058ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.408+0000 7f6891d30640 1 --2- 10.20.193.58:0/621693237 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f688c15d4a0 0x7f688c0affb0 unknown :-1 s=CLOSED pgs=49 gs=2 cs=0 l=1 c_cookie=16971481623113296742 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.408+0000 7f6891d30640 1 -- 10.20.193.58:0/621693237 >> 10.20.193.58:0/621693237 conn(0x7f688c0b3c20 msgr2=0x7f688c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:22.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.409+0000 7f6891d30640 1 -- 10.20.193.58:0/621693237 shutdown_connections 2026-02-23T06:46:22.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.409+0000 7f6891d30640 1 -- 10.20.193.58:0/621693237 wait complete. 2026-02-23T06:46:22.408 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.410+0000 7f6891d30640 1 Processor -- start 2026-02-23T06:46:22.408 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.410+0000 7f6891d30640 1 -- start start 2026-02-23T06:46:22.408 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.410+0000 7f6891d30640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f688c0b6690 0x7f688c1401b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:22.408 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.410+0000 7f6891d30640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f688c15d4a0 0x7f688c05c480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:22.408 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.410+0000 7f6891d30640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f688c15d870 0x7f688c11e060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:22.409 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.410+0000 7f6891d30640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f688c057520 con 0x7f688c0b6690 2026-02-23T06:46:22.409 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.410+0000 7f6891d30640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f688c13bf80 con 0x7f688c15d4a0 2026-02-23T06:46:22.409 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.410+0000 7f6891d30640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f688c057730 con 0x7f688c15d870 2026-02-23T06:46:22.409 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.411+0000 7f6890d2e640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f688c0b6690 0x7f688c1401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:22.409 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.411+0000 7f6890d2e640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f688c0b6690 0x7f688c1401b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:36908/0 (socket says 10.20.193.58:36908) 2026-02-23T06:46:22.409 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.411+0000 7f6890d2e640 1 -- 10.20.193.58:0/1824094629 learned_addr learned my addr 10.20.193.58:0/1824094629 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:46:22.409 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.411+0000 7f689152f640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f688c15d870 0x7f688c11e060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:22.409 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.411+0000 7f6883fff640 1 --2- 10.20.193.58:0/1824094629 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f688c15d4a0 0x7f688c05c480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:22.409 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.411+0000 7f6890d2e640 1 -- 10.20.193.58:0/1824094629 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f688c15d870 msgr2=0x7f688c11e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.409 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.411+0000 7f6890d2e640 1 --2- 10.20.193.58:0/1824094629 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f688c15d870 0x7f688c11e060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.409 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.411+0000 7f6890d2e640 1 -- 10.20.193.58:0/1824094629 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f688c15d4a0 msgr2=0x7f688c05c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.410 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.411+0000 7f6890d2e640 1 --2- 10.20.193.58:0/1824094629 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f688c15d4a0 0x7f688c05c480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.410 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.411+0000 7f6890d2e640 1 -- 10.20.193.58:0/1824094629 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f688800a590 con 0x7f688c0b6690 2026-02-23T06:46:22.410 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.411+0000 7f6890d2e640 1 --2- 10.20.193.58:0/1824094629 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f688c0b6690 0x7f688c1401b0 secure :-1 s=READY pgs=97 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f687c009230 tx=0x7f687c002950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:22.410 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.411+0000 7f68817fa640 1 -- 10.20.193.58:0/1824094629 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f687c038470 con 0x7f688c0b6690 2026-02-23T06:46:22.410 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.411+0000 7f68817fa640 1 -- 10.20.193.58:0/1824094629 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f687c0386c0 con 0x7f688c0b6690 2026-02-23T06:46:22.410 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.411+0000 7f68817fa640 1 -- 10.20.193.58:0/1824094629 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f687c038a90 con 0x7f688c0b6690 2026-02-23T06:46:22.410 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.411+0000 7f6891d30640 1 -- 10.20.193.58:0/1824094629 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f687c0094b0 con 0x7f688c0b6690 2026-02-23T06:46:22.410 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.411+0000 7f6891d30640 1 -- 10.20.193.58:0/1824094629 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f688c13c1d0 con 0x7f688c0b6690 2026-02-23T06:46:22.410 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.412+0000 7f6891d30640 1 --2- 10.20.193.58:0/1824094629 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f688c13c3f0 0x7f688c11e5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:22.410 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.412+0000 7f6891d30640 1 -- 10.20.193.58:0/1824094629 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f688c057c10 con 0x7f688c13c3f0 2026-02-23T06:46:22.410 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.412+0000 7f6883fff640 1 --2- 10.20.193.58:0/1824094629 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f688c13c3f0 0x7f688c11e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:22.410 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.412+0000 7f6883fff640 1 -- 10.20.193.58:0/1824094629 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f688c0b6330 con 0x7f688c13c3f0 2026-02-23T06:46:22.411 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.413+0000 7f6883fff640 1 --2- 10.20.193.58:0/1824094629 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f688c13c3f0 0x7f688c11e5a0 secure :-1 s=READY pgs=98 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f688c15a750 tx=0x7f687400fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:22.411 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.413+0000 7f68817fa640 1 -- 10.20.193.58:0/1824094629 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f687400dab0 con 0x7f688c13c3f0 2026-02-23T06:46:22.411 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.413+0000 7f68817fa640 1 -- 10.20.193.58:0/1824094629 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f687400fe10 con 0x7f688c13c3f0 2026-02-23T06:46:22.411 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.413+0000 7f68817fa640 1 -- 10.20.193.58:0/1824094629 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f688c13c3f0 msgr2=0x7f688c11e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.411 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.413+0000 7f68817fa640 1 --2- 10.20.193.58:0/1824094629 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f688c13c3f0 0x7f688c11e5a0 secure :-1 s=READY pgs=98 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f688c15a750 tx=0x7f687400fc10 comp rx=0 tx=0).stop 2026-02-23T06:46:22.411 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.413+0000 7f68817fa640 1 -- 10.20.193.58:0/1824094629 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f688c13c3f0 msgr2=0x7f688c11e5a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:46:22.411 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.413+0000 7f68817fa640 1 --2- 10.20.193.58:0/1824094629 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f688c13c3f0 0x7f688c11e5a0 unknown :-1 s=CLOSED pgs=98 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.411 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.413+0000 7f68817fa640 1 -- 10.20.193.58:0/1824094629 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f687c038bf0 con 0x7f688c0b6690 2026-02-23T06:46:22.412 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.414+0000 7f68817fa640 1 --2- 10.20.193.58:0/1824094629 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f685c07a3c0 0x7f685c09a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:22.412 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.414+0000 7f68817fa640 1 -- 10.20.193.58:0/1824094629 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f687c0c29b0 con 0x7f688c0b6690 2026-02-23T06:46:22.412 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.414+0000 7f6883fff640 1 --2- 10.20.193.58:0/1824094629 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f685c07a3c0 0x7f685c09a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:22.413 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.415+0000 7f6883fff640 1 --2- 10.20.193.58:0/1824094629 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f685c07a3c0 0x7f685c09a870 secure :-1 s=READY pgs=521 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68740023d0 tx=0x7f6874009030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:22.413 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.417+0000 7f6891d30640 1 --2- 10.20.193.58:0/1824094629 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f688c11eae0 0x7f688c14fe60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:22.413 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.417+0000 7f6891d30640 1 -- 10.20.193.58:0/1824094629 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f688c164250 con 0x7f688c11eae0 2026-02-23T06:46:22.413 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.417+0000 7f689152f640 1 --2- 10.20.193.58:0/1824094629 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f688c11eae0 0x7f688c14fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:22.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.418+0000 7f689152f640 1 -- 10.20.193.58:0/1824094629 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f688c0b6d50 con 0x7f688c11eae0 2026-02-23T06:46:22.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.418+0000 7f689152f640 1 --2- 10.20.193.58:0/1824094629 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f688c11eae0 0x7f688c14fe60 secure :-1 s=READY pgs=99 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68880039b0 tx=0x7f6888003e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:22.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.418+0000 7f68817fa640 1 -- 10.20.193.58:0/1824094629 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6888012ba0 con 0x7f688c11eae0 2026-02-23T06:46:22.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.418+0000 7f68817fa640 1 -- 10.20.193.58:0/1824094629 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5415 (secure 0 0 0) 0x7f6888012d00 con 0x7f688c11eae0 2026-02-23T06:46:22.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.418+0000 7f68817fa640 1 -- 10.20.193.58:0/1824094629 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f688c11eae0 msgr2=0x7f688c14fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.418+0000 7f68817fa640 1 --2- 10.20.193.58:0/1824094629 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f688c11eae0 0x7f688c14fe60 secure :-1 s=READY pgs=99 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68880039b0 tx=0x7f6888003e80 comp rx=0 tx=0).stop 2026-02-23T06:46:22.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.418+0000 7f68817fa640 1 -- 10.20.193.58:0/1824094629 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f688c11eae0 msgr2=0x7f688c14fe60 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:46:22.415 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.418+0000 7f68817fa640 1 --2- 10.20.193.58:0/1824094629 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f688c11eae0 0x7f688c14fe60 secure :-1 s=CLOSED pgs=99 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68880039b0 tx=0x7f6888003e80 comp rx=0 tx=0).stop 2026-02-23T06:46:22.415 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:46:22.415 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:46:22.415 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:46:22.415 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:46:22.415 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 222, 2026-02-23T06:46:22.415 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 132090, 2026-02-23T06:46:22.416 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:46:22.416 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:46:22.416 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:46:22.416 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:46:22.416 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:22.416 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:46:22.416 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:46:22.416 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:46:22.416 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:46:22.416 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:46:22.416 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:46:22.417 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:46:22.417 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:46:22.417 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:46:22.417 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:46:22.417 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:46:22.417 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:46:22.417 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:46:22.417 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:46:22.417 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:46:22.417 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:46:22.417 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:46:22.417 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:22.418 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:46:22.418 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:46:22.418 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:46:22.418 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:46:22.418 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:46:22.418 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:46:22.418 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:46:22.418 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:46:22.418 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:46:22.418 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:46:22.418 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:46:22.419 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:46:22.419 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:46:22.419 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:46:22.419 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:46:22.419 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:22.419 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.419 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:46:22.419 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:46:22.419 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:46:22.419 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:46:22.419 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:46:22.419 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:46:22.420 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:46:22.420 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:46:22.420 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:46:22.420 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:46:22.420 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:46:22.420 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:46:22.420 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:46:22.420 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:46:22.420 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:46:22.420 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:46:22.420 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:46:22.421 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:46:22.421 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:46:22.421 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:46:22.421 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:46:22.421 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:46:22.421 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:46:22.421 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:46:22.421 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:46:22.421 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:46:22.421 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:46:22.421 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:46:22.421 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:46:22.421 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:46:22.422 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:22.422 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:46:22.422 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.422 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:46:22.422 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.422 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:46:22.422 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:46:22.422 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:46:22.422 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:46:22.423 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.423 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:46:22.423 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:46:22.423 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:22.423 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.423 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.423 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:46:22.423 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:46:22.423 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:22.423 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:22.423 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:22.423 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.424 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:46:22.424 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:46:22.424 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:46:22.424 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:46:22.424 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:46:22.424 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:46:22.424 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.424 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.424 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:46:22.424 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:46:22.424 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:46:22.424 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:46:22.425 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.425 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:46:22.425 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:46:22.425 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:22.425 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.425 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.425 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:46:22.425 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:46:22.425 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:22.425 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:22.425 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:22.425 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.426 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:46:22.426 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:46:22.426 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:46:22.426 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:46:22.426 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:46:22.426 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:46:22.426 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.426 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.426 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:46:22.426 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:46:22.426 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:46:22.426 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:46:22.427 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.427 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:46:22.427 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:46:22.427 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:22.427 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.427 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.427 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:46:22.427 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:46:22.427 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:22.427 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:22.427 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:22.427 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.427 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:46:22.428 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:46:22.428 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:46:22.428 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:46:22.428 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:46:22.428 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:46:22.428 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:22.428 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:22.428 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.428 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:46:22.428 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:46:22.428 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.428 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:22.428 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:22.429 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:46:22.429 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:22.429 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:22.429 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:46:22.429 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.429 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:22.429 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:22.429 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:46:22.429 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:22.429 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:22.429 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:46:22.429 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.430 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:22.430 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:22.430 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:46:22.430 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:22.430 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:22.430 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:46:22.430 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.430 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:22.430 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:22.430 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:46:22.430 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:22.430 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:22.431 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:46:22.431 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.431 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:22.431 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:22.431 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:46:22.431 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:22.431 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:22.431 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.431 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:46:22.431 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:46:22.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.418+0000 7f6891d30640 1 -- 10.20.193.58:0/1824094629 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f685c07a3c0 msgr2=0x7f685c09a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.418+0000 7f6891d30640 1 --2- 10.20.193.58:0/1824094629 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f685c07a3c0 0x7f685c09a870 secure :-1 s=READY pgs=521 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68740023d0 tx=0x7f6874009030 comp rx=0 tx=0).stop 2026-02-23T06:46:22.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.419+0000 7f6891d30640 1 -- 10.20.193.58:0/1824094629 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f688c0b6690 msgr2=0x7f688c1401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.419+0000 7f6891d30640 1 --2- 10.20.193.58:0/1824094629 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f688c0b6690 0x7f688c1401b0 secure :-1 s=READY pgs=97 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f687c009230 tx=0x7f687c002950 comp rx=0 tx=0).stop 2026-02-23T06:46:22.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.419+0000 7f689152f640 1 -- 10.20.193.58:0/1824094629 reap_dead start 2026-02-23T06:46:22.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.419+0000 7f6891d30640 1 -- 10.20.193.58:0/1824094629 shutdown_connections 2026-02-23T06:46:22.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.419+0000 7f6891d30640 1 -- 10.20.193.58:0/1824094629 >> 10.20.193.58:0/1824094629 conn(0x7f688c0b3c20 msgr2=0x7f688c0b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:22.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.419+0000 7f6891d30640 1 -- 10.20.193.58:0/1824094629 shutdown_connections 2026-02-23T06:46:22.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.419+0000 7f6891d30640 1 -- 10.20.193.58:0/1824094629 wait complete. 2026-02-23T06:46:22.434 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:46:22.434 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:46:22.435 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:46:22.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.562+0000 7fe163043640 1 -- 10.20.193.58:0/1596302233 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe15c056960 msgr2=0x7fe15c0b6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.562+0000 7fe163043640 1 --2- 10.20.193.58:0/1596302233 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe15c056960 0x7fe15c0b6720 secure :-1 s=READY pgs=100 gs=3 cs=0 l=1 c_cookie=17396780519948133988 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe15c059b80 tx=0x7fe15002f190 comp rx=0 tx=0).stop 2026-02-23T06:46:22.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.562+0000 7fe163043640 1 -- 10.20.193.58:0/1596302233 shutdown_connections 2026-02-23T06:46:22.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.562+0000 7fe163043640 1 --2- 10.20.193.58:0/1596302233 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe15c056960 0x7fe15c0b6720 unknown :-1 s=CLOSED pgs=100 gs=3 cs=0 l=1 c_cookie=17396780519948133988 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.562+0000 7fe163043640 1 --2- 10.20.193.58:0/1596302233 >> v2:10.20.193.93:3300/0 conn(0x7fe15c15c4b0 0x7fe15c058200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.562+0000 7fe163043640 1 -- 10.20.193.58:0/1596302233 >> 10.20.193.58:0/1596302233 conn(0x7fe15c0b3c20 msgr2=0x7fe15c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:22.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.562+0000 7fe163043640 1 -- 10.20.193.58:0/1596302233 shutdown_connections 2026-02-23T06:46:22.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.562+0000 7fe163043640 1 -- 10.20.193.58:0/1596302233 wait complete. 2026-02-23T06:46:22.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.563+0000 7fe163043640 1 Processor -- start 2026-02-23T06:46:22.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.563+0000 7fe163043640 1 -- start start 2026-02-23T06:46:22.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.564+0000 7fe163043640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe15c056960 0x7fe15c136530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:22.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.564+0000 7fe163043640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe15c15c4b0 0x7fe15c161a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:22.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.564+0000 7fe163043640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe15c162ca0 0x7fe15c0b0480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:22.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.564+0000 7fe163043640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe15c1607e0 con 0x7fe15c162ca0 2026-02-23T06:46:22.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.564+0000 7fe163043640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe15c0ae550 con 0x7fe15c056960 2026-02-23T06:46:22.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.564+0000 7fe163043640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe15c15fe60 con 0x7fe15c15c4b0 2026-02-23T06:46:22.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.564+0000 7fe162041640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe15c056960 0x7fe15c136530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:22.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.564+0000 7fe161840640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe15c15c4b0 0x7fe15c161a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:22.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.564+0000 7fe162041640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe15c056960 0x7fe15c136530 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:36904/0 (socket says 10.20.193.58:36904) 2026-02-23T06:46:22.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.564+0000 7fe162041640 1 -- 10.20.193.58:0/1664208481 learned_addr learned my addr 10.20.193.58:0/1664208481 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:46:22.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.564+0000 7fe162842640 1 --2- 10.20.193.58:0/1664208481 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe15c162ca0 0x7fe15c0b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:22.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.564+0000 7fe162041640 1 -- 10.20.193.58:0/1664208481 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe15c15c4b0 msgr2=0x7fe15c161a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.564+0000 7fe162041640 1 --2- 10.20.193.58:0/1664208481 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe15c15c4b0 0x7fe15c161a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.564+0000 7fe162041640 1 -- 10.20.193.58:0/1664208481 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe15c162ca0 msgr2=0x7fe15c0b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.564+0000 7fe162041640 1 --2- 10.20.193.58:0/1664208481 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe15c162ca0 0x7fe15c0b0480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.564+0000 7fe162041640 1 -- 10.20.193.58:0/1664208481 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1500094b0 con 0x7fe15c056960 2026-02-23T06:46:22.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.565+0000 7fe162041640 1 --2- 10.20.193.58:0/1664208481 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe15c056960 0x7fe15c136530 secure :-1 s=READY pgs=51 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe14c009480 tx=0x7fe14c00ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:22.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.565+0000 7fe142ffd640 1 -- 10.20.193.58:0/1664208481 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe14c00cd40 con 0x7fe15c056960 2026-02-23T06:46:22.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.565+0000 7fe163043640 1 -- 10.20.193.58:0/1664208481 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe15c160100 con 0x7fe15c056960 2026-02-23T06:46:22.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.565+0000 7fe163043640 1 -- 10.20.193.58:0/1664208481 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe15c0ae270 con 0x7fe15c056960 2026-02-23T06:46:22.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.565+0000 7fe142ffd640 1 -- 10.20.193.58:0/1664208481 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe14c004850 con 0x7fe15c056960 2026-02-23T06:46:22.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.565+0000 7fe142ffd640 1 -- 10.20.193.58:0/1664208481 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe14c00cea0 con 0x7fe15c056960 2026-02-23T06:46:22.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.565+0000 7fe163043640 1 --2- 10.20.193.58:0/1664208481 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe15c1603d0 0x7fe15c160c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:22.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.565+0000 7fe163043640 1 -- 10.20.193.58:0/1664208481 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe15c160950 con 0x7fe15c1603d0 2026-02-23T06:46:22.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.566+0000 7fe161840640 1 --2- 10.20.193.58:0/1664208481 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe15c1603d0 0x7fe15c160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:22.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.566+0000 7fe161840640 1 -- 10.20.193.58:0/1664208481 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe15c059690 con 0x7fe15c1603d0 2026-02-23T06:46:22.565 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.566+0000 7fe161840640 1 --2- 10.20.193.58:0/1664208481 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe15c1603d0 0x7fe15c160c70 secure :-1 s=READY pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe150009230 tx=0x7fe1500028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:22.565 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.566+0000 7fe142ffd640 1 -- 10.20.193.58:0/1664208481 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe150047070 con 0x7fe15c1603d0 2026-02-23T06:46:22.565 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.567+0000 7fe142ffd640 1 -- 10.20.193.58:0/1664208481 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fe15003e040 con 0x7fe15c1603d0 2026-02-23T06:46:22.565 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.567+0000 7fe142ffd640 1 -- 10.20.193.58:0/1664208481 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe15c1603d0 msgr2=0x7fe15c160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.565 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.567+0000 7fe142ffd640 1 --2- 10.20.193.58:0/1664208481 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe15c1603d0 0x7fe15c160c70 secure :-1 s=READY pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe150009230 tx=0x7fe1500028d0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.567+0000 7fe142ffd640 1 -- 10.20.193.58:0/1664208481 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe15c1603d0 msgr2=0x7fe15c160c70 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:46:22.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.567+0000 7fe142ffd640 1 --2- 10.20.193.58:0/1664208481 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe15c1603d0 0x7fe15c160c70 secure :-1 s=CLOSED pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe150009230 tx=0x7fe1500028d0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.568+0000 7fe142ffd640 1 -- 10.20.193.58:0/1664208481 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fe14c01f060 con 0x7fe15c056960 2026-02-23T06:46:22.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.569+0000 7fe142ffd640 1 --2- 10.20.193.58:0/1664208481 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe12c07a430 0x7fe12c09a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:22.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.569+0000 7fe142ffd640 1 -- 10.20.193.58:0/1664208481 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fe14c014070 con 0x7fe15c056960 2026-02-23T06:46:22.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.570+0000 7fe161840640 1 --2- 10.20.193.58:0/1664208481 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe12c07a430 0x7fe12c09a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:22.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.570+0000 7fe163043640 1 --2- 10.20.193.58:0/1664208481 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe15c1318a0 0x7fe15c1611b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:22.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.570+0000 7fe163043640 1 -- 10.20.193.58:0/1664208481 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe15c15c880 con 0x7fe15c1318a0 2026-02-23T06:46:22.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.570+0000 7fe161840640 1 --2- 10.20.193.58:0/1664208481 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe12c07a430 0x7fe12c09a8e0 secure :-1 s=READY pgs=522 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1500046f0 tx=0x7fe150042000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:22.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.570+0000 7fe162842640 1 --2- 10.20.193.58:0/1664208481 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe15c1318a0 0x7fe15c1611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:22.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.571+0000 7fe162842640 1 -- 10.20.193.58:0/1664208481 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe15c13d120 con 0x7fe15c1318a0 2026-02-23T06:46:22.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.571+0000 7fe162842640 1 --2- 10.20.193.58:0/1664208481 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe15c1318a0 0x7fe15c1611b0 secure :-1 s=READY pgs=53 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe15c132910 tx=0x7fe15800ff10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:22.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.571+0000 7fe142ffd640 1 -- 10.20.193.58:0/1664208481 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe15801a070 con 0x7fe15c1318a0 2026-02-23T06:46:22.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.571+0000 7fe142ffd640 1 -- 10.20.193.58:0/1664208481 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5555 (secure 0 0 0) 0x7fe158007b70 con 0x7fe15c1318a0 2026-02-23T06:46:22.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.571+0000 7fe142ffd640 1 -- 10.20.193.58:0/1664208481 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe15c1318a0 msgr2=0x7fe15c1611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.571+0000 7fe142ffd640 1 --2- 10.20.193.58:0/1664208481 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe15c1318a0 0x7fe15c1611b0 secure :-1 s=READY pgs=53 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe15c132910 tx=0x7fe15800ff10 comp rx=0 tx=0).stop 2026-02-23T06:46:22.568 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:46:22.568 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:46:22.569 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:46:22.569 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:46:22.569 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 222, 2026-02-23T06:46:22.569 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 68930, 2026-02-23T06:46:22.569 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:46:22.569 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:46:22.569 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:46:22.569 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:46:22.569 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:22.569 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:46:22.569 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:46:22.570 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:46:22.570 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:46:22.570 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:46:22.570 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:46:22.570 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:46:22.570 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:46:22.570 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:46:22.570 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:46:22.570 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:46:22.570 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:46:22.570 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:46:22.570 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:46:22.570 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:46:22.571 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:46:22.571 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:46:22.571 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:22.571 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:46:22.571 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:46:22.571 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:46:22.571 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:46:22.571 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:46:22.571 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:46:22.571 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:46:22.571 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:46:22.571 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:46:22.572 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:46:22.572 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:46:22.572 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:46:22.572 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:46:22.572 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:46:22.572 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:46:22.572 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:22.572 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.572 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:46:22.572 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:46:22.572 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:46:22.572 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:46:22.573 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:46:22.573 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:46:22.573 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:46:22.573 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:46:22.573 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:46:22.573 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:46:22.573 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:46:22.573 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:46:22.573 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:46:22.573 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:46:22.573 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:46:22.573 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:46:22.574 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:46:22.574 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:46:22.574 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:46:22.574 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:46:22.574 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:46:22.574 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:46:22.574 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:46:22.574 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:46:22.574 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:46:22.574 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:46:22.574 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:46:22.574 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:46:22.575 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:46:22.575 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:46:22.575 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:22.575 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:46:22.575 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.575 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:46:22.575 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.575 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:46:22.575 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:46:22.575 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:46:22.575 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:46:22.575 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.576 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:46:22.576 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:46:22.576 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:22.576 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.576 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.576 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:46:22.576 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:46:22.576 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:22.576 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:22.576 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:22.576 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.576 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:46:22.576 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:46:22.577 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:46:22.577 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:46:22.577 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:46:22.577 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:46:22.577 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.577 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.577 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:46:22.577 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:46:22.577 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:46:22.577 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:46:22.577 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.577 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:46:22.578 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:46:22.578 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:22.578 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.578 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.578 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:46:22.578 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:46:22.578 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:22.578 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:22.578 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:22.578 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.578 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:46:22.578 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:46:22.578 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:46:22.579 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:46:22.579 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:46:22.579 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:46:22.579 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.579 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.579 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:46:22.579 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:46:22.579 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:46:22.579 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:46:22.579 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.579 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:46:22.579 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:46:22.580 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:22.580 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.580 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.580 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:46:22.580 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:46:22.580 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:22.580 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:22.580 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:22.580 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.580 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:46:22.580 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:46:22.580 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:46:22.580 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:46:22.581 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:46:22.581 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:46:22.581 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:22.581 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:22.581 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.581 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:46:22.581 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:46:22.581 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.581 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:22.581 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:22.581 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:46:22.581 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:22.582 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:22.582 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:46:22.582 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.582 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:22.582 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:22.582 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:46:22.582 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:22.582 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:22.582 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:46:22.582 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.582 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:22.582 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:22.583 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:46:22.583 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:22.583 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:22.583 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:46:22.583 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.583 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:46:22.583 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:46:22.583 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:46:22.583 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.583 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.583 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:22.583 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:22.583 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:46:22.584 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:22.584 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:22.584 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:46:22.584 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.584 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:22.584 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:22.584 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:46:22.584 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:22.584 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:22.584 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.584 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:46:22.584 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:46:22.586 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.571+0000 7fe142ffd640 1 -- 10.20.193.58:0/1664208481 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe15c1318a0 msgr2=0x7fe15c1611b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:46:22.586 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.571+0000 7fe142ffd640 1 --2- 10.20.193.58:0/1664208481 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe15c1318a0 0x7fe15c1611b0 secure :-1 s=CLOSED pgs=53 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe15c132910 tx=0x7fe15800ff10 comp rx=0 tx=0).stop 2026-02-23T06:46:22.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.572+0000 7fe163043640 1 -- 10.20.193.58:0/1664208481 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe12c07a430 msgr2=0x7fe12c09a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.572+0000 7fe163043640 1 --2- 10.20.193.58:0/1664208481 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe12c07a430 0x7fe12c09a8e0 secure :-1 s=READY pgs=522 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1500046f0 tx=0x7fe150042000 comp rx=0 tx=0).stop 2026-02-23T06:46:22.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.572+0000 7fe163043640 1 -- 10.20.193.58:0/1664208481 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe15c056960 msgr2=0x7fe15c136530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.572+0000 7fe163043640 1 --2- 10.20.193.58:0/1664208481 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe15c056960 0x7fe15c136530 secure :-1 s=READY pgs=51 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe14c009480 tx=0x7fe14c00ee60 comp rx=0 tx=0).stop 2026-02-23T06:46:22.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.572+0000 7fe162842640 1 -- 10.20.193.58:0/1664208481 reap_dead start 2026-02-23T06:46:22.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.572+0000 7fe163043640 1 -- 10.20.193.58:0/1664208481 shutdown_connections 2026-02-23T06:46:22.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.572+0000 7fe163043640 1 -- 10.20.193.58:0/1664208481 >> 10.20.193.58:0/1664208481 conn(0x7fe15c0b3c20 msgr2=0x7fe15c0b40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:22.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.572+0000 7fe163043640 1 -- 10.20.193.58:0/1664208481 shutdown_connections 2026-02-23T06:46:22.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.572+0000 7fe163043640 1 -- 10.20.193.58:0/1664208481 wait complete. 2026-02-23T06:46:22.588 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:46:22.588 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:46:22.589 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:46:22.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.714+0000 7f1097fff640 1 -- 10.20.193.58:0/3112443435 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f109815d4a0 msgr2=0x7f10980affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.714+0000 7f1097fff640 1 --2- 10.20.193.58:0/3112443435 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f109815d4a0 0x7f10980affb0 secure :-1 s=READY pgs=102 gs=3 cs=0 l=1 c_cookie=524865805413871501 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f108c004740 tx=0x7f108c02f220 comp rx=0 tx=0).stop 2026-02-23T06:46:22.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.715+0000 7f1097fff640 1 -- 10.20.193.58:0/3112443435 shutdown_connections 2026-02-23T06:46:22.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.715+0000 7f1097fff640 1 --2- 10.20.193.58:0/3112443435 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f109815d4a0 0x7f10980affb0 unknown :-1 s=CLOSED pgs=102 gs=3 cs=0 l=1 c_cookie=524865805413871501 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.715+0000 7f1097fff640 1 -- 10.20.193.58:0/3112443435 >> 10.20.193.58:0/3112443435 conn(0x7f10980b3c20 msgr2=0x7f10980b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:22.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.715+0000 7f1097fff640 1 -- 10.20.193.58:0/3112443435 shutdown_connections 2026-02-23T06:46:22.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.715+0000 7f1097fff640 1 -- 10.20.193.58:0/3112443435 wait complete. 2026-02-23T06:46:22.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.716+0000 7f1097fff640 1 Processor -- start 2026-02-23T06:46:22.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.716+0000 7f1097fff640 1 -- start start 2026-02-23T06:46:22.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.716+0000 7f1097fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f10980b6690 0x7f109813a4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:22.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.716+0000 7f1097fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f109815d4a0 0x7f109811e170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:22.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.716+0000 7f1097fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f109815d870 0x7f1098147a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:22.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.716+0000 7f1097fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f109813e6d0 con 0x7f109815d4a0 2026-02-23T06:46:22.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.716+0000 7f1097fff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f109813b190 con 0x7f109815d870 2026-02-23T06:46:22.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.716+0000 7f1097fff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f1098140020 con 0x7f10980b6690 2026-02-23T06:46:22.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.717+0000 7f10967fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f109815d4a0 0x7f109811e170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:22.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.717+0000 7f10967fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f109815d4a0 0x7f109811e170 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:36962/0 (socket says 10.20.193.58:36962) 2026-02-23T06:46:22.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.717+0000 7f10967fc640 1 -- 10.20.193.58:0/2684730363 learned_addr learned my addr 10.20.193.58:0/2684730363 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:46:22.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.717+0000 7f1096ffd640 1 --2- 10.20.193.58:0/2684730363 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f10980b6690 0x7f109813a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:22.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.717+0000 7f10977fe640 1 --2- 10.20.193.58:0/2684730363 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f109815d870 0x7f1098147a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:22.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.717+0000 7f10967fc640 1 -- 10.20.193.58:0/2684730363 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f10980b6690 msgr2=0x7f109813a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.717+0000 7f10967fc640 1 --2- 10.20.193.58:0/2684730363 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f10980b6690 0x7f109813a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.717+0000 7f10967fc640 1 -- 10.20.193.58:0/2684730363 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f109815d870 msgr2=0x7f1098147a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.717+0000 7f10967fc640 1 --2- 10.20.193.58:0/2684730363 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f109815d870 0x7f1098147a70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.717+0000 7f10967fc640 1 -- 10.20.193.58:0/2684730363 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f108c0094b0 con 0x7f109815d4a0 2026-02-23T06:46:22.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.717+0000 7f10967fc640 1 --2- 10.20.193.58:0/2684730363 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f109815d4a0 0x7f109811e170 secure :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1080007fd0 tx=0x7f108000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:22.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.717+0000 7f10777fe640 1 -- 10.20.193.58:0/2684730363 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f10800054a0 con 0x7f109815d4a0 2026-02-23T06:46:22.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.717+0000 7f10777fe640 1 -- 10.20.193.58:0/2684730363 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10800036b0 con 0x7f109815d4a0 2026-02-23T06:46:22.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.717+0000 7f10777fe640 1 -- 10.20.193.58:0/2684730363 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1080003ac0 con 0x7f109815d4a0 2026-02-23T06:46:22.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.717+0000 7f1097fff640 1 -- 10.20.193.58:0/2684730363 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f109813d950 con 0x7f109815d4a0 2026-02-23T06:46:22.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.717+0000 7f1097fff640 1 -- 10.20.193.58:0/2684730363 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f109813aeb0 con 0x7f109815d4a0 2026-02-23T06:46:22.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.718+0000 7f1097fff640 1 --2- 10.20.193.58:0/2684730363 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1098139a60 0x7f109813d160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:22.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.718+0000 7f1097fff640 1 -- 10.20.193.58:0/2684730363 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f1098139e30 con 0x7f1098139a60 2026-02-23T06:46:22.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.718+0000 7f1096ffd640 1 --2- 10.20.193.58:0/2684730363 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1098139a60 0x7f109813d160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:22.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.718+0000 7f1096ffd640 1 -- 10.20.193.58:0/2684730363 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1098164250 con 0x7f1098139a60 2026-02-23T06:46:22.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.719+0000 7f1096ffd640 1 --2- 10.20.193.58:0/2684730363 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1098139a60 0x7f109813d160 secure :-1 s=READY pgs=8 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f108c004740 tx=0x7f108c0028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:22.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.719+0000 7f10777fe640 1 -- 10.20.193.58:0/2684730363 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f108c046070 con 0x7f1098139a60 2026-02-23T06:46:22.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.719+0000 7f10777fe640 1 -- 10.20.193.58:0/2684730363 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f1080003c20 con 0x7f109815d4a0 2026-02-23T06:46:22.717 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.720+0000 7f10777fe640 1 --2- 10.20.193.58:0/2684730363 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f106407a660 0x7f106409ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:22.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.720+0000 7f10777fe640 1 -- 10.20.193.58:0/2684730363 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f108009c8f0 con 0x7f109815d4a0 2026-02-23T06:46:22.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.720+0000 7f10777fe640 1 -- 10.20.193.58:0/2684730363 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f108c03e040 con 0x7f1098139a60 2026-02-23T06:46:22.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.720+0000 7f10777fe640 1 -- 10.20.193.58:0/2684730363 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1098139a60 msgr2=0x7f109813d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.720+0000 7f10777fe640 1 --2- 10.20.193.58:0/2684730363 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1098139a60 0x7f109813d160 secure :-1 s=READY pgs=8 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f108c004740 tx=0x7f108c0028d0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.720+0000 7f10777fe640 1 -- 10.20.193.58:0/2684730363 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1098139a60 msgr2=0x7f109813d160 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:46:22.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.720+0000 7f10777fe640 1 --2- 10.20.193.58:0/2684730363 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1098139a60 0x7f109813d160 unknown :-1 s=CLOSED pgs=8 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.720+0000 7f10977fe640 1 --2- 10.20.193.58:0/2684730363 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f106407a660 0x7f106409ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:22.718 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.721+0000 7f10977fe640 1 --2- 10.20.193.58:0/2684730363 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f106407a660 0x7f106409ab10 secure :-1 s=READY pgs=523 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10880038b0 tx=0x7f108800a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:22.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.724+0000 7f1097fff640 1 --2- 10.20.193.58:0/2684730363 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f109812a280 0x7f109812a680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:22.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.724+0000 7f1097fff640 1 -- 10.20.193.58:0/2684730363 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f109805b0e0 con 0x7f109812a280 2026-02-23T06:46:22.719 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.724+0000 7f1096ffd640 1 --2- 10.20.193.58:0/2684730363 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f109812a280 0x7f109812a680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:22.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.724+0000 7f1096ffd640 1 -- 10.20.193.58:0/2684730363 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f10980b7260 con 0x7f109812a280 2026-02-23T06:46:22.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.725+0000 7f1096ffd640 1 --2- 10.20.193.58:0/2684730363 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f109812a280 0x7f109812a680 secure :-1 s=READY pgs=9 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f108c02ff60 tx=0x7f108c005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:22.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.725+0000 7f10777fe640 1 -- 10.20.193.58:0/2684730363 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f108c0536a0 con 0x7f109812a280 2026-02-23T06:46:22.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.725+0000 7f10777fe640 1 -- 10.20.193.58:0/2684730363 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4911 (secure 0 0 0) 0x7f108c04e070 con 0x7f109812a280 2026-02-23T06:46:22.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.725+0000 7f10777fe640 1 -- 10.20.193.58:0/2684730363 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f109812a280 msgr2=0x7f109812a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.725+0000 7f10777fe640 1 --2- 10.20.193.58:0/2684730363 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f109812a280 0x7f109812a680 secure :-1 s=READY pgs=9 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f108c02ff60 tx=0x7f108c005f90 comp rx=0 tx=0).stop 2026-02-23T06:46:22.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.725+0000 7f10777fe640 1 -- 10.20.193.58:0/2684730363 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f109812a280 msgr2=0x7f109812a680 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:46:22.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.725+0000 7f10777fe640 1 --2- 10.20.193.58:0/2684730363 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f109812a280 0x7f109812a680 unknown :-1 s=CLOSED pgs=9 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.721 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:46:22.721 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:46:22.721 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:46:22.721 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:46:22.722 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 222, 2026-02-23T06:46:22.722 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 15677, 2026-02-23T06:46:22.722 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:46:22.722 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:46:22.722 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:46:22.722 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:46:22.722 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:22.722 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:46:22.722 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:46:22.722 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:46:22.722 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:46:22.723 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:46:22.723 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:46:22.723 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:46:22.723 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:46:22.723 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:46:22.723 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:46:22.723 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:46:22.723 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:46:22.723 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:46:22.723 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:46:22.723 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:46:22.723 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:46:22.723 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:46:22.724 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:22.724 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:46:22.724 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:46:22.724 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:46:22.724 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:46:22.724 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:46:22.724 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:46:22.724 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:46:22.724 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:46:22.724 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:46:22.724 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:46:22.725 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:46:22.725 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:46:22.725 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:46:22.725 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:46:22.725 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:46:22.725 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:22.725 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.725 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:46:22.725 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:46:22.725 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:46:22.725 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:46:22.725 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:46:22.726 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:46:22.726 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:46:22.726 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:46:22.726 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:46:22.726 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:46:22.726 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:46:22.726 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:46:22.726 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:46:22.726 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:46:22.726 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:46:22.726 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:46:22.726 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:46:22.727 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:46:22.727 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:46:22.727 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:46:22.727 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:46:22.727 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:46:22.727 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:46:22.727 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:46:22.727 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:46:22.727 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:46:22.727 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:46:22.727 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:46:22.727 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:46:22.728 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:46:22.728 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:22.728 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:46:22.728 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.728 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:46:22.728 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.728 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:46:22.728 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:46:22.728 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:46:22.728 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:46:22.728 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.728 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:46:22.728 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:46:22.729 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:22.729 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.729 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.729 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:46:22.729 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:46:22.729 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:22.729 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:22.729 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:22.729 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.729 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:46:22.729 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:46:22.729 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:46:22.730 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:46:22.730 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:46:22.730 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:46:22.730 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.730 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.730 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:46:22.730 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:46:22.730 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:46:22.730 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:46:22.730 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.730 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:46:22.730 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:46:22.731 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:22.731 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.731 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.731 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:46:22.731 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:46:22.731 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:22.731 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:22.731 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:22.731 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.731 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:46:22.731 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:46:22.731 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:46:22.732 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:46:22.732 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:46:22.732 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:46:22.732 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.732 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.732 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:46:22.732 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:46:22.732 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:46:22.732 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:46:22.732 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.732 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:46:22.732 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:46:22.732 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:22.733 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.733 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.733 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:46:22.733 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:46:22.733 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:22.733 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:22.733 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:22.733 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.733 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:46:22.733 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:46:22.733 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:46:22.733 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:46:22.733 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:46:22.734 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:46:22.734 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:22.734 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:22.734 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.734 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:46:22.734 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:46:22.734 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.734 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:22.734 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:22.734 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:46:22.734 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:22.734 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:22.734 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:46:22.735 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:22.735 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:22.735 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:22.735 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:46:22.735 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:22.735 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:22.735 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:22.735 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:46:22.735 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:46:22.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.725+0000 7f1097fff640 1 -- 10.20.193.58:0/2684730363 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f106407a660 msgr2=0x7f106409ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.725+0000 7f1097fff640 1 --2- 10.20.193.58:0/2684730363 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f106407a660 0x7f106409ab10 secure :-1 s=READY pgs=523 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10880038b0 tx=0x7f108800a040 comp rx=0 tx=0).stop 2026-02-23T06:46:22.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.725+0000 7f1097fff640 1 -- 10.20.193.58:0/2684730363 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f109815d4a0 msgr2=0x7f109811e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.725+0000 7f1097fff640 1 --2- 10.20.193.58:0/2684730363 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f109815d4a0 0x7f109811e170 secure :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1080007fd0 tx=0x7f108000c950 comp rx=0 tx=0).stop 2026-02-23T06:46:22.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.725+0000 7f10977fe640 1 -- 10.20.193.58:0/2684730363 reap_dead start 2026-02-23T06:46:22.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.725+0000 7f10977fe640 1 -- 10.20.193.58:0/2684730363 reap_dead start 2026-02-23T06:46:22.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.725+0000 7f1097fff640 1 -- 10.20.193.58:0/2684730363 shutdown_connections 2026-02-23T06:46:22.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.725+0000 7f1097fff640 1 -- 10.20.193.58:0/2684730363 >> 10.20.193.58:0/2684730363 conn(0x7f10980b3c20 msgr2=0x7f10980b0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:22.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.725+0000 7f1097fff640 1 -- 10.20.193.58:0/2684730363 shutdown_connections 2026-02-23T06:46:22.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.726+0000 7f1097fff640 1 -- 10.20.193.58:0/2684730363 wait complete. 2026-02-23T06:46:22.738 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:46:22.738 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:46:22.739 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:46:22.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.863+0000 7f027ae43640 1 -- 10.20.193.58:0/2730994692 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f027415d870 msgr2=0x7f02740587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.863+0000 7f027ae43640 1 --2- 10.20.193.58:0/2730994692 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f027415d870 0x7f02740587b0 secure :-1 s=READY pgs=105 gs=3 cs=0 l=1 c_cookie=5029781844404918674 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0268005e70 tx=0x7f026802f290 comp rx=0 tx=0).stop 2026-02-23T06:46:22.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.864+0000 7f027ae43640 1 -- 10.20.193.58:0/2730994692 shutdown_connections 2026-02-23T06:46:22.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.864+0000 7f027ae43640 1 --2- 10.20.193.58:0/2730994692 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f027415d870 0x7f02740587b0 unknown :-1 s=CLOSED pgs=105 gs=3 cs=0 l=1 c_cookie=5029781844404918674 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.864+0000 7f027ae43640 1 --2- 10.20.193.58:0/2730994692 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f027415d4a0 0x7f02740affb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.859 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.864+0000 7f027ae43640 1 -- 10.20.193.58:0/2730994692 >> 10.20.193.58:0/2730994692 conn(0x7f02740b3c20 msgr2=0x7f02740b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:22.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.864+0000 7f027ae43640 1 -- 10.20.193.58:0/2730994692 shutdown_connections 2026-02-23T06:46:22.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.864+0000 7f027ae43640 1 -- 10.20.193.58:0/2730994692 wait complete. 2026-02-23T06:46:22.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.865+0000 7f027ae43640 1 Processor -- start 2026-02-23T06:46:22.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.865+0000 7f027ae43640 1 -- start start 2026-02-23T06:46:22.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.865+0000 7f027ae43640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f02740b6690 0x7f0274128c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:22.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.865+0000 7f027ae43640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f027415d4a0 0x7f027414d640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:22.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.865+0000 7f027ae43640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f027415d870 0x7f027414db80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:22.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.865+0000 7f027ae43640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f0274056680 con 0x7f027415d870 2026-02-23T06:46:22.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.865+0000 7f027ae43640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f02741404e0 con 0x7f02740b6690 2026-02-23T06:46:22.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.865+0000 7f027ae43640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f027414d140 con 0x7f027415d4a0 2026-02-23T06:46:22.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.865+0000 7f0279e41640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f02740b6690 0x7f0274128c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:22.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.865+0000 7f027a642640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f027415d870 0x7f027414db80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:22.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.865+0000 7f0279e41640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f02740b6690 0x7f0274128c40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:36942/0 (socket says 10.20.193.58:36942) 2026-02-23T06:46:22.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.865+0000 7f0279e41640 1 -- 10.20.193.58:0/672310581 learned_addr learned my addr 10.20.193.58:0/672310581 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:46:22.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.866+0000 7f0279640640 1 --2- 10.20.193.58:0/672310581 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f027415d4a0 0x7f027414d640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:22.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.866+0000 7f027a642640 1 -- 10.20.193.58:0/672310581 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f027415d4a0 msgr2=0x7f027414d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.866+0000 7f027a642640 1 --2- 10.20.193.58:0/672310581 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f027415d4a0 0x7f027414d640 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.866+0000 7f027a642640 1 -- 10.20.193.58:0/672310581 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f02740b6690 msgr2=0x7f0274128c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:22.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.866+0000 7f027a642640 1 --2- 10.20.193.58:0/672310581 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f02740b6690 0x7f0274128c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:22.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.866+0000 7f027a642640 1 -- 10.20.193.58:0/672310581 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02640094b0 con 0x7f027415d870 2026-02-23T06:46:22.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.866+0000 7f027a642640 1 --2- 10.20.193.58:0/672310581 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f027415d870 0x7f027414db80 secure :-1 s=READY pgs=106 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0270003810 tx=0x7f027000d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:22.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.866+0000 7f02627fc640 1 -- 10.20.193.58:0/672310581 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f02700064a0 con 0x7f027415d870 2026-02-23T06:46:22.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.866+0000 7f02627fc640 1 -- 10.20.193.58:0/672310581 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0270006600 con 0x7f027415d870 2026-02-23T06:46:22.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.866+0000 7f02627fc640 1 -- 10.20.193.58:0/672310581 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0270004a10 con 0x7f027415d870 2026-02-23T06:46:22.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.866+0000 7f027ae43640 1 -- 10.20.193.58:0/672310581 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0268009570 con 0x7f027415d870 2026-02-23T06:46:22.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.866+0000 7f027ae43640 1 -- 10.20.193.58:0/672310581 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0274140730 con 0x7f027415d870 2026-02-23T06:46:22.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.867+0000 7f027ae43640 1 -- 10.20.193.58:0/672310581 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02740b6d50 con 0x7f027415d870 2026-02-23T06:46:22.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.868+0000 7f02627fc640 1 -- 10.20.193.58:0/672310581 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f027001a020 con 0x7f027415d870 2026-02-23T06:46:22.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.869+0000 7f02627fc640 1 --2- 10.20.193.58:0/672310581 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f024407a6c0 0x7f024409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:22.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.869+0000 7f02627fc640 1 -- 10.20.193.58:0/672310581 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f027009de10 con 0x7f027415d870 2026-02-23T06:46:22.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.869+0000 7f0279e41640 1 --2- 10.20.193.58:0/672310581 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f024407a6c0 0x7f024409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:22.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.870+0000 7f0279e41640 1 --2- 10.20.193.58:0/672310581 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f024407a6c0 0x7f024409ab70 secure :-1 s=READY pgs=524 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0264005c70 tx=0x7f0264005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:22.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:22.870+0000 7f02627fc640 1 -- 10.20.193.58:0/672310581 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f0270060f20 con 0x7f027415d870 2026-02-23T06:46:23.019 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:23.024+0000 7f027ae43640 1 -- 10.20.193.58:0/672310581 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f027414d300 con 0x7f027415d870 2026-02-23T06:46:23.020 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:23.025+0000 7f02627fc640 1 -- 10.20.193.58:0/672310581 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f0270064040 con 0x7f027415d870 2026-02-23T06:46:23.021 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:23.026+0000 7f027ae43640 1 -- 10.20.193.58:0/672310581 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f024407a6c0 msgr2=0x7f024409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:23.021 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:23.026+0000 7f027ae43640 1 --2- 10.20.193.58:0/672310581 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f024407a6c0 0x7f024409ab70 secure :-1 s=READY pgs=524 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0264005c70 tx=0x7f0264005f90 comp rx=0 tx=0).stop 2026-02-23T06:46:23.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:23.026+0000 7f027ae43640 1 -- 10.20.193.58:0/672310581 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f027415d870 msgr2=0x7f027414db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:23.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:23.026+0000 7f027ae43640 1 --2- 10.20.193.58:0/672310581 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f027415d870 0x7f027414db80 secure :-1 s=READY pgs=106 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0270003810 tx=0x7f027000d8f0 comp rx=0 tx=0).stop 2026-02-23T06:46:23.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:23.026+0000 7f027ae43640 1 -- 10.20.193.58:0/672310581 shutdown_connections 2026-02-23T06:46:23.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:23.026+0000 7f027ae43640 1 --2- 10.20.193.58:0/672310581 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f024407a6c0 0x7f024409ab70 unknown :-1 s=CLOSED pgs=524 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:23.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:23.026+0000 7f027ae43640 1 --2- 10.20.193.58:0/672310581 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f027415d870 0x7f027414db80 unknown :-1 s=CLOSED pgs=106 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:23.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:23.026+0000 7f027ae43640 1 --2- 10.20.193.58:0/672310581 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f027415d4a0 0x7f027414d640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:23.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:23.026+0000 7f027ae43640 1 --2- 10.20.193.58:0/672310581 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f02740b6690 0x7f0274128c40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:23.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:23.026+0000 7f027ae43640 1 -- 10.20.193.58:0/672310581 >> 10.20.193.58:0/672310581 conn(0x7f02740b3c20 msgr2=0x7f027415c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:23.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:23.026+0000 7f027ae43640 1 -- 10.20.193.58:0/672310581 shutdown_connections 2026-02-23T06:46:23.022 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:23.026+0000 7f027ae43640 1 -- 10.20.193.58:0/672310581 wait complete. 2026-02-23T06:46:23.033 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:46:33.034 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:46:33.035 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:46:33.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.162+0000 7f9b95c2f640 1 -- 10.20.193.58:0/3108041781 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b9015d870 msgr2=0x7f9b900587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:33.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.162+0000 7f9b95c2f640 1 --2- 10.20.193.58:0/3108041781 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b9015d870 0x7f9b900587b0 secure :-1 s=READY pgs=108 gs=2 cs=0 l=1 c_cookie=16293864185630690155 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b78004740 tx=0x7f9b7802f1d0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.163+0000 7f9b95c2f640 1 -- 10.20.193.58:0/3108041781 shutdown_connections 2026-02-23T06:46:33.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.163+0000 7f9b95c2f640 1 --2- 10.20.193.58:0/3108041781 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b9015d870 0x7f9b900587b0 unknown :-1 s=CLOSED pgs=108 gs=2 cs=0 l=1 c_cookie=16293864185630690155 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.163+0000 7f9b95c2f640 1 --2- 10.20.193.58:0/3108041781 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9b9015d4a0 0x7f9b900affb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.163+0000 7f9b95c2f640 1 -- 10.20.193.58:0/3108041781 >> 10.20.193.58:0/3108041781 conn(0x7f9b900b3c20 msgr2=0x7f9b900b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:33.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.163+0000 7f9b95c2f640 1 -- 10.20.193.58:0/3108041781 shutdown_connections 2026-02-23T06:46:33.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.163+0000 7f9b95c2f640 1 -- 10.20.193.58:0/3108041781 wait complete. 2026-02-23T06:46:33.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.164+0000 7f9b95c2f640 1 Processor -- start 2026-02-23T06:46:33.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.164+0000 7f9b95c2f640 1 -- start start 2026-02-23T06:46:33.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.164+0000 7f9b95c2f640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9b900b6690 0x7f9b9011ef80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:33.161 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.164+0000 7f9b95c2f640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b9015d4a0 0x7f9b9011d0d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:33.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.164+0000 7f9b95c2f640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b9015d870 0x7f9b9013af20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:33.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.164+0000 7f9b95c2f640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f9b90056770 con 0x7f9b9015d4a0 2026-02-23T06:46:33.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.164+0000 7f9b95c2f640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9b9011f4c0 con 0x7f9b9015d870 2026-02-23T06:46:33.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.164+0000 7f9b95c2f640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f9b9013c7e0 con 0x7f9b900b6690 2026-02-23T06:46:33.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.165+0000 7f9b94c2d640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9b900b6690 0x7f9b9011ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:33.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.165+0000 7f9b87fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b9015d4a0 0x7f9b9011d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:33.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.165+0000 7f9b94c2d640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9b900b6690 0x7f9b9011ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:38738/0 (socket says 10.20.193.58:38738) 2026-02-23T06:46:33.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.165+0000 7f9b94c2d640 1 -- 10.20.193.58:0/35371982 learned_addr learned my addr 10.20.193.58:0/35371982 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:46:33.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.165+0000 7f9b9542e640 1 --2- 10.20.193.58:0/35371982 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b9015d870 0x7f9b9013af20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:33.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.165+0000 7f9b87fff640 1 -- 10.20.193.58:0/35371982 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9b900b6690 msgr2=0x7f9b9011ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:33.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.165+0000 7f9b87fff640 1 --2- 10.20.193.58:0/35371982 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9b900b6690 0x7f9b9011ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.165+0000 7f9b87fff640 1 -- 10.20.193.58:0/35371982 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b9015d870 msgr2=0x7f9b9013af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:33.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.165+0000 7f9b87fff640 1 --2- 10.20.193.58:0/35371982 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b9015d870 0x7f9b9013af20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.165+0000 7f9b87fff640 1 -- 10.20.193.58:0/35371982 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b780094b0 con 0x7f9b9015d4a0 2026-02-23T06:46:33.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.165+0000 7f9b87fff640 1 --2- 10.20.193.58:0/35371982 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b9015d4a0 0x7f9b9011d0d0 secure :-1 s=READY pgs=109 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b78004740 tx=0x7f9b78002950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:33.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.165+0000 7f9b857fa640 1 -- 10.20.193.58:0/35371982 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9b78038690 con 0x7f9b9015d4a0 2026-02-23T06:46:33.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.165+0000 7f9b857fa640 1 -- 10.20.193.58:0/35371982 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b780388e0 con 0x7f9b9015d4a0 2026-02-23T06:46:33.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.165+0000 7f9b857fa640 1 -- 10.20.193.58:0/35371982 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9b78038cd0 con 0x7f9b9015d4a0 2026-02-23T06:46:33.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.165+0000 7f9b95c2f640 1 -- 10.20.193.58:0/35371982 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b9013cac0 con 0x7f9b9015d4a0 2026-02-23T06:46:33.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.165+0000 7f9b95c2f640 1 -- 10.20.193.58:0/35371982 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b90121230 con 0x7f9b9015d4a0 2026-02-23T06:46:33.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.166+0000 7f9b95c2f640 1 -- 10.20.193.58:0/35371982 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b900b6d50 con 0x7f9b9015d4a0 2026-02-23T06:46:33.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.167+0000 7f9b857fa640 1 -- 10.20.193.58:0/35371982 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f9b78040420 con 0x7f9b9015d4a0 2026-02-23T06:46:33.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.168+0000 7f9b857fa640 1 --2- 10.20.193.58:0/35371982 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9b6007a6c0 0x7f9b6009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:33.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.168+0000 7f9b857fa640 1 -- 10.20.193.58:0/35371982 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f9b780c3b70 con 0x7f9b9015d4a0 2026-02-23T06:46:33.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.168+0000 7f9b94c2d640 1 --2- 10.20.193.58:0/35371982 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9b6007a6c0 0x7f9b6009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:33.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.169+0000 7f9b857fa640 1 -- 10.20.193.58:0/35371982 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f9b78086d00 con 0x7f9b9015d4a0 2026-02-23T06:46:33.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.169+0000 7f9b94c2d640 1 --2- 10.20.193.58:0/35371982 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9b6007a6c0 0x7f9b6009ab70 secure :-1 s=READY pgs=525 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b800097c0 tx=0x7f9b80009310 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:33.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.323+0000 7f9b95c2f640 1 -- 10.20.193.58:0/35371982 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9b9005dd10 con 0x7f9b9015d4a0 2026-02-23T06:46:33.319 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.324+0000 7f9b857fa640 1 -- 10.20.193.58:0/35371982 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f9b78005b60 con 0x7f9b9015d4a0 2026-02-23T06:46:33.320 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":222,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:46:33.321 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.325+0000 7f9b95c2f640 1 -- 10.20.193.58:0/35371982 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9b6007a6c0 msgr2=0x7f9b6009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:33.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.325+0000 7f9b95c2f640 1 --2- 10.20.193.58:0/35371982 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9b6007a6c0 0x7f9b6009ab70 secure :-1 s=READY pgs=525 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b800097c0 tx=0x7f9b80009310 comp rx=0 tx=0).stop 2026-02-23T06:46:33.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.325+0000 7f9b95c2f640 1 -- 10.20.193.58:0/35371982 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b9015d4a0 msgr2=0x7f9b9011d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:33.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.325+0000 7f9b95c2f640 1 --2- 10.20.193.58:0/35371982 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b9015d4a0 0x7f9b9011d0d0 secure :-1 s=READY pgs=109 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b78004740 tx=0x7f9b78002950 comp rx=0 tx=0).stop 2026-02-23T06:46:33.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.325+0000 7f9b95c2f640 1 -- 10.20.193.58:0/35371982 shutdown_connections 2026-02-23T06:46:33.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.325+0000 7f9b95c2f640 1 --2- 10.20.193.58:0/35371982 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9b6007a6c0 0x7f9b6009ab70 unknown :-1 s=CLOSED pgs=525 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.325+0000 7f9b95c2f640 1 --2- 10.20.193.58:0/35371982 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b9015d870 0x7f9b9013af20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.322 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.325+0000 7f9b95c2f640 1 --2- 10.20.193.58:0/35371982 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b9015d4a0 0x7f9b9011d0d0 unknown :-1 s=CLOSED pgs=109 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.325+0000 7f9b95c2f640 1 --2- 10.20.193.58:0/35371982 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9b900b6690 0x7f9b9011ef80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.325+0000 7f9b95c2f640 1 -- 10.20.193.58:0/35371982 >> 10.20.193.58:0/35371982 conn(0x7f9b900b3c20 msgr2=0x7f9b900b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:33.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.325+0000 7f9b95c2f640 1 -- 10.20.193.58:0/35371982 shutdown_connections 2026-02-23T06:46:33.323 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.325+0000 7f9b95c2f640 1 -- 10.20.193.58:0/35371982 wait complete. 2026-02-23T06:46:33.333 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:46:33.333 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:46:33.333 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:46:33.333 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:46:33.456 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.460+0000 7fb7ad683640 1 -- 10.20.193.58:0/2387876 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb78c003c60 msgr2=0x7fb78c004050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:33.456 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.460+0000 7fb7ad683640 1 --2- 10.20.193.58:0/2387876 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb78c003c60 0x7fb78c004050 secure :-1 s=READY pgs=111 gs=4 cs=0 l=1 c_cookie=11470948770640467114 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb79400c260 tx=0x7fb79402f930 comp rx=0 tx=0).stop 2026-02-23T06:46:33.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.460+0000 7fb7ace82640 1 -- 10.20.193.58:0/2387876 reap_dead start 2026-02-23T06:46:33.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.460+0000 7fb7ad683640 1 -- 10.20.193.58:0/2387876 shutdown_connections 2026-02-23T06:46:33.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.460+0000 7fb7ad683640 1 -- 10.20.193.58:0/2387876 >> 10.20.193.58:0/2387876 conn(0x7fb7a80b3c20 msgr2=0x7fb7a80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:33.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.460+0000 7fb7ad683640 1 -- 10.20.193.58:0/2387876 shutdown_connections 2026-02-23T06:46:33.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.460+0000 7fb7ad683640 1 -- 10.20.193.58:0/2387876 wait complete. 2026-02-23T06:46:33.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.461+0000 7fb7ad683640 1 Processor -- start 2026-02-23T06:46:33.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.461+0000 7fb7ad683640 1 -- start start 2026-02-23T06:46:33.462 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.462+0000 7fb7ad683640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb78c003c60 0x7fb7a8153710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:33.462 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.462+0000 7fb7ad683640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb7a8163bd0 0x7fb7a8151810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:33.462 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.462+0000 7fb7ad683640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7a80ae4f0 0x7fb7a8157130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:33.462 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.462+0000 7fb7ad683640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a8155430 con 0x7fb7a80ae4f0 2026-02-23T06:46:33.462 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.462+0000 7fb7ad683640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a8155a80 con 0x7fb7a8163bd0 2026-02-23T06:46:33.462 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.462+0000 7fb7ad683640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb7a8151d50 con 0x7fb78c003c60 2026-02-23T06:46:33.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.462+0000 7fb7ace82640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7a80ae4f0 0x7fb7a8157130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:33.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.462+0000 7fb7ace82640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7a80ae4f0 0x7fb7a8157130 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:58612/0 (socket says 10.20.193.58:58612) 2026-02-23T06:46:33.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.462+0000 7fb7ace82640 1 -- 10.20.193.58:0/2129171198 learned_addr learned my addr 10.20.193.58:0/2129171198 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:46:33.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.462+0000 7fb7a7fff640 1 --2- 10.20.193.58:0/2129171198 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb78c003c60 0x7fb7a8153710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:33.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.462+0000 7fb7a77fe640 1 --2- 10.20.193.58:0/2129171198 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb7a8163bd0 0x7fb7a8151810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:33.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.462+0000 7fb7ace82640 1 -- 10.20.193.58:0/2129171198 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb78c003c60 msgr2=0x7fb7a8153710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:33.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.462+0000 7fb7ace82640 1 --2- 10.20.193.58:0/2129171198 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb78c003c60 0x7fb7a8153710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.462+0000 7fb7ace82640 1 -- 10.20.193.58:0/2129171198 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb7a8163bd0 msgr2=0x7fb7a8151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:33.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.462+0000 7fb7ace82640 1 --2- 10.20.193.58:0/2129171198 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb7a8163bd0 0x7fb7a8151810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.462+0000 7fb7ace82640 1 -- 10.20.193.58:0/2129171198 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a80ae210 con 0x7fb7a80ae4f0 2026-02-23T06:46:33.463 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.463+0000 7fb7ace82640 1 --2- 10.20.193.58:0/2129171198 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7a80ae4f0 0x7fb7a8157130 secure :-1 s=READY pgs=112 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb79c003860 tx=0x7fb79c00e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:33.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.463+0000 7fb7a4ff9640 1 -- 10.20.193.58:0/2129171198 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb79c011670 con 0x7fb7a80ae4f0 2026-02-23T06:46:33.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.463+0000 7fb7a4ff9640 1 -- 10.20.193.58:0/2129171198 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb79c011900 con 0x7fb7a80ae4f0 2026-02-23T06:46:33.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.463+0000 7fb7a4ff9640 1 -- 10.20.193.58:0/2129171198 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb79c011d30 con 0x7fb7a80ae4f0 2026-02-23T06:46:33.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.463+0000 7fb7ad683640 1 -- 10.20.193.58:0/2129171198 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7a80b10a0 con 0x7fb7a80ae4f0 2026-02-23T06:46:33.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.463+0000 7fb7ad683640 1 -- 10.20.193.58:0/2129171198 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7a8155cd0 con 0x7fb7a80ae4f0 2026-02-23T06:46:33.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.463+0000 7fb7ad683640 1 --2- 10.20.193.58:0/2129171198 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7a8157670 0x7fb7a8152ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:33.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.463+0000 7fb7ad683640 1 -- 10.20.193.58:0/2129171198 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a80b1290 con 0x7fb7a8157670 2026-02-23T06:46:33.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.464+0000 7fb7a7fff640 1 --2- 10.20.193.58:0/2129171198 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7a8157670 0x7fb7a8152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:33.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.464+0000 7fb7a7fff640 1 -- 10.20.193.58:0/2129171198 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb7a805d9c0 con 0x7fb7a8157670 2026-02-23T06:46:33.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.464+0000 7fb7a7fff640 1 --2- 10.20.193.58:0/2129171198 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7a8157670 0x7fb7a8152ee0 secure :-1 s=READY pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb794002b30 tx=0x7fb794006770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:33.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.464+0000 7fb7a4ff9640 1 -- 10.20.193.58:0/2129171198 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb794002e70 con 0x7fb7a8157670 2026-02-23T06:46:33.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.464+0000 7fb7a4ff9640 1 -- 10.20.193.58:0/2129171198 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fb7940456a0 con 0x7fb7a8157670 2026-02-23T06:46:33.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.464+0000 7fb7a4ff9640 1 -- 10.20.193.58:0/2129171198 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7a8157670 msgr2=0x7fb7a8152ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:33.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.464+0000 7fb7a4ff9640 1 --2- 10.20.193.58:0/2129171198 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7a8157670 0x7fb7a8152ee0 secure :-1 s=READY pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb794002b30 tx=0x7fb794006770 comp rx=0 tx=0).stop 2026-02-23T06:46:33.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.464+0000 7fb7a4ff9640 1 -- 10.20.193.58:0/2129171198 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7a8157670 msgr2=0x7fb7a8152ee0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:46:33.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.464+0000 7fb7a4ff9640 1 --2- 10.20.193.58:0/2129171198 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7a8157670 0x7fb7a8152ee0 unknown :-1 s=CLOSED pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.465+0000 7fb7a4ff9640 1 -- 10.20.193.58:0/2129171198 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fb79c01d460 con 0x7fb7a80ae4f0 2026-02-23T06:46:33.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.466+0000 7fb7a4ff9640 1 --2- 10.20.193.58:0/2129171198 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb77807a3c0 0x7fb77809a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:33.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.466+0000 7fb7a4ff9640 1 -- 10.20.193.58:0/2129171198 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fb79c09e280 con 0x7fb7a80ae4f0 2026-02-23T06:46:33.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.466+0000 7fb7a7fff640 1 --2- 10.20.193.58:0/2129171198 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb77807a3c0 0x7fb77809a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:33.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.466+0000 7fb7a7fff640 1 --2- 10.20.193.58:0/2129171198 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb77807a3c0 0x7fb77809a870 secure :-1 s=READY pgs=526 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb794002b30 tx=0x7fb79403b000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:33.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.468+0000 7fb7ad683640 1 --2- 10.20.193.58:0/2129171198 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7a80afde0 0x7fb7a80b01b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:33.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.468+0000 7fb7ad683640 1 -- 10.20.193.58:0/2129171198 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a80b5d90 con 0x7fb7a80afde0 2026-02-23T06:46:33.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.468+0000 7fb7a77fe640 1 --2- 10.20.193.58:0/2129171198 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7a80afde0 0x7fb7a80b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:33.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.468+0000 7fb7a77fe640 1 -- 10.20.193.58:0/2129171198 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb7a8157a40 con 0x7fb7a80afde0 2026-02-23T06:46:33.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.469+0000 7fb7a77fe640 1 --2- 10.20.193.58:0/2129171198 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7a80afde0 0x7fb7a80b01b0 secure :-1 s=READY pgs=114 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7a81644b0 tx=0x7fb798002a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:33.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.469+0000 7fb7a4ff9640 1 -- 10.20.193.58:0/2129171198 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb798016070 con 0x7fb7a80afde0 2026-02-23T06:46:33.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.469+0000 7fb7a4ff9640 1 -- 10.20.193.58:0/2129171198 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5416 (secure 0 0 0) 0x7fb798011b80 con 0x7fb7a80afde0 2026-02-23T06:46:33.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.469+0000 7fb7a4ff9640 1 -- 10.20.193.58:0/2129171198 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7a80afde0 msgr2=0x7fb7a80b01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:33.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.469+0000 7fb7a4ff9640 1 --2- 10.20.193.58:0/2129171198 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7a80afde0 0x7fb7a80b01b0 secure :-1 s=READY pgs=114 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7a81644b0 tx=0x7fb798002a70 comp rx=0 tx=0).stop 2026-02-23T06:46:33.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.469+0000 7fb7a4ff9640 1 -- 10.20.193.58:0/2129171198 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7a80afde0 msgr2=0x7fb7a80b01b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:46:33.468 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.469+0000 7fb7a4ff9640 1 --2- 10.20.193.58:0/2129171198 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7a80afde0 0x7fb7a80b01b0 unknown :-1 s=CLOSED pgs=114 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.468 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:46:33.468 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:46:33.468 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:46:33.468 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:46:33.468 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 222, 2026-02-23T06:46:33.468 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 143141, 2026-02-23T06:46:33.469 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:46:33.469 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:46:33.469 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:46:33.469 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:46:33.469 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:33.469 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:46:33.469 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:46:33.469 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:46:33.469 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:46:33.469 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:46:33.469 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:46:33.469 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:46:33.470 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:46:33.470 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:46:33.470 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:46:33.470 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:46:33.470 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:46:33.470 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:46:33.470 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:46:33.470 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:46:33.470 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:46:33.470 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:46:33.470 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:33.470 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:46:33.471 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:46:33.471 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:46:33.471 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:46:33.471 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:46:33.471 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:46:33.471 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:46:33.471 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:46:33.471 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:46:33.471 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:46:33.471 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:46:33.471 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:46:33.471 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:46:33.472 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:46:33.472 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:46:33.472 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:33.472 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.472 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:46:33.472 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:46:33.472 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:46:33.472 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:46:33.472 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:46:33.472 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:46:33.472 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:46:33.472 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:46:33.473 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:46:33.473 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:46:33.473 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:46:33.473 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:46:33.473 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:46:33.473 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:46:33.473 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:46:33.473 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:46:33.473 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:46:33.473 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:46:33.473 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:46:33.473 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:46:33.474 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:46:33.474 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:46:33.474 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:46:33.474 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:46:33.474 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:46:33.474 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:46:33.474 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:46:33.474 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:46:33.474 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:46:33.474 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:46:33.474 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:33.474 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:46:33.475 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.475 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:46:33.475 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.475 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:46:33.475 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:46:33.475 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:46:33.475 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:46:33.475 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.475 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:46:33.475 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:46:33.475 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:33.475 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.476 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.476 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:46:33.476 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:46:33.476 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:33.476 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:33.476 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:33.476 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.476 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:46:33.476 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:46:33.476 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:46:33.476 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:46:33.476 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:46:33.476 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:46:33.477 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.477 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.477 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:46:33.477 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:46:33.477 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:46:33.477 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:46:33.477 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.477 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:46:33.477 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:46:33.477 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:33.477 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.477 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.477 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:46:33.478 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:46:33.478 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:33.478 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:33.478 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:33.478 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.478 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:46:33.478 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:46:33.478 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:46:33.478 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:46:33.478 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:46:33.478 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:46:33.478 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.479 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.479 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:46:33.479 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:46:33.479 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:46:33.479 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:46:33.479 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.479 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:46:33.479 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:46:33.479 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:33.479 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.479 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.479 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:46:33.480 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:46:33.480 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:33.480 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:33.480 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:33.480 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.480 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:46:33.480 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:46:33.480 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:46:33.480 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:46:33.480 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:46:33.480 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:46:33.480 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:33.481 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:33.481 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.481 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:46:33.481 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:46:33.481 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.481 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:33.481 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:33.481 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:46:33.481 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:33.481 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:33.481 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:46:33.481 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.482 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:33.482 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:33.482 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:46:33.482 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:33.482 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:33.482 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:46:33.482 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.482 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:33.482 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:33.482 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:46:33.482 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:33.482 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:33.482 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:46:33.482 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.483 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:33.483 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:33.483 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:46:33.483 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:33.483 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:33.483 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:46:33.483 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.483 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:33.483 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:33.483 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:46:33.483 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:33.483 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:33.483 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.484 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:46:33.484 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:46:33.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.469+0000 7fb7ad683640 1 -- 10.20.193.58:0/2129171198 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb77807a3c0 msgr2=0x7fb77809a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:33.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.469+0000 7fb7ad683640 1 --2- 10.20.193.58:0/2129171198 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb77807a3c0 0x7fb77809a870 secure :-1 s=READY pgs=526 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb794002b30 tx=0x7fb79403b000 comp rx=0 tx=0).stop 2026-02-23T06:46:33.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.469+0000 7fb7ad683640 1 -- 10.20.193.58:0/2129171198 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7a80ae4f0 msgr2=0x7fb7a8157130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:33.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.469+0000 7fb7ad683640 1 --2- 10.20.193.58:0/2129171198 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb7a80ae4f0 0x7fb7a8157130 secure :-1 s=READY pgs=112 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb79c003860 tx=0x7fb79c00e9c0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.469+0000 7fb7ace82640 1 -- 10.20.193.58:0/2129171198 reap_dead start 2026-02-23T06:46:33.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.469+0000 7fb7ace82640 1 -- 10.20.193.58:0/2129171198 reap_dead start 2026-02-23T06:46:33.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.469+0000 7fb7ad683640 1 -- 10.20.193.58:0/2129171198 shutdown_connections 2026-02-23T06:46:33.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.469+0000 7fb7ad683640 1 -- 10.20.193.58:0/2129171198 >> 10.20.193.58:0/2129171198 conn(0x7fb7a80b3c20 msgr2=0x7fb7a815ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:33.485 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.469+0000 7fb7ad683640 1 -- 10.20.193.58:0/2129171198 shutdown_connections 2026-02-23T06:46:33.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.469+0000 7fb7ad683640 1 -- 10.20.193.58:0/2129171198 wait complete. 2026-02-23T06:46:33.486 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:46:33.486 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:46:33.486 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:46:33.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.612+0000 7ff5ee883640 1 -- 10.20.193.58:0/3498283279 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5d0004850 msgr2=0x7ff5d0004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:33.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.612+0000 7ff5ee883640 1 --2- 10.20.193.58:0/3498283279 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5d0004850 0x7ff5d0004cc0 secure :-1 s=READY pgs=116 gs=4 cs=0 l=1 c_cookie=6432490964274877965 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5dc009b40 tx=0x7ff5dc02fc30 comp rx=0 tx=0).stop 2026-02-23T06:46:33.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.613+0000 7ff5ee883640 1 -- 10.20.193.58:0/3498283279 shutdown_connections 2026-02-23T06:46:33.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.613+0000 7ff5ee883640 1 --2- 10.20.193.58:0/3498283279 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5d0004850 0x7ff5d0004cc0 unknown :-1 s=CLOSED pgs=116 gs=4 cs=0 l=1 c_cookie=6432490964274877965 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.613+0000 7ff5ee883640 1 -- 10.20.193.58:0/3498283279 >> 10.20.193.58:0/3498283279 conn(0x7ff5e80b3c20 msgr2=0x7ff5e80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:33.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.613+0000 7ff5ee883640 1 -- 10.20.193.58:0/3498283279 shutdown_connections 2026-02-23T06:46:33.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.613+0000 7ff5ee883640 1 -- 10.20.193.58:0/3498283279 wait complete. 2026-02-23T06:46:33.611 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.614+0000 7ff5ee883640 1 Processor -- start 2026-02-23T06:46:33.611 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.614+0000 7ff5ee883640 1 -- start start 2026-02-23T06:46:33.611 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.614+0000 7ff5ee883640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff5d0004850 0x7ff5e8160140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:33.611 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.614+0000 7ff5ee883640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff5e813cb10 0x7ff5e813e5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:33.611 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.614+0000 7ff5ee883640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5e8160680 0x7ff5e813eaf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:33.611 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.614+0000 7ff5ee883640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e813bca0 con 0x7ff5e8160680 2026-02-23T06:46:33.611 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.614+0000 7ff5ee883640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e81feaa0 con 0x7ff5e813cb10 2026-02-23T06:46:33.611 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.614+0000 7ff5ee883640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7ff5e81fe540 con 0x7ff5d0004850 2026-02-23T06:46:33.611 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.615+0000 7ff5ed881640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff5d0004850 0x7ff5e8160140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:33.612 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.615+0000 7ff5ed080640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff5e813cb10 0x7ff5e813e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:33.612 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.615+0000 7ff5ed881640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff5d0004850 0x7ff5e8160140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:38780/0 (socket says 10.20.193.58:38780) 2026-02-23T06:46:33.612 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.615+0000 7ff5ed881640 1 -- 10.20.193.58:0/3537080960 learned_addr learned my addr 10.20.193.58:0/3537080960 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:46:33.612 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.615+0000 7ff5ee082640 1 --2- 10.20.193.58:0/3537080960 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5e8160680 0x7ff5e813eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:33.612 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.615+0000 7ff5ed881640 1 -- 10.20.193.58:0/3537080960 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff5e813cb10 msgr2=0x7ff5e813e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:33.612 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.615+0000 7ff5ed881640 1 --2- 10.20.193.58:0/3537080960 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff5e813cb10 0x7ff5e813e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.612 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.615+0000 7ff5ed881640 1 -- 10.20.193.58:0/3537080960 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5e8160680 msgr2=0x7ff5e813eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:33.612 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.615+0000 7ff5ed881640 1 --2- 10.20.193.58:0/3537080960 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5e8160680 0x7ff5e813eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.612 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.615+0000 7ff5ed881640 1 -- 10.20.193.58:0/3537080960 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e815b830 con 0x7ff5d0004850 2026-02-23T06:46:33.612 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.615+0000 7ff5ee082640 1 --2- 10.20.193.58:0/3537080960 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7ff5e8160680 0x7ff5e813eaf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:46:33.612 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.615+0000 7ff5ed881640 1 --2- 10.20.193.58:0/3537080960 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff5d0004850 0x7ff5e8160140 secure :-1 s=READY pgs=10 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5d8002780 tx=0x7ff5d800e5e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:33.613 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.615+0000 7ff5d67fc640 1 -- 10.20.193.58:0/3537080960 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff5d8011890 con 0x7ff5d0004850 2026-02-23T06:46:33.613 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.615+0000 7ff5d67fc640 1 -- 10.20.193.58:0/3537080960 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5d8011b00 con 0x7ff5d0004850 2026-02-23T06:46:33.613 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.615+0000 7ff5ee883640 1 -- 10.20.193.58:0/3537080960 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5e81fe7e0 con 0x7ff5d0004850 2026-02-23T06:46:33.613 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.615+0000 7ff5d67fc640 1 -- 10.20.193.58:0/3537080960 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff5d800ee80 con 0x7ff5d0004850 2026-02-23T06:46:33.613 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.615+0000 7ff5ee883640 1 -- 10.20.193.58:0/3537080960 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5e815bdb0 con 0x7ff5d0004850 2026-02-23T06:46:33.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.616+0000 7ff5ee883640 1 --2- 10.20.193.58:0/3537080960 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff5e815bfa0 0x7ff5e813a510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:33.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.616+0000 7ff5ee883640 1 -- 10.20.193.58:0/3537080960 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e813c1e0 con 0x7ff5e815bfa0 2026-02-23T06:46:33.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.616+0000 7ff5ed080640 1 --2- 10.20.193.58:0/3537080960 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff5e815bfa0 0x7ff5e813a510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:33.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.617+0000 7ff5ed080640 1 -- 10.20.193.58:0/3537080960 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff5e80b5e10 con 0x7ff5e815bfa0 2026-02-23T06:46:33.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.617+0000 7ff5ed080640 1 --2- 10.20.193.58:0/3537080960 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff5e815bfa0 0x7ff5e813a510 secure :-1 s=READY pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5dc004740 tx=0x7ff5dc004a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:33.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.617+0000 7ff5d67fc640 1 -- 10.20.193.58:0/3537080960 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff5dc042070 con 0x7ff5e815bfa0 2026-02-23T06:46:33.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.617+0000 7ff5d67fc640 1 -- 10.20.193.58:0/3537080960 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7ff5d801a400 con 0x7ff5d0004850 2026-02-23T06:46:33.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.618+0000 7ff5d67fc640 1 --2- 10.20.193.58:0/3537080960 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff5b807a660 0x7ff5b809ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:33.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.618+0000 7ff5d67fc640 1 -- 10.20.193.58:0/3537080960 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7ff5d809dbe0 con 0x7ff5d0004850 2026-02-23T06:46:33.616 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.618+0000 7ff5d67fc640 1 -- 10.20.193.58:0/3537080960 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7ff5dc043040 con 0x7ff5e815bfa0 2026-02-23T06:46:33.616 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.618+0000 7ff5d67fc640 1 -- 10.20.193.58:0/3537080960 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff5e815bfa0 msgr2=0x7ff5e813a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:33.616 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.618+0000 7ff5d67fc640 1 --2- 10.20.193.58:0/3537080960 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff5e815bfa0 0x7ff5e813a510 secure :-1 s=READY pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5dc004740 tx=0x7ff5dc004a80 comp rx=0 tx=0).stop 2026-02-23T06:46:33.616 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.618+0000 7ff5d67fc640 1 -- 10.20.193.58:0/3537080960 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff5e815bfa0 msgr2=0x7ff5e813a510 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:46:33.616 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.618+0000 7ff5d67fc640 1 --2- 10.20.193.58:0/3537080960 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff5e815bfa0 0x7ff5e813a510 secure :-1 s=CLOSED pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5dc004740 tx=0x7ff5dc004a80 comp rx=0 tx=0).stop 2026-02-23T06:46:33.616 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.618+0000 7ff5ee082640 1 --2- 10.20.193.58:0/3537080960 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff5b807a660 0x7ff5b809ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:33.616 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.619+0000 7ff5ee082640 1 --2- 10.20.193.58:0/3537080960 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff5b807a660 0x7ff5b809ab10 secure :-1 s=READY pgs=527 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5e4004fd0 tx=0x7ff5e4007e60 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:33.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.622+0000 7ff5ee883640 1 --2- 10.20.193.58:0/3537080960 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff5e813aa50 0x7ff5e8201030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:33.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.622+0000 7ff5ee883640 1 -- 10.20.193.58:0/3537080960 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e80b6330 con 0x7ff5e813aa50 2026-02-23T06:46:33.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.622+0000 7ff5ed080640 1 --2- 10.20.193.58:0/3537080960 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff5e813aa50 0x7ff5e8201030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:33.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.623+0000 7ff5ed080640 1 -- 10.20.193.58:0/3537080960 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff5e80b6d50 con 0x7ff5e813aa50 2026-02-23T06:46:33.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.623+0000 7ff5ed080640 1 --2- 10.20.193.58:0/3537080960 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff5e813aa50 0x7ff5e8201030 secure :-1 s=READY pgs=58 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5dc009b40 tx=0x7ff5dc005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:33.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.623+0000 7ff5d67fc640 1 -- 10.20.193.58:0/3537080960 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff5dc032440 con 0x7ff5e813aa50 2026-02-23T06:46:33.619 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.623+0000 7ff5d67fc640 1 -- 10.20.193.58:0/3537080960 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5556 (secure 0 0 0) 0x7ff5dc0325a0 con 0x7ff5e813aa50 2026-02-23T06:46:33.620 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:46:33.620 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:46:33.620 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:46:33.620 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:46:33.620 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 222, 2026-02-23T06:46:33.620 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 79982, 2026-02-23T06:46:33.620 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:46:33.620 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:46:33.621 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:46:33.621 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:46:33.621 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:33.621 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:46:33.621 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:46:33.621 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:46:33.621 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:46:33.621 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:46:33.621 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:46:33.622 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:46:33.622 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:46:33.622 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:46:33.622 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:46:33.622 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:46:33.622 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:46:33.622 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:46:33.622 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:46:33.622 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:46:33.622 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:46:33.623 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:46:33.623 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:33.623 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:46:33.623 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:46:33.623 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:46:33.623 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:46:33.623 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:46:33.623 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:46:33.623 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:46:33.623 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:46:33.624 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:46:33.624 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:46:33.624 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:46:33.624 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:46:33.624 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:46:33.624 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:46:33.624 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:46:33.624 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:33.624 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.624 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:46:33.625 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:46:33.625 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:46:33.625 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:46:33.625 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:46:33.625 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:46:33.625 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:46:33.625 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:46:33.625 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:46:33.625 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:46:33.625 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:46:33.626 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:46:33.626 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:46:33.626 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:46:33.626 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:46:33.626 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:46:33.626 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:46:33.626 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:46:33.626 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:46:33.626 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:46:33.626 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:46:33.626 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:46:33.627 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:46:33.627 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:46:33.627 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:46:33.627 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:46:33.627 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:46:33.627 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:46:33.627 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:46:33.627 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:46:33.627 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:33.627 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:46:33.628 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.628 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:46:33.628 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.628 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:46:33.628 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:46:33.628 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:46:33.628 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:46:33.628 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.628 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:46:33.628 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:46:33.629 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:33.629 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.629 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.629 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:46:33.629 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:46:33.629 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:33.629 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:33.629 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:33.629 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.629 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:46:33.629 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:46:33.630 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:46:33.630 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:46:33.630 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:46:33.630 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:46:33.630 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.630 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.630 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:46:33.630 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:46:33.630 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:46:33.630 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:46:33.631 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.631 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:46:33.631 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:46:33.631 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:33.631 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.631 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.631 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:46:33.631 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:46:33.631 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:33.631 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:33.631 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:33.632 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.632 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:46:33.632 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:46:33.632 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:46:33.632 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:46:33.632 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:46:33.632 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:46:33.632 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.632 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.632 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:46:33.633 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:46:33.633 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:46:33.633 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:46:33.633 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.633 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:46:33.633 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:46:33.633 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:33.633 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.633 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.633 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:46:33.634 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:46:33.634 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:33.634 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:33.634 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:33.634 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.634 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:46:33.634 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:46:33.634 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:46:33.634 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:46:33.634 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:46:33.634 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:46:33.635 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:33.635 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:33.635 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.635 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:46:33.635 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:46:33.635 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.635 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:33.635 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:33.635 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:46:33.635 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:33.635 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:33.635 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:46:33.636 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.636 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:33.636 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:33.636 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:46:33.636 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:33.636 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:33.636 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:46:33.636 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.636 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:33.636 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:33.636 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:46:33.636 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:33.637 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:33.637 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:46:33.637 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.637 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:46:33.637 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:46:33.637 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:46:33.637 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.637 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.637 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:33.637 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:33.637 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:46:33.637 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:33.638 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:33.638 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:46:33.638 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.638 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:33.638 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:33.638 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:46:33.638 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:33.638 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:33.638 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.638 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:46:33.638 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:46:33.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.623+0000 7ff5d67fc640 1 -- 10.20.193.58:0/3537080960 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff5e813aa50 msgr2=0x7ff5e8201030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:33.640 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.623+0000 7ff5d67fc640 1 --2- 10.20.193.58:0/3537080960 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff5e813aa50 0x7ff5e8201030 secure :-1 s=READY pgs=58 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5dc009b40 tx=0x7ff5dc005f90 comp rx=0 tx=0).stop 2026-02-23T06:46:33.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.623+0000 7ff5d67fc640 1 -- 10.20.193.58:0/3537080960 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff5e813aa50 msgr2=0x7ff5e8201030 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:46:33.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.623+0000 7ff5d67fc640 1 --2- 10.20.193.58:0/3537080960 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7ff5e813aa50 0x7ff5e8201030 secure :-1 s=CLOSED pgs=58 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5dc009b40 tx=0x7ff5dc005f90 comp rx=0 tx=0).stop 2026-02-23T06:46:33.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.624+0000 7ff5ee883640 1 -- 10.20.193.58:0/3537080960 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff5b807a660 msgr2=0x7ff5b809ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:33.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.624+0000 7ff5ee883640 1 --2- 10.20.193.58:0/3537080960 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7ff5b807a660 0x7ff5b809ab10 secure :-1 s=READY pgs=527 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5e4004fd0 tx=0x7ff5e4007e60 comp rx=0 tx=0).stop 2026-02-23T06:46:33.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.624+0000 7ff5ee883640 1 -- 10.20.193.58:0/3537080960 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff5d0004850 msgr2=0x7ff5e8160140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:33.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.624+0000 7ff5ee883640 1 --2- 10.20.193.58:0/3537080960 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff5d0004850 0x7ff5e8160140 secure :-1 s=READY pgs=10 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5d8002780 tx=0x7ff5d800e5e0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.624+0000 7ff5ee082640 1 -- 10.20.193.58:0/3537080960 reap_dead start 2026-02-23T06:46:33.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.624+0000 7ff5ee883640 1 -- 10.20.193.58:0/3537080960 shutdown_connections 2026-02-23T06:46:33.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.624+0000 7ff5ee883640 1 --2- 10.20.193.58:0/3537080960 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7ff5d0004850 0x7ff5e8160140 unknown :-1 s=CLOSED pgs=10 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.624+0000 7ff5ee883640 1 -- 10.20.193.58:0/3537080960 >> 10.20.193.58:0/3537080960 conn(0x7ff5e80b3c20 msgr2=0x7ff5e80ae0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:33.641 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.624+0000 7ff5ee883640 1 -- 10.20.193.58:0/3537080960 shutdown_connections 2026-02-23T06:46:33.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.624+0000 7ff5ee883640 1 -- 10.20.193.58:0/3537080960 wait complete. 2026-02-23T06:46:33.642 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:46:33.642 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:46:33.642 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:46:33.763 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.768+0000 7f86f3577640 1 -- 10.20.193.58:0/1448504221 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86f415c040 msgr2=0x7f86f405b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:33.764 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.768+0000 7f86f3577640 1 --2- 10.20.193.58:0/1448504221 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86f415c040 0x7f86f405b0e0 secure :-1 s=READY pgs=11 gs=2 cs=0 l=1 c_cookie=13228304393954806072 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86e8004740 tx=0x7f86e802f1e0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.764 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.768+0000 7f86f3577640 1 -- 10.20.193.58:0/1448504221 shutdown_connections 2026-02-23T06:46:33.764 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.768+0000 7f86f3577640 1 --2- 10.20.193.58:0/1448504221 >> v2:10.20.193.93:3300/0 conn(0x7f86f40b5680 0x7f86f40b5b20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.764 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.768+0000 7f86f3577640 1 --2- 10.20.193.58:0/1448504221 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86f415c040 0x7f86f405b0e0 unknown :-1 s=CLOSED pgs=11 gs=2 cs=0 l=1 c_cookie=13228304393954806072 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.764 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.768+0000 7f86f3577640 1 -- 10.20.193.58:0/1448504221 >> 10.20.193.58:0/1448504221 conn(0x7f86f40b3c20 msgr2=0x7f86f40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:33.764 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.768+0000 7f86f3577640 1 -- 10.20.193.58:0/1448504221 shutdown_connections 2026-02-23T06:46:33.764 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.768+0000 7f86f3577640 1 -- 10.20.193.58:0/1448504221 wait complete. 2026-02-23T06:46:33.767 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.769+0000 7f86f3577640 1 Processor -- start 2026-02-23T06:46:33.767 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.769+0000 7f86f3577640 1 -- start start 2026-02-23T06:46:33.767 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.770+0000 7f86f3577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86f4056550 0x7f86f40b6d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:33.767 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.770+0000 7f86f3577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f86f40b5680 0x7f86f41312d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:33.768 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.770+0000 7f86f3577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f86f415c040 0x7f86f4058210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:33.768 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.770+0000 7f86f3577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f86f4057f70 con 0x7f86f415c040 2026-02-23T06:46:33.768 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.770+0000 7f86f3577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f86f4058e60 con 0x7f86f40b5680 2026-02-23T06:46:33.768 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.770+0000 7f86f3577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f86f40573e0 con 0x7f86f4056550 2026-02-23T06:46:33.768 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.770+0000 7f86f2d76640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f86f415c040 0x7f86f4058210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:33.768 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.770+0000 7f86f2d76640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f86f415c040 0x7f86f4058210 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:58676/0 (socket says 10.20.193.58:58676) 2026-02-23T06:46:33.768 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.770+0000 7f86f2d76640 1 -- 10.20.193.58:0/1737577801 learned_addr learned my addr 10.20.193.58:0/1737577801 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:46:33.768 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.770+0000 7f86f2575640 1 --2- 10.20.193.58:0/1737577801 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86f4056550 0x7f86f40b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:33.768 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.770+0000 7f86f1d74640 1 --2- 10.20.193.58:0/1737577801 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f86f40b5680 0x7f86f41312d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:33.768 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.770+0000 7f86f2d76640 1 -- 10.20.193.58:0/1737577801 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86f4056550 msgr2=0x7f86f40b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:33.768 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.770+0000 7f86f2d76640 1 --2- 10.20.193.58:0/1737577801 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86f4056550 0x7f86f40b6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.769 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.770+0000 7f86f2d76640 1 -- 10.20.193.58:0/1737577801 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f86f40b5680 msgr2=0x7f86f41312d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:33.769 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.771+0000 7f86f2d76640 1 --2- 10.20.193.58:0/1737577801 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f86f40b5680 0x7f86f41312d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.769 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.771+0000 7f86f2d76640 1 -- 10.20.193.58:0/1737577801 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e80094b0 con 0x7f86f415c040 2026-02-23T06:46:33.769 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.771+0000 7f86f1d74640 1 --2- 10.20.193.58:0/1737577801 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f86f40b5680 0x7f86f41312d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:46:33.769 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.771+0000 7f86f2d76640 1 --2- 10.20.193.58:0/1737577801 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f86f415c040 0x7f86f4058210 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86e400f900 tx=0x7f86e400fdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:33.769 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.771+0000 7f86daffd640 1 -- 10.20.193.58:0/1737577801 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f86e400dce0 con 0x7f86f415c040 2026-02-23T06:46:33.769 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.771+0000 7f86daffd640 1 -- 10.20.193.58:0/1737577801 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f86e400de60 con 0x7f86f415c040 2026-02-23T06:46:33.769 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.771+0000 7f86f3577640 1 -- 10.20.193.58:0/1737577801 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f4138f00 con 0x7f86f415c040 2026-02-23T06:46:33.769 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.771+0000 7f86daffd640 1 -- 10.20.193.58:0/1737577801 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f86e4005b90 con 0x7f86f415c040 2026-02-23T06:46:33.769 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.771+0000 7f86f3577640 1 -- 10.20.193.58:0/1737577801 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86f4057870 con 0x7f86f415c040 2026-02-23T06:46:33.769 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.772+0000 7f86f3577640 1 --2- 10.20.193.58:0/1737577801 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86f4059230 0x7f86f413bb60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:33.770 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.772+0000 7f86f3577640 1 -- 10.20.193.58:0/1737577801 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f86f405b620 con 0x7f86f4059230 2026-02-23T06:46:33.770 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.772+0000 7f86f2575640 1 --2- 10.20.193.58:0/1737577801 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86f4059230 0x7f86f413bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:33.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.773+0000 7f86f2575640 1 -- 10.20.193.58:0/1737577801 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f86f4166120 con 0x7f86f4059230 2026-02-23T06:46:33.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.773+0000 7f86f2575640 1 --2- 10.20.193.58:0/1737577801 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86f4059230 0x7f86f413bb60 secure :-1 s=READY pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86e8004740 tx=0x7f86e80028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:33.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.773+0000 7f86daffd640 1 -- 10.20.193.58:0/1737577801 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f86e4020060 con 0x7f86f415c040 2026-02-23T06:46:33.771 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.774+0000 7f86daffd640 1 --2- 10.20.193.58:0/1737577801 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f86c007a5f0 0x7f86c009aaa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:33.772 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.774+0000 7f86daffd640 1 -- 10.20.193.58:0/1737577801 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f86e4015070 con 0x7f86f415c040 2026-02-23T06:46:33.772 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.774+0000 7f86daffd640 1 -- 10.20.193.58:0/1737577801 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f86e8005d60 con 0x7f86f4059230 2026-02-23T06:46:33.772 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.774+0000 7f86daffd640 1 -- 10.20.193.58:0/1737577801 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f86e803e040 con 0x7f86f4059230 2026-02-23T06:46:33.772 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.774+0000 7f86daffd640 1 -- 10.20.193.58:0/1737577801 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86f4059230 msgr2=0x7f86f413bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:33.772 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.774+0000 7f86daffd640 1 --2- 10.20.193.58:0/1737577801 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86f4059230 0x7f86f413bb60 secure :-1 s=READY pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86e8004740 tx=0x7f86e80028d0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.772 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.774+0000 7f86daffd640 1 -- 10.20.193.58:0/1737577801 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86f4059230 msgr2=0x7f86f413bb60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:46:33.772 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.774+0000 7f86daffd640 1 --2- 10.20.193.58:0/1737577801 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86f4059230 0x7f86f413bb60 unknown :-1 s=CLOSED pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.772 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.774+0000 7f86f1d74640 1 --2- 10.20.193.58:0/1737577801 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f86c007a5f0 0x7f86c009aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:33.772 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.775+0000 7f86f1d74640 1 --2- 10.20.193.58:0/1737577801 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f86c007a5f0 0x7f86c009aaa0 secure :-1 s=READY pgs=528 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86dc0029a0 tx=0x7f86dc009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:33.773 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.778+0000 7f86f3577640 1 --2- 10.20.193.58:0/1737577801 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86f4131810 0x7f86f413c0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:33.773 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.778+0000 7f86f3577640 1 -- 10.20.193.58:0/1737577801 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f86f405d9c0 con 0x7f86f4131810 2026-02-23T06:46:33.773 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.778+0000 7f86f2575640 1 --2- 10.20.193.58:0/1737577801 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86f4131810 0x7f86f413c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:33.774 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.778+0000 7f86f2575640 1 -- 10.20.193.58:0/1737577801 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f86f415fa40 con 0x7f86f4131810 2026-02-23T06:46:33.774 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.779+0000 7f86f2575640 1 --2- 10.20.193.58:0/1737577801 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86f4131810 0x7f86f413c0a0 secure :-1 s=READY pgs=13 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86e80023d0 tx=0x7f86e8005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:33.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.779+0000 7f86daffd640 1 -- 10.20.193.58:0/1737577801 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f86e8056650 con 0x7f86f4131810 2026-02-23T06:46:33.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.779+0000 7f86daffd640 1 -- 10.20.193.58:0/1737577801 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4912 (secure 0 0 0) 0x7f86e8050070 con 0x7f86f4131810 2026-02-23T06:46:33.775 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:46:33.775 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:46:33.775 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:46:33.775 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:46:33.776 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 222, 2026-02-23T06:46:33.776 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 26731, 2026-02-23T06:46:33.776 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:46:33.776 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:46:33.776 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:46:33.776 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:46:33.776 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:33.776 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:46:33.776 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:46:33.776 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:46:33.777 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:46:33.777 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:46:33.777 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:46:33.777 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:46:33.777 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:46:33.777 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:46:33.777 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:46:33.777 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:46:33.777 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:46:33.777 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:46:33.778 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:46:33.778 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:46:33.778 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:46:33.778 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:46:33.778 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:33.778 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:46:33.778 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:46:33.778 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:46:33.778 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:46:33.778 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:46:33.779 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:46:33.779 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:46:33.779 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:46:33.779 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:46:33.779 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:46:33.779 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:46:33.779 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:46:33.779 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:46:33.779 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:46:33.779 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:46:33.779 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:33.780 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.780 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:46:33.780 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:46:33.780 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:46:33.780 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:46:33.780 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:46:33.780 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:46:33.780 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:46:33.780 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:46:33.780 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:46:33.781 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:46:33.781 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:46:33.781 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:46:33.781 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:46:33.781 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:46:33.781 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:46:33.781 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:46:33.781 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:46:33.781 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:46:33.781 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:46:33.781 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:46:33.782 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:46:33.782 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:46:33.782 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:46:33.782 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:46:33.782 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:46:33.782 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:46:33.782 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:46:33.782 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:46:33.782 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:46:33.782 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:46:33.782 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:33.783 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:46:33.783 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.783 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:46:33.783 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.783 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:46:33.783 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:46:33.783 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:46:33.783 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:46:33.783 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.783 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:46:33.783 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:46:33.783 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:33.784 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.784 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.784 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:46:33.784 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:46:33.784 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:33.784 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:33.784 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:33.784 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.784 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:46:33.784 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:46:33.784 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:46:33.784 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:46:33.785 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:46:33.785 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:46:33.785 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.785 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.785 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:46:33.785 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:46:33.785 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:46:33.785 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:46:33.785 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.785 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:46:33.785 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:46:33.785 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:33.785 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.786 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.786 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:46:33.786 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:46:33.786 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:33.786 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:33.786 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:33.786 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.786 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:46:33.786 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:46:33.786 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:46:33.786 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:46:33.786 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:46:33.787 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:46:33.787 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.787 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.787 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:46:33.787 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:46:33.787 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:46:33.787 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:46:33.787 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.787 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:46:33.787 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:46:33.787 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:33.788 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.788 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.788 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:46:33.788 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:46:33.788 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:33.788 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:33.788 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:33.788 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.788 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:46:33.788 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:46:33.788 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:46:33.789 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:46:33.789 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:46:33.789 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:46:33.789 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:33.789 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:33.789 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.789 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:46:33.789 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:46:33.789 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.789 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:33.790 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:33.790 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:46:33.790 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:33.790 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:33.790 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:46:33.790 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:33.790 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:33.790 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:33.790 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:46:33.790 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:33.790 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:33.791 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:33.791 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:46:33.791 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:46:33.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.779+0000 7f86daffd640 1 -- 10.20.193.58:0/1737577801 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86f4131810 msgr2=0x7f86f413c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:33.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.779+0000 7f86daffd640 1 --2- 10.20.193.58:0/1737577801 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86f4131810 0x7f86f413c0a0 secure :-1 s=READY pgs=13 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86e80023d0 tx=0x7f86e8005f90 comp rx=0 tx=0).stop 2026-02-23T06:46:33.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.779+0000 7f86daffd640 1 -- 10.20.193.58:0/1737577801 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86f4131810 msgr2=0x7f86f413c0a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:46:33.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.779+0000 7f86daffd640 1 --2- 10.20.193.58:0/1737577801 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86f4131810 0x7f86f413c0a0 secure :-1 s=CLOSED pgs=13 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86e80023d0 tx=0x7f86e8005f90 comp rx=0 tx=0).stop 2026-02-23T06:46:33.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.779+0000 7f86f3577640 1 -- 10.20.193.58:0/1737577801 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f86c007a5f0 msgr2=0x7f86c009aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:33.793 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.779+0000 7f86f3577640 1 --2- 10.20.193.58:0/1737577801 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f86c007a5f0 0x7f86c009aaa0 secure :-1 s=READY pgs=528 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86dc0029a0 tx=0x7f86dc009040 comp rx=0 tx=0).stop 2026-02-23T06:46:33.794 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.780+0000 7f86f3577640 1 -- 10.20.193.58:0/1737577801 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f86f415c040 msgr2=0x7f86f4058210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:33.794 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.780+0000 7f86f3577640 1 --2- 10.20.193.58:0/1737577801 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f86f415c040 0x7f86f4058210 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86e400f900 tx=0x7f86e400fdd0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.794 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.780+0000 7f86f2d76640 1 -- 10.20.193.58:0/1737577801 reap_dead start 2026-02-23T06:46:33.794 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.780+0000 7f86f2d76640 1 -- 10.20.193.58:0/1737577801 reap_dead start 2026-02-23T06:46:33.794 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.780+0000 7f86f3577640 1 -- 10.20.193.58:0/1737577801 shutdown_connections 2026-02-23T06:46:33.794 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.780+0000 7f86f3577640 1 -- 10.20.193.58:0/1737577801 >> 10.20.193.58:0/1737577801 conn(0x7f86f40b3c20 msgr2=0x7f86f41645a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:33.794 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.780+0000 7f86f3577640 1 -- 10.20.193.58:0/1737577801 shutdown_connections 2026-02-23T06:46:33.794 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.780+0000 7f86f3577640 1 -- 10.20.193.58:0/1737577801 wait complete. 2026-02-23T06:46:33.795 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:46:33.795 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-23T06:46:33.795 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-23T06:46:33.795 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-23T06:46:33.795 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-23T06:46:33.796 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-23T06:46:33.796 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:46:33.814 INFO:tasks.ceph.mon.a:Stopped 2026-02-23T06:46:33.814 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:46:33.814 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:46:33.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.980+0000 7f5463189640 1 -- 10.20.193.58:0/3145658120 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f545c15d4a0 msgr2=0x7f545c0affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:33.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.980+0000 7f5463189640 1 --2- 10.20.193.58:0/3145658120 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f545c15d4a0 0x7f545c0affb0 secure :-1 s=READY pgs=64 gs=2 cs=0 l=1 c_cookie=9992569296151244380 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f545c0b5040 tx=0x7f544c02f270 comp rx=0 tx=0).stop 2026-02-23T06:46:33.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.980+0000 7f5463189640 1 -- 10.20.193.58:0/3145658120 shutdown_connections 2026-02-23T06:46:33.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.980+0000 7f5463189640 1 --2- 10.20.193.58:0/3145658120 >> v2:10.20.193.58:3300/0 conn(0x7f545c0b6690 0x7f545c058ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.980+0000 7f5463189640 1 --2- 10.20.193.58:0/3145658120 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f545c15d4a0 0x7f545c0affb0 unknown :-1 s=CLOSED pgs=64 gs=2 cs=0 l=1 c_cookie=9992569296151244380 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.980+0000 7f5463189640 1 -- 10.20.193.58:0/3145658120 >> 10.20.193.58:0/3145658120 conn(0x7f545c0b3c20 msgr2=0x7f545c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:33.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.980+0000 7f5463189640 1 -- 10.20.193.58:0/3145658120 shutdown_connections 2026-02-23T06:46:33.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.980+0000 7f5463189640 1 -- 10.20.193.58:0/3145658120 wait complete. 2026-02-23T06:46:33.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.981+0000 7f5463189640 1 Processor -- start 2026-02-23T06:46:33.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.981+0000 7f5463189640 1 -- start start 2026-02-23T06:46:33.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.982+0000 7f5463189640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f545c0b6690 0x7f545c162410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:33.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.982+0000 7f5463189640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f545c15d4a0 0x7f545c161580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:33.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.982+0000 7f5463189640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f545c15d870 0x7f545c127280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:33.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.982+0000 7f5463189640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f545c13ee40 con 0x7f545c15d870 2026-02-23T06:46:33.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.982+0000 7f5463189640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f545c140db0 con 0x7f545c0b6690 2026-02-23T06:46:33.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.982+0000 7f5463189640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f545c1610c0 con 0x7f545c15d4a0 2026-02-23T06:46:33.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.982+0000 7f5462988640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f545c15d870 msgr2=0x7f545c127280 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:46:33.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.982+0000 7f5462988640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f545c15d870 0x7f545c127280 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:46:33.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.982+0000 7f5462187640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f545c0b6690 0x7f545c162410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:33.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.982+0000 7f5462187640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f545c0b6690 0x7f545c162410 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:39762/0 (socket says 10.20.193.58:39762) 2026-02-23T06:46:33.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.982+0000 7f5462187640 1 -- 10.20.193.58:0/3101072338 learned_addr learned my addr 10.20.193.58:0/3101072338 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:46:33.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.982+0000 7f5461986640 1 --2- 10.20.193.58:0/3101072338 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f545c15d4a0 0x7f545c161580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:33.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.982+0000 7f5462187640 1 -- 10.20.193.58:0/3101072338 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f545c15d4a0 msgr2=0x7f545c161580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:33.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.982+0000 7f5462187640 1 --2- 10.20.193.58:0/3101072338 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f545c15d4a0 0x7f545c161580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.982+0000 7f5462187640 1 -- 10.20.193.58:0/3101072338 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f545c15d870 msgr2=0x7f545c127280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:46:33.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.982+0000 7f5462187640 1 --2- 10.20.193.58:0/3101072338 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f545c15d870 0x7f545c127280 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:33.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.982+0000 7f5462187640 1 -- 10.20.193.58:0/3101072338 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f544c009570 con 0x7f545c0b6690 2026-02-23T06:46:33.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.982+0000 7f5462187640 1 --2- 10.20.193.58:0/3101072338 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f545c0b6690 0x7f545c162410 secure :-1 s=READY pgs=65 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f544c02f7a0 tx=0x7f544c002a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:33.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.983+0000 7f5442ffd640 1 -- 10.20.193.58:0/3101072338 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f544c03d070 con 0x7f545c0b6690 2026-02-23T06:46:33.982 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.983+0000 7f5442ffd640 1 -- 10.20.193.58:0/3101072338 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f544c004a70 con 0x7f545c0b6690 2026-02-23T06:46:33.982 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.983+0000 7f5442ffd640 1 -- 10.20.193.58:0/3101072338 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f544c004e40 con 0x7f545c0b6690 2026-02-23T06:46:33.982 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.983+0000 7f5463189640 1 -- 10.20.193.58:0/3101072338 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f545c162950 con 0x7f545c0b6690 2026-02-23T06:46:33.982 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.983+0000 7f5463189640 1 -- 10.20.193.58:0/3101072338 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f545c13f210 con 0x7f545c0b6690 2026-02-23T06:46:33.982 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.983+0000 7f5463189640 1 -- 10.20.193.58:0/3101072338 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f545c0b6d50 con 0x7f545c0b6690 2026-02-23T06:46:33.982 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.984+0000 7f5442ffd640 1 -- 10.20.193.58:0/3101072338 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f544c066b20 con 0x7f545c0b6690 2026-02-23T06:46:33.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.985+0000 7f5442ffd640 1 --2- 10.20.193.58:0/3101072338 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f542c07a5b0 0x7f542c09aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:33.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.985+0000 7f5442ffd640 1 -- 10.20.193.58:0/3101072338 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f544c0c2ad0 con 0x7f545c0b6690 2026-02-23T06:46:33.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.986+0000 7f5461986640 1 --2- 10.20.193.58:0/3101072338 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f542c07a5b0 0x7f542c09aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:33.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.986+0000 7f5461986640 1 --2- 10.20.193.58:0/3101072338 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f542c07a5b0 0x7f542c09aa60 secure :-1 s=READY pgs=529 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54500027d0 tx=0x7f5450007ee0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:33.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:33.987+0000 7f5442ffd640 1 -- 10.20.193.58:0/3101072338 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f544c085be0 con 0x7f545c0b6690 2026-02-23T06:46:34.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:34.141+0000 7f5463189640 1 -- 10.20.193.58:0/3101072338 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f545c05b0e0 con 0x7f545c0b6690 2026-02-23T06:46:34.136 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:34.141+0000 7f5442ffd640 1 -- 10.20.193.58:0/3101072338 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f544c088d00 con 0x7f545c0b6690 2026-02-23T06:46:34.137 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":222,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:46:34.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:34.143+0000 7f5463189640 1 -- 10.20.193.58:0/3101072338 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f542c07a5b0 msgr2=0x7f542c09aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:34.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:34.143+0000 7f5463189640 1 --2- 10.20.193.58:0/3101072338 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f542c07a5b0 0x7f542c09aa60 secure :-1 s=READY pgs=529 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54500027d0 tx=0x7f5450007ee0 comp rx=0 tx=0).stop 2026-02-23T06:46:34.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:34.143+0000 7f5463189640 1 -- 10.20.193.58:0/3101072338 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f545c0b6690 msgr2=0x7f545c162410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:34.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:34.143+0000 7f5463189640 1 --2- 10.20.193.58:0/3101072338 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f545c0b6690 0x7f545c162410 secure :-1 s=READY pgs=65 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f544c02f7a0 tx=0x7f544c002a10 comp rx=0 tx=0).stop 2026-02-23T06:46:34.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:34.143+0000 7f5463189640 1 -- 10.20.193.58:0/3101072338 shutdown_connections 2026-02-23T06:46:34.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:34.143+0000 7f5463189640 1 --2- 10.20.193.58:0/3101072338 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f542c07a5b0 0x7f542c09aa60 unknown :-1 s=CLOSED pgs=529 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:34.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:34.143+0000 7f5463189640 1 --2- 10.20.193.58:0/3101072338 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f545c15d870 0x7f545c127280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:34.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:34.143+0000 7f5463189640 1 --2- 10.20.193.58:0/3101072338 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f545c15d4a0 0x7f545c161580 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:34.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:34.143+0000 7f5463189640 1 --2- 10.20.193.58:0/3101072338 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f545c0b6690 0x7f545c162410 unknown :-1 s=CLOSED pgs=65 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:34.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:34.143+0000 7f5463189640 1 -- 10.20.193.58:0/3101072338 >> 10.20.193.58:0/3101072338 conn(0x7f545c0b3c20 msgr2=0x7f545c15ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:34.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:34.143+0000 7f5463189640 1 -- 10.20.193.58:0/3101072338 shutdown_connections 2026-02-23T06:46:34.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:34.143+0000 7f5463189640 1 -- 10.20.193.58:0/3101072338 wait complete. 2026-02-23T06:46:37.150 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:46:37.273 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.277+0000 7f6931dc2640 1 -- 10.20.193.58:0/1646308896 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f692c163c70 msgr2=0x7f692c05b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:37.274 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.277+0000 7f6931dc2640 1 --2- 10.20.193.58:0/1646308896 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f692c163c70 0x7f692c05b230 secure :-1 s=READY pgs=24 gs=4 cs=0 l=1 c_cookie=5027194441368973088 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f691c009890 tx=0x7f691c02f290 comp rx=0 tx=0).stop 2026-02-23T06:46:37.274 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.278+0000 7f6931dc2640 1 -- 10.20.193.58:0/1646308896 shutdown_connections 2026-02-23T06:46:37.274 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.278+0000 7f6931dc2640 1 --2- 10.20.193.58:0/1646308896 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f692c163c70 0x7f692c05b230 unknown :-1 s=CLOSED pgs=24 gs=4 cs=0 l=1 c_cookie=5027194441368973088 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:37.274 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.278+0000 7f6931dc2640 1 -- 10.20.193.58:0/1646308896 >> 10.20.193.58:0/1646308896 conn(0x7f692c0561f0 msgr2=0x7f692c0565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:37.274 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.278+0000 7f6931dc2640 1 -- 10.20.193.58:0/1646308896 shutdown_connections 2026-02-23T06:46:37.274 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.278+0000 7f6931dc2640 1 -- 10.20.193.58:0/1646308896 wait complete. 2026-02-23T06:46:37.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.279+0000 7f6931dc2640 1 Processor -- start 2026-02-23T06:46:37.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.279+0000 7f6931dc2640 1 -- start start 2026-02-23T06:46:37.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.279+0000 7f6931dc2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f692c0b10e0 0x7f692c13f390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:37.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.279+0000 7f6931dc2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f692c0b6020 0x7f692c1656e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:37.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.279+0000 7f6931dc2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f692c163c70 0x7f692c165c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:37.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.279+0000 7f6931dc2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f692c0b06a0 con 0x7f692c0b10e0 2026-02-23T06:46:37.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.279+0000 7f6931dc2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f692c1425e0 con 0x7f692c163c70 2026-02-23T06:46:37.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.279+0000 7f6931dc2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f692c164f70 con 0x7f692c0b6020 2026-02-23T06:46:37.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.279+0000 7f692b7fe640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f692c0b10e0 msgr2=0x7f692c13f390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:46:37.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.279+0000 7f692b7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f692c0b10e0 0x7f692c13f390 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:46:37.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.280+0000 7f692bfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f692c163c70 0x7f692c165c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:37.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.280+0000 7f692affd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f692c0b6020 0x7f692c1656e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:37.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.280+0000 7f692affd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f692c0b6020 0x7f692c1656e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:38910/0 (socket says 10.20.193.58:38910) 2026-02-23T06:46:37.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.280+0000 7f692affd640 1 -- 10.20.193.58:0/1085321485 learned_addr learned my addr 10.20.193.58:0/1085321485 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:46:37.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.280+0000 7f692affd640 1 -- 10.20.193.58:0/1085321485 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f692c163c70 msgr2=0x7f692c165c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:37.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.280+0000 7f692affd640 1 --2- 10.20.193.58:0/1085321485 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f692c163c70 0x7f692c165c20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:37.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.280+0000 7f692affd640 1 -- 10.20.193.58:0/1085321485 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f692c0b10e0 msgr2=0x7f692c13f390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:46:37.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.280+0000 7f692affd640 1 --2- 10.20.193.58:0/1085321485 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f692c0b10e0 0x7f692c13f390 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:37.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.280+0000 7f692affd640 1 -- 10.20.193.58:0/1085321485 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f691c0094b0 con 0x7f692c0b6020 2026-02-23T06:46:37.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.280+0000 7f692affd640 1 --2- 10.20.193.58:0/1085321485 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f692c0b6020 0x7f692c1656e0 secure :-1 s=READY pgs=25 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f691c02f7a0 tx=0x7f691c002cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:37.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.281+0000 7f6907fff640 1 -- 10.20.193.58:0/1085321485 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f691c0388a0 con 0x7f692c0b6020 2026-02-23T06:46:37.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.281+0000 7f6907fff640 1 -- 10.20.193.58:0/1085321485 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f691c038b10 con 0x7f692c0b6020 2026-02-23T06:46:37.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.281+0000 7f6907fff640 1 -- 10.20.193.58:0/1085321485 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f691c02fcb0 con 0x7f692c0b6020 2026-02-23T06:46:37.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.281+0000 7f6931dc2640 1 -- 10.20.193.58:0/1085321485 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f692c165210 con 0x7f692c0b6020 2026-02-23T06:46:37.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.281+0000 7f6931dc2640 1 -- 10.20.193.58:0/1085321485 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f692c0afd70 con 0x7f692c0b6020 2026-02-23T06:46:37.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.281+0000 7f6931dc2640 1 -- 10.20.193.58:0/1085321485 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f692c058640 con 0x7f692c0b6020 2026-02-23T06:46:37.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.283+0000 7f6907fff640 1 -- 10.20.193.58:0/1085321485 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f691c040420 con 0x7f692c0b6020 2026-02-23T06:46:37.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.284+0000 7f6907fff640 1 --2- 10.20.193.58:0/1085321485 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f68fc07a5a0 0x7f68fc09aa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:37.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.284+0000 7f6907fff640 1 -- 10.20.193.58:0/1085321485 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f691c0c3380 con 0x7f692c0b6020 2026-02-23T06:46:37.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.284+0000 7f6907fff640 1 -- 10.20.193.58:0/1085321485 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f691c086630 con 0x7f692c0b6020 2026-02-23T06:46:37.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.284+0000 7f692b7fe640 1 --2- 10.20.193.58:0/1085321485 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f68fc07a5a0 0x7f68fc09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:37.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.285+0000 7f692b7fe640 1 --2- 10.20.193.58:0/1085321485 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f68fc07a5a0 0x7f68fc09aa50 secure :-1 s=READY pgs=530 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6918002870 tx=0x7f6918006da0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:37.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.441+0000 7f6931dc2640 1 -- 10.20.193.58:0/1085321485 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f692c0b14b0 con 0x7f692c0b6020 2026-02-23T06:46:37.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.441+0000 7f6907fff640 1 -- 10.20.193.58:0/1085321485 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f691c089750 con 0x7f692c0b6020 2026-02-23T06:46:37.437 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":222,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:46:37.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.443+0000 7f6931dc2640 1 -- 10.20.193.58:0/1085321485 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f68fc07a5a0 msgr2=0x7f68fc09aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:37.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.443+0000 7f6931dc2640 1 --2- 10.20.193.58:0/1085321485 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f68fc07a5a0 0x7f68fc09aa50 secure :-1 s=READY pgs=530 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6918002870 tx=0x7f6918006da0 comp rx=0 tx=0).stop 2026-02-23T06:46:37.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.443+0000 7f6931dc2640 1 -- 10.20.193.58:0/1085321485 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f692c0b6020 msgr2=0x7f692c1656e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:37.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.443+0000 7f6931dc2640 1 --2- 10.20.193.58:0/1085321485 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f692c0b6020 0x7f692c1656e0 secure :-1 s=READY pgs=25 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f691c02f7a0 tx=0x7f691c002cc0 comp rx=0 tx=0).stop 2026-02-23T06:46:37.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.443+0000 7f6931dc2640 1 -- 10.20.193.58:0/1085321485 shutdown_connections 2026-02-23T06:46:37.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.443+0000 7f6931dc2640 1 --2- 10.20.193.58:0/1085321485 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f68fc07a5a0 0x7f68fc09aa50 unknown :-1 s=CLOSED pgs=530 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:37.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.443+0000 7f6931dc2640 1 --2- 10.20.193.58:0/1085321485 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f692c163c70 0x7f692c165c20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:37.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.443+0000 7f6931dc2640 1 --2- 10.20.193.58:0/1085321485 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f692c0b6020 0x7f692c1656e0 unknown :-1 s=CLOSED pgs=25 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:37.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.443+0000 7f6931dc2640 1 --2- 10.20.193.58:0/1085321485 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f692c0b10e0 0x7f692c13f390 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:37.439 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.443+0000 7f6931dc2640 1 -- 10.20.193.58:0/1085321485 >> 10.20.193.58:0/1085321485 conn(0x7f692c0561f0 msgr2=0x7f692c05b130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:37.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.443+0000 7f6931dc2640 1 -- 10.20.193.58:0/1085321485 shutdown_connections 2026-02-23T06:46:37.440 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:37.443+0000 7f6931dc2640 1 -- 10.20.193.58:0/1085321485 wait complete. 2026-02-23T06:46:40.452 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:46:40.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.580+0000 7f1fff577640 1 -- 10.20.193.58:0/4135778873 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f200015d4a0 msgr2=0x7f20000affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:40.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.580+0000 7f1fff577640 1 --2- 10.20.193.58:0/4135778873 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f200015d4a0 0x7f20000affb0 secure :-1 s=READY pgs=73 gs=4 cs=0 l=1 c_cookie=2474178078179369352 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ff4004740 tx=0x7f1ff402f1d0 comp rx=0 tx=0).stop 2026-02-23T06:46:40.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.581+0000 7f1fff577640 1 -- 10.20.193.58:0/4135778873 shutdown_connections 2026-02-23T06:46:40.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.581+0000 7f1fff577640 1 --2- 10.20.193.58:0/4135778873 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f200015d4a0 0x7f20000affb0 unknown :-1 s=CLOSED pgs=73 gs=4 cs=0 l=1 c_cookie=2474178078179369352 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:40.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.581+0000 7f1fff577640 1 -- 10.20.193.58:0/4135778873 >> 10.20.193.58:0/4135778873 conn(0x7f20000b3c20 msgr2=0x7f20000b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:40.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.581+0000 7f1fff577640 1 -- 10.20.193.58:0/4135778873 shutdown_connections 2026-02-23T06:46:40.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.581+0000 7f1fff577640 1 -- 10.20.193.58:0/4135778873 wait complete. 2026-02-23T06:46:40.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.582+0000 7f1fff577640 1 Processor -- start 2026-02-23T06:46:40.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.582+0000 7f1fff577640 1 -- start start 2026-02-23T06:46:40.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.582+0000 7f1fff577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20000b6690 0x7f200015f4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:40.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.582+0000 7f1fff577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f200015d4a0 0x7f200013d480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:40.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.582+0000 7f1fff577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f200015d870 0x7f2000159c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:40.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.582+0000 7f1fff577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f200013fdf0 con 0x7f200015d4a0 2026-02-23T06:46:40.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.582+0000 7f1fff577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f2000200e90 con 0x7f20000b6690 2026-02-23T06:46:40.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.582+0000 7f1fff577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f2000058060 con 0x7f200015d870 2026-02-23T06:46:40.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.582+0000 7f1ffdd74640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f200015d4a0 msgr2=0x7f200013d480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:46:40.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.582+0000 7f1ffdd74640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f200015d4a0 0x7f200013d480 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:46:40.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.583+0000 7f1ffe575640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20000b6690 0x7f200015f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:40.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.583+0000 7f1ffed76640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f200015d870 0x7f2000159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:40.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.583+0000 7f1ffe575640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20000b6690 0x7f200015f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:41442/0 (socket says 10.20.193.58:41442) 2026-02-23T06:46:40.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.583+0000 7f1ffe575640 1 -- 10.20.193.58:0/3947408058 learned_addr learned my addr 10.20.193.58:0/3947408058 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:46:40.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.583+0000 7f1ffe575640 1 -- 10.20.193.58:0/3947408058 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f200015d870 msgr2=0x7f2000159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:40.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.583+0000 7f1ffe575640 1 --2- 10.20.193.58:0/3947408058 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f200015d870 0x7f2000159c00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:40.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.583+0000 7f1ffe575640 1 -- 10.20.193.58:0/3947408058 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f200015d4a0 msgr2=0x7f200013d480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:46:40.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.583+0000 7f1ffe575640 1 --2- 10.20.193.58:0/3947408058 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f200015d4a0 0x7f200013d480 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:40.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.583+0000 7f1ffe575640 1 -- 10.20.193.58:0/3947408058 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff40094b0 con 0x7f20000b6690 2026-02-23T06:46:40.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.584+0000 7f1ffe575640 1 --2- 10.20.193.58:0/3947408058 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20000b6690 0x7f200015f4c0 secure :-1 s=READY pgs=74 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ff4009960 tx=0x7f1ff4002cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:40.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.584+0000 7f1fe6ffd640 1 -- 10.20.193.58:0/3947408058 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ff40388a0 con 0x7f20000b6690 2026-02-23T06:46:40.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.584+0000 7f1fe6ffd640 1 -- 10.20.193.58:0/3947408058 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ff4038af0 con 0x7f20000b6690 2026-02-23T06:46:40.582 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.584+0000 7f1fe6ffd640 1 -- 10.20.193.58:0/3947408058 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ff402fc40 con 0x7f20000b6690 2026-02-23T06:46:40.582 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.584+0000 7f1fff577640 1 -- 10.20.193.58:0/3947408058 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2000162bc0 con 0x7f20000b6690 2026-02-23T06:46:40.582 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.584+0000 7f1fff577640 1 -- 10.20.193.58:0/3947408058 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20002010e0 con 0x7f20000b6690 2026-02-23T06:46:40.583 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.585+0000 7f1fff577640 1 -- 10.20.193.58:0/3947408058 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f200013f730 con 0x7f20000b6690 2026-02-23T06:46:40.583 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.586+0000 7f1fe6ffd640 1 -- 10.20.193.58:0/3947408058 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f1ff4040420 con 0x7f20000b6690 2026-02-23T06:46:40.583 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.587+0000 7f1fe6ffd640 1 --2- 10.20.193.58:0/3947408058 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1fcc07a5b0 0x7f1fcc09aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:40.583 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.587+0000 7f1fe6ffd640 1 -- 10.20.193.58:0/3947408058 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f1ff40c31b0 con 0x7f20000b6690 2026-02-23T06:46:40.583 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.587+0000 7f1ffdd74640 1 --2- 10.20.193.58:0/3947408058 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1fcc07a5b0 0x7f1fcc09aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:40.584 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.587+0000 7f1fe6ffd640 1 -- 10.20.193.58:0/3947408058 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f1ff4086460 con 0x7f20000b6690 2026-02-23T06:46:40.584 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.588+0000 7f1ffdd74640 1 --2- 10.20.193.58:0/3947408058 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1fcc07a5b0 0x7f1fcc09aa60 secure :-1 s=READY pgs=532 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2000160dd0 tx=0x7f1fe8006e10 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:40.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.741+0000 7f1fff577640 1 -- 10.20.193.58:0/3947408058 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f200013f730 con 0x7f20000b6690 2026-02-23T06:46:40.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.742+0000 7f1fe6ffd640 1 -- 10.20.193.58:0/3947408058 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f200013f730 con 0x7f20000b6690 2026-02-23T06:46:40.738 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":222,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:46:40.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.743+0000 7f1fff577640 1 -- 10.20.193.58:0/3947408058 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1fcc07a5b0 msgr2=0x7f1fcc09aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:40.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.743+0000 7f1fff577640 1 --2- 10.20.193.58:0/3947408058 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1fcc07a5b0 0x7f1fcc09aa60 secure :-1 s=READY pgs=532 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2000160dd0 tx=0x7f1fe8006e10 comp rx=0 tx=0).stop 2026-02-23T06:46:40.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.743+0000 7f1fff577640 1 -- 10.20.193.58:0/3947408058 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20000b6690 msgr2=0x7f200015f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:40.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.743+0000 7f1fff577640 1 --2- 10.20.193.58:0/3947408058 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20000b6690 0x7f200015f4c0 secure :-1 s=READY pgs=74 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ff4009960 tx=0x7f1ff4002cc0 comp rx=0 tx=0).stop 2026-02-23T06:46:40.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.743+0000 7f1fff577640 1 -- 10.20.193.58:0/3947408058 shutdown_connections 2026-02-23T06:46:40.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.743+0000 7f1fff577640 1 --2- 10.20.193.58:0/3947408058 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1fcc07a5b0 0x7f1fcc09aa60 unknown :-1 s=CLOSED pgs=532 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:40.739 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.743+0000 7f1fff577640 1 --2- 10.20.193.58:0/3947408058 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f200015d870 0x7f2000159c00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:40.740 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.743+0000 7f1fff577640 1 --2- 10.20.193.58:0/3947408058 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f200015d4a0 0x7f200013d480 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:40.740 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.743+0000 7f1fff577640 1 --2- 10.20.193.58:0/3947408058 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f20000b6690 0x7f200015f4c0 unknown :-1 s=CLOSED pgs=74 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:40.740 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.743+0000 7f1fff577640 1 -- 10.20.193.58:0/3947408058 >> 10.20.193.58:0/3947408058 conn(0x7f20000b3c20 msgr2=0x7f20000b7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:40.740 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.743+0000 7f1fff577640 1 -- 10.20.193.58:0/3947408058 shutdown_connections 2026-02-23T06:46:40.740 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:40.743+0000 7f1fff577640 1 -- 10.20.193.58:0/3947408058 wait complete. 2026-02-23T06:46:43.751 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:46:45.223 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:46:45.227 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:46:48.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.081+0000 7fe9a3283640 1 -- 10.20.193.58:0/1007471623 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe984003a30 msgr2=0x7fe984003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:48.078 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.081+0000 7fe9a3283640 1 --2- 10.20.193.58:0/1007471623 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe984003a30 0x7fe984003e20 secure :-1 s=READY pgs=29 gs=25 cs=0 l=1 c_cookie=11664401800554860890 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe98c002c30 tx=0x7fe98c030a90 comp rx=0 tx=0).stop 2026-02-23T06:46:48.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.081+0000 7fe9a3283640 1 -- 10.20.193.58:0/1007471623 shutdown_connections 2026-02-23T06:46:48.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.081+0000 7fe9a3283640 1 --2- 10.20.193.58:0/1007471623 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe984005320 0x7fe984065a10 unknown :-1 s=CLOSED pgs=0 gs=27 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:48.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.081+0000 7fe9a3283640 1 --2- 10.20.193.58:0/1007471623 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe984004850 0x7fe984004cc0 unknown :-1 s=CLOSED pgs=0 gs=26 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:48.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.081+0000 7fe9a3283640 1 --2- 10.20.193.58:0/1007471623 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe984003a30 0x7fe984003e20 unknown :-1 s=CLOSED pgs=29 gs=25 cs=0 l=1 c_cookie=11664401800554860890 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:48.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.081+0000 7fe9a3283640 1 -- 10.20.193.58:0/1007471623 >> 10.20.193.58:0/1007471623 conn(0x7fe99c0b3c20 msgr2=0x7fe99c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:48.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.081+0000 7fe9a3283640 1 -- 10.20.193.58:0/1007471623 shutdown_connections 2026-02-23T06:46:48.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.081+0000 7fe9a3283640 1 -- 10.20.193.58:0/1007471623 wait complete. 2026-02-23T06:46:48.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.083+0000 7fe9a3283640 1 Processor -- start 2026-02-23T06:46:48.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.083+0000 7fe9a3283640 1 -- start start 2026-02-23T06:46:48.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.084+0000 7fe9a3283640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe984003a30 0x7fe99c056310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:48.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.084+0000 7fe9a3283640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe984004850 0x7fe99c15dc40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:48.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.084+0000 7fe9a3283640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe984005320 0x7fe99c1405c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:48.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.084+0000 7fe9a3283640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c1401a0 con 0x7fe984003a30 2026-02-23T06:46:48.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.084+0000 7fe9a3283640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c141330 con 0x7fe984004850 2026-02-23T06:46:48.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.084+0000 7fe9a3283640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe99c140b00 con 0x7fe984005320 2026-02-23T06:46:48.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.084+0000 7fe9a2281640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe984003a30 msgr2=0x7fe99c056310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:46:48.086 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.084+0000 7fe9a2281640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe984003a30 0x7fe99c056310 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:46:48.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.084+0000 7fe9a1a80640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe984004850 0x7fe99c15dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:48.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.084+0000 7fe9a1a80640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe984004850 0x7fe99c15dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:41514/0 (socket says 10.20.193.58:41514) 2026-02-23T06:46:48.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.084+0000 7fe9a2a82640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe984005320 0x7fe99c1405c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:48.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.084+0000 7fe9a1a80640 1 -- 10.20.193.58:0/2072725919 learned_addr learned my addr 10.20.193.58:0/2072725919 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:46:48.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.084+0000 7fe9a1a80640 1 -- 10.20.193.58:0/2072725919 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe984005320 msgr2=0x7fe99c1405c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:48.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.084+0000 7fe9a1a80640 1 --2- 10.20.193.58:0/2072725919 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe984005320 0x7fe99c1405c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:48.088 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.084+0000 7fe9a1a80640 1 -- 10.20.193.58:0/2072725919 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe984003a30 msgr2=0x7fe99c056310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:46:48.088 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.084+0000 7fe9a1a80640 1 --2- 10.20.193.58:0/2072725919 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe984003a30 0x7fe99c056310 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:48.088 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.084+0000 7fe9a1a80640 1 -- 10.20.193.58:0/2072725919 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99c13f280 con 0x7fe984004850 2026-02-23T06:46:48.088 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.084+0000 7fe9a1a80640 1 --2- 10.20.193.58:0/2072725919 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe984004850 0x7fe99c15dc40 secure :-1 s=READY pgs=77 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe990007ad0 tx=0x7fe990009380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:48.088 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.085+0000 7fe982ffd640 1 -- 10.20.193.58:0/2072725919 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe990019070 con 0x7fe984004850 2026-02-23T06:46:48.088 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.085+0000 7fe9a3283640 1 -- 10.20.193.58:0/2072725919 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe99c13f520 con 0x7fe984004850 2026-02-23T06:46:48.089 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.085+0000 7fe982ffd640 1 -- 10.20.193.58:0/2072725919 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe99000f040 con 0x7fe984004850 2026-02-23T06:46:48.089 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.085+0000 7fe982ffd640 1 -- 10.20.193.58:0/2072725919 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe990010ae0 con 0x7fe984004850 2026-02-23T06:46:48.089 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.085+0000 7fe9a3283640 1 -- 10.20.193.58:0/2072725919 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe99c13fae0 con 0x7fe984004850 2026-02-23T06:46:48.089 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.085+0000 7fe9a3283640 1 -- 10.20.193.58:0/2072725919 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe99c140410 con 0x7fe984004850 2026-02-23T06:46:48.089 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.086+0000 7fe982ffd640 1 -- 10.20.193.58:0/2072725919 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fe990010c40 con 0x7fe984004850 2026-02-23T06:46:48.089 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.087+0000 7fe982ffd640 1 --2- 10.20.193.58:0/2072725919 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe96c07a5a0 0x7fe96c09aa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:48.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.087+0000 7fe982ffd640 1 -- 10.20.193.58:0/2072725919 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fe99009dbb0 con 0x7fe984004850 2026-02-23T06:46:48.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.088+0000 7fe9a2281640 1 --2- 10.20.193.58:0/2072725919 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe96c07a5a0 0x7fe96c09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:48.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.088+0000 7fe982ffd640 1 -- 10.20.193.58:0/2072725919 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fe990060e60 con 0x7fe984004850 2026-02-23T06:46:48.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.088+0000 7fe9a2281640 1 --2- 10.20.193.58:0/2072725919 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe96c07a5a0 0x7fe96c09aa50 secure :-1 s=READY pgs=533 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe98c03a040 tx=0x7fe98c004040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:48.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.246+0000 7fe9a3283640 1 -- 10.20.193.58:0/2072725919 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe99c0b6d50 con 0x7fe984004850 2026-02-23T06:46:48.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.247+0000 7fe982ffd640 1 -- 10.20.193.58:0/2072725919 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1749 (secure 0 0 0) 0x7fe9900040d0 con 0x7fe984004850 2026-02-23T06:46:48.243 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":224,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:46:48.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.248+0000 7fe9a3283640 1 -- 10.20.193.58:0/2072725919 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe96c07a5a0 msgr2=0x7fe96c09aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:48.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.248+0000 7fe9a3283640 1 --2- 10.20.193.58:0/2072725919 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe96c07a5a0 0x7fe96c09aa50 secure :-1 s=READY pgs=533 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe98c03a040 tx=0x7fe98c004040 comp rx=0 tx=0).stop 2026-02-23T06:46:48.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.248+0000 7fe9a3283640 1 -- 10.20.193.58:0/2072725919 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe984004850 msgr2=0x7fe99c15dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:48.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.248+0000 7fe9a3283640 1 --2- 10.20.193.58:0/2072725919 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe984004850 0x7fe99c15dc40 secure :-1 s=READY pgs=77 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe990007ad0 tx=0x7fe990009380 comp rx=0 tx=0).stop 2026-02-23T06:46:48.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.248+0000 7fe9a3283640 1 -- 10.20.193.58:0/2072725919 shutdown_connections 2026-02-23T06:46:48.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.248+0000 7fe9a3283640 1 --2- 10.20.193.58:0/2072725919 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe96c07a5a0 0x7fe96c09aa50 unknown :-1 s=CLOSED pgs=533 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:48.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.248+0000 7fe9a3283640 1 --2- 10.20.193.58:0/2072725919 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe984005320 0x7fe99c1405c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:48.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.248+0000 7fe9a3283640 1 --2- 10.20.193.58:0/2072725919 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe984004850 0x7fe99c15dc40 unknown :-1 s=CLOSED pgs=77 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:48.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.248+0000 7fe9a3283640 1 --2- 10.20.193.58:0/2072725919 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe984003a30 0x7fe99c056310 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:48.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.248+0000 7fe9a3283640 1 -- 10.20.193.58:0/2072725919 >> 10.20.193.58:0/2072725919 conn(0x7fe99c0b3c20 msgr2=0x7fe99c13e620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:48.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.249+0000 7fe9a3283640 1 -- 10.20.193.58:0/2072725919 shutdown_connections 2026-02-23T06:46:48.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.249+0000 7fe9a3283640 1 -- 10.20.193.58:0/2072725919 wait complete. 2026-02-23T06:46:48.257 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:46:48.257 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-23T06:46:48.257 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:46:48.384 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.390+0000 7f2e99392640 1 -- 10.20.193.58:0/1164803754 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2e9415c4b0 msgr2=0x7f2e94058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:48.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.390+0000 7f2e99392640 1 --2- 10.20.193.58:0/1164803754 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2e9415c4b0 0x7f2e94058200 secure :-1 s=READY pgs=30 gs=4 cs=0 l=1 c_cookie=6157513676043528325 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e80009950 tx=0x7f2e8002f250 comp rx=0 tx=0).stop 2026-02-23T06:46:48.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.390+0000 7f2e99392640 1 -- 10.20.193.58:0/1164803754 shutdown_connections 2026-02-23T06:46:48.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.390+0000 7f2e99392640 1 --2- 10.20.193.58:0/1164803754 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2e9415c4b0 0x7f2e94058200 unknown :-1 s=CLOSED pgs=30 gs=4 cs=0 l=1 c_cookie=6157513676043528325 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:48.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.390+0000 7f2e99392640 1 -- 10.20.193.58:0/1164803754 >> 10.20.193.58:0/1164803754 conn(0x7f2e940b3c20 msgr2=0x7f2e940b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:48.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.390+0000 7f2e99392640 1 -- 10.20.193.58:0/1164803754 shutdown_connections 2026-02-23T06:46:48.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.390+0000 7f2e99392640 1 -- 10.20.193.58:0/1164803754 wait complete. 2026-02-23T06:46:48.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.391+0000 7f2e99392640 1 Processor -- start 2026-02-23T06:46:48.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.391+0000 7f2e99392640 1 -- start start 2026-02-23T06:46:48.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.392+0000 7f2e99392640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e94056960 0x7f2e94141aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:48.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.392+0000 7f2e99392640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2e9415c4b0 0x7f2e94159fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:48.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.392+0000 7f2e99392640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2e94162ca0 0x7f2e941591e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:48.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.392+0000 7f2e99392640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f2e940b1080 con 0x7f2e9415c4b0 2026-02-23T06:46:48.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.392+0000 7f2e99392640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9413f7e0 con 0x7f2e94056960 2026-02-23T06:46:48.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.392+0000 7f2e99392640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f2e940b0b00 con 0x7f2e94162ca0 2026-02-23T06:46:48.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.392+0000 7f2e937fe640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2e9415c4b0 msgr2=0x7f2e94159fb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:46:48.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.392+0000 7f2e937fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2e9415c4b0 0x7f2e94159fb0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:46:48.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.392+0000 7f2e93fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e94056960 0x7f2e94141aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:48.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.392+0000 7f2e93fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e94056960 0x7f2e94141aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:41526/0 (socket says 10.20.193.58:41526) 2026-02-23T06:46:48.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.392+0000 7f2e93fff640 1 -- 10.20.193.58:0/2318313626 learned_addr learned my addr 10.20.193.58:0/2318313626 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:46:48.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.392+0000 7f2e98b91640 1 --2- 10.20.193.58:0/2318313626 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2e94162ca0 0x7f2e941591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:48.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.392+0000 7f2e93fff640 1 -- 10.20.193.58:0/2318313626 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2e94162ca0 msgr2=0x7f2e941591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:48.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.392+0000 7f2e93fff640 1 --2- 10.20.193.58:0/2318313626 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2e94162ca0 0x7f2e941591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:48.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.392+0000 7f2e93fff640 1 -- 10.20.193.58:0/2318313626 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2e9415c4b0 msgr2=0x7f2e94159fb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:46:48.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.392+0000 7f2e93fff640 1 --2- 10.20.193.58:0/2318313626 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2e9415c4b0 0x7f2e94159fb0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:48.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.392+0000 7f2e93fff640 1 -- 10.20.193.58:0/2318313626 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e80009570 con 0x7f2e94056960 2026-02-23T06:46:48.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.393+0000 7f2e93fff640 1 --2- 10.20.193.58:0/2318313626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e94056960 0x7f2e94141aa0 secure :-1 s=READY pgs=79 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e80009a50 tx=0x7f2e800028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:48.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.393+0000 7f2e90ff9640 1 -- 10.20.193.58:0/2318313626 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e8003d070 con 0x7f2e94056960 2026-02-23T06:46:48.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.393+0000 7f2e99392640 1 -- 10.20.193.58:0/2318313626 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e94140e20 con 0x7f2e94056960 2026-02-23T06:46:48.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.393+0000 7f2e99392640 1 -- 10.20.193.58:0/2318313626 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e94140860 con 0x7f2e94056960 2026-02-23T06:46:48.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.393+0000 7f2e90ff9640 1 -- 10.20.193.58:0/2318313626 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e80038470 con 0x7f2e94056960 2026-02-23T06:46:48.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.393+0000 7f2e90ff9640 1 -- 10.20.193.58:0/2318313626 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e80038860 con 0x7f2e94056960 2026-02-23T06:46:48.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.393+0000 7f2e99392640 1 --2- 10.20.193.58:0/2318313626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e94140a50 0x7f2e94159720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:48.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.393+0000 7f2e99392640 1 -- 10.20.193.58:0/2318313626 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f2e94059690 con 0x7f2e94140a50 2026-02-23T06:46:48.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.394+0000 7f2e937fe640 1 --2- 10.20.193.58:0/2318313626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e94140a50 0x7f2e94159720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:48.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.394+0000 7f2e937fe640 1 -- 10.20.193.58:0/2318313626 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2e940593b0 con 0x7f2e94140a50 2026-02-23T06:46:48.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.394+0000 7f2e937fe640 1 --2- 10.20.193.58:0/2318313626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e94140a50 0x7f2e94159720 secure :-1 s=READY pgs=80 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e94141260 tx=0x7f2e8400b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:48.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.395+0000 7f2e90ff9640 1 -- 10.20.193.58:0/2318313626 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e84003e70 con 0x7f2e94140a50 2026-02-23T06:46:48.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.395+0000 7f2e90ff9640 1 -- 10.20.193.58:0/2318313626 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f2e840050f0 con 0x7f2e94140a50 2026-02-23T06:46:48.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.395+0000 7f2e90ff9640 1 -- 10.20.193.58:0/2318313626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e94140a50 msgr2=0x7f2e94159720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:48.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.395+0000 7f2e90ff9640 1 --2- 10.20.193.58:0/2318313626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e94140a50 0x7f2e94159720 secure :-1 s=READY pgs=80 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e94141260 tx=0x7f2e8400b8f0 comp rx=0 tx=0).stop 2026-02-23T06:46:48.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.395+0000 7f2e90ff9640 1 -- 10.20.193.58:0/2318313626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e94140a50 msgr2=0x7f2e94159720 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:46:48.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.395+0000 7f2e90ff9640 1 --2- 10.20.193.58:0/2318313626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e94140a50 0x7f2e94159720 unknown :-1 s=CLOSED pgs=80 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:48.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.395+0000 7f2e90ff9640 1 -- 10.20.193.58:0/2318313626 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f2e800389c0 con 0x7f2e94056960 2026-02-23T06:46:48.390 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.396+0000 7f2e90ff9640 1 --2- 10.20.193.58:0/2318313626 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2e6407a3c0 0x7f2e6409a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:48.391 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.396+0000 7f2e90ff9640 1 -- 10.20.193.58:0/2318313626 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f2e800c2310 con 0x7f2e94056960 2026-02-23T06:46:48.391 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.397+0000 7f2e937fe640 1 --2- 10.20.193.58:0/2318313626 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2e6407a3c0 0x7f2e6409a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:48.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.397+0000 7f2e937fe640 1 --2- 10.20.193.58:0/2318313626 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2e6407a3c0 0x7f2e6409a870 secure :-1 s=READY pgs=534 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e84012040 tx=0x7f2e84008030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:48.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.398+0000 7f2e99392640 1 --2- 10.20.193.58:0/2318313626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e940b0010 0x7f2e94142340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:48.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.398+0000 7f2e99392640 1 -- 10.20.193.58:0/2318313626 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f2e941406c0 con 0x7f2e940b0010 2026-02-23T06:46:48.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.399+0000 7f2e98b91640 1 --2- 10.20.193.58:0/2318313626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e940b0010 0x7f2e94142340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:48.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.399+0000 7f2e98b91640 1 -- 10.20.193.58:0/2318313626 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2e9405b840 con 0x7f2e940b0010 2026-02-23T06:46:48.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.399+0000 7f2e98b91640 1 --2- 10.20.193.58:0/2318313626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e940b0010 0x7f2e94142340 secure :-1 s=READY pgs=81 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e880038b0 tx=0x7f2e8800ff10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:48.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.399+0000 7f2e90ff9640 1 -- 10.20.193.58:0/2318313626 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e8801a070 con 0x7f2e940b0010 2026-02-23T06:46:48.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.400+0000 7f2e90ff9640 1 -- 10.20.193.58:0/2318313626 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5546 (secure 0 0 0) 0x7f2e88007b90 con 0x7f2e940b0010 2026-02-23T06:46:48.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.400+0000 7f2e90ff9640 1 -- 10.20.193.58:0/2318313626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e940b0010 msgr2=0x7f2e94142340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:48.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.400+0000 7f2e90ff9640 1 --2- 10.20.193.58:0/2318313626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e940b0010 0x7f2e94142340 secure :-1 s=READY pgs=81 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e880038b0 tx=0x7f2e8800ff10 comp rx=0 tx=0).stop 2026-02-23T06:46:48.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.400+0000 7f2e90ff9640 1 -- 10.20.193.58:0/2318313626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e940b0010 msgr2=0x7f2e94142340 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:46:48.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.400+0000 7f2e90ff9640 1 --2- 10.20.193.58:0/2318313626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e940b0010 0x7f2e94142340 secure :-1 s=CLOSED pgs=81 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e880038b0 tx=0x7f2e8800ff10 comp rx=0 tx=0).stop 2026-02-23T06:46:48.394 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 224, 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 94758, 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:46:48.395 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:46:48.396 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.397 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:48.398 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:46:48.399 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:48.400 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:48.400 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:48.400 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:46:48.400 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:46:48.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.400+0000 7f2e99392640 1 -- 10.20.193.58:0/2318313626 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2e6407a3c0 msgr2=0x7f2e6409a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:48.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.400+0000 7f2e99392640 1 --2- 10.20.193.58:0/2318313626 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2e6407a3c0 0x7f2e6409a870 secure :-1 s=READY pgs=534 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e84012040 tx=0x7f2e84008030 comp rx=0 tx=0).stop 2026-02-23T06:46:48.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.400+0000 7f2e99392640 1 -- 10.20.193.58:0/2318313626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e94056960 msgr2=0x7f2e94141aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:48.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.400+0000 7f2e99392640 1 --2- 10.20.193.58:0/2318313626 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2e94056960 0x7f2e94141aa0 secure :-1 s=READY pgs=79 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e80009a50 tx=0x7f2e800028d0 comp rx=0 tx=0).stop 2026-02-23T06:46:48.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.400+0000 7f2e98b91640 1 -- 10.20.193.58:0/2318313626 reap_dead start 2026-02-23T06:46:48.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.400+0000 7f2e99392640 1 -- 10.20.193.58:0/2318313626 shutdown_connections 2026-02-23T06:46:48.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.400+0000 7f2e99392640 1 -- 10.20.193.58:0/2318313626 >> 10.20.193.58:0/2318313626 conn(0x7f2e940b3c20 msgr2=0x7f2e941621f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:48.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.400+0000 7f2e99392640 1 -- 10.20.193.58:0/2318313626 shutdown_connections 2026-02-23T06:46:48.400 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.400+0000 7f2e99392640 1 -- 10.20.193.58:0/2318313626 wait complete. 2026-02-23T06:46:48.401 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:46:48.401 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-23T06:46:48.401 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:46:48.524 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.529+0000 7fe7f7577640 1 -- 10.20.193.58:0/224511278 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe7f815d4a0 msgr2=0x7fe7f80affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:48.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.529+0000 7fe7f7577640 1 --2- 10.20.193.58:0/224511278 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe7f815d4a0 0x7fe7f80affb0 secure :-1 s=READY pgs=82 gs=4 cs=0 l=1 c_cookie=4286134841119792924 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7f80b5040 tx=0x7fe7ec02f280 comp rx=0 tx=0).stop 2026-02-23T06:46:48.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.530+0000 7fe7f7577640 1 -- 10.20.193.58:0/224511278 shutdown_connections 2026-02-23T06:46:48.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.530+0000 7fe7f7577640 1 --2- 10.20.193.58:0/224511278 >> v2:10.20.193.58:3300/0 conn(0x7fe7f815d870 0x7fe7f80587b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:48.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.530+0000 7fe7f7577640 1 --2- 10.20.193.58:0/224511278 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe7f815d4a0 0x7fe7f80affb0 unknown :-1 s=CLOSED pgs=82 gs=4 cs=0 l=1 c_cookie=4286134841119792924 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:48.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.530+0000 7fe7f7577640 1 -- 10.20.193.58:0/224511278 >> 10.20.193.58:0/224511278 conn(0x7fe7f80b3c20 msgr2=0x7fe7f80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:48.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.530+0000 7fe7f7577640 1 -- 10.20.193.58:0/224511278 shutdown_connections 2026-02-23T06:46:48.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.530+0000 7fe7f7577640 1 -- 10.20.193.58:0/224511278 wait complete. 2026-02-23T06:46:48.526 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.531+0000 7fe7f7577640 1 Processor -- start 2026-02-23T06:46:48.526 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.531+0000 7fe7f7577640 1 -- start start 2026-02-23T06:46:48.527 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.531+0000 7fe7f7577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe7f80b6690 0x7fe7f8175aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:48.527 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.531+0000 7fe7f7577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe7f815d4a0 0x7fe7f80587e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:48.534 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.531+0000 7fe7f7577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe7f815d870 0x7fe7f813c900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:48.534 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.531+0000 7fe7f7577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f813da40 con 0x7fe7f80b6690 2026-02-23T06:46:48.534 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.531+0000 7fe7f7577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f813dd20 con 0x7fe7f815d870 2026-02-23T06:46:48.534 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.531+0000 7fe7f7577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe7f813e000 con 0x7fe7f815d4a0 2026-02-23T06:46:48.534 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.531+0000 7fe7f6575640 1 -- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe7f80b6690 msgr2=0x7fe7f8175aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.58:3300/0 2026-02-23T06:46:48.535 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.531+0000 7fe7f6575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe7f80b6690 0x7fe7f8175aa0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:46:48.535 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.538+0000 7fe7f6d76640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe7f815d870 0x7fe7f813c900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:48.535 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.538+0000 7fe7f5d74640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe7f815d4a0 0x7fe7f80587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:48.535 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.538+0000 7fe7f6d76640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe7f815d870 0x7fe7f813c900 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:41558/0 (socket says 10.20.193.58:41558) 2026-02-23T06:46:48.535 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.538+0000 7fe7f6d76640 1 -- 10.20.193.58:0/2133644091 learned_addr learned my addr 10.20.193.58:0/2133644091 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:46:48.535 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.539+0000 7fe7f5d74640 1 -- 10.20.193.58:0/2133644091 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe7f815d870 msgr2=0x7fe7f813c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:48.535 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.539+0000 7fe7f5d74640 1 --2- 10.20.193.58:0/2133644091 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe7f815d870 0x7fe7f813c900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:48.535 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.539+0000 7fe7f5d74640 1 -- 10.20.193.58:0/2133644091 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe7f80b6690 msgr2=0x7fe7f8175aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:46:48.535 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.539+0000 7fe7f5d74640 1 --2- 10.20.193.58:0/2133644091 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe7f80b6690 0x7fe7f8175aa0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:48.535 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.539+0000 7fe7f5d74640 1 -- 10.20.193.58:0/2133644091 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ec009570 con 0x7fe7f815d4a0 2026-02-23T06:46:48.535 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.539+0000 7fe7f6d76640 1 --2- 10.20.193.58:0/2133644091 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe7f815d870 0x7fe7f813c900 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:46:48.536 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.539+0000 7fe7f5d74640 1 --2- 10.20.193.58:0/2133644091 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe7f815d4a0 0x7fe7f80587e0 secure :-1 s=READY pgs=31 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7e000b4a0 tx=0x7fe7e000b970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:48.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.540+0000 7fe7deffd640 1 -- 10.20.193.58:0/2133644091 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7e0002cd0 con 0x7fe7f815d4a0 2026-02-23T06:46:48.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.540+0000 7fe7deffd640 1 -- 10.20.193.58:0/2133644091 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7e0004070 con 0x7fe7f815d4a0 2026-02-23T06:46:48.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.540+0000 7fe7deffd640 1 -- 10.20.193.58:0/2133644091 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7e0004460 con 0x7fe7f815d4a0 2026-02-23T06:46:48.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.540+0000 7fe7f7577640 1 -- 10.20.193.58:0/2133644091 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7f8172650 con 0x7fe7f815d4a0 2026-02-23T06:46:48.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.540+0000 7fe7f7577640 1 -- 10.20.193.58:0/2133644091 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7f8172c10 con 0x7fe7f815d4a0 2026-02-23T06:46:48.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.540+0000 7fe7f7577640 1 --2- 10.20.193.58:0/2133644091 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe7f815f0e0 0x7fe7f8159b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:48.537 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.540+0000 7fe7f7577640 1 -- 10.20.193.58:0/2133644091 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe7f80609c0 con 0x7fe7f815f0e0 2026-02-23T06:46:48.538 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.540+0000 7fe7f6575640 1 --2- 10.20.193.58:0/2133644091 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe7f815f0e0 0x7fe7f8159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:48.538 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.541+0000 7fe7f6575640 1 -- 10.20.193.58:0/2133644091 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe7f80b6330 con 0x7fe7f815f0e0 2026-02-23T06:46:48.538 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.541+0000 7fe7f6575640 1 --2- 10.20.193.58:0/2133644091 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe7f815f0e0 0x7fe7f8159b00 secure :-1 s=READY pgs=32 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7f80b5040 tx=0x7fe7ec0028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:48.538 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.542+0000 7fe7deffd640 1 -- 10.20.193.58:0/2133644091 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7ec03f070 con 0x7fe7f815f0e0 2026-02-23T06:46:48.538 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.542+0000 7fe7deffd640 1 -- 10.20.193.58:0/2133644091 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fe7e00045c0 con 0x7fe7f815d4a0 2026-02-23T06:46:48.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.542+0000 7fe7deffd640 1 --2- 10.20.193.58:0/2133644091 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe7c407a660 0x7fe7c409ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:48.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.542+0000 7fe7deffd640 1 -- 10.20.193.58:0/2133644091 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fe7e009d390 con 0x7fe7f815d4a0 2026-02-23T06:46:48.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.543+0000 7fe7deffd640 1 -- 10.20.193.58:0/2133644091 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fe7ec004850 con 0x7fe7f815f0e0 2026-02-23T06:46:48.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.543+0000 7fe7deffd640 1 -- 10.20.193.58:0/2133644091 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe7f815f0e0 msgr2=0x7fe7f8159b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:48.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.543+0000 7fe7deffd640 1 --2- 10.20.193.58:0/2133644091 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe7f815f0e0 0x7fe7f8159b00 secure :-1 s=READY pgs=32 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7f80b5040 tx=0x7fe7ec0028d0 comp rx=0 tx=0).stop 2026-02-23T06:46:48.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.543+0000 7fe7deffd640 1 -- 10.20.193.58:0/2133644091 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe7f815f0e0 msgr2=0x7fe7f8159b00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:46:48.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.543+0000 7fe7deffd640 1 --2- 10.20.193.58:0/2133644091 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe7f815f0e0 0x7fe7f8159b00 unknown :-1 s=CLOSED pgs=32 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:48.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.543+0000 7fe7f6d76640 1 --2- 10.20.193.58:0/2133644091 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe7c407a660 0x7fe7c409ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:48.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.544+0000 7fe7f6d76640 1 --2- 10.20.193.58:0/2133644091 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe7c407a660 0x7fe7c409ab10 secure :-1 s=READY pgs=535 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7f813d440 tx=0x7fe7e800a210 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:48.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.546+0000 7fe7f7577640 1 --2- 10.20.193.58:0/2133644091 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe7f813ce40 0x7fe7f815a040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:46:48.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.546+0000 7fe7f7577640 1 -- 10.20.193.58:0/2133644091 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe7f8164250 con 0x7fe7f813ce40 2026-02-23T06:46:48.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.546+0000 7fe7f6575640 1 --2- 10.20.193.58:0/2133644091 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe7f813ce40 0x7fe7f815a040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:46:48.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.547+0000 7fe7f6575640 1 -- 10.20.193.58:0/2133644091 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe7f81724b0 con 0x7fe7f813ce40 2026-02-23T06:46:48.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.547+0000 7fe7f6575640 1 --2- 10.20.193.58:0/2133644091 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe7f813ce40 0x7fe7f815a040 secure :-1 s=READY pgs=33 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7ec0023d0 tx=0x7fe7ec02f280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:46:48.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.548+0000 7fe7deffd640 1 -- 10.20.193.58:0/2133644091 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7ec04f070 con 0x7fe7f813ce40 2026-02-23T06:46:48.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.548+0000 7fe7deffd640 1 -- 10.20.193.58:0/2133644091 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5401 (secure 0 0 0) 0x7fe7ec043410 con 0x7fe7f813ce40 2026-02-23T06:46:48.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.548+0000 7fe7deffd640 1 -- 10.20.193.58:0/2133644091 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe7f813ce40 msgr2=0x7fe7f815a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:48.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.548+0000 7fe7deffd640 1 --2- 10.20.193.58:0/2133644091 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe7f813ce40 0x7fe7f815a040 secure :-1 s=READY pgs=33 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7ec0023d0 tx=0x7fe7ec02f280 comp rx=0 tx=0).stop 2026-02-23T06:46:48.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.548+0000 7fe7deffd640 1 -- 10.20.193.58:0/2133644091 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe7f813ce40 msgr2=0x7fe7f815a040 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:46:48.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.548+0000 7fe7deffd640 1 --2- 10.20.193.58:0/2133644091 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe7f813ce40 0x7fe7f815a040 unknown :-1 s=CLOSED pgs=33 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:48.544 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:46:48.544 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:46:48.544 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:46:48.544 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:46:48.544 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 224, 2026-02-23T06:46:48.544 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 41500, 2026-02-23T06:46:48.544 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:46:48.544 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:46:48.545 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:46:48.545 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:48.545 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:46:48.545 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:46:48.545 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:46:48.545 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:46:48.545 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:46:48.545 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:46:48.545 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:46:48.545 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:46:48.545 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:46:48.545 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:46:48.546 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:46:48.546 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:46:48.546 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:46:48.546 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:46:48.546 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:46:48.546 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:46:48.546 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:46:48.546 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:48.546 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:46:48.546 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:46:48.546 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:46:48.546 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:46:48.547 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:46:48.547 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:46:48.547 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:46:48.547 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:46:48.547 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:46:48.547 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:46:48.547 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:46:48.547 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:46:48.547 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:46:48.547 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:46:48.547 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:46:48.547 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:48.548 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:48.548 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:46:48.548 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:46:48.548 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:46:48.548 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:46:48.548 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:46:48.548 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:46:48.548 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:46:48.548 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:46:48.548 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:46:48.548 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:46:48.548 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:46:48.549 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:46:48.549 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:46:48.549 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:46:48.549 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:46:48.549 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:46:48.549 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:46:48.549 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:46:48.549 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:46:48.549 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:46:48.549 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:46:48.549 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:46:48.549 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:46:48.550 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:46:48.550 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:46:48.550 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:46:48.550 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:46:48.550 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:46:48.550 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:46:48.550 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:46:48.550 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:48.550 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:46:48.550 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:48.550 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:46:48.550 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.550 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:46:48.551 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:46:48.551 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:46:48.551 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:46:48.551 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.551 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:46:48.551 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:46:48.551 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:48.551 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:48.551 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.551 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:46:48.551 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:46:48.551 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:48.552 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:48.552 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:48.552 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:48.552 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:46:48.552 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:46:48.552 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:46:48.552 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:46:48.552 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:46:48.552 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:46:48.552 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:48.552 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.552 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:46:48.553 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:46:48.553 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:46:48.553 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:46:48.553 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.553 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:46:48.553 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:46:48.553 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:48.553 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:48.553 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.553 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:46:48.553 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:46:48.554 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:48.554 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:48.554 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:48.554 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:48.554 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:46:48.554 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:46:48.554 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:46:48.554 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:46:48.554 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:46:48.554 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:46:48.554 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:48.555 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.555 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:46:48.555 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:46:48.555 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:46:48.555 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:46:48.555 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.555 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:46:48.555 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:46:48.555 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:48.555 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:48.555 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.555 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:46:48.555 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:46:48.556 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:46:48.556 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:48.556 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:48.556 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:48.556 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:46:48.556 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:46:48.556 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:46:48.556 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:46:48.556 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:46:48.556 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:46:48.556 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:48.556 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:48.557 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:48.557 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:46:48.557 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:46:48.557 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.557 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:48.557 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:48.557 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:46:48.557 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:48.557 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:48.557 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:46:48.557 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.557 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:48.558 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:48.558 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:46:48.558 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:48.558 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:48.558 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:46:48.558 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.558 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:48.558 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:48.558 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:46:48.558 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:48.558 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:48.558 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:46:48.558 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.559 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:48.559 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:48.559 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:46:48.559 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:48.559 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:46:48.559 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:46:48.559 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:46:48.559 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:46:48.559 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:46:48.559 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:46:48.559 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:46:48.559 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:46:48.560 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:46:48.560 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:46:48.560 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:46:48.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.548+0000 7fe7f7577640 1 -- 10.20.193.58:0/2133644091 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe7c407a660 msgr2=0x7fe7c409ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:48.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.548+0000 7fe7f7577640 1 --2- 10.20.193.58:0/2133644091 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe7c407a660 0x7fe7c409ab10 secure :-1 s=READY pgs=535 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7f813d440 tx=0x7fe7e800a210 comp rx=0 tx=0).stop 2026-02-23T06:46:48.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.548+0000 7fe7f7577640 1 -- 10.20.193.58:0/2133644091 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe7f815d4a0 msgr2=0x7fe7f80587e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:46:48.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.548+0000 7fe7f7577640 1 --2- 10.20.193.58:0/2133644091 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe7f815d4a0 0x7fe7f80587e0 secure :-1 s=READY pgs=31 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7e000b4a0 tx=0x7fe7e000b970 comp rx=0 tx=0).stop 2026-02-23T06:46:48.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.548+0000 7fe7f6d76640 1 -- 10.20.193.58:0/2133644091 reap_dead start 2026-02-23T06:46:48.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.548+0000 7fe7f7577640 1 -- 10.20.193.58:0/2133644091 shutdown_connections 2026-02-23T06:46:48.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.548+0000 7fe7f7577640 1 --2- 10.20.193.58:0/2133644091 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe7f815d4a0 0x7fe7f80587e0 unknown :-1 s=CLOSED pgs=31 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:46:48.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.548+0000 7fe7f7577640 1 -- 10.20.193.58:0/2133644091 >> 10.20.193.58:0/2133644091 conn(0x7fe7f80b3c20 msgr2=0x7fe7f80b7480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:46:48.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.548+0000 7fe7f7577640 1 -- 10.20.193.58:0/2133644091 shutdown_connections 2026-02-23T06:46:48.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:46:48.548+0000 7fe7f7577640 1 -- 10.20.193.58:0/2133644091 wait complete. 2026-02-23T06:46:48.563 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:46:48.563 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:47:08.564 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-23T06:47:08.564 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-23T06:47:08.564 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-23T06:47:08.564 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-23T06:47:08.568 INFO:tasks.ceph.mon.a:Started 2026-02-23T06:47:08.568 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:47:08.568 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:47:08.689 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.693+0000 7f88929c9640 1 -- 10.20.193.58:0/1710909740 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f888c0b5d90 msgr2=0x7f888c15bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:08.689 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.693+0000 7f88929c9640 1 --2- 10.20.193.58:0/1710909740 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f888c0b5d90 0x7f888c15bea0 secure :-1 s=READY pgs=87 gs=3 cs=0 l=1 c_cookie=13045937175847074771 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8888004740 tx=0x7f888802f110 comp rx=0 tx=0).stop 2026-02-23T06:47:08.689 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.693+0000 7f88929c9640 1 -- 10.20.193.58:0/1710909740 shutdown_connections 2026-02-23T06:47:08.689 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.693+0000 7f88929c9640 1 --2- 10.20.193.58:0/1710909740 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f888c0b5d90 0x7f888c15bea0 unknown :-1 s=CLOSED pgs=87 gs=3 cs=0 l=1 c_cookie=13045937175847074771 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:08.689 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.693+0000 7f88929c9640 1 -- 10.20.193.58:0/1710909740 >> 10.20.193.58:0/1710909740 conn(0x7f888c0b3c20 msgr2=0x7f888c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:08.689 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.693+0000 7f88929c9640 1 -- 10.20.193.58:0/1710909740 shutdown_connections 2026-02-23T06:47:08.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.693+0000 7f88929c9640 1 -- 10.20.193.58:0/1710909740 wait complete. 2026-02-23T06:47:08.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.694+0000 7f88929c9640 1 Processor -- start 2026-02-23T06:47:08.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.694+0000 7f88929c9640 1 -- start start 2026-02-23T06:47:08.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.695+0000 7f88929c9640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f888c05d080 0x7f888c1547f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:08.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.695+0000 7f88929c9640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f888c05d450 0x7f888c132070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:08.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.695+0000 7f88929c9640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f888c0b5d90 0x7f888c153370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:08.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.695+0000 7f88929c9640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f888c151480 con 0x7f888c0b5d90 2026-02-23T06:47:08.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.695+0000 7f88929c9640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f888c154d30 con 0x7f888c05d080 2026-02-23T06:47:08.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.695+0000 7f88929c9640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f888c152ee0 con 0x7f888c05d450 2026-02-23T06:47:08.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.695+0000 7f88921c8640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f888c0b5d90 0x7f888c153370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:08.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.695+0000 7f88911c6640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f888c05d450 0x7f888c132070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:08.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.695+0000 7f88921c8640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f888c0b5d90 0x7f888c153370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:54236/0 (socket says 10.20.193.58:54236) 2026-02-23T06:47:08.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.695+0000 7f88921c8640 1 -- 10.20.193.58:0/1778352447 learned_addr learned my addr 10.20.193.58:0/1778352447 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:47:08.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.695+0000 7f88919c7640 1 --2- 10.20.193.58:0/1778352447 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f888c05d080 0x7f888c1547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:08.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.695+0000 7f88921c8640 1 -- 10.20.193.58:0/1778352447 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f888c0b5d90 msgr2=0x7f888c153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-23T06:47:08.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.695+0000 7f88921c8640 1 -- 10.20.193.58:0/1778352447 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f888c0b5d90 msgr2=0x7f888c153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:47:08.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.695+0000 7f88921c8640 1 --2- 10.20.193.58:0/1778352447 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f888c0b5d90 0x7f888c153370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:47:08.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.696+0000 7f88921c8640 1 --2- 10.20.193.58:0/1778352447 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f888c0b5d90 0x7f888c153370 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:47:08.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.696+0000 7f88919c7640 1 -- 10.20.193.58:0/1778352447 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f888c05d450 msgr2=0x7f888c132070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:08.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.696+0000 7f88919c7640 1 --2- 10.20.193.58:0/1778352447 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f888c05d450 0x7f888c132070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:08.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.696+0000 7f88919c7640 1 -- 10.20.193.58:0/1778352447 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f888c0b5d90 msgr2=0x7f888c153370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:47:08.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.696+0000 7f88919c7640 1 --2- 10.20.193.58:0/1778352447 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f888c0b5d90 0x7f888c153370 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:08.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.696+0000 7f88919c7640 1 -- 10.20.193.58:0/1778352447 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88880094b0 con 0x7f888c05d080 2026-02-23T06:47:08.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.696+0000 7f88919c7640 1 --2- 10.20.193.58:0/1778352447 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f888c05d080 0x7f888c1547f0 secure :-1 s=READY pgs=88 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f887c003810 tx=0x7f887c00d990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:08.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.697+0000 7f887a7fc640 1 -- 10.20.193.58:0/1778352447 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f887c013850 con 0x7f888c05d080 2026-02-23T06:47:08.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.697+0000 7f887a7fc640 1 -- 10.20.193.58:0/1778352447 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f887c013aa0 con 0x7f888c05d080 2026-02-23T06:47:08.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.697+0000 7f887a7fc640 1 -- 10.20.193.58:0/1778352447 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f887c013e50 con 0x7f888c05d080 2026-02-23T06:47:08.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.697+0000 7f88929c9640 1 -- 10.20.193.58:0/1778352447 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f888c158010 con 0x7f888c05d080 2026-02-23T06:47:08.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.697+0000 7f88929c9640 1 -- 10.20.193.58:0/1778352447 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f888c1516b0 con 0x7f888c05d080 2026-02-23T06:47:08.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.697+0000 7f88929c9640 1 -- 10.20.193.58:0/1778352447 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f888c165880 con 0x7f888c05d080 2026-02-23T06:47:08.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.699+0000 7f887a7fc640 1 -- 10.20.193.58:0/1778352447 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f887c01c400 con 0x7f888c05d080 2026-02-23T06:47:08.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.700+0000 7f887a7fc640 1 --2- 10.20.193.58:0/1778352447 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f885c07a790 0x7f885c09ac40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:08.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.700+0000 7f887a7fc640 1 -- 10.20.193.58:0/1778352447 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f887c09eab0 con 0x7f888c05d080 2026-02-23T06:47:08.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.701+0000 7f887a7fc640 1 -- 10.20.193.58:0/1778352447 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f887c0d7720 con 0x7f888c05d080 2026-02-23T06:47:08.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.701+0000 7f88911c6640 1 --2- 10.20.193.58:0/1778352447 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f885c07a790 0x7f885c09ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:08.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.702+0000 7f88911c6640 1 --2- 10.20.193.58:0/1778352447 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f885c07a790 0x7f885c09ac40 secure :-1 s=READY pgs=537 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f888c132d30 tx=0x7f8880007de0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:08.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.855+0000 7f88929c9640 1 -- 10.20.193.58:0/1778352447 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f888c157fb0 con 0x7f888c05d080 2026-02-23T06:47:08.850 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.855+0000 7f887a7fc640 1 -- 10.20.193.58:0/1778352447 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f887c0176f0 con 0x7f888c05d080 2026-02-23T06:47:08.851 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":228,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:47:08.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.856+0000 7f88929c9640 1 -- 10.20.193.58:0/1778352447 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f885c07a790 msgr2=0x7f885c09ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:08.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.856+0000 7f88929c9640 1 --2- 10.20.193.58:0/1778352447 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f885c07a790 0x7f885c09ac40 secure :-1 s=READY pgs=537 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f888c132d30 tx=0x7f8880007de0 comp rx=0 tx=0).stop 2026-02-23T06:47:08.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.856+0000 7f88929c9640 1 -- 10.20.193.58:0/1778352447 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f888c05d080 msgr2=0x7f888c1547f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:08.852 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.856+0000 7f88929c9640 1 --2- 10.20.193.58:0/1778352447 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f888c05d080 0x7f888c1547f0 secure :-1 s=READY pgs=88 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f887c003810 tx=0x7f887c00d990 comp rx=0 tx=0).stop 2026-02-23T06:47:08.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.856+0000 7f88929c9640 1 -- 10.20.193.58:0/1778352447 shutdown_connections 2026-02-23T06:47:08.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.856+0000 7f88929c9640 1 --2- 10.20.193.58:0/1778352447 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f885c07a790 0x7f885c09ac40 unknown :-1 s=CLOSED pgs=537 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:08.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.856+0000 7f88929c9640 1 --2- 10.20.193.58:0/1778352447 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f888c0b5d90 0x7f888c153370 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:08.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.856+0000 7f88929c9640 1 --2- 10.20.193.58:0/1778352447 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f888c05d450 0x7f888c132070 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:08.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.856+0000 7f88929c9640 1 --2- 10.20.193.58:0/1778352447 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f888c05d080 0x7f888c1547f0 unknown :-1 s=CLOSED pgs=88 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:08.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.856+0000 7f88929c9640 1 -- 10.20.193.58:0/1778352447 >> 10.20.193.58:0/1778352447 conn(0x7f888c0b3c20 msgr2=0x7f888c0583c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:08.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.856+0000 7f88929c9640 1 -- 10.20.193.58:0/1778352447 shutdown_connections 2026-02-23T06:47:08.853 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.856+0000 7f88929c9640 1 -- 10.20.193.58:0/1778352447 wait complete. 2026-02-23T06:47:08.864 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:47:08.864 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:47:08.864 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:47:08.988 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.992+0000 7fe429954640 1 -- 10.20.193.58:0/99894279 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe424056550 msgr2=0x7fe42405ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:08.988 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.992+0000 7fe429954640 1 --2- 10.20.193.58:0/99894279 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe424056550 0x7fe42405ce30 secure :-1 s=READY pgs=5 gs=3 cs=0 l=1 c_cookie=13461501994297972157 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe40c004740 tx=0x7fe40c02f250 comp rx=0 tx=0).stop 2026-02-23T06:47:08.988 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.992+0000 7fe429954640 1 -- 10.20.193.58:0/99894279 shutdown_connections 2026-02-23T06:47:08.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.992+0000 7fe429954640 1 --2- 10.20.193.58:0/99894279 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe424056550 0x7fe42405ce30 unknown :-1 s=CLOSED pgs=5 gs=3 cs=0 l=1 c_cookie=13461501994297972157 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:08.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.992+0000 7fe429954640 1 -- 10.20.193.58:0/99894279 >> 10.20.193.58:0/99894279 conn(0x7fe4240b3c20 msgr2=0x7fe4240b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:08.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.992+0000 7fe429954640 1 -- 10.20.193.58:0/99894279 shutdown_connections 2026-02-23T06:47:08.989 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.992+0000 7fe429954640 1 -- 10.20.193.58:0/99894279 wait complete. 2026-02-23T06:47:08.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.993+0000 7fe429954640 1 Processor -- start 2026-02-23T06:47:08.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.993+0000 7fe429954640 1 -- start start 2026-02-23T06:47:08.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.994+0000 7fe429954640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe424056550 0x7fe424201420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:08.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.994+0000 7fe429954640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe42405d370 0x7fe424201960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:08.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.994+0000 7fe429954640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe42415c040 0x7fe4241ff610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:08.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.994+0000 7fe429954640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe4241579a0 con 0x7fe42405d370 2026-02-23T06:47:08.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.994+0000 7fe429954640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe4241ff180 con 0x7fe424056550 2026-02-23T06:47:08.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.994+0000 7fe429954640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe424155410 con 0x7fe42415c040 2026-02-23T06:47:08.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.994+0000 7fe41bfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe42405d370 0x7fe424201960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:08.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.994+0000 7fe41bfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe42405d370 0x7fe424201960 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:33104/0 (socket says 10.20.193.58:33104) 2026-02-23T06:47:08.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.994+0000 7fe41bfff640 1 -- 10.20.193.58:0/672553916 learned_addr learned my addr 10.20.193.58:0/672553916 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:47:08.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.994+0000 7fe428952640 1 --2- 10.20.193.58:0/672553916 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe424056550 0x7fe424201420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:08.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.994+0000 7fe41bfff640 1 -- 10.20.193.58:0/672553916 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe42415c040 msgr2=0x7fe4241ff610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:08.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.994+0000 7fe41bfff640 1 --2- 10.20.193.58:0/672553916 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe42415c040 0x7fe4241ff610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:08.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.994+0000 7fe41bfff640 1 -- 10.20.193.58:0/672553916 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe424056550 msgr2=0x7fe424201420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:08.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.994+0000 7fe41bfff640 1 --2- 10.20.193.58:0/672553916 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe424056550 0x7fe424201420 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:08.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.994+0000 7fe41bfff640 1 -- 10.20.193.58:0/672553916 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe40c0094b0 con 0x7fe42405d370 2026-02-23T06:47:08.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.995+0000 7fe41bfff640 1 --2- 10.20.193.58:0/672553916 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe42405d370 0x7fe424201960 secure :-1 s=READY pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe40c0023d0 tx=0x7fe40c002cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:08.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.995+0000 7fe4197fa640 1 -- 10.20.193.58:0/672553916 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe40c044070 con 0x7fe42405d370 2026-02-23T06:47:08.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.995+0000 7fe4197fa640 1 -- 10.20.193.58:0/672553916 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe40c004b80 con 0x7fe42405d370 2026-02-23T06:47:08.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.995+0000 7fe429954640 1 -- 10.20.193.58:0/672553916 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe424201ff0 con 0x7fe42405d370 2026-02-23T06:47:08.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.995+0000 7fe4197fa640 1 -- 10.20.193.58:0/672553916 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe40c02fcf0 con 0x7fe42405d370 2026-02-23T06:47:08.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.995+0000 7fe429954640 1 -- 10.20.193.58:0/672553916 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe424155b70 con 0x7fe42405d370 2026-02-23T06:47:08.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.995+0000 7fe3f2ffd640 1 --2- 10.20.193.58:0/672553916 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3e80041f0 0x7fe3e80246a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:08.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.995+0000 7fe3f2ffd640 1 -- 10.20.193.58:0/672553916 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e8025f20 con 0x7fe3e80041f0 2026-02-23T06:47:08.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.996+0000 7fe428952640 1 --2- 10.20.193.58:0/672553916 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3e80041f0 0x7fe3e80246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:08.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.996+0000 7fe428952640 1 -- 10.20.193.58:0/672553916 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe3e80260e0 con 0x7fe3e80041f0 2026-02-23T06:47:08.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.996+0000 7fe428952640 1 --2- 10.20.193.58:0/672553916 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3e80041f0 0x7fe3e80246a0 secure :-1 s=READY pgs=7 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4140027d0 tx=0x7fe41400e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:08.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.996+0000 7fe4197fa640 1 -- 10.20.193.58:0/672553916 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe414019070 con 0x7fe3e80041f0 2026-02-23T06:47:08.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.996+0000 7fe4197fa640 1 -- 10.20.193.58:0/672553916 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fe414005240 con 0x7fe3e80041f0 2026-02-23T06:47:08.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.996+0000 7fe4197fa640 1 -- 10.20.193.58:0/672553916 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3e80041f0 msgr2=0x7fe3e80246a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:08.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.996+0000 7fe4197fa640 1 --2- 10.20.193.58:0/672553916 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3e80041f0 0x7fe3e80246a0 secure :-1 s=READY pgs=7 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4140027d0 tx=0x7fe41400e990 comp rx=0 tx=0).stop 2026-02-23T06:47:08.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.996+0000 7fe4197fa640 1 -- 10.20.193.58:0/672553916 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3e80041f0 msgr2=0x7fe3e80246a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:47:08.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.996+0000 7fe4197fa640 1 --2- 10.20.193.58:0/672553916 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3e80041f0 0x7fe3e80246a0 unknown :-1 s=CLOSED pgs=7 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:08.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.997+0000 7fe4197fa640 1 -- 10.20.193.58:0/672553916 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fe40c004fb0 con 0x7fe42405d370 2026-02-23T06:47:08.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.998+0000 7fe4197fa640 1 --2- 10.20.193.58:0/672553916 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe3f407a3c0 0x7fe3f409a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:08.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.998+0000 7fe4197fa640 1 -- 10.20.193.58:0/672553916 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fe40c0c28f0 con 0x7fe42405d370 2026-02-23T06:47:08.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.998+0000 7fe428952640 1 --2- 10.20.193.58:0/672553916 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe3f407a3c0 0x7fe3f409a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:08.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:08.999+0000 7fe428952640 1 --2- 10.20.193.58:0/672553916 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe3f407a3c0 0x7fe3f409a870 secure :-1 s=READY pgs=538 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4140027a0 tx=0x7fe414014000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:08.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.000+0000 7fe3f2ffd640 1 --2- 10.20.193.58:0/672553916 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3e8025030 0x7fe3e80254b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:08.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.000+0000 7fe3f2ffd640 1 -- 10.20.193.58:0/672553916 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e8025a90 con 0x7fe3e8025030 2026-02-23T06:47:08.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.000+0000 7fe429153640 1 --2- 10.20.193.58:0/672553916 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3e8025030 0x7fe3e80254b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:08.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.000+0000 7fe429153640 1 -- 10.20.193.58:0/672553916 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe3e8025c50 con 0x7fe3e8025030 2026-02-23T06:47:08.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.000+0000 7fe429153640 1 --2- 10.20.193.58:0/672553916 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3e8025030 0x7fe3e80254b0 secure :-1 s=READY pgs=8 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe420008fd0 tx=0x7fe42000d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:08.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.001+0000 7fe4197fa640 1 -- 10.20.193.58:0/672553916 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe420007b90 con 0x7fe3e8025030 2026-02-23T06:47:08.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.001+0000 7fe4197fa640 1 -- 10.20.193.58:0/672553916 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4911 (secure 0 0 0) 0x7fe420007cf0 con 0x7fe3e8025030 2026-02-23T06:47:08.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.001+0000 7fe4197fa640 1 -- 10.20.193.58:0/672553916 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3e8025030 msgr2=0x7fe3e80254b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:08.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.001+0000 7fe4197fa640 1 --2- 10.20.193.58:0/672553916 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3e8025030 0x7fe3e80254b0 secure :-1 s=READY pgs=8 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe420008fd0 tx=0x7fe42000d8f0 comp rx=0 tx=0).stop 2026-02-23T06:47:08.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.001+0000 7fe4197fa640 1 -- 10.20.193.58:0/672553916 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3e8025030 msgr2=0x7fe3e80254b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:47:08.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.001+0000 7fe4197fa640 1 --2- 10.20.193.58:0/672553916 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3e8025030 0x7fe3e80254b0 unknown :-1 s=CLOSED pgs=8 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:08.999 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:47:09.000 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:47:09.000 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:47:09.000 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:47:09.000 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 228, 2026-02-23T06:47:09.000 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 320, 2026-02-23T06:47:09.000 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:47:09.000 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:47:09.000 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:47:09.000 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:47:09.001 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:09.001 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:47:09.001 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:47:09.001 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:47:09.001 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:47:09.001 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:09.001 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:09.001 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:09.001 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:09.001 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:09.001 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:09.001 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:09.001 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:09.002 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:09.002 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:09.002 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:09.002 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:09.002 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:09.002 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:09.002 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:47:09.002 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:47:09.002 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:09.002 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:09.002 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:09.002 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:09.003 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:09.003 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:09.003 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:09.003 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:09.003 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:09.003 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:09.003 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:09.003 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:09.003 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:09.003 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:09.003 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.003 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:47:09.004 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:47:09.004 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:47:09.004 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:47:09.004 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:47:09.004 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:47:09.004 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:47:09.004 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:47:09.004 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:47:09.004 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:47:09.004 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:47:09.004 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:47:09.004 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:47:09.005 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:47:09.005 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:47:09.005 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:47:09.005 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:47:09.005 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:09.005 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:09.005 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:09.005 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:09.005 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:09.005 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:09.005 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:09.005 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:09.005 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:09.006 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:09.006 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:09.006 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:09.006 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:09.006 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:09.006 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:47:09.006 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.006 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:47:09.006 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.006 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:47:09.006 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:47:09.006 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:09.007 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:09.007 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.007 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:09.007 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:47:09.007 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:09.007 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.007 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.007 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:09.007 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:47:09.007 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:09.007 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:09.007 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:09.007 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.008 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:47:09.008 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:47:09.008 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:09.008 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:09.008 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:47:09.008 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:09.008 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.008 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.008 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:47:09.008 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:47:09.008 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:09.008 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:09.008 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.009 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:09.009 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:47:09.009 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:09.009 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.009 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.009 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:09.009 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:47:09.009 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:09.009 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:09.009 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:09.009 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.009 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:47:09.009 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:47:09.009 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:09.010 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:09.010 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:47:09.010 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:09.010 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.010 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.010 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:47:09.010 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:47:09.010 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:09.010 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:09.010 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.010 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:09.010 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:47:09.010 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:09.010 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.011 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.011 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:09.011 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:47:09.011 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:09.011 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:09.011 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:09.011 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.011 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:47:09.011 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:47:09.011 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:09.011 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:09.011 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:47:09.011 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:09.011 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:09.012 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:09.012 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.012 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:47:09.012 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:47:09.012 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.012 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:09.012 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:09.012 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:47:09.012 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:09.012 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:09.012 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:47:09.012 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.012 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:09.012 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:09.013 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:47:09.013 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:09.013 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:09.013 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.013 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:47:09.013 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:47:09.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.001+0000 7fe3f2ffd640 1 -- 10.20.193.58:0/672553916 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe3f407a3c0 msgr2=0x7fe3f409a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:09.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.001+0000 7fe3f2ffd640 1 --2- 10.20.193.58:0/672553916 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe3f407a3c0 0x7fe3f409a870 secure :-1 s=READY pgs=538 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4140027a0 tx=0x7fe414014000 comp rx=0 tx=0).stop 2026-02-23T06:47:09.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.001+0000 7fe3f2ffd640 1 -- 10.20.193.58:0/672553916 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe42405d370 msgr2=0x7fe424201960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:09.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.001+0000 7fe3f2ffd640 1 --2- 10.20.193.58:0/672553916 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe42405d370 0x7fe424201960 secure :-1 s=READY pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe40c0023d0 tx=0x7fe40c002cc0 comp rx=0 tx=0).stop 2026-02-23T06:47:09.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.001+0000 7fe429153640 1 -- 10.20.193.58:0/672553916 reap_dead start 2026-02-23T06:47:09.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.001+0000 7fe429153640 1 -- 10.20.193.58:0/672553916 reap_dead start 2026-02-23T06:47:09.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.001+0000 7fe3f2ffd640 1 -- 10.20.193.58:0/672553916 shutdown_connections 2026-02-23T06:47:09.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.001+0000 7fe3f2ffd640 1 -- 10.20.193.58:0/672553916 >> 10.20.193.58:0/672553916 conn(0x7fe4240b3c20 msgr2=0x7fe4240b61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:09.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.001+0000 7fe3f2ffd640 1 -- 10.20.193.58:0/672553916 shutdown_connections 2026-02-23T06:47:09.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.001+0000 7fe3f2ffd640 1 -- 10.20.193.58:0/672553916 wait complete. 2026-02-23T06:47:09.015 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:47:09.016 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:47:09.016 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:47:09.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.141+0000 7f1bb0b14640 1 -- 10.20.193.58:0/4193980701 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1bac15d870 msgr2=0x7f1bac0587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:09.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.141+0000 7f1bb0b14640 1 --2- 10.20.193.58:0/4193980701 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1bac15d870 0x7f1bac0587b0 secure :-1 s=READY pgs=9 gs=2 cs=0 l=1 c_cookie=239180096368000953 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b9c005e70 tx=0x7f1b9c02f290 comp rx=0 tx=0).stop 2026-02-23T06:47:09.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.141+0000 7f1bb0b14640 1 -- 10.20.193.58:0/4193980701 shutdown_connections 2026-02-23T06:47:09.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.141+0000 7f1bb0b14640 1 --2- 10.20.193.58:0/4193980701 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1bac15d870 0x7f1bac0587b0 unknown :-1 s=CLOSED pgs=9 gs=2 cs=0 l=1 c_cookie=239180096368000953 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:09.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.141+0000 7f1bb0b14640 1 --2- 10.20.193.58:0/4193980701 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1bac15d4a0 0x7f1bac0affb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:09.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.141+0000 7f1bb0b14640 1 -- 10.20.193.58:0/4193980701 >> 10.20.193.58:0/4193980701 conn(0x7f1bac0b3c20 msgr2=0x7f1bac0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:09.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.141+0000 7f1bb0b14640 1 -- 10.20.193.58:0/4193980701 shutdown_connections 2026-02-23T06:47:09.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.141+0000 7f1bb0b14640 1 -- 10.20.193.58:0/4193980701 wait complete. 2026-02-23T06:47:09.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.142+0000 7f1bb0b14640 1 Processor -- start 2026-02-23T06:47:09.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.143+0000 7f1bb0b14640 1 -- start start 2026-02-23T06:47:09.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.143+0000 7f1bb0b14640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1bac0b6690 0x7f1bac1610a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:09.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.143+0000 7f1bb0b14640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1bac15d4a0 0x7f1bac124d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:09.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.143+0000 7f1bb0b14640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1bac15d870 0x7f1bac122770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:09.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.143+0000 7f1bb0b14640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac161af0 con 0x7f1bac15d870 2026-02-23T06:47:09.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.143+0000 7f1bb0b14640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac121740 con 0x7f1bac0b6690 2026-02-23T06:47:09.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.143+0000 7f1bb0b14640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f1bac0ae680 con 0x7f1bac15d4a0 2026-02-23T06:47:09.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.143+0000 7f1babfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1bac15d870 0x7f1bac122770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:09.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.143+0000 7f1bab7fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1bac0b6690 0x7f1bac1610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:09.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.143+0000 7f1babfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1bac15d870 0x7f1bac122770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:33148/0 (socket says 10.20.193.58:33148) 2026-02-23T06:47:09.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.143+0000 7f1babfff640 1 -- 10.20.193.58:0/3370731273 learned_addr learned my addr 10.20.193.58:0/3370731273 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:47:09.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.143+0000 7f1baaffd640 1 --2- 10.20.193.58:0/3370731273 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1bac15d4a0 0x7f1bac124d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:09.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.143+0000 7f1babfff640 1 -- 10.20.193.58:0/3370731273 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1bac15d4a0 msgr2=0x7f1bac124d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:09.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.143+0000 7f1babfff640 1 --2- 10.20.193.58:0/3370731273 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f1bac15d4a0 0x7f1bac124d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:09.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.143+0000 7f1babfff640 1 -- 10.20.193.58:0/3370731273 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1bac0b6690 msgr2=0x7f1bac1610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:09.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.144+0000 7f1babfff640 1 --2- 10.20.193.58:0/3370731273 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1bac0b6690 0x7f1bac1610a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:09.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.144+0000 7f1babfff640 1 -- 10.20.193.58:0/3370731273 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b9c009570 con 0x7f1bac15d870 2026-02-23T06:47:09.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.144+0000 7f1bab7fe640 1 --2- 10.20.193.58:0/3370731273 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1bac0b6690 0x7f1bac1610a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:47:09.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.144+0000 7f1babfff640 1 --2- 10.20.193.58:0/3370731273 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1bac15d870 0x7f1bac122770 secure :-1 s=READY pgs=10 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ba000d550 tx=0x7f1ba000da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:09.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.144+0000 7f1b87fff640 1 -- 10.20.193.58:0/3370731273 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ba0007b90 con 0x7f1bac15d870 2026-02-23T06:47:09.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.144+0000 7f1b87fff640 1 -- 10.20.193.58:0/3370731273 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ba0007de0 con 0x7f1bac15d870 2026-02-23T06:47:09.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.144+0000 7f1b87fff640 1 -- 10.20.193.58:0/3370731273 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ba00062b0 con 0x7f1bac15d870 2026-02-23T06:47:09.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.144+0000 7f1bb0b14640 1 -- 10.20.193.58:0/3370731273 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bac161cd0 con 0x7f1bac15d870 2026-02-23T06:47:09.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.144+0000 7f1bb0b14640 1 -- 10.20.193.58:0/3370731273 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bac162290 con 0x7f1bac15d870 2026-02-23T06:47:09.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.144+0000 7f1bb0b14640 1 --2- 10.20.193.58:0/3370731273 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1bac122cb0 0x7f1bac13efa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:09.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.144+0000 7f1bb0b14640 1 -- 10.20.193.58:0/3370731273 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac161e60 con 0x7f1bac122cb0 2026-02-23T06:47:09.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.145+0000 7f1bab7fe640 1 --2- 10.20.193.58:0/3370731273 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1bac122cb0 0x7f1bac13efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:09.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.145+0000 7f1bab7fe640 1 -- 10.20.193.58:0/3370731273 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1bac0b6330 con 0x7f1bac122cb0 2026-02-23T06:47:09.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.145+0000 7f1bab7fe640 1 --2- 10.20.193.58:0/3370731273 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1bac122cb0 0x7f1bac13efa0 secure :-1 s=READY pgs=91 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b9800f900 tx=0x7f1b9800fdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:09.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.146+0000 7f1b87fff640 1 -- 10.20.193.58:0/3370731273 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b9800db50 con 0x7f1bac122cb0 2026-02-23T06:47:09.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.146+0000 7f1b87fff640 1 -- 10.20.193.58:0/3370731273 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f1b9800dcb0 con 0x7f1bac122cb0 2026-02-23T06:47:09.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.146+0000 7f1b87fff640 1 -- 10.20.193.58:0/3370731273 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1bac122cb0 msgr2=0x7f1bac13efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:09.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.146+0000 7f1b87fff640 1 --2- 10.20.193.58:0/3370731273 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1bac122cb0 0x7f1bac13efa0 secure :-1 s=READY pgs=91 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b9800f900 tx=0x7f1b9800fdd0 comp rx=0 tx=0).stop 2026-02-23T06:47:09.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.146+0000 7f1b87fff640 1 -- 10.20.193.58:0/3370731273 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1bac122cb0 msgr2=0x7f1bac13efa0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:47:09.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.146+0000 7f1b87fff640 1 --2- 10.20.193.58:0/3370731273 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1bac122cb0 0x7f1bac13efa0 secure :-1 s=CLOSED pgs=91 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b9800f900 tx=0x7f1b9800fdd0 comp rx=0 tx=0).stop 2026-02-23T06:47:09.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.147+0000 7f1b87fff640 1 -- 10.20.193.58:0/3370731273 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f1ba0006410 con 0x7f1bac15d870 2026-02-23T06:47:09.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.148+0000 7f1b87fff640 1 --2- 10.20.193.58:0/3370731273 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1b7c07e940 0x7f1b7c09edf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:09.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.148+0000 7f1b87fff640 1 -- 10.20.193.58:0/3370731273 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f1ba009e240 con 0x7f1bac15d870 2026-02-23T06:47:09.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.148+0000 7f1bb0b14640 1 --2- 10.20.193.58:0/3370731273 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1bac13f4e0 0x7f1bac13f8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:09.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.148+0000 7f1bb0b14640 1 -- 10.20.193.58:0/3370731273 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac164250 con 0x7f1bac13f4e0 2026-02-23T06:47:09.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.156+0000 7f1baaffd640 1 --2- 10.20.193.58:0/3370731273 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1bac13f4e0 0x7f1bac13f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:09.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.156+0000 7f1bab7fe640 1 --2- 10.20.193.58:0/3370731273 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1b7c07e940 0x7f1b7c09edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:09.152 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.156+0000 7f1baaffd640 1 -- 10.20.193.58:0/3370731273 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1bac0b6d50 con 0x7f1bac13f4e0 2026-02-23T06:47:09.152 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.156+0000 7f1bab7fe640 1 --2- 10.20.193.58:0/3370731273 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1b7c07e940 0x7f1b7c09edf0 secure :-1 s=READY pgs=539 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b9800f900 tx=0x7f1b98014000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:09.152 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.156+0000 7f1baaffd640 1 --2- 10.20.193.58:0/3370731273 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1bac13f4e0 0x7f1bac13f8b0 secure :-1 s=READY pgs=92 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1bac0b1d30 tx=0x7f1b9c0028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:09.152 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.156+0000 7f1b87fff640 1 -- 10.20.193.58:0/3370731273 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b9c03d050 con 0x7f1bac13f4e0 2026-02-23T06:47:09.152 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.156+0000 7f1b87fff640 1 -- 10.20.193.58:0/3370731273 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5556 (secure 0 0 0) 0x7f1b9c03e040 con 0x7f1bac13f4e0 2026-02-23T06:47:09.152 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.156+0000 7f1b87fff640 1 -- 10.20.193.58:0/3370731273 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1bac13f4e0 msgr2=0x7f1bac13f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:09.153 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:47:09.153 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:47:09.153 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:47:09.153 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:47:09.153 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 228, 2026-02-23T06:47:09.153 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 115515, 2026-02-23T06:47:09.153 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:47:09.154 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:47:09.154 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:47:09.154 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:47:09.154 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:09.154 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:47:09.154 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:47:09.154 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:47:09.154 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:47:09.154 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:09.154 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:09.154 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:09.154 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:09.155 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:09.155 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:09.155 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:09.155 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:09.155 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:09.155 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:09.155 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:09.155 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:09.155 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:09.155 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:09.155 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:47:09.155 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:47:09.156 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:09.156 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:09.156 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:09.156 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:09.156 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:09.156 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:09.156 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:09.156 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:09.156 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:09.156 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:09.156 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:09.156 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:09.157 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:09.157 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:09.157 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.157 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:47:09.157 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:47:09.157 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:47:09.157 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:47:09.157 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:47:09.157 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:47:09.157 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:47:09.157 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:47:09.157 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:47:09.158 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:47:09.158 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:47:09.158 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:47:09.158 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:47:09.158 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:47:09.158 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:47:09.158 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:47:09.158 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:47:09.158 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:09.158 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:09.158 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:09.158 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:09.158 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:09.159 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:09.159 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:09.159 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:09.159 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:09.159 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:09.159 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:09.159 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:09.159 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:09.159 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:09.159 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:47:09.159 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.159 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:47:09.160 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.160 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:47:09.160 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:47:09.160 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:09.160 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:09.160 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.160 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:09.160 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:47:09.160 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:09.160 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.160 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.160 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:09.160 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:47:09.161 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:09.161 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:09.161 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:09.161 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.161 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:47:09.161 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:47:09.161 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:09.161 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:09.161 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:47:09.161 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:09.161 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.161 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.162 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:47:09.162 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:47:09.162 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:09.162 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:09.162 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.162 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:09.162 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:47:09.162 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:09.162 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.162 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.162 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:09.162 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:47:09.162 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:09.163 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:09.163 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:09.163 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.163 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:47:09.163 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:47:09.163 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:09.163 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:09.163 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:47:09.163 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:09.163 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.163 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.163 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:47:09.163 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:47:09.164 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:09.164 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:09.164 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.164 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:09.164 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:47:09.164 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:09.164 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.164 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.164 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:09.164 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:47:09.164 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:09.164 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:09.165 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:09.165 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.165 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:47:09.165 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:47:09.165 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:09.165 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:09.165 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:47:09.165 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:09.165 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:09.165 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:09.165 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.165 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:47:09.165 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:47:09.166 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.166 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:09.166 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:09.166 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:47:09.166 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:09.166 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:09.166 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:47:09.166 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.166 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:09.166 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:09.166 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:47:09.166 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:09.167 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:09.167 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:47:09.167 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.167 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:09.167 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:09.167 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:47:09.167 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:09.167 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:09.167 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:47:09.167 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.167 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:47:09.167 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:47:09.167 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:47:09.168 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.168 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.168 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:09.168 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:09.168 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:47:09.168 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:09.168 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:09.168 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:47:09.168 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.168 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:09.168 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:09.168 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:47:09.168 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:09.169 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:09.169 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.169 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:47:09.169 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:47:09.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.156+0000 7f1b87fff640 1 --2- 10.20.193.58:0/3370731273 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1bac13f4e0 0x7f1bac13f8b0 secure :-1 s=READY pgs=92 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1bac0b1d30 tx=0x7f1b9c0028d0 comp rx=0 tx=0).stop 2026-02-23T06:47:09.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.156+0000 7f1b87fff640 1 -- 10.20.193.58:0/3370731273 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1bac13f4e0 msgr2=0x7f1bac13f8b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:47:09.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.156+0000 7f1b87fff640 1 --2- 10.20.193.58:0/3370731273 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f1bac13f4e0 0x7f1bac13f8b0 unknown :-1 s=CLOSED pgs=92 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:09.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.157+0000 7f1bb0b14640 1 -- 10.20.193.58:0/3370731273 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1b7c07e940 msgr2=0x7f1b7c09edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:09.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.157+0000 7f1bb0b14640 1 --2- 10.20.193.58:0/3370731273 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f1b7c07e940 0x7f1b7c09edf0 secure :-1 s=READY pgs=539 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b9800f900 tx=0x7f1b98014000 comp rx=0 tx=0).stop 2026-02-23T06:47:09.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.157+0000 7f1bb0b14640 1 -- 10.20.193.58:0/3370731273 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1bac15d870 msgr2=0x7f1bac122770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:09.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.157+0000 7f1bb0b14640 1 --2- 10.20.193.58:0/3370731273 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f1bac15d870 0x7f1bac122770 secure :-1 s=READY pgs=10 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ba000d550 tx=0x7f1ba000da20 comp rx=0 tx=0).stop 2026-02-23T06:47:09.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.157+0000 7f1babfff640 1 -- 10.20.193.58:0/3370731273 reap_dead start 2026-02-23T06:47:09.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.157+0000 7f1babfff640 1 -- 10.20.193.58:0/3370731273 reap_dead start 2026-02-23T06:47:09.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.157+0000 7f1bb0b14640 1 -- 10.20.193.58:0/3370731273 shutdown_connections 2026-02-23T06:47:09.171 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.157+0000 7f1bb0b14640 1 -- 10.20.193.58:0/3370731273 >> 10.20.193.58:0/3370731273 conn(0x7f1bac0b3c20 msgr2=0x7f1bac0585b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:09.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.157+0000 7f1bb0b14640 1 -- 10.20.193.58:0/3370731273 shutdown_connections 2026-02-23T06:47:09.172 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.157+0000 7f1bb0b14640 1 -- 10.20.193.58:0/3370731273 wait complete. 2026-02-23T06:47:09.172 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:47:09.172 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:47:09.173 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:47:09.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.299+0000 7fc19d54b640 1 -- 10.20.193.58:0/3019416649 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc19815c4b0 msgr2=0x7fc198058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:09.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.299+0000 7fc19d54b640 1 --2- 10.20.193.58:0/3019416649 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc19815c4b0 0x7fc198058200 secure :-1 s=READY pgs=11 gs=1 cs=0 l=1 c_cookie=3458549170528274399 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc198062070 tx=0x7fc18402f200 comp rx=0 tx=0).stop 2026-02-23T06:47:09.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.299+0000 7fc19d54b640 1 -- 10.20.193.58:0/3019416649 shutdown_connections 2026-02-23T06:47:09.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.299+0000 7fc19d54b640 1 --2- 10.20.193.58:0/3019416649 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc198162ca0 0x7fc1980b6c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:09.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.299+0000 7fc19d54b640 1 --2- 10.20.193.58:0/3019416649 >> v2:10.20.193.93:3300/0 conn(0x7fc198056960 0x7fc1980b6720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:09.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.299+0000 7fc19d54b640 1 --2- 10.20.193.58:0/3019416649 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc19815c4b0 0x7fc198058200 unknown :-1 s=CLOSED pgs=11 gs=1 cs=0 l=1 c_cookie=3458549170528274399 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:09.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.299+0000 7fc19d54b640 1 -- 10.20.193.58:0/3019416649 >> 10.20.193.58:0/3019416649 conn(0x7fc1980b3c20 msgr2=0x7fc1980b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:09.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.300+0000 7fc19d54b640 1 -- 10.20.193.58:0/3019416649 shutdown_connections 2026-02-23T06:47:09.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.300+0000 7fc19d54b640 1 -- 10.20.193.58:0/3019416649 wait complete. 2026-02-23T06:47:09.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.301+0000 7fc19d54b640 1 Processor -- start 2026-02-23T06:47:09.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.301+0000 7fc19d54b640 1 -- start start 2026-02-23T06:47:09.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.301+0000 7fc19d54b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc198056960 0x7fc19813e940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:09.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.301+0000 7fc19d54b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc19815c4b0 0x7fc1980b0480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:09.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.301+0000 7fc19d54b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc198162ca0 0x7fc1981405a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:09.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.301+0000 7fc19d54b640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc19813be70 con 0x7fc198162ca0 2026-02-23T06:47:09.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.301+0000 7fc19d54b640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc198140110 con 0x7fc198056960 2026-02-23T06:47:09.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.301+0000 7fc19d54b640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc19813f850 con 0x7fc19815c4b0 2026-02-23T06:47:09.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.302+0000 7fc197fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc198056960 0x7fc19813e940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:09.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.302+0000 7fc19cd4a640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc198162ca0 0x7fc1981405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:09.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.302+0000 7fc197fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc198056960 0x7fc19813e940 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:58472/0 (socket says 10.20.193.58:58472) 2026-02-23T06:47:09.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.302+0000 7fc197fff640 1 -- 10.20.193.58:0/1282120769 learned_addr learned my addr 10.20.193.58:0/1282120769 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:47:09.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.302+0000 7fc1977fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc19815c4b0 0x7fc1980b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:09.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.302+0000 7fc19cd4a640 1 -- 10.20.193.58:0/1282120769 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc19815c4b0 msgr2=0x7fc1980b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:09.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.302+0000 7fc19cd4a640 1 --2- 10.20.193.58:0/1282120769 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc19815c4b0 0x7fc1980b0480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:09.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.302+0000 7fc19cd4a640 1 -- 10.20.193.58:0/1282120769 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc198056960 msgr2=0x7fc19813e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:09.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.302+0000 7fc19cd4a640 1 --2- 10.20.193.58:0/1282120769 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc198056960 0x7fc19813e940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:09.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.302+0000 7fc19cd4a640 1 -- 10.20.193.58:0/1282120769 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1880094b0 con 0x7fc198162ca0 2026-02-23T06:47:09.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.302+0000 7fc197fff640 1 --2- 10.20.193.58:0/1282120769 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc198056960 0x7fc19813e940 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:47:09.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.302+0000 7fc19cd4a640 1 --2- 10.20.193.58:0/1282120769 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc198162ca0 0x7fc1981405a0 secure :-1 s=READY pgs=12 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc18c00f970 tx=0x7fc18c00fe40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:09.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.302+0000 7fc194ff9640 1 -- 10.20.193.58:0/1282120769 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc18c00dc60 con 0x7fc198162ca0 2026-02-23T06:47:09.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.302+0000 7fc194ff9640 1 -- 10.20.193.58:0/1282120769 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc18c00ddc0 con 0x7fc198162ca0 2026-02-23T06:47:09.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.302+0000 7fc19d54b640 1 -- 10.20.193.58:0/1282120769 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc184009570 con 0x7fc198162ca0 2026-02-23T06:47:09.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.302+0000 7fc194ff9640 1 -- 10.20.193.58:0/1282120769 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc18c005bb0 con 0x7fc198162ca0 2026-02-23T06:47:09.301 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.302+0000 7fc19d54b640 1 -- 10.20.193.58:0/1282120769 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc198201900 con 0x7fc198162ca0 2026-02-23T06:47:09.302 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.303+0000 7fc19d54b640 1 --2- 10.20.193.58:0/1282120769 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc198140ae0 0x7fc19813fac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:09.302 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.303+0000 7fc19d54b640 1 -- 10.20.193.58:0/1282120769 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc198059690 con 0x7fc198140ae0 2026-02-23T06:47:09.302 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.303+0000 7fc197fff640 1 --2- 10.20.193.58:0/1282120769 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc198140ae0 0x7fc19813fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:09.302 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.303+0000 7fc197fff640 1 -- 10.20.193.58:0/1282120769 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc1980593b0 con 0x7fc198140ae0 2026-02-23T06:47:09.302 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.304+0000 7fc197fff640 1 --2- 10.20.193.58:0/1282120769 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc198140ae0 0x7fc19813fac0 secure :-1 s=READY pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc1840023d0 tx=0x7fc1840028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:09.302 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.304+0000 7fc194ff9640 1 -- 10.20.193.58:0/1282120769 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc184005bb0 con 0x7fc198140ae0 2026-02-23T06:47:09.302 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.304+0000 7fc194ff9640 1 -- 10.20.193.58:0/1282120769 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fc18c020060 con 0x7fc198162ca0 2026-02-23T06:47:09.304 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.305+0000 7fc194ff9640 1 --2- 10.20.193.58:0/1282120769 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc16807a660 0x7fc16809ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:09.304 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.305+0000 7fc194ff9640 1 -- 10.20.193.58:0/1282120769 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fc18c015070 con 0x7fc198162ca0 2026-02-23T06:47:09.304 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.305+0000 7fc194ff9640 1 -- 10.20.193.58:0/1282120769 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fc184004550 con 0x7fc198140ae0 2026-02-23T06:47:09.304 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.305+0000 7fc194ff9640 1 -- 10.20.193.58:0/1282120769 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc198140ae0 msgr2=0x7fc19813fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:09.304 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.305+0000 7fc194ff9640 1 --2- 10.20.193.58:0/1282120769 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc198140ae0 0x7fc19813fac0 secure :-1 s=READY pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc1840023d0 tx=0x7fc1840028d0 comp rx=0 tx=0).stop 2026-02-23T06:47:09.304 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.305+0000 7fc194ff9640 1 -- 10.20.193.58:0/1282120769 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc198140ae0 msgr2=0x7fc19813fac0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:47:09.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.305+0000 7fc194ff9640 1 --2- 10.20.193.58:0/1282120769 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc198140ae0 0x7fc19813fac0 secure :-1 s=CLOSED pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc1840023d0 tx=0x7fc1840028d0 comp rx=0 tx=0).stop 2026-02-23T06:47:09.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.305+0000 7fc1977fe640 1 --2- 10.20.193.58:0/1282120769 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc16807a660 0x7fc16809ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:09.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.306+0000 7fc1977fe640 1 --2- 10.20.193.58:0/1282120769 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc16807a660 0x7fc16809ab10 secure :-1 s=READY pgs=540 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc1980b5ac0 tx=0x7fc188005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:09.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.308+0000 7fc19d54b640 1 --2- 10.20.193.58:0/1282120769 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc1981591f0 0x7fc1981595f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:09.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.308+0000 7fc19d54b640 1 -- 10.20.193.58:0/1282120769 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc1981402c0 con 0x7fc1981591f0 2026-02-23T06:47:09.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.309+0000 7fc197fff640 1 --2- 10.20.193.58:0/1282120769 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc1981591f0 0x7fc1981595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:09.305 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.309+0000 7fc197fff640 1 -- 10.20.193.58:0/1282120769 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc198159b30 con 0x7fc1981591f0 2026-02-23T06:47:09.306 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.309+0000 7fc197fff640 1 --2- 10.20.193.58:0/1282120769 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc1981591f0 0x7fc1981595f0 secure :-1 s=READY pgs=38 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc18402f730 tx=0x7fc184009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:09.306 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.309+0000 7fc194ff9640 1 -- 10.20.193.58:0/1282120769 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc184050070 con 0x7fc1981591f0 2026-02-23T06:47:09.306 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.310+0000 7fc194ff9640 1 -- 10.20.193.58:0/1282120769 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5412 (secure 0 0 0) 0x7fc184038e20 con 0x7fc1981591f0 2026-02-23T06:47:09.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.310+0000 7fc194ff9640 1 -- 10.20.193.58:0/1282120769 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc1981591f0 msgr2=0x7fc1981595f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:09.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.310+0000 7fc194ff9640 1 --2- 10.20.193.58:0/1282120769 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc1981591f0 0x7fc1981595f0 secure :-1 s=READY pgs=38 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc18402f730 tx=0x7fc184009310 comp rx=0 tx=0).stop 2026-02-23T06:47:09.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.310+0000 7fc194ff9640 1 -- 10.20.193.58:0/1282120769 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc1981591f0 msgr2=0x7fc1981595f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:47:09.307 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.310+0000 7fc194ff9640 1 --2- 10.20.193.58:0/1282120769 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc1981591f0 0x7fc1981595f0 secure :-1 s=CLOSED pgs=38 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc18402f730 tx=0x7fc184009310 comp rx=0 tx=0).stop 2026-02-23T06:47:09.307 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:47:09.307 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:47:09.308 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:47:09.308 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:47:09.308 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 228, 2026-02-23T06:47:09.308 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 62261, 2026-02-23T06:47:09.308 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:47:09.308 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:47:09.308 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:47:09.308 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:47:09.308 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:09.308 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:47:09.309 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:47:09.309 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:47:09.309 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:47:09.309 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:09.309 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:09.309 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:09.309 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:09.309 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:09.309 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:09.309 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:09.310 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:09.310 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:09.310 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:09.310 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:09.310 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:09.310 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:09.310 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:09.310 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:47:09.310 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:47:09.310 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:09.311 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:09.311 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:09.311 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:09.311 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:09.311 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:09.311 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:09.311 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:09.311 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:09.311 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:09.311 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:09.312 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:09.312 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:09.312 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:09.312 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.312 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:47:09.312 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:47:09.312 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:47:09.312 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:47:09.312 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:47:09.312 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:47:09.313 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:47:09.313 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:47:09.313 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:47:09.313 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:47:09.313 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:47:09.313 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:47:09.313 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:47:09.313 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:47:09.313 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:47:09.313 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:47:09.313 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:47:09.314 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:09.314 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:09.314 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:09.314 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:09.314 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:09.314 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:09.314 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:09.314 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:09.314 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:09.314 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:09.315 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:09.315 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:09.315 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:09.315 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:09.315 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:47:09.315 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.315 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:47:09.315 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.315 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:47:09.315 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:47:09.315 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:09.316 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:09.316 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.316 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:09.316 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:47:09.316 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:09.316 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.316 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.316 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:09.316 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:47:09.316 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:09.317 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:09.317 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:09.317 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.317 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:47:09.317 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:47:09.317 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:09.317 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:09.317 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:47:09.317 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:09.317 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.317 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.318 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:47:09.318 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:47:09.318 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:09.318 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:09.318 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.318 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:09.318 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:47:09.318 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:09.318 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.318 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.319 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:09.319 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:47:09.319 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:09.319 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:09.319 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:09.319 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.319 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:47:09.319 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:47:09.319 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:09.319 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:09.320 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:47:09.320 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:09.320 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.320 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.320 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:47:09.320 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:47:09.320 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:09.320 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:09.320 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.320 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:09.320 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:47:09.321 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:09.321 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.321 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.321 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:09.321 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:47:09.321 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:09.321 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:09.321 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:09.321 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.321 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:47:09.321 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:47:09.322 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:09.322 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:09.322 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:47:09.322 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:09.322 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:09.322 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:09.322 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.322 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:47:09.322 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:47:09.322 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.322 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:09.323 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:09.323 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:47:09.323 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:09.323 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:09.323 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:47:09.323 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.323 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:09.323 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:09.323 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:47:09.323 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:09.323 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:09.323 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:47:09.324 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.324 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:09.324 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:09.324 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:47:09.324 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:09.324 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:09.324 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:47:09.324 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.324 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:09.324 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:09.324 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:47:09.324 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:09.324 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:09.325 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:47:09.325 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:09.325 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:09.325 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:09.325 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:47:09.325 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:09.325 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:09.325 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:09.325 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:47:09.325 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:47:09.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.310+0000 7fc19d54b640 1 -- 10.20.193.58:0/1282120769 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc16807a660 msgr2=0x7fc16809ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:09.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.310+0000 7fc19d54b640 1 --2- 10.20.193.58:0/1282120769 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc16807a660 0x7fc16809ab10 secure :-1 s=READY pgs=540 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc1980b5ac0 tx=0x7fc188005f90 comp rx=0 tx=0).stop 2026-02-23T06:47:09.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.310+0000 7fc19d54b640 1 -- 10.20.193.58:0/1282120769 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc198162ca0 msgr2=0x7fc1981405a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:09.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.310+0000 7fc19d54b640 1 --2- 10.20.193.58:0/1282120769 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc198162ca0 0x7fc1981405a0 secure :-1 s=READY pgs=12 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc18c00f970 tx=0x7fc18c00fe40 comp rx=0 tx=0).stop 2026-02-23T06:47:09.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.310+0000 7fc19cd4a640 1 -- 10.20.193.58:0/1282120769 reap_dead start 2026-02-23T06:47:09.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.310+0000 7fc19cd4a640 1 -- 10.20.193.58:0/1282120769 reap_dead start 2026-02-23T06:47:09.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.310+0000 7fc19d54b640 1 -- 10.20.193.58:0/1282120769 shutdown_connections 2026-02-23T06:47:09.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.310+0000 7fc19d54b640 1 -- 10.20.193.58:0/1282120769 >> 10.20.193.58:0/1282120769 conn(0x7fc1980b3c20 msgr2=0x7fc198162290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:09.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.310+0000 7fc19d54b640 1 -- 10.20.193.58:0/1282120769 shutdown_connections 2026-02-23T06:47:09.328 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.310+0000 7fc19d54b640 1 -- 10.20.193.58:0/1282120769 wait complete. 2026-02-23T06:47:09.329 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:47:09.329 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:47:09.329 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:47:09.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.456+0000 7fc2e1d64640 1 -- 10.20.193.58:0/911833215 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc2dc15d870 msgr2=0x7fc2dc0587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:09.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.456+0000 7fc2e1d64640 1 --2- 10.20.193.58:0/911833215 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc2dc15d870 0x7fc2dc0587b0 secure :-1 s=READY pgs=14 gs=3 cs=0 l=1 c_cookie=15525056985431686652 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2c4004740 tx=0x7fc2c402f270 comp rx=0 tx=0).stop 2026-02-23T06:47:09.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.456+0000 7fc2e1d64640 1 -- 10.20.193.58:0/911833215 shutdown_connections 2026-02-23T06:47:09.452 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.456+0000 7fc2e1d64640 1 --2- 10.20.193.58:0/911833215 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc2dc15d870 0x7fc2dc0587b0 unknown :-1 s=CLOSED pgs=14 gs=3 cs=0 l=1 c_cookie=15525056985431686652 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:09.453 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.456+0000 7fc2e1d64640 1 -- 10.20.193.58:0/911833215 >> 10.20.193.58:0/911833215 conn(0x7fc2dc0b3c20 msgr2=0x7fc2dc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:09.453 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.456+0000 7fc2e1d64640 1 -- 10.20.193.58:0/911833215 shutdown_connections 2026-02-23T06:47:09.453 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.457+0000 7fc2e1d64640 1 -- 10.20.193.58:0/911833215 wait complete. 2026-02-23T06:47:09.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.458+0000 7fc2e1d64640 1 Processor -- start 2026-02-23T06:47:09.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.458+0000 7fc2e1d64640 1 -- start start 2026-02-23T06:47:09.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.458+0000 7fc2e1d64640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc2dc0b6690 0x7fc2dc1598a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:09.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.458+0000 7fc2e1d64640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc2dc15d4a0 0x7fc2dc1622f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:09.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.458+0000 7fc2e1d64640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc2dc15d870 0x7fc2dc126e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:09.455 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.458+0000 7fc2e1d64640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc2dc15bc50 con 0x7fc2dc0b6690 2026-02-23T06:47:09.456 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.458+0000 7fc2e1d64640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc2dc13d0d0 con 0x7fc2dc15d870 2026-02-23T06:47:09.456 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.458+0000 7fc2e1d64640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc2dc162d30 con 0x7fc2dc15d4a0 2026-02-23T06:47:09.456 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.458+0000 7fc2e0d62640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc2dc0b6690 0x7fc2dc1598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:09.456 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.458+0000 7fc2e1563640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc2dc15d870 0x7fc2dc126e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:09.456 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.458+0000 7fc2e0d62640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc2dc0b6690 0x7fc2dc1598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:33184/0 (socket says 10.20.193.58:33184) 2026-02-23T06:47:09.456 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.458+0000 7fc2e0d62640 1 -- 10.20.193.58:0/2974992457 learned_addr learned my addr 10.20.193.58:0/2974992457 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:47:09.456 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.459+0000 7fc2d3fff640 1 --2- 10.20.193.58:0/2974992457 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc2dc15d4a0 0x7fc2dc1622f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:09.456 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.459+0000 7fc2e0d62640 1 -- 10.20.193.58:0/2974992457 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc2dc15d4a0 msgr2=0x7fc2dc1622f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:09.456 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.459+0000 7fc2e0d62640 1 --2- 10.20.193.58:0/2974992457 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc2dc15d4a0 0x7fc2dc1622f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:09.456 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.459+0000 7fc2e0d62640 1 -- 10.20.193.58:0/2974992457 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc2dc15d870 msgr2=0x7fc2dc126e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:09.456 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.459+0000 7fc2e0d62640 1 --2- 10.20.193.58:0/2974992457 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc2dc15d870 0x7fc2dc126e30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:09.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.459+0000 7fc2e0d62640 1 -- 10.20.193.58:0/2974992457 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c40094b0 con 0x7fc2dc0b6690 2026-02-23T06:47:09.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.459+0000 7fc2e0d62640 1 --2- 10.20.193.58:0/2974992457 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc2dc0b6690 0x7fc2dc1598a0 secure :-1 s=READY pgs=15 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2cc00c530 tx=0x7fc2cc00ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:09.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.459+0000 7fc2d17fa640 1 -- 10.20.193.58:0/2974992457 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc2cc012850 con 0x7fc2dc0b6690 2026-02-23T06:47:09.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.459+0000 7fc2d17fa640 1 -- 10.20.193.58:0/2974992457 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2cc012aa0 con 0x7fc2dc0b6690 2026-02-23T06:47:09.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.459+0000 7fc2d17fa640 1 -- 10.20.193.58:0/2974992457 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc2cc012e90 con 0x7fc2dc0b6690 2026-02-23T06:47:09.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.459+0000 7fc2e1d64640 1 -- 10.20.193.58:0/2974992457 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2dc15bea0 con 0x7fc2dc0b6690 2026-02-23T06:47:09.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.459+0000 7fc2e1d64640 1 -- 10.20.193.58:0/2974992457 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2dc1619a0 con 0x7fc2dc0b6690 2026-02-23T06:47:09.457 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.460+0000 7fc2e1d64640 1 -- 10.20.193.58:0/2974992457 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc29c005300 con 0x7fc2dc0b6690 2026-02-23T06:47:09.458 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.461+0000 7fc2d17fa640 1 -- 10.20.193.58:0/2974992457 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fc2cc01c460 con 0x7fc2dc0b6690 2026-02-23T06:47:09.458 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.462+0000 7fc2d17fa640 1 --2- 10.20.193.58:0/2974992457 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc2ac07a6b0 0x7fc2ac09ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:09.458 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.462+0000 7fc2d17fa640 1 -- 10.20.193.58:0/2974992457 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fc2cc09d390 con 0x7fc2dc0b6690 2026-02-23T06:47:09.458 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.462+0000 7fc2d3fff640 1 --2- 10.20.193.58:0/2974992457 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc2ac07a6b0 0x7fc2ac09ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:09.459 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.463+0000 7fc2d3fff640 1 --2- 10.20.193.58:0/2974992457 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc2ac07a6b0 0x7fc2ac09ab60 secure :-1 s=READY pgs=541 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2c402f7a0 tx=0x7fc2c4031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:09.460 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.465+0000 7fc2d17fa640 1 -- 10.20.193.58:0/2974992457 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fc2cc0605e0 con 0x7fc2dc0b6690 2026-02-23T06:47:09.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.619+0000 7fc2e1d64640 1 -- 10.20.193.58:0/2974992457 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fc29c005dc0 con 0x7fc2dc0b6690 2026-02-23T06:47:09.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.619+0000 7fc2d17fa640 1 -- 10.20.193.58:0/2974992457 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fc2cc063700 con 0x7fc2dc0b6690 2026-02-23T06:47:09.616 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.621+0000 7fc2e1d64640 1 -- 10.20.193.58:0/2974992457 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc2ac07a6b0 msgr2=0x7fc2ac09ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:09.616 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.621+0000 7fc2e1d64640 1 --2- 10.20.193.58:0/2974992457 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc2ac07a6b0 0x7fc2ac09ab60 secure :-1 s=READY pgs=541 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2c402f7a0 tx=0x7fc2c4031040 comp rx=0 tx=0).stop 2026-02-23T06:47:09.616 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.621+0000 7fc2e1d64640 1 -- 10.20.193.58:0/2974992457 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc2dc0b6690 msgr2=0x7fc2dc1598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:09.616 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.621+0000 7fc2e1d64640 1 --2- 10.20.193.58:0/2974992457 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc2dc0b6690 0x7fc2dc1598a0 secure :-1 s=READY pgs=15 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2cc00c530 tx=0x7fc2cc00ca00 comp rx=0 tx=0).stop 2026-02-23T06:47:09.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.621+0000 7fc2e1d64640 1 -- 10.20.193.58:0/2974992457 shutdown_connections 2026-02-23T06:47:09.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.621+0000 7fc2e1d64640 1 --2- 10.20.193.58:0/2974992457 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc2ac07a6b0 0x7fc2ac09ab60 unknown :-1 s=CLOSED pgs=541 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:09.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.621+0000 7fc2e1d64640 1 --2- 10.20.193.58:0/2974992457 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc2dc15d870 0x7fc2dc126e30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:09.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.621+0000 7fc2e1d64640 1 --2- 10.20.193.58:0/2974992457 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc2dc15d4a0 0x7fc2dc1622f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:09.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.621+0000 7fc2e1d64640 1 --2- 10.20.193.58:0/2974992457 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc2dc0b6690 0x7fc2dc1598a0 unknown :-1 s=CLOSED pgs=15 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:09.617 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.621+0000 7fc2e1d64640 1 -- 10.20.193.58:0/2974992457 >> 10.20.193.58:0/2974992457 conn(0x7fc2dc0b3c20 msgr2=0x7fc2dc05c760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:09.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.622+0000 7fc2e1d64640 1 -- 10.20.193.58:0/2974992457 shutdown_connections 2026-02-23T06:47:09.618 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:09.622+0000 7fc2e1d64640 1 -- 10.20.193.58:0/2974992457 wait complete. 2026-02-23T06:47:09.628 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:47:15.286 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:47:15.291 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:47:19.630 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:47:19.630 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:47:19.751 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.756+0000 7f5267fff640 1 -- 10.20.193.58:0/3650209147 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5268056960 msgr2=0x7f5268058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:19.752 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.756+0000 7f5267fff640 1 --2- 10.20.193.58:0/3650209147 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5268056960 0x7f5268058200 secure :-1 s=READY pgs=95 gs=3 cs=0 l=1 c_cookie=12342363598325107839 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5250004740 tx=0x7f525002f230 comp rx=0 tx=0).stop 2026-02-23T06:47:19.752 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.756+0000 7f5267fff640 1 -- 10.20.193.58:0/3650209147 shutdown_connections 2026-02-23T06:47:19.752 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.756+0000 7f5267fff640 1 --2- 10.20.193.58:0/3650209147 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5268056960 0x7f5268058200 unknown :-1 s=CLOSED pgs=95 gs=3 cs=0 l=1 c_cookie=12342363598325107839 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:19.752 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.756+0000 7f5267fff640 1 -- 10.20.193.58:0/3650209147 >> 10.20.193.58:0/3650209147 conn(0x7f52680b3c20 msgr2=0x7f52680b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:19.752 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.756+0000 7f5267fff640 1 -- 10.20.193.58:0/3650209147 shutdown_connections 2026-02-23T06:47:19.752 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.756+0000 7f5267fff640 1 -- 10.20.193.58:0/3650209147 wait complete. 2026-02-23T06:47:19.754 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.757+0000 7f5267fff640 1 Processor -- start 2026-02-23T06:47:19.754 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.757+0000 7f5267fff640 1 -- start start 2026-02-23T06:47:19.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.758+0000 7f5267fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5268056960 0x7f5268121570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:19.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.758+0000 7f5267fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f526815c4b0 0x7f5268120340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:19.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.758+0000 7f5267fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5268162ca0 0x7f52680b02d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:19.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.758+0000 7f5267fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f5268121ab0 con 0x7f526815c4b0 2026-02-23T06:47:19.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.758+0000 7f5267fff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f5268149b20 con 0x7f5268162ca0 2026-02-23T06:47:19.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.758+0000 7f5267fff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f5268121cd0 con 0x7f5268056960 2026-02-23T06:47:19.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.758+0000 7f52667fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f526815c4b0 0x7f5268120340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:19.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.758+0000 7f52667fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f526815c4b0 0x7f5268120340 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:33434/0 (socket says 10.20.193.58:33434) 2026-02-23T06:47:19.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.758+0000 7f52667fc640 1 -- 10.20.193.58:0/2927838594 learned_addr learned my addr 10.20.193.58:0/2927838594 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:47:19.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.758+0000 7f5266ffd640 1 --2- 10.20.193.58:0/2927838594 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5268056960 0x7f5268121570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:19.755 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.758+0000 7f52677fe640 1 --2- 10.20.193.58:0/2927838594 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5268162ca0 0x7f52680b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:19.756 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.758+0000 7f52667fc640 1 -- 10.20.193.58:0/2927838594 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5268056960 msgr2=0x7f5268121570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:19.756 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.758+0000 7f52667fc640 1 --2- 10.20.193.58:0/2927838594 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5268056960 0x7f5268121570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:19.756 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.758+0000 7f52667fc640 1 -- 10.20.193.58:0/2927838594 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5268162ca0 msgr2=0x7f52680b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:19.756 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.758+0000 7f52667fc640 1 --2- 10.20.193.58:0/2927838594 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5268162ca0 0x7f52680b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:19.756 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.758+0000 7f52667fc640 1 -- 10.20.193.58:0/2927838594 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52500094b0 con 0x7f526815c4b0 2026-02-23T06:47:19.756 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.758+0000 7f5266ffd640 1 --2- 10.20.193.58:0/2927838594 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5268056960 0x7f5268121570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:47:19.756 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.758+0000 7f52667fc640 1 --2- 10.20.193.58:0/2927838594 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f526815c4b0 0x7f5268120340 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52500023d0 tx=0x7f5250002950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:19.756 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.759+0000 7f52477fe640 1 -- 10.20.193.58:0/2927838594 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5250038470 con 0x7f526815c4b0 2026-02-23T06:47:19.756 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.759+0000 7f52477fe640 1 -- 10.20.193.58:0/2927838594 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52500386c0 con 0x7f526815c4b0 2026-02-23T06:47:19.756 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.759+0000 7f52477fe640 1 -- 10.20.193.58:0/2927838594 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5250038ad0 con 0x7f526815c4b0 2026-02-23T06:47:19.756 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.759+0000 7f5267fff640 1 -- 10.20.193.58:0/2927838594 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5268149de0 con 0x7f526815c4b0 2026-02-23T06:47:19.756 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.759+0000 7f5267fff640 1 -- 10.20.193.58:0/2927838594 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f526814a3a0 con 0x7f526815c4b0 2026-02-23T06:47:19.757 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.759+0000 7f5267fff640 1 -- 10.20.193.58:0/2927838594 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f526815fbd0 con 0x7f526815c4b0 2026-02-23T06:47:19.757 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.760+0000 7f52477fe640 1 -- 10.20.193.58:0/2927838594 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f5250038c30 con 0x7f526815c4b0 2026-02-23T06:47:19.758 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.761+0000 7f52477fe640 1 --2- 10.20.193.58:0/2927838594 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f523407a6c0 0x7f523409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:19.758 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.761+0000 7f52477fe640 1 -- 10.20.193.58:0/2927838594 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f52500c2c50 con 0x7f526815c4b0 2026-02-23T06:47:19.758 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.762+0000 7f5266ffd640 1 --2- 10.20.193.58:0/2927838594 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f523407a6c0 0x7f523409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:19.758 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.762+0000 7f5266ffd640 1 --2- 10.20.193.58:0/2927838594 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f523407a6c0 0x7f523409ab70 secure :-1 s=READY pgs=542 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f525c0027d0 tx=0x7f525c009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:19.760 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.765+0000 7f52477fe640 1 -- 10.20.193.58:0/2927838594 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f5250085df0 con 0x7f526815c4b0 2026-02-23T06:47:19.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.919+0000 7f5267fff640 1 -- 10.20.193.58:0/2927838594 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5268142000 con 0x7f526815c4b0 2026-02-23T06:47:19.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.919+0000 7f52477fe640 1 -- 10.20.193.58:0/2927838594 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f5250008ee0 con 0x7f526815c4b0 2026-02-23T06:47:19.914 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":228,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:47:19.915 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.920+0000 7f5267fff640 1 -- 10.20.193.58:0/2927838594 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f523407a6c0 msgr2=0x7f523409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:19.915 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.920+0000 7f5267fff640 1 --2- 10.20.193.58:0/2927838594 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f523407a6c0 0x7f523409ab70 secure :-1 s=READY pgs=542 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f525c0027d0 tx=0x7f525c009040 comp rx=0 tx=0).stop 2026-02-23T06:47:19.915 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.920+0000 7f5267fff640 1 -- 10.20.193.58:0/2927838594 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f526815c4b0 msgr2=0x7f5268120340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:19.915 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.920+0000 7f5267fff640 1 --2- 10.20.193.58:0/2927838594 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f526815c4b0 0x7f5268120340 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52500023d0 tx=0x7f5250002950 comp rx=0 tx=0).stop 2026-02-23T06:47:19.915 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.920+0000 7f5267fff640 1 -- 10.20.193.58:0/2927838594 shutdown_connections 2026-02-23T06:47:19.915 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.920+0000 7f5267fff640 1 --2- 10.20.193.58:0/2927838594 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f523407a6c0 0x7f523409ab70 unknown :-1 s=CLOSED pgs=542 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:19.915 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.920+0000 7f5267fff640 1 --2- 10.20.193.58:0/2927838594 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5268162ca0 0x7f52680b02d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:19.915 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.920+0000 7f5267fff640 1 --2- 10.20.193.58:0/2927838594 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f526815c4b0 0x7f5268120340 unknown :-1 s=CLOSED pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:19.915 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.920+0000 7f5267fff640 1 --2- 10.20.193.58:0/2927838594 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5268056960 0x7f5268121570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:19.915 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.920+0000 7f5267fff640 1 -- 10.20.193.58:0/2927838594 >> 10.20.193.58:0/2927838594 conn(0x7f52680b3c20 msgr2=0x7f52680b40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:19.916 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.921+0000 7f5267fff640 1 -- 10.20.193.58:0/2927838594 shutdown_connections 2026-02-23T06:47:19.916 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:19.921+0000 7f5267fff640 1 -- 10.20.193.58:0/2927838594 wait complete. 2026-02-23T06:47:19.927 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:47:19.927 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:47:19.927 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:47:19.927 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:47:20.053 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.058+0000 7fc32f0cc640 1 -- 10.20.193.58:0/3271191398 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc32815be70 msgr2=0x7fc3280b1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:20.053 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.058+0000 7fc32f0cc640 1 --2- 10.20.193.58:0/3271191398 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc32815be70 0x7fc3280b1310 secure :-1 s=READY pgs=18 gs=3 cs=0 l=1 c_cookie=2049125134571431002 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc328059e30 tx=0x7fc31002f250 comp rx=0 tx=0).stop 2026-02-23T06:47:20.053 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.058+0000 7fc32f0cc640 1 -- 10.20.193.58:0/3271191398 shutdown_connections 2026-02-23T06:47:20.053 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.058+0000 7fc32f0cc640 1 --2- 10.20.193.58:0/3271191398 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc3280b39f0 0x7fc3280b1850 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.053 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.058+0000 7fc32f0cc640 1 --2- 10.20.193.58:0/3271191398 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc32815be70 0x7fc3280b1310 unknown :-1 s=CLOSED pgs=18 gs=3 cs=0 l=1 c_cookie=2049125134571431002 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.053 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.058+0000 7fc32f0cc640 1 --2- 10.20.193.58:0/3271191398 >> v2:10.20.193.93:3300/0 conn(0x7fc32815baa0 0x7fc3280b5610 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.053 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.058+0000 7fc32f0cc640 1 -- 10.20.193.58:0/3271191398 >> 10.20.193.58:0/3271191398 conn(0x7fc328058e50 msgr2=0x7fc328059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:20.053 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.058+0000 7fc32f0cc640 1 -- 10.20.193.58:0/3271191398 shutdown_connections 2026-02-23T06:47:20.053 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.058+0000 7fc32f0cc640 1 -- 10.20.193.58:0/3271191398 wait complete. 2026-02-23T06:47:20.054 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.059+0000 7fc32f0cc640 1 Processor -- start 2026-02-23T06:47:20.054 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.060+0000 7fc32f0cc640 1 -- start start 2026-02-23T06:47:20.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.060+0000 7fc32f0cc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc3280b39f0 0x7fc32813b7c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:20.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.060+0000 7fc32f0cc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc32815baa0 0x7fc328148c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:20.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.060+0000 7fc32f0cc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc32815be70 0x7fc32811fc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:20.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.060+0000 7fc32f0cc640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc32814c900 con 0x7fc32815baa0 2026-02-23T06:47:20.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.060+0000 7fc32f0cc640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc32811a280 con 0x7fc32815be70 2026-02-23T06:47:20.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.060+0000 7fc32f0cc640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc32811a560 con 0x7fc3280b39f0 2026-02-23T06:47:20.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.060+0000 7fc31ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc32815baa0 0x7fc328148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:20.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.060+0000 7fc32ce41640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc3280b39f0 0x7fc32813b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:20.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.060+0000 7fc31ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc32815baa0 0x7fc328148c30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:33464/0 (socket says 10.20.193.58:33464) 2026-02-23T06:47:20.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.060+0000 7fc31ffff640 1 -- 10.20.193.58:0/386863405 learned_addr learned my addr 10.20.193.58:0/386863405 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:47:20.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.060+0000 7fc32d642640 1 --2- 10.20.193.58:0/386863405 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc32815be70 0x7fc32811fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:20.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.060+0000 7fc31ffff640 1 -- 10.20.193.58:0/386863405 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc3280b39f0 msgr2=0x7fc32813b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:20.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.060+0000 7fc31ffff640 1 --2- 10.20.193.58:0/386863405 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc3280b39f0 0x7fc32813b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.060+0000 7fc31ffff640 1 -- 10.20.193.58:0/386863405 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc32815be70 msgr2=0x7fc32811fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:20.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.060+0000 7fc31ffff640 1 --2- 10.20.193.58:0/386863405 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc32815be70 0x7fc32811fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.055 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.060+0000 7fc31ffff640 1 -- 10.20.193.58:0/386863405 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc310009570 con 0x7fc32815baa0 2026-02-23T06:47:20.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.061+0000 7fc31ffff640 1 --2- 10.20.193.58:0/386863405 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc32815baa0 0x7fc328148c30 secure :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc310004740 tx=0x7fc3100028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:20.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.061+0000 7fc31d7fa640 1 -- 10.20.193.58:0/386863405 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc31003d070 con 0x7fc32815baa0 2026-02-23T06:47:20.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.061+0000 7fc31d7fa640 1 -- 10.20.193.58:0/386863405 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc310038470 con 0x7fc32815baa0 2026-02-23T06:47:20.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.061+0000 7fc32f0cc640 1 -- 10.20.193.58:0/386863405 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc32811a840 con 0x7fc32815baa0 2026-02-23T06:47:20.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.061+0000 7fc31d7fa640 1 -- 10.20.193.58:0/386863405 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc3100388a0 con 0x7fc32815baa0 2026-02-23T06:47:20.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.061+0000 7fc32f0cc640 1 -- 10.20.193.58:0/386863405 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc328148710 con 0x7fc32815baa0 2026-02-23T06:47:20.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.062+0000 7fc32f0cc640 1 --2- 10.20.193.58:0/386863405 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc32811aa80 0x7fc32815a8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:20.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.062+0000 7fc32f0cc640 1 -- 10.20.193.58:0/386863405 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc328165d30 con 0x7fc32811aa80 2026-02-23T06:47:20.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.062+0000 7fc32ce41640 1 --2- 10.20.193.58:0/386863405 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc32811aa80 0x7fc32815a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:20.056 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.062+0000 7fc32ce41640 1 -- 10.20.193.58:0/386863405 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc328165a50 con 0x7fc32811aa80 2026-02-23T06:47:20.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.062+0000 7fc32ce41640 1 --2- 10.20.193.58:0/386863405 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc32811aa80 0x7fc32815a8b0 secure :-1 s=READY pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc318002fa0 tx=0x7fc3180099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:20.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.062+0000 7fc31d7fa640 1 -- 10.20.193.58:0/386863405 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc318010a70 con 0x7fc32811aa80 2026-02-23T06:47:20.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.062+0000 7fc31d7fa640 1 -- 10.20.193.58:0/386863405 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fc318010bd0 con 0x7fc32811aa80 2026-02-23T06:47:20.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.062+0000 7fc31d7fa640 1 -- 10.20.193.58:0/386863405 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc32811aa80 msgr2=0x7fc32815a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:20.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.062+0000 7fc31d7fa640 1 --2- 10.20.193.58:0/386863405 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc32811aa80 0x7fc32815a8b0 secure :-1 s=READY pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc318002fa0 tx=0x7fc3180099f0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.062+0000 7fc31d7fa640 1 -- 10.20.193.58:0/386863405 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc32811aa80 msgr2=0x7fc32815a8b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:47:20.057 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.062+0000 7fc31d7fa640 1 --2- 10.20.193.58:0/386863405 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc32811aa80 0x7fc32815a8b0 secure :-1 s=CLOSED pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc318002fa0 tx=0x7fc3180099f0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.058 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.063+0000 7fc31d7fa640 1 -- 10.20.193.58:0/386863405 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fc310038a00 con 0x7fc32815baa0 2026-02-23T06:47:20.058 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.064+0000 7fc31d7fa640 1 --2- 10.20.193.58:0/386863405 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc2f807a430 0x7fc2f809a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:20.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.064+0000 7fc31d7fa640 1 -- 10.20.193.58:0/386863405 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fc3100c2360 con 0x7fc32815baa0 2026-02-23T06:47:20.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.064+0000 7fc32f0cc640 1 --2- 10.20.193.58:0/386863405 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc328119db0 0x7fc32815adf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:20.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.064+0000 7fc32f0cc640 1 -- 10.20.193.58:0/386863405 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc328148930 con 0x7fc328119db0 2026-02-23T06:47:20.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.064+0000 7fc32d642640 1 --2- 10.20.193.58:0/386863405 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc328119db0 0x7fc32815adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:20.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.064+0000 7fc32d642640 1 -- 10.20.193.58:0/386863405 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc32815b330 con 0x7fc328119db0 2026-02-23T06:47:20.061 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.064+0000 7fc32d642640 1 --2- 10.20.193.58:0/386863405 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc328119db0 0x7fc32815adf0 secure :-1 s=READY pgs=21 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc324003f20 tx=0x7fc32400aad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:20.062 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.064+0000 7fc31d7fa640 1 -- 10.20.193.58:0/386863405 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc324011aa0 con 0x7fc328119db0 2026-02-23T06:47:20.062 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.064+0000 7fc31d7fa640 1 -- 10.20.193.58:0/386863405 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4914 (secure 0 0 0) 0x7fc324011c00 con 0x7fc328119db0 2026-02-23T06:47:20.062 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:47:20.062 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:47:20.062 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:47:20.062 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:47:20.062 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 228, 2026-02-23T06:47:20.062 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 11383, 2026-02-23T06:47:20.062 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:47:20.062 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:47:20.062 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:47:20.062 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:47:20.062 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:20.062 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:47:20.062 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:47:20.062 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:47:20.062 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:47:20.062 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:20.062 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:20.062 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:20.062 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:20.062 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:20.062 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:20.062 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:20.062 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:20.062 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:47:20.063 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:47:20.064 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.065 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:47:20.066 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:47:20.067 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.064+0000 7fc31d7fa640 1 -- 10.20.193.58:0/386863405 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc328119db0 msgr2=0x7fc32815adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:20.067 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.064+0000 7fc31d7fa640 1 --2- 10.20.193.58:0/386863405 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc328119db0 0x7fc32815adf0 secure :-1 s=READY pgs=21 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc324003f20 tx=0x7fc32400aad0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.067 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.064+0000 7fc31d7fa640 1 -- 10.20.193.58:0/386863405 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc328119db0 msgr2=0x7fc32815adf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:47:20.067 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.064+0000 7fc31d7fa640 1 --2- 10.20.193.58:0/386863405 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc328119db0 0x7fc32815adf0 unknown :-1 s=CLOSED pgs=21 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.067 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.064+0000 7fc32f0cc640 1 -- 10.20.193.58:0/386863405 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc2f807a430 msgr2=0x7fc2f809a8e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-23T06:47:20.067 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.064+0000 7fc32f0cc640 1 --2- 10.20.193.58:0/386863405 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc2f807a430 0x7fc2f809a8e0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.067 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.064+0000 7fc32f0cc640 1 -- 10.20.193.58:0/386863405 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc32815baa0 msgr2=0x7fc328148c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:20.067 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.064+0000 7fc32f0cc640 1 --2- 10.20.193.58:0/386863405 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc32815baa0 0x7fc328148c30 secure :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc310004740 tx=0x7fc3100028d0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.067 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.064+0000 7fc32d642640 1 -- 10.20.193.58:0/386863405 reap_dead start 2026-02-23T06:47:20.067 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.064+0000 7fc32d642640 1 -- 10.20.193.58:0/386863405 reap_dead start 2026-02-23T06:47:20.067 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.064+0000 7fc32f0cc640 1 -- 10.20.193.58:0/386863405 shutdown_connections 2026-02-23T06:47:20.067 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.064+0000 7fc32f0cc640 1 -- 10.20.193.58:0/386863405 >> 10.20.193.58:0/386863405 conn(0x7fc328058e50 msgr2=0x7fc328164630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:20.067 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.064+0000 7fc32f0cc640 1 -- 10.20.193.58:0/386863405 shutdown_connections 2026-02-23T06:47:20.067 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.064+0000 7fc32f0cc640 1 -- 10.20.193.58:0/386863405 wait complete. 2026-02-23T06:47:20.069 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:47:20.069 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:47:20.069 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:47:20.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.195+0000 7f5862192640 1 -- 10.20.193.58:0/3162710736 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f585c15c040 msgr2=0x7f585c05b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:20.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.195+0000 7f5862192640 1 --2- 10.20.193.58:0/3162710736 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f585c15c040 0x7f585c05b0e0 secure :-1 s=READY pgs=23 gs=2 cs=0 l=1 c_cookie=13239424864271279514 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f584c005e70 tx=0x7f584c02f290 comp rx=0 tx=0).stop 2026-02-23T06:47:20.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.195+0000 7f5862192640 1 -- 10.20.193.58:0/3162710736 shutdown_connections 2026-02-23T06:47:20.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.195+0000 7f5862192640 1 --2- 10.20.193.58:0/3162710736 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f585c0b5680 0x7f585c0b5b00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.195+0000 7f5862192640 1 --2- 10.20.193.58:0/3162710736 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f585c15c040 0x7f585c05b0e0 unknown :-1 s=CLOSED pgs=23 gs=2 cs=0 l=1 c_cookie=13239424864271279514 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.195+0000 7f5862192640 1 -- 10.20.193.58:0/3162710736 >> 10.20.193.58:0/3162710736 conn(0x7f585c0b3c20 msgr2=0x7f585c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:20.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.195+0000 7f5862192640 1 -- 10.20.193.58:0/3162710736 shutdown_connections 2026-02-23T06:47:20.190 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.195+0000 7f5862192640 1 -- 10.20.193.58:0/3162710736 wait complete. 2026-02-23T06:47:20.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.196+0000 7f5862192640 1 Processor -- start 2026-02-23T06:47:20.191 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.196+0000 7f5862192640 1 -- start start 2026-02-23T06:47:20.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.197+0000 7f5862192640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f585c056550 0x7f585c2018b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:20.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.197+0000 7f5862192640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f585c0b5680 0x7f585c15e520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:20.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.197+0000 7f5862192640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f585c15c040 0x7f585c153260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:20.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.197+0000 7f5862192640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f585c1fe170 con 0x7f585c0b5680 2026-02-23T06:47:20.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.197+0000 7f5862192640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f585c1fe6a0 con 0x7f585c15c040 2026-02-23T06:47:20.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.197+0000 7f5862192640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f585c200e10 con 0x7f585c056550 2026-02-23T06:47:20.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.197+0000 7f586098f640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f585c0b5680 0x7f585c15e520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:20.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.197+0000 7f5861190640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f585c056550 0x7f585c2018b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:20.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.197+0000 7f5861190640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f585c056550 0x7f585c2018b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:49628/0 (socket says 10.20.193.58:49628) 2026-02-23T06:47:20.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.197+0000 7f5861190640 1 -- 10.20.193.58:0/1153111956 learned_addr learned my addr 10.20.193.58:0/1153111956 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:47:20.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.197+0000 7f5861991640 1 --2- 10.20.193.58:0/1153111956 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f585c15c040 0x7f585c153260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:20.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.198+0000 7f5861190640 1 -- 10.20.193.58:0/1153111956 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f585c15c040 msgr2=0x7f585c153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:20.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.198+0000 7f5861190640 1 --2- 10.20.193.58:0/1153111956 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f585c15c040 0x7f585c153260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.198+0000 7f5861190640 1 -- 10.20.193.58:0/1153111956 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f585c0b5680 msgr2=0x7f585c15e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:20.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.198+0000 7f5861190640 1 --2- 10.20.193.58:0/1153111956 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f585c0b5680 0x7f585c15e520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.198+0000 7f5861190640 1 -- 10.20.193.58:0/1153111956 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f584c009570 con 0x7f585c056550 2026-02-23T06:47:20.193 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.198+0000 7f586098f640 1 --2- 10.20.193.58:0/1153111956 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f585c0b5680 0x7f585c15e520 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:47:20.193 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.198+0000 7f5861190640 1 --2- 10.20.193.58:0/1153111956 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f585c056550 0x7f585c2018b0 secure :-1 s=READY pgs=39 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f584c004740 tx=0x7f584c0028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:20.193 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.198+0000 7f5849ffb640 1 -- 10.20.193.58:0/1153111956 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f584c03d070 con 0x7f585c056550 2026-02-23T06:47:20.193 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.198+0000 7f5849ffb640 1 -- 10.20.193.58:0/1153111956 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f584c038470 con 0x7f585c056550 2026-02-23T06:47:20.193 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.198+0000 7f5849ffb640 1 -- 10.20.193.58:0/1153111956 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f584c0388a0 con 0x7f585c056550 2026-02-23T06:47:20.193 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.198+0000 7f5862192640 1 -- 10.20.193.58:0/1153111956 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f585c1537a0 con 0x7f585c056550 2026-02-23T06:47:20.193 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.198+0000 7f5862192640 1 -- 10.20.193.58:0/1153111956 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f585c2010b0 con 0x7f585c056550 2026-02-23T06:47:20.193 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.199+0000 7f5862192640 1 --2- 10.20.193.58:0/1153111956 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f585c1629e0 0x7f585c2012d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:20.193 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.199+0000 7f5862192640 1 -- 10.20.193.58:0/1153111956 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f585c05b620 con 0x7f585c1629e0 2026-02-23T06:47:20.193 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.199+0000 7f586098f640 1 --2- 10.20.193.58:0/1153111956 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f585c1629e0 0x7f585c2012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:20.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.199+0000 7f586098f640 1 -- 10.20.193.58:0/1153111956 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f585c166120 con 0x7f585c1629e0 2026-02-23T06:47:20.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.199+0000 7f586098f640 1 --2- 10.20.193.58:0/1153111956 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f585c1629e0 0x7f585c2012d0 secure :-1 s=READY pgs=96 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58500027d0 tx=0x7f585000c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:20.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.199+0000 7f5849ffb640 1 -- 10.20.193.58:0/1153111956 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f585000cd30 con 0x7f585c1629e0 2026-02-23T06:47:20.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.200+0000 7f5849ffb640 1 -- 10.20.193.58:0/1153111956 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f585000ce90 con 0x7f585c1629e0 2026-02-23T06:47:20.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.200+0000 7f5849ffb640 1 -- 10.20.193.58:0/1153111956 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f585c1629e0 msgr2=0x7f585c2012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:20.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.200+0000 7f5849ffb640 1 --2- 10.20.193.58:0/1153111956 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f585c1629e0 0x7f585c2012d0 secure :-1 s=READY pgs=96 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58500027d0 tx=0x7f585000c4b0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.200+0000 7f5849ffb640 1 -- 10.20.193.58:0/1153111956 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f585c1629e0 msgr2=0x7f585c2012d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:47:20.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.200+0000 7f5849ffb640 1 --2- 10.20.193.58:0/1153111956 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f585c1629e0 0x7f585c2012d0 unknown :-1 s=CLOSED pgs=96 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.201+0000 7f5849ffb640 1 -- 10.20.193.58:0/1153111956 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f584c038a00 con 0x7f585c056550 2026-02-23T06:47:20.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.202+0000 7f5849ffb640 1 --2- 10.20.193.58:0/1153111956 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f582c07a3c0 0x7f582c09a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:20.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.202+0000 7f5849ffb640 1 -- 10.20.193.58:0/1153111956 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f584c0c2170 con 0x7f585c056550 2026-02-23T06:47:20.197 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.202+0000 7f586098f640 1 --2- 10.20.193.58:0/1153111956 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f582c07a3c0 0x7f582c09a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:20.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.203+0000 7f586098f640 1 --2- 10.20.193.58:0/1153111956 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f582c07a3c0 0x7f582c09a870 secure :-1 s=READY pgs=543 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5850017040 tx=0x7f5850014000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:20.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.203+0000 7f5862192640 1 --2- 10.20.193.58:0/1153111956 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f585c162580 0x7f585c1572a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:20.198 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.203+0000 7f5862192640 1 -- 10.20.193.58:0/1153111956 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f585c05d9c0 con 0x7f585c162580 2026-02-23T06:47:20.199 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.203+0000 7f5861991640 1 --2- 10.20.193.58:0/1153111956 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f585c162580 0x7f585c1572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:20.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.204+0000 7f5861991640 1 -- 10.20.193.58:0/1153111956 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f585c056330 con 0x7f585c162580 2026-02-23T06:47:20.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.204+0000 7f5861991640 1 --2- 10.20.193.58:0/1153111956 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f585c162580 0x7f585c1572a0 secure :-1 s=READY pgs=97 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5858010590 tx=0x7f5858010a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:20.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.204+0000 7f5849ffb640 1 -- 10.20.193.58:0/1153111956 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f585800ea20 con 0x7f585c162580 2026-02-23T06:47:20.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.204+0000 7f5849ffb640 1 -- 10.20.193.58:0/1153111956 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5557 (secure 0 0 0) 0x7f585800eb80 con 0x7f585c162580 2026-02-23T06:47:20.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.204+0000 7f5849ffb640 1 -- 10.20.193.58:0/1153111956 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f585c162580 msgr2=0x7f585c1572a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:20.200 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:47:20.201 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:47:20.201 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:47:20.201 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:47:20.201 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 228, 2026-02-23T06:47:20.201 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 126563, 2026-02-23T06:47:20.201 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:47:20.201 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:47:20.201 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:47:20.201 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:47:20.201 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:20.201 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:47:20.202 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:47:20.202 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:47:20.202 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:47:20.202 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:20.202 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:20.202 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:20.202 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:20.202 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:20.202 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:20.202 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:20.202 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:20.203 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:20.203 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:20.203 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:20.203 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:20.203 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:20.203 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:20.203 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:47:20.203 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:47:20.203 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:20.203 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:20.203 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:20.203 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:20.204 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:20.204 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:20.204 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:20.204 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:20.204 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:20.204 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:20.204 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:20.204 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:20.204 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:20.204 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:20.204 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.204 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:47:20.205 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:47:20.205 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:47:20.205 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:47:20.205 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:47:20.205 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:47:20.205 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:47:20.205 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:47:20.205 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:47:20.205 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:47:20.205 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:47:20.205 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:47:20.205 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:47:20.206 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:47:20.206 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:47:20.206 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:47:20.206 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:47:20.206 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:20.206 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:20.206 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:20.206 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:20.206 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:20.206 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:20.206 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:20.206 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:20.207 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:20.207 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:20.207 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:20.207 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:20.207 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:20.207 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:20.207 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:47:20.207 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.207 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:47:20.207 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.207 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:47:20.207 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:47:20.207 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:20.208 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:20.208 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.208 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:20.208 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:47:20.208 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:20.208 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.208 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.208 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:20.208 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:47:20.208 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:20.208 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:20.208 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:20.209 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.209 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:47:20.209 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:47:20.209 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:20.209 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:20.209 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:47:20.209 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:20.209 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.209 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.209 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:47:20.209 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:47:20.210 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:20.210 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:20.210 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.210 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:20.210 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:47:20.210 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:20.210 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.210 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.210 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:20.210 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:47:20.210 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:20.210 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:20.210 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:20.211 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.211 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:47:20.211 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:47:20.211 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:20.211 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:20.211 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:47:20.211 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:20.211 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.211 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.211 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:47:20.211 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:47:20.211 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:20.212 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:20.212 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.212 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:20.212 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:47:20.212 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:20.212 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.212 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.212 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:20.212 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:47:20.212 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:20.212 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:20.212 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:20.212 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.213 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:47:20.213 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:47:20.213 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:20.213 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:20.213 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:47:20.213 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:20.213 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:20.213 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:20.213 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.213 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:47:20.213 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:47:20.213 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.214 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:20.214 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:20.214 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:47:20.214 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:20.214 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:20.214 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:47:20.214 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.214 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:20.214 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:20.214 INFO:teuthology.orchestra.run.trial058.stdout: "num": 4 2026-02-23T06:47:20.214 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:20.214 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:20.215 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:47:20.215 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.215 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:20.215 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:20.215 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:47:20.215 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:20.215 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:20.215 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:47:20.215 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.215 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:47:20.215 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:47:20.215 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:47:20.215 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.216 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.216 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:20.216 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:20.216 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:47:20.216 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:20.216 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:20.216 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:47:20.216 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.216 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:20.216 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:20.216 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:47:20.216 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:20.216 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:20.217 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.217 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:47:20.217 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:47:20.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.204+0000 7f5849ffb640 1 --2- 10.20.193.58:0/1153111956 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f585c162580 0x7f585c1572a0 secure :-1 s=READY pgs=97 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5858010590 tx=0x7f5858010a60 comp rx=0 tx=0).stop 2026-02-23T06:47:20.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.204+0000 7f5849ffb640 1 -- 10.20.193.58:0/1153111956 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f585c162580 msgr2=0x7f585c1572a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:47:20.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.204+0000 7f5849ffb640 1 --2- 10.20.193.58:0/1153111956 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f585c162580 0x7f585c1572a0 unknown :-1 s=CLOSED pgs=97 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.204+0000 7f5862192640 1 -- 10.20.193.58:0/1153111956 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f582c07a3c0 msgr2=0x7f582c09a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:20.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.204+0000 7f5862192640 1 --2- 10.20.193.58:0/1153111956 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f582c07a3c0 0x7f582c09a870 secure :-1 s=READY pgs=543 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5850017040 tx=0x7f5850014000 comp rx=0 tx=0).stop 2026-02-23T06:47:20.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.204+0000 7f5862192640 1 -- 10.20.193.58:0/1153111956 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f585c056550 msgr2=0x7f585c2018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:20.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.204+0000 7f5862192640 1 --2- 10.20.193.58:0/1153111956 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f585c056550 0x7f585c2018b0 secure :-1 s=READY pgs=39 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f584c004740 tx=0x7f584c0028d0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.204+0000 7f5861991640 1 -- 10.20.193.58:0/1153111956 reap_dead start 2026-02-23T06:47:20.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.204+0000 7f5862192640 1 -- 10.20.193.58:0/1153111956 shutdown_connections 2026-02-23T06:47:20.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.204+0000 7f5862192640 1 --2- 10.20.193.58:0/1153111956 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f585c056550 0x7f585c2018b0 unknown :-1 s=CLOSED pgs=39 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.204+0000 7f5862192640 1 -- 10.20.193.58:0/1153111956 >> 10.20.193.58:0/1153111956 conn(0x7f585c0b3c20 msgr2=0x7f585c05cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:20.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.204+0000 7f5862192640 1 -- 10.20.193.58:0/1153111956 shutdown_connections 2026-02-23T06:47:20.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.205+0000 7f5862192640 1 -- 10.20.193.58:0/1153111956 wait complete. 2026-02-23T06:47:20.220 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:47:20.220 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:47:20.220 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:47:20.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.349+0000 7fd861247640 1 -- 10.20.193.58:0/2101908176 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd85c0b2120 msgr2=0x7fd85c169080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:20.345 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.349+0000 7fd861247640 1 --2- 10.20.193.58:0/2101908176 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd85c0b2120 0x7fd85c169080 secure :-1 s=READY pgs=25 gs=3 cs=0 l=1 c_cookie=18386431572876128611 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd844005e70 tx=0x7fd84402f320 comp rx=0 tx=0).stop 2026-02-23T06:47:20.345 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.349+0000 7fd861247640 1 -- 10.20.193.58:0/2101908176 shutdown_connections 2026-02-23T06:47:20.345 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.349+0000 7fd861247640 1 --2- 10.20.193.58:0/2101908176 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd85c0b2120 0x7fd85c169080 unknown :-1 s=CLOSED pgs=25 gs=3 cs=0 l=1 c_cookie=18386431572876128611 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.345 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.349+0000 7fd861247640 1 -- 10.20.193.58:0/2101908176 >> 10.20.193.58:0/2101908176 conn(0x7fd85c0561f0 msgr2=0x7fd85c0565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:20.345 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.349+0000 7fd861247640 1 -- 10.20.193.58:0/2101908176 shutdown_connections 2026-02-23T06:47:20.345 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.349+0000 7fd861247640 1 -- 10.20.193.58:0/2101908176 wait complete. 2026-02-23T06:47:20.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.350+0000 7fd861247640 1 Processor -- start 2026-02-23T06:47:20.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.350+0000 7fd861247640 1 -- start start 2026-02-23T06:47:20.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.351+0000 7fd861247640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd85c0b2120 0x7fd85c13d1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:20.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.351+0000 7fd861247640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd85c168cb0 0x7fd85c05c830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:20.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.351+0000 7fd861247640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd85c1695c0 0x7fd85c05cd70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:20.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.351+0000 7fd861247640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c05e000 con 0x7fd85c1695c0 2026-02-23T06:47:20.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.351+0000 7fd861247640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c15e640 con 0x7fd85c168cb0 2026-02-23T06:47:20.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.351+0000 7fd861247640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fd85c15e920 con 0x7fd85c0b2120 2026-02-23T06:47:20.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.351+0000 7fd85b577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd85c1695c0 0x7fd85c05cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:20.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.351+0000 7fd85ad76640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd85c0b2120 0x7fd85c13d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:20.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.351+0000 7fd85b577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd85c1695c0 0x7fd85c05cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:33542/0 (socket says 10.20.193.58:33542) 2026-02-23T06:47:20.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.351+0000 7fd85b577640 1 -- 10.20.193.58:0/600459660 learned_addr learned my addr 10.20.193.58:0/600459660 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:47:20.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.351+0000 7fd85a575640 1 --2- 10.20.193.58:0/600459660 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd85c168cb0 0x7fd85c05c830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:20.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.351+0000 7fd85b577640 1 -- 10.20.193.58:0/600459660 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd85c0b2120 msgr2=0x7fd85c13d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:20.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.351+0000 7fd85b577640 1 --2- 10.20.193.58:0/600459660 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd85c0b2120 0x7fd85c13d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.351+0000 7fd85b577640 1 -- 10.20.193.58:0/600459660 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd85c168cb0 msgr2=0x7fd85c05c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:20.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.351+0000 7fd85b577640 1 --2- 10.20.193.58:0/600459660 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd85c168cb0 0x7fd85c05c830 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.351+0000 7fd85b577640 1 -- 10.20.193.58:0/600459660 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd844009570 con 0x7fd85c1695c0 2026-02-23T06:47:20.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.351+0000 7fd85b577640 1 --2- 10.20.193.58:0/600459660 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd85c1695c0 0x7fd85c05cd70 secure :-1 s=READY pgs=26 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd84c00d4d0 tx=0x7fd84c00d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:20.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.351+0000 7fd83b7fe640 1 -- 10.20.193.58:0/600459660 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd84c0064a0 con 0x7fd85c1695c0 2026-02-23T06:47:20.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.352+0000 7fd83b7fe640 1 -- 10.20.193.58:0/600459660 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd84c006600 con 0x7fd85c1695c0 2026-02-23T06:47:20.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.352+0000 7fd861247640 1 -- 10.20.193.58:0/600459660 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd85c15ec00 con 0x7fd85c1695c0 2026-02-23T06:47:20.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.352+0000 7fd83b7fe640 1 -- 10.20.193.58:0/600459660 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd84c0049f0 con 0x7fd85c1695c0 2026-02-23T06:47:20.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.352+0000 7fd861247640 1 -- 10.20.193.58:0/600459660 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd85c05c030 con 0x7fd85c1695c0 2026-02-23T06:47:20.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.352+0000 7fd861247640 1 --2- 10.20.193.58:0/600459660 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd85c05e5d0 0x7fd85c05c250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:20.352 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.352+0000 7fd861247640 1 -- 10.20.193.58:0/600459660 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fd85c0609c0 con 0x7fd85c05e5d0 2026-02-23T06:47:20.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.352+0000 7fd85ad76640 1 --2- 10.20.193.58:0/600459660 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd85c05e5d0 0x7fd85c05c250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:20.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.353+0000 7fd85ad76640 1 -- 10.20.193.58:0/600459660 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd85c0b6460 con 0x7fd85c05e5d0 2026-02-23T06:47:20.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.353+0000 7fd85ad76640 1 --2- 10.20.193.58:0/600459660 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd85c05e5d0 0x7fd85c05c250 secure :-1 s=READY pgs=40 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd850003770 tx=0x7fd85000fc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:20.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.353+0000 7fd83b7fe640 1 -- 10.20.193.58:0/600459660 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd85000dbd0 con 0x7fd85c05e5d0 2026-02-23T06:47:20.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.353+0000 7fd83b7fe640 1 -- 10.20.193.58:0/600459660 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fd85000fe10 con 0x7fd85c05e5d0 2026-02-23T06:47:20.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.353+0000 7fd83b7fe640 1 -- 10.20.193.58:0/600459660 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd85c05e5d0 msgr2=0x7fd85c05c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:20.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.353+0000 7fd83b7fe640 1 --2- 10.20.193.58:0/600459660 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd85c05e5d0 0x7fd85c05c250 secure :-1 s=READY pgs=40 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd850003770 tx=0x7fd85000fc10 comp rx=0 tx=0).stop 2026-02-23T06:47:20.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.353+0000 7fd83b7fe640 1 -- 10.20.193.58:0/600459660 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd85c05e5d0 msgr2=0x7fd85c05c250 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:47:20.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.353+0000 7fd83b7fe640 1 --2- 10.20.193.58:0/600459660 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd85c05e5d0 0x7fd85c05c250 unknown :-1 s=CLOSED pgs=40 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.353+0000 7fd83b7fe640 1 -- 10.20.193.58:0/600459660 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fd84c01a020 con 0x7fd85c1695c0 2026-02-23T06:47:20.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.354+0000 7fd83b7fe640 1 --2- 10.20.193.58:0/600459660 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd82807a3c0 0x7fd82809a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:20.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.354+0000 7fd83b7fe640 1 -- 10.20.193.58:0/600459660 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fd84c09dce0 con 0x7fd85c1695c0 2026-02-23T06:47:20.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.354+0000 7fd85ad76640 1 --2- 10.20.193.58:0/600459660 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd82807a3c0 0x7fd82809a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:20.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.355+0000 7fd85ad76640 1 --2- 10.20.193.58:0/600459660 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd82807a3c0 0x7fd82809a870 secure :-1 s=READY pgs=544 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd85000d5c0 tx=0x7fd850009030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:20.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.357+0000 7fd861247640 1 --2- 10.20.193.58:0/600459660 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd85c166630 0x7fd85c15c810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:20.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.357+0000 7fd861247640 1 -- 10.20.193.58:0/600459660 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fd85c0b1620 con 0x7fd85c166630 2026-02-23T06:47:20.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.357+0000 7fd85a575640 1 --2- 10.20.193.58:0/600459660 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd85c166630 0x7fd85c15c810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:20.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.357+0000 7fd85a575640 1 -- 10.20.193.58:0/600459660 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd85c0b6f80 con 0x7fd85c166630 2026-02-23T06:47:20.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.358+0000 7fd85a575640 1 --2- 10.20.193.58:0/600459660 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd85c166630 0x7fd85c15c810 secure :-1 s=READY pgs=41 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd844004740 tx=0x7fd844002a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:20.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.358+0000 7fd83b7fe640 1 -- 10.20.193.58:0/600459660 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd84403d050 con 0x7fd85c166630 2026-02-23T06:47:20.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.358+0000 7fd83b7fe640 1 -- 10.20.193.58:0/600459660 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5413 (secure 0 0 0) 0x7fd84403e040 con 0x7fd85c166630 2026-02-23T06:47:20.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.358+0000 7fd83b7fe640 1 -- 10.20.193.58:0/600459660 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd85c166630 msgr2=0x7fd85c15c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:20.356 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:47:20.356 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:47:20.357 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:47:20.357 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:47:20.357 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 228, 2026-02-23T06:47:20.357 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 73309, 2026-02-23T06:47:20.357 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:47:20.357 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:47:20.357 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:47:20.357 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:47:20.357 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:20.357 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:47:20.357 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:47:20.358 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:47:20.358 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:47:20.358 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:20.358 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:20.358 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:20.358 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:20.358 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:20.358 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:20.358 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:20.358 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:20.358 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:20.358 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:20.359 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:20.359 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:20.359 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:20.359 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:20.359 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:47:20.359 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:47:20.359 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:20.359 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:20.359 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:20.359 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:20.359 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:20.359 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:20.360 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:20.360 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:20.360 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:20.360 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:20.360 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:20.360 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:20.360 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:20.360 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:20.360 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.360 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:47:20.360 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:47:20.361 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:47:20.361 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:47:20.361 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:47:20.361 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:47:20.361 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:47:20.361 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:47:20.361 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:47:20.361 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:47:20.361 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:47:20.361 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:47:20.362 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:47:20.362 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:47:20.362 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:47:20.362 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:47:20.362 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:47:20.362 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:20.362 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:20.362 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:20.362 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:20.362 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:20.362 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:20.363 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:20.363 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:20.363 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:20.363 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:20.363 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:20.363 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:20.363 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:20.363 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:20.363 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:47:20.363 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.363 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:47:20.364 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.364 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:47:20.364 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:47:20.364 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:20.364 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:20.364 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.364 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:20.364 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:47:20.364 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:20.364 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.364 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.365 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:20.365 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:47:20.365 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:20.365 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:20.365 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:20.365 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.365 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:47:20.365 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:47:20.365 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:20.365 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:20.366 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:47:20.366 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:20.366 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.366 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.366 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:47:20.366 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:47:20.366 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:20.366 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:20.366 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.366 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:20.367 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:47:20.367 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:20.367 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.367 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.367 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:20.367 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:47:20.367 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:20.367 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:20.367 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:20.367 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.368 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:47:20.368 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:47:20.368 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:20.368 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:20.368 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:47:20.368 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:20.368 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.368 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.368 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:47:20.368 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:47:20.369 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:20.369 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:20.369 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.369 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:20.369 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:47:20.369 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:20.369 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.369 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.369 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:20.369 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:47:20.369 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:20.369 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:20.369 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:20.370 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.370 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:47:20.370 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:47:20.370 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:20.370 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:20.370 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:47:20.370 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:20.370 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:20.370 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:20.370 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.370 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:47:20.371 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:47:20.371 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.371 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:20.371 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:20.371 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:47:20.371 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:20.371 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:20.371 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:47:20.371 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.371 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:20.371 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:20.371 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:47:20.372 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:20.372 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:20.372 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:47:20.372 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.372 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:20.372 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:20.372 INFO:teuthology.orchestra.run.trial058.stdout: "num": 3 2026-02-23T06:47:20.372 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:20.372 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:20.372 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:47:20.372 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.372 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:20.372 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:20.373 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:47:20.373 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:20.373 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:20.373 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:47:20.373 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:20.373 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:20.373 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:20.373 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:47:20.373 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:20.373 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:20.373 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:20.374 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:47:20.374 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:47:20.376 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.358+0000 7fd83b7fe640 1 --2- 10.20.193.58:0/600459660 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd85c166630 0x7fd85c15c810 secure :-1 s=READY pgs=41 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd844004740 tx=0x7fd844002a10 comp rx=0 tx=0).stop 2026-02-23T06:47:20.376 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.358+0000 7fd83b7fe640 1 -- 10.20.193.58:0/600459660 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd85c166630 msgr2=0x7fd85c15c810 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:47:20.376 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.358+0000 7fd83b7fe640 1 --2- 10.20.193.58:0/600459660 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd85c166630 0x7fd85c15c810 secure :-1 s=CLOSED pgs=41 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd844004740 tx=0x7fd844002a10 comp rx=0 tx=0).stop 2026-02-23T06:47:20.376 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.358+0000 7fd861247640 1 -- 10.20.193.58:0/600459660 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd82807a3c0 msgr2=0x7fd82809a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:20.376 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.358+0000 7fd861247640 1 --2- 10.20.193.58:0/600459660 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd82807a3c0 0x7fd82809a870 secure :-1 s=READY pgs=544 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd85000d5c0 tx=0x7fd850009030 comp rx=0 tx=0).stop 2026-02-23T06:47:20.376 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.358+0000 7fd861247640 1 -- 10.20.193.58:0/600459660 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd85c1695c0 msgr2=0x7fd85c05cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:20.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.358+0000 7fd861247640 1 --2- 10.20.193.58:0/600459660 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd85c1695c0 0x7fd85c05cd70 secure :-1 s=READY pgs=26 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd84c00d4d0 tx=0x7fd84c00d9a0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.358+0000 7fd85b577640 1 -- 10.20.193.58:0/600459660 reap_dead start 2026-02-23T06:47:20.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.358+0000 7fd861247640 1 -- 10.20.193.58:0/600459660 shutdown_connections 2026-02-23T06:47:20.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.358+0000 7fd861247640 1 --2- 10.20.193.58:0/600459660 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd85c1695c0 0x7fd85c05cd70 unknown :-1 s=CLOSED pgs=26 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.358+0000 7fd861247640 1 -- 10.20.193.58:0/600459660 >> 10.20.193.58:0/600459660 conn(0x7fd85c0561f0 msgr2=0x7fd85c0b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:20.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.358+0000 7fd861247640 1 -- 10.20.193.58:0/600459660 shutdown_connections 2026-02-23T06:47:20.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.358+0000 7fd861247640 1 -- 10.20.193.58:0/600459660 wait complete. 2026-02-23T06:47:20.377 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:47:20.378 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-23T06:47:20.378 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-23T06:47:20.378 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-23T06:47:20.378 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-23T06:47:20.378 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-23T06:47:20.378 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:47:20.388 INFO:tasks.ceph.mon.c:Stopped 2026-02-23T06:47:20.388 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:47:20.388 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:47:20.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.514+0000 7f7f56dd2640 1 -- 10.20.193.58:0/4210192736 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7f5015d4a0 msgr2=0x7f7f500affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:20.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.514+0000 7f7f56dd2640 1 --2- 10.20.193.58:0/4210192736 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7f5015d4a0 0x7f7f500affb0 secure :-1 s=READY pgs=30 gs=2 cs=0 l=1 c_cookie=3656575257560107864 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f40005e70 tx=0x7f7f4002f2b0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.514+0000 7f7f56dd2640 1 -- 10.20.193.58:0/4210192736 shutdown_connections 2026-02-23T06:47:20.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.514+0000 7f7f56dd2640 1 --2- 10.20.193.58:0/4210192736 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7f5015d870 0x7f7f500587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.514+0000 7f7f56dd2640 1 --2- 10.20.193.58:0/4210192736 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7f5015d4a0 0x7f7f500affb0 unknown :-1 s=CLOSED pgs=30 gs=2 cs=0 l=1 c_cookie=3656575257560107864 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.510 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.514+0000 7f7f56dd2640 1 -- 10.20.193.58:0/4210192736 >> 10.20.193.58:0/4210192736 conn(0x7f7f500b3c20 msgr2=0x7f7f500b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:20.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.514+0000 7f7f56dd2640 1 -- 10.20.193.58:0/4210192736 shutdown_connections 2026-02-23T06:47:20.511 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.514+0000 7f7f56dd2640 1 -- 10.20.193.58:0/4210192736 wait complete. 2026-02-23T06:47:20.513 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.516+0000 7f7f56dd2640 1 Processor -- start 2026-02-23T06:47:20.513 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.516+0000 7f7f56dd2640 1 -- start start 2026-02-23T06:47:20.513 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.516+0000 7f7f56dd2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7f500b6690 0x7f7f50161530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:20.513 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.516+0000 7f7f56dd2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7f5015d4a0 0x7f7f501206e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:20.513 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.516+0000 7f7f56dd2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7f5015d870 0x7f7f50056f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:20.513 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.516+0000 7f7f56dd2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5011e760 con 0x7f7f500b6690 2026-02-23T06:47:20.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.516+0000 7f7f56dd2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5011ea40 con 0x7f7f5015d4a0 2026-02-23T06:47:20.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.516+0000 7f7f56dd2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f7f50162140 con 0x7f7f5015d870 2026-02-23T06:47:20.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.516+0000 7f7f565d1640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7f5015d870 msgr2=0x7f7f50056f50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:47:20.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.516+0000 7f7f55dd0640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7f500b6690 0x7f7f50161530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:20.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.516+0000 7f7f565d1640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7f5015d870 0x7f7f50056f50 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:47:20.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.516+0000 7f7f555cf640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7f5015d4a0 0x7f7f501206e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:20.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.516+0000 7f7f55dd0640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7f500b6690 0x7f7f50161530 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:33620/0 (socket says 10.20.193.58:33620) 2026-02-23T06:47:20.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.516+0000 7f7f55dd0640 1 -- 10.20.193.58:0/1645073797 learned_addr learned my addr 10.20.193.58:0/1645073797 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:47:20.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.517+0000 7f7f55dd0640 1 -- 10.20.193.58:0/1645073797 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7f5015d870 msgr2=0x7f7f50056f50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:47:20.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.517+0000 7f7f55dd0640 1 --2- 10.20.193.58:0/1645073797 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7f5015d870 0x7f7f50056f50 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.517+0000 7f7f55dd0640 1 -- 10.20.193.58:0/1645073797 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7f5015d4a0 msgr2=0x7f7f501206e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:20.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.517+0000 7f7f55dd0640 1 --2- 10.20.193.58:0/1645073797 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7f5015d4a0 0x7f7f501206e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.515 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.517+0000 7f7f55dd0640 1 -- 10.20.193.58:0/1645073797 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f40009570 con 0x7f7f500b6690 2026-02-23T06:47:20.515 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.517+0000 7f7f55dd0640 1 --2- 10.20.193.58:0/1645073797 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7f500b6690 0x7f7f50161530 secure :-1 s=READY pgs=31 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f40004740 tx=0x7f7f40002a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:20.515 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.517+0000 7f7f3e7fc640 1 -- 10.20.193.58:0/1645073797 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f4003d070 con 0x7f7f500b6690 2026-02-23T06:47:20.515 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.517+0000 7f7f3e7fc640 1 -- 10.20.193.58:0/1645073797 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f40004a70 con 0x7f7f500b6690 2026-02-23T06:47:20.515 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.517+0000 7f7f56dd2640 1 -- 10.20.193.58:0/1645073797 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f50162420 con 0x7f7f500b6690 2026-02-23T06:47:20.515 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.517+0000 7f7f56dd2640 1 -- 10.20.193.58:0/1645073797 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f50163050 con 0x7f7f500b6690 2026-02-23T06:47:20.515 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.517+0000 7f7f3e7fc640 1 -- 10.20.193.58:0/1645073797 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f40004e80 con 0x7f7f500b6690 2026-02-23T06:47:20.515 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.518+0000 7f7f17fff640 1 -- 10.20.193.58:0/1645073797 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f500b6d50 con 0x7f7f500b6690 2026-02-23T06:47:20.516 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.519+0000 7f7f3e7fc640 1 -- 10.20.193.58:0/1645073797 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f7f40004fe0 con 0x7f7f500b6690 2026-02-23T06:47:20.516 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.520+0000 7f7f3e7fc640 1 --2- 10.20.193.58:0/1645073797 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7f2007a5a0 0x7f7f2009aa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:20.516 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.520+0000 7f7f555cf640 1 --2- 10.20.193.58:0/1645073797 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7f2007a5a0 0x7f7f2009aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:20.516 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.521+0000 7f7f555cf640 1 --2- 10.20.193.58:0/1645073797 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7f2007a5a0 0x7f7f2009aa50 secure :-1 s=READY pgs=545 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f500b08e0 tx=0x7f7f44006f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:20.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.522+0000 7f7f3e7fc640 1 -- 10.20.193.58:0/1645073797 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f7f40089ce0 con 0x7f7f500b6690 2026-02-23T06:47:20.517 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.522+0000 7f7f3e7fc640 1 -- 10.20.193.58:0/1645073797 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f7f40085930 con 0x7f7f500b6690 2026-02-23T06:47:20.671 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.676+0000 7f7f17fff640 1 -- 10.20.193.58:0/1645073797 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7f50161f80 con 0x7f7f500b6690 2026-02-23T06:47:20.672 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.676+0000 7f7f3e7fc640 1 -- 10.20.193.58:0/1645073797 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f7f40088ae0 con 0x7f7f500b6690 2026-02-23T06:47:20.672 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":228,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:47:20.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.678+0000 7f7f17fff640 1 -- 10.20.193.58:0/1645073797 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7f2007a5a0 msgr2=0x7f7f2009aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:20.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.678+0000 7f7f17fff640 1 --2- 10.20.193.58:0/1645073797 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7f2007a5a0 0x7f7f2009aa50 secure :-1 s=READY pgs=545 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f500b08e0 tx=0x7f7f44006f90 comp rx=0 tx=0).stop 2026-02-23T06:47:20.674 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.678+0000 7f7f17fff640 1 -- 10.20.193.58:0/1645073797 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7f500b6690 msgr2=0x7f7f50161530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:20.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.678+0000 7f7f17fff640 1 --2- 10.20.193.58:0/1645073797 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7f500b6690 0x7f7f50161530 secure :-1 s=READY pgs=31 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f40004740 tx=0x7f7f40002a10 comp rx=0 tx=0).stop 2026-02-23T06:47:20.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.678+0000 7f7f17fff640 1 -- 10.20.193.58:0/1645073797 shutdown_connections 2026-02-23T06:47:20.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.678+0000 7f7f17fff640 1 --2- 10.20.193.58:0/1645073797 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7f2007a5a0 0x7f7f2009aa50 unknown :-1 s=CLOSED pgs=545 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.678+0000 7f7f17fff640 1 --2- 10.20.193.58:0/1645073797 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7f5015d870 0x7f7f50056f50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.678+0000 7f7f17fff640 1 --2- 10.20.193.58:0/1645073797 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7f5015d4a0 0x7f7f501206e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.678+0000 7f7f17fff640 1 --2- 10.20.193.58:0/1645073797 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7f500b6690 0x7f7f50161530 unknown :-1 s=CLOSED pgs=31 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:20.675 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.678+0000 7f7f17fff640 1 -- 10.20.193.58:0/1645073797 >> 10.20.193.58:0/1645073797 conn(0x7f7f500b3c20 msgr2=0x7f7f500b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:20.676 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.678+0000 7f7f17fff640 1 -- 10.20.193.58:0/1645073797 shutdown_connections 2026-02-23T06:47:20.676 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:20.678+0000 7f7f17fff640 1 -- 10.20.193.58:0/1645073797 wait complete. 2026-02-23T06:47:23.686 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:47:23.810 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.815+0000 7f4047739640 1 -- 10.20.193.58:0/3395985236 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4040162ca0 msgr2=0x7f4040056fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:23.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.815+0000 7f4047739640 1 --2- 10.20.193.58:0/3395985236 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4040162ca0 0x7f4040056fc0 secure :-1 s=READY pgs=108 gs=2 cs=0 l=1 c_cookie=14880460326671596019 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4034005820 tx=0x7f40340302f0 comp rx=0 tx=0).stop 2026-02-23T06:47:23.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.815+0000 7f4047739640 1 -- 10.20.193.58:0/3395985236 shutdown_connections 2026-02-23T06:47:23.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.815+0000 7f4047739640 1 --2- 10.20.193.58:0/3395985236 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4040162ca0 0x7f4040056fc0 unknown :-1 s=CLOSED pgs=108 gs=2 cs=0 l=1 c_cookie=14880460326671596019 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:23.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.815+0000 7f4047739640 1 --2- 10.20.193.58:0/3395985236 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f404015c4b0 0x7f4040058200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:23.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.815+0000 7f4047739640 1 -- 10.20.193.58:0/3395985236 >> 10.20.193.58:0/3395985236 conn(0x7f40400b3c20 msgr2=0x7f40400b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:23.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.815+0000 7f4047739640 1 -- 10.20.193.58:0/3395985236 shutdown_connections 2026-02-23T06:47:23.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.815+0000 7f4047739640 1 -- 10.20.193.58:0/3395985236 wait complete. 2026-02-23T06:47:23.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.816+0000 7f4047739640 1 Processor -- start 2026-02-23T06:47:23.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.816+0000 7f4047739640 1 -- start start 2026-02-23T06:47:23.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.817+0000 7f4047739640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4040056960 0x7f40400afe70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:23.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.817+0000 7f4047739640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f404015c4b0 0x7f4040141ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:23.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.817+0000 7f4047739640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4040162ca0 0x7f404013e480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:23.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.817+0000 7f4047739640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f40401433c0 con 0x7f4040056960 2026-02-23T06:47:23.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.817+0000 7f4047739640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f40400b0850 con 0x7f4040162ca0 2026-02-23T06:47:23.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.817+0000 7f4047739640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f40400af0a0 con 0x7f404015c4b0 2026-02-23T06:47:23.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.817+0000 7f4045f36640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f404015c4b0 msgr2=0x7f4040141ba0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:47:23.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.817+0000 7f4045f36640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f404015c4b0 0x7f4040141ba0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:47:23.814 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.817+0000 7f4046f38640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4040162ca0 0x7f404013e480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:23.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.817+0000 7f4046737640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4040056960 0x7f40400afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:23.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.817+0000 7f4046f38640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4040162ca0 0x7f404013e480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:34746/0 (socket says 10.20.193.58:34746) 2026-02-23T06:47:23.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.817+0000 7f4046f38640 1 -- 10.20.193.58:0/2326317757 learned_addr learned my addr 10.20.193.58:0/2326317757 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:47:23.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.817+0000 7f4046737640 1 -- 10.20.193.58:0/2326317757 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f404015c4b0 msgr2=0x7f4040141ba0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:47:23.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.817+0000 7f4046737640 1 --2- 10.20.193.58:0/2326317757 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f404015c4b0 0x7f4040141ba0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:23.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.817+0000 7f4046737640 1 -- 10.20.193.58:0/2326317757 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4040162ca0 msgr2=0x7f404013e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:23.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.817+0000 7f4046737640 1 --2- 10.20.193.58:0/2326317757 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4040162ca0 0x7f404013e480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:23.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.817+0000 7f4046737640 1 -- 10.20.193.58:0/2326317757 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f403400a590 con 0x7f4040056960 2026-02-23T06:47:23.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.818+0000 7f4046737640 1 --2- 10.20.193.58:0/2326317757 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4040056960 0x7f40400afe70 secure :-1 s=READY pgs=37 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f403800b4a0 tx=0x7f403800b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:23.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.818+0000 7f402affd640 1 -- 10.20.193.58:0/2326317757 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4038002cd0 con 0x7f4040056960 2026-02-23T06:47:23.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.818+0000 7f402affd640 1 -- 10.20.193.58:0/2326317757 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4038004070 con 0x7f4040056960 2026-02-23T06:47:23.815 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.818+0000 7f402affd640 1 -- 10.20.193.58:0/2326317757 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4038004460 con 0x7f4040056960 2026-02-23T06:47:23.816 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.818+0000 7f4047739640 1 -- 10.20.193.58:0/2326317757 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40400b0a80 con 0x7f4040056960 2026-02-23T06:47:23.816 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.818+0000 7f4047739640 1 -- 10.20.193.58:0/2326317757 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40400b03b0 con 0x7f4040056960 2026-02-23T06:47:23.816 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.819+0000 7f4047739640 1 -- 10.20.193.58:0/2326317757 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4040143500 con 0x7f4040056960 2026-02-23T06:47:23.817 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.820+0000 7f402affd640 1 -- 10.20.193.58:0/2326317757 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f40380045c0 con 0x7f4040056960 2026-02-23T06:47:23.817 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.820+0000 7f402affd640 1 --2- 10.20.193.58:0/2326317757 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f401007a5b0 0x7f401009aa60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:23.817 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.820+0000 7f402affd640 1 -- 10.20.193.58:0/2326317757 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f403809d440 con 0x7f4040056960 2026-02-23T06:47:23.817 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.821+0000 7f4045f36640 1 --2- 10.20.193.58:0/2326317757 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f401007a5b0 0x7f401009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:23.817 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.822+0000 7f4045f36640 1 --2- 10.20.193.58:0/2326317757 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f401007a5b0 0x7f401009aa60 secure :-1 s=READY pgs=546 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f404005ca90 tx=0x7f402c007b70 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:23.818 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.823+0000 7f402affd640 1 -- 10.20.193.58:0/2326317757 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f4040143500 con 0x7f4040056960 2026-02-23T06:47:23.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.979+0000 7f4047739640 1 -- 10.20.193.58:0/2326317757 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4040143500 con 0x7f4040056960 2026-02-23T06:47:23.975 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.979+0000 7f402affd640 1 -- 10.20.193.58:0/2326317757 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f4040143500 con 0x7f4040056960 2026-02-23T06:47:23.975 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":228,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:47:23.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.980+0000 7f4047739640 1 -- 10.20.193.58:0/2326317757 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f401007a5b0 msgr2=0x7f401009aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:23.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.980+0000 7f4047739640 1 --2- 10.20.193.58:0/2326317757 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f401007a5b0 0x7f401009aa60 secure :-1 s=READY pgs=546 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f404005ca90 tx=0x7f402c007b70 comp rx=0 tx=0).stop 2026-02-23T06:47:23.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.980+0000 7f4047739640 1 -- 10.20.193.58:0/2326317757 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4040056960 msgr2=0x7f40400afe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:23.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.980+0000 7f4047739640 1 --2- 10.20.193.58:0/2326317757 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4040056960 0x7f40400afe70 secure :-1 s=READY pgs=37 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f403800b4a0 tx=0x7f403800b970 comp rx=0 tx=0).stop 2026-02-23T06:47:23.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.980+0000 7f4047739640 1 -- 10.20.193.58:0/2326317757 shutdown_connections 2026-02-23T06:47:23.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.980+0000 7f4047739640 1 --2- 10.20.193.58:0/2326317757 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f401007a5b0 0x7f401009aa60 unknown :-1 s=CLOSED pgs=546 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:23.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.980+0000 7f4047739640 1 --2- 10.20.193.58:0/2326317757 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f4040162ca0 0x7f404013e480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:23.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.980+0000 7f4047739640 1 --2- 10.20.193.58:0/2326317757 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f404015c4b0 0x7f4040141ba0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:23.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.980+0000 7f4047739640 1 --2- 10.20.193.58:0/2326317757 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4040056960 0x7f40400afe70 unknown :-1 s=CLOSED pgs=37 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:23.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.980+0000 7f4047739640 1 -- 10.20.193.58:0/2326317757 >> 10.20.193.58:0/2326317757 conn(0x7f40400b3c20 msgr2=0x7f40400b40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:23.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.980+0000 7f4047739640 1 -- 10.20.193.58:0/2326317757 shutdown_connections 2026-02-23T06:47:23.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:23.980+0000 7f4047739640 1 -- 10.20.193.58:0/2326317757 wait complete. 2026-02-23T06:47:26.990 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:47:27.122 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.127+0000 7f93c6375640 1 -- 10.20.193.58:0/3444099639 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f93c00b6690 msgr2=0x7f93c0058ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:27.122 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.127+0000 7f93c6375640 1 --2- 10.20.193.58:0/3444099639 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f93c00b6690 0x7f93c0058ec0 secure :-1 s=READY pgs=111 gs=3 cs=0 l=1 c_cookie=619026609237206959 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93bc005820 tx=0x7f93bc030300 comp rx=0 tx=0).stop 2026-02-23T06:47:27.123 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.127+0000 7f93c6375640 1 -- 10.20.193.58:0/3444099639 shutdown_connections 2026-02-23T06:47:27.123 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.127+0000 7f93c6375640 1 --2- 10.20.193.58:0/3444099639 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f93c00b6690 0x7f93c0058ec0 unknown :-1 s=CLOSED pgs=111 gs=3 cs=0 l=1 c_cookie=619026609237206959 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:27.123 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.127+0000 7f93c6375640 1 -- 10.20.193.58:0/3444099639 >> 10.20.193.58:0/3444099639 conn(0x7f93c00b3c20 msgr2=0x7f93c00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:27.123 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.127+0000 7f93c6375640 1 -- 10.20.193.58:0/3444099639 shutdown_connections 2026-02-23T06:47:27.123 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.127+0000 7f93c6375640 1 -- 10.20.193.58:0/3444099639 wait complete. 2026-02-23T06:47:27.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.128+0000 7f93c6375640 1 Processor -- start 2026-02-23T06:47:27.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.128+0000 7f93c6375640 1 -- start start 2026-02-23T06:47:27.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.128+0000 7f93c6375640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f93c00b6690 0x7f93c0120070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:27.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.128+0000 7f93c6375640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f93c015d4a0 0x7f93c011e7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:27.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.128+0000 7f93c6375640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f93c015d870 0x7f93c011ed10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:27.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.128+0000 7f93c6375640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f93c0056570 con 0x7f93c015d4a0 2026-02-23T06:47:27.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.128+0000 7f93c6375640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f93c0056290 con 0x7f93c015d870 2026-02-23T06:47:27.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.128+0000 7f93c6375640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f93c0120c60 con 0x7f93c00b6690 2026-02-23T06:47:27.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.128+0000 7f93c5373640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f93c00b6690 msgr2=0x7f93c0120070 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:47:27.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.128+0000 7f93c5373640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f93c00b6690 0x7f93c0120070 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:47:27.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.128+0000 7f93c4b72640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f93c015d4a0 0x7f93c011e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:27.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.128+0000 7f93c4b72640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f93c015d4a0 0x7f93c011e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:33642/0 (socket says 10.20.193.58:33642) 2026-02-23T06:47:27.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.128+0000 7f93c4b72640 1 -- 10.20.193.58:0/2333743678 learned_addr learned my addr 10.20.193.58:0/2333743678 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:47:27.126 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.128+0000 7f93c5b74640 1 --2- 10.20.193.58:0/2333743678 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f93c015d870 0x7f93c011ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:27.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.129+0000 7f93c4b72640 1 -- 10.20.193.58:0/2333743678 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f93c00b6690 msgr2=0x7f93c0120070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:47:27.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.129+0000 7f93c4b72640 1 --2- 10.20.193.58:0/2333743678 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f93c00b6690 0x7f93c0120070 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:27.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.129+0000 7f93c4b72640 1 -- 10.20.193.58:0/2333743678 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f93c015d870 msgr2=0x7f93c011ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:27.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.129+0000 7f93c4b72640 1 --2- 10.20.193.58:0/2333743678 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f93c015d870 0x7f93c011ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:27.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.129+0000 7f93c4b72640 1 -- 10.20.193.58:0/2333743678 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93bc00a590 con 0x7f93c015d4a0 2026-02-23T06:47:27.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.129+0000 7f93c4b72640 1 --2- 10.20.193.58:0/2333743678 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f93c015d4a0 0x7f93c011e7d0 secure :-1 s=READY pgs=40 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93b4007fd0 tx=0x7f93b400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:27.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.129+0000 7f93adffb640 1 -- 10.20.193.58:0/2333743678 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f93b400a860 con 0x7f93c015d4a0 2026-02-23T06:47:27.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.129+0000 7f93adffb640 1 -- 10.20.193.58:0/2333743678 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93b400aab0 con 0x7f93c015d4a0 2026-02-23T06:47:27.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.129+0000 7f93adffb640 1 -- 10.20.193.58:0/2333743678 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f93b400aea0 con 0x7f93c015d4a0 2026-02-23T06:47:27.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.129+0000 7f93c6375640 1 -- 10.20.193.58:0/2333743678 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93c0057cf0 con 0x7f93c015d4a0 2026-02-23T06:47:27.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.129+0000 7f93c6375640 1 -- 10.20.193.58:0/2333743678 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93c0120f40 con 0x7f93c015d4a0 2026-02-23T06:47:27.127 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.130+0000 7f93c6375640 1 -- 10.20.193.58:0/2333743678 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93c00b6d50 con 0x7f93c015d4a0 2026-02-23T06:47:27.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.131+0000 7f93adffb640 1 -- 10.20.193.58:0/2333743678 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f93b401b400 con 0x7f93c015d4a0 2026-02-23T06:47:27.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.132+0000 7f93adffb640 1 --2- 10.20.193.58:0/2333743678 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f939007a5a0 0x7f939009aa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:27.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.132+0000 7f93adffb640 1 -- 10.20.193.58:0/2333743678 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f93b409d9e0 con 0x7f93c015d4a0 2026-02-23T06:47:27.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.132+0000 7f93c5373640 1 --2- 10.20.193.58:0/2333743678 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f939007a5a0 0x7f939009aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:27.129 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.132+0000 7f93c5373640 1 --2- 10.20.193.58:0/2333743678 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f939007a5a0 0x7f939009aa50 secure :-1 s=READY pgs=547 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93b0002390 tx=0x7f93b0007a70 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:27.131 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.136+0000 7f93adffb640 1 -- 10.20.193.58:0/2333743678 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f93b4060a60 con 0x7f93c015d4a0 2026-02-23T06:47:27.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.294+0000 7f93c6375640 1 -- 10.20.193.58:0/2333743678 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f93c00581d0 con 0x7f93c015d4a0 2026-02-23T06:47:27.289 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.294+0000 7f93adffb640 1 -- 10.20.193.58:0/2333743678 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f93b4063c10 con 0x7f93c015d4a0 2026-02-23T06:47:27.290 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":228,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:47:27.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.295+0000 7f93c6375640 1 -- 10.20.193.58:0/2333743678 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f939007a5a0 msgr2=0x7f939009aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:27.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.295+0000 7f93c6375640 1 --2- 10.20.193.58:0/2333743678 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f939007a5a0 0x7f939009aa50 secure :-1 s=READY pgs=547 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93b0002390 tx=0x7f93b0007a70 comp rx=0 tx=0).stop 2026-02-23T06:47:27.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.295+0000 7f93c6375640 1 -- 10.20.193.58:0/2333743678 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f93c015d4a0 msgr2=0x7f93c011e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:27.291 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.295+0000 7f93c6375640 1 --2- 10.20.193.58:0/2333743678 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f93c015d4a0 0x7f93c011e7d0 secure :-1 s=READY pgs=40 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93b4007fd0 tx=0x7f93b400cba0 comp rx=0 tx=0).stop 2026-02-23T06:47:27.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.295+0000 7f93c6375640 1 -- 10.20.193.58:0/2333743678 shutdown_connections 2026-02-23T06:47:27.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.295+0000 7f93c6375640 1 --2- 10.20.193.58:0/2333743678 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f939007a5a0 0x7f939009aa50 unknown :-1 s=CLOSED pgs=547 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:27.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.295+0000 7f93c6375640 1 --2- 10.20.193.58:0/2333743678 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f93c015d870 0x7f93c011ed10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:27.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.295+0000 7f93c6375640 1 --2- 10.20.193.58:0/2333743678 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f93c015d4a0 0x7f93c011e7d0 unknown :-1 s=CLOSED pgs=40 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:27.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.295+0000 7f93c6375640 1 --2- 10.20.193.58:0/2333743678 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f93c00b6690 0x7f93c0120070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:27.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.295+0000 7f93c6375640 1 -- 10.20.193.58:0/2333743678 >> 10.20.193.58:0/2333743678 conn(0x7f93c00b3c20 msgr2=0x7f93c013c550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:27.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.295+0000 7f93c6375640 1 -- 10.20.193.58:0/2333743678 shutdown_connections 2026-02-23T06:47:27.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:27.295+0000 7f93c6375640 1 -- 10.20.193.58:0/2333743678 wait complete. 2026-02-23T06:47:30.304 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:47:34.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.789+0000 7fec7ffff640 1 -- 10.20.193.58:0/846948312 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fec6c005270 msgr2=0x7fec6c065a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:34.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.789+0000 7fec7ffff640 1 --2- 10.20.193.58:0/846948312 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fec6c005270 0x7fec6c065a10 secure :-1 s=READY pgs=115 gs=22 cs=0 l=1 c_cookie=10067386517560478195 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec800b1b90 tx=0x7fec7002fbd0 comp rx=0 tx=0).stop 2026-02-23T06:47:34.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.789+0000 7fec7ffff640 1 -- 10.20.193.58:0/846948312 shutdown_connections 2026-02-23T06:47:34.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.789+0000 7fec7ffff640 1 --2- 10.20.193.58:0/846948312 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fec6c005270 0x7fec6c065a10 unknown :-1 s=CLOSED pgs=115 gs=22 cs=0 l=1 c_cookie=10067386517560478195 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:34.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.789+0000 7fec7ffff640 1 --2- 10.20.193.58:0/846948312 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fec6c004850 0x7fec6c004cc0 unknown :-1 s=CLOSED pgs=0 gs=23 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:34.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.789+0000 7fec7ffff640 1 --2- 10.20.193.58:0/846948312 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fec6c003a30 0x7fec6c003e20 unknown :-1 s=CLOSED pgs=0 gs=21 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:34.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.789+0000 7fec7ffff640 1 -- 10.20.193.58:0/846948312 >> 10.20.193.58:0/846948312 conn(0x7fec800b3c20 msgr2=0x7fec800b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:34.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.789+0000 7fec7ffff640 1 -- 10.20.193.58:0/846948312 shutdown_connections 2026-02-23T06:47:34.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.789+0000 7fec7ffff640 1 -- 10.20.193.58:0/846948312 wait complete. 2026-02-23T06:47:34.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.790+0000 7fec7ffff640 1 Processor -- start 2026-02-23T06:47:34.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.790+0000 7fec7ffff640 1 -- start start 2026-02-23T06:47:34.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.791+0000 7fec7ffff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fec6c003a30 0x7fec80135d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:34.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.791+0000 7fec7ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fec6c004850 0x7fec80057520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:34.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.791+0000 7fec7ffff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fec6c005270 0x7fec80057a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:34.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.791+0000 7fec7ffff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fec8013eb80 con 0x7fec6c004850 2026-02-23T06:47:34.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.791+0000 7fec7ffff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fec80163650 con 0x7fec6c003a30 2026-02-23T06:47:34.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.791+0000 7fec7ffff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fec8013a340 con 0x7fec6c005270 2026-02-23T06:47:34.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.791+0000 7fec7f7fe640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fec6c005270 msgr2=0x7fec80057a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:47:34.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.791+0000 7fec7f7fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fec6c005270 0x7fec80057a60 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:47:34.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.791+0000 7fec7e7fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fec6c004850 0x7fec80057520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:34.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.791+0000 7fec7e7fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fec6c004850 0x7fec80057520 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:46526/0 (socket says 10.20.193.58:46526) 2026-02-23T06:47:34.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.791+0000 7fec7e7fc640 1 -- 10.20.193.58:0/4041697952 learned_addr learned my addr 10.20.193.58:0/4041697952 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:47:34.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.791+0000 7fec7effd640 1 --2- 10.20.193.58:0/4041697952 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fec6c003a30 0x7fec80135d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:34.787 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.791+0000 7fec7e7fc640 1 -- 10.20.193.58:0/4041697952 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fec6c005270 msgr2=0x7fec80057a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:47:34.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.791+0000 7fec7e7fc640 1 --2- 10.20.193.58:0/4041697952 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fec6c005270 0x7fec80057a60 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:34.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.791+0000 7fec7e7fc640 1 -- 10.20.193.58:0/4041697952 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fec6c003a30 msgr2=0x7fec80135d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:34.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.791+0000 7fec7e7fc640 1 --2- 10.20.193.58:0/4041697952 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fec6c003a30 0x7fec80135d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:34.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.791+0000 7fec7e7fc640 1 -- 10.20.193.58:0/4041697952 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec80163110 con 0x7fec6c004850 2026-02-23T06:47:34.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.791+0000 7fec7effd640 1 --2- 10.20.193.58:0/4041697952 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fec6c003a30 0x7fec80135d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:47:34.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.791+0000 7fec7e7fc640 1 --2- 10.20.193.58:0/4041697952 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fec6c004850 0x7fec80057520 secure :-1 s=READY pgs=43 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec68005c00 tx=0x7fec68013b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:34.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.791+0000 7fec5f7fe640 1 -- 10.20.193.58:0/4041697952 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fec68011b50 con 0x7fec6c004850 2026-02-23T06:47:34.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.791+0000 7fec5f7fe640 1 -- 10.20.193.58:0/4041697952 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec68011da0 con 0x7fec6c004850 2026-02-23T06:47:34.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.791+0000 7fec5f7fe640 1 -- 10.20.193.58:0/4041697952 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fec68004ad0 con 0x7fec6c004850 2026-02-23T06:47:34.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.791+0000 7fec7ffff640 1 -- 10.20.193.58:0/4041697952 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec8013e8a0 con 0x7fec6c004850 2026-02-23T06:47:34.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.791+0000 7fec7ffff640 1 -- 10.20.193.58:0/4041697952 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec80162e30 con 0x7fec6c004850 2026-02-23T06:47:34.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.793+0000 7fec7ffff640 1 -- 10.20.193.58:0/4041697952 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec800b6d50 con 0x7fec6c004850 2026-02-23T06:47:34.788 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.793+0000 7fec5f7fe640 1 -- 10.20.193.58:0/4041697952 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fec6801b3f0 con 0x7fec6c004850 2026-02-23T06:47:34.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.794+0000 7fec5f7fe640 1 --2- 10.20.193.58:0/4041697952 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fec4c07a5a0 0x7fec4c09aa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:34.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.794+0000 7fec5f7fe640 1 -- 10.20.193.58:0/4041697952 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fec6809e880 con 0x7fec6c004850 2026-02-23T06:47:34.789 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.794+0000 7fec7effd640 1 --2- 10.20.193.58:0/4041697952 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fec4c07a5a0 0x7fec4c09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:34.790 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.795+0000 7fec7effd640 1 --2- 10.20.193.58:0/4041697952 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fec4c07a5a0 0x7fec4c09aa50 secure :-1 s=READY pgs=548 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec74006fd0 tx=0x7fec74002960 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:34.791 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.796+0000 7fec5f7fe640 1 -- 10.20.193.58:0/4041697952 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fec68061900 con 0x7fec6c004850 2026-02-23T06:47:34.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.951+0000 7fec7ffff640 1 -- 10.20.193.58:0/4041697952 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fec800af470 con 0x7fec6c004850 2026-02-23T06:47:34.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.951+0000 7fec5f7fe640 1 -- 10.20.193.58:0/4041697952 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1749 (secure 0 0 0) 0x7fec68064ab0 con 0x7fec6c004850 2026-02-23T06:47:34.947 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":232,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:47:34.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.952+0000 7fec7ffff640 1 -- 10.20.193.58:0/4041697952 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fec4c07a5a0 msgr2=0x7fec4c09aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:34.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.952+0000 7fec7ffff640 1 --2- 10.20.193.58:0/4041697952 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fec4c07a5a0 0x7fec4c09aa50 secure :-1 s=READY pgs=548 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec74006fd0 tx=0x7fec74002960 comp rx=0 tx=0).stop 2026-02-23T06:47:34.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.952+0000 7fec7ffff640 1 -- 10.20.193.58:0/4041697952 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fec6c004850 msgr2=0x7fec80057520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:34.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.952+0000 7fec7ffff640 1 --2- 10.20.193.58:0/4041697952 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fec6c004850 0x7fec80057520 secure :-1 s=READY pgs=43 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec68005c00 tx=0x7fec68013b90 comp rx=0 tx=0).stop 2026-02-23T06:47:34.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.952+0000 7fec7ffff640 1 -- 10.20.193.58:0/4041697952 shutdown_connections 2026-02-23T06:47:34.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.952+0000 7fec7ffff640 1 --2- 10.20.193.58:0/4041697952 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fec4c07a5a0 0x7fec4c09aa50 unknown :-1 s=CLOSED pgs=548 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:34.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.952+0000 7fec7ffff640 1 --2- 10.20.193.58:0/4041697952 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fec6c005270 0x7fec80057a60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:34.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.952+0000 7fec7ffff640 1 --2- 10.20.193.58:0/4041697952 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fec6c004850 0x7fec80057520 unknown :-1 s=CLOSED pgs=43 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:34.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.952+0000 7fec7ffff640 1 --2- 10.20.193.58:0/4041697952 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fec6c003a30 0x7fec80135d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:34.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.952+0000 7fec7ffff640 1 -- 10.20.193.58:0/4041697952 >> 10.20.193.58:0/4041697952 conn(0x7fec800b3c20 msgr2=0x7fec800b7480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:34.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.953+0000 7fec7ffff640 1 -- 10.20.193.58:0/4041697952 shutdown_connections 2026-02-23T06:47:34.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:34.953+0000 7fec7ffff640 1 -- 10.20.193.58:0/4041697952 wait complete. 2026-02-23T06:47:34.960 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:47:34.960 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-23T06:47:34.960 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:47:35.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.088+0000 7f6cdd5d2640 1 -- 10.20.193.58:0/3595131608 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6cd815d4a0 msgr2=0x7f6cd80affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:35.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.088+0000 7f6cdd5d2640 1 --2- 10.20.193.58:0/3595131608 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6cd815d4a0 0x7f6cd80affb0 secure :-1 s=READY pgs=116 gs=3 cs=0 l=1 c_cookie=6809840724397260421 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cd80b5040 tx=0x7f6cc402f250 comp rx=0 tx=0).stop 2026-02-23T06:47:35.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.089+0000 7f6cdd5d2640 1 -- 10.20.193.58:0/3595131608 shutdown_connections 2026-02-23T06:47:35.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.089+0000 7f6cdd5d2640 1 --2- 10.20.193.58:0/3595131608 >> v2:10.20.193.58:3300/0 conn(0x7f6cd815d870 0x7f6cd80587b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:35.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.089+0000 7f6cdd5d2640 1 --2- 10.20.193.58:0/3595131608 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6cd815d4a0 0x7f6cd80affb0 unknown :-1 s=CLOSED pgs=116 gs=3 cs=0 l=1 c_cookie=6809840724397260421 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:35.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.089+0000 7f6cdd5d2640 1 -- 10.20.193.58:0/3595131608 >> 10.20.193.58:0/3595131608 conn(0x7f6cd80b3c20 msgr2=0x7f6cd80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:35.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.089+0000 7f6cdd5d2640 1 -- 10.20.193.58:0/3595131608 shutdown_connections 2026-02-23T06:47:35.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.089+0000 7f6cdd5d2640 1 -- 10.20.193.58:0/3595131608 wait complete. 2026-02-23T06:47:35.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.090+0000 7f6cdd5d2640 1 Processor -- start 2026-02-23T06:47:35.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.090+0000 7f6cdd5d2640 1 -- start start 2026-02-23T06:47:35.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.090+0000 7f6cdd5d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6cd80b6690 0x7f6cd8125ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:35.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.090+0000 7f6cdd5d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6cd815d4a0 0x7f6cd8126410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:35.091 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.090+0000 7f6cdd5d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6cd815d870 0x7f6cd81611c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:35.091 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.090+0000 7f6cdd5d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd8162e70 con 0x7f6cd80b6690 2026-02-23T06:47:35.091 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.090+0000 7f6cdd5d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd813e770 con 0x7f6cd815d4a0 2026-02-23T06:47:35.091 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.090+0000 7f6cdd5d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f6cd8125a40 con 0x7f6cd815d870 2026-02-23T06:47:35.091 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.090+0000 7f6cd7fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6cd80b6690 0x7f6cd8125ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:35.091 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.091+0000 7f6cdcdd1640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6cd815d870 msgr2=0x7f6cd81611c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:47:35.091 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.091+0000 7f6cd7fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6cd80b6690 0x7f6cd8125ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:46546/0 (socket says 10.20.193.58:46546) 2026-02-23T06:47:35.091 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.091+0000 7f6cd7fff640 1 -- 10.20.193.58:0/1566743802 learned_addr learned my addr 10.20.193.58:0/1566743802 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:47:35.091 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.091+0000 7f6cdcdd1640 1 --2- 10.20.193.58:0/1566743802 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6cd815d870 0x7f6cd81611c0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:47:35.091 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.091+0000 7f6cd77fe640 1 --2- 10.20.193.58:0/1566743802 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6cd815d4a0 0x7f6cd8126410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:35.092 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.091+0000 7f6cd7fff640 1 -- 10.20.193.58:0/1566743802 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6cd815d870 msgr2=0x7f6cd81611c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:47:35.092 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.091+0000 7f6cd7fff640 1 --2- 10.20.193.58:0/1566743802 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6cd815d870 0x7f6cd81611c0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:35.092 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.091+0000 7f6cd7fff640 1 -- 10.20.193.58:0/1566743802 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6cd815d4a0 msgr2=0x7f6cd8126410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:35.092 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.091+0000 7f6cd7fff640 1 --2- 10.20.193.58:0/1566743802 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6cd815d4a0 0x7f6cd8126410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:35.092 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.091+0000 7f6cd7fff640 1 -- 10.20.193.58:0/1566743802 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc4009570 con 0x7f6cd80b6690 2026-02-23T06:47:35.092 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.091+0000 7f6cd7fff640 1 --2- 10.20.193.58:0/1566743802 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6cd80b6690 0x7f6cd8125ed0 secure :-1 s=READY pgs=45 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cc4005e70 tx=0x7f6cc40028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:35.092 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.091+0000 7f6cd4ff9640 1 -- 10.20.193.58:0/1566743802 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6cc403d070 con 0x7f6cd80b6690 2026-02-23T06:47:35.092 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.091+0000 7f6cd4ff9640 1 -- 10.20.193.58:0/1566743802 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cc4038470 con 0x7f6cd80b6690 2026-02-23T06:47:35.092 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.091+0000 7f6cd4ff9640 1 -- 10.20.193.58:0/1566743802 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6cc4038880 con 0x7f6cd80b6690 2026-02-23T06:47:35.092 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.091+0000 7f6cdd5d2640 1 -- 10.20.193.58:0/1566743802 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd814da10 con 0x7f6cd80b6690 2026-02-23T06:47:35.092 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.091+0000 7f6cdd5d2640 1 -- 10.20.193.58:0/1566743802 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd81256d0 con 0x7f6cd80b6690 2026-02-23T06:47:35.092 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.092+0000 7f6cdd5d2640 1 --2- 10.20.193.58:0/1566743802 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6cd81274d0 0x7f6cd81278a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:35.093 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.092+0000 7f6cdd5d2640 1 -- 10.20.193.58:0/1566743802 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd80609c0 con 0x7f6cd81274d0 2026-02-23T06:47:35.093 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.092+0000 7f6cd77fe640 1 --2- 10.20.193.58:0/1566743802 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6cd81274d0 0x7f6cd81278a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:35.093 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.092+0000 7f6cd77fe640 1 -- 10.20.193.58:0/1566743802 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6cd80b6330 con 0x7f6cd81274d0 2026-02-23T06:47:35.093 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.092+0000 7f6cd77fe640 1 --2- 10.20.193.58:0/1566743802 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6cd81274d0 0x7f6cd81278a0 secure :-1 s=READY pgs=46 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cd813ff70 tx=0x7f6cc800fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:35.093 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.093+0000 7f6cd4ff9640 1 -- 10.20.193.58:0/1566743802 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6cc800db20 con 0x7f6cd81274d0 2026-02-23T06:47:35.093 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.093+0000 7f6cd4ff9640 1 -- 10.20.193.58:0/1566743802 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f6cc800dc80 con 0x7f6cd81274d0 2026-02-23T06:47:35.093 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.093+0000 7f6cd4ff9640 1 -- 10.20.193.58:0/1566743802 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6cd81274d0 msgr2=0x7f6cd81278a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:35.093 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.093+0000 7f6cd4ff9640 1 --2- 10.20.193.58:0/1566743802 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6cd81274d0 0x7f6cd81278a0 secure :-1 s=READY pgs=46 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cd813ff70 tx=0x7f6cc800fda0 comp rx=0 tx=0).stop 2026-02-23T06:47:35.093 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.093+0000 7f6cd4ff9640 1 -- 10.20.193.58:0/1566743802 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6cd81274d0 msgr2=0x7f6cd81278a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:47:35.093 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.093+0000 7f6cd4ff9640 1 --2- 10.20.193.58:0/1566743802 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6cd81274d0 0x7f6cd81278a0 secure :-1 s=CLOSED pgs=46 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cd813ff70 tx=0x7f6cc800fda0 comp rx=0 tx=0).stop 2026-02-23T06:47:35.093 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.093+0000 7f6cd4ff9640 1 -- 10.20.193.58:0/1566743802 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f6cc4048060 con 0x7f6cd80b6690 2026-02-23T06:47:35.094 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.094+0000 7f6cd4ff9640 1 --2- 10.20.193.58:0/1566743802 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6ca807a430 0x7f6ca809a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:35.094 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.094+0000 7f6cd4ff9640 1 -- 10.20.193.58:0/1566743802 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f6cc40c1d20 con 0x7f6cd80b6690 2026-02-23T06:47:35.094 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.094+0000 7f6cd77fe640 1 --2- 10.20.193.58:0/1566743802 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6ca807a430 0x7f6ca809a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:35.094 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.095+0000 7f6cd77fe640 1 --2- 10.20.193.58:0/1566743802 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6ca807a430 0x7f6ca809a8e0 secure :-1 s=READY pgs=549 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cd813ff70 tx=0x7f6cc8013000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:35.095 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.096+0000 7f6cdd5d2640 1 --2- 10.20.193.58:0/1566743802 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6cd81504e0 0x7f6cd81508b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:35.095 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.096+0000 7f6cdd5d2640 1 -- 10.20.193.58:0/1566743802 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd8164250 con 0x7f6cd81504e0 2026-02-23T06:47:35.095 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.097+0000 7f6cdcdd1640 1 --2- 10.20.193.58:0/1566743802 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6cd81504e0 0x7f6cd81508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:35.095 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.097+0000 7f6cdcdd1640 1 -- 10.20.193.58:0/1566743802 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6cd8125b80 con 0x7f6cd81504e0 2026-02-23T06:47:35.095 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.097+0000 7f6cdcdd1640 1 --2- 10.20.193.58:0/1566743802 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6cd81504e0 0x7f6cd81508b0 secure :-1 s=READY pgs=47 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ccc003860 tx=0x7f6ccc00d820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:35.095 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.097+0000 7f6cd4ff9640 1 -- 10.20.193.58:0/1566743802 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ccc006d90 con 0x7f6cd81504e0 2026-02-23T06:47:35.096 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.097+0000 7f6cd4ff9640 1 -- 10.20.193.58:0/1566743802 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5403 (secure 0 0 0) 0x7f6ccc0080d0 con 0x7f6cd81504e0 2026-02-23T06:47:35.096 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.097+0000 7f6cd4ff9640 1 -- 10.20.193.58:0/1566743802 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6cd81504e0 msgr2=0x7f6cd81508b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:35.096 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.097+0000 7f6cd4ff9640 1 --2- 10.20.193.58:0/1566743802 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6cd81504e0 0x7f6cd81508b0 secure :-1 s=READY pgs=47 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ccc003860 tx=0x7f6ccc00d820 comp rx=0 tx=0).stop 2026-02-23T06:47:35.096 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:47:35.096 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:47:35.096 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:47:35.097 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:47:35.097 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 232, 2026-02-23T06:47:35.097 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 26416, 2026-02-23T06:47:35.097 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:47:35.097 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:47:35.097 INFO:teuthology.orchestra.run.trial058.stdout: 1 2026-02-23T06:47:35.097 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:35.097 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:47:35.097 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:47:35.097 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:47:35.097 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:47:35.097 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:35.098 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:35.098 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:35.098 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:35.098 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:35.098 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:35.098 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:35.098 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:35.098 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:35.098 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:35.098 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:35.098 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:35.098 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:35.099 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:35.099 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:47:35.099 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:47:35.099 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:35.099 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:35.099 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:35.099 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:35.099 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:35.099 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:35.099 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:35.099 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:35.099 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:35.100 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:35.100 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:35.100 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:35.100 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:35.100 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:35.100 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:35.100 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:47:35.100 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:47:35.100 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:47:35.100 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:47:35.100 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:47:35.100 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:47:35.101 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:47:35.101 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:47:35.101 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:47:35.101 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:47:35.101 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:47:35.101 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:47:35.101 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:47:35.101 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:47:35.101 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:47:35.101 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:47:35.101 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:47:35.102 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:35.102 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:35.102 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:35.102 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:35.102 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:35.102 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:35.102 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:35.102 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:35.102 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:35.102 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:35.102 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:35.102 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:35.102 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:35.103 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:35.103 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:47:35.103 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:35.103 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:47:35.103 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.103 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:47:35.103 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:47:35.103 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:35.103 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:35.103 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.103 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:35.103 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:47:35.104 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:35.104 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:35.104 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.104 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:35.104 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:47:35.104 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:35.104 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:35.104 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:35.104 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:35.104 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:47:35.104 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:47:35.104 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:35.104 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:35.105 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:47:35.105 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:35.105 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:35.105 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.105 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:47:35.105 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:47:35.105 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:35.105 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:35.105 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.105 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:35.105 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:47:35.105 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:35.106 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:35.106 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.106 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:35.106 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:47:35.106 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:35.106 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:35.106 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:35.106 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:35.106 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:47:35.106 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:47:35.106 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:35.106 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:35.106 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:47:35.107 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:35.107 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:35.107 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.107 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:47:35.107 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:47:35.107 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:35.107 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:35.107 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.107 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:35.107 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:47:35.107 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:35.107 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:35.108 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.108 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:35.108 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:47:35.108 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:35.108 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:35.108 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:35.108 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:35.108 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:47:35.108 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:47:35.108 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:35.108 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:35.108 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:47:35.108 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:35.109 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:35.109 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:35.109 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:35.109 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:47:35.109 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:47:35.109 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.109 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:35.109 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:35.109 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:47:35.109 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:35.109 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:35.109 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:47:35.110 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.110 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:35.110 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:35.110 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:47:35.110 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:35.110 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:35.110 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:47:35.110 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.110 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:35.110 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:35.110 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:47:35.110 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:35.110 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:35.111 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:47:35.111 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.111 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:35.111 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:35.111 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:47:35.111 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:35.111 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:35.111 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:47:35.111 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.111 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:35.111 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:35.111 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:47:35.112 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:35.112 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:35.112 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:35.112 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:47:35.112 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:47:35.113 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.097+0000 7f6cd4ff9640 1 -- 10.20.193.58:0/1566743802 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6cd81504e0 msgr2=0x7f6cd81508b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:47:35.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.097+0000 7f6cd4ff9640 1 --2- 10.20.193.58:0/1566743802 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6cd81504e0 0x7f6cd81508b0 secure :-1 s=CLOSED pgs=47 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ccc003860 tx=0x7f6ccc00d820 comp rx=0 tx=0).stop 2026-02-23T06:47:35.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.097+0000 7f6cdd5d2640 1 -- 10.20.193.58:0/1566743802 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6ca807a430 msgr2=0x7f6ca809a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:35.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.097+0000 7f6cdd5d2640 1 --2- 10.20.193.58:0/1566743802 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6ca807a430 0x7f6ca809a8e0 secure :-1 s=READY pgs=549 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cd813ff70 tx=0x7f6cc8013000 comp rx=0 tx=0).stop 2026-02-23T06:47:35.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.097+0000 7f6cdd5d2640 1 -- 10.20.193.58:0/1566743802 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6cd80b6690 msgr2=0x7f6cd8125ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:35.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.097+0000 7f6cdd5d2640 1 --2- 10.20.193.58:0/1566743802 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6cd80b6690 0x7f6cd8125ed0 secure :-1 s=READY pgs=45 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cc4005e70 tx=0x7f6cc40028d0 comp rx=0 tx=0).stop 2026-02-23T06:47:35.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.097+0000 7f6cdcdd1640 1 -- 10.20.193.58:0/1566743802 reap_dead start 2026-02-23T06:47:35.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.098+0000 7f6cdd5d2640 1 -- 10.20.193.58:0/1566743802 shutdown_connections 2026-02-23T06:47:35.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.098+0000 7f6cdd5d2640 1 --2- 10.20.193.58:0/1566743802 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6cd80b6690 0x7f6cd8125ed0 unknown :-1 s=CLOSED pgs=45 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:35.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.098+0000 7f6cdd5d2640 1 -- 10.20.193.58:0/1566743802 >> 10.20.193.58:0/1566743802 conn(0x7f6cd80b3c20 msgr2=0x7f6cd80b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:35.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.098+0000 7f6cdd5d2640 1 -- 10.20.193.58:0/1566743802 shutdown_connections 2026-02-23T06:47:35.114 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.098+0000 7f6cdd5d2640 1 -- 10.20.193.58:0/1566743802 wait complete. 2026-02-23T06:47:35.115 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:47:35.115 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-23T06:47:35.115 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:47:35.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.242+0000 7f56a8bdd640 1 -- 10.20.193.58:0/161546853 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5690004eb0 msgr2=0x7f5690005320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:35.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.242+0000 7f56a8bdd640 1 --2- 10.20.193.58:0/161546853 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5690004eb0 0x7f5690005320 secure :-1 s=READY pgs=49 gs=5 cs=0 l=1 c_cookie=13152446635561011131 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56a40b6420 tx=0x7f56940301d0 comp rx=0 tx=0).stop 2026-02-23T06:47:35.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.242+0000 7f56a2d76640 1 -- 10.20.193.58:0/161546853 reap_dead start 2026-02-23T06:47:35.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.242+0000 7f56a8bdd640 1 -- 10.20.193.58:0/161546853 shutdown_connections 2026-02-23T06:47:35.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.242+0000 7f56a8bdd640 1 -- 10.20.193.58:0/161546853 >> 10.20.193.58:0/161546853 conn(0x7f56a40561f0 msgr2=0x7f56a40565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:35.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.242+0000 7f56a8bdd640 1 -- 10.20.193.58:0/161546853 shutdown_connections 2026-02-23T06:47:35.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.242+0000 7f56a8bdd640 1 -- 10.20.193.58:0/161546853 wait complete. 2026-02-23T06:47:35.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.243+0000 7f56a8bdd640 1 Processor -- start 2026-02-23T06:47:35.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.244+0000 7f56a8bdd640 1 -- start start 2026-02-23T06:47:35.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.244+0000 7f56a8bdd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f56a40b0180 0x7f56a41407d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:35.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.244+0000 7f56a8bdd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f56a413ba10 0x7f56a4140d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:35.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.244+0000 7f56a8bdd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f56a40b0550 0x7f56a413ef90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:35.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.244+0000 7f56a8bdd640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f56a415d360 con 0x7f56a40b0550 2026-02-23T06:47:35.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.244+0000 7f56a8bdd640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f56a4166350 con 0x7f56a40b0180 2026-02-23T06:47:35.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.244+0000 7f56a8bdd640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f56a413cd80 con 0x7f56a413ba10 2026-02-23T06:47:35.241 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.244+0000 7f56a1d74640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f56a413ba10 msgr2=0x7f56a4140d10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:47:35.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.244+0000 7f56a1d74640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f56a413ba10 0x7f56a4140d10 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:47:35.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.244+0000 7f56a2d76640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f56a40b0550 0x7f56a413ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:35.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.245+0000 7f56a2d76640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f56a40b0550 0x7f56a413ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:46586/0 (socket says 10.20.193.58:46586) 2026-02-23T06:47:35.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.245+0000 7f56a2d76640 1 -- 10.20.193.58:0/2860843711 learned_addr learned my addr 10.20.193.58:0/2860843711 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:47:35.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.245+0000 7f56a2575640 1 --2- 10.20.193.58:0/2860843711 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f56a40b0180 0x7f56a41407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:35.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.245+0000 7f56a2d76640 1 -- 10.20.193.58:0/2860843711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f56a413ba10 msgr2=0x7f56a4140d10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:47:35.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.245+0000 7f56a2d76640 1 --2- 10.20.193.58:0/2860843711 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f56a413ba10 0x7f56a4140d10 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:35.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.245+0000 7f56a2d76640 1 -- 10.20.193.58:0/2860843711 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f56a40b0180 msgr2=0x7f56a41407d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:35.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.245+0000 7f56a2d76640 1 --2- 10.20.193.58:0/2860843711 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f56a40b0180 0x7f56a41407d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:35.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.245+0000 7f56a2d76640 1 -- 10.20.193.58:0/2860843711 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56a415d080 con 0x7f56a40b0550 2026-02-23T06:47:35.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.245+0000 7f56a2d76640 1 --2- 10.20.193.58:0/2860843711 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f56a40b0550 0x7f56a413ef90 secure :-1 s=READY pgs=50 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5694003810 tx=0x7f5694039c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:35.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.245+0000 7f568affd640 1 -- 10.20.193.58:0/2860843711 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5694030c10 con 0x7f56a40b0550 2026-02-23T06:47:35.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.245+0000 7f568affd640 1 -- 10.20.193.58:0/2860843711 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56940038e0 con 0x7f56a40b0550 2026-02-23T06:47:35.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.245+0000 7f568affd640 1 -- 10.20.193.58:0/2860843711 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5694003d10 con 0x7f56a40b0550 2026-02-23T06:47:35.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.245+0000 7f56a8bdd640 1 -- 10.20.193.58:0/2860843711 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56a4165a20 con 0x7f56a40b0550 2026-02-23T06:47:35.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.245+0000 7f56a8bdd640 1 -- 10.20.193.58:0/2860843711 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56a4165fe0 con 0x7f56a40b0550 2026-02-23T06:47:35.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.246+0000 7f56a8bdd640 1 --2- 10.20.193.58:0/2860843711 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f56a413e7a0 0x7f56a413f4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:35.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.246+0000 7f56a8bdd640 1 -- 10.20.193.58:0/2860843711 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f56a40609c0 con 0x7f56a413e7a0 2026-02-23T06:47:35.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.246+0000 7f56a2575640 1 --2- 10.20.193.58:0/2860843711 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f56a413e7a0 0x7f56a413f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:35.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.246+0000 7f56a2575640 1 -- 10.20.193.58:0/2860843711 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f56a4166a80 con 0x7f56a413e7a0 2026-02-23T06:47:35.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.246+0000 7f56a2575640 1 --2- 10.20.193.58:0/2860843711 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f56a413e7a0 0x7f56a413f4d0 secure :-1 s=READY pgs=118 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5698003130 tx=0x7f5698003a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:35.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.247+0000 7f568affd640 1 -- 10.20.193.58:0/2860843711 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56980128d0 con 0x7f56a413e7a0 2026-02-23T06:47:35.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.247+0000 7f568affd640 1 -- 10.20.193.58:0/2860843711 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f5698012a30 con 0x7f56a413e7a0 2026-02-23T06:47:35.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.247+0000 7f568affd640 1 -- 10.20.193.58:0/2860843711 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f56a413e7a0 msgr2=0x7f56a413f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:35.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.247+0000 7f568affd640 1 --2- 10.20.193.58:0/2860843711 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f56a413e7a0 0x7f56a413f4d0 secure :-1 s=READY pgs=118 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5698003130 tx=0x7f5698003a80 comp rx=0 tx=0).stop 2026-02-23T06:47:35.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.247+0000 7f568affd640 1 -- 10.20.193.58:0/2860843711 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f56a413e7a0 msgr2=0x7f56a413f4d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:47:35.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.247+0000 7f568affd640 1 --2- 10.20.193.58:0/2860843711 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f56a413e7a0 0x7f56a413f4d0 secure :-1 s=CLOSED pgs=118 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5698003130 tx=0x7f5698003a80 comp rx=0 tx=0).stop 2026-02-23T06:47:35.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.247+0000 7f568affd640 1 -- 10.20.193.58:0/2860843711 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f5694005030 con 0x7f56a40b0550 2026-02-23T06:47:35.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.248+0000 7f568affd640 1 --2- 10.20.193.58:0/2860843711 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f567007a3c0 0x7f567009a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:35.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.248+0000 7f568affd640 1 -- 10.20.193.58:0/2860843711 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f56940c2bc0 con 0x7f56a40b0550 2026-02-23T06:47:35.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.248+0000 7f56a2575640 1 --2- 10.20.193.58:0/2860843711 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f567007a3c0 0x7f567009a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:35.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.249+0000 7f56a2575640 1 --2- 10.20.193.58:0/2860843711 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f567007a3c0 0x7f567009a870 secure :-1 s=READY pgs=550 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5698004fd0 tx=0x7f569800f000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:35.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.250+0000 7f56a8bdd640 1 --2- 10.20.193.58:0/2860843711 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f56a413fa10 0x7f56a4201280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:35.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.250+0000 7f56a8bdd640 1 -- 10.20.193.58:0/2860843711 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f56a41676b0 con 0x7f56a413fa10 2026-02-23T06:47:35.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.250+0000 7f56a1d74640 1 --2- 10.20.193.58:0/2860843711 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f56a413fa10 0x7f56a4201280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:35.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.251+0000 7f56a1d74640 1 -- 10.20.193.58:0/2860843711 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f56a41661a0 con 0x7f56a413fa10 2026-02-23T06:47:35.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.251+0000 7f56a1d74640 1 --2- 10.20.193.58:0/2860843711 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f56a413fa10 0x7f56a4201280 secure :-1 s=READY pgs=119 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56a4137b80 tx=0x7f568c00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:35.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.251+0000 7f568affd640 1 -- 10.20.193.58:0/2860843711 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f568c005e30 con 0x7f56a413fa10 2026-02-23T06:47:35.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.251+0000 7f568affd640 1 -- 10.20.193.58:0/2860843711 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5545 (secure 0 0 0) 0x7f568c0070d0 con 0x7f56a413fa10 2026-02-23T06:47:35.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.251+0000 7f568affd640 1 -- 10.20.193.58:0/2860843711 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f56a413fa10 msgr2=0x7f56a4201280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:35.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.251+0000 7f568affd640 1 --2- 10.20.193.58:0/2860843711 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f56a413fa10 0x7f56a4201280 secure :-1 s=READY pgs=119 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56a4137b80 tx=0x7f568c00c8d0 comp rx=0 tx=0).stop 2026-02-23T06:47:35.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.251+0000 7f568affd640 1 -- 10.20.193.58:0/2860843711 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f56a413fa10 msgr2=0x7f56a4201280 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:47:35.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.251+0000 7f568affd640 1 --2- 10.20.193.58:0/2860843711 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f56a413fa10 0x7f56a4201280 unknown :-1 s=CLOSED pgs=119 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:35.248 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:47:35.248 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:47:35.248 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:47:35.249 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:47:35.249 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 232, 2026-02-23T06:47:35.249 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 141610, 2026-02-23T06:47:35.249 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:47:35.249 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:47:35.249 INFO:teuthology.orchestra.run.trial058.stdout: 1 2026-02-23T06:47:35.249 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:35.249 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:47:35.249 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:47:35.249 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:47:35.249 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:47:35.250 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:35.250 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:35.250 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:35.250 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:35.250 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:35.250 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:35.250 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:35.250 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:35.250 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:35.250 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:35.250 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:35.250 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:35.250 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:35.251 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:35.251 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:47:35.251 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:47:35.251 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:35.251 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:35.251 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:35.251 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:35.251 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:35.251 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:35.251 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:35.251 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:35.251 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:35.252 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:35.252 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:35.252 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:35.252 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:35.252 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:35.252 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:35.252 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:47:35.252 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:47:35.252 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:47:35.252 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:47:35.252 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:47:35.252 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:47:35.253 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:47:35.253 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:47:35.253 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:47:35.253 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:47:35.253 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:47:35.253 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:47:35.253 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:47:35.253 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:47:35.253 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:47:35.253 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:47:35.253 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:47:35.253 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:35.254 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:35.254 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:35.254 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:35.254 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:35.254 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:35.254 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:35.254 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:35.254 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:35.254 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:35.254 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:35.254 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:35.254 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:35.255 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:35.255 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:47:35.255 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:35.255 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:47:35.255 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.255 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:47:35.255 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:47:35.255 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:35.255 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:35.255 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.255 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:35.255 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:47:35.256 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:35.256 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:35.256 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.256 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:35.256 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:47:35.256 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:35.256 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:35.256 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:35.256 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:35.256 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:47:35.256 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:47:35.256 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:35.257 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:35.257 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:47:35.257 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:35.257 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:35.257 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.257 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:47:35.257 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:47:35.257 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:35.257 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:35.257 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.257 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:35.257 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:47:35.258 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:35.258 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:35.258 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.258 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:35.258 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:47:35.258 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:35.258 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:35.258 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:35.258 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:35.258 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:47:35.258 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:47:35.259 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:35.259 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:35.259 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:47:35.259 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:35.259 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:35.259 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.259 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:47:35.259 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:47:35.259 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:35.259 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:35.259 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.259 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:35.260 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:47:35.260 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:35.260 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:35.260 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.260 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:35.260 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:47:35.260 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:35.260 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:35.260 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:35.260 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:35.260 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:47:35.260 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:47:35.261 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:35.261 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:35.261 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:47:35.261 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:35.261 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:35.261 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:35.261 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:35.261 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:47:35.261 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:47:35.261 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.261 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:35.261 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:35.262 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:47:35.262 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:35.262 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:35.262 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:47:35.262 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.262 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:35.262 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:35.262 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:47:35.262 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:35.262 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:35.262 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:47:35.262 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.262 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:35.263 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:35.263 INFO:teuthology.orchestra.run.trial058.stdout: "num": 7 2026-02-23T06:47:35.263 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:35.263 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:35.263 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:47:35.263 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.263 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:47:35.263 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:47:35.263 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:47:35.263 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:35.263 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.263 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:35.264 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:35.264 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:47:35.264 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:35.264 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:35.264 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:47:35.264 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:35.264 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:35.264 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:35.264 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:47:35.264 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:35.264 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:35.264 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:35.265 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:47:35.265 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:47:35.266 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.252+0000 7f56a8bdd640 1 -- 10.20.193.58:0/2860843711 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f567007a3c0 msgr2=0x7f567009a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:35.266 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.252+0000 7f56a8bdd640 1 --2- 10.20.193.58:0/2860843711 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f567007a3c0 0x7f567009a870 secure :-1 s=READY pgs=550 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5698004fd0 tx=0x7f569800f000 comp rx=0 tx=0).stop 2026-02-23T06:47:35.266 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.252+0000 7f56a8bdd640 1 -- 10.20.193.58:0/2860843711 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f56a40b0550 msgr2=0x7f56a413ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:35.267 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.252+0000 7f56a8bdd640 1 --2- 10.20.193.58:0/2860843711 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f56a40b0550 0x7f56a413ef90 secure :-1 s=READY pgs=50 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5694003810 tx=0x7f5694039c50 comp rx=0 tx=0).stop 2026-02-23T06:47:35.267 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.252+0000 7f56a2d76640 1 -- 10.20.193.58:0/2860843711 reap_dead start 2026-02-23T06:47:35.267 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.252+0000 7f56a2d76640 1 -- 10.20.193.58:0/2860843711 reap_dead start 2026-02-23T06:47:35.267 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.252+0000 7f56a8bdd640 1 -- 10.20.193.58:0/2860843711 shutdown_connections 2026-02-23T06:47:35.267 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.252+0000 7f56a8bdd640 1 -- 10.20.193.58:0/2860843711 >> 10.20.193.58:0/2860843711 conn(0x7f56a40561f0 msgr2=0x7f56a40b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:35.267 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.252+0000 7f56a8bdd640 1 -- 10.20.193.58:0/2860843711 shutdown_connections 2026-02-23T06:47:35.267 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:35.252+0000 7f56a8bdd640 1 -- 10.20.193.58:0/2860843711 wait complete. 2026-02-23T06:47:35.268 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:47:35.268 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:47:45.349 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:47:45.355 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:47:55.268 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-23T06:47:55.268 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-23T06:47:55.268 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-23T06:47:55.269 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-23T06:47:55.271 INFO:tasks.ceph.mon.c:Started 2026-02-23T06:47:55.271 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:47:55.271 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:47:55.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.397+0000 7f7b66047640 1 -- 10.20.193.58:0/3278962942 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b600b2b20 msgr2=0x7f7b601636d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:55.393 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.397+0000 7f7b66047640 1 --2- 10.20.193.58:0/3278962942 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b600b2b20 0x7f7b601636d0 secure :-1 s=READY pgs=54 gs=2 cs=0 l=1 c_cookie=14987595991075176238 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b600b1700 tx=0x7f7b5002f250 comp rx=0 tx=0).stop 2026-02-23T06:47:55.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.397+0000 7f7b66047640 1 -- 10.20.193.58:0/3278962942 shutdown_connections 2026-02-23T06:47:55.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.397+0000 7f7b66047640 1 --2- 10.20.193.58:0/3278962942 >> v2:10.20.193.93:3300/0 conn(0x7f7b600b3370 0x7f7b60163c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:55.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.397+0000 7f7b66047640 1 --2- 10.20.193.58:0/3278962942 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b600b2b20 0x7f7b601636d0 unknown :-1 s=CLOSED pgs=54 gs=2 cs=0 l=1 c_cookie=14987595991075176238 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:55.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.397+0000 7f7b66047640 1 -- 10.20.193.58:0/3278962942 >> 10.20.193.58:0/3278962942 conn(0x7f7b600561f0 msgr2=0x7f7b600565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:55.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.398+0000 7f7b66047640 1 -- 10.20.193.58:0/3278962942 shutdown_connections 2026-02-23T06:47:55.394 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.398+0000 7f7b66047640 1 -- 10.20.193.58:0/3278962942 wait complete. 2026-02-23T06:47:55.396 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.399+0000 7f7b66047640 1 Processor -- start 2026-02-23T06:47:55.396 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.399+0000 7f7b66047640 1 -- start start 2026-02-23T06:47:55.396 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.399+0000 7f7b66047640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7b600b2b20 0x7f7b60139a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:55.396 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.399+0000 7f7b66047640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b600b3370 0x7f7b60131080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:55.396 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.399+0000 7f7b66047640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7b60158b40 0x7f7b60138900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:55.396 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.399+0000 7f7b66047640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f7b60139780 con 0x7f7b600b3370 2026-02-23T06:47:55.396 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.399+0000 7f7b66047640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f7b600afc10 con 0x7f7b60158b40 2026-02-23T06:47:55.397 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.399+0000 7f7b66047640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f7b60139fd0 con 0x7f7b600b2b20 2026-02-23T06:47:55.397 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.399+0000 7f7b5effd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b600b3370 0x7f7b60131080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:55.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.399+0000 7f7b5effd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b600b3370 0x7f7b60131080 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:46564/0 (socket says 10.20.193.58:46564) 2026-02-23T06:47:55.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.399+0000 7f7b5effd640 1 -- 10.20.193.58:0/4174333491 learned_addr learned my addr 10.20.193.58:0/4174333491 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:47:55.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.399+0000 7f7b5effd640 1 -- 10.20.193.58:0/4174333491 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7b600b2b20 msgr2=0x7f7b60139a90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-23T06:47:55.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.399+0000 7f7b5effd640 1 --2- 10.20.193.58:0/4174333491 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7b600b2b20 0x7f7b60139a90 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:55.401 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.399+0000 7f7b5effd640 1 -- 10.20.193.58:0/4174333491 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7b60158b40 msgr2=0x7f7b60138900 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-23T06:47:55.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.399+0000 7f7b5effd640 1 --2- 10.20.193.58:0/4174333491 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7b60158b40 0x7f7b60138900 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:55.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.399+0000 7f7b5effd640 1 -- 10.20.193.58:0/4174333491 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b50009570 con 0x7f7b600b3370 2026-02-23T06:47:55.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.399+0000 7f7b5effd640 1 --2- 10.20.193.58:0/4174333491 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b600b3370 0x7f7b60131080 secure :-1 s=READY pgs=55 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b50004740 tx=0x7f7b500028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:55.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.399+0000 7f7b3bfff640 1 -- 10.20.193.58:0/4174333491 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7b5003d070 con 0x7f7b600b3370 2026-02-23T06:47:55.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.399+0000 7f7b3bfff640 1 -- 10.20.193.58:0/4174333491 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b50038470 con 0x7f7b600b3370 2026-02-23T06:47:55.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.399+0000 7f7b3bfff640 1 -- 10.20.193.58:0/4174333491 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7b50038880 con 0x7f7b600b3370 2026-02-23T06:47:55.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.399+0000 7f7b66047640 1 -- 10.20.193.58:0/4174333491 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b600b0830 con 0x7f7b600b3370 2026-02-23T06:47:55.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.399+0000 7f7b66047640 1 -- 10.20.193.58:0/4174333491 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b600b0290 con 0x7f7b600b3370 2026-02-23T06:47:55.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.399+0000 7f7b39ffb640 1 -- 10.20.193.58:0/4174333491 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b60058640 con 0x7f7b600b3370 2026-02-23T06:47:55.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.399+0000 7f7b3bfff640 1 -- 10.20.193.58:0/4174333491 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f7b50048060 con 0x7f7b600b3370 2026-02-23T06:47:55.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.399+0000 7f7b3bfff640 1 --2- 10.20.193.58:0/4174333491 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7b3007a6b0 0x7f7b3009ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:55.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.399+0000 7f7b3bfff640 1 -- 10.20.193.58:0/4174333491 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f7b500c1f90 con 0x7f7b600b3370 2026-02-23T06:47:55.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.399+0000 7f7b3bfff640 1 -- 10.20.193.58:0/4174333491 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f7b50085240 con 0x7f7b600b3370 2026-02-23T06:47:55.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.406+0000 7f7b5f7fe640 1 --2- 10.20.193.58:0/4174333491 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7b3007a6b0 0x7f7b3009ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:55.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.407+0000 7f7b5f7fe640 1 --2- 10.20.193.58:0/4174333491 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7b3007a6b0 0x7f7b3009ab60 secure :-1 s=READY pgs=552 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b4c0027d0 tx=0x7f7b4c007a90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:55.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.560+0000 7f7b39ffb640 1 -- 10.20.193.58:0/4174333491 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7b6015c760 con 0x7f7b600b3370 2026-02-23T06:47:55.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.561+0000 7f7b3bfff640 1 -- 10.20.193.58:0/4174333491 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7f7b50088360 con 0x7f7b600b3370 2026-02-23T06:47:55.557 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":234,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:47:55.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.562+0000 7f7b39ffb640 1 -- 10.20.193.58:0/4174333491 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7b3007a6b0 msgr2=0x7f7b3009ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:55.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.562+0000 7f7b39ffb640 1 --2- 10.20.193.58:0/4174333491 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7b3007a6b0 0x7f7b3009ab60 secure :-1 s=READY pgs=552 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b4c0027d0 tx=0x7f7b4c007a90 comp rx=0 tx=0).stop 2026-02-23T06:47:55.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.562+0000 7f7b39ffb640 1 -- 10.20.193.58:0/4174333491 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b600b3370 msgr2=0x7f7b60131080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:55.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.562+0000 7f7b39ffb640 1 --2- 10.20.193.58:0/4174333491 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b600b3370 0x7f7b60131080 secure :-1 s=READY pgs=55 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b50004740 tx=0x7f7b500028d0 comp rx=0 tx=0).stop 2026-02-23T06:47:55.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.562+0000 7f7b39ffb640 1 -- 10.20.193.58:0/4174333491 shutdown_connections 2026-02-23T06:47:55.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.562+0000 7f7b39ffb640 1 --2- 10.20.193.58:0/4174333491 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7b3007a6b0 0x7f7b3009ab60 unknown :-1 s=CLOSED pgs=552 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:55.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.562+0000 7f7b39ffb640 1 --2- 10.20.193.58:0/4174333491 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7b60158b40 0x7f7b60138900 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:55.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.562+0000 7f7b39ffb640 1 --2- 10.20.193.58:0/4174333491 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b600b3370 0x7f7b60131080 unknown :-1 s=CLOSED pgs=55 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:55.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.562+0000 7f7b39ffb640 1 --2- 10.20.193.58:0/4174333491 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7b600b2b20 0x7f7b60139a90 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:55.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.562+0000 7f7b39ffb640 1 -- 10.20.193.58:0/4174333491 >> 10.20.193.58:0/4174333491 conn(0x7f7b600561f0 msgr2=0x7f7b600b76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:55.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.562+0000 7f7b39ffb640 1 -- 10.20.193.58:0/4174333491 shutdown_connections 2026-02-23T06:47:55.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.562+0000 7f7b39ffb640 1 -- 10.20.193.58:0/4174333491 wait complete. 2026-02-23T06:47:55.570 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:47:55.570 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:47:55.570 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:47:55.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.697+0000 7f8bd7577640 1 -- 10.20.193.58:0/500096293 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8bc4003db0 msgr2=0x7f8bc4004200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:55.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.697+0000 7f8bd7577640 1 --2- 10.20.193.58:0/500096293 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8bc4003db0 0x7f8bc4004200 secure :-1 s=READY pgs=57 gs=6 cs=0 l=1 c_cookie=17827741647475231593 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8bc8004760 tx=0x7f8bc80309e0 comp rx=0 tx=0).stop 2026-02-23T06:47:55.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.697+0000 7f8bd6d76640 1 -- 10.20.193.58:0/500096293 reap_dead start 2026-02-23T06:47:55.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.697+0000 7f8bd7577640 1 -- 10.20.193.58:0/500096293 shutdown_connections 2026-02-23T06:47:55.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.697+0000 7f8bd7577640 1 -- 10.20.193.58:0/500096293 >> 10.20.193.58:0/500096293 conn(0x7f8bd80b3c20 msgr2=0x7f8bd80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:55.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.697+0000 7f8bd7577640 1 -- 10.20.193.58:0/500096293 shutdown_connections 2026-02-23T06:47:55.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.697+0000 7f8bd7577640 1 -- 10.20.193.58:0/500096293 wait complete. 2026-02-23T06:47:55.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.699+0000 7f8bd7577640 1 Processor -- start 2026-02-23T06:47:55.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.699+0000 7f8bd7577640 1 -- start start 2026-02-23T06:47:55.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.699+0000 7f8bd7577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8bd8057520 0x7f8bd80578f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:55.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.699+0000 7f8bd7577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8bd8121310 0x7f8bd8149960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.699+0000 7f8bd7577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8bd814cde0 0x7f8bd813cf10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.699+0000 7f8bd7577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd8057e30 con 0x7f8bd8057520 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.699+0000 7f8bd7577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd8149ea0 con 0x7f8bd814cde0 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.699+0000 7f8bd7577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f8bd8121ab0 con 0x7f8bd8121310 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.700+0000 7f8bd6575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8bd8057520 0x7f8bd80578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.700+0000 7f8bd6575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8bd8057520 0x7f8bd80578f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:46582/0 (socket says 10.20.193.58:46582) 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.700+0000 7f8bd6575640 1 -- 10.20.193.58:0/2243591101 learned_addr learned my addr 10.20.193.58:0/2243591101 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.700+0000 7f8bd5d74640 1 --2- 10.20.193.58:0/2243591101 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8bd8121310 0x7f8bd8149960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.700+0000 7f8bd6d76640 1 --2- 10.20.193.58:0/2243591101 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8bd814cde0 0x7f8bd813cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.700+0000 7f8bd5d74640 1 -- 10.20.193.58:0/2243591101 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8bd8121310 msgr2=0x7f8bd8149960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.700+0000 7f8bd5d74640 1 -- 10.20.193.58:0/2243591101 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8bd8121310 msgr2=0x7f8bd8149960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.700+0000 7f8bd5d74640 1 --2- 10.20.193.58:0/2243591101 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8bd8121310 0x7f8bd8149960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.700+0000 7f8bd5d74640 1 --2- 10.20.193.58:0/2243591101 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8bd8121310 0x7f8bd8149960 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.700+0000 7f8bd6575640 1 -- 10.20.193.58:0/2243591101 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8bd8121310 msgr2=0x7f8bd8149960 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.700+0000 7f8bd6575640 1 --2- 10.20.193.58:0/2243591101 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8bd8121310 0x7f8bd8149960 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.700+0000 7f8bd6575640 1 -- 10.20.193.58:0/2243591101 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8bd814cde0 msgr2=0x7f8bd813cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.700+0000 7f8bd6575640 1 --2- 10.20.193.58:0/2243591101 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8bd814cde0 0x7f8bd813cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.700+0000 7f8bd6575640 1 -- 10.20.193.58:0/2243591101 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd8121d50 con 0x7f8bd8057520 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.700+0000 7f8bd6575640 1 --2- 10.20.193.58:0/2243591101 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8bd8057520 0x7f8bd80578f0 secure :-1 s=READY pgs=58 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8bcc010a40 tx=0x7f8bcc010e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.700+0000 7f8bbeffd640 1 -- 10.20.193.58:0/2243591101 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8bcc004500 con 0x7f8bd8057520 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.700+0000 7f8bbeffd640 1 -- 10.20.193.58:0/2243591101 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8bcc00e9d0 con 0x7f8bd8057520 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.700+0000 7f8bbeffd640 1 -- 10.20.193.58:0/2243591101 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8bcc00ede0 con 0x7f8bd8057520 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.700+0000 7f8bd7577640 1 -- 10.20.193.58:0/2243591101 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bd8122030 con 0x7f8bd8057520 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.700+0000 7f8bd7577640 1 -- 10.20.193.58:0/2243591101 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bd814c5e0 con 0x7f8bd8057520 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.701+0000 7f8bd7577640 1 --2- 10.20.193.58:0/2243591101 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8bd814d1b0 0x7f8bd813d450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.701+0000 7f8bd7577640 1 -- 10.20.193.58:0/2243591101 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd8164250 con 0x7f8bd814d1b0 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.701+0000 7f8bd5d74640 1 --2- 10.20.193.58:0/2243591101 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8bd814d1b0 0x7f8bd813d450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.701+0000 7f8bd5d74640 1 -- 10.20.193.58:0/2243591101 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8bd80b6330 con 0x7f8bd814d1b0 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.701+0000 7f8bd5d74640 1 --2- 10.20.193.58:0/2243591101 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8bd814d1b0 0x7f8bd813d450 secure :-1 s=READY pgs=59 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8bc00028e0 tx=0x7f8bc0010b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.702+0000 7f8bbeffd640 1 -- 10.20.193.58:0/2243591101 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8bc000e9b0 con 0x7f8bd814d1b0 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.702+0000 7f8bbeffd640 1 -- 10.20.193.58:0/2243591101 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f8bc000eb10 con 0x7f8bd814d1b0 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.702+0000 7f8bbeffd640 1 -- 10.20.193.58:0/2243591101 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8bd814d1b0 msgr2=0x7f8bd813d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.702+0000 7f8bbeffd640 1 --2- 10.20.193.58:0/2243591101 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8bd814d1b0 0x7f8bd813d450 secure :-1 s=READY pgs=59 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8bc00028e0 tx=0x7f8bc0010b70 comp rx=0 tx=0).stop 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.702+0000 7f8bbeffd640 1 -- 10.20.193.58:0/2243591101 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8bd814d1b0 msgr2=0x7f8bd813d450 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.702+0000 7f8bbeffd640 1 --2- 10.20.193.58:0/2243591101 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8bd814d1b0 0x7f8bd813d450 secure :-1 s=CLOSED pgs=59 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8bc00028e0 tx=0x7f8bc0010b70 comp rx=0 tx=0).stop 2026-02-23T06:47:55.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.702+0000 7f8bbeffd640 1 -- 10.20.193.58:0/2243591101 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f8bcc0026a0 con 0x7f8bd8057520 2026-02-23T06:47:55.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.703+0000 7f8bbeffd640 1 --2- 10.20.193.58:0/2243591101 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8ba407a430 0x7f8ba409a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:55.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.703+0000 7f8bbeffd640 1 -- 10.20.193.58:0/2243591101 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f8bcc09e580 con 0x7f8bd8057520 2026-02-23T06:47:55.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.704+0000 7f8bd5d74640 1 --2- 10.20.193.58:0/2243591101 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8ba407a430 0x7f8ba409a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:55.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.704+0000 7f8bd5d74640 1 --2- 10.20.193.58:0/2243591101 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8ba407a430 0x7f8ba409a8e0 secure :-1 s=READY pgs=553 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8bc00028e0 tx=0x7f8bc000a000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:55.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.705+0000 7f8bd7577640 1 --2- 10.20.193.58:0/2243591101 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8bd814c7a0 0x7f8bd813d990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:55.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.705+0000 7f8bd7577640 1 -- 10.20.193.58:0/2243591101 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd80b7260 con 0x7f8bd814c7a0 2026-02-23T06:47:55.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.706+0000 7f8bd6d76640 1 --2- 10.20.193.58:0/2243591101 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8bd814c7a0 0x7f8bd813d990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:55.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.706+0000 7f8bd6d76640 1 -- 10.20.193.58:0/2243591101 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8bd81224b0 con 0x7f8bd814c7a0 2026-02-23T06:47:55.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.706+0000 7f8bd6d76640 1 --2- 10.20.193.58:0/2243591101 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8bd814c7a0 0x7f8bd813d990 secure :-1 s=READY pgs=60 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8bd80af700 tx=0x7f8bc8007b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:55.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.706+0000 7f8bbeffd640 1 -- 10.20.193.58:0/2243591101 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8bc8007510 con 0x7f8bd814c7a0 2026-02-23T06:47:55.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.706+0000 7f8bbeffd640 1 -- 10.20.193.58:0/2243591101 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5414 (secure 0 0 0) 0x7f8bc8007670 con 0x7f8bd814c7a0 2026-02-23T06:47:55.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.706+0000 7f8bbeffd640 1 -- 10.20.193.58:0/2243591101 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8bd814c7a0 msgr2=0x7f8bd813d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:55.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.706+0000 7f8bbeffd640 1 --2- 10.20.193.58:0/2243591101 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8bd814c7a0 0x7f8bd813d990 secure :-1 s=READY pgs=60 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8bd80af700 tx=0x7f8bc8007b70 comp rx=0 tx=0).stop 2026-02-23T06:47:55.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.706+0000 7f8bbeffd640 1 -- 10.20.193.58:0/2243591101 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8bd814c7a0 msgr2=0x7f8bd813d990 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:47:55.701 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.706+0000 7f8bbeffd640 1 --2- 10.20.193.58:0/2243591101 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8bd814c7a0 0x7f8bd813d990 unknown :-1 s=CLOSED pgs=60 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:55.701 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:47:55.701 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:47:55.701 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:47:55.701 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:47:55.701 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 234, 2026-02-23T06:47:55.701 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 47025, 2026-02-23T06:47:55.701 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:47:55.701 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:47:55.701 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:47:55.701 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:47:55.701 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:55.701 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:47:55.701 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:47:55.701 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:47:55.701 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:47:55.701 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:47:55.702 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:47:55.703 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:55.704 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:47:55.705 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:47:55.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.706+0000 7f8bd7577640 1 -- 10.20.193.58:0/2243591101 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8ba407a430 msgr2=0x7f8ba409a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:55.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.706+0000 7f8bd7577640 1 --2- 10.20.193.58:0/2243591101 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8ba407a430 0x7f8ba409a8e0 secure :-1 s=READY pgs=553 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8bc00028e0 tx=0x7f8bc000a000 comp rx=0 tx=0).stop 2026-02-23T06:47:55.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.706+0000 7f8bd7577640 1 -- 10.20.193.58:0/2243591101 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8bd8057520 msgr2=0x7f8bd80578f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:55.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.706+0000 7f8bd7577640 1 --2- 10.20.193.58:0/2243591101 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8bd8057520 0x7f8bd80578f0 secure :-1 s=READY pgs=58 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8bcc010a40 tx=0x7f8bcc010e40 comp rx=0 tx=0).stop 2026-02-23T06:47:55.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.706+0000 7f8bd6d76640 1 -- 10.20.193.58:0/2243591101 reap_dead start 2026-02-23T06:47:55.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.707+0000 7f8bd7577640 1 -- 10.20.193.58:0/2243591101 shutdown_connections 2026-02-23T06:47:55.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.707+0000 7f8bd7577640 1 -- 10.20.193.58:0/2243591101 >> 10.20.193.58:0/2243591101 conn(0x7f8bd80b3c20 msgr2=0x7f8bd815b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:55.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.707+0000 7f8bd7577640 1 -- 10.20.193.58:0/2243591101 shutdown_connections 2026-02-23T06:47:55.706 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.707+0000 7f8bd7577640 1 -- 10.20.193.58:0/2243591101 wait complete. 2026-02-23T06:47:55.709 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:47:55.709 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:47:55.709 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:47:55.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.836+0000 7fdf1d9b5640 1 -- 10.20.193.58:0/861183141 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdf180b6690 msgr2=0x7fdf18058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:55.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.836+0000 7fdf1d9b5640 1 --2- 10.20.193.58:0/861183141 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdf180b6690 0x7fdf18058cf0 secure :-1 s=READY pgs=124 gs=3 cs=0 l=1 c_cookie=14908663843115158936 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf14005820 tx=0x7fdf140302b0 comp rx=0 tx=0).stop 2026-02-23T06:47:55.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.836+0000 7fdf1d9b5640 1 -- 10.20.193.58:0/861183141 shutdown_connections 2026-02-23T06:47:55.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.836+0000 7fdf1d9b5640 1 --2- 10.20.193.58:0/861183141 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdf180b6690 0x7fdf18058cf0 unknown :-1 s=CLOSED pgs=124 gs=3 cs=0 l=1 c_cookie=14908663843115158936 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:55.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.836+0000 7fdf1d9b5640 1 --2- 10.20.193.58:0/861183141 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdf1815d870 0x7fdf180587b0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:55.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.836+0000 7fdf1d9b5640 1 -- 10.20.193.58:0/861183141 >> 10.20.193.58:0/861183141 conn(0x7fdf180b3c20 msgr2=0x7fdf180b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:55.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.836+0000 7fdf1d9b5640 1 -- 10.20.193.58:0/861183141 shutdown_connections 2026-02-23T06:47:55.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.836+0000 7fdf1d9b5640 1 -- 10.20.193.58:0/861183141 wait complete. 2026-02-23T06:47:55.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.837+0000 7fdf1d9b5640 1 Processor -- start 2026-02-23T06:47:55.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.838+0000 7fdf1d9b5640 1 -- start start 2026-02-23T06:47:55.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.838+0000 7fdf1d9b5640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdf180b6690 0x7fdf180b7920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:55.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.838+0000 7fdf1d9b5640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdf1815d4a0 0x7fdf1813f7f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:55.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.838+0000 7fdf1d9b5640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdf1815d870 0x7fdf1813fd30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:55.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.838+0000 7fdf1d9b5640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fdf18165650 con 0x7fdf1815d870 2026-02-23T06:47:55.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.838+0000 7fdf1d9b5640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1813df30 con 0x7fdf180b6690 2026-02-23T06:47:55.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.838+0000 7fdf1d9b5640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fdf18142500 con 0x7fdf1815d4a0 2026-02-23T06:47:55.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.838+0000 7fdf1d1b4640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdf1815d870 0x7fdf1813fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:55.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.838+0000 7fdf1d1b4640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdf1815d870 0x7fdf1813fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:46604/0 (socket says 10.20.193.58:46604) 2026-02-23T06:47:55.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.838+0000 7fdf1d1b4640 1 -- 10.20.193.58:0/4083153565 learned_addr learned my addr 10.20.193.58:0/4083153565 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:47:55.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.839+0000 7fdf0ffff640 1 --2- 10.20.193.58:0/4083153565 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdf1815d4a0 0x7fdf1813f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:55.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.839+0000 7fdf1c9b3640 1 --2- 10.20.193.58:0/4083153565 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdf180b6690 0x7fdf180b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:55.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.839+0000 7fdf1d1b4640 1 -- 10.20.193.58:0/4083153565 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdf1815d4a0 msgr2=0x7fdf1813f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:55.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.839+0000 7fdf1d1b4640 1 --2- 10.20.193.58:0/4083153565 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fdf1815d4a0 0x7fdf1813f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:55.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.839+0000 7fdf1d1b4640 1 -- 10.20.193.58:0/4083153565 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdf180b6690 msgr2=0x7fdf180b7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:55.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.839+0000 7fdf1d1b4640 1 --2- 10.20.193.58:0/4083153565 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdf180b6690 0x7fdf180b7920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:55.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.839+0000 7fdf1d1b4640 1 -- 10.20.193.58:0/4083153565 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf1400a590 con 0x7fdf1815d870 2026-02-23T06:47:55.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.839+0000 7fdf1d1b4640 1 --2- 10.20.193.58:0/4083153565 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdf1815d870 0x7fdf1813fd30 secure :-1 s=READY pgs=61 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf14003d30 tx=0x7fdf14003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:55.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.839+0000 7fdf0d7fa640 1 -- 10.20.193.58:0/4083153565 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdf1403e070 con 0x7fdf1815d870 2026-02-23T06:47:55.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.839+0000 7fdf0d7fa640 1 -- 10.20.193.58:0/4083153565 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf140398a0 con 0x7fdf1815d870 2026-02-23T06:47:55.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.839+0000 7fdf0d7fa640 1 -- 10.20.193.58:0/4083153565 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdf14039c30 con 0x7fdf1815d870 2026-02-23T06:47:55.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.839+0000 7fdf1d9b5640 1 -- 10.20.193.58:0/4083153565 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf1813dc50 con 0x7fdf1815d870 2026-02-23T06:47:55.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.839+0000 7fdf1d9b5640 1 -- 10.20.193.58:0/4083153565 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf18141f40 con 0x7fdf1815d870 2026-02-23T06:47:55.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.840+0000 7fdf1d9b5640 1 --2- 10.20.193.58:0/4083153565 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdf18057520 0x7fdf18166a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:55.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.840+0000 7fdf1d9b5640 1 -- 10.20.193.58:0/4083153565 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fdf180609c0 con 0x7fdf18057520 2026-02-23T06:47:55.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.840+0000 7fdf1c9b3640 1 --2- 10.20.193.58:0/4083153565 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdf18057520 0x7fdf18166a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:55.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.841+0000 7fdf1c9b3640 1 -- 10.20.193.58:0/4083153565 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdf180b6330 con 0x7fdf18057520 2026-02-23T06:47:55.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.841+0000 7fdf0d7fa640 1 -- 10.20.193.58:0/4083153565 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fdf1404b3b0 con 0x7fdf1815d870 2026-02-23T06:47:55.839 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.841+0000 7fdf1c9b3640 1 --2- 10.20.193.58:0/4083153565 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdf18057520 0x7fdf18166a40 secure :-1 s=READY pgs=125 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf08002730 tx=0x7fdf0800e970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:55.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.842+0000 7fdf0d7fa640 1 --2- 10.20.193.58:0/4083153565 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdee807a630 0x7fdee809aae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:55.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.842+0000 7fdf0d7fa640 1 -- 10.20.193.58:0/4083153565 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fdf140c3b50 con 0x7fdf1815d870 2026-02-23T06:47:55.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.842+0000 7fdf0d7fa640 1 -- 10.20.193.58:0/4083153565 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdf08013810 con 0x7fdf18057520 2026-02-23T06:47:55.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.842+0000 7fdf0d7fa640 1 -- 10.20.193.58:0/4083153565 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fdf08013970 con 0x7fdf18057520 2026-02-23T06:47:55.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.842+0000 7fdf0d7fa640 1 -- 10.20.193.58:0/4083153565 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdf18057520 msgr2=0x7fdf18166a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:55.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.842+0000 7fdf0d7fa640 1 --2- 10.20.193.58:0/4083153565 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdf18057520 0x7fdf18166a40 secure :-1 s=READY pgs=125 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf08002730 tx=0x7fdf0800e970 comp rx=0 tx=0).stop 2026-02-23T06:47:55.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.842+0000 7fdf0d7fa640 1 -- 10.20.193.58:0/4083153565 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdf18057520 msgr2=0x7fdf18166a40 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:47:55.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.842+0000 7fdf0d7fa640 1 --2- 10.20.193.58:0/4083153565 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdf18057520 0x7fdf18166a40 secure :-1 s=CLOSED pgs=125 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf08002730 tx=0x7fdf0800e970 comp rx=0 tx=0).stop 2026-02-23T06:47:55.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.842+0000 7fdf0ffff640 1 --2- 10.20.193.58:0/4083153565 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdee807a630 0x7fdee809aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:55.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.843+0000 7fdf0ffff640 1 --2- 10.20.193.58:0/4083153565 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdee807a630 0x7fdee809aae0 secure :-1 s=READY pgs=554 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf00005970 tx=0x7fdf00005900 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:55.842 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.846+0000 7fdf1d9b5640 1 --2- 10.20.193.58:0/4083153565 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdf18166f80 0x7fdf18200b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:55.843 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.846+0000 7fdf1d9b5640 1 -- 10.20.193.58:0/4083153565 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fdf18164250 con 0x7fdf18166f80 2026-02-23T06:47:55.843 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.846+0000 7fdf1c9b3640 1 --2- 10.20.193.58:0/4083153565 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdf18166f80 0x7fdf18200b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:55.843 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.846+0000 7fdf1c9b3640 1 -- 10.20.193.58:0/4083153565 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdf180b6d50 con 0x7fdf18166f80 2026-02-23T06:47:55.843 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.847+0000 7fdf1c9b3640 1 --2- 10.20.193.58:0/4083153565 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdf18166f80 0x7fdf18200b10 secure :-1 s=READY pgs=126 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf0800e9b0 tx=0x7fdf080026a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:55.843 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.847+0000 7fdf0d7fa640 1 -- 10.20.193.58:0/4083153565 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdf08015650 con 0x7fdf18166f80 2026-02-23T06:47:55.843 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.847+0000 7fdf0d7fa640 1 -- 10.20.193.58:0/4083153565 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5556 (secure 0 0 0) 0x7fdf0801f810 con 0x7fdf18166f80 2026-02-23T06:47:55.843 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.847+0000 7fdf0d7fa640 1 -- 10.20.193.58:0/4083153565 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdf18166f80 msgr2=0x7fdf18200b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:55.844 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:47:55.844 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:47:55.844 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:47:55.844 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:47:55.844 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 234, 2026-02-23T06:47:55.844 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 162206, 2026-02-23T06:47:55.844 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:47:55.844 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:47:55.845 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:47:55.845 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:47:55.845 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:55.845 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:47:55.845 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:47:55.845 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:47:55.845 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:47:55.845 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:55.845 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:55.845 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:55.845 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:55.846 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:55.846 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:55.846 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:55.846 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:55.846 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:55.846 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:55.846 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:55.846 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:55.846 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:55.846 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:55.846 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:47:55.846 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:47:55.846 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:55.847 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:55.847 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:55.847 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:55.847 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:55.847 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:55.847 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:55.847 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:55.847 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:55.847 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:55.847 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:55.847 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:55.847 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:55.848 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:55.848 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:55.848 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:47:55.848 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:47:55.848 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:47:55.848 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:47:55.848 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:47:55.848 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:47:55.848 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:47:55.848 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:47:55.848 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:47:55.849 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:47:55.849 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:47:55.849 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:47:55.849 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:47:55.849 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:47:55.849 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:47:55.849 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:47:55.849 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:47:55.849 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:47:55.849 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:47:55.849 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:47:55.850 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:47:55.850 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:47:55.850 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:47:55.850 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:47:55.850 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:47:55.850 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:47:55.850 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:47:55.850 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:47:55.850 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:47:55.850 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:47:55.850 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:55.851 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:47:55.851 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:55.851 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:47:55.851 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.851 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:47:55.851 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:47:55.851 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:55.851 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:55.851 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.851 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:55.851 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:47:55.851 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:55.852 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:55.852 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.852 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:55.852 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:47:55.852 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:55.852 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:55.852 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:55.852 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:55.852 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:47:55.852 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:47:55.852 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:55.852 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:55.853 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:47:55.853 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:55.853 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:55.853 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.853 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:47:55.853 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:47:55.853 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:55.853 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:55.853 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.853 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:55.853 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:47:55.853 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:55.854 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:55.854 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.854 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:55.854 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:47:55.854 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:55.854 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:55.854 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:55.854 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:55.854 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:47:55.854 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:47:55.854 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:55.855 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:55.855 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:47:55.855 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:55.855 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:55.855 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.855 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:47:55.855 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:47:55.855 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:47:55.855 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:47:55.855 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.856 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:47:55.856 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:47:55.856 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:55.856 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:55.856 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.856 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:47:55.856 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:47:55.856 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:47:55.856 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:55.856 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:55.857 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:55.857 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:47:55.857 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:47:55.857 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:47:55.857 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:47:55.857 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:47:55.857 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:47:55.857 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:55.857 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:55.857 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:55.858 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:47:55.858 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:47:55.858 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.858 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:55.858 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:55.858 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:47:55.858 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:55.858 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:55.858 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:47:55.858 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.859 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:55.859 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:55.859 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:47:55.859 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:55.859 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:55.859 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:47:55.859 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.859 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:55.859 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:55.859 INFO:teuthology.orchestra.run.trial058.stdout: "num": 7 2026-02-23T06:47:55.860 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:55.860 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:55.860 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:47:55.860 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.860 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:47:55.860 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:47:55.860 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:47:55.860 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:55.860 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.860 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:55.861 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:55.861 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:47:55.861 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:55.861 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:47:55.861 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:47:55.861 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:47:55.861 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:47:55.861 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:47:55.861 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:47:55.861 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:47:55.862 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:47:55.862 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:47:55.862 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:47:55.862 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:47:55.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.847+0000 7fdf0d7fa640 1 --2- 10.20.193.58:0/4083153565 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdf18166f80 0x7fdf18200b10 secure :-1 s=READY pgs=126 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf0800e9b0 tx=0x7fdf080026a0 comp rx=0 tx=0).stop 2026-02-23T06:47:55.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.847+0000 7fdf0d7fa640 1 -- 10.20.193.58:0/4083153565 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdf18166f80 msgr2=0x7fdf18200b10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:47:55.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.847+0000 7fdf0d7fa640 1 --2- 10.20.193.58:0/4083153565 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fdf18166f80 0x7fdf18200b10 unknown :-1 s=CLOSED pgs=126 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:55.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.847+0000 7fdf1d9b5640 1 -- 10.20.193.58:0/4083153565 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdee807a630 msgr2=0x7fdee809aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:55.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.847+0000 7fdf1d9b5640 1 --2- 10.20.193.58:0/4083153565 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fdee807a630 0x7fdee809aae0 secure :-1 s=READY pgs=554 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf00005970 tx=0x7fdf00005900 comp rx=0 tx=0).stop 2026-02-23T06:47:55.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.847+0000 7fdf1d9b5640 1 -- 10.20.193.58:0/4083153565 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdf1815d870 msgr2=0x7fdf1813fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:55.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.847+0000 7fdf1d9b5640 1 --2- 10.20.193.58:0/4083153565 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fdf1815d870 0x7fdf1813fd30 secure :-1 s=READY pgs=61 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf14003d30 tx=0x7fdf14003d60 comp rx=0 tx=0).stop 2026-02-23T06:47:55.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.847+0000 7fdf1d1b4640 1 -- 10.20.193.58:0/4083153565 reap_dead start 2026-02-23T06:47:55.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.847+0000 7fdf1d1b4640 1 -- 10.20.193.58:0/4083153565 reap_dead start 2026-02-23T06:47:55.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.847+0000 7fdf1d9b5640 1 -- 10.20.193.58:0/4083153565 shutdown_connections 2026-02-23T06:47:55.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.847+0000 7fdf1d9b5640 1 -- 10.20.193.58:0/4083153565 >> 10.20.193.58:0/4083153565 conn(0x7fdf180b3c20 msgr2=0x7fdf1815bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:55.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.848+0000 7fdf1d9b5640 1 -- 10.20.193.58:0/4083153565 shutdown_connections 2026-02-23T06:47:55.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.848+0000 7fdf1d9b5640 1 -- 10.20.193.58:0/4083153565 wait complete. 2026-02-23T06:47:55.866 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:47:55.866 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:47:55.866 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:47:55.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.994+0000 7f5cb27d2640 1 -- 10.20.193.58:0/3965876467 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5cac15d870 msgr2=0x7f5cac0587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:55.990 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.994+0000 7f5cb27d2640 1 --2- 10.20.193.58:0/3965876467 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5cac15d870 0x7f5cac0587b0 secure :-1 s=READY pgs=63 gs=3 cs=0 l=1 c_cookie=12159572837292999548 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ca0005e70 tx=0x7f5ca002f290 comp rx=0 tx=0).stop 2026-02-23T06:47:55.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.994+0000 7f5cb27d2640 1 -- 10.20.193.58:0/3965876467 shutdown_connections 2026-02-23T06:47:55.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.994+0000 7f5cb27d2640 1 --2- 10.20.193.58:0/3965876467 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5cac15d870 0x7f5cac0587b0 unknown :-1 s=CLOSED pgs=63 gs=3 cs=0 l=1 c_cookie=12159572837292999548 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:55.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.994+0000 7f5cb27d2640 1 -- 10.20.193.58:0/3965876467 >> 10.20.193.58:0/3965876467 conn(0x7f5cac0b3c20 msgr2=0x7f5cac0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:47:55.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.994+0000 7f5cb27d2640 1 -- 10.20.193.58:0/3965876467 shutdown_connections 2026-02-23T06:47:55.991 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.995+0000 7f5cb27d2640 1 -- 10.20.193.58:0/3965876467 wait complete. 2026-02-23T06:47:55.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.996+0000 7f5cb27d2640 1 Processor -- start 2026-02-23T06:47:55.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.996+0000 7f5cb27d2640 1 -- start start 2026-02-23T06:47:55.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.996+0000 7f5cb27d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5cac0b6690 0x7f5cac164d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:55.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.996+0000 7f5cb27d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5cac15d4a0 0x7f5cac13f940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:55.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.996+0000 7f5cb27d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac15d870 0x7f5cac13b140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:55.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.996+0000 7f5cb27d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f5cac164a90 con 0x7f5cac15d4a0 2026-02-23T06:47:55.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.996+0000 7f5cb27d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f5cac13d460 con 0x7f5cac0b6690 2026-02-23T06:47:55.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.996+0000 7f5cb27d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f5cac13d6b0 con 0x7f5cac15d870 2026-02-23T06:47:55.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.997+0000 7f5cb17d0640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5cac0b6690 0x7f5cac164d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:55.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.997+0000 7f5cb0fcf640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5cac15d4a0 0x7f5cac13f940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:55.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.997+0000 7f5cb0fcf640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5cac15d4a0 0x7f5cac13f940 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:46620/0 (socket says 10.20.193.58:46620) 2026-02-23T06:47:55.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.997+0000 7f5cb0fcf640 1 -- 10.20.193.58:0/3362897532 learned_addr learned my addr 10.20.193.58:0/3362897532 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:47:55.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.997+0000 7f5cb1fd1640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac15d870 0x7f5cac13b140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:55.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.997+0000 7f5cb0fcf640 1 -- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac15d870 msgr2=0x7f5cac13b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:55.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.997+0000 7f5cb0fcf640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac15d870 0x7f5cac13b140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:55.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.997+0000 7f5cb0fcf640 1 -- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5cac0b6690 msgr2=0x7f5cac164d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:47:55.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.997+0000 7f5cb0fcf640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5cac0b6690 0x7f5cac164d50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:55.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.997+0000 7f5cb0fcf640 1 -- 10.20.193.58:0/3362897532 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca0009570 con 0x7f5cac15d4a0 2026-02-23T06:47:55.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.997+0000 7f5cb1fd1640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac15d870 0x7f5cac13b140 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:47:55.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.997+0000 7f5cb0fcf640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5cac15d4a0 0x7f5cac13f940 secure :-1 s=READY pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ca0004740 tx=0x7f5ca0002a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:55.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.997+0000 7f5c99ffb640 1 -- 10.20.193.58:0/3362897532 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ca003d070 con 0x7f5cac15d4a0 2026-02-23T06:47:55.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.997+0000 7f5c99ffb640 1 -- 10.20.193.58:0/3362897532 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ca0038690 con 0x7f5cac15d4a0 2026-02-23T06:47:55.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.997+0000 7f5c99ffb640 1 -- 10.20.193.58:0/3362897532 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ca0038ac0 con 0x7f5cac15d4a0 2026-02-23T06:47:55.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.997+0000 7f5cb27d2640 1 -- 10.20.193.58:0/3362897532 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cac0572a0 con 0x7f5cac15d4a0 2026-02-23T06:47:55.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.998+0000 7f5cb27d2640 1 -- 10.20.193.58:0/3362897532 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cac13eec0 con 0x7f5cac15d4a0 2026-02-23T06:47:55.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.998+0000 7f5cb27d2640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 0x7f5cac13b680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:55.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.998+0000 7f5cb27d2640 1 -- 10.20.193.58:0/3362897532 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f5cac0609c0 con 0x7f5cac13fe80 2026-02-23T06:47:55.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.998+0000 7f5cb17d0640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 0x7f5cac13b680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:55.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.999+0000 7f5cb17d0640 1 -- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 msgr2=0x7f5cac13b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-23T06:47:55.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.999+0000 7f5cb17d0640 1 -- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 msgr2=0x7f5cac13b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:47:55.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.999+0000 7f5cb17d0640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 0x7f5cac13b680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:47:55.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.999+0000 7f5cb17d0640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 0x7f5cac13b680 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:47:55.997 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:55.999+0000 7f5c99ffb640 1 -- 10.20.193.58:0/3362897532 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f5ca0038c20 con 0x7f5cac15d4a0 2026-02-23T06:47:55.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:56.000+0000 7f5c99ffb640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5c7c07a6b0 0x7f5c7c09ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:55.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:56.000+0000 7f5c99ffb640 1 -- 10.20.193.58:0/3362897532 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f5ca00c2170 con 0x7f5cac15d4a0 2026-02-23T06:47:55.998 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:56.001+0000 7f5cb1fd1640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5c7c07a6b0 0x7f5c7c09ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:55.999 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:56.003+0000 7f5cb1fd1640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5c7c07a6b0 0x7f5c7c09ab60 secure :-1 s=READY pgs=555 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cac13d100 tx=0x7f5ca800a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:47:56.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:56.206+0000 7f5cb17d0640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 0x7f5cac13b680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:56.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:56.206+0000 7f5cb17d0640 1 -- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 msgr2=0x7f5cac13b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:47:56.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:56.206+0000 7f5cb17d0640 1 -- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 msgr2=0x7f5cac13b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:47:56.201 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:56.206+0000 7f5cb17d0640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 0x7f5cac13b680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:47:56.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:56.206+0000 7f5cb17d0640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 0x7f5cac13b680 unknown :-1 s=START_CONNECT pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-23T06:47:56.602 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:56.607+0000 7f5cb17d0640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 0x7f5cac13b680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:56.603 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:56.607+0000 7f5cb17d0640 1 -- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 msgr2=0x7f5cac13b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:47:56.603 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:56.607+0000 7f5cb17d0640 1 -- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 msgr2=0x7f5cac13b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:47:56.603 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:56.607+0000 7f5cb17d0640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 0x7f5cac13b680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:47:56.603 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:56.607+0000 7f5cb17d0640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 0x7f5cac13b680 unknown :-1 s=START_CONNECT pgs=0 gs=10 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-23T06:47:57.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:57.408+0000 7f5cb17d0640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 0x7f5cac13b680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=11 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:57.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:57.408+0000 7f5cb17d0640 1 -- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 msgr2=0x7f5cac13b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:47:57.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:57.408+0000 7f5cb17d0640 1 -- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 msgr2=0x7f5cac13b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:47:57.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:57.408+0000 7f5cb17d0640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 0x7f5cac13b680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=11 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:47:57.403 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:57.408+0000 7f5cb17d0640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 0x7f5cac13b680 unknown :-1 s=START_CONNECT pgs=0 gs=12 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-23T06:47:59.004 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:59.009+0000 7f5cb17d0640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 0x7f5cac13b680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=13 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:59.004 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:59.009+0000 7f5cb17d0640 1 -- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 msgr2=0x7f5cac13b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:47:59.004 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:59.009+0000 7f5cb17d0640 1 -- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 msgr2=0x7f5cac13b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:47:59.004 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:59.009+0000 7f5cb17d0640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 0x7f5cac13b680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=13 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:47:59.004 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:59.009+0000 7f5cb17d0640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 0x7f5cac13b680 unknown :-1 s=START_CONNECT pgs=0 gs=14 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2026-02-23T06:47:59.992 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:59.997+0000 7f5c98ff9640 1 -- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 msgr2=0x7f5cac13b680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:47:59.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:59.997+0000 7f5c98ff9640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 0x7f5cac13b680 unknown :-1 s=START_CONNECT pgs=0 gs=14 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:59.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:59.997+0000 7f5c98ff9640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5c74003600 0x7f5c74023a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:47:59.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:59.997+0000 7f5c98ff9640 1 -- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 msgr2=0x7f5cac13b680 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:47:59.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:59.997+0000 7f5c98ff9640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13fe80 0x7f5cac13b680 unknown :-1 s=CLOSED pgs=0 gs=14 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:47:59.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:59.997+0000 7f5c98ff9640 1 -- 10.20.193.58:0/3362897532 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f5c74024130 con 0x7f5c74003600 2026-02-23T06:47:59.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:59.997+0000 7f5cb17d0640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5c74003600 0x7f5c74023a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=15 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:47:59.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:59.997+0000 7f5cb17d0640 1 -- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5c74003600 msgr2=0x7f5c74023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:47:59.993 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:59.997+0000 7f5cb17d0640 1 -- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5c74003600 msgr2=0x7f5c74023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:47:59.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:59.997+0000 7f5cb17d0640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5c74003600 0x7f5c74023a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=15 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:47:59.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:47:59.997+0000 7f5cb17d0640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5c74003600 0x7f5c74023a80 unknown :-1 s=START_CONNECT pgs=0 gs=16 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:48:00.193 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.198+0000 7f5cb17d0640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5c74003600 0x7f5c74023a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=17 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:00.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.198+0000 7f5cb17d0640 1 -- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5c74003600 msgr2=0x7f5c74023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-23T06:48:00.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.198+0000 7f5cb17d0640 1 -- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5c74003600 msgr2=0x7f5c74023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:48:00.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.198+0000 7f5cb17d0640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5c74003600 0x7f5c74023a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=17 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:48:00.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.198+0000 7f5cb17d0640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5c74003600 0x7f5c74023a80 unknown :-1 s=START_CONNECT pgs=0 gs=18 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-23T06:48:00.594 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.599+0000 7f5cb17d0640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5c74003600 0x7f5c74023a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=19 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:00.594 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.599+0000 7f5cb17d0640 1 -- 10.20.193.58:0/3362897532 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5c740242a0 con 0x7f5c74003600 2026-02-23T06:48:00.595 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.599+0000 7f5cb17d0640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5c74003600 0x7f5c74023a80 secure :-1 s=READY pgs=3 gs=19 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c9c002730 tx=0x7f5c9c01aea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:48:00.596 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.600+0000 7f5c99ffb640 1 -- 10.20.193.58:0/3362897532 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5c9c01f070 con 0x7f5c74003600 2026-02-23T06:48:00.596 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.600+0000 7f5c99ffb640 1 -- 10.20.193.58:0/3362897532 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f5c9c018e00 con 0x7f5c74003600 2026-02-23T06:48:00.596 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.600+0000 7f5c99ffb640 1 -- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5c74003600 msgr2=0x7f5c74023a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:00.596 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.600+0000 7f5c99ffb640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5c74003600 0x7f5c74023a80 secure :-1 s=READY pgs=3 gs=19 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c9c002730 tx=0x7f5c9c01aea0 comp rx=0 tx=0).stop 2026-02-23T06:48:00.596 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.600+0000 7f5c99ffb640 1 -- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5c74003600 msgr2=0x7f5c74023a80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:48:00.596 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.600+0000 7f5c99ffb640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5c74003600 0x7f5c74023a80 unknown :-1 s=CLOSED pgs=3 gs=19 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:00.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.603+0000 7f5cb27d2640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13f3c0 0x7f5cac13bd60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:00.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.603+0000 7f5cb27d2640 1 -- 10.20.193.58:0/3362897532 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f5cac0b6330 con 0x7f5cac13f3c0 2026-02-23T06:48:00.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.604+0000 7f5cb17d0640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13f3c0 0x7f5cac13bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=20 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:00.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.604+0000 7f5cb17d0640 1 -- 10.20.193.58:0/3362897532 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5cac0b6d50 con 0x7f5cac13f3c0 2026-02-23T06:48:00.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.604+0000 7f5cb17d0640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13f3c0 0x7f5cac13bd60 secure :-1 s=READY pgs=4 gs=20 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c9c022000 tx=0x7f5c9c0026a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:48:00.599 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.604+0000 7f5c99ffb640 1 -- 10.20.193.58:0/3362897532 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5c9c036660 con 0x7f5cac13f3c0 2026-02-23T06:48:00.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.605+0000 7f5c99ffb640 1 -- 10.20.193.58:0/3362897532 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4910 (secure 0 0 0) 0x7f5c9c0367c0 con 0x7f5cac13f3c0 2026-02-23T06:48:00.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.605+0000 7f5c99ffb640 1 -- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13f3c0 msgr2=0x7f5cac13bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:00.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.605+0000 7f5c99ffb640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13f3c0 0x7f5cac13bd60 secure :-1 s=READY pgs=4 gs=20 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c9c022000 tx=0x7f5c9c0026a0 comp rx=0 tx=0).stop 2026-02-23T06:48:00.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.605+0000 7f5c99ffb640 1 -- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13f3c0 msgr2=0x7f5cac13bd60 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:48:00.600 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.605+0000 7f5c99ffb640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5cac13f3c0 0x7f5cac13bd60 secure :-1 s=CLOSED pgs=4 gs=20 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c9c022000 tx=0x7f5c9c0026a0 comp rx=0 tx=0).stop 2026-02-23T06:48:00.601 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:48:00.601 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:48:00.601 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:48:00.601 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:48:00.601 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 234, 2026-02-23T06:48:00.601 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 5269, 2026-02-23T06:48:00.601 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:48:00.601 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:48:00.601 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:48:00.601 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:48:00.601 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:00.602 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 5, 2026-02-23T06:48:00.602 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:48:00.602 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:48:00.602 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:48:00.602 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:48:00.602 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:48:00.602 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:48:00.602 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:48:00.602 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:48:00.602 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:48:00.602 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:48:00.602 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:48:00.602 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:48:00.603 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:48:00.603 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:48:00.603 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:48:00.603 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:48:00.603 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:00.603 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:48:00.603 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:48:00.603 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:48:00.603 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:48:00.603 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:48:00.603 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:48:00.604 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:48:00.604 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:48:00.604 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:48:00.604 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:48:00.604 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:48:00.604 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:48:00.604 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:48:00.604 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:48:00.604 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:48:00.604 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:00.604 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:00.604 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:48:00.604 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:48:00.605 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:48:00.605 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:48:00.605 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:48:00.605 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:48:00.605 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:48:00.605 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:48:00.605 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:48:00.605 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:48:00.605 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:48:00.605 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:48:00.605 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:48:00.605 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:48:00.605 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:48:00.606 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:48:00.606 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:48:00.606 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:48:00.606 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:48:00.606 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:48:00.606 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:48:00.606 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:48:00.606 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:48:00.606 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:48:00.606 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:48:00.606 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:48:00.606 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:48:00.606 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:48:00.606 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:48:00.607 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:48:00.607 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:00.607 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:48:00.607 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:00.607 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:48:00.607 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:00.607 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:48:00.607 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:48:00.607 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:48:00.607 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:48:00.607 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:00.607 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:48:00.607 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:48:00.607 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:00.607 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:00.608 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:00.608 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:48:00.608 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:48:00.608 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:00.608 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:00.608 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:00.608 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:00.608 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:48:00.608 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:48:00.608 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:48:00.608 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:48:00.608 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:48:00.608 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:48:00.608 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:00.608 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:00.609 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:48:00.609 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:48:00.609 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:48:00.609 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:48:00.609 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:00.609 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:48:00.609 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:48:00.609 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:00.609 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:00.609 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:00.609 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:48:00.609 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:48:00.609 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:00.609 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:00.609 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:00.609 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:00.610 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:48:00.610 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:48:00.610 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:48:00.610 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:48:00.610 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:48:00.610 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:48:00.610 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:00.610 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:00.610 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:48:00.610 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:48:00.610 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:48:00.610 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:48:00.610 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:00.610 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:48:00.610 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:48:00.610 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:00.610 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:00.611 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:00.611 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:48:00.611 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:48:00.611 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:00.611 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:00.611 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:00.611 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:00.611 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:48:00.611 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:48:00.611 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:48:00.611 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:48:00.611 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:48:00.611 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:48:00.611 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:00.611 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:00.611 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:00.611 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:48:00.612 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:48:00.612 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:00.612 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:48:00.612 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:48:00.612 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:48:00.612 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:00.612 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:00.612 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:48:00.612 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:00.612 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:48:00.612 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:48:00.612 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:48:00.612 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:00.612 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:00.612 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:00.612 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:48:00.612 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:48:00.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.605+0000 7f5cb1fd1640 1 -- 10.20.193.58:0/3362897532 reap_dead start 2026-02-23T06:48:00.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.605+0000 7f5cb27d2640 1 -- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5c7c07a6b0 msgr2=0x7f5c7c09ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:00.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.605+0000 7f5cb27d2640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5c7c07a6b0 0x7f5c7c09ab60 secure :-1 s=READY pgs=555 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cac13d100 tx=0x7f5ca800a040 comp rx=0 tx=0).stop 2026-02-23T06:48:00.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.605+0000 7f5cb27d2640 1 -- 10.20.193.58:0/3362897532 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5cac15d4a0 msgr2=0x7f5cac13f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:00.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.605+0000 7f5cb27d2640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5cac15d4a0 0x7f5cac13f940 secure :-1 s=READY pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ca0004740 tx=0x7f5ca0002a10 comp rx=0 tx=0).stop 2026-02-23T06:48:00.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.605+0000 7f5cb27d2640 1 -- 10.20.193.58:0/3362897532 shutdown_connections 2026-02-23T06:48:00.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.605+0000 7f5cb27d2640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5c7c07a6b0 0x7f5c7c09ab60 unknown :-1 s=CLOSED pgs=555 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:00.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.605+0000 7f5cb27d2640 1 --2- 10.20.193.58:0/3362897532 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5cac15d4a0 0x7f5cac13f940 unknown :-1 s=CLOSED pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:00.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.605+0000 7f5cb27d2640 1 -- 10.20.193.58:0/3362897532 >> 10.20.193.58:0/3362897532 conn(0x7f5cac0b3c20 msgr2=0x7f5cac0aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:48:00.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.605+0000 7f5cb27d2640 1 -- 10.20.193.58:0/3362897532 shutdown_connections 2026-02-23T06:48:00.614 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.605+0000 7f5cb27d2640 1 -- 10.20.193.58:0/3362897532 wait complete. 2026-02-23T06:48:00.615 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:48:00.615 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:48:00.615 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:48:00.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.742+0000 7f6b02083640 1 -- 10.20.193.58:0/3164321306 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6afc0b6690 msgr2=0x7f6afc058ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:00.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.742+0000 7f6b02083640 1 --2- 10.20.193.58:0/3164321306 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6afc0b6690 0x7f6afc058ec0 secure :-1 s=READY pgs=66 gs=2 cs=0 l=1 c_cookie=12469702249054108477 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6afc0b5040 tx=0x7f6af8030270 comp rx=0 tx=0).stop 2026-02-23T06:48:00.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.742+0000 7f6b02083640 1 -- 10.20.193.58:0/3164321306 shutdown_connections 2026-02-23T06:48:00.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.742+0000 7f6b02083640 1 --2- 10.20.193.58:0/3164321306 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6afc0b6690 0x7f6afc058ec0 unknown :-1 s=CLOSED pgs=66 gs=2 cs=0 l=1 c_cookie=12469702249054108477 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:00.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.742+0000 7f6b02083640 1 --2- 10.20.193.58:0/3164321306 >> v2:10.20.193.93:3300/0 conn(0x7f6afc15d4a0 0x7f6afc0affb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:00.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.742+0000 7f6b02083640 1 -- 10.20.193.58:0/3164321306 >> 10.20.193.58:0/3164321306 conn(0x7f6afc0b3c20 msgr2=0x7f6afc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:48:00.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.742+0000 7f6b02083640 1 -- 10.20.193.58:0/3164321306 shutdown_connections 2026-02-23T06:48:00.738 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.742+0000 7f6b02083640 1 -- 10.20.193.58:0/3164321306 wait complete. 2026-02-23T06:48:00.740 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.743+0000 7f6b02083640 1 Processor -- start 2026-02-23T06:48:00.740 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.743+0000 7f6b02083640 1 -- start start 2026-02-23T06:48:00.740 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.744+0000 7f6b02083640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6afc0b6690 0x7f6afc162910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:00.740 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.744+0000 7f6b02083640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6afc15d4a0 0x7f6afc121060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:00.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.744+0000 7f6b02083640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6afc15d870 0x7f6afc14d210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:00.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.744+0000 7f6b02083640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f6afc1240a0 con 0x7f6afc15d4a0 2026-02-23T06:48:00.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.744+0000 7f6b02083640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f6afc162050 con 0x7f6afc0b6690 2026-02-23T06:48:00.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.744+0000 7f6b02083640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f6afc162400 con 0x7f6afc15d870 2026-02-23T06:48:00.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.744+0000 7f6b00880640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6afc15d4a0 0x7f6afc121060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:00.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.744+0000 7f6b00880640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6afc15d4a0 0x7f6afc121060 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:46698/0 (socket says 10.20.193.58:46698) 2026-02-23T06:48:00.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.744+0000 7f6b00880640 1 -- 10.20.193.58:0/3611900782 learned_addr learned my addr 10.20.193.58:0/3611900782 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:48:00.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.744+0000 7f6b01081640 1 --2- 10.20.193.58:0/3611900782 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6afc0b6690 0x7f6afc162910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:00.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.744+0000 7f6b01882640 1 --2- 10.20.193.58:0/3611900782 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6afc15d870 0x7f6afc14d210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:00.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.744+0000 7f6b00880640 1 -- 10.20.193.58:0/3611900782 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6afc15d870 msgr2=0x7f6afc14d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:00.741 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.744+0000 7f6b00880640 1 --2- 10.20.193.58:0/3611900782 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6afc15d870 0x7f6afc14d210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:00.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.744+0000 7f6b00880640 1 -- 10.20.193.58:0/3611900782 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6afc0b6690 msgr2=0x7f6afc162910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:00.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.744+0000 7f6b00880640 1 --2- 10.20.193.58:0/3611900782 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6afc0b6690 0x7f6afc162910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:00.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.744+0000 7f6b00880640 1 -- 10.20.193.58:0/3611900782 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af800a590 con 0x7f6afc15d4a0 2026-02-23T06:48:00.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.744+0000 7f6b00880640 1 --2- 10.20.193.58:0/3611900782 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6afc15d4a0 0x7f6afc121060 secure :-1 s=READY pgs=67 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6af000c4d0 tx=0x7f6af000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:48:00.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.744+0000 7f6ae9ffb640 1 -- 10.20.193.58:0/3611900782 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6af0016070 con 0x7f6afc15d4a0 2026-02-23T06:48:00.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.744+0000 7f6ae9ffb640 1 -- 10.20.193.58:0/3611900782 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6af0005330 con 0x7f6afc15d4a0 2026-02-23T06:48:00.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.744+0000 7f6ae9ffb640 1 -- 10.20.193.58:0/3611900782 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6af0004780 con 0x7f6afc15d4a0 2026-02-23T06:48:00.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.745+0000 7f6b02083640 1 -- 10.20.193.58:0/3611900782 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6afc124a20 con 0x7f6afc15d4a0 2026-02-23T06:48:00.742 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.745+0000 7f6b02083640 1 -- 10.20.193.58:0/3611900782 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6afc120860 con 0x7f6afc15d4a0 2026-02-23T06:48:00.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.746+0000 7f6b02083640 1 -- 10.20.193.58:0/3611900782 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6afc0b6d50 con 0x7f6afc15d4a0 2026-02-23T06:48:00.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.746+0000 7f6ae9ffb640 1 -- 10.20.193.58:0/3611900782 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f6af00048e0 con 0x7f6afc15d4a0 2026-02-23T06:48:00.743 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.747+0000 7f6ae9ffb640 1 --2- 10.20.193.58:0/3611900782 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6acc07a6b0 0x7f6acc09ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:00.744 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.747+0000 7f6ae9ffb640 1 -- 10.20.193.58:0/3611900782 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f6af009cdd0 con 0x7f6afc15d4a0 2026-02-23T06:48:00.744 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.748+0000 7f6b01081640 1 --2- 10.20.193.58:0/3611900782 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6acc07a6b0 0x7f6acc09ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:00.744 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.748+0000 7f6b01081640 1 --2- 10.20.193.58:0/3611900782 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6acc07a6b0 0x7f6acc09ab60 secure :-1 s=READY pgs=556 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6aec004740 tx=0x7f6aec00b410 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:48:00.744 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.749+0000 7f6ae9ffb640 1 -- 10.20.193.58:0/3611900782 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f6af00a0030 con 0x7f6afc15d4a0 2026-02-23T06:48:00.898 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.903+0000 7f6b02083640 1 -- 10.20.193.58:0/3611900782 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f6afc124de0 con 0x7f6afc15d4a0 2026-02-23T06:48:00.899 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.903+0000 7f6ae9ffb640 1 -- 10.20.193.58:0/3611900782 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f6af0060020 con 0x7f6afc15d4a0 2026-02-23T06:48:00.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.904+0000 7f6b02083640 1 -- 10.20.193.58:0/3611900782 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6acc07a6b0 msgr2=0x7f6acc09ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:00.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.904+0000 7f6b02083640 1 --2- 10.20.193.58:0/3611900782 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6acc07a6b0 0x7f6acc09ab60 secure :-1 s=READY pgs=556 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6aec004740 tx=0x7f6aec00b410 comp rx=0 tx=0).stop 2026-02-23T06:48:00.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.904+0000 7f6b02083640 1 -- 10.20.193.58:0/3611900782 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6afc15d4a0 msgr2=0x7f6afc121060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:00.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.904+0000 7f6b02083640 1 --2- 10.20.193.58:0/3611900782 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6afc15d4a0 0x7f6afc121060 secure :-1 s=READY pgs=67 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6af000c4d0 tx=0x7f6af000c9a0 comp rx=0 tx=0).stop 2026-02-23T06:48:00.900 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.905+0000 7f6b02083640 1 -- 10.20.193.58:0/3611900782 shutdown_connections 2026-02-23T06:48:00.901 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.905+0000 7f6b02083640 1 --2- 10.20.193.58:0/3611900782 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f6acc07a6b0 0x7f6acc09ab60 unknown :-1 s=CLOSED pgs=556 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:00.901 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.905+0000 7f6b02083640 1 --2- 10.20.193.58:0/3611900782 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f6afc15d870 0x7f6afc14d210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:00.901 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.905+0000 7f6b02083640 1 --2- 10.20.193.58:0/3611900782 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f6afc15d4a0 0x7f6afc121060 unknown :-1 s=CLOSED pgs=67 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:00.901 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.905+0000 7f6b02083640 1 --2- 10.20.193.58:0/3611900782 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f6afc0b6690 0x7f6afc162910 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:00.901 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.905+0000 7f6b02083640 1 -- 10.20.193.58:0/3611900782 >> 10.20.193.58:0/3611900782 conn(0x7f6afc0b3c20 msgr2=0x7f6afc15ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:48:00.901 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.905+0000 7f6b02083640 1 -- 10.20.193.58:0/3611900782 shutdown_connections 2026-02-23T06:48:00.901 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:00.905+0000 7f6b02083640 1 -- 10.20.193.58:0/3611900782 wait complete. 2026-02-23T06:48:00.912 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:48:10.913 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:48:10.914 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:48:11.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.042+0000 7fe0958cc640 1 -- 10.20.193.58:0/1346867824 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe090163de0 msgr2=0x7fe0900b6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:11.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.042+0000 7fe0958cc640 1 --2- 10.20.193.58:0/1346867824 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe090163de0 0x7fe0900b6cb0 secure :-1 s=READY pgs=5 gs=3 cs=0 l=1 c_cookie=3255115084645342592 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe080005820 tx=0x7fe0800302b0 comp rx=0 tx=0).stop 2026-02-23T06:48:11.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.042+0000 7fe0958cc640 1 -- 10.20.193.58:0/1346867824 shutdown_connections 2026-02-23T06:48:11.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.042+0000 7fe0958cc640 1 --2- 10.20.193.58:0/1346867824 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe090163de0 0x7fe0900b6cb0 unknown :-1 s=CLOSED pgs=5 gs=3 cs=0 l=1 c_cookie=3255115084645342592 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:11.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.042+0000 7fe0958cc640 1 --2- 10.20.193.58:0/1346867824 >> v2:10.20.193.93:3300/0 conn(0x7fe090158b40 0x7fe0900b6770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:11.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.042+0000 7fe0958cc640 1 -- 10.20.193.58:0/1346867824 >> 10.20.193.58:0/1346867824 conn(0x7fe0900561f0 msgr2=0x7fe0900565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:48:11.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.042+0000 7fe0958cc640 1 -- 10.20.193.58:0/1346867824 shutdown_connections 2026-02-23T06:48:11.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.042+0000 7fe0958cc640 1 -- 10.20.193.58:0/1346867824 wait complete. 2026-02-23T06:48:11.040 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.043+0000 7fe0958cc640 1 Processor -- start 2026-02-23T06:48:11.041 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.043+0000 7fe0958cc640 1 -- start start 2026-02-23T06:48:11.041 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.044+0000 7fe0958cc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe0900b2b20 0x7fe090134480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:11.041 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.044+0000 7fe0958cc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe090158b40 0x7fe090115210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:11.041 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.044+0000 7fe0958cc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe090163de0 0x7fe090156430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:11.041 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.044+0000 7fe0958cc640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe090134b10 con 0x7fe090158b40 2026-02-23T06:48:11.041 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.044+0000 7fe0958cc640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe090157c70 con 0x7fe0900b2b20 2026-02-23T06:48:11.041 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.044+0000 7fe0958cc640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe090134060 con 0x7fe090163de0 2026-02-23T06:48:11.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.044+0000 7fe08effd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe0900b2b20 0x7fe090134480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:11.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.044+0000 7fe08effd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe0900b2b20 0x7fe090134480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:38220/0 (socket says 10.20.193.58:38220) 2026-02-23T06:48:11.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.044+0000 7fe08effd640 1 -- 10.20.193.58:0/1773490063 learned_addr learned my addr 10.20.193.58:0/1773490063 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:48:11.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.044+0000 7fe08e7fc640 1 --2- 10.20.193.58:0/1773490063 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe090158b40 0x7fe090115210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:11.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.044+0000 7fe08f7fe640 1 --2- 10.20.193.58:0/1773490063 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe090163de0 0x7fe090156430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:11.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.044+0000 7fe08effd640 1 -- 10.20.193.58:0/1773490063 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe090163de0 msgr2=0x7fe090156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:11.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.044+0000 7fe08effd640 1 --2- 10.20.193.58:0/1773490063 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe090163de0 0x7fe090156430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:11.043 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.044+0000 7fe08effd640 1 -- 10.20.193.58:0/1773490063 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe090158b40 msgr2=0x7fe090115210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:11.043 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.044+0000 7fe08effd640 1 --2- 10.20.193.58:0/1773490063 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe090158b40 0x7fe090115210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:11.043 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.044+0000 7fe08effd640 1 -- 10.20.193.58:0/1773490063 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0840094b0 con 0x7fe0900b2b20 2026-02-23T06:48:11.043 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.045+0000 7fe08e7fc640 1 --2- 10.20.193.58:0/1773490063 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe090158b40 0x7fe090115210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:48:11.043 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.045+0000 7fe08effd640 1 --2- 10.20.193.58:0/1773490063 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe0900b2b20 0x7fe090134480 secure :-1 s=READY pgs=129 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe084002720 tx=0x7fe084002bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:48:11.043 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.045+0000 7fe067fff640 1 -- 10.20.193.58:0/1773490063 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe08400ed60 con 0x7fe0900b2b20 2026-02-23T06:48:11.043 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.045+0000 7fe067fff640 1 -- 10.20.193.58:0/1773490063 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe084002e50 con 0x7fe0900b2b20 2026-02-23T06:48:11.043 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.045+0000 7fe0958cc640 1 -- 10.20.193.58:0/1773490063 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe08000a590 con 0x7fe0900b2b20 2026-02-23T06:48:11.043 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.045+0000 7fe067fff640 1 -- 10.20.193.58:0/1773490063 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe084010690 con 0x7fe0900b2b20 2026-02-23T06:48:11.043 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.045+0000 7fe0958cc640 1 -- 10.20.193.58:0/1773490063 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe090132f20 con 0x7fe0900b2b20 2026-02-23T06:48:11.043 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.046+0000 7fe0958cc640 1 -- 10.20.193.58:0/1773490063 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe090058640 con 0x7fe0900b2b20 2026-02-23T06:48:11.044 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.047+0000 7fe067fff640 1 -- 10.20.193.58:0/1773490063 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fe084016020 con 0x7fe0900b2b20 2026-02-23T06:48:11.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.048+0000 7fe067fff640 1 --2- 10.20.193.58:0/1773490063 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe06007a6c0 0x7fe06009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:11.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.048+0000 7fe067fff640 1 -- 10.20.193.58:0/1773490063 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fe08409df40 con 0x7fe0900b2b20 2026-02-23T06:48:11.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.048+0000 7fe08e7fc640 1 --2- 10.20.193.58:0/1773490063 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe06007a6c0 0x7fe06009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:11.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.049+0000 7fe067fff640 1 -- 10.20.193.58:0/1773490063 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fe084061180 con 0x7fe0900b2b20 2026-02-23T06:48:11.045 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.049+0000 7fe08e7fc640 1 --2- 10.20.193.58:0/1773490063 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe06007a6c0 0x7fe06009ab70 secure :-1 s=READY pgs=558 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe078007b30 tx=0x7fe078007a80 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:48:11.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.205+0000 7fe0958cc640 1 -- 10.20.193.58:0/1773490063 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe0900b3150 con 0x7fe0900b2b20 2026-02-23T06:48:11.200 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.205+0000 7fe067fff640 1 -- 10.20.193.58:0/1773490063 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7fe0840642a0 con 0x7fe0900b2b20 2026-02-23T06:48:11.201 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":234,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:48:11.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.207+0000 7fe0958cc640 1 -- 10.20.193.58:0/1773490063 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe06007a6c0 msgr2=0x7fe06009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:11.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.207+0000 7fe0958cc640 1 --2- 10.20.193.58:0/1773490063 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe06007a6c0 0x7fe06009ab70 secure :-1 s=READY pgs=558 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe078007b30 tx=0x7fe078007a80 comp rx=0 tx=0).stop 2026-02-23T06:48:11.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.207+0000 7fe0958cc640 1 -- 10.20.193.58:0/1773490063 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe0900b2b20 msgr2=0x7fe090134480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:11.202 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.207+0000 7fe0958cc640 1 --2- 10.20.193.58:0/1773490063 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe0900b2b20 0x7fe090134480 secure :-1 s=READY pgs=129 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe084002720 tx=0x7fe084002bf0 comp rx=0 tx=0).stop 2026-02-23T06:48:11.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.207+0000 7fe0958cc640 1 -- 10.20.193.58:0/1773490063 shutdown_connections 2026-02-23T06:48:11.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.207+0000 7fe0958cc640 1 --2- 10.20.193.58:0/1773490063 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe06007a6c0 0x7fe06009ab70 unknown :-1 s=CLOSED pgs=558 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:11.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.207+0000 7fe0958cc640 1 --2- 10.20.193.58:0/1773490063 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe090163de0 0x7fe090156430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:11.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.207+0000 7fe0958cc640 1 --2- 10.20.193.58:0/1773490063 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe090158b40 0x7fe090115210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:11.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.207+0000 7fe0958cc640 1 --2- 10.20.193.58:0/1773490063 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe0900b2b20 0x7fe090134480 unknown :-1 s=CLOSED pgs=129 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:11.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.207+0000 7fe0958cc640 1 -- 10.20.193.58:0/1773490063 >> 10.20.193.58:0/1773490063 conn(0x7fe0900561f0 msgr2=0x7fe090134cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:48:11.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.207+0000 7fe0958cc640 1 -- 10.20.193.58:0/1773490063 shutdown_connections 2026-02-23T06:48:11.203 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.207+0000 7fe0958cc640 1 -- 10.20.193.58:0/1773490063 wait complete. 2026-02-23T06:48:11.214 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:48:11.214 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:48:11.214 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:48:11.214 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:48:11.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.340+0000 7f00cb577640 1 -- 10.20.193.58:0/881366208 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00b8005270 msgr2=0x7f00b8065a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:11.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.340+0000 7f00cb577640 1 --2- 10.20.193.58:0/881366208 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00b8005270 0x7f00b8065a10 secure :-1 s=READY pgs=69 gs=6 cs=0 l=1 c_cookie=10522876539145767885 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00bc00ac20 tx=0x7f00bc030d10 comp rx=0 tx=0).stop 2026-02-23T06:48:11.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.340+0000 7f00cb577640 1 -- 10.20.193.58:0/881366208 shutdown_connections 2026-02-23T06:48:11.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.340+0000 7f00cb577640 1 --2- 10.20.193.58:0/881366208 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00b8005270 0x7f00b8065a10 unknown :-1 s=CLOSED pgs=69 gs=6 cs=0 l=1 c_cookie=10522876539145767885 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:11.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.340+0000 7f00cb577640 1 -- 10.20.193.58:0/881366208 >> 10.20.193.58:0/881366208 conn(0x7f00cc059db0 msgr2=0x7f00cc05a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:48:11.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.340+0000 7f00cb577640 1 -- 10.20.193.58:0/881366208 shutdown_connections 2026-02-23T06:48:11.336 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.340+0000 7f00cb577640 1 -- 10.20.193.58:0/881366208 wait complete. 2026-02-23T06:48:11.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.341+0000 7f00cb577640 1 Processor -- start 2026-02-23T06:48:11.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.342+0000 7f00cb577640 1 -- start start 2026-02-23T06:48:11.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.342+0000 7f00cb577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00b8005270 0x7f00cc14e9b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:11.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.342+0000 7f00cb577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f00cc142c40 0x7f00cc140100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:11.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.342+0000 7f00cb577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f00cc140640 0x7f00cc124540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:11.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.342+0000 7f00cb577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f00cc121f50 con 0x7f00b8005270 2026-02-23T06:48:11.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.342+0000 7f00cb577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f00cc1240f0 con 0x7f00cc142c40 2026-02-23T06:48:11.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.342+0000 7f00cb577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f00cc143090 con 0x7f00cc140640 2026-02-23T06:48:11.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.342+0000 7f00ca575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00b8005270 0x7f00cc14e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:11.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.342+0000 7f00cad76640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f00cc140640 0x7f00cc124540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:11.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.342+0000 7f00ca575640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00b8005270 0x7f00cc14e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50016/0 (socket says 10.20.193.58:50016) 2026-02-23T06:48:11.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.342+0000 7f00ca575640 1 -- 10.20.193.58:0/3746898300 learned_addr learned my addr 10.20.193.58:0/3746898300 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:48:11.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.342+0000 7f00c9d74640 1 --2- 10.20.193.58:0/3746898300 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f00cc142c40 0x7f00cc140100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:11.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.342+0000 7f00ca575640 1 -- 10.20.193.58:0/3746898300 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f00cc140640 msgr2=0x7f00cc124540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:11.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.342+0000 7f00ca575640 1 --2- 10.20.193.58:0/3746898300 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f00cc140640 0x7f00cc124540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:11.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.343+0000 7f00ca575640 1 -- 10.20.193.58:0/3746898300 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f00cc142c40 msgr2=0x7f00cc140100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:11.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.343+0000 7f00ca575640 1 --2- 10.20.193.58:0/3746898300 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f00cc142c40 0x7f00cc140100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:11.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.343+0000 7f00ca575640 1 -- 10.20.193.58:0/3746898300 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00cc122140 con 0x7f00b8005270 2026-02-23T06:48:11.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.343+0000 7f00ca575640 1 --2- 10.20.193.58:0/3746898300 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00b8005270 0x7f00cc14e9b0 secure :-1 s=READY pgs=70 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00c0002820 tx=0x7f00c0004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:48:11.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.343+0000 7f00b2ffd640 1 -- 10.20.193.58:0/3746898300 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00c000ec90 con 0x7f00b8005270 2026-02-23T06:48:11.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.343+0000 7f00b2ffd640 1 -- 10.20.193.58:0/3746898300 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00c0004e70 con 0x7f00b8005270 2026-02-23T06:48:11.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.343+0000 7f00b2ffd640 1 -- 10.20.193.58:0/3746898300 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00c00116c0 con 0x7f00b8005270 2026-02-23T06:48:11.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.343+0000 7f00cb577640 1 -- 10.20.193.58:0/3746898300 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00cc122420 con 0x7f00b8005270 2026-02-23T06:48:11.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.343+0000 7f00cb577640 1 -- 10.20.193.58:0/3746898300 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00cc1229e0 con 0x7f00b8005270 2026-02-23T06:48:11.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.343+0000 7f00cb577640 1 --2- 10.20.193.58:0/3746898300 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00cc124a80 0x7f00cc151520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:11.341 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.343+0000 7f00cb577640 1 -- 10.20.193.58:0/3746898300 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f00cc1452a0 con 0x7f00cc124a80 2026-02-23T06:48:11.343 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.344+0000 7f00c9d74640 1 --2- 10.20.193.58:0/3746898300 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00cc124a80 0x7f00cc151520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:11.343 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.344+0000 7f00c9d74640 1 -- 10.20.193.58:0/3746898300 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f00cc165d30 con 0x7f00cc124a80 2026-02-23T06:48:11.343 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.344+0000 7f00c9d74640 1 --2- 10.20.193.58:0/3746898300 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00cc124a80 0x7f00cc151520 secure :-1 s=READY pgs=71 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00cc1487f0 tx=0x7f00b4010e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:48:11.343 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.346+0000 7f00b2ffd640 1 -- 10.20.193.58:0/3746898300 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00b400ec20 con 0x7f00cc124a80 2026-02-23T06:48:11.343 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.346+0000 7f00b2ffd640 1 -- 10.20.193.58:0/3746898300 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f00b400ed80 con 0x7f00cc124a80 2026-02-23T06:48:11.343 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.346+0000 7f00b2ffd640 1 -- 10.20.193.58:0/3746898300 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00cc124a80 msgr2=0x7f00cc151520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:11.343 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.346+0000 7f00b2ffd640 1 --2- 10.20.193.58:0/3746898300 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00cc124a80 0x7f00cc151520 secure :-1 s=READY pgs=71 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00cc1487f0 tx=0x7f00b4010e00 comp rx=0 tx=0).stop 2026-02-23T06:48:11.343 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.346+0000 7f00b2ffd640 1 -- 10.20.193.58:0/3746898300 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00cc124a80 msgr2=0x7f00cc151520 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:48:11.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.346+0000 7f00b2ffd640 1 --2- 10.20.193.58:0/3746898300 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00cc124a80 0x7f00cc151520 unknown :-1 s=CLOSED pgs=71 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:11.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.346+0000 7f00b2ffd640 1 -- 10.20.193.58:0/3746898300 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f00c0011820 con 0x7f00b8005270 2026-02-23T06:48:11.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.347+0000 7f00b2ffd640 1 --2- 10.20.193.58:0/3746898300 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f009807a300 0x7f009809a7b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:11.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.347+0000 7f00b2ffd640 1 -- 10.20.193.58:0/3746898300 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f00c009e2a0 con 0x7f00b8005270 2026-02-23T06:48:11.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.348+0000 7f00c9d74640 1 --2- 10.20.193.58:0/3746898300 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f009807a300 0x7f009809a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:11.344 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.348+0000 7f00c9d74640 1 --2- 10.20.193.58:0/3746898300 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f009807a300 0x7f009809a7b0 secure :-1 s=READY pgs=559 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00cc1487f0 tx=0x7f00b4013000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:48:11.345 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.350+0000 7f00cb577640 1 --2- 10.20.193.58:0/3746898300 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00cc151a60 0x7f00cc151e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:11.345 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.350+0000 7f00cb577640 1 -- 10.20.193.58:0/3746898300 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f00cc1225b0 con 0x7f00cc151a60 2026-02-23T06:48:11.346 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.350+0000 7f00cad76640 1 --2- 10.20.193.58:0/3746898300 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00cc151a60 0x7f00cc151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:11.346 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.351+0000 7f00cad76640 1 -- 10.20.193.58:0/3746898300 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f00cc165a50 con 0x7f00cc151a60 2026-02-23T06:48:11.346 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.351+0000 7f00cad76640 1 --2- 10.20.193.58:0/3746898300 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00cc151a60 0x7f00cc151e60 secure :-1 s=READY pgs=72 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00bc00ab70 tx=0x7f00bc005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:48:11.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.351+0000 7f00b2ffd640 1 -- 10.20.193.58:0/3746898300 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00bc040070 con 0x7f00cc151a60 2026-02-23T06:48:11.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.351+0000 7f00b2ffd640 1 -- 10.20.193.58:0/3746898300 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5415 (secure 0 0 0) 0x7f00bc041040 con 0x7f00cc151a60 2026-02-23T06:48:11.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.351+0000 7f00b2ffd640 1 -- 10.20.193.58:0/3746898300 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00cc151a60 msgr2=0x7f00cc151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:11.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.351+0000 7f00b2ffd640 1 --2- 10.20.193.58:0/3746898300 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00cc151a60 0x7f00cc151e60 secure :-1 s=READY pgs=72 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00bc00ab70 tx=0x7f00bc005740 comp rx=0 tx=0).stop 2026-02-23T06:48:11.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.351+0000 7f00b2ffd640 1 -- 10.20.193.58:0/3746898300 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00cc151a60 msgr2=0x7f00cc151e60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:48:11.347 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.351+0000 7f00b2ffd640 1 --2- 10.20.193.58:0/3746898300 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00cc151a60 0x7f00cc151e60 unknown :-1 s=CLOSED pgs=72 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:11.347 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:48:11.348 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:48:11.348 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:48:11.348 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:48:11.348 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 234, 2026-02-23T06:48:11.348 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 62670, 2026-02-23T06:48:11.348 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:48:11.348 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:48:11.348 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:48:11.348 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:48:11.348 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:11.348 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 16, 2026-02-23T06:48:11.349 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:48:11.349 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:48:11.349 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:48:11.349 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:48:11.349 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:48:11.349 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:48:11.349 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:48:11.349 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:48:11.349 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:48:11.349 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:48:11.349 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:48:11.349 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:48:11.350 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:48:11.350 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:48:11.350 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:48:11.350 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:48:11.350 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:11.350 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:48:11.350 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:48:11.350 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:48:11.350 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:48:11.350 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:48:11.350 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:48:11.350 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:48:11.351 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:48:11.351 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:48:11.351 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:48:11.351 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:48:11.351 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:48:11.351 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:48:11.351 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:48:11.351 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:48:11.351 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:11.351 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.351 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:48:11.351 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:48:11.351 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:48:11.352 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:48:11.352 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:48:11.352 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:48:11.352 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:48:11.352 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:48:11.352 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:48:11.352 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:48:11.352 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:48:11.352 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:48:11.352 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:48:11.352 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:48:11.353 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:48:11.353 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:48:11.353 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:48:11.353 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:48:11.353 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:48:11.353 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:48:11.353 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:48:11.353 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:48:11.353 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:48:11.353 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:48:11.353 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:48:11.353 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:48:11.353 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:48:11.354 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:48:11.354 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:48:11.354 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:48:11.354 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:11.354 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:48:11.354 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.354 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:48:11.354 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.354 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:48:11.354 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:48:11.354 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:48:11.354 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:48:11.354 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.355 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:48:11.355 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:48:11.355 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:11.355 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.355 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.355 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:48:11.355 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:48:11.355 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:11.355 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:11.355 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:11.355 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.355 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:48:11.355 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:48:11.356 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:48:11.356 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:48:11.356 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:48:11.356 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:48:11.356 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.356 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.356 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:48:11.356 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:48:11.356 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:48:11.356 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:48:11.356 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.356 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:48:11.357 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:48:11.357 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:11.357 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.357 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.357 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:48:11.357 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:48:11.357 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:11.357 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:11.357 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:11.357 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.357 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:48:11.357 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:48:11.357 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:48:11.358 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:48:11.358 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:48:11.358 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:48:11.358 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.358 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.358 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:48:11.358 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:48:11.358 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:48:11.358 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:48:11.358 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.358 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:48:11.358 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:48:11.358 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:11.359 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.359 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.359 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:48:11.359 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:48:11.359 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:11.359 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:11.359 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:11.359 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.359 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:48:11.359 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:48:11.359 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:48:11.359 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:48:11.359 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:48:11.360 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:48:11.360 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:11.360 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:11.360 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.360 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:48:11.360 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:48:11.360 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.360 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:48:11.360 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:48:11.360 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:48:11.360 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:11.360 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:11.361 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:48:11.361 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.361 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:48:11.361 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:48:11.361 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:48:11.361 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:11.361 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:11.361 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:48:11.361 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.361 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:48:11.361 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:48:11.361 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:48:11.361 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:11.362 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:11.362 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:48:11.362 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.362 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:48:11.362 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:48:11.362 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:48:11.362 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:11.362 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:11.362 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:48:11.362 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.362 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:48:11.362 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:48:11.362 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:48:11.363 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:11.363 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:11.363 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.363 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:48:11.363 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:48:11.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.352+0000 7f00cb577640 1 -- 10.20.193.58:0/3746898300 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f009807a300 msgr2=0x7f009809a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:11.365 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.352+0000 7f00cb577640 1 --2- 10.20.193.58:0/3746898300 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f009807a300 0x7f009809a7b0 secure :-1 s=READY pgs=559 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00cc1487f0 tx=0x7f00b4013000 comp rx=0 tx=0).stop 2026-02-23T06:48:11.365 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.352+0000 7f00cb577640 1 -- 10.20.193.58:0/3746898300 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00b8005270 msgr2=0x7f00cc14e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:11.365 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.352+0000 7f00cb577640 1 --2- 10.20.193.58:0/3746898300 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00b8005270 0x7f00cc14e9b0 secure :-1 s=READY pgs=70 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00c0002820 tx=0x7f00c0004c70 comp rx=0 tx=0).stop 2026-02-23T06:48:11.365 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.352+0000 7f00cad76640 1 -- 10.20.193.58:0/3746898300 reap_dead start 2026-02-23T06:48:11.365 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.352+0000 7f00cb577640 1 -- 10.20.193.58:0/3746898300 shutdown_connections 2026-02-23T06:48:11.365 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.352+0000 7f00cb577640 1 --2- 10.20.193.58:0/3746898300 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f00b8005270 0x7f00cc14e9b0 unknown :-1 s=CLOSED pgs=70 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:11.365 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.352+0000 7f00cb577640 1 -- 10.20.193.58:0/3746898300 >> 10.20.193.58:0/3746898300 conn(0x7f00cc059db0 msgr2=0x7f00cc0b7710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:48:11.365 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.352+0000 7f00cb577640 1 -- 10.20.193.58:0/3746898300 shutdown_connections 2026-02-23T06:48:11.365 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.352+0000 7f00cb577640 1 -- 10.20.193.58:0/3746898300 wait complete. 2026-02-23T06:48:11.366 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:48:11.366 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:48:11.366 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:48:11.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.499+0000 7fd9d4883640 1 -- 10.20.193.58:0/2246338137 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd9d00b6690 msgr2=0x7fd9d0058ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:11.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.499+0000 7fd9d4883640 1 --2- 10.20.193.58:0/2246338137 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd9d00b6690 0x7fd9d0058ec0 secure :-1 s=READY pgs=73 gs=2 cs=0 l=1 c_cookie=12358059320504483936 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9d00b5040 tx=0x7fd9c4030340 comp rx=0 tx=0).stop 2026-02-23T06:48:11.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.499+0000 7fd9d4883640 1 -- 10.20.193.58:0/2246338137 shutdown_connections 2026-02-23T06:48:11.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.499+0000 7fd9d4883640 1 --2- 10.20.193.58:0/2246338137 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd9d00b6690 0x7fd9d0058ec0 unknown :-1 s=CLOSED pgs=73 gs=2 cs=0 l=1 c_cookie=12358059320504483936 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:11.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.499+0000 7fd9d4883640 1 --2- 10.20.193.58:0/2246338137 >> v2:10.20.193.93:3300/0 conn(0x7fd9d015d4a0 0x7fd9d00affb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:11.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.499+0000 7fd9d4883640 1 -- 10.20.193.58:0/2246338137 >> 10.20.193.58:0/2246338137 conn(0x7fd9d00b3c20 msgr2=0x7fd9d00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:48:11.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.499+0000 7fd9d4883640 1 -- 10.20.193.58:0/2246338137 shutdown_connections 2026-02-23T06:48:11.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.499+0000 7fd9d4883640 1 -- 10.20.193.58:0/2246338137 wait complete. 2026-02-23T06:48:11.498 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.500+0000 7fd9d4883640 1 Processor -- start 2026-02-23T06:48:11.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.500+0000 7fd9d4883640 1 -- start start 2026-02-23T06:48:11.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.501+0000 7fd9d4883640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd9d00b6690 0x7fd9d0162bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:11.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.501+0000 7fd9d4883640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd9d015d4a0 0x7fd9d0142050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:11.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.501+0000 7fd9d4883640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd9d015d870 0x7fd9d0140f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:11.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.501+0000 7fd9d4883640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d0163130 con 0x7fd9d015d870 2026-02-23T06:48:11.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.501+0000 7fd9d4883640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d0142d10 con 0x7fd9d015d4a0 2026-02-23T06:48:11.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.501+0000 7fd9d4883640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fd9d01621d0 con 0x7fd9d00b6690 2026-02-23T06:48:11.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.501+0000 7fd9cffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd9d015d870 0x7fd9d0140f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:11.499 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.501+0000 7fd9cffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd9d015d870 0x7fd9d0140f60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50060/0 (socket says 10.20.193.58:50060) 2026-02-23T06:48:11.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.501+0000 7fd9cffff640 1 -- 10.20.193.58:0/404588459 learned_addr learned my addr 10.20.193.58:0/404588459 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:48:11.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.501+0000 7fd9ceffd640 1 --2- 10.20.193.58:0/404588459 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd9d015d4a0 0x7fd9d0142050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:11.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.501+0000 7fd9cf7fe640 1 --2- 10.20.193.58:0/404588459 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd9d00b6690 0x7fd9d0162bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:11.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.501+0000 7fd9cffff640 1 -- 10.20.193.58:0/404588459 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd9d00b6690 msgr2=0x7fd9d0162bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:11.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.501+0000 7fd9cffff640 1 --2- 10.20.193.58:0/404588459 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd9d00b6690 0x7fd9d0162bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:11.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.501+0000 7fd9cffff640 1 -- 10.20.193.58:0/404588459 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd9d015d4a0 msgr2=0x7fd9d0142050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:11.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.501+0000 7fd9cffff640 1 --2- 10.20.193.58:0/404588459 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd9d015d4a0 0x7fd9d0142050 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:11.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.501+0000 7fd9cffff640 1 -- 10.20.193.58:0/404588459 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c400a650 con 0x7fd9d015d870 2026-02-23T06:48:11.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.502+0000 7fd9cffff640 1 --2- 10.20.193.58:0/404588459 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd9d015d870 0x7fd9d0140f60 secure :-1 s=READY pgs=74 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9c4005820 tx=0x7fd9c40039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:48:11.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.502+0000 7fd9abfff640 1 -- 10.20.193.58:0/404588459 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd9c4039470 con 0x7fd9d015d870 2026-02-23T06:48:11.500 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.502+0000 7fd9abfff640 1 -- 10.20.193.58:0/404588459 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9c40396c0 con 0x7fd9d015d870 2026-02-23T06:48:11.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.502+0000 7fd9d4883640 1 -- 10.20.193.58:0/404588459 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9d0162490 con 0x7fd9d015d870 2026-02-23T06:48:11.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.502+0000 7fd9abfff640 1 -- 10.20.193.58:0/404588459 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd9c4039a70 con 0x7fd9d015d870 2026-02-23T06:48:11.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.502+0000 7fd9d4883640 1 -- 10.20.193.58:0/404588459 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9d0142f80 con 0x7fd9d015d870 2026-02-23T06:48:11.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.502+0000 7fd9d4883640 1 --2- 10.20.193.58:0/404588459 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd9d01431a0 0x7fd9d0161070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:11.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.502+0000 7fd9d4883640 1 -- 10.20.193.58:0/404588459 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d0162970 con 0x7fd9d01431a0 2026-02-23T06:48:11.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.503+0000 7fd9cf7fe640 1 --2- 10.20.193.58:0/404588459 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd9d01431a0 0x7fd9d0161070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:11.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.503+0000 7fd9cf7fe640 1 -- 10.20.193.58:0/404588459 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd9d00b6330 con 0x7fd9d01431a0 2026-02-23T06:48:11.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.504+0000 7fd9cf7fe640 1 --2- 10.20.193.58:0/404588459 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd9d01431a0 0x7fd9d0161070 secure :-1 s=READY pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9bc00e520 tx=0x7fd9bc00e920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:48:11.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.504+0000 7fd9abfff640 1 -- 10.20.193.58:0/404588459 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fd9c4039bd0 con 0x7fd9d015d870 2026-02-23T06:48:11.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.505+0000 7fd9abfff640 1 --2- 10.20.193.58:0/404588459 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd9a007a600 0x7fd9a009aab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:11.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.505+0000 7fd9abfff640 1 -- 10.20.193.58:0/404588459 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fd9c40c4290 con 0x7fd9d015d870 2026-02-23T06:48:11.502 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.505+0000 7fd9abfff640 1 -- 10.20.193.58:0/404588459 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd9bc0108c0 con 0x7fd9d01431a0 2026-02-23T06:48:11.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.505+0000 7fd9abfff640 1 -- 10.20.193.58:0/404588459 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fd9bc010a20 con 0x7fd9d01431a0 2026-02-23T06:48:11.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.505+0000 7fd9abfff640 1 -- 10.20.193.58:0/404588459 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd9d01431a0 msgr2=0x7fd9d0161070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:11.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.505+0000 7fd9abfff640 1 --2- 10.20.193.58:0/404588459 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd9d01431a0 0x7fd9d0161070 secure :-1 s=READY pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9bc00e520 tx=0x7fd9bc00e920 comp rx=0 tx=0).stop 2026-02-23T06:48:11.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.505+0000 7fd9abfff640 1 -- 10.20.193.58:0/404588459 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd9d01431a0 msgr2=0x7fd9d0161070 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:48:11.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.505+0000 7fd9abfff640 1 --2- 10.20.193.58:0/404588459 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd9d01431a0 0x7fd9d0161070 secure :-1 s=CLOSED pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9bc00e520 tx=0x7fd9bc00e920 comp rx=0 tx=0).stop 2026-02-23T06:48:11.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.505+0000 7fd9ceffd640 1 --2- 10.20.193.58:0/404588459 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd9a007a600 0x7fd9a009aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:11.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.506+0000 7fd9ceffd640 1 --2- 10.20.193.58:0/404588459 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd9a007a600 0x7fd9a009aab0 secure :-1 s=READY pgs=560 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9d005cb80 tx=0x7fd9c0009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:48:11.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.509+0000 7fd9d4883640 1 --2- 10.20.193.58:0/404588459 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd9d01615b0 0x7fd9d013cec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:11.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.509+0000 7fd9d4883640 1 -- 10.20.193.58:0/404588459 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d0164250 con 0x7fd9d01615b0 2026-02-23T06:48:11.504 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.509+0000 7fd9cf7fe640 1 --2- 10.20.193.58:0/404588459 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd9d01615b0 0x7fd9d013cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:11.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.509+0000 7fd9cf7fe640 1 -- 10.20.193.58:0/404588459 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd9d00b6d50 con 0x7fd9d01615b0 2026-02-23T06:48:11.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.510+0000 7fd9cf7fe640 1 --2- 10.20.193.58:0/404588459 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd9d01615b0 0x7fd9d013cec0 secure :-1 s=READY pgs=133 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9bc004740 tx=0x7fd9bc004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:48:11.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.510+0000 7fd9abfff640 1 -- 10.20.193.58:0/404588459 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd9bc01d050 con 0x7fd9d01615b0 2026-02-23T06:48:11.505 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.510+0000 7fd9abfff640 1 -- 10.20.193.58:0/404588459 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5557 (secure 0 0 0) 0x7fd9bc01e040 con 0x7fd9d01615b0 2026-02-23T06:48:11.506 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:48:11.506 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:48:11.506 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:48:11.506 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:48:11.506 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 234, 2026-02-23T06:48:11.506 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 177869, 2026-02-23T06:48:11.506 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:48:11.506 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:48:11.507 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:48:11.507 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:48:11.507 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 16, 2026-02-23T06:48:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:48:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:48:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:48:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:48:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:48:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:48:11.507 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:48:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:48:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:48:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:48:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:48:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:48:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:48:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:48:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:48:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:48:11.508 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:48:11.508 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:48:11.509 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:48:11.509 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:48:11.509 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:48:11.509 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:48:11.509 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:48:11.509 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:48:11.509 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:48:11.509 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:48:11.509 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:48:11.509 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:48:11.509 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:48:11.509 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:48:11.510 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:48:11.510 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:11.510 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.510 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:48:11.510 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:48:11.510 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:48:11.510 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:48:11.510 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:48:11.510 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:48:11.510 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:48:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:48:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:48:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:48:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:48:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:48:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:48:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:48:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:48:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:48:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:48:11.511 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:48:11.512 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:48:11.512 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:48:11.512 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:48:11.512 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:48:11.512 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:48:11.512 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:48:11.512 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:48:11.512 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:48:11.512 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:48:11.512 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:48:11.512 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:48:11.512 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:48:11.513 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:11.513 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:48:11.513 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.513 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:48:11.513 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.513 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:48:11.513 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:48:11.513 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:48:11.513 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:48:11.513 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.513 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:48:11.513 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:48:11.514 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:11.514 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.514 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.514 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:48:11.514 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:48:11.514 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:11.514 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:11.514 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:11.514 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.514 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:48:11.514 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:48:11.514 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:48:11.515 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:48:11.515 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:48:11.515 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:48:11.515 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.515 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.515 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:48:11.515 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:48:11.515 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:48:11.515 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:48:11.515 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.515 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:48:11.516 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:48:11.516 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:11.516 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.516 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.516 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:48:11.516 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:48:11.516 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:11.516 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:11.516 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:11.516 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.517 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:48:11.517 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:48:11.517 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:48:11.517 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:48:11.517 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:48:11.517 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:48:11.517 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.517 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.517 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:48:11.517 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:48:11.517 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:48:11.517 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:48:11.518 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.518 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:48:11.518 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:48:11.518 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:11.518 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.518 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.518 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:48:11.518 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:48:11.518 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:11.518 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:11.518 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:11.518 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.519 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:48:11.519 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:48:11.519 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:48:11.519 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:48:11.519 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:48:11.519 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:48:11.519 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:11.519 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:11.519 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.519 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:48:11.519 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:48:11.519 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.520 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:48:11.520 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:48:11.520 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:48:11.520 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:11.520 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:11.520 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:48:11.520 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.520 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:48:11.520 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:48:11.520 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:48:11.520 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:11.520 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:11.521 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:48:11.521 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.521 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:48:11.521 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:48:11.521 INFO:teuthology.orchestra.run.trial058.stdout: "num": 7 2026-02-23T06:48:11.521 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:11.521 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:11.521 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:48:11.521 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.521 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:48:11.521 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:48:11.521 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:48:11.522 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.522 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.522 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:48:11.522 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:48:11.522 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:48:11.522 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:11.522 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:11.522 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:48:11.522 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.522 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:48:11.522 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:48:11.522 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:48:11.523 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:11.523 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:11.523 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.523 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:48:11.523 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:48:11.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.510+0000 7fd9abfff640 1 -- 10.20.193.58:0/404588459 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd9d01615b0 msgr2=0x7fd9d013cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:11.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.510+0000 7fd9abfff640 1 --2- 10.20.193.58:0/404588459 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd9d01615b0 0x7fd9d013cec0 secure :-1 s=READY pgs=133 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9bc004740 tx=0x7fd9bc004770 comp rx=0 tx=0).stop 2026-02-23T06:48:11.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.510+0000 7fd9abfff640 1 -- 10.20.193.58:0/404588459 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd9d01615b0 msgr2=0x7fd9d013cec0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:48:11.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.510+0000 7fd9abfff640 1 --2- 10.20.193.58:0/404588459 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd9d01615b0 0x7fd9d013cec0 unknown :-1 s=CLOSED pgs=133 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:11.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.510+0000 7fd9d4883640 1 -- 10.20.193.58:0/404588459 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd9a007a600 msgr2=0x7fd9a009aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:11.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.510+0000 7fd9d4883640 1 --2- 10.20.193.58:0/404588459 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd9a007a600 0x7fd9a009aab0 secure :-1 s=READY pgs=560 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9d005cb80 tx=0x7fd9c0009040 comp rx=0 tx=0).stop 2026-02-23T06:48:11.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.510+0000 7fd9d4883640 1 -- 10.20.193.58:0/404588459 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd9d015d870 msgr2=0x7fd9d0140f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:11.525 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.510+0000 7fd9d4883640 1 --2- 10.20.193.58:0/404588459 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd9d015d870 0x7fd9d0140f60 secure :-1 s=READY pgs=74 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9c4005820 tx=0x7fd9c40039b0 comp rx=0 tx=0).stop 2026-02-23T06:48:11.526 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.510+0000 7fd9cffff640 1 -- 10.20.193.58:0/404588459 reap_dead start 2026-02-23T06:48:11.526 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.510+0000 7fd9cffff640 1 -- 10.20.193.58:0/404588459 reap_dead start 2026-02-23T06:48:11.526 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.511+0000 7fd9d4883640 1 -- 10.20.193.58:0/404588459 shutdown_connections 2026-02-23T06:48:11.526 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.511+0000 7fd9d4883640 1 -- 10.20.193.58:0/404588459 >> 10.20.193.58:0/404588459 conn(0x7fd9d00b3c20 msgr2=0x7fd9d00585b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:48:11.526 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.511+0000 7fd9d4883640 1 -- 10.20.193.58:0/404588459 shutdown_connections 2026-02-23T06:48:11.526 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.511+0000 7fd9d4883640 1 -- 10.20.193.58:0/404588459 wait complete. 2026-02-23T06:48:11.527 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:48:11.527 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:48:11.527 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:48:11.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.659+0000 7fe663577640 1 -- 10.20.193.58:0/4277473939 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe6500040a0 msgr2=0x7fe650004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:11.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.659+0000 7fe663577640 1 --2- 10.20.193.58:0/4277473939 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe6500040a0 0x7fe650004850 secure :-1 s=READY pgs=76 gs=4 cs=0 l=1 c_cookie=15207508522250127647 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe64c004740 tx=0x7fe64c02fc30 comp rx=0 tx=0).stop 2026-02-23T06:48:11.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.659+0000 7fe662d76640 1 -- 10.20.193.58:0/4277473939 reap_dead start 2026-02-23T06:48:11.655 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.659+0000 7fe663577640 1 -- 10.20.193.58:0/4277473939 shutdown_connections 2026-02-23T06:48:11.656 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.659+0000 7fe663577640 1 -- 10.20.193.58:0/4277473939 >> 10.20.193.58:0/4277473939 conn(0x7fe6640b3c20 msgr2=0x7fe6640b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:48:11.656 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.659+0000 7fe663577640 1 -- 10.20.193.58:0/4277473939 shutdown_connections 2026-02-23T06:48:11.656 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.660+0000 7fe663577640 1 -- 10.20.193.58:0/4277473939 wait complete. 2026-02-23T06:48:11.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.661+0000 7fe663577640 1 Processor -- start 2026-02-23T06:48:11.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.661+0000 7fe663577640 1 -- start start 2026-02-23T06:48:11.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.661+0000 7fe663577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe664159430 0x7fe664159800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:11.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.661+0000 7fe663577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe66415d2d0 0x7fe66415ec00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:11.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.661+0000 7fe663577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe66413fd50 0x7fe66413d9a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:11.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.662+0000 7fe663577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe66413f0b0 con 0x7fe66415d2d0 2026-02-23T06:48:11.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.662+0000 7fe663577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe66413cf50 con 0x7fe66413fd50 2026-02-23T06:48:11.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.662+0000 7fe663577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe66415d7a0 con 0x7fe664159430 2026-02-23T06:48:11.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.662+0000 7fe661d74640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe66415d2d0 0x7fe66415ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:11.660 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.662+0000 7fe661d74640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe66415d2d0 0x7fe66415ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50070/0 (socket says 10.20.193.58:50070) 2026-02-23T06:48:11.660 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.662+0000 7fe661d74640 1 -- 10.20.193.58:0/564146582 learned_addr learned my addr 10.20.193.58:0/564146582 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:48:11.660 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.662+0000 7fe662575640 1 --2- 10.20.193.58:0/564146582 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe664159430 0x7fe664159800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:11.660 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.662+0000 7fe662d76640 1 --2- 10.20.193.58:0/564146582 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe66413fd50 0x7fe66413d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:11.660 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.662+0000 7fe661d74640 1 -- 10.20.193.58:0/564146582 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe664159430 msgr2=0x7fe664159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:11.660 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.662+0000 7fe661d74640 1 --2- 10.20.193.58:0/564146582 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe664159430 0x7fe664159800 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:11.660 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.662+0000 7fe661d74640 1 -- 10.20.193.58:0/564146582 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe66413fd50 msgr2=0x7fe66413d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:11.660 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.662+0000 7fe661d74640 1 --2- 10.20.193.58:0/564146582 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe66413fd50 0x7fe66413d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:11.660 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.662+0000 7fe661d74640 1 -- 10.20.193.58:0/564146582 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe66415da80 con 0x7fe66415d2d0 2026-02-23T06:48:11.660 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.662+0000 7fe662d76640 1 --2- 10.20.193.58:0/564146582 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe66413fd50 0x7fe66413d9a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:48:11.660 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.662+0000 7fe661d74640 1 --2- 10.20.193.58:0/564146582 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe66415d2d0 0x7fe66415ec00 secure :-1 s=READY pgs=77 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe64c009a90 tx=0x7fe64c031710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:48:11.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.662+0000 7fe64affd640 1 -- 10.20.193.58:0/564146582 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe64c031f10 con 0x7fe66415d2d0 2026-02-23T06:48:11.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.662+0000 7fe64affd640 1 -- 10.20.193.58:0/564146582 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe64c004410 con 0x7fe66415d2d0 2026-02-23T06:48:11.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.662+0000 7fe64affd640 1 -- 10.20.193.58:0/564146582 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe64c004580 con 0x7fe66415d2d0 2026-02-23T06:48:11.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.662+0000 7fe663577640 1 -- 10.20.193.58:0/564146582 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe66415dd60 con 0x7fe66415d2d0 2026-02-23T06:48:11.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.662+0000 7fe663577640 1 -- 10.20.193.58:0/564146582 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe66413d480 con 0x7fe66415d2d0 2026-02-23T06:48:11.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.663+0000 7fe663577640 1 --2- 10.20.193.58:0/564146582 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe66415e6b0 0x7fe6640b6de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:11.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.663+0000 7fe663577640 1 -- 10.20.193.58:0/564146582 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe66415ea80 con 0x7fe66415e6b0 2026-02-23T06:48:11.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.663+0000 7fe662575640 1 --2- 10.20.193.58:0/564146582 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe66415e6b0 0x7fe6640b6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:11.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.664+0000 7fe662575640 1 -- 10.20.193.58:0/564146582 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe664059690 con 0x7fe66415e6b0 2026-02-23T06:48:11.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.664+0000 7fe662575640 1 --2- 10.20.193.58:0/564146582 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe66415e6b0 0x7fe6640b6de0 secure :-1 s=READY pgs=6 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe658002b30 tx=0x7fe65800fb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:48:11.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.664+0000 7fe64affd640 1 -- 10.20.193.58:0/564146582 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe65800d9b0 con 0x7fe66415e6b0 2026-02-23T06:48:11.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.664+0000 7fe64affd640 1 -- 10.20.193.58:0/564146582 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fe64c039020 con 0x7fe66415d2d0 2026-02-23T06:48:11.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.665+0000 7fe64affd640 1 --2- 10.20.193.58:0/564146582 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe63007a660 0x7fe63009ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:11.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.665+0000 7fe64affd640 1 -- 10.20.193.58:0/564146582 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fe64c0c26c0 con 0x7fe66415d2d0 2026-02-23T06:48:11.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.665+0000 7fe64affd640 1 -- 10.20.193.58:0/564146582 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fe65800db10 con 0x7fe66415e6b0 2026-02-23T06:48:11.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.665+0000 7fe64affd640 1 -- 10.20.193.58:0/564146582 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe66415e6b0 msgr2=0x7fe6640b6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:11.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.665+0000 7fe64affd640 1 --2- 10.20.193.58:0/564146582 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe66415e6b0 0x7fe6640b6de0 secure :-1 s=READY pgs=6 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe658002b30 tx=0x7fe65800fb00 comp rx=0 tx=0).stop 2026-02-23T06:48:11.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.665+0000 7fe64affd640 1 -- 10.20.193.58:0/564146582 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe66415e6b0 msgr2=0x7fe6640b6de0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:48:11.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.665+0000 7fe64affd640 1 --2- 10.20.193.58:0/564146582 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe66415e6b0 0x7fe6640b6de0 unknown :-1 s=CLOSED pgs=6 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:11.663 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.665+0000 7fe662d76640 1 --2- 10.20.193.58:0/564146582 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe63007a660 0x7fe63009ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:11.664 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.666+0000 7fe662d76640 1 --2- 10.20.193.58:0/564146582 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe63007a660 0x7fe63009ab10 secure :-1 s=READY pgs=561 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe664059b50 tx=0x7fe65400a310 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:48:11.665 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.669+0000 7fe663577640 1 --2- 10.20.193.58:0/564146582 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe6640b7320 0x7fe664159d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:11.665 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.669+0000 7fe663577640 1 -- 10.20.193.58:0/564146582 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe6640593b0 con 0x7fe6640b7320 2026-02-23T06:48:11.665 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.669+0000 7fe662575640 1 --2- 10.20.193.58:0/564146582 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe6640b7320 0x7fe664159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:11.665 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.669+0000 7fe662575640 1 -- 10.20.193.58:0/564146582 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe66415c880 con 0x7fe6640b7320 2026-02-23T06:48:11.665 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.670+0000 7fe662575640 1 --2- 10.20.193.58:0/564146582 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe6640b7320 0x7fe664159d80 secure :-1 s=READY pgs=7 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe658015000 tx=0x7fe6640aee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:48:11.665 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.670+0000 7fe64affd640 1 -- 10.20.193.58:0/564146582 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe65801c940 con 0x7fe6640b7320 2026-02-23T06:48:11.665 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.670+0000 7fe64affd640 1 -- 10.20.193.58:0/564146582 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4912 (secure 0 0 0) 0x7fe65801caa0 con 0x7fe6640b7320 2026-02-23T06:48:11.666 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.670+0000 7fe64affd640 1 -- 10.20.193.58:0/564146582 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe6640b7320 msgr2=0x7fe664159d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:11.666 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.670+0000 7fe64affd640 1 --2- 10.20.193.58:0/564146582 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe6640b7320 0x7fe664159d80 secure :-1 s=READY pgs=7 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe658015000 tx=0x7fe6640aee20 comp rx=0 tx=0).stop 2026-02-23T06:48:11.666 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.670+0000 7fe64affd640 1 -- 10.20.193.58:0/564146582 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe6640b7320 msgr2=0x7fe664159d80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:48:11.666 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.670+0000 7fe64affd640 1 --2- 10.20.193.58:0/564146582 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe6640b7320 0x7fe664159d80 unknown :-1 s=CLOSED pgs=7 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:11.666 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:48:11.666 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:48:11.666 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:48:11.667 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:48:11.667 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 234, 2026-02-23T06:48:11.667 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 16334, 2026-02-23T06:48:11.667 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:48:11.667 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:48:11.667 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:48:11.667 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:48:11.667 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:11.667 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 16, 2026-02-23T06:48:11.667 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:48:11.667 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:48:11.667 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:48:11.668 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:48:11.668 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:48:11.668 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:48:11.668 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:48:11.668 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:48:11.668 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:48:11.668 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:48:11.668 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:48:11.668 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:48:11.668 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:48:11.668 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:48:11.668 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:48:11.669 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:48:11.669 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:11.669 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:48:11.669 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:48:11.669 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:48:11.669 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:48:11.669 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:48:11.669 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:48:11.669 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:48:11.669 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:48:11.669 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:48:11.669 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:48:11.670 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:48:11.670 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:48:11.670 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:48:11.670 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:48:11.670 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:48:11.670 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:11.670 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.670 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:48:11.670 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:48:11.670 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:48:11.670 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:48:11.670 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:48:11.671 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:48:11.671 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:48:11.671 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:48:11.671 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:48:11.671 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:48:11.671 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:48:11.671 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:48:11.671 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:48:11.671 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:48:11.671 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:48:11.671 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:48:11.671 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:48:11.672 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:48:11.672 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:48:11.672 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:48:11.672 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:48:11.672 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:48:11.672 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:48:11.672 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:48:11.672 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:48:11.672 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:48:11.672 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:48:11.672 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:48:11.672 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:48:11.673 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:48:11.673 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:11.673 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:48:11.673 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.673 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:48:11.673 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.673 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:48:11.673 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:48:11.673 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:48:11.673 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:48:11.673 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.673 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:48:11.674 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:48:11.674 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:11.674 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.674 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.674 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:48:11.674 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:48:11.674 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:11.674 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:11.674 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:11.674 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.674 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:48:11.674 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:48:11.675 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:48:11.675 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:48:11.675 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:48:11.675 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:48:11.675 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.675 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.675 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:48:11.675 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:48:11.675 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:48:11.675 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:48:11.675 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.675 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:48:11.676 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:48:11.676 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:11.676 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.676 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.676 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:48:11.676 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:48:11.676 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:11.676 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:11.676 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:11.676 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.676 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:48:11.676 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:48:11.676 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:48:11.677 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:48:11.677 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:48:11.677 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:48:11.677 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.677 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.677 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:48:11.677 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:48:11.677 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:48:11.677 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:48:11.677 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.677 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:48:11.677 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:48:11.677 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:11.678 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.678 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.678 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:48:11.678 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:48:11.678 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:11.678 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:11.678 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:11.678 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.678 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:48:11.678 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:48:11.678 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:48:11.679 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:48:11.679 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:48:11.679 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:48:11.679 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:11.679 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:11.679 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.679 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:48:11.679 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:48:11.679 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.679 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:48:11.679 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:48:11.679 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:48:11.680 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:11.680 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:11.680 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:48:11.680 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:11.680 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:48:11.680 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:48:11.680 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:48:11.680 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:11.680 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:11.680 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:11.680 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:48:11.680 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:48:11.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.670+0000 7fe663577640 1 -- 10.20.193.58:0/564146582 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe63007a660 msgr2=0x7fe63009ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:11.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.670+0000 7fe663577640 1 --2- 10.20.193.58:0/564146582 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe63007a660 0x7fe63009ab10 secure :-1 s=READY pgs=561 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe664059b50 tx=0x7fe65400a310 comp rx=0 tx=0).stop 2026-02-23T06:48:11.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.670+0000 7fe663577640 1 -- 10.20.193.58:0/564146582 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe66415d2d0 msgr2=0x7fe66415ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:11.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.670+0000 7fe663577640 1 --2- 10.20.193.58:0/564146582 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe66415d2d0 0x7fe66415ec00 secure :-1 s=READY pgs=77 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe64c009a90 tx=0x7fe64c031710 comp rx=0 tx=0).stop 2026-02-23T06:48:11.682 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.670+0000 7fe662d76640 1 -- 10.20.193.58:0/564146582 reap_dead start 2026-02-23T06:48:11.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.670+0000 7fe662d76640 1 -- 10.20.193.58:0/564146582 reap_dead start 2026-02-23T06:48:11.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.670+0000 7fe663577640 1 -- 10.20.193.58:0/564146582 shutdown_connections 2026-02-23T06:48:11.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.670+0000 7fe663577640 1 -- 10.20.193.58:0/564146582 >> 10.20.193.58:0/564146582 conn(0x7fe6640b3c20 msgr2=0x7fe6640ae1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:48:11.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.670+0000 7fe663577640 1 -- 10.20.193.58:0/564146582 shutdown_connections 2026-02-23T06:48:11.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:11.670+0000 7fe663577640 1 -- 10.20.193.58:0/564146582 wait complete. 2026-02-23T06:48:11.683 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:48:11.684 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-23T06:48:11.684 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2026-02-23T06:48:11.684 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-23T06:48:11.684 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-23T06:48:11.684 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-23T06:48:11.684 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:48:11.693 INFO:tasks.ceph.mon.c:Stopped 2026-02-23T06:48:11.693 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.a 2026-02-23T06:48:11.693 INFO:tasks.mon_thrash:Sending STOP to mon a 2026-02-23T06:48:11.693 INFO:tasks.ceph.mon.a:Sent signal 19 2026-02-23T06:48:11.694 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-23T06:48:15.414 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:48:15.420 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:48:26.694 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.a 2026-02-23T06:48:26.694 INFO:tasks.mon_thrash:Sending CONT to mon a 2026-02-23T06:48:26.695 INFO:tasks.ceph.mon.a:Sent signal 18 2026-02-23T06:48:26.695 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:48:26.695 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:48:31.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.711+0000 7f3a09a43640 1 -- 10.20.193.58:0/451065952 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f39f0004850 msgr2=0x7f39f0004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:31.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.711+0000 7f3a09a43640 1 --2- 10.20.193.58:0/451065952 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f39f0004850 0x7f39f0004cc0 secure :-1 s=READY pgs=142 gs=24 cs=0 l=1 c_cookie=3482723265299107283 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39ec003060 tx=0x7f39ec02f780 comp rx=0 tx=0).stop 2026-02-23T06:48:31.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.711+0000 7f3a09a43640 1 -- 10.20.193.58:0/451065952 shutdown_connections 2026-02-23T06:48:31.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.711+0000 7f3a09a43640 1 --2- 10.20.193.58:0/451065952 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f39f0005320 0x7f39f0065a10 unknown :-1 s=CLOSED pgs=0 gs=25 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:31.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.711+0000 7f3a09a43640 1 --2- 10.20.193.58:0/451065952 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f39f0004850 0x7f39f0004cc0 unknown :-1 s=CLOSED pgs=142 gs=24 cs=0 l=1 c_cookie=3482723265299107283 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:31.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.711+0000 7f3a09a43640 1 --2- 10.20.193.58:0/451065952 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f39f0003a30 0x7f39f0003e20 unknown :-1 s=CLOSED pgs=0 gs=23 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:31.707 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.711+0000 7f3a09a43640 1 -- 10.20.193.58:0/451065952 >> 10.20.193.58:0/451065952 conn(0x7f3a040b3c20 msgr2=0x7f3a040b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:48:31.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.711+0000 7f3a09a43640 1 -- 10.20.193.58:0/451065952 shutdown_connections 2026-02-23T06:48:31.708 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.711+0000 7f3a09a43640 1 -- 10.20.193.58:0/451065952 wait complete. 2026-02-23T06:48:31.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.712+0000 7f3a09a43640 1 Processor -- start 2026-02-23T06:48:31.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.712+0000 7f3a09a43640 1 -- start start 2026-02-23T06:48:31.710 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.713+0000 7f3a09a43640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f39f0003a30 0x7f3a040b0750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:31.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.713+0000 7f3a09a43640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f39f0004850 0x7f3a04126640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:31.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.713+0000 7f3a09a43640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f39f0005320 0x7f3a040af440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:31.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.713+0000 7f3a09a43640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f3a040b0c90 con 0x7f39f0003a30 2026-02-23T06:48:31.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.713+0000 7f3a09a43640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f3a04124680 con 0x7f39f0004850 2026-02-23T06:48:31.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.713+0000 7f3a09a43640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f3a041279e0 con 0x7f39f0005320 2026-02-23T06:48:31.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.713+0000 7f3a08a41640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f39f0003a30 0x7f3a040b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:31.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.713+0000 7f3a08a41640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f39f0003a30 0x7f3a040b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:59584/0 (socket says 10.20.193.58:59584) 2026-02-23T06:48:31.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.713+0000 7f3a08a41640 1 -- 10.20.193.58:0/1461385928 learned_addr learned my addr 10.20.193.58:0/1461385928 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:48:31.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.713+0000 7f39fbfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f39f0004850 0x7f3a04126640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:31.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.713+0000 7f3a09242640 1 -- 10.20.193.58:0/1461385928 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f39f0005320 msgr2=0x7f3a040af440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:48:31.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.713+0000 7f3a09242640 1 --2- 10.20.193.58:0/1461385928 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f39f0005320 0x7f3a040af440 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:48:31.712 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.713+0000 7f3a08a41640 1 -- 10.20.193.58:0/1461385928 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f39f0005320 msgr2=0x7f3a040af440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:48:31.712 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.713+0000 7f3a08a41640 1 --2- 10.20.193.58:0/1461385928 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f39f0005320 0x7f3a040af440 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:31.712 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.713+0000 7f3a08a41640 1 -- 10.20.193.58:0/1461385928 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f39f0004850 msgr2=0x7f3a04126640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:31.712 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.713+0000 7f3a08a41640 1 --2- 10.20.193.58:0/1461385928 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f39f0004850 0x7f3a04126640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:31.712 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.713+0000 7f3a08a41640 1 -- 10.20.193.58:0/1461385928 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a04127c50 con 0x7f39f0003a30 2026-02-23T06:48:31.712 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.713+0000 7f3a08a41640 1 --2- 10.20.193.58:0/1461385928 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f39f0003a30 0x7f3a040b0750 secure :-1 s=READY pgs=84 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39f4012750 tx=0x7f39f4012c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:48:31.712 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.714+0000 7f39f97fa640 1 -- 10.20.193.58:0/1461385928 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f39f4021070 con 0x7f39f0003a30 2026-02-23T06:48:31.712 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.714+0000 7f39f97fa640 1 -- 10.20.193.58:0/1461385928 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39f4018050 con 0x7f39f0003a30 2026-02-23T06:48:31.712 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.714+0000 7f39f97fa640 1 -- 10.20.193.58:0/1461385928 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f39f4004850 con 0x7f39f0003a30 2026-02-23T06:48:31.712 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.714+0000 7f3a09a43640 1 -- 10.20.193.58:0/1461385928 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a04127f30 con 0x7f39f0003a30 2026-02-23T06:48:31.712 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.714+0000 7f3a09a43640 1 -- 10.20.193.58:0/1461385928 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a04160090 con 0x7f39f0003a30 2026-02-23T06:48:31.712 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.714+0000 7f3a09a43640 1 -- 10.20.193.58:0/1461385928 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a04058070 con 0x7f39f0003a30 2026-02-23T06:48:31.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.715+0000 7f39f97fa640 1 -- 10.20.193.58:0/1461385928 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f39f4026410 con 0x7f39f0003a30 2026-02-23T06:48:31.713 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.716+0000 7f39f97fa640 1 --2- 10.20.193.58:0/1461385928 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f39d407a5a0 0x7f39d409aa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:31.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.716+0000 7f39f97fa640 1 -- 10.20.193.58:0/1461385928 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f39f409ec40 con 0x7f39f0003a30 2026-02-23T06:48:31.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.717+0000 7f39fbfff640 1 --2- 10.20.193.58:0/1461385928 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f39d407a5a0 0x7f39d409aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:31.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.717+0000 7f39fbfff640 1 --2- 10.20.193.58:0/1461385928 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f39d407a5a0 0x7f39d409aa50 secure :-1 s=READY pgs=562 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39ec002bc0 tx=0x7f39ec003100 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:48:31.714 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.719+0000 7f39f97fa640 1 -- 10.20.193.58:0/1461385928 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f39f4061e10 con 0x7f39f0003a30 2026-02-23T06:48:31.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.874+0000 7f3a09a43640 1 -- 10.20.193.58:0/1461385928 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3a0415b7f0 con 0x7f39f0003a30 2026-02-23T06:48:31.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.875+0000 7f39f97fa640 1 -- 10.20.193.58:0/1461385928 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1749 (secure 0 0 0) 0x7f39f4064f30 con 0x7f39f0003a30 2026-02-23T06:48:31.871 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":238,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:48:31.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.876+0000 7f3a09a43640 1 -- 10.20.193.58:0/1461385928 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f39d407a5a0 msgr2=0x7f39d409aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:31.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.876+0000 7f3a09a43640 1 --2- 10.20.193.58:0/1461385928 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f39d407a5a0 0x7f39d409aa50 secure :-1 s=READY pgs=562 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39ec002bc0 tx=0x7f39ec003100 comp rx=0 tx=0).stop 2026-02-23T06:48:31.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.876+0000 7f3a09a43640 1 -- 10.20.193.58:0/1461385928 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f39f0003a30 msgr2=0x7f3a040b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:31.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.876+0000 7f3a09a43640 1 --2- 10.20.193.58:0/1461385928 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f39f0003a30 0x7f3a040b0750 secure :-1 s=READY pgs=84 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39f4012750 tx=0x7f39f4012c20 comp rx=0 tx=0).stop 2026-02-23T06:48:31.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.876+0000 7f3a09a43640 1 -- 10.20.193.58:0/1461385928 shutdown_connections 2026-02-23T06:48:31.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.876+0000 7f3a09a43640 1 --2- 10.20.193.58:0/1461385928 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f39d407a5a0 0x7f39d409aa50 unknown :-1 s=CLOSED pgs=562 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:31.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.876+0000 7f3a09a43640 1 --2- 10.20.193.58:0/1461385928 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f39f0005320 0x7f3a040af440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:31.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.876+0000 7f3a09a43640 1 --2- 10.20.193.58:0/1461385928 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f39f0004850 0x7f3a04126640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:31.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.876+0000 7f3a09a43640 1 --2- 10.20.193.58:0/1461385928 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f39f0003a30 0x7f3a040b0750 unknown :-1 s=CLOSED pgs=84 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:31.873 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.876+0000 7f3a09a43640 1 -- 10.20.193.58:0/1461385928 >> 10.20.193.58:0/1461385928 conn(0x7f3a040b3c20 msgr2=0x7f3a040b7680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:48:31.873 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.876+0000 7f3a09a43640 1 -- 10.20.193.58:0/1461385928 shutdown_connections 2026-02-23T06:48:31.873 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:31.876+0000 7f3a09a43640 1 -- 10.20.193.58:0/1461385928 wait complete. 2026-02-23T06:48:31.884 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:48:31.885 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-23T06:48:31.885 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:48:32.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.011+0000 7fd248992640 1 -- 10.20.193.58:0/1219870757 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd24415d870 msgr2=0x7fd2440587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:32.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.011+0000 7fd248992640 1 --2- 10.20.193.58:0/1219870757 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd24415d870 0x7fd2440587b0 secure :-1 s=READY pgs=144 gs=2 cs=0 l=1 c_cookie=4835878719870563822 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd234004740 tx=0x7fd23402f200 comp rx=0 tx=0).stop 2026-02-23T06:48:32.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.011+0000 7fd248992640 1 -- 10.20.193.58:0/1219870757 shutdown_connections 2026-02-23T06:48:32.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.011+0000 7fd248992640 1 --2- 10.20.193.58:0/1219870757 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd2440b6690 0x7fd244058cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:32.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.011+0000 7fd248992640 1 --2- 10.20.193.58:0/1219870757 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd24415d870 0x7fd2440587b0 unknown :-1 s=CLOSED pgs=144 gs=2 cs=0 l=1 c_cookie=4835878719870563822 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:32.007 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.011+0000 7fd248992640 1 -- 10.20.193.58:0/1219870757 >> 10.20.193.58:0/1219870757 conn(0x7fd2440b3c20 msgr2=0x7fd2440b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:48:32.008 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.011+0000 7fd248992640 1 -- 10.20.193.58:0/1219870757 shutdown_connections 2026-02-23T06:48:32.008 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.011+0000 7fd248992640 1 -- 10.20.193.58:0/1219870757 wait complete. 2026-02-23T06:48:32.011 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.012+0000 7fd248992640 1 Processor -- start 2026-02-23T06:48:32.011 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.013+0000 7fd248992640 1 -- start start 2026-02-23T06:48:32.011 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.013+0000 7fd248992640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd2440b6690 0x7fd2441252f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:32.011 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.013+0000 7fd248992640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd24415d4a0 0x7fd2440567b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:32.011 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.013+0000 7fd248992640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd24415d870 0x7fd244056cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:32.011 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.013+0000 7fd248992640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fd24414cd90 con 0x7fd24415d870 2026-02-23T06:48:32.011 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.013+0000 7fd248992640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fd24414d070 con 0x7fd24415d4a0 2026-02-23T06:48:32.011 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.013+0000 7fd248992640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fd244057bf0 con 0x7fd2440b6690 2026-02-23T06:48:32.012 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.013+0000 7fd2437fe640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd2440b6690 msgr2=0x7fd2441252f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:48:32.012 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.013+0000 7fd2437fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd2440b6690 0x7fd2441252f0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:48:32.012 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.013+0000 7fd242ffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd24415d4a0 0x7fd2440567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:32.012 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.013+0000 7fd242ffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd24415d4a0 0x7fd2440567b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:38480/0 (socket says 10.20.193.58:38480) 2026-02-23T06:48:32.012 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.013+0000 7fd242ffd640 1 -- 10.20.193.58:0/1767874822 learned_addr learned my addr 10.20.193.58:0/1767874822 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:48:32.012 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.013+0000 7fd243fff640 1 --2- 10.20.193.58:0/1767874822 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd24415d870 0x7fd244056cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:32.012 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.014+0000 7fd242ffd640 1 -- 10.20.193.58:0/1767874822 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd2440b6690 msgr2=0x7fd2441252f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:48:32.012 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.014+0000 7fd242ffd640 1 --2- 10.20.193.58:0/1767874822 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd2440b6690 0x7fd2441252f0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:32.012 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.014+0000 7fd242ffd640 1 -- 10.20.193.58:0/1767874822 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd24415d870 msgr2=0x7fd244056cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:32.012 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.014+0000 7fd242ffd640 1 --2- 10.20.193.58:0/1767874822 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd24415d870 0x7fd244056cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:32.012 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.014+0000 7fd242ffd640 1 -- 10.20.193.58:0/1767874822 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2340094b0 con 0x7fd24415d4a0 2026-02-23T06:48:32.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.014+0000 7fd242ffd640 1 --2- 10.20.193.58:0/1767874822 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd24415d4a0 0x7fd2440567b0 secure :-1 s=READY pgs=145 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2340023d0 tx=0x7fd234002a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:48:32.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.014+0000 7fd21ffff640 1 -- 10.20.193.58:0/1767874822 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd234044070 con 0x7fd24415d4a0 2026-02-23T06:48:32.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.014+0000 7fd248992640 1 -- 10.20.193.58:0/1767874822 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd244057ed0 con 0x7fd24415d4a0 2026-02-23T06:48:32.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.014+0000 7fd21ffff640 1 -- 10.20.193.58:0/1767874822 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd234004b60 con 0x7fd24415d4a0 2026-02-23T06:48:32.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.014+0000 7fd21ffff640 1 -- 10.20.193.58:0/1767874822 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd234002e50 con 0x7fd24415d4a0 2026-02-23T06:48:32.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.014+0000 7fd248992640 1 -- 10.20.193.58:0/1767874822 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd244056290 con 0x7fd24415d4a0 2026-02-23T06:48:32.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.015+0000 7fd248992640 1 --2- 10.20.193.58:0/1767874822 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd24413e880 0x7fd2441425b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:32.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.015+0000 7fd248992640 1 -- 10.20.193.58:0/1767874822 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fd2440b6330 con 0x7fd24413e880 2026-02-23T06:48:32.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.015+0000 7fd2437fe640 1 --2- 10.20.193.58:0/1767874822 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd24413e880 0x7fd2441425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:32.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.015+0000 7fd2437fe640 1 -- 10.20.193.58:0/1767874822 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd2440b5e10 con 0x7fd24413e880 2026-02-23T06:48:32.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.015+0000 7fd2437fe640 1 --2- 10.20.193.58:0/1767874822 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd24413e880 0x7fd2441425b0 secure :-1 s=READY pgs=85 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd230002a40 tx=0x7fd23000cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:48:32.013 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.016+0000 7fd21ffff640 1 -- 10.20.193.58:0/1767874822 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd230004b30 con 0x7fd24413e880 2026-02-23T06:48:32.014 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.016+0000 7fd21ffff640 1 -- 10.20.193.58:0/1767874822 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fd234004f10 con 0x7fd24415d4a0 2026-02-23T06:48:32.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.016+0000 7fd21ffff640 1 --2- 10.20.193.58:0/1767874822 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd21407a660 0x7fd21409ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:32.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.017+0000 7fd21ffff640 1 -- 10.20.193.58:0/1767874822 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fd2340c26e0 con 0x7fd24415d4a0 2026-02-23T06:48:32.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.017+0000 7fd21ffff640 1 -- 10.20.193.58:0/1767874822 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fd23000ce70 con 0x7fd24413e880 2026-02-23T06:48:32.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.017+0000 7fd21ffff640 1 -- 10.20.193.58:0/1767874822 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd24413e880 msgr2=0x7fd2441425b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:32.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.017+0000 7fd21ffff640 1 --2- 10.20.193.58:0/1767874822 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd24413e880 0x7fd2441425b0 secure :-1 s=READY pgs=85 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd230002a40 tx=0x7fd23000cb20 comp rx=0 tx=0).stop 2026-02-23T06:48:32.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.017+0000 7fd21ffff640 1 -- 10.20.193.58:0/1767874822 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd24413e880 msgr2=0x7fd2441425b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:48:32.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.017+0000 7fd21ffff640 1 --2- 10.20.193.58:0/1767874822 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd24413e880 0x7fd2441425b0 secure :-1 s=CLOSED pgs=85 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd230002a40 tx=0x7fd23000cb20 comp rx=0 tx=0).stop 2026-02-23T06:48:32.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.017+0000 7fd243fff640 1 --2- 10.20.193.58:0/1767874822 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd21407a660 0x7fd21409ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:32.016 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.017+0000 7fd243fff640 1 --2- 10.20.193.58:0/1767874822 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd21407a660 0x7fd21409ab10 secure :-1 s=READY pgs=563 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd238007fd0 tx=0x7fd23800a190 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:48:32.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.020+0000 7fd248992640 1 --2- 10.20.193.58:0/1767874822 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd2441610b0 0x7fd244142af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:32.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.020+0000 7fd248992640 1 -- 10.20.193.58:0/1767874822 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fd2440b6d50 con 0x7fd2441610b0 2026-02-23T06:48:32.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.020+0000 7fd2437fe640 1 --2- 10.20.193.58:0/1767874822 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd2441610b0 0x7fd244142af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:32.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.021+0000 7fd2437fe640 1 -- 10.20.193.58:0/1767874822 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd24405b0e0 con 0x7fd2441610b0 2026-02-23T06:48:32.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.021+0000 7fd2437fe640 1 --2- 10.20.193.58:0/1767874822 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd2441610b0 0x7fd244142af0 secure :-1 s=READY pgs=86 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd230002a70 tx=0x7fd2300026a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:48:32.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.021+0000 7fd21ffff640 1 -- 10.20.193.58:0/1767874822 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd230020070 con 0x7fd2441610b0 2026-02-23T06:48:32.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.021+0000 7fd21ffff640 1 -- 10.20.193.58:0/1767874822 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5403 (secure 0 0 0) 0x7fd23000a820 con 0x7fd2441610b0 2026-02-23T06:48:32.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.021+0000 7fd21ffff640 1 -- 10.20.193.58:0/1767874822 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd2441610b0 msgr2=0x7fd244142af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:32.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.021+0000 7fd21ffff640 1 --2- 10.20.193.58:0/1767874822 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd2441610b0 0x7fd244142af0 secure :-1 s=READY pgs=86 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd230002a70 tx=0x7fd2300026a0 comp rx=0 tx=0).stop 2026-02-23T06:48:32.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.021+0000 7fd21ffff640 1 -- 10.20.193.58:0/1767874822 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd2441610b0 msgr2=0x7fd244142af0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:48:32.018 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.021+0000 7fd21ffff640 1 --2- 10.20.193.58:0/1767874822 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd2441610b0 0x7fd244142af0 secure :-1 s=CLOSED pgs=86 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd230002a70 tx=0x7fd2300026a0 comp rx=0 tx=0).stop 2026-02-23T06:48:32.018 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:48:32.018 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:48:32.019 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:48:32.019 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:48:32.019 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 238, 2026-02-23T06:48:32.019 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 83340, 2026-02-23T06:48:32.019 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:48:32.019 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:48:32.019 INFO:teuthology.orchestra.run.trial058.stdout: 1 2026-02-23T06:48:32.019 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:32.019 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:48:32.019 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:48:32.019 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:48:32.019 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:48:32.020 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:48:32.020 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:48:32.020 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:48:32.020 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:48:32.020 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:48:32.020 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:48:32.020 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:48:32.020 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:48:32.021 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:48:32.021 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:48:32.021 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:48:32.021 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:48:32.021 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:48:32.021 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:32.021 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:48:32.021 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:48:32.021 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:48:32.021 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:48:32.021 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:48:32.021 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:48:32.022 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:48:32.022 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:48:32.022 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:48:32.022 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:48:32.022 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:48:32.022 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:48:32.022 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:48:32.022 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:48:32.022 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:48:32.022 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:32.022 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:32.022 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:48:32.023 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:48:32.023 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:48:32.023 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:48:32.023 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:48:32.023 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:48:32.023 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:48:32.023 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:48:32.023 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:48:32.023 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:48:32.023 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:48:32.023 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:48:32.024 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:48:32.024 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:48:32.024 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:48:32.024 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:48:32.024 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:48:32.024 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:48:32.024 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:48:32.024 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:48:32.024 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:48:32.024 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:48:32.024 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:48:32.024 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:48:32.024 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:48:32.025 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:48:32.025 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:48:32.025 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:48:32.025 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:48:32.025 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:48:32.025 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:32.025 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:48:32.025 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:32.025 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:48:32.025 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.025 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:48:32.025 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:48:32.026 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:48:32.026 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:48:32.026 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.026 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:48:32.026 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:48:32.026 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:32.026 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:32.026 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.026 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:48:32.026 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:48:32.026 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:32.026 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:32.026 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:32.027 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:32.027 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:48:32.027 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:48:32.027 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:48:32.027 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:48:32.027 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:48:32.027 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:48:32.027 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:32.027 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.027 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:48:32.027 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:48:32.027 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:48:32.028 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:48:32.028 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.028 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:48:32.028 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:48:32.028 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:32.028 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:32.028 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.028 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:48:32.028 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:48:32.028 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:32.028 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:32.028 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:32.029 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:32.029 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:48:32.029 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:48:32.029 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:48:32.029 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:48:32.029 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:48:32.029 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:48:32.029 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:32.029 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.029 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:48:32.029 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:48:32.029 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:48:32.030 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:48:32.030 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.030 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:48:32.030 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:48:32.030 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:32.030 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:32.030 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.030 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:48:32.030 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:48:32.030 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:32.031 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:32.031 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:32.031 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:32.031 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:48:32.031 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:48:32.031 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:48:32.031 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:48:32.031 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:48:32.031 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:48:32.031 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:32.031 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:32.032 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:32.032 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:48:32.032 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:48:32.032 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.032 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:48:32.032 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:48:32.032 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:48:32.032 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:32.032 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:32.032 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:48:32.032 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.032 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:48:32.033 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:48:32.033 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:48:32.033 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:32.033 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:32.033 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:48:32.033 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.033 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:48:32.033 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:48:32.033 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:48:32.033 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:32.033 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:32.033 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:48:32.033 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.034 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:48:32.034 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:48:32.034 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:48:32.034 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:32.034 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:32.034 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:48:32.034 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.034 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:48:32.034 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:48:32.034 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:48:32.034 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:32.035 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:32.035 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:32.035 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:48:32.035 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:48:32.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.021+0000 7fd248992640 1 -- 10.20.193.58:0/1767874822 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd21407a660 msgr2=0x7fd21409ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:32.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.021+0000 7fd248992640 1 --2- 10.20.193.58:0/1767874822 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd21407a660 0x7fd21409ab10 secure :-1 s=READY pgs=563 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd238007fd0 tx=0x7fd23800a190 comp rx=0 tx=0).stop 2026-02-23T06:48:32.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.021+0000 7fd248992640 1 -- 10.20.193.58:0/1767874822 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd24415d4a0 msgr2=0x7fd2440567b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:32.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.021+0000 7fd248992640 1 --2- 10.20.193.58:0/1767874822 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd24415d4a0 0x7fd2440567b0 secure :-1 s=READY pgs=145 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2340023d0 tx=0x7fd234002a10 comp rx=0 tx=0).stop 2026-02-23T06:48:32.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.021+0000 7fd243fff640 1 -- 10.20.193.58:0/1767874822 reap_dead start 2026-02-23T06:48:32.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.021+0000 7fd243fff640 1 -- 10.20.193.58:0/1767874822 reap_dead start 2026-02-23T06:48:32.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.021+0000 7fd248992640 1 -- 10.20.193.58:0/1767874822 shutdown_connections 2026-02-23T06:48:32.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.021+0000 7fd248992640 1 -- 10.20.193.58:0/1767874822 >> 10.20.193.58:0/1767874822 conn(0x7fd2440b3c20 msgr2=0x7fd244163350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:48:32.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.021+0000 7fd248992640 1 -- 10.20.193.58:0/1767874822 shutdown_connections 2026-02-23T06:48:32.037 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.021+0000 7fd248992640 1 -- 10.20.193.58:0/1767874822 wait complete. 2026-02-23T06:48:32.038 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:48:32.038 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-23T06:48:32.038 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:48:32.158 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.163+0000 7fb872883640 1 -- 10.20.193.58:0/3797420698 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb86c0576d0 msgr2=0x7fb86c058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:32.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.163+0000 7fb872883640 1 --2- 10.20.193.58:0/3797420698 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb86c0576d0 0x7fb86c058200 secure :-1 s=READY pgs=88 gs=3 cs=0 l=1 c_cookie=2476723993654080237 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb868005820 tx=0x7fb868030300 comp rx=0 tx=0).stop 2026-02-23T06:48:32.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.163+0000 7fb872883640 1 -- 10.20.193.58:0/3797420698 shutdown_connections 2026-02-23T06:48:32.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.163+0000 7fb872883640 1 --2- 10.20.193.58:0/3797420698 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb86c0576d0 0x7fb86c058200 unknown :-1 s=CLOSED pgs=88 gs=3 cs=0 l=1 c_cookie=2476723993654080237 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:32.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.163+0000 7fb872883640 1 -- 10.20.193.58:0/3797420698 >> 10.20.193.58:0/3797420698 conn(0x7fb86c0b3c20 msgr2=0x7fb86c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:48:32.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.163+0000 7fb872883640 1 -- 10.20.193.58:0/3797420698 shutdown_connections 2026-02-23T06:48:32.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.163+0000 7fb872883640 1 -- 10.20.193.58:0/3797420698 wait complete. 2026-02-23T06:48:32.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.164+0000 7fb872883640 1 Processor -- start 2026-02-23T06:48:32.162 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.164+0000 7fb872883640 1 -- start start 2026-02-23T06:48:32.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.165+0000 7fb872883640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb86c056960 0x7fb86c13c6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:32.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.165+0000 7fb872883640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb86c0576d0 0x7fb86c11ff00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:32.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.165+0000 7fb872883640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb86c15c4b0 0x7fb86c13ba50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:32.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.165+0000 7fb872883640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb86c13bf90 con 0x7fb86c15c4b0 2026-02-23T06:48:32.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.165+0000 7fb872883640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb86c11d800 con 0x7fb86c0576d0 2026-02-23T06:48:32.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.165+0000 7fb872883640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb86c15a470 con 0x7fb86c056960 2026-02-23T06:48:32.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.165+0000 7fb871881640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb86c056960 msgr2=0x7fb86c13c6f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:48:32.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.165+0000 7fb871881640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb86c056960 0x7fb86c13c6f0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:48:32.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.165+0000 7fb872082640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb86c15c4b0 0x7fb86c13ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:32.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.165+0000 7fb871080640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb86c0576d0 0x7fb86c11ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:32.163 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.165+0000 7fb872082640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb86c15c4b0 0x7fb86c13ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:59614/0 (socket says 10.20.193.58:59614) 2026-02-23T06:48:32.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.165+0000 7fb872082640 1 -- 10.20.193.58:0/3625592651 learned_addr learned my addr 10.20.193.58:0/3625592651 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:48:32.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.165+0000 7fb872082640 1 -- 10.20.193.58:0/3625592651 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb86c056960 msgr2=0x7fb86c13c6f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:48:32.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.165+0000 7fb872082640 1 --2- 10.20.193.58:0/3625592651 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb86c056960 0x7fb86c13c6f0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:32.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.165+0000 7fb872082640 1 -- 10.20.193.58:0/3625592651 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb86c0576d0 msgr2=0x7fb86c11ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:32.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.165+0000 7fb872082640 1 --2- 10.20.193.58:0/3625592651 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb86c0576d0 0x7fb86c11ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:32.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.165+0000 7fb872082640 1 -- 10.20.193.58:0/3625592651 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb86800a590 con 0x7fb86c15c4b0 2026-02-23T06:48:32.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.166+0000 7fb872082640 1 --2- 10.20.193.58:0/3625592651 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb86c15c4b0 0x7fb86c13ba50 secure :-1 s=READY pgs=89 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb868003e60 tx=0x7fb868003e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:48:32.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.166+0000 7fb85a7fc640 1 -- 10.20.193.58:0/3625592651 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb86803e070 con 0x7fb86c15c4b0 2026-02-23T06:48:32.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.166+0000 7fb85a7fc640 1 -- 10.20.193.58:0/3625592651 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb868039960 con 0x7fb86c15c4b0 2026-02-23T06:48:32.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.166+0000 7fb85a7fc640 1 -- 10.20.193.58:0/3625592651 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb868039d10 con 0x7fb86c15c4b0 2026-02-23T06:48:32.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.166+0000 7fb872883640 1 -- 10.20.193.58:0/3625592651 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb86c15a930 con 0x7fb86c15c4b0 2026-02-23T06:48:32.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.166+0000 7fb872883640 1 -- 10.20.193.58:0/3625592651 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb86c161f50 con 0x7fb86c15c4b0 2026-02-23T06:48:32.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.166+0000 7fb872883640 1 --2- 10.20.193.58:0/3625592651 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb86c15ba90 0x7fb86c11f5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:32.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.166+0000 7fb872883640 1 -- 10.20.193.58:0/3625592651 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb86c059690 con 0x7fb86c15ba90 2026-02-23T06:48:32.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.167+0000 7fb871881640 1 --2- 10.20.193.58:0/3625592651 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb86c15ba90 0x7fb86c11f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:32.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.167+0000 7fb871881640 1 -- 10.20.193.58:0/3625592651 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb86c0593b0 con 0x7fb86c15ba90 2026-02-23T06:48:32.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.167+0000 7fb871881640 1 --2- 10.20.193.58:0/3625592651 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb86c15ba90 0x7fb86c11f5d0 secure :-1 s=READY pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb85c003760 tx=0x7fb85c00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:48:32.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.167+0000 7fb85a7fc640 1 -- 10.20.193.58:0/3625592651 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb85c005d70 con 0x7fb86c15ba90 2026-02-23T06:48:32.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.168+0000 7fb85a7fc640 1 -- 10.20.193.58:0/3625592651 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fb85c0070d0 con 0x7fb86c15ba90 2026-02-23T06:48:32.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.168+0000 7fb85a7fc640 1 -- 10.20.193.58:0/3625592651 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb86c15ba90 msgr2=0x7fb86c11f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:32.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.168+0000 7fb85a7fc640 1 --2- 10.20.193.58:0/3625592651 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb86c15ba90 0x7fb86c11f5d0 secure :-1 s=READY pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb85c003760 tx=0x7fb85c00c8d0 comp rx=0 tx=0).stop 2026-02-23T06:48:32.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.168+0000 7fb85a7fc640 1 -- 10.20.193.58:0/3625592651 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb86c15ba90 msgr2=0x7fb86c11f5d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:48:32.166 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.168+0000 7fb85a7fc640 1 --2- 10.20.193.58:0/3625592651 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb86c15ba90 0x7fb86c11f5d0 unknown :-1 s=CLOSED pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:48:32.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.168+0000 7fb85a7fc640 1 -- 10.20.193.58:0/3625592651 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fb86804c440 con 0x7fb86c15c4b0 2026-02-23T06:48:32.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.169+0000 7fb85a7fc640 1 --2- 10.20.193.58:0/3625592651 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb83c07a3c0 0x7fb83c09a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:32.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.169+0000 7fb85a7fc640 1 -- 10.20.193.58:0/3625592651 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fb8680c3b70 con 0x7fb86c15c4b0 2026-02-23T06:48:32.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.169+0000 7fb871881640 1 --2- 10.20.193.58:0/3625592651 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb83c07a3c0 0x7fb83c09a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:32.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.170+0000 7fb871881640 1 --2- 10.20.193.58:0/3625592651 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb83c07a3c0 0x7fb83c09a870 secure :-1 s=READY pgs=564 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb85c00ce00 tx=0x7fb85c00a000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:48:32.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.171+0000 7fb872883640 1 --2- 10.20.193.58:0/3625592651 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb86c14b530 0x7fb86c14b900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:48:32.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.171+0000 7fb872883640 1 -- 10.20.193.58:0/3625592651 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb86c058070 con 0x7fb86c14b530 2026-02-23T06:48:32.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.171+0000 7fb871080640 1 --2- 10.20.193.58:0/3625592651 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb86c14b530 0x7fb86c14b900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:48:32.174 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.179+0000 7fb871080640 1 -- 10.20.193.58:0/3625592651 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb86c162ca0 con 0x7fb86c14b530 2026-02-23T06:48:32.175 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.179+0000 7fb871080640 1 --2- 10.20.193.58:0/3625592651 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb86c14b530 0x7fb86c14b900 secure :-1 s=READY pgs=148 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb86c160ba0 tx=0x7fb86000eb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:48:32.175 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.179+0000 7fb85a7fc640 1 -- 10.20.193.58:0/3625592651 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb860019070 con 0x7fb86c14b530 2026-02-23T06:48:32.175 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.179+0000 7fb85a7fc640 1 -- 10.20.193.58:0/3625592651 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5545 (secure 0 0 0) 0x7fb860006ab0 con 0x7fb86c14b530 2026-02-23T06:48:32.175 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.179+0000 7fb85a7fc640 1 -- 10.20.193.58:0/3625592651 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb86c14b530 msgr2=0x7fb86c14b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:32.175 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.179+0000 7fb85a7fc640 1 --2- 10.20.193.58:0/3625592651 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb86c14b530 0x7fb86c14b900 secure :-1 s=READY pgs=148 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb86c160ba0 tx=0x7fb86000eb30 comp rx=0 tx=0).stop 2026-02-23T06:48:32.175 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.179+0000 7fb85a7fc640 1 -- 10.20.193.58:0/3625592651 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb86c14b530 msgr2=0x7fb86c14b900 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:48:32.176 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.179+0000 7fb85a7fc640 1 --2- 10.20.193.58:0/3625592651 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb86c14b530 0x7fb86c14b900 secure :-1 s=CLOSED pgs=148 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb86c160ba0 tx=0x7fb86000eb30 comp rx=0 tx=0).stop 2026-02-23T06:48:32.176 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:48:32.176 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:48:32.176 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:48:32.176 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:48:32.176 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 238, 2026-02-23T06:48:32.177 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 198538, 2026-02-23T06:48:32.177 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:48:32.177 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:48:32.177 INFO:teuthology.orchestra.run.trial058.stdout: 1 2026-02-23T06:48:32.177 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:32.177 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:48:32.177 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:48:32.177 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:48:32.177 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:48:32.177 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:48:32.177 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:48:32.178 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:48:32.178 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:48:32.178 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:48:32.178 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:48:32.178 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:48:32.178 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:48:32.178 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:48:32.178 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:48:32.178 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:48:32.178 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:48:32.178 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:48:32.178 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:32.179 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:48:32.179 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:48:32.179 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:48:32.179 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:48:32.179 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:48:32.179 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:48:32.179 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:48:32.179 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:48:32.179 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:48:32.179 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:48:32.179 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:48:32.180 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:48:32.180 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:48:32.180 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:48:32.180 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:48:32.180 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:32.180 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:32.180 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:48:32.180 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:48:32.180 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:48:32.180 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:48:32.180 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:48:32.180 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:48:32.181 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:48:32.181 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:48:32.181 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:48:32.181 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:48:32.181 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:48:32.181 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:48:32.181 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:48:32.181 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:48:32.181 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:48:32.181 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:48:32.181 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:48:32.181 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:48:32.182 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:48:32.182 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:48:32.182 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:48:32.182 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:48:32.182 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:48:32.182 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:48:32.182 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:48:32.182 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:48:32.182 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:48:32.182 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:48:32.182 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:48:32.182 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:48:32.182 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:32.183 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:48:32.183 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:32.183 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:48:32.183 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.183 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:48:32.183 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:48:32.183 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:48:32.183 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:48:32.183 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.183 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:48:32.183 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:48:32.183 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:32.184 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:32.184 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.184 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:48:32.184 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:48:32.184 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:32.184 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:32.184 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:32.184 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:32.184 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:48:32.184 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:48:32.184 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:48:32.184 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:48:32.185 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:48:32.185 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:48:32.185 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:32.185 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.185 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:48:32.185 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:48:32.185 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:48:32.185 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:48:32.185 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.185 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:48:32.185 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:48:32.185 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:32.185 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:32.186 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.186 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:48:32.186 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:48:32.186 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:32.186 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:32.186 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:32.186 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:32.186 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:48:32.186 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:48:32.187 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:48:32.187 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:48:32.187 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:48:32.187 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:48:32.187 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:32.187 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.187 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:48:32.187 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:48:32.187 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:48:32.187 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:48:32.187 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.187 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:48:32.188 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:48:32.188 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:32.188 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:32.188 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.188 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:48:32.188 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:48:32.188 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:48:32.188 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:32.188 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:32.188 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:32.188 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:48:32.188 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:48:32.189 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:48:32.189 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:48:32.189 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:48:32.189 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:48:32.189 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:32.189 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:32.189 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:32.189 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:48:32.189 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:48:32.189 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.189 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:48:32.189 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:48:32.189 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:48:32.190 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:32.190 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:32.190 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:48:32.190 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.190 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:48:32.190 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:48:32.190 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:48:32.190 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:32.190 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:32.190 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:48:32.190 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.190 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:48:32.191 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:48:32.191 INFO:teuthology.orchestra.run.trial058.stdout: "num": 7 2026-02-23T06:48:32.191 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:32.191 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:32.191 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:48:32.191 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.191 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:48:32.191 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:48:32.191 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:48:32.191 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:32.191 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.191 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:48:32.191 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:48:32.192 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:48:32.192 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:32.192 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:48:32.192 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:48:32.192 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:48:32.192 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:48:32.192 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:48:32.192 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:48:32.192 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:48:32.192 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:48:32.192 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:48:32.193 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:48:32.193 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:48:32.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.180+0000 7fb872883640 1 -- 10.20.193.58:0/3625592651 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb83c07a3c0 msgr2=0x7fb83c09a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:32.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.180+0000 7fb872883640 1 --2- 10.20.193.58:0/3625592651 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb83c07a3c0 0x7fb83c09a870 secure :-1 s=READY pgs=564 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb85c00ce00 tx=0x7fb85c00a000 comp rx=0 tx=0).stop 2026-02-23T06:48:32.194 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.180+0000 7fb872883640 1 -- 10.20.193.58:0/3625592651 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb86c15c4b0 msgr2=0x7fb86c13ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:48:32.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.180+0000 7fb872883640 1 --2- 10.20.193.58:0/3625592651 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb86c15c4b0 0x7fb86c13ba50 secure :-1 s=READY pgs=89 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb868003e60 tx=0x7fb868003e90 comp rx=0 tx=0).stop 2026-02-23T06:48:32.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.180+0000 7fb872082640 1 -- 10.20.193.58:0/3625592651 reap_dead start 2026-02-23T06:48:32.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.180+0000 7fb872082640 1 -- 10.20.193.58:0/3625592651 reap_dead start 2026-02-23T06:48:32.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.180+0000 7fb872883640 1 -- 10.20.193.58:0/3625592651 shutdown_connections 2026-02-23T06:48:32.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.180+0000 7fb872883640 1 -- 10.20.193.58:0/3625592651 >> 10.20.193.58:0/3625592651 conn(0x7fb86c0b3c20 msgr2=0x7fb86c0b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:48:32.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.180+0000 7fb872883640 1 -- 10.20.193.58:0/3625592651 shutdown_connections 2026-02-23T06:48:32.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:48:32.180+0000 7fb872883640 1 -- 10.20.193.58:0/3625592651 wait complete. 2026-02-23T06:48:32.196 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:48:32.196 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:48:45.477 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:48:45.481 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:48:52.197 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-23T06:48:52.197 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-23T06:48:52.197 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-23T06:48:52.198 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-23T06:48:52.200 INFO:tasks.ceph.mon.c:Started 2026-02-23T06:48:52.200 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.a 2026-02-23T06:48:52.200 INFO:tasks.mon_thrash:Sending STOP to mon a 2026-02-23T06:48:52.201 INFO:tasks.ceph.mon.a:Sent signal 19 2026-02-23T06:48:52.201 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-23T06:49:07.202 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.a 2026-02-23T06:49:07.203 INFO:tasks.mon_thrash:Sending CONT to mon a 2026-02-23T06:49:07.204 INFO:tasks.ceph.mon.a:Sent signal 18 2026-02-23T06:49:07.204 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:49:07.204 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:49:07.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.331+0000 7fc225592640 1 -- 10.20.193.58:0/1137297522 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc22015d4a0 msgr2=0x7fc2200affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:07.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.331+0000 7fc225592640 1 --2- 10.20.193.58:0/1137297522 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc22015d4a0 0x7fc2200affb0 secure :-1 s=READY pgs=95 gs=3 cs=0 l=1 c_cookie=17739629098288102315 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc20c005e70 tx=0x7fc20c02f290 comp rx=0 tx=0).stop 2026-02-23T06:49:07.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.331+0000 7fc225592640 1 -- 10.20.193.58:0/1137297522 shutdown_connections 2026-02-23T06:49:07.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.331+0000 7fc225592640 1 --2- 10.20.193.58:0/1137297522 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc22015d4a0 0x7fc2200affb0 unknown :-1 s=CLOSED pgs=95 gs=3 cs=0 l=1 c_cookie=17739629098288102315 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:07.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.331+0000 7fc225592640 1 -- 10.20.193.58:0/1137297522 >> 10.20.193.58:0/1137297522 conn(0x7fc2200b3c20 msgr2=0x7fc2200b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:49:07.326 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.331+0000 7fc225592640 1 -- 10.20.193.58:0/1137297522 shutdown_connections 2026-02-23T06:49:07.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.331+0000 7fc225592640 1 -- 10.20.193.58:0/1137297522 wait complete. 2026-02-23T06:49:07.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.333+0000 7fc225592640 1 Processor -- start 2026-02-23T06:49:07.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.333+0000 7fc225592640 1 -- start start 2026-02-23T06:49:07.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.333+0000 7fc225592640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc2200b6690 0x7fc2201605f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:07.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.333+0000 7fc225592640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc22015d4a0 0x7fc22013beb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:07.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.334+0000 7fc225592640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc22015d870 0x7fc22015ad90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:07.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.334+0000 7fc225592640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc2201fec90 con 0x7fc22015d870 2026-02-23T06:49:07.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.334+0000 7fc225592640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc220201b00 con 0x7fc22015d4a0 2026-02-23T06:49:07.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.334+0000 7fc225592640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc22013c3f0 con 0x7fc2200b6690 2026-02-23T06:49:07.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.334+0000 7fc224d91640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc22015d870 0x7fc22015ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:07.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.334+0000 7fc21f7fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc22015d4a0 0x7fc22013beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:07.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.334+0000 7fc224d91640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc22015d870 0x7fc22015ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:52734/0 (socket says 10.20.193.58:52734) 2026-02-23T06:49:07.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.334+0000 7fc224d91640 1 -- 10.20.193.58:0/18878450 learned_addr learned my addr 10.20.193.58:0/18878450 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:49:07.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.334+0000 7fc21ffff640 1 --2- 10.20.193.58:0/18878450 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc2200b6690 0x7fc2201605f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:07.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.334+0000 7fc224d91640 1 -- 10.20.193.58:0/18878450 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc2200b6690 msgr2=0x7fc2201605f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:07.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.334+0000 7fc224d91640 1 --2- 10.20.193.58:0/18878450 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc2200b6690 0x7fc2201605f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:07.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.334+0000 7fc224d91640 1 -- 10.20.193.58:0/18878450 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc22015d4a0 msgr2=0x7fc22013beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:07.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.334+0000 7fc224d91640 1 --2- 10.20.193.58:0/18878450 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc22015d4a0 0x7fc22013beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:07.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.334+0000 7fc224d91640 1 -- 10.20.193.58:0/18878450 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc20c009570 con 0x7fc22015d870 2026-02-23T06:49:07.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.334+0000 7fc21ffff640 1 --2- 10.20.193.58:0/18878450 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc2200b6690 0x7fc2201605f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:49:07.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.334+0000 7fc224d91640 1 --2- 10.20.193.58:0/18878450 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc22015d870 0x7fc22015ad90 secure :-1 s=READY pgs=96 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc21400d730 tx=0x7fc21400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:07.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.334+0000 7fc21cff9640 1 -- 10.20.193.58:0/18878450 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc214007b90 con 0x7fc22015d870 2026-02-23T06:49:07.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.334+0000 7fc21cff9640 1 -- 10.20.193.58:0/18878450 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc214007de0 con 0x7fc22015d870 2026-02-23T06:49:07.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.334+0000 7fc225592640 1 -- 10.20.193.58:0/18878450 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2201fe9b0 con 0x7fc22015d870 2026-02-23T06:49:07.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.334+0000 7fc21cff9640 1 -- 10.20.193.58:0/18878450 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc214006280 con 0x7fc22015d870 2026-02-23T06:49:07.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.334+0000 7fc225592640 1 -- 10.20.193.58:0/18878450 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc220201790 con 0x7fc22015d870 2026-02-23T06:49:07.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.335+0000 7fc225592640 1 -- 10.20.193.58:0/18878450 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc220201c90 con 0x7fc22015d870 2026-02-23T06:49:07.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.336+0000 7fc21cff9640 1 -- 10.20.193.58:0/18878450 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fc21401a030 con 0x7fc22015d870 2026-02-23T06:49:07.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.337+0000 7fc21cff9640 1 --2- 10.20.193.58:0/18878450 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc1f007a6b0 0x7fc1f009ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:07.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.337+0000 7fc21cff9640 1 -- 10.20.193.58:0/18878450 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fc21409dcc0 con 0x7fc22015d870 2026-02-23T06:49:07.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.337+0000 7fc21ffff640 1 --2- 10.20.193.58:0/18878450 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc1f007a6b0 0x7fc1f009ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:07.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.338+0000 7fc21ffff640 1 --2- 10.20.193.58:0/18878450 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc1f007a6b0 0x7fc1f009ab60 secure :-1 s=READY pgs=566 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc20c0098a0 tx=0x7fc20c031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:07.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.339+0000 7fc21cff9640 1 -- 10.20.193.58:0/18878450 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fc214060ef0 con 0x7fc22015d870 2026-02-23T06:49:07.486 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.492+0000 7fc225592640 1 -- 10.20.193.58:0/18878450 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc2200ae8c0 con 0x7fc22015d870 2026-02-23T06:49:07.487 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.492+0000 7fc21cff9640 1 -- 10.20.193.58:0/18878450 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7fc214064010 con 0x7fc22015d870 2026-02-23T06:49:07.487 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":242,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:49:07.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.493+0000 7fc225592640 1 -- 10.20.193.58:0/18878450 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc1f007a6b0 msgr2=0x7fc1f009ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:07.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.493+0000 7fc225592640 1 --2- 10.20.193.58:0/18878450 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc1f007a6b0 0x7fc1f009ab60 secure :-1 s=READY pgs=566 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc20c0098a0 tx=0x7fc20c031040 comp rx=0 tx=0).stop 2026-02-23T06:49:07.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.493+0000 7fc225592640 1 -- 10.20.193.58:0/18878450 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc22015d870 msgr2=0x7fc22015ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:07.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.493+0000 7fc225592640 1 --2- 10.20.193.58:0/18878450 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc22015d870 0x7fc22015ad90 secure :-1 s=READY pgs=96 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc21400d730 tx=0x7fc21400dc00 comp rx=0 tx=0).stop 2026-02-23T06:49:07.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.493+0000 7fc225592640 1 -- 10.20.193.58:0/18878450 shutdown_connections 2026-02-23T06:49:07.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.493+0000 7fc225592640 1 --2- 10.20.193.58:0/18878450 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc1f007a6b0 0x7fc1f009ab60 unknown :-1 s=CLOSED pgs=566 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:07.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.493+0000 7fc225592640 1 --2- 10.20.193.58:0/18878450 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc22015d870 0x7fc22015ad90 unknown :-1 s=CLOSED pgs=96 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:07.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.493+0000 7fc225592640 1 --2- 10.20.193.58:0/18878450 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc22015d4a0 0x7fc22013beb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:07.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.493+0000 7fc225592640 1 --2- 10.20.193.58:0/18878450 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc2200b6690 0x7fc2201605f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:07.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.493+0000 7fc225592640 1 -- 10.20.193.58:0/18878450 >> 10.20.193.58:0/18878450 conn(0x7fc2200b3c20 msgr2=0x7fc2200b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:49:07.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.493+0000 7fc225592640 1 -- 10.20.193.58:0/18878450 shutdown_connections 2026-02-23T06:49:07.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.493+0000 7fc225592640 1 -- 10.20.193.58:0/18878450 wait complete. 2026-02-23T06:49:07.500 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:49:07.500 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:49:07.500 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:49:07.623 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.629+0000 7f7b2bfff640 1 -- 10.20.193.58:0/3955233508 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7b18003b20 msgr2=0x7f7b18003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:07.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.629+0000 7f7b2bfff640 1 --2- 10.20.193.58:0/3955233508 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7b18003b20 0x7f7b18003f30 secure :-1 s=READY pgs=153 gs=4 cs=0 l=1 c_cookie=13185541507344156491 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b20009b40 tx=0x7f7b2002fc30 comp rx=0 tx=0).stop 2026-02-23T06:49:07.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.629+0000 7f7b2bfff640 1 -- 10.20.193.58:0/3955233508 shutdown_connections 2026-02-23T06:49:07.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.629+0000 7f7b2bfff640 1 --2- 10.20.193.58:0/3955233508 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7b18003b20 0x7f7b18003f30 unknown :-1 s=CLOSED pgs=153 gs=4 cs=0 l=1 c_cookie=13185541507344156491 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:07.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.629+0000 7f7b2bfff640 1 -- 10.20.193.58:0/3955233508 >> 10.20.193.58:0/3955233508 conn(0x7f7b2c0b3c20 msgr2=0x7f7b2c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:49:07.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.629+0000 7f7b2bfff640 1 -- 10.20.193.58:0/3955233508 shutdown_connections 2026-02-23T06:49:07.624 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.629+0000 7f7b2bfff640 1 -- 10.20.193.58:0/3955233508 wait complete. 2026-02-23T06:49:07.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.630+0000 7f7b2bfff640 1 Processor -- start 2026-02-23T06:49:07.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.630+0000 7f7b2bfff640 1 -- start start 2026-02-23T06:49:07.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.631+0000 7f7b2bfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b18003b20 0x7f7b2c0afeb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:07.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.631+0000 7f7b2bfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7b2c1fdf80 0x7f7b2c1fe7f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:07.627 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.631+0000 7f7b2bfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7b2c0aecc0 0x7f7b2c162330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:07.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.631+0000 7f7b2bfff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c151e90 con 0x7f7b18003b20 2026-02-23T06:49:07.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.631+0000 7f7b2bfff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c0b0940 con 0x7f7b2c1fdf80 2026-02-23T06:49:07.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.631+0000 7f7b2bfff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f7b2c0b1e00 con 0x7f7b2c0aecc0 2026-02-23T06:49:07.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.631+0000 7f7b2affd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b18003b20 0x7f7b2c0afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:07.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.631+0000 7f7b2affd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b18003b20 0x7f7b2c0afeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:52748/0 (socket says 10.20.193.58:52748) 2026-02-23T06:49:07.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.631+0000 7f7b2affd640 1 -- 10.20.193.58:0/4084762082 learned_addr learned my addr 10.20.193.58:0/4084762082 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:49:07.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.631+0000 7f7b2a7fc640 1 --2- 10.20.193.58:0/4084762082 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7b2c1fdf80 0x7f7b2c1fe7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:07.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.631+0000 7f7b2b7fe640 1 --2- 10.20.193.58:0/4084762082 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7b2c0aecc0 0x7f7b2c162330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:07.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.632+0000 7f7b2affd640 1 -- 10.20.193.58:0/4084762082 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7b2c0aecc0 msgr2=0x7f7b2c162330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:07.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.632+0000 7f7b2affd640 1 --2- 10.20.193.58:0/4084762082 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7b2c0aecc0 0x7f7b2c162330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:07.628 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.632+0000 7f7b2affd640 1 -- 10.20.193.58:0/4084762082 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7b2c1fdf80 msgr2=0x7f7b2c1fe7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:07.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.632+0000 7f7b2affd640 1 --2- 10.20.193.58:0/4084762082 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f7b2c1fdf80 0x7f7b2c1fe7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:07.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.632+0000 7f7b2affd640 1 -- 10.20.193.58:0/4084762082 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2c0b1880 con 0x7f7b18003b20 2026-02-23T06:49:07.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.632+0000 7f7b2affd640 1 --2- 10.20.193.58:0/4084762082 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b18003b20 0x7f7b2c0afeb0 secure :-1 s=READY pgs=98 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b20004740 tx=0x7f7b20005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:07.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.632+0000 7f7b0b7fe640 1 -- 10.20.193.58:0/4084762082 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7b20042070 con 0x7f7b18003b20 2026-02-23T06:49:07.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.632+0000 7f7b0b7fe640 1 -- 10.20.193.58:0/4084762082 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b20004a60 con 0x7f7b18003b20 2026-02-23T06:49:07.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.632+0000 7f7b0b7fe640 1 -- 10.20.193.58:0/4084762082 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7b200044f0 con 0x7f7b18003b20 2026-02-23T06:49:07.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.632+0000 7f7b2bfff640 1 -- 10.20.193.58:0/4084762082 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b2c0b1b20 con 0x7f7b18003b20 2026-02-23T06:49:07.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.632+0000 7f7b2bfff640 1 -- 10.20.193.58:0/4084762082 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b2c1fd780 con 0x7f7b18003b20 2026-02-23T06:49:07.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.633+0000 7f7b097fa640 1 --2- 10.20.193.58:0/4084762082 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b2c0af090 0x7f7b2c2008f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:07.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.633+0000 7f7b097fa640 1 -- 10.20.193.58:0/4084762082 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c05d9c0 con 0x7f7b2c0af090 2026-02-23T06:49:07.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.633+0000 7f7b2a7fc640 1 --2- 10.20.193.58:0/4084762082 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b2c0af090 0x7f7b2c2008f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:07.629 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.633+0000 7f7b2a7fc640 1 -- 10.20.193.58:0/4084762082 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b2c15c410 con 0x7f7b2c0af090 2026-02-23T06:49:07.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.633+0000 7f7b2a7fc640 1 --2- 10.20.193.58:0/4084762082 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b2c0af090 0x7f7b2c2008f0 secure :-1 s=READY pgs=99 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b140028e0 tx=0x7f7b14006760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:07.630 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.633+0000 7f7b0b7fe640 1 -- 10.20.193.58:0/4084762082 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7b14003ea0 con 0x7f7b2c0af090 2026-02-23T06:49:07.632 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.633+0000 7f7b0b7fe640 1 -- 10.20.193.58:0/4084762082 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f7b14012660 con 0x7f7b2c0af090 2026-02-23T06:49:07.632 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.633+0000 7f7b0b7fe640 1 -- 10.20.193.58:0/4084762082 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b2c0af090 msgr2=0x7f7b2c2008f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:07.632 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.633+0000 7f7b0b7fe640 1 --2- 10.20.193.58:0/4084762082 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b2c0af090 0x7f7b2c2008f0 secure :-1 s=READY pgs=99 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b140028e0 tx=0x7f7b14006760 comp rx=0 tx=0).stop 2026-02-23T06:49:07.632 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.634+0000 7f7b0b7fe640 1 -- 10.20.193.58:0/4084762082 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b2c0af090 msgr2=0x7f7b2c2008f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:49:07.632 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.634+0000 7f7b0b7fe640 1 --2- 10.20.193.58:0/4084762082 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b2c0af090 0x7f7b2c2008f0 secure :-1 s=CLOSED pgs=99 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b140028e0 tx=0x7f7b14006760 comp rx=0 tx=0).stop 2026-02-23T06:49:07.632 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.634+0000 7f7b0b7fe640 1 -- 10.20.193.58:0/4084762082 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f7b20039030 con 0x7f7b18003b20 2026-02-23T06:49:07.632 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.635+0000 7f7b0b7fe640 1 --2- 10.20.193.58:0/4084762082 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7af807a370 0x7f7af809a820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:07.632 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.635+0000 7f7b0b7fe640 1 -- 10.20.193.58:0/4084762082 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f7b200c25f0 con 0x7f7b18003b20 2026-02-23T06:49:07.632 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.635+0000 7f7b2a7fc640 1 --2- 10.20.193.58:0/4084762082 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7af807a370 0x7f7af809a820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:07.632 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.636+0000 7f7b2a7fc640 1 --2- 10.20.193.58:0/4084762082 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7af807a370 0x7f7af809a820 secure :-1 s=READY pgs=567 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b140023d0 tx=0x7f7b1400f000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:07.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.637+0000 7f7b097fa640 1 --2- 10.20.193.58:0/4084762082 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b2c1fd990 0x7f7b2c200e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:07.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.637+0000 7f7b097fa640 1 -- 10.20.193.58:0/4084762082 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c1fd300 con 0x7f7b2c1fd990 2026-02-23T06:49:07.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.637+0000 7f7b2b7fe640 1 --2- 10.20.193.58:0/4084762082 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b2c1fd990 0x7f7b2c200e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:07.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.637+0000 7f7b2b7fe640 1 -- 10.20.193.58:0/4084762082 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7b2c0b5f60 con 0x7f7b2c1fd990 2026-02-23T06:49:07.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.637+0000 7f7b2b7fe640 1 --2- 10.20.193.58:0/4084762082 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b2c1fd990 0x7f7b2c200e30 secure :-1 s=READY pgs=100 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b2c0b5230 tx=0x7f7b1c0119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:07.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.638+0000 7f7b0b7fe640 1 -- 10.20.193.58:0/4084762082 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7b1c0076f0 con 0x7f7b2c1fd990 2026-02-23T06:49:07.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.638+0000 7f7b0b7fe640 1 -- 10.20.193.58:0/4084762082 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5415 (secure 0 0 0) 0x7f7b1c013440 con 0x7f7b2c1fd990 2026-02-23T06:49:07.633 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.638+0000 7f7b0b7fe640 1 -- 10.20.193.58:0/4084762082 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b2c1fd990 msgr2=0x7f7b2c200e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:07.633 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:49:07.634 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:49:07.634 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:49:07.634 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:49:07.634 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 242, 2026-02-23T06:49:07.634 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 118956, 2026-02-23T06:49:07.634 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:49:07.634 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:49:07.635 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:49:07.635 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:49:07.635 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:07.635 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:49:07.635 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:49:07.635 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:49:07.635 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:49:07.635 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:49:07.635 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:49:07.635 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:49:07.636 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:49:07.636 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:49:07.636 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:49:07.636 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:49:07.636 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:49:07.636 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:49:07.636 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:49:07.636 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:49:07.636 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:49:07.636 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:49:07.636 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:07.636 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:49:07.637 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:49:07.637 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:49:07.637 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:49:07.637 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:49:07.637 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:49:07.637 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:49:07.637 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:49:07.637 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:49:07.637 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:49:07.637 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:49:07.637 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:49:07.637 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:49:07.637 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:49:07.638 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:49:07.638 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:07.638 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.638 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:49:07.638 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:49:07.638 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:49:07.638 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:49:07.638 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:49:07.638 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:49:07.638 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:49:07.638 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:49:07.639 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:49:07.639 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:49:07.639 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:49:07.639 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:49:07.639 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:49:07.639 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:49:07.639 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:49:07.639 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:49:07.639 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:49:07.639 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:49:07.639 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:49:07.639 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:49:07.640 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:49:07.640 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:49:07.640 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:49:07.640 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:49:07.640 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:49:07.640 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:49:07.640 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:49:07.640 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:49:07.640 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:49:07.640 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:49:07.640 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:07.640 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:49:07.640 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.641 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:49:07.641 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.641 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:49:07.641 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:49:07.641 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:49:07.641 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:49:07.641 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.641 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:49:07.641 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:49:07.641 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:07.641 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.641 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.642 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:49:07.642 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:49:07.642 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:07.642 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:07.642 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:07.642 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.642 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:49:07.642 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:49:07.642 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:49:07.642 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:49:07.642 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:49:07.642 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:49:07.642 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.643 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.643 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:49:07.643 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:49:07.643 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:49:07.643 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:49:07.643 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.643 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:49:07.643 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:49:07.643 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:07.643 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.643 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.643 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:49:07.644 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:49:07.644 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:07.644 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:07.644 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:07.644 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.644 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:49:07.644 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:49:07.644 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:49:07.644 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:49:07.644 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:49:07.644 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:49:07.644 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.644 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.645 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:49:07.645 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:49:07.645 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:49:07.645 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:49:07.645 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.645 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:49:07.645 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:49:07.645 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:07.645 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.645 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.645 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:49:07.645 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:49:07.645 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:07.646 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:07.646 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:07.646 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.646 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:49:07.646 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:49:07.646 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:49:07.646 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:49:07.646 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:49:07.646 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:49:07.646 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:07.646 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:07.646 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.647 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:49:07.647 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:49:07.647 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.647 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:07.647 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:07.647 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:49:07.647 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:07.647 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:07.647 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:49:07.647 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.647 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:07.647 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:07.647 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:49:07.648 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:07.648 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:07.648 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:49:07.648 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.648 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:07.648 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:07.648 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:49:07.648 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:07.648 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:07.648 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:49:07.648 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.648 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:07.649 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:07.649 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:49:07.649 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:07.649 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:07.649 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:49:07.649 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.649 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:07.649 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:07.649 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:49:07.649 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:07.649 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:07.649 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.649 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:49:07.650 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:49:07.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.638+0000 7f7b0b7fe640 1 --2- 10.20.193.58:0/4084762082 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b2c1fd990 0x7f7b2c200e30 secure :-1 s=READY pgs=100 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b2c0b5230 tx=0x7f7b1c0119d0 comp rx=0 tx=0).stop 2026-02-23T06:49:07.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.638+0000 7f7b0b7fe640 1 -- 10.20.193.58:0/4084762082 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b2c1fd990 msgr2=0x7f7b2c200e30 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:49:07.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.638+0000 7f7b0b7fe640 1 --2- 10.20.193.58:0/4084762082 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b2c1fd990 0x7f7b2c200e30 secure :-1 s=CLOSED pgs=100 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b2c0b5230 tx=0x7f7b1c0119d0 comp rx=0 tx=0).stop 2026-02-23T06:49:07.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.638+0000 7f7b097fa640 1 -- 10.20.193.58:0/4084762082 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7af807a370 msgr2=0x7f7af809a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:07.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.638+0000 7f7b097fa640 1 --2- 10.20.193.58:0/4084762082 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f7af807a370 0x7f7af809a820 secure :-1 s=READY pgs=567 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b140023d0 tx=0x7f7b1400f000 comp rx=0 tx=0).stop 2026-02-23T06:49:07.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.638+0000 7f7b097fa640 1 -- 10.20.193.58:0/4084762082 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b18003b20 msgr2=0x7f7b2c0afeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:07.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.638+0000 7f7b097fa640 1 --2- 10.20.193.58:0/4084762082 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f7b18003b20 0x7f7b2c0afeb0 secure :-1 s=READY pgs=98 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b20004740 tx=0x7f7b20005590 comp rx=0 tx=0).stop 2026-02-23T06:49:07.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.638+0000 7f7b2b7fe640 1 -- 10.20.193.58:0/4084762082 reap_dead start 2026-02-23T06:49:07.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.638+0000 7f7b2b7fe640 1 -- 10.20.193.58:0/4084762082 reap_dead start 2026-02-23T06:49:07.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.638+0000 7f7b097fa640 1 -- 10.20.193.58:0/4084762082 shutdown_connections 2026-02-23T06:49:07.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.638+0000 7f7b097fa640 1 -- 10.20.193.58:0/4084762082 >> 10.20.193.58:0/4084762082 conn(0x7f7b2c0b3c20 msgr2=0x7f7b2c1598a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:49:07.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.638+0000 7f7b097fa640 1 -- 10.20.193.58:0/4084762082 shutdown_connections 2026-02-23T06:49:07.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.638+0000 7f7b097fa640 1 -- 10.20.193.58:0/4084762082 wait complete. 2026-02-23T06:49:07.654 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:49:07.654 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:49:07.654 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:49:07.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.781+0000 7f65a891c640 1 -- 10.20.193.58:0/2407086656 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f65a4056550 msgr2=0x7f65a405ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:07.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.781+0000 7f65a891c640 1 --2- 10.20.193.58:0/2407086656 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f65a4056550 0x7f65a405ce30 secure :-1 s=READY pgs=6 gs=3 cs=0 l=1 c_cookie=13567805044858367969 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6594009950 tx=0x7f659402f2b0 comp rx=0 tx=0).stop 2026-02-23T06:49:07.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.781+0000 7f65a891c640 1 -- 10.20.193.58:0/2407086656 shutdown_connections 2026-02-23T06:49:07.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.781+0000 7f65a891c640 1 --2- 10.20.193.58:0/2407086656 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f65a4056550 0x7f65a405ce30 unknown :-1 s=CLOSED pgs=6 gs=3 cs=0 l=1 c_cookie=13567805044858367969 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:07.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.781+0000 7f65a891c640 1 -- 10.20.193.58:0/2407086656 >> 10.20.193.58:0/2407086656 conn(0x7f65a40b3c20 msgr2=0x7f65a40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:49:07.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.781+0000 7f65a891c640 1 -- 10.20.193.58:0/2407086656 shutdown_connections 2026-02-23T06:49:07.776 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.781+0000 7f65a891c640 1 -- 10.20.193.58:0/2407086656 wait complete. 2026-02-23T06:49:07.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.782+0000 7f65a891c640 1 Processor -- start 2026-02-23T06:49:07.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.782+0000 7f65a891c640 1 -- start start 2026-02-23T06:49:07.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.783+0000 7f65a891c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f65a4056550 0x7f65a40b0230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:07.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.783+0000 7f65a891c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f65a405d370 0x7f65a42013b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:07.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.783+0000 7f65a891c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f65a415c040 0x7f65a42018f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:07.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.783+0000 7f65a891c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f65a4162560 con 0x7f65a415c040 2026-02-23T06:49:07.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.783+0000 7f65a891c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f65a40b0b60 con 0x7f65a4056550 2026-02-23T06:49:07.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.783+0000 7f65a891c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f65a40b0e20 con 0x7f65a405d370 2026-02-23T06:49:07.779 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.783+0000 7f65a37fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f65a4056550 0x7f65a40b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:07.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.783+0000 7f65a2ffd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f65a405d370 0x7f65a42013b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:07.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.783+0000 7f65a3fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f65a415c040 0x7f65a42018f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:07.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.783+0000 7f65a2ffd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f65a405d370 0x7f65a42013b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:55836/0 (socket says 10.20.193.58:55836) 2026-02-23T06:49:07.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.783+0000 7f65a2ffd640 1 -- 10.20.193.58:0/1459796261 learned_addr learned my addr 10.20.193.58:0/1459796261 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:49:07.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.784+0000 7f65a2ffd640 1 -- 10.20.193.58:0/1459796261 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f65a4056550 msgr2=0x7f65a40b0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:07.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.784+0000 7f65a2ffd640 1 --2- 10.20.193.58:0/1459796261 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f65a4056550 0x7f65a40b0230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:07.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.784+0000 7f65a2ffd640 1 -- 10.20.193.58:0/1459796261 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f65a415c040 msgr2=0x7f65a42018f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:07.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.784+0000 7f65a2ffd640 1 --2- 10.20.193.58:0/1459796261 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f65a415c040 0x7f65a42018f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:07.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.784+0000 7f65a2ffd640 1 -- 10.20.193.58:0/1459796261 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6594009570 con 0x7f65a405d370 2026-02-23T06:49:07.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.784+0000 7f65a2ffd640 1 --2- 10.20.193.58:0/1459796261 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f65a405d370 0x7f65a42013b0 secure :-1 s=READY pgs=7 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6594004740 tx=0x7f65940028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:07.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.784+0000 7f657ffff640 1 -- 10.20.193.58:0/1459796261 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f659403d070 con 0x7f65a405d370 2026-02-23T06:49:07.780 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.784+0000 7f657ffff640 1 -- 10.20.193.58:0/1459796261 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6594038470 con 0x7f65a405d370 2026-02-23T06:49:07.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.784+0000 7f657ffff640 1 -- 10.20.193.58:0/1459796261 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6594038860 con 0x7f65a405d370 2026-02-23T06:49:07.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.784+0000 7f65a891c640 1 -- 10.20.193.58:0/1459796261 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65a40b1100 con 0x7f65a405d370 2026-02-23T06:49:07.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.784+0000 7f65a891c640 1 -- 10.20.193.58:0/1459796261 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f65a4160170 con 0x7f65a405d370 2026-02-23T06:49:07.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.785+0000 7f65a891c640 1 --2- 10.20.193.58:0/1459796261 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f65a4162e10 0x7f65a4124eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:07.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.785+0000 7f65a891c640 1 -- 10.20.193.58:0/1459796261 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f65a40609c0 con 0x7f65a4162e10 2026-02-23T06:49:07.781 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.785+0000 7f65a37fe640 1 --2- 10.20.193.58:0/1459796261 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f65a4162e10 0x7f65a4124eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:07.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.785+0000 7f65a37fe640 1 -- 10.20.193.58:0/1459796261 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f65a405d9c0 con 0x7f65a4162e10 2026-02-23T06:49:07.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.785+0000 7f65a37fe640 1 --2- 10.20.193.58:0/1459796261 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f65a4162e10 0x7f65a4124eb0 secure :-1 s=READY pgs=155 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6590002730 tx=0x7f659000eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:07.783 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.786+0000 7f657ffff640 1 -- 10.20.193.58:0/1459796261 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f659000c900 con 0x7f65a4162e10 2026-02-23T06:49:07.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.786+0000 7f657ffff640 1 -- 10.20.193.58:0/1459796261 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f659000ca60 con 0x7f65a4162e10 2026-02-23T06:49:07.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.786+0000 7f657ffff640 1 -- 10.20.193.58:0/1459796261 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f65a4162e10 msgr2=0x7f65a4124eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:07.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.786+0000 7f657ffff640 1 --2- 10.20.193.58:0/1459796261 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f65a4162e10 0x7f65a4124eb0 secure :-1 s=READY pgs=155 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6590002730 tx=0x7f659000eb80 comp rx=0 tx=0).stop 2026-02-23T06:49:07.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.786+0000 7f657ffff640 1 -- 10.20.193.58:0/1459796261 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f65a4162e10 msgr2=0x7f65a4124eb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:49:07.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.786+0000 7f657ffff640 1 --2- 10.20.193.58:0/1459796261 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f65a4162e10 0x7f65a4124eb0 secure :-1 s=CLOSED pgs=155 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6590002730 tx=0x7f659000eb80 comp rx=0 tx=0).stop 2026-02-23T06:49:07.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.786+0000 7f657ffff640 1 -- 10.20.193.58:0/1459796261 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f65940389c0 con 0x7f65a405d370 2026-02-23T06:49:07.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.787+0000 7f657ffff640 1 --2- 10.20.193.58:0/1459796261 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f657407a430 0x7f657409a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:07.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.787+0000 7f657ffff640 1 -- 10.20.193.58:0/1459796261 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f65940c2060 con 0x7f65a405d370 2026-02-23T06:49:07.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.787+0000 7f65a37fe640 1 --2- 10.20.193.58:0/1459796261 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f657407a430 0x7f657409a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:07.784 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.788+0000 7f65a37fe640 1 --2- 10.20.193.58:0/1459796261 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f657407a430 0x7f657409a8e0 secure :-1 s=READY pgs=568 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6590017040 tx=0x7f6590014000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:07.786 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.790+0000 7f65a891c640 1 --2- 10.20.193.58:0/1459796261 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f65a4160390 0x7f65a41253f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:07.786 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.790+0000 7f65a891c640 1 -- 10.20.193.58:0/1459796261 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f65a40b5d90 con 0x7f65a4160390 2026-02-23T06:49:07.786 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.790+0000 7f65a3fff640 1 --2- 10.20.193.58:0/1459796261 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f65a4160390 0x7f65a41253f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:07.786 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.790+0000 7f65a3fff640 1 -- 10.20.193.58:0/1459796261 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f65a4125930 con 0x7f65a4160390 2026-02-23T06:49:07.786 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.791+0000 7f65a3fff640 1 --2- 10.20.193.58:0/1459796261 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f65a4160390 0x7f65a41253f0 secure :-1 s=READY pgs=156 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65980038b0 tx=0x7f659800ff10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:07.786 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.791+0000 7f657ffff640 1 -- 10.20.193.58:0/1459796261 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f659801a070 con 0x7f65a4160390 2026-02-23T06:49:07.786 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.791+0000 7f657ffff640 1 -- 10.20.193.58:0/1459796261 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5556 (secure 0 0 0) 0x7f6598007b90 con 0x7f65a4160390 2026-02-23T06:49:07.786 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.791+0000 7f657ffff640 1 -- 10.20.193.58:0/1459796261 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f65a4160390 msgr2=0x7f65a41253f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:07.787 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:49:07.787 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:49:07.787 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:49:07.787 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:49:07.787 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 242, 2026-02-23T06:49:07.787 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 234148, 2026-02-23T06:49:07.787 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:49:07.787 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:49:07.788 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:49:07.788 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:49:07.788 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:07.788 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:49:07.788 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:49:07.788 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:49:07.788 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:49:07.788 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:49:07.788 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:49:07.788 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:49:07.788 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:49:07.788 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:49:07.789 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:49:07.789 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:49:07.789 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:49:07.789 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:49:07.789 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:49:07.789 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:49:07.789 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:49:07.789 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:49:07.789 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:07.789 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:49:07.789 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:49:07.789 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:49:07.790 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:49:07.790 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:49:07.790 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:49:07.790 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:49:07.790 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:49:07.790 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:49:07.790 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:49:07.790 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:49:07.790 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:49:07.790 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:49:07.790 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:49:07.790 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:49:07.791 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:07.791 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.791 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:49:07.791 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:49:07.791 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:49:07.791 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:49:07.791 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:49:07.791 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:49:07.791 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:49:07.791 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:49:07.791 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:49:07.791 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:49:07.792 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:49:07.792 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:49:07.792 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:49:07.792 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:49:07.792 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:49:07.792 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:49:07.792 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:49:07.792 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:49:07.792 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:49:07.792 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:49:07.792 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:49:07.792 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:49:07.793 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:49:07.793 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:49:07.793 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:49:07.793 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:49:07.793 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:49:07.793 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:49:07.793 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:49:07.793 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:49:07.793 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:07.793 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:49:07.793 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.793 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:49:07.793 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.794 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:49:07.794 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:49:07.794 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:49:07.794 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:49:07.794 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.794 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:49:07.794 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:49:07.794 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:07.794 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.794 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.794 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:49:07.794 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:49:07.795 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:07.795 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:07.795 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:07.795 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.795 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:49:07.795 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:49:07.795 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:49:07.795 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:49:07.795 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:49:07.795 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:49:07.795 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.795 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.796 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:49:07.796 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:49:07.796 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:49:07.796 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:49:07.796 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.796 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:49:07.796 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:49:07.796 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:07.796 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.796 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.796 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:49:07.796 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:49:07.796 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:07.797 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:07.797 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:07.797 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.797 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:49:07.797 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:49:07.797 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:49:07.797 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:49:07.797 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:49:07.797 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:49:07.797 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.797 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.797 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:49:07.798 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:49:07.798 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:49:07.798 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:49:07.798 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.798 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:49:07.798 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:49:07.798 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:07.798 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.798 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.798 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:49:07.798 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:49:07.798 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:07.798 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:07.799 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:07.799 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.799 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:49:07.799 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:49:07.799 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:49:07.799 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:49:07.799 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:49:07.799 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:49:07.799 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:07.799 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:07.799 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.799 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:49:07.799 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:49:07.800 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.800 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:07.800 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:07.800 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:49:07.800 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:07.800 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:07.800 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:49:07.800 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.800 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:07.800 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:07.800 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:49:07.800 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:07.801 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:07.801 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:49:07.801 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.801 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:07.801 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:07.801 INFO:teuthology.orchestra.run.trial058.stdout: "num": 7 2026-02-23T06:49:07.801 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:07.801 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:07.801 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:49:07.801 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.801 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:49:07.801 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:49:07.801 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:49:07.802 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.802 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.802 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:07.802 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:07.802 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:49:07.802 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:07.802 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:07.802 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:49:07.802 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.802 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:07.802 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:07.802 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:49:07.803 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:07.803 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:07.803 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.803 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:49:07.803 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:49:07.804 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.791+0000 7f657ffff640 1 --2- 10.20.193.58:0/1459796261 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f65a4160390 0x7f65a41253f0 secure :-1 s=READY pgs=156 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65980038b0 tx=0x7f659800ff10 comp rx=0 tx=0).stop 2026-02-23T06:49:07.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.791+0000 7f657ffff640 1 -- 10.20.193.58:0/1459796261 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f65a4160390 msgr2=0x7f65a41253f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:49:07.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.791+0000 7f657ffff640 1 --2- 10.20.193.58:0/1459796261 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f65a4160390 0x7f65a41253f0 unknown :-1 s=CLOSED pgs=156 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:07.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.791+0000 7f65a891c640 1 -- 10.20.193.58:0/1459796261 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f657407a430 msgr2=0x7f657409a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:07.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.791+0000 7f65a891c640 1 --2- 10.20.193.58:0/1459796261 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f657407a430 0x7f657409a8e0 secure :-1 s=READY pgs=568 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6590017040 tx=0x7f6590014000 comp rx=0 tx=0).stop 2026-02-23T06:49:07.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.791+0000 7f65a891c640 1 -- 10.20.193.58:0/1459796261 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f65a405d370 msgr2=0x7f65a42013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:07.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.791+0000 7f65a891c640 1 --2- 10.20.193.58:0/1459796261 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f65a405d370 0x7f65a42013b0 secure :-1 s=READY pgs=7 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6594004740 tx=0x7f65940028d0 comp rx=0 tx=0).stop 2026-02-23T06:49:07.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.791+0000 7f65a3fff640 1 -- 10.20.193.58:0/1459796261 reap_dead start 2026-02-23T06:49:07.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.791+0000 7f65a3fff640 1 -- 10.20.193.58:0/1459796261 reap_dead start 2026-02-23T06:49:07.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.791+0000 7f65a891c640 1 -- 10.20.193.58:0/1459796261 shutdown_connections 2026-02-23T06:49:07.805 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.791+0000 7f65a891c640 1 -- 10.20.193.58:0/1459796261 >> 10.20.193.58:0/1459796261 conn(0x7f65a40b3c20 msgr2=0x7f65a4164b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:49:07.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.791+0000 7f65a891c640 1 -- 10.20.193.58:0/1459796261 shutdown_connections 2026-02-23T06:49:07.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.791+0000 7f65a891c640 1 -- 10.20.193.58:0/1459796261 wait complete. 2026-02-23T06:49:07.806 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:49:07.806 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:49:07.806 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:49:07.929 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.935+0000 7f11bbfff640 1 -- 10.20.193.58:0/4148122098 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11bc15c040 msgr2=0x7f11bc05b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:07.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.935+0000 7f11bbfff640 1 --2- 10.20.193.58:0/4148122098 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11bc15c040 0x7f11bc05b0e0 secure :-1 s=READY pgs=8 gs=3 cs=0 l=1 c_cookie=15724451058169654230 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11b0004740 tx=0x7f11b002f1e0 comp rx=0 tx=0).stop 2026-02-23T06:49:07.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.935+0000 7f11bbfff640 1 -- 10.20.193.58:0/4148122098 shutdown_connections 2026-02-23T06:49:07.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.935+0000 7f11bbfff640 1 --2- 10.20.193.58:0/4148122098 >> v2:10.20.193.93:3300/0 conn(0x7f11bc056550 0x7f11bc05ce30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:07.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.935+0000 7f11bbfff640 1 --2- 10.20.193.58:0/4148122098 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11bc15c040 0x7f11bc05b0e0 unknown :-1 s=CLOSED pgs=8 gs=3 cs=0 l=1 c_cookie=15724451058169654230 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:07.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.935+0000 7f11bbfff640 1 -- 10.20.193.58:0/4148122098 >> 10.20.193.58:0/4148122098 conn(0x7f11bc0b3c20 msgr2=0x7f11bc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:49:07.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.935+0000 7f11bbfff640 1 -- 10.20.193.58:0/4148122098 shutdown_connections 2026-02-23T06:49:07.930 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.935+0000 7f11bbfff640 1 -- 10.20.193.58:0/4148122098 wait complete. 2026-02-23T06:49:07.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.936+0000 7f11bbfff640 1 Processor -- start 2026-02-23T06:49:07.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.936+0000 7f11bbfff640 1 -- start start 2026-02-23T06:49:07.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.937+0000 7f11bbfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f11bc056550 0x7f11bc1372e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:07.933 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.937+0000 7f11bbfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f11bc05d370 0x7f11bc0572b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:07.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.937+0000 7f11bbfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11bc15c040 0x7f11bc13bec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:07.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.937+0000 7f11bbfff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f11bc138ff0 con 0x7f11bc056550 2026-02-23T06:49:07.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.937+0000 7f11bbfff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f11bc1580b0 con 0x7f11bc05d370 2026-02-23T06:49:07.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.937+0000 7f11bbfff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f11bc138990 con 0x7f11bc15c040 2026-02-23T06:49:07.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.937+0000 7f11baffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f11bc056550 0x7f11bc1372e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:07.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.937+0000 7f11bb7fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11bc15c040 0x7f11bc13bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:07.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.937+0000 7f11ba7fc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f11bc05d370 0x7f11bc0572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:07.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.937+0000 7f11bb7fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11bc15c040 0x7f11bc13bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:55868/0 (socket says 10.20.193.58:55868) 2026-02-23T06:49:07.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.937+0000 7f11bb7fe640 1 -- 10.20.193.58:0/2210936136 learned_addr learned my addr 10.20.193.58:0/2210936136 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:49:07.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.938+0000 7f11baffd640 1 -- 10.20.193.58:0/2210936136 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11bc15c040 msgr2=0x7f11bc13bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:07.934 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.938+0000 7f11baffd640 1 --2- 10.20.193.58:0/2210936136 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11bc15c040 0x7f11bc13bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:07.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.938+0000 7f11baffd640 1 -- 10.20.193.58:0/2210936136 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f11bc05d370 msgr2=0x7f11bc0572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:07.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.938+0000 7f11baffd640 1 --2- 10.20.193.58:0/2210936136 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f11bc05d370 0x7f11bc0572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:07.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.938+0000 7f11baffd640 1 -- 10.20.193.58:0/2210936136 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b00094b0 con 0x7f11bc056550 2026-02-23T06:49:07.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.938+0000 7f11baffd640 1 --2- 10.20.193.58:0/2210936136 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f11bc056550 0x7f11bc1372e0 secure :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11b0009230 tx=0x7f11b0002950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:07.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.938+0000 7f119b7fe640 1 -- 10.20.193.58:0/2210936136 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f11b0038470 con 0x7f11bc056550 2026-02-23T06:49:07.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.938+0000 7f119b7fe640 1 -- 10.20.193.58:0/2210936136 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11b00386c0 con 0x7f11bc056550 2026-02-23T06:49:07.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.938+0000 7f119b7fe640 1 -- 10.20.193.58:0/2210936136 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f11b0038ad0 con 0x7f11bc056550 2026-02-23T06:49:07.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.938+0000 7f11bbfff640 1 -- 10.20.193.58:0/2210936136 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11bc138d10 con 0x7f11bc056550 2026-02-23T06:49:07.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.938+0000 7f11bbfff640 1 -- 10.20.193.58:0/2210936136 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11bc136800 con 0x7f11bc056550 2026-02-23T06:49:07.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.939+0000 7f11bbfff640 1 --2- 10.20.193.58:0/2210936136 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11bc13b310 0x7f11bc136b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:07.935 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.939+0000 7f11bbfff640 1 -- 10.20.193.58:0/2210936136 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f11bc15c410 con 0x7f11bc13b310 2026-02-23T06:49:07.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.939+0000 7f11ba7fc640 1 --2- 10.20.193.58:0/2210936136 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11bc13b310 0x7f11bc136b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:07.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.939+0000 7f11ba7fc640 1 -- 10.20.193.58:0/2210936136 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f11bc05b620 con 0x7f11bc13b310 2026-02-23T06:49:07.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.939+0000 7f11ba7fc640 1 --2- 10.20.193.58:0/2210936136 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11bc13b310 0x7f11bc136b40 secure :-1 s=READY pgs=9 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11bc162dc0 tx=0x7f11a4009ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:07.936 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.939+0000 7f119b7fe640 1 -- 10.20.193.58:0/2210936136 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f11a4011920 con 0x7f11bc13b310 2026-02-23T06:49:07.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.940+0000 7f119b7fe640 1 -- 10.20.193.58:0/2210936136 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f11a4011a80 con 0x7f11bc13b310 2026-02-23T06:49:07.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.940+0000 7f119b7fe640 1 -- 10.20.193.58:0/2210936136 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11bc13b310 msgr2=0x7f11bc136b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:07.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.940+0000 7f119b7fe640 1 --2- 10.20.193.58:0/2210936136 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11bc13b310 0x7f11bc136b40 secure :-1 s=READY pgs=9 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11bc162dc0 tx=0x7f11a4009ae0 comp rx=0 tx=0).stop 2026-02-23T06:49:07.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.940+0000 7f119b7fe640 1 -- 10.20.193.58:0/2210936136 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11bc13b310 msgr2=0x7f11bc136b40 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:49:07.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.940+0000 7f119b7fe640 1 --2- 10.20.193.58:0/2210936136 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11bc13b310 0x7f11bc136b40 secure :-1 s=CLOSED pgs=9 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11bc162dc0 tx=0x7f11a4009ae0 comp rx=0 tx=0).stop 2026-02-23T06:49:07.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.940+0000 7f119b7fe640 1 -- 10.20.193.58:0/2210936136 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f11b0038c30 con 0x7f11bc056550 2026-02-23T06:49:07.938 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.941+0000 7f119b7fe640 1 --2- 10.20.193.58:0/2210936136 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f118807a480 0x7f118809a930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:07.938 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.941+0000 7f119b7fe640 1 -- 10.20.193.58:0/2210936136 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f11b00c2430 con 0x7f11bc056550 2026-02-23T06:49:07.938 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.941+0000 7f11ba7fc640 1 --2- 10.20.193.58:0/2210936136 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f118807a480 0x7f118809a930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:07.938 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.942+0000 7f11ba7fc640 1 --2- 10.20.193.58:0/2210936136 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f118807a480 0x7f118809a930 secure :-1 s=READY pgs=569 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11a40046b0 tx=0x7f11a400e000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:07.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.943+0000 7f11bbfff640 1 --2- 10.20.193.58:0/2210936136 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11bc155780 0x7f11bc155b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:07.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.943+0000 7f11bbfff640 1 -- 10.20.193.58:0/2210936136 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f11bc137080 con 0x7f11bc155780 2026-02-23T06:49:07.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.944+0000 7f11bb7fe640 1 --2- 10.20.193.58:0/2210936136 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11bc155780 0x7f11bc155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:07.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.944+0000 7f11bb7fe640 1 -- 10.20.193.58:0/2210936136 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f11bc05ce30 con 0x7f11bc155780 2026-02-23T06:49:07.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.944+0000 7f11bb7fe640 1 --2- 10.20.193.58:0/2210936136 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11bc155780 0x7f11bc155b70 secure :-1 s=READY pgs=10 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11ac008ce0 tx=0x7f11ac010c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:07.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.944+0000 7f119b7fe640 1 -- 10.20.193.58:0/2210936136 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f11ac010ee0 con 0x7f11bc155780 2026-02-23T06:49:07.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.944+0000 7f119b7fe640 1 -- 10.20.193.58:0/2210936136 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4911 (secure 0 0 0) 0x7f11ac00eab0 con 0x7f11bc155780 2026-02-23T06:49:07.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.944+0000 7f119b7fe640 1 -- 10.20.193.58:0/2210936136 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11bc155780 msgr2=0x7f11bc155b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:07.940 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.944+0000 7f119b7fe640 1 --2- 10.20.193.58:0/2210936136 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11bc155780 0x7f11bc155b70 secure :-1 s=READY pgs=10 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11ac008ce0 tx=0x7f11ac010c80 comp rx=0 tx=0).stop 2026-02-23T06:49:07.940 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:49:07.940 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:49:07.940 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:49:07.940 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:49:07.941 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 242, 2026-02-23T06:49:07.941 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 15680, 2026-02-23T06:49:07.941 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:49:07.941 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:49:07.941 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:49:07.941 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:49:07.941 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:07.941 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:49:07.941 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:49:07.941 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:49:07.941 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:49:07.941 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:49:07.942 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:49:07.942 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:49:07.942 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:49:07.942 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:49:07.942 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:49:07.942 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:49:07.942 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:49:07.942 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:49:07.942 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:49:07.942 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:49:07.942 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:49:07.942 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:49:07.943 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:07.943 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:49:07.943 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:49:07.943 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:49:07.943 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:49:07.943 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:49:07.943 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:49:07.943 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:49:07.943 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:49:07.943 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:49:07.943 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:49:07.943 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:49:07.944 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:49:07.944 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:49:07.944 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:49:07.944 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:49:07.944 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:07.944 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.944 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:49:07.944 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:49:07.944 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:49:07.944 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:49:07.944 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:49:07.944 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:49:07.945 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:49:07.945 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:49:07.945 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:49:07.945 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:49:07.945 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:49:07.945 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:49:07.945 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:49:07.945 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:49:07.945 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:49:07.945 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:49:07.945 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:49:07.945 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:49:07.946 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:49:07.946 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:49:07.946 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:49:07.946 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:49:07.946 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:49:07.946 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:49:07.946 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:49:07.946 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:49:07.946 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:49:07.946 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:49:07.946 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:49:07.946 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:49:07.946 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:07.947 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:49:07.947 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.947 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:49:07.947 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.947 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:49:07.947 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:49:07.947 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:49:07.947 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:49:07.947 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.947 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:49:07.947 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:49:07.947 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:07.948 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.948 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.948 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:49:07.948 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:49:07.948 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:07.948 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:07.948 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:07.948 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.948 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:49:07.948 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:49:07.948 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:49:07.948 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:49:07.949 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:49:07.949 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:49:07.949 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.949 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.949 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:49:07.949 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:49:07.949 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:49:07.949 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:49:07.949 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.949 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:49:07.949 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:49:07.949 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:07.949 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.950 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.950 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:49:07.950 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:49:07.950 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:07.950 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:07.950 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:07.950 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.950 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:49:07.950 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:49:07.950 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:49:07.950 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:49:07.950 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:49:07.951 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:49:07.951 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.951 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.951 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:49:07.951 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:49:07.951 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:49:07.951 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:49:07.951 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.951 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:49:07.951 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:49:07.951 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:07.951 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.951 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.952 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:49:07.952 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:49:07.952 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:07.952 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:07.952 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:07.952 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.952 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:49:07.952 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:49:07.952 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:49:07.952 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:49:07.952 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:49:07.952 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:49:07.953 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:07.953 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:07.953 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.953 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:49:07.953 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:49:07.953 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.953 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:07.953 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:07.953 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:49:07.953 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:07.953 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:07.953 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:49:07.954 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:07.954 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:07.954 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:07.954 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:49:07.954 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:07.954 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:07.954 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:07.954 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:49:07.954 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:49:07.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.944+0000 7f119b7fe640 1 -- 10.20.193.58:0/2210936136 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11bc155780 msgr2=0x7f11bc155b70 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:49:07.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.944+0000 7f119b7fe640 1 --2- 10.20.193.58:0/2210936136 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11bc155780 0x7f11bc155b70 secure :-1 s=CLOSED pgs=10 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11ac008ce0 tx=0x7f11ac010c80 comp rx=0 tx=0).stop 2026-02-23T06:49:07.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.945+0000 7f11bbfff640 1 -- 10.20.193.58:0/2210936136 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f118807a480 msgr2=0x7f118809a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:07.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.945+0000 7f11bbfff640 1 --2- 10.20.193.58:0/2210936136 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f118807a480 0x7f118809a930 secure :-1 s=READY pgs=569 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11a40046b0 tx=0x7f11a400e000 comp rx=0 tx=0).stop 2026-02-23T06:49:07.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.945+0000 7f11bbfff640 1 -- 10.20.193.58:0/2210936136 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f11bc056550 msgr2=0x7f11bc1372e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:07.956 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.945+0000 7f11bbfff640 1 --2- 10.20.193.58:0/2210936136 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f11bc056550 0x7f11bc1372e0 secure :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11b0009230 tx=0x7f11b0002950 comp rx=0 tx=0).stop 2026-02-23T06:49:07.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.945+0000 7f11bb7fe640 1 -- 10.20.193.58:0/2210936136 reap_dead start 2026-02-23T06:49:07.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.945+0000 7f11bbfff640 1 -- 10.20.193.58:0/2210936136 shutdown_connections 2026-02-23T06:49:07.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.945+0000 7f11bbfff640 1 -- 10.20.193.58:0/2210936136 >> 10.20.193.58:0/2210936136 conn(0x7f11bc0b3c20 msgr2=0x7f11bc0b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:49:07.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.945+0000 7f11bbfff640 1 -- 10.20.193.58:0/2210936136 shutdown_connections 2026-02-23T06:49:07.957 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:07.945+0000 7f11bbfff640 1 -- 10.20.193.58:0/2210936136 wait complete. 2026-02-23T06:49:07.957 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:49:07.957 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:49:07.958 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:49:08.079 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.085+0000 7f6933577640 1 -- 10.20.193.58:0/1762902340 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f693415d4a0 msgr2=0x7f69340affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:08.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.085+0000 7f6933577640 1 --2- 10.20.193.58:0/1762902340 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f693415d4a0 0x7f69340affb0 secure :-1 s=READY pgs=11 gs=3 cs=0 l=1 c_cookie=8937378462144064016 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6928004740 tx=0x7f692802f1e0 comp rx=0 tx=0).stop 2026-02-23T06:49:08.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.085+0000 7f6933577640 1 -- 10.20.193.58:0/1762902340 shutdown_connections 2026-02-23T06:49:08.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.085+0000 7f6933577640 1 --2- 10.20.193.58:0/1762902340 >> v2:10.20.193.58:3300/0 conn(0x7f69340b6690 0x7f6934058ec0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:08.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.085+0000 7f6933577640 1 --2- 10.20.193.58:0/1762902340 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f693415d4a0 0x7f69340affb0 unknown :-1 s=CLOSED pgs=11 gs=3 cs=0 l=1 c_cookie=8937378462144064016 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:08.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.085+0000 7f6933577640 1 -- 10.20.193.58:0/1762902340 >> 10.20.193.58:0/1762902340 conn(0x7f69340b3c20 msgr2=0x7f69340b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:49:08.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.085+0000 7f6933577640 1 -- 10.20.193.58:0/1762902340 shutdown_connections 2026-02-23T06:49:08.080 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.085+0000 7f6933577640 1 -- 10.20.193.58:0/1762902340 wait complete. 2026-02-23T06:49:08.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.086+0000 7f6933577640 1 Processor -- start 2026-02-23T06:49:08.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.087+0000 7f6933577640 1 -- start start 2026-02-23T06:49:08.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.087+0000 7f6933577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f69340b6690 0x7f693411c950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:08.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.087+0000 7f6933577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f693415d4a0 0x7f69340b76f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:08.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.087+0000 7f6933577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f693415d870 0x7f69340b7c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:08.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.087+0000 7f6933577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f6934140a90 con 0x7f693415d4a0 2026-02-23T06:49:08.082 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.087+0000 7f6933577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f6934140d50 con 0x7f693415d870 2026-02-23T06:49:08.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.087+0000 7f6933577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f69341427c0 con 0x7f69340b6690 2026-02-23T06:49:08.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.087+0000 7f6932575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f69340b6690 0x7f693411c950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:08.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.087+0000 7f6932d76640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f693415d870 0x7f69340b7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:08.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.087+0000 7f6931d74640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f693415d4a0 0x7f69340b76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:08.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.087+0000 7f6932575640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f69340b6690 0x7f693411c950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:55886/0 (socket says 10.20.193.58:55886) 2026-02-23T06:49:08.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.087+0000 7f6932575640 1 -- 10.20.193.58:0/2796924525 learned_addr learned my addr 10.20.193.58:0/2796924525 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:49:08.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.088+0000 7f6931d74640 1 -- 10.20.193.58:0/2796924525 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f69340b6690 msgr2=0x7f693411c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:08.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.088+0000 7f6931d74640 1 --2- 10.20.193.58:0/2796924525 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f69340b6690 0x7f693411c950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:08.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.088+0000 7f6931d74640 1 -- 10.20.193.58:0/2796924525 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f693415d870 msgr2=0x7f69340b7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:08.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.088+0000 7f6931d74640 1 --2- 10.20.193.58:0/2796924525 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f693415d870 0x7f69340b7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:08.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.088+0000 7f6931d74640 1 -- 10.20.193.58:0/2796924525 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69280094b0 con 0x7f693415d4a0 2026-02-23T06:49:08.083 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.088+0000 7f6932d76640 1 --2- 10.20.193.58:0/2796924525 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f693415d870 0x7f69340b7c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:49:08.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.088+0000 7f6931d74640 1 --2- 10.20.193.58:0/2796924525 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f693415d4a0 0x7f69340b76f0 secure :-1 s=READY pgs=105 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69340b1d30 tx=0x7f691c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:08.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.088+0000 7f691affd640 1 -- 10.20.193.58:0/2796924525 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f691c005500 con 0x7f693415d4a0 2026-02-23T06:49:08.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.088+0000 7f691affd640 1 -- 10.20.193.58:0/2796924525 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f691c0036b0 con 0x7f693415d4a0 2026-02-23T06:49:08.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.088+0000 7f6933577640 1 -- 10.20.193.58:0/2796924525 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6934142aa0 con 0x7f693415d4a0 2026-02-23T06:49:08.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.088+0000 7f691affd640 1 -- 10.20.193.58:0/2796924525 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f691c003aa0 con 0x7f693415d4a0 2026-02-23T06:49:08.084 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.088+0000 7f6933577640 1 -- 10.20.193.58:0/2796924525 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6934141e40 con 0x7f693415d4a0 2026-02-23T06:49:08.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.088+0000 7f6933577640 1 -- 10.20.193.58:0/2796924525 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69340b6d50 con 0x7f693415d4a0 2026-02-23T06:49:08.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.088+0000 7f691affd640 1 -- 10.20.193.58:0/2796924525 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f691c003c00 con 0x7f693415d4a0 2026-02-23T06:49:08.085 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.088+0000 7f691affd640 1 --2- 10.20.193.58:0/2796924525 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f690007a6c0 0x7f690009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:08.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.088+0000 7f691affd640 1 -- 10.20.193.58:0/2796924525 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f691c09cd10 con 0x7f693415d4a0 2026-02-23T06:49:08.087 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.088+0000 7f691affd640 1 -- 10.20.193.58:0/2796924525 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f691c05fe40 con 0x7f693415d4a0 2026-02-23T06:49:08.090 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.096+0000 7f6932575640 1 --2- 10.20.193.58:0/2796924525 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f690007a6c0 0x7f690009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:08.091 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.097+0000 7f6932575640 1 --2- 10.20.193.58:0/2796924525 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f690007a6c0 0x7f690009ab70 secure :-1 s=READY pgs=570 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69280097e0 tx=0x7f6928031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:08.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.249+0000 7f6933577640 1 -- 10.20.193.58:0/2796924525 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f6934142f80 con 0x7f693415d4a0 2026-02-23T06:49:08.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.250+0000 7f691affd640 1 -- 10.20.193.58:0/2796924525 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f691c062ff0 con 0x7f693415d4a0 2026-02-23T06:49:08.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.251+0000 7f6933577640 1 -- 10.20.193.58:0/2796924525 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f690007a6c0 msgr2=0x7f690009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:08.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.251+0000 7f6933577640 1 --2- 10.20.193.58:0/2796924525 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f690007a6c0 0x7f690009ab70 secure :-1 s=READY pgs=570 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69280097e0 tx=0x7f6928031040 comp rx=0 tx=0).stop 2026-02-23T06:49:08.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.251+0000 7f6933577640 1 -- 10.20.193.58:0/2796924525 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f693415d4a0 msgr2=0x7f69340b76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:08.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.251+0000 7f6933577640 1 --2- 10.20.193.58:0/2796924525 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f693415d4a0 0x7f69340b76f0 secure :-1 s=READY pgs=105 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69340b1d30 tx=0x7f691c00c8a0 comp rx=0 tx=0).stop 2026-02-23T06:49:08.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.251+0000 7f6933577640 1 -- 10.20.193.58:0/2796924525 shutdown_connections 2026-02-23T06:49:08.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.251+0000 7f6933577640 1 --2- 10.20.193.58:0/2796924525 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f690007a6c0 0x7f690009ab70 unknown :-1 s=CLOSED pgs=570 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:08.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.251+0000 7f6933577640 1 --2- 10.20.193.58:0/2796924525 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f693415d870 0x7f69340b7c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:08.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.251+0000 7f6933577640 1 --2- 10.20.193.58:0/2796924525 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f693415d4a0 0x7f69340b76f0 unknown :-1 s=CLOSED pgs=105 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:08.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.251+0000 7f6933577640 1 --2- 10.20.193.58:0/2796924525 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f69340b6690 0x7f693411c950 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:08.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.251+0000 7f6933577640 1 -- 10.20.193.58:0/2796924525 >> 10.20.193.58:0/2796924525 conn(0x7f69340b3c20 msgr2=0x7f693405d100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:49:08.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.251+0000 7f6933577640 1 -- 10.20.193.58:0/2796924525 shutdown_connections 2026-02-23T06:49:08.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:08.251+0000 7f6933577640 1 -- 10.20.193.58:0/2796924525 wait complete. 2026-02-23T06:49:08.257 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:49:15.539 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:49:15.543 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:49:18.257 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:49:18.258 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:49:18.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.386+0000 7f80d3fff640 1 -- 10.20.193.58:0/3399372580 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f80c00041d0 msgr2=0x7f80c0065a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:18.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.386+0000 7f80d3fff640 1 --2- 10.20.193.58:0/3399372580 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f80c00041d0 0x7f80c0065a10 secure :-1 s=READY pgs=107 gs=4 cs=0 l=1 c_cookie=16584788535199450912 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80c4004080 tx=0x7f80c4030900 comp rx=0 tx=0).stop 2026-02-23T06:49:18.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.386+0000 7f80d3fff640 1 -- 10.20.193.58:0/3399372580 shutdown_connections 2026-02-23T06:49:18.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.386+0000 7f80d3fff640 1 --2- 10.20.193.58:0/3399372580 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f80c00041d0 0x7f80c0065a10 unknown :-1 s=CLOSED pgs=107 gs=4 cs=0 l=1 c_cookie=16584788535199450912 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.386+0000 7f80d3fff640 1 -- 10.20.193.58:0/3399372580 >> 10.20.193.58:0/3399372580 conn(0x7f80d40b3c20 msgr2=0x7f80d40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:49:18.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.386+0000 7f80d3fff640 1 -- 10.20.193.58:0/3399372580 shutdown_connections 2026-02-23T06:49:18.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.386+0000 7f80d3fff640 1 -- 10.20.193.58:0/3399372580 wait complete. 2026-02-23T06:49:18.384 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.387+0000 7f80d3fff640 1 Processor -- start 2026-02-23T06:49:18.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.387+0000 7f80d3fff640 1 -- start start 2026-02-23T06:49:18.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.387+0000 7f80d3fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f80c00041d0 0x7f80d413abc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:18.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.387+0000 7f80d3fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f80d41317f0 0x7f80d4131c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:18.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.387+0000 7f80d3fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f80d4200ea0 0x7f80d4201310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:18.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.388+0000 7f80d3fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f80d4131510 con 0x7f80d4200ea0 2026-02-23T06:49:18.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.388+0000 7f80d3fff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f80d4138bc0 con 0x7f80c00041d0 2026-02-23T06:49:18.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.388+0000 7f80d3fff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f80d4201850 con 0x7f80d41317f0 2026-02-23T06:49:18.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.388+0000 7f80d37fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f80d4200ea0 0x7f80d4201310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:18.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.388+0000 7f80d37fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f80d4200ea0 0x7f80d4201310 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:42372/0 (socket says 10.20.193.58:42372) 2026-02-23T06:49:18.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.388+0000 7f80d37fe640 1 -- 10.20.193.58:0/3182949187 learned_addr learned my addr 10.20.193.58:0/3182949187 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:49:18.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.388+0000 7f80d27fc640 1 --2- 10.20.193.58:0/3182949187 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f80d41317f0 0x7f80d4131c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:18.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.388+0000 7f80d2ffd640 1 --2- 10.20.193.58:0/3182949187 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f80c00041d0 0x7f80d413abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:18.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.388+0000 7f80d37fe640 1 -- 10.20.193.58:0/3182949187 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f80d41317f0 msgr2=0x7f80d4131c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:18.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.388+0000 7f80d37fe640 1 --2- 10.20.193.58:0/3182949187 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f80d41317f0 0x7f80d4131c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.388+0000 7f80d37fe640 1 -- 10.20.193.58:0/3182949187 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f80c00041d0 msgr2=0x7f80d413abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:18.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.388+0000 7f80d37fe640 1 --2- 10.20.193.58:0/3182949187 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f80c00041d0 0x7f80d413abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.388+0000 7f80d37fe640 1 -- 10.20.193.58:0/3182949187 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80d4132550 con 0x7f80d4200ea0 2026-02-23T06:49:18.386 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.388+0000 7f80d37fe640 1 --2- 10.20.193.58:0/3182949187 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f80d4200ea0 0x7f80d4201310 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80c400d330 tx=0x7f80c40045a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:18.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.388+0000 7f80abfff640 1 -- 10.20.193.58:0/3182949187 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f80c4007250 con 0x7f80d4200ea0 2026-02-23T06:49:18.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.388+0000 7f80abfff640 1 -- 10.20.193.58:0/3182949187 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80c40074c0 con 0x7f80d4200ea0 2026-02-23T06:49:18.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.388+0000 7f80abfff640 1 -- 10.20.193.58:0/3182949187 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f80c4004a10 con 0x7f80d4200ea0 2026-02-23T06:49:18.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.388+0000 7f80d3fff640 1 -- 10.20.193.58:0/3182949187 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80d4130e80 con 0x7f80d4200ea0 2026-02-23T06:49:18.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.389+0000 7f80d3fff640 1 -- 10.20.193.58:0/3182949187 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80d41308c0 con 0x7f80d4200ea0 2026-02-23T06:49:18.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.389+0000 7f80a9ffb640 1 -- 10.20.193.58:0/3182949187 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80d4165880 con 0x7f80d4200ea0 2026-02-23T06:49:18.387 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.390+0000 7f80abfff640 1 -- 10.20.193.58:0/3182949187 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f80c4042030 con 0x7f80d4200ea0 2026-02-23T06:49:18.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.391+0000 7f80abfff640 1 --2- 10.20.193.58:0/3182949187 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f80a407a6c0 0x7f80a409ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:18.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.391+0000 7f80abfff640 1 -- 10.20.193.58:0/3182949187 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f80c40c24e0 con 0x7f80d4200ea0 2026-02-23T06:49:18.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.391+0000 7f80d2ffd640 1 --2- 10.20.193.58:0/3182949187 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f80a407a6c0 0x7f80a409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:18.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.392+0000 7f80d2ffd640 1 --2- 10.20.193.58:0/3182949187 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f80a407a6c0 0x7f80a409ab70 secure :-1 s=READY pgs=571 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80c8004820 tx=0x7f80c80096e0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:18.389 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.393+0000 7f80abfff640 1 -- 10.20.193.58:0/3182949187 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f80c4085770 con 0x7f80d4200ea0 2026-02-23T06:49:18.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.547+0000 7f80a9ffb640 1 -- 10.20.193.58:0/3182949187 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f80d4162f70 con 0x7f80d4200ea0 2026-02-23T06:49:18.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.548+0000 7f80abfff640 1 -- 10.20.193.58:0/3182949187 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f80c4088890 con 0x7f80d4200ea0 2026-02-23T06:49:18.542 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":242,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:49:18.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.549+0000 7f80a9ffb640 1 -- 10.20.193.58:0/3182949187 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f80a407a6c0 msgr2=0x7f80a409ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:18.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.549+0000 7f80a9ffb640 1 --2- 10.20.193.58:0/3182949187 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f80a407a6c0 0x7f80a409ab70 secure :-1 s=READY pgs=571 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80c8004820 tx=0x7f80c80096e0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.549+0000 7f80a9ffb640 1 -- 10.20.193.58:0/3182949187 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f80d4200ea0 msgr2=0x7f80d4201310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:18.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.549+0000 7f80a9ffb640 1 --2- 10.20.193.58:0/3182949187 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f80d4200ea0 0x7f80d4201310 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80c400d330 tx=0x7f80c40045a0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.549+0000 7f80a9ffb640 1 -- 10.20.193.58:0/3182949187 shutdown_connections 2026-02-23T06:49:18.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.549+0000 7f80a9ffb640 1 --2- 10.20.193.58:0/3182949187 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f80a407a6c0 0x7f80a409ab70 unknown :-1 s=CLOSED pgs=571 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.549+0000 7f80a9ffb640 1 --2- 10.20.193.58:0/3182949187 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f80d4200ea0 0x7f80d4201310 unknown :-1 s=CLOSED pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.549+0000 7f80a9ffb640 1 --2- 10.20.193.58:0/3182949187 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f80d41317f0 0x7f80d4131c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.549+0000 7f80a9ffb640 1 --2- 10.20.193.58:0/3182949187 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f80c00041d0 0x7f80d413abc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.549+0000 7f80a9ffb640 1 -- 10.20.193.58:0/3182949187 >> 10.20.193.58:0/3182949187 conn(0x7f80d40b3c20 msgr2=0x7f80d405d050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:49:18.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.549+0000 7f80a9ffb640 1 -- 10.20.193.58:0/3182949187 shutdown_connections 2026-02-23T06:49:18.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.549+0000 7f80a9ffb640 1 -- 10.20.193.58:0/3182949187 wait complete. 2026-02-23T06:49:18.554 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:49:18.554 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-23T06:49:18.554 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:49:18.554 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:49:18.676 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.682+0000 7f8e3f577640 1 -- 10.20.193.58:0/3780989365 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e4015d870 msgr2=0x7f8e400587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:18.676 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.682+0000 7f8e3f577640 1 --2- 10.20.193.58:0/3780989365 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e4015d870 0x7f8e400587b0 secure :-1 s=READY pgs=110 gs=2 cs=0 l=1 c_cookie=12587356742194682887 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e400b5040 tx=0x7f8e2802f190 comp rx=0 tx=0).stop 2026-02-23T06:49:18.676 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.682+0000 7f8e3f577640 1 -- 10.20.193.58:0/3780989365 shutdown_connections 2026-02-23T06:49:18.676 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.682+0000 7f8e3f577640 1 --2- 10.20.193.58:0/3780989365 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e4015d870 0x7f8e400587b0 unknown :-1 s=CLOSED pgs=110 gs=2 cs=0 l=1 c_cookie=12587356742194682887 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.676 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.682+0000 7f8e3f577640 1 --2- 10.20.193.58:0/3780989365 >> v2:10.20.193.93:3300/0 conn(0x7f8e4015d4a0 0x7f8e400affb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.676 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.682+0000 7f8e3f577640 1 -- 10.20.193.58:0/3780989365 >> 10.20.193.58:0/3780989365 conn(0x7f8e400b3c20 msgr2=0x7f8e400b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:49:18.676 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.682+0000 7f8e3f577640 1 -- 10.20.193.58:0/3780989365 shutdown_connections 2026-02-23T06:49:18.676 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.682+0000 7f8e3f577640 1 -- 10.20.193.58:0/3780989365 wait complete. 2026-02-23T06:49:18.677 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.683+0000 7f8e3f577640 1 Processor -- start 2026-02-23T06:49:18.677 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.683+0000 7f8e3f577640 1 -- start start 2026-02-23T06:49:18.677 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.684+0000 7f8e3f577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8e400b6690 0x7f8e40150b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:18.677 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.684+0000 7f8e3f577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8e4015d4a0 0x7f8e40123600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:18.677 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.684+0000 7f8e3f577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e4015d870 0x7f8e40123b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:18.677 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.684+0000 7f8e3f577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4014deb0 con 0x7f8e4015d870 2026-02-23T06:49:18.677 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.684+0000 7f8e3f577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f8e40127370 con 0x7f8e400b6690 2026-02-23T06:49:18.677 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.684+0000 7f8e3f577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f8e4014d5a0 con 0x7f8e4015d4a0 2026-02-23T06:49:18.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.684+0000 7f8e3ed76640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e4015d870 0x7f8e40123b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:18.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.684+0000 7f8e3ed76640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e4015d870 0x7f8e40123b40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:42390/0 (socket says 10.20.193.58:42390) 2026-02-23T06:49:18.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.684+0000 7f8e3ed76640 1 -- 10.20.193.58:0/3617078412 learned_addr learned my addr 10.20.193.58:0/3617078412 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:49:18.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.684+0000 7f8e3e575640 1 --2- 10.20.193.58:0/3617078412 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8e400b6690 0x7f8e40150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:18.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.684+0000 7f8e3dd74640 1 --2- 10.20.193.58:0/3617078412 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8e4015d4a0 0x7f8e40123600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:18.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.684+0000 7f8e3ed76640 1 -- 10.20.193.58:0/3617078412 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8e4015d4a0 msgr2=0x7f8e40123600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:18.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.684+0000 7f8e3ed76640 1 --2- 10.20.193.58:0/3617078412 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f8e4015d4a0 0x7f8e40123600 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.684+0000 7f8e3ed76640 1 -- 10.20.193.58:0/3617078412 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8e400b6690 msgr2=0x7f8e40150b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:18.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.684+0000 7f8e3ed76640 1 --2- 10.20.193.58:0/3617078412 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f8e400b6690 0x7f8e40150b90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.684+0000 7f8e3ed76640 1 -- 10.20.193.58:0/3617078412 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e280094b0 con 0x7f8e4015d870 2026-02-23T06:49:18.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.684+0000 7f8e3ed76640 1 --2- 10.20.193.58:0/3617078412 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e4015d870 0x7f8e40123b40 secure :-1 s=READY pgs=111 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e3000d700 tx=0x7f8e3000dbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:18.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.685+0000 7f8e26ffd640 1 -- 10.20.193.58:0/3617078412 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e30005250 con 0x7f8e4015d870 2026-02-23T06:49:18.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.685+0000 7f8e26ffd640 1 -- 10.20.193.58:0/3617078412 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e300054a0 con 0x7f8e4015d870 2026-02-23T06:49:18.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.685+0000 7f8e26ffd640 1 -- 10.20.193.58:0/3617078412 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e30004930 con 0x7f8e4015d870 2026-02-23T06:49:18.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.685+0000 7f8e3f577640 1 -- 10.20.193.58:0/3617078412 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e4013f700 con 0x7f8e4015d870 2026-02-23T06:49:18.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.685+0000 7f8e3f577640 1 -- 10.20.193.58:0/3617078412 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e4014d860 con 0x7f8e4015d870 2026-02-23T06:49:18.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.685+0000 7f8e3f577640 1 --2- 10.20.193.58:0/3617078412 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e4014da50 0x7f8e40057920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:18.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.685+0000 7f8e3f577640 1 -- 10.20.193.58:0/3617078412 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f8e400b6330 con 0x7f8e4014da50 2026-02-23T06:49:18.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.685+0000 7f8e3e575640 1 --2- 10.20.193.58:0/3617078412 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e4014da50 0x7f8e40057920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:18.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.686+0000 7f8e3e575640 1 -- 10.20.193.58:0/3617078412 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8e400b5e10 con 0x7f8e4014da50 2026-02-23T06:49:18.679 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.686+0000 7f8e3e575640 1 --2- 10.20.193.58:0/3617078412 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e4014da50 0x7f8e40057920 secure :-1 s=READY pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e34002fc0 tx=0x7f8e34009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:18.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.686+0000 7f8e26ffd640 1 -- 10.20.193.58:0/3617078412 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e34011030 con 0x7f8e4014da50 2026-02-23T06:49:18.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.686+0000 7f8e26ffd640 1 -- 10.20.193.58:0/3617078412 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f8e34011190 con 0x7f8e4014da50 2026-02-23T06:49:18.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.686+0000 7f8e26ffd640 1 -- 10.20.193.58:0/3617078412 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e4014da50 msgr2=0x7f8e40057920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:18.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.686+0000 7f8e26ffd640 1 --2- 10.20.193.58:0/3617078412 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e4014da50 0x7f8e40057920 secure :-1 s=READY pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e34002fc0 tx=0x7f8e34009ae0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.686+0000 7f8e26ffd640 1 -- 10.20.193.58:0/3617078412 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e4014da50 msgr2=0x7f8e40057920 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:49:18.680 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.686+0000 7f8e26ffd640 1 --2- 10.20.193.58:0/3617078412 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e4014da50 0x7f8e40057920 unknown :-1 s=CLOSED pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.686+0000 7f8e26ffd640 1 -- 10.20.193.58:0/3617078412 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f8e3001a070 con 0x7f8e4015d870 2026-02-23T06:49:18.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.686+0000 7f8e26ffd640 1 --2- 10.20.193.58:0/3617078412 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8e0c07a410 0x7f8e0c09a8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:18.681 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.686+0000 7f8e26ffd640 1 -- 10.20.193.58:0/3617078412 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f8e3009dbd0 con 0x7f8e4015d870 2026-02-23T06:49:18.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.686+0000 7f8e3f577640 1 --2- 10.20.193.58:0/3617078412 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e4014e320 0x7f8e40057e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:18.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.686+0000 7f8e3f577640 1 -- 10.20.193.58:0/3617078412 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f8e400b6d50 con 0x7f8e4014e320 2026-02-23T06:49:18.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.686+0000 7f8e3dd74640 1 --2- 10.20.193.58:0/3617078412 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e4014e320 0x7f8e40057e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:18.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.686+0000 7f8e3dd74640 1 -- 10.20.193.58:0/3617078412 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8e4005b0e0 con 0x7f8e4014e320 2026-02-23T06:49:18.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.686+0000 7f8e3dd74640 1 --2- 10.20.193.58:0/3617078412 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e4014e320 0x7f8e40057e60 secure :-1 s=READY pgs=113 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e400b5040 tx=0x7f8e280028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:18.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.691+0000 7f8e26ffd640 1 -- 10.20.193.58:0/3617078412 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e28047070 con 0x7f8e4014e320 2026-02-23T06:49:18.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.691+0000 7f8e26ffd640 1 -- 10.20.193.58:0/3617078412 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5416 (secure 0 0 0) 0x7f8e2803e040 con 0x7f8e4014e320 2026-02-23T06:49:18.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.691+0000 7f8e26ffd640 1 -- 10.20.193.58:0/3617078412 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e4014e320 msgr2=0x7f8e40057e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:18.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.691+0000 7f8e26ffd640 1 --2- 10.20.193.58:0/3617078412 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e4014e320 0x7f8e40057e60 secure :-1 s=READY pgs=113 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e400b5040 tx=0x7f8e280028d0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.691+0000 7f8e26ffd640 1 -- 10.20.193.58:0/3617078412 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e4014e320 msgr2=0x7f8e40057e60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:49:18.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.691+0000 7f8e26ffd640 1 --2- 10.20.193.58:0/3617078412 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e4014e320 0x7f8e40057e60 unknown :-1 s=CLOSED pgs=113 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.687 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:49:18.687 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:49:18.687 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 242, 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 130009, 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:49:18.688 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:49:18.689 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.690 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:49:18.691 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:49:18.691 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:18.691 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:18.691 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:18.691 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.691 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:49:18.691 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:49:18.691 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:49:18.691 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:49:18.691 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:49:18.691 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:49:18.691 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.691 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.691 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:49:18.691 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:49:18.691 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:49:18.691 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:49:18.691 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.692 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:49:18.692 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:49:18.692 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:18.692 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.692 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.692 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:49:18.692 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:49:18.692 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:18.692 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:18.692 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:18.692 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.692 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:49:18.692 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:49:18.692 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:49:18.692 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:49:18.692 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:49:18.692 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:49:18.692 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:18.692 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:18.692 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.693 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:18.694 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:18.694 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:49:18.694 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:18.694 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:18.694 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.694 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:49:18.694 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:49:18.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.691+0000 7f8e3f577640 1 -- 10.20.193.58:0/3617078412 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8e0c07a410 msgr2=0x7f8e0c09a8c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-23T06:49:18.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.691+0000 7f8e3f577640 1 --2- 10.20.193.58:0/3617078412 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8e0c07a410 0x7f8e0c09a8c0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.691+0000 7f8e3f577640 1 -- 10.20.193.58:0/3617078412 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e4015d870 msgr2=0x7f8e40123b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:18.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.691+0000 7f8e3f577640 1 --2- 10.20.193.58:0/3617078412 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f8e4015d870 0x7f8e40123b40 secure :-1 s=READY pgs=111 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e3000d700 tx=0x7f8e3000dbd0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.691+0000 7f8e3ed76640 1 -- 10.20.193.58:0/3617078412 reap_dead start 2026-02-23T06:49:18.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.691+0000 7f8e3ed76640 1 -- 10.20.193.58:0/3617078412 reap_dead start 2026-02-23T06:49:18.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.691+0000 7f8e3f577640 1 -- 10.20.193.58:0/3617078412 shutdown_connections 2026-02-23T06:49:18.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.691+0000 7f8e3f577640 1 -- 10.20.193.58:0/3617078412 >> 10.20.193.58:0/3617078412 conn(0x7f8e400b3c20 msgr2=0x7f8e400b79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:49:18.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.691+0000 7f8e3f577640 1 -- 10.20.193.58:0/3617078412 shutdown_connections 2026-02-23T06:49:18.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.691+0000 7f8e3f577640 1 -- 10.20.193.58:0/3617078412 wait complete. 2026-02-23T06:49:18.695 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:49:18.695 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:49:18.695 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:49:18.816 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.822+0000 7f9c6dd74640 1 -- 10.20.193.58:0/3929044270 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c64004420 con 0x7f9c7015d4a0 2026-02-23T06:49:18.817 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.823+0000 7f9c749dc640 1 -- 10.20.193.58:0/3929044270 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9c7015d4a0 msgr2=0x7f9c700affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:18.817 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.823+0000 7f9c749dc640 1 --2- 10.20.193.58:0/3929044270 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9c7015d4a0 0x7f9c700affb0 secure :-1 s=READY pgs=159 gs=3 cs=0 l=1 c_cookie=8327800571430602278 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c64004740 tx=0x7f9c6402f220 comp rx=0 tx=0).stop 2026-02-23T06:49:18.817 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.823+0000 7f9c749dc640 1 -- 10.20.193.58:0/3929044270 shutdown_connections 2026-02-23T06:49:18.817 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.823+0000 7f9c749dc640 1 --2- 10.20.193.58:0/3929044270 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9c7015d4a0 0x7f9c700affb0 unknown :-1 s=CLOSED pgs=159 gs=3 cs=0 l=1 c_cookie=8327800571430602278 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.817 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.823+0000 7f9c749dc640 1 -- 10.20.193.58:0/3929044270 >> 10.20.193.58:0/3929044270 conn(0x7f9c700b3c20 msgr2=0x7f9c700b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:49:18.817 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.823+0000 7f9c749dc640 1 -- 10.20.193.58:0/3929044270 shutdown_connections 2026-02-23T06:49:18.817 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.823+0000 7f9c749dc640 1 -- 10.20.193.58:0/3929044270 wait complete. 2026-02-23T06:49:18.818 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.824+0000 7f9c749dc640 1 Processor -- start 2026-02-23T06:49:18.818 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.824+0000 7f9c749dc640 1 -- start start 2026-02-23T06:49:18.818 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.825+0000 7f9c749dc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9c700b6690 0x7f9c7013e770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:18.818 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.825+0000 7f9c749dc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9c7015d4a0 0x7f9c70124a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:18.818 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.825+0000 7f9c749dc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9c7015d870 0x7f9c70121670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:18.818 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.825+0000 7f9c749dc640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f9c70120e30 con 0x7f9c7015d870 2026-02-23T06:49:18.818 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.825+0000 7f9c749dc640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9c70056a00 con 0x7f9c700b6690 2026-02-23T06:49:18.818 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.825+0000 7f9c749dc640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f9c70056740 con 0x7f9c7015d4a0 2026-02-23T06:49:18.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.825+0000 7f9c6f577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9c7015d870 0x7f9c70121670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:18.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.825+0000 7f9c6ed76640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9c700b6690 0x7f9c7013e770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:18.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.825+0000 7f9c6f577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9c7015d870 0x7f9c70121670 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:49170/0 (socket says 10.20.193.58:49170) 2026-02-23T06:49:18.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.825+0000 7f9c6f577640 1 -- 10.20.193.58:0/87377846 learned_addr learned my addr 10.20.193.58:0/87377846 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:49:18.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.825+0000 7f9c6e575640 1 --2- 10.20.193.58:0/87377846 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9c7015d4a0 0x7f9c70124a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:18.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.825+0000 7f9c6f577640 1 -- 10.20.193.58:0/87377846 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9c7015d4a0 msgr2=0x7f9c70124a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:18.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.825+0000 7f9c6f577640 1 --2- 10.20.193.58:0/87377846 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9c7015d4a0 0x7f9c70124a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.825+0000 7f9c6f577640 1 -- 10.20.193.58:0/87377846 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9c700b6690 msgr2=0x7f9c7013e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:18.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.825+0000 7f9c6f577640 1 --2- 10.20.193.58:0/87377846 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9c700b6690 0x7f9c7013e770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.825+0000 7f9c6f577640 1 -- 10.20.193.58:0/87377846 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c640094b0 con 0x7f9c7015d870 2026-02-23T06:49:18.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.825+0000 7f9c6e575640 1 --2- 10.20.193.58:0/87377846 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9c7015d4a0 0x7f9c70124a60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:49:18.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.825+0000 7f9c6f577640 1 --2- 10.20.193.58:0/87377846 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9c7015d870 0x7f9c70121670 secure :-1 s=READY pgs=115 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c6000d700 tx=0x7f9c6000dbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:18.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.825+0000 7f9c4f7fe640 1 -- 10.20.193.58:0/87377846 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c60006290 con 0x7f9c7015d870 2026-02-23T06:49:18.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.825+0000 7f9c4f7fe640 1 -- 10.20.193.58:0/87377846 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c600063f0 con 0x7f9c7015d870 2026-02-23T06:49:18.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.825+0000 7f9c4f7fe640 1 -- 10.20.193.58:0/87377846 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c60004790 con 0x7f9c7015d870 2026-02-23T06:49:18.819 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.825+0000 7f9c749dc640 1 -- 10.20.193.58:0/87377846 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c70056fa0 con 0x7f9c7015d870 2026-02-23T06:49:18.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.826+0000 7f9c749dc640 1 -- 10.20.193.58:0/87377846 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c700b7f60 con 0x7f9c7015d870 2026-02-23T06:49:18.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.826+0000 7f9c749dc640 1 --2- 10.20.193.58:0/87377846 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9c70056b90 0x7f9c701509b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:18.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.826+0000 7f9c749dc640 1 -- 10.20.193.58:0/87377846 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9c70164250 con 0x7f9c70056b90 2026-02-23T06:49:18.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.826+0000 7f9c6ed76640 1 --2- 10.20.193.58:0/87377846 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9c70056b90 0x7f9c701509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:18.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.827+0000 7f9c6ed76640 1 -- 10.20.193.58:0/87377846 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9c700b6330 con 0x7f9c70056b90 2026-02-23T06:49:18.820 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.827+0000 7f9c6ed76640 1 --2- 10.20.193.58:0/87377846 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9c70056b90 0x7f9c701509b0 secure :-1 s=READY pgs=160 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c64004740 tx=0x7f9c64004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:18.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.827+0000 7f9c4f7fe640 1 -- 10.20.193.58:0/87377846 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c64047070 con 0x7f9c70056b90 2026-02-23T06:49:18.821 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.827+0000 7f9c4f7fe640 1 -- 10.20.193.58:0/87377846 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f9c6001a020 con 0x7f9c7015d870 2026-02-23T06:49:18.822 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.828+0000 7f9c4f7fe640 1 --2- 10.20.193.58:0/87377846 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9c3c07a660 0x7f9c3c09ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:18.822 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.828+0000 7f9c4f7fe640 1 -- 10.20.193.58:0/87377846 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f9c6009dfa0 con 0x7f9c7015d870 2026-02-23T06:49:18.822 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.829+0000 7f9c6e575640 1 --2- 10.20.193.58:0/87377846 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9c3c07a660 0x7f9c3c09ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:18.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.829+0000 7f9c6e575640 1 --2- 10.20.193.58:0/87377846 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9c3c07a660 0x7f9c3c09ab10 secure :-1 s=READY pgs=572 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c701255f0 tx=0x7f9c58009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:18.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.830+0000 7f9c4f7fe640 1 -- 10.20.193.58:0/87377846 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f9c6403e040 con 0x7f9c70056b90 2026-02-23T06:49:18.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.830+0000 7f9c4f7fe640 1 -- 10.20.193.58:0/87377846 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9c70056b90 msgr2=0x7f9c701509b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:18.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.830+0000 7f9c4f7fe640 1 --2- 10.20.193.58:0/87377846 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9c70056b90 0x7f9c701509b0 secure :-1 s=READY pgs=160 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c64004740 tx=0x7f9c64004770 comp rx=0 tx=0).stop 2026-02-23T06:49:18.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.830+0000 7f9c4f7fe640 1 -- 10.20.193.58:0/87377846 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9c70056b90 msgr2=0x7f9c701509b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:49:18.823 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.830+0000 7f9c4f7fe640 1 --2- 10.20.193.58:0/87377846 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9c70056b90 0x7f9c701509b0 secure :-1 s=CLOSED pgs=160 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c64004740 tx=0x7f9c64004770 comp rx=0 tx=0).stop 2026-02-23T06:49:18.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.833+0000 7f9c749dc640 1 --2- 10.20.193.58:0/87377846 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9c70121bb0 0x7f9c70150ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:18.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.833+0000 7f9c749dc640 1 -- 10.20.193.58:0/87377846 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9c700b7260 con 0x7f9c70121bb0 2026-02-23T06:49:18.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.839+0000 7f9c6ed76640 1 --2- 10.20.193.58:0/87377846 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9c70121bb0 0x7f9c70150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:18.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.839+0000 7f9c6ed76640 1 -- 10.20.193.58:0/87377846 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9c7005b5a0 con 0x7f9c70121bb0 2026-02-23T06:49:18.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.843+0000 7f9c6ed76640 1 --2- 10.20.193.58:0/87377846 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9c70121bb0 0x7f9c70150ef0 secure :-1 s=READY pgs=161 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c640171f0 tx=0x7f9c64005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:18.840 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.847+0000 7f9c4f7fe640 1 -- 10.20.193.58:0/87377846 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c6403d050 con 0x7f9c70121bb0 2026-02-23T06:49:18.840 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:49:18.840 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:49:18.840 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 242, 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 245200, 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:49:18.841 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:49:18.842 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:49:18.843 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.844 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:18.845 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout: "num": 7 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:49:18.846 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:49:18.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.847+0000 7f9c4f7fe640 1 -- 10.20.193.58:0/87377846 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5557 (secure 0 0 0) 0x7f9c64050070 con 0x7f9c70121bb0 2026-02-23T06:49:18.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.847+0000 7f9c4f7fe640 1 -- 10.20.193.58:0/87377846 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9c70121bb0 msgr2=0x7f9c70150ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:18.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.847+0000 7f9c4f7fe640 1 --2- 10.20.193.58:0/87377846 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9c70121bb0 0x7f9c70150ef0 secure :-1 s=READY pgs=161 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c640171f0 tx=0x7f9c64005f90 comp rx=0 tx=0).stop 2026-02-23T06:49:18.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.847+0000 7f9c4f7fe640 1 -- 10.20.193.58:0/87377846 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9c70121bb0 msgr2=0x7f9c70150ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:49:18.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.847+0000 7f9c4f7fe640 1 --2- 10.20.193.58:0/87377846 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9c70121bb0 0x7f9c70150ef0 secure :-1 s=CLOSED pgs=161 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c640171f0 tx=0x7f9c64005f90 comp rx=0 tx=0).stop 2026-02-23T06:49:18.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.847+0000 7f9c749dc640 1 -- 10.20.193.58:0/87377846 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9c3c07a660 msgr2=0x7f9c3c09ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:18.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.847+0000 7f9c749dc640 1 --2- 10.20.193.58:0/87377846 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9c3c07a660 0x7f9c3c09ab10 secure :-1 s=READY pgs=572 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c701255f0 tx=0x7f9c58009040 comp rx=0 tx=0).stop 2026-02-23T06:49:18.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.847+0000 7f9c749dc640 1 -- 10.20.193.58:0/87377846 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9c7015d870 msgr2=0x7f9c70121670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:18.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.847+0000 7f9c749dc640 1 --2- 10.20.193.58:0/87377846 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9c7015d870 0x7f9c70121670 secure :-1 s=READY pgs=115 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c6000d700 tx=0x7f9c6000dbd0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.847+0000 7f9c6f577640 1 -- 10.20.193.58:0/87377846 reap_dead start 2026-02-23T06:49:18.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.847+0000 7f9c6f577640 1 -- 10.20.193.58:0/87377846 reap_dead start 2026-02-23T06:49:18.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.847+0000 7f9c749dc640 1 -- 10.20.193.58:0/87377846 shutdown_connections 2026-02-23T06:49:18.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.847+0000 7f9c749dc640 1 -- 10.20.193.58:0/87377846 >> 10.20.193.58:0/87377846 conn(0x7f9c700b3c20 msgr2=0x7f9c7015bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:49:18.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.847+0000 7f9c749dc640 1 -- 10.20.193.58:0/87377846 shutdown_connections 2026-02-23T06:49:18.847 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.847+0000 7f9c749dc640 1 -- 10.20.193.58:0/87377846 wait complete. 2026-02-23T06:49:18.850 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:49:18.850 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:49:18.850 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:49:18.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.979+0000 7fe612a83640 1 -- 10.20.193.58:0/3425083908 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe60c15c4b0 msgr2=0x7fe60c058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:18.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.979+0000 7fe612a83640 1 --2- 10.20.193.58:0/3425083908 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe60c15c4b0 0x7fe60c058200 secure :-1 s=READY pgs=162 gs=2 cs=0 l=1 c_cookie=18351018979016424952 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe5fc004740 tx=0x7fe5fc02f1e0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.979+0000 7fe612a83640 1 -- 10.20.193.58:0/3425083908 shutdown_connections 2026-02-23T06:49:18.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.979+0000 7fe612a83640 1 --2- 10.20.193.58:0/3425083908 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe60c162ca0 0x7fe60c056fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.979+0000 7fe612a83640 1 --2- 10.20.193.58:0/3425083908 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe60c15c4b0 0x7fe60c058200 unknown :-1 s=CLOSED pgs=162 gs=2 cs=0 l=1 c_cookie=18351018979016424952 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.979+0000 7fe612a83640 1 -- 10.20.193.58:0/3425083908 >> 10.20.193.58:0/3425083908 conn(0x7fe60c0b3c20 msgr2=0x7fe60c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:49:18.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.979+0000 7fe612a83640 1 -- 10.20.193.58:0/3425083908 shutdown_connections 2026-02-23T06:49:18.973 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.979+0000 7fe612a83640 1 -- 10.20.193.58:0/3425083908 wait complete. 2026-02-23T06:49:18.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.980+0000 7fe612a83640 1 Processor -- start 2026-02-23T06:49:18.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.980+0000 7fe612a83640 1 -- start start 2026-02-23T06:49:18.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.981+0000 7fe612a83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe60c056960 0x7fe60c13adf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:18.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.981+0000 7fe612a83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe60c15c4b0 0x7fe60c13dc00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:18.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.981+0000 7fe612a83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe60c162ca0 0x7fe60c13e140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:18.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.981+0000 7fe612a83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe60c2007a0 con 0x7fe60c056960 2026-02-23T06:49:18.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.981+0000 7fe612a83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe60c2009b0 con 0x7fe60c15c4b0 2026-02-23T06:49:18.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.981+0000 7fe612a83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe60c200c90 con 0x7fe60c162ca0 2026-02-23T06:49:18.976 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.981+0000 7fe611a81640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe60c056960 0x7fe60c13adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:18.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.981+0000 7fe611a81640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe60c056960 0x7fe60c13adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:49182/0 (socket says 10.20.193.58:49182) 2026-02-23T06:49:18.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.981+0000 7fe611a81640 1 -- 10.20.193.58:0/3230893200 learned_addr learned my addr 10.20.193.58:0/3230893200 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:49:18.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.981+0000 7fe611280640 1 --2- 10.20.193.58:0/3230893200 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe60c15c4b0 0x7fe60c13dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:18.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.981+0000 7fe612282640 1 --2- 10.20.193.58:0/3230893200 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe60c162ca0 0x7fe60c13e140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:18.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.981+0000 7fe611a81640 1 -- 10.20.193.58:0/3230893200 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe60c162ca0 msgr2=0x7fe60c13e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:18.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.981+0000 7fe611a81640 1 --2- 10.20.193.58:0/3230893200 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe60c162ca0 0x7fe60c13e140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.981+0000 7fe611a81640 1 -- 10.20.193.58:0/3230893200 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe60c15c4b0 msgr2=0x7fe60c13dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:18.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.981+0000 7fe611a81640 1 --2- 10.20.193.58:0/3230893200 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe60c15c4b0 0x7fe60c13dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.981+0000 7fe611a81640 1 -- 10.20.193.58:0/3230893200 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5fc0094b0 con 0x7fe60c056960 2026-02-23T06:49:18.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.982+0000 7fe611a81640 1 --2- 10.20.193.58:0/3230893200 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe60c056960 0x7fe60c13adf0 secure :-1 s=READY pgs=117 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe5fc009960 tx=0x7fe5fc0028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:18.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.982+0000 7fe5fa7fc640 1 -- 10.20.193.58:0/3230893200 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe5fc038470 con 0x7fe60c056960 2026-02-23T06:49:18.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.982+0000 7fe5fa7fc640 1 -- 10.20.193.58:0/3230893200 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5fc0386c0 con 0x7fe60c056960 2026-02-23T06:49:18.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.982+0000 7fe5fa7fc640 1 -- 10.20.193.58:0/3230893200 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe5fc038af0 con 0x7fe60c056960 2026-02-23T06:49:18.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.982+0000 7fe612a83640 1 -- 10.20.193.58:0/3230893200 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe60c200f70 con 0x7fe60c056960 2026-02-23T06:49:18.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.982+0000 7fe612a83640 1 -- 10.20.193.58:0/3230893200 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe60c13b330 con 0x7fe60c056960 2026-02-23T06:49:18.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.982+0000 7fe612a83640 1 --2- 10.20.193.58:0/3230893200 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe60c0af150 0x7fe60c0af520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:18.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.982+0000 7fe612a83640 1 -- 10.20.193.58:0/3230893200 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe60c059690 con 0x7fe60c0af150 2026-02-23T06:49:18.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.983+0000 7fe611280640 1 --2- 10.20.193.58:0/3230893200 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe60c0af150 0x7fe60c0af520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:18.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.983+0000 7fe611280640 1 -- 10.20.193.58:0/3230893200 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe60c0593b0 con 0x7fe60c0af150 2026-02-23T06:49:18.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.983+0000 7fe5fa7fc640 1 -- 10.20.193.58:0/3230893200 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fe5fc038c50 con 0x7fe60c056960 2026-02-23T06:49:18.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.983+0000 7fe611280640 1 --2- 10.20.193.58:0/3230893200 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe60c0af150 0x7fe60c0af520 secure :-1 s=READY pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe60c13cf10 tx=0x7fe60000e970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:18.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.985+0000 7fe5fa7fc640 1 --2- 10.20.193.58:0/3230893200 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe5dc07a6c0 0x7fe5dc09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:18.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.985+0000 7fe5fa7fc640 1 -- 10.20.193.58:0/3230893200 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fe5fc0c2b90 con 0x7fe60c056960 2026-02-23T06:49:18.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.985+0000 7fe5fa7fc640 1 -- 10.20.193.58:0/3230893200 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6000040d0 con 0x7fe60c0af150 2026-02-23T06:49:18.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.985+0000 7fe5fa7fc640 1 -- 10.20.193.58:0/3230893200 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fe600004230 con 0x7fe60c0af150 2026-02-23T06:49:18.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.985+0000 7fe5fa7fc640 1 -- 10.20.193.58:0/3230893200 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe60c0af150 msgr2=0x7fe60c0af520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:18.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.985+0000 7fe5fa7fc640 1 --2- 10.20.193.58:0/3230893200 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe60c0af150 0x7fe60c0af520 secure :-1 s=READY pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe60c13cf10 tx=0x7fe60000e970 comp rx=0 tx=0).stop 2026-02-23T06:49:18.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.985+0000 7fe5fa7fc640 1 -- 10.20.193.58:0/3230893200 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe60c0af150 msgr2=0x7fe60c0af520 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:49:18.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.985+0000 7fe5fa7fc640 1 --2- 10.20.193.58:0/3230893200 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe60c0af150 0x7fe60c0af520 secure :-1 s=CLOSED pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe60c13cf10 tx=0x7fe60000e970 comp rx=0 tx=0).stop 2026-02-23T06:49:18.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.985+0000 7fe612282640 1 --2- 10.20.193.58:0/3230893200 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe5dc07a6c0 0x7fe5dc09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:18.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.986+0000 7fe612282640 1 --2- 10.20.193.58:0/3230893200 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe5dc07a6c0 0x7fe5dc09ab70 secure :-1 s=READY pgs=573 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe608005820 tx=0x7fe60800a310 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:18.982 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.988+0000 7fe612a83640 1 --2- 10.20.193.58:0/3230893200 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe60c158af0 0x7fe60c158ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:18.982 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.988+0000 7fe612a83640 1 -- 10.20.193.58:0/3230893200 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe60c2013f0 con 0x7fe60c158af0 2026-02-23T06:49:18.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.989+0000 7fe611280640 1 --2- 10.20.193.58:0/3230893200 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe60c158af0 0x7fe60c158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:18.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.989+0000 7fe611280640 1 -- 10.20.193.58:0/3230893200 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe60c0b70f0 con 0x7fe60c158af0 2026-02-23T06:49:18.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.989+0000 7fe611280640 1 --2- 10.20.193.58:0/3230893200 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe60c158af0 0x7fe60c158ec0 secure :-1 s=READY pgs=13 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe60000eef0 tx=0x7fe6000026a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:18.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.990+0000 7fe5fa7fc640 1 -- 10.20.193.58:0/3230893200 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe600022070 con 0x7fe60c158af0 2026-02-23T06:49:18.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.990+0000 7fe5fa7fc640 1 -- 10.20.193.58:0/3230893200 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4912 (secure 0 0 0) 0x7fe600013420 con 0x7fe60c158af0 2026-02-23T06:49:18.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.990+0000 7fe5fa7fc640 1 -- 10.20.193.58:0/3230893200 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe60c158af0 msgr2=0x7fe60c158ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:18.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.990+0000 7fe5fa7fc640 1 --2- 10.20.193.58:0/3230893200 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe60c158af0 0x7fe60c158ec0 secure :-1 s=READY pgs=13 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe60000eef0 tx=0x7fe6000026a0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.985 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.990+0000 7fe5fa7fc640 1 -- 10.20.193.58:0/3230893200 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe60c158af0 msgr2=0x7fe60c158ec0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:49:18.985 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.990+0000 7fe5fa7fc640 1 --2- 10.20.193.58:0/3230893200 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe60c158af0 0x7fe60c158ec0 secure :-1 s=CLOSED pgs=13 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe60000eef0 tx=0x7fe6000026a0 comp rx=0 tx=0).stop 2026-02-23T06:49:18.985 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:49:18.985 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:49:18.985 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:49:18.985 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:49:18.985 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 242, 2026-02-23T06:49:18.986 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 26725, 2026-02-23T06:49:18.986 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:49:18.986 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:49:18.986 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:49:18.986 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:49:18.986 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:18.986 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 11, 2026-02-23T06:49:18.986 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:49:18.986 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:49:18.986 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:49:18.986 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:49:18.987 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:49:18.987 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:49:18.987 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:49:18.987 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:49:18.987 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:49:18.987 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:49:18.987 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:49:18.987 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:49:18.987 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:49:18.987 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:49:18.987 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:49:18.987 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:49:18.987 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:18.988 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:49:18.988 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:49:18.988 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:49:18.988 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:49:18.988 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:49:18.988 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:49:18.988 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:49:18.988 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:49:18.988 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:49:18.988 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:49:18.988 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:49:18.988 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:49:18.989 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:49:18.989 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:49:18.989 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:49:18.989 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:18.989 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.989 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:49:18.989 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:49:18.989 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:49:18.989 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:49:18.989 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:49:18.989 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:49:18.989 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:49:18.990 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:49:18.990 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:49:18.990 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:49:18.990 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:49:18.990 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:49:18.990 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:49:18.990 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:49:18.990 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:49:18.990 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:49:18.990 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:49:18.990 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:49:18.990 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:49:18.991 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:49:18.991 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:49:18.991 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:49:18.991 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:49:18.991 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:49:18.991 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:49:18.991 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:49:18.991 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:49:18.991 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:49:18.991 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:49:18.991 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:49:18.991 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:18.992 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:49:18.992 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.992 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:49:18.992 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.992 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:49:18.992 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:49:18.992 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:49:18.992 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:49:18.992 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.992 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:49:18.992 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:49:18.992 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:18.992 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.993 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.993 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:49:18.993 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:49:18.993 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:18.993 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:18.993 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:18.993 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.993 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:49:18.993 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:49:18.993 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:49:18.993 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:49:18.993 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:49:18.993 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:49:18.994 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.994 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.994 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:49:18.994 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:49:18.994 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:49:18.994 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:49:18.994 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.994 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:49:18.994 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:49:18.994 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:18.994 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.994 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.995 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:49:18.995 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:49:18.995 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:18.995 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:18.995 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:18.995 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.995 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:49:18.995 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:49:18.995 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:49:18.995 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:49:18.995 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:49:18.995 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:49:18.995 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.996 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.996 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:49:18.996 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:49:18.996 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:49:18.996 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:49:18.996 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.996 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:49:18.996 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:49:18.996 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:18.996 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.996 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.996 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:49:18.996 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:49:18.997 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:18.997 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:18.997 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:18.997 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.997 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:49:18.997 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:49:18.997 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:49:18.997 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:49:18.997 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:49:18.997 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:49:18.997 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:18.997 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:18.998 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.998 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:49:18.998 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:49:18.998 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.998 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:18.998 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:18.998 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:49:18.998 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:18.998 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:18.998 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:49:18.998 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:18.998 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:18.999 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:18.999 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:49:18.999 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:18.999 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:18.999 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:18.999 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:49:18.999 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:49:19.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.990+0000 7fe612a83640 1 -- 10.20.193.58:0/3230893200 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe5dc07a6c0 msgr2=0x7fe5dc09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:19.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.990+0000 7fe612a83640 1 --2- 10.20.193.58:0/3230893200 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe5dc07a6c0 0x7fe5dc09ab70 secure :-1 s=READY pgs=573 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe608005820 tx=0x7fe60800a310 comp rx=0 tx=0).stop 2026-02-23T06:49:19.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.990+0000 7fe612a83640 1 -- 10.20.193.58:0/3230893200 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe60c056960 msgr2=0x7fe60c13adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:19.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.990+0000 7fe612a83640 1 --2- 10.20.193.58:0/3230893200 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe60c056960 0x7fe60c13adf0 secure :-1 s=READY pgs=117 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe5fc009960 tx=0x7fe5fc0028d0 comp rx=0 tx=0).stop 2026-02-23T06:49:19.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.990+0000 7fe612282640 1 -- 10.20.193.58:0/3230893200 reap_dead start 2026-02-23T06:49:19.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.990+0000 7fe612282640 1 -- 10.20.193.58:0/3230893200 reap_dead start 2026-02-23T06:49:19.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.990+0000 7fe612a83640 1 -- 10.20.193.58:0/3230893200 shutdown_connections 2026-02-23T06:49:19.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.990+0000 7fe612a83640 1 -- 10.20.193.58:0/3230893200 >> 10.20.193.58:0/3230893200 conn(0x7fe60c0b3c20 msgr2=0x7fe60c0b1260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:49:19.001 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.990+0000 7fe612a83640 1 -- 10.20.193.58:0/3230893200 shutdown_connections 2026-02-23T06:49:19.002 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:18.990+0000 7fe612a83640 1 -- 10.20.193.58:0/3230893200 wait complete. 2026-02-23T06:49:19.002 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:49:19.002 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-23T06:49:19.002 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2026-02-23T06:49:19.002 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-23T06:49:19.002 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-23T06:49:19.003 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-23T06:49:19.003 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:49:19.011 INFO:tasks.ceph.mon.c:Stopped 2026-02-23T06:49:19.011 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.a 2026-02-23T06:49:19.011 INFO:tasks.mon_thrash:Sending STOP to mon a 2026-02-23T06:49:19.011 INFO:tasks.ceph.mon.a:Sent signal 19 2026-02-23T06:49:19.011 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-23T06:49:34.012 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.a 2026-02-23T06:49:34.012 INFO:tasks.mon_thrash:Sending CONT to mon a 2026-02-23T06:49:34.012 INFO:tasks.ceph.mon.a:Sent signal 18 2026-02-23T06:49:34.013 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-23T06:49:34.013 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:49:38.657 INFO:tasks.workunit.client.0.trial058.stdout:Syncing()...462 sec 2026-02-23T06:49:38.657 INFO:tasks.workunit.client.0.trial058.stdout:FFSB benchmark finished at: Mon Feb 23 06:49:38 2026 2026-02-23T06:49:38.657 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-23T06:49:38.657 INFO:tasks.workunit.client.0.trial058.stdout:Results: 2026-02-23T06:49:38.657 INFO:tasks.workunit.client.0.trial058.stdout:Benchmark took 798.49 sec 2026-02-23T06:49:38.657 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-23T06:49:38.657 INFO:tasks.workunit.client.0.trial058.stdout:Total Results 2026-02-23T06:49:38.658 INFO:tasks.workunit.client.0.trial058.stdout:=============== 2026-02-23T06:49:38.658 INFO:tasks.workunit.client.0.trial058.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2026-02-23T06:49:38.658 INFO:tasks.workunit.client.0.trial058.stdout: ======= ============ ========= ======= =========== ========== 2026-02-23T06:49:38.658 INFO:tasks.workunit.client.0.trial058.stdout: write : 45274880 56700.85 100.000% 100.000% 221MB/sec 2026-02-23T06:49:38.658 INFO:tasks.workunit.client.0.trial058.stdout:- 2026-02-23T06:49:38.658 INFO:tasks.workunit.client.0.trial058.stdout:56700.85 Transactions per Second 2026-02-23T06:49:38.658 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-23T06:49:38.658 INFO:tasks.workunit.client.0.trial058.stdout:Throughput Results 2026-02-23T06:49:38.658 INFO:tasks.workunit.client.0.trial058.stdout:=================== 2026-02-23T06:49:38.658 INFO:tasks.workunit.client.0.trial058.stdout:Write Throughput: 221MB/sec 2026-02-23T06:49:39.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.037+0000 7f9b36043640 1 -- 10.20.193.58:0/2160853018 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b18003a30 msgr2=0x7f9b18003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:39.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.037+0000 7f9b36043640 1 --2- 10.20.193.58:0/2160853018 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b18003a30 0x7f9b18003e20 secure :-1 s=READY pgs=124 gs=24 cs=0 l=1 c_cookie=14018589560088278743 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b14025310 tx=0x7f9b2002f320 comp rx=0 tx=0).stop 2026-02-23T06:49:39.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.037+0000 7f9b36043640 1 -- 10.20.193.58:0/2160853018 shutdown_connections 2026-02-23T06:49:39.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.037+0000 7f9b36043640 1 --2- 10.20.193.58:0/2160853018 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9b18005250 0x7f9b18065a10 unknown :-1 s=CLOSED pgs=0 gs=23 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:39.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.037+0000 7f9b36043640 1 --2- 10.20.193.58:0/2160853018 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b18004850 0x7f9b18004cc0 unknown :-1 s=CLOSED pgs=0 gs=25 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:39.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.037+0000 7f9b36043640 1 --2- 10.20.193.58:0/2160853018 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b18003a30 0x7f9b18003e20 unknown :-1 s=CLOSED pgs=124 gs=24 cs=0 l=1 c_cookie=14018589560088278743 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:39.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.037+0000 7f9b36043640 1 -- 10.20.193.58:0/2160853018 >> 10.20.193.58:0/2160853018 conn(0x7f9b300b3c20 msgr2=0x7f9b300b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:49:39.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.037+0000 7f9b36043640 1 -- 10.20.193.58:0/2160853018 shutdown_connections 2026-02-23T06:49:39.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.037+0000 7f9b36043640 1 -- 10.20.193.58:0/2160853018 wait complete. 2026-02-23T06:49:39.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.038+0000 7f9b36043640 1 Processor -- start 2026-02-23T06:49:39.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.038+0000 7f9b36043640 1 -- start start 2026-02-23T06:49:39.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.039+0000 7f9b36043640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b18003a30 0x7f9b300567f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:39.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.039+0000 7f9b36043640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b18004850 0x7f9b3013aca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:39.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.039+0000 7f9b36043640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9b18005250 0x7f9b3013b1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:39.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.039+0000 7f9b36043640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f9b30161c10 con 0x7f9b18004850 2026-02-23T06:49:39.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.039+0000 7f9b36043640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9b30162ee0 con 0x7f9b18003a30 2026-02-23T06:49:39.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.039+0000 7f9b36043640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f9b30139520 con 0x7f9b18005250 2026-02-23T06:49:39.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.039+0000 7f9b34840640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b18004850 0x7f9b3013aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:39.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.039+0000 7f9b35842640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9b18005250 msgr2=0x7f9b3013b1e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:49:39.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.039+0000 7f9b35842640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9b18005250 0x7f9b3013b1e0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:49:39.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.039+0000 7f9b34840640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b18004850 0x7f9b3013aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:36912/0 (socket says 10.20.193.58:36912) 2026-02-23T06:49:39.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.039+0000 7f9b34840640 1 -- 10.20.193.58:0/748114594 learned_addr learned my addr 10.20.193.58:0/748114594 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:49:39.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.039+0000 7f9b35041640 1 --2- 10.20.193.58:0/748114594 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b18003a30 0x7f9b300567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:39.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.039+0000 7f9b34840640 1 -- 10.20.193.58:0/748114594 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9b18005250 msgr2=0x7f9b3013b1e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:49:39.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.039+0000 7f9b34840640 1 --2- 10.20.193.58:0/748114594 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9b18005250 0x7f9b3013b1e0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:39.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.039+0000 7f9b34840640 1 -- 10.20.193.58:0/748114594 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b18003a30 msgr2=0x7f9b300567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:39.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.039+0000 7f9b34840640 1 --2- 10.20.193.58:0/748114594 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b18003a30 0x7f9b300567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:39.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.039+0000 7f9b34840640 1 -- 10.20.193.58:0/748114594 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b30161930 con 0x7f9b18004850 2026-02-23T06:49:39.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.040+0000 7f9b34840640 1 --2- 10.20.193.58:0/748114594 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b18004850 0x7f9b3013aca0 secure :-1 s=READY pgs=125 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b24012750 tx=0x7f9b24012850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:39.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.040+0000 7f9b1dffb640 1 -- 10.20.193.58:0/748114594 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9b24011880 con 0x7f9b18004850 2026-02-23T06:49:39.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.040+0000 7f9b1dffb640 1 -- 10.20.193.58:0/748114594 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b24018040 con 0x7f9b18004850 2026-02-23T06:49:39.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.040+0000 7f9b1dffb640 1 -- 10.20.193.58:0/748114594 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9b24011c20 con 0x7f9b18004850 2026-02-23T06:49:39.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.040+0000 7f9b36043640 1 -- 10.20.193.58:0/748114594 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b30162920 con 0x7f9b18004850 2026-02-23T06:49:39.036 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.040+0000 7f9b36043640 1 -- 10.20.193.58:0/748114594 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b30139000 con 0x7f9b18004850 2026-02-23T06:49:39.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.041+0000 7f9b36043640 1 -- 10.20.193.58:0/748114594 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b300b6d50 con 0x7f9b18004850 2026-02-23T06:49:39.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.042+0000 7f9b1dffb640 1 -- 10.20.193.58:0/748114594 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f9b2401d040 con 0x7f9b18004850 2026-02-23T06:49:39.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.043+0000 7f9b1dffb640 1 --2- 10.20.193.58:0/748114594 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9b0007a630 0x7f9b0009aae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:39.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.043+0000 7f9b1dffb640 1 -- 10.20.193.58:0/748114594 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f9b2409fb90 con 0x7f9b18004850 2026-02-23T06:49:39.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.043+0000 7f9b35041640 1 --2- 10.20.193.58:0/748114594 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9b0007a630 0x7f9b0009aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:39.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.044+0000 7f9b1dffb640 1 -- 10.20.193.58:0/748114594 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f9b24062db0 con 0x7f9b18004850 2026-02-23T06:49:39.038 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.044+0000 7f9b35041640 1 --2- 10.20.193.58:0/748114594 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9b0007a630 0x7f9b0009aae0 secure :-1 s=READY pgs=574 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b20002820 tx=0x7f9b2003a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:39.056 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-23T06:49:39.056 INFO:tasks.workunit.client.0.trial058.stdout:System Call Latency statistics in millisecs 2026-02-23T06:49:39.056 INFO:tasks.workunit.client.0.trial058.stdout:===== 2026-02-23T06:49:39.056 INFO:tasks.workunit.client.0.trial058.stdout: Min Avg Max Total Calls 2026-02-23T06:49:39.056 INFO:tasks.workunit.client.0.trial058.stdout: ======== ======== ======== ============ 2026-02-23T06:49:39.056 INFO:tasks.workunit.client.0.trial058.stdout:[ open] 0.013000 0.073585 99.250999 35371 2026-02-23T06:49:39.056 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2026-02-23T06:49:39.056 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2026-02-23T06:49:39.056 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2026-02-23T06:49:39.057 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2026-02-23T06:49:39.057 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2026-02-23T06:49:39.057 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2026-02-23T06:49:39.057 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[6] 50.000000 - 100.000000 : 1 2026-02-23T06:49:39.057 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[7] 20.000000 - 50.000000 : 13 2026-02-23T06:49:39.057 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[8] 10.000000 - 20.000000 : 32 2026-02-23T06:49:39.057 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[9] 5.000000 - 10.000000 : 91 2026-02-23T06:49:39.057 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[10] 2.000000 - 5.000000 : 79 2026-02-23T06:49:39.057 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[11] 1.000000 - 2.000000 : 35 2026-02-23T06:49:39.057 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[12] 0.500000 - 1.000000 : 31 2026-02-23T06:49:39.057 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[13] 0.200000 - 0.500000 : 91 2026-02-23T06:49:39.057 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[14] 0.100000 - 0.200000 : 79 2026-02-23T06:49:39.057 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[15] 0.050000 - 0.100000 : 315 2026-02-23T06:49:39.058 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[16] 0.020000 - 0.050000 : 10031 2026-02-23T06:49:39.058 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[17] 0.010000 - 0.020000 : 24573 2026-02-23T06:49:39.058 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2026-02-23T06:49:39.058 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-23T06:49:39.058 INFO:tasks.workunit.client.0.trial058.stdout:[ write] 0.004000 0.219104 57107.503906 45274880 2026-02-23T06:49:39.058 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[0] 5000.000000 - 10000.000000 : 247 2026-02-23T06:49:39.058 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[1] 2000.000000 - 5000.000000 : 253 2026-02-23T06:49:39.058 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[2] 1000.000000 - 2000.000000 : 179 2026-02-23T06:49:39.058 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[3] 500.000000 - 1000.000000 : 169 2026-02-23T06:49:39.058 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[4] 200.000000 - 500.000000 : 729 2026-02-23T06:49:39.058 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[5] 100.000000 - 200.000000 : 1016 2026-02-23T06:49:39.058 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[6] 50.000000 - 100.000000 : 1877 2026-02-23T06:49:39.059 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[7] 20.000000 - 50.000000 : 6575 2026-02-23T06:49:39.059 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[8] 10.000000 - 20.000000 : 16357 2026-02-23T06:49:39.059 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[9] 5.000000 - 10.000000 : 39765 2026-02-23T06:49:39.059 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[10] 2.000000 - 5.000000 : 25261 2026-02-23T06:49:39.059 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[11] 1.000000 - 2.000000 : 8821 2026-02-23T06:49:39.059 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[12] 0.500000 - 1.000000 : 7081 2026-02-23T06:49:39.059 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[13] 0.200000 - 0.500000 : 14141 2026-02-23T06:49:39.059 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[14] 0.100000 - 0.200000 : 18208 2026-02-23T06:49:39.059 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[15] 0.050000 - 0.100000 : 27502 2026-02-23T06:49:39.059 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[16] 0.020000 - 0.050000 : 124648 2026-02-23T06:49:39.059 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[17] 0.010000 - 0.020000 : 3020852 2026-02-23T06:49:39.059 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[18] 0.000000 - 0.010000 : 41960911 2026-02-23T06:49:39.059 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-23T06:49:39.060 INFO:tasks.workunit.client.0.trial058.stdout:[ lseek] 0.000000 0.002588 223.820999 45274880 2026-02-23T06:49:39.060 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2026-02-23T06:49:39.060 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2026-02-23T06:49:39.060 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2026-02-23T06:49:39.060 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2026-02-23T06:49:39.060 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[4] 200.000000 - 500.000000 : 1 2026-02-23T06:49:39.060 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[5] 100.000000 - 200.000000 : 12 2026-02-23T06:49:39.060 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[6] 50.000000 - 100.000000 : 57 2026-02-23T06:49:39.060 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[7] 20.000000 - 50.000000 : 467 2026-02-23T06:49:39.060 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[8] 10.000000 - 20.000000 : 1413 2026-02-23T06:49:39.060 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[9] 5.000000 - 10.000000 : 3919 2026-02-23T06:49:39.060 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[10] 2.000000 - 5.000000 : 2710 2026-02-23T06:49:39.061 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[11] 1.000000 - 2.000000 : 1004 2026-02-23T06:49:39.061 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[12] 0.500000 - 1.000000 : 834 2026-02-23T06:49:39.061 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[13] 0.200000 - 0.500000 : 1631 2026-02-23T06:49:39.061 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[14] 0.100000 - 0.200000 : 2106 2026-02-23T06:49:39.061 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[15] 0.050000 - 0.100000 : 2894 2026-02-23T06:49:39.061 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[16] 0.020000 - 0.050000 : 5279 2026-02-23T06:49:39.061 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[17] 0.010000 - 0.020000 : 6676 2026-02-23T06:49:39.061 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[18] 0.000000 - 0.010000 : 45245877 2026-02-23T06:49:39.061 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-23T06:49:39.061 INFO:tasks.workunit.client.0.trial058.stdout:[ close] 0.002000 0.012662 37.000000 35371 2026-02-23T06:49:39.061 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2026-02-23T06:49:39.061 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2026-02-23T06:49:39.061 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2026-02-23T06:49:39.062 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2026-02-23T06:49:39.062 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2026-02-23T06:49:39.062 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2026-02-23T06:49:39.062 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2026-02-23T06:49:39.062 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[7] 20.000000 - 50.000000 : 5 2026-02-23T06:49:39.062 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[8] 10.000000 - 20.000000 : 4 2026-02-23T06:49:39.062 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[9] 5.000000 - 10.000000 : 14 2026-02-23T06:49:39.062 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[10] 2.000000 - 5.000000 : 5 2026-02-23T06:49:39.062 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[11] 1.000000 - 2.000000 : 3 2026-02-23T06:49:39.062 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[12] 0.500000 - 1.000000 : 2 2026-02-23T06:49:39.062 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[13] 0.200000 - 0.500000 : 6 2026-02-23T06:49:39.062 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[14] 0.100000 - 0.200000 : 9 2026-02-23T06:49:39.062 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[15] 0.050000 - 0.100000 : 9 2026-02-23T06:49:39.063 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[16] 0.020000 - 0.050000 : 25 2026-02-23T06:49:39.063 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[17] 0.010000 - 0.020000 : 27 2026-02-23T06:49:39.063 INFO:tasks.workunit.client.0.trial058.stdout: msec_range[18] 0.000000 - 0.010000 : 35262 2026-02-23T06:49:39.063 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-23T06:49:39.063 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-23T06:49:39.063 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-23T06:49:39.063 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-23T06:49:39.063 INFO:tasks.workunit.client.0.trial058.stdout:3.7% User Time 2026-02-23T06:49:39.063 INFO:tasks.workunit.client.0.trial058.stdout:42.8% System Time 2026-02-23T06:49:39.063 INFO:tasks.workunit.client.0.trial058.stdout:46.5% CPU Utilization 2026-02-23T06:49:39.145 INFO:tasks.workunit.client.0.trial058.stderr:+ cd .. 2026-02-23T06:49:39.146 INFO:tasks.workunit.client.0.trial058.stderr:+ rm -r tmp ffsb 2026-02-23T06:49:39.192 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.198+0000 7f9b36043640 1 -- 10.20.193.58:0/748114594 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9b30138e60 con 0x7f9b18004850 2026-02-23T06:49:39.193 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.199+0000 7f9b1dffb640 1 -- 10.20.193.58:0/748114594 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1749 (secure 0 0 0) 0x7f9b30138e60 con 0x7f9b18004850 2026-02-23T06:49:39.193 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":246,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:49:39.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.200+0000 7f9b36043640 1 -- 10.20.193.58:0/748114594 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9b0007a630 msgr2=0x7f9b0009aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:39.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.200+0000 7f9b36043640 1 --2- 10.20.193.58:0/748114594 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9b0007a630 0x7f9b0009aae0 secure :-1 s=READY pgs=574 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b20002820 tx=0x7f9b2003a040 comp rx=0 tx=0).stop 2026-02-23T06:49:39.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.200+0000 7f9b36043640 1 -- 10.20.193.58:0/748114594 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b18004850 msgr2=0x7f9b3013aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:39.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.200+0000 7f9b36043640 1 --2- 10.20.193.58:0/748114594 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b18004850 0x7f9b3013aca0 secure :-1 s=READY pgs=125 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b24012750 tx=0x7f9b24012850 comp rx=0 tx=0).stop 2026-02-23T06:49:39.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.200+0000 7f9b36043640 1 -- 10.20.193.58:0/748114594 shutdown_connections 2026-02-23T06:49:39.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.200+0000 7f9b36043640 1 --2- 10.20.193.58:0/748114594 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9b0007a630 0x7f9b0009aae0 unknown :-1 s=CLOSED pgs=574 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:39.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.200+0000 7f9b36043640 1 --2- 10.20.193.58:0/748114594 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9b18005250 0x7f9b3013b1e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:39.195 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.200+0000 7f9b36043640 1 --2- 10.20.193.58:0/748114594 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9b18004850 0x7f9b3013aca0 unknown :-1 s=CLOSED pgs=125 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:39.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.200+0000 7f9b36043640 1 --2- 10.20.193.58:0/748114594 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9b18003a30 0x7f9b300567f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:39.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.200+0000 7f9b36043640 1 -- 10.20.193.58:0/748114594 >> 10.20.193.58:0/748114594 conn(0x7f9b300b3c20 msgr2=0x7f9b3015c170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:49:39.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.200+0000 7f9b36043640 1 -- 10.20.193.58:0/748114594 shutdown_connections 2026-02-23T06:49:39.196 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.200+0000 7f9b36043640 1 -- 10.20.193.58:0/748114594 wait complete. 2026-02-23T06:49:39.207 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-23T06:49:39.207 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-23T06:49:39.208 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:49:39.329 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.335+0000 7fe41a514640 1 -- 10.20.193.58:0/1380918034 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3fc003a30 msgr2=0x7fe3fc003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:39.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.335+0000 7fe41a514640 1 --2- 10.20.193.58:0/1380918034 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3fc003a30 0x7fe3fc003e40 secure :-1 s=READY pgs=127 gs=4 cs=0 l=1 c_cookie=13714880663576935343 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe404009b40 tx=0x7fe40402fc80 comp rx=0 tx=0).stop 2026-02-23T06:49:39.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.335+0000 7fe419d13640 1 -- 10.20.193.58:0/1380918034 reap_dead start 2026-02-23T06:49:39.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.335+0000 7fe41a514640 1 -- 10.20.193.58:0/1380918034 shutdown_connections 2026-02-23T06:49:39.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.335+0000 7fe41a514640 1 -- 10.20.193.58:0/1380918034 >> 10.20.193.58:0/1380918034 conn(0x7fe4140b3c20 msgr2=0x7fe4140b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:49:39.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.335+0000 7fe41a514640 1 -- 10.20.193.58:0/1380918034 shutdown_connections 2026-02-23T06:49:39.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.335+0000 7fe41a514640 1 -- 10.20.193.58:0/1380918034 wait complete. 2026-02-23T06:49:39.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.337+0000 7fe41a514640 1 Processor -- start 2026-02-23T06:49:39.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.337+0000 7fe41a514640 1 -- start start 2026-02-23T06:49:39.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.337+0000 7fe41a514640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe41413b940 0x7fe41412c6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:39.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.337+0000 7fe41a514640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe41412cc00 0x7fe4140585e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:39.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.337+0000 7fe41a514640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe414161a40 0x7fe414058b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:39.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.337+0000 7fe41a514640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe414161260 con 0x7fe414161a40 2026-02-23T06:49:39.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.337+0000 7fe41a514640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe4141627e0 con 0x7fe41413b940 2026-02-23T06:49:39.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.337+0000 7fe41a514640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe4140af5f0 con 0x7fe41412cc00 2026-02-23T06:49:39.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.337+0000 7fe418d11640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe41412cc00 msgr2=0x7fe4140585e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:49:39.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.337+0000 7fe418d11640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe41412cc00 0x7fe4140585e0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:49:39.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.337+0000 7fe419d13640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe414161a40 0x7fe414058b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:39.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.337+0000 7fe419d13640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe414161a40 0x7fe414058b20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:36918/0 (socket says 10.20.193.58:36918) 2026-02-23T06:49:39.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.337+0000 7fe419d13640 1 -- 10.20.193.58:0/1305847540 learned_addr learned my addr 10.20.193.58:0/1305847540 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:49:39.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.337+0000 7fe419512640 1 --2- 10.20.193.58:0/1305847540 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe41413b940 0x7fe41412c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:39.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.338+0000 7fe419d13640 1 -- 10.20.193.58:0/1305847540 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe41412cc00 msgr2=0x7fe4140585e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:49:39.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.338+0000 7fe419d13640 1 --2- 10.20.193.58:0/1305847540 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe41412cc00 0x7fe4140585e0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:39.334 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.338+0000 7fe419d13640 1 -- 10.20.193.58:0/1305847540 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe41413b940 msgr2=0x7fe41412c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:39.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.338+0000 7fe419d13640 1 --2- 10.20.193.58:0/1305847540 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe41413b940 0x7fe41412c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:39.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.338+0000 7fe419d13640 1 -- 10.20.193.58:0/1305847540 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4140af8d0 con 0x7fe414161a40 2026-02-23T06:49:39.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.338+0000 7fe419d13640 1 --2- 10.20.193.58:0/1305847540 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe414161a40 0x7fe414058b20 secure :-1 s=READY pgs=128 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe41405c580 tx=0x7fe41000c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:39.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.338+0000 7fe401ffb640 1 -- 10.20.193.58:0/1305847540 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe41000c780 con 0x7fe414161a40 2026-02-23T06:49:39.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.338+0000 7fe401ffb640 1 -- 10.20.193.58:0/1305847540 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe41000c9d0 con 0x7fe414161a40 2026-02-23T06:49:39.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.338+0000 7fe41a514640 1 -- 10.20.193.58:0/1305847540 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4140afbb0 con 0x7fe414161a40 2026-02-23T06:49:39.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.338+0000 7fe401ffb640 1 -- 10.20.193.58:0/1305847540 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe41000cd80 con 0x7fe414161a40 2026-02-23T06:49:39.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.338+0000 7fe41a514640 1 -- 10.20.193.58:0/1305847540 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe414162470 con 0x7fe414161a40 2026-02-23T06:49:39.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.339+0000 7fe41a514640 1 --2- 10.20.193.58:0/1305847540 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe414160870 0x7fe41412fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:39.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.339+0000 7fe41a514640 1 -- 10.20.193.58:0/1305847540 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe4140609c0 con 0x7fe414160870 2026-02-23T06:49:39.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.339+0000 7fe419512640 1 --2- 10.20.193.58:0/1305847540 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe414160870 0x7fe41412fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:39.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.339+0000 7fe419512640 1 -- 10.20.193.58:0/1305847540 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe41405b620 con 0x7fe414160870 2026-02-23T06:49:39.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.339+0000 7fe419512640 1 --2- 10.20.193.58:0/1305847540 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe414160870 0x7fe41412fcb0 secure :-1 s=READY pgs=129 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe404004740 tx=0x7fe404004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:39.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.340+0000 7fe401ffb640 1 -- 10.20.193.58:0/1305847540 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe404004210 con 0x7fe414160870 2026-02-23T06:49:39.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.340+0000 7fe401ffb640 1 -- 10.20.193.58:0/1305847540 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fe404004370 con 0x7fe414160870 2026-02-23T06:49:39.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.340+0000 7fe401ffb640 1 -- 10.20.193.58:0/1305847540 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe414160870 msgr2=0x7fe41412fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:39.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.340+0000 7fe401ffb640 1 --2- 10.20.193.58:0/1305847540 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe414160870 0x7fe41412fcb0 secure :-1 s=READY pgs=129 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe404004740 tx=0x7fe404004af0 comp rx=0 tx=0).stop 2026-02-23T06:49:39.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.340+0000 7fe401ffb640 1 -- 10.20.193.58:0/1305847540 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe414160870 msgr2=0x7fe41412fcb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:49:39.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.340+0000 7fe401ffb640 1 --2- 10.20.193.58:0/1305847540 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe414160870 0x7fe41412fcb0 secure :-1 s=CLOSED pgs=129 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe404004740 tx=0x7fe404004af0 comp rx=0 tx=0).stop 2026-02-23T06:49:39.337 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.340+0000 7fe401ffb640 1 -- 10.20.193.58:0/1305847540 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fe410007110 con 0x7fe414161a40 2026-02-23T06:49:39.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.341+0000 7fe401ffb640 1 --2- 10.20.193.58:0/1305847540 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe3e407a3c0 0x7fe3e409a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:39.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.341+0000 7fe401ffb640 1 -- 10.20.193.58:0/1305847540 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fe41009d560 con 0x7fe414161a40 2026-02-23T06:49:39.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.341+0000 7fe419512640 1 --2- 10.20.193.58:0/1305847540 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe3e407a3c0 0x7fe3e409a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:39.338 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.342+0000 7fe419512640 1 --2- 10.20.193.58:0/1305847540 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe3e407a3c0 0x7fe3e409a870 secure :-1 s=READY pgs=575 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe404005c30 tx=0x7fe40403c000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:39.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.343+0000 7fe41a514640 1 --2- 10.20.193.58:0/1305847540 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe4140af040 0x7fe4141301f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:39.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.343+0000 7fe41a514640 1 -- 10.20.193.58:0/1305847540 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe41415c410 con 0x7fe4140af040 2026-02-23T06:49:39.339 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.344+0000 7fe418d11640 1 --2- 10.20.193.58:0/1305847540 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe4140af040 0x7fe4141301f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:39.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.344+0000 7fe418d11640 1 -- 10.20.193.58:0/1305847540 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe41405c3e0 con 0x7fe4140af040 2026-02-23T06:49:39.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.344+0000 7fe418d11640 1 --2- 10.20.193.58:0/1305847540 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe4140af040 0x7fe4141301f0 secure :-1 s=READY pgs=130 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe414158140 tx=0x7fe40800e9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:39.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.344+0000 7fe401ffb640 1 -- 10.20.193.58:0/1305847540 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe408010970 con 0x7fe4140af040 2026-02-23T06:49:39.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.344+0000 7fe401ffb640 1 -- 10.20.193.58:0/1305847540 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5404 (secure 0 0 0) 0x7fe408010ad0 con 0x7fe4140af040 2026-02-23T06:49:39.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.344+0000 7fe401ffb640 1 -- 10.20.193.58:0/1305847540 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe4140af040 msgr2=0x7fe4141301f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:39.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.344+0000 7fe401ffb640 1 --2- 10.20.193.58:0/1305847540 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe4140af040 0x7fe4141301f0 secure :-1 s=READY pgs=130 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe414158140 tx=0x7fe40800e9b0 comp rx=0 tx=0).stop 2026-02-23T06:49:39.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.344+0000 7fe401ffb640 1 -- 10.20.193.58:0/1305847540 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe4140af040 msgr2=0x7fe4141301f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:49:39.340 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.344+0000 7fe401ffb640 1 --2- 10.20.193.58:0/1305847540 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe4140af040 0x7fe4141301f0 secure :-1 s=CLOSED pgs=130 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe414158140 tx=0x7fe40800e9b0 comp rx=0 tx=0).stop 2026-02-23T06:49:39.340 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:49:39.341 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:49:39.341 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:49:39.341 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:49:39.341 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 246, 2026-02-23T06:49:39.341 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 150662, 2026-02-23T06:49:39.341 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:49:39.341 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:49:39.341 INFO:teuthology.orchestra.run.trial058.stdout: 1 2026-02-23T06:49:39.341 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:39.341 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:49:39.342 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:49:39.342 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:49:39.342 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:49:39.342 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:49:39.342 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:49:39.342 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:49:39.342 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:49:39.342 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:49:39.342 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:49:39.342 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:49:39.342 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:49:39.342 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:49:39.343 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:49:39.343 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:49:39.343 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:49:39.343 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:49:39.343 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:39.343 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:49:39.343 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:49:39.343 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:49:39.343 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:49:39.343 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:49:39.343 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:49:39.343 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:49:39.344 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:49:39.344 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:49:39.344 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:49:39.344 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:49:39.344 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:49:39.344 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:49:39.344 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:49:39.344 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:49:39.344 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:39.344 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:39.344 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:49:39.344 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:49:39.345 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:49:39.345 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:49:39.345 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:49:39.345 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:49:39.345 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:49:39.345 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:49:39.345 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:49:39.345 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:49:39.345 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:49:39.345 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:49:39.345 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:49:39.345 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:49:39.346 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:49:39.346 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:49:39.346 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:49:39.346 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:49:39.346 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:49:39.346 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:49:39.346 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:49:39.346 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:49:39.346 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:49:39.346 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:49:39.346 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:49:39.346 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:49:39.346 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:49:39.347 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:49:39.347 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:49:39.347 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:49:39.347 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:39.347 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:49:39.347 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:39.347 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:49:39.347 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.347 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:49:39.347 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:49:39.347 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:49:39.347 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:49:39.348 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.348 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:49:39.348 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:49:39.348 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:39.348 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:39.348 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.348 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:49:39.348 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:49:39.348 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:39.348 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:39.348 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:39.348 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:39.349 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:49:39.349 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:49:39.349 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:49:39.349 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:49:39.349 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:49:39.349 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:49:39.349 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:39.349 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.349 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:49:39.349 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:49:39.349 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:49:39.349 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:49:39.349 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.350 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:49:39.350 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:49:39.350 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:39.350 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:39.350 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.350 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:49:39.350 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:49:39.350 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:39.350 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:39.350 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:39.350 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:39.350 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:49:39.350 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:49:39.351 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:49:39.351 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:49:39.351 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:49:39.351 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:49:39.351 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:39.351 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.351 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:49:39.351 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:49:39.351 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:49:39.351 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:49:39.351 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.351 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:49:39.352 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:49:39.352 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:39.352 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:39.352 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.352 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:49:39.352 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:49:39.352 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:39.352 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:39.352 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:39.352 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:39.352 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:49:39.352 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:49:39.352 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:49:39.353 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:49:39.353 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:49:39.353 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:49:39.353 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:39.353 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:39.353 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:39.353 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:49:39.353 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:49:39.353 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.353 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:39.353 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:39.353 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:49:39.354 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:39.354 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:39.354 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:49:39.354 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.354 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:39.354 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:39.354 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:49:39.354 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:39.354 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:39.355 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:49:39.355 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.355 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:39.355 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:39.355 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:49:39.355 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:39.355 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:39.355 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:49:39.355 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.355 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:39.355 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:39.355 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:49:39.356 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:39.356 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:39.356 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:49:39.356 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.356 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:39.356 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:39.356 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:49:39.356 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:39.356 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:39.356 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:39.356 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:49:39.356 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:49:39.358 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.344+0000 7fe41a514640 1 -- 10.20.193.58:0/1305847540 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe3e407a3c0 msgr2=0x7fe3e409a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:39.358 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.344+0000 7fe41a514640 1 --2- 10.20.193.58:0/1305847540 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe3e407a3c0 0x7fe3e409a870 secure :-1 s=READY pgs=575 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe404005c30 tx=0x7fe40403c000 comp rx=0 tx=0).stop 2026-02-23T06:49:39.358 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.344+0000 7fe41a514640 1 -- 10.20.193.58:0/1305847540 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe414161a40 msgr2=0x7fe414058b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:39.358 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.344+0000 7fe41a514640 1 --2- 10.20.193.58:0/1305847540 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe414161a40 0x7fe414058b20 secure :-1 s=READY pgs=128 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe41405c580 tx=0x7fe41000c460 comp rx=0 tx=0).stop 2026-02-23T06:49:39.359 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.344+0000 7fe419d13640 1 -- 10.20.193.58:0/1305847540 reap_dead start 2026-02-23T06:49:39.359 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.344+0000 7fe419d13640 1 -- 10.20.193.58:0/1305847540 reap_dead start 2026-02-23T06:49:39.359 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.345+0000 7fe41a514640 1 -- 10.20.193.58:0/1305847540 shutdown_connections 2026-02-23T06:49:39.359 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.345+0000 7fe41a514640 1 -- 10.20.193.58:0/1305847540 >> 10.20.193.58:0/1305847540 conn(0x7fe4140b3c20 msgr2=0x7fe414159e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:49:39.359 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.345+0000 7fe41a514640 1 -- 10.20.193.58:0/1305847540 shutdown_connections 2026-02-23T06:49:39.359 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.345+0000 7fe41a514640 1 -- 10.20.193.58:0/1305847540 wait complete. 2026-02-23T06:49:39.359 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:49:39.360 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-23T06:49:39.360 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:49:39.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.487+0000 7fbdf72c3640 1 -- 10.20.193.58:0/2442814396 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbdf00b6020 msgr2=0x7fbdf015ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:39.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.487+0000 7fbdf72c3640 1 --2- 10.20.193.58:0/2442814396 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbdf00b6020 0x7fbdf015ce30 secure :-1 s=READY pgs=131 gs=2 cs=0 l=1 c_cookie=9842365739942659090 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdec005820 tx=0x7fbdec030360 comp rx=0 tx=0).stop 2026-02-23T06:49:39.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.487+0000 7fbdf72c3640 1 -- 10.20.193.58:0/2442814396 shutdown_connections 2026-02-23T06:49:39.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.487+0000 7fbdf72c3640 1 --2- 10.20.193.58:0/2442814396 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbdf00b6020 0x7fbdf015ce30 unknown :-1 s=CLOSED pgs=131 gs=2 cs=0 l=1 c_cookie=9842365739942659090 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:39.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.487+0000 7fbdf72c3640 1 --2- 10.20.193.58:0/2442814396 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbdf00b10e0 0x7fbdf005b230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:39.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.487+0000 7fbdf72c3640 1 -- 10.20.193.58:0/2442814396 >> 10.20.193.58:0/2442814396 conn(0x7fbdf00561f0 msgr2=0x7fbdf00565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:49:39.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.487+0000 7fbdf72c3640 1 -- 10.20.193.58:0/2442814396 shutdown_connections 2026-02-23T06:49:39.483 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.487+0000 7fbdf72c3640 1 -- 10.20.193.58:0/2442814396 wait complete. 2026-02-23T06:49:39.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.488+0000 7fbdf72c3640 1 Processor -- start 2026-02-23T06:49:39.484 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.488+0000 7fbdf72c3640 1 -- start start 2026-02-23T06:49:39.488 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.489+0000 7fbdf72c3640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbdf00b10e0 0x7fbdf01647a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:39.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.489+0000 7fbdf72c3640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbdf00b6020 0x7fbdf0162840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:39.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.489+0000 7fbdf72c3640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbdf0163c70 0x7fbdf0165e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:39.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.489+0000 7fbdf72c3640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf013be60 con 0x7fbdf00b6020 2026-02-23T06:49:39.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.489+0000 7fbdf72c3640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf0165a00 con 0x7fbdf00b10e0 2026-02-23T06:49:39.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.489+0000 7fbdf72c3640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fbdf013eeb0 con 0x7fbdf0163c70 2026-02-23T06:49:39.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.489+0000 7fbdf5839640 1 -- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbdf0163c70 msgr2=0x7fbdf0165e20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.93:3301/0 2026-02-23T06:49:39.489 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.489+0000 7fbdf5839640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbdf0163c70 0x7fbdf0165e20 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:49:39.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.489+0000 7fbdf5038640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbdf00b10e0 0x7fbdf01647a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:39.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.489+0000 7fbdf5038640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbdf00b10e0 0x7fbdf01647a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:38872/0 (socket says 10.20.193.58:38872) 2026-02-23T06:49:39.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.489+0000 7fbdf5038640 1 -- 10.20.193.58:0/3884487471 learned_addr learned my addr 10.20.193.58:0/3884487471 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:49:39.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.489+0000 7fbdf4837640 1 --2- 10.20.193.58:0/3884487471 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbdf00b6020 0x7fbdf0162840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:39.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.489+0000 7fbdf5038640 1 -- 10.20.193.58:0/3884487471 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbdf0163c70 msgr2=0x7fbdf0165e20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:49:39.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.489+0000 7fbdf5038640 1 --2- 10.20.193.58:0/3884487471 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbdf0163c70 0x7fbdf0165e20 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:39.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.489+0000 7fbdf5038640 1 -- 10.20.193.58:0/3884487471 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbdf00b6020 msgr2=0x7fbdf0162840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:39.490 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.489+0000 7fbdf5038640 1 --2- 10.20.193.58:0/3884487471 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbdf00b6020 0x7fbdf0162840 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:39.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.489+0000 7fbdf5038640 1 -- 10.20.193.58:0/3884487471 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdec00a590 con 0x7fbdf00b10e0 2026-02-23T06:49:39.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.490+0000 7fbdf5038640 1 --2- 10.20.193.58:0/3884487471 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbdf00b10e0 0x7fbdf01647a0 secure :-1 s=READY pgs=167 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbde0006fd0 tx=0x7fbde000bbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:39.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.490+0000 7fbdddffb640 1 -- 10.20.193.58:0/3884487471 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbde0002cd0 con 0x7fbdf00b10e0 2026-02-23T06:49:39.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.490+0000 7fbdddffb640 1 -- 10.20.193.58:0/3884487471 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbde0004070 con 0x7fbdf00b10e0 2026-02-23T06:49:39.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.490+0000 7fbdddffb640 1 -- 10.20.193.58:0/3884487471 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbde0004460 con 0x7fbdf00b10e0 2026-02-23T06:49:39.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.490+0000 7fbdf72c3640 1 -- 10.20.193.58:0/3884487471 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdf013d690 con 0x7fbdf00b10e0 2026-02-23T06:49:39.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.490+0000 7fbdf72c3640 1 -- 10.20.193.58:0/3884487471 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdf015cdb0 con 0x7fbdf00b10e0 2026-02-23T06:49:39.491 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.490+0000 7fbdf72c3640 1 --2- 10.20.193.58:0/3884487471 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbdf00b0a10 0x7fbdf01652a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:39.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.490+0000 7fbdf72c3640 1 -- 10.20.193.58:0/3884487471 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf013bc40 con 0x7fbdf00b0a10 2026-02-23T06:49:39.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.491+0000 7fbdf4837640 1 --2- 10.20.193.58:0/3884487471 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbdf00b0a10 0x7fbdf01652a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:39.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.491+0000 7fbdf4837640 1 -- 10.20.193.58:0/3884487471 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbdf0166a80 con 0x7fbdf00b0a10 2026-02-23T06:49:39.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.491+0000 7fbdf4837640 1 --2- 10.20.193.58:0/3884487471 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbdf00b0a10 0x7fbdf01652a0 secure :-1 s=READY pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdf00b03b0 tx=0x7fbde400fc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:39.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.491+0000 7fbdddffb640 1 -- 10.20.193.58:0/3884487471 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbde4005270 con 0x7fbdf00b0a10 2026-02-23T06:49:39.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.492+0000 7fbdddffb640 1 -- 10.20.193.58:0/3884487471 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fbde40053d0 con 0x7fbdf00b0a10 2026-02-23T06:49:39.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.492+0000 7fbdddffb640 1 -- 10.20.193.58:0/3884487471 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbdf00b0a10 msgr2=0x7fbdf01652a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:39.492 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.492+0000 7fbdddffb640 1 --2- 10.20.193.58:0/3884487471 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbdf00b0a10 0x7fbdf01652a0 secure :-1 s=READY pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdf00b03b0 tx=0x7fbde400fc10 comp rx=0 tx=0).stop 2026-02-23T06:49:39.493 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.492+0000 7fbdddffb640 1 -- 10.20.193.58:0/3884487471 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbdf00b0a10 msgr2=0x7fbdf01652a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:49:39.493 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.492+0000 7fbdddffb640 1 --2- 10.20.193.58:0/3884487471 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbdf00b0a10 0x7fbdf01652a0 unknown :-1 s=CLOSED pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:49:39.493 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.492+0000 7fbdddffb640 1 -- 10.20.193.58:0/3884487471 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fbde00045c0 con 0x7fbdf00b10e0 2026-02-23T06:49:39.493 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.493+0000 7fbdddffb640 1 --2- 10.20.193.58:0/3884487471 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbdc007a3c0 0x7fbdc009a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:39.493 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.493+0000 7fbdddffb640 1 -- 10.20.193.58:0/3884487471 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fbde009cfe0 con 0x7fbdf00b10e0 2026-02-23T06:49:39.493 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.493+0000 7fbdf4837640 1 --2- 10.20.193.58:0/3884487471 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbdc007a3c0 0x7fbdc009a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:39.493 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.493+0000 7fbdf4837640 1 --2- 10.20.193.58:0/3884487471 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbdc007a3c0 0x7fbdc009a870 secure :-1 s=READY pgs=576 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdf00b03b0 tx=0x7fbde4009030 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:39.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.496+0000 7fbdf72c3640 1 --2- 10.20.193.58:0/3884487471 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbdf0166360 0x7fbdf0201420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:49:39.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.496+0000 7fbdf72c3640 1 -- 10.20.193.58:0/3884487471 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf01676b0 con 0x7fbdf0166360 2026-02-23T06:49:39.495 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.496+0000 7fbdf5839640 1 --2- 10.20.193.58:0/3884487471 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbdf0166360 0x7fbdf0201420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:49:39.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.496+0000 7fbdf5839640 1 -- 10.20.193.58:0/3884487471 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbdf0165c70 con 0x7fbdf0166360 2026-02-23T06:49:39.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.497+0000 7fbdf5839640 1 --2- 10.20.193.58:0/3884487471 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbdf0166360 0x7fbdf0201420 secure :-1 s=READY pgs=169 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdf00b6420 tx=0x7fbdec004b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:49:39.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.497+0000 7fbdddffb640 1 -- 10.20.193.58:0/3884487471 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbdec040070 con 0x7fbdf0166360 2026-02-23T06:49:39.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.497+0000 7fbdddffb640 1 -- 10.20.193.58:0/3884487471 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5545 (secure 0 0 0) 0x7fbdec005100 con 0x7fbdf0166360 2026-02-23T06:49:39.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.497+0000 7fbdddffb640 1 -- 10.20.193.58:0/3884487471 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbdf0166360 msgr2=0x7fbdf0201420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:39.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.497+0000 7fbdddffb640 1 --2- 10.20.193.58:0/3884487471 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbdf0166360 0x7fbdf0201420 secure :-1 s=READY pgs=169 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdf00b6420 tx=0x7fbdec004b00 comp rx=0 tx=0).stop 2026-02-23T06:49:39.496 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.497+0000 7fbdddffb640 1 -- 10.20.193.58:0/3884487471 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbdf0166360 msgr2=0x7fbdf0201420 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:49:39.496 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:49:39.497 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:49:39.497 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:49:39.497 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:49:39.497 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 246, 2026-02-23T06:49:39.497 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 265854, 2026-02-23T06:49:39.497 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:49:39.497 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:49:39.497 INFO:teuthology.orchestra.run.trial058.stdout: 1 2026-02-23T06:49:39.497 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:39.497 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:49:39.498 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:49:39.498 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:49:39.498 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:49:39.498 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:49:39.498 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:49:39.498 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:49:39.498 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:49:39.498 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:49:39.498 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:49:39.498 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:49:39.498 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:49:39.498 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:49:39.499 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:49:39.499 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:49:39.499 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:49:39.499 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:49:39.499 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:39.499 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:49:39.499 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:49:39.499 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:49:39.499 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:49:39.499 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:49:39.499 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:49:39.499 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:49:39.500 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:49:39.500 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:49:39.500 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:49:39.500 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:49:39.500 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:49:39.500 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:49:39.500 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:49:39.500 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:49:39.500 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:39.500 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:39.500 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:49:39.500 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:49:39.501 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:49:39.501 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:49:39.501 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:49:39.501 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:49:39.501 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:49:39.501 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:49:39.501 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:49:39.501 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:49:39.501 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:49:39.501 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:49:39.501 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:49:39.501 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:49:39.502 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:49:39.502 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:49:39.502 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:49:39.502 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:49:39.502 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:49:39.502 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:49:39.502 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:49:39.502 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:49:39.502 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:49:39.502 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:49:39.502 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:49:39.502 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:49:39.502 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:49:39.503 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:49:39.503 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:49:39.503 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:49:39.503 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:39.503 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:49:39.503 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:39.503 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:49:39.503 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.503 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:49:39.503 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:49:39.503 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:49:39.503 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:49:39.504 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.504 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:49:39.504 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:49:39.504 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:39.504 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:39.504 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.504 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:49:39.504 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:49:39.504 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:39.504 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:39.504 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:39.504 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:39.505 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:49:39.505 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:49:39.505 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:49:39.505 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:49:39.505 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:49:39.505 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:49:39.505 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:39.505 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.505 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:49:39.505 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:49:39.505 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:49:39.505 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:49:39.505 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.506 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:49:39.506 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:49:39.506 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:39.506 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:39.506 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.506 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:49:39.506 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:49:39.506 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:39.506 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:39.506 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:39.506 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:39.506 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:49:39.507 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:49:39.507 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:49:39.507 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:49:39.507 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:49:39.507 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:49:39.507 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:39.507 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.507 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:49:39.507 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:49:39.507 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:49:39.507 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:49:39.507 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.507 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:49:39.508 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:49:39.508 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:39.508 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:39.508 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.508 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:49:39.508 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:49:39.508 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:49:39.508 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:39.508 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:39.508 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:39.508 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:49:39.508 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:49:39.509 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:49:39.509 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:49:39.509 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:49:39.509 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:49:39.509 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:39.509 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:39.509 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:39.509 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:49:39.509 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:49:39.509 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.509 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:39.509 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:39.510 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:49:39.510 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:39.510 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:39.510 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:49:39.510 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.510 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:39.510 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:39.510 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:49:39.510 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:39.510 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:39.510 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:49:39.510 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.511 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:39.511 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:39.511 INFO:teuthology.orchestra.run.trial058.stdout: "num": 7 2026-02-23T06:49:39.511 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:39.511 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:39.511 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:49:39.511 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.511 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:49:39.511 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:49:39.511 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:49:39.511 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:39.511 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.511 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:39.512 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:39.512 INFO:teuthology.orchestra.run.trial058.stdout: "num": 6 2026-02-23T06:49:39.512 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:39.512 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:49:39.512 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:49:39.512 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:49:39.512 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:49:39.512 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:49:39.512 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:49:39.512 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:49:39.512 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:49:39.512 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:49:39.512 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:49:39.513 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:49:39.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.497+0000 7fbdddffb640 1 --2- 10.20.193.58:0/3884487471 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbdf0166360 0x7fbdf0201420 secure :-1 s=CLOSED pgs=169 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdf00b6420 tx=0x7fbdec004b00 comp rx=0 tx=0).stop 2026-02-23T06:49:39.514 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.497+0000 7fbdf72c3640 1 -- 10.20.193.58:0/3884487471 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbdc007a3c0 msgr2=0x7fbdc009a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:39.515 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.497+0000 7fbdf72c3640 1 --2- 10.20.193.58:0/3884487471 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbdc007a3c0 0x7fbdc009a870 secure :-1 s=READY pgs=576 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdf00b03b0 tx=0x7fbde4009030 comp rx=0 tx=0).stop 2026-02-23T06:49:39.515 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.497+0000 7fbdf72c3640 1 -- 10.20.193.58:0/3884487471 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbdf00b10e0 msgr2=0x7fbdf01647a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:49:39.515 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.497+0000 7fbdf72c3640 1 --2- 10.20.193.58:0/3884487471 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbdf00b10e0 0x7fbdf01647a0 secure :-1 s=READY pgs=167 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbde0006fd0 tx=0x7fbde000bbf0 comp rx=0 tx=0).stop 2026-02-23T06:49:39.515 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.497+0000 7fbdf5839640 1 -- 10.20.193.58:0/3884487471 reap_dead start 2026-02-23T06:49:39.515 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.497+0000 7fbdf5839640 1 -- 10.20.193.58:0/3884487471 reap_dead start 2026-02-23T06:49:39.515 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.497+0000 7fbdf72c3640 1 -- 10.20.193.58:0/3884487471 shutdown_connections 2026-02-23T06:49:39.515 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.497+0000 7fbdf72c3640 1 -- 10.20.193.58:0/3884487471 >> 10.20.193.58:0/3884487471 conn(0x7fbdf00561f0 msgr2=0x7fbdf00add50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:49:39.515 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.497+0000 7fbdf72c3640 1 -- 10.20.193.58:0/3884487471 shutdown_connections 2026-02-23T06:49:39.515 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:49:39.497+0000 7fbdf72c3640 1 -- 10.20.193.58:0/3884487471 wait complete. 2026-02-23T06:49:39.516 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-23T06:49:39.516 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-23T06:49:40.169 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-23T06:49:40.169 DEBUG:teuthology.orchestra.run.trial058:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-23T06:49:40.394 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2026-02-23T06:49:40.394 DEBUG:teuthology.orchestra.run.trial058:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-23T06:49:41.492 DEBUG:teuthology.parallel:result is None 2026-02-23T06:49:41.492 DEBUG:teuthology.orchestra.run.trial058:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-23T06:49:41.556 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-23T06:49:41.557 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2026-02-23T06:49:41.572 INFO:tasks.mon_thrash:joining mon_thrasher 2026-02-23T06:49:45.601 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:49:45.606 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:49:59.516 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-23T06:49:59.517 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-23T06:49:59.517 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-23T06:49:59.517 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-23T06:49:59.520 INFO:tasks.ceph.mon.c:Started 2026-02-23T06:49:59.520 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.a 2026-02-23T06:49:59.520 INFO:tasks.mon_thrash:Sending STOP to mon a 2026-02-23T06:49:59.520 INFO:tasks.ceph.mon.a:Sent signal 19 2026-02-23T06:49:59.520 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-23T06:50:14.520 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.a 2026-02-23T06:50:14.521 INFO:tasks.mon_thrash:Sending CONT to mon a 2026-02-23T06:50:14.521 INFO:tasks.ceph.mon.a:Sent signal 18 2026-02-23T06:50:14.521 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:50:14.521 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:50:15.663 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:50:15.668 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:50:17.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.648+0000 7f1204a5a640 1 -- 10.20.193.58:0/3817878727 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11e4003730 msgr2=0x7f11e4023b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:17.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.648+0000 7f1204a5a640 1 --2- 10.20.193.58:0/3817878727 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11e4003730 0x7f11e4023b70 secure :-1 s=READY pgs=6 gs=19 cs=0 l=1 c_cookie=1794435605245883956 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11f4002870 tx=0x7f11f40305e0 comp rx=0 tx=0).stop 2026-02-23T06:50:17.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.648+0000 7f11ff577640 1 -- 10.20.193.58:0/3817878727 reap_dead start 2026-02-23T06:50:17.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.648+0000 7f1204a5a640 1 -- 10.20.193.58:0/3817878727 shutdown_connections 2026-02-23T06:50:17.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.648+0000 7f1204a5a640 1 -- 10.20.193.58:0/3817878727 >> 10.20.193.58:0/3817878727 conn(0x7f12000b3c20 msgr2=0x7f12000b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:50:17.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.648+0000 7f1204a5a640 1 -- 10.20.193.58:0/3817878727 shutdown_connections 2026-02-23T06:50:17.642 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.648+0000 7f1204a5a640 1 -- 10.20.193.58:0/3817878727 wait complete. 2026-02-23T06:50:17.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.650+0000 7f1204a5a640 1 Processor -- start 2026-02-23T06:50:17.643 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.650+0000 7f1204a5a640 1 -- start start 2026-02-23T06:50:17.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.651+0000 7f1204a5a640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11e4003730 0x7f120013fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:17.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.651+0000 7f1204a5a640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f120015ee50 0x7f12001624f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:17.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.651+0000 7f1204a5a640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f120015e370 0x7f120015e810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:17.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.651+0000 7f1204a5a640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f120015df50 con 0x7f120015e370 2026-02-23T06:50:17.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.651+0000 7f1204a5a640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f120013ebc0 con 0x7f120015ee50 2026-02-23T06:50:17.644 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.651+0000 7f1204a5a640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f120015dc40 con 0x7f11e4003730 2026-02-23T06:50:17.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.651+0000 7f11ff577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f120015e370 0x7f120015e810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:17.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.651+0000 7f11ff577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f120015e370 0x7f120015e810 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:45326/0 (socket says 10.20.193.58:45326) 2026-02-23T06:50:17.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.651+0000 7f11ff577640 1 -- 10.20.193.58:0/654423662 learned_addr learned my addr 10.20.193.58:0/654423662 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:50:17.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.651+0000 7f11fe575640 1 --2- 10.20.193.58:0/654423662 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f120015ee50 0x7f12001624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:17.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.651+0000 7f11fed76640 1 --2- 10.20.193.58:0/654423662 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11e4003730 0x7f120013fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:17.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.651+0000 7f11ff577640 1 -- 10.20.193.58:0/654423662 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f120015e370 msgr2=0x7f120015e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-23T06:50:17.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.651+0000 7f11ff577640 1 -- 10.20.193.58:0/654423662 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f120015e370 msgr2=0x7f120015e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:50:17.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.651+0000 7f11ff577640 1 --2- 10.20.193.58:0/654423662 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f120015e370 0x7f120015e810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:50:17.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.651+0000 7f11ff577640 1 --2- 10.20.193.58:0/654423662 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f120015e370 0x7f120015e810 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:50:17.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.651+0000 7f11fe575640 1 -- 10.20.193.58:0/654423662 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f120015ee50 msgr2=0x7f12001624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-23T06:50:17.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.651+0000 7f11fe575640 1 -- 10.20.193.58:0/654423662 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f120015ee50 msgr2=0x7f12001624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-23T06:50:17.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.651+0000 7f11fe575640 1 --2- 10.20.193.58:0/654423662 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f120015ee50 0x7f12001624f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-23T06:50:17.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.651+0000 7f11fe575640 1 --2- 10.20.193.58:0/654423662 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f120015ee50 0x7f12001624f0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-23T06:50:17.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.651+0000 7f11fed76640 1 -- 10.20.193.58:0/654423662 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f120015ee50 msgr2=0x7f12001624f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:50:17.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.651+0000 7f11fed76640 1 --2- 10.20.193.58:0/654423662 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f120015ee50 0x7f12001624f0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:17.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.651+0000 7f11fed76640 1 -- 10.20.193.58:0/654423662 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f120015e370 msgr2=0x7f120015e810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-23T06:50:17.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.651+0000 7f11fed76640 1 --2- 10.20.193.58:0/654423662 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f120015e370 0x7f120015e810 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:17.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.651+0000 7f11fed76640 1 -- 10.20.193.58:0/654423662 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11f4004540 con 0x7f11e4003730 2026-02-23T06:50:17.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.651+0000 7f11fed76640 1 --2- 10.20.193.58:0/654423662 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11e4003730 0x7f120013fd20 secure :-1 s=READY pgs=7 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11e4046fa0 tx=0x7f11f4039610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:50:17.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.652+0000 7f11df7fe640 1 -- 10.20.193.58:0/654423662 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f11f4049070 con 0x7f11e4003730 2026-02-23T06:50:17.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.652+0000 7f1204a5a640 1 -- 10.20.193.58:0/654423662 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f120013fa60 con 0x7f11e4003730 2026-02-23T06:50:17.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.652+0000 7f11df7fe640 1 -- 10.20.193.58:0/654423662 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11f403ae60 con 0x7f11e4003730 2026-02-23T06:50:17.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.652+0000 7f11df7fe640 1 -- 10.20.193.58:0/654423662 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f11f4039a80 con 0x7f11e4003730 2026-02-23T06:50:17.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.652+0000 7f1204a5a640 1 -- 10.20.193.58:0/654423662 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f120015f240 con 0x7f11e4003730 2026-02-23T06:50:17.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.652+0000 7f1204a5a640 1 -- 10.20.193.58:0/654423662 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12000b6d50 con 0x7f11e4003730 2026-02-23T06:50:17.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.654+0000 7f11df7fe640 1 -- 10.20.193.58:0/654423662 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f11f4039be0 con 0x7f11e4003730 2026-02-23T06:50:17.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.655+0000 7f11df7fe640 1 --2- 10.20.193.58:0/654423662 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f11cc07a6c0 0x7f11cc09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:17.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.656+0000 7f11df7fe640 1 -- 10.20.193.58:0/654423662 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f11f40c3ff0 con 0x7f11e4003730 2026-02-23T06:50:17.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.656+0000 7f11fe575640 1 --2- 10.20.193.58:0/654423662 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f11cc07a6c0 0x7f11cc09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:17.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.656+0000 7f11fe575640 1 --2- 10.20.193.58:0/654423662 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f11cc07a6c0 0x7f11cc09ab70 secure :-1 s=READY pgs=579 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f120015bfa0 tx=0x7f11e8005ba0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:50:17.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.657+0000 7f11df7fe640 1 -- 10.20.193.58:0/654423662 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f11f40871a0 con 0x7f11e4003730 2026-02-23T06:50:17.804 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.810+0000 7f1204a5a640 1 -- 10.20.193.58:0/654423662 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f120013fa60 con 0x7f11e4003730 2026-02-23T06:50:17.804 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.810+0000 7f11df7fe640 1 -- 10.20.193.58:0/654423662 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1750 (secure 0 0 0) 0x7f120013fa60 con 0x7f11e4003730 2026-02-23T06:50:17.805 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":248,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":13,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:50:17.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.811+0000 7f1204a5a640 1 -- 10.20.193.58:0/654423662 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f11cc07a6c0 msgr2=0x7f11cc09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:17.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.811+0000 7f1204a5a640 1 --2- 10.20.193.58:0/654423662 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f11cc07a6c0 0x7f11cc09ab70 secure :-1 s=READY pgs=579 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f120015bfa0 tx=0x7f11e8005ba0 comp rx=0 tx=0).stop 2026-02-23T06:50:17.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.811+0000 7f1204a5a640 1 -- 10.20.193.58:0/654423662 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11e4003730 msgr2=0x7f120013fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:17.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.811+0000 7f1204a5a640 1 --2- 10.20.193.58:0/654423662 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11e4003730 0x7f120013fd20 secure :-1 s=READY pgs=7 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11e4046fa0 tx=0x7f11f4039610 comp rx=0 tx=0).stop 2026-02-23T06:50:17.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.811+0000 7f1204a5a640 1 -- 10.20.193.58:0/654423662 shutdown_connections 2026-02-23T06:50:17.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.811+0000 7f1204a5a640 1 --2- 10.20.193.58:0/654423662 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f11cc07a6c0 0x7f11cc09ab70 unknown :-1 s=CLOSED pgs=579 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:17.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.811+0000 7f1204a5a640 1 --2- 10.20.193.58:0/654423662 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f120015e370 0x7f120015e810 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:17.806 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.811+0000 7f1204a5a640 1 --2- 10.20.193.58:0/654423662 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f120015ee50 0x7f12001624f0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:17.807 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.811+0000 7f1204a5a640 1 --2- 10.20.193.58:0/654423662 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f11e4003730 0x7f120013fd20 unknown :-1 s=CLOSED pgs=7 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:17.807 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.811+0000 7f1204a5a640 1 -- 10.20.193.58:0/654423662 >> 10.20.193.58:0/654423662 conn(0x7f12000b3c20 msgr2=0x7f120015b280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:50:17.807 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.811+0000 7f1204a5a640 1 -- 10.20.193.58:0/654423662 shutdown_connections 2026-02-23T06:50:17.807 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:17.811+0000 7f1204a5a640 1 -- 10.20.193.58:0/654423662 wait complete. 2026-02-23T06:50:20.819 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:50:20.943 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.949+0000 7f69b568c640 1 -- 10.20.193.58:0/139201050 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f69b0163820 msgr2=0x7f69b015d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:20.943 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.949+0000 7f69b568c640 1 --2- 10.20.193.58:0/139201050 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f69b0163820 0x7f69b015d380 secure :-1 s=READY pgs=137 gs=2 cs=0 l=1 c_cookie=4134929581177354913 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69b0059e30 tx=0x7f69a0030340 comp rx=0 tx=0).stop 2026-02-23T06:50:20.943 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.949+0000 7f69b568c640 1 -- 10.20.193.58:0/139201050 shutdown_connections 2026-02-23T06:50:20.943 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.949+0000 7f69b568c640 1 --2- 10.20.193.58:0/139201050 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f69b0163820 0x7f69b015d380 unknown :-1 s=CLOSED pgs=137 gs=2 cs=0 l=1 c_cookie=4134929581177354913 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:20.943 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.949+0000 7f69b568c640 1 --2- 10.20.193.58:0/139201050 >> v2:10.20.193.93:3300/0 conn(0x7f69b00b1170 0x7f69b015ce40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:20.944 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.949+0000 7f69b568c640 1 -- 10.20.193.58:0/139201050 >> 10.20.193.58:0/139201050 conn(0x7f69b0058e50 msgr2=0x7f69b0059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:50:20.944 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.949+0000 7f69b568c640 1 -- 10.20.193.58:0/139201050 shutdown_connections 2026-02-23T06:50:20.944 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.949+0000 7f69b568c640 1 -- 10.20.193.58:0/139201050 wait complete. 2026-02-23T06:50:20.944 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.950+0000 7f69b568c640 1 Processor -- start 2026-02-23T06:50:20.944 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.950+0000 7f69b568c640 1 -- start start 2026-02-23T06:50:20.945 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.951+0000 7f69b568c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f69b00b1170 0x7f69b00b02f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:20.945 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.951+0000 7f69b568c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f69b00b1540 0x7f69b00b7040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:20.945 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.951+0000 7f69b568c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f69b0163820 0x7f69b00b7580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:20.945 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.951+0000 7f69b568c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f69b01626a0 con 0x7f69b0163820 2026-02-23T06:50:20.945 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.951+0000 7f69b568c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f69b00b6bb0 con 0x7f69b00b1170 2026-02-23T06:50:20.945 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.951+0000 7f69b568c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f69b01fd7b0 con 0x7f69b00b1540 2026-02-23T06:50:20.945 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.951+0000 7f69af7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f69b0163820 0x7f69b00b7580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:20.945 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.951+0000 7f69af7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f69b0163820 0x7f69b00b7580 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:49770/0 (socket says 10.20.193.58:49770) 2026-02-23T06:50:20.945 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.951+0000 7f69af7fe640 1 -- 10.20.193.58:0/2835979797 learned_addr learned my addr 10.20.193.58:0/2835979797 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:50:20.945 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.951+0000 7f69aeffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f69b00b1170 0x7f69b00b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:20.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.951+0000 7f69ae7fc640 1 --2- 10.20.193.58:0/2835979797 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f69b00b1540 0x7f69b00b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:20.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.951+0000 7f69af7fe640 1 -- 10.20.193.58:0/2835979797 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f69b00b1540 msgr2=0x7f69b00b7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:20.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.951+0000 7f69af7fe640 1 --2- 10.20.193.58:0/2835979797 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f69b00b1540 0x7f69b00b7040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:20.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.951+0000 7f69af7fe640 1 -- 10.20.193.58:0/2835979797 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f69b00b1170 msgr2=0x7f69b00b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:20.947 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.951+0000 7f69af7fe640 1 --2- 10.20.193.58:0/2835979797 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f69b00b1170 0x7f69b00b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:20.947 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.951+0000 7f69af7fe640 1 -- 10.20.193.58:0/2835979797 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a000a650 con 0x7f69b0163820 2026-02-23T06:50:20.947 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.951+0000 7f69ae7fc640 1 --2- 10.20.193.58:0/2835979797 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f69b00b1540 0x7f69b00b7040 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:50:20.947 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.952+0000 7f69af7fe640 1 --2- 10.20.193.58:0/2835979797 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f69b0163820 0x7f69b00b7580 secure :-1 s=READY pgs=138 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69a00057b0 tx=0x7f69a0003d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:50:20.947 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.952+0000 7f698f7fe640 1 -- 10.20.193.58:0/2835979797 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f69a00398a0 con 0x7f69b0163820 2026-02-23T06:50:20.947 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.952+0000 7f698f7fe640 1 -- 10.20.193.58:0/2835979797 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69a0039af0 con 0x7f69b0163820 2026-02-23T06:50:20.947 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.952+0000 7f698f7fe640 1 -- 10.20.193.58:0/2835979797 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f69a0039ea0 con 0x7f69b0163820 2026-02-23T06:50:20.947 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.952+0000 7f69b568c640 1 -- 10.20.193.58:0/2835979797 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69b005e6d0 con 0x7f69b0163820 2026-02-23T06:50:20.947 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.952+0000 7f69b568c640 1 -- 10.20.193.58:0/2835979797 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69b00b0bf0 con 0x7f69b0163820 2026-02-23T06:50:20.947 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.953+0000 7f69b568c640 1 -- 10.20.193.58:0/2835979797 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69b005b2d0 con 0x7f69b0163820 2026-02-23T06:50:20.947 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.954+0000 7f698f7fe640 1 -- 10.20.193.58:0/2835979797 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f69a004b460 con 0x7f69b0163820 2026-02-23T06:50:20.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.955+0000 7f698f7fe640 1 --2- 10.20.193.58:0/2835979797 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f697c07a6c0 0x7f697c09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:20.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.955+0000 7f698f7fe640 1 -- 10.20.193.58:0/2835979797 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f69a00c4350 con 0x7f69b0163820 2026-02-23T06:50:20.948 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.955+0000 7f69aeffd640 1 --2- 10.20.193.58:0/2835979797 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f697c07a6c0 0x7f697c09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:20.949 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.955+0000 7f69aeffd640 1 --2- 10.20.193.58:0/2835979797 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f697c07a6c0 0x7f697c09ab70 secure :-1 s=READY pgs=580 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69a4004740 tx=0x7f69a4005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:50:20.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:20.956+0000 7f698f7fe640 1 -- 10.20.193.58:0/2835979797 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f69a0087460 con 0x7f69b0163820 2026-02-23T06:50:21.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:21.110+0000 7f69b568c640 1 -- 10.20.193.58:0/2835979797 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f69b00b6cf0 con 0x7f69b0163820 2026-02-23T06:50:21.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:21.111+0000 7f698f7fe640 1 -- 10.20.193.58:0/2835979797 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1749 (secure 0 0 0) 0x7f69a008a580 con 0x7f69b0163820 2026-02-23T06:50:21.105 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":250,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:50:21.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:21.112+0000 7f69b568c640 1 -- 10.20.193.58:0/2835979797 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f697c07a6c0 msgr2=0x7f697c09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:21.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:21.112+0000 7f69b568c640 1 --2- 10.20.193.58:0/2835979797 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f697c07a6c0 0x7f697c09ab70 secure :-1 s=READY pgs=580 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69a4004740 tx=0x7f69a4005f90 comp rx=0 tx=0).stop 2026-02-23T06:50:21.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:21.112+0000 7f69b568c640 1 -- 10.20.193.58:0/2835979797 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f69b0163820 msgr2=0x7f69b00b7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:21.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:21.112+0000 7f69b568c640 1 --2- 10.20.193.58:0/2835979797 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f69b0163820 0x7f69b00b7580 secure :-1 s=READY pgs=138 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69a00057b0 tx=0x7f69a0003d20 comp rx=0 tx=0).stop 2026-02-23T06:50:21.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:21.112+0000 7f69b568c640 1 -- 10.20.193.58:0/2835979797 shutdown_connections 2026-02-23T06:50:21.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:21.112+0000 7f69b568c640 1 --2- 10.20.193.58:0/2835979797 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f697c07a6c0 0x7f697c09ab70 unknown :-1 s=CLOSED pgs=580 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:21.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:21.112+0000 7f69b568c640 1 --2- 10.20.193.58:0/2835979797 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f69b0163820 0x7f69b00b7580 unknown :-1 s=CLOSED pgs=138 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:21.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:21.112+0000 7f69b568c640 1 --2- 10.20.193.58:0/2835979797 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f69b00b1540 0x7f69b00b7040 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:21.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:21.112+0000 7f69b568c640 1 --2- 10.20.193.58:0/2835979797 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f69b00b1170 0x7f69b00b02f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:21.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:21.112+0000 7f69b568c640 1 -- 10.20.193.58:0/2835979797 >> 10.20.193.58:0/2835979797 conn(0x7f69b0058e50 msgr2=0x7f69b005d970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:50:21.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:21.112+0000 7f69b568c640 1 -- 10.20.193.58:0/2835979797 shutdown_connections 2026-02-23T06:50:21.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:21.112+0000 7f69b568c640 1 -- 10.20.193.58:0/2835979797 wait complete. 2026-02-23T06:50:24.118 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:50:24.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.245+0000 7faac93be640 1 -- 10.20.193.58:0/1174056797 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faac4056960 msgr2=0x7faac40b6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.245+0000 7faac93be640 1 --2- 10.20.193.58:0/1174056797 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faac4056960 0x7faac40b6720 secure :-1 s=READY pgs=8 gs=2 cs=0 l=1 c_cookie=11118454215122643252 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faab4004740 tx=0x7faab402f180 comp rx=0 tx=0).stop 2026-02-23T06:50:24.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.245+0000 7faac93be640 1 -- 10.20.193.58:0/1174056797 shutdown_connections 2026-02-23T06:50:24.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.245+0000 7faac93be640 1 --2- 10.20.193.58:0/1174056797 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faac4056960 0x7faac40b6720 unknown :-1 s=CLOSED pgs=8 gs=2 cs=0 l=1 c_cookie=11118454215122643252 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.245+0000 7faac93be640 1 --2- 10.20.193.58:0/1174056797 >> v2:10.20.193.93:3300/0 conn(0x7faac415c4b0 0x7faac4058200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.245+0000 7faac93be640 1 -- 10.20.193.58:0/1174056797 >> 10.20.193.58:0/1174056797 conn(0x7faac40b3c20 msgr2=0x7faac40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:50:24.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.245+0000 7faac93be640 1 -- 10.20.193.58:0/1174056797 shutdown_connections 2026-02-23T06:50:24.240 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.245+0000 7faac93be640 1 -- 10.20.193.58:0/1174056797 wait complete. 2026-02-23T06:50:24.242 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.246+0000 7faac93be640 1 Processor -- start 2026-02-23T06:50:24.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.246+0000 7faac93be640 1 -- start start 2026-02-23T06:50:24.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.247+0000 7faac93be640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faac4056960 0x7faac41fdc10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:24.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.247+0000 7faac93be640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faac415c4b0 0x7faac40ad0d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:24.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.247+0000 7faac93be640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faac4162ca0 0x7faac40b00a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:24.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.247+0000 7faac93be640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7faac4165bf0 con 0x7faac415c4b0 2026-02-23T06:50:24.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.247+0000 7faac93be640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7faac4163830 con 0x7faac4162ca0 2026-02-23T06:50:24.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.247+0000 7faac93be640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7faac4163b10 con 0x7faac4056960 2026-02-23T06:50:24.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.247+0000 7faac37fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faac415c4b0 0x7faac40ad0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:24.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.247+0000 7faac37fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faac415c4b0 0x7faac40ad0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:49772/0 (socket says 10.20.193.58:49772) 2026-02-23T06:50:24.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.247+0000 7faac37fe640 1 -- 10.20.193.58:0/178706011 learned_addr learned my addr 10.20.193.58:0/178706011 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:50:24.243 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.247+0000 7faac3fff640 1 --2- 10.20.193.58:0/178706011 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faac4056960 0x7faac41fdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:24.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.247+0000 7faac8bbd640 1 --2- 10.20.193.58:0/178706011 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faac4162ca0 0x7faac40b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:24.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.247+0000 7faac37fe640 1 -- 10.20.193.58:0/178706011 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faac4056960 msgr2=0x7faac41fdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.247+0000 7faac37fe640 1 --2- 10.20.193.58:0/178706011 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faac4056960 0x7faac41fdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.247+0000 7faac37fe640 1 -- 10.20.193.58:0/178706011 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faac4162ca0 msgr2=0x7faac40b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.247+0000 7faac37fe640 1 --2- 10.20.193.58:0/178706011 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faac4162ca0 0x7faac40b00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.247+0000 7faac37fe640 1 -- 10.20.193.58:0/178706011 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab40094b0 con 0x7faac415c4b0 2026-02-23T06:50:24.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.247+0000 7faac37fe640 1 --2- 10.20.193.58:0/178706011 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faac415c4b0 0x7faac40ad0d0 secure :-1 s=READY pgs=140 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faab40023d0 tx=0x7faab4002950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:50:24.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.247+0000 7faac0ff9640 1 -- 10.20.193.58:0/178706011 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faab4038470 con 0x7faac415c4b0 2026-02-23T06:50:24.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.247+0000 7faac0ff9640 1 -- 10.20.193.58:0/178706011 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faab40386c0 con 0x7faac415c4b0 2026-02-23T06:50:24.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.247+0000 7faac0ff9640 1 -- 10.20.193.58:0/178706011 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faab4038ab0 con 0x7faac415c4b0 2026-02-23T06:50:24.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.248+0000 7faac93be640 1 -- 10.20.193.58:0/178706011 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faac4163df0 con 0x7faac415c4b0 2026-02-23T06:50:24.244 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.248+0000 7faac93be640 1 -- 10.20.193.58:0/178706011 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faac4141f30 con 0x7faac415c4b0 2026-02-23T06:50:24.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.249+0000 7faac93be640 1 -- 10.20.193.58:0/178706011 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faac4141d90 con 0x7faac415c4b0 2026-02-23T06:50:24.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.249+0000 7faac0ff9640 1 -- 10.20.193.58:0/178706011 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7faab4038c10 con 0x7faac415c4b0 2026-02-23T06:50:24.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.250+0000 7faac0ff9640 1 --2- 10.20.193.58:0/178706011 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa9407a6b0 0x7faa9409ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:24.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.250+0000 7faac0ff9640 1 -- 10.20.193.58:0/178706011 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7faab40c2c70 con 0x7faac415c4b0 2026-02-23T06:50:24.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.251+0000 7faac3fff640 1 --2- 10.20.193.58:0/178706011 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa9407a6b0 0x7faa9409ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:24.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.251+0000 7faac3fff640 1 --2- 10.20.193.58:0/178706011 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa9407a6b0 0x7faa9409ab60 secure :-1 s=READY pgs=581 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faab0004740 tx=0x7faab0005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:50:24.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.252+0000 7faac0ff9640 1 -- 10.20.193.58:0/178706011 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7faac4141d90 con 0x7faac415c4b0 2026-02-23T06:50:24.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.408+0000 7faac93be640 1 -- 10.20.193.58:0/178706011 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7faac40aea60 con 0x7faac415c4b0 2026-02-23T06:50:24.402 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.408+0000 7faac0ff9640 1 -- 10.20.193.58:0/178706011 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1755 (secure 0 0 0) 0x7faac40aea60 con 0x7faac415c4b0 2026-02-23T06:50:24.403 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":252,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:50:24.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.409+0000 7faac93be640 1 -- 10.20.193.58:0/178706011 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa9407a6b0 msgr2=0x7faa9409ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.409+0000 7faac93be640 1 --2- 10.20.193.58:0/178706011 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa9407a6b0 0x7faa9409ab60 secure :-1 s=READY pgs=581 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faab0004740 tx=0x7faab0005f90 comp rx=0 tx=0).stop 2026-02-23T06:50:24.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.409+0000 7faac93be640 1 -- 10.20.193.58:0/178706011 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faac415c4b0 msgr2=0x7faac40ad0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.409+0000 7faac93be640 1 --2- 10.20.193.58:0/178706011 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faac415c4b0 0x7faac40ad0d0 secure :-1 s=READY pgs=140 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faab40023d0 tx=0x7faab4002950 comp rx=0 tx=0).stop 2026-02-23T06:50:24.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.409+0000 7faac93be640 1 -- 10.20.193.58:0/178706011 shutdown_connections 2026-02-23T06:50:24.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.409+0000 7faac93be640 1 --2- 10.20.193.58:0/178706011 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa9407a6b0 0x7faa9409ab60 unknown :-1 s=CLOSED pgs=581 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.404 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.409+0000 7faac93be640 1 --2- 10.20.193.58:0/178706011 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faac4162ca0 0x7faac40b00a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.409+0000 7faac93be640 1 --2- 10.20.193.58:0/178706011 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faac415c4b0 0x7faac40ad0d0 unknown :-1 s=CLOSED pgs=140 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.409+0000 7faac93be640 1 --2- 10.20.193.58:0/178706011 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faac4056960 0x7faac41fdc10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.409+0000 7faac93be640 1 -- 10.20.193.58:0/178706011 >> 10.20.193.58:0/178706011 conn(0x7faac40b3c20 msgr2=0x7faac40b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:50:24.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.409+0000 7faac93be640 1 -- 10.20.193.58:0/178706011 shutdown_connections 2026-02-23T06:50:24.405 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.409+0000 7faac93be640 1 -- 10.20.193.58:0/178706011 wait complete. 2026-02-23T06:50:24.415 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:50:24.416 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-23T06:50:24.416 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-23T06:50:24.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.544+0000 7efdf1139640 1 -- 10.20.193.58:0/2022221712 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efdec0b6690 msgr2=0x7efdec058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.544+0000 7efdf1139640 1 --2- 10.20.193.58:0/2022221712 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efdec0b6690 0x7efdec058cf0 secure :-1 s=READY pgs=9 gs=3 cs=0 l=1 c_cookie=4211219141782269082 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efde0005820 tx=0x7efde00302b0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.545+0000 7efdf1139640 1 -- 10.20.193.58:0/2022221712 shutdown_connections 2026-02-23T06:50:24.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.545+0000 7efdf1139640 1 --2- 10.20.193.58:0/2022221712 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efdec0b6690 0x7efdec058cf0 unknown :-1 s=CLOSED pgs=9 gs=3 cs=0 l=1 c_cookie=4211219141782269082 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.545+0000 7efdf1139640 1 --2- 10.20.193.58:0/2022221712 >> v2:10.20.193.93:3300/0 conn(0x7efdec15d870 0x7efdec0587b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.545+0000 7efdf1139640 1 -- 10.20.193.58:0/2022221712 >> 10.20.193.58:0/2022221712 conn(0x7efdec0b3c20 msgr2=0x7efdec0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:50:24.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.545+0000 7efdf1139640 1 -- 10.20.193.58:0/2022221712 shutdown_connections 2026-02-23T06:50:24.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.545+0000 7efdf1139640 1 -- 10.20.193.58:0/2022221712 wait complete. 2026-02-23T06:50:24.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.546+0000 7efdf1139640 1 Processor -- start 2026-02-23T06:50:24.539 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.546+0000 7efdf1139640 1 -- start start 2026-02-23T06:50:24.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.546+0000 7efdf1139640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efdec0b6690 0x7efdec13f280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:24.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.546+0000 7efdf1139640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efdec15d4a0 0x7efdec13d1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:24.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.546+0000 7efdf1139640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efdec15d870 0x7efdec13d700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:24.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.546+0000 7efdf1139640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7efdec200c80 con 0x7efdec15d870 2026-02-23T06:50:24.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.546+0000 7efdf1139640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7efdec056630 con 0x7efdec15d4a0 2026-02-23T06:50:24.540 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.546+0000 7efdf1139640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7efdec056910 con 0x7efdec0b6690 2026-02-23T06:50:24.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.547+0000 7efdebfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efdec0b6690 0x7efdec13f280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:24.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.547+0000 7efdeb7fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efdec15d4a0 0x7efdec13d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:24.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.547+0000 7efdebfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efdec0b6690 0x7efdec13f280 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:39436/0 (socket says 10.20.193.58:39436) 2026-02-23T06:50:24.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.547+0000 7efdebfff640 1 -- 10.20.193.58:0/1957370911 learned_addr learned my addr 10.20.193.58:0/1957370911 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:50:24.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.547+0000 7efdf0938640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efdec15d870 0x7efdec13d700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:24.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.547+0000 7efdebfff640 1 -- 10.20.193.58:0/1957370911 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efdec15d4a0 msgr2=0x7efdec13d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.547+0000 7efdebfff640 1 --2- 10.20.193.58:0/1957370911 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efdec15d4a0 0x7efdec13d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.547+0000 7efdebfff640 1 -- 10.20.193.58:0/1957370911 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efdec15d870 msgr2=0x7efdec13d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.547+0000 7efdebfff640 1 --2- 10.20.193.58:0/1957370911 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efdec15d870 0x7efdec13d700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.547+0000 7efdebfff640 1 -- 10.20.193.58:0/1957370911 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde000a590 con 0x7efdec0b6690 2026-02-23T06:50:24.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.547+0000 7efdebfff640 1 --2- 10.20.193.58:0/1957370911 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efdec0b6690 0x7efdec13f280 secure :-1 s=READY pgs=10 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdd8007fd0 tx=0x7efdd800c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:50:24.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.547+0000 7efde8ff9640 1 -- 10.20.193.58:0/1957370911 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efdd8012910 con 0x7efdec0b6690 2026-02-23T06:50:24.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.547+0000 7efde8ff9640 1 -- 10.20.193.58:0/1957370911 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efdd8012b60 con 0x7efdec0b6690 2026-02-23T06:50:24.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.547+0000 7efde8ff9640 1 -- 10.20.193.58:0/1957370911 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efdd8011380 con 0x7efdec0b6690 2026-02-23T06:50:24.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.547+0000 7efdf1139640 1 -- 10.20.193.58:0/1957370911 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdec056bf0 con 0x7efdec0b6690 2026-02-23T06:50:24.541 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.547+0000 7efdf1139640 1 -- 10.20.193.58:0/1957370911 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efdec0571b0 con 0x7efdec0b6690 2026-02-23T06:50:24.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.548+0000 7efdf1139640 1 --2- 10.20.193.58:0/1957370911 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efdec161fa0 0x7efdec15fa40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:24.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.548+0000 7efdf1139640 1 -- 10.20.193.58:0/1957370911 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7efdec0b6330 con 0x7efdec161fa0 2026-02-23T06:50:24.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.548+0000 7efdeb7fe640 1 --2- 10.20.193.58:0/1957370911 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efdec161fa0 0x7efdec15fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:24.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.548+0000 7efdeb7fe640 1 -- 10.20.193.58:0/1957370911 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efdec0b5e10 con 0x7efdec161fa0 2026-02-23T06:50:24.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.549+0000 7efdeb7fe640 1 --2- 10.20.193.58:0/1957370911 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efdec161fa0 0x7efdec15fa40 secure :-1 s=READY pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdec15ad40 tx=0x7efddc009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:50:24.542 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.549+0000 7efde8ff9640 1 -- 10.20.193.58:0/1957370911 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efddc011920 con 0x7efdec161fa0 2026-02-23T06:50:24.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.549+0000 7efde8ff9640 1 -- 10.20.193.58:0/1957370911 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7efdd80114e0 con 0x7efdec0b6690 2026-02-23T06:50:24.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.550+0000 7efde8ff9640 1 --2- 10.20.193.58:0/1957370911 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efdbc07a660 0x7efdbc09ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:24.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.550+0000 7efde8ff9640 1 -- 10.20.193.58:0/1957370911 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7efddc011a80 con 0x7efdec161fa0 2026-02-23T06:50:24.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.550+0000 7efde8ff9640 1 -- 10.20.193.58:0/1957370911 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efdec161fa0 msgr2=0x7efdec15fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.550+0000 7efde8ff9640 1 --2- 10.20.193.58:0/1957370911 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efdec161fa0 0x7efdec15fa40 secure :-1 s=READY pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdec15ad40 tx=0x7efddc009ae0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.550+0000 7efde8ff9640 1 -- 10.20.193.58:0/1957370911 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efdec161fa0 msgr2=0x7efdec15fa40 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:50:24.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.550+0000 7efde8ff9640 1 --2- 10.20.193.58:0/1957370911 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efdec161fa0 0x7efdec15fa40 secure :-1 s=CLOSED pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdec15ad40 tx=0x7efddc009ae0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.550+0000 7efde8ff9640 1 -- 10.20.193.58:0/1957370911 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7efdd809d750 con 0x7efdec0b6690 2026-02-23T06:50:24.544 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.550+0000 7efdf0938640 1 --2- 10.20.193.58:0/1957370911 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efdbc07a660 0x7efdbc09ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:24.545 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.551+0000 7efdf0938640 1 --2- 10.20.193.58:0/1957370911 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efdbc07a660 0x7efdbc09ab10 secure :-1 s=READY pgs=582 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efde000a8c0 tx=0x7efde003b040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:50:24.547 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.554+0000 7efdf1139640 1 --2- 10.20.193.58:0/1957370911 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efdec15ff80 0x7efdec05bfa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:24.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.554+0000 7efdf1139640 1 -- 10.20.193.58:0/1957370911 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7efdec0b6d50 con 0x7efdec15ff80 2026-02-23T06:50:24.548 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.554+0000 7efdeb7fe640 1 --2- 10.20.193.58:0/1957370911 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efdec15ff80 0x7efdec05bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:24.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.554+0000 7efdeb7fe640 1 -- 10.20.193.58:0/1957370911 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efdec056a50 con 0x7efdec15ff80 2026-02-23T06:50:24.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.554+0000 7efdeb7fe640 1 --2- 10.20.193.58:0/1957370911 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efdec15ff80 0x7efdec05bfa0 secure :-1 s=READY pgs=142 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efddc017000 tx=0x7efddc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:50:24.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.555+0000 7efde8ff9640 1 -- 10.20.193.58:0/1957370911 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efddc024070 con 0x7efdec15ff80 2026-02-23T06:50:24.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.555+0000 7efde8ff9640 1 -- 10.20.193.58:0/1957370911 <== mon.0 v2:10.20.193.58:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5415 (secure 0 0 0) 0x7efddc01f7c0 con 0x7efdec15ff80 2026-02-23T06:50:24.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.555+0000 7efde8ff9640 1 -- 10.20.193.58:0/1957370911 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efdec15ff80 msgr2=0x7efdec05bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.555+0000 7efde8ff9640 1 --2- 10.20.193.58:0/1957370911 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efdec15ff80 0x7efdec05bfa0 secure :-1 s=READY pgs=142 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efddc017000 tx=0x7efddc004770 comp rx=0 tx=0).stop 2026-02-23T06:50:24.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.555+0000 7efde8ff9640 1 -- 10.20.193.58:0/1957370911 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efdec15ff80 msgr2=0x7efdec05bfa0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:50:24.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.555+0000 7efde8ff9640 1 --2- 10.20.193.58:0/1957370911 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efdec15ff80 0x7efdec05bfa0 secure :-1 s=CLOSED pgs=142 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efddc017000 tx=0x7efddc004770 comp rx=0 tx=0).stop 2026-02-23T06:50:24.549 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:50:24.550 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:50:24.550 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:50:24.550 INFO:teuthology.orchestra.run.trial058.stdout: "state": "leader", 2026-02-23T06:50:24.550 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 252, 2026-02-23T06:50:24.550 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 195873, 2026-02-23T06:50:24.550 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:50:24.550 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:50:24.550 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:50:24.550 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:50:24.550 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:50:24.550 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 0, 2026-02-23T06:50:24.550 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:50:24.550 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:50:24.550 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:50:24.550 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:50:24.551 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:50:24.551 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:50:24.551 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:50:24.551 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:50:24.551 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:50:24.551 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:50:24.551 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:50:24.551 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:50:24.551 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:50:24.551 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:50:24.551 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:50:24.551 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:50:24.551 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:50:24.551 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:50:24.551 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:50:24.551 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:50:24.552 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:50:24.552 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:50:24.552 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:50:24.552 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:50:24.552 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:50:24.552 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:50:24.552 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:50:24.552 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:50:24.552 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:50:24.552 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:50:24.552 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:50:24.552 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:50:24.552 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:50:24.552 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.552 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:50:24.552 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:50:24.552 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:50:24.553 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:50:24.553 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:50:24.553 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:50:24.553 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:50:24.553 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:50:24.553 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:50:24.553 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:50:24.553 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:50:24.553 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:50:24.553 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:50:24.553 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:50:24.553 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:50:24.553 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:50:24.553 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:50:24.553 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:50:24.553 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:50:24.554 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:50:24.554 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:50:24.554 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:50:24.554 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:50:24.554 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:50:24.554 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:50:24.554 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:50:24.554 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:50:24.554 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:50:24.554 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:50:24.554 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:50:24.554 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:50:24.554 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:50:24.554 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.554 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:50:24.554 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.554 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:50:24.554 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:50:24.555 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:50:24.555 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:50:24.555 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.555 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:50:24.555 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:50:24.555 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:50:24.555 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.555 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.555 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:50:24.555 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:50:24.555 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:50:24.555 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:50:24.555 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:50:24.555 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.555 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:50:24.556 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:50:24.556 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:50:24.556 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:50:24.556 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:50:24.556 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:50:24.556 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.556 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.556 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:50:24.556 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:50:24.556 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:50:24.556 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:50:24.556 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.556 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:50:24.556 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:50:24.556 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:50:24.556 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.556 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.556 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:50:24.557 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:50:24.557 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:50:24.557 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:50:24.557 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:50:24.557 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.557 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:50:24.557 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:50:24.557 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:50:24.557 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:50:24.557 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:50:24.557 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:50:24.557 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.557 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.557 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:50:24.557 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:50:24.557 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:50:24.557 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:50:24.558 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.558 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:50:24.558 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:50:24.558 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:50:24.558 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.558 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.558 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:50:24.558 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:50:24.558 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:50:24.558 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:50:24.558 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:50:24.558 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.558 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:50:24.558 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:50:24.558 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:50:24.558 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:50:24.558 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:50:24.559 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:50:24.559 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:50:24.559 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:50:24.559 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.559 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:50:24.559 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:50:24.559 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.559 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:50:24.559 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:50:24.559 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:50:24.559 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:50:24.559 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:50:24.559 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:50:24.559 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.559 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:50:24.559 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:50:24.559 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:50:24.560 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:50:24.560 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:50:24.560 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:50:24.560 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.560 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:50:24.560 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:50:24.560 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:50:24.560 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:50:24.560 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:50:24.560 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:50:24.560 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.560 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:50:24.560 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:50:24.560 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:50:24.560 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:50:24.560 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:50:24.560 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:50:24.561 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.561 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:50:24.561 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:50:24.561 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:50:24.561 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:50:24.561 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:50:24.561 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.561 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:50:24.561 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:50:24.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.555+0000 7efdf1139640 1 -- 10.20.193.58:0/1957370911 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efdbc07a660 msgr2=0x7efdbc09ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.555+0000 7efdf1139640 1 --2- 10.20.193.58:0/1957370911 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efdbc07a660 0x7efdbc09ab10 secure :-1 s=READY pgs=582 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efde000a8c0 tx=0x7efde003b040 comp rx=0 tx=0).stop 2026-02-23T06:50:24.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.555+0000 7efdf1139640 1 -- 10.20.193.58:0/1957370911 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efdec0b6690 msgr2=0x7efdec13f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.555+0000 7efdf1139640 1 --2- 10.20.193.58:0/1957370911 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efdec0b6690 0x7efdec13f280 secure :-1 s=READY pgs=10 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdd8007fd0 tx=0x7efdd800c970 comp rx=0 tx=0).stop 2026-02-23T06:50:24.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.555+0000 7efdf0938640 1 -- 10.20.193.58:0/1957370911 reap_dead start 2026-02-23T06:50:24.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.555+0000 7efdf0938640 1 -- 10.20.193.58:0/1957370911 reap_dead start 2026-02-23T06:50:24.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.555+0000 7efdf1139640 1 -- 10.20.193.58:0/1957370911 shutdown_connections 2026-02-23T06:50:24.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.555+0000 7efdf1139640 1 -- 10.20.193.58:0/1957370911 >> 10.20.193.58:0/1957370911 conn(0x7efdec0b3c20 msgr2=0x7efdec13df20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:50:24.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.555+0000 7efdf1139640 1 -- 10.20.193.58:0/1957370911 shutdown_connections 2026-02-23T06:50:24.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.555+0000 7efdf1139640 1 -- 10.20.193.58:0/1957370911 wait complete. 2026-02-23T06:50:24.563 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:50:24.563 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-23T06:50:24.563 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-23T06:50:24.683 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.690+0000 7f43abfff640 1 -- 10.20.193.58:0/1215193038 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f43ac0576d0 msgr2=0x7f43ac058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.690+0000 7f43abfff640 1 --2- 10.20.193.58:0/1215193038 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f43ac0576d0 0x7f43ac058200 secure :-1 s=READY pgs=144 gs=3 cs=0 l=1 c_cookie=4728745585222517237 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f439c006f50 tx=0x7f439c0303b0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.690+0000 7f43abfff640 1 -- 10.20.193.58:0/1215193038 shutdown_connections 2026-02-23T06:50:24.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.690+0000 7f43abfff640 1 --2- 10.20.193.58:0/1215193038 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f43ac0576d0 0x7f43ac058200 unknown :-1 s=CLOSED pgs=144 gs=3 cs=0 l=1 c_cookie=4728745585222517237 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.690+0000 7f43abfff640 1 -- 10.20.193.58:0/1215193038 >> 10.20.193.58:0/1215193038 conn(0x7f43ac0b3c20 msgr2=0x7f43ac0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:50:24.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.690+0000 7f43abfff640 1 -- 10.20.193.58:0/1215193038 shutdown_connections 2026-02-23T06:50:24.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.690+0000 7f43abfff640 1 -- 10.20.193.58:0/1215193038 wait complete. 2026-02-23T06:50:24.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.691+0000 7f43abfff640 1 Processor -- start 2026-02-23T06:50:24.684 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.691+0000 7f43abfff640 1 -- start start 2026-02-23T06:50:24.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.691+0000 7f43abfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f43ac056960 0x7f43ac11e200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:24.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.691+0000 7f43abfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f43ac0576d0 0x7f43ac15adc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:24.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.691+0000 7f43abfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f43ac15c4b0 0x7f43ac0af510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:24.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.691+0000 7f43abfff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac121590 con 0x7f43ac15c4b0 2026-02-23T06:50:24.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.691+0000 7f43abfff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac159d80 con 0x7f43ac056960 2026-02-23T06:50:24.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.691+0000 7f43abfff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f43ac121bc0 con 0x7f43ac0576d0 2026-02-23T06:50:24.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.692+0000 7f43ab7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f43ac15c4b0 0x7f43ac0af510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:24.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.692+0000 7f43aaffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f43ac056960 0x7f43ac11e200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:24.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.692+0000 7f43ab7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f43ac15c4b0 0x7f43ac0af510 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:49812/0 (socket says 10.20.193.58:49812) 2026-02-23T06:50:24.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.692+0000 7f43ab7fe640 1 -- 10.20.193.58:0/492041429 learned_addr learned my addr 10.20.193.58:0/492041429 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:50:24.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.692+0000 7f43aa7fc640 1 --2- 10.20.193.58:0/492041429 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f43ac0576d0 0x7f43ac15adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:24.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.692+0000 7f43ab7fe640 1 -- 10.20.193.58:0/492041429 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f43ac0576d0 msgr2=0x7f43ac15adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.692+0000 7f43ab7fe640 1 --2- 10.20.193.58:0/492041429 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f43ac0576d0 0x7f43ac15adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.692+0000 7f43ab7fe640 1 -- 10.20.193.58:0/492041429 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f43ac056960 msgr2=0x7f43ac11e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.692+0000 7f43ab7fe640 1 --2- 10.20.193.58:0/492041429 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f43ac056960 0x7f43ac11e200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.692+0000 7f43ab7fe640 1 -- 10.20.193.58:0/492041429 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f439c00a650 con 0x7f43ac15c4b0 2026-02-23T06:50:24.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.692+0000 7f43ab7fe640 1 --2- 10.20.193.58:0/492041429 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f43ac15c4b0 0x7f43ac0af510 secure :-1 s=READY pgs=145 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f439c005820 tx=0x7f439c0039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:50:24.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.692+0000 7f438b7fe640 1 -- 10.20.193.58:0/492041429 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f439c03e070 con 0x7f43ac15c4b0 2026-02-23T06:50:24.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.692+0000 7f438b7fe640 1 -- 10.20.193.58:0/492041429 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f439c039470 con 0x7f43ac15c4b0 2026-02-23T06:50:24.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.692+0000 7f438b7fe640 1 -- 10.20.193.58:0/492041429 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f439c039860 con 0x7f43ac15c4b0 2026-02-23T06:50:24.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.693+0000 7f43abfff640 1 -- 10.20.193.58:0/492041429 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43ac122050 con 0x7f43ac15c4b0 2026-02-23T06:50:24.686 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.693+0000 7f43abfff640 1 -- 10.20.193.58:0/492041429 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43ac1212b0 con 0x7f43ac15c4b0 2026-02-23T06:50:24.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.693+0000 7f43abfff640 1 --2- 10.20.193.58:0/492041429 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f43ac0b0db0 0x7f43ac0afa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:24.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.693+0000 7f43abfff640 1 -- 10.20.193.58:0/492041429 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac059690 con 0x7f43ac0b0db0 2026-02-23T06:50:24.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.693+0000 7f43aaffd640 1 --2- 10.20.193.58:0/492041429 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f43ac0b0db0 0x7f43ac0afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:24.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.694+0000 7f43aaffd640 1 -- 10.20.193.58:0/492041429 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f43ac0593b0 con 0x7f43ac0b0db0 2026-02-23T06:50:24.687 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.694+0000 7f43aaffd640 1 --2- 10.20.193.58:0/492041429 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f43ac0b0db0 0x7f43ac0afa50 secure :-1 s=READY pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43a00029a0 tx=0x7f43a000eba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:50:24.688 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.694+0000 7f438b7fe640 1 -- 10.20.193.58:0/492041429 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f43a0019070 con 0x7f43ac0b0db0 2026-02-23T06:50:24.688 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.694+0000 7f438b7fe640 1 -- 10.20.193.58:0/492041429 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f43a0006ab0 con 0x7f43ac0b0db0 2026-02-23T06:50:24.688 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.694+0000 7f438b7fe640 1 -- 10.20.193.58:0/492041429 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f43ac0b0db0 msgr2=0x7f43ac0afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.688 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.694+0000 7f438b7fe640 1 --2- 10.20.193.58:0/492041429 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f43ac0b0db0 0x7f43ac0afa50 secure :-1 s=READY pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43a00029a0 tx=0x7f43a000eba0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.688 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.694+0000 7f438b7fe640 1 -- 10.20.193.58:0/492041429 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f43ac0b0db0 msgr2=0x7f43ac0afa50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:50:24.688 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.694+0000 7f438b7fe640 1 --2- 10.20.193.58:0/492041429 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f43ac0b0db0 0x7f43ac0afa50 secure :-1 s=CLOSED pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43a00029a0 tx=0x7f43a000eba0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.689 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.695+0000 7f438b7fe640 1 -- 10.20.193.58:0/492041429 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f439c0399c0 con 0x7f43ac15c4b0 2026-02-23T06:50:24.689 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.695+0000 7f438b7fe640 1 --2- 10.20.193.58:0/492041429 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f437807a430 0x7f437809a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:24.689 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.695+0000 7f438b7fe640 1 -- 10.20.193.58:0/492041429 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f439c0c3870 con 0x7f43ac15c4b0 2026-02-23T06:50:24.689 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.696+0000 7f43aaffd640 1 --2- 10.20.193.58:0/492041429 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f437807a430 0x7f437809a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:24.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.696+0000 7f43aaffd640 1 --2- 10.20.193.58:0/492041429 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f437807a430 0x7f437809a8e0 secure :-1 s=READY pgs=583 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43a0003fd0 tx=0x7f43a0014000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:50:24.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.698+0000 7f43abfff640 1 --2- 10.20.193.58:0/492041429 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f43ac15b300 0x7f43ac11ecc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:24.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.698+0000 7f43abfff640 1 -- 10.20.193.58:0/492041429 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac121a20 con 0x7f43ac15b300 2026-02-23T06:50:24.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.699+0000 7f43aa7fc640 1 --2- 10.20.193.58:0/492041429 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f43ac15b300 0x7f43ac11ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:24.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.699+0000 7f43aa7fc640 1 -- 10.20.193.58:0/492041429 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f43ac058070 con 0x7f43ac15b300 2026-02-23T06:50:24.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.699+0000 7f43aa7fc640 1 --2- 10.20.193.58:0/492041429 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f43ac15b300 0x7f43ac11ecc0 secure :-1 s=READY pgs=177 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43ac13c200 tx=0x7f439400ebc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:50:24.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.699+0000 7f438b7fe640 1 -- 10.20.193.58:0/492041429 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4394006ab0 con 0x7f43ac15b300 2026-02-23T06:50:24.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.699+0000 7f438b7fe640 1 -- 10.20.193.58:0/492041429 <== mon.1 v2:10.20.193.93:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5556 (secure 0 0 0) 0x7f4394006c10 con 0x7f43ac15b300 2026-02-23T06:50:24.693 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:50:24.693 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:50:24.693 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:50:24.693 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:50:24.693 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 252, 2026-02-23T06:50:24.693 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 311057, 2026-02-23T06:50:24.693 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:50:24.693 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:50:24.693 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:50:24.693 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:50:24.693 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:50:24.693 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 1, 2026-02-23T06:50:24.693 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:50:24.693 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:50:24.693 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:50:24.693 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:50:24.693 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:50:24.694 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:50:24.695 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:50:24.696 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "mds": [ 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "osd": [ 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "num": 7 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x2f018fb87aa4aafe", 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "release": "luminous", 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "num": 5 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "mgr": [ 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:50:24.697 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:50:24.698 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:50:24.698 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:50:24.698 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:50:24.698 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.698 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:50:24.698 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:50:24.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.699+0000 7f438b7fe640 1 -- 10.20.193.58:0/492041429 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f43ac15b300 msgr2=0x7f43ac11ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.699+0000 7f438b7fe640 1 --2- 10.20.193.58:0/492041429 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f43ac15b300 0x7f43ac11ecc0 secure :-1 s=READY pgs=177 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43ac13c200 tx=0x7f439400ebc0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.699+0000 7f438b7fe640 1 -- 10.20.193.58:0/492041429 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f43ac15b300 msgr2=0x7f43ac11ecc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:50:24.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.699+0000 7f438b7fe640 1 --2- 10.20.193.58:0/492041429 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f43ac15b300 0x7f43ac11ecc0 secure :-1 s=CLOSED pgs=177 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43ac13c200 tx=0x7f439400ebc0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.700+0000 7f43abfff640 1 -- 10.20.193.58:0/492041429 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f437807a430 msgr2=0x7f437809a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.700+0000 7f43abfff640 1 --2- 10.20.193.58:0/492041429 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f437807a430 0x7f437809a8e0 secure :-1 s=READY pgs=583 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43a0003fd0 tx=0x7f43a0014000 comp rx=0 tx=0).stop 2026-02-23T06:50:24.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.700+0000 7f43abfff640 1 -- 10.20.193.58:0/492041429 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f43ac15c4b0 msgr2=0x7f43ac0af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.700+0000 7f43abfff640 1 --2- 10.20.193.58:0/492041429 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f43ac15c4b0 0x7f43ac0af510 secure :-1 s=READY pgs=145 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f439c005820 tx=0x7f439c0039b0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.700+0000 7f43ab7fe640 1 -- 10.20.193.58:0/492041429 reap_dead start 2026-02-23T06:50:24.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.700+0000 7f43ab7fe640 1 -- 10.20.193.58:0/492041429 reap_dead start 2026-02-23T06:50:24.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.700+0000 7f43abfff640 1 -- 10.20.193.58:0/492041429 shutdown_connections 2026-02-23T06:50:24.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.700+0000 7f43abfff640 1 -- 10.20.193.58:0/492041429 >> 10.20.193.58:0/492041429 conn(0x7f43ac0b3c20 msgr2=0x7f43ac13c470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:50:24.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.700+0000 7f43abfff640 1 -- 10.20.193.58:0/492041429 shutdown_connections 2026-02-23T06:50:24.698 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.700+0000 7f43abfff640 1 -- 10.20.193.58:0/492041429 wait complete. 2026-02-23T06:50:24.700 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:50:24.701 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-23T06:50:24.701 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-23T06:50:24.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.832+0000 7feeb7fff640 1 -- 10.20.193.58:0/2918119617 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feeb80b6690 msgr2=0x7feeb8058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.832+0000 7feeb7fff640 1 --2- 10.20.193.58:0/2918119617 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feeb80b6690 0x7feeb8058cf0 secure :-1 s=READY pgs=146 gs=1 cs=0 l=1 c_cookie=15078349802609612342 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feeb80b5040 tx=0x7feea8030340 comp rx=0 tx=0).stop 2026-02-23T06:50:24.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.832+0000 7feeb7fff640 1 -- 10.20.193.58:0/2918119617 shutdown_connections 2026-02-23T06:50:24.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.832+0000 7feeb7fff640 1 --2- 10.20.193.58:0/2918119617 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feeb80b6690 0x7feeb8058cf0 unknown :-1 s=CLOSED pgs=146 gs=1 cs=0 l=1 c_cookie=15078349802609612342 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.832+0000 7feeb7fff640 1 --2- 10.20.193.58:0/2918119617 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feeb815d870 0x7feeb80587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.832+0000 7feeb7fff640 1 --2- 10.20.193.58:0/2918119617 >> v2:10.20.193.93:3300/0 conn(0x7feeb815d4a0 0x7feeb80affb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.832+0000 7feeb7fff640 1 -- 10.20.193.58:0/2918119617 >> 10.20.193.58:0/2918119617 conn(0x7feeb80b3c20 msgr2=0x7feeb80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:50:24.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.832+0000 7feeb7fff640 1 -- 10.20.193.58:0/2918119617 shutdown_connections 2026-02-23T06:50:24.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.832+0000 7feeb7fff640 1 -- 10.20.193.58:0/2918119617 wait complete. 2026-02-23T06:50:24.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.833+0000 7feeb7fff640 1 Processor -- start 2026-02-23T06:50:24.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.834+0000 7feeb7fff640 1 -- start start 2026-02-23T06:50:24.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.834+0000 7feeb7fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feeb80b6690 0x7feeb813cbc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:24.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.834+0000 7feeb7fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feeb815d4a0 0x7feeb8057170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:24.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.834+0000 7feeb7fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feeb815d870 0x7feeb8122680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:24.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.834+0000 7feeb7fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7feeb813d100 con 0x7feeb815d4a0 2026-02-23T06:50:24.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.834+0000 7feeb7fff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7feeb8160f90 con 0x7feeb80b6690 2026-02-23T06:50:24.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.834+0000 7feeb7fff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7feeb8056500 con 0x7feeb815d870 2026-02-23T06:50:24.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.834+0000 7feeb6ffd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feeb80b6690 0x7feeb813cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:24.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.834+0000 7feeb67fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feeb815d4a0 0x7feeb8057170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:24.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.834+0000 7feeb77fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feeb815d870 0x7feeb8122680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:24.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.834+0000 7feeb67fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feeb815d4a0 0x7feeb8057170 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:49830/0 (socket says 10.20.193.58:49830) 2026-02-23T06:50:24.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.834+0000 7feeb67fc640 1 -- 10.20.193.58:0/2448380468 learned_addr learned my addr 10.20.193.58:0/2448380468 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:50:24.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.835+0000 7feeb77fe640 1 -- 10.20.193.58:0/2448380468 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feeb80b6690 msgr2=0x7feeb813cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.835+0000 7feeb77fe640 1 --2- 10.20.193.58:0/2448380468 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7feeb80b6690 0x7feeb813cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.835+0000 7feeb77fe640 1 -- 10.20.193.58:0/2448380468 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feeb815d4a0 msgr2=0x7feeb8057170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.835+0000 7feeb77fe640 1 --2- 10.20.193.58:0/2448380468 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feeb815d4a0 0x7feeb8057170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.835+0000 7feeb77fe640 1 -- 10.20.193.58:0/2448380468 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea800a650 con 0x7feeb815d870 2026-02-23T06:50:24.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.835+0000 7feeb67fc640 1 --2- 10.20.193.58:0/2448380468 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7feeb815d4a0 0x7feeb8057170 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:50:24.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.835+0000 7feeb77fe640 1 --2- 10.20.193.58:0/2448380468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feeb815d870 0x7feeb8122680 secure :-1 s=READY pgs=11 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feeb8059c90 tx=0x7feea80037a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:50:24.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.835+0000 7fee8ffff640 1 -- 10.20.193.58:0/2448380468 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feea8003e80 con 0x7feeb815d870 2026-02-23T06:50:24.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.835+0000 7feeb7fff640 1 -- 10.20.193.58:0/2448380468 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeb8161230 con 0x7feeb815d870 2026-02-23T06:50:24.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.835+0000 7feeb7fff640 1 -- 10.20.193.58:0/2448380468 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feeb8057d10 con 0x7feeb815d870 2026-02-23T06:50:24.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.835+0000 7fee8ffff640 1 -- 10.20.193.58:0/2448380468 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feea8039560 con 0x7feeb815d870 2026-02-23T06:50:24.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.835+0000 7fee8ffff640 1 -- 10.20.193.58:0/2448380468 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feea80398f0 con 0x7feeb815d870 2026-02-23T06:50:24.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.836+0000 7fee8e7fc640 1 --2- 10.20.193.58:0/2448380468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feeb8161e60 0x7feeb8122bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:24.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.836+0000 7fee8e7fc640 1 -- 10.20.193.58:0/2448380468 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7feeb8164250 con 0x7feeb8161e60 2026-02-23T06:50:24.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.836+0000 7feeb6ffd640 1 --2- 10.20.193.58:0/2448380468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feeb8161e60 0x7feeb8122bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:24.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.836+0000 7feeb6ffd640 1 -- 10.20.193.58:0/2448380468 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feeb80b6330 con 0x7feeb8161e60 2026-02-23T06:50:24.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.837+0000 7feeb6ffd640 1 --2- 10.20.193.58:0/2448380468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feeb8161e60 0x7feeb8122bc0 secure :-1 s=READY pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feeac004740 tx=0x7feeac0099d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:50:24.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.837+0000 7fee8ffff640 1 -- 10.20.193.58:0/2448380468 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feeac0118d0 con 0x7feeb8161e60 2026-02-23T06:50:24.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.837+0000 7fee8ffff640 1 -- 10.20.193.58:0/2448380468 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7feeac011a30 con 0x7feeb8161e60 2026-02-23T06:50:24.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.837+0000 7fee8ffff640 1 -- 10.20.193.58:0/2448380468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feeb8161e60 msgr2=0x7feeb8122bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.837+0000 7fee8ffff640 1 --2- 10.20.193.58:0/2448380468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feeb8161e60 0x7feeb8122bc0 secure :-1 s=READY pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feeac004740 tx=0x7feeac0099d0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.837+0000 7fee8ffff640 1 -- 10.20.193.58:0/2448380468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feeb8161e60 msgr2=0x7feeb8122bc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:50:24.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.837+0000 7fee8ffff640 1 --2- 10.20.193.58:0/2448380468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feeb8161e60 0x7feeb8122bc0 unknown :-1 s=CLOSED pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.839+0000 7fee8ffff640 1 -- 10.20.193.58:0/2448380468 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7feea8039a50 con 0x7feeb815d870 2026-02-23T06:50:24.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.840+0000 7fee8ffff640 1 --2- 10.20.193.58:0/2448380468 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fee8807a3c0 0x7fee8809a870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:24.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.840+0000 7fee8ffff640 1 -- 10.20.193.58:0/2448380468 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7feea80c3ae0 con 0x7feeb815d870 2026-02-23T06:50:24.834 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.840+0000 7feeb6ffd640 1 --2- 10.20.193.58:0/2448380468 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fee8807a3c0 0x7fee8809a870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:24.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.841+0000 7fee8e7fc640 1 --2- 10.20.193.58:0/2448380468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feeb8057f00 0x7feeb814dab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:24.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.841+0000 7fee8e7fc640 1 -- 10.20.193.58:0/2448380468 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7feeb81613c0 con 0x7feeb8057f00 2026-02-23T06:50:24.835 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.841+0000 7feeb6ffd640 1 --2- 10.20.193.58:0/2448380468 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fee8807a3c0 0x7fee8809a870 secure :-1 s=READY pgs=584 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feeac0023d0 tx=0x7feeac00e000 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:50:24.836 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.841+0000 7feeb67fc640 1 --2- 10.20.193.58:0/2448380468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feeb8057f00 0x7feeb814dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:24.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.842+0000 7feeb67fc640 1 -- 10.20.193.58:0/2448380468 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7feeb80b7260 con 0x7feeb8057f00 2026-02-23T06:50:24.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.842+0000 7feeb67fc640 1 --2- 10.20.193.58:0/2448380468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feeb8057f00 0x7feeb814dab0 secure :-1 s=READY pgs=13 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feeb813f270 tx=0x7feea000bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:50:24.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.843+0000 7fee8ffff640 1 -- 10.20.193.58:0/2448380468 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feea0004500 con 0x7feeb8057f00 2026-02-23T06:50:24.837 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.843+0000 7fee8ffff640 1 -- 10.20.193.58:0/2448380468 <== mon.2 v2:10.20.193.93:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4911 (secure 0 0 0) 0x7feea00026a0 con 0x7feeb8057f00 2026-02-23T06:50:24.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.843+0000 7fee8ffff640 1 -- 10.20.193.58:0/2448380468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feeb8057f00 msgr2=0x7feeb814dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.843+0000 7fee8ffff640 1 --2- 10.20.193.58:0/2448380468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feeb8057f00 0x7feeb814dab0 secure :-1 s=READY pgs=13 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feeb813f270 tx=0x7feea000bf90 comp rx=0 tx=0).stop 2026-02-23T06:50:24.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.843+0000 7fee8ffff640 1 -- 10.20.193.58:0/2448380468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feeb8057f00 msgr2=0x7feeb814dab0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-23T06:50:24.838 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.843+0000 7fee8ffff640 1 --2- 10.20.193.58:0/2448380468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feeb8057f00 0x7feeb814dab0 secure :-1 s=CLOSED pgs=13 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feeb813f270 tx=0x7feea000bf90 comp rx=0 tx=0).stop 2026-02-23T06:50:24.838 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:50:24.838 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:50:24.839 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:50:24.839 INFO:teuthology.orchestra.run.trial058.stdout: "state": "peon", 2026-02-23T06:50:24.839 INFO:teuthology.orchestra.run.trial058.stdout: "election_epoch": 252, 2026-02-23T06:50:24.839 INFO:teuthology.orchestra.run.trial058.stdout: "uptime": 25259, 2026-02-23T06:50:24.839 INFO:teuthology.orchestra.run.trial058.stdout: "quorum": [ 2026-02-23T06:50:24.839 INFO:teuthology.orchestra.run.trial058.stdout: 0, 2026-02-23T06:50:24.839 INFO:teuthology.orchestra.run.trial058.stdout: 1, 2026-02-23T06:50:24.839 INFO:teuthology.orchestra.run.trial058.stdout: 2 2026-02-23T06:50:24.839 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:50:24.839 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_age": 1, 2026-02-23T06:50:24.839 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:50:24.840 INFO:teuthology.orchestra.run.trial058.stdout: "required_con": "2453899407728394244", 2026-02-23T06:50:24.840 INFO:teuthology.orchestra.run.trial058.stdout: "required_mon": [ 2026-02-23T06:50:24.840 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:50:24.840 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:50:24.840 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:50:24.840 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:50:24.840 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:50:24.840 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:50:24.840 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:50:24.840 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:50:24.840 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:50:24.840 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:50:24.841 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:50:24.841 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:50:24.841 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:50:24.841 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:50:24.841 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_con": "4544132024016699391", 2026-02-23T06:50:24.841 INFO:teuthology.orchestra.run.trial058.stdout: "quorum_mon": [ 2026-02-23T06:50:24.841 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:50:24.841 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:50:24.841 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:50:24.841 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:50:24.841 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:50:24.842 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:50:24.842 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:50:24.842 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:50:24.842 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:50:24.842 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:50:24.842 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:50:24.842 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:50:24.843 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:50:24.843 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:50:24.843 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.843 INFO:teuthology.orchestra.run.trial058.stdout: "outside_quorum": [], 2026-02-23T06:50:24.843 INFO:teuthology.orchestra.run.trial058.stdout: "extra_probe_peers": [], 2026-02-23T06:50:24.843 INFO:teuthology.orchestra.run.trial058.stdout: "sync_provider": [], 2026-02-23T06:50:24.843 INFO:teuthology.orchestra.run.trial058.stdout: "monmap": { 2026-02-23T06:50:24.844 INFO:teuthology.orchestra.run.trial058.stdout: "epoch": 1, 2026-02-23T06:50:24.844 INFO:teuthology.orchestra.run.trial058.stdout: "fsid": "2624bd29-dc40-41ea-9c77-09981694f232", 2026-02-23T06:50:24.844 INFO:teuthology.orchestra.run.trial058.stdout: "modified": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:50:24.844 INFO:teuthology.orchestra.run.trial058.stdout: "created": "2026-02-23T06:20:43.887319Z", 2026-02-23T06:50:24.844 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release": 20, 2026-02-23T06:50:24.844 INFO:teuthology.orchestra.run.trial058.stdout: "min_mon_release_name": "tentacle", 2026-02-23T06:50:24.844 INFO:teuthology.orchestra.run.trial058.stdout: "election_strategy": 1, 2026-02-23T06:50:24.845 INFO:teuthology.orchestra.run.trial058.stdout: "disallowed_leaders": "", 2026-02-23T06:50:24.845 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false, 2026-02-23T06:50:24.845 INFO:teuthology.orchestra.run.trial058.stdout: "tiebreaker_mon": "", 2026-02-23T06:50:24.845 INFO:teuthology.orchestra.run.trial058.stdout: "removed_ranks": "", 2026-02-23T06:50:24.845 INFO:teuthology.orchestra.run.trial058.stdout: "features": { 2026-02-23T06:50:24.845 INFO:teuthology.orchestra.run.trial058.stdout: "persistent": [ 2026-02-23T06:50:24.845 INFO:teuthology.orchestra.run.trial058.stdout: "kraken", 2026-02-23T06:50:24.846 INFO:teuthology.orchestra.run.trial058.stdout: "luminous", 2026-02-23T06:50:24.846 INFO:teuthology.orchestra.run.trial058.stdout: "mimic", 2026-02-23T06:50:24.846 INFO:teuthology.orchestra.run.trial058.stdout: "osdmap-prune", 2026-02-23T06:50:24.846 INFO:teuthology.orchestra.run.trial058.stdout: "nautilus", 2026-02-23T06:50:24.846 INFO:teuthology.orchestra.run.trial058.stdout: "octopus", 2026-02-23T06:50:24.846 INFO:teuthology.orchestra.run.trial058.stdout: "pacific", 2026-02-23T06:50:24.846 INFO:teuthology.orchestra.run.trial058.stdout: "elector-pinging", 2026-02-23T06:50:24.846 INFO:teuthology.orchestra.run.trial058.stdout: "quincy", 2026-02-23T06:50:24.846 INFO:teuthology.orchestra.run.trial058.stdout: "reef", 2026-02-23T06:50:24.847 INFO:teuthology.orchestra.run.trial058.stdout: "squid", 2026-02-23T06:50:24.847 INFO:teuthology.orchestra.run.trial058.stdout: "tentacle", 2026-02-23T06:50:24.847 INFO:teuthology.orchestra.run.trial058.stdout: "nvmeof_beacon_diff" 2026-02-23T06:50:24.847 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:50:24.847 INFO:teuthology.orchestra.run.trial058.stdout: "optional": [] 2026-02-23T06:50:24.847 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.847 INFO:teuthology.orchestra.run.trial058.stdout: "mons": [ 2026-02-23T06:50:24.847 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.847 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 0, 2026-02-23T06:50:24.848 INFO:teuthology.orchestra.run.trial058.stdout: "name": "a", 2026-02-23T06:50:24.848 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:50:24.848 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:50:24.848 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.848 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:50:24.848 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:3300", 2026-02-23T06:50:24.848 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:50:24.848 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.848 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.848 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:50:24.848 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789", 2026-02-23T06:50:24.848 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:50:24.848 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:50:24.848 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:50:24.848 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.849 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.58:6789/0", 2026-02-23T06:50:24.849 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.58:6789/0", 2026-02-23T06:50:24.849 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:50:24.849 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:50:24.849 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887372+0000", 2026-02-23T06:50:24.849 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:50:24.849 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.849 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.849 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 1, 2026-02-23T06:50:24.849 INFO:teuthology.orchestra.run.trial058.stdout: "name": "b", 2026-02-23T06:50:24.849 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:50:24.849 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:50:24.849 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.849 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:50:24.849 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3300", 2026-02-23T06:50:24.850 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:50:24.850 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.850 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.850 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:50:24.850 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789", 2026-02-23T06:50:24.850 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:50:24.850 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:50:24.850 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:50:24.850 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.850 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6789/0", 2026-02-23T06:50:24.850 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6789/0", 2026-02-23T06:50:24.850 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:50:24.850 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:50:24.850 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887373+0000", 2026-02-23T06:50:24.850 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:50:24.850 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.851 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.851 INFO:teuthology.orchestra.run.trial058.stdout: "rank": 2, 2026-02-23T06:50:24.851 INFO:teuthology.orchestra.run.trial058.stdout: "name": "c", 2026-02-23T06:50:24.851 INFO:teuthology.orchestra.run.trial058.stdout: "public_addrs": { 2026-02-23T06:50:24.851 INFO:teuthology.orchestra.run.trial058.stdout: "addrvec": [ 2026-02-23T06:50:24.851 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.851 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v2", 2026-02-23T06:50:24.851 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:3301", 2026-02-23T06:50:24.851 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:50:24.851 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.851 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.851 INFO:teuthology.orchestra.run.trial058.stdout: "type": "v1", 2026-02-23T06:50:24.851 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790", 2026-02-23T06:50:24.851 INFO:teuthology.orchestra.run.trial058.stdout: "nonce": 0 2026-02-23T06:50:24.851 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:50:24.852 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:50:24.852 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.852 INFO:teuthology.orchestra.run.trial058.stdout: "addr": "10.20.193.93:6790/0", 2026-02-23T06:50:24.852 INFO:teuthology.orchestra.run.trial058.stdout: "public_addr": "10.20.193.93:6790/0", 2026-02-23T06:50:24.852 INFO:teuthology.orchestra.run.trial058.stdout: "priority": 0, 2026-02-23T06:50:24.852 INFO:teuthology.orchestra.run.trial058.stdout: "weight": 0, 2026-02-23T06:50:24.852 INFO:teuthology.orchestra.run.trial058.stdout: "time_added": "2026-02-23T06:20:43:887374+0000", 2026-02-23T06:50:24.852 INFO:teuthology.orchestra.run.trial058.stdout: "crush_location": [] 2026-02-23T06:50:24.852 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:50:24.852 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:50:24.852 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.852 INFO:teuthology.orchestra.run.trial058.stdout: "feature_map": { 2026-02-23T06:50:24.852 INFO:teuthology.orchestra.run.trial058.stdout: "mon": [ 2026-02-23T06:50:24.852 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.853 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:50:24.853 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:50:24.853 INFO:teuthology.orchestra.run.trial058.stdout: "num": 1 2026-02-23T06:50:24.853 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:50:24.853 INFO:teuthology.orchestra.run.trial058.stdout: ], 2026-02-23T06:50:24.853 INFO:teuthology.orchestra.run.trial058.stdout: "client": [ 2026-02-23T06:50:24.853 INFO:teuthology.orchestra.run.trial058.stdout: { 2026-02-23T06:50:24.853 INFO:teuthology.orchestra.run.trial058.stdout: "features": "0x3f0ffffffffdffff", 2026-02-23T06:50:24.853 INFO:teuthology.orchestra.run.trial058.stdout: "release": "squid", 2026-02-23T06:50:24.854 INFO:teuthology.orchestra.run.trial058.stdout: "num": 2 2026-02-23T06:50:24.854 INFO:teuthology.orchestra.run.trial058.stdout: } 2026-02-23T06:50:24.854 INFO:teuthology.orchestra.run.trial058.stdout: ] 2026-02-23T06:50:24.854 INFO:teuthology.orchestra.run.trial058.stdout: }, 2026-02-23T06:50:24.854 INFO:teuthology.orchestra.run.trial058.stdout: "stretch_mode": false 2026-02-23T06:50:24.854 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:50:24.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.843+0000 7fee8e7fc640 1 -- 10.20.193.58:0/2448380468 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fee8807a3c0 msgr2=0x7fee8809a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.843+0000 7fee8e7fc640 1 --2- 10.20.193.58:0/2448380468 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fee8807a3c0 0x7fee8809a870 secure :-1 s=READY pgs=584 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feeac0023d0 tx=0x7feeac00e000 comp rx=0 tx=0).stop 2026-02-23T06:50:24.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.843+0000 7fee8e7fc640 1 -- 10.20.193.58:0/2448380468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feeb815d870 msgr2=0x7feeb8122680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.843+0000 7fee8e7fc640 1 --2- 10.20.193.58:0/2448380468 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7feeb815d870 0x7feeb8122680 secure :-1 s=READY pgs=11 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feeb8059c90 tx=0x7feea80037a0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.843+0000 7feeb77fe640 1 -- 10.20.193.58:0/2448380468 reap_dead start 2026-02-23T06:50:24.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.843+0000 7feeb77fe640 1 -- 10.20.193.58:0/2448380468 reap_dead start 2026-02-23T06:50:24.856 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.843+0000 7fee8e7fc640 1 -- 10.20.193.58:0/2448380468 shutdown_connections 2026-02-23T06:50:24.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.843+0000 7fee8e7fc640 1 -- 10.20.193.58:0/2448380468 >> 10.20.193.58:0/2448380468 conn(0x7feeb80b3c20 msgr2=0x7feeb8163450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:50:24.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.843+0000 7fee8e7fc640 1 -- 10.20.193.58:0/2448380468 shutdown_connections 2026-02-23T06:50:24.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.843+0000 7fee8e7fc640 1 -- 10.20.193.58:0/2448380468 wait complete. 2026-02-23T06:50:24.857 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-23T06:50:24.857 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-23T06:50:24.857 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-23T06:50:24.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.984+0000 7fb5e3043640 1 -- 10.20.193.58:0/2613080506 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5dc1688d0 msgr2=0x7fb5dc168ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.984+0000 7fb5e3043640 1 --2- 10.20.193.58:0/2613080506 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5dc1688d0 0x7fb5dc168ca0 secure :-1 s=READY pgs=14 gs=3 cs=0 l=1 c_cookie=10512590102170295089 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5cc009890 tx=0x7fb5cc02f200 comp rx=0 tx=0).stop 2026-02-23T06:50:24.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.984+0000 7fb5e3043640 1 -- 10.20.193.58:0/2613080506 shutdown_connections 2026-02-23T06:50:24.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.984+0000 7fb5e3043640 1 --2- 10.20.193.58:0/2613080506 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5dc1688d0 0x7fb5dc168ca0 unknown :-1 s=CLOSED pgs=14 gs=3 cs=0 l=1 c_cookie=10512590102170295089 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.984+0000 7fb5e3043640 1 -- 10.20.193.58:0/2613080506 >> 10.20.193.58:0/2613080506 conn(0x7fb5dc054e40 msgr2=0x7fb5dc057b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:50:24.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.984+0000 7fb5e3043640 1 -- 10.20.193.58:0/2613080506 shutdown_connections 2026-02-23T06:50:24.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.984+0000 7fb5e3043640 1 -- 10.20.193.58:0/2613080506 wait complete. 2026-02-23T06:50:24.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.985+0000 7fb5e3043640 1 Processor -- start 2026-02-23T06:50:24.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.985+0000 7fb5e3043640 1 -- start start 2026-02-23T06:50:24.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.985+0000 7fb5e3043640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb5dc0b6440 0x7fb5dc134df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:24.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.985+0000 7fb5e3043640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5dc0bb0b0 0x7fb5dc09f0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:24.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.986+0000 7fb5e3043640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5dc1688d0 0x7fb5dc139530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:24.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.986+0000 7fb5e3043640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc09f5e0 con 0x7fb5dc0b6440 2026-02-23T06:50:24.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.986+0000 7fb5e3043640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc13bdd0 con 0x7fb5dc0bb0b0 2026-02-23T06:50:24.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.986+0000 7fb5e3043640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb5dc13de10 con 0x7fb5dc1688d0 2026-02-23T06:50:24.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.986+0000 7fb5e2041640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb5dc0b6440 0x7fb5dc134df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:24.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.986+0000 7fb5e2041640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb5dc0b6440 0x7fb5dc134df0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:49834/0 (socket says 10.20.193.58:49834) 2026-02-23T06:50:24.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.986+0000 7fb5e2041640 1 -- 10.20.193.58:0/218264303 learned_addr learned my addr 10.20.193.58:0/218264303 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:50:24.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.986+0000 7fb5e1840640 1 --2- 10.20.193.58:0/218264303 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5dc0bb0b0 0x7fb5dc09f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:24.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.986+0000 7fb5e2842640 1 --2- 10.20.193.58:0/218264303 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5dc1688d0 0x7fb5dc139530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:24.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.986+0000 7fb5e2041640 1 -- 10.20.193.58:0/218264303 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5dc1688d0 msgr2=0x7fb5dc139530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.986+0000 7fb5e2041640 1 --2- 10.20.193.58:0/218264303 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5dc1688d0 0x7fb5dc139530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.986+0000 7fb5e2041640 1 -- 10.20.193.58:0/218264303 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5dc0bb0b0 msgr2=0x7fb5dc09f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:24.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.986+0000 7fb5e2041640 1 --2- 10.20.193.58:0/218264303 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5dc0bb0b0 0x7fb5dc09f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:24.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.986+0000 7fb5e2041640 1 -- 10.20.193.58:0/218264303 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5cc0094b0 con 0x7fb5dc0b6440 2026-02-23T06:50:24.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.986+0000 7fb5e1840640 1 --2- 10.20.193.58:0/218264303 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5dc0bb0b0 0x7fb5dc09f0a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:50:24.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.986+0000 7fb5e2041640 1 --2- 10.20.193.58:0/218264303 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb5dc0b6440 0x7fb5dc134df0 secure :-1 s=READY pgs=148 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5cc0023d0 tx=0x7fb5cc0028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:50:24.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.986+0000 7fb5c2ffd640 1 -- 10.20.193.58:0/218264303 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5cc03c040 con 0x7fb5dc0b6440 2026-02-23T06:50:24.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.986+0000 7fb5e3043640 1 -- 10.20.193.58:0/218264303 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5dc0a1d30 con 0x7fb5dc0b6440 2026-02-23T06:50:24.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.986+0000 7fb5c2ffd640 1 -- 10.20.193.58:0/218264303 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5cc038470 con 0x7fb5dc0b6440 2026-02-23T06:50:24.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.986+0000 7fb5c2ffd640 1 -- 10.20.193.58:0/218264303 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5cc038860 con 0x7fb5dc0b6440 2026-02-23T06:50:24.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.987+0000 7fb5e3043640 1 -- 10.20.193.58:0/218264303 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5dc13c300 con 0x7fb5dc0b6440 2026-02-23T06:50:24.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.987+0000 7fb5e3043640 1 -- 10.20.193.58:0/218264303 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5dc0b7170 con 0x7fb5dc0b6440 2026-02-23T06:50:24.982 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.988+0000 7fb5c2ffd640 1 -- 10.20.193.58:0/218264303 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fb5cc0389c0 con 0x7fb5dc0b6440 2026-02-23T06:50:24.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.989+0000 7fb5c2ffd640 1 --2- 10.20.193.58:0/218264303 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb5ac07a6c0 0x7fb5ac09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:24.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.989+0000 7fb5c2ffd640 1 -- 10.20.193.58:0/218264303 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fb5cc0c2b30 con 0x7fb5dc0b6440 2026-02-23T06:50:24.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.990+0000 7fb5e1840640 1 --2- 10.20.193.58:0/218264303 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb5ac07a6c0 0x7fb5ac09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:24.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.990+0000 7fb5e1840640 1 --2- 10.20.193.58:0/218264303 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb5ac07a6c0 0x7fb5ac09ab70 secure :-1 s=READY pgs=585 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5dc039330 tx=0x7fb5d0009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:50:24.985 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:24.991+0000 7fb5c2ffd640 1 -- 10.20.193.58:0/218264303 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fb5cc085d70 con 0x7fb5dc0b6440 2026-02-23T06:50:25.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:25.147+0000 7fb5e3043640 1 -- 10.20.193.58:0/218264303 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fb5dc057f20 con 0x7fb5dc0b6440 2026-02-23T06:50:25.141 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:25.147+0000 7fb5c2ffd640 1 -- 10.20.193.58:0/218264303 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fb5cc088e90 con 0x7fb5dc0b6440 2026-02-23T06:50:25.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:25.148+0000 7fb5e3043640 1 -- 10.20.193.58:0/218264303 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb5ac07a6c0 msgr2=0x7fb5ac09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:25.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:25.148+0000 7fb5e3043640 1 --2- 10.20.193.58:0/218264303 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb5ac07a6c0 0x7fb5ac09ab70 secure :-1 s=READY pgs=585 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5dc039330 tx=0x7fb5d0009040 comp rx=0 tx=0).stop 2026-02-23T06:50:25.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:25.148+0000 7fb5e3043640 1 -- 10.20.193.58:0/218264303 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb5dc0b6440 msgr2=0x7fb5dc134df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:25.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:25.148+0000 7fb5e3043640 1 --2- 10.20.193.58:0/218264303 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb5dc0b6440 0x7fb5dc134df0 secure :-1 s=READY pgs=148 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5cc0023d0 tx=0x7fb5cc0028d0 comp rx=0 tx=0).stop 2026-02-23T06:50:25.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:25.148+0000 7fb5e3043640 1 -- 10.20.193.58:0/218264303 shutdown_connections 2026-02-23T06:50:25.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:25.148+0000 7fb5e3043640 1 --2- 10.20.193.58:0/218264303 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb5ac07a6c0 0x7fb5ac09ab70 unknown :-1 s=CLOSED pgs=585 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:25.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:25.148+0000 7fb5e3043640 1 --2- 10.20.193.58:0/218264303 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb5dc1688d0 0x7fb5dc139530 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:25.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:25.148+0000 7fb5e3043640 1 --2- 10.20.193.58:0/218264303 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb5dc0bb0b0 0x7fb5dc09f0a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:25.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:25.148+0000 7fb5e3043640 1 --2- 10.20.193.58:0/218264303 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb5dc0b6440 0x7fb5dc134df0 unknown :-1 s=CLOSED pgs=148 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:25.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:25.148+0000 7fb5e3043640 1 -- 10.20.193.58:0/218264303 >> 10.20.193.58:0/218264303 conn(0x7fb5dc054e40 msgr2=0x7fb5dc1674c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:50:25.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:25.149+0000 7fb5e3043640 1 -- 10.20.193.58:0/218264303 shutdown_connections 2026-02-23T06:50:25.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:25.149+0000 7fb5e3043640 1 -- 10.20.193.58:0/218264303 wait complete. 2026-02-23T06:50:25.154 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2026-02-23T06:50:35.155 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2026-02-23T06:50:35.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.283+0000 7fb353083640 1 -- 10.20.193.58:0/3280138168 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb34c0b6690 msgr2=0x7fb34c058ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:35.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.283+0000 7fb353083640 1 --2- 10.20.193.58:0/3280138168 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb34c0b6690 0x7fb34c058ec0 secure :-1 s=READY pgs=150 gs=2 cs=0 l=1 c_cookie=7334615147224338606 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb348006f50 tx=0x7fb348030360 comp rx=0 tx=0).stop 2026-02-23T06:50:35.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.283+0000 7fb353083640 1 -- 10.20.193.58:0/3280138168 shutdown_connections 2026-02-23T06:50:35.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.283+0000 7fb353083640 1 --2- 10.20.193.58:0/3280138168 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb34c0b6690 0x7fb34c058ec0 unknown :-1 s=CLOSED pgs=150 gs=2 cs=0 l=1 c_cookie=7334615147224338606 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:35.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.283+0000 7fb353083640 1 --2- 10.20.193.58:0/3280138168 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb34c15d4a0 0x7fb34c0affb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:35.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.283+0000 7fb353083640 1 -- 10.20.193.58:0/3280138168 >> 10.20.193.58:0/3280138168 conn(0x7fb34c0b3c20 msgr2=0x7fb34c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:50:35.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.283+0000 7fb353083640 1 -- 10.20.193.58:0/3280138168 shutdown_connections 2026-02-23T06:50:35.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.283+0000 7fb353083640 1 -- 10.20.193.58:0/3280138168 wait complete. 2026-02-23T06:50:35.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.284+0000 7fb353083640 1 Processor -- start 2026-02-23T06:50:35.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.284+0000 7fb353083640 1 -- start start 2026-02-23T06:50:35.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.285+0000 7fb353083640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb34c0b6690 0x7fb34c142c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:35.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.285+0000 7fb353083640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb34c15d4a0 0x7fb34c13f180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:35.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.285+0000 7fb353083640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb34c15d870 0x7fb34c144210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:35.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.285+0000 7fb353083640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb34c13f6c0 con 0x7fb34c15d4a0 2026-02-23T06:50:35.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.285+0000 7fb353083640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb34c1427a0 con 0x7fb34c15d870 2026-02-23T06:50:35.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.285+0000 7fb353083640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb34c141050 con 0x7fb34c0b6690 2026-02-23T06:50:35.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.285+0000 7fb351880640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb34c15d4a0 0x7fb34c13f180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:35.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.285+0000 7fb351880640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb34c15d4a0 0x7fb34c13f180 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:38616/0 (socket says 10.20.193.58:38616) 2026-02-23T06:50:35.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.285+0000 7fb351880640 1 -- 10.20.193.58:0/1593935597 learned_addr learned my addr 10.20.193.58:0/1593935597 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:50:35.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.285+0000 7fb352081640 1 --2- 10.20.193.58:0/1593935597 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb34c0b6690 0x7fb34c142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:35.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.285+0000 7fb352882640 1 --2- 10.20.193.58:0/1593935597 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb34c15d870 0x7fb34c144210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:35.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.285+0000 7fb351880640 1 -- 10.20.193.58:0/1593935597 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb34c0b6690 msgr2=0x7fb34c142c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:35.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.285+0000 7fb351880640 1 --2- 10.20.193.58:0/1593935597 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb34c0b6690 0x7fb34c142c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:35.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.285+0000 7fb351880640 1 -- 10.20.193.58:0/1593935597 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb34c15d870 msgr2=0x7fb34c144210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:35.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.285+0000 7fb351880640 1 --2- 10.20.193.58:0/1593935597 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb34c15d870 0x7fb34c144210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:35.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.285+0000 7fb351880640 1 -- 10.20.193.58:0/1593935597 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb34800a650 con 0x7fb34c15d4a0 2026-02-23T06:50:35.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.285+0000 7fb352882640 1 --2- 10.20.193.58:0/1593935597 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb34c15d870 0x7fb34c144210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:50:35.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.285+0000 7fb351880640 1 --2- 10.20.193.58:0/1593935597 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb34c15d4a0 0x7fb34c13f180 secure :-1 s=READY pgs=151 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb34000c4d0 tx=0x7fb34000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:50:35.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.285+0000 7fb332ffd640 1 -- 10.20.193.58:0/1593935597 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb340005240 con 0x7fb34c15d4a0 2026-02-23T06:50:35.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.285+0000 7fb332ffd640 1 -- 10.20.193.58:0/1593935597 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb340005490 con 0x7fb34c15d4a0 2026-02-23T06:50:35.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.285+0000 7fb332ffd640 1 -- 10.20.193.58:0/1593935597 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb340006b10 con 0x7fb34c15d4a0 2026-02-23T06:50:35.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.285+0000 7fb353083640 1 -- 10.20.193.58:0/1593935597 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb34c141330 con 0x7fb34c15d4a0 2026-02-23T06:50:35.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.286+0000 7fb353083640 1 -- 10.20.193.58:0/1593935597 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb34c1418f0 con 0x7fb34c15d4a0 2026-02-23T06:50:35.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.286+0000 7fb353083640 1 -- 10.20.193.58:0/1593935597 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb34c0b6d50 con 0x7fb34c15d4a0 2026-02-23T06:50:35.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.287+0000 7fb332ffd640 1 -- 10.20.193.58:0/1593935597 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fb340019030 con 0x7fb34c15d4a0 2026-02-23T06:50:35.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.288+0000 7fb332ffd640 1 --2- 10.20.193.58:0/1593935597 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb31c07a6c0 0x7fb31c09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:35.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.288+0000 7fb332ffd640 1 -- 10.20.193.58:0/1593935597 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fb34009cc60 con 0x7fb34c15d4a0 2026-02-23T06:50:35.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.289+0000 7fb352081640 1 --2- 10.20.193.58:0/1593935597 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb31c07a6c0 0x7fb31c09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:35.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.289+0000 7fb352081640 1 --2- 10.20.193.58:0/1593935597 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb31c07a6c0 0x7fb31c09ab70 secure :-1 s=READY pgs=586 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb33c004740 tx=0x7fb33c00b410 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:50:35.284 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.290+0000 7fb332ffd640 1 -- 10.20.193.58:0/1593935597 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fb34005fe00 con 0x7fb34c15d4a0 2026-02-23T06:50:35.424 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.430+0000 7fb353083640 1 -- 10.20.193.58:0/1593935597 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb34c05b0e0 con 0x7fb34c15d4a0 2026-02-23T06:50:35.424 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.430+0000 7fb332ffd640 1 -- 10.20.193.58:0/1593935597 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6886 (secure 0 0 0) 0x7fb340062f20 con 0x7fb34c15d4a0 2026-02-23T06:50:35.425 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:50:35.425 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":9,"btime":"2026-02-23T06:21:35:181391+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4320,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.58:6836/332204623","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6834","nonce":332204623},{"type":"v1","addr":"10.20.193.58:6836","nonce":332204623}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4349,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6839/49797428","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6838","nonce":49797428},{"type":"v1","addr":"10.20.193.93:6839","nonce":49797428}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4355,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.58:6833/363105980","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6832","nonce":363105980},{"type":"v1","addr":"10.20.193.58:6833","nonce":363105980}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4438,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6835/3715244768","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6834","nonce":3715244768},{"type":"v1","addr":"10.20.193.93:6835","nonce":3715244768}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4444,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6837/3986540573","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6836","nonce":3986540573},{"type":"v1","addr":"10.20.193.93:6837","nonce":3986540573}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false,"allow_referent_inodes":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-23T06:21:17.428505+0000","modified":"2026-02-23T06:21:34.468900+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4468},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4468":{"gid":4468,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"10.20.193.58:6837/4266460647","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6835","nonce":4266460647},{"type":"v1","addr":"10.20.193.58:6837","nonce":4266460647}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4468,"qdb_cluster":[4468]},"id":1}]} 2026-02-23T06:50:35.426 INFO:teuthology.orchestra.run.trial058.stderr:dumped fsmap epoch 9 2026-02-23T06:50:35.426 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.432+0000 7fb353083640 1 -- 10.20.193.58:0/1593935597 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb31c07a6c0 msgr2=0x7fb31c09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:35.426 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.432+0000 7fb353083640 1 --2- 10.20.193.58:0/1593935597 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb31c07a6c0 0x7fb31c09ab70 secure :-1 s=READY pgs=586 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb33c004740 tx=0x7fb33c00b410 comp rx=0 tx=0).stop 2026-02-23T06:50:35.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.432+0000 7fb353083640 1 -- 10.20.193.58:0/1593935597 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb34c15d4a0 msgr2=0x7fb34c13f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:35.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.432+0000 7fb353083640 1 --2- 10.20.193.58:0/1593935597 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb34c15d4a0 0x7fb34c13f180 secure :-1 s=READY pgs=151 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb34000c4d0 tx=0x7fb34000c9a0 comp rx=0 tx=0).stop 2026-02-23T06:50:35.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.432+0000 7fb353083640 1 -- 10.20.193.58:0/1593935597 shutdown_connections 2026-02-23T06:50:35.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.432+0000 7fb353083640 1 --2- 10.20.193.58:0/1593935597 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb31c07a6c0 0x7fb31c09ab70 unknown :-1 s=CLOSED pgs=586 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:35.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.432+0000 7fb353083640 1 --2- 10.20.193.58:0/1593935597 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb34c15d870 0x7fb34c144210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:35.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.432+0000 7fb353083640 1 --2- 10.20.193.58:0/1593935597 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb34c15d4a0 0x7fb34c13f180 unknown :-1 s=CLOSED pgs=151 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:35.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.432+0000 7fb353083640 1 --2- 10.20.193.58:0/1593935597 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb34c0b6690 0x7fb34c142c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:35.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.432+0000 7fb353083640 1 -- 10.20.193.58:0/1593935597 >> 10.20.193.58:0/1593935597 conn(0x7fb34c0b3c20 msgr2=0x7fb34c0aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:50:35.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.432+0000 7fb353083640 1 -- 10.20.193.58:0/1593935597 shutdown_connections 2026-02-23T06:50:35.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.432+0000 7fb353083640 1 -- 10.20.193.58:0/1593935597 wait complete. 2026-02-23T06:50:35.438 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-23T06:50:35.438 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-23T06:50:35.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.566+0000 7f1361483640 1 -- 10.20.193.58:0/962161021 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f135c15c040 msgr2=0x7f135c05b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:35.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.566+0000 7f1361483640 1 --2- 10.20.193.58:0/962161021 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f135c15c040 0x7f135c05b0e0 secure :-1 s=READY pgs=15 gs=3 cs=0 l=1 c_cookie=6795986623443978911 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1348004740 tx=0x7f134802f1d0 comp rx=0 tx=0).stop 2026-02-23T06:50:35.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.566+0000 7f1361483640 1 -- 10.20.193.58:0/962161021 shutdown_connections 2026-02-23T06:50:35.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.566+0000 7f1361483640 1 --2- 10.20.193.58:0/962161021 >> v2:10.20.193.58:3300/0 conn(0x7f135c056550 0x7f135c05ce30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:35.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.566+0000 7f1361483640 1 --2- 10.20.193.58:0/962161021 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f135c15c040 0x7f135c05b0e0 unknown :-1 s=CLOSED pgs=15 gs=3 cs=0 l=1 c_cookie=6795986623443978911 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:35.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.566+0000 7f1361483640 1 -- 10.20.193.58:0/962161021 >> 10.20.193.58:0/962161021 conn(0x7f135c0b3c20 msgr2=0x7f135c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:50:35.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.566+0000 7f1361483640 1 -- 10.20.193.58:0/962161021 shutdown_connections 2026-02-23T06:50:35.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.566+0000 7f1361483640 1 -- 10.20.193.58:0/962161021 wait complete. 2026-02-23T06:50:35.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.567+0000 7f1361483640 1 Processor -- start 2026-02-23T06:50:35.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.567+0000 7f1361483640 1 -- start start 2026-02-23T06:50:35.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.567+0000 7f1361483640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f135c056550 0x7f135c2010b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:35.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.567+0000 7f1361483640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f135c05d370 0x7f135c151690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:35.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.567+0000 7f1361483640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f135c15c040 0x7f135c058430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:35.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.567+0000 7f1361483640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f135c1fdb40 con 0x7f135c15c040 2026-02-23T06:50:35.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.567+0000 7f1361483640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f135c15d360 con 0x7f135c056550 2026-02-23T06:50:35.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.567+0000 7f1361483640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f135c15d640 con 0x7f135c05d370 2026-02-23T06:50:35.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.568+0000 7f135b7fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f135c05d370 0x7f135c151690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:35.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.568+0000 7f135b7fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f135c05d370 0x7f135c151690 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:42384/0 (socket says 10.20.193.58:42384) 2026-02-23T06:50:35.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.568+0000 7f135b7fe640 1 -- 10.20.193.58:0/3742151745 learned_addr learned my addr 10.20.193.58:0/3742151745 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:50:35.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.568+0000 7f1360c82640 1 --2- 10.20.193.58:0/3742151745 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f135c15c040 0x7f135c058430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:35.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.568+0000 7f135bfff640 1 --2- 10.20.193.58:0/3742151745 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f135c056550 0x7f135c2010b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:35.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.568+0000 7f135b7fe640 1 -- 10.20.193.58:0/3742151745 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f135c056550 msgr2=0x7f135c2010b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:35.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.568+0000 7f135b7fe640 1 --2- 10.20.193.58:0/3742151745 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f135c056550 0x7f135c2010b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:35.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.568+0000 7f135b7fe640 1 -- 10.20.193.58:0/3742151745 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f135c15c040 msgr2=0x7f135c058430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:35.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.568+0000 7f135b7fe640 1 --2- 10.20.193.58:0/3742151745 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f135c15c040 0x7f135c058430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:35.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.568+0000 7f135b7fe640 1 -- 10.20.193.58:0/3742151745 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13480094b0 con 0x7f135c05d370 2026-02-23T06:50:35.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.568+0000 7f1360c82640 1 --2- 10.20.193.58:0/3742151745 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f135c15c040 0x7f135c058430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:50:35.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.568+0000 7f135b7fe640 1 --2- 10.20.193.58:0/3742151745 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f135c05d370 0x7f135c151690 secure :-1 s=READY pgs=16 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f134c009480 tx=0x7f134c00ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:50:35.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.568+0000 7f1358ff9640 1 -- 10.20.193.58:0/3742151745 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f134c00cd40 con 0x7f135c05d370 2026-02-23T06:50:35.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.568+0000 7f1358ff9640 1 -- 10.20.193.58:0/3742151745 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f134c004020 con 0x7f135c05d370 2026-02-23T06:50:35.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.568+0000 7f1358ff9640 1 -- 10.20.193.58:0/3742151745 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f134c00cea0 con 0x7f135c05d370 2026-02-23T06:50:35.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.568+0000 7f1361483640 1 -- 10.20.193.58:0/3742151745 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f135c1fdd50 con 0x7f135c05d370 2026-02-23T06:50:35.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.568+0000 7f1361483640 1 -- 10.20.193.58:0/3742151745 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f135c1fe310 con 0x7f135c05d370 2026-02-23T06:50:35.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.569+0000 7f1361483640 1 -- 10.20.193.58:0/3742151745 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f135c05ce30 con 0x7f135c05d370 2026-02-23T06:50:35.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.570+0000 7f1358ff9640 1 -- 10.20.193.58:0/3742151745 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f134c01f060 con 0x7f135c05d370 2026-02-23T06:50:35.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.571+0000 7f1358ff9640 1 --2- 10.20.193.58:0/3742151745 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f132c07a6c0 0x7f132c09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:35.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.571+0000 7f1358ff9640 1 -- 10.20.193.58:0/3742151745 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f134c014070 con 0x7f135c05d370 2026-02-23T06:50:35.565 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.571+0000 7f135bfff640 1 --2- 10.20.193.58:0/3742151745 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f132c07a6c0 0x7f132c09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:35.565 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.572+0000 7f135bfff640 1 --2- 10.20.193.58:0/3742151745 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f132c07a6c0 0x7f132c09ab70 secure :-1 s=READY pgs=587 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13480097e0 tx=0x7f1348031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:50:35.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.573+0000 7f1358ff9640 1 -- 10.20.193.58:0/3742151745 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f134c060fb0 con 0x7f135c05d370 2026-02-23T06:50:35.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.728+0000 7f1361483640 1 -- 10.20.193.58:0/3742151745 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f135c056330 con 0x7f135c05d370 2026-02-23T06:50:35.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.729+0000 7f1358ff9640 1 -- 10.20.193.58:0/3742151745 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1756 (secure 0 0 0) 0x7f134c004430 con 0x7f135c05d370 2026-02-23T06:50:35.722 INFO:teuthology.orchestra.run.trial058.stdout:{"election_epoch":252,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","modified":"2026-02-23T06:20:43.887319Z","created":"2026-02-23T06:20:43.887319Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:3300","nonce":0},{"type":"v1","addr":"10.20.193.58:6789","nonce":0}]},"addr":"10.20.193.58:6789/0","public_addr":"10.20.193.58:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887372+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3300","nonce":0},{"type":"v1","addr":"10.20.193.93:6789","nonce":0}]},"addr":"10.20.193.93:6789/0","public_addr":"10.20.193.93:6789/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887373+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:3301","nonce":0},{"type":"v1","addr":"10.20.193.93:6790","nonce":0}]},"addr":"10.20.193.93:6790/0","public_addr":"10.20.193.93:6790/0","priority":0,"weight":0,"time_added":"2026-02-23T06:20:43:887374+0000","crush_location":[]}]}} 2026-02-23T06:50:35.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.730+0000 7f1361483640 1 -- 10.20.193.58:0/3742151745 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f132c07a6c0 msgr2=0x7f132c09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:35.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.730+0000 7f1361483640 1 --2- 10.20.193.58:0/3742151745 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f132c07a6c0 0x7f132c09ab70 secure :-1 s=READY pgs=587 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13480097e0 tx=0x7f1348031040 comp rx=0 tx=0).stop 2026-02-23T06:50:35.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.730+0000 7f1361483640 1 -- 10.20.193.58:0/3742151745 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f135c05d370 msgr2=0x7f135c151690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:35.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.730+0000 7f1361483640 1 --2- 10.20.193.58:0/3742151745 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f135c05d370 0x7f135c151690 secure :-1 s=READY pgs=16 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f134c009480 tx=0x7f134c00ee60 comp rx=0 tx=0).stop 2026-02-23T06:50:35.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.730+0000 7f1361483640 1 -- 10.20.193.58:0/3742151745 shutdown_connections 2026-02-23T06:50:35.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.730+0000 7f1361483640 1 --2- 10.20.193.58:0/3742151745 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f132c07a6c0 0x7f132c09ab70 unknown :-1 s=CLOSED pgs=587 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:35.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.730+0000 7f1361483640 1 --2- 10.20.193.58:0/3742151745 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f135c15c040 0x7f135c058430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:35.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.730+0000 7f1361483640 1 --2- 10.20.193.58:0/3742151745 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f135c05d370 0x7f135c151690 unknown :-1 s=CLOSED pgs=16 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:35.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.730+0000 7f1361483640 1 --2- 10.20.193.58:0/3742151745 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f135c056550 0x7f135c2010b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:35.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.730+0000 7f1361483640 1 -- 10.20.193.58:0/3742151745 >> 10.20.193.58:0/3742151745 conn(0x7f135c0b3c20 msgr2=0x7f135c163200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:50:35.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.730+0000 7f1361483640 1 -- 10.20.193.58:0/3742151745 shutdown_connections 2026-02-23T06:50:35.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:35.730+0000 7f1361483640 1 -- 10.20.193.58:0/3742151745 wait complete. 2026-02-23T06:50:35.737 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-23T06:50:35.737 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2026-02-23T06:50:35.748 INFO:tasks.kclient:Unmounting kernel clients... 2026-02-23T06:50:35.748 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:50:35.748 DEBUG:teuthology.orchestra.run.trial058:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-23T06:50:35.789 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-23T06:50:35.789 DEBUG:teuthology.orchestra.run.trial058:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-23T06:50:35.867 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2026-02-23T06:50:36.027 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.033+0000 7f6656530640 1 -- 10.20.193.58:0/2397426956 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f665015d870 msgr2=0x7f66500587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:36.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.033+0000 7f6656530640 1 --2- 10.20.193.58:0/2397426956 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f665015d870 0x7f66500587b0 secure :-1 s=READY pgs=152 gs=2 cs=0 l=1 c_cookie=7871075043442107239 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66500b5040 tx=0x7f664402f250 comp rx=0 tx=0).stop 2026-02-23T06:50:36.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.033+0000 7f6656530640 1 -- 10.20.193.58:0/2397426956 shutdown_connections 2026-02-23T06:50:36.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.033+0000 7f6656530640 1 --2- 10.20.193.58:0/2397426956 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f665015d870 0x7f66500587b0 unknown :-1 s=CLOSED pgs=152 gs=2 cs=0 l=1 c_cookie=7871075043442107239 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:36.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.033+0000 7f6656530640 1 --2- 10.20.193.58:0/2397426956 >> v2:10.20.193.93:3300/0 conn(0x7f665015d4a0 0x7f66500affb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:36.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.033+0000 7f6656530640 1 -- 10.20.193.58:0/2397426956 >> 10.20.193.58:0/2397426956 conn(0x7f66500b3c20 msgr2=0x7f66500b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:50:36.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.033+0000 7f6656530640 1 -- 10.20.193.58:0/2397426956 shutdown_connections 2026-02-23T06:50:36.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.034+0000 7f6656530640 1 -- 10.20.193.58:0/2397426956 wait complete. 2026-02-23T06:50:36.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.035+0000 7f6656530640 1 Processor -- start 2026-02-23T06:50:36.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.035+0000 7f6656530640 1 -- start start 2026-02-23T06:50:36.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.035+0000 7f6656530640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f66500b6690 0x7f6650057750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:36.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.035+0000 7f6656530640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f665015d4a0 0x7f665015df00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:36.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.035+0000 7f6656530640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f665015d870 0x7f665015e440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:36.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.035+0000 7f6656530640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f66500b7720 con 0x7f665015d4a0 2026-02-23T06:50:36.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.035+0000 7f6656530640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f6650162b30 con 0x7f66500b6690 2026-02-23T06:50:36.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.035+0000 7f6656530640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f66500b7eb0 con 0x7f665015d870 2026-02-23T06:50:36.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.035+0000 7f6654d2d640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f665015d4a0 0x7f665015df00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:36.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.036+0000 7f6654d2d640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f665015d4a0 0x7f665015df00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:38654/0 (socket says 10.20.193.58:38654) 2026-02-23T06:50:36.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.036+0000 7f6654d2d640 1 -- 10.20.193.58:0/2562716610 learned_addr learned my addr 10.20.193.58:0/2562716610 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:50:36.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.036+0000 7f6655d2f640 1 --2- 10.20.193.58:0/2562716610 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f665015d870 0x7f665015e440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:36.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.036+0000 7f665552e640 1 --2- 10.20.193.58:0/2562716610 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f66500b6690 0x7f6650057750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:36.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.036+0000 7f6654d2d640 1 -- 10.20.193.58:0/2562716610 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f665015d870 msgr2=0x7f665015e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:36.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.036+0000 7f6654d2d640 1 --2- 10.20.193.58:0/2562716610 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f665015d870 0x7f665015e440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:36.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.036+0000 7f6654d2d640 1 -- 10.20.193.58:0/2562716610 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f66500b6690 msgr2=0x7f6650057750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:36.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.036+0000 7f6654d2d640 1 --2- 10.20.193.58:0/2562716610 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f66500b6690 0x7f6650057750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:36.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.036+0000 7f6654d2d640 1 -- 10.20.193.58:0/2562716610 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6644009570 con 0x7f665015d4a0 2026-02-23T06:50:36.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.036+0000 7f6654d2d640 1 --2- 10.20.193.58:0/2562716610 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f665015d4a0 0x7f665015df00 secure :-1 s=READY pgs=153 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6644005e70 tx=0x7f66440028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:50:36.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.036+0000 7f663dffb640 1 -- 10.20.193.58:0/2562716610 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f664403d070 con 0x7f665015d4a0 2026-02-23T06:50:36.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.036+0000 7f6656530640 1 -- 10.20.193.58:0/2562716610 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66500b7c50 con 0x7f665015d4a0 2026-02-23T06:50:36.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.036+0000 7f663dffb640 1 -- 10.20.193.58:0/2562716610 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6644038470 con 0x7f665015d4a0 2026-02-23T06:50:36.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.036+0000 7f663dffb640 1 -- 10.20.193.58:0/2562716610 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6644038880 con 0x7f665015d4a0 2026-02-23T06:50:36.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.036+0000 7f6656530640 1 -- 10.20.193.58:0/2562716610 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66501624e0 con 0x7f665015d4a0 2026-02-23T06:50:36.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.037+0000 7f6656530640 1 -- 10.20.193.58:0/2562716610 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6614005300 con 0x7f665015d4a0 2026-02-23T06:50:36.032 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.038+0000 7f663dffb640 1 -- 10.20.193.58:0/2562716610 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f66440389e0 con 0x7f665015d4a0 2026-02-23T06:50:36.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.039+0000 7f663dffb640 1 --2- 10.20.193.58:0/2562716610 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f662007a6c0 0x7f662009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:50:36.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.039+0000 7f663dffb640 1 -- 10.20.193.58:0/2562716610 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f66440c2010 con 0x7f665015d4a0 2026-02-23T06:50:36.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.039+0000 7f665552e640 1 --2- 10.20.193.58:0/2562716610 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f662007a6c0 0x7f662009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:50:36.033 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.040+0000 7f665552e640 1 --2- 10.20.193.58:0/2562716610 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f662007a6c0 0x7f662009ab70 secure :-1 s=READY pgs=588 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6640004740 tx=0x7f6640005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:50:36.035 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.041+0000 7f663dffb640 1 -- 10.20.193.58:0/2562716610 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f6644085330 con 0x7f665015d4a0 2026-02-23T06:50:36.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.160+0000 7f6656530640 1 -- 10.20.193.58:0/2562716610 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6614005b30 con 0x7f665015d4a0 2026-02-23T06:50:36.154 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.160+0000 7f663dffb640 1 -- 10.20.193.58:0/2562716610 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f6644088450 con 0x7f665015d4a0 2026-02-23T06:50:36.155 INFO:teuthology.orchestra.run.trial058.stderr:listed 0 entries 2026-02-23T06:50:36.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.161+0000 7f6656530640 1 -- 10.20.193.58:0/2562716610 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f662007a6c0 msgr2=0x7f662009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:36.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.161+0000 7f6656530640 1 --2- 10.20.193.58:0/2562716610 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f662007a6c0 0x7f662009ab70 secure :-1 s=READY pgs=588 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6640004740 tx=0x7f6640005f90 comp rx=0 tx=0).stop 2026-02-23T06:50:36.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.161+0000 7f6656530640 1 -- 10.20.193.58:0/2562716610 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f665015d4a0 msgr2=0x7f665015df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:50:36.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.161+0000 7f6656530640 1 --2- 10.20.193.58:0/2562716610 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f665015d4a0 0x7f665015df00 secure :-1 s=READY pgs=153 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6644005e70 tx=0x7f66440028d0 comp rx=0 tx=0).stop 2026-02-23T06:50:36.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.161+0000 7f6656530640 1 -- 10.20.193.58:0/2562716610 shutdown_connections 2026-02-23T06:50:36.156 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.161+0000 7f6656530640 1 --2- 10.20.193.58:0/2562716610 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f662007a6c0 0x7f662009ab70 unknown :-1 s=CLOSED pgs=588 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:36.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.161+0000 7f6656530640 1 --2- 10.20.193.58:0/2562716610 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f665015d870 0x7f665015e440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:36.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.161+0000 7f6656530640 1 --2- 10.20.193.58:0/2562716610 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f665015d4a0 0x7f665015df00 unknown :-1 s=CLOSED pgs=153 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:36.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.161+0000 7f6656530640 1 --2- 10.20.193.58:0/2562716610 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f66500b6690 0x7f6650057750 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:50:36.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.161+0000 7f6656530640 1 -- 10.20.193.58:0/2562716610 >> 10.20.193.58:0/2562716610 conn(0x7f66500b3c20 msgr2=0x7f665005cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:50:36.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.161+0000 7f6656530640 1 -- 10.20.193.58:0/2562716610 shutdown_connections 2026-02-23T06:50:36.157 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:50:36.161+0000 7f6656530640 1 -- 10.20.193.58:0/2562716610 wait complete. 2026-02-23T06:50:36.167 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2026-02-23T06:50:36.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-23T06:50:36.168 DEBUG:teuthology.orchestra.run.trial058:> sudo umount /home/ubuntu/cephtest/mnt.0 2026-02-23T06:50:45.728 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:50:45.732 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:51:15.789 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:51:15.793 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:51:39.091 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@trial058.front.sepia.ceph.com 2026-02-23T06:51:39.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-23T06:51:39.091 DEBUG:teuthology.orchestra.run.trial058:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2026-02-23T06:51:39.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-23T06:51:39.135 DEBUG:teuthology.orchestra.run.trial058:> ip netns list 2026-02-23T06:51:39.214 INFO:teuthology.orchestra.run.trial058.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2026-02-23T06:51:39.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-23T06:51:39.215 DEBUG:teuthology.orchestra.run.trial058:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2026-02-23T06:51:39.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-23T06:51:39.318 DEBUG:teuthology.orchestra.run.trial058:> sudo ip link delete ceph-brx 2026-02-23T06:51:39.419 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-23T06:51:39.431 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-23T06:51:39.432 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-23T06:51:39.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.571+0000 7fe3bcc83640 1 -- 10.20.193.58:0/3554480067 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3b815d870 msgr2=0x7fe3b80587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:39.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.571+0000 7fe3bcc83640 1 --2- 10.20.193.58:0/3554480067 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3b815d870 0x7fe3b80587b0 secure :-1 s=READY pgs=155 gs=3 cs=0 l=1 c_cookie=7691659124469599633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3a8004740 tx=0x7fe3a802f220 comp rx=0 tx=0).stop 2026-02-23T06:51:39.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.571+0000 7fe3bcc83640 1 -- 10.20.193.58:0/3554480067 shutdown_connections 2026-02-23T06:51:39.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.571+0000 7fe3bcc83640 1 --2- 10.20.193.58:0/3554480067 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3b815d870 0x7fe3b80587b0 unknown :-1 s=CLOSED pgs=155 gs=3 cs=0 l=1 c_cookie=7691659124469599633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:39.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.571+0000 7fe3bcc83640 1 -- 10.20.193.58:0/3554480067 >> 10.20.193.58:0/3554480067 conn(0x7fe3b80b3c20 msgr2=0x7fe3b80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:39.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.571+0000 7fe3bcc83640 1 -- 10.20.193.58:0/3554480067 shutdown_connections 2026-02-23T06:51:39.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.571+0000 7fe3bcc83640 1 -- 10.20.193.58:0/3554480067 wait complete. 2026-02-23T06:51:39.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.572+0000 7fe3bcc83640 1 Processor -- start 2026-02-23T06:51:39.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.572+0000 7fe3bcc83640 1 -- start start 2026-02-23T06:51:39.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.573+0000 7fe3bcc83640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe3b80b6690 0x7fe3b8140520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:39.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.573+0000 7fe3bcc83640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3b815d4a0 0x7fe3b814e270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:39.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.573+0000 7fe3bcc83640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe3b815d870 0x7fe3b815b9c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:39.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.573+0000 7fe3bcc83640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b814da90 con 0x7fe3b815d4a0 2026-02-23T06:51:39.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.573+0000 7fe3bcc83640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b81206e0 con 0x7fe3b815d870 2026-02-23T06:51:39.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.573+0000 7fe3bcc83640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fe3b81209c0 con 0x7fe3b80b6690 2026-02-23T06:51:39.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.573+0000 7fe3b77fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe3b80b6690 0x7fe3b8140520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:39.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.573+0000 7fe3b6ffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3b815d4a0 0x7fe3b814e270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:39.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.573+0000 7fe3b77fe640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe3b80b6690 0x7fe3b8140520 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:37220/0 (socket says 10.20.193.58:37220) 2026-02-23T06:51:39.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.573+0000 7fe3b77fe640 1 -- 10.20.193.58:0/4138798990 learned_addr learned my addr 10.20.193.58:0/4138798990 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:51:39.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.573+0000 7fe3b7fff640 1 --2- 10.20.193.58:0/4138798990 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe3b815d870 0x7fe3b815b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:39.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.573+0000 7fe3b6ffd640 1 -- 10.20.193.58:0/4138798990 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe3b80b6690 msgr2=0x7fe3b8140520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:39.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.573+0000 7fe3b6ffd640 1 --2- 10.20.193.58:0/4138798990 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe3b80b6690 0x7fe3b8140520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:39.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.573+0000 7fe3b6ffd640 1 -- 10.20.193.58:0/4138798990 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe3b815d870 msgr2=0x7fe3b815b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:39.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.573+0000 7fe3b6ffd640 1 --2- 10.20.193.58:0/4138798990 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe3b815d870 0x7fe3b815b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:39.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.573+0000 7fe3b6ffd640 1 -- 10.20.193.58:0/4138798990 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a80094b0 con 0x7fe3b815d4a0 2026-02-23T06:51:39.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.573+0000 7fe3b6ffd640 1 --2- 10.20.193.58:0/4138798990 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3b815d4a0 0x7fe3b814e270 secure :-1 s=READY pgs=156 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3a8009230 tx=0x7fe3a8002bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:39.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.574+0000 7fe393fff640 1 -- 10.20.193.58:0/4138798990 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3a8044070 con 0x7fe3b815d4a0 2026-02-23T06:51:39.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.574+0000 7fe3bcc83640 1 -- 10.20.193.58:0/4138798990 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3b8120ca0 con 0x7fe3b815d4a0 2026-02-23T06:51:39.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.574+0000 7fe393fff640 1 -- 10.20.193.58:0/4138798990 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3a8038780 con 0x7fe3b815d4a0 2026-02-23T06:51:39.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.574+0000 7fe393fff640 1 -- 10.20.193.58:0/4138798990 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3a8038b70 con 0x7fe3b815d4a0 2026-02-23T06:51:39.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.574+0000 7fe3bcc83640 1 -- 10.20.193.58:0/4138798990 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3b814e7b0 con 0x7fe3b815d4a0 2026-02-23T06:51:39.569 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.575+0000 7fe3bcc83640 1 -- 10.20.193.58:0/4138798990 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3b80b6d50 con 0x7fe3b815d4a0 2026-02-23T06:51:39.570 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.575+0000 7fe393fff640 1 -- 10.20.193.58:0/4138798990 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fe3a8038cd0 con 0x7fe3b815d4a0 2026-02-23T06:51:39.571 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.576+0000 7fe393fff640 1 --2- 10.20.193.58:0/4138798990 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe38807a6c0 0x7fe38809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:39.571 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.577+0000 7fe393fff640 1 -- 10.20.193.58:0/4138798990 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fe3a80c2420 con 0x7fe3b815d4a0 2026-02-23T06:51:39.571 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.577+0000 7fe3b77fe640 1 --2- 10.20.193.58:0/4138798990 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe38807a6c0 0x7fe38809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:39.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.578+0000 7fe3b77fe640 1 --2- 10.20.193.58:0/4138798990 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe38807a6c0 0x7fe38809ab70 secure :-1 s=READY pgs=602 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3a4007be0 tx=0x7fe3a4003dd0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:39.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.578+0000 7fe393fff640 1 -- 10.20.193.58:0/4138798990 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fe3a8085660 con 0x7fe3b815d4a0 2026-02-23T06:51:39.685 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.690+0000 7fe3bcc83640 1 -- 10.20.193.58:0/4138798990 --> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe3b814d910 con 0x7fe38807a6c0 2026-02-23T06:51:39.688 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.694+0000 7fe393fff640 1 -- 10.20.193.58:0/4138798990 <== mgr.4126 v2:10.20.193.93:6800/4124709854 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334898 (secure 0 0 0) 0x7fe3a40053e0 con 0x7fe38807a6c0 2026-02-23T06:51:39.694 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:51:39.697 INFO:teuthology.orchestra.run.trial058.stderr:dumped all 2026-02-23T06:51:39.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.696+0000 7fe3bcc83640 1 -- 10.20.193.58:0/4138798990 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe38807a6c0 msgr2=0x7fe38809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:39.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.696+0000 7fe3bcc83640 1 --2- 10.20.193.58:0/4138798990 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe38807a6c0 0x7fe38809ab70 secure :-1 s=READY pgs=602 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3a4007be0 tx=0x7fe3a4003dd0 comp rx=0 tx=0).stop 2026-02-23T06:51:39.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.696+0000 7fe3bcc83640 1 -- 10.20.193.58:0/4138798990 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3b815d4a0 msgr2=0x7fe3b814e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:39.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.696+0000 7fe3bcc83640 1 --2- 10.20.193.58:0/4138798990 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3b815d4a0 0x7fe3b814e270 secure :-1 s=READY pgs=156 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3a8009230 tx=0x7fe3a8002bd0 comp rx=0 tx=0).stop 2026-02-23T06:51:39.699 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.696+0000 7fe3bcc83640 1 -- 10.20.193.58:0/4138798990 shutdown_connections 2026-02-23T06:51:39.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.696+0000 7fe3bcc83640 1 --2- 10.20.193.58:0/4138798990 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fe38807a6c0 0x7fe38809ab70 unknown :-1 s=CLOSED pgs=602 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:39.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.696+0000 7fe3bcc83640 1 --2- 10.20.193.58:0/4138798990 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fe3b815d870 0x7fe3b815b9c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:39.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.696+0000 7fe3bcc83640 1 --2- 10.20.193.58:0/4138798990 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fe3b815d4a0 0x7fe3b814e270 unknown :-1 s=CLOSED pgs=156 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:39.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.696+0000 7fe3bcc83640 1 --2- 10.20.193.58:0/4138798990 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fe3b80b6690 0x7fe3b8140520 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:39.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.696+0000 7fe3bcc83640 1 -- 10.20.193.58:0/4138798990 >> 10.20.193.58:0/4138798990 conn(0x7fe3b80b3c20 msgr2=0x7fe3b805c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:39.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.696+0000 7fe3bcc83640 1 -- 10.20.193.58:0/4138798990 shutdown_connections 2026-02-23T06:51:39.700 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.696+0000 7fe3bcc83640 1 -- 10.20.193.58:0/4138798990 wait complete. 2026-02-23T06:51:39.704 INFO:teuthology.orchestra.run.trial058.stdout:{"pg_ready":true,"pg_map":{"version":938,"stamp":"2026-02-23T06:51:38.655843+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3578981466,"num_objects":878,"num_object_clones":0,"num_object_copies":3456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":878,"num_whiteouts":0,"num_read":117,"num_read_kb":175,"num_write":759269,"num_write_kb":39399252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62961,"ondisk_log_size":62961,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3474480,"kb_used_data":1689136,"kb_used_omap":705,"kb_used_meta":1784510,"kb_avail":751500240,"statfs":{"total":773094113280,"available":769536245760,"internally_reserved":0,"allocated":1729675264,"data_stored":7158907516,"data_compressed":421610194,"data_compressed_allocated":1018142720,"data_compressed_original":6448824320,"omap_allocated":722493,"internal_metadata":1827338691},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001580"},"pg_stats":[{"pgid":"2.1f","version":"27'27","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:38.203132+0000","last_change":"2026-02-23T06:21:17.142582+0000","last_active":"2026-02-23T06:50:38.203132+0000","last_peered":"2026-02-23T06:50:38.203132+0000","last_clean":"2026-02-23T06:50:38.203132+0000","last_became_active":"2026-02-23T06:21:17.142416+0000","last_became_peered":"2026-02-23T06:21:17.142416+0000","last_unstale":"2026-02-23T06:50:38.203132+0000","last_undegraded":"2026-02-23T06:50:38.203132+0000","last_fullsized":"2026-02-23T06:50:38.203132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:13:12.649937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569948,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.110619+0000","last_change":"2026-02-23T06:21:18.148362+0000","last_active":"2026-02-23T06:49:41.110619+0000","last_peered":"2026-02-23T06:49:41.110619+0000","last_clean":"2026-02-23T06:49:41.110619+0000","last_became_active":"2026-02-23T06:21:18.148276+0000","last_became_peered":"2026-02-23T06:21:18.148276+0000","last_unstale":"2026-02-23T06:49:41.110619+0000","last_undegraded":"2026-02-23T06:49:41.110619+0000","last_fullsized":"2026-02-23T06:49:41.110619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:47.221741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'2019","reported_seq":2050,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.526367+0000","last_change":"2026-02-23T06:21:22.169541+0000","last_active":"2026-02-23T06:50:45.526367+0000","last_peered":"2026-02-23T06:50:45.526367+0000","last_clean":"2026-02-23T06:50:45.526367+0000","last_became_active":"2026-02-23T06:21:22.169307+0000","last_became_peered":"2026-02-23T06:21:22.169307+0000","last_unstale":"2026-02-23T06:50:45.526367+0000","last_undegraded":"2026-02-23T06:50:45.526367+0000","last_fullsized":"2026-02-23T06:50:45.526367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2019,"log_dups_size":0,"ondisk_log_size":2019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:40:10.952374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25583,"num_write_kb":1337383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'3","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.078645+0000","last_change":"2026-02-23T06:21:17.138864+0000","last_active":"2026-02-23T06:49:41.078645+0000","last_peered":"2026-02-23T06:49:41.078645+0000","last_clean":"2026-02-23T06:49:41.078645+0000","last_became_active":"2026-02-23T06:21:17.138651+0000","last_became_peered":"2026-02-23T06:21:17.138651+0000","last_unstale":"2026-02-23T06:49:41.078645+0000","last_undegraded":"2026-02-23T06:49:41.078645+0000","last_fullsized":"2026-02-23T06:49:41.078645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:24.172617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'14","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.255888+0000","last_change":"2026-02-23T06:21:18.145040+0000","last_active":"2026-02-23T06:50:43.255888+0000","last_peered":"2026-02-23T06:50:43.255888+0000","last_clean":"2026-02-23T06:50:43.255888+0000","last_became_active":"2026-02-23T06:21:18.144915+0000","last_became_peered":"2026-02-23T06:21:18.144915+0000","last_unstale":"2026-02-23T06:50:43.255888+0000","last_undegraded":"2026-02-23T06:50:43.255888+0000","last_fullsized":"2026-02-23T06:50:43.255888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:17:30.105623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'1991","reported_seq":2030,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.573583+0000","last_change":"2026-02-23T06:22:05.910182+0000","last_active":"2026-02-23T06:50:45.573583+0000","last_peered":"2026-02-23T06:50:45.573583+0000","last_clean":"2026-02-23T06:50:45.573583+0000","last_became_active":"2026-02-23T06:22:05.909877+0000","last_became_peered":"2026-02-23T06:22:05.909877+0000","last_unstale":"2026-02-23T06:50:45.573583+0000","last_undegraded":"2026-02-23T06:50:45.573583+0000","last_fullsized":"2026-02-23T06:50:45.573583+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:45:51.963908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25310,"num_write_kb":1284660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'9","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.059320+0000","last_change":"2026-02-23T06:21:17.150375+0000","last_active":"2026-02-23T06:49:41.059320+0000","last_peered":"2026-02-23T06:49:41.059320+0000","last_clean":"2026-02-23T06:49:41.059320+0000","last_became_active":"2026-02-23T06:21:17.150244+0000","last_became_peered":"2026-02-23T06:21:17.150244+0000","last_unstale":"2026-02-23T06:49:41.059320+0000","last_undegraded":"2026-02-23T06:49:41.059320+0000","last_fullsized":"2026-02-23T06:49:41.059320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:06:21.465108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:41.247849+0000","last_change":"2026-02-23T06:21:18.150247+0000","last_active":"2026-02-23T06:50:41.247849+0000","last_peered":"2026-02-23T06:50:41.247849+0000","last_clean":"2026-02-23T06:50:41.247849+0000","last_became_active":"2026-02-23T06:21:18.149827+0000","last_became_peered":"2026-02-23T06:21:18.149827+0000","last_unstale":"2026-02-23T06:50:41.247849+0000","last_undegraded":"2026-02-23T06:50:41.247849+0000","last_fullsized":"2026-02-23T06:50:41.247849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:37:58.944726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'1720","reported_seq":1751,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.544254+0000","last_change":"2026-02-23T06:21:22.174417+0000","last_active":"2026-02-23T06:50:45.544254+0000","last_peered":"2026-02-23T06:50:45.544254+0000","last_clean":"2026-02-23T06:50:45.544254+0000","last_became_active":"2026-02-23T06:21:22.173939+0000","last_became_peered":"2026-02-23T06:21:22.173939+0000","last_unstale":"2026-02-23T06:50:45.544254+0000","last_undegraded":"2026-02-23T06:50:45.544254+0000","last_fullsized":"2026-02-23T06:50:45.544254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1720,"log_dups_size":0,"ondisk_log_size":1720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:41:53.008301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21991,"num_write_kb":1043178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:48:49.514790+0000","last_change":"2026-02-23T06:21:17.145244+0000","last_active":"2026-02-23T06:48:49.514790+0000","last_peered":"2026-02-23T06:48:49.514790+0000","last_clean":"2026-02-23T06:48:49.514790+0000","last_became_active":"2026-02-23T06:21:17.144122+0000","last_became_peered":"2026-02-23T06:21:17.144122+0000","last_unstale":"2026-02-23T06:48:49.514790+0000","last_undegraded":"2026-02-23T06:48:49.514790+0000","last_fullsized":"2026-02-23T06:48:49.514790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:42:56.020005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'11","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.972332+0000","last_change":"2026-02-23T06:22:05.870395+0000","last_active":"2026-02-23T06:50:43.972332+0000","last_peered":"2026-02-23T06:50:43.972332+0000","last_clean":"2026-02-23T06:50:43.972332+0000","last_became_active":"2026-02-23T06:22:05.870252+0000","last_became_peered":"2026-02-23T06:22:05.870252+0000","last_unstale":"2026-02-23T06:50:43.972332+0000","last_undegraded":"2026-02-23T06:50:43.972332+0000","last_fullsized":"2026-02-23T06:50:43.972332+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:05:32.729525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'2068","reported_seq":2099,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.563415+0000","last_change":"2026-02-23T06:21:22.168755+0000","last_active":"2026-02-23T06:50:45.563415+0000","last_peered":"2026-02-23T06:50:45.563415+0000","last_clean":"2026-02-23T06:50:45.563415+0000","last_became_active":"2026-02-23T06:21:22.165671+0000","last_became_peered":"2026-02-23T06:21:22.165671+0000","last_unstale":"2026-02-23T06:50:45.563415+0000","last_undegraded":"2026-02-23T06:50:45.563415+0000","last_fullsized":"2026-02-23T06:50:45.563415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2068,"log_dups_size":0,"ondisk_log_size":2068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:04:32.848929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26558,"num_write_kb":1292875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'10","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.058819+0000","last_change":"2026-02-23T06:21:18.150907+0000","last_active":"2026-02-23T06:49:41.058819+0000","last_peered":"2026-02-23T06:49:41.058819+0000","last_clean":"2026-02-23T06:49:41.058819+0000","last_became_active":"2026-02-23T06:21:18.150604+0000","last_became_peered":"2026-02-23T06:21:18.150604+0000","last_unstale":"2026-02-23T06:49:41.058819+0000","last_undegraded":"2026-02-23T06:49:41.058819+0000","last_fullsized":"2026-02-23T06:49:41.058819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:15:21.672153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'325","reported_seq":364,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.103715+0000","last_change":"2026-02-23T06:21:17.147523+0000","last_active":"2026-02-23T06:49:41.103715+0000","last_peered":"2026-02-23T06:49:41.103715+0000","last_clean":"2026-02-23T06:49:41.103715+0000","last_became_active":"2026-02-23T06:21:17.147351+0000","last_became_peered":"2026-02-23T06:21:17.147351+0000","last_unstale":"2026-02-23T06:49:41.103715+0000","last_undegraded":"2026-02-23T06:49:41.103715+0000","last_fullsized":"2026-02-23T06:49:41.103715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:36:34.550499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":322,"num_write_kb":4304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'1793","reported_seq":1825,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.575304+0000","last_change":"2026-02-23T06:21:22.169413+0000","last_active":"2026-02-23T06:50:45.575304+0000","last_peered":"2026-02-23T06:50:45.575304+0000","last_clean":"2026-02-23T06:50:45.575304+0000","last_became_active":"2026-02-23T06:21:22.169259+0000","last_became_peered":"2026-02-23T06:21:22.169259+0000","last_unstale":"2026-02-23T06:50:45.575304+0000","last_undegraded":"2026-02-23T06:50:45.575304+0000","last_fullsized":"2026-02-23T06:50:45.575304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1793,"log_dups_size":0,"ondisk_log_size":1793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:14:12.944321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22776,"num_write_kb":1137326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'10","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:34.445802+0000","last_change":"2026-02-23T06:21:18.142316+0000","last_active":"2026-02-23T06:50:34.445802+0000","last_peered":"2026-02-23T06:50:34.445802+0000","last_clean":"2026-02-23T06:50:34.445802+0000","last_became_active":"2026-02-23T06:21:18.142144+0000","last_became_peered":"2026-02-23T06:21:18.142144+0000","last_unstale":"2026-02-23T06:50:34.445802+0000","last_undegraded":"2026-02-23T06:50:34.445802+0000","last_fullsized":"2026-02-23T06:50:34.445802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:53:33.429271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'1","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:47:24.431558+0000","last_change":"2026-02-23T06:21:17.137576+0000","last_active":"2026-02-23T06:47:24.431558+0000","last_peered":"2026-02-23T06:47:24.431558+0000","last_clean":"2026-02-23T06:47:24.431558+0000","last_became_active":"2026-02-23T06:21:17.137371+0000","last_became_peered":"2026-02-23T06:21:17.137371+0000","last_unstale":"2026-02-23T06:47:24.431558+0000","last_undegraded":"2026-02-23T06:47:24.431558+0000","last_fullsized":"2026-02-23T06:47:24.431558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:27.159743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'1749","reported_seq":1781,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.569230+0000","last_change":"2026-02-23T06:21:22.163003+0000","last_active":"2026-02-23T06:50:45.569230+0000","last_peered":"2026-02-23T06:50:45.569230+0000","last_clean":"2026-02-23T06:50:45.569230+0000","last_became_active":"2026-02-23T06:21:22.162898+0000","last_became_peered":"2026-02-23T06:21:22.162898+0000","last_unstale":"2026-02-23T06:50:45.569230+0000","last_undegraded":"2026-02-23T06:50:45.569230+0000","last_fullsized":"2026-02-23T06:50:45.569230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1749,"log_dups_size":0,"ondisk_log_size":1749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:29:18.161667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21377,"num_write_kb":1230733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'8","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:29.498516+0000","last_change":"2026-02-23T06:21:18.141281+0000","last_active":"2026-02-23T06:49:29.498516+0000","last_peered":"2026-02-23T06:49:29.498516+0000","last_clean":"2026-02-23T06:49:29.498516+0000","last_became_active":"2026-02-23T06:21:18.141090+0000","last_became_peered":"2026-02-23T06:21:18.141090+0000","last_unstale":"2026-02-23T06:49:29.498516+0000","last_undegraded":"2026-02-23T06:49:29.498516+0000","last_fullsized":"2026-02-23T06:49:29.498516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:12:21.750595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:47:19.490471+0000","last_change":"2026-02-23T06:21:17.144179+0000","last_active":"2026-02-23T06:47:19.490471+0000","last_peered":"2026-02-23T06:47:19.490471+0000","last_clean":"2026-02-23T06:47:19.490471+0000","last_became_active":"2026-02-23T06:21:17.144017+0000","last_became_peered":"2026-02-23T06:21:17.144017+0000","last_unstale":"2026-02-23T06:47:19.490471+0000","last_undegraded":"2026-02-23T06:47:19.490471+0000","last_fullsized":"2026-02-23T06:47:19.490471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:25:41.992201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'2539","reported_seq":2571,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.575621+0000","last_change":"2026-02-23T06:21:22.174826+0000","last_active":"2026-02-23T06:50:45.575621+0000","last_peered":"2026-02-23T06:50:45.575621+0000","last_clean":"2026-02-23T06:50:45.575621+0000","last_became_active":"2026-02-23T06:21:22.174683+0000","last_became_peered":"2026-02-23T06:21:22.174683+0000","last_unstale":"2026-02-23T06:50:45.575621+0000","last_undegraded":"2026-02-23T06:50:45.575621+0000","last_fullsized":"2026-02-23T06:50:45.575621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2539,"log_dups_size":0,"ondisk_log_size":2539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:04:49.277580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32937,"num_write_kb":1504117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'7","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.086801+0000","last_change":"2026-02-23T06:21:18.145331+0000","last_active":"2026-02-23T06:49:41.086801+0000","last_peered":"2026-02-23T06:49:41.086801+0000","last_clean":"2026-02-23T06:49:41.086801+0000","last_became_active":"2026-02-23T06:21:18.145231+0000","last_became_peered":"2026-02-23T06:21:18.145231+0000","last_unstale":"2026-02-23T06:49:41.086801+0000","last_undegraded":"2026-02-23T06:49:41.086801+0000","last_fullsized":"2026-02-23T06:49:41.086801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:32:44.487867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'3","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:29.517107+0000","last_change":"2026-02-23T06:21:17.147584+0000","last_active":"2026-02-23T06:49:29.517107+0000","last_peered":"2026-02-23T06:49:29.517107+0000","last_clean":"2026-02-23T06:49:29.517107+0000","last_became_active":"2026-02-23T06:21:17.147431+0000","last_became_peered":"2026-02-23T06:21:17.147431+0000","last_unstale":"2026-02-23T06:49:29.517107+0000","last_undegraded":"2026-02-23T06:49:29.517107+0000","last_fullsized":"2026-02-23T06:49:29.517107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:10:39.127457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'2046","reported_seq":2078,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.529417+0000","last_change":"2026-02-23T06:21:22.175656+0000","last_active":"2026-02-23T06:50:45.529417+0000","last_peered":"2026-02-23T06:50:45.529417+0000","last_clean":"2026-02-23T06:50:45.529417+0000","last_became_active":"2026-02-23T06:21:22.175493+0000","last_became_peered":"2026-02-23T06:21:22.175493+0000","last_unstale":"2026-02-23T06:50:45.529417+0000","last_undegraded":"2026-02-23T06:50:45.529417+0000","last_fullsized":"2026-02-23T06:50:45.529417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2046,"log_dups_size":0,"ondisk_log_size":2046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:10:41.366772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25584,"num_write_kb":1337535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'18","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:29.059447+0000","last_change":"2026-02-23T06:21:18.141486+0000","last_active":"2026-02-23T06:50:29.059447+0000","last_peered":"2026-02-23T06:50:29.059447+0000","last_clean":"2026-02-23T06:50:29.059447+0000","last_became_active":"2026-02-23T06:21:18.141277+0000","last_became_peered":"2026-02-23T06:21:18.141277+0000","last_unstale":"2026-02-23T06:50:29.059447+0000","last_undegraded":"2026-02-23T06:50:29.059447+0000","last_fullsized":"2026-02-23T06:50:29.059447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:21:15.738187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.091039+0000","last_change":"2026-02-23T06:21:17.148536+0000","last_active":"2026-02-23T06:49:41.091039+0000","last_peered":"2026-02-23T06:49:41.091039+0000","last_clean":"2026-02-23T06:49:41.091039+0000","last_became_active":"2026-02-23T06:21:17.148424+0000","last_became_peered":"2026-02-23T06:21:17.148424+0000","last_unstale":"2026-02-23T06:49:41.091039+0000","last_undegraded":"2026-02-23T06:49:41.091039+0000","last_fullsized":"2026-02-23T06:49:41.091039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:02:54.995144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'1584","reported_seq":1617,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:44.677283+0000","last_change":"2026-02-23T06:21:22.171333+0000","last_active":"2026-02-23T06:50:44.677283+0000","last_peered":"2026-02-23T06:50:44.677283+0000","last_clean":"2026-02-23T06:50:44.677283+0000","last_became_active":"2026-02-23T06:21:22.170496+0000","last_became_peered":"2026-02-23T06:21:22.170496+0000","last_unstale":"2026-02-23T06:50:44.677283+0000","last_undegraded":"2026-02-23T06:50:44.677283+0000","last_fullsized":"2026-02-23T06:50:44.677283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1584,"log_dups_size":0,"ondisk_log_size":1584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:40:07.996281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20571,"num_write_kb":974984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'12","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.629461+0000","last_change":"2026-02-23T06:21:18.142135+0000","last_active":"2026-02-23T06:50:43.629461+0000","last_peered":"2026-02-23T06:50:43.629461+0000","last_clean":"2026-02-23T06:50:43.629461+0000","last_became_active":"2026-02-23T06:21:18.141771+0000","last_became_peered":"2026-02-23T06:21:18.141771+0000","last_unstale":"2026-02-23T06:50:43.629461+0000","last_undegraded":"2026-02-23T06:50:43.629461+0000","last_fullsized":"2026-02-23T06:50:43.629461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:10:18.195986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'154","reported_seq":193,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:37.438555+0000","last_change":"2026-02-23T06:21:17.142326+0000","last_active":"2026-02-23T06:50:37.438555+0000","last_peered":"2026-02-23T06:50:37.438555+0000","last_clean":"2026-02-23T06:50:37.438555+0000","last_became_active":"2026-02-23T06:21:17.142203+0000","last_became_peered":"2026-02-23T06:21:17.142203+0000","last_unstale":"2026-02-23T06:50:37.438555+0000","last_undegraded":"2026-02-23T06:50:37.438555+0000","last_fullsized":"2026-02-23T06:50:37.438555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:49:44.262210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'1540","reported_seq":1574,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.582158+0000","last_change":"2026-02-23T06:21:22.168717+0000","last_active":"2026-02-23T06:50:45.582158+0000","last_peered":"2026-02-23T06:50:45.582158+0000","last_clean":"2026-02-23T06:50:45.582158+0000","last_became_active":"2026-02-23T06:21:22.168375+0000","last_became_peered":"2026-02-23T06:21:22.168375+0000","last_unstale":"2026-02-23T06:50:45.582158+0000","last_undegraded":"2026-02-23T06:50:45.582158+0000","last_fullsized":"2026-02-23T06:50:45.582158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1540,"log_dups_size":0,"ondisk_log_size":1540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:03:53.993581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18660,"num_write_kb":1083504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'9","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:29.444279+0000","last_change":"2026-02-23T06:21:18.141908+0000","last_active":"2026-02-23T06:50:29.444279+0000","last_peered":"2026-02-23T06:50:29.444279+0000","last_clean":"2026-02-23T06:50:29.444279+0000","last_became_active":"2026-02-23T06:21:18.141363+0000","last_became_peered":"2026-02-23T06:21:18.141363+0000","last_unstale":"2026-02-23T06:50:29.444279+0000","last_undegraded":"2026-02-23T06:50:29.444279+0000","last_fullsized":"2026-02-23T06:50:29.444279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:06:26.731868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.081381+0000","last_change":"2026-02-23T06:21:17.144716+0000","last_active":"2026-02-23T06:49:41.081381+0000","last_peered":"2026-02-23T06:49:41.081381+0000","last_clean":"2026-02-23T06:49:41.081381+0000","last_became_active":"2026-02-23T06:21:17.144515+0000","last_became_peered":"2026-02-23T06:21:17.144515+0000","last_unstale":"2026-02-23T06:49:41.081381+0000","last_undegraded":"2026-02-23T06:49:41.081381+0000","last_fullsized":"2026-02-23T06:49:41.081381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:38:35.014170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'1993","reported_seq":2026,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.583075+0000","last_change":"2026-02-23T06:21:22.171364+0000","last_active":"2026-02-23T06:50:45.583075+0000","last_peered":"2026-02-23T06:50:45.583075+0000","last_clean":"2026-02-23T06:50:45.583075+0000","last_became_active":"2026-02-23T06:21:22.171165+0000","last_became_peered":"2026-02-23T06:21:22.171165+0000","last_unstale":"2026-02-23T06:50:45.583075+0000","last_undegraded":"2026-02-23T06:50:45.583075+0000","last_fullsized":"2026-02-23T06:50:45.583075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1993,"log_dups_size":0,"ondisk_log_size":1993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:00:42.055334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24991,"num_write_kb":1370848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'12","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:34.065120+0000","last_change":"2026-02-23T06:21:18.144182+0000","last_active":"2026-02-23T06:50:34.065120+0000","last_peered":"2026-02-23T06:50:34.065120+0000","last_clean":"2026-02-23T06:50:34.065120+0000","last_became_active":"2026-02-23T06:21:18.143585+0000","last_became_peered":"2026-02-23T06:21:18.143585+0000","last_unstale":"2026-02-23T06:50:34.065120+0000","last_undegraded":"2026-02-23T06:50:34.065120+0000","last_fullsized":"2026-02-23T06:50:34.065120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:07:05.513990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:48:24.435637+0000","last_change":"2026-02-23T06:21:17.137935+0000","last_active":"2026-02-23T06:48:24.435637+0000","last_peered":"2026-02-23T06:48:24.435637+0000","last_clean":"2026-02-23T06:48:24.435637+0000","last_became_active":"2026-02-23T06:21:17.137386+0000","last_became_peered":"2026-02-23T06:21:17.137386+0000","last_unstale":"2026-02-23T06:48:24.435637+0000","last_undegraded":"2026-02-23T06:48:24.435637+0000","last_fullsized":"2026-02-23T06:48:24.435637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:51:24.646436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'1807","reported_seq":1840,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.529577+0000","last_change":"2026-02-23T06:21:22.163110+0000","last_active":"2026-02-23T06:50:45.529577+0000","last_peered":"2026-02-23T06:50:45.529577+0000","last_clean":"2026-02-23T06:50:45.529577+0000","last_became_active":"2026-02-23T06:21:22.162891+0000","last_became_peered":"2026-02-23T06:21:22.162891+0000","last_unstale":"2026-02-23T06:50:45.529577+0000","last_undegraded":"2026-02-23T06:50:45.529577+0000","last_fullsized":"2026-02-23T06:50:45.529577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1807,"log_dups_size":0,"ondisk_log_size":1807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:06:23.664613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22820,"num_write_kb":1167007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'9","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:42.194253+0000","last_change":"2026-02-23T06:21:18.152606+0000","last_active":"2026-02-23T06:50:42.194253+0000","last_peered":"2026-02-23T06:50:42.194253+0000","last_clean":"2026-02-23T06:50:42.194253+0000","last_became_active":"2026-02-23T06:21:18.152102+0000","last_became_peered":"2026-02-23T06:21:18.152102+0000","last_unstale":"2026-02-23T06:50:42.194253+0000","last_undegraded":"2026-02-23T06:50:42.194253+0000","last_fullsized":"2026-02-23T06:50:42.194253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:59:30.188417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:48:24.491404+0000","last_change":"2026-02-23T06:21:17.143289+0000","last_active":"2026-02-23T06:48:24.491404+0000","last_peered":"2026-02-23T06:48:24.491404+0000","last_clean":"2026-02-23T06:48:24.491404+0000","last_became_active":"2026-02-23T06:21:17.143201+0000","last_became_peered":"2026-02-23T06:21:17.143201+0000","last_unstale":"2026-02-23T06:48:24.491404+0000","last_undegraded":"2026-02-23T06:48:24.491404+0000","last_fullsized":"2026-02-23T06:48:24.491404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:33:06.892035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'1941","reported_seq":1974,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.582448+0000","last_change":"2026-02-23T06:21:22.163932+0000","last_active":"2026-02-23T06:50:45.582448+0000","last_peered":"2026-02-23T06:50:45.582448+0000","last_clean":"2026-02-23T06:50:45.582448+0000","last_became_active":"2026-02-23T06:21:22.163734+0000","last_became_peered":"2026-02-23T06:21:22.163734+0000","last_unstale":"2026-02-23T06:50:45.582448+0000","last_undegraded":"2026-02-23T06:50:45.582448+0000","last_fullsized":"2026-02-23T06:50:45.582448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1941,"log_dups_size":0,"ondisk_log_size":1941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:44:47.208608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24396,"num_write_kb":1329645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'16","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:44.636060+0000","last_change":"2026-02-23T06:21:18.141664+0000","last_active":"2026-02-23T06:50:44.636060+0000","last_peered":"2026-02-23T06:50:44.636060+0000","last_clean":"2026-02-23T06:50:44.636060+0000","last_became_active":"2026-02-23T06:21:18.141350+0000","last_became_peered":"2026-02-23T06:21:18.141350+0000","last_unstale":"2026-02-23T06:50:44.636060+0000","last_undegraded":"2026-02-23T06:50:44.636060+0000","last_fullsized":"2026-02-23T06:50:44.636060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:01:50.434732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'31","reported_seq":102,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:41.061841+0000","last_change":"2026-02-23T06:21:17.139311+0000","last_active":"2026-02-23T06:50:41.061841+0000","last_peered":"2026-02-23T06:50:41.061841+0000","last_clean":"2026-02-23T06:50:41.061841+0000","last_became_active":"2026-02-23T06:21:17.139200+0000","last_became_peered":"2026-02-23T06:21:17.139200+0000","last_unstale":"2026-02-23T06:50:41.061841+0000","last_undegraded":"2026-02-23T06:50:41.061841+0000","last_fullsized":"2026-02-23T06:50:41.061841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:52:23.863807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78928,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":99,"num_write":30,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'1732","reported_seq":1764,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.547623+0000","last_change":"2026-02-23T06:21:22.164793+0000","last_active":"2026-02-23T06:50:45.547623+0000","last_peered":"2026-02-23T06:50:45.547623+0000","last_clean":"2026-02-23T06:50:45.547623+0000","last_became_active":"2026-02-23T06:21:22.164667+0000","last_became_peered":"2026-02-23T06:21:22.164667+0000","last_unstale":"2026-02-23T06:50:45.547623+0000","last_undegraded":"2026-02-23T06:50:45.547623+0000","last_fullsized":"2026-02-23T06:50:45.547623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1732,"log_dups_size":0,"ondisk_log_size":1732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:36:39.520044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22104,"num_write_kb":1081444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'7","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:29.444261+0000","last_change":"2026-02-23T06:21:18.146624+0000","last_active":"2026-02-23T06:50:29.444261+0000","last_peered":"2026-02-23T06:50:29.444261+0000","last_clean":"2026-02-23T06:50:29.444261+0000","last_became_active":"2026-02-23T06:21:18.146491+0000","last_became_peered":"2026-02-23T06:21:18.146491+0000","last_unstale":"2026-02-23T06:50:29.444261+0000","last_undegraded":"2026-02-23T06:50:29.444261+0000","last_fullsized":"2026-02-23T06:50:29.444261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:11:23.574241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'5","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.036902+0000","last_change":"2026-02-23T06:21:17.143128+0000","last_active":"2026-02-23T06:49:41.036902+0000","last_peered":"2026-02-23T06:49:41.036902+0000","last_clean":"2026-02-23T06:49:41.036902+0000","last_became_active":"2026-02-23T06:21:17.143050+0000","last_became_peered":"2026-02-23T06:21:17.143050+0000","last_unstale":"2026-02-23T06:49:41.036902+0000","last_undegraded":"2026-02-23T06:49:41.036902+0000","last_fullsized":"2026-02-23T06:49:41.036902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:15.628487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'1668","reported_seq":1700,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.540464+0000","last_change":"2026-02-23T06:21:22.168755+0000","last_active":"2026-02-23T06:50:45.540464+0000","last_peered":"2026-02-23T06:50:45.540464+0000","last_clean":"2026-02-23T06:50:45.540464+0000","last_became_active":"2026-02-23T06:21:22.168510+0000","last_became_peered":"2026-02-23T06:21:22.168510+0000","last_unstale":"2026-02-23T06:50:45.540464+0000","last_undegraded":"2026-02-23T06:50:45.540464+0000","last_fullsized":"2026-02-23T06:50:45.540464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1668,"log_dups_size":0,"ondisk_log_size":1668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:19:06.716318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20170,"num_write_kb":1220870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:41.398913+0000","last_change":"2026-02-23T06:21:18.145397+0000","last_active":"2026-02-23T06:50:41.398913+0000","last_peered":"2026-02-23T06:50:41.398913+0000","last_clean":"2026-02-23T06:50:41.398913+0000","last_became_active":"2026-02-23T06:21:18.145214+0000","last_became_peered":"2026-02-23T06:21:18.145214+0000","last_unstale":"2026-02-23T06:50:41.398913+0000","last_undegraded":"2026-02-23T06:50:41.398913+0000","last_fullsized":"2026-02-23T06:50:41.398913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:33:41.870582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'2","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.031120+0000","last_change":"2026-02-23T06:21:17.147696+0000","last_active":"2026-02-23T06:49:41.031120+0000","last_peered":"2026-02-23T06:49:41.031120+0000","last_clean":"2026-02-23T06:49:41.031120+0000","last_became_active":"2026-02-23T06:21:17.147619+0000","last_became_peered":"2026-02-23T06:21:17.147619+0000","last_unstale":"2026-02-23T06:49:41.031120+0000","last_undegraded":"2026-02-23T06:49:41.031120+0000","last_fullsized":"2026-02-23T06:49:41.031120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:49:09.070245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'112","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:19.503937+0000","last_change":"2026-02-23T06:21:11.397748+0000","last_active":"2026-02-23T06:49:19.503937+0000","last_peered":"2026-02-23T06:49:19.503937+0000","last_clean":"2026-02-23T06:49:19.503937+0000","last_became_active":"2026-02-23T06:21:11.397664+0000","last_became_peered":"2026-02-23T06:21:11.397664+0000","last_unstale":"2026-02-23T06:49:19.503937+0000","last_undegraded":"2026-02-23T06:49:19.503937+0000","last_fullsized":"2026-02-23T06:49:19.503937+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:10.392316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:10.392316+0000","last_clean_scrub_stamp":"2026-02-23T06:21:10.392316+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:43.157572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'1573","reported_seq":1606,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.540404+0000","last_change":"2026-02-23T06:21:22.174696+0000","last_active":"2026-02-23T06:50:45.540404+0000","last_peered":"2026-02-23T06:50:45.540404+0000","last_clean":"2026-02-23T06:50:45.540404+0000","last_became_active":"2026-02-23T06:21:22.174253+0000","last_became_peered":"2026-02-23T06:21:22.174253+0000","last_unstale":"2026-02-23T06:50:45.540404+0000","last_undegraded":"2026-02-23T06:50:45.540404+0000","last_fullsized":"2026-02-23T06:50:45.540404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1573,"log_dups_size":0,"ondisk_log_size":1573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:28.487343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19207,"num_write_kb":1122014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'10","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:14.095464+0000","last_change":"2026-02-23T06:21:18.150652+0000","last_active":"2026-02-23T06:50:14.095464+0000","last_peered":"2026-02-23T06:50:14.095464+0000","last_clean":"2026-02-23T06:50:14.095464+0000","last_became_active":"2026-02-23T06:21:18.150501+0000","last_became_peered":"2026-02-23T06:21:18.150501+0000","last_unstale":"2026-02-23T06:50:14.095464+0000","last_undegraded":"2026-02-23T06:50:14.095464+0000","last_fullsized":"2026-02-23T06:50:14.095464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:34:20.113034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.038910+0000","last_change":"2026-02-23T06:21:17.146074+0000","last_active":"2026-02-23T06:49:41.038910+0000","last_peered":"2026-02-23T06:49:41.038910+0000","last_clean":"2026-02-23T06:49:41.038910+0000","last_became_active":"2026-02-23T06:21:17.145938+0000","last_became_peered":"2026-02-23T06:21:17.145938+0000","last_unstale":"2026-02-23T06:49:41.038910+0000","last_undegraded":"2026-02-23T06:49:41.038910+0000","last_fullsized":"2026-02-23T06:49:41.038910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:41:42.571718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'1561","reported_seq":1593,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:44.762982+0000","last_change":"2026-02-23T06:21:22.172266+0000","last_active":"2026-02-23T06:50:44.762982+0000","last_peered":"2026-02-23T06:50:44.762982+0000","last_clean":"2026-02-23T06:50:44.762982+0000","last_became_active":"2026-02-23T06:21:22.171828+0000","last_became_peered":"2026-02-23T06:21:22.171828+0000","last_unstale":"2026-02-23T06:50:44.762982+0000","last_undegraded":"2026-02-23T06:50:44.762982+0000","last_fullsized":"2026-02-23T06:50:44.762982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1561,"log_dups_size":0,"ondisk_log_size":1561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:34:06.583640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19191,"num_write_kb":1080158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'12","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.093218+0000","last_change":"2026-02-23T06:21:18.147056+0000","last_active":"2026-02-23T06:49:41.093218+0000","last_peered":"2026-02-23T06:49:41.093218+0000","last_clean":"2026-02-23T06:49:41.093218+0000","last_became_active":"2026-02-23T06:21:18.146977+0000","last_became_peered":"2026-02-23T06:21:18.146977+0000","last_unstale":"2026-02-23T06:49:41.093218+0000","last_undegraded":"2026-02-23T06:49:41.093218+0000","last_fullsized":"2026-02-23T06:49:41.093218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:02:14.013207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.036506+0000","last_change":"2026-02-23T06:21:17.139417+0000","last_active":"2026-02-23T06:49:41.036506+0000","last_peered":"2026-02-23T06:49:41.036506+0000","last_clean":"2026-02-23T06:49:41.036506+0000","last_became_active":"2026-02-23T06:21:17.139209+0000","last_became_peered":"2026-02-23T06:21:17.139209+0000","last_unstale":"2026-02-23T06:49:41.036506+0000","last_undegraded":"2026-02-23T06:49:41.036506+0000","last_fullsized":"2026-02-23T06:49:41.036506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:02:19.925669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'2272","reported_seq":2304,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.541787+0000","last_change":"2026-02-23T06:21:22.162912+0000","last_active":"2026-02-23T06:50:45.541787+0000","last_peered":"2026-02-23T06:50:45.541787+0000","last_clean":"2026-02-23T06:50:45.541787+0000","last_became_active":"2026-02-23T06:21:22.162777+0000","last_became_peered":"2026-02-23T06:21:22.162777+0000","last_unstale":"2026-02-23T06:50:45.541787+0000","last_undegraded":"2026-02-23T06:50:45.541787+0000","last_fullsized":"2026-02-23T06:50:45.541787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2272,"log_dups_size":0,"ondisk_log_size":2272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:40:10.012263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28575,"num_write_kb":1525996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'9","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.085449+0000","last_change":"2026-02-23T06:21:18.149281+0000","last_active":"2026-02-23T06:49:41.085449+0000","last_peered":"2026-02-23T06:49:41.085449+0000","last_clean":"2026-02-23T06:49:41.085449+0000","last_became_active":"2026-02-23T06:21:18.149038+0000","last_became_peered":"2026-02-23T06:21:18.149038+0000","last_unstale":"2026-02-23T06:49:41.085449+0000","last_undegraded":"2026-02-23T06:49:41.085449+0000","last_fullsized":"2026-02-23T06:49:41.085449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:57:13.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.083324+0000","last_change":"2026-02-23T06:21:17.137649+0000","last_active":"2026-02-23T06:49:41.083324+0000","last_peered":"2026-02-23T06:49:41.083324+0000","last_clean":"2026-02-23T06:49:41.083324+0000","last_became_active":"2026-02-23T06:21:17.137476+0000","last_became_peered":"2026-02-23T06:21:17.137476+0000","last_unstale":"2026-02-23T06:49:41.083324+0000","last_undegraded":"2026-02-23T06:49:41.083324+0000","last_fullsized":"2026-02-23T06:49:41.083324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:47:43.648999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'1596","reported_seq":1628,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.574320+0000","last_change":"2026-02-23T06:21:22.174081+0000","last_active":"2026-02-23T06:50:45.574320+0000","last_peered":"2026-02-23T06:50:45.574320+0000","last_clean":"2026-02-23T06:50:45.574320+0000","last_became_active":"2026-02-23T06:21:22.173501+0000","last_became_peered":"2026-02-23T06:21:22.173501+0000","last_unstale":"2026-02-23T06:50:45.574320+0000","last_undegraded":"2026-02-23T06:50:45.574320+0000","last_fullsized":"2026-02-23T06:50:45.574320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1596,"log_dups_size":0,"ondisk_log_size":1596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:29:42.370894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20195,"num_write_kb":1002716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'7","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.099249+0000","last_change":"2026-02-23T06:21:18.155183+0000","last_active":"2026-02-23T06:49:41.099249+0000","last_peered":"2026-02-23T06:49:41.099249+0000","last_clean":"2026-02-23T06:49:41.099249+0000","last_became_active":"2026-02-23T06:21:18.154271+0000","last_became_peered":"2026-02-23T06:21:18.154271+0000","last_unstale":"2026-02-23T06:49:41.099249+0000","last_undegraded":"2026-02-23T06:49:41.099249+0000","last_fullsized":"2026-02-23T06:49:41.099249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:34:53.495073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:48:19.512931+0000","last_change":"2026-02-23T06:21:17.144988+0000","last_active":"2026-02-23T06:48:19.512931+0000","last_peered":"2026-02-23T06:48:19.512931+0000","last_clean":"2026-02-23T06:48:19.512931+0000","last_became_active":"2026-02-23T06:21:17.144914+0000","last_became_peered":"2026-02-23T06:21:17.144914+0000","last_unstale":"2026-02-23T06:48:19.512931+0000","last_undegraded":"2026-02-23T06:48:19.512931+0000","last_fullsized":"2026-02-23T06:48:19.512931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:20:30.802189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'1694","reported_seq":1726,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.564313+0000","last_change":"2026-02-23T06:21:22.169035+0000","last_active":"2026-02-23T06:50:45.564313+0000","last_peered":"2026-02-23T06:50:45.564313+0000","last_clean":"2026-02-23T06:50:45.564313+0000","last_became_active":"2026-02-23T06:21:22.168516+0000","last_became_peered":"2026-02-23T06:21:22.168516+0000","last_unstale":"2026-02-23T06:50:45.564313+0000","last_undegraded":"2026-02-23T06:50:45.564313+0000","last_fullsized":"2026-02-23T06:50:45.564313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1694,"log_dups_size":0,"ondisk_log_size":1694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:53:53.761208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20934,"num_write_kb":1166144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'13","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.848111+0000","last_change":"2026-02-23T06:21:18.152543+0000","last_active":"2026-02-23T06:50:43.848111+0000","last_peered":"2026-02-23T06:50:43.848111+0000","last_clean":"2026-02-23T06:50:43.848111+0000","last_became_active":"2026-02-23T06:21:18.152381+0000","last_became_peered":"2026-02-23T06:21:18.152381+0000","last_unstale":"2026-02-23T06:50:43.848111+0000","last_undegraded":"2026-02-23T06:50:43.848111+0000","last_fullsized":"2026-02-23T06:50:43.848111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:20:11.159653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'13","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.084190+0000","last_change":"2026-02-23T06:21:17.137277+0000","last_active":"2026-02-23T06:49:41.084190+0000","last_peered":"2026-02-23T06:49:41.084190+0000","last_clean":"2026-02-23T06:49:41.084190+0000","last_became_active":"2026-02-23T06:21:17.137101+0000","last_became_peered":"2026-02-23T06:21:17.137101+0000","last_unstale":"2026-02-23T06:49:41.084190+0000","last_undegraded":"2026-02-23T06:49:41.084190+0000","last_fullsized":"2026-02-23T06:49:41.084190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:26:19.732037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'2316","reported_seq":2347,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.497983+0000","last_change":"2026-02-23T06:21:22.168965+0000","last_active":"2026-02-23T06:50:45.497983+0000","last_peered":"2026-02-23T06:50:45.497983+0000","last_clean":"2026-02-23T06:50:45.497983+0000","last_became_active":"2026-02-23T06:21:22.168603+0000","last_became_peered":"2026-02-23T06:21:22.168603+0000","last_unstale":"2026-02-23T06:50:45.497983+0000","last_undegraded":"2026-02-23T06:50:45.497983+0000","last_fullsized":"2026-02-23T06:50:45.497983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2316,"log_dups_size":0,"ondisk_log_size":2316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:15:47.100236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30296,"num_write_kb":1393408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'11","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.111681+0000","last_change":"2026-02-23T06:21:18.143842+0000","last_active":"2026-02-23T06:49:41.111681+0000","last_peered":"2026-02-23T06:49:41.111681+0000","last_clean":"2026-02-23T06:49:41.111681+0000","last_became_active":"2026-02-23T06:21:18.143002+0000","last_became_peered":"2026-02-23T06:21:18.143002+0000","last_unstale":"2026-02-23T06:49:41.111681+0000","last_undegraded":"2026-02-23T06:49:41.111681+0000","last_fullsized":"2026-02-23T06:49:41.111681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:04:36.461970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'3","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:46:59.508058+0000","last_change":"2026-02-23T06:21:17.143842+0000","last_active":"2026-02-23T06:46:59.508058+0000","last_peered":"2026-02-23T06:46:59.508058+0000","last_clean":"2026-02-23T06:46:59.508058+0000","last_became_active":"2026-02-23T06:21:17.143700+0000","last_became_peered":"2026-02-23T06:21:17.143700+0000","last_unstale":"2026-02-23T06:46:59.508058+0000","last_undegraded":"2026-02-23T06:46:59.508058+0000","last_fullsized":"2026-02-23T06:46:59.508058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:14:07.166043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'2127","reported_seq":2158,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.581277+0000","last_change":"2026-02-23T06:21:22.168834+0000","last_active":"2026-02-23T06:50:45.581277+0000","last_peered":"2026-02-23T06:50:45.581277+0000","last_clean":"2026-02-23T06:50:45.581277+0000","last_became_active":"2026-02-23T06:21:22.168593+0000","last_became_peered":"2026-02-23T06:21:22.168593+0000","last_unstale":"2026-02-23T06:50:45.581277+0000","last_undegraded":"2026-02-23T06:50:45.581277+0000","last_fullsized":"2026-02-23T06:50:45.581277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2127,"log_dups_size":0,"ondisk_log_size":2127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:15:01.999978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27189,"num_write_kb":1335474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'17","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.119990+0000","last_change":"2026-02-23T06:21:18.155135+0000","last_active":"2026-02-23T06:49:41.119990+0000","last_peered":"2026-02-23T06:49:41.119990+0000","last_clean":"2026-02-23T06:49:41.119990+0000","last_became_active":"2026-02-23T06:21:18.155022+0000","last_became_peered":"2026-02-23T06:21:18.155022+0000","last_unstale":"2026-02-23T06:49:41.119990+0000","last_undegraded":"2026-02-23T06:49:41.119990+0000","last_fullsized":"2026-02-23T06:49:41.119990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:50.396096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.090013+0000","last_change":"2026-02-23T06:21:17.144113+0000","last_active":"2026-02-23T06:49:41.090013+0000","last_peered":"2026-02-23T06:49:41.090013+0000","last_clean":"2026-02-23T06:49:41.090013+0000","last_became_active":"2026-02-23T06:21:17.144052+0000","last_became_peered":"2026-02-23T06:21:17.144052+0000","last_unstale":"2026-02-23T06:49:41.090013+0000","last_undegraded":"2026-02-23T06:49:41.090013+0000","last_fullsized":"2026-02-23T06:49:41.090013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:52:50.479411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'1770","reported_seq":1802,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.541361+0000","last_change":"2026-02-23T06:21:22.163712+0000","last_active":"2026-02-23T06:50:45.541361+0000","last_peered":"2026-02-23T06:50:45.541361+0000","last_clean":"2026-02-23T06:50:45.541361+0000","last_became_active":"2026-02-23T06:21:22.163563+0000","last_became_peered":"2026-02-23T06:21:22.163563+0000","last_unstale":"2026-02-23T06:50:45.541361+0000","last_undegraded":"2026-02-23T06:50:45.541361+0000","last_fullsized":"2026-02-23T06:50:45.541361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1770,"log_dups_size":0,"ondisk_log_size":1770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:58:44.301443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1,"num_read_kb":3,"num_write":22555,"num_write_kb":1140198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.036485+0000","last_change":"2026-02-23T06:21:18.152736+0000","last_active":"2026-02-23T06:49:41.036485+0000","last_peered":"2026-02-23T06:49:41.036485+0000","last_clean":"2026-02-23T06:49:41.036485+0000","last_became_active":"2026-02-23T06:21:18.152627+0000","last_became_peered":"2026-02-23T06:21:18.152627+0000","last_unstale":"2026-02-23T06:49:41.036485+0000","last_undegraded":"2026-02-23T06:49:41.036485+0000","last_fullsized":"2026-02-23T06:49:41.036485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:26:04.233805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'3","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:19.440107+0000","last_change":"2026-02-23T06:21:17.144924+0000","last_active":"2026-02-23T06:49:19.440107+0000","last_peered":"2026-02-23T06:49:19.440107+0000","last_clean":"2026-02-23T06:49:19.440107+0000","last_became_active":"2026-02-23T06:21:17.144847+0000","last_became_peered":"2026-02-23T06:21:17.144847+0000","last_unstale":"2026-02-23T06:49:19.440107+0000","last_undegraded":"2026-02-23T06:49:19.440107+0000","last_fullsized":"2026-02-23T06:49:19.440107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:09:16.703922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'2203","reported_seq":2234,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.562001+0000","last_change":"2026-02-23T06:21:22.164167+0000","last_active":"2026-02-23T06:50:45.562001+0000","last_peered":"2026-02-23T06:50:45.562001+0000","last_clean":"2026-02-23T06:50:45.562001+0000","last_became_active":"2026-02-23T06:21:22.164057+0000","last_became_peered":"2026-02-23T06:21:22.164057+0000","last_unstale":"2026-02-23T06:50:45.562001+0000","last_undegraded":"2026-02-23T06:50:45.562001+0000","last_fullsized":"2026-02-23T06:50:45.562001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2203,"log_dups_size":0,"ondisk_log_size":2203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:19:45.888728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27835,"num_write_kb":1432250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:19.521394+0000","last_change":"2026-02-23T06:21:18.148382+0000","last_active":"2026-02-23T06:50:19.521394+0000","last_peered":"2026-02-23T06:50:19.521394+0000","last_clean":"2026-02-23T06:50:19.521394+0000","last_became_active":"2026-02-23T06:21:18.147826+0000","last_became_peered":"2026-02-23T06:21:18.147826+0000","last_unstale":"2026-02-23T06:50:19.521394+0000","last_undegraded":"2026-02-23T06:50:19.521394+0000","last_fullsized":"2026-02-23T06:50:19.521394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:52:32.524186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'302","reported_seq":341,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:28.198411+0000","last_change":"2026-02-23T06:21:17.151131+0000","last_active":"2026-02-23T06:50:28.198411+0000","last_peered":"2026-02-23T06:50:28.198411+0000","last_clean":"2026-02-23T06:50:28.198411+0000","last_became_active":"2026-02-23T06:21:17.151030+0000","last_became_peered":"2026-02-23T06:21:17.151030+0000","last_unstale":"2026-02-23T06:50:28.198411+0000","last_undegraded":"2026-02-23T06:50:28.198411+0000","last_fullsized":"2026-02-23T06:50:28.198411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:19:57.049773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194998,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299,"num_write_kb":4303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'1451","reported_seq":1482,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.581521+0000","last_change":"2026-02-23T06:21:22.165171+0000","last_active":"2026-02-23T06:50:45.581521+0000","last_peered":"2026-02-23T06:50:45.581521+0000","last_clean":"2026-02-23T06:50:45.581521+0000","last_became_active":"2026-02-23T06:21:22.164972+0000","last_became_peered":"2026-02-23T06:21:22.164972+0000","last_unstale":"2026-02-23T06:50:45.581521+0000","last_undegraded":"2026-02-23T06:50:45.581521+0000","last_fullsized":"2026-02-23T06:50:45.581521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1451,"log_dups_size":0,"ondisk_log_size":1451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:58:26.519641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17009,"num_write_kb":1082863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:14.074409+0000","last_change":"2026-02-23T06:21:18.153296+0000","last_active":"2026-02-23T06:50:14.074409+0000","last_peered":"2026-02-23T06:50:14.074409+0000","last_clean":"2026-02-23T06:50:14.074409+0000","last_became_active":"2026-02-23T06:21:18.153052+0000","last_became_peered":"2026-02-23T06:21:18.153052+0000","last_unstale":"2026-02-23T06:50:14.074409+0000","last_undegraded":"2026-02-23T06:50:14.074409+0000","last_fullsized":"2026-02-23T06:50:14.074409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:38:32.662334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'20","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:34.102331+0000","last_change":"2026-02-23T06:21:17.137568+0000","last_active":"2026-02-23T06:50:34.102331+0000","last_peered":"2026-02-23T06:50:34.102331+0000","last_clean":"2026-02-23T06:50:34.102331+0000","last_became_active":"2026-02-23T06:21:17.137479+0000","last_became_peered":"2026-02-23T06:21:17.137479+0000","last_unstale":"2026-02-23T06:50:34.102331+0000","last_undegraded":"2026-02-23T06:50:34.102331+0000","last_fullsized":"2026-02-23T06:50:34.102331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:50:22.850887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'2249","reported_seq":2280,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.574206+0000","last_change":"2026-02-23T06:21:22.175837+0000","last_active":"2026-02-23T06:50:45.574206+0000","last_peered":"2026-02-23T06:50:45.574206+0000","last_clean":"2026-02-23T06:50:45.574206+0000","last_became_active":"2026-02-23T06:21:22.175638+0000","last_became_peered":"2026-02-23T06:21:22.175638+0000","last_unstale":"2026-02-23T06:50:45.574206+0000","last_undegraded":"2026-02-23T06:50:45.574206+0000","last_fullsized":"2026-02-23T06:50:45.574206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2249,"log_dups_size":0,"ondisk_log_size":2249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:24:39.312650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28921,"num_write_kb":1359033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'14","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:42.202491+0000","last_change":"2026-02-23T06:21:18.155473+0000","last_active":"2026-02-23T06:50:42.202491+0000","last_peered":"2026-02-23T06:50:42.202491+0000","last_clean":"2026-02-23T06:50:42.202491+0000","last_became_active":"2026-02-23T06:21:18.155349+0000","last_became_peered":"2026-02-23T06:21:18.155349+0000","last_unstale":"2026-02-23T06:50:42.202491+0000","last_undegraded":"2026-02-23T06:50:42.202491+0000","last_fullsized":"2026-02-23T06:50:42.202491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:20:20.345986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'1","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.093368+0000","last_change":"2026-02-23T06:21:17.148953+0000","last_active":"2026-02-23T06:49:41.093368+0000","last_peered":"2026-02-23T06:49:41.093368+0000","last_clean":"2026-02-23T06:49:41.093368+0000","last_became_active":"2026-02-23T06:21:17.148841+0000","last_became_peered":"2026-02-23T06:21:17.148841+0000","last_unstale":"2026-02-23T06:49:41.093368+0000","last_undegraded":"2026-02-23T06:49:41.093368+0000","last_fullsized":"2026-02-23T06:49:41.093368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:48:14.620108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'1724","reported_seq":1755,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.552172+0000","last_change":"2026-02-23T06:21:22.172897+0000","last_active":"2026-02-23T06:50:45.552172+0000","last_peered":"2026-02-23T06:50:45.552172+0000","last_clean":"2026-02-23T06:50:45.552172+0000","last_became_active":"2026-02-23T06:21:22.172683+0000","last_became_peered":"2026-02-23T06:21:22.172683+0000","last_unstale":"2026-02-23T06:50:45.552172+0000","last_undegraded":"2026-02-23T06:50:45.552172+0000","last_fullsized":"2026-02-23T06:50:45.552172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1724,"log_dups_size":0,"ondisk_log_size":1724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:17:41.991286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21477,"num_write_kb":1135952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'12","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.143594+0000","last_change":"2026-02-23T06:21:18.154897+0000","last_active":"2026-02-23T06:50:43.143594+0000","last_peered":"2026-02-23T06:50:43.143594+0000","last_clean":"2026-02-23T06:50:43.143594+0000","last_became_active":"2026-02-23T06:21:18.154586+0000","last_became_peered":"2026-02-23T06:21:18.154586+0000","last_unstale":"2026-02-23T06:50:43.143594+0000","last_undegraded":"2026-02-23T06:50:43.143594+0000","last_fullsized":"2026-02-23T06:50:43.143594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:22:13.361673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.033236+0000","last_change":"2026-02-23T06:21:17.140774+0000","last_active":"2026-02-23T06:49:41.033236+0000","last_peered":"2026-02-23T06:49:41.033236+0000","last_clean":"2026-02-23T06:49:41.033236+0000","last_became_active":"2026-02-23T06:21:17.140699+0000","last_became_peered":"2026-02-23T06:21:17.140699+0000","last_unstale":"2026-02-23T06:49:41.033236+0000","last_undegraded":"2026-02-23T06:49:41.033236+0000","last_fullsized":"2026-02-23T06:49:41.033236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:59:47.987932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'1855","reported_seq":1886,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.517289+0000","last_change":"2026-02-23T06:21:22.166371+0000","last_active":"2026-02-23T06:50:45.517289+0000","last_peered":"2026-02-23T06:50:45.517289+0000","last_clean":"2026-02-23T06:50:45.517289+0000","last_became_active":"2026-02-23T06:21:22.166204+0000","last_became_peered":"2026-02-23T06:21:22.166204+0000","last_unstale":"2026-02-23T06:50:45.517289+0000","last_undegraded":"2026-02-23T06:50:45.517289+0000","last_fullsized":"2026-02-23T06:50:45.517289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1855,"log_dups_size":0,"ondisk_log_size":1855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:50:51.116428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23435,"num_write_kb":1201520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'1867","reported_seq":1901,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.548532+0000","last_change":"2026-02-23T06:21:22.167411+0000","last_active":"2026-02-23T06:50:45.548532+0000","last_peered":"2026-02-23T06:50:45.548532+0000","last_clean":"2026-02-23T06:50:45.548532+0000","last_became_active":"2026-02-23T06:21:22.167217+0000","last_became_peered":"2026-02-23T06:21:22.167217+0000","last_unstale":"2026-02-23T06:50:45.548532+0000","last_undegraded":"2026-02-23T06:50:45.548532+0000","last_fullsized":"2026-02-23T06:50:45.548532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1867,"log_dups_size":0,"ondisk_log_size":1867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:20:54.687551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23697,"num_write_kb":1252431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:42.235822+0000","last_change":"2026-02-23T06:21:18.146043+0000","last_active":"2026-02-23T06:50:42.235822+0000","last_peered":"2026-02-23T06:50:42.235822+0000","last_clean":"2026-02-23T06:50:42.235822+0000","last_became_active":"2026-02-23T06:21:18.145938+0000","last_became_peered":"2026-02-23T06:21:18.145938+0000","last_unstale":"2026-02-23T06:50:42.235822+0000","last_undegraded":"2026-02-23T06:50:42.235822+0000","last_fullsized":"2026-02-23T06:50:42.235822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:03:21.252772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.039459+0000","last_change":"2026-02-23T06:21:17.149581+0000","last_active":"2026-02-23T06:49:41.039459+0000","last_peered":"2026-02-23T06:49:41.039459+0000","last_clean":"2026-02-23T06:49:41.039459+0000","last_became_active":"2026-02-23T06:21:17.149490+0000","last_became_peered":"2026-02-23T06:21:17.149490+0000","last_unstale":"2026-02-23T06:49:41.039459+0000","last_undegraded":"2026-02-23T06:49:41.039459+0000","last_fullsized":"2026-02-23T06:49:41.039459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:18:42.211307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'2152","reported_seq":2185,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.574313+0000","last_change":"2026-02-23T06:21:22.175655+0000","last_active":"2026-02-23T06:50:45.574313+0000","last_peered":"2026-02-23T06:50:45.574313+0000","last_clean":"2026-02-23T06:50:45.574313+0000","last_became_active":"2026-02-23T06:21:22.174906+0000","last_became_peered":"2026-02-23T06:21:22.174906+0000","last_unstale":"2026-02-23T06:50:45.574313+0000","last_undegraded":"2026-02-23T06:50:45.574313+0000","last_fullsized":"2026-02-23T06:50:45.574313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2152,"log_dups_size":0,"ondisk_log_size":2152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:50:34.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27270,"num_write_kb":1403073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'15","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:19.444217+0000","last_change":"2026-02-23T06:21:18.142560+0000","last_active":"2026-02-23T06:50:19.444217+0000","last_peered":"2026-02-23T06:50:19.444217+0000","last_clean":"2026-02-23T06:50:19.444217+0000","last_became_active":"2026-02-23T06:21:18.142325+0000","last_became_peered":"2026-02-23T06:21:18.142325+0000","last_unstale":"2026-02-23T06:50:19.444217+0000","last_undegraded":"2026-02-23T06:50:19.444217+0000","last_fullsized":"2026-02-23T06:50:19.444217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:45:44.641652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:47:59.433744+0000","last_change":"2026-02-23T06:21:17.146195+0000","last_active":"2026-02-23T06:47:59.433744+0000","last_peered":"2026-02-23T06:47:59.433744+0000","last_clean":"2026-02-23T06:47:59.433744+0000","last_became_active":"2026-02-23T06:21:17.146022+0000","last_became_peered":"2026-02-23T06:21:17.146022+0000","last_unstale":"2026-02-23T06:47:59.433744+0000","last_undegraded":"2026-02-23T06:47:59.433744+0000","last_fullsized":"2026-02-23T06:47:59.433744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:34:32.822540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.091157+0000","last_change":"2026-02-23T06:21:17.148590+0000","last_active":"2026-02-23T06:49:41.091157+0000","last_peered":"2026-02-23T06:49:41.091157+0000","last_clean":"2026-02-23T06:49:41.091157+0000","last_became_active":"2026-02-23T06:21:17.148417+0000","last_became_peered":"2026-02-23T06:21:17.148417+0000","last_unstale":"2026-02-23T06:49:41.091157+0000","last_undegraded":"2026-02-23T06:49:41.091157+0000","last_fullsized":"2026-02-23T06:49:41.091157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:21:11.877590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.050118+0000","last_change":"2026-02-23T06:21:18.152383+0000","last_active":"2026-02-23T06:49:41.050118+0000","last_peered":"2026-02-23T06:49:41.050118+0000","last_clean":"2026-02-23T06:49:41.050118+0000","last_became_active":"2026-02-23T06:21:18.152267+0000","last_became_peered":"2026-02-23T06:21:18.152267+0000","last_unstale":"2026-02-23T06:49:41.050118+0000","last_undegraded":"2026-02-23T06:49:41.050118+0000","last_fullsized":"2026-02-23T06:49:41.050118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:34:11.558509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'1670","reported_seq":1701,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.582047+0000","last_change":"2026-02-23T06:21:22.158812+0000","last_active":"2026-02-23T06:50:45.582047+0000","last_peered":"2026-02-23T06:50:45.582047+0000","last_clean":"2026-02-23T06:50:45.582047+0000","last_became_active":"2026-02-23T06:21:22.158607+0000","last_became_peered":"2026-02-23T06:21:22.158607+0000","last_unstale":"2026-02-23T06:50:45.582047+0000","last_undegraded":"2026-02-23T06:50:45.582047+0000","last_fullsized":"2026-02-23T06:50:45.582047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1670,"log_dups_size":0,"ondisk_log_size":1670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:59:07.000053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20239,"num_write_kb":1221270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1152","reported_seq":1190,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.044630+0000","last_change":"2026-02-23T06:21:17.138744+0000","last_active":"2026-02-23T06:49:41.044630+0000","last_peered":"2026-02-23T06:49:41.044630+0000","last_clean":"2026-02-23T06:49:41.044630+0000","last_became_active":"2026-02-23T06:21:17.138245+0000","last_became_peered":"2026-02-23T06:21:17.138245+0000","last_unstale":"2026-02-23T06:49:41.044630+0000","last_undegraded":"2026-02-23T06:49:41.044630+0000","last_fullsized":"2026-02-23T06:49:41.044630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1152,"log_dups_size":0,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:08:03.143401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1150,"num_write_kb":5073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'11","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:42.307472+0000","last_change":"2026-02-23T06:21:18.143640+0000","last_active":"2026-02-23T06:50:42.307472+0000","last_peered":"2026-02-23T06:50:42.307472+0000","last_clean":"2026-02-23T06:50:42.307472+0000","last_became_active":"2026-02-23T06:21:18.143550+0000","last_became_peered":"2026-02-23T06:21:18.143550+0000","last_unstale":"2026-02-23T06:50:42.307472+0000","last_undegraded":"2026-02-23T06:50:42.307472+0000","last_fullsized":"2026-02-23T06:50:42.307472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:11:40.394042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'1800","reported_seq":1831,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.534982+0000","last_change":"2026-02-23T06:21:22.169641+0000","last_active":"2026-02-23T06:50:45.534982+0000","last_peered":"2026-02-23T06:50:45.534982+0000","last_clean":"2026-02-23T06:50:45.534982+0000","last_became_active":"2026-02-23T06:21:22.169432+0000","last_became_peered":"2026-02-23T06:21:22.169432+0000","last_unstale":"2026-02-23T06:50:45.534982+0000","last_undegraded":"2026-02-23T06:50:45.534982+0000","last_fullsized":"2026-02-23T06:50:45.534982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1800,"log_dups_size":0,"ondisk_log_size":1800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:00:17.622113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23033,"num_write_kb":1131314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'13","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:29.625537+0000","last_change":"2026-02-23T06:21:18.143781+0000","last_active":"2026-02-23T06:50:29.625537+0000","last_peered":"2026-02-23T06:50:29.625537+0000","last_clean":"2026-02-23T06:50:29.625537+0000","last_became_active":"2026-02-23T06:21:18.143724+0000","last_became_peered":"2026-02-23T06:21:18.143724+0000","last_unstale":"2026-02-23T06:50:29.625537+0000","last_undegraded":"2026-02-23T06:50:29.625537+0000","last_fullsized":"2026-02-23T06:50:29.625537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:25:55.416021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'8","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:48:24.437036+0000","last_change":"2026-02-23T06:21:18.145425+0000","last_active":"2026-02-23T06:48:24.437036+0000","last_peered":"2026-02-23T06:48:24.437036+0000","last_clean":"2026-02-23T06:48:24.437036+0000","last_became_active":"2026-02-23T06:21:18.145325+0000","last_became_peered":"2026-02-23T06:21:18.145325+0000","last_unstale":"2026-02-23T06:48:24.437036+0000","last_undegraded":"2026-02-23T06:48:24.437036+0000","last_fullsized":"2026-02-23T06:48:24.437036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:55:31.700518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'15","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:29.500812+0000","last_change":"2026-02-23T06:21:18.150997+0000","last_active":"2026-02-23T06:50:29.500812+0000","last_peered":"2026-02-23T06:50:29.500812+0000","last_clean":"2026-02-23T06:50:29.500812+0000","last_became_active":"2026-02-23T06:21:18.150738+0000","last_became_peered":"2026-02-23T06:21:18.150738+0000","last_unstale":"2026-02-23T06:50:29.500812+0000","last_undegraded":"2026-02-23T06:50:29.500812+0000","last_fullsized":"2026-02-23T06:50:29.500812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:11:13.400669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'8","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:42.246163+0000","last_change":"2026-02-23T06:21:18.142305+0000","last_active":"2026-02-23T06:50:42.246163+0000","last_peered":"2026-02-23T06:50:42.246163+0000","last_clean":"2026-02-23T06:50:42.246163+0000","last_became_active":"2026-02-23T06:21:18.141484+0000","last_became_peered":"2026-02-23T06:21:18.141484+0000","last_unstale":"2026-02-23T06:50:42.246163+0000","last_undegraded":"2026-02-23T06:50:42.246163+0000","last_fullsized":"2026-02-23T06:50:42.246163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:12:36.003405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'10","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:42.171753+0000","last_change":"2026-02-23T06:21:18.148610+0000","last_active":"2026-02-23T06:50:42.171753+0000","last_peered":"2026-02-23T06:50:42.171753+0000","last_clean":"2026-02-23T06:50:42.171753+0000","last_became_active":"2026-02-23T06:21:18.148489+0000","last_became_peered":"2026-02-23T06:21:18.148489+0000","last_unstale":"2026-02-23T06:50:42.171753+0000","last_undegraded":"2026-02-23T06:50:42.171753+0000","last_fullsized":"2026-02-23T06:50:42.171753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:36:29.486147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.044709+0000","last_change":"2026-02-23T06:21:18.142438+0000","last_active":"2026-02-23T06:49:41.044709+0000","last_peered":"2026-02-23T06:49:41.044709+0000","last_clean":"2026-02-23T06:49:41.044709+0000","last_became_active":"2026-02-23T06:21:18.141854+0000","last_became_peered":"2026-02-23T06:21:18.141854+0000","last_unstale":"2026-02-23T06:49:41.044709+0000","last_undegraded":"2026-02-23T06:49:41.044709+0000","last_fullsized":"2026-02-23T06:49:41.044709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:23:35.379462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'12","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:41.378044+0000","last_change":"2026-02-23T06:21:18.153825+0000","last_active":"2026-02-23T06:50:41.378044+0000","last_peered":"2026-02-23T06:50:41.378044+0000","last_clean":"2026-02-23T06:50:41.378044+0000","last_became_active":"2026-02-23T06:21:18.153133+0000","last_became_peered":"2026-02-23T06:21:18.153133+0000","last_unstale":"2026-02-23T06:50:41.378044+0000","last_undegraded":"2026-02-23T06:50:41.378044+0000","last_fullsized":"2026-02-23T06:50:41.378044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:15:03.662362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'11","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:14.054874+0000","last_change":"2026-02-23T06:21:18.144945+0000","last_active":"2026-02-23T06:50:14.054874+0000","last_peered":"2026-02-23T06:50:14.054874+0000","last_clean":"2026-02-23T06:50:14.054874+0000","last_became_active":"2026-02-23T06:21:18.144832+0000","last_became_peered":"2026-02-23T06:21:18.144832+0000","last_unstale":"2026-02-23T06:50:14.054874+0000","last_undegraded":"2026-02-23T06:50:14.054874+0000","last_fullsized":"2026-02-23T06:50:14.054874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:41:07.968870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'13","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:41.106448+0000","last_change":"2026-02-23T06:21:18.150652+0000","last_active":"2026-02-23T06:50:41.106448+0000","last_peered":"2026-02-23T06:50:41.106448+0000","last_clean":"2026-02-23T06:50:41.106448+0000","last_became_active":"2026-02-23T06:21:18.150489+0000","last_became_peered":"2026-02-23T06:21:18.150489+0000","last_unstale":"2026-02-23T06:50:41.106448+0000","last_undegraded":"2026-02-23T06:50:41.106448+0000","last_fullsized":"2026-02-23T06:50:41.106448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:42:35.233149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'14","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.135455+0000","last_change":"2026-02-23T06:21:18.143636+0000","last_active":"2026-02-23T06:50:43.135455+0000","last_peered":"2026-02-23T06:50:43.135455+0000","last_clean":"2026-02-23T06:50:43.135455+0000","last_became_active":"2026-02-23T06:21:18.143495+0000","last_became_peered":"2026-02-23T06:21:18.143495+0000","last_unstale":"2026-02-23T06:50:43.135455+0000","last_undegraded":"2026-02-23T06:50:43.135455+0000","last_fullsized":"2026-02-23T06:50:43.135455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:47:19.057181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'11","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.064358+0000","last_change":"2026-02-23T06:21:18.148787+0000","last_active":"2026-02-23T06:49:41.064358+0000","last_peered":"2026-02-23T06:49:41.064358+0000","last_clean":"2026-02-23T06:49:41.064358+0000","last_became_active":"2026-02-23T06:21:18.148701+0000","last_became_peered":"2026-02-23T06:21:18.148701+0000","last_unstale":"2026-02-23T06:49:41.064358+0000","last_undegraded":"2026-02-23T06:49:41.064358+0000","last_fullsized":"2026-02-23T06:49:41.064358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:19:32.878202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'17","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.963539+0000","last_change":"2026-02-23T06:21:18.145498+0000","last_active":"2026-02-23T06:50:43.963539+0000","last_peered":"2026-02-23T06:50:43.963539+0000","last_clean":"2026-02-23T06:50:43.963539+0000","last_became_active":"2026-02-23T06:21:18.145346+0000","last_became_peered":"2026-02-23T06:21:18.145346+0000","last_unstale":"2026-02-23T06:50:43.963539+0000","last_undegraded":"2026-02-23T06:50:43.963539+0000","last_fullsized":"2026-02-23T06:50:43.963539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:44:15.203843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'13","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:34.522293+0000","last_change":"2026-02-23T06:21:18.147453+0000","last_active":"2026-02-23T06:50:34.522293+0000","last_peered":"2026-02-23T06:50:34.522293+0000","last_clean":"2026-02-23T06:50:34.522293+0000","last_became_active":"2026-02-23T06:21:18.147357+0000","last_became_peered":"2026-02-23T06:21:18.147357+0000","last_unstale":"2026-02-23T06:50:34.522293+0000","last_undegraded":"2026-02-23T06:50:34.522293+0000","last_fullsized":"2026-02-23T06:50:34.522293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:41:05.063786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'12","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.263261+0000","last_change":"2026-02-23T06:21:18.151381+0000","last_active":"2026-02-23T06:50:43.263261+0000","last_peered":"2026-02-23T06:50:43.263261+0000","last_clean":"2026-02-23T06:50:43.263261+0000","last_became_active":"2026-02-23T06:21:18.151269+0000","last_became_peered":"2026-02-23T06:21:18.151269+0000","last_unstale":"2026-02-23T06:50:43.263261+0000","last_undegraded":"2026-02-23T06:50:43.263261+0000","last_fullsized":"2026-02-23T06:50:43.263261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:50:46.152385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'18","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.826816+0000","last_change":"2026-02-23T06:21:18.148411+0000","last_active":"2026-02-23T06:50:43.826816+0000","last_peered":"2026-02-23T06:50:43.826816+0000","last_clean":"2026-02-23T06:50:43.826816+0000","last_became_active":"2026-02-23T06:21:18.148262+0000","last_became_peered":"2026-02-23T06:21:18.148262+0000","last_unstale":"2026-02-23T06:50:43.826816+0000","last_undegraded":"2026-02-23T06:50:43.826816+0000","last_fullsized":"2026-02-23T06:50:43.826816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:09:54.723244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:19.495112+0000","last_change":"2026-02-23T06:21:18.155275+0000","last_active":"2026-02-23T06:49:19.495112+0000","last_peered":"2026-02-23T06:49:19.495112+0000","last_clean":"2026-02-23T06:49:19.495112+0000","last_became_active":"2026-02-23T06:21:18.155214+0000","last_became_peered":"2026-02-23T06:21:18.155214+0000","last_unstale":"2026-02-23T06:49:19.495112+0000","last_undegraded":"2026-02-23T06:49:19.495112+0000","last_fullsized":"2026-02-23T06:49:19.495112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:44:47.367234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.659186+0000","last_change":"2026-02-23T06:21:18.153381+0000","last_active":"2026-02-23T06:50:43.659186+0000","last_peered":"2026-02-23T06:50:43.659186+0000","last_clean":"2026-02-23T06:50:43.659186+0000","last_became_active":"2026-02-23T06:21:18.152456+0000","last_became_peered":"2026-02-23T06:21:18.152456+0000","last_unstale":"2026-02-23T06:50:43.659186+0000","last_undegraded":"2026-02-23T06:50:43.659186+0000","last_fullsized":"2026-02-23T06:50:43.659186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:14:46.231331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'13","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:19.054621+0000","last_change":"2026-02-23T06:21:18.148599+0000","last_active":"2026-02-23T06:50:19.054621+0000","last_peered":"2026-02-23T06:50:19.054621+0000","last_clean":"2026-02-23T06:50:19.054621+0000","last_became_active":"2026-02-23T06:21:18.148498+0000","last_became_peered":"2026-02-23T06:21:18.148498+0000","last_unstale":"2026-02-23T06:50:19.054621+0000","last_undegraded":"2026-02-23T06:50:19.054621+0000","last_fullsized":"2026-02-23T06:50:19.054621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:05:56.074928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'14","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:14.132776+0000","last_change":"2026-02-23T06:21:18.142621+0000","last_active":"2026-02-23T06:50:14.132776+0000","last_peered":"2026-02-23T06:50:14.132776+0000","last_clean":"2026-02-23T06:50:14.132776+0000","last_became_active":"2026-02-23T06:21:18.141938+0000","last_became_peered":"2026-02-23T06:21:18.141938+0000","last_unstale":"2026-02-23T06:50:14.132776+0000","last_undegraded":"2026-02-23T06:50:14.132776+0000","last_fullsized":"2026-02-23T06:50:14.132776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:25:55.390738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'14","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:44.625290+0000","last_change":"2026-02-23T06:21:18.153183+0000","last_active":"2026-02-23T06:50:44.625290+0000","last_peered":"2026-02-23T06:50:44.625290+0000","last_clean":"2026-02-23T06:50:44.625290+0000","last_became_active":"2026-02-23T06:21:18.153090+0000","last_became_peered":"2026-02-23T06:21:18.153090+0000","last_unstale":"2026-02-23T06:50:44.625290+0000","last_undegraded":"2026-02-23T06:50:44.625290+0000","last_fullsized":"2026-02-23T06:50:44.625290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:26:17.749612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:19.521373+0000","last_change":"2026-02-23T06:21:18.148055+0000","last_active":"2026-02-23T06:50:19.521373+0000","last_peered":"2026-02-23T06:50:19.521373+0000","last_clean":"2026-02-23T06:50:19.521373+0000","last_became_active":"2026-02-23T06:21:18.147956+0000","last_became_peered":"2026-02-23T06:21:18.147956+0000","last_unstale":"2026-02-23T06:50:19.521373+0000","last_undegraded":"2026-02-23T06:50:19.521373+0000","last_fullsized":"2026-02-23T06:50:19.521373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:22:55.028859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'12","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:19.521388+0000","last_change":"2026-02-23T06:21:18.155576+0000","last_active":"2026-02-23T06:50:19.521388+0000","last_peered":"2026-02-23T06:50:19.521388+0000","last_clean":"2026-02-23T06:50:19.521388+0000","last_became_active":"2026-02-23T06:21:18.155130+0000","last_became_peered":"2026-02-23T06:21:18.155130+0000","last_unstale":"2026-02-23T06:50:19.521388+0000","last_undegraded":"2026-02-23T06:50:19.521388+0000","last_fullsized":"2026-02-23T06:50:19.521388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:43:12.801427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'12","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.108444+0000","last_change":"2026-02-23T06:21:18.152980+0000","last_active":"2026-02-23T06:49:41.108444+0000","last_peered":"2026-02-23T06:49:41.108444+0000","last_clean":"2026-02-23T06:49:41.108444+0000","last_became_active":"2026-02-23T06:21:18.152790+0000","last_became_peered":"2026-02-23T06:21:18.152790+0000","last_unstale":"2026-02-23T06:49:41.108444+0000","last_undegraded":"2026-02-23T06:49:41.108444+0000","last_fullsized":"2026-02-23T06:49:41.108444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:33:09.398040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'9","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:24.508958+0000","last_change":"2026-02-23T06:21:18.155247+0000","last_active":"2026-02-23T06:50:24.508958+0000","last_peered":"2026-02-23T06:50:24.508958+0000","last_clean":"2026-02-23T06:50:24.508958+0000","last_became_active":"2026-02-23T06:21:18.155122+0000","last_became_peered":"2026-02-23T06:21:18.155122+0000","last_unstale":"2026-02-23T06:50:24.508958+0000","last_undegraded":"2026-02-23T06:50:24.508958+0000","last_fullsized":"2026-02-23T06:50:24.508958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:45:08.775934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'4","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.568725+0000","last_change":"2026-02-23T06:21:18.151259+0000","last_active":"2026-02-23T06:50:45.568725+0000","last_peered":"2026-02-23T06:50:45.568725+0000","last_clean":"2026-02-23T06:50:45.568725+0000","last_became_active":"2026-02-23T06:21:18.151151+0000","last_became_peered":"2026-02-23T06:21:18.151151+0000","last_unstale":"2026-02-23T06:50:45.568725+0000","last_undegraded":"2026-02-23T06:50:45.568725+0000","last_fullsized":"2026-02-23T06:50:45.568725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:08:03.361054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'7","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.094234+0000","last_change":"2026-02-23T06:21:18.146606+0000","last_active":"2026-02-23T06:49:41.094234+0000","last_peered":"2026-02-23T06:49:41.094234+0000","last_clean":"2026-02-23T06:49:41.094234+0000","last_became_active":"2026-02-23T06:21:18.146527+0000","last_became_peered":"2026-02-23T06:21:18.146527+0000","last_unstale":"2026-02-23T06:49:41.094234+0000","last_undegraded":"2026-02-23T06:49:41.094234+0000","last_fullsized":"2026-02-23T06:49:41.094234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:30:44.739034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.052849+0000","last_change":"2026-02-23T06:21:18.145872+0000","last_active":"2026-02-23T06:49:41.052849+0000","last_peered":"2026-02-23T06:49:41.052849+0000","last_clean":"2026-02-23T06:49:41.052849+0000","last_became_active":"2026-02-23T06:21:18.145770+0000","last_became_peered":"2026-02-23T06:21:18.145770+0000","last_unstale":"2026-02-23T06:49:41.052849+0000","last_undegraded":"2026-02-23T06:49:41.052849+0000","last_fullsized":"2026-02-23T06:49:41.052849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:21:28.063960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'12","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:44.613087+0000","last_change":"2026-02-23T06:21:18.152478+0000","last_active":"2026-02-23T06:50:44.613087+0000","last_peered":"2026-02-23T06:50:44.613087+0000","last_clean":"2026-02-23T06:50:44.613087+0000","last_became_active":"2026-02-23T06:21:18.151948+0000","last_became_peered":"2026-02-23T06:21:18.151948+0000","last_unstale":"2026-02-23T06:50:44.613087+0000","last_undegraded":"2026-02-23T06:50:44.613087+0000","last_fullsized":"2026-02-23T06:50:44.613087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:58:02.829593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'5","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:19.620285+0000","last_change":"2026-02-23T06:21:18.144778+0000","last_active":"2026-02-23T06:49:19.620285+0000","last_peered":"2026-02-23T06:49:19.620285+0000","last_clean":"2026-02-23T06:49:19.620285+0000","last_became_active":"2026-02-23T06:21:18.144346+0000","last_became_peered":"2026-02-23T06:21:18.144346+0000","last_unstale":"2026-02-23T06:49:19.620285+0000","last_undegraded":"2026-02-23T06:49:19.620285+0000","last_fullsized":"2026-02-23T06:49:19.620285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:25:27.650673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'10","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:41.065242+0000","last_change":"2026-02-23T06:21:18.141648+0000","last_active":"2026-02-23T06:50:41.065242+0000","last_peered":"2026-02-23T06:50:41.065242+0000","last_clean":"2026-02-23T06:50:41.065242+0000","last_became_active":"2026-02-23T06:21:18.141449+0000","last_became_peered":"2026-02-23T06:21:18.141449+0000","last_unstale":"2026-02-23T06:50:41.065242+0000","last_undegraded":"2026-02-23T06:50:41.065242+0000","last_fullsized":"2026-02-23T06:50:41.065242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:33:18.986892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.059906+0000","last_change":"2026-02-23T06:21:18.142536+0000","last_active":"2026-02-23T06:49:41.059906+0000","last_peered":"2026-02-23T06:49:41.059906+0000","last_clean":"2026-02-23T06:49:41.059906+0000","last_became_active":"2026-02-23T06:21:18.142359+0000","last_became_peered":"2026-02-23T06:21:18.142359+0000","last_unstale":"2026-02-23T06:49:41.059906+0000","last_undegraded":"2026-02-23T06:49:41.059906+0000","last_fullsized":"2026-02-23T06:49:41.059906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:54:09.503227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'8","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:29.522014+0000","last_change":"2026-02-23T06:21:18.156667+0000","last_active":"2026-02-23T06:50:29.522014+0000","last_peered":"2026-02-23T06:50:29.522014+0000","last_clean":"2026-02-23T06:50:29.522014+0000","last_became_active":"2026-02-23T06:21:18.156564+0000","last_became_peered":"2026-02-23T06:21:18.156564+0000","last_unstale":"2026-02-23T06:50:29.522014+0000","last_undegraded":"2026-02-23T06:50:29.522014+0000","last_fullsized":"2026-02-23T06:50:29.522014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:11:13.967668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3565158400,"num_objects":850,"num_object_clones":0,"num_object_copies":3400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":850,"num_whiteouts":0,"num_read":1,"num_read_kb":3,"num_write":756886,"num_write_kb":39381923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1713389568,"data_stored":7130316800,"data_compressed":418887520,"data_compressed_allocated":1014562816,"data_compressed_original":6431490048,"omap_allocated":0,"internal_metadata":0},"log_size":60070,"ondisk_log_size":60070,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":687,"ondisk_log_size":687,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":13232698,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":30,"num_read_kb":99,"num_write":2238,"num_write_kb":14657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13828096,"data_stored":26465396,"data_compressed":2652502,"data_compressed_allocated":3489792,"data_compressed_original":16187392,"omap_allocated":629893,"internal_metadata":0},"log_size":2092,"ondisk_log_size":2092,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70172,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575216,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":519516,"kb_used_data":257996,"kb_used_omap":128,"kb_used_meta":261375,"kb_avail":93852324,"statfs":{"total":96636764160,"available":96104779776,"internally_reserved":0,"allocated":264187904,"data_stored":1087033247,"data_compressed":63788459,"data_compressed_allocated":155418624,"data_compressed_original":978444288,"omap_allocated":131483,"internal_metadata":267648613},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575217,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":496264,"kb_used_data":234744,"kb_used_omap":20,"kb_used_meta":261483,"kb_avail":93875576,"statfs":{"total":96636764160,"available":96128589824,"internally_reserved":0,"allocated":240377856,"data_stored":1015218693,"data_compressed":59697398,"data_compressed_allocated":143745024,"data_compressed_original":918769664,"omap_allocated":20978,"internal_metadata":267759118},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575218,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":454856,"kb_used_data":229432,"kb_used_omap":17,"kb_used_meta":225390,"kb_avail":93916984,"statfs":{"total":96636764160,"available":96170991616,"internally_reserved":0,"allocated":234938368,"data_stored":966905145,"data_compressed":56345986,"data_compressed_allocated":135413760,"data_compressed_original":867553280,"omap_allocated":17420,"internal_metadata":230800372},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575219,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":406156,"kb_used_data":198780,"kb_used_omap":43,"kb_used_meta":207316,"kb_avail":93965684,"statfs":{"total":96636764160,"available":96220860416,"internally_reserved":0,"allocated":203550720,"data_stored":845939717,"data_compressed":49159380,"data_compressed_allocated":117428224,"data_compressed_original":760004608,"omap_allocated":44556,"internal_metadata":212292084},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575218,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":398512,"kb_used_data":191136,"kb_used_omap":238,"kb_used_meta":207121,"kb_avail":93973328,"statfs":{"total":96636764160,"available":96228687872,"internally_reserved":0,"allocated":195723264,"data_stored":805995173,"data_compressed":47782846,"data_compressed_allocated":115453952,"data_compressed_original":725913600,"omap_allocated":243898,"internal_metadata":212092742},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575217,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":513096,"kb_used_data":251576,"kb_used_omap":48,"kb_used_meta":261455,"kb_avail":93858744,"statfs":{"total":96636764160,"available":96111353856,"internally_reserved":0,"allocated":257613824,"data_stored":1063944085,"data_compressed":62960251,"data_compressed_allocated":152305664,"data_compressed_original":958812160,"omap_allocated":49901,"internal_metadata":267730195},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575216,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":377884,"kb_used_data":188556,"kb_used_omap":16,"kb_used_meta":189295,"kb_avail":93993956,"statfs":{"total":96636764160,"available":96249810944,"internally_reserved":0,"allocated":193081344,"data_stored":794939375,"data_compressed":47425382,"data_compressed_allocated":114155520,"data_compressed_original":716193792,"omap_allocated":16904,"internal_metadata":193838584},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575216,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308196,"kb_used_data":136916,"kb_used_omap":192,"kb_used_meta":171071,"kb_avail":94063644,"statfs":{"total":96636764160,"available":96321171456,"internally_reserved":0,"allocated":140201984,"data_stored":578932081,"data_compressed":34450492,"data_compressed_allocated":84221952,"data_compressed_original":523132928,"omap_allocated":197353,"internal_metadata":175176983},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":177910,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":126753,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3362816,"data_stored":8389302,"data_compressed":1069508,"data_compressed_allocated":1413120,"data_compressed_original":6447104,"omap_allocated":8580,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1941504,"data_stored":4764252,"data_compressed":535205,"data_compressed_allocated":708608,"data_compressed_original":3534848,"omap_allocated":32915,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1777664,"data_stored":4765036,"data_compressed":679663,"data_compressed_allocated":884736,"data_compressed_original":3887104,"omap_allocated":232920,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3366912,"data_stored":4273324,"data_compressed":184063,"data_compressed_allocated":241664,"data_compressed_original":1159168,"omap_allocated":36527,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3284992,"data_stored":4194304,"data_compressed":181645,"data_compressed_allocated":237568,"data_compressed_original":1146880,"omap_allocated":4760,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":79052,"data_compressed":2418,"data_compressed_allocated":4096,"data_compressed_original":12288,"omap_allocated":9528,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":139902976,"data_stored":578813952,"data_compressed":34450492,"data_compressed_allocated":84221952,"data_compressed_original":523132928,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":263827456,"data_stored":1086324736,"data_compressed":63753373,"data_compressed_allocated":155373568,"data_compressed_original":977870848,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":189427712,"data_stored":786432000,"data_compressed":46355874,"data_compressed_allocated":112742400,"data_compressed_original":709746688,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":255381504,"data_stored":1059061760,"data_compressed":62425046,"data_compressed_allocated":151597056,"data_compressed_original":955277312,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":193654784,"data_stored":801112064,"data_compressed":47103183,"data_compressed_allocated":114569216,"data_compressed_original":722026496,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":199827456,"data_stored":840957952,"data_compressed":48940231,"data_compressed_allocated":117141504,"data_compressed_original":758272000,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":231362560,"data_stored":962592768,"data_compressed":56164341,"data_compressed_allocated":135176192,"data_compressed_original":866406400,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":240005120,"data_stored":1015021568,"data_compressed":59694980,"data_compressed_allocated":143740928,"data_compressed_original":918757376,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T06:51:39.715 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-23T06:51:39.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.870+0000 7fc7ab1d2640 1 -- 10.20.193.58:0/788742717 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7a415d870 msgr2=0x7fc7a40587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:39.865 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.870+0000 7fc7ab1d2640 1 --2- 10.20.193.58:0/788742717 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7a415d870 0x7fc7a40587b0 secure :-1 s=READY pgs=158 gs=2 cs=0 l=1 c_cookie=6635293794547117263 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7a40b5040 tx=0x7fc79802f250 comp rx=0 tx=0).stop 2026-02-23T06:51:39.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.870+0000 7fc7ab1d2640 1 -- 10.20.193.58:0/788742717 shutdown_connections 2026-02-23T06:51:39.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.870+0000 7fc7ab1d2640 1 --2- 10.20.193.58:0/788742717 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7a415d870 0x7fc7a40587b0 unknown :-1 s=CLOSED pgs=158 gs=2 cs=0 l=1 c_cookie=6635293794547117263 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:39.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.870+0000 7fc7ab1d2640 1 --2- 10.20.193.58:0/788742717 >> v2:10.20.193.93:3300/0 conn(0x7fc7a415d4a0 0x7fc7a40affb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:39.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.870+0000 7fc7ab1d2640 1 -- 10.20.193.58:0/788742717 >> 10.20.193.58:0/788742717 conn(0x7fc7a40b3c20 msgr2=0x7fc7a40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:39.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.870+0000 7fc7ab1d2640 1 -- 10.20.193.58:0/788742717 shutdown_connections 2026-02-23T06:51:39.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.870+0000 7fc7ab1d2640 1 -- 10.20.193.58:0/788742717 wait complete. 2026-02-23T06:51:39.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.871+0000 7fc7ab1d2640 1 Processor -- start 2026-02-23T06:51:39.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.871+0000 7fc7ab1d2640 1 -- start start 2026-02-23T06:51:39.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.872+0000 7fc7ab1d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7a40b6690 0x7fc7a4057750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:39.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.872+0000 7fc7ab1d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc7a415d4a0 0x7fc7a4162700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:39.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.872+0000 7fc7ab1d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc7a415d870 0x7fc7a4162c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:39.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.872+0000 7fc7ab1d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a413cc20 con 0x7fc7a40b6690 2026-02-23T06:51:39.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.872+0000 7fc7ab1d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a413e560 con 0x7fc7a415d870 2026-02-23T06:51:39.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.872+0000 7fc7ab1d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc7a413c010 con 0x7fc7a415d4a0 2026-02-23T06:51:39.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.872+0000 7fc7aa1d0640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7a40b6690 0x7fc7a4057750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:39.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.872+0000 7fc7aa1d0640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7a40b6690 0x7fc7a4057750 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50104/0 (socket says 10.20.193.58:50104) 2026-02-23T06:51:39.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.872+0000 7fc7aa1d0640 1 -- 10.20.193.58:0/492410281 learned_addr learned my addr 10.20.193.58:0/492410281 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:51:39.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.872+0000 7fc7a99cf640 1 --2- 10.20.193.58:0/492410281 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc7a415d4a0 0x7fc7a4162700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:39.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.872+0000 7fc7aa9d1640 1 --2- 10.20.193.58:0/492410281 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc7a415d870 0x7fc7a4162c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:39.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.872+0000 7fc7aa1d0640 1 -- 10.20.193.58:0/492410281 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc7a415d4a0 msgr2=0x7fc7a4162700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:39.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.872+0000 7fc7aa1d0640 1 --2- 10.20.193.58:0/492410281 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc7a415d4a0 0x7fc7a4162700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:39.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.872+0000 7fc7aa1d0640 1 -- 10.20.193.58:0/492410281 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc7a415d870 msgr2=0x7fc7a4162c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:39.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.872+0000 7fc7aa1d0640 1 --2- 10.20.193.58:0/492410281 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc7a415d870 0x7fc7a4162c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:39.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.872+0000 7fc7aa1d0640 1 -- 10.20.193.58:0/492410281 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc798009570 con 0x7fc7a40b6690 2026-02-23T06:51:39.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.872+0000 7fc7aa1d0640 1 --2- 10.20.193.58:0/492410281 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7a40b6690 0x7fc7a4057750 secure :-1 s=READY pgs=159 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc794009480 tx=0x7fc79400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:39.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.872+0000 7fc78affd640 1 -- 10.20.193.58:0/492410281 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc79400cd40 con 0x7fc7a40b6690 2026-02-23T06:51:39.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.872+0000 7fc78affd640 1 -- 10.20.193.58:0/492410281 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc794004850 con 0x7fc7a40b6690 2026-02-23T06:51:39.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.872+0000 7fc78affd640 1 -- 10.20.193.58:0/492410281 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc79400cea0 con 0x7fc7a40b6690 2026-02-23T06:51:39.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.872+0000 7fc7ab1d2640 1 -- 10.20.193.58:0/492410281 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7a413c2f0 con 0x7fc7a40b6690 2026-02-23T06:51:39.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.873+0000 7fc7ab1d2640 1 -- 10.20.193.58:0/492410281 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7a413c8b0 con 0x7fc7a40b6690 2026-02-23T06:51:39.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.873+0000 7fc7ab1d2640 1 -- 10.20.193.58:0/492410281 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7a40b6d50 con 0x7fc7a40b6690 2026-02-23T06:51:39.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.874+0000 7fc78affd640 1 -- 10.20.193.58:0/492410281 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fc79401f060 con 0x7fc7a40b6690 2026-02-23T06:51:39.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.875+0000 7fc78affd640 1 --2- 10.20.193.58:0/492410281 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc77407a6b0 0x7fc77409ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:39.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.875+0000 7fc78affd640 1 -- 10.20.193.58:0/492410281 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fc794014070 con 0x7fc7a40b6690 2026-02-23T06:51:39.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.876+0000 7fc7a99cf640 1 --2- 10.20.193.58:0/492410281 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc77407a6b0 0x7fc77409ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:39.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.876+0000 7fc7a99cf640 1 --2- 10.20.193.58:0/492410281 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc77407a6b0 0x7fc77409ab60 secure :-1 s=READY pgs=603 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7980098a0 tx=0x7fc798031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:39.872 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.877+0000 7fc78affd640 1 -- 10.20.193.58:0/492410281 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fc794060ef0 con 0x7fc7a40b6690 2026-02-23T06:51:39.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.988+0000 7fc7ab1d2640 1 -- 10.20.193.58:0/492410281 --> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc7a40b6330 con 0x7fc77407a6b0 2026-02-23T06:51:39.987 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.992+0000 7fc78affd640 1 -- 10.20.193.58:0/492410281 <== mgr.4126 v2:10.20.193.93:6800/4124709854 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334898 (secure 0 0 0) 0x7fc7980041e0 con 0x7fc77407a6b0 2026-02-23T06:51:39.990 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:51:39.993 INFO:teuthology.orchestra.run.trial058.stderr:dumped all 2026-02-23T06:51:39.994 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.994+0000 7fc7ab1d2640 1 -- 10.20.193.58:0/492410281 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc77407a6b0 msgr2=0x7fc77409ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:39.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.994+0000 7fc7ab1d2640 1 --2- 10.20.193.58:0/492410281 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc77407a6b0 0x7fc77409ab60 secure :-1 s=READY pgs=603 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7980098a0 tx=0x7fc798031040 comp rx=0 tx=0).stop 2026-02-23T06:51:39.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.994+0000 7fc7ab1d2640 1 -- 10.20.193.58:0/492410281 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7a40b6690 msgr2=0x7fc7a4057750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:39.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.994+0000 7fc7ab1d2640 1 --2- 10.20.193.58:0/492410281 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7a40b6690 0x7fc7a4057750 secure :-1 s=READY pgs=159 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc794009480 tx=0x7fc79400ee60 comp rx=0 tx=0).stop 2026-02-23T06:51:39.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.995+0000 7fc7ab1d2640 1 -- 10.20.193.58:0/492410281 shutdown_connections 2026-02-23T06:51:39.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.995+0000 7fc7ab1d2640 1 --2- 10.20.193.58:0/492410281 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc77407a6b0 0x7fc77409ab60 unknown :-1 s=CLOSED pgs=603 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:39.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.995+0000 7fc7ab1d2640 1 --2- 10.20.193.58:0/492410281 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc7a415d870 0x7fc7a4162c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:39.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.995+0000 7fc7ab1d2640 1 --2- 10.20.193.58:0/492410281 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc7a415d4a0 0x7fc7a4162700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:39.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.995+0000 7fc7ab1d2640 1 --2- 10.20.193.58:0/492410281 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc7a40b6690 0x7fc7a4057750 unknown :-1 s=CLOSED pgs=159 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:39.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.995+0000 7fc7ab1d2640 1 -- 10.20.193.58:0/492410281 >> 10.20.193.58:0/492410281 conn(0x7fc7a40b3c20 msgr2=0x7fc7a413ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:39.995 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.995+0000 7fc7ab1d2640 1 -- 10.20.193.58:0/492410281 shutdown_connections 2026-02-23T06:51:39.996 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:39.995+0000 7fc7ab1d2640 1 -- 10.20.193.58:0/492410281 wait complete. 2026-02-23T06:51:40.002 INFO:teuthology.orchestra.run.trial058.stdout:{"pg_ready":true,"pg_map":{"version":938,"stamp":"2026-02-23T06:51:38.655843+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3578981466,"num_objects":878,"num_object_clones":0,"num_object_copies":3456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":878,"num_whiteouts":0,"num_read":117,"num_read_kb":175,"num_write":759269,"num_write_kb":39399252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62961,"ondisk_log_size":62961,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3474480,"kb_used_data":1689136,"kb_used_omap":705,"kb_used_meta":1784510,"kb_avail":751500240,"statfs":{"total":773094113280,"available":769536245760,"internally_reserved":0,"allocated":1729675264,"data_stored":7158907516,"data_compressed":421610194,"data_compressed_allocated":1018142720,"data_compressed_original":6448824320,"omap_allocated":722493,"internal_metadata":1827338691},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001580"},"pg_stats":[{"pgid":"2.1f","version":"27'27","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:38.203132+0000","last_change":"2026-02-23T06:21:17.142582+0000","last_active":"2026-02-23T06:50:38.203132+0000","last_peered":"2026-02-23T06:50:38.203132+0000","last_clean":"2026-02-23T06:50:38.203132+0000","last_became_active":"2026-02-23T06:21:17.142416+0000","last_became_peered":"2026-02-23T06:21:17.142416+0000","last_unstale":"2026-02-23T06:50:38.203132+0000","last_undegraded":"2026-02-23T06:50:38.203132+0000","last_fullsized":"2026-02-23T06:50:38.203132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:13:12.649937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569948,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.110619+0000","last_change":"2026-02-23T06:21:18.148362+0000","last_active":"2026-02-23T06:49:41.110619+0000","last_peered":"2026-02-23T06:49:41.110619+0000","last_clean":"2026-02-23T06:49:41.110619+0000","last_became_active":"2026-02-23T06:21:18.148276+0000","last_became_peered":"2026-02-23T06:21:18.148276+0000","last_unstale":"2026-02-23T06:49:41.110619+0000","last_undegraded":"2026-02-23T06:49:41.110619+0000","last_fullsized":"2026-02-23T06:49:41.110619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:47.221741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'2019","reported_seq":2050,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.526367+0000","last_change":"2026-02-23T06:21:22.169541+0000","last_active":"2026-02-23T06:50:45.526367+0000","last_peered":"2026-02-23T06:50:45.526367+0000","last_clean":"2026-02-23T06:50:45.526367+0000","last_became_active":"2026-02-23T06:21:22.169307+0000","last_became_peered":"2026-02-23T06:21:22.169307+0000","last_unstale":"2026-02-23T06:50:45.526367+0000","last_undegraded":"2026-02-23T06:50:45.526367+0000","last_fullsized":"2026-02-23T06:50:45.526367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2019,"log_dups_size":0,"ondisk_log_size":2019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:40:10.952374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25583,"num_write_kb":1337383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'3","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.078645+0000","last_change":"2026-02-23T06:21:17.138864+0000","last_active":"2026-02-23T06:49:41.078645+0000","last_peered":"2026-02-23T06:49:41.078645+0000","last_clean":"2026-02-23T06:49:41.078645+0000","last_became_active":"2026-02-23T06:21:17.138651+0000","last_became_peered":"2026-02-23T06:21:17.138651+0000","last_unstale":"2026-02-23T06:49:41.078645+0000","last_undegraded":"2026-02-23T06:49:41.078645+0000","last_fullsized":"2026-02-23T06:49:41.078645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:24.172617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'14","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.255888+0000","last_change":"2026-02-23T06:21:18.145040+0000","last_active":"2026-02-23T06:50:43.255888+0000","last_peered":"2026-02-23T06:50:43.255888+0000","last_clean":"2026-02-23T06:50:43.255888+0000","last_became_active":"2026-02-23T06:21:18.144915+0000","last_became_peered":"2026-02-23T06:21:18.144915+0000","last_unstale":"2026-02-23T06:50:43.255888+0000","last_undegraded":"2026-02-23T06:50:43.255888+0000","last_fullsized":"2026-02-23T06:50:43.255888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:17:30.105623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'1991","reported_seq":2030,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.573583+0000","last_change":"2026-02-23T06:22:05.910182+0000","last_active":"2026-02-23T06:50:45.573583+0000","last_peered":"2026-02-23T06:50:45.573583+0000","last_clean":"2026-02-23T06:50:45.573583+0000","last_became_active":"2026-02-23T06:22:05.909877+0000","last_became_peered":"2026-02-23T06:22:05.909877+0000","last_unstale":"2026-02-23T06:50:45.573583+0000","last_undegraded":"2026-02-23T06:50:45.573583+0000","last_fullsized":"2026-02-23T06:50:45.573583+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:45:51.963908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25310,"num_write_kb":1284660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'9","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.059320+0000","last_change":"2026-02-23T06:21:17.150375+0000","last_active":"2026-02-23T06:49:41.059320+0000","last_peered":"2026-02-23T06:49:41.059320+0000","last_clean":"2026-02-23T06:49:41.059320+0000","last_became_active":"2026-02-23T06:21:17.150244+0000","last_became_peered":"2026-02-23T06:21:17.150244+0000","last_unstale":"2026-02-23T06:49:41.059320+0000","last_undegraded":"2026-02-23T06:49:41.059320+0000","last_fullsized":"2026-02-23T06:49:41.059320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:06:21.465108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:41.247849+0000","last_change":"2026-02-23T06:21:18.150247+0000","last_active":"2026-02-23T06:50:41.247849+0000","last_peered":"2026-02-23T06:50:41.247849+0000","last_clean":"2026-02-23T06:50:41.247849+0000","last_became_active":"2026-02-23T06:21:18.149827+0000","last_became_peered":"2026-02-23T06:21:18.149827+0000","last_unstale":"2026-02-23T06:50:41.247849+0000","last_undegraded":"2026-02-23T06:50:41.247849+0000","last_fullsized":"2026-02-23T06:50:41.247849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:37:58.944726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'1720","reported_seq":1751,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.544254+0000","last_change":"2026-02-23T06:21:22.174417+0000","last_active":"2026-02-23T06:50:45.544254+0000","last_peered":"2026-02-23T06:50:45.544254+0000","last_clean":"2026-02-23T06:50:45.544254+0000","last_became_active":"2026-02-23T06:21:22.173939+0000","last_became_peered":"2026-02-23T06:21:22.173939+0000","last_unstale":"2026-02-23T06:50:45.544254+0000","last_undegraded":"2026-02-23T06:50:45.544254+0000","last_fullsized":"2026-02-23T06:50:45.544254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1720,"log_dups_size":0,"ondisk_log_size":1720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:41:53.008301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21991,"num_write_kb":1043178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:48:49.514790+0000","last_change":"2026-02-23T06:21:17.145244+0000","last_active":"2026-02-23T06:48:49.514790+0000","last_peered":"2026-02-23T06:48:49.514790+0000","last_clean":"2026-02-23T06:48:49.514790+0000","last_became_active":"2026-02-23T06:21:17.144122+0000","last_became_peered":"2026-02-23T06:21:17.144122+0000","last_unstale":"2026-02-23T06:48:49.514790+0000","last_undegraded":"2026-02-23T06:48:49.514790+0000","last_fullsized":"2026-02-23T06:48:49.514790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:42:56.020005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'11","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.972332+0000","last_change":"2026-02-23T06:22:05.870395+0000","last_active":"2026-02-23T06:50:43.972332+0000","last_peered":"2026-02-23T06:50:43.972332+0000","last_clean":"2026-02-23T06:50:43.972332+0000","last_became_active":"2026-02-23T06:22:05.870252+0000","last_became_peered":"2026-02-23T06:22:05.870252+0000","last_unstale":"2026-02-23T06:50:43.972332+0000","last_undegraded":"2026-02-23T06:50:43.972332+0000","last_fullsized":"2026-02-23T06:50:43.972332+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:05:32.729525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'2068","reported_seq":2099,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.563415+0000","last_change":"2026-02-23T06:21:22.168755+0000","last_active":"2026-02-23T06:50:45.563415+0000","last_peered":"2026-02-23T06:50:45.563415+0000","last_clean":"2026-02-23T06:50:45.563415+0000","last_became_active":"2026-02-23T06:21:22.165671+0000","last_became_peered":"2026-02-23T06:21:22.165671+0000","last_unstale":"2026-02-23T06:50:45.563415+0000","last_undegraded":"2026-02-23T06:50:45.563415+0000","last_fullsized":"2026-02-23T06:50:45.563415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2068,"log_dups_size":0,"ondisk_log_size":2068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:04:32.848929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26558,"num_write_kb":1292875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'10","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.058819+0000","last_change":"2026-02-23T06:21:18.150907+0000","last_active":"2026-02-23T06:49:41.058819+0000","last_peered":"2026-02-23T06:49:41.058819+0000","last_clean":"2026-02-23T06:49:41.058819+0000","last_became_active":"2026-02-23T06:21:18.150604+0000","last_became_peered":"2026-02-23T06:21:18.150604+0000","last_unstale":"2026-02-23T06:49:41.058819+0000","last_undegraded":"2026-02-23T06:49:41.058819+0000","last_fullsized":"2026-02-23T06:49:41.058819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:15:21.672153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'325","reported_seq":364,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.103715+0000","last_change":"2026-02-23T06:21:17.147523+0000","last_active":"2026-02-23T06:49:41.103715+0000","last_peered":"2026-02-23T06:49:41.103715+0000","last_clean":"2026-02-23T06:49:41.103715+0000","last_became_active":"2026-02-23T06:21:17.147351+0000","last_became_peered":"2026-02-23T06:21:17.147351+0000","last_unstale":"2026-02-23T06:49:41.103715+0000","last_undegraded":"2026-02-23T06:49:41.103715+0000","last_fullsized":"2026-02-23T06:49:41.103715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:36:34.550499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":322,"num_write_kb":4304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'1793","reported_seq":1825,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.575304+0000","last_change":"2026-02-23T06:21:22.169413+0000","last_active":"2026-02-23T06:50:45.575304+0000","last_peered":"2026-02-23T06:50:45.575304+0000","last_clean":"2026-02-23T06:50:45.575304+0000","last_became_active":"2026-02-23T06:21:22.169259+0000","last_became_peered":"2026-02-23T06:21:22.169259+0000","last_unstale":"2026-02-23T06:50:45.575304+0000","last_undegraded":"2026-02-23T06:50:45.575304+0000","last_fullsized":"2026-02-23T06:50:45.575304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1793,"log_dups_size":0,"ondisk_log_size":1793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:14:12.944321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22776,"num_write_kb":1137326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'10","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:34.445802+0000","last_change":"2026-02-23T06:21:18.142316+0000","last_active":"2026-02-23T06:50:34.445802+0000","last_peered":"2026-02-23T06:50:34.445802+0000","last_clean":"2026-02-23T06:50:34.445802+0000","last_became_active":"2026-02-23T06:21:18.142144+0000","last_became_peered":"2026-02-23T06:21:18.142144+0000","last_unstale":"2026-02-23T06:50:34.445802+0000","last_undegraded":"2026-02-23T06:50:34.445802+0000","last_fullsized":"2026-02-23T06:50:34.445802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:53:33.429271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'1","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:47:24.431558+0000","last_change":"2026-02-23T06:21:17.137576+0000","last_active":"2026-02-23T06:47:24.431558+0000","last_peered":"2026-02-23T06:47:24.431558+0000","last_clean":"2026-02-23T06:47:24.431558+0000","last_became_active":"2026-02-23T06:21:17.137371+0000","last_became_peered":"2026-02-23T06:21:17.137371+0000","last_unstale":"2026-02-23T06:47:24.431558+0000","last_undegraded":"2026-02-23T06:47:24.431558+0000","last_fullsized":"2026-02-23T06:47:24.431558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:27.159743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'1749","reported_seq":1781,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.569230+0000","last_change":"2026-02-23T06:21:22.163003+0000","last_active":"2026-02-23T06:50:45.569230+0000","last_peered":"2026-02-23T06:50:45.569230+0000","last_clean":"2026-02-23T06:50:45.569230+0000","last_became_active":"2026-02-23T06:21:22.162898+0000","last_became_peered":"2026-02-23T06:21:22.162898+0000","last_unstale":"2026-02-23T06:50:45.569230+0000","last_undegraded":"2026-02-23T06:50:45.569230+0000","last_fullsized":"2026-02-23T06:50:45.569230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1749,"log_dups_size":0,"ondisk_log_size":1749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:29:18.161667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21377,"num_write_kb":1230733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'8","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:29.498516+0000","last_change":"2026-02-23T06:21:18.141281+0000","last_active":"2026-02-23T06:49:29.498516+0000","last_peered":"2026-02-23T06:49:29.498516+0000","last_clean":"2026-02-23T06:49:29.498516+0000","last_became_active":"2026-02-23T06:21:18.141090+0000","last_became_peered":"2026-02-23T06:21:18.141090+0000","last_unstale":"2026-02-23T06:49:29.498516+0000","last_undegraded":"2026-02-23T06:49:29.498516+0000","last_fullsized":"2026-02-23T06:49:29.498516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:12:21.750595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:47:19.490471+0000","last_change":"2026-02-23T06:21:17.144179+0000","last_active":"2026-02-23T06:47:19.490471+0000","last_peered":"2026-02-23T06:47:19.490471+0000","last_clean":"2026-02-23T06:47:19.490471+0000","last_became_active":"2026-02-23T06:21:17.144017+0000","last_became_peered":"2026-02-23T06:21:17.144017+0000","last_unstale":"2026-02-23T06:47:19.490471+0000","last_undegraded":"2026-02-23T06:47:19.490471+0000","last_fullsized":"2026-02-23T06:47:19.490471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:25:41.992201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'2539","reported_seq":2571,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.575621+0000","last_change":"2026-02-23T06:21:22.174826+0000","last_active":"2026-02-23T06:50:45.575621+0000","last_peered":"2026-02-23T06:50:45.575621+0000","last_clean":"2026-02-23T06:50:45.575621+0000","last_became_active":"2026-02-23T06:21:22.174683+0000","last_became_peered":"2026-02-23T06:21:22.174683+0000","last_unstale":"2026-02-23T06:50:45.575621+0000","last_undegraded":"2026-02-23T06:50:45.575621+0000","last_fullsized":"2026-02-23T06:50:45.575621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2539,"log_dups_size":0,"ondisk_log_size":2539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:04:49.277580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32937,"num_write_kb":1504117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'7","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.086801+0000","last_change":"2026-02-23T06:21:18.145331+0000","last_active":"2026-02-23T06:49:41.086801+0000","last_peered":"2026-02-23T06:49:41.086801+0000","last_clean":"2026-02-23T06:49:41.086801+0000","last_became_active":"2026-02-23T06:21:18.145231+0000","last_became_peered":"2026-02-23T06:21:18.145231+0000","last_unstale":"2026-02-23T06:49:41.086801+0000","last_undegraded":"2026-02-23T06:49:41.086801+0000","last_fullsized":"2026-02-23T06:49:41.086801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:32:44.487867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'3","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:29.517107+0000","last_change":"2026-02-23T06:21:17.147584+0000","last_active":"2026-02-23T06:49:29.517107+0000","last_peered":"2026-02-23T06:49:29.517107+0000","last_clean":"2026-02-23T06:49:29.517107+0000","last_became_active":"2026-02-23T06:21:17.147431+0000","last_became_peered":"2026-02-23T06:21:17.147431+0000","last_unstale":"2026-02-23T06:49:29.517107+0000","last_undegraded":"2026-02-23T06:49:29.517107+0000","last_fullsized":"2026-02-23T06:49:29.517107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:10:39.127457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'2046","reported_seq":2078,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.529417+0000","last_change":"2026-02-23T06:21:22.175656+0000","last_active":"2026-02-23T06:50:45.529417+0000","last_peered":"2026-02-23T06:50:45.529417+0000","last_clean":"2026-02-23T06:50:45.529417+0000","last_became_active":"2026-02-23T06:21:22.175493+0000","last_became_peered":"2026-02-23T06:21:22.175493+0000","last_unstale":"2026-02-23T06:50:45.529417+0000","last_undegraded":"2026-02-23T06:50:45.529417+0000","last_fullsized":"2026-02-23T06:50:45.529417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2046,"log_dups_size":0,"ondisk_log_size":2046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:10:41.366772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25584,"num_write_kb":1337535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'18","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:29.059447+0000","last_change":"2026-02-23T06:21:18.141486+0000","last_active":"2026-02-23T06:50:29.059447+0000","last_peered":"2026-02-23T06:50:29.059447+0000","last_clean":"2026-02-23T06:50:29.059447+0000","last_became_active":"2026-02-23T06:21:18.141277+0000","last_became_peered":"2026-02-23T06:21:18.141277+0000","last_unstale":"2026-02-23T06:50:29.059447+0000","last_undegraded":"2026-02-23T06:50:29.059447+0000","last_fullsized":"2026-02-23T06:50:29.059447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:21:15.738187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.091039+0000","last_change":"2026-02-23T06:21:17.148536+0000","last_active":"2026-02-23T06:49:41.091039+0000","last_peered":"2026-02-23T06:49:41.091039+0000","last_clean":"2026-02-23T06:49:41.091039+0000","last_became_active":"2026-02-23T06:21:17.148424+0000","last_became_peered":"2026-02-23T06:21:17.148424+0000","last_unstale":"2026-02-23T06:49:41.091039+0000","last_undegraded":"2026-02-23T06:49:41.091039+0000","last_fullsized":"2026-02-23T06:49:41.091039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:02:54.995144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'1584","reported_seq":1617,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:44.677283+0000","last_change":"2026-02-23T06:21:22.171333+0000","last_active":"2026-02-23T06:50:44.677283+0000","last_peered":"2026-02-23T06:50:44.677283+0000","last_clean":"2026-02-23T06:50:44.677283+0000","last_became_active":"2026-02-23T06:21:22.170496+0000","last_became_peered":"2026-02-23T06:21:22.170496+0000","last_unstale":"2026-02-23T06:50:44.677283+0000","last_undegraded":"2026-02-23T06:50:44.677283+0000","last_fullsized":"2026-02-23T06:50:44.677283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1584,"log_dups_size":0,"ondisk_log_size":1584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:40:07.996281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20571,"num_write_kb":974984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'12","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.629461+0000","last_change":"2026-02-23T06:21:18.142135+0000","last_active":"2026-02-23T06:50:43.629461+0000","last_peered":"2026-02-23T06:50:43.629461+0000","last_clean":"2026-02-23T06:50:43.629461+0000","last_became_active":"2026-02-23T06:21:18.141771+0000","last_became_peered":"2026-02-23T06:21:18.141771+0000","last_unstale":"2026-02-23T06:50:43.629461+0000","last_undegraded":"2026-02-23T06:50:43.629461+0000","last_fullsized":"2026-02-23T06:50:43.629461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:10:18.195986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'154","reported_seq":193,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:37.438555+0000","last_change":"2026-02-23T06:21:17.142326+0000","last_active":"2026-02-23T06:50:37.438555+0000","last_peered":"2026-02-23T06:50:37.438555+0000","last_clean":"2026-02-23T06:50:37.438555+0000","last_became_active":"2026-02-23T06:21:17.142203+0000","last_became_peered":"2026-02-23T06:21:17.142203+0000","last_unstale":"2026-02-23T06:50:37.438555+0000","last_undegraded":"2026-02-23T06:50:37.438555+0000","last_fullsized":"2026-02-23T06:50:37.438555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:49:44.262210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'1540","reported_seq":1574,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.582158+0000","last_change":"2026-02-23T06:21:22.168717+0000","last_active":"2026-02-23T06:50:45.582158+0000","last_peered":"2026-02-23T06:50:45.582158+0000","last_clean":"2026-02-23T06:50:45.582158+0000","last_became_active":"2026-02-23T06:21:22.168375+0000","last_became_peered":"2026-02-23T06:21:22.168375+0000","last_unstale":"2026-02-23T06:50:45.582158+0000","last_undegraded":"2026-02-23T06:50:45.582158+0000","last_fullsized":"2026-02-23T06:50:45.582158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1540,"log_dups_size":0,"ondisk_log_size":1540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:03:53.993581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18660,"num_write_kb":1083504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'9","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:29.444279+0000","last_change":"2026-02-23T06:21:18.141908+0000","last_active":"2026-02-23T06:50:29.444279+0000","last_peered":"2026-02-23T06:50:29.444279+0000","last_clean":"2026-02-23T06:50:29.444279+0000","last_became_active":"2026-02-23T06:21:18.141363+0000","last_became_peered":"2026-02-23T06:21:18.141363+0000","last_unstale":"2026-02-23T06:50:29.444279+0000","last_undegraded":"2026-02-23T06:50:29.444279+0000","last_fullsized":"2026-02-23T06:50:29.444279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:06:26.731868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.081381+0000","last_change":"2026-02-23T06:21:17.144716+0000","last_active":"2026-02-23T06:49:41.081381+0000","last_peered":"2026-02-23T06:49:41.081381+0000","last_clean":"2026-02-23T06:49:41.081381+0000","last_became_active":"2026-02-23T06:21:17.144515+0000","last_became_peered":"2026-02-23T06:21:17.144515+0000","last_unstale":"2026-02-23T06:49:41.081381+0000","last_undegraded":"2026-02-23T06:49:41.081381+0000","last_fullsized":"2026-02-23T06:49:41.081381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:38:35.014170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'1993","reported_seq":2026,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.583075+0000","last_change":"2026-02-23T06:21:22.171364+0000","last_active":"2026-02-23T06:50:45.583075+0000","last_peered":"2026-02-23T06:50:45.583075+0000","last_clean":"2026-02-23T06:50:45.583075+0000","last_became_active":"2026-02-23T06:21:22.171165+0000","last_became_peered":"2026-02-23T06:21:22.171165+0000","last_unstale":"2026-02-23T06:50:45.583075+0000","last_undegraded":"2026-02-23T06:50:45.583075+0000","last_fullsized":"2026-02-23T06:50:45.583075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1993,"log_dups_size":0,"ondisk_log_size":1993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:00:42.055334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24991,"num_write_kb":1370848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'12","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:34.065120+0000","last_change":"2026-02-23T06:21:18.144182+0000","last_active":"2026-02-23T06:50:34.065120+0000","last_peered":"2026-02-23T06:50:34.065120+0000","last_clean":"2026-02-23T06:50:34.065120+0000","last_became_active":"2026-02-23T06:21:18.143585+0000","last_became_peered":"2026-02-23T06:21:18.143585+0000","last_unstale":"2026-02-23T06:50:34.065120+0000","last_undegraded":"2026-02-23T06:50:34.065120+0000","last_fullsized":"2026-02-23T06:50:34.065120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:07:05.513990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:48:24.435637+0000","last_change":"2026-02-23T06:21:17.137935+0000","last_active":"2026-02-23T06:48:24.435637+0000","last_peered":"2026-02-23T06:48:24.435637+0000","last_clean":"2026-02-23T06:48:24.435637+0000","last_became_active":"2026-02-23T06:21:17.137386+0000","last_became_peered":"2026-02-23T06:21:17.137386+0000","last_unstale":"2026-02-23T06:48:24.435637+0000","last_undegraded":"2026-02-23T06:48:24.435637+0000","last_fullsized":"2026-02-23T06:48:24.435637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:51:24.646436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'1807","reported_seq":1840,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.529577+0000","last_change":"2026-02-23T06:21:22.163110+0000","last_active":"2026-02-23T06:50:45.529577+0000","last_peered":"2026-02-23T06:50:45.529577+0000","last_clean":"2026-02-23T06:50:45.529577+0000","last_became_active":"2026-02-23T06:21:22.162891+0000","last_became_peered":"2026-02-23T06:21:22.162891+0000","last_unstale":"2026-02-23T06:50:45.529577+0000","last_undegraded":"2026-02-23T06:50:45.529577+0000","last_fullsized":"2026-02-23T06:50:45.529577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1807,"log_dups_size":0,"ondisk_log_size":1807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:06:23.664613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22820,"num_write_kb":1167007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'9","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:42.194253+0000","last_change":"2026-02-23T06:21:18.152606+0000","last_active":"2026-02-23T06:50:42.194253+0000","last_peered":"2026-02-23T06:50:42.194253+0000","last_clean":"2026-02-23T06:50:42.194253+0000","last_became_active":"2026-02-23T06:21:18.152102+0000","last_became_peered":"2026-02-23T06:21:18.152102+0000","last_unstale":"2026-02-23T06:50:42.194253+0000","last_undegraded":"2026-02-23T06:50:42.194253+0000","last_fullsized":"2026-02-23T06:50:42.194253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:59:30.188417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:48:24.491404+0000","last_change":"2026-02-23T06:21:17.143289+0000","last_active":"2026-02-23T06:48:24.491404+0000","last_peered":"2026-02-23T06:48:24.491404+0000","last_clean":"2026-02-23T06:48:24.491404+0000","last_became_active":"2026-02-23T06:21:17.143201+0000","last_became_peered":"2026-02-23T06:21:17.143201+0000","last_unstale":"2026-02-23T06:48:24.491404+0000","last_undegraded":"2026-02-23T06:48:24.491404+0000","last_fullsized":"2026-02-23T06:48:24.491404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:33:06.892035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'1941","reported_seq":1974,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.582448+0000","last_change":"2026-02-23T06:21:22.163932+0000","last_active":"2026-02-23T06:50:45.582448+0000","last_peered":"2026-02-23T06:50:45.582448+0000","last_clean":"2026-02-23T06:50:45.582448+0000","last_became_active":"2026-02-23T06:21:22.163734+0000","last_became_peered":"2026-02-23T06:21:22.163734+0000","last_unstale":"2026-02-23T06:50:45.582448+0000","last_undegraded":"2026-02-23T06:50:45.582448+0000","last_fullsized":"2026-02-23T06:50:45.582448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1941,"log_dups_size":0,"ondisk_log_size":1941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:44:47.208608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24396,"num_write_kb":1329645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'16","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:44.636060+0000","last_change":"2026-02-23T06:21:18.141664+0000","last_active":"2026-02-23T06:50:44.636060+0000","last_peered":"2026-02-23T06:50:44.636060+0000","last_clean":"2026-02-23T06:50:44.636060+0000","last_became_active":"2026-02-23T06:21:18.141350+0000","last_became_peered":"2026-02-23T06:21:18.141350+0000","last_unstale":"2026-02-23T06:50:44.636060+0000","last_undegraded":"2026-02-23T06:50:44.636060+0000","last_fullsized":"2026-02-23T06:50:44.636060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:01:50.434732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'31","reported_seq":102,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:41.061841+0000","last_change":"2026-02-23T06:21:17.139311+0000","last_active":"2026-02-23T06:50:41.061841+0000","last_peered":"2026-02-23T06:50:41.061841+0000","last_clean":"2026-02-23T06:50:41.061841+0000","last_became_active":"2026-02-23T06:21:17.139200+0000","last_became_peered":"2026-02-23T06:21:17.139200+0000","last_unstale":"2026-02-23T06:50:41.061841+0000","last_undegraded":"2026-02-23T06:50:41.061841+0000","last_fullsized":"2026-02-23T06:50:41.061841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:52:23.863807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78928,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":99,"num_write":30,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'1732","reported_seq":1764,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.547623+0000","last_change":"2026-02-23T06:21:22.164793+0000","last_active":"2026-02-23T06:50:45.547623+0000","last_peered":"2026-02-23T06:50:45.547623+0000","last_clean":"2026-02-23T06:50:45.547623+0000","last_became_active":"2026-02-23T06:21:22.164667+0000","last_became_peered":"2026-02-23T06:21:22.164667+0000","last_unstale":"2026-02-23T06:50:45.547623+0000","last_undegraded":"2026-02-23T06:50:45.547623+0000","last_fullsized":"2026-02-23T06:50:45.547623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1732,"log_dups_size":0,"ondisk_log_size":1732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:36:39.520044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22104,"num_write_kb":1081444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'7","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:29.444261+0000","last_change":"2026-02-23T06:21:18.146624+0000","last_active":"2026-02-23T06:50:29.444261+0000","last_peered":"2026-02-23T06:50:29.444261+0000","last_clean":"2026-02-23T06:50:29.444261+0000","last_became_active":"2026-02-23T06:21:18.146491+0000","last_became_peered":"2026-02-23T06:21:18.146491+0000","last_unstale":"2026-02-23T06:50:29.444261+0000","last_undegraded":"2026-02-23T06:50:29.444261+0000","last_fullsized":"2026-02-23T06:50:29.444261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:11:23.574241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'5","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.036902+0000","last_change":"2026-02-23T06:21:17.143128+0000","last_active":"2026-02-23T06:49:41.036902+0000","last_peered":"2026-02-23T06:49:41.036902+0000","last_clean":"2026-02-23T06:49:41.036902+0000","last_became_active":"2026-02-23T06:21:17.143050+0000","last_became_peered":"2026-02-23T06:21:17.143050+0000","last_unstale":"2026-02-23T06:49:41.036902+0000","last_undegraded":"2026-02-23T06:49:41.036902+0000","last_fullsized":"2026-02-23T06:49:41.036902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:15.628487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'1668","reported_seq":1700,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.540464+0000","last_change":"2026-02-23T06:21:22.168755+0000","last_active":"2026-02-23T06:50:45.540464+0000","last_peered":"2026-02-23T06:50:45.540464+0000","last_clean":"2026-02-23T06:50:45.540464+0000","last_became_active":"2026-02-23T06:21:22.168510+0000","last_became_peered":"2026-02-23T06:21:22.168510+0000","last_unstale":"2026-02-23T06:50:45.540464+0000","last_undegraded":"2026-02-23T06:50:45.540464+0000","last_fullsized":"2026-02-23T06:50:45.540464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1668,"log_dups_size":0,"ondisk_log_size":1668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:19:06.716318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20170,"num_write_kb":1220870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:41.398913+0000","last_change":"2026-02-23T06:21:18.145397+0000","last_active":"2026-02-23T06:50:41.398913+0000","last_peered":"2026-02-23T06:50:41.398913+0000","last_clean":"2026-02-23T06:50:41.398913+0000","last_became_active":"2026-02-23T06:21:18.145214+0000","last_became_peered":"2026-02-23T06:21:18.145214+0000","last_unstale":"2026-02-23T06:50:41.398913+0000","last_undegraded":"2026-02-23T06:50:41.398913+0000","last_fullsized":"2026-02-23T06:50:41.398913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:33:41.870582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'2","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.031120+0000","last_change":"2026-02-23T06:21:17.147696+0000","last_active":"2026-02-23T06:49:41.031120+0000","last_peered":"2026-02-23T06:49:41.031120+0000","last_clean":"2026-02-23T06:49:41.031120+0000","last_became_active":"2026-02-23T06:21:17.147619+0000","last_became_peered":"2026-02-23T06:21:17.147619+0000","last_unstale":"2026-02-23T06:49:41.031120+0000","last_undegraded":"2026-02-23T06:49:41.031120+0000","last_fullsized":"2026-02-23T06:49:41.031120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:49:09.070245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'112","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:19.503937+0000","last_change":"2026-02-23T06:21:11.397748+0000","last_active":"2026-02-23T06:49:19.503937+0000","last_peered":"2026-02-23T06:49:19.503937+0000","last_clean":"2026-02-23T06:49:19.503937+0000","last_became_active":"2026-02-23T06:21:11.397664+0000","last_became_peered":"2026-02-23T06:21:11.397664+0000","last_unstale":"2026-02-23T06:49:19.503937+0000","last_undegraded":"2026-02-23T06:49:19.503937+0000","last_fullsized":"2026-02-23T06:49:19.503937+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:10.392316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:10.392316+0000","last_clean_scrub_stamp":"2026-02-23T06:21:10.392316+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:43.157572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'1573","reported_seq":1606,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.540404+0000","last_change":"2026-02-23T06:21:22.174696+0000","last_active":"2026-02-23T06:50:45.540404+0000","last_peered":"2026-02-23T06:50:45.540404+0000","last_clean":"2026-02-23T06:50:45.540404+0000","last_became_active":"2026-02-23T06:21:22.174253+0000","last_became_peered":"2026-02-23T06:21:22.174253+0000","last_unstale":"2026-02-23T06:50:45.540404+0000","last_undegraded":"2026-02-23T06:50:45.540404+0000","last_fullsized":"2026-02-23T06:50:45.540404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1573,"log_dups_size":0,"ondisk_log_size":1573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:28.487343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19207,"num_write_kb":1122014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'10","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:14.095464+0000","last_change":"2026-02-23T06:21:18.150652+0000","last_active":"2026-02-23T06:50:14.095464+0000","last_peered":"2026-02-23T06:50:14.095464+0000","last_clean":"2026-02-23T06:50:14.095464+0000","last_became_active":"2026-02-23T06:21:18.150501+0000","last_became_peered":"2026-02-23T06:21:18.150501+0000","last_unstale":"2026-02-23T06:50:14.095464+0000","last_undegraded":"2026-02-23T06:50:14.095464+0000","last_fullsized":"2026-02-23T06:50:14.095464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:34:20.113034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.038910+0000","last_change":"2026-02-23T06:21:17.146074+0000","last_active":"2026-02-23T06:49:41.038910+0000","last_peered":"2026-02-23T06:49:41.038910+0000","last_clean":"2026-02-23T06:49:41.038910+0000","last_became_active":"2026-02-23T06:21:17.145938+0000","last_became_peered":"2026-02-23T06:21:17.145938+0000","last_unstale":"2026-02-23T06:49:41.038910+0000","last_undegraded":"2026-02-23T06:49:41.038910+0000","last_fullsized":"2026-02-23T06:49:41.038910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:41:42.571718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'1561","reported_seq":1593,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:44.762982+0000","last_change":"2026-02-23T06:21:22.172266+0000","last_active":"2026-02-23T06:50:44.762982+0000","last_peered":"2026-02-23T06:50:44.762982+0000","last_clean":"2026-02-23T06:50:44.762982+0000","last_became_active":"2026-02-23T06:21:22.171828+0000","last_became_peered":"2026-02-23T06:21:22.171828+0000","last_unstale":"2026-02-23T06:50:44.762982+0000","last_undegraded":"2026-02-23T06:50:44.762982+0000","last_fullsized":"2026-02-23T06:50:44.762982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1561,"log_dups_size":0,"ondisk_log_size":1561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:34:06.583640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19191,"num_write_kb":1080158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'12","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.093218+0000","last_change":"2026-02-23T06:21:18.147056+0000","last_active":"2026-02-23T06:49:41.093218+0000","last_peered":"2026-02-23T06:49:41.093218+0000","last_clean":"2026-02-23T06:49:41.093218+0000","last_became_active":"2026-02-23T06:21:18.146977+0000","last_became_peered":"2026-02-23T06:21:18.146977+0000","last_unstale":"2026-02-23T06:49:41.093218+0000","last_undegraded":"2026-02-23T06:49:41.093218+0000","last_fullsized":"2026-02-23T06:49:41.093218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:02:14.013207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.036506+0000","last_change":"2026-02-23T06:21:17.139417+0000","last_active":"2026-02-23T06:49:41.036506+0000","last_peered":"2026-02-23T06:49:41.036506+0000","last_clean":"2026-02-23T06:49:41.036506+0000","last_became_active":"2026-02-23T06:21:17.139209+0000","last_became_peered":"2026-02-23T06:21:17.139209+0000","last_unstale":"2026-02-23T06:49:41.036506+0000","last_undegraded":"2026-02-23T06:49:41.036506+0000","last_fullsized":"2026-02-23T06:49:41.036506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:02:19.925669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'2272","reported_seq":2304,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.541787+0000","last_change":"2026-02-23T06:21:22.162912+0000","last_active":"2026-02-23T06:50:45.541787+0000","last_peered":"2026-02-23T06:50:45.541787+0000","last_clean":"2026-02-23T06:50:45.541787+0000","last_became_active":"2026-02-23T06:21:22.162777+0000","last_became_peered":"2026-02-23T06:21:22.162777+0000","last_unstale":"2026-02-23T06:50:45.541787+0000","last_undegraded":"2026-02-23T06:50:45.541787+0000","last_fullsized":"2026-02-23T06:50:45.541787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2272,"log_dups_size":0,"ondisk_log_size":2272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:40:10.012263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28575,"num_write_kb":1525996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'9","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.085449+0000","last_change":"2026-02-23T06:21:18.149281+0000","last_active":"2026-02-23T06:49:41.085449+0000","last_peered":"2026-02-23T06:49:41.085449+0000","last_clean":"2026-02-23T06:49:41.085449+0000","last_became_active":"2026-02-23T06:21:18.149038+0000","last_became_peered":"2026-02-23T06:21:18.149038+0000","last_unstale":"2026-02-23T06:49:41.085449+0000","last_undegraded":"2026-02-23T06:49:41.085449+0000","last_fullsized":"2026-02-23T06:49:41.085449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:57:13.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.083324+0000","last_change":"2026-02-23T06:21:17.137649+0000","last_active":"2026-02-23T06:49:41.083324+0000","last_peered":"2026-02-23T06:49:41.083324+0000","last_clean":"2026-02-23T06:49:41.083324+0000","last_became_active":"2026-02-23T06:21:17.137476+0000","last_became_peered":"2026-02-23T06:21:17.137476+0000","last_unstale":"2026-02-23T06:49:41.083324+0000","last_undegraded":"2026-02-23T06:49:41.083324+0000","last_fullsized":"2026-02-23T06:49:41.083324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:47:43.648999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'1596","reported_seq":1628,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.574320+0000","last_change":"2026-02-23T06:21:22.174081+0000","last_active":"2026-02-23T06:50:45.574320+0000","last_peered":"2026-02-23T06:50:45.574320+0000","last_clean":"2026-02-23T06:50:45.574320+0000","last_became_active":"2026-02-23T06:21:22.173501+0000","last_became_peered":"2026-02-23T06:21:22.173501+0000","last_unstale":"2026-02-23T06:50:45.574320+0000","last_undegraded":"2026-02-23T06:50:45.574320+0000","last_fullsized":"2026-02-23T06:50:45.574320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1596,"log_dups_size":0,"ondisk_log_size":1596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:29:42.370894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20195,"num_write_kb":1002716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'7","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.099249+0000","last_change":"2026-02-23T06:21:18.155183+0000","last_active":"2026-02-23T06:49:41.099249+0000","last_peered":"2026-02-23T06:49:41.099249+0000","last_clean":"2026-02-23T06:49:41.099249+0000","last_became_active":"2026-02-23T06:21:18.154271+0000","last_became_peered":"2026-02-23T06:21:18.154271+0000","last_unstale":"2026-02-23T06:49:41.099249+0000","last_undegraded":"2026-02-23T06:49:41.099249+0000","last_fullsized":"2026-02-23T06:49:41.099249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:34:53.495073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:48:19.512931+0000","last_change":"2026-02-23T06:21:17.144988+0000","last_active":"2026-02-23T06:48:19.512931+0000","last_peered":"2026-02-23T06:48:19.512931+0000","last_clean":"2026-02-23T06:48:19.512931+0000","last_became_active":"2026-02-23T06:21:17.144914+0000","last_became_peered":"2026-02-23T06:21:17.144914+0000","last_unstale":"2026-02-23T06:48:19.512931+0000","last_undegraded":"2026-02-23T06:48:19.512931+0000","last_fullsized":"2026-02-23T06:48:19.512931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:20:30.802189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'1694","reported_seq":1726,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.564313+0000","last_change":"2026-02-23T06:21:22.169035+0000","last_active":"2026-02-23T06:50:45.564313+0000","last_peered":"2026-02-23T06:50:45.564313+0000","last_clean":"2026-02-23T06:50:45.564313+0000","last_became_active":"2026-02-23T06:21:22.168516+0000","last_became_peered":"2026-02-23T06:21:22.168516+0000","last_unstale":"2026-02-23T06:50:45.564313+0000","last_undegraded":"2026-02-23T06:50:45.564313+0000","last_fullsized":"2026-02-23T06:50:45.564313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1694,"log_dups_size":0,"ondisk_log_size":1694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:53:53.761208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20934,"num_write_kb":1166144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'13","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.848111+0000","last_change":"2026-02-23T06:21:18.152543+0000","last_active":"2026-02-23T06:50:43.848111+0000","last_peered":"2026-02-23T06:50:43.848111+0000","last_clean":"2026-02-23T06:50:43.848111+0000","last_became_active":"2026-02-23T06:21:18.152381+0000","last_became_peered":"2026-02-23T06:21:18.152381+0000","last_unstale":"2026-02-23T06:50:43.848111+0000","last_undegraded":"2026-02-23T06:50:43.848111+0000","last_fullsized":"2026-02-23T06:50:43.848111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:20:11.159653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'13","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.084190+0000","last_change":"2026-02-23T06:21:17.137277+0000","last_active":"2026-02-23T06:49:41.084190+0000","last_peered":"2026-02-23T06:49:41.084190+0000","last_clean":"2026-02-23T06:49:41.084190+0000","last_became_active":"2026-02-23T06:21:17.137101+0000","last_became_peered":"2026-02-23T06:21:17.137101+0000","last_unstale":"2026-02-23T06:49:41.084190+0000","last_undegraded":"2026-02-23T06:49:41.084190+0000","last_fullsized":"2026-02-23T06:49:41.084190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:26:19.732037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'2316","reported_seq":2347,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.497983+0000","last_change":"2026-02-23T06:21:22.168965+0000","last_active":"2026-02-23T06:50:45.497983+0000","last_peered":"2026-02-23T06:50:45.497983+0000","last_clean":"2026-02-23T06:50:45.497983+0000","last_became_active":"2026-02-23T06:21:22.168603+0000","last_became_peered":"2026-02-23T06:21:22.168603+0000","last_unstale":"2026-02-23T06:50:45.497983+0000","last_undegraded":"2026-02-23T06:50:45.497983+0000","last_fullsized":"2026-02-23T06:50:45.497983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2316,"log_dups_size":0,"ondisk_log_size":2316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:15:47.100236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30296,"num_write_kb":1393408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'11","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.111681+0000","last_change":"2026-02-23T06:21:18.143842+0000","last_active":"2026-02-23T06:49:41.111681+0000","last_peered":"2026-02-23T06:49:41.111681+0000","last_clean":"2026-02-23T06:49:41.111681+0000","last_became_active":"2026-02-23T06:21:18.143002+0000","last_became_peered":"2026-02-23T06:21:18.143002+0000","last_unstale":"2026-02-23T06:49:41.111681+0000","last_undegraded":"2026-02-23T06:49:41.111681+0000","last_fullsized":"2026-02-23T06:49:41.111681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:04:36.461970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'3","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:46:59.508058+0000","last_change":"2026-02-23T06:21:17.143842+0000","last_active":"2026-02-23T06:46:59.508058+0000","last_peered":"2026-02-23T06:46:59.508058+0000","last_clean":"2026-02-23T06:46:59.508058+0000","last_became_active":"2026-02-23T06:21:17.143700+0000","last_became_peered":"2026-02-23T06:21:17.143700+0000","last_unstale":"2026-02-23T06:46:59.508058+0000","last_undegraded":"2026-02-23T06:46:59.508058+0000","last_fullsized":"2026-02-23T06:46:59.508058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:14:07.166043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'2127","reported_seq":2158,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.581277+0000","last_change":"2026-02-23T06:21:22.168834+0000","last_active":"2026-02-23T06:50:45.581277+0000","last_peered":"2026-02-23T06:50:45.581277+0000","last_clean":"2026-02-23T06:50:45.581277+0000","last_became_active":"2026-02-23T06:21:22.168593+0000","last_became_peered":"2026-02-23T06:21:22.168593+0000","last_unstale":"2026-02-23T06:50:45.581277+0000","last_undegraded":"2026-02-23T06:50:45.581277+0000","last_fullsized":"2026-02-23T06:50:45.581277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2127,"log_dups_size":0,"ondisk_log_size":2127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:15:01.999978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27189,"num_write_kb":1335474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'17","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.119990+0000","last_change":"2026-02-23T06:21:18.155135+0000","last_active":"2026-02-23T06:49:41.119990+0000","last_peered":"2026-02-23T06:49:41.119990+0000","last_clean":"2026-02-23T06:49:41.119990+0000","last_became_active":"2026-02-23T06:21:18.155022+0000","last_became_peered":"2026-02-23T06:21:18.155022+0000","last_unstale":"2026-02-23T06:49:41.119990+0000","last_undegraded":"2026-02-23T06:49:41.119990+0000","last_fullsized":"2026-02-23T06:49:41.119990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:50.396096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.090013+0000","last_change":"2026-02-23T06:21:17.144113+0000","last_active":"2026-02-23T06:49:41.090013+0000","last_peered":"2026-02-23T06:49:41.090013+0000","last_clean":"2026-02-23T06:49:41.090013+0000","last_became_active":"2026-02-23T06:21:17.144052+0000","last_became_peered":"2026-02-23T06:21:17.144052+0000","last_unstale":"2026-02-23T06:49:41.090013+0000","last_undegraded":"2026-02-23T06:49:41.090013+0000","last_fullsized":"2026-02-23T06:49:41.090013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:52:50.479411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'1770","reported_seq":1802,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.541361+0000","last_change":"2026-02-23T06:21:22.163712+0000","last_active":"2026-02-23T06:50:45.541361+0000","last_peered":"2026-02-23T06:50:45.541361+0000","last_clean":"2026-02-23T06:50:45.541361+0000","last_became_active":"2026-02-23T06:21:22.163563+0000","last_became_peered":"2026-02-23T06:21:22.163563+0000","last_unstale":"2026-02-23T06:50:45.541361+0000","last_undegraded":"2026-02-23T06:50:45.541361+0000","last_fullsized":"2026-02-23T06:50:45.541361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1770,"log_dups_size":0,"ondisk_log_size":1770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:58:44.301443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1,"num_read_kb":3,"num_write":22555,"num_write_kb":1140198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.036485+0000","last_change":"2026-02-23T06:21:18.152736+0000","last_active":"2026-02-23T06:49:41.036485+0000","last_peered":"2026-02-23T06:49:41.036485+0000","last_clean":"2026-02-23T06:49:41.036485+0000","last_became_active":"2026-02-23T06:21:18.152627+0000","last_became_peered":"2026-02-23T06:21:18.152627+0000","last_unstale":"2026-02-23T06:49:41.036485+0000","last_undegraded":"2026-02-23T06:49:41.036485+0000","last_fullsized":"2026-02-23T06:49:41.036485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:26:04.233805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'3","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:19.440107+0000","last_change":"2026-02-23T06:21:17.144924+0000","last_active":"2026-02-23T06:49:19.440107+0000","last_peered":"2026-02-23T06:49:19.440107+0000","last_clean":"2026-02-23T06:49:19.440107+0000","last_became_active":"2026-02-23T06:21:17.144847+0000","last_became_peered":"2026-02-23T06:21:17.144847+0000","last_unstale":"2026-02-23T06:49:19.440107+0000","last_undegraded":"2026-02-23T06:49:19.440107+0000","last_fullsized":"2026-02-23T06:49:19.440107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:09:16.703922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'2203","reported_seq":2234,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.562001+0000","last_change":"2026-02-23T06:21:22.164167+0000","last_active":"2026-02-23T06:50:45.562001+0000","last_peered":"2026-02-23T06:50:45.562001+0000","last_clean":"2026-02-23T06:50:45.562001+0000","last_became_active":"2026-02-23T06:21:22.164057+0000","last_became_peered":"2026-02-23T06:21:22.164057+0000","last_unstale":"2026-02-23T06:50:45.562001+0000","last_undegraded":"2026-02-23T06:50:45.562001+0000","last_fullsized":"2026-02-23T06:50:45.562001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2203,"log_dups_size":0,"ondisk_log_size":2203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:19:45.888728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27835,"num_write_kb":1432250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:19.521394+0000","last_change":"2026-02-23T06:21:18.148382+0000","last_active":"2026-02-23T06:50:19.521394+0000","last_peered":"2026-02-23T06:50:19.521394+0000","last_clean":"2026-02-23T06:50:19.521394+0000","last_became_active":"2026-02-23T06:21:18.147826+0000","last_became_peered":"2026-02-23T06:21:18.147826+0000","last_unstale":"2026-02-23T06:50:19.521394+0000","last_undegraded":"2026-02-23T06:50:19.521394+0000","last_fullsized":"2026-02-23T06:50:19.521394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:52:32.524186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'302","reported_seq":341,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:28.198411+0000","last_change":"2026-02-23T06:21:17.151131+0000","last_active":"2026-02-23T06:50:28.198411+0000","last_peered":"2026-02-23T06:50:28.198411+0000","last_clean":"2026-02-23T06:50:28.198411+0000","last_became_active":"2026-02-23T06:21:17.151030+0000","last_became_peered":"2026-02-23T06:21:17.151030+0000","last_unstale":"2026-02-23T06:50:28.198411+0000","last_undegraded":"2026-02-23T06:50:28.198411+0000","last_fullsized":"2026-02-23T06:50:28.198411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:19:57.049773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194998,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299,"num_write_kb":4303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'1451","reported_seq":1482,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.581521+0000","last_change":"2026-02-23T06:21:22.165171+0000","last_active":"2026-02-23T06:50:45.581521+0000","last_peered":"2026-02-23T06:50:45.581521+0000","last_clean":"2026-02-23T06:50:45.581521+0000","last_became_active":"2026-02-23T06:21:22.164972+0000","last_became_peered":"2026-02-23T06:21:22.164972+0000","last_unstale":"2026-02-23T06:50:45.581521+0000","last_undegraded":"2026-02-23T06:50:45.581521+0000","last_fullsized":"2026-02-23T06:50:45.581521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1451,"log_dups_size":0,"ondisk_log_size":1451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:58:26.519641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17009,"num_write_kb":1082863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:14.074409+0000","last_change":"2026-02-23T06:21:18.153296+0000","last_active":"2026-02-23T06:50:14.074409+0000","last_peered":"2026-02-23T06:50:14.074409+0000","last_clean":"2026-02-23T06:50:14.074409+0000","last_became_active":"2026-02-23T06:21:18.153052+0000","last_became_peered":"2026-02-23T06:21:18.153052+0000","last_unstale":"2026-02-23T06:50:14.074409+0000","last_undegraded":"2026-02-23T06:50:14.074409+0000","last_fullsized":"2026-02-23T06:50:14.074409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:38:32.662334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'20","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:34.102331+0000","last_change":"2026-02-23T06:21:17.137568+0000","last_active":"2026-02-23T06:50:34.102331+0000","last_peered":"2026-02-23T06:50:34.102331+0000","last_clean":"2026-02-23T06:50:34.102331+0000","last_became_active":"2026-02-23T06:21:17.137479+0000","last_became_peered":"2026-02-23T06:21:17.137479+0000","last_unstale":"2026-02-23T06:50:34.102331+0000","last_undegraded":"2026-02-23T06:50:34.102331+0000","last_fullsized":"2026-02-23T06:50:34.102331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:50:22.850887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'2249","reported_seq":2280,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.574206+0000","last_change":"2026-02-23T06:21:22.175837+0000","last_active":"2026-02-23T06:50:45.574206+0000","last_peered":"2026-02-23T06:50:45.574206+0000","last_clean":"2026-02-23T06:50:45.574206+0000","last_became_active":"2026-02-23T06:21:22.175638+0000","last_became_peered":"2026-02-23T06:21:22.175638+0000","last_unstale":"2026-02-23T06:50:45.574206+0000","last_undegraded":"2026-02-23T06:50:45.574206+0000","last_fullsized":"2026-02-23T06:50:45.574206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2249,"log_dups_size":0,"ondisk_log_size":2249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:24:39.312650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28921,"num_write_kb":1359033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'14","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:42.202491+0000","last_change":"2026-02-23T06:21:18.155473+0000","last_active":"2026-02-23T06:50:42.202491+0000","last_peered":"2026-02-23T06:50:42.202491+0000","last_clean":"2026-02-23T06:50:42.202491+0000","last_became_active":"2026-02-23T06:21:18.155349+0000","last_became_peered":"2026-02-23T06:21:18.155349+0000","last_unstale":"2026-02-23T06:50:42.202491+0000","last_undegraded":"2026-02-23T06:50:42.202491+0000","last_fullsized":"2026-02-23T06:50:42.202491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:20:20.345986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'1","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.093368+0000","last_change":"2026-02-23T06:21:17.148953+0000","last_active":"2026-02-23T06:49:41.093368+0000","last_peered":"2026-02-23T06:49:41.093368+0000","last_clean":"2026-02-23T06:49:41.093368+0000","last_became_active":"2026-02-23T06:21:17.148841+0000","last_became_peered":"2026-02-23T06:21:17.148841+0000","last_unstale":"2026-02-23T06:49:41.093368+0000","last_undegraded":"2026-02-23T06:49:41.093368+0000","last_fullsized":"2026-02-23T06:49:41.093368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:48:14.620108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'1724","reported_seq":1755,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.552172+0000","last_change":"2026-02-23T06:21:22.172897+0000","last_active":"2026-02-23T06:50:45.552172+0000","last_peered":"2026-02-23T06:50:45.552172+0000","last_clean":"2026-02-23T06:50:45.552172+0000","last_became_active":"2026-02-23T06:21:22.172683+0000","last_became_peered":"2026-02-23T06:21:22.172683+0000","last_unstale":"2026-02-23T06:50:45.552172+0000","last_undegraded":"2026-02-23T06:50:45.552172+0000","last_fullsized":"2026-02-23T06:50:45.552172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1724,"log_dups_size":0,"ondisk_log_size":1724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:17:41.991286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21477,"num_write_kb":1135952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'12","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.143594+0000","last_change":"2026-02-23T06:21:18.154897+0000","last_active":"2026-02-23T06:50:43.143594+0000","last_peered":"2026-02-23T06:50:43.143594+0000","last_clean":"2026-02-23T06:50:43.143594+0000","last_became_active":"2026-02-23T06:21:18.154586+0000","last_became_peered":"2026-02-23T06:21:18.154586+0000","last_unstale":"2026-02-23T06:50:43.143594+0000","last_undegraded":"2026-02-23T06:50:43.143594+0000","last_fullsized":"2026-02-23T06:50:43.143594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:22:13.361673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.033236+0000","last_change":"2026-02-23T06:21:17.140774+0000","last_active":"2026-02-23T06:49:41.033236+0000","last_peered":"2026-02-23T06:49:41.033236+0000","last_clean":"2026-02-23T06:49:41.033236+0000","last_became_active":"2026-02-23T06:21:17.140699+0000","last_became_peered":"2026-02-23T06:21:17.140699+0000","last_unstale":"2026-02-23T06:49:41.033236+0000","last_undegraded":"2026-02-23T06:49:41.033236+0000","last_fullsized":"2026-02-23T06:49:41.033236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:59:47.987932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'1855","reported_seq":1886,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.517289+0000","last_change":"2026-02-23T06:21:22.166371+0000","last_active":"2026-02-23T06:50:45.517289+0000","last_peered":"2026-02-23T06:50:45.517289+0000","last_clean":"2026-02-23T06:50:45.517289+0000","last_became_active":"2026-02-23T06:21:22.166204+0000","last_became_peered":"2026-02-23T06:21:22.166204+0000","last_unstale":"2026-02-23T06:50:45.517289+0000","last_undegraded":"2026-02-23T06:50:45.517289+0000","last_fullsized":"2026-02-23T06:50:45.517289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1855,"log_dups_size":0,"ondisk_log_size":1855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:50:51.116428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23435,"num_write_kb":1201520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'1867","reported_seq":1901,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.548532+0000","last_change":"2026-02-23T06:21:22.167411+0000","last_active":"2026-02-23T06:50:45.548532+0000","last_peered":"2026-02-23T06:50:45.548532+0000","last_clean":"2026-02-23T06:50:45.548532+0000","last_became_active":"2026-02-23T06:21:22.167217+0000","last_became_peered":"2026-02-23T06:21:22.167217+0000","last_unstale":"2026-02-23T06:50:45.548532+0000","last_undegraded":"2026-02-23T06:50:45.548532+0000","last_fullsized":"2026-02-23T06:50:45.548532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1867,"log_dups_size":0,"ondisk_log_size":1867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:20:54.687551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23697,"num_write_kb":1252431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:42.235822+0000","last_change":"2026-02-23T06:21:18.146043+0000","last_active":"2026-02-23T06:50:42.235822+0000","last_peered":"2026-02-23T06:50:42.235822+0000","last_clean":"2026-02-23T06:50:42.235822+0000","last_became_active":"2026-02-23T06:21:18.145938+0000","last_became_peered":"2026-02-23T06:21:18.145938+0000","last_unstale":"2026-02-23T06:50:42.235822+0000","last_undegraded":"2026-02-23T06:50:42.235822+0000","last_fullsized":"2026-02-23T06:50:42.235822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:03:21.252772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.039459+0000","last_change":"2026-02-23T06:21:17.149581+0000","last_active":"2026-02-23T06:49:41.039459+0000","last_peered":"2026-02-23T06:49:41.039459+0000","last_clean":"2026-02-23T06:49:41.039459+0000","last_became_active":"2026-02-23T06:21:17.149490+0000","last_became_peered":"2026-02-23T06:21:17.149490+0000","last_unstale":"2026-02-23T06:49:41.039459+0000","last_undegraded":"2026-02-23T06:49:41.039459+0000","last_fullsized":"2026-02-23T06:49:41.039459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:18:42.211307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'2152","reported_seq":2185,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.574313+0000","last_change":"2026-02-23T06:21:22.175655+0000","last_active":"2026-02-23T06:50:45.574313+0000","last_peered":"2026-02-23T06:50:45.574313+0000","last_clean":"2026-02-23T06:50:45.574313+0000","last_became_active":"2026-02-23T06:21:22.174906+0000","last_became_peered":"2026-02-23T06:21:22.174906+0000","last_unstale":"2026-02-23T06:50:45.574313+0000","last_undegraded":"2026-02-23T06:50:45.574313+0000","last_fullsized":"2026-02-23T06:50:45.574313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2152,"log_dups_size":0,"ondisk_log_size":2152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:50:34.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27270,"num_write_kb":1403073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'15","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:19.444217+0000","last_change":"2026-02-23T06:21:18.142560+0000","last_active":"2026-02-23T06:50:19.444217+0000","last_peered":"2026-02-23T06:50:19.444217+0000","last_clean":"2026-02-23T06:50:19.444217+0000","last_became_active":"2026-02-23T06:21:18.142325+0000","last_became_peered":"2026-02-23T06:21:18.142325+0000","last_unstale":"2026-02-23T06:50:19.444217+0000","last_undegraded":"2026-02-23T06:50:19.444217+0000","last_fullsized":"2026-02-23T06:50:19.444217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:45:44.641652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:47:59.433744+0000","last_change":"2026-02-23T06:21:17.146195+0000","last_active":"2026-02-23T06:47:59.433744+0000","last_peered":"2026-02-23T06:47:59.433744+0000","last_clean":"2026-02-23T06:47:59.433744+0000","last_became_active":"2026-02-23T06:21:17.146022+0000","last_became_peered":"2026-02-23T06:21:17.146022+0000","last_unstale":"2026-02-23T06:47:59.433744+0000","last_undegraded":"2026-02-23T06:47:59.433744+0000","last_fullsized":"2026-02-23T06:47:59.433744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:34:32.822540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.091157+0000","last_change":"2026-02-23T06:21:17.148590+0000","last_active":"2026-02-23T06:49:41.091157+0000","last_peered":"2026-02-23T06:49:41.091157+0000","last_clean":"2026-02-23T06:49:41.091157+0000","last_became_active":"2026-02-23T06:21:17.148417+0000","last_became_peered":"2026-02-23T06:21:17.148417+0000","last_unstale":"2026-02-23T06:49:41.091157+0000","last_undegraded":"2026-02-23T06:49:41.091157+0000","last_fullsized":"2026-02-23T06:49:41.091157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:21:11.877590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.050118+0000","last_change":"2026-02-23T06:21:18.152383+0000","last_active":"2026-02-23T06:49:41.050118+0000","last_peered":"2026-02-23T06:49:41.050118+0000","last_clean":"2026-02-23T06:49:41.050118+0000","last_became_active":"2026-02-23T06:21:18.152267+0000","last_became_peered":"2026-02-23T06:21:18.152267+0000","last_unstale":"2026-02-23T06:49:41.050118+0000","last_undegraded":"2026-02-23T06:49:41.050118+0000","last_fullsized":"2026-02-23T06:49:41.050118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:34:11.558509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'1670","reported_seq":1701,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.582047+0000","last_change":"2026-02-23T06:21:22.158812+0000","last_active":"2026-02-23T06:50:45.582047+0000","last_peered":"2026-02-23T06:50:45.582047+0000","last_clean":"2026-02-23T06:50:45.582047+0000","last_became_active":"2026-02-23T06:21:22.158607+0000","last_became_peered":"2026-02-23T06:21:22.158607+0000","last_unstale":"2026-02-23T06:50:45.582047+0000","last_undegraded":"2026-02-23T06:50:45.582047+0000","last_fullsized":"2026-02-23T06:50:45.582047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1670,"log_dups_size":0,"ondisk_log_size":1670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:59:07.000053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20239,"num_write_kb":1221270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1152","reported_seq":1190,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.044630+0000","last_change":"2026-02-23T06:21:17.138744+0000","last_active":"2026-02-23T06:49:41.044630+0000","last_peered":"2026-02-23T06:49:41.044630+0000","last_clean":"2026-02-23T06:49:41.044630+0000","last_became_active":"2026-02-23T06:21:17.138245+0000","last_became_peered":"2026-02-23T06:21:17.138245+0000","last_unstale":"2026-02-23T06:49:41.044630+0000","last_undegraded":"2026-02-23T06:49:41.044630+0000","last_fullsized":"2026-02-23T06:49:41.044630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1152,"log_dups_size":0,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:08:03.143401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1150,"num_write_kb":5073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'11","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:42.307472+0000","last_change":"2026-02-23T06:21:18.143640+0000","last_active":"2026-02-23T06:50:42.307472+0000","last_peered":"2026-02-23T06:50:42.307472+0000","last_clean":"2026-02-23T06:50:42.307472+0000","last_became_active":"2026-02-23T06:21:18.143550+0000","last_became_peered":"2026-02-23T06:21:18.143550+0000","last_unstale":"2026-02-23T06:50:42.307472+0000","last_undegraded":"2026-02-23T06:50:42.307472+0000","last_fullsized":"2026-02-23T06:50:42.307472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:11:40.394042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'1800","reported_seq":1831,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.534982+0000","last_change":"2026-02-23T06:21:22.169641+0000","last_active":"2026-02-23T06:50:45.534982+0000","last_peered":"2026-02-23T06:50:45.534982+0000","last_clean":"2026-02-23T06:50:45.534982+0000","last_became_active":"2026-02-23T06:21:22.169432+0000","last_became_peered":"2026-02-23T06:21:22.169432+0000","last_unstale":"2026-02-23T06:50:45.534982+0000","last_undegraded":"2026-02-23T06:50:45.534982+0000","last_fullsized":"2026-02-23T06:50:45.534982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1800,"log_dups_size":0,"ondisk_log_size":1800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:00:17.622113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23033,"num_write_kb":1131314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'13","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:29.625537+0000","last_change":"2026-02-23T06:21:18.143781+0000","last_active":"2026-02-23T06:50:29.625537+0000","last_peered":"2026-02-23T06:50:29.625537+0000","last_clean":"2026-02-23T06:50:29.625537+0000","last_became_active":"2026-02-23T06:21:18.143724+0000","last_became_peered":"2026-02-23T06:21:18.143724+0000","last_unstale":"2026-02-23T06:50:29.625537+0000","last_undegraded":"2026-02-23T06:50:29.625537+0000","last_fullsized":"2026-02-23T06:50:29.625537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:25:55.416021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'8","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:48:24.437036+0000","last_change":"2026-02-23T06:21:18.145425+0000","last_active":"2026-02-23T06:48:24.437036+0000","last_peered":"2026-02-23T06:48:24.437036+0000","last_clean":"2026-02-23T06:48:24.437036+0000","last_became_active":"2026-02-23T06:21:18.145325+0000","last_became_peered":"2026-02-23T06:21:18.145325+0000","last_unstale":"2026-02-23T06:48:24.437036+0000","last_undegraded":"2026-02-23T06:48:24.437036+0000","last_fullsized":"2026-02-23T06:48:24.437036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:55:31.700518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'15","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:29.500812+0000","last_change":"2026-02-23T06:21:18.150997+0000","last_active":"2026-02-23T06:50:29.500812+0000","last_peered":"2026-02-23T06:50:29.500812+0000","last_clean":"2026-02-23T06:50:29.500812+0000","last_became_active":"2026-02-23T06:21:18.150738+0000","last_became_peered":"2026-02-23T06:21:18.150738+0000","last_unstale":"2026-02-23T06:50:29.500812+0000","last_undegraded":"2026-02-23T06:50:29.500812+0000","last_fullsized":"2026-02-23T06:50:29.500812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:11:13.400669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'8","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:42.246163+0000","last_change":"2026-02-23T06:21:18.142305+0000","last_active":"2026-02-23T06:50:42.246163+0000","last_peered":"2026-02-23T06:50:42.246163+0000","last_clean":"2026-02-23T06:50:42.246163+0000","last_became_active":"2026-02-23T06:21:18.141484+0000","last_became_peered":"2026-02-23T06:21:18.141484+0000","last_unstale":"2026-02-23T06:50:42.246163+0000","last_undegraded":"2026-02-23T06:50:42.246163+0000","last_fullsized":"2026-02-23T06:50:42.246163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:12:36.003405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'10","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:42.171753+0000","last_change":"2026-02-23T06:21:18.148610+0000","last_active":"2026-02-23T06:50:42.171753+0000","last_peered":"2026-02-23T06:50:42.171753+0000","last_clean":"2026-02-23T06:50:42.171753+0000","last_became_active":"2026-02-23T06:21:18.148489+0000","last_became_peered":"2026-02-23T06:21:18.148489+0000","last_unstale":"2026-02-23T06:50:42.171753+0000","last_undegraded":"2026-02-23T06:50:42.171753+0000","last_fullsized":"2026-02-23T06:50:42.171753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:36:29.486147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.044709+0000","last_change":"2026-02-23T06:21:18.142438+0000","last_active":"2026-02-23T06:49:41.044709+0000","last_peered":"2026-02-23T06:49:41.044709+0000","last_clean":"2026-02-23T06:49:41.044709+0000","last_became_active":"2026-02-23T06:21:18.141854+0000","last_became_peered":"2026-02-23T06:21:18.141854+0000","last_unstale":"2026-02-23T06:49:41.044709+0000","last_undegraded":"2026-02-23T06:49:41.044709+0000","last_fullsized":"2026-02-23T06:49:41.044709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:23:35.379462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'12","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:41.378044+0000","last_change":"2026-02-23T06:21:18.153825+0000","last_active":"2026-02-23T06:50:41.378044+0000","last_peered":"2026-02-23T06:50:41.378044+0000","last_clean":"2026-02-23T06:50:41.378044+0000","last_became_active":"2026-02-23T06:21:18.153133+0000","last_became_peered":"2026-02-23T06:21:18.153133+0000","last_unstale":"2026-02-23T06:50:41.378044+0000","last_undegraded":"2026-02-23T06:50:41.378044+0000","last_fullsized":"2026-02-23T06:50:41.378044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:15:03.662362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'11","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:14.054874+0000","last_change":"2026-02-23T06:21:18.144945+0000","last_active":"2026-02-23T06:50:14.054874+0000","last_peered":"2026-02-23T06:50:14.054874+0000","last_clean":"2026-02-23T06:50:14.054874+0000","last_became_active":"2026-02-23T06:21:18.144832+0000","last_became_peered":"2026-02-23T06:21:18.144832+0000","last_unstale":"2026-02-23T06:50:14.054874+0000","last_undegraded":"2026-02-23T06:50:14.054874+0000","last_fullsized":"2026-02-23T06:50:14.054874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:41:07.968870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'13","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:41.106448+0000","last_change":"2026-02-23T06:21:18.150652+0000","last_active":"2026-02-23T06:50:41.106448+0000","last_peered":"2026-02-23T06:50:41.106448+0000","last_clean":"2026-02-23T06:50:41.106448+0000","last_became_active":"2026-02-23T06:21:18.150489+0000","last_became_peered":"2026-02-23T06:21:18.150489+0000","last_unstale":"2026-02-23T06:50:41.106448+0000","last_undegraded":"2026-02-23T06:50:41.106448+0000","last_fullsized":"2026-02-23T06:50:41.106448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:42:35.233149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'14","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.135455+0000","last_change":"2026-02-23T06:21:18.143636+0000","last_active":"2026-02-23T06:50:43.135455+0000","last_peered":"2026-02-23T06:50:43.135455+0000","last_clean":"2026-02-23T06:50:43.135455+0000","last_became_active":"2026-02-23T06:21:18.143495+0000","last_became_peered":"2026-02-23T06:21:18.143495+0000","last_unstale":"2026-02-23T06:50:43.135455+0000","last_undegraded":"2026-02-23T06:50:43.135455+0000","last_fullsized":"2026-02-23T06:50:43.135455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:47:19.057181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'11","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.064358+0000","last_change":"2026-02-23T06:21:18.148787+0000","last_active":"2026-02-23T06:49:41.064358+0000","last_peered":"2026-02-23T06:49:41.064358+0000","last_clean":"2026-02-23T06:49:41.064358+0000","last_became_active":"2026-02-23T06:21:18.148701+0000","last_became_peered":"2026-02-23T06:21:18.148701+0000","last_unstale":"2026-02-23T06:49:41.064358+0000","last_undegraded":"2026-02-23T06:49:41.064358+0000","last_fullsized":"2026-02-23T06:49:41.064358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:19:32.878202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'17","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.963539+0000","last_change":"2026-02-23T06:21:18.145498+0000","last_active":"2026-02-23T06:50:43.963539+0000","last_peered":"2026-02-23T06:50:43.963539+0000","last_clean":"2026-02-23T06:50:43.963539+0000","last_became_active":"2026-02-23T06:21:18.145346+0000","last_became_peered":"2026-02-23T06:21:18.145346+0000","last_unstale":"2026-02-23T06:50:43.963539+0000","last_undegraded":"2026-02-23T06:50:43.963539+0000","last_fullsized":"2026-02-23T06:50:43.963539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:44:15.203843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'13","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:34.522293+0000","last_change":"2026-02-23T06:21:18.147453+0000","last_active":"2026-02-23T06:50:34.522293+0000","last_peered":"2026-02-23T06:50:34.522293+0000","last_clean":"2026-02-23T06:50:34.522293+0000","last_became_active":"2026-02-23T06:21:18.147357+0000","last_became_peered":"2026-02-23T06:21:18.147357+0000","last_unstale":"2026-02-23T06:50:34.522293+0000","last_undegraded":"2026-02-23T06:50:34.522293+0000","last_fullsized":"2026-02-23T06:50:34.522293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:41:05.063786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'12","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.263261+0000","last_change":"2026-02-23T06:21:18.151381+0000","last_active":"2026-02-23T06:50:43.263261+0000","last_peered":"2026-02-23T06:50:43.263261+0000","last_clean":"2026-02-23T06:50:43.263261+0000","last_became_active":"2026-02-23T06:21:18.151269+0000","last_became_peered":"2026-02-23T06:21:18.151269+0000","last_unstale":"2026-02-23T06:50:43.263261+0000","last_undegraded":"2026-02-23T06:50:43.263261+0000","last_fullsized":"2026-02-23T06:50:43.263261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:50:46.152385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'18","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.826816+0000","last_change":"2026-02-23T06:21:18.148411+0000","last_active":"2026-02-23T06:50:43.826816+0000","last_peered":"2026-02-23T06:50:43.826816+0000","last_clean":"2026-02-23T06:50:43.826816+0000","last_became_active":"2026-02-23T06:21:18.148262+0000","last_became_peered":"2026-02-23T06:21:18.148262+0000","last_unstale":"2026-02-23T06:50:43.826816+0000","last_undegraded":"2026-02-23T06:50:43.826816+0000","last_fullsized":"2026-02-23T06:50:43.826816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:09:54.723244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:19.495112+0000","last_change":"2026-02-23T06:21:18.155275+0000","last_active":"2026-02-23T06:49:19.495112+0000","last_peered":"2026-02-23T06:49:19.495112+0000","last_clean":"2026-02-23T06:49:19.495112+0000","last_became_active":"2026-02-23T06:21:18.155214+0000","last_became_peered":"2026-02-23T06:21:18.155214+0000","last_unstale":"2026-02-23T06:49:19.495112+0000","last_undegraded":"2026-02-23T06:49:19.495112+0000","last_fullsized":"2026-02-23T06:49:19.495112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:44:47.367234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.659186+0000","last_change":"2026-02-23T06:21:18.153381+0000","last_active":"2026-02-23T06:50:43.659186+0000","last_peered":"2026-02-23T06:50:43.659186+0000","last_clean":"2026-02-23T06:50:43.659186+0000","last_became_active":"2026-02-23T06:21:18.152456+0000","last_became_peered":"2026-02-23T06:21:18.152456+0000","last_unstale":"2026-02-23T06:50:43.659186+0000","last_undegraded":"2026-02-23T06:50:43.659186+0000","last_fullsized":"2026-02-23T06:50:43.659186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:14:46.231331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'13","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:19.054621+0000","last_change":"2026-02-23T06:21:18.148599+0000","last_active":"2026-02-23T06:50:19.054621+0000","last_peered":"2026-02-23T06:50:19.054621+0000","last_clean":"2026-02-23T06:50:19.054621+0000","last_became_active":"2026-02-23T06:21:18.148498+0000","last_became_peered":"2026-02-23T06:21:18.148498+0000","last_unstale":"2026-02-23T06:50:19.054621+0000","last_undegraded":"2026-02-23T06:50:19.054621+0000","last_fullsized":"2026-02-23T06:50:19.054621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:05:56.074928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'14","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:14.132776+0000","last_change":"2026-02-23T06:21:18.142621+0000","last_active":"2026-02-23T06:50:14.132776+0000","last_peered":"2026-02-23T06:50:14.132776+0000","last_clean":"2026-02-23T06:50:14.132776+0000","last_became_active":"2026-02-23T06:21:18.141938+0000","last_became_peered":"2026-02-23T06:21:18.141938+0000","last_unstale":"2026-02-23T06:50:14.132776+0000","last_undegraded":"2026-02-23T06:50:14.132776+0000","last_fullsized":"2026-02-23T06:50:14.132776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:25:55.390738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'14","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:44.625290+0000","last_change":"2026-02-23T06:21:18.153183+0000","last_active":"2026-02-23T06:50:44.625290+0000","last_peered":"2026-02-23T06:50:44.625290+0000","last_clean":"2026-02-23T06:50:44.625290+0000","last_became_active":"2026-02-23T06:21:18.153090+0000","last_became_peered":"2026-02-23T06:21:18.153090+0000","last_unstale":"2026-02-23T06:50:44.625290+0000","last_undegraded":"2026-02-23T06:50:44.625290+0000","last_fullsized":"2026-02-23T06:50:44.625290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:26:17.749612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:19.521373+0000","last_change":"2026-02-23T06:21:18.148055+0000","last_active":"2026-02-23T06:50:19.521373+0000","last_peered":"2026-02-23T06:50:19.521373+0000","last_clean":"2026-02-23T06:50:19.521373+0000","last_became_active":"2026-02-23T06:21:18.147956+0000","last_became_peered":"2026-02-23T06:21:18.147956+0000","last_unstale":"2026-02-23T06:50:19.521373+0000","last_undegraded":"2026-02-23T06:50:19.521373+0000","last_fullsized":"2026-02-23T06:50:19.521373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:22:55.028859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'12","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:19.521388+0000","last_change":"2026-02-23T06:21:18.155576+0000","last_active":"2026-02-23T06:50:19.521388+0000","last_peered":"2026-02-23T06:50:19.521388+0000","last_clean":"2026-02-23T06:50:19.521388+0000","last_became_active":"2026-02-23T06:21:18.155130+0000","last_became_peered":"2026-02-23T06:21:18.155130+0000","last_unstale":"2026-02-23T06:50:19.521388+0000","last_undegraded":"2026-02-23T06:50:19.521388+0000","last_fullsized":"2026-02-23T06:50:19.521388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:43:12.801427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'12","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.108444+0000","last_change":"2026-02-23T06:21:18.152980+0000","last_active":"2026-02-23T06:49:41.108444+0000","last_peered":"2026-02-23T06:49:41.108444+0000","last_clean":"2026-02-23T06:49:41.108444+0000","last_became_active":"2026-02-23T06:21:18.152790+0000","last_became_peered":"2026-02-23T06:21:18.152790+0000","last_unstale":"2026-02-23T06:49:41.108444+0000","last_undegraded":"2026-02-23T06:49:41.108444+0000","last_fullsized":"2026-02-23T06:49:41.108444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:33:09.398040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'9","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:24.508958+0000","last_change":"2026-02-23T06:21:18.155247+0000","last_active":"2026-02-23T06:50:24.508958+0000","last_peered":"2026-02-23T06:50:24.508958+0000","last_clean":"2026-02-23T06:50:24.508958+0000","last_became_active":"2026-02-23T06:21:18.155122+0000","last_became_peered":"2026-02-23T06:21:18.155122+0000","last_unstale":"2026-02-23T06:50:24.508958+0000","last_undegraded":"2026-02-23T06:50:24.508958+0000","last_fullsized":"2026-02-23T06:50:24.508958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:45:08.775934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'4","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.568725+0000","last_change":"2026-02-23T06:21:18.151259+0000","last_active":"2026-02-23T06:50:45.568725+0000","last_peered":"2026-02-23T06:50:45.568725+0000","last_clean":"2026-02-23T06:50:45.568725+0000","last_became_active":"2026-02-23T06:21:18.151151+0000","last_became_peered":"2026-02-23T06:21:18.151151+0000","last_unstale":"2026-02-23T06:50:45.568725+0000","last_undegraded":"2026-02-23T06:50:45.568725+0000","last_fullsized":"2026-02-23T06:50:45.568725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:08:03.361054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'7","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.094234+0000","last_change":"2026-02-23T06:21:18.146606+0000","last_active":"2026-02-23T06:49:41.094234+0000","last_peered":"2026-02-23T06:49:41.094234+0000","last_clean":"2026-02-23T06:49:41.094234+0000","last_became_active":"2026-02-23T06:21:18.146527+0000","last_became_peered":"2026-02-23T06:21:18.146527+0000","last_unstale":"2026-02-23T06:49:41.094234+0000","last_undegraded":"2026-02-23T06:49:41.094234+0000","last_fullsized":"2026-02-23T06:49:41.094234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:30:44.739034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.052849+0000","last_change":"2026-02-23T06:21:18.145872+0000","last_active":"2026-02-23T06:49:41.052849+0000","last_peered":"2026-02-23T06:49:41.052849+0000","last_clean":"2026-02-23T06:49:41.052849+0000","last_became_active":"2026-02-23T06:21:18.145770+0000","last_became_peered":"2026-02-23T06:21:18.145770+0000","last_unstale":"2026-02-23T06:49:41.052849+0000","last_undegraded":"2026-02-23T06:49:41.052849+0000","last_fullsized":"2026-02-23T06:49:41.052849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:21:28.063960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'12","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:44.613087+0000","last_change":"2026-02-23T06:21:18.152478+0000","last_active":"2026-02-23T06:50:44.613087+0000","last_peered":"2026-02-23T06:50:44.613087+0000","last_clean":"2026-02-23T06:50:44.613087+0000","last_became_active":"2026-02-23T06:21:18.151948+0000","last_became_peered":"2026-02-23T06:21:18.151948+0000","last_unstale":"2026-02-23T06:50:44.613087+0000","last_undegraded":"2026-02-23T06:50:44.613087+0000","last_fullsized":"2026-02-23T06:50:44.613087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:58:02.829593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'5","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:19.620285+0000","last_change":"2026-02-23T06:21:18.144778+0000","last_active":"2026-02-23T06:49:19.620285+0000","last_peered":"2026-02-23T06:49:19.620285+0000","last_clean":"2026-02-23T06:49:19.620285+0000","last_became_active":"2026-02-23T06:21:18.144346+0000","last_became_peered":"2026-02-23T06:21:18.144346+0000","last_unstale":"2026-02-23T06:49:19.620285+0000","last_undegraded":"2026-02-23T06:49:19.620285+0000","last_fullsized":"2026-02-23T06:49:19.620285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:25:27.650673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'10","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:41.065242+0000","last_change":"2026-02-23T06:21:18.141648+0000","last_active":"2026-02-23T06:50:41.065242+0000","last_peered":"2026-02-23T06:50:41.065242+0000","last_clean":"2026-02-23T06:50:41.065242+0000","last_became_active":"2026-02-23T06:21:18.141449+0000","last_became_peered":"2026-02-23T06:21:18.141449+0000","last_unstale":"2026-02-23T06:50:41.065242+0000","last_undegraded":"2026-02-23T06:50:41.065242+0000","last_fullsized":"2026-02-23T06:50:41.065242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:33:18.986892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.059906+0000","last_change":"2026-02-23T06:21:18.142536+0000","last_active":"2026-02-23T06:49:41.059906+0000","last_peered":"2026-02-23T06:49:41.059906+0000","last_clean":"2026-02-23T06:49:41.059906+0000","last_became_active":"2026-02-23T06:21:18.142359+0000","last_became_peered":"2026-02-23T06:21:18.142359+0000","last_unstale":"2026-02-23T06:49:41.059906+0000","last_undegraded":"2026-02-23T06:49:41.059906+0000","last_fullsized":"2026-02-23T06:49:41.059906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:54:09.503227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'8","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:29.522014+0000","last_change":"2026-02-23T06:21:18.156667+0000","last_active":"2026-02-23T06:50:29.522014+0000","last_peered":"2026-02-23T06:50:29.522014+0000","last_clean":"2026-02-23T06:50:29.522014+0000","last_became_active":"2026-02-23T06:21:18.156564+0000","last_became_peered":"2026-02-23T06:21:18.156564+0000","last_unstale":"2026-02-23T06:50:29.522014+0000","last_undegraded":"2026-02-23T06:50:29.522014+0000","last_fullsized":"2026-02-23T06:50:29.522014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:11:13.967668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3565158400,"num_objects":850,"num_object_clones":0,"num_object_copies":3400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":850,"num_whiteouts":0,"num_read":1,"num_read_kb":3,"num_write":756886,"num_write_kb":39381923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1713389568,"data_stored":7130316800,"data_compressed":418887520,"data_compressed_allocated":1014562816,"data_compressed_original":6431490048,"omap_allocated":0,"internal_metadata":0},"log_size":60070,"ondisk_log_size":60070,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":687,"ondisk_log_size":687,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":13232698,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":30,"num_read_kb":99,"num_write":2238,"num_write_kb":14657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13828096,"data_stored":26465396,"data_compressed":2652502,"data_compressed_allocated":3489792,"data_compressed_original":16187392,"omap_allocated":629893,"internal_metadata":0},"log_size":2092,"ondisk_log_size":2092,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70172,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575216,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":519516,"kb_used_data":257996,"kb_used_omap":128,"kb_used_meta":261375,"kb_avail":93852324,"statfs":{"total":96636764160,"available":96104779776,"internally_reserved":0,"allocated":264187904,"data_stored":1087033247,"data_compressed":63788459,"data_compressed_allocated":155418624,"data_compressed_original":978444288,"omap_allocated":131483,"internal_metadata":267648613},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575217,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":496264,"kb_used_data":234744,"kb_used_omap":20,"kb_used_meta":261483,"kb_avail":93875576,"statfs":{"total":96636764160,"available":96128589824,"internally_reserved":0,"allocated":240377856,"data_stored":1015218693,"data_compressed":59697398,"data_compressed_allocated":143745024,"data_compressed_original":918769664,"omap_allocated":20978,"internal_metadata":267759118},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575218,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":454856,"kb_used_data":229432,"kb_used_omap":17,"kb_used_meta":225390,"kb_avail":93916984,"statfs":{"total":96636764160,"available":96170991616,"internally_reserved":0,"allocated":234938368,"data_stored":966905145,"data_compressed":56345986,"data_compressed_allocated":135413760,"data_compressed_original":867553280,"omap_allocated":17420,"internal_metadata":230800372},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575219,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":406156,"kb_used_data":198780,"kb_used_omap":43,"kb_used_meta":207316,"kb_avail":93965684,"statfs":{"total":96636764160,"available":96220860416,"internally_reserved":0,"allocated":203550720,"data_stored":845939717,"data_compressed":49159380,"data_compressed_allocated":117428224,"data_compressed_original":760004608,"omap_allocated":44556,"internal_metadata":212292084},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575218,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":398512,"kb_used_data":191136,"kb_used_omap":238,"kb_used_meta":207121,"kb_avail":93973328,"statfs":{"total":96636764160,"available":96228687872,"internally_reserved":0,"allocated":195723264,"data_stored":805995173,"data_compressed":47782846,"data_compressed_allocated":115453952,"data_compressed_original":725913600,"omap_allocated":243898,"internal_metadata":212092742},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575217,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":513096,"kb_used_data":251576,"kb_used_omap":48,"kb_used_meta":261455,"kb_avail":93858744,"statfs":{"total":96636764160,"available":96111353856,"internally_reserved":0,"allocated":257613824,"data_stored":1063944085,"data_compressed":62960251,"data_compressed_allocated":152305664,"data_compressed_original":958812160,"omap_allocated":49901,"internal_metadata":267730195},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575216,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":377884,"kb_used_data":188556,"kb_used_omap":16,"kb_used_meta":189295,"kb_avail":93993956,"statfs":{"total":96636764160,"available":96249810944,"internally_reserved":0,"allocated":193081344,"data_stored":794939375,"data_compressed":47425382,"data_compressed_allocated":114155520,"data_compressed_original":716193792,"omap_allocated":16904,"internal_metadata":193838584},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575216,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308196,"kb_used_data":136916,"kb_used_omap":192,"kb_used_meta":171071,"kb_avail":94063644,"statfs":{"total":96636764160,"available":96321171456,"internally_reserved":0,"allocated":140201984,"data_stored":578932081,"data_compressed":34450492,"data_compressed_allocated":84221952,"data_compressed_original":523132928,"omap_allocated":197353,"internal_metadata":175176983},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":177910,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":126753,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3362816,"data_stored":8389302,"data_compressed":1069508,"data_compressed_allocated":1413120,"data_compressed_original":6447104,"omap_allocated":8580,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1941504,"data_stored":4764252,"data_compressed":535205,"data_compressed_allocated":708608,"data_compressed_original":3534848,"omap_allocated":32915,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1777664,"data_stored":4765036,"data_compressed":679663,"data_compressed_allocated":884736,"data_compressed_original":3887104,"omap_allocated":232920,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3366912,"data_stored":4273324,"data_compressed":184063,"data_compressed_allocated":241664,"data_compressed_original":1159168,"omap_allocated":36527,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3284992,"data_stored":4194304,"data_compressed":181645,"data_compressed_allocated":237568,"data_compressed_original":1146880,"omap_allocated":4760,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":79052,"data_compressed":2418,"data_compressed_allocated":4096,"data_compressed_original":12288,"omap_allocated":9528,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":139902976,"data_stored":578813952,"data_compressed":34450492,"data_compressed_allocated":84221952,"data_compressed_original":523132928,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":263827456,"data_stored":1086324736,"data_compressed":63753373,"data_compressed_allocated":155373568,"data_compressed_original":977870848,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":189427712,"data_stored":786432000,"data_compressed":46355874,"data_compressed_allocated":112742400,"data_compressed_original":709746688,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":255381504,"data_stored":1059061760,"data_compressed":62425046,"data_compressed_allocated":151597056,"data_compressed_original":955277312,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":193654784,"data_stored":801112064,"data_compressed":47103183,"data_compressed_allocated":114569216,"data_compressed_original":722026496,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":199827456,"data_stored":840957952,"data_compressed":48940231,"data_compressed_allocated":117141504,"data_compressed_original":758272000,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":231362560,"data_stored":962592768,"data_compressed":56164341,"data_compressed_allocated":135176192,"data_compressed_original":866406400,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":240005120,"data_stored":1015021568,"data_compressed":59694980,"data_compressed_allocated":143740928,"data_compressed_original":918757376,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T06:51:40.010 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-23T06:51:40.011 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-23T06:51:40.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.169+0000 7f82a7683640 1 -- 10.20.193.58:0/380174024 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f82a00b6690 msgr2=0x7f82a0058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:40.164 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.169+0000 7f82a7683640 1 --2- 10.20.193.58:0/380174024 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f82a00b6690 0x7f82a0058cf0 secure :-1 s=READY pgs=160 gs=2 cs=0 l=1 c_cookie=1785269465569297159 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82a0059740 tx=0x7f8294030340 comp rx=0 tx=0).stop 2026-02-23T06:51:40.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.169+0000 7f82a7683640 1 -- 10.20.193.58:0/380174024 shutdown_connections 2026-02-23T06:51:40.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.169+0000 7f82a7683640 1 --2- 10.20.193.58:0/380174024 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f82a00b6690 0x7f82a0058cf0 unknown :-1 s=CLOSED pgs=160 gs=2 cs=0 l=1 c_cookie=1785269465569297159 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:40.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.169+0000 7f82a7683640 1 --2- 10.20.193.58:0/380174024 >> v2:10.20.193.93:3300/0 conn(0x7f82a015d870 0x7f82a00587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:40.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.169+0000 7f82a7683640 1 -- 10.20.193.58:0/380174024 >> 10.20.193.58:0/380174024 conn(0x7f82a00b3c20 msgr2=0x7f82a00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:40.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.169+0000 7f82a7683640 1 -- 10.20.193.58:0/380174024 shutdown_connections 2026-02-23T06:51:40.165 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.169+0000 7f82a7683640 1 -- 10.20.193.58:0/380174024 wait complete. 2026-02-23T06:51:40.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.170+0000 7f82a7683640 1 Processor -- start 2026-02-23T06:51:40.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.170+0000 7f82a7683640 1 -- start start 2026-02-23T06:51:40.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.170+0000 7f82a7683640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f82a00b6690 0x7f82a0127060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:40.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.170+0000 7f82a7683640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f82a015d4a0 0x7f82a0056870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:40.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.170+0000 7f82a7683640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f82a015d870 0x7f82a0056db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:40.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.170+0000 7f82a7683640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f82a00582a0 con 0x7f82a00b6690 2026-02-23T06:51:40.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.170+0000 7f82a7683640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f82a0162590 con 0x7f82a015d870 2026-02-23T06:51:40.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.170+0000 7f82a7683640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f82a0057480 con 0x7f82a015d4a0 2026-02-23T06:51:40.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.171+0000 7f82a6681640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f82a00b6690 0x7f82a0127060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:40.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.171+0000 7f82a6681640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f82a00b6690 0x7f82a0127060 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50124/0 (socket says 10.20.193.58:50124) 2026-02-23T06:51:40.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.171+0000 7f82a6681640 1 -- 10.20.193.58:0/679094000 learned_addr learned my addr 10.20.193.58:0/679094000 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:51:40.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.171+0000 7f82a6681640 1 -- 10.20.193.58:0/679094000 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f82a015d4a0 msgr2=0x7f82a0056870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:40.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.171+0000 7f82a6681640 1 --2- 10.20.193.58:0/679094000 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f82a015d4a0 0x7f82a0056870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:40.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.171+0000 7f82a6681640 1 -- 10.20.193.58:0/679094000 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f82a015d870 msgr2=0x7f82a0056db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:40.168 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.171+0000 7f82a6681640 1 --2- 10.20.193.58:0/679094000 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f82a015d870 0x7f82a0056db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:40.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.171+0000 7f82a6681640 1 -- 10.20.193.58:0/679094000 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f829400a650 con 0x7f82a00b6690 2026-02-23T06:51:40.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.171+0000 7f82a6681640 1 --2- 10.20.193.58:0/679094000 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f82a00b6690 0x7f82a0127060 secure :-1 s=READY pgs=161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f829800c480 tx=0x7f829800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:40.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.171+0000 7f828affd640 1 -- 10.20.193.58:0/679094000 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8298006ab0 con 0x7f82a00b6690 2026-02-23T06:51:40.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.171+0000 7f828affd640 1 -- 10.20.193.58:0/679094000 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8298006d00 con 0x7f82a00b6690 2026-02-23T06:51:40.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.171+0000 7f828affd640 1 -- 10.20.193.58:0/679094000 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82980072b0 con 0x7f82a00b6690 2026-02-23T06:51:40.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.171+0000 7f82a7683640 1 -- 10.20.193.58:0/679094000 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82a0057720 con 0x7f82a00b6690 2026-02-23T06:51:40.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.171+0000 7f82a7683640 1 -- 10.20.193.58:0/679094000 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82a0057ce0 con 0x7f82a00b6690 2026-02-23T06:51:40.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.172+0000 7f82a7683640 1 -- 10.20.193.58:0/679094000 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82a00b6d50 con 0x7f82a00b6690 2026-02-23T06:51:40.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.173+0000 7f828affd640 1 -- 10.20.193.58:0/679094000 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f8298007410 con 0x7f82a00b6690 2026-02-23T06:51:40.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.174+0000 7f828affd640 1 --2- 10.20.193.58:0/679094000 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f827007a6c0 0x7f827009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:40.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.174+0000 7f828affd640 1 -- 10.20.193.58:0/679094000 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f829809cd60 con 0x7f82a00b6690 2026-02-23T06:51:40.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.174+0000 7f82a5e80640 1 --2- 10.20.193.58:0/679094000 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f827007a6c0 0x7f827009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:40.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.175+0000 7f82a5e80640 1 --2- 10.20.193.58:0/679094000 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f827007a6c0 0x7f827009ab70 secure :-1 s=READY pgs=604 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f828c005970 tx=0x7f828c005900 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:40.170 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.175+0000 7f828affd640 1 -- 10.20.193.58:0/679094000 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f829805fe70 con 0x7f82a00b6690 2026-02-23T06:51:40.297 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.302+0000 7f82a7683640 1 -- 10.20.193.58:0/679094000 --> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f82a00b5e10 con 0x7f827007a6c0 2026-02-23T06:51:40.303 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.306+0000 7f828affd640 1 -- 10.20.193.58:0/679094000 <== mgr.4126 v2:10.20.193.93:6800/4124709854 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334898 (secure 0 0 0) 0x7f828c0040d0 con 0x7f827007a6c0 2026-02-23T06:51:40.303 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:51:40.306 INFO:teuthology.orchestra.run.trial058.stderr:dumped all 2026-02-23T06:51:40.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.313+0000 7f82a7683640 1 -- 10.20.193.58:0/679094000 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f827007a6c0 msgr2=0x7f827009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:40.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.313+0000 7f82a7683640 1 --2- 10.20.193.58:0/679094000 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f827007a6c0 0x7f827009ab70 secure :-1 s=READY pgs=604 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f828c005970 tx=0x7f828c005900 comp rx=0 tx=0).stop 2026-02-23T06:51:40.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.313+0000 7f82a7683640 1 -- 10.20.193.58:0/679094000 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f82a00b6690 msgr2=0x7f82a0127060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:40.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.313+0000 7f82a7683640 1 --2- 10.20.193.58:0/679094000 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f82a00b6690 0x7f82a0127060 secure :-1 s=READY pgs=161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f829800c480 tx=0x7f829800c950 comp rx=0 tx=0).stop 2026-02-23T06:51:40.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.313+0000 7f82a7683640 1 -- 10.20.193.58:0/679094000 shutdown_connections 2026-02-23T06:51:40.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.313+0000 7f82a7683640 1 --2- 10.20.193.58:0/679094000 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f827007a6c0 0x7f827009ab70 unknown :-1 s=CLOSED pgs=604 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:40.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.313+0000 7f82a7683640 1 --2- 10.20.193.58:0/679094000 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f82a015d870 0x7f82a0056db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:40.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.313+0000 7f82a7683640 1 --2- 10.20.193.58:0/679094000 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f82a015d4a0 0x7f82a0056870 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:40.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.313+0000 7f82a7683640 1 --2- 10.20.193.58:0/679094000 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f82a00b6690 0x7f82a0127060 unknown :-1 s=CLOSED pgs=161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:40.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.313+0000 7f82a7683640 1 -- 10.20.193.58:0/679094000 >> 10.20.193.58:0/679094000 conn(0x7f82a00b3c20 msgr2=0x7f82a015bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:40.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.313+0000 7f82a7683640 1 -- 10.20.193.58:0/679094000 shutdown_connections 2026-02-23T06:51:40.308 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.314+0000 7f82a7683640 1 -- 10.20.193.58:0/679094000 wait complete. 2026-02-23T06:51:40.326 INFO:teuthology.orchestra.run.trial058.stdout:{"pg_ready":true,"pg_map":{"version":938,"stamp":"2026-02-23T06:51:38.655843+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3578981466,"num_objects":878,"num_object_clones":0,"num_object_copies":3456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":878,"num_whiteouts":0,"num_read":117,"num_read_kb":175,"num_write":759269,"num_write_kb":39399252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62961,"ondisk_log_size":62961,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3474480,"kb_used_data":1689136,"kb_used_omap":705,"kb_used_meta":1784510,"kb_avail":751500240,"statfs":{"total":773094113280,"available":769536245760,"internally_reserved":0,"allocated":1729675264,"data_stored":7158907516,"data_compressed":421610194,"data_compressed_allocated":1018142720,"data_compressed_original":6448824320,"omap_allocated":722493,"internal_metadata":1827338691},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001580"},"pg_stats":[{"pgid":"2.1f","version":"27'27","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:38.203132+0000","last_change":"2026-02-23T06:21:17.142582+0000","last_active":"2026-02-23T06:50:38.203132+0000","last_peered":"2026-02-23T06:50:38.203132+0000","last_clean":"2026-02-23T06:50:38.203132+0000","last_became_active":"2026-02-23T06:21:17.142416+0000","last_became_peered":"2026-02-23T06:21:17.142416+0000","last_unstale":"2026-02-23T06:50:38.203132+0000","last_undegraded":"2026-02-23T06:50:38.203132+0000","last_fullsized":"2026-02-23T06:50:38.203132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:13:12.649937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569948,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.110619+0000","last_change":"2026-02-23T06:21:18.148362+0000","last_active":"2026-02-23T06:49:41.110619+0000","last_peered":"2026-02-23T06:49:41.110619+0000","last_clean":"2026-02-23T06:49:41.110619+0000","last_became_active":"2026-02-23T06:21:18.148276+0000","last_became_peered":"2026-02-23T06:21:18.148276+0000","last_unstale":"2026-02-23T06:49:41.110619+0000","last_undegraded":"2026-02-23T06:49:41.110619+0000","last_fullsized":"2026-02-23T06:49:41.110619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:47.221741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'2019","reported_seq":2050,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.526367+0000","last_change":"2026-02-23T06:21:22.169541+0000","last_active":"2026-02-23T06:50:45.526367+0000","last_peered":"2026-02-23T06:50:45.526367+0000","last_clean":"2026-02-23T06:50:45.526367+0000","last_became_active":"2026-02-23T06:21:22.169307+0000","last_became_peered":"2026-02-23T06:21:22.169307+0000","last_unstale":"2026-02-23T06:50:45.526367+0000","last_undegraded":"2026-02-23T06:50:45.526367+0000","last_fullsized":"2026-02-23T06:50:45.526367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2019,"log_dups_size":0,"ondisk_log_size":2019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:40:10.952374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25583,"num_write_kb":1337383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'3","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.078645+0000","last_change":"2026-02-23T06:21:17.138864+0000","last_active":"2026-02-23T06:49:41.078645+0000","last_peered":"2026-02-23T06:49:41.078645+0000","last_clean":"2026-02-23T06:49:41.078645+0000","last_became_active":"2026-02-23T06:21:17.138651+0000","last_became_peered":"2026-02-23T06:21:17.138651+0000","last_unstale":"2026-02-23T06:49:41.078645+0000","last_undegraded":"2026-02-23T06:49:41.078645+0000","last_fullsized":"2026-02-23T06:49:41.078645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:24.172617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'14","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.255888+0000","last_change":"2026-02-23T06:21:18.145040+0000","last_active":"2026-02-23T06:50:43.255888+0000","last_peered":"2026-02-23T06:50:43.255888+0000","last_clean":"2026-02-23T06:50:43.255888+0000","last_became_active":"2026-02-23T06:21:18.144915+0000","last_became_peered":"2026-02-23T06:21:18.144915+0000","last_unstale":"2026-02-23T06:50:43.255888+0000","last_undegraded":"2026-02-23T06:50:43.255888+0000","last_fullsized":"2026-02-23T06:50:43.255888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:17:30.105623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'1991","reported_seq":2030,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.573583+0000","last_change":"2026-02-23T06:22:05.910182+0000","last_active":"2026-02-23T06:50:45.573583+0000","last_peered":"2026-02-23T06:50:45.573583+0000","last_clean":"2026-02-23T06:50:45.573583+0000","last_became_active":"2026-02-23T06:22:05.909877+0000","last_became_peered":"2026-02-23T06:22:05.909877+0000","last_unstale":"2026-02-23T06:50:45.573583+0000","last_undegraded":"2026-02-23T06:50:45.573583+0000","last_fullsized":"2026-02-23T06:50:45.573583+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:45:51.963908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25310,"num_write_kb":1284660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'9","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.059320+0000","last_change":"2026-02-23T06:21:17.150375+0000","last_active":"2026-02-23T06:49:41.059320+0000","last_peered":"2026-02-23T06:49:41.059320+0000","last_clean":"2026-02-23T06:49:41.059320+0000","last_became_active":"2026-02-23T06:21:17.150244+0000","last_became_peered":"2026-02-23T06:21:17.150244+0000","last_unstale":"2026-02-23T06:49:41.059320+0000","last_undegraded":"2026-02-23T06:49:41.059320+0000","last_fullsized":"2026-02-23T06:49:41.059320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:06:21.465108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:41.247849+0000","last_change":"2026-02-23T06:21:18.150247+0000","last_active":"2026-02-23T06:50:41.247849+0000","last_peered":"2026-02-23T06:50:41.247849+0000","last_clean":"2026-02-23T06:50:41.247849+0000","last_became_active":"2026-02-23T06:21:18.149827+0000","last_became_peered":"2026-02-23T06:21:18.149827+0000","last_unstale":"2026-02-23T06:50:41.247849+0000","last_undegraded":"2026-02-23T06:50:41.247849+0000","last_fullsized":"2026-02-23T06:50:41.247849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:37:58.944726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'1720","reported_seq":1751,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.544254+0000","last_change":"2026-02-23T06:21:22.174417+0000","last_active":"2026-02-23T06:50:45.544254+0000","last_peered":"2026-02-23T06:50:45.544254+0000","last_clean":"2026-02-23T06:50:45.544254+0000","last_became_active":"2026-02-23T06:21:22.173939+0000","last_became_peered":"2026-02-23T06:21:22.173939+0000","last_unstale":"2026-02-23T06:50:45.544254+0000","last_undegraded":"2026-02-23T06:50:45.544254+0000","last_fullsized":"2026-02-23T06:50:45.544254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1720,"log_dups_size":0,"ondisk_log_size":1720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:41:53.008301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21991,"num_write_kb":1043178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:48:49.514790+0000","last_change":"2026-02-23T06:21:17.145244+0000","last_active":"2026-02-23T06:48:49.514790+0000","last_peered":"2026-02-23T06:48:49.514790+0000","last_clean":"2026-02-23T06:48:49.514790+0000","last_became_active":"2026-02-23T06:21:17.144122+0000","last_became_peered":"2026-02-23T06:21:17.144122+0000","last_unstale":"2026-02-23T06:48:49.514790+0000","last_undegraded":"2026-02-23T06:48:49.514790+0000","last_fullsized":"2026-02-23T06:48:49.514790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:42:56.020005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'11","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.972332+0000","last_change":"2026-02-23T06:22:05.870395+0000","last_active":"2026-02-23T06:50:43.972332+0000","last_peered":"2026-02-23T06:50:43.972332+0000","last_clean":"2026-02-23T06:50:43.972332+0000","last_became_active":"2026-02-23T06:22:05.870252+0000","last_became_peered":"2026-02-23T06:22:05.870252+0000","last_unstale":"2026-02-23T06:50:43.972332+0000","last_undegraded":"2026-02-23T06:50:43.972332+0000","last_fullsized":"2026-02-23T06:50:43.972332+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:05:32.729525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'2068","reported_seq":2099,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.563415+0000","last_change":"2026-02-23T06:21:22.168755+0000","last_active":"2026-02-23T06:50:45.563415+0000","last_peered":"2026-02-23T06:50:45.563415+0000","last_clean":"2026-02-23T06:50:45.563415+0000","last_became_active":"2026-02-23T06:21:22.165671+0000","last_became_peered":"2026-02-23T06:21:22.165671+0000","last_unstale":"2026-02-23T06:50:45.563415+0000","last_undegraded":"2026-02-23T06:50:45.563415+0000","last_fullsized":"2026-02-23T06:50:45.563415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2068,"log_dups_size":0,"ondisk_log_size":2068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:04:32.848929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26558,"num_write_kb":1292875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'10","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.058819+0000","last_change":"2026-02-23T06:21:18.150907+0000","last_active":"2026-02-23T06:49:41.058819+0000","last_peered":"2026-02-23T06:49:41.058819+0000","last_clean":"2026-02-23T06:49:41.058819+0000","last_became_active":"2026-02-23T06:21:18.150604+0000","last_became_peered":"2026-02-23T06:21:18.150604+0000","last_unstale":"2026-02-23T06:49:41.058819+0000","last_undegraded":"2026-02-23T06:49:41.058819+0000","last_fullsized":"2026-02-23T06:49:41.058819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:15:21.672153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'325","reported_seq":364,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.103715+0000","last_change":"2026-02-23T06:21:17.147523+0000","last_active":"2026-02-23T06:49:41.103715+0000","last_peered":"2026-02-23T06:49:41.103715+0000","last_clean":"2026-02-23T06:49:41.103715+0000","last_became_active":"2026-02-23T06:21:17.147351+0000","last_became_peered":"2026-02-23T06:21:17.147351+0000","last_unstale":"2026-02-23T06:49:41.103715+0000","last_undegraded":"2026-02-23T06:49:41.103715+0000","last_fullsized":"2026-02-23T06:49:41.103715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:36:34.550499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":322,"num_write_kb":4304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'1793","reported_seq":1825,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.575304+0000","last_change":"2026-02-23T06:21:22.169413+0000","last_active":"2026-02-23T06:50:45.575304+0000","last_peered":"2026-02-23T06:50:45.575304+0000","last_clean":"2026-02-23T06:50:45.575304+0000","last_became_active":"2026-02-23T06:21:22.169259+0000","last_became_peered":"2026-02-23T06:21:22.169259+0000","last_unstale":"2026-02-23T06:50:45.575304+0000","last_undegraded":"2026-02-23T06:50:45.575304+0000","last_fullsized":"2026-02-23T06:50:45.575304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1793,"log_dups_size":0,"ondisk_log_size":1793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:14:12.944321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22776,"num_write_kb":1137326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'10","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:34.445802+0000","last_change":"2026-02-23T06:21:18.142316+0000","last_active":"2026-02-23T06:50:34.445802+0000","last_peered":"2026-02-23T06:50:34.445802+0000","last_clean":"2026-02-23T06:50:34.445802+0000","last_became_active":"2026-02-23T06:21:18.142144+0000","last_became_peered":"2026-02-23T06:21:18.142144+0000","last_unstale":"2026-02-23T06:50:34.445802+0000","last_undegraded":"2026-02-23T06:50:34.445802+0000","last_fullsized":"2026-02-23T06:50:34.445802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:53:33.429271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'1","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:47:24.431558+0000","last_change":"2026-02-23T06:21:17.137576+0000","last_active":"2026-02-23T06:47:24.431558+0000","last_peered":"2026-02-23T06:47:24.431558+0000","last_clean":"2026-02-23T06:47:24.431558+0000","last_became_active":"2026-02-23T06:21:17.137371+0000","last_became_peered":"2026-02-23T06:21:17.137371+0000","last_unstale":"2026-02-23T06:47:24.431558+0000","last_undegraded":"2026-02-23T06:47:24.431558+0000","last_fullsized":"2026-02-23T06:47:24.431558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:27.159743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'1749","reported_seq":1781,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.569230+0000","last_change":"2026-02-23T06:21:22.163003+0000","last_active":"2026-02-23T06:50:45.569230+0000","last_peered":"2026-02-23T06:50:45.569230+0000","last_clean":"2026-02-23T06:50:45.569230+0000","last_became_active":"2026-02-23T06:21:22.162898+0000","last_became_peered":"2026-02-23T06:21:22.162898+0000","last_unstale":"2026-02-23T06:50:45.569230+0000","last_undegraded":"2026-02-23T06:50:45.569230+0000","last_fullsized":"2026-02-23T06:50:45.569230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1749,"log_dups_size":0,"ondisk_log_size":1749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:29:18.161667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21377,"num_write_kb":1230733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'8","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:29.498516+0000","last_change":"2026-02-23T06:21:18.141281+0000","last_active":"2026-02-23T06:49:29.498516+0000","last_peered":"2026-02-23T06:49:29.498516+0000","last_clean":"2026-02-23T06:49:29.498516+0000","last_became_active":"2026-02-23T06:21:18.141090+0000","last_became_peered":"2026-02-23T06:21:18.141090+0000","last_unstale":"2026-02-23T06:49:29.498516+0000","last_undegraded":"2026-02-23T06:49:29.498516+0000","last_fullsized":"2026-02-23T06:49:29.498516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:12:21.750595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:47:19.490471+0000","last_change":"2026-02-23T06:21:17.144179+0000","last_active":"2026-02-23T06:47:19.490471+0000","last_peered":"2026-02-23T06:47:19.490471+0000","last_clean":"2026-02-23T06:47:19.490471+0000","last_became_active":"2026-02-23T06:21:17.144017+0000","last_became_peered":"2026-02-23T06:21:17.144017+0000","last_unstale":"2026-02-23T06:47:19.490471+0000","last_undegraded":"2026-02-23T06:47:19.490471+0000","last_fullsized":"2026-02-23T06:47:19.490471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:25:41.992201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'2539","reported_seq":2571,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.575621+0000","last_change":"2026-02-23T06:21:22.174826+0000","last_active":"2026-02-23T06:50:45.575621+0000","last_peered":"2026-02-23T06:50:45.575621+0000","last_clean":"2026-02-23T06:50:45.575621+0000","last_became_active":"2026-02-23T06:21:22.174683+0000","last_became_peered":"2026-02-23T06:21:22.174683+0000","last_unstale":"2026-02-23T06:50:45.575621+0000","last_undegraded":"2026-02-23T06:50:45.575621+0000","last_fullsized":"2026-02-23T06:50:45.575621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2539,"log_dups_size":0,"ondisk_log_size":2539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:04:49.277580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32937,"num_write_kb":1504117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'7","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.086801+0000","last_change":"2026-02-23T06:21:18.145331+0000","last_active":"2026-02-23T06:49:41.086801+0000","last_peered":"2026-02-23T06:49:41.086801+0000","last_clean":"2026-02-23T06:49:41.086801+0000","last_became_active":"2026-02-23T06:21:18.145231+0000","last_became_peered":"2026-02-23T06:21:18.145231+0000","last_unstale":"2026-02-23T06:49:41.086801+0000","last_undegraded":"2026-02-23T06:49:41.086801+0000","last_fullsized":"2026-02-23T06:49:41.086801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:32:44.487867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'3","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:29.517107+0000","last_change":"2026-02-23T06:21:17.147584+0000","last_active":"2026-02-23T06:49:29.517107+0000","last_peered":"2026-02-23T06:49:29.517107+0000","last_clean":"2026-02-23T06:49:29.517107+0000","last_became_active":"2026-02-23T06:21:17.147431+0000","last_became_peered":"2026-02-23T06:21:17.147431+0000","last_unstale":"2026-02-23T06:49:29.517107+0000","last_undegraded":"2026-02-23T06:49:29.517107+0000","last_fullsized":"2026-02-23T06:49:29.517107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:10:39.127457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'2046","reported_seq":2078,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.529417+0000","last_change":"2026-02-23T06:21:22.175656+0000","last_active":"2026-02-23T06:50:45.529417+0000","last_peered":"2026-02-23T06:50:45.529417+0000","last_clean":"2026-02-23T06:50:45.529417+0000","last_became_active":"2026-02-23T06:21:22.175493+0000","last_became_peered":"2026-02-23T06:21:22.175493+0000","last_unstale":"2026-02-23T06:50:45.529417+0000","last_undegraded":"2026-02-23T06:50:45.529417+0000","last_fullsized":"2026-02-23T06:50:45.529417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2046,"log_dups_size":0,"ondisk_log_size":2046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:10:41.366772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25584,"num_write_kb":1337535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'18","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:29.059447+0000","last_change":"2026-02-23T06:21:18.141486+0000","last_active":"2026-02-23T06:50:29.059447+0000","last_peered":"2026-02-23T06:50:29.059447+0000","last_clean":"2026-02-23T06:50:29.059447+0000","last_became_active":"2026-02-23T06:21:18.141277+0000","last_became_peered":"2026-02-23T06:21:18.141277+0000","last_unstale":"2026-02-23T06:50:29.059447+0000","last_undegraded":"2026-02-23T06:50:29.059447+0000","last_fullsized":"2026-02-23T06:50:29.059447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:21:15.738187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.091039+0000","last_change":"2026-02-23T06:21:17.148536+0000","last_active":"2026-02-23T06:49:41.091039+0000","last_peered":"2026-02-23T06:49:41.091039+0000","last_clean":"2026-02-23T06:49:41.091039+0000","last_became_active":"2026-02-23T06:21:17.148424+0000","last_became_peered":"2026-02-23T06:21:17.148424+0000","last_unstale":"2026-02-23T06:49:41.091039+0000","last_undegraded":"2026-02-23T06:49:41.091039+0000","last_fullsized":"2026-02-23T06:49:41.091039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:02:54.995144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'1584","reported_seq":1617,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:44.677283+0000","last_change":"2026-02-23T06:21:22.171333+0000","last_active":"2026-02-23T06:50:44.677283+0000","last_peered":"2026-02-23T06:50:44.677283+0000","last_clean":"2026-02-23T06:50:44.677283+0000","last_became_active":"2026-02-23T06:21:22.170496+0000","last_became_peered":"2026-02-23T06:21:22.170496+0000","last_unstale":"2026-02-23T06:50:44.677283+0000","last_undegraded":"2026-02-23T06:50:44.677283+0000","last_fullsized":"2026-02-23T06:50:44.677283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1584,"log_dups_size":0,"ondisk_log_size":1584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:40:07.996281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20571,"num_write_kb":974984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'12","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.629461+0000","last_change":"2026-02-23T06:21:18.142135+0000","last_active":"2026-02-23T06:50:43.629461+0000","last_peered":"2026-02-23T06:50:43.629461+0000","last_clean":"2026-02-23T06:50:43.629461+0000","last_became_active":"2026-02-23T06:21:18.141771+0000","last_became_peered":"2026-02-23T06:21:18.141771+0000","last_unstale":"2026-02-23T06:50:43.629461+0000","last_undegraded":"2026-02-23T06:50:43.629461+0000","last_fullsized":"2026-02-23T06:50:43.629461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:10:18.195986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'154","reported_seq":193,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:37.438555+0000","last_change":"2026-02-23T06:21:17.142326+0000","last_active":"2026-02-23T06:50:37.438555+0000","last_peered":"2026-02-23T06:50:37.438555+0000","last_clean":"2026-02-23T06:50:37.438555+0000","last_became_active":"2026-02-23T06:21:17.142203+0000","last_became_peered":"2026-02-23T06:21:17.142203+0000","last_unstale":"2026-02-23T06:50:37.438555+0000","last_undegraded":"2026-02-23T06:50:37.438555+0000","last_fullsized":"2026-02-23T06:50:37.438555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:49:44.262210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'1540","reported_seq":1574,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.582158+0000","last_change":"2026-02-23T06:21:22.168717+0000","last_active":"2026-02-23T06:50:45.582158+0000","last_peered":"2026-02-23T06:50:45.582158+0000","last_clean":"2026-02-23T06:50:45.582158+0000","last_became_active":"2026-02-23T06:21:22.168375+0000","last_became_peered":"2026-02-23T06:21:22.168375+0000","last_unstale":"2026-02-23T06:50:45.582158+0000","last_undegraded":"2026-02-23T06:50:45.582158+0000","last_fullsized":"2026-02-23T06:50:45.582158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1540,"log_dups_size":0,"ondisk_log_size":1540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:03:53.993581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18660,"num_write_kb":1083504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'9","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:29.444279+0000","last_change":"2026-02-23T06:21:18.141908+0000","last_active":"2026-02-23T06:50:29.444279+0000","last_peered":"2026-02-23T06:50:29.444279+0000","last_clean":"2026-02-23T06:50:29.444279+0000","last_became_active":"2026-02-23T06:21:18.141363+0000","last_became_peered":"2026-02-23T06:21:18.141363+0000","last_unstale":"2026-02-23T06:50:29.444279+0000","last_undegraded":"2026-02-23T06:50:29.444279+0000","last_fullsized":"2026-02-23T06:50:29.444279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:06:26.731868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.081381+0000","last_change":"2026-02-23T06:21:17.144716+0000","last_active":"2026-02-23T06:49:41.081381+0000","last_peered":"2026-02-23T06:49:41.081381+0000","last_clean":"2026-02-23T06:49:41.081381+0000","last_became_active":"2026-02-23T06:21:17.144515+0000","last_became_peered":"2026-02-23T06:21:17.144515+0000","last_unstale":"2026-02-23T06:49:41.081381+0000","last_undegraded":"2026-02-23T06:49:41.081381+0000","last_fullsized":"2026-02-23T06:49:41.081381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:38:35.014170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'1993","reported_seq":2026,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.583075+0000","last_change":"2026-02-23T06:21:22.171364+0000","last_active":"2026-02-23T06:50:45.583075+0000","last_peered":"2026-02-23T06:50:45.583075+0000","last_clean":"2026-02-23T06:50:45.583075+0000","last_became_active":"2026-02-23T06:21:22.171165+0000","last_became_peered":"2026-02-23T06:21:22.171165+0000","last_unstale":"2026-02-23T06:50:45.583075+0000","last_undegraded":"2026-02-23T06:50:45.583075+0000","last_fullsized":"2026-02-23T06:50:45.583075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1993,"log_dups_size":0,"ondisk_log_size":1993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:00:42.055334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24991,"num_write_kb":1370848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'12","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:34.065120+0000","last_change":"2026-02-23T06:21:18.144182+0000","last_active":"2026-02-23T06:50:34.065120+0000","last_peered":"2026-02-23T06:50:34.065120+0000","last_clean":"2026-02-23T06:50:34.065120+0000","last_became_active":"2026-02-23T06:21:18.143585+0000","last_became_peered":"2026-02-23T06:21:18.143585+0000","last_unstale":"2026-02-23T06:50:34.065120+0000","last_undegraded":"2026-02-23T06:50:34.065120+0000","last_fullsized":"2026-02-23T06:50:34.065120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:07:05.513990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:48:24.435637+0000","last_change":"2026-02-23T06:21:17.137935+0000","last_active":"2026-02-23T06:48:24.435637+0000","last_peered":"2026-02-23T06:48:24.435637+0000","last_clean":"2026-02-23T06:48:24.435637+0000","last_became_active":"2026-02-23T06:21:17.137386+0000","last_became_peered":"2026-02-23T06:21:17.137386+0000","last_unstale":"2026-02-23T06:48:24.435637+0000","last_undegraded":"2026-02-23T06:48:24.435637+0000","last_fullsized":"2026-02-23T06:48:24.435637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:51:24.646436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'1807","reported_seq":1840,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.529577+0000","last_change":"2026-02-23T06:21:22.163110+0000","last_active":"2026-02-23T06:50:45.529577+0000","last_peered":"2026-02-23T06:50:45.529577+0000","last_clean":"2026-02-23T06:50:45.529577+0000","last_became_active":"2026-02-23T06:21:22.162891+0000","last_became_peered":"2026-02-23T06:21:22.162891+0000","last_unstale":"2026-02-23T06:50:45.529577+0000","last_undegraded":"2026-02-23T06:50:45.529577+0000","last_fullsized":"2026-02-23T06:50:45.529577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1807,"log_dups_size":0,"ondisk_log_size":1807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:06:23.664613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22820,"num_write_kb":1167007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'9","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:42.194253+0000","last_change":"2026-02-23T06:21:18.152606+0000","last_active":"2026-02-23T06:50:42.194253+0000","last_peered":"2026-02-23T06:50:42.194253+0000","last_clean":"2026-02-23T06:50:42.194253+0000","last_became_active":"2026-02-23T06:21:18.152102+0000","last_became_peered":"2026-02-23T06:21:18.152102+0000","last_unstale":"2026-02-23T06:50:42.194253+0000","last_undegraded":"2026-02-23T06:50:42.194253+0000","last_fullsized":"2026-02-23T06:50:42.194253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:59:30.188417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:48:24.491404+0000","last_change":"2026-02-23T06:21:17.143289+0000","last_active":"2026-02-23T06:48:24.491404+0000","last_peered":"2026-02-23T06:48:24.491404+0000","last_clean":"2026-02-23T06:48:24.491404+0000","last_became_active":"2026-02-23T06:21:17.143201+0000","last_became_peered":"2026-02-23T06:21:17.143201+0000","last_unstale":"2026-02-23T06:48:24.491404+0000","last_undegraded":"2026-02-23T06:48:24.491404+0000","last_fullsized":"2026-02-23T06:48:24.491404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:33:06.892035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'1941","reported_seq":1974,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.582448+0000","last_change":"2026-02-23T06:21:22.163932+0000","last_active":"2026-02-23T06:50:45.582448+0000","last_peered":"2026-02-23T06:50:45.582448+0000","last_clean":"2026-02-23T06:50:45.582448+0000","last_became_active":"2026-02-23T06:21:22.163734+0000","last_became_peered":"2026-02-23T06:21:22.163734+0000","last_unstale":"2026-02-23T06:50:45.582448+0000","last_undegraded":"2026-02-23T06:50:45.582448+0000","last_fullsized":"2026-02-23T06:50:45.582448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1941,"log_dups_size":0,"ondisk_log_size":1941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:44:47.208608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24396,"num_write_kb":1329645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'16","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:44.636060+0000","last_change":"2026-02-23T06:21:18.141664+0000","last_active":"2026-02-23T06:50:44.636060+0000","last_peered":"2026-02-23T06:50:44.636060+0000","last_clean":"2026-02-23T06:50:44.636060+0000","last_became_active":"2026-02-23T06:21:18.141350+0000","last_became_peered":"2026-02-23T06:21:18.141350+0000","last_unstale":"2026-02-23T06:50:44.636060+0000","last_undegraded":"2026-02-23T06:50:44.636060+0000","last_fullsized":"2026-02-23T06:50:44.636060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:01:50.434732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'31","reported_seq":102,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:41.061841+0000","last_change":"2026-02-23T06:21:17.139311+0000","last_active":"2026-02-23T06:50:41.061841+0000","last_peered":"2026-02-23T06:50:41.061841+0000","last_clean":"2026-02-23T06:50:41.061841+0000","last_became_active":"2026-02-23T06:21:17.139200+0000","last_became_peered":"2026-02-23T06:21:17.139200+0000","last_unstale":"2026-02-23T06:50:41.061841+0000","last_undegraded":"2026-02-23T06:50:41.061841+0000","last_fullsized":"2026-02-23T06:50:41.061841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:52:23.863807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78928,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":99,"num_write":30,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'1732","reported_seq":1764,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.547623+0000","last_change":"2026-02-23T06:21:22.164793+0000","last_active":"2026-02-23T06:50:45.547623+0000","last_peered":"2026-02-23T06:50:45.547623+0000","last_clean":"2026-02-23T06:50:45.547623+0000","last_became_active":"2026-02-23T06:21:22.164667+0000","last_became_peered":"2026-02-23T06:21:22.164667+0000","last_unstale":"2026-02-23T06:50:45.547623+0000","last_undegraded":"2026-02-23T06:50:45.547623+0000","last_fullsized":"2026-02-23T06:50:45.547623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1732,"log_dups_size":0,"ondisk_log_size":1732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:36:39.520044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22104,"num_write_kb":1081444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'7","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:29.444261+0000","last_change":"2026-02-23T06:21:18.146624+0000","last_active":"2026-02-23T06:50:29.444261+0000","last_peered":"2026-02-23T06:50:29.444261+0000","last_clean":"2026-02-23T06:50:29.444261+0000","last_became_active":"2026-02-23T06:21:18.146491+0000","last_became_peered":"2026-02-23T06:21:18.146491+0000","last_unstale":"2026-02-23T06:50:29.444261+0000","last_undegraded":"2026-02-23T06:50:29.444261+0000","last_fullsized":"2026-02-23T06:50:29.444261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:11:23.574241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'5","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.036902+0000","last_change":"2026-02-23T06:21:17.143128+0000","last_active":"2026-02-23T06:49:41.036902+0000","last_peered":"2026-02-23T06:49:41.036902+0000","last_clean":"2026-02-23T06:49:41.036902+0000","last_became_active":"2026-02-23T06:21:17.143050+0000","last_became_peered":"2026-02-23T06:21:17.143050+0000","last_unstale":"2026-02-23T06:49:41.036902+0000","last_undegraded":"2026-02-23T06:49:41.036902+0000","last_fullsized":"2026-02-23T06:49:41.036902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:15.628487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'1668","reported_seq":1700,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.540464+0000","last_change":"2026-02-23T06:21:22.168755+0000","last_active":"2026-02-23T06:50:45.540464+0000","last_peered":"2026-02-23T06:50:45.540464+0000","last_clean":"2026-02-23T06:50:45.540464+0000","last_became_active":"2026-02-23T06:21:22.168510+0000","last_became_peered":"2026-02-23T06:21:22.168510+0000","last_unstale":"2026-02-23T06:50:45.540464+0000","last_undegraded":"2026-02-23T06:50:45.540464+0000","last_fullsized":"2026-02-23T06:50:45.540464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1668,"log_dups_size":0,"ondisk_log_size":1668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:19:06.716318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20170,"num_write_kb":1220870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:41.398913+0000","last_change":"2026-02-23T06:21:18.145397+0000","last_active":"2026-02-23T06:50:41.398913+0000","last_peered":"2026-02-23T06:50:41.398913+0000","last_clean":"2026-02-23T06:50:41.398913+0000","last_became_active":"2026-02-23T06:21:18.145214+0000","last_became_peered":"2026-02-23T06:21:18.145214+0000","last_unstale":"2026-02-23T06:50:41.398913+0000","last_undegraded":"2026-02-23T06:50:41.398913+0000","last_fullsized":"2026-02-23T06:50:41.398913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:33:41.870582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'2","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.031120+0000","last_change":"2026-02-23T06:21:17.147696+0000","last_active":"2026-02-23T06:49:41.031120+0000","last_peered":"2026-02-23T06:49:41.031120+0000","last_clean":"2026-02-23T06:49:41.031120+0000","last_became_active":"2026-02-23T06:21:17.147619+0000","last_became_peered":"2026-02-23T06:21:17.147619+0000","last_unstale":"2026-02-23T06:49:41.031120+0000","last_undegraded":"2026-02-23T06:49:41.031120+0000","last_fullsized":"2026-02-23T06:49:41.031120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:49:09.070245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'112","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:19.503937+0000","last_change":"2026-02-23T06:21:11.397748+0000","last_active":"2026-02-23T06:49:19.503937+0000","last_peered":"2026-02-23T06:49:19.503937+0000","last_clean":"2026-02-23T06:49:19.503937+0000","last_became_active":"2026-02-23T06:21:11.397664+0000","last_became_peered":"2026-02-23T06:21:11.397664+0000","last_unstale":"2026-02-23T06:49:19.503937+0000","last_undegraded":"2026-02-23T06:49:19.503937+0000","last_fullsized":"2026-02-23T06:49:19.503937+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:10.392316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:10.392316+0000","last_clean_scrub_stamp":"2026-02-23T06:21:10.392316+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:59:43.157572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'1573","reported_seq":1606,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.540404+0000","last_change":"2026-02-23T06:21:22.174696+0000","last_active":"2026-02-23T06:50:45.540404+0000","last_peered":"2026-02-23T06:50:45.540404+0000","last_clean":"2026-02-23T06:50:45.540404+0000","last_became_active":"2026-02-23T06:21:22.174253+0000","last_became_peered":"2026-02-23T06:21:22.174253+0000","last_unstale":"2026-02-23T06:50:45.540404+0000","last_undegraded":"2026-02-23T06:50:45.540404+0000","last_fullsized":"2026-02-23T06:50:45.540404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1573,"log_dups_size":0,"ondisk_log_size":1573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:28.487343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19207,"num_write_kb":1122014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'10","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:14.095464+0000","last_change":"2026-02-23T06:21:18.150652+0000","last_active":"2026-02-23T06:50:14.095464+0000","last_peered":"2026-02-23T06:50:14.095464+0000","last_clean":"2026-02-23T06:50:14.095464+0000","last_became_active":"2026-02-23T06:21:18.150501+0000","last_became_peered":"2026-02-23T06:21:18.150501+0000","last_unstale":"2026-02-23T06:50:14.095464+0000","last_undegraded":"2026-02-23T06:50:14.095464+0000","last_fullsized":"2026-02-23T06:50:14.095464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:34:20.113034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.038910+0000","last_change":"2026-02-23T06:21:17.146074+0000","last_active":"2026-02-23T06:49:41.038910+0000","last_peered":"2026-02-23T06:49:41.038910+0000","last_clean":"2026-02-23T06:49:41.038910+0000","last_became_active":"2026-02-23T06:21:17.145938+0000","last_became_peered":"2026-02-23T06:21:17.145938+0000","last_unstale":"2026-02-23T06:49:41.038910+0000","last_undegraded":"2026-02-23T06:49:41.038910+0000","last_fullsized":"2026-02-23T06:49:41.038910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:41:42.571718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'1561","reported_seq":1593,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:44.762982+0000","last_change":"2026-02-23T06:21:22.172266+0000","last_active":"2026-02-23T06:50:44.762982+0000","last_peered":"2026-02-23T06:50:44.762982+0000","last_clean":"2026-02-23T06:50:44.762982+0000","last_became_active":"2026-02-23T06:21:22.171828+0000","last_became_peered":"2026-02-23T06:21:22.171828+0000","last_unstale":"2026-02-23T06:50:44.762982+0000","last_undegraded":"2026-02-23T06:50:44.762982+0000","last_fullsized":"2026-02-23T06:50:44.762982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1561,"log_dups_size":0,"ondisk_log_size":1561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:34:06.583640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19191,"num_write_kb":1080158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'12","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.093218+0000","last_change":"2026-02-23T06:21:18.147056+0000","last_active":"2026-02-23T06:49:41.093218+0000","last_peered":"2026-02-23T06:49:41.093218+0000","last_clean":"2026-02-23T06:49:41.093218+0000","last_became_active":"2026-02-23T06:21:18.146977+0000","last_became_peered":"2026-02-23T06:21:18.146977+0000","last_unstale":"2026-02-23T06:49:41.093218+0000","last_undegraded":"2026-02-23T06:49:41.093218+0000","last_fullsized":"2026-02-23T06:49:41.093218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:02:14.013207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.036506+0000","last_change":"2026-02-23T06:21:17.139417+0000","last_active":"2026-02-23T06:49:41.036506+0000","last_peered":"2026-02-23T06:49:41.036506+0000","last_clean":"2026-02-23T06:49:41.036506+0000","last_became_active":"2026-02-23T06:21:17.139209+0000","last_became_peered":"2026-02-23T06:21:17.139209+0000","last_unstale":"2026-02-23T06:49:41.036506+0000","last_undegraded":"2026-02-23T06:49:41.036506+0000","last_fullsized":"2026-02-23T06:49:41.036506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:02:19.925669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'2272","reported_seq":2304,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.541787+0000","last_change":"2026-02-23T06:21:22.162912+0000","last_active":"2026-02-23T06:50:45.541787+0000","last_peered":"2026-02-23T06:50:45.541787+0000","last_clean":"2026-02-23T06:50:45.541787+0000","last_became_active":"2026-02-23T06:21:22.162777+0000","last_became_peered":"2026-02-23T06:21:22.162777+0000","last_unstale":"2026-02-23T06:50:45.541787+0000","last_undegraded":"2026-02-23T06:50:45.541787+0000","last_fullsized":"2026-02-23T06:50:45.541787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2272,"log_dups_size":0,"ondisk_log_size":2272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:40:10.012263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28575,"num_write_kb":1525996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'9","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.085449+0000","last_change":"2026-02-23T06:21:18.149281+0000","last_active":"2026-02-23T06:49:41.085449+0000","last_peered":"2026-02-23T06:49:41.085449+0000","last_clean":"2026-02-23T06:49:41.085449+0000","last_became_active":"2026-02-23T06:21:18.149038+0000","last_became_peered":"2026-02-23T06:21:18.149038+0000","last_unstale":"2026-02-23T06:49:41.085449+0000","last_undegraded":"2026-02-23T06:49:41.085449+0000","last_fullsized":"2026-02-23T06:49:41.085449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:57:13.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.083324+0000","last_change":"2026-02-23T06:21:17.137649+0000","last_active":"2026-02-23T06:49:41.083324+0000","last_peered":"2026-02-23T06:49:41.083324+0000","last_clean":"2026-02-23T06:49:41.083324+0000","last_became_active":"2026-02-23T06:21:17.137476+0000","last_became_peered":"2026-02-23T06:21:17.137476+0000","last_unstale":"2026-02-23T06:49:41.083324+0000","last_undegraded":"2026-02-23T06:49:41.083324+0000","last_fullsized":"2026-02-23T06:49:41.083324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:47:43.648999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'1596","reported_seq":1628,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.574320+0000","last_change":"2026-02-23T06:21:22.174081+0000","last_active":"2026-02-23T06:50:45.574320+0000","last_peered":"2026-02-23T06:50:45.574320+0000","last_clean":"2026-02-23T06:50:45.574320+0000","last_became_active":"2026-02-23T06:21:22.173501+0000","last_became_peered":"2026-02-23T06:21:22.173501+0000","last_unstale":"2026-02-23T06:50:45.574320+0000","last_undegraded":"2026-02-23T06:50:45.574320+0000","last_fullsized":"2026-02-23T06:50:45.574320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1596,"log_dups_size":0,"ondisk_log_size":1596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:29:42.370894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20195,"num_write_kb":1002716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'7","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.099249+0000","last_change":"2026-02-23T06:21:18.155183+0000","last_active":"2026-02-23T06:49:41.099249+0000","last_peered":"2026-02-23T06:49:41.099249+0000","last_clean":"2026-02-23T06:49:41.099249+0000","last_became_active":"2026-02-23T06:21:18.154271+0000","last_became_peered":"2026-02-23T06:21:18.154271+0000","last_unstale":"2026-02-23T06:49:41.099249+0000","last_undegraded":"2026-02-23T06:49:41.099249+0000","last_fullsized":"2026-02-23T06:49:41.099249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:34:53.495073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:48:19.512931+0000","last_change":"2026-02-23T06:21:17.144988+0000","last_active":"2026-02-23T06:48:19.512931+0000","last_peered":"2026-02-23T06:48:19.512931+0000","last_clean":"2026-02-23T06:48:19.512931+0000","last_became_active":"2026-02-23T06:21:17.144914+0000","last_became_peered":"2026-02-23T06:21:17.144914+0000","last_unstale":"2026-02-23T06:48:19.512931+0000","last_undegraded":"2026-02-23T06:48:19.512931+0000","last_fullsized":"2026-02-23T06:48:19.512931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:20:30.802189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'1694","reported_seq":1726,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.564313+0000","last_change":"2026-02-23T06:21:22.169035+0000","last_active":"2026-02-23T06:50:45.564313+0000","last_peered":"2026-02-23T06:50:45.564313+0000","last_clean":"2026-02-23T06:50:45.564313+0000","last_became_active":"2026-02-23T06:21:22.168516+0000","last_became_peered":"2026-02-23T06:21:22.168516+0000","last_unstale":"2026-02-23T06:50:45.564313+0000","last_undegraded":"2026-02-23T06:50:45.564313+0000","last_fullsized":"2026-02-23T06:50:45.564313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1694,"log_dups_size":0,"ondisk_log_size":1694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:53:53.761208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20934,"num_write_kb":1166144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'13","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.848111+0000","last_change":"2026-02-23T06:21:18.152543+0000","last_active":"2026-02-23T06:50:43.848111+0000","last_peered":"2026-02-23T06:50:43.848111+0000","last_clean":"2026-02-23T06:50:43.848111+0000","last_became_active":"2026-02-23T06:21:18.152381+0000","last_became_peered":"2026-02-23T06:21:18.152381+0000","last_unstale":"2026-02-23T06:50:43.848111+0000","last_undegraded":"2026-02-23T06:50:43.848111+0000","last_fullsized":"2026-02-23T06:50:43.848111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:20:11.159653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'13","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.084190+0000","last_change":"2026-02-23T06:21:17.137277+0000","last_active":"2026-02-23T06:49:41.084190+0000","last_peered":"2026-02-23T06:49:41.084190+0000","last_clean":"2026-02-23T06:49:41.084190+0000","last_became_active":"2026-02-23T06:21:17.137101+0000","last_became_peered":"2026-02-23T06:21:17.137101+0000","last_unstale":"2026-02-23T06:49:41.084190+0000","last_undegraded":"2026-02-23T06:49:41.084190+0000","last_fullsized":"2026-02-23T06:49:41.084190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:26:19.732037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'2316","reported_seq":2347,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.497983+0000","last_change":"2026-02-23T06:21:22.168965+0000","last_active":"2026-02-23T06:50:45.497983+0000","last_peered":"2026-02-23T06:50:45.497983+0000","last_clean":"2026-02-23T06:50:45.497983+0000","last_became_active":"2026-02-23T06:21:22.168603+0000","last_became_peered":"2026-02-23T06:21:22.168603+0000","last_unstale":"2026-02-23T06:50:45.497983+0000","last_undegraded":"2026-02-23T06:50:45.497983+0000","last_fullsized":"2026-02-23T06:50:45.497983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2316,"log_dups_size":0,"ondisk_log_size":2316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:15:47.100236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30296,"num_write_kb":1393408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'11","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.111681+0000","last_change":"2026-02-23T06:21:18.143842+0000","last_active":"2026-02-23T06:49:41.111681+0000","last_peered":"2026-02-23T06:49:41.111681+0000","last_clean":"2026-02-23T06:49:41.111681+0000","last_became_active":"2026-02-23T06:21:18.143002+0000","last_became_peered":"2026-02-23T06:21:18.143002+0000","last_unstale":"2026-02-23T06:49:41.111681+0000","last_undegraded":"2026-02-23T06:49:41.111681+0000","last_fullsized":"2026-02-23T06:49:41.111681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:04:36.461970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'3","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:46:59.508058+0000","last_change":"2026-02-23T06:21:17.143842+0000","last_active":"2026-02-23T06:46:59.508058+0000","last_peered":"2026-02-23T06:46:59.508058+0000","last_clean":"2026-02-23T06:46:59.508058+0000","last_became_active":"2026-02-23T06:21:17.143700+0000","last_became_peered":"2026-02-23T06:21:17.143700+0000","last_unstale":"2026-02-23T06:46:59.508058+0000","last_undegraded":"2026-02-23T06:46:59.508058+0000","last_fullsized":"2026-02-23T06:46:59.508058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:14:07.166043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'2127","reported_seq":2158,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.581277+0000","last_change":"2026-02-23T06:21:22.168834+0000","last_active":"2026-02-23T06:50:45.581277+0000","last_peered":"2026-02-23T06:50:45.581277+0000","last_clean":"2026-02-23T06:50:45.581277+0000","last_became_active":"2026-02-23T06:21:22.168593+0000","last_became_peered":"2026-02-23T06:21:22.168593+0000","last_unstale":"2026-02-23T06:50:45.581277+0000","last_undegraded":"2026-02-23T06:50:45.581277+0000","last_fullsized":"2026-02-23T06:50:45.581277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2127,"log_dups_size":0,"ondisk_log_size":2127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:15:01.999978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27189,"num_write_kb":1335474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'17","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.119990+0000","last_change":"2026-02-23T06:21:18.155135+0000","last_active":"2026-02-23T06:49:41.119990+0000","last_peered":"2026-02-23T06:49:41.119990+0000","last_clean":"2026-02-23T06:49:41.119990+0000","last_became_active":"2026-02-23T06:21:18.155022+0000","last_became_peered":"2026-02-23T06:21:18.155022+0000","last_unstale":"2026-02-23T06:49:41.119990+0000","last_undegraded":"2026-02-23T06:49:41.119990+0000","last_fullsized":"2026-02-23T06:49:41.119990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:50.396096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.090013+0000","last_change":"2026-02-23T06:21:17.144113+0000","last_active":"2026-02-23T06:49:41.090013+0000","last_peered":"2026-02-23T06:49:41.090013+0000","last_clean":"2026-02-23T06:49:41.090013+0000","last_became_active":"2026-02-23T06:21:17.144052+0000","last_became_peered":"2026-02-23T06:21:17.144052+0000","last_unstale":"2026-02-23T06:49:41.090013+0000","last_undegraded":"2026-02-23T06:49:41.090013+0000","last_fullsized":"2026-02-23T06:49:41.090013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:52:50.479411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'1770","reported_seq":1802,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.541361+0000","last_change":"2026-02-23T06:21:22.163712+0000","last_active":"2026-02-23T06:50:45.541361+0000","last_peered":"2026-02-23T06:50:45.541361+0000","last_clean":"2026-02-23T06:50:45.541361+0000","last_became_active":"2026-02-23T06:21:22.163563+0000","last_became_peered":"2026-02-23T06:21:22.163563+0000","last_unstale":"2026-02-23T06:50:45.541361+0000","last_undegraded":"2026-02-23T06:50:45.541361+0000","last_fullsized":"2026-02-23T06:50:45.541361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1770,"log_dups_size":0,"ondisk_log_size":1770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:58:44.301443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1,"num_read_kb":3,"num_write":22555,"num_write_kb":1140198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.036485+0000","last_change":"2026-02-23T06:21:18.152736+0000","last_active":"2026-02-23T06:49:41.036485+0000","last_peered":"2026-02-23T06:49:41.036485+0000","last_clean":"2026-02-23T06:49:41.036485+0000","last_became_active":"2026-02-23T06:21:18.152627+0000","last_became_peered":"2026-02-23T06:21:18.152627+0000","last_unstale":"2026-02-23T06:49:41.036485+0000","last_undegraded":"2026-02-23T06:49:41.036485+0000","last_fullsized":"2026-02-23T06:49:41.036485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:26:04.233805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'3","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:19.440107+0000","last_change":"2026-02-23T06:21:17.144924+0000","last_active":"2026-02-23T06:49:19.440107+0000","last_peered":"2026-02-23T06:49:19.440107+0000","last_clean":"2026-02-23T06:49:19.440107+0000","last_became_active":"2026-02-23T06:21:17.144847+0000","last_became_peered":"2026-02-23T06:21:17.144847+0000","last_unstale":"2026-02-23T06:49:19.440107+0000","last_undegraded":"2026-02-23T06:49:19.440107+0000","last_fullsized":"2026-02-23T06:49:19.440107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:09:16.703922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'2203","reported_seq":2234,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.562001+0000","last_change":"2026-02-23T06:21:22.164167+0000","last_active":"2026-02-23T06:50:45.562001+0000","last_peered":"2026-02-23T06:50:45.562001+0000","last_clean":"2026-02-23T06:50:45.562001+0000","last_became_active":"2026-02-23T06:21:22.164057+0000","last_became_peered":"2026-02-23T06:21:22.164057+0000","last_unstale":"2026-02-23T06:50:45.562001+0000","last_undegraded":"2026-02-23T06:50:45.562001+0000","last_fullsized":"2026-02-23T06:50:45.562001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2203,"log_dups_size":0,"ondisk_log_size":2203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:19:45.888728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27835,"num_write_kb":1432250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:19.521394+0000","last_change":"2026-02-23T06:21:18.148382+0000","last_active":"2026-02-23T06:50:19.521394+0000","last_peered":"2026-02-23T06:50:19.521394+0000","last_clean":"2026-02-23T06:50:19.521394+0000","last_became_active":"2026-02-23T06:21:18.147826+0000","last_became_peered":"2026-02-23T06:21:18.147826+0000","last_unstale":"2026-02-23T06:50:19.521394+0000","last_undegraded":"2026-02-23T06:50:19.521394+0000","last_fullsized":"2026-02-23T06:50:19.521394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:52:32.524186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'302","reported_seq":341,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:28.198411+0000","last_change":"2026-02-23T06:21:17.151131+0000","last_active":"2026-02-23T06:50:28.198411+0000","last_peered":"2026-02-23T06:50:28.198411+0000","last_clean":"2026-02-23T06:50:28.198411+0000","last_became_active":"2026-02-23T06:21:17.151030+0000","last_became_peered":"2026-02-23T06:21:17.151030+0000","last_unstale":"2026-02-23T06:50:28.198411+0000","last_undegraded":"2026-02-23T06:50:28.198411+0000","last_fullsized":"2026-02-23T06:50:28.198411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:19:57.049773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194998,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299,"num_write_kb":4303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'1451","reported_seq":1482,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.581521+0000","last_change":"2026-02-23T06:21:22.165171+0000","last_active":"2026-02-23T06:50:45.581521+0000","last_peered":"2026-02-23T06:50:45.581521+0000","last_clean":"2026-02-23T06:50:45.581521+0000","last_became_active":"2026-02-23T06:21:22.164972+0000","last_became_peered":"2026-02-23T06:21:22.164972+0000","last_unstale":"2026-02-23T06:50:45.581521+0000","last_undegraded":"2026-02-23T06:50:45.581521+0000","last_fullsized":"2026-02-23T06:50:45.581521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1451,"log_dups_size":0,"ondisk_log_size":1451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:58:26.519641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17009,"num_write_kb":1082863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:14.074409+0000","last_change":"2026-02-23T06:21:18.153296+0000","last_active":"2026-02-23T06:50:14.074409+0000","last_peered":"2026-02-23T06:50:14.074409+0000","last_clean":"2026-02-23T06:50:14.074409+0000","last_became_active":"2026-02-23T06:21:18.153052+0000","last_became_peered":"2026-02-23T06:21:18.153052+0000","last_unstale":"2026-02-23T06:50:14.074409+0000","last_undegraded":"2026-02-23T06:50:14.074409+0000","last_fullsized":"2026-02-23T06:50:14.074409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:38:32.662334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'20","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:34.102331+0000","last_change":"2026-02-23T06:21:17.137568+0000","last_active":"2026-02-23T06:50:34.102331+0000","last_peered":"2026-02-23T06:50:34.102331+0000","last_clean":"2026-02-23T06:50:34.102331+0000","last_became_active":"2026-02-23T06:21:17.137479+0000","last_became_peered":"2026-02-23T06:21:17.137479+0000","last_unstale":"2026-02-23T06:50:34.102331+0000","last_undegraded":"2026-02-23T06:50:34.102331+0000","last_fullsized":"2026-02-23T06:50:34.102331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:50:22.850887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'2249","reported_seq":2280,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.574206+0000","last_change":"2026-02-23T06:21:22.175837+0000","last_active":"2026-02-23T06:50:45.574206+0000","last_peered":"2026-02-23T06:50:45.574206+0000","last_clean":"2026-02-23T06:50:45.574206+0000","last_became_active":"2026-02-23T06:21:22.175638+0000","last_became_peered":"2026-02-23T06:21:22.175638+0000","last_unstale":"2026-02-23T06:50:45.574206+0000","last_undegraded":"2026-02-23T06:50:45.574206+0000","last_fullsized":"2026-02-23T06:50:45.574206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2249,"log_dups_size":0,"ondisk_log_size":2249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:24:39.312650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28921,"num_write_kb":1359033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'14","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:42.202491+0000","last_change":"2026-02-23T06:21:18.155473+0000","last_active":"2026-02-23T06:50:42.202491+0000","last_peered":"2026-02-23T06:50:42.202491+0000","last_clean":"2026-02-23T06:50:42.202491+0000","last_became_active":"2026-02-23T06:21:18.155349+0000","last_became_peered":"2026-02-23T06:21:18.155349+0000","last_unstale":"2026-02-23T06:50:42.202491+0000","last_undegraded":"2026-02-23T06:50:42.202491+0000","last_fullsized":"2026-02-23T06:50:42.202491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:20:20.345986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'1","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.093368+0000","last_change":"2026-02-23T06:21:17.148953+0000","last_active":"2026-02-23T06:49:41.093368+0000","last_peered":"2026-02-23T06:49:41.093368+0000","last_clean":"2026-02-23T06:49:41.093368+0000","last_became_active":"2026-02-23T06:21:17.148841+0000","last_became_peered":"2026-02-23T06:21:17.148841+0000","last_unstale":"2026-02-23T06:49:41.093368+0000","last_undegraded":"2026-02-23T06:49:41.093368+0000","last_fullsized":"2026-02-23T06:49:41.093368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:48:14.620108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'1724","reported_seq":1755,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.552172+0000","last_change":"2026-02-23T06:21:22.172897+0000","last_active":"2026-02-23T06:50:45.552172+0000","last_peered":"2026-02-23T06:50:45.552172+0000","last_clean":"2026-02-23T06:50:45.552172+0000","last_became_active":"2026-02-23T06:21:22.172683+0000","last_became_peered":"2026-02-23T06:21:22.172683+0000","last_unstale":"2026-02-23T06:50:45.552172+0000","last_undegraded":"2026-02-23T06:50:45.552172+0000","last_fullsized":"2026-02-23T06:50:45.552172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1724,"log_dups_size":0,"ondisk_log_size":1724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:17:41.991286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21477,"num_write_kb":1135952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'12","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.143594+0000","last_change":"2026-02-23T06:21:18.154897+0000","last_active":"2026-02-23T06:50:43.143594+0000","last_peered":"2026-02-23T06:50:43.143594+0000","last_clean":"2026-02-23T06:50:43.143594+0000","last_became_active":"2026-02-23T06:21:18.154586+0000","last_became_peered":"2026-02-23T06:21:18.154586+0000","last_unstale":"2026-02-23T06:50:43.143594+0000","last_undegraded":"2026-02-23T06:50:43.143594+0000","last_fullsized":"2026-02-23T06:50:43.143594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:22:13.361673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.033236+0000","last_change":"2026-02-23T06:21:17.140774+0000","last_active":"2026-02-23T06:49:41.033236+0000","last_peered":"2026-02-23T06:49:41.033236+0000","last_clean":"2026-02-23T06:49:41.033236+0000","last_became_active":"2026-02-23T06:21:17.140699+0000","last_became_peered":"2026-02-23T06:21:17.140699+0000","last_unstale":"2026-02-23T06:49:41.033236+0000","last_undegraded":"2026-02-23T06:49:41.033236+0000","last_fullsized":"2026-02-23T06:49:41.033236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:59:47.987932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'1855","reported_seq":1886,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.517289+0000","last_change":"2026-02-23T06:21:22.166371+0000","last_active":"2026-02-23T06:50:45.517289+0000","last_peered":"2026-02-23T06:50:45.517289+0000","last_clean":"2026-02-23T06:50:45.517289+0000","last_became_active":"2026-02-23T06:21:22.166204+0000","last_became_peered":"2026-02-23T06:21:22.166204+0000","last_unstale":"2026-02-23T06:50:45.517289+0000","last_undegraded":"2026-02-23T06:50:45.517289+0000","last_fullsized":"2026-02-23T06:50:45.517289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1855,"log_dups_size":0,"ondisk_log_size":1855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:50:51.116428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23435,"num_write_kb":1201520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'1867","reported_seq":1901,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.548532+0000","last_change":"2026-02-23T06:21:22.167411+0000","last_active":"2026-02-23T06:50:45.548532+0000","last_peered":"2026-02-23T06:50:45.548532+0000","last_clean":"2026-02-23T06:50:45.548532+0000","last_became_active":"2026-02-23T06:21:22.167217+0000","last_became_peered":"2026-02-23T06:21:22.167217+0000","last_unstale":"2026-02-23T06:50:45.548532+0000","last_undegraded":"2026-02-23T06:50:45.548532+0000","last_fullsized":"2026-02-23T06:50:45.548532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1867,"log_dups_size":0,"ondisk_log_size":1867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:20:54.687551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23697,"num_write_kb":1252431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:42.235822+0000","last_change":"2026-02-23T06:21:18.146043+0000","last_active":"2026-02-23T06:50:42.235822+0000","last_peered":"2026-02-23T06:50:42.235822+0000","last_clean":"2026-02-23T06:50:42.235822+0000","last_became_active":"2026-02-23T06:21:18.145938+0000","last_became_peered":"2026-02-23T06:21:18.145938+0000","last_unstale":"2026-02-23T06:50:42.235822+0000","last_undegraded":"2026-02-23T06:50:42.235822+0000","last_fullsized":"2026-02-23T06:50:42.235822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:03:21.252772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.039459+0000","last_change":"2026-02-23T06:21:17.149581+0000","last_active":"2026-02-23T06:49:41.039459+0000","last_peered":"2026-02-23T06:49:41.039459+0000","last_clean":"2026-02-23T06:49:41.039459+0000","last_became_active":"2026-02-23T06:21:17.149490+0000","last_became_peered":"2026-02-23T06:21:17.149490+0000","last_unstale":"2026-02-23T06:49:41.039459+0000","last_undegraded":"2026-02-23T06:49:41.039459+0000","last_fullsized":"2026-02-23T06:49:41.039459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:18:42.211307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'2152","reported_seq":2185,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.574313+0000","last_change":"2026-02-23T06:21:22.175655+0000","last_active":"2026-02-23T06:50:45.574313+0000","last_peered":"2026-02-23T06:50:45.574313+0000","last_clean":"2026-02-23T06:50:45.574313+0000","last_became_active":"2026-02-23T06:21:22.174906+0000","last_became_peered":"2026-02-23T06:21:22.174906+0000","last_unstale":"2026-02-23T06:50:45.574313+0000","last_undegraded":"2026-02-23T06:50:45.574313+0000","last_fullsized":"2026-02-23T06:50:45.574313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2152,"log_dups_size":0,"ondisk_log_size":2152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:50:34.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27270,"num_write_kb":1403073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'15","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:19.444217+0000","last_change":"2026-02-23T06:21:18.142560+0000","last_active":"2026-02-23T06:50:19.444217+0000","last_peered":"2026-02-23T06:50:19.444217+0000","last_clean":"2026-02-23T06:50:19.444217+0000","last_became_active":"2026-02-23T06:21:18.142325+0000","last_became_peered":"2026-02-23T06:21:18.142325+0000","last_unstale":"2026-02-23T06:50:19.444217+0000","last_undegraded":"2026-02-23T06:50:19.444217+0000","last_fullsized":"2026-02-23T06:50:19.444217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:45:44.641652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:47:59.433744+0000","last_change":"2026-02-23T06:21:17.146195+0000","last_active":"2026-02-23T06:47:59.433744+0000","last_peered":"2026-02-23T06:47:59.433744+0000","last_clean":"2026-02-23T06:47:59.433744+0000","last_became_active":"2026-02-23T06:21:17.146022+0000","last_became_peered":"2026-02-23T06:21:17.146022+0000","last_unstale":"2026-02-23T06:47:59.433744+0000","last_undegraded":"2026-02-23T06:47:59.433744+0000","last_fullsized":"2026-02-23T06:47:59.433744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:34:32.822540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.091157+0000","last_change":"2026-02-23T06:21:17.148590+0000","last_active":"2026-02-23T06:49:41.091157+0000","last_peered":"2026-02-23T06:49:41.091157+0000","last_clean":"2026-02-23T06:49:41.091157+0000","last_became_active":"2026-02-23T06:21:17.148417+0000","last_became_peered":"2026-02-23T06:21:17.148417+0000","last_unstale":"2026-02-23T06:49:41.091157+0000","last_undegraded":"2026-02-23T06:49:41.091157+0000","last_fullsized":"2026-02-23T06:49:41.091157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:21:11.877590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.050118+0000","last_change":"2026-02-23T06:21:18.152383+0000","last_active":"2026-02-23T06:49:41.050118+0000","last_peered":"2026-02-23T06:49:41.050118+0000","last_clean":"2026-02-23T06:49:41.050118+0000","last_became_active":"2026-02-23T06:21:18.152267+0000","last_became_peered":"2026-02-23T06:21:18.152267+0000","last_unstale":"2026-02-23T06:49:41.050118+0000","last_undegraded":"2026-02-23T06:49:41.050118+0000","last_fullsized":"2026-02-23T06:49:41.050118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:34:11.558509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'1670","reported_seq":1701,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.582047+0000","last_change":"2026-02-23T06:21:22.158812+0000","last_active":"2026-02-23T06:50:45.582047+0000","last_peered":"2026-02-23T06:50:45.582047+0000","last_clean":"2026-02-23T06:50:45.582047+0000","last_became_active":"2026-02-23T06:21:22.158607+0000","last_became_peered":"2026-02-23T06:21:22.158607+0000","last_unstale":"2026-02-23T06:50:45.582047+0000","last_undegraded":"2026-02-23T06:50:45.582047+0000","last_fullsized":"2026-02-23T06:50:45.582047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1670,"log_dups_size":0,"ondisk_log_size":1670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:59:07.000053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20239,"num_write_kb":1221270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1152","reported_seq":1190,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.044630+0000","last_change":"2026-02-23T06:21:17.138744+0000","last_active":"2026-02-23T06:49:41.044630+0000","last_peered":"2026-02-23T06:49:41.044630+0000","last_clean":"2026-02-23T06:49:41.044630+0000","last_became_active":"2026-02-23T06:21:17.138245+0000","last_became_peered":"2026-02-23T06:21:17.138245+0000","last_unstale":"2026-02-23T06:49:41.044630+0000","last_undegraded":"2026-02-23T06:49:41.044630+0000","last_fullsized":"2026-02-23T06:49:41.044630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1152,"log_dups_size":0,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:08:03.143401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1150,"num_write_kb":5073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'11","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:42.307472+0000","last_change":"2026-02-23T06:21:18.143640+0000","last_active":"2026-02-23T06:50:42.307472+0000","last_peered":"2026-02-23T06:50:42.307472+0000","last_clean":"2026-02-23T06:50:42.307472+0000","last_became_active":"2026-02-23T06:21:18.143550+0000","last_became_peered":"2026-02-23T06:21:18.143550+0000","last_unstale":"2026-02-23T06:50:42.307472+0000","last_undegraded":"2026-02-23T06:50:42.307472+0000","last_fullsized":"2026-02-23T06:50:42.307472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:11:40.394042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'1800","reported_seq":1831,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.534982+0000","last_change":"2026-02-23T06:21:22.169641+0000","last_active":"2026-02-23T06:50:45.534982+0000","last_peered":"2026-02-23T06:50:45.534982+0000","last_clean":"2026-02-23T06:50:45.534982+0000","last_became_active":"2026-02-23T06:21:22.169432+0000","last_became_peered":"2026-02-23T06:21:22.169432+0000","last_unstale":"2026-02-23T06:50:45.534982+0000","last_undegraded":"2026-02-23T06:50:45.534982+0000","last_fullsized":"2026-02-23T06:50:45.534982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1800,"log_dups_size":0,"ondisk_log_size":1800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:00:17.622113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23033,"num_write_kb":1131314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'13","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:29.625537+0000","last_change":"2026-02-23T06:21:18.143781+0000","last_active":"2026-02-23T06:50:29.625537+0000","last_peered":"2026-02-23T06:50:29.625537+0000","last_clean":"2026-02-23T06:50:29.625537+0000","last_became_active":"2026-02-23T06:21:18.143724+0000","last_became_peered":"2026-02-23T06:21:18.143724+0000","last_unstale":"2026-02-23T06:50:29.625537+0000","last_undegraded":"2026-02-23T06:50:29.625537+0000","last_fullsized":"2026-02-23T06:50:29.625537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:25:55.416021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'8","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:48:24.437036+0000","last_change":"2026-02-23T06:21:18.145425+0000","last_active":"2026-02-23T06:48:24.437036+0000","last_peered":"2026-02-23T06:48:24.437036+0000","last_clean":"2026-02-23T06:48:24.437036+0000","last_became_active":"2026-02-23T06:21:18.145325+0000","last_became_peered":"2026-02-23T06:21:18.145325+0000","last_unstale":"2026-02-23T06:48:24.437036+0000","last_undegraded":"2026-02-23T06:48:24.437036+0000","last_fullsized":"2026-02-23T06:48:24.437036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:55:31.700518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'15","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:29.500812+0000","last_change":"2026-02-23T06:21:18.150997+0000","last_active":"2026-02-23T06:50:29.500812+0000","last_peered":"2026-02-23T06:50:29.500812+0000","last_clean":"2026-02-23T06:50:29.500812+0000","last_became_active":"2026-02-23T06:21:18.150738+0000","last_became_peered":"2026-02-23T06:21:18.150738+0000","last_unstale":"2026-02-23T06:50:29.500812+0000","last_undegraded":"2026-02-23T06:50:29.500812+0000","last_fullsized":"2026-02-23T06:50:29.500812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:11:13.400669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'8","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:42.246163+0000","last_change":"2026-02-23T06:21:18.142305+0000","last_active":"2026-02-23T06:50:42.246163+0000","last_peered":"2026-02-23T06:50:42.246163+0000","last_clean":"2026-02-23T06:50:42.246163+0000","last_became_active":"2026-02-23T06:21:18.141484+0000","last_became_peered":"2026-02-23T06:21:18.141484+0000","last_unstale":"2026-02-23T06:50:42.246163+0000","last_undegraded":"2026-02-23T06:50:42.246163+0000","last_fullsized":"2026-02-23T06:50:42.246163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:12:36.003405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'10","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:42.171753+0000","last_change":"2026-02-23T06:21:18.148610+0000","last_active":"2026-02-23T06:50:42.171753+0000","last_peered":"2026-02-23T06:50:42.171753+0000","last_clean":"2026-02-23T06:50:42.171753+0000","last_became_active":"2026-02-23T06:21:18.148489+0000","last_became_peered":"2026-02-23T06:21:18.148489+0000","last_unstale":"2026-02-23T06:50:42.171753+0000","last_undegraded":"2026-02-23T06:50:42.171753+0000","last_fullsized":"2026-02-23T06:50:42.171753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:36:29.486147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.044709+0000","last_change":"2026-02-23T06:21:18.142438+0000","last_active":"2026-02-23T06:49:41.044709+0000","last_peered":"2026-02-23T06:49:41.044709+0000","last_clean":"2026-02-23T06:49:41.044709+0000","last_became_active":"2026-02-23T06:21:18.141854+0000","last_became_peered":"2026-02-23T06:21:18.141854+0000","last_unstale":"2026-02-23T06:49:41.044709+0000","last_undegraded":"2026-02-23T06:49:41.044709+0000","last_fullsized":"2026-02-23T06:49:41.044709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:23:35.379462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'12","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:41.378044+0000","last_change":"2026-02-23T06:21:18.153825+0000","last_active":"2026-02-23T06:50:41.378044+0000","last_peered":"2026-02-23T06:50:41.378044+0000","last_clean":"2026-02-23T06:50:41.378044+0000","last_became_active":"2026-02-23T06:21:18.153133+0000","last_became_peered":"2026-02-23T06:21:18.153133+0000","last_unstale":"2026-02-23T06:50:41.378044+0000","last_undegraded":"2026-02-23T06:50:41.378044+0000","last_fullsized":"2026-02-23T06:50:41.378044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:15:03.662362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'11","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:14.054874+0000","last_change":"2026-02-23T06:21:18.144945+0000","last_active":"2026-02-23T06:50:14.054874+0000","last_peered":"2026-02-23T06:50:14.054874+0000","last_clean":"2026-02-23T06:50:14.054874+0000","last_became_active":"2026-02-23T06:21:18.144832+0000","last_became_peered":"2026-02-23T06:21:18.144832+0000","last_unstale":"2026-02-23T06:50:14.054874+0000","last_undegraded":"2026-02-23T06:50:14.054874+0000","last_fullsized":"2026-02-23T06:50:14.054874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:41:07.968870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'13","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:41.106448+0000","last_change":"2026-02-23T06:21:18.150652+0000","last_active":"2026-02-23T06:50:41.106448+0000","last_peered":"2026-02-23T06:50:41.106448+0000","last_clean":"2026-02-23T06:50:41.106448+0000","last_became_active":"2026-02-23T06:21:18.150489+0000","last_became_peered":"2026-02-23T06:21:18.150489+0000","last_unstale":"2026-02-23T06:50:41.106448+0000","last_undegraded":"2026-02-23T06:50:41.106448+0000","last_fullsized":"2026-02-23T06:50:41.106448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:42:35.233149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'14","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.135455+0000","last_change":"2026-02-23T06:21:18.143636+0000","last_active":"2026-02-23T06:50:43.135455+0000","last_peered":"2026-02-23T06:50:43.135455+0000","last_clean":"2026-02-23T06:50:43.135455+0000","last_became_active":"2026-02-23T06:21:18.143495+0000","last_became_peered":"2026-02-23T06:21:18.143495+0000","last_unstale":"2026-02-23T06:50:43.135455+0000","last_undegraded":"2026-02-23T06:50:43.135455+0000","last_fullsized":"2026-02-23T06:50:43.135455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:47:19.057181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'11","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.064358+0000","last_change":"2026-02-23T06:21:18.148787+0000","last_active":"2026-02-23T06:49:41.064358+0000","last_peered":"2026-02-23T06:49:41.064358+0000","last_clean":"2026-02-23T06:49:41.064358+0000","last_became_active":"2026-02-23T06:21:18.148701+0000","last_became_peered":"2026-02-23T06:21:18.148701+0000","last_unstale":"2026-02-23T06:49:41.064358+0000","last_undegraded":"2026-02-23T06:49:41.064358+0000","last_fullsized":"2026-02-23T06:49:41.064358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:19:32.878202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'17","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.963539+0000","last_change":"2026-02-23T06:21:18.145498+0000","last_active":"2026-02-23T06:50:43.963539+0000","last_peered":"2026-02-23T06:50:43.963539+0000","last_clean":"2026-02-23T06:50:43.963539+0000","last_became_active":"2026-02-23T06:21:18.145346+0000","last_became_peered":"2026-02-23T06:21:18.145346+0000","last_unstale":"2026-02-23T06:50:43.963539+0000","last_undegraded":"2026-02-23T06:50:43.963539+0000","last_fullsized":"2026-02-23T06:50:43.963539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:44:15.203843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'13","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:34.522293+0000","last_change":"2026-02-23T06:21:18.147453+0000","last_active":"2026-02-23T06:50:34.522293+0000","last_peered":"2026-02-23T06:50:34.522293+0000","last_clean":"2026-02-23T06:50:34.522293+0000","last_became_active":"2026-02-23T06:21:18.147357+0000","last_became_peered":"2026-02-23T06:21:18.147357+0000","last_unstale":"2026-02-23T06:50:34.522293+0000","last_undegraded":"2026-02-23T06:50:34.522293+0000","last_fullsized":"2026-02-23T06:50:34.522293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:41:05.063786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'12","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.263261+0000","last_change":"2026-02-23T06:21:18.151381+0000","last_active":"2026-02-23T06:50:43.263261+0000","last_peered":"2026-02-23T06:50:43.263261+0000","last_clean":"2026-02-23T06:50:43.263261+0000","last_became_active":"2026-02-23T06:21:18.151269+0000","last_became_peered":"2026-02-23T06:21:18.151269+0000","last_unstale":"2026-02-23T06:50:43.263261+0000","last_undegraded":"2026-02-23T06:50:43.263261+0000","last_fullsized":"2026-02-23T06:50:43.263261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:50:46.152385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'18","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.826816+0000","last_change":"2026-02-23T06:21:18.148411+0000","last_active":"2026-02-23T06:50:43.826816+0000","last_peered":"2026-02-23T06:50:43.826816+0000","last_clean":"2026-02-23T06:50:43.826816+0000","last_became_active":"2026-02-23T06:21:18.148262+0000","last_became_peered":"2026-02-23T06:21:18.148262+0000","last_unstale":"2026-02-23T06:50:43.826816+0000","last_undegraded":"2026-02-23T06:50:43.826816+0000","last_fullsized":"2026-02-23T06:50:43.826816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:09:54.723244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:19.495112+0000","last_change":"2026-02-23T06:21:18.155275+0000","last_active":"2026-02-23T06:49:19.495112+0000","last_peered":"2026-02-23T06:49:19.495112+0000","last_clean":"2026-02-23T06:49:19.495112+0000","last_became_active":"2026-02-23T06:21:18.155214+0000","last_became_peered":"2026-02-23T06:21:18.155214+0000","last_unstale":"2026-02-23T06:49:19.495112+0000","last_undegraded":"2026-02-23T06:49:19.495112+0000","last_fullsized":"2026-02-23T06:49:19.495112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:44:47.367234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:43.659186+0000","last_change":"2026-02-23T06:21:18.153381+0000","last_active":"2026-02-23T06:50:43.659186+0000","last_peered":"2026-02-23T06:50:43.659186+0000","last_clean":"2026-02-23T06:50:43.659186+0000","last_became_active":"2026-02-23T06:21:18.152456+0000","last_became_peered":"2026-02-23T06:21:18.152456+0000","last_unstale":"2026-02-23T06:50:43.659186+0000","last_undegraded":"2026-02-23T06:50:43.659186+0000","last_fullsized":"2026-02-23T06:50:43.659186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:14:46.231331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'13","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:19.054621+0000","last_change":"2026-02-23T06:21:18.148599+0000","last_active":"2026-02-23T06:50:19.054621+0000","last_peered":"2026-02-23T06:50:19.054621+0000","last_clean":"2026-02-23T06:50:19.054621+0000","last_became_active":"2026-02-23T06:21:18.148498+0000","last_became_peered":"2026-02-23T06:21:18.148498+0000","last_unstale":"2026-02-23T06:50:19.054621+0000","last_undegraded":"2026-02-23T06:50:19.054621+0000","last_fullsized":"2026-02-23T06:50:19.054621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:05:56.074928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'14","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:14.132776+0000","last_change":"2026-02-23T06:21:18.142621+0000","last_active":"2026-02-23T06:50:14.132776+0000","last_peered":"2026-02-23T06:50:14.132776+0000","last_clean":"2026-02-23T06:50:14.132776+0000","last_became_active":"2026-02-23T06:21:18.141938+0000","last_became_peered":"2026-02-23T06:21:18.141938+0000","last_unstale":"2026-02-23T06:50:14.132776+0000","last_undegraded":"2026-02-23T06:50:14.132776+0000","last_fullsized":"2026-02-23T06:50:14.132776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:25:55.390738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'14","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:44.625290+0000","last_change":"2026-02-23T06:21:18.153183+0000","last_active":"2026-02-23T06:50:44.625290+0000","last_peered":"2026-02-23T06:50:44.625290+0000","last_clean":"2026-02-23T06:50:44.625290+0000","last_became_active":"2026-02-23T06:21:18.153090+0000","last_became_peered":"2026-02-23T06:21:18.153090+0000","last_unstale":"2026-02-23T06:50:44.625290+0000","last_undegraded":"2026-02-23T06:50:44.625290+0000","last_fullsized":"2026-02-23T06:50:44.625290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:26:17.749612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:19.521373+0000","last_change":"2026-02-23T06:21:18.148055+0000","last_active":"2026-02-23T06:50:19.521373+0000","last_peered":"2026-02-23T06:50:19.521373+0000","last_clean":"2026-02-23T06:50:19.521373+0000","last_became_active":"2026-02-23T06:21:18.147956+0000","last_became_peered":"2026-02-23T06:21:18.147956+0000","last_unstale":"2026-02-23T06:50:19.521373+0000","last_undegraded":"2026-02-23T06:50:19.521373+0000","last_fullsized":"2026-02-23T06:50:19.521373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:22:55.028859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'12","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:19.521388+0000","last_change":"2026-02-23T06:21:18.155576+0000","last_active":"2026-02-23T06:50:19.521388+0000","last_peered":"2026-02-23T06:50:19.521388+0000","last_clean":"2026-02-23T06:50:19.521388+0000","last_became_active":"2026-02-23T06:21:18.155130+0000","last_became_peered":"2026-02-23T06:21:18.155130+0000","last_unstale":"2026-02-23T06:50:19.521388+0000","last_undegraded":"2026-02-23T06:50:19.521388+0000","last_fullsized":"2026-02-23T06:50:19.521388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:43:12.801427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'12","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.108444+0000","last_change":"2026-02-23T06:21:18.152980+0000","last_active":"2026-02-23T06:49:41.108444+0000","last_peered":"2026-02-23T06:49:41.108444+0000","last_clean":"2026-02-23T06:49:41.108444+0000","last_became_active":"2026-02-23T06:21:18.152790+0000","last_became_peered":"2026-02-23T06:21:18.152790+0000","last_unstale":"2026-02-23T06:49:41.108444+0000","last_undegraded":"2026-02-23T06:49:41.108444+0000","last_fullsized":"2026-02-23T06:49:41.108444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:33:09.398040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'9","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:24.508958+0000","last_change":"2026-02-23T06:21:18.155247+0000","last_active":"2026-02-23T06:50:24.508958+0000","last_peered":"2026-02-23T06:50:24.508958+0000","last_clean":"2026-02-23T06:50:24.508958+0000","last_became_active":"2026-02-23T06:21:18.155122+0000","last_became_peered":"2026-02-23T06:21:18.155122+0000","last_unstale":"2026-02-23T06:50:24.508958+0000","last_undegraded":"2026-02-23T06:50:24.508958+0000","last_fullsized":"2026-02-23T06:50:24.508958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:45:08.775934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'4","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:45.568725+0000","last_change":"2026-02-23T06:21:18.151259+0000","last_active":"2026-02-23T06:50:45.568725+0000","last_peered":"2026-02-23T06:50:45.568725+0000","last_clean":"2026-02-23T06:50:45.568725+0000","last_became_active":"2026-02-23T06:21:18.151151+0000","last_became_peered":"2026-02-23T06:21:18.151151+0000","last_unstale":"2026-02-23T06:50:45.568725+0000","last_undegraded":"2026-02-23T06:50:45.568725+0000","last_fullsized":"2026-02-23T06:50:45.568725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:08:03.361054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'7","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.094234+0000","last_change":"2026-02-23T06:21:18.146606+0000","last_active":"2026-02-23T06:49:41.094234+0000","last_peered":"2026-02-23T06:49:41.094234+0000","last_clean":"2026-02-23T06:49:41.094234+0000","last_became_active":"2026-02-23T06:21:18.146527+0000","last_became_peered":"2026-02-23T06:21:18.146527+0000","last_unstale":"2026-02-23T06:49:41.094234+0000","last_undegraded":"2026-02-23T06:49:41.094234+0000","last_fullsized":"2026-02-23T06:49:41.094234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:30:44.739034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.052849+0000","last_change":"2026-02-23T06:21:18.145872+0000","last_active":"2026-02-23T06:49:41.052849+0000","last_peered":"2026-02-23T06:49:41.052849+0000","last_clean":"2026-02-23T06:49:41.052849+0000","last_became_active":"2026-02-23T06:21:18.145770+0000","last_became_peered":"2026-02-23T06:21:18.145770+0000","last_unstale":"2026-02-23T06:49:41.052849+0000","last_undegraded":"2026-02-23T06:49:41.052849+0000","last_fullsized":"2026-02-23T06:49:41.052849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:21:28.063960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'12","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:44.613087+0000","last_change":"2026-02-23T06:21:18.152478+0000","last_active":"2026-02-23T06:50:44.613087+0000","last_peered":"2026-02-23T06:50:44.613087+0000","last_clean":"2026-02-23T06:50:44.613087+0000","last_became_active":"2026-02-23T06:21:18.151948+0000","last_became_peered":"2026-02-23T06:21:18.151948+0000","last_unstale":"2026-02-23T06:50:44.613087+0000","last_undegraded":"2026-02-23T06:50:44.613087+0000","last_fullsized":"2026-02-23T06:50:44.613087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:58:02.829593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'5","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:19.620285+0000","last_change":"2026-02-23T06:21:18.144778+0000","last_active":"2026-02-23T06:49:19.620285+0000","last_peered":"2026-02-23T06:49:19.620285+0000","last_clean":"2026-02-23T06:49:19.620285+0000","last_became_active":"2026-02-23T06:21:18.144346+0000","last_became_peered":"2026-02-23T06:21:18.144346+0000","last_unstale":"2026-02-23T06:49:19.620285+0000","last_undegraded":"2026-02-23T06:49:19.620285+0000","last_fullsized":"2026-02-23T06:49:19.620285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:25:27.650673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'10","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:41.065242+0000","last_change":"2026-02-23T06:21:18.141648+0000","last_active":"2026-02-23T06:50:41.065242+0000","last_peered":"2026-02-23T06:50:41.065242+0000","last_clean":"2026-02-23T06:50:41.065242+0000","last_became_active":"2026-02-23T06:21:18.141449+0000","last_became_peered":"2026-02-23T06:21:18.141449+0000","last_unstale":"2026-02-23T06:50:41.065242+0000","last_undegraded":"2026-02-23T06:50:41.065242+0000","last_fullsized":"2026-02-23T06:50:41.065242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:33:18.986892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.059906+0000","last_change":"2026-02-23T06:21:18.142536+0000","last_active":"2026-02-23T06:49:41.059906+0000","last_peered":"2026-02-23T06:49:41.059906+0000","last_clean":"2026-02-23T06:49:41.059906+0000","last_became_active":"2026-02-23T06:21:18.142359+0000","last_became_peered":"2026-02-23T06:21:18.142359+0000","last_unstale":"2026-02-23T06:49:41.059906+0000","last_undegraded":"2026-02-23T06:49:41.059906+0000","last_fullsized":"2026-02-23T06:49:41.059906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:54:09.503227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'8","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:29.522014+0000","last_change":"2026-02-23T06:21:18.156667+0000","last_active":"2026-02-23T06:50:29.522014+0000","last_peered":"2026-02-23T06:50:29.522014+0000","last_clean":"2026-02-23T06:50:29.522014+0000","last_became_active":"2026-02-23T06:21:18.156564+0000","last_became_peered":"2026-02-23T06:21:18.156564+0000","last_unstale":"2026-02-23T06:50:29.522014+0000","last_undegraded":"2026-02-23T06:50:29.522014+0000","last_fullsized":"2026-02-23T06:50:29.522014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:11:13.967668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3565158400,"num_objects":850,"num_object_clones":0,"num_object_copies":3400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":850,"num_whiteouts":0,"num_read":1,"num_read_kb":3,"num_write":756886,"num_write_kb":39381923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1713389568,"data_stored":7130316800,"data_compressed":418887520,"data_compressed_allocated":1014562816,"data_compressed_original":6431490048,"omap_allocated":0,"internal_metadata":0},"log_size":60070,"ondisk_log_size":60070,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":687,"ondisk_log_size":687,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":13232698,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":30,"num_read_kb":99,"num_write":2238,"num_write_kb":14657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13828096,"data_stored":26465396,"data_compressed":2652502,"data_compressed_allocated":3489792,"data_compressed_original":16187392,"omap_allocated":629893,"internal_metadata":0},"log_size":2092,"ondisk_log_size":2092,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70172,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575216,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":519516,"kb_used_data":257996,"kb_used_omap":128,"kb_used_meta":261375,"kb_avail":93852324,"statfs":{"total":96636764160,"available":96104779776,"internally_reserved":0,"allocated":264187904,"data_stored":1087033247,"data_compressed":63788459,"data_compressed_allocated":155418624,"data_compressed_original":978444288,"omap_allocated":131483,"internal_metadata":267648613},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575217,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":496264,"kb_used_data":234744,"kb_used_omap":20,"kb_used_meta":261483,"kb_avail":93875576,"statfs":{"total":96636764160,"available":96128589824,"internally_reserved":0,"allocated":240377856,"data_stored":1015218693,"data_compressed":59697398,"data_compressed_allocated":143745024,"data_compressed_original":918769664,"omap_allocated":20978,"internal_metadata":267759118},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575218,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":454856,"kb_used_data":229432,"kb_used_omap":17,"kb_used_meta":225390,"kb_avail":93916984,"statfs":{"total":96636764160,"available":96170991616,"internally_reserved":0,"allocated":234938368,"data_stored":966905145,"data_compressed":56345986,"data_compressed_allocated":135413760,"data_compressed_original":867553280,"omap_allocated":17420,"internal_metadata":230800372},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575219,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":406156,"kb_used_data":198780,"kb_used_omap":43,"kb_used_meta":207316,"kb_avail":93965684,"statfs":{"total":96636764160,"available":96220860416,"internally_reserved":0,"allocated":203550720,"data_stored":845939717,"data_compressed":49159380,"data_compressed_allocated":117428224,"data_compressed_original":760004608,"omap_allocated":44556,"internal_metadata":212292084},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575218,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":398512,"kb_used_data":191136,"kb_used_omap":238,"kb_used_meta":207121,"kb_avail":93973328,"statfs":{"total":96636764160,"available":96228687872,"internally_reserved":0,"allocated":195723264,"data_stored":805995173,"data_compressed":47782846,"data_compressed_allocated":115453952,"data_compressed_original":725913600,"omap_allocated":243898,"internal_metadata":212092742},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575217,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":513096,"kb_used_data":251576,"kb_used_omap":48,"kb_used_meta":261455,"kb_avail":93858744,"statfs":{"total":96636764160,"available":96111353856,"internally_reserved":0,"allocated":257613824,"data_stored":1063944085,"data_compressed":62960251,"data_compressed_allocated":152305664,"data_compressed_original":958812160,"omap_allocated":49901,"internal_metadata":267730195},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575216,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":377884,"kb_used_data":188556,"kb_used_omap":16,"kb_used_meta":189295,"kb_avail":93993956,"statfs":{"total":96636764160,"available":96249810944,"internally_reserved":0,"allocated":193081344,"data_stored":794939375,"data_compressed":47425382,"data_compressed_allocated":114155520,"data_compressed_original":716193792,"omap_allocated":16904,"internal_metadata":193838584},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575216,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308196,"kb_used_data":136916,"kb_used_omap":192,"kb_used_meta":171071,"kb_avail":94063644,"statfs":{"total":96636764160,"available":96321171456,"internally_reserved":0,"allocated":140201984,"data_stored":578932081,"data_compressed":34450492,"data_compressed_allocated":84221952,"data_compressed_original":523132928,"omap_allocated":197353,"internal_metadata":175176983},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":177910,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":126753,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3362816,"data_stored":8389302,"data_compressed":1069508,"data_compressed_allocated":1413120,"data_compressed_original":6447104,"omap_allocated":8580,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1941504,"data_stored":4764252,"data_compressed":535205,"data_compressed_allocated":708608,"data_compressed_original":3534848,"omap_allocated":32915,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1777664,"data_stored":4765036,"data_compressed":679663,"data_compressed_allocated":884736,"data_compressed_original":3887104,"omap_allocated":232920,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3366912,"data_stored":4273324,"data_compressed":184063,"data_compressed_allocated":241664,"data_compressed_original":1159168,"omap_allocated":36527,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3284992,"data_stored":4194304,"data_compressed":181645,"data_compressed_allocated":237568,"data_compressed_original":1146880,"omap_allocated":4760,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":79052,"data_compressed":2418,"data_compressed_allocated":4096,"data_compressed_original":12288,"omap_allocated":9528,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":139902976,"data_stored":578813952,"data_compressed":34450492,"data_compressed_allocated":84221952,"data_compressed_original":523132928,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":263827456,"data_stored":1086324736,"data_compressed":63753373,"data_compressed_allocated":155373568,"data_compressed_original":977870848,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":189427712,"data_stored":786432000,"data_compressed":46355874,"data_compressed_allocated":112742400,"data_compressed_original":709746688,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":255381504,"data_stored":1059061760,"data_compressed":62425046,"data_compressed_allocated":151597056,"data_compressed_original":955277312,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":193654784,"data_stored":801112064,"data_compressed":47103183,"data_compressed_allocated":114569216,"data_compressed_original":722026496,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":199827456,"data_stored":840957952,"data_compressed":48940231,"data_compressed_allocated":117141504,"data_compressed_original":758272000,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":231362560,"data_stored":962592768,"data_compressed":56164341,"data_compressed_allocated":135176192,"data_compressed_original":866406400,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":240005120,"data_stored":1015021568,"data_compressed":59694980,"data_compressed_allocated":143740928,"data_compressed_original":918757376,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T06:51:40.335 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-23T06:51:40.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.557+0000 7f39b7fff640 1 -- 10.20.193.58:0/2877431092 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f39b815d4a0 msgr2=0x7f39b80affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:40.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.557+0000 7f39b7fff640 1 --2- 10.20.193.58:0/2877431092 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f39b815d4a0 0x7f39b80affb0 secure :-1 s=READY pgs=17 gs=3 cs=0 l=1 c_cookie=4827655717295475530 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39b80b5230 tx=0x7f39ac02f1b0 comp rx=0 tx=0).stop 2026-02-23T06:51:40.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.558+0000 7f39b7fff640 1 -- 10.20.193.58:0/2877431092 shutdown_connections 2026-02-23T06:51:40.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.558+0000 7f39b7fff640 1 --2- 10.20.193.58:0/2877431092 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f39b815d4a0 0x7f39b80affb0 unknown :-1 s=CLOSED pgs=17 gs=3 cs=0 l=1 c_cookie=4827655717295475530 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:40.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.558+0000 7f39b7fff640 1 -- 10.20.193.58:0/2877431092 >> 10.20.193.58:0/2877431092 conn(0x7f39b80b3c20 msgr2=0x7f39b80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:40.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.558+0000 7f39b7fff640 1 -- 10.20.193.58:0/2877431092 shutdown_connections 2026-02-23T06:51:40.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.558+0000 7f39b7fff640 1 -- 10.20.193.58:0/2877431092 wait complete. 2026-02-23T06:51:40.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.559+0000 7f39b7fff640 1 Processor -- start 2026-02-23T06:51:40.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.559+0000 7f39b7fff640 1 -- start start 2026-02-23T06:51:40.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.559+0000 7f39b7fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f39b80b6690 0x7f39b813f280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:40.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.559+0000 7f39b7fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f39b815d4a0 0x7f39b81fe810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:40.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.559+0000 7f39b7fff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f39b815d870 0x7f39b81449f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:40.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.560+0000 7f39b7fff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f39b81fe3f0 con 0x7f39b815d4a0 2026-02-23T06:51:40.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.560+0000 7f39b7fff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f39b8144f30 con 0x7f39b815d870 2026-02-23T06:51:40.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.560+0000 7f39b7fff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f39b81fdd50 con 0x7f39b80b6690 2026-02-23T06:51:40.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.560+0000 7f39b67fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f39b815d4a0 0x7f39b81fe810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:40.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.560+0000 7f39b77fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f39b815d870 0x7f39b81449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:40.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.560+0000 7f39b67fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f39b815d4a0 0x7f39b81fe810 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50126/0 (socket says 10.20.193.58:50126) 2026-02-23T06:51:40.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.560+0000 7f39b67fc640 1 -- 10.20.193.58:0/3883967015 learned_addr learned my addr 10.20.193.58:0/3883967015 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:51:40.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.560+0000 7f39b6ffd640 1 --2- 10.20.193.58:0/3883967015 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f39b80b6690 0x7f39b813f280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:40.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.560+0000 7f39b67fc640 1 -- 10.20.193.58:0/3883967015 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f39b80b6690 msgr2=0x7f39b813f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:40.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.560+0000 7f39b67fc640 1 --2- 10.20.193.58:0/3883967015 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f39b80b6690 0x7f39b813f280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:40.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.560+0000 7f39b67fc640 1 -- 10.20.193.58:0/3883967015 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f39b815d870 msgr2=0x7f39b81449f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:40.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.560+0000 7f39b67fc640 1 --2- 10.20.193.58:0/3883967015 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f39b815d870 0x7f39b81449f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:40.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.560+0000 7f39b67fc640 1 -- 10.20.193.58:0/3883967015 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39ac0094b0 con 0x7f39b815d4a0 2026-02-23T06:51:40.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.560+0000 7f39b67fc640 1 --2- 10.20.193.58:0/3883967015 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f39b815d4a0 0x7f39b81fe810 secure :-1 s=READY pgs=163 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39a000c4d0 tx=0x7f39a000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:40.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.561+0000 7f398ffff640 1 -- 10.20.193.58:0/3883967015 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f39a0004240 con 0x7f39b815d4a0 2026-02-23T06:51:40.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.561+0000 7f398ffff640 1 -- 10.20.193.58:0/3883967015 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39a0004490 con 0x7f39b815d4a0 2026-02-23T06:51:40.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.561+0000 7f398ffff640 1 -- 10.20.193.58:0/3883967015 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f39a0006af0 con 0x7f39b815d4a0 2026-02-23T06:51:40.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.561+0000 7f39b7fff640 1 -- 10.20.193.58:0/3883967015 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39b813c9c0 con 0x7f39b815d4a0 2026-02-23T06:51:40.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.561+0000 7f39b7fff640 1 -- 10.20.193.58:0/3883967015 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39b813cf80 con 0x7f39b815d4a0 2026-02-23T06:51:40.556 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.561+0000 7f398dffb640 1 -- 10.20.193.58:0/3883967015 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39b80b0110 con 0x7f39b815d4a0 2026-02-23T06:51:40.557 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.563+0000 7f398ffff640 1 -- 10.20.193.58:0/3883967015 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f39a0006c50 con 0x7f39b815d4a0 2026-02-23T06:51:40.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.563+0000 7f398ffff640 1 --2- 10.20.193.58:0/3883967015 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f398807a790 0x7f398809ac40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:40.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.563+0000 7f398ffff640 1 -- 10.20.193.58:0/3883967015 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f39a00694d0 con 0x7f39b815d4a0 2026-02-23T06:51:40.558 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.564+0000 7f39b6ffd640 1 --2- 10.20.193.58:0/3883967015 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f398807a790 0x7f398809ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:40.559 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.564+0000 7f39b6ffd640 1 --2- 10.20.193.58:0/3883967015 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f398807a790 0x7f398809ac40 secure :-1 s=READY pgs=605 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39ac0023d0 tx=0x7f39ac03a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:40.560 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.566+0000 7f398ffff640 1 -- 10.20.193.58:0/3883967015 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f39a0060160 con 0x7f39b815d4a0 2026-02-23T06:51:40.676 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.681+0000 7f398dffb640 1 -- 10.20.193.58:0/3883967015 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39b80b1300 con 0x7f39b815d4a0 2026-02-23T06:51:40.677 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.682+0000 7f398ffff640 1 -- 10.20.193.58:0/3883967015 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18696 (secure 0 0 0) 0x7f39a0060300 con 0x7f39b815d4a0 2026-02-23T06:51:40.677 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:51:40.677 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":27,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","created":"2026-02-23T06:21:02.010508+0000","modified":"2026-02-23T06:22:05.841021+0000","last_up_change":"2026-02-23T06:21:08.383048+0000","last_in_change":"2026-02-23T06:21:04.690899+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-23T06:21:10.389081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-23T06:21:16.080621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-23T06:21:16.401311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-23T06:21:20.153808+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"96cc0898-14bb-4d56-827a-8845bd4307c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6808","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6809","nonce":692913334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6810","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6811","nonce":692913334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6814","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6815","nonce":692913334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6812","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6813","nonce":692913334}]},"public_addr":"10.20.193.58:6809/692913334","cluster_addr":"10.20.193.58:6811/692913334","heartbeat_back_addr":"10.20.193.58:6815/692913334","heartbeat_front_addr":"10.20.193.58:6813/692913334","state":["exists","up"]},{"osd":1,"uuid":"bf665af4-6e3c-4cb3-899c-acede65c31f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6800","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6801","nonce":1850584280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6802","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6803","nonce":1850584280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6806","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6807","nonce":1850584280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6804","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6805","nonce":1850584280}]},"public_addr":"10.20.193.58:6801/1850584280","cluster_addr":"10.20.193.58:6803/1850584280","heartbeat_back_addr":"10.20.193.58:6807/1850584280","heartbeat_front_addr":"10.20.193.58:6805/1850584280","state":["exists","up"]},{"osd":2,"uuid":"2bcb3165-28ad-45d6-9a49-9d9da08501f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6823","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6825","nonce":4284600061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6826","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6827","nonce":4284600061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6830","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6831","nonce":4284600061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6828","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6829","nonce":4284600061}]},"public_addr":"10.20.193.58:6825/4284600061","cluster_addr":"10.20.193.58:6827/4284600061","heartbeat_back_addr":"10.20.193.58:6831/4284600061","heartbeat_front_addr":"10.20.193.58:6829/4284600061","state":["exists","up"]},{"osd":3,"uuid":"4750309a-5bf2-4f48-a550-ca677b0b0f61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6816","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6817","nonce":2858636994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6818","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6819","nonce":2858636994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6822","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6824","nonce":2858636994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6820","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6821","nonce":2858636994}]},"public_addr":"10.20.193.58:6817/2858636994","cluster_addr":"10.20.193.58:6819/2858636994","heartbeat_back_addr":"10.20.193.58:6824/2858636994","heartbeat_front_addr":"10.20.193.58:6821/2858636994","state":["exists","up"]},{"osd":4,"uuid":"5cbb50f2-4e49-46eb-bd84-d92706459d2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6803","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6805","nonce":1874834171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6807","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6809","nonce":1874834171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6816","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6817","nonce":1874834171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6812","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6814","nonce":1874834171}]},"public_addr":"10.20.193.93:6805/1874834171","cluster_addr":"10.20.193.93:6809/1874834171","heartbeat_back_addr":"10.20.193.93:6817/1874834171","heartbeat_front_addr":"10.20.193.93:6814/1874834171","state":["exists","up"]},{"osd":5,"uuid":"2806c775-4720-43a7-ab9f-85a4adb31098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6802","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6804","nonce":356968280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6806","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6808","nonce":356968280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6813","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6815","nonce":356968280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6810","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6811","nonce":356968280}]},"public_addr":"10.20.193.93:6804/356968280","cluster_addr":"10.20.193.93:6808/356968280","heartbeat_back_addr":"10.20.193.93:6815/356968280","heartbeat_front_addr":"10.20.193.93:6811/356968280","state":["exists","up"]},{"osd":6,"uuid":"aa03b46d-d30f-4b09-9251-c9514e8b8b6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6819","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6821","nonce":2948039088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6823","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6825","nonce":2948039088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6831","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6833","nonce":2948039088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6827","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6829","nonce":2948039088}]},"public_addr":"10.20.193.93:6821/2948039088","cluster_addr":"10.20.193.93:6825/2948039088","heartbeat_back_addr":"10.20.193.93:6833/2948039088","heartbeat_front_addr":"10.20.193.93:6829/2948039088","state":["exists","up"]},{"osd":7,"uuid":"b15519bf-2b7b-4fd5-8ef6-e09af0ad9817","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6818","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6820","nonce":2960650087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6822","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6824","nonce":2960650087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6830","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6832","nonce":2960650087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6826","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6828","nonce":2960650087}]},"public_addr":"10.20.193.93:6820/2960650087","cluster_addr":"10.20.193.93:6824/2960650087","heartbeat_back_addr":"10.20.193.93:6832/2960650087","heartbeat_front_addr":"10.20.193.93:6828/2960650087","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.717515+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.744114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.772247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.768341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.521808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.486005+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.480882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.473408+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1d","mappings":[{"from":0,"to":7}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"2","m":"2","plugin":"isa","technique":"reed_sol_van"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-23T06:51:40.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.682+0000 7f398dffb640 1 -- 10.20.193.58:0/3883967015 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f398807a790 msgr2=0x7f398809ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:40.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.682+0000 7f398dffb640 1 --2- 10.20.193.58:0/3883967015 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f398807a790 0x7f398809ac40 secure :-1 s=READY pgs=605 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39ac0023d0 tx=0x7f39ac03a040 comp rx=0 tx=0).stop 2026-02-23T06:51:40.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.683+0000 7f398dffb640 1 -- 10.20.193.58:0/3883967015 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f39b815d4a0 msgr2=0x7f39b81fe810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:40.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.683+0000 7f398dffb640 1 --2- 10.20.193.58:0/3883967015 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f39b815d4a0 0x7f39b81fe810 secure :-1 s=READY pgs=163 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39a000c4d0 tx=0x7f39a000c9a0 comp rx=0 tx=0).stop 2026-02-23T06:51:40.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.683+0000 7f398dffb640 1 -- 10.20.193.58:0/3883967015 shutdown_connections 2026-02-23T06:51:40.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.683+0000 7f398dffb640 1 --2- 10.20.193.58:0/3883967015 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f398807a790 0x7f398809ac40 unknown :-1 s=CLOSED pgs=605 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:40.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.683+0000 7f398dffb640 1 --2- 10.20.193.58:0/3883967015 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f39b815d870 0x7f39b81449f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:40.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.683+0000 7f398dffb640 1 --2- 10.20.193.58:0/3883967015 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f39b815d4a0 0x7f39b81fe810 unknown :-1 s=CLOSED pgs=163 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:40.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.683+0000 7f398dffb640 1 --2- 10.20.193.58:0/3883967015 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f39b80b6690 0x7f39b813f280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:40.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.683+0000 7f398dffb640 1 -- 10.20.193.58:0/3883967015 >> 10.20.193.58:0/3883967015 conn(0x7f39b80b3c20 msgr2=0x7f39b81629b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:40.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.683+0000 7f398dffb640 1 -- 10.20.193.58:0/3883967015 shutdown_connections 2026-02-23T06:51:40.678 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:40.683+0000 7f398dffb640 1 -- 10.20.193.58:0/3883967015 wait complete. 2026-02-23T06:51:41.690 INFO:tasks.ceph:Scrubbing osd.0 2026-02-23T06:51:41.690 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-23T06:51:41.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.861+0000 7f901bfff640 1 -- 10.20.193.58:0/3220000388 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f901404f170 msgr2=0x7f9014035070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:41.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.861+0000 7f901bfff640 1 --2- 10.20.193.58:0/3220000388 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f901404f170 0x7f9014035070 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=12272503490866844586 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9004005e70 tx=0x7f900402f320 comp rx=0 tx=0).stop 2026-02-23T06:51:41.857 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.862+0000 7f901bfff640 1 -- 10.20.193.58:0/3220000388 shutdown_connections 2026-02-23T06:51:41.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.862+0000 7f901bfff640 1 --2- 10.20.193.58:0/3220000388 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f901404f170 0x7f9014035070 unknown :-1 s=CLOSED pgs=18 gs=2 cs=0 l=1 c_cookie=12272503490866844586 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:41.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.862+0000 7f901bfff640 1 --2- 10.20.193.58:0/3220000388 >> v2:10.20.193.58:3300/0 conn(0x7f90140fb710 0x7f901404ec30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:41.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.862+0000 7f901bfff640 1 -- 10.20.193.58:0/3220000388 >> 10.20.193.58:0/3220000388 conn(0x7f901400a260 msgr2=0x7f901400b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:41.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.862+0000 7f901bfff640 1 -- 10.20.193.58:0/3220000388 shutdown_connections 2026-02-23T06:51:41.858 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.862+0000 7f901bfff640 1 -- 10.20.193.58:0/3220000388 wait complete. 2026-02-23T06:51:41.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.863+0000 7f901bfff640 1 Processor -- start 2026-02-23T06:51:41.860 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.864+0000 7f901bfff640 1 -- start start 2026-02-23T06:51:41.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.864+0000 7f901bfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f901404f170 0x7f90140f8470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:41.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.864+0000 7f901bfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f90140f5aa0 0x7f90140d4170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:41.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.864+0000 7f901bfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f90140fb710 0x7f90140f1d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:41.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.864+0000 7f901bfff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f90140f8ee0 con 0x7f90140f5aa0 2026-02-23T06:51:41.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.864+0000 7f901bfff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f90140f2940 con 0x7f901404f170 2026-02-23T06:51:41.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.864+0000 7f901bfff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f90140feb10 con 0x7f90140fb710 2026-02-23T06:51:41.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.865+0000 7f901affd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f901404f170 0x7f90140f8470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:41.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.865+0000 7f901affd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f901404f170 0x7f90140f8470 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:43296/0 (socket says 10.20.193.58:43296) 2026-02-23T06:51:41.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.866+0000 7f901affd640 1 -- 10.20.193.58:0/186441926 learned_addr learned my addr 10.20.193.58:0/186441926 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:51:41.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.867+0000 7f901b7fe640 1 --2- 10.20.193.58:0/186441926 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f90140fb710 0x7f90140f1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:41.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.867+0000 7f901a7fc640 1 --2- 10.20.193.58:0/186441926 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f90140f5aa0 0x7f90140d4170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:41.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.871+0000 7f901a7fc640 1 -- 10.20.193.58:0/186441926 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f90140fb710 msgr2=0x7f90140f1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:41.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.871+0000 7f901a7fc640 1 --2- 10.20.193.58:0/186441926 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f90140fb710 0x7f90140f1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:41.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.871+0000 7f901a7fc640 1 -- 10.20.193.58:0/186441926 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f901404f170 msgr2=0x7f90140f8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:41.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.871+0000 7f901a7fc640 1 --2- 10.20.193.58:0/186441926 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f901404f170 0x7f90140f8470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:41.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.871+0000 7f901a7fc640 1 -- 10.20.193.58:0/186441926 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9004009570 con 0x7f90140f5aa0 2026-02-23T06:51:41.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.872+0000 7f901affd640 1 --2- 10.20.193.58:0/186441926 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f901404f170 0x7f90140f8470 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:51:41.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.872+0000 7f901b7fe640 1 --2- 10.20.193.58:0/186441926 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f90140fb710 0x7f90140f1d90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-23T06:51:41.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.872+0000 7f901a7fc640 1 --2- 10.20.193.58:0/186441926 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f90140f5aa0 0x7f90140d4170 secure :-1 s=READY pgs=164 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f901000d720 tx=0x7f901000dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:41.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.874+0000 7f8ffb7fe640 1 -- 10.20.193.58:0/186441926 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9010004500 con 0x7f90140f5aa0 2026-02-23T06:51:41.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.874+0000 7f8ffb7fe640 1 -- 10.20.193.58:0/186441926 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90100097c0 con 0x7f90140f5aa0 2026-02-23T06:51:41.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.874+0000 7f8ffb7fe640 1 -- 10.20.193.58:0/186441926 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9010009bb0 con 0x7f90140f5aa0 2026-02-23T06:51:41.869 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.874+0000 7f901bfff640 1 -- 10.20.193.58:0/186441926 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90140f2b90 con 0x7f90140f5aa0 2026-02-23T06:51:41.870 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.876+0000 7f901bfff640 1 -- 10.20.193.58:0/186441926 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90140f63a0 con 0x7f90140f5aa0 2026-02-23T06:51:41.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.876+0000 7f901bfff640 1 -- 10.20.193.58:0/186441926 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f901404f990 con 0x7f90140f5aa0 2026-02-23T06:51:41.871 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.877+0000 7f8ffb7fe640 1 -- 10.20.193.58:0/186441926 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f9010009d10 con 0x7f90140f5aa0 2026-02-23T06:51:41.877 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.878+0000 7f8ffb7fe640 1 --2- 10.20.193.58:0/186441926 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8fec07a790 0x7f8fec09ac40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:41.877 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.878+0000 7f8ffb7fe640 1 -- 10.20.193.58:0/186441926 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f901009cd00 con 0x7f90140f5aa0 2026-02-23T06:51:41.877 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.878+0000 7f8ffb7fe640 1 --2- 10.20.193.58:0/186441926 >> [v2:10.20.193.58:6808/692913334,v1:10.20.193.58:6809/692913334] conn(0x7f8fec0a1d20 0x7f8fec0c2190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:41.877 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.878+0000 7f8ffb7fe640 1 -- 10.20.193.58:0/186441926 --> [v2:10.20.193.58:6808/692913334,v1:10.20.193.58:6809/692913334] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8fec0c2860 con 0x7f8fec0a1d20 2026-02-23T06:51:41.877 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.878+0000 7f8ffb7fe640 1 -- 10.20.193.58:0/186441926 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f901009d000 con 0x7f90140f5aa0 2026-02-23T06:51:41.877 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.878+0000 7f901affd640 1 --2- 10.20.193.58:0/186441926 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8fec07a790 0x7f8fec09ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:41.877 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.878+0000 7f901b7fe640 1 --2- 10.20.193.58:0/186441926 >> [v2:10.20.193.58:6808/692913334,v1:10.20.193.58:6809/692913334] conn(0x7f8fec0a1d20 0x7f8fec0c2190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:41.878 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.879+0000 7f901affd640 1 --2- 10.20.193.58:0/186441926 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8fec07a790 0x7f8fec09ac40 secure :-1 s=READY pgs=606 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f900c008c90 tx=0x7f900c008be0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:41.878 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.879+0000 7f901b7fe640 1 --2- 10.20.193.58:0/186441926 >> [v2:10.20.193.58:6808/692913334,v1:10.20.193.58:6809/692913334] conn(0x7f8fec0a1d20 0x7f8fec0c2190 crc :-1 s=READY pgs=110 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:41.878 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.879+0000 7f8ffb7fe640 1 -- 10.20.193.58:0/186441926 <== osd.0 v2:10.20.193.58:6808/692913334 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f8fec0c2860 con 0x7f8fec0a1d20 2026-02-23T06:51:41.886 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.892+0000 7f901bfff640 1 -- 10.20.193.58:0/186441926 --> [v2:10.20.193.58:6808/692913334,v1:10.20.193.58:6809/692913334] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f90140ff180 con 0x7f8fec0a1d20 2026-02-23T06:51:41.887 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.892+0000 7f8ffb7fe640 1 -- 10.20.193.58:0/186441926 <== osd.0 v2:10.20.193.58:6808/692913334 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8fec0c2860 con 0x7f8fec0a1d20 2026-02-23T06:51:41.887 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:51:41.888 INFO:teuthology.orchestra.run.trial058.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-23T06:51:41.888 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:51:41.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.893+0000 7f901bfff640 1 -- 10.20.193.58:0/186441926 >> [v2:10.20.193.58:6808/692913334,v1:10.20.193.58:6809/692913334] conn(0x7f8fec0a1d20 msgr2=0x7f8fec0c2190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:41.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.893+0000 7f901bfff640 1 --2- 10.20.193.58:0/186441926 >> [v2:10.20.193.58:6808/692913334,v1:10.20.193.58:6809/692913334] conn(0x7f8fec0a1d20 0x7f8fec0c2190 crc :-1 s=READY pgs=110 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:41.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.893+0000 7f901bfff640 1 -- 10.20.193.58:0/186441926 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8fec07a790 msgr2=0x7f8fec09ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:41.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.893+0000 7f901bfff640 1 --2- 10.20.193.58:0/186441926 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f8fec07a790 0x7f8fec09ac40 secure :-1 s=READY pgs=606 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f900c008c90 tx=0x7f900c008be0 comp rx=0 tx=0).stop 2026-02-23T06:51:41.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.893+0000 7f901bfff640 1 -- 10.20.193.58:0/186441926 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f90140f5aa0 msgr2=0x7f90140d4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:41.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.893+0000 7f901bfff640 1 --2- 10.20.193.58:0/186441926 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f90140f5aa0 0x7f90140d4170 secure :-1 s=READY pgs=164 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f901000d720 tx=0x7f901000dbf0 comp rx=0 tx=0).stop 2026-02-23T06:51:41.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.893+0000 7f901b7fe640 1 -- 10.20.193.58:0/186441926 reap_dead start 2026-02-23T06:51:41.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.894+0000 7f901bfff640 1 -- 10.20.193.58:0/186441926 shutdown_connections 2026-02-23T06:51:41.889 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.894+0000 7f901bfff640 1 -- 10.20.193.58:0/186441926 >> 10.20.193.58:0/186441926 conn(0x7f901400a260 msgr2=0x7f90140f3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:41.890 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.894+0000 7f901bfff640 1 -- 10.20.193.58:0/186441926 shutdown_connections 2026-02-23T06:51:41.890 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:41.894+0000 7f901bfff640 1 -- 10.20.193.58:0/186441926 wait complete. 2026-02-23T06:51:41.909 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-23T06:51:42.098 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.103+0000 7f02eeccc640 1 -- 10.20.193.58:0/1181445485 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f02e80b62f0 msgr2=0x7f02e80b45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:42.099 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.103+0000 7f02eeccc640 1 --2- 10.20.193.58:0/1181445485 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f02e80b62f0 0x7f02e80b45f0 secure :-1 s=READY pgs=186 gs=3 cs=0 l=1 c_cookie=14514606561679934915 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02d4004740 tx=0x7f02d402f130 comp rx=0 tx=0).stop 2026-02-23T06:51:42.099 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.103+0000 7f02eeccc640 1 -- 10.20.193.58:0/1181445485 shutdown_connections 2026-02-23T06:51:42.099 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.103+0000 7f02eeccc640 1 --2- 10.20.193.58:0/1181445485 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f02e80b62f0 0x7f02e80b45f0 unknown :-1 s=CLOSED pgs=186 gs=3 cs=0 l=1 c_cookie=14514606561679934915 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.099 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.103+0000 7f02eeccc640 1 -- 10.20.193.58:0/1181445485 >> 10.20.193.58:0/1181445485 conn(0x7f02e8058e50 msgr2=0x7f02e8059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:42.099 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.103+0000 7f02eeccc640 1 -- 10.20.193.58:0/1181445485 shutdown_connections 2026-02-23T06:51:42.099 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.103+0000 7f02eeccc640 1 -- 10.20.193.58:0/1181445485 wait complete. 2026-02-23T06:51:42.102 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.104+0000 7f02eeccc640 1 Processor -- start 2026-02-23T06:51:42.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.104+0000 7f02eeccc640 1 -- start start 2026-02-23T06:51:42.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.105+0000 7f02eeccc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f02e80b4b30 0x7f02e8139910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:42.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.105+0000 7f02eeccc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02e80b62f0 0x7f02e80affe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:42.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.105+0000 7f02eeccc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f02e815d240 0x7f02e80b0520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:42.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.105+0000 7f02eeccc640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f02e8140ff0 con 0x7f02e80b62f0 2026-02-23T06:51:42.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.105+0000 7f02eeccc640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f02e813a4e0 con 0x7f02e815d240 2026-02-23T06:51:42.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.105+0000 7f02eeccc640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f02e8139e50 con 0x7f02e80b4b30 2026-02-23T06:51:42.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.105+0000 7f02e7fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02e80b62f0 0x7f02e80affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:42.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.105+0000 7f02e7fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02e80b62f0 0x7f02e80affe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50144/0 (socket says 10.20.193.58:50144) 2026-02-23T06:51:42.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.105+0000 7f02e7fff640 1 -- 10.20.193.58:0/2324600221 learned_addr learned my addr 10.20.193.58:0/2324600221 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:51:42.103 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.105+0000 7f02eca41640 1 --2- 10.20.193.58:0/2324600221 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f02e80b4b30 0x7f02e8139910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:42.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.105+0000 7f02ed242640 1 --2- 10.20.193.58:0/2324600221 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f02e815d240 0x7f02e80b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:42.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.106+0000 7f02e7fff640 1 -- 10.20.193.58:0/2324600221 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f02e80b4b30 msgr2=0x7f02e8139910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:42.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.106+0000 7f02e7fff640 1 --2- 10.20.193.58:0/2324600221 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f02e80b4b30 0x7f02e8139910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.106+0000 7f02e7fff640 1 -- 10.20.193.58:0/2324600221 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f02e815d240 msgr2=0x7f02e80b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:42.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.106+0000 7f02e7fff640 1 --2- 10.20.193.58:0/2324600221 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f02e815d240 0x7f02e80b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.106+0000 7f02e7fff640 1 -- 10.20.193.58:0/2324600221 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d40094b0 con 0x7f02e80b62f0 2026-02-23T06:51:42.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.106+0000 7f02ed242640 1 --2- 10.20.193.58:0/2324600221 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f02e815d240 0x7f02e80b0520 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:51:42.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.106+0000 7f02e7fff640 1 --2- 10.20.193.58:0/2324600221 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02e80b62f0 0x7f02e80affe0 secure :-1 s=READY pgs=166 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02d4009230 tx=0x7f02d40028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:42.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.106+0000 7f02e57fa640 1 -- 10.20.193.58:0/2324600221 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f02d403c040 con 0x7f02e80b62f0 2026-02-23T06:51:42.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.106+0000 7f02eeccc640 1 -- 10.20.193.58:0/2324600221 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02e813a220 con 0x7f02e80b62f0 2026-02-23T06:51:42.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.106+0000 7f02e57fa640 1 -- 10.20.193.58:0/2324600221 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02d4038470 con 0x7f02e80b62f0 2026-02-23T06:51:42.104 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.106+0000 7f02e57fa640 1 -- 10.20.193.58:0/2324600221 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f02d4038840 con 0x7f02e80b62f0 2026-02-23T06:51:42.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.106+0000 7f02eeccc640 1 -- 10.20.193.58:0/2324600221 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02e8140d50 con 0x7f02e80b62f0 2026-02-23T06:51:42.105 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.107+0000 7f02eeccc640 1 -- 10.20.193.58:0/2324600221 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02e813a620 con 0x7f02e80b62f0 2026-02-23T06:51:42.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.108+0000 7f02e57fa640 1 -- 10.20.193.58:0/2324600221 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f02d40389a0 con 0x7f02e80b62f0 2026-02-23T06:51:42.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.109+0000 7f02e57fa640 1 --2- 10.20.193.58:0/2324600221 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f02c007a6c0 0x7f02c009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:42.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.109+0000 7f02e57fa640 1 -- 10.20.193.58:0/2324600221 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f02d40c25a0 con 0x7f02e80b62f0 2026-02-23T06:51:42.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.109+0000 7f02eca41640 1 --2- 10.20.193.58:0/2324600221 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f02c007a6c0 0x7f02c009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:42.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.110+0000 7f02eca41640 1 --2- 10.20.193.58:0/2324600221 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f02c007a6c0 0x7f02c009ab70 secure :-1 s=READY pgs=607 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02dc003780 tx=0x7f02dc008e90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:42.106 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.111+0000 7f02e57fa640 1 -- 10.20.193.58:0/2324600221 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f02e813a620 con 0x7f02e80b62f0 2026-02-23T06:51:42.220 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.226+0000 7f02eeccc640 1 -- 10.20.193.58:0/2324600221 --> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f02e80b56b0 con 0x7f02c007a6c0 2026-02-23T06:51:42.221 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.226+0000 7f02e57fa640 1 -- 10.20.193.58:0/2324600221 <== mgr.4126 v2:10.20.193.93:6800/4124709854 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f02dc0107e0 con 0x7f02c007a6c0 2026-02-23T06:51:42.221 INFO:teuthology.orchestra.run.trial058.stderr:instructed osd(s) 0 to deep-scrub 2026-02-23T06:51:42.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.227+0000 7f02eeccc640 1 -- 10.20.193.58:0/2324600221 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f02c007a6c0 msgr2=0x7f02c009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:42.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.227+0000 7f02eeccc640 1 --2- 10.20.193.58:0/2324600221 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f02c007a6c0 0x7f02c009ab70 secure :-1 s=READY pgs=607 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02dc003780 tx=0x7f02dc008e90 comp rx=0 tx=0).stop 2026-02-23T06:51:42.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.227+0000 7f02eeccc640 1 -- 10.20.193.58:0/2324600221 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02e80b62f0 msgr2=0x7f02e80affe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:42.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.227+0000 7f02eeccc640 1 --2- 10.20.193.58:0/2324600221 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02e80b62f0 0x7f02e80affe0 secure :-1 s=READY pgs=166 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02d4009230 tx=0x7f02d40028d0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.227+0000 7f02eeccc640 1 -- 10.20.193.58:0/2324600221 shutdown_connections 2026-02-23T06:51:42.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.227+0000 7f02eeccc640 1 --2- 10.20.193.58:0/2324600221 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f02c007a6c0 0x7f02c009ab70 unknown :-1 s=CLOSED pgs=607 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.227+0000 7f02eeccc640 1 --2- 10.20.193.58:0/2324600221 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f02e815d240 0x7f02e80b0520 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.227+0000 7f02eeccc640 1 --2- 10.20.193.58:0/2324600221 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f02e80b62f0 0x7f02e80affe0 unknown :-1 s=CLOSED pgs=166 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.227+0000 7f02eeccc640 1 --2- 10.20.193.58:0/2324600221 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f02e80b4b30 0x7f02e8139910 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.228+0000 7f02eeccc640 1 -- 10.20.193.58:0/2324600221 >> 10.20.193.58:0/2324600221 conn(0x7f02e8058e50 msgr2=0x7f02e813dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:42.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.228+0000 7f02eeccc640 1 -- 10.20.193.58:0/2324600221 shutdown_connections 2026-02-23T06:51:42.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.228+0000 7f02eeccc640 1 -- 10.20.193.58:0/2324600221 wait complete. 2026-02-23T06:51:42.234 INFO:tasks.ceph:Scrubbing osd.1 2026-02-23T06:51:42.234 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-23T06:51:42.359 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.364+0000 7f86c7577640 1 -- 10.20.193.58:0/542789709 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f86b4005200 msgr2=0x7f86b4065a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:42.359 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.364+0000 7f86c7577640 1 --2- 10.20.193.58:0/542789709 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f86b4005200 0x7f86b4065a10 secure :-1 s=READY pgs=168 gs=6 cs=0 l=1 c_cookie=16345873193424814871 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86b8004080 tx=0x7f86b8030250 comp rx=0 tx=0).stop 2026-02-23T06:51:42.359 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.364+0000 7f86c7577640 1 -- 10.20.193.58:0/542789709 shutdown_connections 2026-02-23T06:51:42.359 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.364+0000 7f86c7577640 1 --2- 10.20.193.58:0/542789709 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f86b4005200 0x7f86b4065a10 unknown :-1 s=CLOSED pgs=168 gs=6 cs=0 l=1 c_cookie=16345873193424814871 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.359 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.364+0000 7f86c7577640 1 -- 10.20.193.58:0/542789709 >> 10.20.193.58:0/542789709 conn(0x7f86c80b3c20 msgr2=0x7f86c80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:42.359 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.364+0000 7f86c7577640 1 -- 10.20.193.58:0/542789709 shutdown_connections 2026-02-23T06:51:42.359 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.364+0000 7f86c7577640 1 -- 10.20.193.58:0/542789709 wait complete. 2026-02-23T06:51:42.360 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.365+0000 7f86c7577640 1 Processor -- start 2026-02-23T06:51:42.360 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.365+0000 7f86c7577640 1 -- start start 2026-02-23T06:51:42.360 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.366+0000 7f86c7577640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86b4005200 0x7f86c811fad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:42.360 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.366+0000 7f86c7577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f86c815a970 0x7f86c814dc60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:42.360 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.366+0000 7f86c7577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f86c8124100 0x7f86c8162500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:42.360 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.366+0000 7f86c7577640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f86c8120500 con 0x7f86c815a970 2026-02-23T06:51:42.360 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.366+0000 7f86c7577640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f86c81207e0 con 0x7f86c8124100 2026-02-23T06:51:42.360 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.366+0000 7f86c7577640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f86c8120ac0 con 0x7f86b4005200 2026-02-23T06:51:42.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.366+0000 7f86c5d74640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f86c815a970 0x7f86c814dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:42.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.366+0000 7f86c5d74640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f86c815a970 0x7f86c814dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50164/0 (socket says 10.20.193.58:50164) 2026-02-23T06:51:42.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.366+0000 7f86c5d74640 1 -- 10.20.193.58:0/2571585910 learned_addr learned my addr 10.20.193.58:0/2571585910 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:51:42.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.366+0000 7f86c6575640 1 --2- 10.20.193.58:0/2571585910 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86b4005200 0x7f86c811fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:42.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.366+0000 7f86c6d76640 1 --2- 10.20.193.58:0/2571585910 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f86c8124100 0x7f86c8162500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:42.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.366+0000 7f86c5d74640 1 -- 10.20.193.58:0/2571585910 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86b4005200 msgr2=0x7f86c811fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:42.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.366+0000 7f86c5d74640 1 --2- 10.20.193.58:0/2571585910 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f86b4005200 0x7f86c811fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.366+0000 7f86c5d74640 1 -- 10.20.193.58:0/2571585910 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f86c8124100 msgr2=0x7f86c8162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:42.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.366+0000 7f86c5d74640 1 --2- 10.20.193.58:0/2571585910 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f86c8124100 0x7f86c8162500 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.366+0000 7f86c5d74640 1 -- 10.20.193.58:0/2571585910 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c811f2d0 con 0x7f86c815a970 2026-02-23T06:51:42.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.366+0000 7f86c5d74640 1 --2- 10.20.193.58:0/2571585910 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f86c815a970 0x7f86c814dc60 secure :-1 s=READY pgs=169 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86b0002c80 tx=0x7f86b000eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:42.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.367+0000 7f86aeffd640 1 -- 10.20.193.58:0/2571585910 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f86b0004240 con 0x7f86c815a970 2026-02-23T06:51:42.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.367+0000 7f86aeffd640 1 -- 10.20.193.58:0/2571585910 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f86b000c880 con 0x7f86c815a970 2026-02-23T06:51:42.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.367+0000 7f86aeffd640 1 -- 10.20.193.58:0/2571585910 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f86b000ccb0 con 0x7f86c815a970 2026-02-23T06:51:42.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.367+0000 7f86c7577640 1 -- 10.20.193.58:0/2571585910 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c811f5b0 con 0x7f86c815a970 2026-02-23T06:51:42.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.367+0000 7f86c7577640 1 -- 10.20.193.58:0/2571585910 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c81202d0 con 0x7f86c815a970 2026-02-23T06:51:42.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.367+0000 7f86c7577640 1 -- 10.20.193.58:0/2571585910 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f86c8164250 con 0x7f86c815a970 2026-02-23T06:51:42.363 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.368+0000 7f86aeffd640 1 -- 10.20.193.58:0/2571585910 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f86b0011460 con 0x7f86c815a970 2026-02-23T06:51:42.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.369+0000 7f86aeffd640 1 --2- 10.20.193.58:0/2571585910 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f869407a6b0 0x7f869409ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:42.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.370+0000 7f86aeffd640 1 -- 10.20.193.58:0/2571585910 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f86b009da20 con 0x7f86c815a970 2026-02-23T06:51:42.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.370+0000 7f86aeffd640 1 --2- 10.20.193.58:0/2571585910 >> [v2:10.20.193.58:6800/1850584280,v1:10.20.193.58:6801/1850584280] conn(0x7f86940a1cc0 0x7f86940c2130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:42.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.370+0000 7f86aeffd640 1 -- 10.20.193.58:0/2571585910 --> [v2:10.20.193.58:6800/1850584280,v1:10.20.193.58:6801/1850584280] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f86940c2800 con 0x7f86940a1cc0 2026-02-23T06:51:42.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.370+0000 7f86aeffd640 1 -- 10.20.193.58:0/2571585910 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f86b00a22a0 con 0x7f86c815a970 2026-02-23T06:51:42.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.370+0000 7f86c6575640 1 --2- 10.20.193.58:0/2571585910 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f869407a6b0 0x7f869409ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:42.364 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.370+0000 7f86c6d76640 1 --2- 10.20.193.58:0/2571585910 >> [v2:10.20.193.58:6800/1850584280,v1:10.20.193.58:6801/1850584280] conn(0x7f86940a1cc0 0x7f86940c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:42.365 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.370+0000 7f86c6d76640 1 --2- 10.20.193.58:0/2571585910 >> [v2:10.20.193.58:6800/1850584280,v1:10.20.193.58:6801/1850584280] conn(0x7f86940a1cc0 0x7f86940c2130 crc :-1 s=READY pgs=110 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:42.365 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.371+0000 7f86c6575640 1 --2- 10.20.193.58:0/2571585910 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f869407a6b0 0x7f869409ab60 secure :-1 s=READY pgs=608 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86bc004740 tx=0x7f86bc005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:42.365 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.371+0000 7f86aeffd640 1 -- 10.20.193.58:0/2571585910 <== osd.1 v2:10.20.193.58:6800/1850584280 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f86940c2800 con 0x7f86940a1cc0 2026-02-23T06:51:42.382 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.387+0000 7f86c7577640 1 -- 10.20.193.58:0/2571585910 --> [v2:10.20.193.58:6800/1850584280,v1:10.20.193.58:6801/1850584280] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f86c80b6330 con 0x7f86940a1cc0 2026-02-23T06:51:42.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.391+0000 7f86aeffd640 1 -- 10.20.193.58:0/2571585910 <== osd.1 v2:10.20.193.58:6800/1850584280 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f86b8030b70 con 0x7f86940a1cc0 2026-02-23T06:51:42.387 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:51:42.387 INFO:teuthology.orchestra.run.trial058.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-23T06:51:42.387 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:51:42.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.393+0000 7f86c7577640 1 -- 10.20.193.58:0/2571585910 >> [v2:10.20.193.58:6800/1850584280,v1:10.20.193.58:6801/1850584280] conn(0x7f86940a1cc0 msgr2=0x7f86940c2130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:42.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.393+0000 7f86c7577640 1 --2- 10.20.193.58:0/2571585910 >> [v2:10.20.193.58:6800/1850584280,v1:10.20.193.58:6801/1850584280] conn(0x7f86940a1cc0 0x7f86940c2130 crc :-1 s=READY pgs=110 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.393+0000 7f86c7577640 1 -- 10.20.193.58:0/2571585910 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f869407a6b0 msgr2=0x7f869409ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:42.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.393+0000 7f86c7577640 1 --2- 10.20.193.58:0/2571585910 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f869407a6b0 0x7f869409ab60 secure :-1 s=READY pgs=608 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86bc004740 tx=0x7f86bc005f90 comp rx=0 tx=0).stop 2026-02-23T06:51:42.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.393+0000 7f86c7577640 1 -- 10.20.193.58:0/2571585910 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f86c815a970 msgr2=0x7f86c814dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:42.388 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.393+0000 7f86c7577640 1 --2- 10.20.193.58:0/2571585910 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f86c815a970 0x7f86c814dc60 secure :-1 s=READY pgs=169 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86b0002c80 tx=0x7f86b000eaf0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.391 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.397+0000 7f86c6d76640 1 -- 10.20.193.58:0/2571585910 reap_dead start 2026-02-23T06:51:42.391 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.397+0000 7f86c7577640 1 -- 10.20.193.58:0/2571585910 shutdown_connections 2026-02-23T06:51:42.391 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.397+0000 7f86c7577640 1 -- 10.20.193.58:0/2571585910 >> 10.20.193.58:0/2571585910 conn(0x7f86c80b3c20 msgr2=0x7f86c80b0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:42.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.398+0000 7f86c7577640 1 -- 10.20.193.58:0/2571585910 shutdown_connections 2026-02-23T06:51:42.392 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.398+0000 7f86c7577640 1 -- 10.20.193.58:0/2571585910 wait complete. 2026-02-23T06:51:42.412 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-23T06:51:42.571 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.576+0000 7faaa1b92640 1 -- 10.20.193.58:0/2940137840 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa9c15d4a0 msgr2=0x7faa9c0affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:42.571 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.576+0000 7faaa1b92640 1 --2- 10.20.193.58:0/2940137840 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa9c15d4a0 0x7faa9c0affb0 secure :-1 s=READY pgs=188 gs=2 cs=0 l=1 c_cookie=2579047410192248368 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa8c005e70 tx=0x7faa8c02f290 comp rx=0 tx=0).stop 2026-02-23T06:51:42.571 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.576+0000 7faaa1b92640 1 -- 10.20.193.58:0/2940137840 shutdown_connections 2026-02-23T06:51:42.571 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.576+0000 7faaa1b92640 1 --2- 10.20.193.58:0/2940137840 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa9c15d870 0x7faa9c0587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.571 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.576+0000 7faaa1b92640 1 --2- 10.20.193.58:0/2940137840 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa9c15d4a0 0x7faa9c0affb0 unknown :-1 s=CLOSED pgs=188 gs=2 cs=0 l=1 c_cookie=2579047410192248368 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.571 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.576+0000 7faaa1b92640 1 -- 10.20.193.58:0/2940137840 >> 10.20.193.58:0/2940137840 conn(0x7faa9c0b3c20 msgr2=0x7faa9c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:42.571 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.576+0000 7faaa1b92640 1 -- 10.20.193.58:0/2940137840 shutdown_connections 2026-02-23T06:51:42.571 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.576+0000 7faaa1b92640 1 -- 10.20.193.58:0/2940137840 wait complete. 2026-02-23T06:51:42.571 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.577+0000 7faaa1b92640 1 Processor -- start 2026-02-23T06:51:42.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.577+0000 7faaa1b92640 1 -- start start 2026-02-23T06:51:42.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.578+0000 7faaa1b92640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa9c0b6690 0x7faa9c122320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:42.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.578+0000 7faaa1b92640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa9c15d4a0 0x7faa9c149e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:42.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.578+0000 7faaa1b92640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa9c15d870 0x7faa9c13d2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:42.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.578+0000 7faaa1b92640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7faa9c056580 con 0x7faa9c15d4a0 2026-02-23T06:51:42.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.578+0000 7faaa1b92640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7faa9c14a390 con 0x7faa9c0b6690 2026-02-23T06:51:42.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.578+0000 7faaa1b92640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7faa9c11e2d0 con 0x7faa9c15d870 2026-02-23T06:51:42.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.578+0000 7faaa0b90640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa9c0b6690 0x7faa9c122320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:42.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.578+0000 7faa93fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa9c15d4a0 0x7faa9c149e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:42.572 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.578+0000 7faaa1391640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa9c15d870 0x7faa9c13d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:42.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.578+0000 7faa93fff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa9c15d4a0 0x7faa9c149e50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50174/0 (socket says 10.20.193.58:50174) 2026-02-23T06:51:42.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.578+0000 7faa93fff640 1 -- 10.20.193.58:0/3391629402 learned_addr learned my addr 10.20.193.58:0/3391629402 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:51:42.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.578+0000 7faa93fff640 1 -- 10.20.193.58:0/3391629402 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa9c15d870 msgr2=0x7faa9c13d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:42.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.578+0000 7faa93fff640 1 --2- 10.20.193.58:0/3391629402 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa9c15d870 0x7faa9c13d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.578+0000 7faa93fff640 1 -- 10.20.193.58:0/3391629402 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa9c0b6690 msgr2=0x7faa9c122320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:42.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.578+0000 7faa93fff640 1 --2- 10.20.193.58:0/3391629402 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa9c0b6690 0x7faa9c122320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.578+0000 7faa93fff640 1 -- 10.20.193.58:0/3391629402 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa8c009570 con 0x7faa9c15d4a0 2026-02-23T06:51:42.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.578+0000 7faa93fff640 1 --2- 10.20.193.58:0/3391629402 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa9c15d4a0 0x7faa9c149e50 secure :-1 s=READY pgs=171 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa8400e9c0 tx=0x7faa8400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:42.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.578+0000 7faa917fa640 1 -- 10.20.193.58:0/3391629402 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa8400cd70 con 0x7faa9c15d4a0 2026-02-23T06:51:42.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.578+0000 7faa917fa640 1 -- 10.20.193.58:0/3391629402 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa84004850 con 0x7faa9c15d4a0 2026-02-23T06:51:42.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.578+0000 7faa917fa640 1 -- 10.20.193.58:0/3391629402 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa84004c80 con 0x7faa9c15d4a0 2026-02-23T06:51:42.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.578+0000 7faaa1b92640 1 -- 10.20.193.58:0/3391629402 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa9c122b20 con 0x7faa9c15d4a0 2026-02-23T06:51:42.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.579+0000 7faaa1b92640 1 -- 10.20.193.58:0/3391629402 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa9c1230e0 con 0x7faa9c15d4a0 2026-02-23T06:51:42.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.579+0000 7faaa1b92640 1 -- 10.20.193.58:0/3391629402 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa9c0b6d50 con 0x7faa9c15d4a0 2026-02-23T06:51:42.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.580+0000 7faa917fa640 1 -- 10.20.193.58:0/3391629402 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7faa8401f060 con 0x7faa9c15d4a0 2026-02-23T06:51:42.575 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.581+0000 7faa917fa640 1 --2- 10.20.193.58:0/3391629402 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa6c07a6b0 0x7faa6c09ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:42.575 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.581+0000 7faa917fa640 1 -- 10.20.193.58:0/3391629402 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7faa84014070 con 0x7faa9c15d4a0 2026-02-23T06:51:42.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.581+0000 7faaa0b90640 1 --2- 10.20.193.58:0/3391629402 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa6c07a6b0 0x7faa6c09ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:42.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.582+0000 7faaa0b90640 1 --2- 10.20.193.58:0/3391629402 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa6c07a6b0 0x7faa6c09ab60 secure :-1 s=READY pgs=609 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa8c0023d0 tx=0x7faa8c03a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:42.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.583+0000 7faa917fa640 1 -- 10.20.193.58:0/3391629402 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7faa84060e60 con 0x7faa9c15d4a0 2026-02-23T06:51:42.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.695+0000 7faaa1b92640 1 -- 10.20.193.58:0/3391629402 --> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7faa9c0b5e10 con 0x7faa6c07a6b0 2026-02-23T06:51:42.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.697+0000 7faa917fa640 1 -- 10.20.193.58:0/3391629402 <== mgr.4126 v2:10.20.193.93:6800/4124709854 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7faa8c03e040 con 0x7faa6c07a6b0 2026-02-23T06:51:42.690 INFO:teuthology.orchestra.run.trial058.stderr:instructed osd(s) 1 to deep-scrub 2026-02-23T06:51:42.691 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.697+0000 7faaa1b92640 1 -- 10.20.193.58:0/3391629402 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa6c07a6b0 msgr2=0x7faa6c09ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:42.691 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.697+0000 7faaa1b92640 1 --2- 10.20.193.58:0/3391629402 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa6c07a6b0 0x7faa6c09ab60 secure :-1 s=READY pgs=609 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa8c0023d0 tx=0x7faa8c03a040 comp rx=0 tx=0).stop 2026-02-23T06:51:42.691 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.697+0000 7faaa1b92640 1 -- 10.20.193.58:0/3391629402 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa9c15d4a0 msgr2=0x7faa9c149e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:42.691 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.697+0000 7faaa1b92640 1 --2- 10.20.193.58:0/3391629402 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa9c15d4a0 0x7faa9c149e50 secure :-1 s=READY pgs=171 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa8400e9c0 tx=0x7faa8400ee90 comp rx=0 tx=0).stop 2026-02-23T06:51:42.691 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.697+0000 7faaa1b92640 1 -- 10.20.193.58:0/3391629402 shutdown_connections 2026-02-23T06:51:42.691 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.697+0000 7faaa1b92640 1 --2- 10.20.193.58:0/3391629402 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faa6c07a6b0 0x7faa6c09ab60 unknown :-1 s=CLOSED pgs=609 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.691 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.697+0000 7faaa1b92640 1 --2- 10.20.193.58:0/3391629402 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7faa9c15d870 0x7faa9c13d2d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.691 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.697+0000 7faaa1b92640 1 --2- 10.20.193.58:0/3391629402 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7faa9c15d4a0 0x7faa9c149e50 unknown :-1 s=CLOSED pgs=171 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.697+0000 7faaa1b92640 1 --2- 10.20.193.58:0/3391629402 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7faa9c0b6690 0x7faa9c122320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.697+0000 7faaa1b92640 1 -- 10.20.193.58:0/3391629402 >> 10.20.193.58:0/3391629402 conn(0x7faa9c0b3c20 msgr2=0x7faa9c05d100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:42.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.697+0000 7faaa1b92640 1 -- 10.20.193.58:0/3391629402 shutdown_connections 2026-02-23T06:51:42.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.697+0000 7faaa1b92640 1 -- 10.20.193.58:0/3391629402 wait complete. 2026-02-23T06:51:42.703 INFO:tasks.ceph:Scrubbing osd.2 2026-02-23T06:51:42.703 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-23T06:51:42.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.830+0000 7f9f3517e640 1 -- 10.20.193.58:0/2835372076 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f300b5680 msgr2=0x7f9f300b5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:42.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.830+0000 7f9f3517e640 1 --2- 10.20.193.58:0/2835372076 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f300b5680 0x7f9f300b5b20 secure :-1 s=READY pgs=173 gs=3 cs=0 l=1 c_cookie=4098800102273879017 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f24005820 tx=0x7f9f240302a0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.825 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.831+0000 7f9f3517e640 1 -- 10.20.193.58:0/2835372076 shutdown_connections 2026-02-23T06:51:42.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.831+0000 7f9f3517e640 1 --2- 10.20.193.58:0/2835372076 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f300b5680 0x7f9f300b5b20 unknown :-1 s=CLOSED pgs=173 gs=3 cs=0 l=1 c_cookie=4098800102273879017 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.831+0000 7f9f3517e640 1 --2- 10.20.193.58:0/2835372076 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9f3015c040 0x7f9f3005b0e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.831+0000 7f9f3517e640 1 -- 10.20.193.58:0/2835372076 >> 10.20.193.58:0/2835372076 conn(0x7f9f300b3c20 msgr2=0x7f9f300b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:42.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.831+0000 7f9f3517e640 1 -- 10.20.193.58:0/2835372076 shutdown_connections 2026-02-23T06:51:42.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.831+0000 7f9f3517e640 1 -- 10.20.193.58:0/2835372076 wait complete. 2026-02-23T06:51:42.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.832+0000 7f9f3517e640 1 Processor -- start 2026-02-23T06:51:42.826 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.832+0000 7f9f3517e640 1 -- start start 2026-02-23T06:51:42.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.832+0000 7f9f3517e640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9f30056550 0x7f9f301366f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:42.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.832+0000 7f9f3517e640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f300b5680 0x7f9f3013a040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:42.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.832+0000 7f9f3517e640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9f3015c040 0x7f9f30153e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:42.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.832+0000 7f9f3517e640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f9f30136c30 con 0x7f9f300b5680 2026-02-23T06:51:42.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.832+0000 7f9f3517e640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9f30163590 con 0x7f9f3015c040 2026-02-23T06:51:42.827 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.832+0000 7f9f3517e640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f9f301637e0 con 0x7f9f30056550 2026-02-23T06:51:42.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.833+0000 7f9f2f7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f300b5680 0x7f9f3013a040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:42.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.833+0000 7f9f2f7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f300b5680 0x7f9f3013a040 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50188/0 (socket says 10.20.193.58:50188) 2026-02-23T06:51:42.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.833+0000 7f9f2ffff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9f30056550 0x7f9f301366f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:42.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.833+0000 7f9f2f7fe640 1 -- 10.20.193.58:0/967024192 learned_addr learned my addr 10.20.193.58:0/967024192 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:51:42.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.833+0000 7f9f3497d640 1 --2- 10.20.193.58:0/967024192 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9f3015c040 0x7f9f30153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:42.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.833+0000 7f9f2f7fe640 1 -- 10.20.193.58:0/967024192 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9f30056550 msgr2=0x7f9f301366f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:42.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.833+0000 7f9f2f7fe640 1 --2- 10.20.193.58:0/967024192 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9f30056550 0x7f9f301366f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.833+0000 7f9f2f7fe640 1 -- 10.20.193.58:0/967024192 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9f3015c040 msgr2=0x7f9f30153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:42.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.833+0000 7f9f2f7fe640 1 --2- 10.20.193.58:0/967024192 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9f3015c040 0x7f9f30153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.833+0000 7f9f2f7fe640 1 -- 10.20.193.58:0/967024192 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2400a590 con 0x7f9f300b5680 2026-02-23T06:51:42.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.833+0000 7f9f3497d640 1 --2- 10.20.193.58:0/967024192 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9f3015c040 0x7f9f30153e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:51:42.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.833+0000 7f9f2f7fe640 1 --2- 10.20.193.58:0/967024192 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f300b5680 0x7f9f3013a040 secure :-1 s=READY pgs=174 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f20007fd0 tx=0x7f9f2000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:42.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.833+0000 7f9f2cff9640 1 -- 10.20.193.58:0/967024192 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f20012850 con 0x7f9f300b5680 2026-02-23T06:51:42.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.833+0000 7f9f3517e640 1 -- 10.20.193.58:0/967024192 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f30163e00 con 0x7f9f300b5680 2026-02-23T06:51:42.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.834+0000 7f9f2cff9640 1 -- 10.20.193.58:0/967024192 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f20012aa0 con 0x7f9f300b5680 2026-02-23T06:51:42.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.834+0000 7f9f2cff9640 1 -- 10.20.193.58:0/967024192 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f20012e70 con 0x7f9f300b5680 2026-02-23T06:51:42.828 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.834+0000 7f9f3517e640 1 -- 10.20.193.58:0/967024192 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f301643c0 con 0x7f9f300b5680 2026-02-23T06:51:42.829 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.834+0000 7f9f0a7fc640 1 -- 10.20.193.58:0/967024192 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9f3005b620 con 0x7f9f300b5680 2026-02-23T06:51:42.830 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.835+0000 7f9f2cff9640 1 -- 10.20.193.58:0/967024192 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f9f2001b400 con 0x7f9f300b5680 2026-02-23T06:51:42.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.836+0000 7f9f2cff9640 1 --2- 10.20.193.58:0/967024192 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9f0007a6c0 0x7f9f0009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:42.831 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.836+0000 7f9f2cff9640 1 -- 10.20.193.58:0/967024192 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f9f2009d8b0 con 0x7f9f300b5680 2026-02-23T06:51:42.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.837+0000 7f9f2cff9640 1 --2- 10.20.193.58:0/967024192 >> [v2:10.20.193.58:6823/4284600061,v1:10.20.193.58:6825/4284600061] conn(0x7f9f000a1cc0 0x7f9f000c2130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:42.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.837+0000 7f9f2ffff640 1 --2- 10.20.193.58:0/967024192 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9f0007a6c0 0x7f9f0009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:42.832 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.837+0000 7f9f2cff9640 1 -- 10.20.193.58:0/967024192 --> [v2:10.20.193.58:6823/4284600061,v1:10.20.193.58:6825/4284600061] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9f000c2800 con 0x7f9f000a1cc0 2026-02-23T06:51:42.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.837+0000 7f9f2cff9640 1 -- 10.20.193.58:0/967024192 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9f200a22c0 con 0x7f9f300b5680 2026-02-23T06:51:42.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.837+0000 7f9f3497d640 1 --2- 10.20.193.58:0/967024192 >> [v2:10.20.193.58:6823/4284600061,v1:10.20.193.58:6825/4284600061] conn(0x7f9f000a1cc0 0x7f9f000c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:42.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.837+0000 7f9f2ffff640 1 --2- 10.20.193.58:0/967024192 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9f0007a6c0 0x7f9f0009ab70 secure :-1 s=READY pgs=610 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f1c004740 tx=0x7f9f1c005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:42.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.837+0000 7f9f3497d640 1 --2- 10.20.193.58:0/967024192 >> [v2:10.20.193.58:6823/4284600061,v1:10.20.193.58:6825/4284600061] conn(0x7f9f000a1cc0 0x7f9f000c2130 crc :-1 s=READY pgs=1523 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:42.833 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.838+0000 7f9f2cff9640 1 -- 10.20.193.58:0/967024192 <== osd.2 v2:10.20.193.58:6823/4284600061 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f9f000c2800 con 0x7f9f000a1cc0 2026-02-23T06:51:42.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.846+0000 7f9f0a7fc640 1 -- 10.20.193.58:0/967024192 --> [v2:10.20.193.58:6823/4284600061,v1:10.20.193.58:6825/4284600061] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9f30166120 con 0x7f9f000a1cc0 2026-02-23T06:51:42.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.846+0000 7f9f2cff9640 1 -- 10.20.193.58:0/967024192 <== osd.2 v2:10.20.193.58:6823/4284600061 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9f240054c0 con 0x7f9f000a1cc0 2026-02-23T06:51:42.841 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:51:42.841 INFO:teuthology.orchestra.run.trial058.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-23T06:51:42.841 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:51:42.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.846+0000 7f9f0a7fc640 1 -- 10.20.193.58:0/967024192 >> [v2:10.20.193.58:6823/4284600061,v1:10.20.193.58:6825/4284600061] conn(0x7f9f000a1cc0 msgr2=0x7f9f000c2130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:42.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.846+0000 7f9f0a7fc640 1 --2- 10.20.193.58:0/967024192 >> [v2:10.20.193.58:6823/4284600061,v1:10.20.193.58:6825/4284600061] conn(0x7f9f000a1cc0 0x7f9f000c2130 crc :-1 s=READY pgs=1523 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.846+0000 7f9f0a7fc640 1 -- 10.20.193.58:0/967024192 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9f0007a6c0 msgr2=0x7f9f0009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:42.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.846+0000 7f9f0a7fc640 1 --2- 10.20.193.58:0/967024192 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9f0007a6c0 0x7f9f0009ab70 secure :-1 s=READY pgs=610 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f1c004740 tx=0x7f9f1c005f90 comp rx=0 tx=0).stop 2026-02-23T06:51:42.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.846+0000 7f9f0a7fc640 1 -- 10.20.193.58:0/967024192 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f300b5680 msgr2=0x7f9f3013a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:42.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.846+0000 7f9f0a7fc640 1 --2- 10.20.193.58:0/967024192 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9f300b5680 0x7f9f3013a040 secure :-1 s=READY pgs=174 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f20007fd0 tx=0x7f9f2000c970 comp rx=0 tx=0).stop 2026-02-23T06:51:42.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.846+0000 7f9f3497d640 1 -- 10.20.193.58:0/967024192 reap_dead start 2026-02-23T06:51:42.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.846+0000 7f9f0a7fc640 1 -- 10.20.193.58:0/967024192 shutdown_connections 2026-02-23T06:51:42.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.846+0000 7f9f0a7fc640 1 -- 10.20.193.58:0/967024192 >> 10.20.193.58:0/967024192 conn(0x7f9f300b3c20 msgr2=0x7f9f3015afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:42.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.847+0000 7f9f0a7fc640 1 -- 10.20.193.58:0/967024192 shutdown_connections 2026-02-23T06:51:42.841 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.847+0000 7f9f0a7fc640 1 -- 10.20.193.58:0/967024192 wait complete. 2026-02-23T06:51:42.850 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-23T06:51:42.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.978+0000 7f5b7490b640 1 -- 10.20.193.58:0/1037697223 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5b70056960 msgr2=0x7f5b700b6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:42.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.978+0000 7f5b7490b640 1 --2- 10.20.193.58:0/1037697223 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5b70056960 0x7f5b700b6720 secure :-1 s=READY pgs=19 gs=3 cs=0 l=1 c_cookie=15607729149313352283 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b58005e70 tx=0x7f5b5802f230 comp rx=0 tx=0).stop 2026-02-23T06:51:42.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.978+0000 7f5b7490b640 1 -- 10.20.193.58:0/1037697223 shutdown_connections 2026-02-23T06:51:42.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.978+0000 7f5b7490b640 1 --2- 10.20.193.58:0/1037697223 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5b70056960 0x7f5b700b6720 unknown :-1 s=CLOSED pgs=19 gs=3 cs=0 l=1 c_cookie=15607729149313352283 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.978+0000 7f5b7490b640 1 --2- 10.20.193.58:0/1037697223 >> v2:10.20.193.58:3300/0 conn(0x7f5b7015c4b0 0x7f5b70058200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.974 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.978+0000 7f5b7490b640 1 -- 10.20.193.58:0/1037697223 >> 10.20.193.58:0/1037697223 conn(0x7f5b700b3c20 msgr2=0x7f5b700b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:42.975 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.978+0000 7f5b7490b640 1 -- 10.20.193.58:0/1037697223 shutdown_connections 2026-02-23T06:51:42.975 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.978+0000 7f5b7490b640 1 -- 10.20.193.58:0/1037697223 wait complete. 2026-02-23T06:51:42.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.979+0000 7f5b7490b640 1 Processor -- start 2026-02-23T06:51:42.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.980+0000 7f5b7490b640 1 -- start start 2026-02-23T06:51:42.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.980+0000 7f5b7490b640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5b70056960 0x7f5b7013d480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:42.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.980+0000 7f5b7490b640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5b7015c4b0 0x7f5b700af9d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:42.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.980+0000 7f5b7490b640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5b70162ca0 0x7f5b700b6980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:42.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.980+0000 7f5b7490b640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f5b700aef20 con 0x7f5b70056960 2026-02-23T06:51:42.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.980+0000 7f5b7490b640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f5b70160bc0 con 0x7f5b70162ca0 2026-02-23T06:51:42.977 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.980+0000 7f5b7490b640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f5b7013cff0 con 0x7f5b7015c4b0 2026-02-23T06:51:42.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.980+0000 7f5b6ed76640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5b70056960 0x7f5b7013d480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:42.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.980+0000 7f5b6f577640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5b70162ca0 0x7f5b700b6980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:42.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.980+0000 7f5b6ed76640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5b70056960 0x7f5b7013d480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50196/0 (socket says 10.20.193.58:50196) 2026-02-23T06:51:42.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.980+0000 7f5b6ed76640 1 -- 10.20.193.58:0/1653993888 learned_addr learned my addr 10.20.193.58:0/1653993888 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:51:42.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.980+0000 7f5b6e575640 1 --2- 10.20.193.58:0/1653993888 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5b7015c4b0 0x7f5b700af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:42.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.980+0000 7f5b6ed76640 1 -- 10.20.193.58:0/1653993888 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5b7015c4b0 msgr2=0x7f5b700af9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:42.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.980+0000 7f5b6ed76640 1 --2- 10.20.193.58:0/1653993888 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5b7015c4b0 0x7f5b700af9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.980+0000 7f5b6ed76640 1 -- 10.20.193.58:0/1653993888 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5b70162ca0 msgr2=0x7f5b700b6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:42.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.980+0000 7f5b6ed76640 1 --2- 10.20.193.58:0/1653993888 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5b70162ca0 0x7f5b700b6980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:42.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.980+0000 7f5b6ed76640 1 -- 10.20.193.58:0/1653993888 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b58009570 con 0x7f5b70056960 2026-02-23T06:51:42.978 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.981+0000 7f5b6ed76640 1 --2- 10.20.193.58:0/1653993888 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5b70056960 0x7f5b7013d480 secure :-1 s=READY pgs=175 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b64009480 tx=0x7f5b6400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:42.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.981+0000 7f5b4f7fe640 1 -- 10.20.193.58:0/1653993888 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5b6400cd40 con 0x7f5b70056960 2026-02-23T06:51:42.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.981+0000 7f5b4f7fe640 1 -- 10.20.193.58:0/1653993888 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b64004850 con 0x7f5b70056960 2026-02-23T06:51:42.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.981+0000 7f5b7490b640 1 -- 10.20.193.58:0/1653993888 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b7013b670 con 0x7f5b70056960 2026-02-23T06:51:42.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.981+0000 7f5b4f7fe640 1 -- 10.20.193.58:0/1653993888 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5b6400cea0 con 0x7f5b70056960 2026-02-23T06:51:42.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.981+0000 7f5b7490b640 1 -- 10.20.193.58:0/1653993888 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b700af410 con 0x7f5b70056960 2026-02-23T06:51:42.979 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.981+0000 7f5b7490b640 1 -- 10.20.193.58:0/1653993888 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b7013ecf0 con 0x7f5b70056960 2026-02-23T06:51:42.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.983+0000 7f5b4f7fe640 1 -- 10.20.193.58:0/1653993888 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f5b6401f060 con 0x7f5b70056960 2026-02-23T06:51:42.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.984+0000 7f5b4f7fe640 1 --2- 10.20.193.58:0/1653993888 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5b3c07a6c0 0x7f5b3c09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:42.980 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.984+0000 7f5b4f7fe640 1 -- 10.20.193.58:0/1653993888 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f5b64014070 con 0x7f5b70056960 2026-02-23T06:51:42.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.984+0000 7f5b6e575640 1 --2- 10.20.193.58:0/1653993888 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5b3c07a6c0 0x7f5b3c09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:42.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.985+0000 7f5b6e575640 1 --2- 10.20.193.58:0/1653993888 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5b3c07a6c0 0x7f5b3c09ab70 secure :-1 s=READY pgs=611 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b580023d0 tx=0x7f5b5803a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:42.981 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:42.985+0000 7f5b4f7fe640 1 -- 10.20.193.58:0/1653993888 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f5b64060e40 con 0x7f5b70056960 2026-02-23T06:51:43.095 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.099+0000 7f5b7490b640 1 -- 10.20.193.58:0/1653993888 --> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f5b70059690 con 0x7f5b3c07a6c0 2026-02-23T06:51:43.095 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.100+0000 7f5b4f7fe640 1 -- 10.20.193.58:0/1653993888 <== mgr.4126 v2:10.20.193.93:6800/4124709854 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5b5803e040 con 0x7f5b3c07a6c0 2026-02-23T06:51:43.096 INFO:teuthology.orchestra.run.trial058.stderr:instructed osd(s) 2 to deep-scrub 2026-02-23T06:51:43.096 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.101+0000 7f5b7490b640 1 -- 10.20.193.58:0/1653993888 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5b3c07a6c0 msgr2=0x7f5b3c09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:43.096 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.101+0000 7f5b7490b640 1 --2- 10.20.193.58:0/1653993888 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5b3c07a6c0 0x7f5b3c09ab70 secure :-1 s=READY pgs=611 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b580023d0 tx=0x7f5b5803a040 comp rx=0 tx=0).stop 2026-02-23T06:51:43.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.101+0000 7f5b7490b640 1 -- 10.20.193.58:0/1653993888 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5b70056960 msgr2=0x7f5b7013d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:43.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.101+0000 7f5b7490b640 1 --2- 10.20.193.58:0/1653993888 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5b70056960 0x7f5b7013d480 secure :-1 s=READY pgs=175 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b64009480 tx=0x7f5b6400ee60 comp rx=0 tx=0).stop 2026-02-23T06:51:43.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.101+0000 7f5b7490b640 1 -- 10.20.193.58:0/1653993888 shutdown_connections 2026-02-23T06:51:43.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.101+0000 7f5b7490b640 1 --2- 10.20.193.58:0/1653993888 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5b3c07a6c0 0x7f5b3c09ab70 unknown :-1 s=CLOSED pgs=611 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.101+0000 7f5b7490b640 1 --2- 10.20.193.58:0/1653993888 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5b70162ca0 0x7f5b700b6980 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.101+0000 7f5b7490b640 1 --2- 10.20.193.58:0/1653993888 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5b7015c4b0 0x7f5b700af9d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.101+0000 7f5b7490b640 1 --2- 10.20.193.58:0/1653993888 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5b70056960 0x7f5b7013d480 unknown :-1 s=CLOSED pgs=175 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.101+0000 7f5b7490b640 1 -- 10.20.193.58:0/1653993888 >> 10.20.193.58:0/1653993888 conn(0x7f5b700b3c20 msgr2=0x7f5b70159d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:43.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.101+0000 7f5b7490b640 1 -- 10.20.193.58:0/1653993888 shutdown_connections 2026-02-23T06:51:43.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.101+0000 7f5b7490b640 1 -- 10.20.193.58:0/1653993888 wait complete. 2026-02-23T06:51:43.108 INFO:tasks.ceph:Scrubbing osd.3 2026-02-23T06:51:43.108 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-23T06:51:43.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.235+0000 7f34a5992640 1 -- 10.20.193.58:0/3416808076 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f34a00b6690 msgr2=0x7f34a0058ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:43.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.235+0000 7f34a5992640 1 --2- 10.20.193.58:0/3416808076 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f34a00b6690 0x7f34a0058ec0 secure :-1 s=READY pgs=191 gs=3 cs=0 l=1 c_cookie=5558271668503469708 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f349c005820 tx=0x7f349c030300 comp rx=0 tx=0).stop 2026-02-23T06:51:43.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.235+0000 7f34a5992640 1 -- 10.20.193.58:0/3416808076 shutdown_connections 2026-02-23T06:51:43.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.235+0000 7f34a5992640 1 --2- 10.20.193.58:0/3416808076 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f34a00b6690 0x7f34a0058ec0 unknown :-1 s=CLOSED pgs=191 gs=3 cs=0 l=1 c_cookie=5558271668503469708 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.231 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.235+0000 7f34a5992640 1 -- 10.20.193.58:0/3416808076 >> 10.20.193.58:0/3416808076 conn(0x7f34a00b3c20 msgr2=0x7f34a00b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:43.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.235+0000 7f34a5992640 1 -- 10.20.193.58:0/3416808076 shutdown_connections 2026-02-23T06:51:43.232 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.235+0000 7f34a5992640 1 -- 10.20.193.58:0/3416808076 wait complete. 2026-02-23T06:51:43.235 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.237+0000 7f34a5992640 1 Processor -- start 2026-02-23T06:51:43.235 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.237+0000 7f34a5992640 1 -- start start 2026-02-23T06:51:43.235 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.237+0000 7f34a5992640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f34a00b6690 0x7f34a015ff20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:43.235 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.237+0000 7f34a5992640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f34a015d4a0 0x7f34a013e520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:43.235 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.237+0000 7f34a5992640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f34a015d870 0x7f34a01fdac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:43.235 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.237+0000 7f34a5992640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f34a0161630 con 0x7f34a00b6690 2026-02-23T06:51:43.235 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.237+0000 7f34a5992640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f34a0161b60 con 0x7f34a015d4a0 2026-02-23T06:51:43.235 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.237+0000 7f34a5992640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f34a0162110 con 0x7f34a015d870 2026-02-23T06:51:43.235 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.237+0000 7f34a4990640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f34a00b6690 0x7f34a015ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:43.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.237+0000 7f34a4990640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f34a00b6690 0x7f34a015ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50212/0 (socket says 10.20.193.58:50212) 2026-02-23T06:51:43.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.237+0000 7f34a4990640 1 -- 10.20.193.58:0/214166403 learned_addr learned my addr 10.20.193.58:0/214166403 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:51:43.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.237+0000 7f3497fff640 1 --2- 10.20.193.58:0/214166403 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f34a015d4a0 0x7f34a013e520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:43.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.237+0000 7f34a5191640 1 --2- 10.20.193.58:0/214166403 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f34a015d870 0x7f34a01fdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:43.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.238+0000 7f3497fff640 1 -- 10.20.193.58:0/214166403 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f34a015d870 msgr2=0x7f34a01fdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:43.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.238+0000 7f3497fff640 1 --2- 10.20.193.58:0/214166403 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f34a015d870 0x7f34a01fdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.238+0000 7f3497fff640 1 -- 10.20.193.58:0/214166403 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f34a00b6690 msgr2=0x7f34a015ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:43.236 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.238+0000 7f3497fff640 1 --2- 10.20.193.58:0/214166403 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f34a00b6690 0x7f34a015ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.238+0000 7f3497fff640 1 -- 10.20.193.58:0/214166403 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349c00a590 con 0x7f34a015d4a0 2026-02-23T06:51:43.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.238+0000 7f34a4990640 1 --2- 10.20.193.58:0/214166403 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f34a00b6690 0x7f34a015ff20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:51:43.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.238+0000 7f3497fff640 1 --2- 10.20.193.58:0/214166403 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f34a015d4a0 0x7f34a013e520 secure :-1 s=READY pgs=192 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f34880029a0 tx=0x7f348800c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:43.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.238+0000 7f34957fa640 1 -- 10.20.193.58:0/214166403 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f34880052f0 con 0x7f34a015d4a0 2026-02-23T06:51:43.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.238+0000 7f34957fa640 1 -- 10.20.193.58:0/214166403 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3488005540 con 0x7f34a015d4a0 2026-02-23T06:51:43.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.238+0000 7f34957fa640 1 -- 10.20.193.58:0/214166403 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3488003930 con 0x7f34a015d4a0 2026-02-23T06:51:43.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.238+0000 7f34a5992640 1 -- 10.20.193.58:0/214166403 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34a0160460 con 0x7f34a015d4a0 2026-02-23T06:51:43.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.238+0000 7f34a5992640 1 -- 10.20.193.58:0/214166403 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34a0201dc0 con 0x7f34a015d4a0 2026-02-23T06:51:43.237 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.239+0000 7f34a5992640 1 -- 10.20.193.58:0/214166403 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f34a00b5e10 con 0x7f34a015d4a0 2026-02-23T06:51:43.238 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.240+0000 7f34957fa640 1 -- 10.20.193.58:0/214166403 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f3488023020 con 0x7f34a015d4a0 2026-02-23T06:51:43.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.241+0000 7f34957fa640 1 --2- 10.20.193.58:0/214166403 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f347007a6b0 0x7f347009ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:43.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.241+0000 7f34957fa640 1 -- 10.20.193.58:0/214166403 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f348809d3f0 con 0x7f34a015d4a0 2026-02-23T06:51:43.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.242+0000 7f34a4990640 1 --2- 10.20.193.58:0/214166403 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f347007a6b0 0x7f347009ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:43.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.242+0000 7f34957fa640 1 --2- 10.20.193.58:0/214166403 >> [v2:10.20.193.58:6816/2858636994,v1:10.20.193.58:6817/2858636994] conn(0x7f34700a1cc0 0x7f34700c2130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:43.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.242+0000 7f34957fa640 1 -- 10.20.193.58:0/214166403 --> [v2:10.20.193.58:6816/2858636994,v1:10.20.193.58:6817/2858636994] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f34700c2800 con 0x7f34700a1cc0 2026-02-23T06:51:43.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.242+0000 7f34957fa640 1 -- 10.20.193.58:0/214166403 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f348809d7a0 con 0x7f34a015d4a0 2026-02-23T06:51:43.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.242+0000 7f34a5191640 1 --2- 10.20.193.58:0/214166403 >> [v2:10.20.193.58:6816/2858636994,v1:10.20.193.58:6817/2858636994] conn(0x7f34700a1cc0 0x7f34700c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:43.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.242+0000 7f34a4990640 1 --2- 10.20.193.58:0/214166403 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f347007a6b0 0x7f347009ab60 secure :-1 s=READY pgs=612 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f34900023d0 tx=0x7f3490002950 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:43.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.242+0000 7f34a5191640 1 --2- 10.20.193.58:0/214166403 >> [v2:10.20.193.58:6816/2858636994,v1:10.20.193.58:6817/2858636994] conn(0x7f34700a1cc0 0x7f34700c2130 crc :-1 s=READY pgs=658 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:43.239 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.243+0000 7f34957fa640 1 -- 10.20.193.58:0/214166403 <== osd.3 v2:10.20.193.58:6816/2858636994 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f34700c2800 con 0x7f34700a1cc0 2026-02-23T06:51:43.245 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.250+0000 7f34a5992640 1 -- 10.20.193.58:0/214166403 --> [v2:10.20.193.58:6816/2858636994,v1:10.20.193.58:6817/2858636994] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f34a00b5b30 con 0x7f34700a1cc0 2026-02-23T06:51:43.246 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.251+0000 7f34957fa640 1 -- 10.20.193.58:0/214166403 <== osd.3 v2:10.20.193.58:6816/2858636994 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f349c03f040 con 0x7f34700a1cc0 2026-02-23T06:51:43.246 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:51:43.246 INFO:teuthology.orchestra.run.trial058.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-23T06:51:43.246 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:51:43.247 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.251+0000 7f34a5992640 1 -- 10.20.193.58:0/214166403 >> [v2:10.20.193.58:6816/2858636994,v1:10.20.193.58:6817/2858636994] conn(0x7f34700a1cc0 msgr2=0x7f34700c2130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:43.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.251+0000 7f34a5992640 1 --2- 10.20.193.58:0/214166403 >> [v2:10.20.193.58:6816/2858636994,v1:10.20.193.58:6817/2858636994] conn(0x7f34700a1cc0 0x7f34700c2130 crc :-1 s=READY pgs=658 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.251+0000 7f34a5992640 1 -- 10.20.193.58:0/214166403 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f347007a6b0 msgr2=0x7f347009ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:43.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.251+0000 7f34a5992640 1 --2- 10.20.193.58:0/214166403 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f347007a6b0 0x7f347009ab60 secure :-1 s=READY pgs=612 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f34900023d0 tx=0x7f3490002950 comp rx=0 tx=0).stop 2026-02-23T06:51:43.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.251+0000 7f34a5992640 1 -- 10.20.193.58:0/214166403 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f34a015d4a0 msgr2=0x7f34a013e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:43.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.251+0000 7f34a5992640 1 --2- 10.20.193.58:0/214166403 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f34a015d4a0 0x7f34a013e520 secure :-1 s=READY pgs=192 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f34880029a0 tx=0x7f348800c8a0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.251+0000 7f34a5191640 1 -- 10.20.193.58:0/214166403 reap_dead start 2026-02-23T06:51:43.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.251+0000 7f34a5992640 1 -- 10.20.193.58:0/214166403 shutdown_connections 2026-02-23T06:51:43.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.251+0000 7f34a5992640 1 -- 10.20.193.58:0/214166403 >> 10.20.193.58:0/214166403 conn(0x7f34a00b3c20 msgr2=0x7f34a00b7480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:43.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.251+0000 7f34a5992640 1 -- 10.20.193.58:0/214166403 shutdown_connections 2026-02-23T06:51:43.248 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.251+0000 7f34a5992640 1 -- 10.20.193.58:0/214166403 wait complete. 2026-02-23T06:51:43.253 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-23T06:51:43.374 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.379+0000 7fab7ea43640 1 -- 10.20.193.58:0/933408627 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fab780b5680 msgr2=0x7fab780b5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:43.375 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.379+0000 7fab7ea43640 1 --2- 10.20.193.58:0/933408627 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fab780b5680 0x7fab780b5ac0 secure :-1 s=READY pgs=194 gs=3 cs=0 l=1 c_cookie=1907219962498852016 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab74005820 tx=0x7fab74030340 comp rx=0 tx=0).stop 2026-02-23T06:51:43.375 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.379+0000 7fab7ea43640 1 -- 10.20.193.58:0/933408627 shutdown_connections 2026-02-23T06:51:43.375 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.379+0000 7fab7ea43640 1 --2- 10.20.193.58:0/933408627 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fab780b5680 0x7fab780b5ac0 unknown :-1 s=CLOSED pgs=194 gs=3 cs=0 l=1 c_cookie=1907219962498852016 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.375 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.379+0000 7fab7ea43640 1 -- 10.20.193.58:0/933408627 >> 10.20.193.58:0/933408627 conn(0x7fab780b3c20 msgr2=0x7fab780b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:43.375 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.379+0000 7fab7ea43640 1 -- 10.20.193.58:0/933408627 shutdown_connections 2026-02-23T06:51:43.375 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.379+0000 7fab7ea43640 1 -- 10.20.193.58:0/933408627 wait complete. 2026-02-23T06:51:43.377 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.380+0000 7fab7ea43640 1 Processor -- start 2026-02-23T06:51:43.378 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.380+0000 7fab7ea43640 1 -- start start 2026-02-23T06:51:43.378 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.381+0000 7fab7ea43640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fab78056550 0x7fab782013b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:43.378 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.381+0000 7fab7ea43640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fab780b5680 0x7fab78058810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:43.378 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.381+0000 7fab7ea43640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fab7815c040 0x7fab78153470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:43.378 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.381+0000 7fab7ea43640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fab78155da0 con 0x7fab780b5680 2026-02-23T06:51:43.378 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.381+0000 7fab7ea43640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fab782018f0 con 0x7fab7815c040 2026-02-23T06:51:43.378 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.381+0000 7fab7ea43640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fab78155ae0 con 0x7fab78056550 2026-02-23T06:51:43.378 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.381+0000 7fab7d240640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fab780b5680 0x7fab78058810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:43.378 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.381+0000 7fab7da41640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fab78056550 0x7fab782013b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:43.378 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.381+0000 7fab7da41640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fab78056550 0x7fab782013b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:37396/0 (socket says 10.20.193.58:37396) 2026-02-23T06:51:43.378 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.381+0000 7fab7da41640 1 -- 10.20.193.58:0/1692013901 learned_addr learned my addr 10.20.193.58:0/1692013901 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:51:43.379 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.381+0000 7fab7d240640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fab780b5680 0x7fab78058810 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50222/0 (socket says 10.20.193.58:50222) 2026-02-23T06:51:43.379 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.381+0000 7fab7e242640 1 --2- 10.20.193.58:0/1692013901 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fab7815c040 0x7fab78153470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:43.379 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.381+0000 7fab7d240640 1 -- 10.20.193.58:0/1692013901 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fab78056550 msgr2=0x7fab782013b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:43.379 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.381+0000 7fab7d240640 1 --2- 10.20.193.58:0/1692013901 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fab78056550 0x7fab782013b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.379 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.381+0000 7fab7d240640 1 -- 10.20.193.58:0/1692013901 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fab7815c040 msgr2=0x7fab78153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:43.379 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.381+0000 7fab7d240640 1 --2- 10.20.193.58:0/1692013901 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fab7815c040 0x7fab78153470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.379 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.381+0000 7fab7d240640 1 -- 10.20.193.58:0/1692013901 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab7400a590 con 0x7fab780b5680 2026-02-23T06:51:43.379 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.382+0000 7fab7d240640 1 --2- 10.20.193.58:0/1692013901 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fab780b5680 0x7fab78058810 secure :-1 s=READY pgs=178 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab6c00c400 tx=0x7fab6c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:43.379 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.382+0000 7fab667fc640 1 -- 10.20.193.58:0/1692013901 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fab6c0052f0 con 0x7fab780b5680 2026-02-23T06:51:43.379 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.382+0000 7fab667fc640 1 -- 10.20.193.58:0/1692013901 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab6c005540 con 0x7fab780b5680 2026-02-23T06:51:43.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.382+0000 7fab667fc640 1 -- 10.20.193.58:0/1692013901 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fab6c0038f0 con 0x7fab780b5680 2026-02-23T06:51:43.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.382+0000 7fab7ea43640 1 -- 10.20.193.58:0/1692013901 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab78162920 con 0x7fab780b5680 2026-02-23T06:51:43.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.382+0000 7fab7ea43640 1 -- 10.20.193.58:0/1692013901 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab78162640 con 0x7fab780b5680 2026-02-23T06:51:43.380 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.382+0000 7fab7ea43640 1 -- 10.20.193.58:0/1692013901 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab780b5a50 con 0x7fab780b5680 2026-02-23T06:51:43.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.384+0000 7fab667fc640 1 -- 10.20.193.58:0/1692013901 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fab6c003a50 con 0x7fab780b5680 2026-02-23T06:51:43.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.385+0000 7fab667fc640 1 --2- 10.20.193.58:0/1692013901 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fab4807a6c0 0x7fab4809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:43.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.385+0000 7fab667fc640 1 -- 10.20.193.58:0/1692013901 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fab6c09ccd0 con 0x7fab780b5680 2026-02-23T06:51:43.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.385+0000 7fab7da41640 1 --2- 10.20.193.58:0/1692013901 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fab4807a6c0 0x7fab4809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:43.381 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.386+0000 7fab7da41640 1 --2- 10.20.193.58:0/1692013901 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fab4807a6c0 0x7fab4809ab70 secure :-1 s=READY pgs=613 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab68007c80 tx=0x7fab68007ee0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:43.382 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.387+0000 7fab667fc640 1 -- 10.20.193.58:0/1692013901 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fab6c0a2020 con 0x7fab780b5680 2026-02-23T06:51:43.501 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.507+0000 7fab7ea43640 1 -- 10.20.193.58:0/1692013901 --> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fab78166120 con 0x7fab4807a6c0 2026-02-23T06:51:43.503 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.508+0000 7fab667fc640 1 -- 10.20.193.58:0/1692013901 <== mgr.4126 v2:10.20.193.93:6800/4124709854 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fab68002a90 con 0x7fab4807a6c0 2026-02-23T06:51:43.505 INFO:teuthology.orchestra.run.trial058.stderr:instructed osd(s) 3 to deep-scrub 2026-02-23T06:51:43.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.513+0000 7fab7ea43640 1 -- 10.20.193.58:0/1692013901 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fab4807a6c0 msgr2=0x7fab4809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:43.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.513+0000 7fab7ea43640 1 --2- 10.20.193.58:0/1692013901 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fab4807a6c0 0x7fab4809ab70 secure :-1 s=READY pgs=613 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab68007c80 tx=0x7fab68007ee0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.513+0000 7fab7ea43640 1 -- 10.20.193.58:0/1692013901 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fab780b5680 msgr2=0x7fab78058810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:43.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.513+0000 7fab7ea43640 1 --2- 10.20.193.58:0/1692013901 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fab780b5680 0x7fab78058810 secure :-1 s=READY pgs=178 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab6c00c400 tx=0x7fab6c00c8d0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.513+0000 7fab7ea43640 1 -- 10.20.193.58:0/1692013901 shutdown_connections 2026-02-23T06:51:43.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.513+0000 7fab7ea43640 1 --2- 10.20.193.58:0/1692013901 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fab4807a6c0 0x7fab4809ab70 unknown :-1 s=CLOSED pgs=613 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.513+0000 7fab7ea43640 1 --2- 10.20.193.58:0/1692013901 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fab7815c040 0x7fab78153470 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.513+0000 7fab7ea43640 1 --2- 10.20.193.58:0/1692013901 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fab780b5680 0x7fab78058810 unknown :-1 s=CLOSED pgs=178 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.513+0000 7fab7ea43640 1 --2- 10.20.193.58:0/1692013901 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fab78056550 0x7fab782013b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.513+0000 7fab7ea43640 1 -- 10.20.193.58:0/1692013901 >> 10.20.193.58:0/1692013901 conn(0x7fab780b3c20 msgr2=0x7fab781598a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:43.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.513+0000 7fab7ea43640 1 -- 10.20.193.58:0/1692013901 shutdown_connections 2026-02-23T06:51:43.508 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.514+0000 7fab7ea43640 1 -- 10.20.193.58:0/1692013901 wait complete. 2026-02-23T06:51:43.523 INFO:tasks.ceph:Scrubbing osd.4 2026-02-23T06:51:43.524 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-23T06:51:43.715 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.720+0000 7f763885a640 1 -- 10.20.193.58:0/3190785743 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f763415c040 msgr2=0x7f763405b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:43.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.720+0000 7f763885a640 1 --2- 10.20.193.58:0/3190785743 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f763415c040 0x7f763405b0e0 secure :-1 s=READY pgs=20 gs=3 cs=0 l=1 c_cookie=5074564017101639985 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7628009890 tx=0x7f762802f200 comp rx=0 tx=0).stop 2026-02-23T06:51:43.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.720+0000 7f763885a640 1 -- 10.20.193.58:0/3190785743 shutdown_connections 2026-02-23T06:51:43.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.720+0000 7f763885a640 1 --2- 10.20.193.58:0/3190785743 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f763415c040 0x7f763405b0e0 unknown :-1 s=CLOSED pgs=20 gs=3 cs=0 l=1 c_cookie=5074564017101639985 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.720+0000 7f763885a640 1 -- 10.20.193.58:0/3190785743 >> 10.20.193.58:0/3190785743 conn(0x7f76340b3c20 msgr2=0x7f76340b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:43.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.720+0000 7f763885a640 1 -- 10.20.193.58:0/3190785743 shutdown_connections 2026-02-23T06:51:43.716 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.720+0000 7f763885a640 1 -- 10.20.193.58:0/3190785743 wait complete. 2026-02-23T06:51:43.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.721+0000 7f763885a640 1 Processor -- start 2026-02-23T06:51:43.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.722+0000 7f763885a640 1 -- start start 2026-02-23T06:51:43.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.722+0000 7f763885a640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7634056550 0x7f76340b1030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:43.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.722+0000 7f763885a640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f76340b5680 0x7f7634058810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:43.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.722+0000 7f763885a640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f763415c040 0x7f76340af7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:43.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.722+0000 7f763885a640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f76340b04f0 con 0x7f763415c040 2026-02-23T06:51:43.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.722+0000 7f763885a640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f76340b1570 con 0x7f76340b5680 2026-02-23T06:51:43.720 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.722+0000 7f763885a640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f76340b1c90 con 0x7f7634056550 2026-02-23T06:51:43.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.722+0000 7f7633577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f763415c040 0x7f76340af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:43.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.722+0000 7f7632d76640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7634056550 0x7f76340b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:43.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.722+0000 7f7633577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f763415c040 0x7f76340af7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50226/0 (socket says 10.20.193.58:50226) 2026-02-23T06:51:43.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.722+0000 7f7633577640 1 -- 10.20.193.58:0/1801266916 learned_addr learned my addr 10.20.193.58:0/1801266916 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:51:43.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.722+0000 7f7632575640 1 --2- 10.20.193.58:0/1801266916 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f76340b5680 0x7f7634058810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:43.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.723+0000 7f7633577640 1 -- 10.20.193.58:0/1801266916 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7634056550 msgr2=0x7f76340b1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:43.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.723+0000 7f7633577640 1 --2- 10.20.193.58:0/1801266916 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f7634056550 0x7f76340b1030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.723+0000 7f7633577640 1 -- 10.20.193.58:0/1801266916 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f76340b5680 msgr2=0x7f7634058810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:43.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.723+0000 7f7633577640 1 --2- 10.20.193.58:0/1801266916 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f76340b5680 0x7f7634058810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.723+0000 7f7633577640 1 -- 10.20.193.58:0/1801266916 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76280094b0 con 0x7f763415c040 2026-02-23T06:51:43.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.723+0000 7f7633577640 1 --2- 10.20.193.58:0/1801266916 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f763415c040 0x7f76340af7a0 secure :-1 s=READY pgs=180 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f762400d520 tx=0x7f762400d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:43.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.723+0000 7f76137fe640 1 -- 10.20.193.58:0/1801266916 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7624013850 con 0x7f763415c040 2026-02-23T06:51:43.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.723+0000 7f76137fe640 1 -- 10.20.193.58:0/1801266916 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7624013aa0 con 0x7f763415c040 2026-02-23T06:51:43.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.723+0000 7f76137fe640 1 -- 10.20.193.58:0/1801266916 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7624012380 con 0x7f763415c040 2026-02-23T06:51:43.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.723+0000 7f763885a640 1 -- 10.20.193.58:0/1801266916 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7634201640 con 0x7f763415c040 2026-02-23T06:51:43.721 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.723+0000 7f763885a640 1 -- 10.20.193.58:0/1801266916 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76340aefa0 con 0x7f763415c040 2026-02-23T06:51:43.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.724+0000 7f763885a640 1 -- 10.20.193.58:0/1801266916 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f763415c410 con 0x7f763415c040 2026-02-23T06:51:43.722 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.725+0000 7f76137fe640 1 -- 10.20.193.58:0/1801266916 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f7624023020 con 0x7f763415c040 2026-02-23T06:51:43.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.726+0000 7f76137fe640 1 --2- 10.20.193.58:0/1801266916 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f760007a790 0x7f760009ac40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:43.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.726+0000 7f76137fe640 1 -- 10.20.193.58:0/1801266916 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f762409ea30 con 0x7f763415c040 2026-02-23T06:51:43.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.726+0000 7f76137fe640 1 --2- 10.20.193.58:0/1801266916 >> [v2:10.20.193.93:6803/1874834171,v1:10.20.193.93:6805/1874834171] conn(0x7f76000a1da0 0x7f76000c2210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:43.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.726+0000 7f76137fe640 1 -- 10.20.193.58:0/1801266916 --> [v2:10.20.193.93:6803/1874834171,v1:10.20.193.93:6805/1874834171] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f76000c28e0 con 0x7f76000a1da0 2026-02-23T06:51:43.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.726+0000 7f76137fe640 1 -- 10.20.193.58:0/1801266916 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f762409ede0 con 0x7f763415c040 2026-02-23T06:51:43.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.726+0000 7f7632d76640 1 --2- 10.20.193.58:0/1801266916 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f760007a790 0x7f760009ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:43.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.726+0000 7f7632575640 1 --2- 10.20.193.58:0/1801266916 >> [v2:10.20.193.93:6803/1874834171,v1:10.20.193.93:6805/1874834171] conn(0x7f76000a1da0 0x7f76000c2210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:43.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.727+0000 7f7632d76640 1 --2- 10.20.193.58:0/1801266916 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f760007a790 0x7f760009ac40 secure :-1 s=READY pgs=614 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f762802f730 tx=0x7f7628031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:43.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.727+0000 7f7632575640 1 --2- 10.20.193.58:0/1801266916 >> [v2:10.20.193.93:6803/1874834171,v1:10.20.193.93:6805/1874834171] conn(0x7f76000a1da0 0x7f76000c2210 crc :-1 s=READY pgs=3282 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:43.723 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.728+0000 7f76137fe640 1 -- 10.20.193.58:0/1801266916 <== osd.4 v2:10.20.193.93:6803/1874834171 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f76000c28e0 con 0x7f76000a1da0 2026-02-23T06:51:43.730 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.736+0000 7f763885a640 1 -- 10.20.193.58:0/1801266916 --> [v2:10.20.193.93:6803/1874834171,v1:10.20.193.93:6805/1874834171] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f763405b620 con 0x7f76000a1da0 2026-02-23T06:51:43.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.736+0000 7f76137fe640 1 -- 10.20.193.58:0/1801266916 <== osd.4 v2:10.20.193.93:6803/1874834171 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f761c0051b0 con 0x7f76000a1da0 2026-02-23T06:51:43.731 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:51:43.731 INFO:teuthology.orchestra.run.trial058.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-23T06:51:43.731 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:51:43.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.736+0000 7f763885a640 1 -- 10.20.193.58:0/1801266916 >> [v2:10.20.193.93:6803/1874834171,v1:10.20.193.93:6805/1874834171] conn(0x7f76000a1da0 msgr2=0x7f76000c2210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:43.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.736+0000 7f763885a640 1 --2- 10.20.193.58:0/1801266916 >> [v2:10.20.193.93:6803/1874834171,v1:10.20.193.93:6805/1874834171] conn(0x7f76000a1da0 0x7f76000c2210 crc :-1 s=READY pgs=3282 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.736+0000 7f763885a640 1 -- 10.20.193.58:0/1801266916 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f760007a790 msgr2=0x7f760009ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:43.733 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.736+0000 7f763885a640 1 --2- 10.20.193.58:0/1801266916 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f760007a790 0x7f760009ac40 secure :-1 s=READY pgs=614 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f762802f730 tx=0x7f7628031040 comp rx=0 tx=0).stop 2026-02-23T06:51:43.733 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.736+0000 7f763885a640 1 -- 10.20.193.58:0/1801266916 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f763415c040 msgr2=0x7f76340af7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:43.733 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.736+0000 7f763885a640 1 --2- 10.20.193.58:0/1801266916 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f763415c040 0x7f76340af7a0 secure :-1 s=READY pgs=180 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f762400d520 tx=0x7f762400d9f0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.733 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.736+0000 7f7633577640 1 -- 10.20.193.58:0/1801266916 reap_dead start 2026-02-23T06:51:43.733 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.736+0000 7f763885a640 1 -- 10.20.193.58:0/1801266916 shutdown_connections 2026-02-23T06:51:43.733 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.736+0000 7f763885a640 1 -- 10.20.193.58:0/1801266916 >> 10.20.193.58:0/1801266916 conn(0x7f76340b3c20 msgr2=0x7f763415adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:43.733 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.736+0000 7f763885a640 1 -- 10.20.193.58:0/1801266916 shutdown_connections 2026-02-23T06:51:43.733 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.736+0000 7f763885a640 1 -- 10.20.193.58:0/1801266916 wait complete. 2026-02-23T06:51:43.741 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-23T06:51:43.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.866+0000 7fa567603640 1 -- 10.20.193.58:0/589489950 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5601688d0 msgr2=0x7fa560168ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:43.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.866+0000 7fa567603640 1 --2- 10.20.193.58:0/589489950 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5601688d0 0x7fa560168ca0 secure :-1 s=READY pgs=182 gs=2 cs=0 l=1 c_cookie=4756988143224315694 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa558005e70 tx=0x7fa55802f290 comp rx=0 tx=0).stop 2026-02-23T06:51:43.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.866+0000 7fa567603640 1 -- 10.20.193.58:0/589489950 shutdown_connections 2026-02-23T06:51:43.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.866+0000 7fa567603640 1 --2- 10.20.193.58:0/589489950 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5600bb0b0 0x7fa56015b620 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.866+0000 7fa567603640 1 --2- 10.20.193.58:0/589489950 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5601688d0 0x7fa560168ca0 unknown :-1 s=CLOSED pgs=182 gs=2 cs=0 l=1 c_cookie=4756988143224315694 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.866+0000 7fa567603640 1 -- 10.20.193.58:0/589489950 >> 10.20.193.58:0/589489950 conn(0x7fa560054e40 msgr2=0x7fa560057b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:43.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.866+0000 7fa567603640 1 -- 10.20.193.58:0/589489950 shutdown_connections 2026-02-23T06:51:43.861 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.867+0000 7fa567603640 1 -- 10.20.193.58:0/589489950 wait complete. 2026-02-23T06:51:43.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.868+0000 7fa567603640 1 Processor -- start 2026-02-23T06:51:43.862 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.868+0000 7fa567603640 1 -- start start 2026-02-23T06:51:43.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.868+0000 7fa567603640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa5600b6440 0x7fa56009f0e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:43.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.868+0000 7fa567603640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5600bb0b0 0x7fa560165740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:43.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.868+0000 7fa567603640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5601688d0 0x7fa5600b3970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:43.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.868+0000 7fa567603640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa5600b2e00 con 0x7fa5601688d0 2026-02-23T06:51:43.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.868+0000 7fa567603640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fa560163e60 con 0x7fa5600b6440 2026-02-23T06:51:43.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.868+0000 7fa567603640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa5600b4660 con 0x7fa5600bb0b0 2026-02-23T06:51:43.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.868+0000 7fa566e02640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5601688d0 0x7fa5600b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:43.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.869+0000 7fa565e00640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5600bb0b0 0x7fa560165740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:43.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.869+0000 7fa566601640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa5600b6440 0x7fa56009f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:43.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.869+0000 7fa566601640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa5600b6440 0x7fa56009f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:43418/0 (socket says 10.20.193.58:43418) 2026-02-23T06:51:43.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.869+0000 7fa566601640 1 -- 10.20.193.58:0/1171315002 learned_addr learned my addr 10.20.193.58:0/1171315002 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:51:43.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.869+0000 7fa565e00640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5600bb0b0 0x7fa560165740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:37426/0 (socket says 10.20.193.58:37426) 2026-02-23T06:51:43.863 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.869+0000 7fa566e02640 1 -- 10.20.193.58:0/1171315002 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5600bb0b0 msgr2=0x7fa560165740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:43.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.869+0000 7fa566e02640 1 --2- 10.20.193.58:0/1171315002 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5600bb0b0 0x7fa560165740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.869+0000 7fa566e02640 1 -- 10.20.193.58:0/1171315002 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa5600b6440 msgr2=0x7fa56009f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:43.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.869+0000 7fa566e02640 1 --2- 10.20.193.58:0/1171315002 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa5600b6440 0x7fa56009f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.869+0000 7fa566e02640 1 -- 10.20.193.58:0/1171315002 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa558009570 con 0x7fa5601688d0 2026-02-23T06:51:43.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.869+0000 7fa566e02640 1 --2- 10.20.193.58:0/1171315002 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5601688d0 0x7fa5600b3970 secure :-1 s=READY pgs=183 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa55400e5e0 tx=0x7fa55400eab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:43.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.869+0000 7fa54affd640 1 -- 10.20.193.58:0/1171315002 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5540108e0 con 0x7fa5601688d0 2026-02-23T06:51:43.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.869+0000 7fa54affd640 1 -- 10.20.193.58:0/1171315002 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa554010b30 con 0x7fa5601688d0 2026-02-23T06:51:43.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.869+0000 7fa54affd640 1 -- 10.20.193.58:0/1171315002 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa554011460 con 0x7fa5601688d0 2026-02-23T06:51:43.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.869+0000 7fa567603640 1 -- 10.20.193.58:0/1171315002 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5600b5b10 con 0x7fa5601688d0 2026-02-23T06:51:43.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.869+0000 7fa567603640 1 -- 10.20.193.58:0/1171315002 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa560163af0 con 0x7fa5601688d0 2026-02-23T06:51:43.864 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.870+0000 7fa567603640 1 -- 10.20.193.58:0/1171315002 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa560163cb0 con 0x7fa5601688d0 2026-02-23T06:51:43.866 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.871+0000 7fa54affd640 1 -- 10.20.193.58:0/1171315002 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fa554017020 con 0x7fa5601688d0 2026-02-23T06:51:43.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.872+0000 7fa54affd640 1 --2- 10.20.193.58:0/1171315002 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa53007a6c0 0x7fa53009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:43.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.872+0000 7fa54affd640 1 -- 10.20.193.58:0/1171315002 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fa55409e9a0 con 0x7fa5601688d0 2026-02-23T06:51:43.867 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.872+0000 7fa566601640 1 --2- 10.20.193.58:0/1171315002 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa53007a6c0 0x7fa53009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:43.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.873+0000 7fa566601640 1 --2- 10.20.193.58:0/1171315002 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa53007a6c0 0x7fa53009ab70 secure :-1 s=READY pgs=615 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5580098a0 tx=0x7fa55803a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:43.868 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.874+0000 7fa54affd640 1 -- 10.20.193.58:0/1171315002 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fa554061cc0 con 0x7fa5601688d0 2026-02-23T06:51:43.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.988+0000 7fa567603640 1 -- 10.20.193.58:0/1171315002 --> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fa5600b15f0 con 0x7fa53007a6c0 2026-02-23T06:51:43.983 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.989+0000 7fa54affd640 1 -- 10.20.193.58:0/1171315002 <== mgr.4126 v2:10.20.193.93:6800/4124709854 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa55803e040 con 0x7fa53007a6c0 2026-02-23T06:51:43.983 INFO:teuthology.orchestra.run.trial058.stderr:instructed osd(s) 4 to deep-scrub 2026-02-23T06:51:43.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.989+0000 7fa567603640 1 -- 10.20.193.58:0/1171315002 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa53007a6c0 msgr2=0x7fa53009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:43.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.989+0000 7fa567603640 1 --2- 10.20.193.58:0/1171315002 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa53007a6c0 0x7fa53009ab70 secure :-1 s=READY pgs=615 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5580098a0 tx=0x7fa55803a040 comp rx=0 tx=0).stop 2026-02-23T06:51:43.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.989+0000 7fa567603640 1 -- 10.20.193.58:0/1171315002 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5601688d0 msgr2=0x7fa5600b3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:43.984 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.989+0000 7fa567603640 1 --2- 10.20.193.58:0/1171315002 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5601688d0 0x7fa5600b3970 secure :-1 s=READY pgs=183 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa55400e5e0 tx=0x7fa55400eab0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.985 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.990+0000 7fa567603640 1 -- 10.20.193.58:0/1171315002 shutdown_connections 2026-02-23T06:51:43.985 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.990+0000 7fa567603640 1 --2- 10.20.193.58:0/1171315002 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa53007a6c0 0x7fa53009ab70 unknown :-1 s=CLOSED pgs=615 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.985 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.990+0000 7fa567603640 1 --2- 10.20.193.58:0/1171315002 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa5601688d0 0x7fa5600b3970 unknown :-1 s=CLOSED pgs=183 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.985 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.990+0000 7fa567603640 1 --2- 10.20.193.58:0/1171315002 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa5600bb0b0 0x7fa560165740 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.985 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.990+0000 7fa567603640 1 --2- 10.20.193.58:0/1171315002 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa5600b6440 0x7fa56009f0e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:43.985 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.990+0000 7fa567603640 1 -- 10.20.193.58:0/1171315002 >> 10.20.193.58:0/1171315002 conn(0x7fa560054e40 msgr2=0x7fa560159ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:43.985 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.990+0000 7fa567603640 1 -- 10.20.193.58:0/1171315002 shutdown_connections 2026-02-23T06:51:43.986 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:43.991+0000 7fa567603640 1 -- 10.20.193.58:0/1171315002 wait complete. 2026-02-23T06:51:44.007 INFO:tasks.ceph:Scrubbing osd.5 2026-02-23T06:51:44.007 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-23T06:51:44.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.148+0000 7f50559d4640 1 -- 10.20.193.58:0/3678065615 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5034004850 msgr2=0x7f5034004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:44.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.149+0000 7f50559d4640 1 --2- 10.20.193.58:0/3678065615 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5034004850 0x7f5034004cc0 secure :-1 s=READY pgs=197 gs=4 cs=0 l=1 c_cookie=10465781829368547873 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f503c004740 tx=0x7f503c02f170 comp rx=0 tx=0).stop 2026-02-23T06:51:44.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.149+0000 7f50559d4640 1 -- 10.20.193.58:0/3678065615 shutdown_connections 2026-02-23T06:51:44.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.149+0000 7f50559d4640 1 --2- 10.20.193.58:0/3678065615 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5034004850 0x7f5034004cc0 unknown :-1 s=CLOSED pgs=197 gs=4 cs=0 l=1 c_cookie=10465781829368547873 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.149+0000 7f50559d4640 1 -- 10.20.193.58:0/3678065615 >> 10.20.193.58:0/3678065615 conn(0x7f5050058e50 msgr2=0x7f5050059250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:44.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.149+0000 7f50559d4640 1 -- 10.20.193.58:0/3678065615 shutdown_connections 2026-02-23T06:51:44.144 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.149+0000 7f50559d4640 1 -- 10.20.193.58:0/3678065615 wait complete. 2026-02-23T06:51:44.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.151+0000 7f50559d4640 1 Processor -- start 2026-02-23T06:51:44.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.151+0000 7f50559d4640 1 -- start start 2026-02-23T06:51:44.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.151+0000 7f50559d4640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5034004850 0x7f50501458d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:44.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.151+0000 7f50559d4640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5050135db0 0x7f5050138500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:44.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.151+0000 7f50559d4640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f505005be60 0x7f505011f0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:44.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.151+0000 7f50559d4640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f505005d410 con 0x7f505005be60 2026-02-23T06:51:44.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.151+0000 7f50559d4640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f505011c2f0 con 0x7f5034004850 2026-02-23T06:51:44.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.151+0000 7f50559d4640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f505011c5d0 con 0x7f5050135db0 2026-02-23T06:51:44.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.151+0000 7f504f7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f505005be60 0x7f505011f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:44.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.152+0000 7f504f7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f505005be60 0x7f505011f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50274/0 (socket says 10.20.193.58:50274) 2026-02-23T06:51:44.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.152+0000 7f504f7fe640 1 -- 10.20.193.58:0/1690737042 learned_addr learned my addr 10.20.193.58:0/1690737042 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:51:44.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.152+0000 7f504effd640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5034004850 0x7f50501458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:44.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.152+0000 7f504e7fc640 1 --2- 10.20.193.58:0/1690737042 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5050135db0 0x7f5050138500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:44.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.152+0000 7f504f7fe640 1 -- 10.20.193.58:0/1690737042 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5050135db0 msgr2=0x7f5050138500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:44.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.152+0000 7f504f7fe640 1 --2- 10.20.193.58:0/1690737042 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5050135db0 0x7f5050138500 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.146 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.152+0000 7f504f7fe640 1 -- 10.20.193.58:0/1690737042 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5034004850 msgr2=0x7f50501458d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:44.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.152+0000 7f504f7fe640 1 --2- 10.20.193.58:0/1690737042 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5034004850 0x7f50501458d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.152+0000 7f504f7fe640 1 -- 10.20.193.58:0/1690737042 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505011c8b0 con 0x7f505005be60 2026-02-23T06:51:44.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.152+0000 7f504f7fe640 1 --2- 10.20.193.58:0/1690737042 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f505005be60 0x7f505011f0b0 secure :-1 s=READY pgs=185 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50500b5270 tx=0x7f50400076d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:44.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.152+0000 7f502bfff640 1 -- 10.20.193.58:0/1690737042 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5040004d40 con 0x7f505005be60 2026-02-23T06:51:44.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.152+0000 7f502bfff640 1 -- 10.20.193.58:0/1690737042 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5040012430 con 0x7f505005be60 2026-02-23T06:51:44.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.152+0000 7f502bfff640 1 -- 10.20.193.58:0/1690737042 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5040004ea0 con 0x7f505005be60 2026-02-23T06:51:44.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.152+0000 7f50559d4640 1 -- 10.20.193.58:0/1690737042 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f505005b660 con 0x7f505005be60 2026-02-23T06:51:44.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.152+0000 7f50559d4640 1 -- 10.20.193.58:0/1690737042 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5050145e10 con 0x7f505005be60 2026-02-23T06:51:44.147 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.153+0000 7f50559d4640 1 -- 10.20.193.58:0/1690737042 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f50500b7540 con 0x7f505005be60 2026-02-23T06:51:44.148 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.154+0000 7f502bfff640 1 -- 10.20.193.58:0/1690737042 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f5040023070 con 0x7f505005be60 2026-02-23T06:51:44.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.155+0000 7f502bfff640 1 --2- 10.20.193.58:0/1690737042 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f502007a6b0 0x7f502009ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:44.149 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.155+0000 7f502bfff640 1 -- 10.20.193.58:0/1690737042 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f504009e9b0 con 0x7f505005be60 2026-02-23T06:51:44.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.155+0000 7f502bfff640 1 --2- 10.20.193.58:0/1690737042 >> [v2:10.20.193.93:6802/356968280,v1:10.20.193.93:6804/356968280] conn(0x7f50200a1cb0 0x7f50200c2120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:44.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.155+0000 7f502bfff640 1 -- 10.20.193.58:0/1690737042 --> [v2:10.20.193.93:6802/356968280,v1:10.20.193.93:6804/356968280] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f50200c27f0 con 0x7f50200a1cb0 2026-02-23T06:51:44.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.155+0000 7f502bfff640 1 -- 10.20.193.58:0/1690737042 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f50400a32a0 con 0x7f505005be60 2026-02-23T06:51:44.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.155+0000 7f504effd640 1 --2- 10.20.193.58:0/1690737042 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f502007a6b0 0x7f502009ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:44.150 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.155+0000 7f504e7fc640 1 --2- 10.20.193.58:0/1690737042 >> [v2:10.20.193.93:6802/356968280,v1:10.20.193.93:6804/356968280] conn(0x7f50200a1cb0 0x7f50200c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:44.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.156+0000 7f504effd640 1 --2- 10.20.193.58:0/1690737042 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f502007a6b0 0x7f502009ab60 secure :-1 s=READY pgs=616 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5050138dd0 tx=0x7f5044006c80 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:44.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.156+0000 7f504e7fc640 1 --2- 10.20.193.58:0/1690737042 >> [v2:10.20.193.93:6802/356968280,v1:10.20.193.93:6804/356968280] conn(0x7f50200a1cb0 0x7f50200c2120 crc :-1 s=READY pgs=3713 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:44.151 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.157+0000 7f502bfff640 1 -- 10.20.193.58:0/1690737042 <== osd.5 v2:10.20.193.93:6802/356968280 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f50200c27f0 con 0x7f50200a1cb0 2026-02-23T06:51:44.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.165+0000 7f50559d4640 1 -- 10.20.193.58:0/1690737042 --> [v2:10.20.193.93:6802/356968280,v1:10.20.193.93:6804/356968280] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f50500b7260 con 0x7f50200a1cb0 2026-02-23T06:51:44.159 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.165+0000 7f502bfff640 1 -- 10.20.193.58:0/1690737042 <== osd.5 v2:10.20.193.93:6802/356968280 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f503c02fa10 con 0x7f50200a1cb0 2026-02-23T06:51:44.160 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:51:44.160 INFO:teuthology.orchestra.run.trial058.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-23T06:51:44.160 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:51:44.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.165+0000 7f50559d4640 1 -- 10.20.193.58:0/1690737042 >> [v2:10.20.193.93:6802/356968280,v1:10.20.193.93:6804/356968280] conn(0x7f50200a1cb0 msgr2=0x7f50200c2120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:44.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.165+0000 7f50559d4640 1 --2- 10.20.193.58:0/1690737042 >> [v2:10.20.193.93:6802/356968280,v1:10.20.193.93:6804/356968280] conn(0x7f50200a1cb0 0x7f50200c2120 crc :-1 s=READY pgs=3713 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.165+0000 7f50559d4640 1 -- 10.20.193.58:0/1690737042 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f502007a6b0 msgr2=0x7f502009ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:44.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.165+0000 7f50559d4640 1 --2- 10.20.193.58:0/1690737042 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f502007a6b0 0x7f502009ab60 secure :-1 s=READY pgs=616 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5050138dd0 tx=0x7f5044006c80 comp rx=0 tx=0).stop 2026-02-23T06:51:44.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.165+0000 7f50559d4640 1 -- 10.20.193.58:0/1690737042 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f505005be60 msgr2=0x7f505011f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:44.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.165+0000 7f50559d4640 1 --2- 10.20.193.58:0/1690737042 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f505005be60 0x7f505011f0b0 secure :-1 s=READY pgs=185 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50500b5270 tx=0x7f50400076d0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.165+0000 7f504f7fe640 1 -- 10.20.193.58:0/1690737042 reap_dead start 2026-02-23T06:51:44.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.165+0000 7f50559d4640 1 -- 10.20.193.58:0/1690737042 shutdown_connections 2026-02-23T06:51:44.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.165+0000 7f50559d4640 1 -- 10.20.193.58:0/1690737042 >> 10.20.193.58:0/1690737042 conn(0x7f5050058e50 msgr2=0x7f5050059220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:44.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.165+0000 7f50559d4640 1 -- 10.20.193.58:0/1690737042 shutdown_connections 2026-02-23T06:51:44.160 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.166+0000 7f50559d4640 1 -- 10.20.193.58:0/1690737042 wait complete. 2026-02-23T06:51:44.170 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-23T06:51:44.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.297+0000 7f467231c640 1 -- 10.20.193.58:0/1832333882 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4654004850 msgr2=0x7f4654004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:44.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.297+0000 7f467231c640 1 --2- 10.20.193.58:0/1832333882 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f4654004850 0x7f4654004cc0 secure :-1 s=READY pgs=187 gs=4 cs=0 l=1 c_cookie=16269162763533587697 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f466c0b1d30 tx=0x7f466002f250 comp rx=0 tx=0).stop 2026-02-23T06:51:44.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.297+0000 7f4671b1b640 1 -- 10.20.193.58:0/1832333882 reap_dead start 2026-02-23T06:51:44.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.297+0000 7f467231c640 1 -- 10.20.193.58:0/1832333882 shutdown_connections 2026-02-23T06:51:44.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.297+0000 7f467231c640 1 -- 10.20.193.58:0/1832333882 >> 10.20.193.58:0/1832333882 conn(0x7f466c0b3c20 msgr2=0x7f466c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:44.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.297+0000 7f467231c640 1 -- 10.20.193.58:0/1832333882 shutdown_connections 2026-02-23T06:51:44.292 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.297+0000 7f467231c640 1 -- 10.20.193.58:0/1832333882 wait complete. 2026-02-23T06:51:44.293 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.299+0000 7f467231c640 1 Processor -- start 2026-02-23T06:51:44.293 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.299+0000 7f467231c640 1 -- start start 2026-02-23T06:51:44.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.299+0000 7f467231c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4654004850 0x7f466c15a560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:44.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.299+0000 7f467231c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f466c142ab0 0x7f466c142f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:44.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.299+0000 7f467231c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f466c1fd580 0x7f466c1fd9f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:44.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.299+0000 7f467231c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f466c162e80 con 0x7f466c142ab0 2026-02-23T06:51:44.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.299+0000 7f467231c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f466c142690 con 0x7f466c1fd580 2026-02-23T06:51:44.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.299+0000 7f467231c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f466c058220 con 0x7f4654004850 2026-02-23T06:51:44.294 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.300+0000 7f4670b19640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f466c142ab0 0x7f466c142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:44.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.300+0000 7f4670b19640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f466c142ab0 0x7f466c142f20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50280/0 (socket says 10.20.193.58:50280) 2026-02-23T06:51:44.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.300+0000 7f4670b19640 1 -- 10.20.193.58:0/3744898082 learned_addr learned my addr 10.20.193.58:0/3744898082 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:51:44.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.300+0000 7f467131a640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4654004850 0x7f466c15a560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:44.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.300+0000 7f4671b1b640 1 --2- 10.20.193.58:0/3744898082 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f466c1fd580 0x7f466c1fd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:44.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.300+0000 7f4670b19640 1 -- 10.20.193.58:0/3744898082 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4654004850 msgr2=0x7f466c15a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:44.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.300+0000 7f4670b19640 1 --2- 10.20.193.58:0/3744898082 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4654004850 0x7f466c15a560 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.300+0000 7f4670b19640 1 -- 10.20.193.58:0/3744898082 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f466c1fd580 msgr2=0x7f466c1fd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:44.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.300+0000 7f4670b19640 1 --2- 10.20.193.58:0/3744898082 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f466c1fd580 0x7f466c1fd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.300+0000 7f4670b19640 1 -- 10.20.193.58:0/3744898082 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466c161340 con 0x7f466c142ab0 2026-02-23T06:51:44.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.300+0000 7f4670b19640 1 --2- 10.20.193.58:0/3744898082 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f466c142ab0 0x7f466c142f20 secure :-1 s=READY pgs=188 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4660002730 tx=0x7f4660006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:44.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.300+0000 7f4659ffb640 1 -- 10.20.193.58:0/3744898082 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f466003f070 con 0x7f466c142ab0 2026-02-23T06:51:44.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.300+0000 7f4659ffb640 1 -- 10.20.193.58:0/3744898082 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46600036b0 con 0x7f466c142ab0 2026-02-23T06:51:44.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.300+0000 7f4659ffb640 1 -- 10.20.193.58:0/3744898082 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4660003ae0 con 0x7f466c142ab0 2026-02-23T06:51:44.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.300+0000 7f467231c640 1 -- 10.20.193.58:0/3744898082 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f466c162520 con 0x7f466c142ab0 2026-02-23T06:51:44.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.300+0000 7f467231c640 1 -- 10.20.193.58:0/3744898082 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f466c162aa0 con 0x7f466c142ab0 2026-02-23T06:51:44.295 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.301+0000 7f467231c640 1 -- 10.20.193.58:0/3744898082 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f466c162fc0 con 0x7f466c142ab0 2026-02-23T06:51:44.298 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.304+0000 7f4659ffb640 1 -- 10.20.193.58:0/3744898082 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f466004b060 con 0x7f466c142ab0 2026-02-23T06:51:44.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.305+0000 7f4659ffb640 1 --2- 10.20.193.58:0/3744898082 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f463c07a6b0 0x7f463c09ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:44.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.305+0000 7f4659ffb640 1 -- 10.20.193.58:0/3744898082 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f46600c2070 con 0x7f466c142ab0 2026-02-23T06:51:44.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.305+0000 7f4659ffb640 1 -- 10.20.193.58:0/3744898082 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f46600c24f0 con 0x7f466c142ab0 2026-02-23T06:51:44.299 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.305+0000 7f467131a640 1 --2- 10.20.193.58:0/3744898082 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f463c07a6b0 0x7f463c09ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:44.300 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.306+0000 7f467131a640 1 --2- 10.20.193.58:0/3744898082 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f463c07a6b0 0x7f463c09ab60 secure :-1 s=READY pgs=617 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f465c004740 tx=0x7f465c005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:44.412 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.418+0000 7f467231c640 1 -- 10.20.193.58:0/3744898082 --> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f466c164250 con 0x7f463c07a6b0 2026-02-23T06:51:44.412 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.418+0000 7f4659ffb640 1 -- 10.20.193.58:0/3744898082 <== mgr.4126 v2:10.20.193.93:6800/4124709854 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f465c004590 con 0x7f463c07a6b0 2026-02-23T06:51:44.413 INFO:teuthology.orchestra.run.trial058.stderr:instructed osd(s) 5 to deep-scrub 2026-02-23T06:51:44.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.419+0000 7f467231c640 1 -- 10.20.193.58:0/3744898082 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f463c07a6b0 msgr2=0x7f463c09ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:44.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.419+0000 7f467231c640 1 --2- 10.20.193.58:0/3744898082 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f463c07a6b0 0x7f463c09ab60 secure :-1 s=READY pgs=617 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f465c004740 tx=0x7f465c005f90 comp rx=0 tx=0).stop 2026-02-23T06:51:44.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.419+0000 7f467231c640 1 -- 10.20.193.58:0/3744898082 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f466c142ab0 msgr2=0x7f466c142f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:44.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.419+0000 7f467231c640 1 --2- 10.20.193.58:0/3744898082 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f466c142ab0 0x7f466c142f20 secure :-1 s=READY pgs=188 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4660002730 tx=0x7f4660006040 comp rx=0 tx=0).stop 2026-02-23T06:51:44.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.419+0000 7f467231c640 1 -- 10.20.193.58:0/3744898082 shutdown_connections 2026-02-23T06:51:44.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.419+0000 7f467231c640 1 --2- 10.20.193.58:0/3744898082 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f463c07a6b0 0x7f463c09ab60 unknown :-1 s=CLOSED pgs=617 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.419+0000 7f467231c640 1 --2- 10.20.193.58:0/3744898082 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f466c1fd580 0x7f466c1fd9f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.419+0000 7f467231c640 1 --2- 10.20.193.58:0/3744898082 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f466c142ab0 0x7f466c142f20 unknown :-1 s=CLOSED pgs=188 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.419+0000 7f467231c640 1 --2- 10.20.193.58:0/3744898082 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f4654004850 0x7f466c15a560 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.419+0000 7f467231c640 1 -- 10.20.193.58:0/3744898082 >> 10.20.193.58:0/3744898082 conn(0x7f466c0b3c20 msgr2=0x7f466c05d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:44.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.419+0000 7f467231c640 1 -- 10.20.193.58:0/3744898082 shutdown_connections 2026-02-23T06:51:44.414 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.419+0000 7f467231c640 1 -- 10.20.193.58:0/3744898082 wait complete. 2026-02-23T06:51:44.426 INFO:tasks.ceph:Scrubbing osd.6 2026-02-23T06:51:44.426 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2026-02-23T06:51:44.549 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.553+0000 7fa8f2e2f640 1 -- 10.20.193.58:0/1014807273 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa8ec15c040 msgr2=0x7fa8ec05b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:44.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.553+0000 7fa8f2e2f640 1 --2- 10.20.193.58:0/1014807273 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa8ec15c040 0x7fa8ec05b0e0 secure :-1 s=READY pgs=190 gs=2 cs=0 l=1 c_cookie=14672832902553857142 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8dc004740 tx=0x7fa8dc02f1d0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.553+0000 7fa8f2e2f640 1 -- 10.20.193.58:0/1014807273 shutdown_connections 2026-02-23T06:51:44.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.553+0000 7fa8f2e2f640 1 --2- 10.20.193.58:0/1014807273 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa8ec0b5680 0x7fa8ec0b5b00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.553+0000 7fa8f2e2f640 1 --2- 10.20.193.58:0/1014807273 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa8ec15c040 0x7fa8ec05b0e0 unknown :-1 s=CLOSED pgs=190 gs=2 cs=0 l=1 c_cookie=14672832902553857142 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.553+0000 7fa8f2e2f640 1 -- 10.20.193.58:0/1014807273 >> 10.20.193.58:0/1014807273 conn(0x7fa8ec0b3c20 msgr2=0x7fa8ec0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:44.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.553+0000 7fa8f2e2f640 1 -- 10.20.193.58:0/1014807273 shutdown_connections 2026-02-23T06:51:44.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.553+0000 7fa8f2e2f640 1 -- 10.20.193.58:0/1014807273 wait complete. 2026-02-23T06:51:44.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.554+0000 7fa8f2e2f640 1 Processor -- start 2026-02-23T06:51:44.550 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.554+0000 7fa8f2e2f640 1 -- start start 2026-02-23T06:51:44.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.555+0000 7fa8f2e2f640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa8ec056550 0x7fa8ec13aac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:44.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.555+0000 7fa8f2e2f640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa8ec0b5680 0x7fa8ec1fd7c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:44.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.555+0000 7fa8f2e2f640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa8ec15c040 0x7fa8ec1f7680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:44.551 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.555+0000 7fa8f2e2f640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec136080 con 0x7fa8ec0b5680 2026-02-23T06:51:44.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.555+0000 7fa8f2e2f640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec138f80 con 0x7fa8ec15c040 2026-02-23T06:51:44.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.555+0000 7fa8f2e2f640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fa8ec136340 con 0x7fa8ec056550 2026-02-23T06:51:44.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.555+0000 7fa8f1e2d640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa8ec056550 0x7fa8ec13aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:44.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.555+0000 7fa8f1e2d640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa8ec056550 0x7fa8ec13aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:37484/0 (socket says 10.20.193.58:37484) 2026-02-23T06:51:44.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.555+0000 7fa8f162c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa8ec0b5680 0x7fa8ec1fd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:44.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.555+0000 7fa8f1e2d640 1 -- 10.20.193.58:0/1986368309 learned_addr learned my addr 10.20.193.58:0/1986368309 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:51:44.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.555+0000 7fa8f262e640 1 --2- 10.20.193.58:0/1986368309 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa8ec15c040 0x7fa8ec1f7680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:44.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.555+0000 7fa8f162c640 1 -- 10.20.193.58:0/1986368309 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa8ec056550 msgr2=0x7fa8ec13aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:44.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.555+0000 7fa8f162c640 1 --2- 10.20.193.58:0/1986368309 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fa8ec056550 0x7fa8ec13aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.555+0000 7fa8f162c640 1 -- 10.20.193.58:0/1986368309 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa8ec15c040 msgr2=0x7fa8ec1f7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:44.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.555+0000 7fa8f162c640 1 --2- 10.20.193.58:0/1986368309 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fa8ec15c040 0x7fa8ec1f7680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.555+0000 7fa8f162c640 1 -- 10.20.193.58:0/1986368309 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8dc0094b0 con 0x7fa8ec0b5680 2026-02-23T06:51:44.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.556+0000 7fa8f162c640 1 --2- 10.20.193.58:0/1986368309 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa8ec0b5680 0x7fa8ec1fd7c0 secure :-1 s=READY pgs=191 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8e0002800 tx=0x7fa8e000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:44.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.556+0000 7fa8da7fc640 1 -- 10.20.193.58:0/1986368309 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa8e00054a0 con 0x7fa8ec0b5680 2026-02-23T06:51:44.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.556+0000 7fa8da7fc640 1 -- 10.20.193.58:0/1986368309 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8e0003690 con 0x7fa8ec0b5680 2026-02-23T06:51:44.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.556+0000 7fa8da7fc640 1 -- 10.20.193.58:0/1986368309 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa8e0003aa0 con 0x7fa8ec0b5680 2026-02-23T06:51:44.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.556+0000 7fa8f2e2f640 1 -- 10.20.193.58:0/1986368309 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8ec136620 con 0x7fa8ec0b5680 2026-02-23T06:51:44.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.556+0000 7fa8f2e2f640 1 -- 10.20.193.58:0/1986368309 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8ec057730 con 0x7fa8ec0b5680 2026-02-23T06:51:44.552 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.556+0000 7fa8f2e2f640 1 -- 10.20.193.58:0/1986368309 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa8ec05b620 con 0x7fa8ec0b5680 2026-02-23T06:51:44.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.558+0000 7fa8da7fc640 1 -- 10.20.193.58:0/1986368309 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fa8e001b3b0 con 0x7fa8ec0b5680 2026-02-23T06:51:44.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.559+0000 7fa8da7fc640 1 --2- 10.20.193.58:0/1986368309 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa8bc07a6c0 0x7fa8bc09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:44.553 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.559+0000 7fa8da7fc640 1 -- 10.20.193.58:0/1986368309 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fa8e009d090 con 0x7fa8ec0b5680 2026-02-23T06:51:44.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.559+0000 7fa8da7fc640 1 --2- 10.20.193.58:0/1986368309 >> [v2:10.20.193.93:6819/2948039088,v1:10.20.193.93:6821/2948039088] conn(0x7fa8bc0a1cc0 0x7fa8bc0c2130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:44.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.559+0000 7fa8da7fc640 1 -- 10.20.193.58:0/1986368309 --> [v2:10.20.193.93:6819/2948039088,v1:10.20.193.93:6821/2948039088] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa8bc0c2800 con 0x7fa8bc0a1cc0 2026-02-23T06:51:44.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.559+0000 7fa8da7fc640 1 -- 10.20.193.58:0/1986368309 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa8e009d440 con 0x7fa8ec0b5680 2026-02-23T06:51:44.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.559+0000 7fa8f1e2d640 1 --2- 10.20.193.58:0/1986368309 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa8bc07a6c0 0x7fa8bc09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:44.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.559+0000 7fa8f262e640 1 --2- 10.20.193.58:0/1986368309 >> [v2:10.20.193.93:6819/2948039088,v1:10.20.193.93:6821/2948039088] conn(0x7fa8bc0a1cc0 0x7fa8bc0c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:44.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.560+0000 7fa8f1e2d640 1 --2- 10.20.193.58:0/1986368309 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa8bc07a6c0 0x7fa8bc09ab70 secure :-1 s=READY pgs=618 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8dc0097e0 tx=0x7fa8dc031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:44.554 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.560+0000 7fa8f262e640 1 --2- 10.20.193.58:0/1986368309 >> [v2:10.20.193.93:6819/2948039088,v1:10.20.193.93:6821/2948039088] conn(0x7fa8bc0a1cc0 0x7fa8bc0c2130 crc :-1 s=READY pgs=3713 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:44.555 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.560+0000 7fa8da7fc640 1 -- 10.20.193.58:0/1986368309 <== osd.6 v2:10.20.193.93:6819/2948039088 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7fa8bc0c2800 con 0x7fa8bc0a1cc0 2026-02-23T06:51:44.562 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.568+0000 7fa8f2e2f640 1 -- 10.20.193.58:0/1986368309 --> [v2:10.20.193.93:6819/2948039088,v1:10.20.193.93:6821/2948039088] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa8ec166120 con 0x7fa8bc0a1cc0 2026-02-23T06:51:44.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.568+0000 7fa8da7fc640 1 -- 10.20.193.58:0/1986368309 <== osd.6 v2:10.20.193.93:6819/2948039088 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa8e8003780 con 0x7fa8bc0a1cc0 2026-02-23T06:51:44.563 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:51:44.563 INFO:teuthology.orchestra.run.trial058.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-23T06:51:44.563 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:51:44.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.568+0000 7fa8f2e2f640 1 -- 10.20.193.58:0/1986368309 >> [v2:10.20.193.93:6819/2948039088,v1:10.20.193.93:6821/2948039088] conn(0x7fa8bc0a1cc0 msgr2=0x7fa8bc0c2130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:44.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.568+0000 7fa8f2e2f640 1 --2- 10.20.193.58:0/1986368309 >> [v2:10.20.193.93:6819/2948039088,v1:10.20.193.93:6821/2948039088] conn(0x7fa8bc0a1cc0 0x7fa8bc0c2130 crc :-1 s=READY pgs=3713 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.568+0000 7fa8f2e2f640 1 -- 10.20.193.58:0/1986368309 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa8bc07a6c0 msgr2=0x7fa8bc09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:44.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.568+0000 7fa8f2e2f640 1 --2- 10.20.193.58:0/1986368309 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fa8bc07a6c0 0x7fa8bc09ab70 secure :-1 s=READY pgs=618 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8dc0097e0 tx=0x7fa8dc031040 comp rx=0 tx=0).stop 2026-02-23T06:51:44.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.568+0000 7fa8f2e2f640 1 -- 10.20.193.58:0/1986368309 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa8ec0b5680 msgr2=0x7fa8ec1fd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:44.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.568+0000 7fa8f2e2f640 1 --2- 10.20.193.58:0/1986368309 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fa8ec0b5680 0x7fa8ec1fd7c0 secure :-1 s=READY pgs=191 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8e0002800 tx=0x7fa8e000c970 comp rx=0 tx=0).stop 2026-02-23T06:51:44.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.568+0000 7fa8f262e640 1 -- 10.20.193.58:0/1986368309 reap_dead start 2026-02-23T06:51:44.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.569+0000 7fa8f2e2f640 1 -- 10.20.193.58:0/1986368309 shutdown_connections 2026-02-23T06:51:44.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.569+0000 7fa8f2e2f640 1 -- 10.20.193.58:0/1986368309 >> 10.20.193.58:0/1986368309 conn(0x7fa8ec0b3c20 msgr2=0x7fa8ec15a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:44.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.569+0000 7fa8f2e2f640 1 -- 10.20.193.58:0/1986368309 shutdown_connections 2026-02-23T06:51:44.563 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.569+0000 7fa8f2e2f640 1 -- 10.20.193.58:0/1986368309 wait complete. 2026-02-23T06:51:44.569 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2026-02-23T06:51:44.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.695+0000 7efc7bfff640 1 -- 10.20.193.58:0/693630663 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc7c15d870 msgr2=0x7efc7c0587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:44.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.695+0000 7efc7bfff640 1 --2- 10.20.193.58:0/693630663 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc7c15d870 0x7efc7c0587b0 secure :-1 s=READY pgs=21 gs=2 cs=0 l=1 c_cookie=1450814674072942855 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc64004740 tx=0x7efc6402f1e0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.695+0000 7efc7bfff640 1 -- 10.20.193.58:0/693630663 shutdown_connections 2026-02-23T06:51:44.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.695+0000 7efc7bfff640 1 --2- 10.20.193.58:0/693630663 >> v2:10.20.193.93:3300/0 conn(0x7efc7c0b6690 0x7efc7c058cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.695+0000 7efc7bfff640 1 --2- 10.20.193.58:0/693630663 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc7c15d870 0x7efc7c0587b0 unknown :-1 s=CLOSED pgs=21 gs=2 cs=0 l=1 c_cookie=1450814674072942855 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.695+0000 7efc7bfff640 1 -- 10.20.193.58:0/693630663 >> 10.20.193.58:0/693630663 conn(0x7efc7c0b3c20 msgr2=0x7efc7c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:44.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.695+0000 7efc7bfff640 1 -- 10.20.193.58:0/693630663 shutdown_connections 2026-02-23T06:51:44.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.696+0000 7efc7bfff640 1 -- 10.20.193.58:0/693630663 wait complete. 2026-02-23T06:51:44.691 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.697+0000 7efc7bfff640 1 Processor -- start 2026-02-23T06:51:44.691 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.697+0000 7efc7bfff640 1 -- start start 2026-02-23T06:51:44.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.697+0000 7efc7bfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc7c0b6690 0x7efc7c13aff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:44.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.697+0000 7efc7bfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc7c15d4a0 0x7efc7c15f1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:44.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.697+0000 7efc7bfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc7c15d870 0x7efc7c15f6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:44.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.697+0000 7efc7bfff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c201750 con 0x7efc7c15d4a0 2026-02-23T06:51:44.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.697+0000 7efc7bfff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c200b80 con 0x7efc7c15d870 2026-02-23T06:51:44.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.697+0000 7efc7bfff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7efc7c15e320 con 0x7efc7c0b6690 2026-02-23T06:51:44.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.698+0000 7efc7affd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc7c0b6690 0x7efc7c13aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:44.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.698+0000 7efc7a7fc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc7c15d4a0 0x7efc7c15f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:44.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.698+0000 7efc7affd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc7c0b6690 0x7efc7c13aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:37492/0 (socket says 10.20.193.58:37492) 2026-02-23T06:51:44.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.698+0000 7efc7affd640 1 -- 10.20.193.58:0/2242866916 learned_addr learned my addr 10.20.193.58:0/2242866916 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:51:44.692 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.698+0000 7efc7b7fe640 1 --2- 10.20.193.58:0/2242866916 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc7c15d870 0x7efc7c15f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:44.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.698+0000 7efc7a7fc640 1 -- 10.20.193.58:0/2242866916 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc7c0b6690 msgr2=0x7efc7c13aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:44.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.698+0000 7efc7a7fc640 1 --2- 10.20.193.58:0/2242866916 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc7c0b6690 0x7efc7c13aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.698+0000 7efc7a7fc640 1 -- 10.20.193.58:0/2242866916 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc7c15d870 msgr2=0x7efc7c15f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:44.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.698+0000 7efc7a7fc640 1 --2- 10.20.193.58:0/2242866916 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc7c15d870 0x7efc7c15f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.698+0000 7efc7a7fc640 1 -- 10.20.193.58:0/2242866916 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc640094b0 con 0x7efc7c15d4a0 2026-02-23T06:51:44.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.698+0000 7efc7a7fc640 1 --2- 10.20.193.58:0/2242866916 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc7c15d4a0 0x7efc7c15f1b0 secure :-1 s=READY pgs=192 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc64009230 tx=0x7efc640028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:44.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.698+0000 7efc5b7fe640 1 -- 10.20.193.58:0/2242866916 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc64038470 con 0x7efc7c15d4a0 2026-02-23T06:51:44.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.698+0000 7efc5b7fe640 1 -- 10.20.193.58:0/2242866916 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc640386c0 con 0x7efc7c15d4a0 2026-02-23T06:51:44.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.698+0000 7efc5b7fe640 1 -- 10.20.193.58:0/2242866916 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc64038a90 con 0x7efc7c15d4a0 2026-02-23T06:51:44.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.698+0000 7efc7bfff640 1 -- 10.20.193.58:0/2242866916 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc7c200e20 con 0x7efc7c15d4a0 2026-02-23T06:51:44.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.698+0000 7efc7bfff640 1 -- 10.20.193.58:0/2242866916 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc7c2013e0 con 0x7efc7c15d4a0 2026-02-23T06:51:44.693 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.699+0000 7efc7bfff640 1 -- 10.20.193.58:0/2242866916 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc7c0b6d50 con 0x7efc7c15d4a0 2026-02-23T06:51:44.695 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.700+0000 7efc5b7fe640 1 -- 10.20.193.58:0/2242866916 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7efc64038bf0 con 0x7efc7c15d4a0 2026-02-23T06:51:44.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.701+0000 7efc5b7fe640 1 --2- 10.20.193.58:0/2242866916 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efc4807a6c0 0x7efc4809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:44.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.701+0000 7efc5b7fe640 1 -- 10.20.193.58:0/2242866916 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7efc640c3840 con 0x7efc7c15d4a0 2026-02-23T06:51:44.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.702+0000 7efc7affd640 1 --2- 10.20.193.58:0/2242866916 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efc4807a6c0 0x7efc4809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:44.696 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.702+0000 7efc5b7fe640 1 -- 10.20.193.58:0/2242866916 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7efc64086af0 con 0x7efc7c15d4a0 2026-02-23T06:51:44.697 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.702+0000 7efc7affd640 1 --2- 10.20.193.58:0/2242866916 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efc4807a6c0 0x7efc4809ab70 secure :-1 s=READY pgs=619 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc70004770 tx=0x7efc70002950 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:44.810 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.815+0000 7efc7bfff640 1 -- 10.20.193.58:0/2242866916 --> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7efc7c0b6330 con 0x7efc4807a6c0 2026-02-23T06:51:44.811 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.815+0000 7efc5b7fe640 1 -- 10.20.193.58:0/2242866916 <== mgr.4126 v2:10.20.193.93:6800/4124709854 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7efc70002ae0 con 0x7efc4807a6c0 2026-02-23T06:51:44.811 INFO:teuthology.orchestra.run.trial058.stderr:instructed osd(s) 6 to deep-scrub 2026-02-23T06:51:44.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.817+0000 7efc7bfff640 1 -- 10.20.193.58:0/2242866916 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efc4807a6c0 msgr2=0x7efc4809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:44.812 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.817+0000 7efc7bfff640 1 --2- 10.20.193.58:0/2242866916 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efc4807a6c0 0x7efc4809ab70 secure :-1 s=READY pgs=619 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc70004770 tx=0x7efc70002950 comp rx=0 tx=0).stop 2026-02-23T06:51:44.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.817+0000 7efc7bfff640 1 -- 10.20.193.58:0/2242866916 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc7c15d4a0 msgr2=0x7efc7c15f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:44.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.817+0000 7efc7bfff640 1 --2- 10.20.193.58:0/2242866916 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc7c15d4a0 0x7efc7c15f1b0 secure :-1 s=READY pgs=192 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc64009230 tx=0x7efc640028d0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.817+0000 7efc7bfff640 1 -- 10.20.193.58:0/2242866916 shutdown_connections 2026-02-23T06:51:44.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.817+0000 7efc7bfff640 1 --2- 10.20.193.58:0/2242866916 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7efc4807a6c0 0x7efc4809ab70 unknown :-1 s=CLOSED pgs=619 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.817+0000 7efc7bfff640 1 --2- 10.20.193.58:0/2242866916 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7efc7c15d870 0x7efc7c15f6f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.817+0000 7efc7bfff640 1 --2- 10.20.193.58:0/2242866916 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7efc7c15d4a0 0x7efc7c15f1b0 unknown :-1 s=CLOSED pgs=192 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.817+0000 7efc7bfff640 1 --2- 10.20.193.58:0/2242866916 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7efc7c0b6690 0x7efc7c13aff0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.817+0000 7efc7bfff640 1 -- 10.20.193.58:0/2242866916 >> 10.20.193.58:0/2242866916 conn(0x7efc7c0b3c20 msgr2=0x7efc7c0b0860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:44.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.817+0000 7efc7bfff640 1 -- 10.20.193.58:0/2242866916 shutdown_connections 2026-02-23T06:51:44.813 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.817+0000 7efc7bfff640 1 -- 10.20.193.58:0/2242866916 wait complete. 2026-02-23T06:51:44.824 INFO:tasks.ceph:Scrubbing osd.7 2026-02-23T06:51:44.824 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2026-02-23T06:51:44.946 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.951+0000 7fbd4bfff640 1 -- 10.20.193.58:0/99498684 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd4c056550 msgr2=0x7fbd4c05ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:44.947 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.951+0000 7fbd4bfff640 1 --2- 10.20.193.58:0/99498684 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd4c056550 0x7fbd4c05ce30 secure :-1 s=READY pgs=194 gs=3 cs=0 l=1 c_cookie=9277696640700127996 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd34004740 tx=0x7fbd3402f220 comp rx=0 tx=0).stop 2026-02-23T06:51:44.947 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.951+0000 7fbd4bfff640 1 -- 10.20.193.58:0/99498684 shutdown_connections 2026-02-23T06:51:44.947 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.951+0000 7fbd4bfff640 1 --2- 10.20.193.58:0/99498684 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd4c056550 0x7fbd4c05ce30 unknown :-1 s=CLOSED pgs=194 gs=3 cs=0 l=1 c_cookie=9277696640700127996 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.947 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.951+0000 7fbd4bfff640 1 -- 10.20.193.58:0/99498684 >> 10.20.193.58:0/99498684 conn(0x7fbd4c0b3c20 msgr2=0x7fbd4c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:44.947 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.951+0000 7fbd4bfff640 1 -- 10.20.193.58:0/99498684 shutdown_connections 2026-02-23T06:51:44.947 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.951+0000 7fbd4bfff640 1 -- 10.20.193.58:0/99498684 wait complete. 2026-02-23T06:51:44.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.953+0000 7fbd4bfff640 1 Processor -- start 2026-02-23T06:51:44.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.953+0000 7fbd4bfff640 1 -- start start 2026-02-23T06:51:44.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.953+0000 7fbd4bfff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd4c056550 0x7fbd4c1fdab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:44.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.953+0000 7fbd4bfff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd4c05d370 0x7fbd4c058810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:44.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.953+0000 7fbd4bfff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd4c15c040 0x7fbd4c160690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:44.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.953+0000 7fbd4bfff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c161370 con 0x7fbd4c15c040 2026-02-23T06:51:44.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.953+0000 7fbd4bfff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c0aeab0 con 0x7fbd4c05d370 2026-02-23T06:51:44.950 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.953+0000 7fbd4bfff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fbd4c15ff30 con 0x7fbd4c056550 2026-02-23T06:51:44.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.954+0000 7fbd4affd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd4c056550 0x7fbd4c1fdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:44.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.954+0000 7fbd4a7fc640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd4c05d370 0x7fbd4c058810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:44.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.954+0000 7fbd4b7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd4c15c040 0x7fbd4c160690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:44.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.954+0000 7fbd4affd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd4c056550 0x7fbd4c1fdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:37498/0 (socket says 10.20.193.58:37498) 2026-02-23T06:51:44.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.954+0000 7fbd4affd640 1 -- 10.20.193.58:0/4156007780 learned_addr learned my addr 10.20.193.58:0/4156007780 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:51:44.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.954+0000 7fbd4b7fe640 1 -- 10.20.193.58:0/4156007780 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd4c056550 msgr2=0x7fbd4c1fdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:44.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.954+0000 7fbd4b7fe640 1 --2- 10.20.193.58:0/4156007780 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fbd4c056550 0x7fbd4c1fdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.954+0000 7fbd4b7fe640 1 -- 10.20.193.58:0/4156007780 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd4c05d370 msgr2=0x7fbd4c058810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:44.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.954+0000 7fbd4b7fe640 1 --2- 10.20.193.58:0/4156007780 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fbd4c05d370 0x7fbd4c058810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.954+0000 7fbd4b7fe640 1 -- 10.20.193.58:0/4156007780 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd340094b0 con 0x7fbd4c15c040 2026-02-23T06:51:44.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.954+0000 7fbd4b7fe640 1 --2- 10.20.193.58:0/4156007780 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd4c15c040 0x7fbd4c160690 secure :-1 s=READY pgs=195 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd3c00d420 tx=0x7fbd3c00d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:44.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.954+0000 7fbd2b7fe640 1 -- 10.20.193.58:0/4156007780 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd3c0062f0 con 0x7fbd4c15c040 2026-02-23T06:51:44.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.954+0000 7fbd2b7fe640 1 -- 10.20.193.58:0/4156007780 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd3c006560 con 0x7fbd4c15c040 2026-02-23T06:51:44.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.954+0000 7fbd2b7fe640 1 -- 10.20.193.58:0/4156007780 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd3c004a30 con 0x7fbd4c15c040 2026-02-23T06:51:44.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.954+0000 7fbd4bfff640 1 -- 10.20.193.58:0/4156007780 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd4c1625f0 con 0x7fbd4c15c040 2026-02-23T06:51:44.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.954+0000 7fbd4bfff640 1 -- 10.20.193.58:0/4156007780 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd4c162bb0 con 0x7fbd4c15c040 2026-02-23T06:51:44.952 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.955+0000 7fbd4bfff640 1 -- 10.20.193.58:0/4156007780 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbd4c05d9c0 con 0x7fbd4c15c040 2026-02-23T06:51:44.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.956+0000 7fbd2b7fe640 1 -- 10.20.193.58:0/4156007780 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fbd3c004b90 con 0x7fbd4c15c040 2026-02-23T06:51:44.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.957+0000 7fbd2b7fe640 1 --2- 10.20.193.58:0/4156007780 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbd1807a6c0 0x7fbd1809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:44.953 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.957+0000 7fbd2b7fe640 1 -- 10.20.193.58:0/4156007780 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fbd3c09e4a0 con 0x7fbd4c15c040 2026-02-23T06:51:44.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.957+0000 7fbd2b7fe640 1 --2- 10.20.193.58:0/4156007780 >> [v2:10.20.193.93:6818/2960650087,v1:10.20.193.93:6820/2960650087] conn(0x7fbd180a1cd0 0x7fbd180c2140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:44.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.957+0000 7fbd2b7fe640 1 -- 10.20.193.58:0/4156007780 --> [v2:10.20.193.93:6818/2960650087,v1:10.20.193.93:6820/2960650087] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd180c2810 con 0x7fbd180a1cd0 2026-02-23T06:51:44.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.957+0000 7fbd2b7fe640 1 -- 10.20.193.58:0/4156007780 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbd3c09e850 con 0x7fbd4c15c040 2026-02-23T06:51:44.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.958+0000 7fbd4affd640 1 --2- 10.20.193.58:0/4156007780 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbd1807a6c0 0x7fbd1809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:44.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.958+0000 7fbd4a7fc640 1 --2- 10.20.193.58:0/4156007780 >> [v2:10.20.193.93:6818/2960650087,v1:10.20.193.93:6820/2960650087] conn(0x7fbd180a1cd0 0x7fbd180c2140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:44.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.958+0000 7fbd4affd640 1 --2- 10.20.193.58:0/4156007780 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbd1807a6c0 0x7fbd1809ab70 secure :-1 s=READY pgs=620 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd400023d0 tx=0x7fbd40007e70 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:44.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.958+0000 7fbd4a7fc640 1 --2- 10.20.193.58:0/4156007780 >> [v2:10.20.193.93:6818/2960650087,v1:10.20.193.93:6820/2960650087] conn(0x7fbd180a1cd0 0x7fbd180c2140 crc :-1 s=READY pgs=1456 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:44.955 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.959+0000 7fbd2b7fe640 1 -- 10.20.193.58:0/4156007780 <== osd.7 v2:10.20.193.93:6818/2960650087 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7fbd180c2810 con 0x7fbd180a1cd0 2026-02-23T06:51:44.962 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.967+0000 7fbd4bfff640 1 -- 10.20.193.58:0/4156007780 --> [v2:10.20.193.93:6818/2960650087,v1:10.20.193.93:6820/2960650087] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbd4c15c410 con 0x7fbd180a1cd0 2026-02-23T06:51:44.963 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.967+0000 7fbd2b7fe640 1 -- 10.20.193.58:0/4156007780 <== osd.7 v2:10.20.193.93:6818/2960650087 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbd3403e040 con 0x7fbd180a1cd0 2026-02-23T06:51:44.963 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-23T06:51:44.964 INFO:teuthology.orchestra.run.trial058.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-23T06:51:44.964 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-23T06:51:44.965 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.967+0000 7fbd4bfff640 1 -- 10.20.193.58:0/4156007780 >> [v2:10.20.193.93:6818/2960650087,v1:10.20.193.93:6820/2960650087] conn(0x7fbd180a1cd0 msgr2=0x7fbd180c2140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:44.966 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.967+0000 7fbd4bfff640 1 --2- 10.20.193.58:0/4156007780 >> [v2:10.20.193.93:6818/2960650087,v1:10.20.193.93:6820/2960650087] conn(0x7fbd180a1cd0 0x7fbd180c2140 crc :-1 s=READY pgs=1456 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.966 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.967+0000 7fbd4bfff640 1 -- 10.20.193.58:0/4156007780 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbd1807a6c0 msgr2=0x7fbd1809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:44.966 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.967+0000 7fbd4bfff640 1 --2- 10.20.193.58:0/4156007780 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fbd1807a6c0 0x7fbd1809ab70 secure :-1 s=READY pgs=620 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd400023d0 tx=0x7fbd40007e70 comp rx=0 tx=0).stop 2026-02-23T06:51:44.966 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.967+0000 7fbd4bfff640 1 -- 10.20.193.58:0/4156007780 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd4c15c040 msgr2=0x7fbd4c160690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:44.966 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.967+0000 7fbd4bfff640 1 --2- 10.20.193.58:0/4156007780 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fbd4c15c040 0x7fbd4c160690 secure :-1 s=READY pgs=195 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd3c00d420 tx=0x7fbd3c00d8f0 comp rx=0 tx=0).stop 2026-02-23T06:51:44.967 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.967+0000 7fbd4b7fe640 1 -- 10.20.193.58:0/4156007780 reap_dead start 2026-02-23T06:51:44.967 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.967+0000 7fbd4bfff640 1 -- 10.20.193.58:0/4156007780 shutdown_connections 2026-02-23T06:51:44.967 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.967+0000 7fbd4bfff640 1 -- 10.20.193.58:0/4156007780 >> 10.20.193.58:0/4156007780 conn(0x7fbd4c0b3c20 msgr2=0x7fbd4c0b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:44.967 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.967+0000 7fbd4bfff640 1 -- 10.20.193.58:0/4156007780 shutdown_connections 2026-02-23T06:51:44.967 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:44.967+0000 7fbd4bfff640 1 -- 10.20.193.58:0/4156007780 wait complete. 2026-02-23T06:51:44.970 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2026-02-23T06:51:45.094 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.098+0000 7f13be992640 1 -- 10.20.193.58:0/2544882201 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f13a0004850 msgr2=0x7f13a0004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:45.094 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.098+0000 7f13be992640 1 --2- 10.20.193.58:0/2544882201 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f13a0004850 0x7f13a0004cc0 secure :-1 s=READY pgs=197 gs=4 cs=0 l=1 c_cookie=17580665110336045053 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13ac00bb10 tx=0x7f13ac02f780 comp rx=0 tx=0).stop 2026-02-23T06:51:45.094 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.098+0000 7f13be992640 1 -- 10.20.193.58:0/2544882201 shutdown_connections 2026-02-23T06:51:45.094 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.098+0000 7f13be992640 1 --2- 10.20.193.58:0/2544882201 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f13a0004850 0x7f13a0004cc0 unknown :-1 s=CLOSED pgs=197 gs=4 cs=0 l=1 c_cookie=17580665110336045053 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:45.094 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.098+0000 7f13be992640 1 -- 10.20.193.58:0/2544882201 >> 10.20.193.58:0/2544882201 conn(0x7f13b80b3c20 msgr2=0x7f13b80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:45.094 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.098+0000 7f13be992640 1 -- 10.20.193.58:0/2544882201 shutdown_connections 2026-02-23T06:51:45.094 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.098+0000 7f13be992640 1 -- 10.20.193.58:0/2544882201 wait complete. 2026-02-23T06:51:45.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.100+0000 7f13be992640 1 Processor -- start 2026-02-23T06:51:45.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.100+0000 7f13be992640 1 -- start start 2026-02-23T06:51:45.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.100+0000 7f13be992640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f13a0004850 0x7f13b81609c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:45.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.100+0000 7f13be992640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f13b813e430 0x7f13b81624f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:45.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.100+0000 7f13be992640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f13b8160330 0x7f13b8159db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:45.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.100+0000 7f13be992640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f13b81fe7a0 con 0x7f13b8160330 2026-02-23T06:51:45.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.100+0000 7f13be992640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f13b813e150 con 0x7f13a0004850 2026-02-23T06:51:45.097 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.100+0000 7f13be992640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f13b81fea10 con 0x7f13b813e430 2026-02-23T06:51:45.098 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.100+0000 7f13be191640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f13b8160330 0x7f13b8159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:45.098 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.101+0000 7f13be191640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f13b8160330 0x7f13b8159db0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:50342/0 (socket says 10.20.193.58:50342) 2026-02-23T06:51:45.098 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.101+0000 7f13be191640 1 -- 10.20.193.58:0/216746563 learned_addr learned my addr 10.20.193.58:0/216746563 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:51:45.098 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.101+0000 7f13bd990640 1 --2- 10.20.193.58:0/216746563 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f13a0004850 0x7f13b81609c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:45.098 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.101+0000 7f13bd18f640 1 --2- 10.20.193.58:0/216746563 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f13b813e430 0x7f13b81624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:45.098 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.101+0000 7f13be191640 1 -- 10.20.193.58:0/216746563 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f13b813e430 msgr2=0x7f13b81624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:45.098 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.101+0000 7f13be191640 1 --2- 10.20.193.58:0/216746563 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f13b813e430 0x7f13b81624f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:45.098 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.101+0000 7f13be191640 1 -- 10.20.193.58:0/216746563 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f13a0004850 msgr2=0x7f13b81609c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:45.098 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.101+0000 7f13be191640 1 --2- 10.20.193.58:0/216746563 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f13a0004850 0x7f13b81609c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:45.098 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.101+0000 7f13be191640 1 -- 10.20.193.58:0/216746563 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13b8167100 con 0x7f13b8160330 2026-02-23T06:51:45.098 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.101+0000 7f13be191640 1 --2- 10.20.193.58:0/216746563 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f13b8160330 0x7f13b8159db0 secure :-1 s=READY pgs=198 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13b8163350 tx=0x7f13b4007810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:45.098 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.101+0000 7f13a67fc640 1 -- 10.20.193.58:0/216746563 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f13b400eb30 con 0x7f13b8160330 2026-02-23T06:51:45.099 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.101+0000 7f13a67fc640 1 -- 10.20.193.58:0/216746563 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13b400ed80 con 0x7f13b8160330 2026-02-23T06:51:45.099 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.101+0000 7f13a67fc640 1 -- 10.20.193.58:0/216746563 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f13b40116d0 con 0x7f13b8160330 2026-02-23T06:51:45.099 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.101+0000 7f13be992640 1 -- 10.20.193.58:0/216746563 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13b81673f0 con 0x7f13b8160330 2026-02-23T06:51:45.099 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.101+0000 7f13be992640 1 -- 10.20.193.58:0/216746563 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13b813f9e0 con 0x7f13b8160330 2026-02-23T06:51:45.099 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.102+0000 7f13be992640 1 -- 10.20.193.58:0/216746563 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13b80b6d50 con 0x7f13b8160330 2026-02-23T06:51:45.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.103+0000 7f13a67fc640 1 -- 10.20.193.58:0/216746563 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f13b4011830 con 0x7f13b8160330 2026-02-23T06:51:45.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.104+0000 7f13a67fc640 1 --2- 10.20.193.58:0/216746563 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f138807a6b0 0x7f138809ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:45.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.104+0000 7f13a67fc640 1 -- 10.20.193.58:0/216746563 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f13b409dcd0 con 0x7f13b8160330 2026-02-23T06:51:45.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.104+0000 7f13bd990640 1 --2- 10.20.193.58:0/216746563 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f138807a6b0 0x7f138809ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:45.100 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.105+0000 7f13bd990640 1 --2- 10.20.193.58:0/216746563 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f138807a6b0 0x7f138809ab60 secure :-1 s=READY pgs=621 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13a8002b30 tx=0x7f13a8006040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:45.101 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.106+0000 7f13a67fc640 1 -- 10.20.193.58:0/216746563 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f13b4060e70 con 0x7f13b8160330 2026-02-23T06:51:45.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.219+0000 7f13be992640 1 -- 10.20.193.58:0/216746563 --> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f13b80b5e10 con 0x7f138807a6b0 2026-02-23T06:51:45.215 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.221+0000 7f13a67fc640 1 -- 10.20.193.58:0/216746563 <== mgr.4126 v2:10.20.193.93:6800/4124709854 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f13a8011e80 con 0x7f138807a6b0 2026-02-23T06:51:45.215 INFO:teuthology.orchestra.run.trial058.stderr:instructed osd(s) 7 to deep-scrub 2026-02-23T06:51:45.217 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.221+0000 7f13be992640 1 -- 10.20.193.58:0/216746563 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f138807a6b0 msgr2=0x7f138809ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:45.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.221+0000 7f13be992640 1 --2- 10.20.193.58:0/216746563 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f138807a6b0 0x7f138809ab60 secure :-1 s=READY pgs=621 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13a8002b30 tx=0x7f13a8006040 comp rx=0 tx=0).stop 2026-02-23T06:51:45.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.221+0000 7f13be992640 1 -- 10.20.193.58:0/216746563 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f13b8160330 msgr2=0x7f13b8159db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:45.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.221+0000 7f13be992640 1 --2- 10.20.193.58:0/216746563 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f13b8160330 0x7f13b8159db0 secure :-1 s=READY pgs=198 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13b8163350 tx=0x7f13b4007810 comp rx=0 tx=0).stop 2026-02-23T06:51:45.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.221+0000 7f13be992640 1 -- 10.20.193.58:0/216746563 shutdown_connections 2026-02-23T06:51:45.218 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.221+0000 7f13be992640 1 --2- 10.20.193.58:0/216746563 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f138807a6b0 0x7f138809ab60 unknown :-1 s=CLOSED pgs=621 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:45.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.221+0000 7f13be992640 1 --2- 10.20.193.58:0/216746563 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f13b8160330 0x7f13b8159db0 unknown :-1 s=CLOSED pgs=198 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:45.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.221+0000 7f13be992640 1 --2- 10.20.193.58:0/216746563 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f13b813e430 0x7f13b81624f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:45.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.221+0000 7f13be992640 1 --2- 10.20.193.58:0/216746563 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f13a0004850 0x7f13b81609c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:45.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.221+0000 7f13be992640 1 -- 10.20.193.58:0/216746563 >> 10.20.193.58:0/216746563 conn(0x7f13b80b3c20 msgr2=0x7f13b815bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:45.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.221+0000 7f13be992640 1 -- 10.20.193.58:0/216746563 shutdown_connections 2026-02-23T06:51:45.219 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.221+0000 7f13be992640 1 -- 10.20.193.58:0/216746563 wait complete. 2026-02-23T06:51:45.228 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-23T06:51:45.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.354+0000 7f9fd910c640 1 -- 10.20.193.58:0/1827780539 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9fd40b10e0 msgr2=0x7f9fd405b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:45.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.354+0000 7f9fd910c640 1 --2- 10.20.193.58:0/1827780539 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9fd40b10e0 0x7f9fd405b230 secure :-1 s=READY pgs=199 gs=2 cs=0 l=1 c_cookie=15945275089469447354 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fc8005e70 tx=0x7f9fc802f320 comp rx=0 tx=0).stop 2026-02-23T06:51:45.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.354+0000 7f9fd910c640 1 -- 10.20.193.58:0/1827780539 shutdown_connections 2026-02-23T06:51:45.350 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.354+0000 7f9fd910c640 1 --2- 10.20.193.58:0/1827780539 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9fd40b6020 0x7f9fd415ce30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:45.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.354+0000 7f9fd910c640 1 --2- 10.20.193.58:0/1827780539 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9fd40b10e0 0x7f9fd405b230 unknown :-1 s=CLOSED pgs=199 gs=2 cs=0 l=1 c_cookie=15945275089469447354 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:45.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.354+0000 7f9fd910c640 1 -- 10.20.193.58:0/1827780539 >> 10.20.193.58:0/1827780539 conn(0x7f9fd40561f0 msgr2=0x7f9fd40565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:45.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.355+0000 7f9fd910c640 1 -- 10.20.193.58:0/1827780539 shutdown_connections 2026-02-23T06:51:45.351 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.355+0000 7f9fd910c640 1 -- 10.20.193.58:0/1827780539 wait complete. 2026-02-23T06:51:45.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.356+0000 7f9fd910c640 1 Processor -- start 2026-02-23T06:51:45.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.356+0000 7f9fd910c640 1 -- start start 2026-02-23T06:51:45.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.357+0000 7f9fd910c640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9fd40b10e0 0x7f9fd40b0180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:45.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.357+0000 7f9fd910c640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9fd40b6020 0x7f9fd4164770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:45.353 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.357+0000 7f9fd910c640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9fd4163c70 0x7f9fd4164cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:45.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.357+0000 7f9fd910c640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd41fdba0 con 0x7f9fd4163c70 2026-02-23T06:51:45.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.357+0000 7f9fd910c640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd40ad9f0 con 0x7f9fd40b6020 2026-02-23T06:51:45.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.357+0000 7f9fd910c640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f9fd41fde40 con 0x7f9fd40b10e0 2026-02-23T06:51:45.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.357+0000 7f9fd2d76640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9fd40b10e0 0x7f9fd40b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:45.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.357+0000 7f9fd3577640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9fd4163c70 0x7f9fd4164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:45.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.357+0000 7f9fd2d76640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9fd40b10e0 0x7f9fd40b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:37552/0 (socket says 10.20.193.58:37552) 2026-02-23T06:51:45.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.357+0000 7f9fd2d76640 1 -- 10.20.193.58:0/3209268259 learned_addr learned my addr 10.20.193.58:0/3209268259 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:51:45.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.357+0000 7f9fd2575640 1 --2- 10.20.193.58:0/3209268259 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9fd40b6020 0x7f9fd4164770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:45.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.357+0000 7f9fd3577640 1 -- 10.20.193.58:0/3209268259 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9fd40b10e0 msgr2=0x7f9fd40b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:45.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.357+0000 7f9fd3577640 1 --2- 10.20.193.58:0/3209268259 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9fd40b10e0 0x7f9fd40b0180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:45.354 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.357+0000 7f9fd3577640 1 -- 10.20.193.58:0/3209268259 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9fd40b6020 msgr2=0x7f9fd4164770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:45.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.357+0000 7f9fd3577640 1 --2- 10.20.193.58:0/3209268259 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9fd40b6020 0x7f9fd4164770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:45.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.357+0000 7f9fd3577640 1 -- 10.20.193.58:0/3209268259 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fc8009570 con 0x7f9fd4163c70 2026-02-23T06:51:45.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.357+0000 7f9fd3577640 1 --2- 10.20.193.58:0/3209268259 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9fd4163c70 0x7f9fd4164cb0 secure :-1 s=READY pgs=200 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fd40b6420 tx=0x7f9fc400eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:45.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.357+0000 7f9fb37fe640 1 -- 10.20.193.58:0/3209268259 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9fc4005500 con 0x7f9fd4163c70 2026-02-23T06:51:45.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.358+0000 7f9fb37fe640 1 -- 10.20.193.58:0/3209268259 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9fc4003780 con 0x7f9fd4163c70 2026-02-23T06:51:45.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.358+0000 7f9fb37fe640 1 -- 10.20.193.58:0/3209268259 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9fc4003b90 con 0x7f9fd4163c70 2026-02-23T06:51:45.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.358+0000 7f9fd910c640 1 -- 10.20.193.58:0/3209268259 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fd41fe120 con 0x7f9fd4163c70 2026-02-23T06:51:45.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.358+0000 7f9fd910c640 1 -- 10.20.193.58:0/3209268259 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fd41fe6e0 con 0x7f9fd4163c70 2026-02-23T06:51:45.355 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.358+0000 7f9fd910c640 1 -- 10.20.193.58:0/3209268259 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fd4164490 con 0x7f9fd4163c70 2026-02-23T06:51:45.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.359+0000 7f9fb37fe640 1 -- 10.20.193.58:0/3209268259 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f9fc4003cf0 con 0x7f9fd4163c70 2026-02-23T06:51:45.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.360+0000 7f9fb37fe640 1 --2- 10.20.193.58:0/3209268259 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9fa007a6c0 0x7f9fa009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:51:45.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.361+0000 7f9fb37fe640 1 -- 10.20.193.58:0/3209268259 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f9fc409edc0 con 0x7f9fd4163c70 2026-02-23T06:51:45.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.361+0000 7f9fd2d76640 1 --2- 10.20.193.58:0/3209268259 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9fa007a6c0 0x7f9fa009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:51:45.356 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.361+0000 7f9fb37fe640 1 -- 10.20.193.58:0/3209268259 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f9fc4062090 con 0x7f9fd4163c70 2026-02-23T06:51:45.357 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.362+0000 7f9fd2d76640 1 --2- 10.20.193.58:0/3209268259 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9fa007a6c0 0x7f9fa009ab70 secure :-1 s=READY pgs=622 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fc80098a0 tx=0x7f9fc803a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:51:45.468 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.473+0000 7f9fd910c640 1 -- 10.20.193.58:0/3209268259 --> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9fd40b6ae0 con 0x7f9fa007a6c0 2026-02-23T06:51:45.471 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.477+0000 7f9fb37fe640 1 -- 10.20.193.58:0/3209268259 <== mgr.4126 v2:10.20.193.93:6800/4124709854 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333178 (secure 0 0 0) 0x7f9fc803e040 con 0x7f9fa007a6c0 2026-02-23T06:51:45.475 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:51:45.477 INFO:teuthology.orchestra.run.trial058.stderr:dumped all 2026-02-23T06:51:45.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.479+0000 7f9fd910c640 1 -- 10.20.193.58:0/3209268259 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9fa007a6c0 msgr2=0x7f9fa009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:45.477 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.479+0000 7f9fd910c640 1 --2- 10.20.193.58:0/3209268259 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9fa007a6c0 0x7f9fa009ab70 secure :-1 s=READY pgs=622 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fc80098a0 tx=0x7f9fc803a040 comp rx=0 tx=0).stop 2026-02-23T06:51:45.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.479+0000 7f9fd910c640 1 -- 10.20.193.58:0/3209268259 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9fd4163c70 msgr2=0x7f9fd4164cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:51:45.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.479+0000 7f9fd910c640 1 --2- 10.20.193.58:0/3209268259 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9fd4163c70 0x7f9fd4164cb0 secure :-1 s=READY pgs=200 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fd40b6420 tx=0x7f9fc400eaf0 comp rx=0 tx=0).stop 2026-02-23T06:51:45.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.479+0000 7f9fd910c640 1 -- 10.20.193.58:0/3209268259 shutdown_connections 2026-02-23T06:51:45.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.479+0000 7f9fd910c640 1 --2- 10.20.193.58:0/3209268259 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f9fa007a6c0 0x7f9fa009ab70 unknown :-1 s=CLOSED pgs=622 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:45.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.479+0000 7f9fd910c640 1 --2- 10.20.193.58:0/3209268259 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f9fd4163c70 0x7f9fd4164cb0 unknown :-1 s=CLOSED pgs=200 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:45.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.479+0000 7f9fd910c640 1 --2- 10.20.193.58:0/3209268259 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f9fd40b6020 0x7f9fd4164770 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:45.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.479+0000 7f9fd910c640 1 --2- 10.20.193.58:0/3209268259 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f9fd40b10e0 0x7f9fd40b0180 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:51:45.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.479+0000 7f9fd910c640 1 -- 10.20.193.58:0/3209268259 >> 10.20.193.58:0/3209268259 conn(0x7f9fd40561f0 msgr2=0x7f9fd4143d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:51:45.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.479+0000 7f9fd910c640 1 -- 10.20.193.58:0/3209268259 shutdown_connections 2026-02-23T06:51:45.478 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:51:45.479+0000 7f9fd910c640 1 -- 10.20.193.58:0/3209268259 wait complete. 2026-02-23T06:51:45.487 INFO:teuthology.orchestra.run.trial058.stdout:{"pg_ready":true,"pg_map":{"version":941,"stamp":"2026-02-23T06:51:44.656743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":13847387,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":119,"num_read_kb":180,"num_write":760130,"num_write_kb":39399281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65243,"ondisk_log_size":65243,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1917100,"kb_used_data":77612,"kb_used_omap":709,"kb_used_meta":1838650,"kb_avail":753057620,"statfs":{"total":773094113280,"available":771131002880,"internally_reserved":0,"allocated":79474688,"data_stored":410321022,"data_compressed":25350852,"data_compressed_allocated":52318208,"data_compressed_original":384622592,"omap_allocated":726837,"internal_metadata":1882777803},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3565134079,"num_objects":-850,"num_object_clones":0,"num_object_copies":-3400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-850,"num_whiteouts":0,"num_read":2,"num_read_kb":5,"num_write":861,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001642"},"pg_stats":[{"pgid":"2.1f","version":"27'29","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.708477+0000","last_change":"2026-02-23T06:21:17.142582+0000","last_active":"2026-02-23T06:51:38.708477+0000","last_peered":"2026-02-23T06:51:38.708477+0000","last_clean":"2026-02-23T06:51:38.708477+0000","last_became_active":"2026-02-23T06:21:17.142416+0000","last_became_peered":"2026-02-23T06:21:17.142416+0000","last_unstale":"2026-02-23T06:51:38.708477+0000","last_undegraded":"2026-02-23T06:51:38.708477+0000","last_fullsized":"2026-02-23T06:51:38.708477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:13:12.649937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590563,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'11","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.729701+0000","last_change":"2026-02-23T06:21:18.148362+0000","last_active":"2026-02-23T06:51:38.729701+0000","last_peered":"2026-02-23T06:51:38.729701+0000","last_clean":"2026-02-23T06:51:38.729701+0000","last_became_active":"2026-02-23T06:21:18.148276+0000","last_became_peered":"2026-02-23T06:21:18.148276+0000","last_unstale":"2026-02-23T06:51:38.729701+0000","last_undegraded":"2026-02-23T06:51:38.729701+0000","last_fullsized":"2026-02-23T06:51:38.729701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:03:47.221741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'2077","reported_seq":2108,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.141814+0000","last_change":"2026-02-23T06:21:22.169541+0000","last_active":"2026-02-23T06:51:44.141814+0000","last_peered":"2026-02-23T06:51:44.141814+0000","last_clean":"2026-02-23T06:51:44.141814+0000","last_became_active":"2026-02-23T06:21:22.169307+0000","last_became_peered":"2026-02-23T06:21:22.169307+0000","last_unstale":"2026-02-23T06:51:44.141814+0000","last_undegraded":"2026-02-23T06:51:44.141814+0000","last_fullsized":"2026-02-23T06:51:44.141814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2077,"log_dups_size":0,"ondisk_log_size":2077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:40:10.952374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25614,"num_write_kb":1337383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'3","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.078645+0000","last_change":"2026-02-23T06:21:17.138864+0000","last_active":"2026-02-23T06:49:41.078645+0000","last_peered":"2026-02-23T06:49:41.078645+0000","last_clean":"2026-02-23T06:49:41.078645+0000","last_became_active":"2026-02-23T06:21:17.138651+0000","last_became_peered":"2026-02-23T06:21:17.138651+0000","last_unstale":"2026-02-23T06:49:41.078645+0000","last_undegraded":"2026-02-23T06:49:41.078645+0000","last_fullsized":"2026-02-23T06:49:41.078645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:24.172617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'21","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.725507+0000","last_change":"2026-02-23T06:21:18.145040+0000","last_active":"2026-02-23T06:51:38.725507+0000","last_peered":"2026-02-23T06:51:38.725507+0000","last_clean":"2026-02-23T06:51:38.725507+0000","last_became_active":"2026-02-23T06:21:18.144915+0000","last_became_peered":"2026-02-23T06:21:18.144915+0000","last_unstale":"2026-02-23T06:51:38.725507+0000","last_undegraded":"2026-02-23T06:51:38.725507+0000","last_fullsized":"2026-02-23T06:51:38.725507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:17:30.105623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'2043","reported_seq":2082,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.132604+0000","last_change":"2026-02-23T06:22:05.910182+0000","last_active":"2026-02-23T06:51:44.132604+0000","last_peered":"2026-02-23T06:51:44.132604+0000","last_clean":"2026-02-23T06:51:44.132604+0000","last_became_active":"2026-02-23T06:22:05.909877+0000","last_became_peered":"2026-02-23T06:22:05.909877+0000","last_unstale":"2026-02-23T06:51:44.132604+0000","last_undegraded":"2026-02-23T06:51:44.132604+0000","last_fullsized":"2026-02-23T06:51:44.132604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2043,"log_dups_size":0,"ondisk_log_size":2043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25337,"num_write_kb":1284660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'9","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.059320+0000","last_change":"2026-02-23T06:21:17.150375+0000","last_active":"2026-02-23T06:49:41.059320+0000","last_peered":"2026-02-23T06:49:41.059320+0000","last_clean":"2026-02-23T06:49:41.059320+0000","last_became_active":"2026-02-23T06:21:17.150244+0000","last_became_peered":"2026-02-23T06:21:17.150244+0000","last_unstale":"2026-02-23T06:49:41.059320+0000","last_undegraded":"2026-02-23T06:49:41.059320+0000","last_fullsized":"2026-02-23T06:49:41.059320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:06:21.465108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'18","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:39.100306+0000","last_change":"2026-02-23T06:21:18.150247+0000","last_active":"2026-02-23T06:51:39.100306+0000","last_peered":"2026-02-23T06:51:39.100306+0000","last_clean":"2026-02-23T06:51:39.100306+0000","last_became_active":"2026-02-23T06:21:18.149827+0000","last_became_peered":"2026-02-23T06:21:18.149827+0000","last_unstale":"2026-02-23T06:51:39.100306+0000","last_undegraded":"2026-02-23T06:51:39.100306+0000","last_fullsized":"2026-02-23T06:51:39.100306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:37:58.944726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'1774","reported_seq":1805,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.024137+0000","last_change":"2026-02-23T06:21:22.174417+0000","last_active":"2026-02-23T06:51:44.024137+0000","last_peered":"2026-02-23T06:51:44.024137+0000","last_clean":"2026-02-23T06:51:44.024137+0000","last_became_active":"2026-02-23T06:21:22.173939+0000","last_became_peered":"2026-02-23T06:21:22.173939+0000","last_unstale":"2026-02-23T06:51:44.024137+0000","last_undegraded":"2026-02-23T06:51:44.024137+0000","last_fullsized":"2026-02-23T06:51:44.024137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1774,"log_dups_size":0,"ondisk_log_size":1774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22016,"num_write_kb":1043178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:48:49.514790+0000","last_change":"2026-02-23T06:21:17.145244+0000","last_active":"2026-02-23T06:48:49.514790+0000","last_peered":"2026-02-23T06:48:49.514790+0000","last_clean":"2026-02-23T06:48:49.514790+0000","last_became_active":"2026-02-23T06:21:17.144122+0000","last_became_peered":"2026-02-23T06:21:17.144122+0000","last_unstale":"2026-02-23T06:48:49.514790+0000","last_undegraded":"2026-02-23T06:48:49.514790+0000","last_fullsized":"2026-02-23T06:48:49.514790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:42:56.020005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'26","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.731336+0000","last_change":"2026-02-23T06:22:05.870395+0000","last_active":"2026-02-23T06:51:38.731336+0000","last_peered":"2026-02-23T06:51:38.731336+0000","last_clean":"2026-02-23T06:51:38.731336+0000","last_became_active":"2026-02-23T06:22:05.870252+0000","last_became_peered":"2026-02-23T06:22:05.870252+0000","last_unstale":"2026-02-23T06:51:38.731336+0000","last_undegraded":"2026-02-23T06:51:38.731336+0000","last_fullsized":"2026-02-23T06:51:38.731336+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:05:32.729525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'2124","reported_seq":2155,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.125915+0000","last_change":"2026-02-23T06:21:22.168755+0000","last_active":"2026-02-23T06:51:44.125915+0000","last_peered":"2026-02-23T06:51:44.125915+0000","last_clean":"2026-02-23T06:51:44.125915+0000","last_became_active":"2026-02-23T06:21:22.165671+0000","last_became_peered":"2026-02-23T06:21:22.165671+0000","last_unstale":"2026-02-23T06:51:44.125915+0000","last_undegraded":"2026-02-23T06:51:44.125915+0000","last_fullsized":"2026-02-23T06:51:44.125915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2124,"log_dups_size":0,"ondisk_log_size":2124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26592,"num_write_kb":1292875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'15","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.731633+0000","last_change":"2026-02-23T06:21:18.150907+0000","last_active":"2026-02-23T06:51:38.731633+0000","last_peered":"2026-02-23T06:51:38.731633+0000","last_clean":"2026-02-23T06:51:38.731633+0000","last_became_active":"2026-02-23T06:21:18.150604+0000","last_became_peered":"2026-02-23T06:21:18.150604+0000","last_unstale":"2026-02-23T06:51:38.731633+0000","last_undegraded":"2026-02-23T06:51:38.731633+0000","last_fullsized":"2026-02-23T06:51:38.731633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'325","reported_seq":364,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.103715+0000","last_change":"2026-02-23T06:21:17.147523+0000","last_active":"2026-02-23T06:49:41.103715+0000","last_peered":"2026-02-23T06:49:41.103715+0000","last_clean":"2026-02-23T06:49:41.103715+0000","last_became_active":"2026-02-23T06:21:17.147351+0000","last_became_peered":"2026-02-23T06:21:17.147351+0000","last_unstale":"2026-02-23T06:49:41.103715+0000","last_undegraded":"2026-02-23T06:49:41.103715+0000","last_fullsized":"2026-02-23T06:49:41.103715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:36:34.550499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":322,"num_write_kb":4304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'1853","reported_seq":1885,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.023475+0000","last_change":"2026-02-23T06:21:22.169413+0000","last_active":"2026-02-23T06:51:44.023475+0000","last_peered":"2026-02-23T06:51:44.023475+0000","last_clean":"2026-02-23T06:51:44.023475+0000","last_became_active":"2026-02-23T06:21:22.169259+0000","last_became_peered":"2026-02-23T06:21:22.169259+0000","last_unstale":"2026-02-23T06:51:44.023475+0000","last_undegraded":"2026-02-23T06:51:44.023475+0000","last_fullsized":"2026-02-23T06:51:44.023475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1853,"log_dups_size":0,"ondisk_log_size":1853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22800,"num_write_kb":1137326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'19","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.718897+0000","last_change":"2026-02-23T06:21:18.142316+0000","last_active":"2026-02-23T06:51:38.718897+0000","last_peered":"2026-02-23T06:51:38.718897+0000","last_clean":"2026-02-23T06:51:38.718897+0000","last_became_active":"2026-02-23T06:21:18.142144+0000","last_became_peered":"2026-02-23T06:21:18.142144+0000","last_unstale":"2026-02-23T06:51:38.718897+0000","last_undegraded":"2026-02-23T06:51:38.718897+0000","last_fullsized":"2026-02-23T06:51:38.718897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:53:33.429271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'1","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:34.439552+0000","last_change":"2026-02-23T06:21:17.137576+0000","last_active":"2026-02-23T06:49:34.439552+0000","last_peered":"2026-02-23T06:49:34.439552+0000","last_clean":"2026-02-23T06:49:34.439552+0000","last_became_active":"2026-02-23T06:21:17.137371+0000","last_became_peered":"2026-02-23T06:21:17.137371+0000","last_unstale":"2026-02-23T06:49:34.439552+0000","last_undegraded":"2026-02-23T06:49:34.439552+0000","last_fullsized":"2026-02-23T06:49:34.439552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:51:27.159743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'1806","reported_seq":1838,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:43.692277+0000","last_change":"2026-02-23T06:21:22.163003+0000","last_active":"2026-02-23T06:51:43.692277+0000","last_peered":"2026-02-23T06:51:43.692277+0000","last_clean":"2026-02-23T06:51:43.692277+0000","last_became_active":"2026-02-23T06:21:22.162898+0000","last_became_peered":"2026-02-23T06:21:22.162898+0000","last_unstale":"2026-02-23T06:51:43.692277+0000","last_undegraded":"2026-02-23T06:51:43.692277+0000","last_fullsized":"2026-02-23T06:51:43.692277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1806,"log_dups_size":0,"ondisk_log_size":1806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21405,"num_write_kb":1230733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'18","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:39.447865+0000","last_change":"2026-02-23T06:21:18.141281+0000","last_active":"2026-02-23T06:51:39.447865+0000","last_peered":"2026-02-23T06:51:39.447865+0000","last_clean":"2026-02-23T06:51:39.447865+0000","last_became_active":"2026-02-23T06:21:18.141090+0000","last_became_peered":"2026-02-23T06:21:18.141090+0000","last_unstale":"2026-02-23T06:51:39.447865+0000","last_undegraded":"2026-02-23T06:51:39.447865+0000","last_fullsized":"2026-02-23T06:51:39.447865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:12:21.750595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:29.498528+0000","last_change":"2026-02-23T06:21:17.144179+0000","last_active":"2026-02-23T06:49:29.498528+0000","last_peered":"2026-02-23T06:49:29.498528+0000","last_clean":"2026-02-23T06:49:29.498528+0000","last_became_active":"2026-02-23T06:21:17.144017+0000","last_became_peered":"2026-02-23T06:21:17.144017+0000","last_unstale":"2026-02-23T06:49:29.498528+0000","last_undegraded":"2026-02-23T06:49:29.498528+0000","last_fullsized":"2026-02-23T06:49:29.498528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:25:41.992201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'2599","reported_seq":2631,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:43.649191+0000","last_change":"2026-02-23T06:21:22.174826+0000","last_active":"2026-02-23T06:51:43.649191+0000","last_peered":"2026-02-23T06:51:43.649191+0000","last_clean":"2026-02-23T06:51:43.649191+0000","last_became_active":"2026-02-23T06:21:22.174683+0000","last_became_peered":"2026-02-23T06:21:22.174683+0000","last_unstale":"2026-02-23T06:51:43.649191+0000","last_undegraded":"2026-02-23T06:51:43.649191+0000","last_fullsized":"2026-02-23T06:51:43.649191+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2599,"log_dups_size":0,"ondisk_log_size":2599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:04:49.277580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32970,"num_write_kb":1504117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'9","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:39.507302+0000","last_change":"2026-02-23T06:21:18.145331+0000","last_active":"2026-02-23T06:51:39.507302+0000","last_peered":"2026-02-23T06:51:39.507302+0000","last_clean":"2026-02-23T06:51:39.507302+0000","last_became_active":"2026-02-23T06:21:18.145231+0000","last_became_peered":"2026-02-23T06:21:18.145231+0000","last_unstale":"2026-02-23T06:51:39.507302+0000","last_undegraded":"2026-02-23T06:51:39.507302+0000","last_fullsized":"2026-02-23T06:51:39.507302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'3","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:43.004448+0000","last_change":"2026-02-23T06:51:43.004448+0000","last_active":"2026-02-23T06:51:43.004448+0000","last_peered":"2026-02-23T06:51:43.004448+0000","last_clean":"2026-02-23T06:51:43.004448+0000","last_became_active":"2026-02-23T06:21:17.147431+0000","last_became_peered":"2026-02-23T06:21:17.147431+0000","last_unstale":"2026-02-23T06:51:43.004448+0000","last_undegraded":"2026-02-23T06:51:43.004448+0000","last_fullsized":"2026-02-23T06:51:43.004448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2026-02-23T06:51:43.004418+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2026-02-23T06:51:43.004418+0000","last_clean_scrub_stamp":"2026-02-23T06:51:43.004418+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:35:53.658192+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'2099","reported_seq":2131,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.140819+0000","last_change":"2026-02-23T06:21:22.175656+0000","last_active":"2026-02-23T06:51:44.140819+0000","last_peered":"2026-02-23T06:51:44.140819+0000","last_clean":"2026-02-23T06:51:44.140819+0000","last_became_active":"2026-02-23T06:21:22.175493+0000","last_became_peered":"2026-02-23T06:21:22.175493+0000","last_unstale":"2026-02-23T06:51:44.140819+0000","last_undegraded":"2026-02-23T06:51:44.140819+0000","last_fullsized":"2026-02-23T06:51:44.140819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2099,"log_dups_size":0,"ondisk_log_size":2099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25611,"num_write_kb":1337535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'25","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.718023+0000","last_change":"2026-02-23T06:21:18.141486+0000","last_active":"2026-02-23T06:51:38.718023+0000","last_peered":"2026-02-23T06:51:38.718023+0000","last_clean":"2026-02-23T06:51:38.718023+0000","last_became_active":"2026-02-23T06:21:18.141277+0000","last_became_peered":"2026-02-23T06:21:18.141277+0000","last_unstale":"2026-02-23T06:51:38.718023+0000","last_undegraded":"2026-02-23T06:51:38.718023+0000","last_fullsized":"2026-02-23T06:51:38.718023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:21:15.738187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'6","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:46.034894+0000","last_change":"2026-02-23T06:21:17.148536+0000","last_active":"2026-02-23T06:49:46.034894+0000","last_peered":"2026-02-23T06:49:46.034894+0000","last_clean":"2026-02-23T06:49:46.034894+0000","last_became_active":"2026-02-23T06:21:17.148424+0000","last_became_peered":"2026-02-23T06:21:17.148424+0000","last_unstale":"2026-02-23T06:49:46.034894+0000","last_undegraded":"2026-02-23T06:49:46.034894+0000","last_fullsized":"2026-02-23T06:49:46.034894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:02:54.995144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'1635","reported_seq":1668,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:43.676674+0000","last_change":"2026-02-23T06:21:22.171333+0000","last_active":"2026-02-23T06:51:43.676674+0000","last_peered":"2026-02-23T06:51:43.676674+0000","last_clean":"2026-02-23T06:51:43.676674+0000","last_became_active":"2026-02-23T06:21:22.170496+0000","last_became_peered":"2026-02-23T06:21:22.170496+0000","last_unstale":"2026-02-23T06:51:43.676674+0000","last_undegraded":"2026-02-23T06:51:43.676674+0000","last_fullsized":"2026-02-23T06:51:43.676674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1635,"log_dups_size":0,"ondisk_log_size":1635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20598,"num_write_kb":974984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'18","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:39.447931+0000","last_change":"2026-02-23T06:21:18.142135+0000","last_active":"2026-02-23T06:51:39.447931+0000","last_peered":"2026-02-23T06:51:39.447931+0000","last_clean":"2026-02-23T06:51:39.447931+0000","last_became_active":"2026-02-23T06:21:18.141771+0000","last_became_peered":"2026-02-23T06:21:18.141771+0000","last_unstale":"2026-02-23T06:51:39.447931+0000","last_undegraded":"2026-02-23T06:51:39.447931+0000","last_fullsized":"2026-02-23T06:51:39.447931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:10:18.195986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'156","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:39.447920+0000","last_change":"2026-02-23T06:21:17.142326+0000","last_active":"2026-02-23T06:51:39.447920+0000","last_peered":"2026-02-23T06:51:39.447920+0000","last_clean":"2026-02-23T06:51:39.447920+0000","last_became_active":"2026-02-23T06:21:17.142203+0000","last_became_peered":"2026-02-23T06:21:17.142203+0000","last_unstale":"2026-02-23T06:51:39.447920+0000","last_undegraded":"2026-02-23T06:51:39.447920+0000","last_fullsized":"2026-02-23T06:51:39.447920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:49:44.262210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'1598","reported_seq":1632,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.016306+0000","last_change":"2026-02-23T06:21:22.168717+0000","last_active":"2026-02-23T06:51:44.016306+0000","last_peered":"2026-02-23T06:51:44.016306+0000","last_clean":"2026-02-23T06:51:44.016306+0000","last_became_active":"2026-02-23T06:21:22.168375+0000","last_became_peered":"2026-02-23T06:21:22.168375+0000","last_unstale":"2026-02-23T06:51:44.016306+0000","last_undegraded":"2026-02-23T06:51:44.016306+0000","last_fullsized":"2026-02-23T06:51:44.016306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1598,"log_dups_size":0,"ondisk_log_size":1598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18683,"num_write_kb":1083504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'19","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.717863+0000","last_change":"2026-02-23T06:21:18.141908+0000","last_active":"2026-02-23T06:51:38.717863+0000","last_peered":"2026-02-23T06:51:38.717863+0000","last_clean":"2026-02-23T06:51:38.717863+0000","last_became_active":"2026-02-23T06:21:18.141363+0000","last_became_peered":"2026-02-23T06:21:18.141363+0000","last_unstale":"2026-02-23T06:51:38.717863+0000","last_undegraded":"2026-02-23T06:51:38.717863+0000","last_fullsized":"2026-02-23T06:51:38.717863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:06:26.731868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.081381+0000","last_change":"2026-02-23T06:21:17.144716+0000","last_active":"2026-02-23T06:49:41.081381+0000","last_peered":"2026-02-23T06:49:41.081381+0000","last_clean":"2026-02-23T06:49:41.081381+0000","last_became_active":"2026-02-23T06:21:17.144515+0000","last_became_peered":"2026-02-23T06:21:17.144515+0000","last_unstale":"2026-02-23T06:49:41.081381+0000","last_undegraded":"2026-02-23T06:49:41.081381+0000","last_fullsized":"2026-02-23T06:49:41.081381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:38:35.014170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'2041","reported_seq":2074,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.141920+0000","last_change":"2026-02-23T06:21:22.171364+0000","last_active":"2026-02-23T06:51:44.141920+0000","last_peered":"2026-02-23T06:51:44.141920+0000","last_clean":"2026-02-23T06:51:44.141920+0000","last_became_active":"2026-02-23T06:21:22.171165+0000","last_became_peered":"2026-02-23T06:21:22.171165+0000","last_unstale":"2026-02-23T06:51:44.141920+0000","last_undegraded":"2026-02-23T06:51:44.141920+0000","last_fullsized":"2026-02-23T06:51:44.141920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2041,"log_dups_size":0,"ondisk_log_size":2041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:00:42.055334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25015,"num_write_kb":1370848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'16","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.244222+0000","last_change":"2026-02-23T06:51:44.244222+0000","last_active":"2026-02-23T06:51:44.244222+0000","last_peered":"2026-02-23T06:51:44.244222+0000","last_clean":"2026-02-23T06:51:44.244222+0000","last_became_active":"2026-02-23T06:21:18.143585+0000","last_became_peered":"2026-02-23T06:21:18.143585+0000","last_unstale":"2026-02-23T06:51:44.244222+0000","last_undegraded":"2026-02-23T06:51:44.244222+0000","last_fullsized":"2026-02-23T06:51:44.244222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2026-02-23T06:51:44.244168+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2026-02-23T06:51:44.244168+0000","last_clean_scrub_stamp":"2026-02-23T06:51:44.244168+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:55:59.183203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:48:24.435637+0000","last_change":"2026-02-23T06:21:17.137935+0000","last_active":"2026-02-23T06:48:24.435637+0000","last_peered":"2026-02-23T06:48:24.435637+0000","last_clean":"2026-02-23T06:48:24.435637+0000","last_became_active":"2026-02-23T06:21:17.137386+0000","last_became_peered":"2026-02-23T06:21:17.137386+0000","last_unstale":"2026-02-23T06:48:24.435637+0000","last_undegraded":"2026-02-23T06:48:24.435637+0000","last_fullsized":"2026-02-23T06:48:24.435637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:51:24.646436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'1858","reported_seq":1891,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:43.687509+0000","last_change":"2026-02-23T06:21:22.163110+0000","last_active":"2026-02-23T06:51:43.687509+0000","last_peered":"2026-02-23T06:51:43.687509+0000","last_clean":"2026-02-23T06:51:43.687509+0000","last_became_active":"2026-02-23T06:21:22.162891+0000","last_became_peered":"2026-02-23T06:21:22.162891+0000","last_unstale":"2026-02-23T06:51:43.687509+0000","last_undegraded":"2026-02-23T06:51:43.687509+0000","last_fullsized":"2026-02-23T06:51:43.687509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1858,"log_dups_size":0,"ondisk_log_size":1858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:06:23.664613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22843,"num_write_kb":1167007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'16","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:39.093205+0000","last_change":"2026-02-23T06:21:18.152606+0000","last_active":"2026-02-23T06:51:39.093205+0000","last_peered":"2026-02-23T06:51:39.093205+0000","last_clean":"2026-02-23T06:51:39.093205+0000","last_became_active":"2026-02-23T06:21:18.152102+0000","last_became_peered":"2026-02-23T06:21:18.152102+0000","last_unstale":"2026-02-23T06:51:39.093205+0000","last_undegraded":"2026-02-23T06:51:39.093205+0000","last_fullsized":"2026-02-23T06:51:39.093205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:59:30.188417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:48:24.491404+0000","last_change":"2026-02-23T06:21:17.143289+0000","last_active":"2026-02-23T06:48:24.491404+0000","last_peered":"2026-02-23T06:48:24.491404+0000","last_clean":"2026-02-23T06:48:24.491404+0000","last_became_active":"2026-02-23T06:21:17.143201+0000","last_became_peered":"2026-02-23T06:21:17.143201+0000","last_unstale":"2026-02-23T06:48:24.491404+0000","last_undegraded":"2026-02-23T06:48:24.491404+0000","last_fullsized":"2026-02-23T06:48:24.491404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:33:06.892035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'1993","reported_seq":2026,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:43.554388+0000","last_change":"2026-02-23T06:21:22.163932+0000","last_active":"2026-02-23T06:51:43.554388+0000","last_peered":"2026-02-23T06:51:43.554388+0000","last_clean":"2026-02-23T06:51:43.554388+0000","last_became_active":"2026-02-23T06:21:22.163734+0000","last_became_peered":"2026-02-23T06:21:22.163734+0000","last_unstale":"2026-02-23T06:51:43.554388+0000","last_undegraded":"2026-02-23T06:51:43.554388+0000","last_fullsized":"2026-02-23T06:51:43.554388+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1993,"log_dups_size":0,"ondisk_log_size":1993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:44:47.208608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24426,"num_write_kb":1329645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'24","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.718216+0000","last_change":"2026-02-23T06:21:18.141664+0000","last_active":"2026-02-23T06:51:38.718216+0000","last_peered":"2026-02-23T06:51:38.718216+0000","last_clean":"2026-02-23T06:51:38.718216+0000","last_became_active":"2026-02-23T06:21:18.141350+0000","last_became_peered":"2026-02-23T06:21:18.141350+0000","last_unstale":"2026-02-23T06:51:38.718216+0000","last_undegraded":"2026-02-23T06:51:38.718216+0000","last_fullsized":"2026-02-23T06:51:38.718216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:01:50.434732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'33","reported_seq":106,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:39.090202+0000","last_change":"2026-02-23T06:21:17.139311+0000","last_active":"2026-02-23T06:51:39.090202+0000","last_peered":"2026-02-23T06:51:39.090202+0000","last_clean":"2026-02-23T06:51:39.090202+0000","last_became_active":"2026-02-23T06:21:17.139200+0000","last_became_peered":"2026-02-23T06:21:17.139200+0000","last_unstale":"2026-02-23T06:51:39.090202+0000","last_undegraded":"2026-02-23T06:51:39.090202+0000","last_fullsized":"2026-02-23T06:51:39.090202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:52:23.863807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82634,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":104,"num_write":32,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'1776","reported_seq":1809,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.131457+0000","last_change":"2026-02-23T06:21:22.164793+0000","last_active":"2026-02-23T06:51:44.131457+0000","last_peered":"2026-02-23T06:51:44.131457+0000","last_clean":"2026-02-23T06:51:44.131457+0000","last_became_active":"2026-02-23T06:21:22.164667+0000","last_became_peered":"2026-02-23T06:21:22.164667+0000","last_unstale":"2026-02-23T06:51:44.131457+0000","last_undegraded":"2026-02-23T06:51:44.131457+0000","last_fullsized":"2026-02-23T06:51:44.131457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1776,"log_dups_size":0,"ondisk_log_size":1776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:36:39.520044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22128,"num_write_kb":1081444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'12","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.723398+0000","last_change":"2026-02-23T06:21:18.146624+0000","last_active":"2026-02-23T06:51:38.723398+0000","last_peered":"2026-02-23T06:51:38.723398+0000","last_clean":"2026-02-23T06:51:38.723398+0000","last_became_active":"2026-02-23T06:21:18.146491+0000","last_became_peered":"2026-02-23T06:21:18.146491+0000","last_unstale":"2026-02-23T06:51:38.723398+0000","last_undegraded":"2026-02-23T06:51:38.723398+0000","last_fullsized":"2026-02-23T06:51:38.723398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:11:23.574241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'5","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.210074+0000","last_change":"2026-02-23T06:51:44.210074+0000","last_active":"2026-02-23T06:51:44.210074+0000","last_peered":"2026-02-23T06:51:44.210074+0000","last_clean":"2026-02-23T06:51:44.210074+0000","last_became_active":"2026-02-23T06:21:17.143050+0000","last_became_peered":"2026-02-23T06:21:17.143050+0000","last_unstale":"2026-02-23T06:51:44.210074+0000","last_undegraded":"2026-02-23T06:51:44.210074+0000","last_fullsized":"2026-02-23T06:51:44.210074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2026-02-23T06:51:44.210030+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2026-02-23T06:51:44.210030+0000","last_clean_scrub_stamp":"2026-02-23T06:51:44.210030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:34:15.364761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'1711","reported_seq":1744,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.148447+0000","last_change":"2026-02-23T06:21:22.168755+0000","last_active":"2026-02-23T06:51:44.148447+0000","last_peered":"2026-02-23T06:51:44.148447+0000","last_clean":"2026-02-23T06:51:44.148447+0000","last_became_active":"2026-02-23T06:21:22.168510+0000","last_became_peered":"2026-02-23T06:21:22.168510+0000","last_unstale":"2026-02-23T06:51:44.148447+0000","last_undegraded":"2026-02-23T06:51:44.148447+0000","last_fullsized":"2026-02-23T06:51:44.148447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1711,"log_dups_size":0,"ondisk_log_size":1711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20193,"num_write_kb":1220870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'13","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.729661+0000","last_change":"2026-02-23T06:21:18.145397+0000","last_active":"2026-02-23T06:51:38.729661+0000","last_peered":"2026-02-23T06:51:38.729661+0000","last_clean":"2026-02-23T06:51:38.729661+0000","last_became_active":"2026-02-23T06:21:18.145214+0000","last_became_peered":"2026-02-23T06:21:18.145214+0000","last_unstale":"2026-02-23T06:51:38.729661+0000","last_undegraded":"2026-02-23T06:51:38.729661+0000","last_fullsized":"2026-02-23T06:51:38.729661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:33:41.870582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'2","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.031120+0000","last_change":"2026-02-23T06:21:17.147696+0000","last_active":"2026-02-23T06:49:41.031120+0000","last_peered":"2026-02-23T06:49:41.031120+0000","last_clean":"2026-02-23T06:49:41.031120+0000","last_became_active":"2026-02-23T06:21:17.147619+0000","last_became_peered":"2026-02-23T06:21:17.147619+0000","last_unstale":"2026-02-23T06:49:41.031120+0000","last_undegraded":"2026-02-23T06:49:41.031120+0000","last_fullsized":"2026-02-23T06:49:41.031120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:49:09.070245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'114","reported_seq":193,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:43.646452+0000","last_change":"2026-02-23T06:51:43.646452+0000","last_active":"2026-02-23T06:51:43.646452+0000","last_peered":"2026-02-23T06:51:43.646452+0000","last_clean":"2026-02-23T06:51:43.646452+0000","last_became_active":"2026-02-23T06:21:11.397664+0000","last_became_peered":"2026-02-23T06:21:11.397664+0000","last_unstale":"2026-02-23T06:51:43.646452+0000","last_undegraded":"2026-02-23T06:51:43.646452+0000","last_fullsized":"2026-02-23T06:51:43.646452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'114","last_scrub_stamp":"2026-02-23T06:51:43.646193+0000","last_deep_scrub":"27'114","last_deep_scrub_stamp":"2026-02-23T06:51:43.646193+0000","last_clean_scrub_stamp":"2026-02-23T06:51:43.646193+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:33:02.284722+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'1620","reported_seq":1653,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.026431+0000","last_change":"2026-02-23T06:21:22.174696+0000","last_active":"2026-02-23T06:51:44.026431+0000","last_peered":"2026-02-23T06:51:44.026431+0000","last_clean":"2026-02-23T06:51:44.026431+0000","last_became_active":"2026-02-23T06:21:22.174253+0000","last_became_peered":"2026-02-23T06:21:22.174253+0000","last_unstale":"2026-02-23T06:51:44.026431+0000","last_undegraded":"2026-02-23T06:51:44.026431+0000","last_fullsized":"2026-02-23T06:51:44.026431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1620,"log_dups_size":0,"ondisk_log_size":1620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19229,"num_write_kb":1122014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'18","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.731386+0000","last_change":"2026-02-23T06:21:18.150652+0000","last_active":"2026-02-23T06:51:38.731386+0000","last_peered":"2026-02-23T06:51:38.731386+0000","last_clean":"2026-02-23T06:51:38.731386+0000","last_became_active":"2026-02-23T06:21:18.150501+0000","last_became_peered":"2026-02-23T06:21:18.150501+0000","last_unstale":"2026-02-23T06:51:38.731386+0000","last_undegraded":"2026-02-23T06:51:38.731386+0000","last_fullsized":"2026-02-23T06:51:38.731386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.038910+0000","last_change":"2026-02-23T06:21:17.146074+0000","last_active":"2026-02-23T06:49:41.038910+0000","last_peered":"2026-02-23T06:49:41.038910+0000","last_clean":"2026-02-23T06:49:41.038910+0000","last_became_active":"2026-02-23T06:21:17.145938+0000","last_became_peered":"2026-02-23T06:21:17.145938+0000","last_unstale":"2026-02-23T06:49:41.038910+0000","last_undegraded":"2026-02-23T06:49:41.038910+0000","last_fullsized":"2026-02-23T06:49:41.038910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:41:42.571718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'1607","reported_seq":1639,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.140857+0000","last_change":"2026-02-23T06:21:22.172266+0000","last_active":"2026-02-23T06:51:44.140857+0000","last_peered":"2026-02-23T06:51:44.140857+0000","last_clean":"2026-02-23T06:51:44.140857+0000","last_became_active":"2026-02-23T06:21:22.171828+0000","last_became_peered":"2026-02-23T06:21:22.171828+0000","last_unstale":"2026-02-23T06:51:44.140857+0000","last_undegraded":"2026-02-23T06:51:44.140857+0000","last_fullsized":"2026-02-23T06:51:44.140857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1607,"log_dups_size":0,"ondisk_log_size":1607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19213,"num_write_kb":1080158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'19","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:39.096181+0000","last_change":"2026-02-23T06:21:18.147056+0000","last_active":"2026-02-23T06:51:39.096181+0000","last_peered":"2026-02-23T06:51:39.096181+0000","last_clean":"2026-02-23T06:51:39.096181+0000","last_became_active":"2026-02-23T06:21:18.146977+0000","last_became_peered":"2026-02-23T06:21:18.146977+0000","last_unstale":"2026-02-23T06:51:39.096181+0000","last_undegraded":"2026-02-23T06:51:39.096181+0000","last_fullsized":"2026-02-23T06:51:39.096181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.036506+0000","last_change":"2026-02-23T06:21:17.139417+0000","last_active":"2026-02-23T06:49:41.036506+0000","last_peered":"2026-02-23T06:49:41.036506+0000","last_clean":"2026-02-23T06:49:41.036506+0000","last_became_active":"2026-02-23T06:21:17.139209+0000","last_became_peered":"2026-02-23T06:21:17.139209+0000","last_unstale":"2026-02-23T06:49:41.036506+0000","last_undegraded":"2026-02-23T06:49:41.036506+0000","last_fullsized":"2026-02-23T06:49:41.036506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:02:19.925669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'2329","reported_seq":2361,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.020197+0000","last_change":"2026-02-23T06:21:22.162912+0000","last_active":"2026-02-23T06:51:44.020197+0000","last_peered":"2026-02-23T06:51:44.020197+0000","last_clean":"2026-02-23T06:51:44.020197+0000","last_became_active":"2026-02-23T06:21:22.162777+0000","last_became_peered":"2026-02-23T06:21:22.162777+0000","last_unstale":"2026-02-23T06:51:44.020197+0000","last_undegraded":"2026-02-23T06:51:44.020197+0000","last_fullsized":"2026-02-23T06:51:44.020197+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2329,"log_dups_size":0,"ondisk_log_size":2329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:40:10.012263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28609,"num_write_kb":1525996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'20","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:40.182858+0000","last_change":"2026-02-23T06:21:18.149281+0000","last_active":"2026-02-23T06:51:40.182858+0000","last_peered":"2026-02-23T06:51:40.182858+0000","last_clean":"2026-02-23T06:51:40.182858+0000","last_became_active":"2026-02-23T06:21:18.149038+0000","last_became_peered":"2026-02-23T06:21:18.149038+0000","last_unstale":"2026-02-23T06:51:40.182858+0000","last_undegraded":"2026-02-23T06:51:40.182858+0000","last_fullsized":"2026-02-23T06:51:40.182858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.083324+0000","last_change":"2026-02-23T06:21:17.137649+0000","last_active":"2026-02-23T06:49:41.083324+0000","last_peered":"2026-02-23T06:49:41.083324+0000","last_clean":"2026-02-23T06:49:41.083324+0000","last_became_active":"2026-02-23T06:21:17.137476+0000","last_became_peered":"2026-02-23T06:21:17.137476+0000","last_unstale":"2026-02-23T06:49:41.083324+0000","last_undegraded":"2026-02-23T06:49:41.083324+0000","last_fullsized":"2026-02-23T06:49:41.083324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:47:43.648999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'1646","reported_seq":1679,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.149858+0000","last_change":"2026-02-23T06:21:22.174081+0000","last_active":"2026-02-23T06:51:44.149858+0000","last_peered":"2026-02-23T06:51:44.149858+0000","last_clean":"2026-02-23T06:51:44.149858+0000","last_became_active":"2026-02-23T06:21:22.173501+0000","last_became_peered":"2026-02-23T06:21:22.173501+0000","last_unstale":"2026-02-23T06:51:44.149858+0000","last_undegraded":"2026-02-23T06:51:44.149858+0000","last_fullsized":"2026-02-23T06:51:44.149858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1646,"log_dups_size":0,"ondisk_log_size":1646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20219,"num_write_kb":1002716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'12","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:39.094487+0000","last_change":"2026-02-23T06:21:18.155183+0000","last_active":"2026-02-23T06:51:39.094487+0000","last_peered":"2026-02-23T06:51:39.094487+0000","last_clean":"2026-02-23T06:51:39.094487+0000","last_became_active":"2026-02-23T06:21:18.154271+0000","last_became_peered":"2026-02-23T06:21:18.154271+0000","last_unstale":"2026-02-23T06:51:39.094487+0000","last_undegraded":"2026-02-23T06:51:39.094487+0000","last_fullsized":"2026-02-23T06:51:39.094487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:34:53.495073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.037316+0000","last_change":"2026-02-23T06:51:44.037316+0000","last_active":"2026-02-23T06:51:44.037316+0000","last_peered":"2026-02-23T06:51:44.037316+0000","last_clean":"2026-02-23T06:51:44.037316+0000","last_became_active":"2026-02-23T06:21:17.144914+0000","last_became_peered":"2026-02-23T06:21:17.144914+0000","last_unstale":"2026-02-23T06:51:44.037316+0000","last_undegraded":"2026-02-23T06:51:44.037316+0000","last_fullsized":"2026-02-23T06:51:44.037316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2026-02-23T06:51:44.037272+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2026-02-23T06:51:44.037272+0000","last_clean_scrub_stamp":"2026-02-23T06:51:44.037272+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:57:15.925199+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'1740","reported_seq":1773,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.146214+0000","last_change":"2026-02-23T06:21:22.169035+0000","last_active":"2026-02-23T06:51:44.146214+0000","last_peered":"2026-02-23T06:51:44.146214+0000","last_clean":"2026-02-23T06:51:44.146214+0000","last_became_active":"2026-02-23T06:21:22.168516+0000","last_became_peered":"2026-02-23T06:21:22.168516+0000","last_unstale":"2026-02-23T06:51:44.146214+0000","last_undegraded":"2026-02-23T06:51:44.146214+0000","last_fullsized":"2026-02-23T06:51:44.146214+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1740,"log_dups_size":0,"ondisk_log_size":1740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20956,"num_write_kb":1166144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'20","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:39.507297+0000","last_change":"2026-02-23T06:21:18.152543+0000","last_active":"2026-02-23T06:51:39.507297+0000","last_peered":"2026-02-23T06:51:39.507297+0000","last_clean":"2026-02-23T06:51:39.507297+0000","last_became_active":"2026-02-23T06:21:18.152381+0000","last_became_peered":"2026-02-23T06:21:18.152381+0000","last_unstale":"2026-02-23T06:51:39.507297+0000","last_undegraded":"2026-02-23T06:51:39.507297+0000","last_fullsized":"2026-02-23T06:51:39.507297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:20:11.159653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'13","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:46.034133+0000","last_change":"2026-02-23T06:21:17.137277+0000","last_active":"2026-02-23T06:49:46.034133+0000","last_peered":"2026-02-23T06:49:46.034133+0000","last_clean":"2026-02-23T06:49:46.034133+0000","last_became_active":"2026-02-23T06:21:17.137101+0000","last_became_peered":"2026-02-23T06:21:17.137101+0000","last_unstale":"2026-02-23T06:49:46.034133+0000","last_undegraded":"2026-02-23T06:49:46.034133+0000","last_fullsized":"2026-02-23T06:49:46.034133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:26:19.732037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'2377","reported_seq":2408,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.017364+0000","last_change":"2026-02-23T06:21:22.168965+0000","last_active":"2026-02-23T06:51:44.017364+0000","last_peered":"2026-02-23T06:51:44.017364+0000","last_clean":"2026-02-23T06:51:44.017364+0000","last_became_active":"2026-02-23T06:21:22.168603+0000","last_became_peered":"2026-02-23T06:21:22.168603+0000","last_unstale":"2026-02-23T06:51:44.017364+0000","last_undegraded":"2026-02-23T06:51:44.017364+0000","last_fullsized":"2026-02-23T06:51:44.017364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2377,"log_dups_size":0,"ondisk_log_size":2377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:15:47.100236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30335,"num_write_kb":1393408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'17","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.719831+0000","last_change":"2026-02-23T06:21:18.143842+0000","last_active":"2026-02-23T06:51:38.719831+0000","last_peered":"2026-02-23T06:51:38.719831+0000","last_clean":"2026-02-23T06:51:38.719831+0000","last_became_active":"2026-02-23T06:21:18.143002+0000","last_became_peered":"2026-02-23T06:21:18.143002+0000","last_unstale":"2026-02-23T06:51:38.719831+0000","last_undegraded":"2026-02-23T06:51:38.719831+0000","last_fullsized":"2026-02-23T06:51:38.719831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:04:36.461970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'3","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:19.516525+0000","last_change":"2026-02-23T06:21:17.143842+0000","last_active":"2026-02-23T06:49:19.516525+0000","last_peered":"2026-02-23T06:49:19.516525+0000","last_clean":"2026-02-23T06:49:19.516525+0000","last_became_active":"2026-02-23T06:21:17.143700+0000","last_became_peered":"2026-02-23T06:21:17.143700+0000","last_unstale":"2026-02-23T06:49:19.516525+0000","last_undegraded":"2026-02-23T06:49:19.516525+0000","last_fullsized":"2026-02-23T06:49:19.516525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:14:07.166043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'2195","reported_seq":2226,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.024961+0000","last_change":"2026-02-23T06:21:22.168834+0000","last_active":"2026-02-23T06:51:44.024961+0000","last_peered":"2026-02-23T06:51:44.024961+0000","last_clean":"2026-02-23T06:51:44.024961+0000","last_became_active":"2026-02-23T06:21:22.168593+0000","last_became_peered":"2026-02-23T06:21:22.168593+0000","last_unstale":"2026-02-23T06:51:44.024961+0000","last_undegraded":"2026-02-23T06:51:44.024961+0000","last_fullsized":"2026-02-23T06:51:44.024961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2195,"log_dups_size":0,"ondisk_log_size":2195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:15:01.999978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27217,"num_write_kb":1335474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'32","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:39.096327+0000","last_change":"2026-02-23T06:21:18.155135+0000","last_active":"2026-02-23T06:51:39.096327+0000","last_peered":"2026-02-23T06:51:39.096327+0000","last_clean":"2026-02-23T06:51:39.096327+0000","last_became_active":"2026-02-23T06:21:18.155022+0000","last_became_peered":"2026-02-23T06:21:18.155022+0000","last_unstale":"2026-02-23T06:51:39.096327+0000","last_undegraded":"2026-02-23T06:51:39.096327+0000","last_fullsized":"2026-02-23T06:51:39.096327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:57:50.396096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.117615+0000","last_change":"2026-02-23T06:21:17.144113+0000","last_active":"2026-02-23T06:49:41.117615+0000","last_peered":"2026-02-23T06:49:41.117615+0000","last_clean":"2026-02-23T06:49:41.117615+0000","last_became_active":"2026-02-23T06:21:17.144052+0000","last_became_peered":"2026-02-23T06:21:17.144052+0000","last_unstale":"2026-02-23T06:49:41.117615+0000","last_undegraded":"2026-02-23T06:49:41.117615+0000","last_fullsized":"2026-02-23T06:49:41.117615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:52:50.479411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'1820","reported_seq":1852,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.023305+0000","last_change":"2026-02-23T06:21:22.163712+0000","last_active":"2026-02-23T06:51:44.023305+0000","last_peered":"2026-02-23T06:51:44.023305+0000","last_clean":"2026-02-23T06:51:44.023305+0000","last_became_active":"2026-02-23T06:21:22.163563+0000","last_became_peered":"2026-02-23T06:21:22.163563+0000","last_unstale":"2026-02-23T06:51:44.023305+0000","last_undegraded":"2026-02-23T06:51:44.023305+0000","last_fullsized":"2026-02-23T06:51:44.023305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1820,"log_dups_size":0,"ondisk_log_size":1820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:58:44.301443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":3,"num_write":22577,"num_write_kb":1140198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'20","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:39.450583+0000","last_change":"2026-02-23T06:21:18.152736+0000","last_active":"2026-02-23T06:51:39.450583+0000","last_peered":"2026-02-23T06:51:39.450583+0000","last_clean":"2026-02-23T06:51:39.450583+0000","last_became_active":"2026-02-23T06:21:18.152627+0000","last_became_peered":"2026-02-23T06:21:18.152627+0000","last_unstale":"2026-02-23T06:51:39.450583+0000","last_undegraded":"2026-02-23T06:51:39.450583+0000","last_fullsized":"2026-02-23T06:51:39.450583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:26:04.233805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'3","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.068731+0000","last_change":"2026-02-23T06:21:17.144924+0000","last_active":"2026-02-23T06:49:41.068731+0000","last_peered":"2026-02-23T06:49:41.068731+0000","last_clean":"2026-02-23T06:49:41.068731+0000","last_became_active":"2026-02-23T06:21:17.144847+0000","last_became_peered":"2026-02-23T06:21:17.144847+0000","last_unstale":"2026-02-23T06:49:41.068731+0000","last_undegraded":"2026-02-23T06:49:41.068731+0000","last_fullsized":"2026-02-23T06:49:41.068731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:09:16.703922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'2267","reported_seq":2298,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:43.688316+0000","last_change":"2026-02-23T06:21:22.164167+0000","last_active":"2026-02-23T06:51:43.688316+0000","last_peered":"2026-02-23T06:51:43.688316+0000","last_clean":"2026-02-23T06:51:43.688316+0000","last_became_active":"2026-02-23T06:21:22.164057+0000","last_became_peered":"2026-02-23T06:21:22.164057+0000","last_unstale":"2026-02-23T06:51:43.688316+0000","last_undegraded":"2026-02-23T06:51:43.688316+0000","last_fullsized":"2026-02-23T06:51:43.688316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2267,"log_dups_size":0,"ondisk_log_size":2267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27868,"num_write_kb":1432250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'15","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:39.095619+0000","last_change":"2026-02-23T06:21:18.148382+0000","last_active":"2026-02-23T06:51:39.095619+0000","last_peered":"2026-02-23T06:51:39.095619+0000","last_clean":"2026-02-23T06:51:39.095619+0000","last_became_active":"2026-02-23T06:21:18.147826+0000","last_became_peered":"2026-02-23T06:21:18.147826+0000","last_unstale":"2026-02-23T06:51:39.095619+0000","last_undegraded":"2026-02-23T06:51:39.095619+0000","last_fullsized":"2026-02-23T06:51:39.095619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:52:32.524186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'306","reported_seq":354,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:43.212787+0000","last_change":"2026-02-23T06:51:43.212761+0000","last_active":"2026-02-23T06:51:43.212787+0000","last_peered":"2026-02-23T06:51:43.212787+0000","last_clean":"2026-02-23T06:51:43.212787+0000","last_became_active":"2026-02-23T06:21:17.151030+0000","last_became_peered":"2026-02-23T06:21:17.151030+0000","last_unstale":"2026-02-23T06:51:43.212787+0000","last_undegraded":"2026-02-23T06:51:43.212787+0000","last_fullsized":"2026-02-23T06:51:43.212787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'306","last_scrub_stamp":"2026-02-23T06:51:43.212718+0000","last_deep_scrub":"27'306","last_deep_scrub_stamp":"2026-02-23T06:51:43.212718+0000","last_clean_scrub_stamp":"2026-02-23T06:51:43.212718+0000","objects_scrubbed":4,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:31:15.200482+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194998,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":300,"num_write_kb":4304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'1502","reported_seq":1534,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.151730+0000","last_change":"2026-02-23T06:21:22.165171+0000","last_active":"2026-02-23T06:51:44.151730+0000","last_peered":"2026-02-23T06:51:44.151730+0000","last_clean":"2026-02-23T06:51:44.151730+0000","last_became_active":"2026-02-23T06:21:22.164972+0000","last_became_peered":"2026-02-23T06:21:22.164972+0000","last_unstale":"2026-02-23T06:51:44.151730+0000","last_undegraded":"2026-02-23T06:51:44.151730+0000","last_fullsized":"2026-02-23T06:51:44.151730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1502,"log_dups_size":0,"ondisk_log_size":1502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17024,"num_write_kb":1082863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'19","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.734112+0000","last_change":"2026-02-23T06:21:18.153296+0000","last_active":"2026-02-23T06:51:38.734112+0000","last_peered":"2026-02-23T06:51:38.734112+0000","last_clean":"2026-02-23T06:51:38.734112+0000","last_became_active":"2026-02-23T06:21:18.153052+0000","last_became_peered":"2026-02-23T06:21:18.153052+0000","last_unstale":"2026-02-23T06:51:38.734112+0000","last_undegraded":"2026-02-23T06:51:38.734112+0000","last_fullsized":"2026-02-23T06:51:38.734112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'21","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:50:46.536856+0000","last_change":"2026-02-23T06:21:17.137568+0000","last_active":"2026-02-23T06:50:46.536856+0000","last_peered":"2026-02-23T06:50:46.536856+0000","last_clean":"2026-02-23T06:50:46.536856+0000","last_became_active":"2026-02-23T06:21:17.137479+0000","last_became_peered":"2026-02-23T06:21:17.137479+0000","last_unstale":"2026-02-23T06:50:46.536856+0000","last_undegraded":"2026-02-23T06:50:46.536856+0000","last_fullsized":"2026-02-23T06:50:46.536856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:50:22.850887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'2313","reported_seq":2345,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.130664+0000","last_change":"2026-02-23T06:21:22.175837+0000","last_active":"2026-02-23T06:51:44.130664+0000","last_peered":"2026-02-23T06:51:44.130664+0000","last_clean":"2026-02-23T06:51:44.130664+0000","last_became_active":"2026-02-23T06:21:22.175638+0000","last_became_peered":"2026-02-23T06:21:22.175638+0000","last_unstale":"2026-02-23T06:51:44.130664+0000","last_undegraded":"2026-02-23T06:51:44.130664+0000","last_fullsized":"2026-02-23T06:51:44.130664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2313,"log_dups_size":0,"ondisk_log_size":2313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28954,"num_write_kb":1359033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'23","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.728327+0000","last_change":"2026-02-23T06:21:18.155473+0000","last_active":"2026-02-23T06:51:38.728327+0000","last_peered":"2026-02-23T06:51:38.728327+0000","last_clean":"2026-02-23T06:51:38.728327+0000","last_became_active":"2026-02-23T06:21:18.155349+0000","last_became_peered":"2026-02-23T06:21:18.155349+0000","last_unstale":"2026-02-23T06:51:38.728327+0000","last_undegraded":"2026-02-23T06:51:38.728327+0000","last_fullsized":"2026-02-23T06:51:38.728327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:20:20.345986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'1","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.093368+0000","last_change":"2026-02-23T06:21:17.148953+0000","last_active":"2026-02-23T06:49:41.093368+0000","last_peered":"2026-02-23T06:49:41.093368+0000","last_clean":"2026-02-23T06:49:41.093368+0000","last_became_active":"2026-02-23T06:21:17.148841+0000","last_became_peered":"2026-02-23T06:21:17.148841+0000","last_unstale":"2026-02-23T06:49:41.093368+0000","last_undegraded":"2026-02-23T06:49:41.093368+0000","last_fullsized":"2026-02-23T06:49:41.093368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:48:14.620108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'1771","reported_seq":1803,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.151840+0000","last_change":"2026-02-23T06:21:22.172897+0000","last_active":"2026-02-23T06:51:44.151840+0000","last_peered":"2026-02-23T06:51:44.151840+0000","last_clean":"2026-02-23T06:51:44.151840+0000","last_became_active":"2026-02-23T06:21:22.172683+0000","last_became_peered":"2026-02-23T06:21:22.172683+0000","last_unstale":"2026-02-23T06:51:44.151840+0000","last_undegraded":"2026-02-23T06:51:44.151840+0000","last_fullsized":"2026-02-23T06:51:44.151840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1771,"log_dups_size":0,"ondisk_log_size":1771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:17:41.991286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21503,"num_write_kb":1135952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'23","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.734196+0000","last_change":"2026-02-23T06:21:18.154897+0000","last_active":"2026-02-23T06:51:38.734196+0000","last_peered":"2026-02-23T06:51:38.734196+0000","last_clean":"2026-02-23T06:51:38.734196+0000","last_became_active":"2026-02-23T06:21:18.154586+0000","last_became_peered":"2026-02-23T06:21:18.154586+0000","last_unstale":"2026-02-23T06:51:38.734196+0000","last_undegraded":"2026-02-23T06:51:38.734196+0000","last_fullsized":"2026-02-23T06:51:38.734196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:22:13.361673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.033236+0000","last_change":"2026-02-23T06:21:17.140774+0000","last_active":"2026-02-23T06:49:41.033236+0000","last_peered":"2026-02-23T06:49:41.033236+0000","last_clean":"2026-02-23T06:49:41.033236+0000","last_became_active":"2026-02-23T06:21:17.140699+0000","last_became_peered":"2026-02-23T06:21:17.140699+0000","last_unstale":"2026-02-23T06:49:41.033236+0000","last_undegraded":"2026-02-23T06:49:41.033236+0000","last_fullsized":"2026-02-23T06:49:41.033236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:59:47.987932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'1912","reported_seq":1944,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.140299+0000","last_change":"2026-02-23T06:21:22.166371+0000","last_active":"2026-02-23T06:51:44.140299+0000","last_peered":"2026-02-23T06:51:44.140299+0000","last_clean":"2026-02-23T06:51:44.140299+0000","last_became_active":"2026-02-23T06:21:22.166204+0000","last_became_peered":"2026-02-23T06:21:22.166204+0000","last_unstale":"2026-02-23T06:51:44.140299+0000","last_undegraded":"2026-02-23T06:51:44.140299+0000","last_fullsized":"2026-02-23T06:51:44.140299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1912,"log_dups_size":0,"ondisk_log_size":1912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23461,"num_write_kb":1201520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'1927","reported_seq":1961,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.014904+0000","last_change":"2026-02-23T06:21:22.167411+0000","last_active":"2026-02-23T06:51:44.014904+0000","last_peered":"2026-02-23T06:51:44.014904+0000","last_clean":"2026-02-23T06:51:44.014904+0000","last_became_active":"2026-02-23T06:21:22.167217+0000","last_became_peered":"2026-02-23T06:21:22.167217+0000","last_unstale":"2026-02-23T06:51:44.014904+0000","last_undegraded":"2026-02-23T06:51:44.014904+0000","last_fullsized":"2026-02-23T06:51:44.014904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1927,"log_dups_size":0,"ondisk_log_size":1927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23726,"num_write_kb":1252431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'22","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:39.094931+0000","last_change":"2026-02-23T06:21:18.146043+0000","last_active":"2026-02-23T06:51:39.094931+0000","last_peered":"2026-02-23T06:51:39.094931+0000","last_clean":"2026-02-23T06:51:39.094931+0000","last_became_active":"2026-02-23T06:21:18.145938+0000","last_became_peered":"2026-02-23T06:21:18.145938+0000","last_unstale":"2026-02-23T06:51:39.094931+0000","last_undegraded":"2026-02-23T06:51:39.094931+0000","last_fullsized":"2026-02-23T06:51:39.094931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.039459+0000","last_change":"2026-02-23T06:21:17.149581+0000","last_active":"2026-02-23T06:49:41.039459+0000","last_peered":"2026-02-23T06:49:41.039459+0000","last_clean":"2026-02-23T06:49:41.039459+0000","last_became_active":"2026-02-23T06:21:17.149490+0000","last_became_peered":"2026-02-23T06:21:17.149490+0000","last_unstale":"2026-02-23T06:49:41.039459+0000","last_undegraded":"2026-02-23T06:49:41.039459+0000","last_fullsized":"2026-02-23T06:49:41.039459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:18:42.211307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'2215","reported_seq":2248,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.144709+0000","last_change":"2026-02-23T06:21:22.175655+0000","last_active":"2026-02-23T06:51:44.144709+0000","last_peered":"2026-02-23T06:51:44.144709+0000","last_clean":"2026-02-23T06:51:44.144709+0000","last_became_active":"2026-02-23T06:21:22.174906+0000","last_became_peered":"2026-02-23T06:21:22.174906+0000","last_unstale":"2026-02-23T06:51:44.144709+0000","last_undegraded":"2026-02-23T06:51:44.144709+0000","last_fullsized":"2026-02-23T06:51:44.144709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2215,"log_dups_size":0,"ondisk_log_size":2215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27299,"num_write_kb":1403073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'24","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.718873+0000","last_change":"2026-02-23T06:21:18.142560+0000","last_active":"2026-02-23T06:51:38.718873+0000","last_peered":"2026-02-23T06:51:38.718873+0000","last_clean":"2026-02-23T06:51:38.718873+0000","last_became_active":"2026-02-23T06:21:18.142325+0000","last_became_peered":"2026-02-23T06:21:18.142325+0000","last_unstale":"2026-02-23T06:51:38.718873+0000","last_undegraded":"2026-02-23T06:51:38.718873+0000","last_fullsized":"2026-02-23T06:51:38.718873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:45:44.641652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:47:59.433744+0000","last_change":"2026-02-23T06:21:17.146195+0000","last_active":"2026-02-23T06:47:59.433744+0000","last_peered":"2026-02-23T06:47:59.433744+0000","last_clean":"2026-02-23T06:47:59.433744+0000","last_became_active":"2026-02-23T06:21:17.146022+0000","last_became_peered":"2026-02-23T06:21:17.146022+0000","last_unstale":"2026-02-23T06:47:59.433744+0000","last_undegraded":"2026-02-23T06:47:59.433744+0000","last_fullsized":"2026-02-23T06:47:59.433744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:34:32.822540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.091157+0000","last_change":"2026-02-23T06:21:17.148590+0000","last_active":"2026-02-23T06:49:41.091157+0000","last_peered":"2026-02-23T06:49:41.091157+0000","last_clean":"2026-02-23T06:49:41.091157+0000","last_became_active":"2026-02-23T06:21:17.148417+0000","last_became_peered":"2026-02-23T06:21:17.148417+0000","last_unstale":"2026-02-23T06:49:41.091157+0000","last_undegraded":"2026-02-23T06:49:41.091157+0000","last_fullsized":"2026-02-23T06:49:41.091157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:21:11.877590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'20","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:42.373093+0000","last_change":"2026-02-23T06:21:18.152383+0000","last_active":"2026-02-23T06:51:42.373093+0000","last_peered":"2026-02-23T06:51:42.373093+0000","last_clean":"2026-02-23T06:51:42.373093+0000","last_became_active":"2026-02-23T06:21:18.152267+0000","last_became_peered":"2026-02-23T06:21:18.152267+0000","last_unstale":"2026-02-23T06:51:42.373093+0000","last_undegraded":"2026-02-23T06:51:42.373093+0000","last_fullsized":"2026-02-23T06:51:42.373093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:34:11.558509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'1715","reported_seq":1746,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:43.667086+0000","last_change":"2026-02-23T06:21:22.158812+0000","last_active":"2026-02-23T06:51:43.667086+0000","last_peered":"2026-02-23T06:51:43.667086+0000","last_clean":"2026-02-23T06:51:43.667086+0000","last_became_active":"2026-02-23T06:21:22.158607+0000","last_became_peered":"2026-02-23T06:21:22.158607+0000","last_unstale":"2026-02-23T06:51:43.667086+0000","last_undegraded":"2026-02-23T06:51:43.667086+0000","last_fullsized":"2026-02-23T06:51:43.667086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1715,"log_dups_size":0,"ondisk_log_size":1715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20257,"num_write_kb":1221270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1152","reported_seq":1190,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:49:41.044630+0000","last_change":"2026-02-23T06:21:17.138744+0000","last_active":"2026-02-23T06:49:41.044630+0000","last_peered":"2026-02-23T06:49:41.044630+0000","last_clean":"2026-02-23T06:49:41.044630+0000","last_became_active":"2026-02-23T06:21:17.138245+0000","last_became_peered":"2026-02-23T06:21:17.138245+0000","last_unstale":"2026-02-23T06:49:41.044630+0000","last_undegraded":"2026-02-23T06:49:41.044630+0000","last_fullsized":"2026-02-23T06:49:41.044630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:16.130732+0000","last_clean_scrub_stamp":"2026-02-23T06:21:16.130732+0000","objects_scrubbed":0,"log_size":1152,"log_dups_size":0,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:08:03.143401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1150,"num_write_kb":5073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'18","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.724655+0000","last_change":"2026-02-23T06:21:18.143640+0000","last_active":"2026-02-23T06:51:38.724655+0000","last_peered":"2026-02-23T06:51:38.724655+0000","last_clean":"2026-02-23T06:51:38.724655+0000","last_became_active":"2026-02-23T06:21:18.143550+0000","last_became_peered":"2026-02-23T06:21:18.143550+0000","last_unstale":"2026-02-23T06:51:38.724655+0000","last_undegraded":"2026-02-23T06:51:38.724655+0000","last_fullsized":"2026-02-23T06:51:38.724655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:11:40.394042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'1861","reported_seq":1892,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.150406+0000","last_change":"2026-02-23T06:21:22.169641+0000","last_active":"2026-02-23T06:51:44.150406+0000","last_peered":"2026-02-23T06:51:44.150406+0000","last_clean":"2026-02-23T06:51:44.150406+0000","last_became_active":"2026-02-23T06:21:22.169432+0000","last_became_peered":"2026-02-23T06:21:22.169432+0000","last_unstale":"2026-02-23T06:51:44.150406+0000","last_undegraded":"2026-02-23T06:51:44.150406+0000","last_fullsized":"2026-02-23T06:51:44.150406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1861,"log_dups_size":0,"ondisk_log_size":1861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:00:17.622113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23058,"num_write_kb":1131314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'22","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.729486+0000","last_change":"2026-02-23T06:21:18.143781+0000","last_active":"2026-02-23T06:51:38.729486+0000","last_peered":"2026-02-23T06:51:38.729486+0000","last_clean":"2026-02-23T06:51:38.729486+0000","last_became_active":"2026-02-23T06:21:18.143724+0000","last_became_peered":"2026-02-23T06:21:18.143724+0000","last_unstale":"2026-02-23T06:51:38.729486+0000","last_undegraded":"2026-02-23T06:51:38.729486+0000","last_fullsized":"2026-02-23T06:51:38.729486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:25:55.416021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'24","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:41.898911+0000","last_change":"2026-02-23T06:21:18.145425+0000","last_active":"2026-02-23T06:51:41.898911+0000","last_peered":"2026-02-23T06:51:41.898911+0000","last_clean":"2026-02-23T06:51:41.898911+0000","last_became_active":"2026-02-23T06:21:18.145325+0000","last_became_peered":"2026-02-23T06:21:18.145325+0000","last_unstale":"2026-02-23T06:51:41.898911+0000","last_undegraded":"2026-02-23T06:51:41.898911+0000","last_fullsized":"2026-02-23T06:51:41.898911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:55:31.700518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'23","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.728942+0000","last_change":"2026-02-23T06:21:18.150997+0000","last_active":"2026-02-23T06:51:38.728942+0000","last_peered":"2026-02-23T06:51:38.728942+0000","last_clean":"2026-02-23T06:51:38.728942+0000","last_became_active":"2026-02-23T06:21:18.150738+0000","last_became_peered":"2026-02-23T06:21:18.150738+0000","last_unstale":"2026-02-23T06:51:38.728942+0000","last_undegraded":"2026-02-23T06:51:38.728942+0000","last_fullsized":"2026-02-23T06:51:38.728942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:11:13.400669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'16","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.716806+0000","last_change":"2026-02-23T06:21:18.142305+0000","last_active":"2026-02-23T06:51:38.716806+0000","last_peered":"2026-02-23T06:51:38.716806+0000","last_clean":"2026-02-23T06:51:38.716806+0000","last_became_active":"2026-02-23T06:21:18.141484+0000","last_became_peered":"2026-02-23T06:21:18.141484+0000","last_unstale":"2026-02-23T06:51:38.716806+0000","last_undegraded":"2026-02-23T06:51:38.716806+0000","last_fullsized":"2026-02-23T06:51:38.716806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:12:36.003405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'14","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:39.098576+0000","last_change":"2026-02-23T06:21:18.148610+0000","last_active":"2026-02-23T06:51:39.098576+0000","last_peered":"2026-02-23T06:51:39.098576+0000","last_clean":"2026-02-23T06:51:39.098576+0000","last_became_active":"2026-02-23T06:21:18.148489+0000","last_became_peered":"2026-02-23T06:21:18.148489+0000","last_unstale":"2026-02-23T06:51:39.098576+0000","last_undegraded":"2026-02-23T06:51:39.098576+0000","last_fullsized":"2026-02-23T06:51:39.098576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:36:29.486147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'15","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.716376+0000","last_change":"2026-02-23T06:21:18.142438+0000","last_active":"2026-02-23T06:51:38.716376+0000","last_peered":"2026-02-23T06:51:38.716376+0000","last_clean":"2026-02-23T06:51:38.716376+0000","last_became_active":"2026-02-23T06:21:18.141854+0000","last_became_peered":"2026-02-23T06:21:18.141854+0000","last_unstale":"2026-02-23T06:51:38.716376+0000","last_undegraded":"2026-02-23T06:51:38.716376+0000","last_fullsized":"2026-02-23T06:51:38.716376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:23:35.379462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'27","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.734132+0000","last_change":"2026-02-23T06:21:18.153825+0000","last_active":"2026-02-23T06:51:38.734132+0000","last_peered":"2026-02-23T06:51:38.734132+0000","last_clean":"2026-02-23T06:51:38.734132+0000","last_became_active":"2026-02-23T06:21:18.153133+0000","last_became_peered":"2026-02-23T06:21:18.153133+0000","last_unstale":"2026-02-23T06:51:38.734132+0000","last_undegraded":"2026-02-23T06:51:38.734132+0000","last_fullsized":"2026-02-23T06:51:38.734132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:15:03.662362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'14","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:39.451676+0000","last_change":"2026-02-23T06:21:18.144945+0000","last_active":"2026-02-23T06:51:39.451676+0000","last_peered":"2026-02-23T06:51:39.451676+0000","last_clean":"2026-02-23T06:51:39.451676+0000","last_became_active":"2026-02-23T06:21:18.144832+0000","last_became_peered":"2026-02-23T06:21:18.144832+0000","last_unstale":"2026-02-23T06:51:39.451676+0000","last_undegraded":"2026-02-23T06:51:39.451676+0000","last_fullsized":"2026-02-23T06:51:39.451676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:41:07.968870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'19","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.729946+0000","last_change":"2026-02-23T06:21:18.150652+0000","last_active":"2026-02-23T06:51:38.729946+0000","last_peered":"2026-02-23T06:51:38.729946+0000","last_clean":"2026-02-23T06:51:38.729946+0000","last_became_active":"2026-02-23T06:21:18.150489+0000","last_became_peered":"2026-02-23T06:21:18.150489+0000","last_unstale":"2026-02-23T06:51:38.729946+0000","last_undegraded":"2026-02-23T06:51:38.729946+0000","last_fullsized":"2026-02-23T06:51:38.729946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'22","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.725578+0000","last_change":"2026-02-23T06:21:18.143636+0000","last_active":"2026-02-23T06:51:38.725578+0000","last_peered":"2026-02-23T06:51:38.725578+0000","last_clean":"2026-02-23T06:51:38.725578+0000","last_became_active":"2026-02-23T06:21:18.143495+0000","last_became_peered":"2026-02-23T06:21:18.143495+0000","last_unstale":"2026-02-23T06:51:38.725578+0000","last_undegraded":"2026-02-23T06:51:38.725578+0000","last_fullsized":"2026-02-23T06:51:38.725578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:47:19.057181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'21","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.730456+0000","last_change":"2026-02-23T06:21:18.148787+0000","last_active":"2026-02-23T06:51:38.730456+0000","last_peered":"2026-02-23T06:51:38.730456+0000","last_clean":"2026-02-23T06:51:38.730456+0000","last_became_active":"2026-02-23T06:21:18.148701+0000","last_became_peered":"2026-02-23T06:21:18.148701+0000","last_unstale":"2026-02-23T06:51:38.730456+0000","last_undegraded":"2026-02-23T06:51:38.730456+0000","last_fullsized":"2026-02-23T06:51:38.730456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:19:32.878202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'28","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.725532+0000","last_change":"2026-02-23T06:21:18.145498+0000","last_active":"2026-02-23T06:51:38.725532+0000","last_peered":"2026-02-23T06:51:38.725532+0000","last_clean":"2026-02-23T06:51:38.725532+0000","last_became_active":"2026-02-23T06:21:18.145346+0000","last_became_peered":"2026-02-23T06:21:18.145346+0000","last_unstale":"2026-02-23T06:51:38.725532+0000","last_undegraded":"2026-02-23T06:51:38.725532+0000","last_fullsized":"2026-02-23T06:51:38.725532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:44:15.203843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'21","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:39.097795+0000","last_change":"2026-02-23T06:21:18.147453+0000","last_active":"2026-02-23T06:51:39.097795+0000","last_peered":"2026-02-23T06:51:39.097795+0000","last_clean":"2026-02-23T06:51:39.097795+0000","last_became_active":"2026-02-23T06:21:18.147357+0000","last_became_peered":"2026-02-23T06:21:18.147357+0000","last_unstale":"2026-02-23T06:51:39.097795+0000","last_undegraded":"2026-02-23T06:51:39.097795+0000","last_fullsized":"2026-02-23T06:51:39.097795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:41:05.063786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'19","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.731255+0000","last_change":"2026-02-23T06:21:18.151381+0000","last_active":"2026-02-23T06:51:38.731255+0000","last_peered":"2026-02-23T06:51:38.731255+0000","last_clean":"2026-02-23T06:51:38.731255+0000","last_became_active":"2026-02-23T06:21:18.151269+0000","last_became_peered":"2026-02-23T06:21:18.151269+0000","last_unstale":"2026-02-23T06:51:38.731255+0000","last_undegraded":"2026-02-23T06:51:38.731255+0000","last_fullsized":"2026-02-23T06:51:38.731255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:50:46.152385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'29","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:39.097112+0000","last_change":"2026-02-23T06:21:18.148411+0000","last_active":"2026-02-23T06:51:39.097112+0000","last_peered":"2026-02-23T06:51:39.097112+0000","last_clean":"2026-02-23T06:51:39.097112+0000","last_became_active":"2026-02-23T06:21:18.148262+0000","last_became_peered":"2026-02-23T06:21:18.148262+0000","last_unstale":"2026-02-23T06:51:39.097112+0000","last_undegraded":"2026-02-23T06:51:39.097112+0000","last_fullsized":"2026-02-23T06:51:39.097112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:09:54.723244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'18","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:39.099473+0000","last_change":"2026-02-23T06:21:18.155275+0000","last_active":"2026-02-23T06:51:39.099473+0000","last_peered":"2026-02-23T06:51:39.099473+0000","last_clean":"2026-02-23T06:51:39.099473+0000","last_became_active":"2026-02-23T06:21:18.155214+0000","last_became_peered":"2026-02-23T06:21:18.155214+0000","last_unstale":"2026-02-23T06:51:39.099473+0000","last_undegraded":"2026-02-23T06:51:39.099473+0000","last_fullsized":"2026-02-23T06:51:39.099473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:44:47.367234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'19","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.733837+0000","last_change":"2026-02-23T06:21:18.153381+0000","last_active":"2026-02-23T06:51:38.733837+0000","last_peered":"2026-02-23T06:51:38.733837+0000","last_clean":"2026-02-23T06:51:38.733837+0000","last_became_active":"2026-02-23T06:21:18.152456+0000","last_became_peered":"2026-02-23T06:21:18.152456+0000","last_unstale":"2026-02-23T06:51:38.733837+0000","last_undegraded":"2026-02-23T06:51:38.733837+0000","last_fullsized":"2026-02-23T06:51:38.733837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:14:46.231331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'21","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:39.451660+0000","last_change":"2026-02-23T06:21:18.148599+0000","last_active":"2026-02-23T06:51:39.451660+0000","last_peered":"2026-02-23T06:51:39.451660+0000","last_clean":"2026-02-23T06:51:39.451660+0000","last_became_active":"2026-02-23T06:21:18.148498+0000","last_became_peered":"2026-02-23T06:21:18.148498+0000","last_unstale":"2026-02-23T06:51:39.451660+0000","last_undegraded":"2026-02-23T06:51:39.451660+0000","last_fullsized":"2026-02-23T06:51:39.451660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:05:56.074928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'21","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.716587+0000","last_change":"2026-02-23T06:21:18.142621+0000","last_active":"2026-02-23T06:51:38.716587+0000","last_peered":"2026-02-23T06:51:38.716587+0000","last_clean":"2026-02-23T06:51:38.716587+0000","last_became_active":"2026-02-23T06:21:18.141938+0000","last_became_peered":"2026-02-23T06:21:18.141938+0000","last_unstale":"2026-02-23T06:51:38.716587+0000","last_undegraded":"2026-02-23T06:51:38.716587+0000","last_fullsized":"2026-02-23T06:51:38.716587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:25:55.390738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'26","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:40.274963+0000","last_change":"2026-02-23T06:21:18.153183+0000","last_active":"2026-02-23T06:51:40.274963+0000","last_peered":"2026-02-23T06:51:40.274963+0000","last_clean":"2026-02-23T06:51:40.274963+0000","last_became_active":"2026-02-23T06:21:18.153090+0000","last_became_peered":"2026-02-23T06:21:18.153090+0000","last_unstale":"2026-02-23T06:51:40.274963+0000","last_undegraded":"2026-02-23T06:51:40.274963+0000","last_fullsized":"2026-02-23T06:51:40.274963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:26:17.749612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'17","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:39.097781+0000","last_change":"2026-02-23T06:21:18.148055+0000","last_active":"2026-02-23T06:51:39.097781+0000","last_peered":"2026-02-23T06:51:39.097781+0000","last_clean":"2026-02-23T06:51:39.097781+0000","last_became_active":"2026-02-23T06:21:18.147956+0000","last_became_peered":"2026-02-23T06:21:18.147956+0000","last_unstale":"2026-02-23T06:51:39.097781+0000","last_undegraded":"2026-02-23T06:51:39.097781+0000","last_fullsized":"2026-02-23T06:51:39.097781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:22:55.028859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'18","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:39.095663+0000","last_change":"2026-02-23T06:21:18.155576+0000","last_active":"2026-02-23T06:51:39.095663+0000","last_peered":"2026-02-23T06:51:39.095663+0000","last_clean":"2026-02-23T06:51:39.095663+0000","last_became_active":"2026-02-23T06:21:18.155130+0000","last_became_peered":"2026-02-23T06:21:18.155130+0000","last_unstale":"2026-02-23T06:51:39.095663+0000","last_undegraded":"2026-02-23T06:51:39.095663+0000","last_fullsized":"2026-02-23T06:51:39.095663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:43:12.801427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'29","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:39.093381+0000","last_change":"2026-02-23T06:21:18.152980+0000","last_active":"2026-02-23T06:51:39.093381+0000","last_peered":"2026-02-23T06:51:39.093381+0000","last_clean":"2026-02-23T06:51:39.093381+0000","last_became_active":"2026-02-23T06:21:18.152790+0000","last_became_peered":"2026-02-23T06:21:18.152790+0000","last_unstale":"2026-02-23T06:51:39.093381+0000","last_undegraded":"2026-02-23T06:51:39.093381+0000","last_fullsized":"2026-02-23T06:51:39.093381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:33:09.398040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'21","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.731945+0000","last_change":"2026-02-23T06:21:18.155247+0000","last_active":"2026-02-23T06:51:38.731945+0000","last_peered":"2026-02-23T06:51:38.731945+0000","last_clean":"2026-02-23T06:51:38.731945+0000","last_became_active":"2026-02-23T06:21:18.155122+0000","last_became_peered":"2026-02-23T06:21:18.155122+0000","last_unstale":"2026-02-23T06:51:38.731945+0000","last_undegraded":"2026-02-23T06:51:38.731945+0000","last_fullsized":"2026-02-23T06:51:38.731945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:45:08.775934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'13","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:39.094359+0000","last_change":"2026-02-23T06:21:18.151259+0000","last_active":"2026-02-23T06:51:39.094359+0000","last_peered":"2026-02-23T06:51:39.094359+0000","last_clean":"2026-02-23T06:51:39.094359+0000","last_became_active":"2026-02-23T06:21:18.151151+0000","last_became_peered":"2026-02-23T06:21:18.151151+0000","last_unstale":"2026-02-23T06:51:39.094359+0000","last_undegraded":"2026-02-23T06:51:39.094359+0000","last_fullsized":"2026-02-23T06:51:39.094359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:08:03.361054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'13","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:39.093904+0000","last_change":"2026-02-23T06:21:18.146606+0000","last_active":"2026-02-23T06:51:39.093904+0000","last_peered":"2026-02-23T06:51:39.093904+0000","last_clean":"2026-02-23T06:51:39.093904+0000","last_became_active":"2026-02-23T06:21:18.146527+0000","last_became_peered":"2026-02-23T06:21:18.146527+0000","last_unstale":"2026-02-23T06:51:39.093904+0000","last_undegraded":"2026-02-23T06:51:39.093904+0000","last_fullsized":"2026-02-23T06:51:39.093904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:30:44.739034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'15","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.729658+0000","last_change":"2026-02-23T06:21:18.145872+0000","last_active":"2026-02-23T06:51:38.729658+0000","last_peered":"2026-02-23T06:51:38.729658+0000","last_clean":"2026-02-23T06:51:38.729658+0000","last_became_active":"2026-02-23T06:21:18.145770+0000","last_became_peered":"2026-02-23T06:21:18.145770+0000","last_unstale":"2026-02-23T06:51:38.729658+0000","last_undegraded":"2026-02-23T06:51:38.729658+0000","last_fullsized":"2026-02-23T06:51:38.729658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:21:28.063960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'17","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:39.093438+0000","last_change":"2026-02-23T06:21:18.152478+0000","last_active":"2026-02-23T06:51:39.093438+0000","last_peered":"2026-02-23T06:51:39.093438+0000","last_clean":"2026-02-23T06:51:39.093438+0000","last_became_active":"2026-02-23T06:21:18.151948+0000","last_became_peered":"2026-02-23T06:21:18.151948+0000","last_unstale":"2026-02-23T06:51:39.093438+0000","last_undegraded":"2026-02-23T06:51:39.093438+0000","last_fullsized":"2026-02-23T06:51:39.093438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:58:02.829593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'13","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.729068+0000","last_change":"2026-02-23T06:21:18.144778+0000","last_active":"2026-02-23T06:51:38.729068+0000","last_peered":"2026-02-23T06:51:38.729068+0000","last_clean":"2026-02-23T06:51:38.729068+0000","last_became_active":"2026-02-23T06:21:18.144346+0000","last_became_peered":"2026-02-23T06:21:18.144346+0000","last_unstale":"2026-02-23T06:51:38.729068+0000","last_undegraded":"2026-02-23T06:51:38.729068+0000","last_fullsized":"2026-02-23T06:51:38.729068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:25:27.650673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'18","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.717839+0000","last_change":"2026-02-23T06:21:18.141648+0000","last_active":"2026-02-23T06:51:38.717839+0000","last_peered":"2026-02-23T06:51:38.717839+0000","last_clean":"2026-02-23T06:51:38.717839+0000","last_became_active":"2026-02-23T06:21:18.141449+0000","last_became_peered":"2026-02-23T06:21:18.141449+0000","last_unstale":"2026-02-23T06:51:38.717839+0000","last_undegraded":"2026-02-23T06:51:38.717839+0000","last_fullsized":"2026-02-23T06:51:38.717839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:33:18.986892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'10","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.717714+0000","last_change":"2026-02-23T06:21:18.142536+0000","last_active":"2026-02-23T06:51:38.717714+0000","last_peered":"2026-02-23T06:51:38.717714+0000","last_clean":"2026-02-23T06:51:38.717714+0000","last_became_active":"2026-02-23T06:21:18.142359+0000","last_became_peered":"2026-02-23T06:21:18.142359+0000","last_unstale":"2026-02-23T06:51:38.717714+0000","last_undegraded":"2026-02-23T06:51:38.717714+0000","last_fullsized":"2026-02-23T06:51:38.717714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:54:09.503227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'16","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:39.096345+0000","last_change":"2026-02-23T06:21:18.156667+0000","last_active":"2026-02-23T06:51:39.096345+0000","last_peered":"2026-02-23T06:51:39.096345+0000","last_clean":"2026-02-23T06:51:39.096345+0000","last_became_active":"2026-02-23T06:21:18.156564+0000","last_became_peered":"2026-02-23T06:21:18.156564+0000","last_unstale":"2026-02-23T06:51:39.096345+0000","last_undegraded":"2026-02-23T06:51:39.096345+0000","last_fullsized":"2026-02-23T06:51:39.096345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:11:13.967668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":3,"num_write":757736,"num_write_kb":39381923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61804,"ondisk_log_size":61804,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1221,"ondisk_log_size":1221,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":13257019,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":32,"num_read_kb":104,"num_write":2249,"num_write_kb":14686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13860864,"data_stored":26514038,"data_compressed":2657250,"data_compressed_allocated":3497984,"data_compressed_original":16220160,"omap_allocated":634237,"internal_metadata":0},"log_size":2104,"ondisk_log_size":2104,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70172,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575218,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280232,"kb_used_data":18712,"kb_used_omap":128,"kb_used_meta":261375,"kb_avail":94091608,"statfs":{"total":96636764160,"available":96349806592,"internally_reserved":0,"allocated":19161088,"data_stored":109760415,"data_compressed":6606692,"data_compressed_allocated":14499840,"data_compressed_original":105279488,"omap_allocated":131483,"internal_metadata":267648613},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575219,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":268120,"kb_used_data":6600,"kb_used_omap":20,"kb_used_meta":261483,"kb_avail":94103720,"statfs":{"total":96636764160,"available":96362209280,"internally_reserved":0,"allocated":6758400,"data_stored":40046719,"data_compressed":2329422,"data_compressed_allocated":4943872,"data_compressed_original":38416384,"omap_allocated":20978,"internal_metadata":267759118},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575220,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254172,"kb_used_data":28748,"kb_used_omap":17,"kb_used_meta":225390,"kb_avail":94117668,"statfs":{"total":96636764160,"available":96376492032,"internally_reserved":0,"allocated":29437952,"data_stored":172084537,"data_compressed":9859668,"data_compressed_allocated":20344832,"data_compressed_original":163164160,"omap_allocated":17420,"internal_metadata":230800372},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575221,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229064,"kb_used_data":3640,"kb_used_omap":43,"kb_used_meta":225364,"kb_avail":94142776,"statfs":{"total":96636764160,"available":96402202624,"internally_reserved":0,"allocated":3727360,"data_stored":4985471,"data_compressed":219149,"data_compressed_allocated":286720,"data_compressed_original":1732608,"omap_allocated":44556,"internal_metadata":230773236},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575220,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":235868,"kb_used_data":10444,"kb_used_omap":239,"kb_used_meta":225168,"kb_avail":94135972,"statfs":{"total":96636764160,"available":96395235328,"internally_reserved":0,"allocated":10694656,"data_stored":46846764,"data_compressed":3417466,"data_compressed_allocated":7405568,"data_compressed_original":43749376,"omap_allocated":245322,"internal_metadata":230572470},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575219,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281760,"kb_used_data":2192,"kb_used_omap":48,"kb_used_meta":279503,"kb_avail":94090080,"statfs":{"total":96636764160,"available":96348241920,"internally_reserved":0,"allocated":2244608,"data_stored":4902940,"data_compressed":537579,"data_compressed_allocated":712704,"data_compressed_original":3551232,"omap_allocated":49901,"internal_metadata":286211347},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575218,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":192896,"kb_used_data":3568,"kb_used_omap":16,"kb_used_meta":189295,"kb_avail":94178944,"statfs":{"total":96636764160,"available":96439238656,"internally_reserved":0,"allocated":3653632,"data_stored":8507375,"data_compressed":1069508,"data_compressed_allocated":1413120,"data_compressed_original":6447104,"omap_allocated":16904,"internal_metadata":193838584},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575218,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174988,"kb_used_data":3708,"kb_used_omap":195,"kb_used_meta":171068,"kb_avail":94196852,"statfs":{"total":96636764160,"available":96457576448,"internally_reserved":0,"allocated":3796992,"data_stored":23186801,"data_compressed":1311368,"data_compressed_allocated":2711552,"data_compressed_original":22282240,"omap_allocated":200273,"internal_metadata":175174063},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":180830,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":126753,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3362816,"data_stored":8389302,"data_compressed":1069508,"data_compressed_allocated":1413120,"data_compressed_original":6447104,"omap_allocated":8580,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1953792,"data_stored":4784867,"data_compressed":537579,"data_compressed_allocated":712704,"data_compressed_original":3551232,"omap_allocated":32915,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1789952,"data_stored":4785651,"data_compressed":682037,"data_compressed_allocated":888832,"data_compressed_original":3903488,"omap_allocated":234344,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3371008,"data_stored":4277030,"data_compressed":184063,"data_compressed_allocated":241664,"data_compressed_original":1159168,"omap_allocated":36527,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3284992,"data_stored":4194304,"data_compressed":181645,"data_compressed_allocated":237568,"data_compressed_original":1146880,"omap_allocated":4760,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":82758,"data_compressed":2418,"data_compressed_allocated":4096,"data_compressed_original":12288,"omap_allocated":9528,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T06:51:45.506 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2026-02-23T06:21:16.130732+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=16, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.506 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.506 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.507 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2026-02-23T06:21:16.130732+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=16, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.507 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.507 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.507 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2026-02-23T06:21:16.130732+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=16, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.507 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.508 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.508 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2026-02-23T06:21:16.130732+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=16, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.508 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.508 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.508 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.508 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2026-02-23T06:21:16.130732+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=16, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.509 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.509 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.509 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2026-02-23T06:21:16.130732+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=16, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.509 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.509 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.509 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2026-02-23T06:21:16.130732+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=16, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.510 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.510 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.510 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.510 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.510 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-23T06:21:16.130732+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=16, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.511 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.511 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.511 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-23T06:21:16.130732+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=16, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.511 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.511 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.511 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-23T06:21:16.130732+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=16, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.512 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.512 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-23T06:21:16.130732+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=16, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.512 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.512 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.512 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-23T06:21:16.130732+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=16, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.512 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.513 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.513 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-23T06:21:16.130732+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=16, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.513 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.513 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.513 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.513 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.513 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-23T06:21:16.130732+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=16, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.513 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.514 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.514 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2026-02-23T06:21:16.130732+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=16, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.514 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.514 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.514 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2026-02-23T06:21:16.130732+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=16, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.514 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.514 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.515 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2026-02-23T06:21:16.130732+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=16, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.515 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.515 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.515 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.515 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.516 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2026-02-23T06:21:16.130732+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=16, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.516 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.516 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.516 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2026-02-23T06:21:16.130732+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=16, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.516 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.516 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.516 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2026-02-23T06:21:16.130732+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=16, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.517 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.517 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.517 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2026-02-23T06:21:16.130732+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=16, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.517 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.517 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.517 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.518 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.518 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2026-02-23T06:21:16.130732+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=16, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.518 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.518 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.518 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2026-02-23T06:21:16.130732+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=16, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.518 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.519 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.519 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2026-02-23T06:21:16.130732+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=16, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.519 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.519 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.519 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.519 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2026-02-23T06:21:16.130732+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=16, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.519 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.519 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.519 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2026-02-23T06:21:16.130732+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=16, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.520 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2026-02-23T06:21:16.130732+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=16, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.520 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.520 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.520 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2026-02-23T06:21:16.130732+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=16, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.520 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.520 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.520 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.520 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.520 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.521 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.521 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.521 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.521 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.521 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.521 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.521 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.521 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.522 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.522 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.522 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.522 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.522 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.522 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.522 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.522 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.523 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.523 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.523 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.523 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.523 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.523 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.523 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.524 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.524 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.524 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.524 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.524 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.524 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:51:45.524 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-23T06:51:45.851 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:51:45.855 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:52:05.525 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-23T06:52:05.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.651+0000 7f71525d2640 1 -- 10.20.193.58:0/3697435792 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f714c0b6690 msgr2=0x7f714c058ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:05.645 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.651+0000 7f71525d2640 1 --2- 10.20.193.58:0/3697435792 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f714c0b6690 0x7f714c058ec0 secure :-1 s=READY pgs=202 gs=3 cs=0 l=1 c_cookie=10923004121456865390 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7148005820 tx=0x7f71480302b0 comp rx=0 tx=0).stop 2026-02-23T06:52:05.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.651+0000 7f71525d2640 1 -- 10.20.193.58:0/3697435792 shutdown_connections 2026-02-23T06:52:05.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.651+0000 7f71525d2640 1 --2- 10.20.193.58:0/3697435792 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f714c0b6690 0x7f714c058ec0 unknown :-1 s=CLOSED pgs=202 gs=3 cs=0 l=1 c_cookie=10923004121456865390 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:05.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.651+0000 7f71525d2640 1 -- 10.20.193.58:0/3697435792 >> 10.20.193.58:0/3697435792 conn(0x7f714c0b3c20 msgr2=0x7f714c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:52:05.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.651+0000 7f71525d2640 1 -- 10.20.193.58:0/3697435792 shutdown_connections 2026-02-23T06:52:05.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.651+0000 7f71525d2640 1 -- 10.20.193.58:0/3697435792 wait complete. 2026-02-23T06:52:05.646 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.652+0000 7f71525d2640 1 Processor -- start 2026-02-23T06:52:05.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.652+0000 7f71525d2640 1 -- start start 2026-02-23T06:52:05.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.653+0000 7f71525d2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f714c0b6690 0x7f714c14a990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:05.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.653+0000 7f71525d2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f714c15d4a0 0x7f714c13d3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:05.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.653+0000 7f71525d2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f714c15d870 0x7f714c1226b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:05.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.653+0000 7f71525d2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f714c14aed0 con 0x7f714c15d4a0 2026-02-23T06:52:05.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.653+0000 7f71525d2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f714c0579a0 con 0x7f714c0b6690 2026-02-23T06:52:05.647 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.653+0000 7f71525d2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f714c058200 con 0x7f714c15d870 2026-02-23T06:52:05.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.653+0000 7f7150dcf640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f714c15d4a0 0x7f714c13d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:05.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.653+0000 7f7150dcf640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f714c15d4a0 0x7f714c13d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:34312/0 (socket says 10.20.193.58:34312) 2026-02-23T06:52:05.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.653+0000 7f7150dcf640 1 -- 10.20.193.58:0/2752315939 learned_addr learned my addr 10.20.193.58:0/2752315939 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:52:05.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.653+0000 7f71515d0640 1 --2- 10.20.193.58:0/2752315939 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f714c0b6690 0x7f714c14a990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:05.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.653+0000 7f7151dd1640 1 --2- 10.20.193.58:0/2752315939 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f714c15d870 0x7f714c1226b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:05.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.653+0000 7f7150dcf640 1 -- 10.20.193.58:0/2752315939 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f714c15d870 msgr2=0x7f714c1226b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:05.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.653+0000 7f7150dcf640 1 --2- 10.20.193.58:0/2752315939 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f714c15d870 0x7f714c1226b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:05.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.653+0000 7f7150dcf640 1 -- 10.20.193.58:0/2752315939 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f714c0b6690 msgr2=0x7f714c14a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:05.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.653+0000 7f7150dcf640 1 --2- 10.20.193.58:0/2752315939 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f714c0b6690 0x7f714c14a990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:05.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.653+0000 7f7150dcf640 1 -- 10.20.193.58:0/2752315939 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f714800a590 con 0x7f714c15d4a0 2026-02-23T06:52:05.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.653+0000 7f71515d0640 1 --2- 10.20.193.58:0/2752315939 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f714c0b6690 0x7f714c14a990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:52:05.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.653+0000 7f7150dcf640 1 --2- 10.20.193.58:0/2752315939 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f714c15d4a0 0x7f714c13d3f0 secure :-1 s=READY pgs=203 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f714000c480 tx=0x7f714000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:52:05.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.653+0000 7f7139ffb640 1 -- 10.20.193.58:0/2752315939 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7140006ab0 con 0x7f714c15d4a0 2026-02-23T06:52:05.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.653+0000 7f7139ffb640 1 -- 10.20.193.58:0/2752315939 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7140006d00 con 0x7f714c15d4a0 2026-02-23T06:52:05.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.653+0000 7f7139ffb640 1 -- 10.20.193.58:0/2752315939 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71400072b0 con 0x7f714c15d4a0 2026-02-23T06:52:05.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.654+0000 7f71525d2640 1 -- 10.20.193.58:0/2752315939 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f714c057c40 con 0x7f714c15d4a0 2026-02-23T06:52:05.648 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.654+0000 7f71525d2640 1 -- 10.20.193.58:0/2752315939 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f714c121eb0 con 0x7f714c15d4a0 2026-02-23T06:52:05.649 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.654+0000 7f71525d2640 1 -- 10.20.193.58:0/2752315939 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f714c0b6d50 con 0x7f714c15d4a0 2026-02-23T06:52:05.650 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.656+0000 7f7139ffb640 1 -- 10.20.193.58:0/2752315939 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f7140007410 con 0x7f714c15d4a0 2026-02-23T06:52:05.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.657+0000 7f7139ffb640 1 --2- 10.20.193.58:0/2752315939 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f711c07a640 0x7f711c09aaf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:05.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.657+0000 7f7139ffb640 1 -- 10.20.193.58:0/2752315939 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f714009ce40 con 0x7f714c15d4a0 2026-02-23T06:52:05.651 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.657+0000 7f71515d0640 1 --2- 10.20.193.58:0/2752315939 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f711c07a640 0x7f711c09aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:05.652 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.658+0000 7f71515d0640 1 --2- 10.20.193.58:0/2752315939 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f711c07a640 0x7f711c09aaf0 secure :-1 s=READY pgs=623 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f713c0027d0 tx=0x7f713c009040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:52:05.653 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.659+0000 7f7139ffb640 1 -- 10.20.193.58:0/2752315939 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f7140060080 con 0x7f714c15d4a0 2026-02-23T06:52:05.766 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.772+0000 7f71525d2640 1 -- 10.20.193.58:0/2752315939 --> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f714c0b5e10 con 0x7f711c07a640 2026-02-23T06:52:05.770 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.775+0000 7f7139ffb640 1 -- 10.20.193.58:0/2752315939 <== mgr.4126 v2:10.20.193.93:6800/4124709854 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334547 (secure 0 0 0) 0x7f713c003c60 con 0x7f711c07a640 2026-02-23T06:52:05.772 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:52:05.773 INFO:teuthology.orchestra.run.trial058.stderr:dumped all 2026-02-23T06:52:05.773 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.778+0000 7f71525d2640 1 -- 10.20.193.58:0/2752315939 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f711c07a640 msgr2=0x7f711c09aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:05.773 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.778+0000 7f71525d2640 1 --2- 10.20.193.58:0/2752315939 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f711c07a640 0x7f711c09aaf0 secure :-1 s=READY pgs=623 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f713c0027d0 tx=0x7f713c009040 comp rx=0 tx=0).stop 2026-02-23T06:52:05.773 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.778+0000 7f71525d2640 1 -- 10.20.193.58:0/2752315939 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f714c15d4a0 msgr2=0x7f714c13d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:05.773 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.778+0000 7f71525d2640 1 --2- 10.20.193.58:0/2752315939 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f714c15d4a0 0x7f714c13d3f0 secure :-1 s=READY pgs=203 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f714000c480 tx=0x7f714000c950 comp rx=0 tx=0).stop 2026-02-23T06:52:05.773 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.778+0000 7f71525d2640 1 -- 10.20.193.58:0/2752315939 shutdown_connections 2026-02-23T06:52:05.773 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.778+0000 7f71525d2640 1 --2- 10.20.193.58:0/2752315939 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f711c07a640 0x7f711c09aaf0 unknown :-1 s=CLOSED pgs=623 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:05.773 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.778+0000 7f71525d2640 1 --2- 10.20.193.58:0/2752315939 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f714c15d870 0x7f714c1226b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:05.773 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.778+0000 7f71525d2640 1 --2- 10.20.193.58:0/2752315939 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f714c15d4a0 0x7f714c13d3f0 unknown :-1 s=CLOSED pgs=203 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:05.773 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.778+0000 7f71525d2640 1 --2- 10.20.193.58:0/2752315939 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f714c0b6690 0x7f714c14a990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:05.773 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.778+0000 7f71525d2640 1 -- 10.20.193.58:0/2752315939 >> 10.20.193.58:0/2752315939 conn(0x7f714c0b3c20 msgr2=0x7f714c05c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:52:05.773 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.778+0000 7f71525d2640 1 -- 10.20.193.58:0/2752315939 shutdown_connections 2026-02-23T06:52:05.773 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:05.778+0000 7f71525d2640 1 -- 10.20.193.58:0/2752315939 wait complete. 2026-02-23T06:52:05.784 INFO:teuthology.orchestra.run.trial058.stdout:{"pg_ready":true,"pg_map":{"version":951,"stamp":"2026-02-23T06:52:04.659797+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":13847387,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":119,"num_read_kb":180,"num_write":760131,"num_write_kb":39399282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5220,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65261,"ondisk_log_size":65261,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1855424,"kb_used_data":15936,"kb_used_omap":709,"kb_used_meta":1838650,"kb_avail":753119296,"statfs":{"total":773094113280,"available":771194159104,"internally_reserved":0,"allocated":16318464,"data_stored":28639358,"data_compressed":2727422,"data_compressed_allocated":3588096,"data_compressed_original":17367040,"omap_allocated":726837,"internal_metadata":1882777803},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001746"},"pg_stats":[{"pgid":"2.1f","version":"27'31","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:48.858073+0000","last_change":"2026-02-23T06:51:48.858073+0000","last_active":"2026-02-23T06:51:48.858073+0000","last_peered":"2026-02-23T06:51:48.858073+0000","last_clean":"2026-02-23T06:51:48.858073+0000","last_became_active":"2026-02-23T06:21:17.142416+0000","last_became_peered":"2026-02-23T06:21:17.142416+0000","last_unstale":"2026-02-23T06:51:48.858073+0000","last_undegraded":"2026-02-23T06:51:48.858073+0000","last_fullsized":"2026-02-23T06:51:48.858073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2026-02-23T06:51:48.858032+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2026-02-23T06:51:48.858032+0000","last_clean_scrub_stamp":"2026-02-23T06:51:48.858032+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:22:12.881273+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590563,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'11","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:52.540178+0000","last_change":"2026-02-23T06:51:52.540178+0000","last_active":"2026-02-23T06:51:52.540178+0000","last_peered":"2026-02-23T06:51:52.540178+0000","last_clean":"2026-02-23T06:51:52.540178+0000","last_became_active":"2026-02-23T06:21:18.148276+0000","last_became_peered":"2026-02-23T06:21:18.148276+0000","last_unstale":"2026-02-23T06:51:52.540178+0000","last_undegraded":"2026-02-23T06:51:52.540178+0000","last_fullsized":"2026-02-23T06:51:52.540178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2026-02-23T06:51:52.540145+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2026-02-23T06:51:52.540145+0000","last_clean_scrub_stamp":"2026-02-23T06:51:52.540145+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:05:29.758869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'2077","reported_seq":2116,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:53.346014+0000","last_change":"2026-02-23T06:51:53.346014+0000","last_active":"2026-02-23T06:51:53.346014+0000","last_peered":"2026-02-23T06:51:53.346014+0000","last_clean":"2026-02-23T06:51:53.346014+0000","last_became_active":"2026-02-23T06:21:22.169307+0000","last_became_peered":"2026-02-23T06:21:22.169307+0000","last_unstale":"2026-02-23T06:51:53.346014+0000","last_undegraded":"2026-02-23T06:51:53.346014+0000","last_fullsized":"2026-02-23T06:51:53.346014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2077","last_scrub_stamp":"2026-02-23T06:51:53.345981+0000","last_deep_scrub":"27'2077","last_deep_scrub_stamp":"2026-02-23T06:51:53.345981+0000","last_clean_scrub_stamp":"2026-02-23T06:51:53.345981+0000","objects_scrubbed":0,"log_size":2077,"log_dups_size":0,"ondisk_log_size":2077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:14:24.157243+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25614,"num_write_kb":1337383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'3","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:47.458768+0000","last_change":"2026-02-23T06:51:47.458768+0000","last_active":"2026-02-23T06:51:47.458768+0000","last_peered":"2026-02-23T06:51:47.458768+0000","last_clean":"2026-02-23T06:51:47.458768+0000","last_became_active":"2026-02-23T06:21:17.138651+0000","last_became_peered":"2026-02-23T06:21:17.138651+0000","last_unstale":"2026-02-23T06:51:47.458768+0000","last_undegraded":"2026-02-23T06:51:47.458768+0000","last_fullsized":"2026-02-23T06:51:47.458768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2026-02-23T06:51:47.458718+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2026-02-23T06:51:47.458718+0000","last_clean_scrub_stamp":"2026-02-23T06:51:47.458718+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:27:36.538570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'21","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:53.510357+0000","last_change":"2026-02-23T06:51:53.510357+0000","last_active":"2026-02-23T06:51:53.510357+0000","last_peered":"2026-02-23T06:51:53.510357+0000","last_clean":"2026-02-23T06:51:53.510357+0000","last_became_active":"2026-02-23T06:21:18.144915+0000","last_became_peered":"2026-02-23T06:21:18.144915+0000","last_unstale":"2026-02-23T06:51:53.510357+0000","last_undegraded":"2026-02-23T06:51:53.510357+0000","last_fullsized":"2026-02-23T06:51:53.510357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2026-02-23T06:51:53.510317+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2026-02-23T06:51:53.510317+0000","last_clean_scrub_stamp":"2026-02-23T06:51:53.510317+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:00:46.450210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'2043","reported_seq":2090,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:54.321630+0000","last_change":"2026-02-23T06:51:54.321630+0000","last_active":"2026-02-23T06:51:54.321630+0000","last_peered":"2026-02-23T06:51:54.321630+0000","last_clean":"2026-02-23T06:51:54.321630+0000","last_became_active":"2026-02-23T06:22:05.909877+0000","last_became_peered":"2026-02-23T06:22:05.909877+0000","last_unstale":"2026-02-23T06:51:54.321630+0000","last_undegraded":"2026-02-23T06:51:54.321630+0000","last_fullsized":"2026-02-23T06:51:54.321630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2043","last_scrub_stamp":"2026-02-23T06:51:54.321602+0000","last_deep_scrub":"27'2043","last_deep_scrub_stamp":"2026-02-23T06:51:54.321602+0000","last_clean_scrub_stamp":"2026-02-23T06:51:54.321602+0000","objects_scrubbed":0,"log_size":2043,"log_dups_size":0,"ondisk_log_size":2043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:32.189373+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25337,"num_write_kb":1284660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'10","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:45.056276+0000","last_change":"2026-02-23T06:51:45.056276+0000","last_active":"2026-02-23T06:51:45.056276+0000","last_peered":"2026-02-23T06:51:45.056276+0000","last_clean":"2026-02-23T06:51:45.056276+0000","last_became_active":"2026-02-23T06:21:17.150244+0000","last_became_peered":"2026-02-23T06:21:17.150244+0000","last_unstale":"2026-02-23T06:51:45.056276+0000","last_undegraded":"2026-02-23T06:51:45.056276+0000","last_fullsized":"2026-02-23T06:51:45.056276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2026-02-23T06:51:45.056235+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2026-02-23T06:51:45.056235+0000","last_clean_scrub_stamp":"2026-02-23T06:51:45.056235+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:23:22.084893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'18","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:46.675046+0000","last_change":"2026-02-23T06:51:46.675046+0000","last_active":"2026-02-23T06:51:46.675046+0000","last_peered":"2026-02-23T06:51:46.675046+0000","last_clean":"2026-02-23T06:51:46.675046+0000","last_became_active":"2026-02-23T06:21:18.149827+0000","last_became_peered":"2026-02-23T06:21:18.149827+0000","last_unstale":"2026-02-23T06:51:46.675046+0000","last_undegraded":"2026-02-23T06:51:46.675046+0000","last_fullsized":"2026-02-23T06:51:46.675046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2026-02-23T06:51:46.675018+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2026-02-23T06:51:46.675018+0000","last_clean_scrub_stamp":"2026-02-23T06:51:46.675018+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:18.760801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'1774","reported_seq":1813,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:57.308902+0000","last_change":"2026-02-23T06:51:57.308902+0000","last_active":"2026-02-23T06:51:57.308902+0000","last_peered":"2026-02-23T06:51:57.308902+0000","last_clean":"2026-02-23T06:51:57.308902+0000","last_became_active":"2026-02-23T06:21:22.173939+0000","last_became_peered":"2026-02-23T06:21:22.173939+0000","last_unstale":"2026-02-23T06:51:57.308902+0000","last_undegraded":"2026-02-23T06:51:57.308902+0000","last_fullsized":"2026-02-23T06:51:57.308902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1774","last_scrub_stamp":"2026-02-23T06:51:57.308868+0000","last_deep_scrub":"27'1774","last_deep_scrub_stamp":"2026-02-23T06:51:57.308868+0000","last_clean_scrub_stamp":"2026-02-23T06:51:57.308868+0000","objects_scrubbed":0,"log_size":1774,"log_dups_size":0,"ondisk_log_size":1774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:29:17.243011+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22016,"num_write_kb":1043178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'3","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:46.100285+0000","last_change":"2026-02-23T06:51:46.100285+0000","last_active":"2026-02-23T06:51:46.100285+0000","last_peered":"2026-02-23T06:51:46.100285+0000","last_clean":"2026-02-23T06:51:46.100285+0000","last_became_active":"2026-02-23T06:21:17.144122+0000","last_became_peered":"2026-02-23T06:21:17.144122+0000","last_unstale":"2026-02-23T06:51:46.100285+0000","last_undegraded":"2026-02-23T06:51:46.100285+0000","last_fullsized":"2026-02-23T06:51:46.100285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2026-02-23T06:51:46.100258+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2026-02-23T06:51:46.100258+0000","last_clean_scrub_stamp":"2026-02-23T06:51:46.100258+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:18:27.197125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'26","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:51.118074+0000","last_change":"2026-02-23T06:51:51.118074+0000","last_active":"2026-02-23T06:51:51.118074+0000","last_peered":"2026-02-23T06:51:51.118074+0000","last_clean":"2026-02-23T06:51:51.118074+0000","last_became_active":"2026-02-23T06:22:05.870252+0000","last_became_peered":"2026-02-23T06:22:05.870252+0000","last_unstale":"2026-02-23T06:51:51.118074+0000","last_undegraded":"2026-02-23T06:51:51.118074+0000","last_fullsized":"2026-02-23T06:51:51.118074+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2026-02-23T06:51:51.118036+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2026-02-23T06:51:51.118036+0000","last_clean_scrub_stamp":"2026-02-23T06:51:51.118036+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:42:18.486538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'2124","reported_seq":2163,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:56.348443+0000","last_change":"2026-02-23T06:51:56.348443+0000","last_active":"2026-02-23T06:51:56.348443+0000","last_peered":"2026-02-23T06:51:56.348443+0000","last_clean":"2026-02-23T06:51:56.348443+0000","last_became_active":"2026-02-23T06:21:22.165671+0000","last_became_peered":"2026-02-23T06:21:22.165671+0000","last_unstale":"2026-02-23T06:51:56.348443+0000","last_undegraded":"2026-02-23T06:51:56.348443+0000","last_fullsized":"2026-02-23T06:51:56.348443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2124","last_scrub_stamp":"2026-02-23T06:51:56.348399+0000","last_deep_scrub":"27'2124","last_deep_scrub_stamp":"2026-02-23T06:51:56.348399+0000","last_clean_scrub_stamp":"2026-02-23T06:51:56.348399+0000","objects_scrubbed":0,"log_size":2124,"log_dups_size":0,"ondisk_log_size":2124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:14:33.358814+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26592,"num_write_kb":1292875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'15","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:59.129656+0000","last_change":"2026-02-23T06:51:59.129656+0000","last_active":"2026-02-23T06:51:59.129656+0000","last_peered":"2026-02-23T06:51:59.129656+0000","last_clean":"2026-02-23T06:51:59.129656+0000","last_became_active":"2026-02-23T06:21:18.150604+0000","last_became_peered":"2026-02-23T06:21:18.150604+0000","last_unstale":"2026-02-23T06:51:59.129656+0000","last_undegraded":"2026-02-23T06:51:59.129656+0000","last_fullsized":"2026-02-23T06:51:59.129656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2026-02-23T06:51:59.129621+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2026-02-23T06:51:59.129621+0000","last_clean_scrub_stamp":"2026-02-23T06:51:59.129621+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:21:46.868501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'327","reported_seq":374,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:53.167028+0000","last_change":"2026-02-23T06:51:53.167028+0000","last_active":"2026-02-23T06:51:53.167028+0000","last_peered":"2026-02-23T06:51:53.167028+0000","last_clean":"2026-02-23T06:51:53.167028+0000","last_became_active":"2026-02-23T06:21:17.147351+0000","last_became_peered":"2026-02-23T06:21:17.147351+0000","last_unstale":"2026-02-23T06:51:53.167028+0000","last_undegraded":"2026-02-23T06:51:53.167028+0000","last_fullsized":"2026-02-23T06:51:53.167028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'327","last_scrub_stamp":"2026-02-23T06:51:53.166985+0000","last_deep_scrub":"27'327","last_deep_scrub_stamp":"2026-02-23T06:51:53.166985+0000","last_clean_scrub_stamp":"2026-02-23T06:51:53.166985+0000","objects_scrubbed":2,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:00:10.858330+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":322,"num_write_kb":4304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'1853","reported_seq":1893,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:52:02.109223+0000","last_change":"2026-02-23T06:52:02.109223+0000","last_active":"2026-02-23T06:52:02.109223+0000","last_peered":"2026-02-23T06:52:02.109223+0000","last_clean":"2026-02-23T06:52:02.109223+0000","last_became_active":"2026-02-23T06:21:22.169259+0000","last_became_peered":"2026-02-23T06:21:22.169259+0000","last_unstale":"2026-02-23T06:52:02.109223+0000","last_undegraded":"2026-02-23T06:52:02.109223+0000","last_fullsized":"2026-02-23T06:52:02.109223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1853","last_scrub_stamp":"2026-02-23T06:52:02.109166+0000","last_deep_scrub":"27'1853","last_deep_scrub_stamp":"2026-02-23T06:52:02.109166+0000","last_clean_scrub_stamp":"2026-02-23T06:52:02.109166+0000","objects_scrubbed":0,"log_size":1853,"log_dups_size":0,"ondisk_log_size":1853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:41:49.448889+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22800,"num_write_kb":1137326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'19","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:48.182076+0000","last_change":"2026-02-23T06:51:48.182076+0000","last_active":"2026-02-23T06:51:48.182076+0000","last_peered":"2026-02-23T06:51:48.182076+0000","last_clean":"2026-02-23T06:51:48.182076+0000","last_became_active":"2026-02-23T06:21:18.142144+0000","last_became_peered":"2026-02-23T06:21:18.142144+0000","last_unstale":"2026-02-23T06:51:48.182076+0000","last_undegraded":"2026-02-23T06:51:48.182076+0000","last_fullsized":"2026-02-23T06:51:48.182076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2026-02-23T06:51:48.182026+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2026-02-23T06:51:48.182026+0000","last_clean_scrub_stamp":"2026-02-23T06:51:48.182026+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:55:25.738920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'1","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:46.474975+0000","last_change":"2026-02-23T06:51:46.474975+0000","last_active":"2026-02-23T06:51:46.474975+0000","last_peered":"2026-02-23T06:51:46.474975+0000","last_clean":"2026-02-23T06:51:46.474975+0000","last_became_active":"2026-02-23T06:21:17.137371+0000","last_became_peered":"2026-02-23T06:21:17.137371+0000","last_unstale":"2026-02-23T06:51:46.474975+0000","last_undegraded":"2026-02-23T06:51:46.474975+0000","last_fullsized":"2026-02-23T06:51:46.474975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2026-02-23T06:51:46.474923+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2026-02-23T06:51:46.474923+0000","last_clean_scrub_stamp":"2026-02-23T06:51:46.474923+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:14:29.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'1806","reported_seq":1846,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:52:00.117260+0000","last_change":"2026-02-23T06:52:00.117260+0000","last_active":"2026-02-23T06:52:00.117260+0000","last_peered":"2026-02-23T06:52:00.117260+0000","last_clean":"2026-02-23T06:52:00.117260+0000","last_became_active":"2026-02-23T06:21:22.162898+0000","last_became_peered":"2026-02-23T06:21:22.162898+0000","last_unstale":"2026-02-23T06:52:00.117260+0000","last_undegraded":"2026-02-23T06:52:00.117260+0000","last_fullsized":"2026-02-23T06:52:00.117260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1806","last_scrub_stamp":"2026-02-23T06:52:00.117227+0000","last_deep_scrub":"27'1806","last_deep_scrub_stamp":"2026-02-23T06:52:00.117227+0000","last_clean_scrub_stamp":"2026-02-23T06:52:00.117227+0000","objects_scrubbed":0,"log_size":1806,"log_dups_size":0,"ondisk_log_size":1806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:23:16.648560+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21405,"num_write_kb":1230733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'18","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:51.829763+0000","last_change":"2026-02-23T06:51:51.829763+0000","last_active":"2026-02-23T06:51:51.829763+0000","last_peered":"2026-02-23T06:51:51.829763+0000","last_clean":"2026-02-23T06:51:51.829763+0000","last_became_active":"2026-02-23T06:21:18.141090+0000","last_became_peered":"2026-02-23T06:21:18.141090+0000","last_unstale":"2026-02-23T06:51:51.829763+0000","last_undegraded":"2026-02-23T06:51:51.829763+0000","last_fullsized":"2026-02-23T06:51:51.829763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2026-02-23T06:51:51.829696+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2026-02-23T06:51:51.829696+0000","last_clean_scrub_stamp":"2026-02-23T06:51:51.829696+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:09:14.391042+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.867731+0000","last_change":"2026-02-23T06:51:44.867731+0000","last_active":"2026-02-23T06:51:44.867731+0000","last_peered":"2026-02-23T06:51:44.867731+0000","last_clean":"2026-02-23T06:51:44.867731+0000","last_became_active":"2026-02-23T06:21:17.144017+0000","last_became_peered":"2026-02-23T06:21:17.144017+0000","last_unstale":"2026-02-23T06:51:44.867731+0000","last_undegraded":"2026-02-23T06:51:44.867731+0000","last_fullsized":"2026-02-23T06:51:44.867731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:51:44.867687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:51:44.867687+0000","last_clean_scrub_stamp":"2026-02-23T06:51:44.867687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:17:40.648805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'2599","reported_seq":2639,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:55.378216+0000","last_change":"2026-02-23T06:51:55.378216+0000","last_active":"2026-02-23T06:51:55.378216+0000","last_peered":"2026-02-23T06:51:55.378216+0000","last_clean":"2026-02-23T06:51:55.378216+0000","last_became_active":"2026-02-23T06:21:22.174683+0000","last_became_peered":"2026-02-23T06:21:22.174683+0000","last_unstale":"2026-02-23T06:51:55.378216+0000","last_undegraded":"2026-02-23T06:51:55.378216+0000","last_fullsized":"2026-02-23T06:51:55.378216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2599","last_scrub_stamp":"2026-02-23T06:51:55.378175+0000","last_deep_scrub":"27'2599","last_deep_scrub_stamp":"2026-02-23T06:51:55.378175+0000","last_clean_scrub_stamp":"2026-02-23T06:51:55.378175+0000","objects_scrubbed":0,"log_size":2599,"log_dups_size":0,"ondisk_log_size":2599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:48:03.569902+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32970,"num_write_kb":1504117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'9","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:46.197485+0000","last_change":"2026-02-23T06:51:46.197485+0000","last_active":"2026-02-23T06:51:46.197485+0000","last_peered":"2026-02-23T06:51:46.197485+0000","last_clean":"2026-02-23T06:51:46.197485+0000","last_became_active":"2026-02-23T06:21:18.145231+0000","last_became_peered":"2026-02-23T06:21:18.145231+0000","last_unstale":"2026-02-23T06:51:46.197485+0000","last_undegraded":"2026-02-23T06:51:46.197485+0000","last_fullsized":"2026-02-23T06:51:46.197485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2026-02-23T06:51:46.197442+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2026-02-23T06:51:46.197442+0000","last_clean_scrub_stamp":"2026-02-23T06:51:46.197442+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:30:10.234524+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'3","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:43.004448+0000","last_change":"2026-02-23T06:51:43.004448+0000","last_active":"2026-02-23T06:51:43.004448+0000","last_peered":"2026-02-23T06:51:43.004448+0000","last_clean":"2026-02-23T06:51:43.004448+0000","last_became_active":"2026-02-23T06:21:17.147431+0000","last_became_peered":"2026-02-23T06:21:17.147431+0000","last_unstale":"2026-02-23T06:51:43.004448+0000","last_undegraded":"2026-02-23T06:51:43.004448+0000","last_fullsized":"2026-02-23T06:51:43.004448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2026-02-23T06:51:43.004418+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2026-02-23T06:51:43.004418+0000","last_clean_scrub_stamp":"2026-02-23T06:51:43.004418+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:35:53.658192+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'2099","reported_seq":2139,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:53.274173+0000","last_change":"2026-02-23T06:51:53.274173+0000","last_active":"2026-02-23T06:51:53.274173+0000","last_peered":"2026-02-23T06:51:53.274173+0000","last_clean":"2026-02-23T06:51:53.274173+0000","last_became_active":"2026-02-23T06:21:22.175493+0000","last_became_peered":"2026-02-23T06:21:22.175493+0000","last_unstale":"2026-02-23T06:51:53.274173+0000","last_undegraded":"2026-02-23T06:51:53.274173+0000","last_fullsized":"2026-02-23T06:51:53.274173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2099","last_scrub_stamp":"2026-02-23T06:51:53.274132+0000","last_deep_scrub":"27'2099","last_deep_scrub_stamp":"2026-02-23T06:51:53.274132+0000","last_clean_scrub_stamp":"2026-02-23T06:51:53.274132+0000","objects_scrubbed":0,"log_size":2099,"log_dups_size":0,"ondisk_log_size":2099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:11:56.138422+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25611,"num_write_kb":1337535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'25","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:52.845994+0000","last_change":"2026-02-23T06:51:52.845994+0000","last_active":"2026-02-23T06:51:52.845994+0000","last_peered":"2026-02-23T06:51:52.845994+0000","last_clean":"2026-02-23T06:51:52.845994+0000","last_became_active":"2026-02-23T06:21:18.141277+0000","last_became_peered":"2026-02-23T06:21:18.141277+0000","last_unstale":"2026-02-23T06:51:52.845994+0000","last_undegraded":"2026-02-23T06:51:52.845994+0000","last_fullsized":"2026-02-23T06:51:52.845994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2026-02-23T06:51:52.845944+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2026-02-23T06:51:52.845944+0000","last_clean_scrub_stamp":"2026-02-23T06:51:52.845944+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:12:13.212674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'7","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:45.171312+0000","last_change":"2026-02-23T06:51:45.171312+0000","last_active":"2026-02-23T06:51:45.171312+0000","last_peered":"2026-02-23T06:51:45.171312+0000","last_clean":"2026-02-23T06:51:45.171312+0000","last_became_active":"2026-02-23T06:21:17.148424+0000","last_became_peered":"2026-02-23T06:21:17.148424+0000","last_unstale":"2026-02-23T06:51:45.171312+0000","last_undegraded":"2026-02-23T06:51:45.171312+0000","last_fullsized":"2026-02-23T06:51:45.171312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2026-02-23T06:51:45.171254+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2026-02-23T06:51:45.171254+0000","last_clean_scrub_stamp":"2026-02-23T06:51:45.171254+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:14:31.321439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'1635","reported_seq":1676,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:47.200857+0000","last_change":"2026-02-23T06:51:47.200857+0000","last_active":"2026-02-23T06:51:47.200857+0000","last_peered":"2026-02-23T06:51:47.200857+0000","last_clean":"2026-02-23T06:51:47.200857+0000","last_became_active":"2026-02-23T06:21:22.170496+0000","last_became_peered":"2026-02-23T06:21:22.170496+0000","last_unstale":"2026-02-23T06:51:47.200857+0000","last_undegraded":"2026-02-23T06:51:47.200857+0000","last_fullsized":"2026-02-23T06:51:47.200857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1635","last_scrub_stamp":"2026-02-23T06:51:47.200826+0000","last_deep_scrub":"27'1635","last_deep_scrub_stamp":"2026-02-23T06:51:47.200826+0000","last_clean_scrub_stamp":"2026-02-23T06:51:47.200826+0000","objects_scrubbed":0,"log_size":1635,"log_dups_size":0,"ondisk_log_size":1635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:59:36.346424+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20598,"num_write_kb":974984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'18","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:50.860931+0000","last_change":"2026-02-23T06:51:50.860931+0000","last_active":"2026-02-23T06:51:50.860931+0000","last_peered":"2026-02-23T06:51:50.860931+0000","last_clean":"2026-02-23T06:51:50.860931+0000","last_became_active":"2026-02-23T06:21:18.141771+0000","last_became_peered":"2026-02-23T06:21:18.141771+0000","last_unstale":"2026-02-23T06:51:50.860931+0000","last_undegraded":"2026-02-23T06:51:50.860931+0000","last_fullsized":"2026-02-23T06:51:50.860931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2026-02-23T06:51:50.860889+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2026-02-23T06:51:50.860889+0000","last_clean_scrub_stamp":"2026-02-23T06:51:50.860889+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:58:54.999496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'156","reported_seq":204,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:46.844509+0000","last_change":"2026-02-23T06:51:46.844509+0000","last_active":"2026-02-23T06:51:46.844509+0000","last_peered":"2026-02-23T06:51:46.844509+0000","last_clean":"2026-02-23T06:51:46.844509+0000","last_became_active":"2026-02-23T06:21:17.142203+0000","last_became_peered":"2026-02-23T06:21:17.142203+0000","last_unstale":"2026-02-23T06:51:46.844509+0000","last_undegraded":"2026-02-23T06:51:46.844509+0000","last_fullsized":"2026-02-23T06:51:46.844509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'156","last_scrub_stamp":"2026-02-23T06:51:46.844474+0000","last_deep_scrub":"27'156","last_deep_scrub_stamp":"2026-02-23T06:51:46.844474+0000","last_clean_scrub_stamp":"2026-02-23T06:51:46.844474+0000","objects_scrubbed":1,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:47:15.311449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'1598","reported_seq":1640,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:57.785992+0000","last_change":"2026-02-23T06:51:57.785992+0000","last_active":"2026-02-23T06:51:57.785992+0000","last_peered":"2026-02-23T06:51:57.785992+0000","last_clean":"2026-02-23T06:51:57.785992+0000","last_became_active":"2026-02-23T06:21:22.168375+0000","last_became_peered":"2026-02-23T06:21:22.168375+0000","last_unstale":"2026-02-23T06:51:57.785992+0000","last_undegraded":"2026-02-23T06:51:57.785992+0000","last_fullsized":"2026-02-23T06:51:57.785992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1598","last_scrub_stamp":"2026-02-23T06:51:57.785932+0000","last_deep_scrub":"27'1598","last_deep_scrub_stamp":"2026-02-23T06:51:57.785932+0000","last_clean_scrub_stamp":"2026-02-23T06:51:57.785932+0000","objects_scrubbed":0,"log_size":1598,"log_dups_size":0,"ondisk_log_size":1598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:04.787137+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18683,"num_write_kb":1083504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'19","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:50.507226+0000","last_change":"2026-02-23T06:51:50.507226+0000","last_active":"2026-02-23T06:51:50.507226+0000","last_peered":"2026-02-23T06:51:50.507226+0000","last_clean":"2026-02-23T06:51:50.507226+0000","last_became_active":"2026-02-23T06:21:18.141363+0000","last_became_peered":"2026-02-23T06:21:18.141363+0000","last_unstale":"2026-02-23T06:51:50.507226+0000","last_undegraded":"2026-02-23T06:51:50.507226+0000","last_fullsized":"2026-02-23T06:51:50.507226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2026-02-23T06:51:50.507144+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2026-02-23T06:51:50.507144+0000","last_clean_scrub_stamp":"2026-02-23T06:51:50.507144+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:36:39.585200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:54.171806+0000","last_change":"2026-02-23T06:51:54.171806+0000","last_active":"2026-02-23T06:51:54.171806+0000","last_peered":"2026-02-23T06:51:54.171806+0000","last_clean":"2026-02-23T06:51:54.171806+0000","last_became_active":"2026-02-23T06:21:17.144515+0000","last_became_peered":"2026-02-23T06:21:17.144515+0000","last_unstale":"2026-02-23T06:51:54.171806+0000","last_undegraded":"2026-02-23T06:51:54.171806+0000","last_fullsized":"2026-02-23T06:51:54.171806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2026-02-23T06:51:54.171758+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2026-02-23T06:51:54.171758+0000","last_clean_scrub_stamp":"2026-02-23T06:51:54.171758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:20:56.193628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'2041","reported_seq":2082,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:56.535882+0000","last_change":"2026-02-23T06:51:56.535882+0000","last_active":"2026-02-23T06:51:56.535882+0000","last_peered":"2026-02-23T06:51:56.535882+0000","last_clean":"2026-02-23T06:51:56.535882+0000","last_became_active":"2026-02-23T06:21:22.171165+0000","last_became_peered":"2026-02-23T06:21:22.171165+0000","last_unstale":"2026-02-23T06:51:56.535882+0000","last_undegraded":"2026-02-23T06:51:56.535882+0000","last_fullsized":"2026-02-23T06:51:56.535882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2041","last_scrub_stamp":"2026-02-23T06:51:56.535845+0000","last_deep_scrub":"27'2041","last_deep_scrub_stamp":"2026-02-23T06:51:56.535845+0000","last_clean_scrub_stamp":"2026-02-23T06:51:56.535845+0000","objects_scrubbed":0,"log_size":2041,"log_dups_size":0,"ondisk_log_size":2041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:13:48.307561+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25015,"num_write_kb":1370848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'16","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.244222+0000","last_change":"2026-02-23T06:51:44.244222+0000","last_active":"2026-02-23T06:51:44.244222+0000","last_peered":"2026-02-23T06:51:44.244222+0000","last_clean":"2026-02-23T06:51:44.244222+0000","last_became_active":"2026-02-23T06:21:18.143585+0000","last_became_peered":"2026-02-23T06:21:18.143585+0000","last_unstale":"2026-02-23T06:51:44.244222+0000","last_undegraded":"2026-02-23T06:51:44.244222+0000","last_fullsized":"2026-02-23T06:51:44.244222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2026-02-23T06:51:44.244168+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2026-02-23T06:51:44.244168+0000","last_clean_scrub_stamp":"2026-02-23T06:51:44.244168+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:55:59.183203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:45.456526+0000","last_change":"2026-02-23T06:51:45.456526+0000","last_active":"2026-02-23T06:51:45.456526+0000","last_peered":"2026-02-23T06:51:45.456526+0000","last_clean":"2026-02-23T06:51:45.456526+0000","last_became_active":"2026-02-23T06:21:17.137386+0000","last_became_peered":"2026-02-23T06:21:17.137386+0000","last_unstale":"2026-02-23T06:51:45.456526+0000","last_undegraded":"2026-02-23T06:51:45.456526+0000","last_fullsized":"2026-02-23T06:51:45.456526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:51:45.456474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:51:45.456474+0000","last_clean_scrub_stamp":"2026-02-23T06:51:45.456474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:45:53.557202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'1858","reported_seq":1899,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:55.548434+0000","last_change":"2026-02-23T06:51:55.548434+0000","last_active":"2026-02-23T06:51:55.548434+0000","last_peered":"2026-02-23T06:51:55.548434+0000","last_clean":"2026-02-23T06:51:55.548434+0000","last_became_active":"2026-02-23T06:21:22.162891+0000","last_became_peered":"2026-02-23T06:21:22.162891+0000","last_unstale":"2026-02-23T06:51:55.548434+0000","last_undegraded":"2026-02-23T06:51:55.548434+0000","last_fullsized":"2026-02-23T06:51:55.548434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1858","last_scrub_stamp":"2026-02-23T06:51:55.548381+0000","last_deep_scrub":"27'1858","last_deep_scrub_stamp":"2026-02-23T06:51:55.548381+0000","last_clean_scrub_stamp":"2026-02-23T06:51:55.548381+0000","objects_scrubbed":0,"log_size":1858,"log_dups_size":0,"ondisk_log_size":1858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:28:20.371419+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22843,"num_write_kb":1167007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'16","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:48.071272+0000","last_change":"2026-02-23T06:51:48.071272+0000","last_active":"2026-02-23T06:51:48.071272+0000","last_peered":"2026-02-23T06:51:48.071272+0000","last_clean":"2026-02-23T06:51:48.071272+0000","last_became_active":"2026-02-23T06:21:18.152102+0000","last_became_peered":"2026-02-23T06:21:18.152102+0000","last_unstale":"2026-02-23T06:51:48.071272+0000","last_undegraded":"2026-02-23T06:51:48.071272+0000","last_fullsized":"2026-02-23T06:51:48.071272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2026-02-23T06:51:48.071239+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2026-02-23T06:51:48.071239+0000","last_clean_scrub_stamp":"2026-02-23T06:51:48.071239+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:54:16.518384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:48.163161+0000","last_change":"2026-02-23T06:51:48.163161+0000","last_active":"2026-02-23T06:51:48.163161+0000","last_peered":"2026-02-23T06:51:48.163161+0000","last_clean":"2026-02-23T06:51:48.163161+0000","last_became_active":"2026-02-23T06:21:17.143201+0000","last_became_peered":"2026-02-23T06:21:17.143201+0000","last_unstale":"2026-02-23T06:51:48.163161+0000","last_undegraded":"2026-02-23T06:51:48.163161+0000","last_fullsized":"2026-02-23T06:51:48.163161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:51:48.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:51:48.163119+0000","last_clean_scrub_stamp":"2026-02-23T06:51:48.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:11:31.231663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'1993","reported_seq":2034,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:58.595693+0000","last_change":"2026-02-23T06:51:58.595693+0000","last_active":"2026-02-23T06:51:58.595693+0000","last_peered":"2026-02-23T06:51:58.595693+0000","last_clean":"2026-02-23T06:51:58.595693+0000","last_became_active":"2026-02-23T06:21:22.163734+0000","last_became_peered":"2026-02-23T06:21:22.163734+0000","last_unstale":"2026-02-23T06:51:58.595693+0000","last_undegraded":"2026-02-23T06:51:58.595693+0000","last_fullsized":"2026-02-23T06:51:58.595693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1993","last_scrub_stamp":"2026-02-23T06:51:58.595663+0000","last_deep_scrub":"27'1993","last_deep_scrub_stamp":"2026-02-23T06:51:58.595663+0000","last_clean_scrub_stamp":"2026-02-23T06:51:58.595663+0000","objects_scrubbed":0,"log_size":1993,"log_dups_size":0,"ondisk_log_size":1993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:35:47.427464+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24426,"num_write_kb":1329645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'24","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:50.542466+0000","last_change":"2026-02-23T06:51:50.542466+0000","last_active":"2026-02-23T06:51:50.542466+0000","last_peered":"2026-02-23T06:51:50.542466+0000","last_clean":"2026-02-23T06:51:50.542466+0000","last_became_active":"2026-02-23T06:21:18.141350+0000","last_became_peered":"2026-02-23T06:21:18.141350+0000","last_unstale":"2026-02-23T06:51:50.542466+0000","last_undegraded":"2026-02-23T06:51:50.542466+0000","last_fullsized":"2026-02-23T06:51:50.542466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2026-02-23T06:51:50.542430+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2026-02-23T06:51:50.542430+0000","last_clean_scrub_stamp":"2026-02-23T06:51:50.542430+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:33:47.382917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'33","reported_seq":114,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:46.136187+0000","last_change":"2026-02-23T06:51:46.136187+0000","last_active":"2026-02-23T06:51:46.136187+0000","last_peered":"2026-02-23T06:51:46.136187+0000","last_clean":"2026-02-23T06:51:46.136187+0000","last_became_active":"2026-02-23T06:21:17.139200+0000","last_became_peered":"2026-02-23T06:21:17.139200+0000","last_unstale":"2026-02-23T06:51:46.136187+0000","last_undegraded":"2026-02-23T06:51:46.136187+0000","last_fullsized":"2026-02-23T06:51:46.136187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2026-02-23T06:51:46.136156+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2026-02-23T06:51:46.136156+0000","last_clean_scrub_stamp":"2026-02-23T06:51:46.136156+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:16:51.413322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82634,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":104,"num_write":32,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'1776","reported_seq":1817,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:57.577597+0000","last_change":"2026-02-23T06:51:57.577597+0000","last_active":"2026-02-23T06:51:57.577597+0000","last_peered":"2026-02-23T06:51:57.577597+0000","last_clean":"2026-02-23T06:51:57.577597+0000","last_became_active":"2026-02-23T06:21:22.164667+0000","last_became_peered":"2026-02-23T06:21:22.164667+0000","last_unstale":"2026-02-23T06:51:57.577597+0000","last_undegraded":"2026-02-23T06:51:57.577597+0000","last_fullsized":"2026-02-23T06:51:57.577597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1776","last_scrub_stamp":"2026-02-23T06:51:57.577449+0000","last_deep_scrub":"27'1776","last_deep_scrub_stamp":"2026-02-23T06:51:57.577449+0000","last_clean_scrub_stamp":"2026-02-23T06:51:57.577449+0000","objects_scrubbed":0,"log_size":1776,"log_dups_size":0,"ondisk_log_size":1776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:17:29.865112+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22128,"num_write_kb":1081444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'12","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:48.557722+0000","last_change":"2026-02-23T06:51:48.557722+0000","last_active":"2026-02-23T06:51:48.557722+0000","last_peered":"2026-02-23T06:51:48.557722+0000","last_clean":"2026-02-23T06:51:48.557722+0000","last_became_active":"2026-02-23T06:21:18.146491+0000","last_became_peered":"2026-02-23T06:21:18.146491+0000","last_unstale":"2026-02-23T06:51:48.557722+0000","last_undegraded":"2026-02-23T06:51:48.557722+0000","last_fullsized":"2026-02-23T06:51:48.557722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2026-02-23T06:51:48.557683+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2026-02-23T06:51:48.557683+0000","last_clean_scrub_stamp":"2026-02-23T06:51:48.557683+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:46:43.720194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'5","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.210074+0000","last_change":"2026-02-23T06:51:44.210074+0000","last_active":"2026-02-23T06:51:44.210074+0000","last_peered":"2026-02-23T06:51:44.210074+0000","last_clean":"2026-02-23T06:51:44.210074+0000","last_became_active":"2026-02-23T06:21:17.143050+0000","last_became_peered":"2026-02-23T06:21:17.143050+0000","last_unstale":"2026-02-23T06:51:44.210074+0000","last_undegraded":"2026-02-23T06:51:44.210074+0000","last_fullsized":"2026-02-23T06:51:44.210074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2026-02-23T06:51:44.210030+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2026-02-23T06:51:44.210030+0000","last_clean_scrub_stamp":"2026-02-23T06:51:44.210030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:34:15.364761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'1711","reported_seq":1752,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:52:00.669576+0000","last_change":"2026-02-23T06:52:00.669576+0000","last_active":"2026-02-23T06:52:00.669576+0000","last_peered":"2026-02-23T06:52:00.669576+0000","last_clean":"2026-02-23T06:52:00.669576+0000","last_became_active":"2026-02-23T06:21:22.168510+0000","last_became_peered":"2026-02-23T06:21:22.168510+0000","last_unstale":"2026-02-23T06:52:00.669576+0000","last_undegraded":"2026-02-23T06:52:00.669576+0000","last_fullsized":"2026-02-23T06:52:00.669576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1711","last_scrub_stamp":"2026-02-23T06:52:00.669542+0000","last_deep_scrub":"27'1711","last_deep_scrub_stamp":"2026-02-23T06:52:00.669542+0000","last_clean_scrub_stamp":"2026-02-23T06:52:00.669542+0000","objects_scrubbed":0,"log_size":1711,"log_dups_size":0,"ondisk_log_size":1711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:51:30.193026+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20193,"num_write_kb":1220870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'13","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:47.877294+0000","last_change":"2026-02-23T06:51:47.877294+0000","last_active":"2026-02-23T06:51:47.877294+0000","last_peered":"2026-02-23T06:51:47.877294+0000","last_clean":"2026-02-23T06:51:47.877294+0000","last_became_active":"2026-02-23T06:21:18.145214+0000","last_became_peered":"2026-02-23T06:21:18.145214+0000","last_unstale":"2026-02-23T06:51:47.877294+0000","last_undegraded":"2026-02-23T06:51:47.877294+0000","last_fullsized":"2026-02-23T06:51:47.877294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2026-02-23T06:51:47.877220+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2026-02-23T06:51:47.877220+0000","last_clean_scrub_stamp":"2026-02-23T06:51:47.877220+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:15:11.644573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'2","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:50.147326+0000","last_change":"2026-02-23T06:51:50.147326+0000","last_active":"2026-02-23T06:51:50.147326+0000","last_peered":"2026-02-23T06:51:50.147326+0000","last_clean":"2026-02-23T06:51:50.147326+0000","last_became_active":"2026-02-23T06:21:17.147619+0000","last_became_peered":"2026-02-23T06:21:17.147619+0000","last_unstale":"2026-02-23T06:51:50.147326+0000","last_undegraded":"2026-02-23T06:51:50.147326+0000","last_fullsized":"2026-02-23T06:51:50.147326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2026-02-23T06:51:50.147279+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2026-02-23T06:51:50.147279+0000","last_clean_scrub_stamp":"2026-02-23T06:51:50.147279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:23:54.754439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'114","reported_seq":193,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:43.646452+0000","last_change":"2026-02-23T06:51:43.646452+0000","last_active":"2026-02-23T06:51:43.646452+0000","last_peered":"2026-02-23T06:51:43.646452+0000","last_clean":"2026-02-23T06:51:43.646452+0000","last_became_active":"2026-02-23T06:21:11.397664+0000","last_became_peered":"2026-02-23T06:21:11.397664+0000","last_unstale":"2026-02-23T06:51:43.646452+0000","last_undegraded":"2026-02-23T06:51:43.646452+0000","last_fullsized":"2026-02-23T06:51:43.646452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'114","last_scrub_stamp":"2026-02-23T06:51:43.646193+0000","last_deep_scrub":"27'114","last_deep_scrub_stamp":"2026-02-23T06:51:43.646193+0000","last_clean_scrub_stamp":"2026-02-23T06:51:43.646193+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:33:02.284722+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'1620","reported_seq":1661,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:52:04.038295+0000","last_change":"2026-02-23T06:52:04.038295+0000","last_active":"2026-02-23T06:52:04.038295+0000","last_peered":"2026-02-23T06:52:04.038295+0000","last_clean":"2026-02-23T06:52:04.038295+0000","last_became_active":"2026-02-23T06:21:22.174253+0000","last_became_peered":"2026-02-23T06:21:22.174253+0000","last_unstale":"2026-02-23T06:52:04.038295+0000","last_undegraded":"2026-02-23T06:52:04.038295+0000","last_fullsized":"2026-02-23T06:52:04.038295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1620","last_scrub_stamp":"2026-02-23T06:52:04.038259+0000","last_deep_scrub":"27'1620","last_deep_scrub_stamp":"2026-02-23T06:52:04.038259+0000","last_clean_scrub_stamp":"2026-02-23T06:52:04.038259+0000","objects_scrubbed":0,"log_size":1620,"log_dups_size":0,"ondisk_log_size":1620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:07:15.012531+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19229,"num_write_kb":1122014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'18","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:49.114438+0000","last_change":"2026-02-23T06:51:49.114438+0000","last_active":"2026-02-23T06:51:49.114438+0000","last_peered":"2026-02-23T06:51:49.114438+0000","last_clean":"2026-02-23T06:51:49.114438+0000","last_became_active":"2026-02-23T06:21:18.150501+0000","last_became_peered":"2026-02-23T06:21:18.150501+0000","last_unstale":"2026-02-23T06:51:49.114438+0000","last_undegraded":"2026-02-23T06:51:49.114438+0000","last_fullsized":"2026-02-23T06:51:49.114438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2026-02-23T06:51:49.114411+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2026-02-23T06:51:49.114411+0000","last_clean_scrub_stamp":"2026-02-23T06:51:49.114411+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:11:26.246425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:45.506894+0000","last_change":"2026-02-23T06:51:45.506894+0000","last_active":"2026-02-23T06:51:45.506894+0000","last_peered":"2026-02-23T06:51:45.506894+0000","last_clean":"2026-02-23T06:51:45.506894+0000","last_became_active":"2026-02-23T06:21:17.145938+0000","last_became_peered":"2026-02-23T06:21:17.145938+0000","last_unstale":"2026-02-23T06:51:45.506894+0000","last_undegraded":"2026-02-23T06:51:45.506894+0000","last_fullsized":"2026-02-23T06:51:45.506894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2026-02-23T06:51:45.506851+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2026-02-23T06:51:45.506851+0000","last_clean_scrub_stamp":"2026-02-23T06:51:45.506851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:17.525225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'1607","reported_seq":1648,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:51.242055+0000","last_change":"2026-02-23T06:51:51.242055+0000","last_active":"2026-02-23T06:51:51.242055+0000","last_peered":"2026-02-23T06:51:51.242055+0000","last_clean":"2026-02-23T06:51:51.242055+0000","last_became_active":"2026-02-23T06:21:22.171828+0000","last_became_peered":"2026-02-23T06:21:22.171828+0000","last_unstale":"2026-02-23T06:51:51.242055+0000","last_undegraded":"2026-02-23T06:51:51.242055+0000","last_fullsized":"2026-02-23T06:51:51.242055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1607","last_scrub_stamp":"2026-02-23T06:51:51.242019+0000","last_deep_scrub":"27'1607","last_deep_scrub_stamp":"2026-02-23T06:51:51.242019+0000","last_clean_scrub_stamp":"2026-02-23T06:51:51.242019+0000","objects_scrubbed":0,"log_size":1607,"log_dups_size":0,"ondisk_log_size":1607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:25:49.522299+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19213,"num_write_kb":1080158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'19","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:51.118812+0000","last_change":"2026-02-23T06:51:51.118812+0000","last_active":"2026-02-23T06:51:51.118812+0000","last_peered":"2026-02-23T06:51:51.118812+0000","last_clean":"2026-02-23T06:51:51.118812+0000","last_became_active":"2026-02-23T06:21:18.146977+0000","last_became_peered":"2026-02-23T06:21:18.146977+0000","last_unstale":"2026-02-23T06:51:51.118812+0000","last_undegraded":"2026-02-23T06:51:51.118812+0000","last_fullsized":"2026-02-23T06:51:51.118812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2026-02-23T06:51:51.118774+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2026-02-23T06:51:51.118774+0000","last_clean_scrub_stamp":"2026-02-23T06:51:51.118774+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:05.146333+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'5","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:46.503161+0000","last_change":"2026-02-23T06:51:46.503161+0000","last_active":"2026-02-23T06:51:46.503161+0000","last_peered":"2026-02-23T06:51:46.503161+0000","last_clean":"2026-02-23T06:51:46.503161+0000","last_became_active":"2026-02-23T06:21:17.139209+0000","last_became_peered":"2026-02-23T06:21:17.139209+0000","last_unstale":"2026-02-23T06:51:46.503161+0000","last_undegraded":"2026-02-23T06:51:46.503161+0000","last_fullsized":"2026-02-23T06:51:46.503161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2026-02-23T06:51:46.503113+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2026-02-23T06:51:46.503113+0000","last_clean_scrub_stamp":"2026-02-23T06:51:46.503113+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:14:20.858888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'2329","reported_seq":2369,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:52:01.711102+0000","last_change":"2026-02-23T06:52:01.711102+0000","last_active":"2026-02-23T06:52:01.711102+0000","last_peered":"2026-02-23T06:52:01.711102+0000","last_clean":"2026-02-23T06:52:01.711102+0000","last_became_active":"2026-02-23T06:21:22.162777+0000","last_became_peered":"2026-02-23T06:21:22.162777+0000","last_unstale":"2026-02-23T06:52:01.711102+0000","last_undegraded":"2026-02-23T06:52:01.711102+0000","last_fullsized":"2026-02-23T06:52:01.711102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2329","last_scrub_stamp":"2026-02-23T06:52:01.711052+0000","last_deep_scrub":"27'2329","last_deep_scrub_stamp":"2026-02-23T06:52:01.711052+0000","last_clean_scrub_stamp":"2026-02-23T06:52:01.711052+0000","objects_scrubbed":0,"log_size":2329,"log_dups_size":0,"ondisk_log_size":2329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:04:43.453469+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28609,"num_write_kb":1525996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'20","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:50.069021+0000","last_change":"2026-02-23T06:51:50.069021+0000","last_active":"2026-02-23T06:51:50.069021+0000","last_peered":"2026-02-23T06:51:50.069021+0000","last_clean":"2026-02-23T06:51:50.069021+0000","last_became_active":"2026-02-23T06:21:18.149038+0000","last_became_peered":"2026-02-23T06:21:18.149038+0000","last_unstale":"2026-02-23T06:51:50.069021+0000","last_undegraded":"2026-02-23T06:51:50.069021+0000","last_fullsized":"2026-02-23T06:51:50.069021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2026-02-23T06:51:50.068980+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2026-02-23T06:51:50.068980+0000","last_clean_scrub_stamp":"2026-02-23T06:51:50.068980+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:33:38.653012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'6","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:49.898828+0000","last_change":"2026-02-23T06:51:49.898828+0000","last_active":"2026-02-23T06:51:49.898828+0000","last_peered":"2026-02-23T06:51:49.898828+0000","last_clean":"2026-02-23T06:51:49.898828+0000","last_became_active":"2026-02-23T06:21:17.137476+0000","last_became_peered":"2026-02-23T06:21:17.137476+0000","last_unstale":"2026-02-23T06:51:49.898828+0000","last_undegraded":"2026-02-23T06:51:49.898828+0000","last_fullsized":"2026-02-23T06:51:49.898828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2026-02-23T06:51:49.898794+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2026-02-23T06:51:49.898794+0000","last_clean_scrub_stamp":"2026-02-23T06:51:49.898794+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:41:35.053874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'1646","reported_seq":1679,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.149858+0000","last_change":"2026-02-23T06:21:22.174081+0000","last_active":"2026-02-23T06:51:44.149858+0000","last_peered":"2026-02-23T06:51:44.149858+0000","last_clean":"2026-02-23T06:51:44.149858+0000","last_became_active":"2026-02-23T06:21:22.173501+0000","last_became_peered":"2026-02-23T06:21:22.173501+0000","last_unstale":"2026-02-23T06:51:44.149858+0000","last_undegraded":"2026-02-23T06:51:44.149858+0000","last_fullsized":"2026-02-23T06:51:44.149858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":1646,"log_dups_size":0,"ondisk_log_size":1646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20219,"num_write_kb":1002716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'12","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:45.281560+0000","last_change":"2026-02-23T06:51:45.281560+0000","last_active":"2026-02-23T06:51:45.281560+0000","last_peered":"2026-02-23T06:51:45.281560+0000","last_clean":"2026-02-23T06:51:45.281560+0000","last_became_active":"2026-02-23T06:21:18.154271+0000","last_became_peered":"2026-02-23T06:21:18.154271+0000","last_unstale":"2026-02-23T06:51:45.281560+0000","last_undegraded":"2026-02-23T06:51:45.281560+0000","last_fullsized":"2026-02-23T06:51:45.281560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2026-02-23T06:51:45.281522+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2026-02-23T06:51:45.281522+0000","last_clean_scrub_stamp":"2026-02-23T06:51:45.281522+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:21:47.810451+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.037316+0000","last_change":"2026-02-23T06:51:44.037316+0000","last_active":"2026-02-23T06:51:44.037316+0000","last_peered":"2026-02-23T06:51:44.037316+0000","last_clean":"2026-02-23T06:51:44.037316+0000","last_became_active":"2026-02-23T06:21:17.144914+0000","last_became_peered":"2026-02-23T06:21:17.144914+0000","last_unstale":"2026-02-23T06:51:44.037316+0000","last_undegraded":"2026-02-23T06:51:44.037316+0000","last_fullsized":"2026-02-23T06:51:44.037316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2026-02-23T06:51:44.037272+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2026-02-23T06:51:44.037272+0000","last_clean_scrub_stamp":"2026-02-23T06:51:44.037272+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:57:15.925199+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'1740","reported_seq":1781,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:50.714103+0000","last_change":"2026-02-23T06:51:50.714103+0000","last_active":"2026-02-23T06:51:50.714103+0000","last_peered":"2026-02-23T06:51:50.714103+0000","last_clean":"2026-02-23T06:51:50.714103+0000","last_became_active":"2026-02-23T06:21:22.168516+0000","last_became_peered":"2026-02-23T06:21:22.168516+0000","last_unstale":"2026-02-23T06:51:50.714103+0000","last_undegraded":"2026-02-23T06:51:50.714103+0000","last_fullsized":"2026-02-23T06:51:50.714103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1740","last_scrub_stamp":"2026-02-23T06:51:50.714061+0000","last_deep_scrub":"27'1740","last_deep_scrub_stamp":"2026-02-23T06:51:50.714061+0000","last_clean_scrub_stamp":"2026-02-23T06:51:50.714061+0000","objects_scrubbed":0,"log_size":1740,"log_dups_size":0,"ondisk_log_size":1740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:17:42.058319+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20956,"num_write_kb":1166144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'20","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:47.157767+0000","last_change":"2026-02-23T06:51:47.157767+0000","last_active":"2026-02-23T06:51:47.157767+0000","last_peered":"2026-02-23T06:51:47.157767+0000","last_clean":"2026-02-23T06:51:47.157767+0000","last_became_active":"2026-02-23T06:21:18.152381+0000","last_became_peered":"2026-02-23T06:21:18.152381+0000","last_unstale":"2026-02-23T06:51:47.157767+0000","last_undegraded":"2026-02-23T06:51:47.157767+0000","last_fullsized":"2026-02-23T06:51:47.157767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2026-02-23T06:51:47.157728+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2026-02-23T06:51:47.157728+0000","last_clean_scrub_stamp":"2026-02-23T06:51:47.157728+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:44:21.145745+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'17","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:45.873384+0000","last_change":"2026-02-23T06:51:45.873384+0000","last_active":"2026-02-23T06:51:45.873384+0000","last_peered":"2026-02-23T06:51:45.873384+0000","last_clean":"2026-02-23T06:51:45.873384+0000","last_became_active":"2026-02-23T06:21:17.137101+0000","last_became_peered":"2026-02-23T06:21:17.137101+0000","last_unstale":"2026-02-23T06:51:45.873384+0000","last_undegraded":"2026-02-23T06:51:45.873384+0000","last_fullsized":"2026-02-23T06:51:45.873384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2026-02-23T06:51:45.873346+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2026-02-23T06:51:45.873346+0000","last_clean_scrub_stamp":"2026-02-23T06:51:45.873346+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:08:14.272959+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'2377","reported_seq":2408,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.017364+0000","last_change":"2026-02-23T06:21:22.168965+0000","last_active":"2026-02-23T06:51:44.017364+0000","last_peered":"2026-02-23T06:51:44.017364+0000","last_clean":"2026-02-23T06:51:44.017364+0000","last_became_active":"2026-02-23T06:21:22.168603+0000","last_became_peered":"2026-02-23T06:21:22.168603+0000","last_unstale":"2026-02-23T06:51:44.017364+0000","last_undegraded":"2026-02-23T06:51:44.017364+0000","last_fullsized":"2026-02-23T06:51:44.017364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2377,"log_dups_size":0,"ondisk_log_size":2377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:15:47.100236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30335,"num_write_kb":1393408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'17","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.674085+0000","last_change":"2026-02-23T06:51:44.674085+0000","last_active":"2026-02-23T06:51:44.674085+0000","last_peered":"2026-02-23T06:51:44.674085+0000","last_clean":"2026-02-23T06:51:44.674085+0000","last_became_active":"2026-02-23T06:21:18.143002+0000","last_became_peered":"2026-02-23T06:21:18.143002+0000","last_unstale":"2026-02-23T06:51:44.674085+0000","last_undegraded":"2026-02-23T06:51:44.674085+0000","last_fullsized":"2026-02-23T06:51:44.674085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2026-02-23T06:51:44.674037+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2026-02-23T06:51:44.674037+0000","last_clean_scrub_stamp":"2026-02-23T06:51:44.674037+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:59:51.296873+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'3","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:49.049082+0000","last_change":"2026-02-23T06:51:49.049082+0000","last_active":"2026-02-23T06:51:49.049082+0000","last_peered":"2026-02-23T06:51:49.049082+0000","last_clean":"2026-02-23T06:51:49.049082+0000","last_became_active":"2026-02-23T06:21:17.143700+0000","last_became_peered":"2026-02-23T06:21:17.143700+0000","last_unstale":"2026-02-23T06:51:49.049082+0000","last_undegraded":"2026-02-23T06:51:49.049082+0000","last_fullsized":"2026-02-23T06:51:49.049082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2026-02-23T06:51:49.049053+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2026-02-23T06:51:49.049053+0000","last_clean_scrub_stamp":"2026-02-23T06:51:49.049053+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:45:35.204711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'2195","reported_seq":2234,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:52:03.772723+0000","last_change":"2026-02-23T06:52:03.772723+0000","last_active":"2026-02-23T06:52:03.772723+0000","last_peered":"2026-02-23T06:52:03.772723+0000","last_clean":"2026-02-23T06:52:03.772723+0000","last_became_active":"2026-02-23T06:21:22.168593+0000","last_became_peered":"2026-02-23T06:21:22.168593+0000","last_unstale":"2026-02-23T06:52:03.772723+0000","last_undegraded":"2026-02-23T06:52:03.772723+0000","last_fullsized":"2026-02-23T06:52:03.772723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2195","last_scrub_stamp":"2026-02-23T06:52:03.772681+0000","last_deep_scrub":"27'2195","last_deep_scrub_stamp":"2026-02-23T06:52:03.772681+0000","last_clean_scrub_stamp":"2026-02-23T06:52:03.772681+0000","objects_scrubbed":0,"log_size":2195,"log_dups_size":0,"ondisk_log_size":2195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:58:07.568079+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27217,"num_write_kb":1335474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'32","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:58.152570+0000","last_change":"2026-02-23T06:51:58.152570+0000","last_active":"2026-02-23T06:51:58.152570+0000","last_peered":"2026-02-23T06:51:58.152570+0000","last_clean":"2026-02-23T06:51:58.152570+0000","last_became_active":"2026-02-23T06:21:18.155022+0000","last_became_peered":"2026-02-23T06:21:18.155022+0000","last_unstale":"2026-02-23T06:51:58.152570+0000","last_undegraded":"2026-02-23T06:51:58.152570+0000","last_fullsized":"2026-02-23T06:51:58.152570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'32","last_scrub_stamp":"2026-02-23T06:51:58.152543+0000","last_deep_scrub":"27'32","last_deep_scrub_stamp":"2026-02-23T06:51:58.152543+0000","last_clean_scrub_stamp":"2026-02-23T06:51:58.152543+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:23:20.015255+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:52.131472+0000","last_change":"2026-02-23T06:51:52.131472+0000","last_active":"2026-02-23T06:51:52.131472+0000","last_peered":"2026-02-23T06:51:52.131472+0000","last_clean":"2026-02-23T06:51:52.131472+0000","last_became_active":"2026-02-23T06:21:17.144052+0000","last_became_peered":"2026-02-23T06:21:17.144052+0000","last_unstale":"2026-02-23T06:51:52.131472+0000","last_undegraded":"2026-02-23T06:51:52.131472+0000","last_fullsized":"2026-02-23T06:51:52.131472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2026-02-23T06:51:52.131443+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2026-02-23T06:51:52.131443+0000","last_clean_scrub_stamp":"2026-02-23T06:51:52.131443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:01:55.188151+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'1820","reported_seq":1861,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:59.638190+0000","last_change":"2026-02-23T06:51:59.638190+0000","last_active":"2026-02-23T06:51:59.638190+0000","last_peered":"2026-02-23T06:51:59.638190+0000","last_clean":"2026-02-23T06:51:59.638190+0000","last_became_active":"2026-02-23T06:21:22.163563+0000","last_became_peered":"2026-02-23T06:21:22.163563+0000","last_unstale":"2026-02-23T06:51:59.638190+0000","last_undegraded":"2026-02-23T06:51:59.638190+0000","last_fullsized":"2026-02-23T06:51:59.638190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1820","last_scrub_stamp":"2026-02-23T06:51:59.638143+0000","last_deep_scrub":"27'1820","last_deep_scrub_stamp":"2026-02-23T06:51:59.638143+0000","last_clean_scrub_stamp":"2026-02-23T06:51:59.638143+0000","objects_scrubbed":0,"log_size":1820,"log_dups_size":0,"ondisk_log_size":1820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:42:57.145819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":3,"num_write":22577,"num_write_kb":1140198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'20","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:49.536522+0000","last_change":"2026-02-23T06:51:49.536522+0000","last_active":"2026-02-23T06:51:49.536522+0000","last_peered":"2026-02-23T06:51:49.536522+0000","last_clean":"2026-02-23T06:51:49.536522+0000","last_became_active":"2026-02-23T06:21:18.152627+0000","last_became_peered":"2026-02-23T06:21:18.152627+0000","last_unstale":"2026-02-23T06:51:49.536522+0000","last_undegraded":"2026-02-23T06:51:49.536522+0000","last_fullsized":"2026-02-23T06:51:49.536522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2026-02-23T06:51:49.536484+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2026-02-23T06:51:49.536484+0000","last_clean_scrub_stamp":"2026-02-23T06:51:49.536484+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:19:49.227979+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'5","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:47.176757+0000","last_change":"2026-02-23T06:51:47.176757+0000","last_active":"2026-02-23T06:51:47.176757+0000","last_peered":"2026-02-23T06:51:47.176757+0000","last_clean":"2026-02-23T06:51:47.176757+0000","last_became_active":"2026-02-23T06:21:17.144847+0000","last_became_peered":"2026-02-23T06:21:17.144847+0000","last_unstale":"2026-02-23T06:51:47.176757+0000","last_undegraded":"2026-02-23T06:51:47.176757+0000","last_fullsized":"2026-02-23T06:51:47.176757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2026-02-23T06:51:47.176712+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2026-02-23T06:51:47.176712+0000","last_clean_scrub_stamp":"2026-02-23T06:51:47.176712+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:15:58.908087+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5220,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'2267","reported_seq":2306,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:52:03.071819+0000","last_change":"2026-02-23T06:52:03.071819+0000","last_active":"2026-02-23T06:52:03.071819+0000","last_peered":"2026-02-23T06:52:03.071819+0000","last_clean":"2026-02-23T06:52:03.071819+0000","last_became_active":"2026-02-23T06:21:22.164057+0000","last_became_peered":"2026-02-23T06:21:22.164057+0000","last_unstale":"2026-02-23T06:52:03.071819+0000","last_undegraded":"2026-02-23T06:52:03.071819+0000","last_fullsized":"2026-02-23T06:52:03.071819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2267","last_scrub_stamp":"2026-02-23T06:52:03.071788+0000","last_deep_scrub":"27'2267","last_deep_scrub_stamp":"2026-02-23T06:52:03.071788+0000","last_clean_scrub_stamp":"2026-02-23T06:52:03.071788+0000","objects_scrubbed":0,"log_size":2267,"log_dups_size":0,"ondisk_log_size":2267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:08:04.120227+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27868,"num_write_kb":1432250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'15","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:53.122709+0000","last_change":"2026-02-23T06:51:53.122709+0000","last_active":"2026-02-23T06:51:53.122709+0000","last_peered":"2026-02-23T06:51:53.122709+0000","last_clean":"2026-02-23T06:51:53.122709+0000","last_became_active":"2026-02-23T06:21:18.147826+0000","last_became_peered":"2026-02-23T06:21:18.147826+0000","last_unstale":"2026-02-23T06:51:53.122709+0000","last_undegraded":"2026-02-23T06:51:53.122709+0000","last_fullsized":"2026-02-23T06:51:53.122709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2026-02-23T06:51:53.122648+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2026-02-23T06:51:53.122648+0000","last_clean_scrub_stamp":"2026-02-23T06:51:53.122648+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:45:29.659477+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'306","reported_seq":354,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:43.212787+0000","last_change":"2026-02-23T06:51:43.212761+0000","last_active":"2026-02-23T06:51:43.212787+0000","last_peered":"2026-02-23T06:51:43.212787+0000","last_clean":"2026-02-23T06:51:43.212787+0000","last_became_active":"2026-02-23T06:21:17.151030+0000","last_became_peered":"2026-02-23T06:21:17.151030+0000","last_unstale":"2026-02-23T06:51:43.212787+0000","last_undegraded":"2026-02-23T06:51:43.212787+0000","last_fullsized":"2026-02-23T06:51:43.212787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'306","last_scrub_stamp":"2026-02-23T06:51:43.212718+0000","last_deep_scrub":"27'306","last_deep_scrub_stamp":"2026-02-23T06:51:43.212718+0000","last_clean_scrub_stamp":"2026-02-23T06:51:43.212718+0000","objects_scrubbed":4,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:31:15.200482+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194998,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":300,"num_write_kb":4304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'1502","reported_seq":1542,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:55.807230+0000","last_change":"2026-02-23T06:51:55.807230+0000","last_active":"2026-02-23T06:51:55.807230+0000","last_peered":"2026-02-23T06:51:55.807230+0000","last_clean":"2026-02-23T06:51:55.807230+0000","last_became_active":"2026-02-23T06:21:22.164972+0000","last_became_peered":"2026-02-23T06:21:22.164972+0000","last_unstale":"2026-02-23T06:51:55.807230+0000","last_undegraded":"2026-02-23T06:51:55.807230+0000","last_fullsized":"2026-02-23T06:51:55.807230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1502","last_scrub_stamp":"2026-02-23T06:51:55.807192+0000","last_deep_scrub":"27'1502","last_deep_scrub_stamp":"2026-02-23T06:51:55.807192+0000","last_clean_scrub_stamp":"2026-02-23T06:51:55.807192+0000","objects_scrubbed":0,"log_size":1502,"log_dups_size":0,"ondisk_log_size":1502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:15:58.402337+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17024,"num_write_kb":1082863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'19","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.734112+0000","last_change":"2026-02-23T06:21:18.153296+0000","last_active":"2026-02-23T06:51:38.734112+0000","last_peered":"2026-02-23T06:51:38.734112+0000","last_clean":"2026-02-23T06:51:38.734112+0000","last_became_active":"2026-02-23T06:21:18.153052+0000","last_became_peered":"2026-02-23T06:21:18.153052+0000","last_unstale":"2026-02-23T06:51:38.734112+0000","last_undegraded":"2026-02-23T06:51:38.734112+0000","last_fullsized":"2026-02-23T06:51:38.734112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'23","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:51.300242+0000","last_change":"2026-02-23T06:51:51.300242+0000","last_active":"2026-02-23T06:51:51.300242+0000","last_peered":"2026-02-23T06:51:51.300242+0000","last_clean":"2026-02-23T06:51:51.300242+0000","last_became_active":"2026-02-23T06:21:17.137479+0000","last_became_peered":"2026-02-23T06:21:17.137479+0000","last_unstale":"2026-02-23T06:51:51.300242+0000","last_undegraded":"2026-02-23T06:51:51.300242+0000","last_fullsized":"2026-02-23T06:51:51.300242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2026-02-23T06:51:51.300112+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2026-02-23T06:51:51.300112+0000","last_clean_scrub_stamp":"2026-02-23T06:51:51.300112+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:24:33.430202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'2313","reported_seq":2353,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:55.373845+0000","last_change":"2026-02-23T06:51:55.373845+0000","last_active":"2026-02-23T06:51:55.373845+0000","last_peered":"2026-02-23T06:51:55.373845+0000","last_clean":"2026-02-23T06:51:55.373845+0000","last_became_active":"2026-02-23T06:21:22.175638+0000","last_became_peered":"2026-02-23T06:21:22.175638+0000","last_unstale":"2026-02-23T06:51:55.373845+0000","last_undegraded":"2026-02-23T06:51:55.373845+0000","last_fullsized":"2026-02-23T06:51:55.373845+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2313","last_scrub_stamp":"2026-02-23T06:51:55.373813+0000","last_deep_scrub":"27'2313","last_deep_scrub_stamp":"2026-02-23T06:51:55.373813+0000","last_clean_scrub_stamp":"2026-02-23T06:51:55.373813+0000","objects_scrubbed":0,"log_size":2313,"log_dups_size":0,"ondisk_log_size":2313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:09:21.145646+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28954,"num_write_kb":1359033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'23","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:49.506160+0000","last_change":"2026-02-23T06:51:49.506160+0000","last_active":"2026-02-23T06:51:49.506160+0000","last_peered":"2026-02-23T06:51:49.506160+0000","last_clean":"2026-02-23T06:51:49.506160+0000","last_became_active":"2026-02-23T06:21:18.155349+0000","last_became_peered":"2026-02-23T06:21:18.155349+0000","last_unstale":"2026-02-23T06:51:49.506160+0000","last_undegraded":"2026-02-23T06:51:49.506160+0000","last_fullsized":"2026-02-23T06:51:49.506160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2026-02-23T06:51:49.506125+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2026-02-23T06:51:49.506125+0000","last_clean_scrub_stamp":"2026-02-23T06:51:49.506125+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:28:11.183113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'1","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:47.116252+0000","last_change":"2026-02-23T06:51:47.116252+0000","last_active":"2026-02-23T06:51:47.116252+0000","last_peered":"2026-02-23T06:51:47.116252+0000","last_clean":"2026-02-23T06:51:47.116252+0000","last_became_active":"2026-02-23T06:21:17.148841+0000","last_became_peered":"2026-02-23T06:21:17.148841+0000","last_unstale":"2026-02-23T06:51:47.116252+0000","last_undegraded":"2026-02-23T06:51:47.116252+0000","last_fullsized":"2026-02-23T06:51:47.116252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2026-02-23T06:51:47.116200+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2026-02-23T06:51:47.116200+0000","last_clean_scrub_stamp":"2026-02-23T06:51:47.116200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:30:21.554125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'1771","reported_seq":1811,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:52.307135+0000","last_change":"2026-02-23T06:51:52.307135+0000","last_active":"2026-02-23T06:51:52.307135+0000","last_peered":"2026-02-23T06:51:52.307135+0000","last_clean":"2026-02-23T06:51:52.307135+0000","last_became_active":"2026-02-23T06:21:22.172683+0000","last_became_peered":"2026-02-23T06:21:22.172683+0000","last_unstale":"2026-02-23T06:51:52.307135+0000","last_undegraded":"2026-02-23T06:51:52.307135+0000","last_fullsized":"2026-02-23T06:51:52.307135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1771","last_scrub_stamp":"2026-02-23T06:51:52.307097+0000","last_deep_scrub":"27'1771","last_deep_scrub_stamp":"2026-02-23T06:51:52.307097+0000","last_clean_scrub_stamp":"2026-02-23T06:51:52.307097+0000","objects_scrubbed":0,"log_size":1771,"log_dups_size":0,"ondisk_log_size":1771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:03:33.362237+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21503,"num_write_kb":1135952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'23","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:49.266682+0000","last_change":"2026-02-23T06:51:49.266682+0000","last_active":"2026-02-23T06:51:49.266682+0000","last_peered":"2026-02-23T06:51:49.266682+0000","last_clean":"2026-02-23T06:51:49.266682+0000","last_became_active":"2026-02-23T06:21:18.154586+0000","last_became_peered":"2026-02-23T06:21:18.154586+0000","last_unstale":"2026-02-23T06:51:49.266682+0000","last_undegraded":"2026-02-23T06:51:49.266682+0000","last_fullsized":"2026-02-23T06:51:49.266682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2026-02-23T06:51:49.266653+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2026-02-23T06:51:49.266653+0000","last_clean_scrub_stamp":"2026-02-23T06:51:49.266653+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:55:37.419448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'4","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:47.691927+0000","last_change":"2026-02-23T06:51:47.691927+0000","last_active":"2026-02-23T06:51:47.691927+0000","last_peered":"2026-02-23T06:51:47.691927+0000","last_clean":"2026-02-23T06:51:47.691927+0000","last_became_active":"2026-02-23T06:21:17.140699+0000","last_became_peered":"2026-02-23T06:21:17.140699+0000","last_unstale":"2026-02-23T06:51:47.691927+0000","last_undegraded":"2026-02-23T06:51:47.691927+0000","last_fullsized":"2026-02-23T06:51:47.691927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2026-02-23T06:51:47.691876+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2026-02-23T06:51:47.691876+0000","last_clean_scrub_stamp":"2026-02-23T06:51:47.691876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:35:22.951973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'1912","reported_seq":1952,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:56.803918+0000","last_change":"2026-02-23T06:51:56.803918+0000","last_active":"2026-02-23T06:51:56.803918+0000","last_peered":"2026-02-23T06:51:56.803918+0000","last_clean":"2026-02-23T06:51:56.803918+0000","last_became_active":"2026-02-23T06:21:22.166204+0000","last_became_peered":"2026-02-23T06:21:22.166204+0000","last_unstale":"2026-02-23T06:51:56.803918+0000","last_undegraded":"2026-02-23T06:51:56.803918+0000","last_fullsized":"2026-02-23T06:51:56.803918+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1912","last_scrub_stamp":"2026-02-23T06:51:56.803887+0000","last_deep_scrub":"27'1912","last_deep_scrub_stamp":"2026-02-23T06:51:56.803887+0000","last_clean_scrub_stamp":"2026-02-23T06:51:56.803887+0000","objects_scrubbed":0,"log_size":1912,"log_dups_size":0,"ondisk_log_size":1912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:12:48.805799+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23461,"num_write_kb":1201520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'1927","reported_seq":1969,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:52:00.832032+0000","last_change":"2026-02-23T06:52:00.832032+0000","last_active":"2026-02-23T06:52:00.832032+0000","last_peered":"2026-02-23T06:52:00.832032+0000","last_clean":"2026-02-23T06:52:00.832032+0000","last_became_active":"2026-02-23T06:21:22.167217+0000","last_became_peered":"2026-02-23T06:21:22.167217+0000","last_unstale":"2026-02-23T06:52:00.832032+0000","last_undegraded":"2026-02-23T06:52:00.832032+0000","last_fullsized":"2026-02-23T06:52:00.832032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1927","last_scrub_stamp":"2026-02-23T06:52:00.831996+0000","last_deep_scrub":"27'1927","last_deep_scrub_stamp":"2026-02-23T06:52:00.831996+0000","last_clean_scrub_stamp":"2026-02-23T06:52:00.831996+0000","objects_scrubbed":0,"log_size":1927,"log_dups_size":0,"ondisk_log_size":1927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:14:11.293279+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23726,"num_write_kb":1252431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'22","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:54.834587+0000","last_change":"2026-02-23T06:51:54.834587+0000","last_active":"2026-02-23T06:51:54.834587+0000","last_peered":"2026-02-23T06:51:54.834587+0000","last_clean":"2026-02-23T06:51:54.834587+0000","last_became_active":"2026-02-23T06:21:18.145938+0000","last_became_peered":"2026-02-23T06:21:18.145938+0000","last_unstale":"2026-02-23T06:51:54.834587+0000","last_undegraded":"2026-02-23T06:51:54.834587+0000","last_fullsized":"2026-02-23T06:51:54.834587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2026-02-23T06:51:54.834549+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2026-02-23T06:51:54.834549+0000","last_clean_scrub_stamp":"2026-02-23T06:51:54.834549+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:57:30.191836+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'4","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:56.143285+0000","last_change":"2026-02-23T06:51:56.143285+0000","last_active":"2026-02-23T06:51:56.143285+0000","last_peered":"2026-02-23T06:51:56.143285+0000","last_clean":"2026-02-23T06:51:56.143285+0000","last_became_active":"2026-02-23T06:21:17.149490+0000","last_became_peered":"2026-02-23T06:21:17.149490+0000","last_unstale":"2026-02-23T06:51:56.143285+0000","last_undegraded":"2026-02-23T06:51:56.143285+0000","last_fullsized":"2026-02-23T06:51:56.143285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2026-02-23T06:51:56.143241+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2026-02-23T06:51:56.143241+0000","last_clean_scrub_stamp":"2026-02-23T06:51:56.143241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:26:16.867845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'2215","reported_seq":2248,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.144709+0000","last_change":"2026-02-23T06:21:22.175655+0000","last_active":"2026-02-23T06:51:44.144709+0000","last_peered":"2026-02-23T06:51:44.144709+0000","last_clean":"2026-02-23T06:51:44.144709+0000","last_became_active":"2026-02-23T06:21:22.174906+0000","last_became_peered":"2026-02-23T06:21:22.174906+0000","last_unstale":"2026-02-23T06:51:44.144709+0000","last_undegraded":"2026-02-23T06:51:44.144709+0000","last_fullsized":"2026-02-23T06:51:44.144709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:21.147043+0000","last_clean_scrub_stamp":"2026-02-23T06:21:21.147043+0000","objects_scrubbed":0,"log_size":2215,"log_dups_size":0,"ondisk_log_size":2215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27299,"num_write_kb":1403073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'24","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:51.508007+0000","last_change":"2026-02-23T06:51:51.508007+0000","last_active":"2026-02-23T06:51:51.508007+0000","last_peered":"2026-02-23T06:51:51.508007+0000","last_clean":"2026-02-23T06:51:51.508007+0000","last_became_active":"2026-02-23T06:21:18.142325+0000","last_became_peered":"2026-02-23T06:21:18.142325+0000","last_unstale":"2026-02-23T06:51:51.508007+0000","last_undegraded":"2026-02-23T06:51:51.508007+0000","last_fullsized":"2026-02-23T06:51:51.508007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2026-02-23T06:51:51.507975+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2026-02-23T06:51:51.507975+0000","last_clean_scrub_stamp":"2026-02-23T06:51:51.507975+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:45:35.717271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:47.515241+0000","last_change":"2026-02-23T06:51:47.515241+0000","last_active":"2026-02-23T06:51:47.515241+0000","last_peered":"2026-02-23T06:51:47.515241+0000","last_clean":"2026-02-23T06:51:47.515241+0000","last_became_active":"2026-02-23T06:21:17.146022+0000","last_became_peered":"2026-02-23T06:21:17.146022+0000","last_unstale":"2026-02-23T06:51:47.515241+0000","last_undegraded":"2026-02-23T06:51:47.515241+0000","last_fullsized":"2026-02-23T06:51:47.515241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:51:47.515200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:51:47.515200+0000","last_clean_scrub_stamp":"2026-02-23T06:51:47.515200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:46.296976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'4","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:55.182297+0000","last_change":"2026-02-23T06:51:55.182297+0000","last_active":"2026-02-23T06:51:55.182297+0000","last_peered":"2026-02-23T06:51:55.182297+0000","last_clean":"2026-02-23T06:51:55.182297+0000","last_became_active":"2026-02-23T06:21:17.148417+0000","last_became_peered":"2026-02-23T06:21:17.148417+0000","last_unstale":"2026-02-23T06:51:55.182297+0000","last_undegraded":"2026-02-23T06:51:55.182297+0000","last_fullsized":"2026-02-23T06:51:55.182297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2026-02-23T06:51:55.182259+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2026-02-23T06:51:55.182259+0000","last_clean_scrub_stamp":"2026-02-23T06:51:55.182259+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:35:51.836482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'20","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:53.860618+0000","last_change":"2026-02-23T06:51:53.860618+0000","last_active":"2026-02-23T06:51:53.860618+0000","last_peered":"2026-02-23T06:51:53.860618+0000","last_clean":"2026-02-23T06:51:53.860618+0000","last_became_active":"2026-02-23T06:21:18.152267+0000","last_became_peered":"2026-02-23T06:21:18.152267+0000","last_unstale":"2026-02-23T06:51:53.860618+0000","last_undegraded":"2026-02-23T06:51:53.860618+0000","last_fullsized":"2026-02-23T06:51:53.860618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2026-02-23T06:51:53.860589+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2026-02-23T06:51:53.860589+0000","last_clean_scrub_stamp":"2026-02-23T06:51:53.860589+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:04:50.172465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'1715","reported_seq":1754,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:59.815667+0000","last_change":"2026-02-23T06:51:59.815667+0000","last_active":"2026-02-23T06:51:59.815667+0000","last_peered":"2026-02-23T06:51:59.815667+0000","last_clean":"2026-02-23T06:51:59.815667+0000","last_became_active":"2026-02-23T06:21:22.158607+0000","last_became_peered":"2026-02-23T06:21:22.158607+0000","last_unstale":"2026-02-23T06:51:59.815667+0000","last_undegraded":"2026-02-23T06:51:59.815667+0000","last_fullsized":"2026-02-23T06:51:59.815667+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1715","last_scrub_stamp":"2026-02-23T06:51:59.815631+0000","last_deep_scrub":"27'1715","last_deep_scrub_stamp":"2026-02-23T06:51:59.815631+0000","last_clean_scrub_stamp":"2026-02-23T06:51:59.815631+0000","objects_scrubbed":0,"log_size":1715,"log_dups_size":0,"ondisk_log_size":1715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:22:14.432247+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20257,"num_write_kb":1221270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1153","reported_seq":1199,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:48.471053+0000","last_change":"2026-02-23T06:51:48.471053+0000","last_active":"2026-02-23T06:51:48.471053+0000","last_peered":"2026-02-23T06:51:48.471053+0000","last_clean":"2026-02-23T06:51:48.471053+0000","last_became_active":"2026-02-23T06:21:17.138245+0000","last_became_peered":"2026-02-23T06:21:17.138245+0000","last_unstale":"2026-02-23T06:51:48.471053+0000","last_undegraded":"2026-02-23T06:51:48.471053+0000","last_fullsized":"2026-02-23T06:51:48.471053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1153","last_scrub_stamp":"2026-02-23T06:51:48.471015+0000","last_deep_scrub":"27'1153","last_deep_scrub_stamp":"2026-02-23T06:51:48.471015+0000","last_clean_scrub_stamp":"2026-02-23T06:51:48.471015+0000","objects_scrubbed":1,"log_size":1153,"log_dups_size":0,"ondisk_log_size":1153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:53:31.299706+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1150,"num_write_kb":5073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'18","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:45.629722+0000","last_change":"2026-02-23T06:51:45.629722+0000","last_active":"2026-02-23T06:51:45.629722+0000","last_peered":"2026-02-23T06:51:45.629722+0000","last_clean":"2026-02-23T06:51:45.629722+0000","last_became_active":"2026-02-23T06:21:18.143550+0000","last_became_peered":"2026-02-23T06:21:18.143550+0000","last_unstale":"2026-02-23T06:51:45.629722+0000","last_undegraded":"2026-02-23T06:51:45.629722+0000","last_fullsized":"2026-02-23T06:51:45.629722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2026-02-23T06:51:45.629668+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2026-02-23T06:51:45.629668+0000","last_clean_scrub_stamp":"2026-02-23T06:51:45.629668+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:22:07.991817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'1861","reported_seq":1900,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:54.366768+0000","last_change":"2026-02-23T06:51:54.366768+0000","last_active":"2026-02-23T06:51:54.366768+0000","last_peered":"2026-02-23T06:51:54.366768+0000","last_clean":"2026-02-23T06:51:54.366768+0000","last_became_active":"2026-02-23T06:21:22.169432+0000","last_became_peered":"2026-02-23T06:21:22.169432+0000","last_unstale":"2026-02-23T06:51:54.366768+0000","last_undegraded":"2026-02-23T06:51:54.366768+0000","last_fullsized":"2026-02-23T06:51:54.366768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1861","last_scrub_stamp":"2026-02-23T06:51:54.366730+0000","last_deep_scrub":"27'1861","last_deep_scrub_stamp":"2026-02-23T06:51:54.366730+0000","last_clean_scrub_stamp":"2026-02-23T06:51:54.366730+0000","objects_scrubbed":0,"log_size":1861,"log_dups_size":0,"ondisk_log_size":1861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:05:57.802141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23058,"num_write_kb":1131314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'22","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:46.237207+0000","last_change":"2026-02-23T06:51:46.237207+0000","last_active":"2026-02-23T06:51:46.237207+0000","last_peered":"2026-02-23T06:51:46.237207+0000","last_clean":"2026-02-23T06:51:46.237207+0000","last_became_active":"2026-02-23T06:21:18.143724+0000","last_became_peered":"2026-02-23T06:21:18.143724+0000","last_unstale":"2026-02-23T06:51:46.237207+0000","last_undegraded":"2026-02-23T06:51:46.237207+0000","last_fullsized":"2026-02-23T06:51:46.237207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2026-02-23T06:51:46.237156+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2026-02-23T06:51:46.237156+0000","last_clean_scrub_stamp":"2026-02-23T06:51:46.237156+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:56:08.028995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'24","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:49.219551+0000","last_change":"2026-02-23T06:51:49.219551+0000","last_active":"2026-02-23T06:51:49.219551+0000","last_peered":"2026-02-23T06:51:49.219551+0000","last_clean":"2026-02-23T06:51:49.219551+0000","last_became_active":"2026-02-23T06:21:18.145325+0000","last_became_peered":"2026-02-23T06:21:18.145325+0000","last_unstale":"2026-02-23T06:51:49.219551+0000","last_undegraded":"2026-02-23T06:51:49.219551+0000","last_fullsized":"2026-02-23T06:51:49.219551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2026-02-23T06:51:49.219511+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2026-02-23T06:51:49.219511+0000","last_clean_scrub_stamp":"2026-02-23T06:51:49.219511+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:12:00.569024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'23","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:52:01.151386+0000","last_change":"2026-02-23T06:52:01.151386+0000","last_active":"2026-02-23T06:52:01.151386+0000","last_peered":"2026-02-23T06:52:01.151386+0000","last_clean":"2026-02-23T06:52:01.151386+0000","last_became_active":"2026-02-23T06:21:18.150738+0000","last_became_peered":"2026-02-23T06:21:18.150738+0000","last_unstale":"2026-02-23T06:52:01.151386+0000","last_undegraded":"2026-02-23T06:52:01.151386+0000","last_fullsized":"2026-02-23T06:52:01.151386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2026-02-23T06:52:01.151352+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2026-02-23T06:52:01.151352+0000","last_clean_scrub_stamp":"2026-02-23T06:52:01.151352+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:23:45.630853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'16","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:55.584403+0000","last_change":"2026-02-23T06:51:55.584403+0000","last_active":"2026-02-23T06:51:55.584403+0000","last_peered":"2026-02-23T06:51:55.584403+0000","last_clean":"2026-02-23T06:51:55.584403+0000","last_became_active":"2026-02-23T06:21:18.141484+0000","last_became_peered":"2026-02-23T06:21:18.141484+0000","last_unstale":"2026-02-23T06:51:55.584403+0000","last_undegraded":"2026-02-23T06:51:55.584403+0000","last_fullsized":"2026-02-23T06:51:55.584403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2026-02-23T06:51:55.584366+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2026-02-23T06:51:55.584366+0000","last_clean_scrub_stamp":"2026-02-23T06:51:55.584366+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:32:31.547683+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'14","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:51.541250+0000","last_change":"2026-02-23T06:51:51.541250+0000","last_active":"2026-02-23T06:51:51.541250+0000","last_peered":"2026-02-23T06:51:51.541250+0000","last_clean":"2026-02-23T06:51:51.541250+0000","last_became_active":"2026-02-23T06:21:18.148489+0000","last_became_peered":"2026-02-23T06:21:18.148489+0000","last_unstale":"2026-02-23T06:51:51.541250+0000","last_undegraded":"2026-02-23T06:51:51.541250+0000","last_fullsized":"2026-02-23T06:51:51.541250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2026-02-23T06:51:51.541196+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2026-02-23T06:51:51.541196+0000","last_clean_scrub_stamp":"2026-02-23T06:51:51.541196+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:00:32.165948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'15","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:53.562285+0000","last_change":"2026-02-23T06:51:53.562285+0000","last_active":"2026-02-23T06:51:53.562285+0000","last_peered":"2026-02-23T06:51:53.562285+0000","last_clean":"2026-02-23T06:51:53.562285+0000","last_became_active":"2026-02-23T06:21:18.141854+0000","last_became_peered":"2026-02-23T06:21:18.141854+0000","last_unstale":"2026-02-23T06:51:53.562285+0000","last_undegraded":"2026-02-23T06:51:53.562285+0000","last_fullsized":"2026-02-23T06:51:53.562285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2026-02-23T06:51:53.562208+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2026-02-23T06:51:53.562208+0000","last_clean_scrub_stamp":"2026-02-23T06:51:53.562208+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:19:13.109959+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'27","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:50.281289+0000","last_change":"2026-02-23T06:51:50.281289+0000","last_active":"2026-02-23T06:51:50.281289+0000","last_peered":"2026-02-23T06:51:50.281289+0000","last_clean":"2026-02-23T06:51:50.281289+0000","last_became_active":"2026-02-23T06:21:18.153133+0000","last_became_peered":"2026-02-23T06:21:18.153133+0000","last_unstale":"2026-02-23T06:51:50.281289+0000","last_undegraded":"2026-02-23T06:51:50.281289+0000","last_fullsized":"2026-02-23T06:51:50.281289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2026-02-23T06:51:50.281254+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2026-02-23T06:51:50.281254+0000","last_clean_scrub_stamp":"2026-02-23T06:51:50.281254+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:53:45.033871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'14","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:54.538307+0000","last_change":"2026-02-23T06:51:54.538307+0000","last_active":"2026-02-23T06:51:54.538307+0000","last_peered":"2026-02-23T06:51:54.538307+0000","last_clean":"2026-02-23T06:51:54.538307+0000","last_became_active":"2026-02-23T06:21:18.144832+0000","last_became_peered":"2026-02-23T06:21:18.144832+0000","last_unstale":"2026-02-23T06:51:54.538307+0000","last_undegraded":"2026-02-23T06:51:54.538307+0000","last_fullsized":"2026-02-23T06:51:54.538307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2026-02-23T06:51:54.538274+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2026-02-23T06:51:54.538274+0000","last_clean_scrub_stamp":"2026-02-23T06:51:54.538274+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:16:53.367747+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'19","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:57.119377+0000","last_change":"2026-02-23T06:51:57.119377+0000","last_active":"2026-02-23T06:51:57.119377+0000","last_peered":"2026-02-23T06:51:57.119377+0000","last_clean":"2026-02-23T06:51:57.119377+0000","last_became_active":"2026-02-23T06:21:18.150489+0000","last_became_peered":"2026-02-23T06:21:18.150489+0000","last_unstale":"2026-02-23T06:51:57.119377+0000","last_undegraded":"2026-02-23T06:51:57.119377+0000","last_fullsized":"2026-02-23T06:51:57.119377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2026-02-23T06:51:57.119340+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2026-02-23T06:51:57.119340+0000","last_clean_scrub_stamp":"2026-02-23T06:51:57.119340+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:11:46.696788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'22","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:56.601310+0000","last_change":"2026-02-23T06:51:56.601310+0000","last_active":"2026-02-23T06:51:56.601310+0000","last_peered":"2026-02-23T06:51:56.601310+0000","last_clean":"2026-02-23T06:51:56.601310+0000","last_became_active":"2026-02-23T06:21:18.143495+0000","last_became_peered":"2026-02-23T06:21:18.143495+0000","last_unstale":"2026-02-23T06:51:56.601310+0000","last_undegraded":"2026-02-23T06:51:56.601310+0000","last_fullsized":"2026-02-23T06:51:56.601310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2026-02-23T06:51:56.601285+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2026-02-23T06:51:56.601285+0000","last_clean_scrub_stamp":"2026-02-23T06:51:56.601285+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:08:26.792939+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'21","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:48.675961+0000","last_change":"2026-02-23T06:51:48.675961+0000","last_active":"2026-02-23T06:51:48.675961+0000","last_peered":"2026-02-23T06:51:48.675961+0000","last_clean":"2026-02-23T06:51:48.675961+0000","last_became_active":"2026-02-23T06:21:18.148701+0000","last_became_peered":"2026-02-23T06:21:18.148701+0000","last_unstale":"2026-02-23T06:51:48.675961+0000","last_undegraded":"2026-02-23T06:51:48.675961+0000","last_fullsized":"2026-02-23T06:51:48.675961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2026-02-23T06:51:48.675927+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2026-02-23T06:51:48.675927+0000","last_clean_scrub_stamp":"2026-02-23T06:51:48.675927+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:11:20.105420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'28","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:58.761417+0000","last_change":"2026-02-23T06:51:58.761417+0000","last_active":"2026-02-23T06:51:58.761417+0000","last_peered":"2026-02-23T06:51:58.761417+0000","last_clean":"2026-02-23T06:51:58.761417+0000","last_became_active":"2026-02-23T06:21:18.145346+0000","last_became_peered":"2026-02-23T06:21:18.145346+0000","last_unstale":"2026-02-23T06:51:58.761417+0000","last_undegraded":"2026-02-23T06:51:58.761417+0000","last_fullsized":"2026-02-23T06:51:58.761417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2026-02-23T06:51:58.761376+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2026-02-23T06:51:58.761376+0000","last_clean_scrub_stamp":"2026-02-23T06:51:58.761376+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:58:22.170877+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'21","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:55.154622+0000","last_change":"2026-02-23T06:51:55.154622+0000","last_active":"2026-02-23T06:51:55.154622+0000","last_peered":"2026-02-23T06:51:55.154622+0000","last_clean":"2026-02-23T06:51:55.154622+0000","last_became_active":"2026-02-23T06:21:18.147357+0000","last_became_peered":"2026-02-23T06:21:18.147357+0000","last_unstale":"2026-02-23T06:51:55.154622+0000","last_undegraded":"2026-02-23T06:51:55.154622+0000","last_fullsized":"2026-02-23T06:51:55.154622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2026-02-23T06:51:55.154572+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2026-02-23T06:51:55.154572+0000","last_clean_scrub_stamp":"2026-02-23T06:51:55.154572+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:48:17.721427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'19","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:52:00.124901+0000","last_change":"2026-02-23T06:52:00.124901+0000","last_active":"2026-02-23T06:52:00.124901+0000","last_peered":"2026-02-23T06:52:00.124901+0000","last_clean":"2026-02-23T06:52:00.124901+0000","last_became_active":"2026-02-23T06:21:18.151269+0000","last_became_peered":"2026-02-23T06:21:18.151269+0000","last_unstale":"2026-02-23T06:52:00.124901+0000","last_undegraded":"2026-02-23T06:52:00.124901+0000","last_fullsized":"2026-02-23T06:52:00.124901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2026-02-23T06:52:00.124857+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2026-02-23T06:52:00.124857+0000","last_clean_scrub_stamp":"2026-02-23T06:52:00.124857+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:11:07.807310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'29","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:50.266631+0000","last_change":"2026-02-23T06:51:50.266631+0000","last_active":"2026-02-23T06:51:50.266631+0000","last_peered":"2026-02-23T06:51:50.266631+0000","last_clean":"2026-02-23T06:51:50.266631+0000","last_became_active":"2026-02-23T06:21:18.148262+0000","last_became_peered":"2026-02-23T06:21:18.148262+0000","last_unstale":"2026-02-23T06:51:50.266631+0000","last_undegraded":"2026-02-23T06:51:50.266631+0000","last_fullsized":"2026-02-23T06:51:50.266631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2026-02-23T06:51:50.266601+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2026-02-23T06:51:50.266601+0000","last_clean_scrub_stamp":"2026-02-23T06:51:50.266601+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:17:23.059565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'18","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:39.099473+0000","last_change":"2026-02-23T06:21:18.155275+0000","last_active":"2026-02-23T06:51:39.099473+0000","last_peered":"2026-02-23T06:51:39.099473+0000","last_clean":"2026-02-23T06:51:39.099473+0000","last_became_active":"2026-02-23T06:21:18.155214+0000","last_became_peered":"2026-02-23T06:21:18.155214+0000","last_unstale":"2026-02-23T06:51:39.099473+0000","last_undegraded":"2026-02-23T06:51:39.099473+0000","last_fullsized":"2026-02-23T06:51:39.099473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:44:47.367234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'19","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:38.733837+0000","last_change":"2026-02-23T06:21:18.153381+0000","last_active":"2026-02-23T06:51:38.733837+0000","last_peered":"2026-02-23T06:51:38.733837+0000","last_clean":"2026-02-23T06:51:38.733837+0000","last_became_active":"2026-02-23T06:21:18.152456+0000","last_became_peered":"2026-02-23T06:21:18.152456+0000","last_unstale":"2026-02-23T06:51:38.733837+0000","last_undegraded":"2026-02-23T06:51:38.733837+0000","last_fullsized":"2026-02-23T06:51:38.733837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:21:17.131962+0000","last_clean_scrub_stamp":"2026-02-23T06:21:17.131962+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:14:46.231331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'21","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:57.565135+0000","last_change":"2026-02-23T06:51:57.565135+0000","last_active":"2026-02-23T06:51:57.565135+0000","last_peered":"2026-02-23T06:51:57.565135+0000","last_clean":"2026-02-23T06:51:57.565135+0000","last_became_active":"2026-02-23T06:21:18.148498+0000","last_became_peered":"2026-02-23T06:21:18.148498+0000","last_unstale":"2026-02-23T06:51:57.565135+0000","last_undegraded":"2026-02-23T06:51:57.565135+0000","last_fullsized":"2026-02-23T06:51:57.565135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2026-02-23T06:51:57.565094+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2026-02-23T06:51:57.565094+0000","last_clean_scrub_stamp":"2026-02-23T06:51:57.565094+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:29.245090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'21","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:52.572084+0000","last_change":"2026-02-23T06:51:52.572084+0000","last_active":"2026-02-23T06:51:52.572084+0000","last_peered":"2026-02-23T06:51:52.572084+0000","last_clean":"2026-02-23T06:51:52.572084+0000","last_became_active":"2026-02-23T06:21:18.141938+0000","last_became_peered":"2026-02-23T06:21:18.141938+0000","last_unstale":"2026-02-23T06:51:52.572084+0000","last_undegraded":"2026-02-23T06:51:52.572084+0000","last_fullsized":"2026-02-23T06:51:52.572084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2026-02-23T06:51:52.572033+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2026-02-23T06:51:52.572033+0000","last_clean_scrub_stamp":"2026-02-23T06:51:52.572033+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:24:29.407570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'26","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:54.546299+0000","last_change":"2026-02-23T06:51:54.546299+0000","last_active":"2026-02-23T06:51:54.546299+0000","last_peered":"2026-02-23T06:51:54.546299+0000","last_clean":"2026-02-23T06:51:54.546299+0000","last_became_active":"2026-02-23T06:21:18.153090+0000","last_became_peered":"2026-02-23T06:21:18.153090+0000","last_unstale":"2026-02-23T06:51:54.546299+0000","last_undegraded":"2026-02-23T06:51:54.546299+0000","last_fullsized":"2026-02-23T06:51:54.546299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2026-02-23T06:51:54.546239+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2026-02-23T06:51:54.546239+0000","last_clean_scrub_stamp":"2026-02-23T06:51:54.546239+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:30:49.355223+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'17","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:58.150758+0000","last_change":"2026-02-23T06:51:58.150758+0000","last_active":"2026-02-23T06:51:58.150758+0000","last_peered":"2026-02-23T06:51:58.150758+0000","last_clean":"2026-02-23T06:51:58.150758+0000","last_became_active":"2026-02-23T06:21:18.147956+0000","last_became_peered":"2026-02-23T06:21:18.147956+0000","last_unstale":"2026-02-23T06:51:58.150758+0000","last_undegraded":"2026-02-23T06:51:58.150758+0000","last_fullsized":"2026-02-23T06:51:58.150758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2026-02-23T06:51:58.150730+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2026-02-23T06:51:58.150730+0000","last_clean_scrub_stamp":"2026-02-23T06:51:58.150730+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:36:56.081338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'18","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:56.159975+0000","last_change":"2026-02-23T06:51:56.159975+0000","last_active":"2026-02-23T06:51:56.159975+0000","last_peered":"2026-02-23T06:51:56.159975+0000","last_clean":"2026-02-23T06:51:56.159975+0000","last_became_active":"2026-02-23T06:21:18.155130+0000","last_became_peered":"2026-02-23T06:21:18.155130+0000","last_unstale":"2026-02-23T06:51:56.159975+0000","last_undegraded":"2026-02-23T06:51:56.159975+0000","last_fullsized":"2026-02-23T06:51:56.159975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2026-02-23T06:51:56.159917+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2026-02-23T06:51:56.159917+0000","last_clean_scrub_stamp":"2026-02-23T06:51:56.159917+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:36:33.596654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'29","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:52.151150+0000","last_change":"2026-02-23T06:51:52.151150+0000","last_active":"2026-02-23T06:51:52.151150+0000","last_peered":"2026-02-23T06:51:52.151150+0000","last_clean":"2026-02-23T06:51:52.151150+0000","last_became_active":"2026-02-23T06:21:18.152790+0000","last_became_peered":"2026-02-23T06:21:18.152790+0000","last_unstale":"2026-02-23T06:51:52.151150+0000","last_undegraded":"2026-02-23T06:51:52.151150+0000","last_fullsized":"2026-02-23T06:51:52.151150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2026-02-23T06:51:52.151121+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2026-02-23T06:51:52.151121+0000","last_clean_scrub_stamp":"2026-02-23T06:51:52.151121+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:54:33.006651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'21","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:49.678445+0000","last_change":"2026-02-23T06:51:49.678445+0000","last_active":"2026-02-23T06:51:49.678445+0000","last_peered":"2026-02-23T06:51:49.678445+0000","last_clean":"2026-02-23T06:51:49.678445+0000","last_became_active":"2026-02-23T06:21:18.155122+0000","last_became_peered":"2026-02-23T06:21:18.155122+0000","last_unstale":"2026-02-23T06:51:49.678445+0000","last_undegraded":"2026-02-23T06:51:49.678445+0000","last_fullsized":"2026-02-23T06:51:49.678445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2026-02-23T06:51:49.678413+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2026-02-23T06:51:49.678413+0000","last_clean_scrub_stamp":"2026-02-23T06:51:49.678413+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:16:52.893383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'13","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:58.607084+0000","last_change":"2026-02-23T06:51:58.607084+0000","last_active":"2026-02-23T06:51:58.607084+0000","last_peered":"2026-02-23T06:51:58.607084+0000","last_clean":"2026-02-23T06:51:58.607084+0000","last_became_active":"2026-02-23T06:21:18.151151+0000","last_became_peered":"2026-02-23T06:21:18.151151+0000","last_unstale":"2026-02-23T06:51:58.607084+0000","last_undegraded":"2026-02-23T06:51:58.607084+0000","last_fullsized":"2026-02-23T06:51:58.607084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2026-02-23T06:51:58.607047+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2026-02-23T06:51:58.607047+0000","last_clean_scrub_stamp":"2026-02-23T06:51:58.607047+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:59:12.325575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'13","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:57.180689+0000","last_change":"2026-02-23T06:51:57.180689+0000","last_active":"2026-02-23T06:51:57.180689+0000","last_peered":"2026-02-23T06:51:57.180689+0000","last_clean":"2026-02-23T06:51:57.180689+0000","last_became_active":"2026-02-23T06:21:18.146527+0000","last_became_peered":"2026-02-23T06:21:18.146527+0000","last_unstale":"2026-02-23T06:51:57.180689+0000","last_undegraded":"2026-02-23T06:51:57.180689+0000","last_fullsized":"2026-02-23T06:51:57.180689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2026-02-23T06:51:57.180660+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2026-02-23T06:51:57.180660+0000","last_clean_scrub_stamp":"2026-02-23T06:51:57.180660+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:47:26.723950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'15","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:48.238789+0000","last_change":"2026-02-23T06:51:48.238789+0000","last_active":"2026-02-23T06:51:48.238789+0000","last_peered":"2026-02-23T06:51:48.238789+0000","last_clean":"2026-02-23T06:51:48.238789+0000","last_became_active":"2026-02-23T06:21:18.145770+0000","last_became_peered":"2026-02-23T06:21:18.145770+0000","last_unstale":"2026-02-23T06:51:48.238789+0000","last_undegraded":"2026-02-23T06:51:48.238789+0000","last_fullsized":"2026-02-23T06:51:48.238789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2026-02-23T06:51:48.238759+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2026-02-23T06:51:48.238759+0000","last_clean_scrub_stamp":"2026-02-23T06:51:48.238759+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:35:52.767995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'17","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:54.167982+0000","last_change":"2026-02-23T06:51:54.167982+0000","last_active":"2026-02-23T06:51:54.167982+0000","last_peered":"2026-02-23T06:51:54.167982+0000","last_clean":"2026-02-23T06:51:54.167982+0000","last_became_active":"2026-02-23T06:21:18.151948+0000","last_became_peered":"2026-02-23T06:21:18.151948+0000","last_unstale":"2026-02-23T06:51:54.167982+0000","last_undegraded":"2026-02-23T06:51:54.167982+0000","last_fullsized":"2026-02-23T06:51:54.167982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2026-02-23T06:51:54.167920+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2026-02-23T06:51:54.167920+0000","last_clean_scrub_stamp":"2026-02-23T06:51:54.167920+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:01:00.503295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'13","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:52.269155+0000","last_change":"2026-02-23T06:51:52.269155+0000","last_active":"2026-02-23T06:51:52.269155+0000","last_peered":"2026-02-23T06:51:52.269155+0000","last_clean":"2026-02-23T06:51:52.269155+0000","last_became_active":"2026-02-23T06:21:18.144346+0000","last_became_peered":"2026-02-23T06:21:18.144346+0000","last_unstale":"2026-02-23T06:51:52.269155+0000","last_undegraded":"2026-02-23T06:51:52.269155+0000","last_fullsized":"2026-02-23T06:51:52.269155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2026-02-23T06:51:52.269110+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2026-02-23T06:51:52.269110+0000","last_clean_scrub_stamp":"2026-02-23T06:51:52.269110+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:09.558981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'18","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:52:02.718581+0000","last_change":"2026-02-23T06:52:02.718581+0000","last_active":"2026-02-23T06:52:02.718581+0000","last_peered":"2026-02-23T06:52:02.718581+0000","last_clean":"2026-02-23T06:52:02.718581+0000","last_became_active":"2026-02-23T06:21:18.141449+0000","last_became_peered":"2026-02-23T06:21:18.141449+0000","last_unstale":"2026-02-23T06:52:02.718581+0000","last_undegraded":"2026-02-23T06:52:02.718581+0000","last_fullsized":"2026-02-23T06:52:02.718581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2026-02-23T06:52:02.718524+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2026-02-23T06:52:02.718524+0000","last_clean_scrub_stamp":"2026-02-23T06:52:02.718524+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:21:15.372942+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'10","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:59.632522+0000","last_change":"2026-02-23T06:51:59.632522+0000","last_active":"2026-02-23T06:51:59.632522+0000","last_peered":"2026-02-23T06:51:59.632522+0000","last_clean":"2026-02-23T06:51:59.632522+0000","last_became_active":"2026-02-23T06:21:18.142359+0000","last_became_peered":"2026-02-23T06:21:18.142359+0000","last_unstale":"2026-02-23T06:51:59.632522+0000","last_undegraded":"2026-02-23T06:51:59.632522+0000","last_fullsized":"2026-02-23T06:51:59.632522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2026-02-23T06:51:59.632489+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2026-02-23T06:51:59.632489+0000","last_clean_scrub_stamp":"2026-02-23T06:51:59.632489+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:04:43.508047+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'16","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:59.154126+0000","last_change":"2026-02-23T06:51:59.154126+0000","last_active":"2026-02-23T06:51:59.154126+0000","last_peered":"2026-02-23T06:51:59.154126+0000","last_clean":"2026-02-23T06:51:59.154126+0000","last_became_active":"2026-02-23T06:21:18.156564+0000","last_became_peered":"2026-02-23T06:21:18.156564+0000","last_unstale":"2026-02-23T06:51:59.154126+0000","last_undegraded":"2026-02-23T06:51:59.154126+0000","last_fullsized":"2026-02-23T06:51:59.154126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2026-02-23T06:51:59.154092+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2026-02-23T06:51:59.154092+0000","last_clean_scrub_stamp":"2026-02-23T06:51:59.154092+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:47:51.191907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":3,"num_write":757736,"num_write_kb":39381923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61804,"ondisk_log_size":61804,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1221,"ondisk_log_size":1221,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":13257019,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":32,"num_read_kb":104,"num_write":2250,"num_write_kb":14687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5220,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13860864,"data_stored":26514038,"data_compressed":2657250,"data_compressed_allocated":3497984,"data_compressed_original":16220160,"omap_allocated":634237,"internal_metadata":0},"log_size":2122,"ondisk_log_size":2122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70172,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575222,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261872,"kb_used_data":352,"kb_used_omap":128,"kb_used_meta":261375,"kb_avail":94109968,"statfs":{"total":96636764160,"available":96368607232,"internally_reserved":0,"allocated":360448,"data_stored":708511,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":131483,"internal_metadata":267648613},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575223,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261888,"kb_used_data":368,"kb_used_omap":20,"kb_used_meta":261483,"kb_avail":94109952,"statfs":{"total":96636764160,"available":96368590848,"internally_reserved":0,"allocated":376832,"data_stored":200831,"data_compressed":2418,"data_compressed_allocated":4096,"data_compressed_original":12288,"omap_allocated":20978,"internal_metadata":267759118},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575224,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":228916,"kb_used_data":3492,"kb_used_omap":17,"kb_used_meta":225390,"kb_avail":94142924,"statfs":{"total":96636764160,"available":96402354176,"internally_reserved":0,"allocated":3575808,"data_stored":4312377,"data_compressed":181645,"data_compressed_allocated":237568,"data_compressed_original":1146880,"omap_allocated":17420,"internal_metadata":230800372},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575225,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229064,"kb_used_data":3640,"kb_used_omap":43,"kb_used_meta":225364,"kb_avail":94142776,"statfs":{"total":96636764160,"available":96402202624,"internally_reserved":0,"allocated":3727360,"data_stored":4985471,"data_compressed":219149,"data_compressed_allocated":286720,"data_compressed_original":1732608,"omap_allocated":44556,"internal_metadata":230773236},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575224,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":227456,"kb_used_data":2032,"kb_used_omap":239,"kb_used_meta":225168,"kb_avail":94144384,"statfs":{"total":96636764160,"available":96403849216,"internally_reserved":0,"allocated":2080768,"data_stored":4903724,"data_compressed":682037,"data_compressed_allocated":888832,"data_compressed_original":3903488,"omap_allocated":245322,"internal_metadata":230572470},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575223,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281760,"kb_used_data":2192,"kb_used_omap":48,"kb_used_meta":279503,"kb_avail":94090080,"statfs":{"total":96636764160,"available":96348241920,"internally_reserved":0,"allocated":2244608,"data_stored":4902940,"data_compressed":537579,"data_compressed_allocated":712704,"data_compressed_original":3551232,"omap_allocated":49901,"internal_metadata":286211347},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575222,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":192896,"kb_used_data":3568,"kb_used_omap":16,"kb_used_meta":189295,"kb_avail":94178944,"statfs":{"total":96636764160,"available":96439238656,"internally_reserved":0,"allocated":3653632,"data_stored":8507375,"data_compressed":1069508,"data_compressed_allocated":1413120,"data_compressed_original":6447104,"omap_allocated":16904,"internal_metadata":193838584},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575222,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":171572,"kb_used_data":292,"kb_used_omap":195,"kb_used_meta":171068,"kb_avail":94200268,"statfs":{"total":96636764160,"available":96461074432,"internally_reserved":0,"allocated":299008,"data_stored":118129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":200273,"internal_metadata":175174063},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":180830,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":126753,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3362816,"data_stored":8389302,"data_compressed":1069508,"data_compressed_allocated":1413120,"data_compressed_original":6447104,"omap_allocated":8580,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1953792,"data_stored":4784867,"data_compressed":537579,"data_compressed_allocated":712704,"data_compressed_original":3551232,"omap_allocated":32915,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1789952,"data_stored":4785651,"data_compressed":682037,"data_compressed_allocated":888832,"data_compressed_original":3903488,"omap_allocated":234344,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3371008,"data_stored":4277030,"data_compressed":184063,"data_compressed_allocated":241664,"data_compressed_original":1159168,"omap_allocated":36527,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3284992,"data_stored":4194304,"data_compressed":181645,"data_compressed_allocated":237568,"data_compressed_original":1146880,"omap_allocated":4760,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":82758,"data_compressed":2418,"data_compressed_allocated":4096,"data_compressed_original":12288,"omap_allocated":9528,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T06:52:05.788 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:52:05.788 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:52:05.788 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:52:05.788 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2026-02-23T06:21:21.147043+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=21, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:52:05.788 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:52:05.788 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2026-02-23T06:21:17.131962+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=21, tm_sec=17, tm_wday=0, tm_yday=54, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=23, tm_hour=6, tm_min=51, tm_sec=40, tm_wday=0, tm_yday=54, tm_isdst=0) 2026-02-23T06:52:05.788 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-23T06:52:15.913 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:52:15.918 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:52:25.790 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-23T06:52:25.913 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.918+0000 7fce35643640 1 -- 10.20.193.58:0/4073169081 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fce300b6690 msgr2=0x7fce30058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:25.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.918+0000 7fce35643640 1 --2- 10.20.193.58:0/4073169081 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fce300b6690 0x7fce30058cf0 secure :-1 s=READY pgs=204 gs=2 cs=0 l=1 c_cookie=18081767657143263452 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce30059740 tx=0x7fce24030340 comp rx=0 tx=0).stop 2026-02-23T06:52:25.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.918+0000 7fce35643640 1 -- 10.20.193.58:0/4073169081 shutdown_connections 2026-02-23T06:52:25.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.918+0000 7fce35643640 1 --2- 10.20.193.58:0/4073169081 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fce300b6690 0x7fce30058cf0 unknown :-1 s=CLOSED pgs=204 gs=2 cs=0 l=1 c_cookie=18081767657143263452 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:25.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.918+0000 7fce35643640 1 --2- 10.20.193.58:0/4073169081 >> v2:10.20.193.93:3300/0 conn(0x7fce3015d870 0x7fce300587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:25.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.918+0000 7fce35643640 1 -- 10.20.193.58:0/4073169081 >> 10.20.193.58:0/4073169081 conn(0x7fce300b3c20 msgr2=0x7fce300b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:52:25.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.918+0000 7fce35643640 1 -- 10.20.193.58:0/4073169081 shutdown_connections 2026-02-23T06:52:25.914 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.918+0000 7fce35643640 1 -- 10.20.193.58:0/4073169081 wait complete. 2026-02-23T06:52:25.917 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.919+0000 7fce35643640 1 Processor -- start 2026-02-23T06:52:25.917 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.919+0000 7fce35643640 1 -- start start 2026-02-23T06:52:25.917 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.920+0000 7fce35643640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fce300b6690 0x7fce30124ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:25.917 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.920+0000 7fce35643640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fce3015d4a0 0x7fce3011fff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:25.917 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.920+0000 7fce35643640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fce3015d870 0x7fce30122110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:25.917 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.920+0000 7fce35643640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fce30162510 con 0x7fce300b6690 2026-02-23T06:52:25.917 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.920+0000 7fce35643640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fce3013e140 con 0x7fce3015d4a0 2026-02-23T06:52:25.917 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.920+0000 7fce35643640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fce30121f10 con 0x7fce3015d870 2026-02-23T06:52:25.918 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.920+0000 7fce2ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fce300b6690 0x7fce30124ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:25.918 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.920+0000 7fce2f7fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fce3015d4a0 0x7fce3011fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:25.918 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.920+0000 7fce2ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fce300b6690 0x7fce30124ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:48684/0 (socket says 10.20.193.58:48684) 2026-02-23T06:52:25.918 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.920+0000 7fce2ffff640 1 -- 10.20.193.58:0/1056978247 learned_addr learned my addr 10.20.193.58:0/1056978247 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:52:25.918 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.920+0000 7fce34e42640 1 --2- 10.20.193.58:0/1056978247 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fce3015d870 0x7fce30122110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:25.918 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.920+0000 7fce2ffff640 1 -- 10.20.193.58:0/1056978247 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fce3015d870 msgr2=0x7fce30122110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:25.918 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.920+0000 7fce2ffff640 1 --2- 10.20.193.58:0/1056978247 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fce3015d870 0x7fce30122110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:25.918 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.920+0000 7fce2ffff640 1 -- 10.20.193.58:0/1056978247 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fce3015d4a0 msgr2=0x7fce3011fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:25.918 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.920+0000 7fce2ffff640 1 --2- 10.20.193.58:0/1056978247 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fce3015d4a0 0x7fce3011fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:25.918 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.920+0000 7fce2ffff640 1 -- 10.20.193.58:0/1056978247 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce2400a650 con 0x7fce300b6690 2026-02-23T06:52:25.918 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.920+0000 7fce34e42640 1 --2- 10.20.193.58:0/1056978247 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fce3015d870 0x7fce30122110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:52:25.918 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.920+0000 7fce2ffff640 1 --2- 10.20.193.58:0/1056978247 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fce300b6690 0x7fce30124ad0 secure :-1 s=READY pgs=205 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce1c00c530 tx=0x7fce1c00ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:52:25.918 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.920+0000 7fce2cff9640 1 -- 10.20.193.58:0/1056978247 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce1c004250 con 0x7fce300b6690 2026-02-23T06:52:25.918 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.920+0000 7fce2cff9640 1 -- 10.20.193.58:0/1056978247 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce1c0044a0 con 0x7fce300b6690 2026-02-23T06:52:25.919 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.920+0000 7fce35643640 1 -- 10.20.193.58:0/1056978247 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce301617f0 con 0x7fce300b6690 2026-02-23T06:52:25.919 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.920+0000 7fce2cff9640 1 -- 10.20.193.58:0/1056978247 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce1c006b10 con 0x7fce300b6690 2026-02-23T06:52:25.919 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.920+0000 7fce35643640 1 -- 10.20.193.58:0/1056978247 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce30161f50 con 0x7fce300b6690 2026-02-23T06:52:25.919 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.921+0000 7fce35643640 1 -- 10.20.193.58:0/1056978247 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce300b6d50 con 0x7fce300b6690 2026-02-23T06:52:25.919 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.922+0000 7fce2cff9640 1 -- 10.20.193.58:0/1056978247 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fce1c003670 con 0x7fce300b6690 2026-02-23T06:52:25.920 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.923+0000 7fce2cff9640 1 --2- 10.20.193.58:0/1056978247 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fce0007a6c0 0x7fce0009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:25.920 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.923+0000 7fce2cff9640 1 -- 10.20.193.58:0/1056978247 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fce1c09d070 con 0x7fce300b6690 2026-02-23T06:52:25.920 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.923+0000 7fce2f7fe640 1 --2- 10.20.193.58:0/1056978247 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fce0007a6c0 0x7fce0009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:25.920 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.924+0000 7fce2f7fe640 1 --2- 10.20.193.58:0/1056978247 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fce0007a6c0 0x7fce0009ab70 secure :-1 s=READY pgs=624 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce3013ed40 tx=0x7fce20005f90 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:52:25.920 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:25.925+0000 7fce2cff9640 1 -- 10.20.193.58:0/1056978247 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fce1c0601c0 con 0x7fce300b6690 2026-02-23T06:52:26.031 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.036+0000 7fce35643640 1 -- 10.20.193.58:0/1056978247 --> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fce300b5e10 con 0x7fce0007a6c0 2026-02-23T06:52:26.034 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.040+0000 7fce2cff9640 1 -- 10.20.193.58:0/1056978247 <== mgr.4126 v2:10.20.193.93:6800/4124709854 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334694 (secure 0 0 0) 0x7fce20009830 con 0x7fce0007a6c0 2026-02-23T06:52:26.038 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:52:26.040 INFO:teuthology.orchestra.run.trial058.stderr:dumped all 2026-02-23T06:52:26.041 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.042+0000 7fce35643640 1 -- 10.20.193.58:0/1056978247 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fce0007a6c0 msgr2=0x7fce0009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:26.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.042+0000 7fce35643640 1 --2- 10.20.193.58:0/1056978247 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fce0007a6c0 0x7fce0009ab70 secure :-1 s=READY pgs=624 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce3013ed40 tx=0x7fce20005f90 comp rx=0 tx=0).stop 2026-02-23T06:52:26.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.042+0000 7fce35643640 1 -- 10.20.193.58:0/1056978247 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fce300b6690 msgr2=0x7fce30124ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:26.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.042+0000 7fce35643640 1 --2- 10.20.193.58:0/1056978247 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fce300b6690 0x7fce30124ad0 secure :-1 s=READY pgs=205 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce1c00c530 tx=0x7fce1c00ca00 comp rx=0 tx=0).stop 2026-02-23T06:52:26.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.042+0000 7fce35643640 1 -- 10.20.193.58:0/1056978247 shutdown_connections 2026-02-23T06:52:26.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.042+0000 7fce35643640 1 --2- 10.20.193.58:0/1056978247 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fce0007a6c0 0x7fce0009ab70 unknown :-1 s=CLOSED pgs=624 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.042+0000 7fce35643640 1 --2- 10.20.193.58:0/1056978247 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fce3015d870 0x7fce30122110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.042+0000 7fce35643640 1 --2- 10.20.193.58:0/1056978247 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fce3015d4a0 0x7fce3011fff0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.042 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.042+0000 7fce35643640 1 --2- 10.20.193.58:0/1056978247 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fce300b6690 0x7fce30124ad0 unknown :-1 s=CLOSED pgs=205 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.043 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.042+0000 7fce35643640 1 -- 10.20.193.58:0/1056978247 >> 10.20.193.58:0/1056978247 conn(0x7fce300b3c20 msgr2=0x7fce3015b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:52:26.043 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.042+0000 7fce35643640 1 -- 10.20.193.58:0/1056978247 shutdown_connections 2026-02-23T06:52:26.043 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.042+0000 7fce35643640 1 -- 10.20.193.58:0/1056978247 wait complete. 2026-02-23T06:52:26.050 INFO:teuthology.orchestra.run.trial058.stdout:{"pg_ready":true,"pg_map":{"version":961,"stamp":"2026-02-23T06:52:24.662793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":13847387,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":119,"num_read_kb":180,"num_write":760131,"num_write_kb":39399282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5220,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65261,"ondisk_log_size":65261,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1855424,"kb_used_data":15936,"kb_used_omap":709,"kb_used_meta":1838650,"kb_avail":753119296,"statfs":{"total":773094113280,"available":771194159104,"internally_reserved":0,"allocated":16318464,"data_stored":28639358,"data_compressed":2727422,"data_compressed_allocated":3588096,"data_compressed_original":17367040,"omap_allocated":726837,"internal_metadata":1882777803},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001579"},"pg_stats":[{"pgid":"2.1f","version":"27'31","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:48.858073+0000","last_change":"2026-02-23T06:51:48.858073+0000","last_active":"2026-02-23T06:51:48.858073+0000","last_peered":"2026-02-23T06:51:48.858073+0000","last_clean":"2026-02-23T06:51:48.858073+0000","last_became_active":"2026-02-23T06:21:17.142416+0000","last_became_peered":"2026-02-23T06:21:17.142416+0000","last_unstale":"2026-02-23T06:51:48.858073+0000","last_undegraded":"2026-02-23T06:51:48.858073+0000","last_fullsized":"2026-02-23T06:51:48.858073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2026-02-23T06:51:48.858032+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2026-02-23T06:51:48.858032+0000","last_clean_scrub_stamp":"2026-02-23T06:51:48.858032+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:22:12.881273+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590563,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'11","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:52.540178+0000","last_change":"2026-02-23T06:51:52.540178+0000","last_active":"2026-02-23T06:51:52.540178+0000","last_peered":"2026-02-23T06:51:52.540178+0000","last_clean":"2026-02-23T06:51:52.540178+0000","last_became_active":"2026-02-23T06:21:18.148276+0000","last_became_peered":"2026-02-23T06:21:18.148276+0000","last_unstale":"2026-02-23T06:51:52.540178+0000","last_undegraded":"2026-02-23T06:51:52.540178+0000","last_fullsized":"2026-02-23T06:51:52.540178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2026-02-23T06:51:52.540145+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2026-02-23T06:51:52.540145+0000","last_clean_scrub_stamp":"2026-02-23T06:51:52.540145+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:05:29.758869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'2077","reported_seq":2116,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:53.346014+0000","last_change":"2026-02-23T06:51:53.346014+0000","last_active":"2026-02-23T06:51:53.346014+0000","last_peered":"2026-02-23T06:51:53.346014+0000","last_clean":"2026-02-23T06:51:53.346014+0000","last_became_active":"2026-02-23T06:21:22.169307+0000","last_became_peered":"2026-02-23T06:21:22.169307+0000","last_unstale":"2026-02-23T06:51:53.346014+0000","last_undegraded":"2026-02-23T06:51:53.346014+0000","last_fullsized":"2026-02-23T06:51:53.346014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2077","last_scrub_stamp":"2026-02-23T06:51:53.345981+0000","last_deep_scrub":"27'2077","last_deep_scrub_stamp":"2026-02-23T06:51:53.345981+0000","last_clean_scrub_stamp":"2026-02-23T06:51:53.345981+0000","objects_scrubbed":0,"log_size":2077,"log_dups_size":0,"ondisk_log_size":2077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:14:24.157243+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25614,"num_write_kb":1337383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'3","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:47.458768+0000","last_change":"2026-02-23T06:51:47.458768+0000","last_active":"2026-02-23T06:51:47.458768+0000","last_peered":"2026-02-23T06:51:47.458768+0000","last_clean":"2026-02-23T06:51:47.458768+0000","last_became_active":"2026-02-23T06:21:17.138651+0000","last_became_peered":"2026-02-23T06:21:17.138651+0000","last_unstale":"2026-02-23T06:51:47.458768+0000","last_undegraded":"2026-02-23T06:51:47.458768+0000","last_fullsized":"2026-02-23T06:51:47.458768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2026-02-23T06:51:47.458718+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2026-02-23T06:51:47.458718+0000","last_clean_scrub_stamp":"2026-02-23T06:51:47.458718+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:27:36.538570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'21","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:53.510357+0000","last_change":"2026-02-23T06:51:53.510357+0000","last_active":"2026-02-23T06:51:53.510357+0000","last_peered":"2026-02-23T06:51:53.510357+0000","last_clean":"2026-02-23T06:51:53.510357+0000","last_became_active":"2026-02-23T06:21:18.144915+0000","last_became_peered":"2026-02-23T06:21:18.144915+0000","last_unstale":"2026-02-23T06:51:53.510357+0000","last_undegraded":"2026-02-23T06:51:53.510357+0000","last_fullsized":"2026-02-23T06:51:53.510357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2026-02-23T06:51:53.510317+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2026-02-23T06:51:53.510317+0000","last_clean_scrub_stamp":"2026-02-23T06:51:53.510317+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:00:46.450210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'2043","reported_seq":2090,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:54.321630+0000","last_change":"2026-02-23T06:51:54.321630+0000","last_active":"2026-02-23T06:51:54.321630+0000","last_peered":"2026-02-23T06:51:54.321630+0000","last_clean":"2026-02-23T06:51:54.321630+0000","last_became_active":"2026-02-23T06:22:05.909877+0000","last_became_peered":"2026-02-23T06:22:05.909877+0000","last_unstale":"2026-02-23T06:51:54.321630+0000","last_undegraded":"2026-02-23T06:51:54.321630+0000","last_fullsized":"2026-02-23T06:51:54.321630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2043","last_scrub_stamp":"2026-02-23T06:51:54.321602+0000","last_deep_scrub":"27'2043","last_deep_scrub_stamp":"2026-02-23T06:51:54.321602+0000","last_clean_scrub_stamp":"2026-02-23T06:51:54.321602+0000","objects_scrubbed":0,"log_size":2043,"log_dups_size":0,"ondisk_log_size":2043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:32.189373+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25337,"num_write_kb":1284660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'10","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:45.056276+0000","last_change":"2026-02-23T06:51:45.056276+0000","last_active":"2026-02-23T06:51:45.056276+0000","last_peered":"2026-02-23T06:51:45.056276+0000","last_clean":"2026-02-23T06:51:45.056276+0000","last_became_active":"2026-02-23T06:21:17.150244+0000","last_became_peered":"2026-02-23T06:21:17.150244+0000","last_unstale":"2026-02-23T06:51:45.056276+0000","last_undegraded":"2026-02-23T06:51:45.056276+0000","last_fullsized":"2026-02-23T06:51:45.056276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2026-02-23T06:51:45.056235+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2026-02-23T06:51:45.056235+0000","last_clean_scrub_stamp":"2026-02-23T06:51:45.056235+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:23:22.084893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'18","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:46.675046+0000","last_change":"2026-02-23T06:51:46.675046+0000","last_active":"2026-02-23T06:51:46.675046+0000","last_peered":"2026-02-23T06:51:46.675046+0000","last_clean":"2026-02-23T06:51:46.675046+0000","last_became_active":"2026-02-23T06:21:18.149827+0000","last_became_peered":"2026-02-23T06:21:18.149827+0000","last_unstale":"2026-02-23T06:51:46.675046+0000","last_undegraded":"2026-02-23T06:51:46.675046+0000","last_fullsized":"2026-02-23T06:51:46.675046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2026-02-23T06:51:46.675018+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2026-02-23T06:51:46.675018+0000","last_clean_scrub_stamp":"2026-02-23T06:51:46.675018+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:18.760801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'1774","reported_seq":1813,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:57.308902+0000","last_change":"2026-02-23T06:51:57.308902+0000","last_active":"2026-02-23T06:51:57.308902+0000","last_peered":"2026-02-23T06:51:57.308902+0000","last_clean":"2026-02-23T06:51:57.308902+0000","last_became_active":"2026-02-23T06:21:22.173939+0000","last_became_peered":"2026-02-23T06:21:22.173939+0000","last_unstale":"2026-02-23T06:51:57.308902+0000","last_undegraded":"2026-02-23T06:51:57.308902+0000","last_fullsized":"2026-02-23T06:51:57.308902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1774","last_scrub_stamp":"2026-02-23T06:51:57.308868+0000","last_deep_scrub":"27'1774","last_deep_scrub_stamp":"2026-02-23T06:51:57.308868+0000","last_clean_scrub_stamp":"2026-02-23T06:51:57.308868+0000","objects_scrubbed":0,"log_size":1774,"log_dups_size":0,"ondisk_log_size":1774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:29:17.243011+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22016,"num_write_kb":1043178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'3","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:46.100285+0000","last_change":"2026-02-23T06:51:46.100285+0000","last_active":"2026-02-23T06:51:46.100285+0000","last_peered":"2026-02-23T06:51:46.100285+0000","last_clean":"2026-02-23T06:51:46.100285+0000","last_became_active":"2026-02-23T06:21:17.144122+0000","last_became_peered":"2026-02-23T06:21:17.144122+0000","last_unstale":"2026-02-23T06:51:46.100285+0000","last_undegraded":"2026-02-23T06:51:46.100285+0000","last_fullsized":"2026-02-23T06:51:46.100285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2026-02-23T06:51:46.100258+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2026-02-23T06:51:46.100258+0000","last_clean_scrub_stamp":"2026-02-23T06:51:46.100258+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:18:27.197125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'26","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:51.118074+0000","last_change":"2026-02-23T06:51:51.118074+0000","last_active":"2026-02-23T06:51:51.118074+0000","last_peered":"2026-02-23T06:51:51.118074+0000","last_clean":"2026-02-23T06:51:51.118074+0000","last_became_active":"2026-02-23T06:22:05.870252+0000","last_became_peered":"2026-02-23T06:22:05.870252+0000","last_unstale":"2026-02-23T06:51:51.118074+0000","last_undegraded":"2026-02-23T06:51:51.118074+0000","last_fullsized":"2026-02-23T06:51:51.118074+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2026-02-23T06:51:51.118036+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2026-02-23T06:51:51.118036+0000","last_clean_scrub_stamp":"2026-02-23T06:51:51.118036+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:42:18.486538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'2124","reported_seq":2163,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:56.348443+0000","last_change":"2026-02-23T06:51:56.348443+0000","last_active":"2026-02-23T06:51:56.348443+0000","last_peered":"2026-02-23T06:51:56.348443+0000","last_clean":"2026-02-23T06:51:56.348443+0000","last_became_active":"2026-02-23T06:21:22.165671+0000","last_became_peered":"2026-02-23T06:21:22.165671+0000","last_unstale":"2026-02-23T06:51:56.348443+0000","last_undegraded":"2026-02-23T06:51:56.348443+0000","last_fullsized":"2026-02-23T06:51:56.348443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2124","last_scrub_stamp":"2026-02-23T06:51:56.348399+0000","last_deep_scrub":"27'2124","last_deep_scrub_stamp":"2026-02-23T06:51:56.348399+0000","last_clean_scrub_stamp":"2026-02-23T06:51:56.348399+0000","objects_scrubbed":0,"log_size":2124,"log_dups_size":0,"ondisk_log_size":2124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:14:33.358814+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26592,"num_write_kb":1292875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'15","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:59.129656+0000","last_change":"2026-02-23T06:51:59.129656+0000","last_active":"2026-02-23T06:51:59.129656+0000","last_peered":"2026-02-23T06:51:59.129656+0000","last_clean":"2026-02-23T06:51:59.129656+0000","last_became_active":"2026-02-23T06:21:18.150604+0000","last_became_peered":"2026-02-23T06:21:18.150604+0000","last_unstale":"2026-02-23T06:51:59.129656+0000","last_undegraded":"2026-02-23T06:51:59.129656+0000","last_fullsized":"2026-02-23T06:51:59.129656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2026-02-23T06:51:59.129621+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2026-02-23T06:51:59.129621+0000","last_clean_scrub_stamp":"2026-02-23T06:51:59.129621+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:21:46.868501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'327","reported_seq":374,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:53.167028+0000","last_change":"2026-02-23T06:51:53.167028+0000","last_active":"2026-02-23T06:51:53.167028+0000","last_peered":"2026-02-23T06:51:53.167028+0000","last_clean":"2026-02-23T06:51:53.167028+0000","last_became_active":"2026-02-23T06:21:17.147351+0000","last_became_peered":"2026-02-23T06:21:17.147351+0000","last_unstale":"2026-02-23T06:51:53.167028+0000","last_undegraded":"2026-02-23T06:51:53.167028+0000","last_fullsized":"2026-02-23T06:51:53.167028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'327","last_scrub_stamp":"2026-02-23T06:51:53.166985+0000","last_deep_scrub":"27'327","last_deep_scrub_stamp":"2026-02-23T06:51:53.166985+0000","last_clean_scrub_stamp":"2026-02-23T06:51:53.166985+0000","objects_scrubbed":2,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:00:10.858330+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":322,"num_write_kb":4304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'1853","reported_seq":1893,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:52:02.109223+0000","last_change":"2026-02-23T06:52:02.109223+0000","last_active":"2026-02-23T06:52:02.109223+0000","last_peered":"2026-02-23T06:52:02.109223+0000","last_clean":"2026-02-23T06:52:02.109223+0000","last_became_active":"2026-02-23T06:21:22.169259+0000","last_became_peered":"2026-02-23T06:21:22.169259+0000","last_unstale":"2026-02-23T06:52:02.109223+0000","last_undegraded":"2026-02-23T06:52:02.109223+0000","last_fullsized":"2026-02-23T06:52:02.109223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1853","last_scrub_stamp":"2026-02-23T06:52:02.109166+0000","last_deep_scrub":"27'1853","last_deep_scrub_stamp":"2026-02-23T06:52:02.109166+0000","last_clean_scrub_stamp":"2026-02-23T06:52:02.109166+0000","objects_scrubbed":0,"log_size":1853,"log_dups_size":0,"ondisk_log_size":1853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:41:49.448889+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22800,"num_write_kb":1137326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'19","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:48.182076+0000","last_change":"2026-02-23T06:51:48.182076+0000","last_active":"2026-02-23T06:51:48.182076+0000","last_peered":"2026-02-23T06:51:48.182076+0000","last_clean":"2026-02-23T06:51:48.182076+0000","last_became_active":"2026-02-23T06:21:18.142144+0000","last_became_peered":"2026-02-23T06:21:18.142144+0000","last_unstale":"2026-02-23T06:51:48.182076+0000","last_undegraded":"2026-02-23T06:51:48.182076+0000","last_fullsized":"2026-02-23T06:51:48.182076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2026-02-23T06:51:48.182026+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2026-02-23T06:51:48.182026+0000","last_clean_scrub_stamp":"2026-02-23T06:51:48.182026+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:55:25.738920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'1","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:46.474975+0000","last_change":"2026-02-23T06:51:46.474975+0000","last_active":"2026-02-23T06:51:46.474975+0000","last_peered":"2026-02-23T06:51:46.474975+0000","last_clean":"2026-02-23T06:51:46.474975+0000","last_became_active":"2026-02-23T06:21:17.137371+0000","last_became_peered":"2026-02-23T06:21:17.137371+0000","last_unstale":"2026-02-23T06:51:46.474975+0000","last_undegraded":"2026-02-23T06:51:46.474975+0000","last_fullsized":"2026-02-23T06:51:46.474975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2026-02-23T06:51:46.474923+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2026-02-23T06:51:46.474923+0000","last_clean_scrub_stamp":"2026-02-23T06:51:46.474923+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:14:29.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'1806","reported_seq":1846,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:52:00.117260+0000","last_change":"2026-02-23T06:52:00.117260+0000","last_active":"2026-02-23T06:52:00.117260+0000","last_peered":"2026-02-23T06:52:00.117260+0000","last_clean":"2026-02-23T06:52:00.117260+0000","last_became_active":"2026-02-23T06:21:22.162898+0000","last_became_peered":"2026-02-23T06:21:22.162898+0000","last_unstale":"2026-02-23T06:52:00.117260+0000","last_undegraded":"2026-02-23T06:52:00.117260+0000","last_fullsized":"2026-02-23T06:52:00.117260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1806","last_scrub_stamp":"2026-02-23T06:52:00.117227+0000","last_deep_scrub":"27'1806","last_deep_scrub_stamp":"2026-02-23T06:52:00.117227+0000","last_clean_scrub_stamp":"2026-02-23T06:52:00.117227+0000","objects_scrubbed":0,"log_size":1806,"log_dups_size":0,"ondisk_log_size":1806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:23:16.648560+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21405,"num_write_kb":1230733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'18","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:51.829763+0000","last_change":"2026-02-23T06:51:51.829763+0000","last_active":"2026-02-23T06:51:51.829763+0000","last_peered":"2026-02-23T06:51:51.829763+0000","last_clean":"2026-02-23T06:51:51.829763+0000","last_became_active":"2026-02-23T06:21:18.141090+0000","last_became_peered":"2026-02-23T06:21:18.141090+0000","last_unstale":"2026-02-23T06:51:51.829763+0000","last_undegraded":"2026-02-23T06:51:51.829763+0000","last_fullsized":"2026-02-23T06:51:51.829763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2026-02-23T06:51:51.829696+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2026-02-23T06:51:51.829696+0000","last_clean_scrub_stamp":"2026-02-23T06:51:51.829696+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:09:14.391042+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.867731+0000","last_change":"2026-02-23T06:51:44.867731+0000","last_active":"2026-02-23T06:51:44.867731+0000","last_peered":"2026-02-23T06:51:44.867731+0000","last_clean":"2026-02-23T06:51:44.867731+0000","last_became_active":"2026-02-23T06:21:17.144017+0000","last_became_peered":"2026-02-23T06:21:17.144017+0000","last_unstale":"2026-02-23T06:51:44.867731+0000","last_undegraded":"2026-02-23T06:51:44.867731+0000","last_fullsized":"2026-02-23T06:51:44.867731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:51:44.867687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:51:44.867687+0000","last_clean_scrub_stamp":"2026-02-23T06:51:44.867687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:17:40.648805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'2599","reported_seq":2639,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:55.378216+0000","last_change":"2026-02-23T06:51:55.378216+0000","last_active":"2026-02-23T06:51:55.378216+0000","last_peered":"2026-02-23T06:51:55.378216+0000","last_clean":"2026-02-23T06:51:55.378216+0000","last_became_active":"2026-02-23T06:21:22.174683+0000","last_became_peered":"2026-02-23T06:21:22.174683+0000","last_unstale":"2026-02-23T06:51:55.378216+0000","last_undegraded":"2026-02-23T06:51:55.378216+0000","last_fullsized":"2026-02-23T06:51:55.378216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2599","last_scrub_stamp":"2026-02-23T06:51:55.378175+0000","last_deep_scrub":"27'2599","last_deep_scrub_stamp":"2026-02-23T06:51:55.378175+0000","last_clean_scrub_stamp":"2026-02-23T06:51:55.378175+0000","objects_scrubbed":0,"log_size":2599,"log_dups_size":0,"ondisk_log_size":2599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:48:03.569902+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32970,"num_write_kb":1504117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'9","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:46.197485+0000","last_change":"2026-02-23T06:51:46.197485+0000","last_active":"2026-02-23T06:51:46.197485+0000","last_peered":"2026-02-23T06:51:46.197485+0000","last_clean":"2026-02-23T06:51:46.197485+0000","last_became_active":"2026-02-23T06:21:18.145231+0000","last_became_peered":"2026-02-23T06:21:18.145231+0000","last_unstale":"2026-02-23T06:51:46.197485+0000","last_undegraded":"2026-02-23T06:51:46.197485+0000","last_fullsized":"2026-02-23T06:51:46.197485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2026-02-23T06:51:46.197442+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2026-02-23T06:51:46.197442+0000","last_clean_scrub_stamp":"2026-02-23T06:51:46.197442+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:30:10.234524+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'3","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:43.004448+0000","last_change":"2026-02-23T06:51:43.004448+0000","last_active":"2026-02-23T06:51:43.004448+0000","last_peered":"2026-02-23T06:51:43.004448+0000","last_clean":"2026-02-23T06:51:43.004448+0000","last_became_active":"2026-02-23T06:21:17.147431+0000","last_became_peered":"2026-02-23T06:21:17.147431+0000","last_unstale":"2026-02-23T06:51:43.004448+0000","last_undegraded":"2026-02-23T06:51:43.004448+0000","last_fullsized":"2026-02-23T06:51:43.004448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2026-02-23T06:51:43.004418+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2026-02-23T06:51:43.004418+0000","last_clean_scrub_stamp":"2026-02-23T06:51:43.004418+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:35:53.658192+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'2099","reported_seq":2139,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:53.274173+0000","last_change":"2026-02-23T06:51:53.274173+0000","last_active":"2026-02-23T06:51:53.274173+0000","last_peered":"2026-02-23T06:51:53.274173+0000","last_clean":"2026-02-23T06:51:53.274173+0000","last_became_active":"2026-02-23T06:21:22.175493+0000","last_became_peered":"2026-02-23T06:21:22.175493+0000","last_unstale":"2026-02-23T06:51:53.274173+0000","last_undegraded":"2026-02-23T06:51:53.274173+0000","last_fullsized":"2026-02-23T06:51:53.274173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2099","last_scrub_stamp":"2026-02-23T06:51:53.274132+0000","last_deep_scrub":"27'2099","last_deep_scrub_stamp":"2026-02-23T06:51:53.274132+0000","last_clean_scrub_stamp":"2026-02-23T06:51:53.274132+0000","objects_scrubbed":0,"log_size":2099,"log_dups_size":0,"ondisk_log_size":2099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:11:56.138422+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25611,"num_write_kb":1337535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'25","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:52.845994+0000","last_change":"2026-02-23T06:51:52.845994+0000","last_active":"2026-02-23T06:51:52.845994+0000","last_peered":"2026-02-23T06:51:52.845994+0000","last_clean":"2026-02-23T06:51:52.845994+0000","last_became_active":"2026-02-23T06:21:18.141277+0000","last_became_peered":"2026-02-23T06:21:18.141277+0000","last_unstale":"2026-02-23T06:51:52.845994+0000","last_undegraded":"2026-02-23T06:51:52.845994+0000","last_fullsized":"2026-02-23T06:51:52.845994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2026-02-23T06:51:52.845944+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2026-02-23T06:51:52.845944+0000","last_clean_scrub_stamp":"2026-02-23T06:51:52.845944+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:12:13.212674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'7","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:45.171312+0000","last_change":"2026-02-23T06:51:45.171312+0000","last_active":"2026-02-23T06:51:45.171312+0000","last_peered":"2026-02-23T06:51:45.171312+0000","last_clean":"2026-02-23T06:51:45.171312+0000","last_became_active":"2026-02-23T06:21:17.148424+0000","last_became_peered":"2026-02-23T06:21:17.148424+0000","last_unstale":"2026-02-23T06:51:45.171312+0000","last_undegraded":"2026-02-23T06:51:45.171312+0000","last_fullsized":"2026-02-23T06:51:45.171312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2026-02-23T06:51:45.171254+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2026-02-23T06:51:45.171254+0000","last_clean_scrub_stamp":"2026-02-23T06:51:45.171254+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:14:31.321439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'1635","reported_seq":1676,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:47.200857+0000","last_change":"2026-02-23T06:51:47.200857+0000","last_active":"2026-02-23T06:51:47.200857+0000","last_peered":"2026-02-23T06:51:47.200857+0000","last_clean":"2026-02-23T06:51:47.200857+0000","last_became_active":"2026-02-23T06:21:22.170496+0000","last_became_peered":"2026-02-23T06:21:22.170496+0000","last_unstale":"2026-02-23T06:51:47.200857+0000","last_undegraded":"2026-02-23T06:51:47.200857+0000","last_fullsized":"2026-02-23T06:51:47.200857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1635","last_scrub_stamp":"2026-02-23T06:51:47.200826+0000","last_deep_scrub":"27'1635","last_deep_scrub_stamp":"2026-02-23T06:51:47.200826+0000","last_clean_scrub_stamp":"2026-02-23T06:51:47.200826+0000","objects_scrubbed":0,"log_size":1635,"log_dups_size":0,"ondisk_log_size":1635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:59:36.346424+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20598,"num_write_kb":974984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'18","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:50.860931+0000","last_change":"2026-02-23T06:51:50.860931+0000","last_active":"2026-02-23T06:51:50.860931+0000","last_peered":"2026-02-23T06:51:50.860931+0000","last_clean":"2026-02-23T06:51:50.860931+0000","last_became_active":"2026-02-23T06:21:18.141771+0000","last_became_peered":"2026-02-23T06:21:18.141771+0000","last_unstale":"2026-02-23T06:51:50.860931+0000","last_undegraded":"2026-02-23T06:51:50.860931+0000","last_fullsized":"2026-02-23T06:51:50.860931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2026-02-23T06:51:50.860889+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2026-02-23T06:51:50.860889+0000","last_clean_scrub_stamp":"2026-02-23T06:51:50.860889+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:58:54.999496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'156","reported_seq":204,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:46.844509+0000","last_change":"2026-02-23T06:51:46.844509+0000","last_active":"2026-02-23T06:51:46.844509+0000","last_peered":"2026-02-23T06:51:46.844509+0000","last_clean":"2026-02-23T06:51:46.844509+0000","last_became_active":"2026-02-23T06:21:17.142203+0000","last_became_peered":"2026-02-23T06:21:17.142203+0000","last_unstale":"2026-02-23T06:51:46.844509+0000","last_undegraded":"2026-02-23T06:51:46.844509+0000","last_fullsized":"2026-02-23T06:51:46.844509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'156","last_scrub_stamp":"2026-02-23T06:51:46.844474+0000","last_deep_scrub":"27'156","last_deep_scrub_stamp":"2026-02-23T06:51:46.844474+0000","last_clean_scrub_stamp":"2026-02-23T06:51:46.844474+0000","objects_scrubbed":1,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:47:15.311449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'1598","reported_seq":1640,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:57.785992+0000","last_change":"2026-02-23T06:51:57.785992+0000","last_active":"2026-02-23T06:51:57.785992+0000","last_peered":"2026-02-23T06:51:57.785992+0000","last_clean":"2026-02-23T06:51:57.785992+0000","last_became_active":"2026-02-23T06:21:22.168375+0000","last_became_peered":"2026-02-23T06:21:22.168375+0000","last_unstale":"2026-02-23T06:51:57.785992+0000","last_undegraded":"2026-02-23T06:51:57.785992+0000","last_fullsized":"2026-02-23T06:51:57.785992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1598","last_scrub_stamp":"2026-02-23T06:51:57.785932+0000","last_deep_scrub":"27'1598","last_deep_scrub_stamp":"2026-02-23T06:51:57.785932+0000","last_clean_scrub_stamp":"2026-02-23T06:51:57.785932+0000","objects_scrubbed":0,"log_size":1598,"log_dups_size":0,"ondisk_log_size":1598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:15:04.787137+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18683,"num_write_kb":1083504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'19","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:50.507226+0000","last_change":"2026-02-23T06:51:50.507226+0000","last_active":"2026-02-23T06:51:50.507226+0000","last_peered":"2026-02-23T06:51:50.507226+0000","last_clean":"2026-02-23T06:51:50.507226+0000","last_became_active":"2026-02-23T06:21:18.141363+0000","last_became_peered":"2026-02-23T06:21:18.141363+0000","last_unstale":"2026-02-23T06:51:50.507226+0000","last_undegraded":"2026-02-23T06:51:50.507226+0000","last_fullsized":"2026-02-23T06:51:50.507226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2026-02-23T06:51:50.507144+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2026-02-23T06:51:50.507144+0000","last_clean_scrub_stamp":"2026-02-23T06:51:50.507144+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:36:39.585200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:54.171806+0000","last_change":"2026-02-23T06:51:54.171806+0000","last_active":"2026-02-23T06:51:54.171806+0000","last_peered":"2026-02-23T06:51:54.171806+0000","last_clean":"2026-02-23T06:51:54.171806+0000","last_became_active":"2026-02-23T06:21:17.144515+0000","last_became_peered":"2026-02-23T06:21:17.144515+0000","last_unstale":"2026-02-23T06:51:54.171806+0000","last_undegraded":"2026-02-23T06:51:54.171806+0000","last_fullsized":"2026-02-23T06:51:54.171806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2026-02-23T06:51:54.171758+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2026-02-23T06:51:54.171758+0000","last_clean_scrub_stamp":"2026-02-23T06:51:54.171758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:20:56.193628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'2041","reported_seq":2082,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:56.535882+0000","last_change":"2026-02-23T06:51:56.535882+0000","last_active":"2026-02-23T06:51:56.535882+0000","last_peered":"2026-02-23T06:51:56.535882+0000","last_clean":"2026-02-23T06:51:56.535882+0000","last_became_active":"2026-02-23T06:21:22.171165+0000","last_became_peered":"2026-02-23T06:21:22.171165+0000","last_unstale":"2026-02-23T06:51:56.535882+0000","last_undegraded":"2026-02-23T06:51:56.535882+0000","last_fullsized":"2026-02-23T06:51:56.535882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2041","last_scrub_stamp":"2026-02-23T06:51:56.535845+0000","last_deep_scrub":"27'2041","last_deep_scrub_stamp":"2026-02-23T06:51:56.535845+0000","last_clean_scrub_stamp":"2026-02-23T06:51:56.535845+0000","objects_scrubbed":0,"log_size":2041,"log_dups_size":0,"ondisk_log_size":2041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:13:48.307561+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25015,"num_write_kb":1370848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'16","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.244222+0000","last_change":"2026-02-23T06:51:44.244222+0000","last_active":"2026-02-23T06:51:44.244222+0000","last_peered":"2026-02-23T06:51:44.244222+0000","last_clean":"2026-02-23T06:51:44.244222+0000","last_became_active":"2026-02-23T06:21:18.143585+0000","last_became_peered":"2026-02-23T06:21:18.143585+0000","last_unstale":"2026-02-23T06:51:44.244222+0000","last_undegraded":"2026-02-23T06:51:44.244222+0000","last_fullsized":"2026-02-23T06:51:44.244222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2026-02-23T06:51:44.244168+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2026-02-23T06:51:44.244168+0000","last_clean_scrub_stamp":"2026-02-23T06:51:44.244168+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:55:59.183203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:45.456526+0000","last_change":"2026-02-23T06:51:45.456526+0000","last_active":"2026-02-23T06:51:45.456526+0000","last_peered":"2026-02-23T06:51:45.456526+0000","last_clean":"2026-02-23T06:51:45.456526+0000","last_became_active":"2026-02-23T06:21:17.137386+0000","last_became_peered":"2026-02-23T06:21:17.137386+0000","last_unstale":"2026-02-23T06:51:45.456526+0000","last_undegraded":"2026-02-23T06:51:45.456526+0000","last_fullsized":"2026-02-23T06:51:45.456526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:51:45.456474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:51:45.456474+0000","last_clean_scrub_stamp":"2026-02-23T06:51:45.456474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:45:53.557202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'1858","reported_seq":1899,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:55.548434+0000","last_change":"2026-02-23T06:51:55.548434+0000","last_active":"2026-02-23T06:51:55.548434+0000","last_peered":"2026-02-23T06:51:55.548434+0000","last_clean":"2026-02-23T06:51:55.548434+0000","last_became_active":"2026-02-23T06:21:22.162891+0000","last_became_peered":"2026-02-23T06:21:22.162891+0000","last_unstale":"2026-02-23T06:51:55.548434+0000","last_undegraded":"2026-02-23T06:51:55.548434+0000","last_fullsized":"2026-02-23T06:51:55.548434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1858","last_scrub_stamp":"2026-02-23T06:51:55.548381+0000","last_deep_scrub":"27'1858","last_deep_scrub_stamp":"2026-02-23T06:51:55.548381+0000","last_clean_scrub_stamp":"2026-02-23T06:51:55.548381+0000","objects_scrubbed":0,"log_size":1858,"log_dups_size":0,"ondisk_log_size":1858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:28:20.371419+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22843,"num_write_kb":1167007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'16","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:48.071272+0000","last_change":"2026-02-23T06:51:48.071272+0000","last_active":"2026-02-23T06:51:48.071272+0000","last_peered":"2026-02-23T06:51:48.071272+0000","last_clean":"2026-02-23T06:51:48.071272+0000","last_became_active":"2026-02-23T06:21:18.152102+0000","last_became_peered":"2026-02-23T06:21:18.152102+0000","last_unstale":"2026-02-23T06:51:48.071272+0000","last_undegraded":"2026-02-23T06:51:48.071272+0000","last_fullsized":"2026-02-23T06:51:48.071272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2026-02-23T06:51:48.071239+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2026-02-23T06:51:48.071239+0000","last_clean_scrub_stamp":"2026-02-23T06:51:48.071239+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:54:16.518384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:48.163161+0000","last_change":"2026-02-23T06:51:48.163161+0000","last_active":"2026-02-23T06:51:48.163161+0000","last_peered":"2026-02-23T06:51:48.163161+0000","last_clean":"2026-02-23T06:51:48.163161+0000","last_became_active":"2026-02-23T06:21:17.143201+0000","last_became_peered":"2026-02-23T06:21:17.143201+0000","last_unstale":"2026-02-23T06:51:48.163161+0000","last_undegraded":"2026-02-23T06:51:48.163161+0000","last_fullsized":"2026-02-23T06:51:48.163161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:51:48.163119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:51:48.163119+0000","last_clean_scrub_stamp":"2026-02-23T06:51:48.163119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:11:31.231663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'1993","reported_seq":2034,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:58.595693+0000","last_change":"2026-02-23T06:51:58.595693+0000","last_active":"2026-02-23T06:51:58.595693+0000","last_peered":"2026-02-23T06:51:58.595693+0000","last_clean":"2026-02-23T06:51:58.595693+0000","last_became_active":"2026-02-23T06:21:22.163734+0000","last_became_peered":"2026-02-23T06:21:22.163734+0000","last_unstale":"2026-02-23T06:51:58.595693+0000","last_undegraded":"2026-02-23T06:51:58.595693+0000","last_fullsized":"2026-02-23T06:51:58.595693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1993","last_scrub_stamp":"2026-02-23T06:51:58.595663+0000","last_deep_scrub":"27'1993","last_deep_scrub_stamp":"2026-02-23T06:51:58.595663+0000","last_clean_scrub_stamp":"2026-02-23T06:51:58.595663+0000","objects_scrubbed":0,"log_size":1993,"log_dups_size":0,"ondisk_log_size":1993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:35:47.427464+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24426,"num_write_kb":1329645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'24","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:50.542466+0000","last_change":"2026-02-23T06:51:50.542466+0000","last_active":"2026-02-23T06:51:50.542466+0000","last_peered":"2026-02-23T06:51:50.542466+0000","last_clean":"2026-02-23T06:51:50.542466+0000","last_became_active":"2026-02-23T06:21:18.141350+0000","last_became_peered":"2026-02-23T06:21:18.141350+0000","last_unstale":"2026-02-23T06:51:50.542466+0000","last_undegraded":"2026-02-23T06:51:50.542466+0000","last_fullsized":"2026-02-23T06:51:50.542466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2026-02-23T06:51:50.542430+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2026-02-23T06:51:50.542430+0000","last_clean_scrub_stamp":"2026-02-23T06:51:50.542430+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:33:47.382917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'33","reported_seq":114,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:46.136187+0000","last_change":"2026-02-23T06:51:46.136187+0000","last_active":"2026-02-23T06:51:46.136187+0000","last_peered":"2026-02-23T06:51:46.136187+0000","last_clean":"2026-02-23T06:51:46.136187+0000","last_became_active":"2026-02-23T06:21:17.139200+0000","last_became_peered":"2026-02-23T06:21:17.139200+0000","last_unstale":"2026-02-23T06:51:46.136187+0000","last_undegraded":"2026-02-23T06:51:46.136187+0000","last_fullsized":"2026-02-23T06:51:46.136187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2026-02-23T06:51:46.136156+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2026-02-23T06:51:46.136156+0000","last_clean_scrub_stamp":"2026-02-23T06:51:46.136156+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:16:51.413322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82634,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":104,"num_write":32,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'1776","reported_seq":1817,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:57.577597+0000","last_change":"2026-02-23T06:51:57.577597+0000","last_active":"2026-02-23T06:51:57.577597+0000","last_peered":"2026-02-23T06:51:57.577597+0000","last_clean":"2026-02-23T06:51:57.577597+0000","last_became_active":"2026-02-23T06:21:22.164667+0000","last_became_peered":"2026-02-23T06:21:22.164667+0000","last_unstale":"2026-02-23T06:51:57.577597+0000","last_undegraded":"2026-02-23T06:51:57.577597+0000","last_fullsized":"2026-02-23T06:51:57.577597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1776","last_scrub_stamp":"2026-02-23T06:51:57.577449+0000","last_deep_scrub":"27'1776","last_deep_scrub_stamp":"2026-02-23T06:51:57.577449+0000","last_clean_scrub_stamp":"2026-02-23T06:51:57.577449+0000","objects_scrubbed":0,"log_size":1776,"log_dups_size":0,"ondisk_log_size":1776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:17:29.865112+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22128,"num_write_kb":1081444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'12","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:48.557722+0000","last_change":"2026-02-23T06:51:48.557722+0000","last_active":"2026-02-23T06:51:48.557722+0000","last_peered":"2026-02-23T06:51:48.557722+0000","last_clean":"2026-02-23T06:51:48.557722+0000","last_became_active":"2026-02-23T06:21:18.146491+0000","last_became_peered":"2026-02-23T06:21:18.146491+0000","last_unstale":"2026-02-23T06:51:48.557722+0000","last_undegraded":"2026-02-23T06:51:48.557722+0000","last_fullsized":"2026-02-23T06:51:48.557722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2026-02-23T06:51:48.557683+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2026-02-23T06:51:48.557683+0000","last_clean_scrub_stamp":"2026-02-23T06:51:48.557683+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:46:43.720194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'5","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.210074+0000","last_change":"2026-02-23T06:51:44.210074+0000","last_active":"2026-02-23T06:51:44.210074+0000","last_peered":"2026-02-23T06:51:44.210074+0000","last_clean":"2026-02-23T06:51:44.210074+0000","last_became_active":"2026-02-23T06:21:17.143050+0000","last_became_peered":"2026-02-23T06:21:17.143050+0000","last_unstale":"2026-02-23T06:51:44.210074+0000","last_undegraded":"2026-02-23T06:51:44.210074+0000","last_fullsized":"2026-02-23T06:51:44.210074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2026-02-23T06:51:44.210030+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2026-02-23T06:51:44.210030+0000","last_clean_scrub_stamp":"2026-02-23T06:51:44.210030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:34:15.364761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'1711","reported_seq":1752,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:52:00.669576+0000","last_change":"2026-02-23T06:52:00.669576+0000","last_active":"2026-02-23T06:52:00.669576+0000","last_peered":"2026-02-23T06:52:00.669576+0000","last_clean":"2026-02-23T06:52:00.669576+0000","last_became_active":"2026-02-23T06:21:22.168510+0000","last_became_peered":"2026-02-23T06:21:22.168510+0000","last_unstale":"2026-02-23T06:52:00.669576+0000","last_undegraded":"2026-02-23T06:52:00.669576+0000","last_fullsized":"2026-02-23T06:52:00.669576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1711","last_scrub_stamp":"2026-02-23T06:52:00.669542+0000","last_deep_scrub":"27'1711","last_deep_scrub_stamp":"2026-02-23T06:52:00.669542+0000","last_clean_scrub_stamp":"2026-02-23T06:52:00.669542+0000","objects_scrubbed":0,"log_size":1711,"log_dups_size":0,"ondisk_log_size":1711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:51:30.193026+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20193,"num_write_kb":1220870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'13","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:47.877294+0000","last_change":"2026-02-23T06:51:47.877294+0000","last_active":"2026-02-23T06:51:47.877294+0000","last_peered":"2026-02-23T06:51:47.877294+0000","last_clean":"2026-02-23T06:51:47.877294+0000","last_became_active":"2026-02-23T06:21:18.145214+0000","last_became_peered":"2026-02-23T06:21:18.145214+0000","last_unstale":"2026-02-23T06:51:47.877294+0000","last_undegraded":"2026-02-23T06:51:47.877294+0000","last_fullsized":"2026-02-23T06:51:47.877294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2026-02-23T06:51:47.877220+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2026-02-23T06:51:47.877220+0000","last_clean_scrub_stamp":"2026-02-23T06:51:47.877220+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:15:11.644573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'2","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:50.147326+0000","last_change":"2026-02-23T06:51:50.147326+0000","last_active":"2026-02-23T06:51:50.147326+0000","last_peered":"2026-02-23T06:51:50.147326+0000","last_clean":"2026-02-23T06:51:50.147326+0000","last_became_active":"2026-02-23T06:21:17.147619+0000","last_became_peered":"2026-02-23T06:21:17.147619+0000","last_unstale":"2026-02-23T06:51:50.147326+0000","last_undegraded":"2026-02-23T06:51:50.147326+0000","last_fullsized":"2026-02-23T06:51:50.147326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2026-02-23T06:51:50.147279+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2026-02-23T06:51:50.147279+0000","last_clean_scrub_stamp":"2026-02-23T06:51:50.147279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:23:54.754439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'114","reported_seq":193,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:43.646452+0000","last_change":"2026-02-23T06:51:43.646452+0000","last_active":"2026-02-23T06:51:43.646452+0000","last_peered":"2026-02-23T06:51:43.646452+0000","last_clean":"2026-02-23T06:51:43.646452+0000","last_became_active":"2026-02-23T06:21:11.397664+0000","last_became_peered":"2026-02-23T06:21:11.397664+0000","last_unstale":"2026-02-23T06:51:43.646452+0000","last_undegraded":"2026-02-23T06:51:43.646452+0000","last_fullsized":"2026-02-23T06:51:43.646452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'114","last_scrub_stamp":"2026-02-23T06:51:43.646193+0000","last_deep_scrub":"27'114","last_deep_scrub_stamp":"2026-02-23T06:51:43.646193+0000","last_clean_scrub_stamp":"2026-02-23T06:51:43.646193+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:33:02.284722+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'1620","reported_seq":1661,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:52:04.038295+0000","last_change":"2026-02-23T06:52:04.038295+0000","last_active":"2026-02-23T06:52:04.038295+0000","last_peered":"2026-02-23T06:52:04.038295+0000","last_clean":"2026-02-23T06:52:04.038295+0000","last_became_active":"2026-02-23T06:21:22.174253+0000","last_became_peered":"2026-02-23T06:21:22.174253+0000","last_unstale":"2026-02-23T06:52:04.038295+0000","last_undegraded":"2026-02-23T06:52:04.038295+0000","last_fullsized":"2026-02-23T06:52:04.038295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1620","last_scrub_stamp":"2026-02-23T06:52:04.038259+0000","last_deep_scrub":"27'1620","last_deep_scrub_stamp":"2026-02-23T06:52:04.038259+0000","last_clean_scrub_stamp":"2026-02-23T06:52:04.038259+0000","objects_scrubbed":0,"log_size":1620,"log_dups_size":0,"ondisk_log_size":1620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:07:15.012531+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19229,"num_write_kb":1122014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'18","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:49.114438+0000","last_change":"2026-02-23T06:51:49.114438+0000","last_active":"2026-02-23T06:51:49.114438+0000","last_peered":"2026-02-23T06:51:49.114438+0000","last_clean":"2026-02-23T06:51:49.114438+0000","last_became_active":"2026-02-23T06:21:18.150501+0000","last_became_peered":"2026-02-23T06:21:18.150501+0000","last_unstale":"2026-02-23T06:51:49.114438+0000","last_undegraded":"2026-02-23T06:51:49.114438+0000","last_fullsized":"2026-02-23T06:51:49.114438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2026-02-23T06:51:49.114411+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2026-02-23T06:51:49.114411+0000","last_clean_scrub_stamp":"2026-02-23T06:51:49.114411+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:11:26.246425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:45.506894+0000","last_change":"2026-02-23T06:51:45.506894+0000","last_active":"2026-02-23T06:51:45.506894+0000","last_peered":"2026-02-23T06:51:45.506894+0000","last_clean":"2026-02-23T06:51:45.506894+0000","last_became_active":"2026-02-23T06:21:17.145938+0000","last_became_peered":"2026-02-23T06:21:17.145938+0000","last_unstale":"2026-02-23T06:51:45.506894+0000","last_undegraded":"2026-02-23T06:51:45.506894+0000","last_fullsized":"2026-02-23T06:51:45.506894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2026-02-23T06:51:45.506851+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2026-02-23T06:51:45.506851+0000","last_clean_scrub_stamp":"2026-02-23T06:51:45.506851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:17.525225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'1607","reported_seq":1648,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:51.242055+0000","last_change":"2026-02-23T06:51:51.242055+0000","last_active":"2026-02-23T06:51:51.242055+0000","last_peered":"2026-02-23T06:51:51.242055+0000","last_clean":"2026-02-23T06:51:51.242055+0000","last_became_active":"2026-02-23T06:21:22.171828+0000","last_became_peered":"2026-02-23T06:21:22.171828+0000","last_unstale":"2026-02-23T06:51:51.242055+0000","last_undegraded":"2026-02-23T06:51:51.242055+0000","last_fullsized":"2026-02-23T06:51:51.242055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1607","last_scrub_stamp":"2026-02-23T06:51:51.242019+0000","last_deep_scrub":"27'1607","last_deep_scrub_stamp":"2026-02-23T06:51:51.242019+0000","last_clean_scrub_stamp":"2026-02-23T06:51:51.242019+0000","objects_scrubbed":0,"log_size":1607,"log_dups_size":0,"ondisk_log_size":1607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:25:49.522299+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19213,"num_write_kb":1080158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'19","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:51.118812+0000","last_change":"2026-02-23T06:51:51.118812+0000","last_active":"2026-02-23T06:51:51.118812+0000","last_peered":"2026-02-23T06:51:51.118812+0000","last_clean":"2026-02-23T06:51:51.118812+0000","last_became_active":"2026-02-23T06:21:18.146977+0000","last_became_peered":"2026-02-23T06:21:18.146977+0000","last_unstale":"2026-02-23T06:51:51.118812+0000","last_undegraded":"2026-02-23T06:51:51.118812+0000","last_fullsized":"2026-02-23T06:51:51.118812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2026-02-23T06:51:51.118774+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2026-02-23T06:51:51.118774+0000","last_clean_scrub_stamp":"2026-02-23T06:51:51.118774+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:50:05.146333+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'5","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:46.503161+0000","last_change":"2026-02-23T06:51:46.503161+0000","last_active":"2026-02-23T06:51:46.503161+0000","last_peered":"2026-02-23T06:51:46.503161+0000","last_clean":"2026-02-23T06:51:46.503161+0000","last_became_active":"2026-02-23T06:21:17.139209+0000","last_became_peered":"2026-02-23T06:21:17.139209+0000","last_unstale":"2026-02-23T06:51:46.503161+0000","last_undegraded":"2026-02-23T06:51:46.503161+0000","last_fullsized":"2026-02-23T06:51:46.503161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2026-02-23T06:51:46.503113+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2026-02-23T06:51:46.503113+0000","last_clean_scrub_stamp":"2026-02-23T06:51:46.503113+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:14:20.858888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'2329","reported_seq":2369,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:52:01.711102+0000","last_change":"2026-02-23T06:52:01.711102+0000","last_active":"2026-02-23T06:52:01.711102+0000","last_peered":"2026-02-23T06:52:01.711102+0000","last_clean":"2026-02-23T06:52:01.711102+0000","last_became_active":"2026-02-23T06:21:22.162777+0000","last_became_peered":"2026-02-23T06:21:22.162777+0000","last_unstale":"2026-02-23T06:52:01.711102+0000","last_undegraded":"2026-02-23T06:52:01.711102+0000","last_fullsized":"2026-02-23T06:52:01.711102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2329","last_scrub_stamp":"2026-02-23T06:52:01.711052+0000","last_deep_scrub":"27'2329","last_deep_scrub_stamp":"2026-02-23T06:52:01.711052+0000","last_clean_scrub_stamp":"2026-02-23T06:52:01.711052+0000","objects_scrubbed":0,"log_size":2329,"log_dups_size":0,"ondisk_log_size":2329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:04:43.453469+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28609,"num_write_kb":1525996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'20","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:50.069021+0000","last_change":"2026-02-23T06:51:50.069021+0000","last_active":"2026-02-23T06:51:50.069021+0000","last_peered":"2026-02-23T06:51:50.069021+0000","last_clean":"2026-02-23T06:51:50.069021+0000","last_became_active":"2026-02-23T06:21:18.149038+0000","last_became_peered":"2026-02-23T06:21:18.149038+0000","last_unstale":"2026-02-23T06:51:50.069021+0000","last_undegraded":"2026-02-23T06:51:50.069021+0000","last_fullsized":"2026-02-23T06:51:50.069021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2026-02-23T06:51:50.068980+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2026-02-23T06:51:50.068980+0000","last_clean_scrub_stamp":"2026-02-23T06:51:50.068980+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:33:38.653012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'6","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:49.898828+0000","last_change":"2026-02-23T06:51:49.898828+0000","last_active":"2026-02-23T06:51:49.898828+0000","last_peered":"2026-02-23T06:51:49.898828+0000","last_clean":"2026-02-23T06:51:49.898828+0000","last_became_active":"2026-02-23T06:21:17.137476+0000","last_became_peered":"2026-02-23T06:21:17.137476+0000","last_unstale":"2026-02-23T06:51:49.898828+0000","last_undegraded":"2026-02-23T06:51:49.898828+0000","last_fullsized":"2026-02-23T06:51:49.898828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2026-02-23T06:51:49.898794+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2026-02-23T06:51:49.898794+0000","last_clean_scrub_stamp":"2026-02-23T06:51:49.898794+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:41:35.053874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'1646","reported_seq":1687,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:52:09.030945+0000","last_change":"2026-02-23T06:52:09.030945+0000","last_active":"2026-02-23T06:52:09.030945+0000","last_peered":"2026-02-23T06:52:09.030945+0000","last_clean":"2026-02-23T06:52:09.030945+0000","last_became_active":"2026-02-23T06:21:22.173501+0000","last_became_peered":"2026-02-23T06:21:22.173501+0000","last_unstale":"2026-02-23T06:52:09.030945+0000","last_undegraded":"2026-02-23T06:52:09.030945+0000","last_fullsized":"2026-02-23T06:52:09.030945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1646","last_scrub_stamp":"2026-02-23T06:52:09.030897+0000","last_deep_scrub":"27'1646","last_deep_scrub_stamp":"2026-02-23T06:52:09.030897+0000","last_clean_scrub_stamp":"2026-02-23T06:52:09.030897+0000","objects_scrubbed":0,"log_size":1646,"log_dups_size":0,"ondisk_log_size":1646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:48:52.655425+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20219,"num_write_kb":1002716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'12","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:45.281560+0000","last_change":"2026-02-23T06:51:45.281560+0000","last_active":"2026-02-23T06:51:45.281560+0000","last_peered":"2026-02-23T06:51:45.281560+0000","last_clean":"2026-02-23T06:51:45.281560+0000","last_became_active":"2026-02-23T06:21:18.154271+0000","last_became_peered":"2026-02-23T06:21:18.154271+0000","last_unstale":"2026-02-23T06:51:45.281560+0000","last_undegraded":"2026-02-23T06:51:45.281560+0000","last_fullsized":"2026-02-23T06:51:45.281560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2026-02-23T06:51:45.281522+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2026-02-23T06:51:45.281522+0000","last_clean_scrub_stamp":"2026-02-23T06:51:45.281522+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:21:47.810451+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.037316+0000","last_change":"2026-02-23T06:51:44.037316+0000","last_active":"2026-02-23T06:51:44.037316+0000","last_peered":"2026-02-23T06:51:44.037316+0000","last_clean":"2026-02-23T06:51:44.037316+0000","last_became_active":"2026-02-23T06:21:17.144914+0000","last_became_peered":"2026-02-23T06:21:17.144914+0000","last_unstale":"2026-02-23T06:51:44.037316+0000","last_undegraded":"2026-02-23T06:51:44.037316+0000","last_fullsized":"2026-02-23T06:51:44.037316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2026-02-23T06:51:44.037272+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2026-02-23T06:51:44.037272+0000","last_clean_scrub_stamp":"2026-02-23T06:51:44.037272+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:57:15.925199+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'1740","reported_seq":1781,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:50.714103+0000","last_change":"2026-02-23T06:51:50.714103+0000","last_active":"2026-02-23T06:51:50.714103+0000","last_peered":"2026-02-23T06:51:50.714103+0000","last_clean":"2026-02-23T06:51:50.714103+0000","last_became_active":"2026-02-23T06:21:22.168516+0000","last_became_peered":"2026-02-23T06:21:22.168516+0000","last_unstale":"2026-02-23T06:51:50.714103+0000","last_undegraded":"2026-02-23T06:51:50.714103+0000","last_fullsized":"2026-02-23T06:51:50.714103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1740","last_scrub_stamp":"2026-02-23T06:51:50.714061+0000","last_deep_scrub":"27'1740","last_deep_scrub_stamp":"2026-02-23T06:51:50.714061+0000","last_clean_scrub_stamp":"2026-02-23T06:51:50.714061+0000","objects_scrubbed":0,"log_size":1740,"log_dups_size":0,"ondisk_log_size":1740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:17:42.058319+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20956,"num_write_kb":1166144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'20","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:47.157767+0000","last_change":"2026-02-23T06:51:47.157767+0000","last_active":"2026-02-23T06:51:47.157767+0000","last_peered":"2026-02-23T06:51:47.157767+0000","last_clean":"2026-02-23T06:51:47.157767+0000","last_became_active":"2026-02-23T06:21:18.152381+0000","last_became_peered":"2026-02-23T06:21:18.152381+0000","last_unstale":"2026-02-23T06:51:47.157767+0000","last_undegraded":"2026-02-23T06:51:47.157767+0000","last_fullsized":"2026-02-23T06:51:47.157767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2026-02-23T06:51:47.157728+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2026-02-23T06:51:47.157728+0000","last_clean_scrub_stamp":"2026-02-23T06:51:47.157728+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:44:21.145745+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'17","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:45.873384+0000","last_change":"2026-02-23T06:51:45.873384+0000","last_active":"2026-02-23T06:51:45.873384+0000","last_peered":"2026-02-23T06:51:45.873384+0000","last_clean":"2026-02-23T06:51:45.873384+0000","last_became_active":"2026-02-23T06:21:17.137101+0000","last_became_peered":"2026-02-23T06:21:17.137101+0000","last_unstale":"2026-02-23T06:51:45.873384+0000","last_undegraded":"2026-02-23T06:51:45.873384+0000","last_fullsized":"2026-02-23T06:51:45.873384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2026-02-23T06:51:45.873346+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2026-02-23T06:51:45.873346+0000","last_clean_scrub_stamp":"2026-02-23T06:51:45.873346+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:08:14.272959+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'2377","reported_seq":2416,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:52:04.719989+0000","last_change":"2026-02-23T06:52:04.719989+0000","last_active":"2026-02-23T06:52:04.719989+0000","last_peered":"2026-02-23T06:52:04.719989+0000","last_clean":"2026-02-23T06:52:04.719989+0000","last_became_active":"2026-02-23T06:21:22.168603+0000","last_became_peered":"2026-02-23T06:21:22.168603+0000","last_unstale":"2026-02-23T06:52:04.719989+0000","last_undegraded":"2026-02-23T06:52:04.719989+0000","last_fullsized":"2026-02-23T06:52:04.719989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2377","last_scrub_stamp":"2026-02-23T06:52:04.719950+0000","last_deep_scrub":"27'2377","last_deep_scrub_stamp":"2026-02-23T06:52:04.719950+0000","last_clean_scrub_stamp":"2026-02-23T06:52:04.719950+0000","objects_scrubbed":0,"log_size":2377,"log_dups_size":0,"ondisk_log_size":2377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:53:28.662238+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30335,"num_write_kb":1393408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'17","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:44.674085+0000","last_change":"2026-02-23T06:51:44.674085+0000","last_active":"2026-02-23T06:51:44.674085+0000","last_peered":"2026-02-23T06:51:44.674085+0000","last_clean":"2026-02-23T06:51:44.674085+0000","last_became_active":"2026-02-23T06:21:18.143002+0000","last_became_peered":"2026-02-23T06:21:18.143002+0000","last_unstale":"2026-02-23T06:51:44.674085+0000","last_undegraded":"2026-02-23T06:51:44.674085+0000","last_fullsized":"2026-02-23T06:51:44.674085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2026-02-23T06:51:44.674037+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2026-02-23T06:51:44.674037+0000","last_clean_scrub_stamp":"2026-02-23T06:51:44.674037+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:59:51.296873+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'3","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:49.049082+0000","last_change":"2026-02-23T06:51:49.049082+0000","last_active":"2026-02-23T06:51:49.049082+0000","last_peered":"2026-02-23T06:51:49.049082+0000","last_clean":"2026-02-23T06:51:49.049082+0000","last_became_active":"2026-02-23T06:21:17.143700+0000","last_became_peered":"2026-02-23T06:21:17.143700+0000","last_unstale":"2026-02-23T06:51:49.049082+0000","last_undegraded":"2026-02-23T06:51:49.049082+0000","last_fullsized":"2026-02-23T06:51:49.049082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2026-02-23T06:51:49.049053+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2026-02-23T06:51:49.049053+0000","last_clean_scrub_stamp":"2026-02-23T06:51:49.049053+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:45:35.204711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'2195","reported_seq":2234,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:52:03.772723+0000","last_change":"2026-02-23T06:52:03.772723+0000","last_active":"2026-02-23T06:52:03.772723+0000","last_peered":"2026-02-23T06:52:03.772723+0000","last_clean":"2026-02-23T06:52:03.772723+0000","last_became_active":"2026-02-23T06:21:22.168593+0000","last_became_peered":"2026-02-23T06:21:22.168593+0000","last_unstale":"2026-02-23T06:52:03.772723+0000","last_undegraded":"2026-02-23T06:52:03.772723+0000","last_fullsized":"2026-02-23T06:52:03.772723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2195","last_scrub_stamp":"2026-02-23T06:52:03.772681+0000","last_deep_scrub":"27'2195","last_deep_scrub_stamp":"2026-02-23T06:52:03.772681+0000","last_clean_scrub_stamp":"2026-02-23T06:52:03.772681+0000","objects_scrubbed":0,"log_size":2195,"log_dups_size":0,"ondisk_log_size":2195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:58:07.568079+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27217,"num_write_kb":1335474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'32","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:58.152570+0000","last_change":"2026-02-23T06:51:58.152570+0000","last_active":"2026-02-23T06:51:58.152570+0000","last_peered":"2026-02-23T06:51:58.152570+0000","last_clean":"2026-02-23T06:51:58.152570+0000","last_became_active":"2026-02-23T06:21:18.155022+0000","last_became_peered":"2026-02-23T06:21:18.155022+0000","last_unstale":"2026-02-23T06:51:58.152570+0000","last_undegraded":"2026-02-23T06:51:58.152570+0000","last_fullsized":"2026-02-23T06:51:58.152570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'32","last_scrub_stamp":"2026-02-23T06:51:58.152543+0000","last_deep_scrub":"27'32","last_deep_scrub_stamp":"2026-02-23T06:51:58.152543+0000","last_clean_scrub_stamp":"2026-02-23T06:51:58.152543+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:23:20.015255+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:52.131472+0000","last_change":"2026-02-23T06:51:52.131472+0000","last_active":"2026-02-23T06:51:52.131472+0000","last_peered":"2026-02-23T06:51:52.131472+0000","last_clean":"2026-02-23T06:51:52.131472+0000","last_became_active":"2026-02-23T06:21:17.144052+0000","last_became_peered":"2026-02-23T06:21:17.144052+0000","last_unstale":"2026-02-23T06:51:52.131472+0000","last_undegraded":"2026-02-23T06:51:52.131472+0000","last_fullsized":"2026-02-23T06:51:52.131472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2026-02-23T06:51:52.131443+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2026-02-23T06:51:52.131443+0000","last_clean_scrub_stamp":"2026-02-23T06:51:52.131443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:01:55.188151+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'1820","reported_seq":1861,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:59.638190+0000","last_change":"2026-02-23T06:51:59.638190+0000","last_active":"2026-02-23T06:51:59.638190+0000","last_peered":"2026-02-23T06:51:59.638190+0000","last_clean":"2026-02-23T06:51:59.638190+0000","last_became_active":"2026-02-23T06:21:22.163563+0000","last_became_peered":"2026-02-23T06:21:22.163563+0000","last_unstale":"2026-02-23T06:51:59.638190+0000","last_undegraded":"2026-02-23T06:51:59.638190+0000","last_fullsized":"2026-02-23T06:51:59.638190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1820","last_scrub_stamp":"2026-02-23T06:51:59.638143+0000","last_deep_scrub":"27'1820","last_deep_scrub_stamp":"2026-02-23T06:51:59.638143+0000","last_clean_scrub_stamp":"2026-02-23T06:51:59.638143+0000","objects_scrubbed":0,"log_size":1820,"log_dups_size":0,"ondisk_log_size":1820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:42:57.145819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":3,"num_write":22577,"num_write_kb":1140198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'20","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:49.536522+0000","last_change":"2026-02-23T06:51:49.536522+0000","last_active":"2026-02-23T06:51:49.536522+0000","last_peered":"2026-02-23T06:51:49.536522+0000","last_clean":"2026-02-23T06:51:49.536522+0000","last_became_active":"2026-02-23T06:21:18.152627+0000","last_became_peered":"2026-02-23T06:21:18.152627+0000","last_unstale":"2026-02-23T06:51:49.536522+0000","last_undegraded":"2026-02-23T06:51:49.536522+0000","last_fullsized":"2026-02-23T06:51:49.536522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2026-02-23T06:51:49.536484+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2026-02-23T06:51:49.536484+0000","last_clean_scrub_stamp":"2026-02-23T06:51:49.536484+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:19:49.227979+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'5","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:47.176757+0000","last_change":"2026-02-23T06:51:47.176757+0000","last_active":"2026-02-23T06:51:47.176757+0000","last_peered":"2026-02-23T06:51:47.176757+0000","last_clean":"2026-02-23T06:51:47.176757+0000","last_became_active":"2026-02-23T06:21:17.144847+0000","last_became_peered":"2026-02-23T06:21:17.144847+0000","last_unstale":"2026-02-23T06:51:47.176757+0000","last_undegraded":"2026-02-23T06:51:47.176757+0000","last_fullsized":"2026-02-23T06:51:47.176757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2026-02-23T06:51:47.176712+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2026-02-23T06:51:47.176712+0000","last_clean_scrub_stamp":"2026-02-23T06:51:47.176712+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:15:58.908087+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5220,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'2267","reported_seq":2306,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:52:03.071819+0000","last_change":"2026-02-23T06:52:03.071819+0000","last_active":"2026-02-23T06:52:03.071819+0000","last_peered":"2026-02-23T06:52:03.071819+0000","last_clean":"2026-02-23T06:52:03.071819+0000","last_became_active":"2026-02-23T06:21:22.164057+0000","last_became_peered":"2026-02-23T06:21:22.164057+0000","last_unstale":"2026-02-23T06:52:03.071819+0000","last_undegraded":"2026-02-23T06:52:03.071819+0000","last_fullsized":"2026-02-23T06:52:03.071819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2267","last_scrub_stamp":"2026-02-23T06:52:03.071788+0000","last_deep_scrub":"27'2267","last_deep_scrub_stamp":"2026-02-23T06:52:03.071788+0000","last_clean_scrub_stamp":"2026-02-23T06:52:03.071788+0000","objects_scrubbed":0,"log_size":2267,"log_dups_size":0,"ondisk_log_size":2267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:08:04.120227+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27868,"num_write_kb":1432250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'15","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:53.122709+0000","last_change":"2026-02-23T06:51:53.122709+0000","last_active":"2026-02-23T06:51:53.122709+0000","last_peered":"2026-02-23T06:51:53.122709+0000","last_clean":"2026-02-23T06:51:53.122709+0000","last_became_active":"2026-02-23T06:21:18.147826+0000","last_became_peered":"2026-02-23T06:21:18.147826+0000","last_unstale":"2026-02-23T06:51:53.122709+0000","last_undegraded":"2026-02-23T06:51:53.122709+0000","last_fullsized":"2026-02-23T06:51:53.122709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2026-02-23T06:51:53.122648+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2026-02-23T06:51:53.122648+0000","last_clean_scrub_stamp":"2026-02-23T06:51:53.122648+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:45:29.659477+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'306","reported_seq":354,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:43.212787+0000","last_change":"2026-02-23T06:51:43.212761+0000","last_active":"2026-02-23T06:51:43.212787+0000","last_peered":"2026-02-23T06:51:43.212787+0000","last_clean":"2026-02-23T06:51:43.212787+0000","last_became_active":"2026-02-23T06:21:17.151030+0000","last_became_peered":"2026-02-23T06:21:17.151030+0000","last_unstale":"2026-02-23T06:51:43.212787+0000","last_undegraded":"2026-02-23T06:51:43.212787+0000","last_fullsized":"2026-02-23T06:51:43.212787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'306","last_scrub_stamp":"2026-02-23T06:51:43.212718+0000","last_deep_scrub":"27'306","last_deep_scrub_stamp":"2026-02-23T06:51:43.212718+0000","last_clean_scrub_stamp":"2026-02-23T06:51:43.212718+0000","objects_scrubbed":4,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:31:15.200482+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194998,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":300,"num_write_kb":4304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'1502","reported_seq":1542,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:55.807230+0000","last_change":"2026-02-23T06:51:55.807230+0000","last_active":"2026-02-23T06:51:55.807230+0000","last_peered":"2026-02-23T06:51:55.807230+0000","last_clean":"2026-02-23T06:51:55.807230+0000","last_became_active":"2026-02-23T06:21:22.164972+0000","last_became_peered":"2026-02-23T06:21:22.164972+0000","last_unstale":"2026-02-23T06:51:55.807230+0000","last_undegraded":"2026-02-23T06:51:55.807230+0000","last_fullsized":"2026-02-23T06:51:55.807230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1502","last_scrub_stamp":"2026-02-23T06:51:55.807192+0000","last_deep_scrub":"27'1502","last_deep_scrub_stamp":"2026-02-23T06:51:55.807192+0000","last_clean_scrub_stamp":"2026-02-23T06:51:55.807192+0000","objects_scrubbed":0,"log_size":1502,"log_dups_size":0,"ondisk_log_size":1502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:15:58.402337+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17024,"num_write_kb":1082863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'19","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:52:05.065480+0000","last_change":"2026-02-23T06:52:05.065480+0000","last_active":"2026-02-23T06:52:05.065480+0000","last_peered":"2026-02-23T06:52:05.065480+0000","last_clean":"2026-02-23T06:52:05.065480+0000","last_became_active":"2026-02-23T06:21:18.153052+0000","last_became_peered":"2026-02-23T06:21:18.153052+0000","last_unstale":"2026-02-23T06:52:05.065480+0000","last_undegraded":"2026-02-23T06:52:05.065480+0000","last_fullsized":"2026-02-23T06:52:05.065480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2026-02-23T06:52:05.065431+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2026-02-23T06:52:05.065431+0000","last_clean_scrub_stamp":"2026-02-23T06:52:05.065431+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:57:52.164237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'23","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:51.300242+0000","last_change":"2026-02-23T06:51:51.300242+0000","last_active":"2026-02-23T06:51:51.300242+0000","last_peered":"2026-02-23T06:51:51.300242+0000","last_clean":"2026-02-23T06:51:51.300242+0000","last_became_active":"2026-02-23T06:21:17.137479+0000","last_became_peered":"2026-02-23T06:21:17.137479+0000","last_unstale":"2026-02-23T06:51:51.300242+0000","last_undegraded":"2026-02-23T06:51:51.300242+0000","last_fullsized":"2026-02-23T06:51:51.300242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2026-02-23T06:51:51.300112+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2026-02-23T06:51:51.300112+0000","last_clean_scrub_stamp":"2026-02-23T06:51:51.300112+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:24:33.430202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'2313","reported_seq":2353,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:55.373845+0000","last_change":"2026-02-23T06:51:55.373845+0000","last_active":"2026-02-23T06:51:55.373845+0000","last_peered":"2026-02-23T06:51:55.373845+0000","last_clean":"2026-02-23T06:51:55.373845+0000","last_became_active":"2026-02-23T06:21:22.175638+0000","last_became_peered":"2026-02-23T06:21:22.175638+0000","last_unstale":"2026-02-23T06:51:55.373845+0000","last_undegraded":"2026-02-23T06:51:55.373845+0000","last_fullsized":"2026-02-23T06:51:55.373845+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2313","last_scrub_stamp":"2026-02-23T06:51:55.373813+0000","last_deep_scrub":"27'2313","last_deep_scrub_stamp":"2026-02-23T06:51:55.373813+0000","last_clean_scrub_stamp":"2026-02-23T06:51:55.373813+0000","objects_scrubbed":0,"log_size":2313,"log_dups_size":0,"ondisk_log_size":2313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:09:21.145646+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28954,"num_write_kb":1359033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'23","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:49.506160+0000","last_change":"2026-02-23T06:51:49.506160+0000","last_active":"2026-02-23T06:51:49.506160+0000","last_peered":"2026-02-23T06:51:49.506160+0000","last_clean":"2026-02-23T06:51:49.506160+0000","last_became_active":"2026-02-23T06:21:18.155349+0000","last_became_peered":"2026-02-23T06:21:18.155349+0000","last_unstale":"2026-02-23T06:51:49.506160+0000","last_undegraded":"2026-02-23T06:51:49.506160+0000","last_fullsized":"2026-02-23T06:51:49.506160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2026-02-23T06:51:49.506125+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2026-02-23T06:51:49.506125+0000","last_clean_scrub_stamp":"2026-02-23T06:51:49.506125+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:28:11.183113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'1","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:47.116252+0000","last_change":"2026-02-23T06:51:47.116252+0000","last_active":"2026-02-23T06:51:47.116252+0000","last_peered":"2026-02-23T06:51:47.116252+0000","last_clean":"2026-02-23T06:51:47.116252+0000","last_became_active":"2026-02-23T06:21:17.148841+0000","last_became_peered":"2026-02-23T06:21:17.148841+0000","last_unstale":"2026-02-23T06:51:47.116252+0000","last_undegraded":"2026-02-23T06:51:47.116252+0000","last_fullsized":"2026-02-23T06:51:47.116252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2026-02-23T06:51:47.116200+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2026-02-23T06:51:47.116200+0000","last_clean_scrub_stamp":"2026-02-23T06:51:47.116200+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:30:21.554125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'1771","reported_seq":1811,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:52.307135+0000","last_change":"2026-02-23T06:51:52.307135+0000","last_active":"2026-02-23T06:51:52.307135+0000","last_peered":"2026-02-23T06:51:52.307135+0000","last_clean":"2026-02-23T06:51:52.307135+0000","last_became_active":"2026-02-23T06:21:22.172683+0000","last_became_peered":"2026-02-23T06:21:22.172683+0000","last_unstale":"2026-02-23T06:51:52.307135+0000","last_undegraded":"2026-02-23T06:51:52.307135+0000","last_fullsized":"2026-02-23T06:51:52.307135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1771","last_scrub_stamp":"2026-02-23T06:51:52.307097+0000","last_deep_scrub":"27'1771","last_deep_scrub_stamp":"2026-02-23T06:51:52.307097+0000","last_clean_scrub_stamp":"2026-02-23T06:51:52.307097+0000","objects_scrubbed":0,"log_size":1771,"log_dups_size":0,"ondisk_log_size":1771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:03:33.362237+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21503,"num_write_kb":1135952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'23","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:49.266682+0000","last_change":"2026-02-23T06:51:49.266682+0000","last_active":"2026-02-23T06:51:49.266682+0000","last_peered":"2026-02-23T06:51:49.266682+0000","last_clean":"2026-02-23T06:51:49.266682+0000","last_became_active":"2026-02-23T06:21:18.154586+0000","last_became_peered":"2026-02-23T06:21:18.154586+0000","last_unstale":"2026-02-23T06:51:49.266682+0000","last_undegraded":"2026-02-23T06:51:49.266682+0000","last_fullsized":"2026-02-23T06:51:49.266682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2026-02-23T06:51:49.266653+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2026-02-23T06:51:49.266653+0000","last_clean_scrub_stamp":"2026-02-23T06:51:49.266653+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:55:37.419448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'4","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:47.691927+0000","last_change":"2026-02-23T06:51:47.691927+0000","last_active":"2026-02-23T06:51:47.691927+0000","last_peered":"2026-02-23T06:51:47.691927+0000","last_clean":"2026-02-23T06:51:47.691927+0000","last_became_active":"2026-02-23T06:21:17.140699+0000","last_became_peered":"2026-02-23T06:21:17.140699+0000","last_unstale":"2026-02-23T06:51:47.691927+0000","last_undegraded":"2026-02-23T06:51:47.691927+0000","last_fullsized":"2026-02-23T06:51:47.691927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2026-02-23T06:51:47.691876+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2026-02-23T06:51:47.691876+0000","last_clean_scrub_stamp":"2026-02-23T06:51:47.691876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:35:22.951973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'1912","reported_seq":1952,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:56.803918+0000","last_change":"2026-02-23T06:51:56.803918+0000","last_active":"2026-02-23T06:51:56.803918+0000","last_peered":"2026-02-23T06:51:56.803918+0000","last_clean":"2026-02-23T06:51:56.803918+0000","last_became_active":"2026-02-23T06:21:22.166204+0000","last_became_peered":"2026-02-23T06:21:22.166204+0000","last_unstale":"2026-02-23T06:51:56.803918+0000","last_undegraded":"2026-02-23T06:51:56.803918+0000","last_fullsized":"2026-02-23T06:51:56.803918+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1912","last_scrub_stamp":"2026-02-23T06:51:56.803887+0000","last_deep_scrub":"27'1912","last_deep_scrub_stamp":"2026-02-23T06:51:56.803887+0000","last_clean_scrub_stamp":"2026-02-23T06:51:56.803887+0000","objects_scrubbed":0,"log_size":1912,"log_dups_size":0,"ondisk_log_size":1912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:12:48.805799+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23461,"num_write_kb":1201520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'1927","reported_seq":1969,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:52:00.832032+0000","last_change":"2026-02-23T06:52:00.832032+0000","last_active":"2026-02-23T06:52:00.832032+0000","last_peered":"2026-02-23T06:52:00.832032+0000","last_clean":"2026-02-23T06:52:00.832032+0000","last_became_active":"2026-02-23T06:21:22.167217+0000","last_became_peered":"2026-02-23T06:21:22.167217+0000","last_unstale":"2026-02-23T06:52:00.832032+0000","last_undegraded":"2026-02-23T06:52:00.832032+0000","last_fullsized":"2026-02-23T06:52:00.832032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1927","last_scrub_stamp":"2026-02-23T06:52:00.831996+0000","last_deep_scrub":"27'1927","last_deep_scrub_stamp":"2026-02-23T06:52:00.831996+0000","last_clean_scrub_stamp":"2026-02-23T06:52:00.831996+0000","objects_scrubbed":0,"log_size":1927,"log_dups_size":0,"ondisk_log_size":1927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:14:11.293279+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23726,"num_write_kb":1252431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'22","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:54.834587+0000","last_change":"2026-02-23T06:51:54.834587+0000","last_active":"2026-02-23T06:51:54.834587+0000","last_peered":"2026-02-23T06:51:54.834587+0000","last_clean":"2026-02-23T06:51:54.834587+0000","last_became_active":"2026-02-23T06:21:18.145938+0000","last_became_peered":"2026-02-23T06:21:18.145938+0000","last_unstale":"2026-02-23T06:51:54.834587+0000","last_undegraded":"2026-02-23T06:51:54.834587+0000","last_fullsized":"2026-02-23T06:51:54.834587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2026-02-23T06:51:54.834549+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2026-02-23T06:51:54.834549+0000","last_clean_scrub_stamp":"2026-02-23T06:51:54.834549+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:57:30.191836+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'4","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:56.143285+0000","last_change":"2026-02-23T06:51:56.143285+0000","last_active":"2026-02-23T06:51:56.143285+0000","last_peered":"2026-02-23T06:51:56.143285+0000","last_clean":"2026-02-23T06:51:56.143285+0000","last_became_active":"2026-02-23T06:21:17.149490+0000","last_became_peered":"2026-02-23T06:21:17.149490+0000","last_unstale":"2026-02-23T06:51:56.143285+0000","last_undegraded":"2026-02-23T06:51:56.143285+0000","last_fullsized":"2026-02-23T06:51:56.143285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2026-02-23T06:51:56.143241+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2026-02-23T06:51:56.143241+0000","last_clean_scrub_stamp":"2026-02-23T06:51:56.143241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:26:16.867845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'2215","reported_seq":2256,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:52:07.048530+0000","last_change":"2026-02-23T06:52:07.048530+0000","last_active":"2026-02-23T06:52:07.048530+0000","last_peered":"2026-02-23T06:52:07.048530+0000","last_clean":"2026-02-23T06:52:07.048530+0000","last_became_active":"2026-02-23T06:21:22.174906+0000","last_became_peered":"2026-02-23T06:21:22.174906+0000","last_unstale":"2026-02-23T06:52:07.048530+0000","last_undegraded":"2026-02-23T06:52:07.048530+0000","last_fullsized":"2026-02-23T06:52:07.048530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2215","last_scrub_stamp":"2026-02-23T06:52:07.048494+0000","last_deep_scrub":"27'2215","last_deep_scrub_stamp":"2026-02-23T06:52:07.048494+0000","last_clean_scrub_stamp":"2026-02-23T06:52:07.048494+0000","objects_scrubbed":0,"log_size":2215,"log_dups_size":0,"ondisk_log_size":2215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:12:36.001196+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27299,"num_write_kb":1403073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'24","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:51.508007+0000","last_change":"2026-02-23T06:51:51.508007+0000","last_active":"2026-02-23T06:51:51.508007+0000","last_peered":"2026-02-23T06:51:51.508007+0000","last_clean":"2026-02-23T06:51:51.508007+0000","last_became_active":"2026-02-23T06:21:18.142325+0000","last_became_peered":"2026-02-23T06:21:18.142325+0000","last_unstale":"2026-02-23T06:51:51.508007+0000","last_undegraded":"2026-02-23T06:51:51.508007+0000","last_fullsized":"2026-02-23T06:51:51.508007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2026-02-23T06:51:51.507975+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2026-02-23T06:51:51.507975+0000","last_clean_scrub_stamp":"2026-02-23T06:51:51.507975+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:45:35.717271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:47.515241+0000","last_change":"2026-02-23T06:51:47.515241+0000","last_active":"2026-02-23T06:51:47.515241+0000","last_peered":"2026-02-23T06:51:47.515241+0000","last_clean":"2026-02-23T06:51:47.515241+0000","last_became_active":"2026-02-23T06:21:17.146022+0000","last_became_peered":"2026-02-23T06:21:17.146022+0000","last_unstale":"2026-02-23T06:51:47.515241+0000","last_undegraded":"2026-02-23T06:51:47.515241+0000","last_fullsized":"2026-02-23T06:51:47.515241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-23T06:51:47.515200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-23T06:51:47.515200+0000","last_clean_scrub_stamp":"2026-02-23T06:51:47.515200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:55:46.296976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'4","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:55.182297+0000","last_change":"2026-02-23T06:51:55.182297+0000","last_active":"2026-02-23T06:51:55.182297+0000","last_peered":"2026-02-23T06:51:55.182297+0000","last_clean":"2026-02-23T06:51:55.182297+0000","last_became_active":"2026-02-23T06:21:17.148417+0000","last_became_peered":"2026-02-23T06:21:17.148417+0000","last_unstale":"2026-02-23T06:51:55.182297+0000","last_undegraded":"2026-02-23T06:51:55.182297+0000","last_fullsized":"2026-02-23T06:51:55.182297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2026-02-23T06:51:55.182259+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2026-02-23T06:51:55.182259+0000","last_clean_scrub_stamp":"2026-02-23T06:51:55.182259+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:35:51.836482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'20","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:53.860618+0000","last_change":"2026-02-23T06:51:53.860618+0000","last_active":"2026-02-23T06:51:53.860618+0000","last_peered":"2026-02-23T06:51:53.860618+0000","last_clean":"2026-02-23T06:51:53.860618+0000","last_became_active":"2026-02-23T06:21:18.152267+0000","last_became_peered":"2026-02-23T06:21:18.152267+0000","last_unstale":"2026-02-23T06:51:53.860618+0000","last_undegraded":"2026-02-23T06:51:53.860618+0000","last_fullsized":"2026-02-23T06:51:53.860618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2026-02-23T06:51:53.860589+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2026-02-23T06:51:53.860589+0000","last_clean_scrub_stamp":"2026-02-23T06:51:53.860589+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:04:50.172465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'1715","reported_seq":1754,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:59.815667+0000","last_change":"2026-02-23T06:51:59.815667+0000","last_active":"2026-02-23T06:51:59.815667+0000","last_peered":"2026-02-23T06:51:59.815667+0000","last_clean":"2026-02-23T06:51:59.815667+0000","last_became_active":"2026-02-23T06:21:22.158607+0000","last_became_peered":"2026-02-23T06:21:22.158607+0000","last_unstale":"2026-02-23T06:51:59.815667+0000","last_undegraded":"2026-02-23T06:51:59.815667+0000","last_fullsized":"2026-02-23T06:51:59.815667+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1715","last_scrub_stamp":"2026-02-23T06:51:59.815631+0000","last_deep_scrub":"27'1715","last_deep_scrub_stamp":"2026-02-23T06:51:59.815631+0000","last_clean_scrub_stamp":"2026-02-23T06:51:59.815631+0000","objects_scrubbed":0,"log_size":1715,"log_dups_size":0,"ondisk_log_size":1715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:22:14.432247+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20257,"num_write_kb":1221270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1153","reported_seq":1199,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:48.471053+0000","last_change":"2026-02-23T06:51:48.471053+0000","last_active":"2026-02-23T06:51:48.471053+0000","last_peered":"2026-02-23T06:51:48.471053+0000","last_clean":"2026-02-23T06:51:48.471053+0000","last_became_active":"2026-02-23T06:21:17.138245+0000","last_became_peered":"2026-02-23T06:21:17.138245+0000","last_unstale":"2026-02-23T06:51:48.471053+0000","last_undegraded":"2026-02-23T06:51:48.471053+0000","last_fullsized":"2026-02-23T06:51:48.471053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1153","last_scrub_stamp":"2026-02-23T06:51:48.471015+0000","last_deep_scrub":"27'1153","last_deep_scrub_stamp":"2026-02-23T06:51:48.471015+0000","last_clean_scrub_stamp":"2026-02-23T06:51:48.471015+0000","objects_scrubbed":1,"log_size":1153,"log_dups_size":0,"ondisk_log_size":1153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:53:31.299706+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1150,"num_write_kb":5073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'18","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:45.629722+0000","last_change":"2026-02-23T06:51:45.629722+0000","last_active":"2026-02-23T06:51:45.629722+0000","last_peered":"2026-02-23T06:51:45.629722+0000","last_clean":"2026-02-23T06:51:45.629722+0000","last_became_active":"2026-02-23T06:21:18.143550+0000","last_became_peered":"2026-02-23T06:21:18.143550+0000","last_unstale":"2026-02-23T06:51:45.629722+0000","last_undegraded":"2026-02-23T06:51:45.629722+0000","last_fullsized":"2026-02-23T06:51:45.629722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2026-02-23T06:51:45.629668+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2026-02-23T06:51:45.629668+0000","last_clean_scrub_stamp":"2026-02-23T06:51:45.629668+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:22:07.991817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'1861","reported_seq":1900,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:54.366768+0000","last_change":"2026-02-23T06:51:54.366768+0000","last_active":"2026-02-23T06:51:54.366768+0000","last_peered":"2026-02-23T06:51:54.366768+0000","last_clean":"2026-02-23T06:51:54.366768+0000","last_became_active":"2026-02-23T06:21:22.169432+0000","last_became_peered":"2026-02-23T06:21:22.169432+0000","last_unstale":"2026-02-23T06:51:54.366768+0000","last_undegraded":"2026-02-23T06:51:54.366768+0000","last_fullsized":"2026-02-23T06:51:54.366768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1861","last_scrub_stamp":"2026-02-23T06:51:54.366730+0000","last_deep_scrub":"27'1861","last_deep_scrub_stamp":"2026-02-23T06:51:54.366730+0000","last_clean_scrub_stamp":"2026-02-23T06:51:54.366730+0000","objects_scrubbed":0,"log_size":1861,"log_dups_size":0,"ondisk_log_size":1861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:05:57.802141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23058,"num_write_kb":1131314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'22","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:46.237207+0000","last_change":"2026-02-23T06:51:46.237207+0000","last_active":"2026-02-23T06:51:46.237207+0000","last_peered":"2026-02-23T06:51:46.237207+0000","last_clean":"2026-02-23T06:51:46.237207+0000","last_became_active":"2026-02-23T06:21:18.143724+0000","last_became_peered":"2026-02-23T06:21:18.143724+0000","last_unstale":"2026-02-23T06:51:46.237207+0000","last_undegraded":"2026-02-23T06:51:46.237207+0000","last_fullsized":"2026-02-23T06:51:46.237207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2026-02-23T06:51:46.237156+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2026-02-23T06:51:46.237156+0000","last_clean_scrub_stamp":"2026-02-23T06:51:46.237156+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:56:08.028995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'24","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:49.219551+0000","last_change":"2026-02-23T06:51:49.219551+0000","last_active":"2026-02-23T06:51:49.219551+0000","last_peered":"2026-02-23T06:51:49.219551+0000","last_clean":"2026-02-23T06:51:49.219551+0000","last_became_active":"2026-02-23T06:21:18.145325+0000","last_became_peered":"2026-02-23T06:21:18.145325+0000","last_unstale":"2026-02-23T06:51:49.219551+0000","last_undegraded":"2026-02-23T06:51:49.219551+0000","last_fullsized":"2026-02-23T06:51:49.219551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2026-02-23T06:51:49.219511+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2026-02-23T06:51:49.219511+0000","last_clean_scrub_stamp":"2026-02-23T06:51:49.219511+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:12:00.569024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'23","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:52:01.151386+0000","last_change":"2026-02-23T06:52:01.151386+0000","last_active":"2026-02-23T06:52:01.151386+0000","last_peered":"2026-02-23T06:52:01.151386+0000","last_clean":"2026-02-23T06:52:01.151386+0000","last_became_active":"2026-02-23T06:21:18.150738+0000","last_became_peered":"2026-02-23T06:21:18.150738+0000","last_unstale":"2026-02-23T06:52:01.151386+0000","last_undegraded":"2026-02-23T06:52:01.151386+0000","last_fullsized":"2026-02-23T06:52:01.151386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2026-02-23T06:52:01.151352+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2026-02-23T06:52:01.151352+0000","last_clean_scrub_stamp":"2026-02-23T06:52:01.151352+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:23:45.630853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'16","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:55.584403+0000","last_change":"2026-02-23T06:51:55.584403+0000","last_active":"2026-02-23T06:51:55.584403+0000","last_peered":"2026-02-23T06:51:55.584403+0000","last_clean":"2026-02-23T06:51:55.584403+0000","last_became_active":"2026-02-23T06:21:18.141484+0000","last_became_peered":"2026-02-23T06:21:18.141484+0000","last_unstale":"2026-02-23T06:51:55.584403+0000","last_undegraded":"2026-02-23T06:51:55.584403+0000","last_fullsized":"2026-02-23T06:51:55.584403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2026-02-23T06:51:55.584366+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2026-02-23T06:51:55.584366+0000","last_clean_scrub_stamp":"2026-02-23T06:51:55.584366+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:32:31.547683+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'14","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:51.541250+0000","last_change":"2026-02-23T06:51:51.541250+0000","last_active":"2026-02-23T06:51:51.541250+0000","last_peered":"2026-02-23T06:51:51.541250+0000","last_clean":"2026-02-23T06:51:51.541250+0000","last_became_active":"2026-02-23T06:21:18.148489+0000","last_became_peered":"2026-02-23T06:21:18.148489+0000","last_unstale":"2026-02-23T06:51:51.541250+0000","last_undegraded":"2026-02-23T06:51:51.541250+0000","last_fullsized":"2026-02-23T06:51:51.541250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2026-02-23T06:51:51.541196+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2026-02-23T06:51:51.541196+0000","last_clean_scrub_stamp":"2026-02-23T06:51:51.541196+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:00:32.165948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'15","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:53.562285+0000","last_change":"2026-02-23T06:51:53.562285+0000","last_active":"2026-02-23T06:51:53.562285+0000","last_peered":"2026-02-23T06:51:53.562285+0000","last_clean":"2026-02-23T06:51:53.562285+0000","last_became_active":"2026-02-23T06:21:18.141854+0000","last_became_peered":"2026-02-23T06:21:18.141854+0000","last_unstale":"2026-02-23T06:51:53.562285+0000","last_undegraded":"2026-02-23T06:51:53.562285+0000","last_fullsized":"2026-02-23T06:51:53.562285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2026-02-23T06:51:53.562208+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2026-02-23T06:51:53.562208+0000","last_clean_scrub_stamp":"2026-02-23T06:51:53.562208+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:19:13.109959+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'27","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:50.281289+0000","last_change":"2026-02-23T06:51:50.281289+0000","last_active":"2026-02-23T06:51:50.281289+0000","last_peered":"2026-02-23T06:51:50.281289+0000","last_clean":"2026-02-23T06:51:50.281289+0000","last_became_active":"2026-02-23T06:21:18.153133+0000","last_became_peered":"2026-02-23T06:21:18.153133+0000","last_unstale":"2026-02-23T06:51:50.281289+0000","last_undegraded":"2026-02-23T06:51:50.281289+0000","last_fullsized":"2026-02-23T06:51:50.281289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2026-02-23T06:51:50.281254+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2026-02-23T06:51:50.281254+0000","last_clean_scrub_stamp":"2026-02-23T06:51:50.281254+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:53:45.033871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'14","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:54.538307+0000","last_change":"2026-02-23T06:51:54.538307+0000","last_active":"2026-02-23T06:51:54.538307+0000","last_peered":"2026-02-23T06:51:54.538307+0000","last_clean":"2026-02-23T06:51:54.538307+0000","last_became_active":"2026-02-23T06:21:18.144832+0000","last_became_peered":"2026-02-23T06:21:18.144832+0000","last_unstale":"2026-02-23T06:51:54.538307+0000","last_undegraded":"2026-02-23T06:51:54.538307+0000","last_fullsized":"2026-02-23T06:51:54.538307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2026-02-23T06:51:54.538274+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2026-02-23T06:51:54.538274+0000","last_clean_scrub_stamp":"2026-02-23T06:51:54.538274+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:16:53.367747+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'19","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:57.119377+0000","last_change":"2026-02-23T06:51:57.119377+0000","last_active":"2026-02-23T06:51:57.119377+0000","last_peered":"2026-02-23T06:51:57.119377+0000","last_clean":"2026-02-23T06:51:57.119377+0000","last_became_active":"2026-02-23T06:21:18.150489+0000","last_became_peered":"2026-02-23T06:21:18.150489+0000","last_unstale":"2026-02-23T06:51:57.119377+0000","last_undegraded":"2026-02-23T06:51:57.119377+0000","last_fullsized":"2026-02-23T06:51:57.119377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2026-02-23T06:51:57.119340+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2026-02-23T06:51:57.119340+0000","last_clean_scrub_stamp":"2026-02-23T06:51:57.119340+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:11:46.696788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'22","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:56.601310+0000","last_change":"2026-02-23T06:51:56.601310+0000","last_active":"2026-02-23T06:51:56.601310+0000","last_peered":"2026-02-23T06:51:56.601310+0000","last_clean":"2026-02-23T06:51:56.601310+0000","last_became_active":"2026-02-23T06:21:18.143495+0000","last_became_peered":"2026-02-23T06:21:18.143495+0000","last_unstale":"2026-02-23T06:51:56.601310+0000","last_undegraded":"2026-02-23T06:51:56.601310+0000","last_fullsized":"2026-02-23T06:51:56.601310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2026-02-23T06:51:56.601285+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2026-02-23T06:51:56.601285+0000","last_clean_scrub_stamp":"2026-02-23T06:51:56.601285+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:08:26.792939+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'21","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:48.675961+0000","last_change":"2026-02-23T06:51:48.675961+0000","last_active":"2026-02-23T06:51:48.675961+0000","last_peered":"2026-02-23T06:51:48.675961+0000","last_clean":"2026-02-23T06:51:48.675961+0000","last_became_active":"2026-02-23T06:21:18.148701+0000","last_became_peered":"2026-02-23T06:21:18.148701+0000","last_unstale":"2026-02-23T06:51:48.675961+0000","last_undegraded":"2026-02-23T06:51:48.675961+0000","last_fullsized":"2026-02-23T06:51:48.675961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2026-02-23T06:51:48.675927+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2026-02-23T06:51:48.675927+0000","last_clean_scrub_stamp":"2026-02-23T06:51:48.675927+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:11:20.105420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'28","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:58.761417+0000","last_change":"2026-02-23T06:51:58.761417+0000","last_active":"2026-02-23T06:51:58.761417+0000","last_peered":"2026-02-23T06:51:58.761417+0000","last_clean":"2026-02-23T06:51:58.761417+0000","last_became_active":"2026-02-23T06:21:18.145346+0000","last_became_peered":"2026-02-23T06:21:18.145346+0000","last_unstale":"2026-02-23T06:51:58.761417+0000","last_undegraded":"2026-02-23T06:51:58.761417+0000","last_fullsized":"2026-02-23T06:51:58.761417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2026-02-23T06:51:58.761376+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2026-02-23T06:51:58.761376+0000","last_clean_scrub_stamp":"2026-02-23T06:51:58.761376+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:58:22.170877+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'21","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:55.154622+0000","last_change":"2026-02-23T06:51:55.154622+0000","last_active":"2026-02-23T06:51:55.154622+0000","last_peered":"2026-02-23T06:51:55.154622+0000","last_clean":"2026-02-23T06:51:55.154622+0000","last_became_active":"2026-02-23T06:21:18.147357+0000","last_became_peered":"2026-02-23T06:21:18.147357+0000","last_unstale":"2026-02-23T06:51:55.154622+0000","last_undegraded":"2026-02-23T06:51:55.154622+0000","last_fullsized":"2026-02-23T06:51:55.154622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2026-02-23T06:51:55.154572+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2026-02-23T06:51:55.154572+0000","last_clean_scrub_stamp":"2026-02-23T06:51:55.154572+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:48:17.721427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'19","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:52:00.124901+0000","last_change":"2026-02-23T06:52:00.124901+0000","last_active":"2026-02-23T06:52:00.124901+0000","last_peered":"2026-02-23T06:52:00.124901+0000","last_clean":"2026-02-23T06:52:00.124901+0000","last_became_active":"2026-02-23T06:21:18.151269+0000","last_became_peered":"2026-02-23T06:21:18.151269+0000","last_unstale":"2026-02-23T06:52:00.124901+0000","last_undegraded":"2026-02-23T06:52:00.124901+0000","last_fullsized":"2026-02-23T06:52:00.124901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2026-02-23T06:52:00.124857+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2026-02-23T06:52:00.124857+0000","last_clean_scrub_stamp":"2026-02-23T06:52:00.124857+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T17:11:07.807310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'29","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:50.266631+0000","last_change":"2026-02-23T06:51:50.266631+0000","last_active":"2026-02-23T06:51:50.266631+0000","last_peered":"2026-02-23T06:51:50.266631+0000","last_clean":"2026-02-23T06:51:50.266631+0000","last_became_active":"2026-02-23T06:21:18.148262+0000","last_became_peered":"2026-02-23T06:21:18.148262+0000","last_unstale":"2026-02-23T06:51:50.266631+0000","last_undegraded":"2026-02-23T06:51:50.266631+0000","last_fullsized":"2026-02-23T06:51:50.266631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2026-02-23T06:51:50.266601+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2026-02-23T06:51:50.266601+0000","last_clean_scrub_stamp":"2026-02-23T06:51:50.266601+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:17:23.059565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'18","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:52:06.078271+0000","last_change":"2026-02-23T06:52:06.078271+0000","last_active":"2026-02-23T06:52:06.078271+0000","last_peered":"2026-02-23T06:52:06.078271+0000","last_clean":"2026-02-23T06:52:06.078271+0000","last_became_active":"2026-02-23T06:21:18.155214+0000","last_became_peered":"2026-02-23T06:21:18.155214+0000","last_unstale":"2026-02-23T06:52:06.078271+0000","last_undegraded":"2026-02-23T06:52:06.078271+0000","last_fullsized":"2026-02-23T06:52:06.078271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2026-02-23T06:52:06.078225+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2026-02-23T06:52:06.078225+0000","last_clean_scrub_stamp":"2026-02-23T06:52:06.078225+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T10:12:15.009935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'19","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:52:08.028090+0000","last_change":"2026-02-23T06:52:08.028090+0000","last_active":"2026-02-23T06:52:08.028090+0000","last_peered":"2026-02-23T06:52:08.028090+0000","last_clean":"2026-02-23T06:52:08.028090+0000","last_became_active":"2026-02-23T06:21:18.152456+0000","last_became_peered":"2026-02-23T06:21:18.152456+0000","last_unstale":"2026-02-23T06:52:08.028090+0000","last_undegraded":"2026-02-23T06:52:08.028090+0000","last_fullsized":"2026-02-23T06:52:08.028090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2026-02-23T06:52:08.028044+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2026-02-23T06:52:08.028044+0000","last_clean_scrub_stamp":"2026-02-23T06:52:08.028044+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:53:53.248821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'21","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:57.565135+0000","last_change":"2026-02-23T06:51:57.565135+0000","last_active":"2026-02-23T06:51:57.565135+0000","last_peered":"2026-02-23T06:51:57.565135+0000","last_clean":"2026-02-23T06:51:57.565135+0000","last_became_active":"2026-02-23T06:21:18.148498+0000","last_became_peered":"2026-02-23T06:21:18.148498+0000","last_unstale":"2026-02-23T06:51:57.565135+0000","last_undegraded":"2026-02-23T06:51:57.565135+0000","last_fullsized":"2026-02-23T06:51:57.565135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2026-02-23T06:51:57.565094+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2026-02-23T06:51:57.565094+0000","last_clean_scrub_stamp":"2026-02-23T06:51:57.565094+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:29.245090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'21","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:52.572084+0000","last_change":"2026-02-23T06:51:52.572084+0000","last_active":"2026-02-23T06:51:52.572084+0000","last_peered":"2026-02-23T06:51:52.572084+0000","last_clean":"2026-02-23T06:51:52.572084+0000","last_became_active":"2026-02-23T06:21:18.141938+0000","last_became_peered":"2026-02-23T06:21:18.141938+0000","last_unstale":"2026-02-23T06:51:52.572084+0000","last_undegraded":"2026-02-23T06:51:52.572084+0000","last_fullsized":"2026-02-23T06:51:52.572084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2026-02-23T06:51:52.572033+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2026-02-23T06:51:52.572033+0000","last_clean_scrub_stamp":"2026-02-23T06:51:52.572033+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:24:29.407570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'26","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:54.546299+0000","last_change":"2026-02-23T06:51:54.546299+0000","last_active":"2026-02-23T06:51:54.546299+0000","last_peered":"2026-02-23T06:51:54.546299+0000","last_clean":"2026-02-23T06:51:54.546299+0000","last_became_active":"2026-02-23T06:21:18.153090+0000","last_became_peered":"2026-02-23T06:21:18.153090+0000","last_unstale":"2026-02-23T06:51:54.546299+0000","last_undegraded":"2026-02-23T06:51:54.546299+0000","last_fullsized":"2026-02-23T06:51:54.546299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2026-02-23T06:51:54.546239+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2026-02-23T06:51:54.546239+0000","last_clean_scrub_stamp":"2026-02-23T06:51:54.546239+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:30:49.355223+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'17","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:58.150758+0000","last_change":"2026-02-23T06:51:58.150758+0000","last_active":"2026-02-23T06:51:58.150758+0000","last_peered":"2026-02-23T06:51:58.150758+0000","last_clean":"2026-02-23T06:51:58.150758+0000","last_became_active":"2026-02-23T06:21:18.147956+0000","last_became_peered":"2026-02-23T06:21:18.147956+0000","last_unstale":"2026-02-23T06:51:58.150758+0000","last_undegraded":"2026-02-23T06:51:58.150758+0000","last_fullsized":"2026-02-23T06:51:58.150758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2026-02-23T06:51:58.150730+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2026-02-23T06:51:58.150730+0000","last_clean_scrub_stamp":"2026-02-23T06:51:58.150730+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:36:56.081338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'18","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:56.159975+0000","last_change":"2026-02-23T06:51:56.159975+0000","last_active":"2026-02-23T06:51:56.159975+0000","last_peered":"2026-02-23T06:51:56.159975+0000","last_clean":"2026-02-23T06:51:56.159975+0000","last_became_active":"2026-02-23T06:21:18.155130+0000","last_became_peered":"2026-02-23T06:21:18.155130+0000","last_unstale":"2026-02-23T06:51:56.159975+0000","last_undegraded":"2026-02-23T06:51:56.159975+0000","last_fullsized":"2026-02-23T06:51:56.159975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2026-02-23T06:51:56.159917+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2026-02-23T06:51:56.159917+0000","last_clean_scrub_stamp":"2026-02-23T06:51:56.159917+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T12:36:33.596654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'29","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:52.151150+0000","last_change":"2026-02-23T06:51:52.151150+0000","last_active":"2026-02-23T06:51:52.151150+0000","last_peered":"2026-02-23T06:51:52.151150+0000","last_clean":"2026-02-23T06:51:52.151150+0000","last_became_active":"2026-02-23T06:21:18.152790+0000","last_became_peered":"2026-02-23T06:21:18.152790+0000","last_unstale":"2026-02-23T06:51:52.151150+0000","last_undegraded":"2026-02-23T06:51:52.151150+0000","last_fullsized":"2026-02-23T06:51:52.151150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2026-02-23T06:51:52.151121+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2026-02-23T06:51:52.151121+0000","last_clean_scrub_stamp":"2026-02-23T06:51:52.151121+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:54:33.006651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'21","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:49.678445+0000","last_change":"2026-02-23T06:51:49.678445+0000","last_active":"2026-02-23T06:51:49.678445+0000","last_peered":"2026-02-23T06:51:49.678445+0000","last_clean":"2026-02-23T06:51:49.678445+0000","last_became_active":"2026-02-23T06:21:18.155122+0000","last_became_peered":"2026-02-23T06:21:18.155122+0000","last_unstale":"2026-02-23T06:51:49.678445+0000","last_undegraded":"2026-02-23T06:51:49.678445+0000","last_fullsized":"2026-02-23T06:51:49.678445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2026-02-23T06:51:49.678413+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2026-02-23T06:51:49.678413+0000","last_clean_scrub_stamp":"2026-02-23T06:51:49.678413+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:16:52.893383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'13","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:58.607084+0000","last_change":"2026-02-23T06:51:58.607084+0000","last_active":"2026-02-23T06:51:58.607084+0000","last_peered":"2026-02-23T06:51:58.607084+0000","last_clean":"2026-02-23T06:51:58.607084+0000","last_became_active":"2026-02-23T06:21:18.151151+0000","last_became_peered":"2026-02-23T06:21:18.151151+0000","last_unstale":"2026-02-23T06:51:58.607084+0000","last_undegraded":"2026-02-23T06:51:58.607084+0000","last_fullsized":"2026-02-23T06:51:58.607084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2026-02-23T06:51:58.607047+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2026-02-23T06:51:58.607047+0000","last_clean_scrub_stamp":"2026-02-23T06:51:58.607047+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:59:12.325575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'13","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:57.180689+0000","last_change":"2026-02-23T06:51:57.180689+0000","last_active":"2026-02-23T06:51:57.180689+0000","last_peered":"2026-02-23T06:51:57.180689+0000","last_clean":"2026-02-23T06:51:57.180689+0000","last_became_active":"2026-02-23T06:21:18.146527+0000","last_became_peered":"2026-02-23T06:21:18.146527+0000","last_unstale":"2026-02-23T06:51:57.180689+0000","last_undegraded":"2026-02-23T06:51:57.180689+0000","last_fullsized":"2026-02-23T06:51:57.180689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2026-02-23T06:51:57.180660+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2026-02-23T06:51:57.180660+0000","last_clean_scrub_stamp":"2026-02-23T06:51:57.180660+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T18:47:26.723950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'15","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:48.238789+0000","last_change":"2026-02-23T06:51:48.238789+0000","last_active":"2026-02-23T06:51:48.238789+0000","last_peered":"2026-02-23T06:51:48.238789+0000","last_clean":"2026-02-23T06:51:48.238789+0000","last_became_active":"2026-02-23T06:21:18.145770+0000","last_became_peered":"2026-02-23T06:21:18.145770+0000","last_unstale":"2026-02-23T06:51:48.238789+0000","last_undegraded":"2026-02-23T06:51:48.238789+0000","last_fullsized":"2026-02-23T06:51:48.238789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2026-02-23T06:51:48.238759+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2026-02-23T06:51:48.238759+0000","last_clean_scrub_stamp":"2026-02-23T06:51:48.238759+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T15:35:52.767995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'17","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:54.167982+0000","last_change":"2026-02-23T06:51:54.167982+0000","last_active":"2026-02-23T06:51:54.167982+0000","last_peered":"2026-02-23T06:51:54.167982+0000","last_clean":"2026-02-23T06:51:54.167982+0000","last_became_active":"2026-02-23T06:21:18.151948+0000","last_became_peered":"2026-02-23T06:21:18.151948+0000","last_unstale":"2026-02-23T06:51:54.167982+0000","last_undegraded":"2026-02-23T06:51:54.167982+0000","last_fullsized":"2026-02-23T06:51:54.167982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2026-02-23T06:51:54.167920+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2026-02-23T06:51:54.167920+0000","last_clean_scrub_stamp":"2026-02-23T06:51:54.167920+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T16:01:00.503295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'13","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:52.269155+0000","last_change":"2026-02-23T06:51:52.269155+0000","last_active":"2026-02-23T06:51:52.269155+0000","last_peered":"2026-02-23T06:51:52.269155+0000","last_clean":"2026-02-23T06:51:52.269155+0000","last_became_active":"2026-02-23T06:21:18.144346+0000","last_became_peered":"2026-02-23T06:21:18.144346+0000","last_unstale":"2026-02-23T06:51:52.269155+0000","last_undegraded":"2026-02-23T06:51:52.269155+0000","last_fullsized":"2026-02-23T06:51:52.269155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2026-02-23T06:51:52.269110+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2026-02-23T06:51:52.269110+0000","last_clean_scrub_stamp":"2026-02-23T06:51:52.269110+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:09.558981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'18","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:52:02.718581+0000","last_change":"2026-02-23T06:52:02.718581+0000","last_active":"2026-02-23T06:52:02.718581+0000","last_peered":"2026-02-23T06:52:02.718581+0000","last_clean":"2026-02-23T06:52:02.718581+0000","last_became_active":"2026-02-23T06:21:18.141449+0000","last_became_peered":"2026-02-23T06:21:18.141449+0000","last_unstale":"2026-02-23T06:52:02.718581+0000","last_undegraded":"2026-02-23T06:52:02.718581+0000","last_fullsized":"2026-02-23T06:52:02.718581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2026-02-23T06:52:02.718524+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2026-02-23T06:52:02.718524+0000","last_clean_scrub_stamp":"2026-02-23T06:52:02.718524+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T11:21:15.372942+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'10","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:59.632522+0000","last_change":"2026-02-23T06:51:59.632522+0000","last_active":"2026-02-23T06:51:59.632522+0000","last_peered":"2026-02-23T06:51:59.632522+0000","last_clean":"2026-02-23T06:51:59.632522+0000","last_became_active":"2026-02-23T06:21:18.142359+0000","last_became_peered":"2026-02-23T06:21:18.142359+0000","last_unstale":"2026-02-23T06:51:59.632522+0000","last_undegraded":"2026-02-23T06:51:59.632522+0000","last_fullsized":"2026-02-23T06:51:59.632522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2026-02-23T06:51:59.632489+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2026-02-23T06:51:59.632489+0000","last_clean_scrub_stamp":"2026-02-23T06:51:59.632489+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T14:04:43.508047+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'16","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-23T06:51:59.154126+0000","last_change":"2026-02-23T06:51:59.154126+0000","last_active":"2026-02-23T06:51:59.154126+0000","last_peered":"2026-02-23T06:51:59.154126+0000","last_clean":"2026-02-23T06:51:59.154126+0000","last_became_active":"2026-02-23T06:21:18.156564+0000","last_became_peered":"2026-02-23T06:21:18.156564+0000","last_unstale":"2026-02-23T06:51:59.154126+0000","last_undegraded":"2026-02-23T06:51:59.154126+0000","last_fullsized":"2026-02-23T06:51:59.154126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2026-02-23T06:51:59.154092+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2026-02-23T06:51:59.154092+0000","last_clean_scrub_stamp":"2026-02-23T06:51:59.154092+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T13:47:51.191907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":3,"num_write":757736,"num_write_kb":39381923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61804,"ondisk_log_size":61804,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1221,"ondisk_log_size":1221,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":13257019,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":32,"num_read_kb":104,"num_write":2250,"num_write_kb":14687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5220,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13860864,"data_stored":26514038,"data_compressed":2657250,"data_compressed_allocated":3497984,"data_compressed_original":16220160,"omap_allocated":634237,"internal_metadata":0},"log_size":2122,"ondisk_log_size":2122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70172,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575226,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261872,"kb_used_data":352,"kb_used_omap":128,"kb_used_meta":261375,"kb_avail":94109968,"statfs":{"total":96636764160,"available":96368607232,"internally_reserved":0,"allocated":360448,"data_stored":708511,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":131483,"internal_metadata":267648613},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575227,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261888,"kb_used_data":368,"kb_used_omap":20,"kb_used_meta":261483,"kb_avail":94109952,"statfs":{"total":96636764160,"available":96368590848,"internally_reserved":0,"allocated":376832,"data_stored":200831,"data_compressed":2418,"data_compressed_allocated":4096,"data_compressed_original":12288,"omap_allocated":20978,"internal_metadata":267759118},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575228,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":228916,"kb_used_data":3492,"kb_used_omap":17,"kb_used_meta":225390,"kb_avail":94142924,"statfs":{"total":96636764160,"available":96402354176,"internally_reserved":0,"allocated":3575808,"data_stored":4312377,"data_compressed":181645,"data_compressed_allocated":237568,"data_compressed_original":1146880,"omap_allocated":17420,"internal_metadata":230800372},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575229,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229064,"kb_used_data":3640,"kb_used_omap":43,"kb_used_meta":225364,"kb_avail":94142776,"statfs":{"total":96636764160,"available":96402202624,"internally_reserved":0,"allocated":3727360,"data_stored":4985471,"data_compressed":219149,"data_compressed_allocated":286720,"data_compressed_original":1732608,"omap_allocated":44556,"internal_metadata":230773236},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575228,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":227456,"kb_used_data":2032,"kb_used_omap":239,"kb_used_meta":225168,"kb_avail":94144384,"statfs":{"total":96636764160,"available":96403849216,"internally_reserved":0,"allocated":2080768,"data_stored":4903724,"data_compressed":682037,"data_compressed_allocated":888832,"data_compressed_original":3903488,"omap_allocated":245322,"internal_metadata":230572470},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575227,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281760,"kb_used_data":2192,"kb_used_omap":48,"kb_used_meta":279503,"kb_avail":94090080,"statfs":{"total":96636764160,"available":96348241920,"internally_reserved":0,"allocated":2244608,"data_stored":4902940,"data_compressed":537579,"data_compressed_allocated":712704,"data_compressed_original":3551232,"omap_allocated":49901,"internal_metadata":286211347},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575226,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":192896,"kb_used_data":3568,"kb_used_omap":16,"kb_used_meta":189295,"kb_avail":94178944,"statfs":{"total":96636764160,"available":96439238656,"internally_reserved":0,"allocated":3653632,"data_stored":8507375,"data_compressed":1069508,"data_compressed_allocated":1413120,"data_compressed_original":6447104,"omap_allocated":16904,"internal_metadata":193838584},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575226,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":171572,"kb_used_data":292,"kb_used_omap":195,"kb_used_meta":171068,"kb_avail":94200268,"statfs":{"total":96636764160,"available":96461074432,"internally_reserved":0,"allocated":299008,"data_stored":118129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":200273,"internal_metadata":175174063},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35086,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":180830,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":126753,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3362816,"data_stored":8389302,"data_compressed":1069508,"data_compressed_allocated":1413120,"data_compressed_original":6447104,"omap_allocated":8580,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1953792,"data_stored":4784867,"data_compressed":537579,"data_compressed_allocated":712704,"data_compressed_original":3551232,"omap_allocated":32915,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1789952,"data_stored":4785651,"data_compressed":682037,"data_compressed_allocated":888832,"data_compressed_original":3903488,"omap_allocated":234344,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3371008,"data_stored":4277030,"data_compressed":184063,"data_compressed_allocated":241664,"data_compressed_original":1159168,"omap_allocated":36527,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3284992,"data_stored":4194304,"data_compressed":181645,"data_compressed_allocated":237568,"data_compressed_original":1146880,"omap_allocated":4760,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":82758,"data_compressed":2418,"data_compressed_allocated":4096,"data_compressed_original":12288,"omap_allocated":9528,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-23T06:52:26.063 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-23T06:52:26.205 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.209+0000 7fab1cfd2640 1 -- 10.20.193.58:0/611333470 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fab180b6690 msgr2=0x7fab18058cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:26.205 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.209+0000 7fab1cfd2640 1 --2- 10.20.193.58:0/611333470 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fab180b6690 0x7fab18058cf0 secure :-1 s=READY pgs=206 gs=1 cs=0 l=1 c_cookie=1977807005303007546 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab180b5040 tx=0x7fab0c030330 comp rx=0 tx=0).stop 2026-02-23T06:52:26.205 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.209+0000 7fab1cfd2640 1 -- 10.20.193.58:0/611333470 shutdown_connections 2026-02-23T06:52:26.205 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.209+0000 7fab1cfd2640 1 --2- 10.20.193.58:0/611333470 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fab180b6690 0x7fab18058cf0 unknown :-1 s=CLOSED pgs=206 gs=1 cs=0 l=1 c_cookie=1977807005303007546 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.205 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.209+0000 7fab1cfd2640 1 --2- 10.20.193.58:0/611333470 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fab1815d870 0x7fab180587b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.205 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.209+0000 7fab1cfd2640 1 --2- 10.20.193.58:0/611333470 >> v2:10.20.193.93:3300/0 conn(0x7fab1815d4a0 0x7fab180affb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.205 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.209+0000 7fab1cfd2640 1 -- 10.20.193.58:0/611333470 >> 10.20.193.58:0/611333470 conn(0x7fab180b3c20 msgr2=0x7fab180b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:52:26.206 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.210+0000 7fab1cfd2640 1 -- 10.20.193.58:0/611333470 shutdown_connections 2026-02-23T06:52:26.206 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.210+0000 7fab1cfd2640 1 -- 10.20.193.58:0/611333470 wait complete. 2026-02-23T06:52:26.208 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.211+0000 7fab1cfd2640 1 Processor -- start 2026-02-23T06:52:26.208 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.211+0000 7fab1cfd2640 1 -- start start 2026-02-23T06:52:26.208 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.211+0000 7fab1cfd2640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fab180b6690 0x7fab1813e1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:26.208 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.211+0000 7fab1cfd2640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fab1815d4a0 0x7fab18167090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:26.209 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.211+0000 7fab1cfd2640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fab1815d870 0x7fab18161fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:26.209 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.211+0000 7fab1cfd2640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fab18162bd0 con 0x7fab1815d4a0 2026-02-23T06:52:26.209 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.211+0000 7fab1cfd2640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fab18160c30 con 0x7fab180b6690 2026-02-23T06:52:26.209 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.211+0000 7fab1cfd2640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fab1815faf0 con 0x7fab1815d870 2026-02-23T06:52:26.209 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.212+0000 7fab177fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fab180b6690 0x7fab1813e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:26.209 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.212+0000 7fab16ffd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fab1815d4a0 0x7fab18167090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:26.209 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.212+0000 7fab177fe640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fab180b6690 0x7fab1813e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:43942/0 (socket says 10.20.193.58:43942) 2026-02-23T06:52:26.209 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.212+0000 7fab177fe640 1 -- 10.20.193.58:0/121863336 learned_addr learned my addr 10.20.193.58:0/121863336 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:52:26.209 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.212+0000 7fab17fff640 1 --2- 10.20.193.58:0/121863336 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fab1815d870 0x7fab18161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:26.209 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.212+0000 7fab16ffd640 1 -- 10.20.193.58:0/121863336 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fab1815d870 msgr2=0x7fab18161fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:26.209 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.212+0000 7fab16ffd640 1 --2- 10.20.193.58:0/121863336 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fab1815d870 0x7fab18161fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.212+0000 7fab16ffd640 1 -- 10.20.193.58:0/121863336 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fab180b6690 msgr2=0x7fab1813e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:26.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.212+0000 7fab16ffd640 1 --2- 10.20.193.58:0/121863336 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fab180b6690 0x7fab1813e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.212+0000 7fab16ffd640 1 -- 10.20.193.58:0/121863336 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab0c00a650 con 0x7fab1815d4a0 2026-02-23T06:52:26.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.212+0000 7fab16ffd640 1 --2- 10.20.193.58:0/121863336 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fab1815d4a0 0x7fab18167090 secure :-1 s=READY pgs=207 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab0800e7e0 tx=0x7fab0800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:52:26.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.212+0000 7faaf3fff640 1 -- 10.20.193.58:0/121863336 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fab0800cce0 con 0x7fab1815d4a0 2026-02-23T06:52:26.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.212+0000 7faaf3fff640 1 -- 10.20.193.58:0/121863336 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab08004020 con 0x7fab1815d4a0 2026-02-23T06:52:26.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.212+0000 7faaf3fff640 1 -- 10.20.193.58:0/121863336 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fab08004450 con 0x7fab1815d4a0 2026-02-23T06:52:26.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.212+0000 7fab1cfd2640 1 -- 10.20.193.58:0/121863336 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab18160120 con 0x7fab1815d4a0 2026-02-23T06:52:26.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.212+0000 7fab1cfd2640 1 -- 10.20.193.58:0/121863336 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab1813e710 con 0x7fab1815d4a0 2026-02-23T06:52:26.210 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.213+0000 7fab1cfd2640 1 -- 10.20.193.58:0/121863336 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab180b7260 con 0x7fab1815d4a0 2026-02-23T06:52:26.211 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.214+0000 7faaf3fff640 1 -- 10.20.193.58:0/121863336 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fab080036d0 con 0x7fab1815d4a0 2026-02-23T06:52:26.212 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.215+0000 7faaf3fff640 1 --2- 10.20.193.58:0/121863336 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faae807a6c0 0x7faae809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:26.212 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.215+0000 7faaf3fff640 1 -- 10.20.193.58:0/121863336 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fab08014070 con 0x7fab1815d4a0 2026-02-23T06:52:26.212 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.215+0000 7fab177fe640 1 --2- 10.20.193.58:0/121863336 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faae807a6c0 0x7faae809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:26.212 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.216+0000 7fab177fe640 1 --2- 10.20.193.58:0/121863336 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faae807a6c0 0x7faae809ab70 secure :-1 s=READY pgs=625 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab04005c70 tx=0x7fab0400b440 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:52:26.212 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.217+0000 7faaf3fff640 1 -- 10.20.193.58:0/121863336 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fab08060d20 con 0x7fab1815d4a0 2026-02-23T06:52:26.327 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.332+0000 7fab1cfd2640 1 -- 10.20.193.58:0/121863336 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fab1805bf10 con 0x7fab1815d4a0 2026-02-23T06:52:26.329 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.334+0000 7faaf3fff640 1 -- 10.20.193.58:0/121863336 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v30)=0 v30) ==== 123+0+0 (secure 0 0 0) 0x7fab08063e40 con 0x7fab1815d4a0 2026-02-23T06:52:26.330 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.335+0000 7faaf3fff640 1 -- 10.20.193.58:0/121863336 <== mon.0 v2:10.20.193.58:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fab080045b0 con 0x7fab1815d4a0 2026-02-23T06:52:26.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.336+0000 7fab1cfd2640 1 -- 10.20.193.58:0/121863336 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faae807a6c0 msgr2=0x7faae809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:26.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.336+0000 7fab1cfd2640 1 --2- 10.20.193.58:0/121863336 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faae807a6c0 0x7faae809ab70 secure :-1 s=READY pgs=625 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab04005c70 tx=0x7fab0400b440 comp rx=0 tx=0).stop 2026-02-23T06:52:26.331 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.336+0000 7fab1cfd2640 1 -- 10.20.193.58:0/121863336 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fab1815d4a0 msgr2=0x7fab18167090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:26.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.336+0000 7fab1cfd2640 1 --2- 10.20.193.58:0/121863336 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fab1815d4a0 0x7fab18167090 secure :-1 s=READY pgs=207 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab0800e7e0 tx=0x7fab0800ecb0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.336+0000 7fab1cfd2640 1 -- 10.20.193.58:0/121863336 shutdown_connections 2026-02-23T06:52:26.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.336+0000 7fab1cfd2640 1 --2- 10.20.193.58:0/121863336 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7faae807a6c0 0x7faae809ab70 unknown :-1 s=CLOSED pgs=625 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.336+0000 7fab1cfd2640 1 --2- 10.20.193.58:0/121863336 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fab1815d870 0x7fab18161fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.336+0000 7fab1cfd2640 1 --2- 10.20.193.58:0/121863336 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fab1815d4a0 0x7fab18167090 unknown :-1 s=CLOSED pgs=207 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.336+0000 7fab1cfd2640 1 --2- 10.20.193.58:0/121863336 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fab180b6690 0x7fab1813e1d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.336+0000 7fab1cfd2640 1 -- 10.20.193.58:0/121863336 >> 10.20.193.58:0/121863336 conn(0x7fab180b3c20 msgr2=0x7fab1815b760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:52:26.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.336+0000 7fab1cfd2640 1 -- 10.20.193.58:0/121863336 shutdown_connections 2026-02-23T06:52:26.332 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.336+0000 7fab1cfd2640 1 -- 10.20.193.58:0/121863336 wait complete. 2026-02-23T06:52:26.344 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2026-02-23T06:52:26.344 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2026-02-23T06:52:26.464 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.470+0000 7fcb7b775640 1 -- 10.20.193.58:0/1625152092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcb74056550 msgr2=0x7fcb7405ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:26.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.470+0000 7fcb7b775640 1 --2- 10.20.193.58:0/1625152092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcb74056550 0x7fcb7405ce30 secure :-1 s=READY pgs=206 gs=3 cs=0 l=1 c_cookie=15744940274092969560 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb60004740 tx=0x7fcb6002f230 comp rx=0 tx=0).stop 2026-02-23T06:52:26.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.470+0000 7fcb7b775640 1 -- 10.20.193.58:0/1625152092 shutdown_connections 2026-02-23T06:52:26.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.470+0000 7fcb7b775640 1 --2- 10.20.193.58:0/1625152092 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcb74056550 0x7fcb7405ce30 unknown :-1 s=CLOSED pgs=206 gs=3 cs=0 l=1 c_cookie=15744940274092969560 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.470+0000 7fcb7b775640 1 -- 10.20.193.58:0/1625152092 >> 10.20.193.58:0/1625152092 conn(0x7fcb740b3c20 msgr2=0x7fcb740b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:52:26.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.470+0000 7fcb7b775640 1 -- 10.20.193.58:0/1625152092 shutdown_connections 2026-02-23T06:52:26.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.470+0000 7fcb7b775640 1 -- 10.20.193.58:0/1625152092 wait complete. 2026-02-23T06:52:26.465 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.471+0000 7fcb7b775640 1 Processor -- start 2026-02-23T06:52:26.466 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.471+0000 7fcb7b775640 1 -- start start 2026-02-23T06:52:26.466 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.472+0000 7fcb7b775640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcb74056550 0x7fcb74201120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:26.466 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.472+0000 7fcb7b775640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcb7405d370 0x7fcb741fe670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:26.466 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.472+0000 7fcb7b775640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcb7415c040 0x7fcb740b1130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:26.466 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.472+0000 7fcb7b775640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fcb741fdbb0 con 0x7fcb7415c040 2026-02-23T06:52:26.466 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.472+0000 7fcb7b775640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fcb740ae650 con 0x7fcb74056550 2026-02-23T06:52:26.466 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.472+0000 7fcb7b775640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fcb74155d40 con 0x7fcb7405d370 2026-02-23T06:52:26.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.472+0000 7fcb7a773640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcb74056550 0x7fcb74201120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:26.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.472+0000 7fcb7af74640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcb7415c040 0x7fcb740b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:26.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.472+0000 7fcb7a773640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcb74056550 0x7fcb74201120 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:43962/0 (socket says 10.20.193.58:43962) 2026-02-23T06:52:26.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.472+0000 7fcb7a773640 1 -- 10.20.193.58:0/4232059249 learned_addr learned my addr 10.20.193.58:0/4232059249 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:52:26.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.472+0000 7fcb79f72640 1 --2- 10.20.193.58:0/4232059249 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcb7405d370 0x7fcb741fe670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:26.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.472+0000 7fcb7a773640 1 -- 10.20.193.58:0/4232059249 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcb7405d370 msgr2=0x7fcb741fe670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:26.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.472+0000 7fcb7a773640 1 --2- 10.20.193.58:0/4232059249 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcb7405d370 0x7fcb741fe670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.472+0000 7fcb7a773640 1 -- 10.20.193.58:0/4232059249 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcb7415c040 msgr2=0x7fcb740b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:26.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.472+0000 7fcb7a773640 1 --2- 10.20.193.58:0/4232059249 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcb7415c040 0x7fcb740b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.472+0000 7fcb7a773640 1 -- 10.20.193.58:0/4232059249 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb600094b0 con 0x7fcb74056550 2026-02-23T06:52:26.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.472+0000 7fcb7af74640 1 --2- 10.20.193.58:0/4232059249 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcb7415c040 0x7fcb740b1130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:52:26.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.473+0000 7fcb7a773640 1 --2- 10.20.193.58:0/4232059249 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcb74056550 0x7fcb74201120 secure :-1 s=READY pgs=207 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb6c007fd0 tx=0x7fcb6c00c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:52:26.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.473+0000 7fcb5effd640 1 -- 10.20.193.58:0/4232059249 <== mon.1 v2:10.20.193.93:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb6c012850 con 0x7fcb74056550 2026-02-23T06:52:26.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.473+0000 7fcb5effd640 1 -- 10.20.193.58:0/4232059249 <== mon.1 v2:10.20.193.93:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fcb6c0129b0 con 0x7fcb74056550 2026-02-23T06:52:26.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.473+0000 7fcb5effd640 1 -- 10.20.193.58:0/4232059249 <== mon.1 v2:10.20.193.93:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb6c012da0 con 0x7fcb74056550 2026-02-23T06:52:26.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.473+0000 7fcb7b775640 1 -- 10.20.193.58:0/4232059249 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb741fde70 con 0x7fcb74056550 2026-02-23T06:52:26.467 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.473+0000 7fcb7b775640 1 -- 10.20.193.58:0/4232059249 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb740aa9d0 con 0x7fcb74056550 2026-02-23T06:52:26.468 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.473+0000 7fcb7b775640 1 -- 10.20.193.58:0/4232059249 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb7405ce30 con 0x7fcb74056550 2026-02-23T06:52:26.469 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.475+0000 7fcb5effd640 1 -- 10.20.193.58:0/4232059249 <== mon.1 v2:10.20.193.93:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fcb6c01b400 con 0x7fcb74056550 2026-02-23T06:52:26.470 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.476+0000 7fcb5effd640 1 --2- 10.20.193.58:0/4232059249 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcb4407a6b0 0x7fcb4409ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:26.470 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.476+0000 7fcb5effd640 1 -- 10.20.193.58:0/4232059249 <== mon.1 v2:10.20.193.93:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fcb6c09db80 con 0x7fcb74056550 2026-02-23T06:52:26.470 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.476+0000 7fcb79f72640 1 --2- 10.20.193.58:0/4232059249 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcb4407a6b0 0x7fcb4409ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:26.470 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.476+0000 7fcb5effd640 1 -- 10.20.193.58:0/4232059249 <== mon.1 v2:10.20.193.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fcb6c0648b0 con 0x7fcb74056550 2026-02-23T06:52:26.471 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.476+0000 7fcb79f72640 1 --2- 10.20.193.58:0/4232059249 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcb4407a6b0 0x7fcb4409ab60 secure :-1 s=READY pgs=626 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb600097e0 tx=0x7fcb60031040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:52:26.613 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.618+0000 7fcb7b775640 1 -- 10.20.193.58:0/4232059249 --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb74057090 con 0x7fcb74056550 2026-02-23T06:52:26.613 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.618+0000 7fcb5effd640 1 -- 10.20.193.58:0/4232059249 <== mon.1 v2:10.20.193.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6886 (secure 0 0 0) 0x7fcb6c064000 con 0x7fcb74056550 2026-02-23T06:52:26.613 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:52:26.614 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":9,"btime":"2026-02-23T06:21:35:181391+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4320,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.58:6836/332204623","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6834","nonce":332204623},{"type":"v1","addr":"10.20.193.58:6836","nonce":332204623}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4349,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6839/49797428","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6838","nonce":49797428},{"type":"v1","addr":"10.20.193.93:6839","nonce":49797428}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4355,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.58:6833/363105980","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6832","nonce":363105980},{"type":"v1","addr":"10.20.193.58:6833","nonce":363105980}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4438,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6835/3715244768","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6834","nonce":3715244768},{"type":"v1","addr":"10.20.193.93:6835","nonce":3715244768}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4444,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6837/3986540573","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6836","nonce":3986540573},{"type":"v1","addr":"10.20.193.93:6837","nonce":3986540573}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false,"allow_referent_inodes":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-23T06:21:17.428505+0000","modified":"2026-02-23T06:21:34.468900+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4468},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4468":{"gid":4468,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"10.20.193.58:6837/4266460647","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6835","nonce":4266460647},{"type":"v1","addr":"10.20.193.58:6837","nonce":4266460647}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4468,"qdb_cluster":[4468]},"id":1}]} 2026-02-23T06:52:26.615 INFO:teuthology.orchestra.run.trial058.stderr:dumped fsmap epoch 9 2026-02-23T06:52:26.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.619+0000 7fcb7b775640 1 -- 10.20.193.58:0/4232059249 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcb4407a6b0 msgr2=0x7fcb4409ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:26.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.619+0000 7fcb7b775640 1 --2- 10.20.193.58:0/4232059249 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcb4407a6b0 0x7fcb4409ab60 secure :-1 s=READY pgs=626 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb600097e0 tx=0x7fcb60031040 comp rx=0 tx=0).stop 2026-02-23T06:52:26.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.619+0000 7fcb7b775640 1 -- 10.20.193.58:0/4232059249 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcb74056550 msgr2=0x7fcb74201120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:26.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.619+0000 7fcb7b775640 1 --2- 10.20.193.58:0/4232059249 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcb74056550 0x7fcb74201120 secure :-1 s=READY pgs=207 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb6c007fd0 tx=0x7fcb6c00c970 comp rx=0 tx=0).stop 2026-02-23T06:52:26.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.619+0000 7fcb7b775640 1 -- 10.20.193.58:0/4232059249 shutdown_connections 2026-02-23T06:52:26.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.619+0000 7fcb7b775640 1 --2- 10.20.193.58:0/4232059249 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fcb4407a6b0 0x7fcb4409ab60 unknown :-1 s=CLOSED pgs=626 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.615 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.619+0000 7fcb7b775640 1 --2- 10.20.193.58:0/4232059249 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fcb7415c040 0x7fcb740b1130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.616 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.619+0000 7fcb7b775640 1 --2- 10.20.193.58:0/4232059249 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fcb7405d370 0x7fcb741fe670 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.616 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.619+0000 7fcb7b775640 1 --2- 10.20.193.58:0/4232059249 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fcb74056550 0x7fcb74201120 unknown :-1 s=CLOSED pgs=207 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.616 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.619+0000 7fcb7b775640 1 -- 10.20.193.58:0/4232059249 >> 10.20.193.58:0/4232059249 conn(0x7fcb740b3c20 msgr2=0x7fcb7415afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:52:26.616 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.619+0000 7fcb7b775640 1 -- 10.20.193.58:0/4232059249 shutdown_connections 2026-02-23T06:52:26.616 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.619+0000 7fcb7b775640 1 -- 10.20.193.58:0/4232059249 wait complete. 2026-02-23T06:52:26.626 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2026-02-23T06:52:26.745 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.750+0000 7f0fed283640 1 -- 10.20.193.58:0/3402183551 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0fe815d4a0 msgr2=0x7f0fe80affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:26.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.750+0000 7f0fed283640 1 --2- 10.20.193.58:0/3402183551 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0fe815d4a0 0x7f0fe80affb0 secure :-1 s=READY pgs=209 gs=2 cs=0 l=1 c_cookie=10347244348466646229 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fd4004740 tx=0x7f0fd402f1e0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.750+0000 7f0fed283640 1 -- 10.20.193.58:0/3402183551 shutdown_connections 2026-02-23T06:52:26.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.750+0000 7f0fed283640 1 --2- 10.20.193.58:0/3402183551 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0fe80b6690 0x7f0fe8058ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.750+0000 7f0fed283640 1 --2- 10.20.193.58:0/3402183551 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0fe815d4a0 0x7f0fe80affb0 unknown :-1 s=CLOSED pgs=209 gs=2 cs=0 l=1 c_cookie=10347244348466646229 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.750+0000 7f0fed283640 1 -- 10.20.193.58:0/3402183551 >> 10.20.193.58:0/3402183551 conn(0x7f0fe80b3c20 msgr2=0x7f0fe80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:52:26.746 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.750+0000 7f0fed283640 1 -- 10.20.193.58:0/3402183551 shutdown_connections 2026-02-23T06:52:26.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.750+0000 7f0fed283640 1 -- 10.20.193.58:0/3402183551 wait complete. 2026-02-23T06:52:26.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.751+0000 7f0fed283640 1 Processor -- start 2026-02-23T06:52:26.749 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.751+0000 7f0fed283640 1 -- start start 2026-02-23T06:52:26.749 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.751+0000 7f0fed283640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0fe80b6690 0x7f0fe814b7f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:26.750 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.751+0000 7f0fed283640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0fe815d4a0 0x7f0fe813b1a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:26.750 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.751+0000 7f0fed283640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0fe815d870 0x7f0fe8056770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:26.750 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.751+0000 7f0fed283640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe8057660 con 0x7f0fe815d4a0 2026-02-23T06:52:26.750 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.751+0000 7f0fed283640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe80b7750 con 0x7f0fe815d870 2026-02-23T06:52:26.750 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.751+0000 7f0fed283640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f0fe80b7d70 con 0x7f0fe80b6690 2026-02-23T06:52:26.750 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.752+0000 7f0fe7fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0fe80b6690 0x7f0fe814b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:26.750 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.752+0000 7f0fe77fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0fe815d4a0 0x7f0fe813b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:26.750 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.752+0000 7f0fe7fff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0fe80b6690 0x7f0fe814b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3301/0 says I am v2:10.20.193.58:42398/0 (socket says 10.20.193.58:42398) 2026-02-23T06:52:26.750 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.752+0000 7f0fe7fff640 1 -- 10.20.193.58:0/1950642540 learned_addr learned my addr 10.20.193.58:0/1950642540 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:52:26.750 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.752+0000 7f0feca82640 1 --2- 10.20.193.58:0/1950642540 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0fe815d870 0x7f0fe8056770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:26.751 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.752+0000 7f0fe7fff640 1 -- 10.20.193.58:0/1950642540 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0fe815d870 msgr2=0x7f0fe8056770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:26.751 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.752+0000 7f0fe7fff640 1 --2- 10.20.193.58:0/1950642540 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0fe815d870 0x7f0fe8056770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.751 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.752+0000 7f0fe7fff640 1 -- 10.20.193.58:0/1950642540 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0fe815d4a0 msgr2=0x7f0fe813b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:26.751 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.752+0000 7f0fe7fff640 1 --2- 10.20.193.58:0/1950642540 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0fe815d4a0 0x7f0fe813b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.751 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.752+0000 7f0fe7fff640 1 -- 10.20.193.58:0/1950642540 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fd40094b0 con 0x7f0fe80b6690 2026-02-23T06:52:26.751 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.752+0000 7f0fe77fe640 1 --2- 10.20.193.58:0/1950642540 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0fe815d4a0 0x7f0fe813b1a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:52:26.751 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.752+0000 7f0fe7fff640 1 --2- 10.20.193.58:0/1950642540 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0fe80b6690 0x7f0fe814b7f0 secure :-1 s=READY pgs=22 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fd4004820 tx=0x7f0fd40028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:52:26.751 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.752+0000 7f0fe4ff9640 1 -- 10.20.193.58:0/1950642540 <== mon.2 v2:10.20.193.93:3301/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0fd403d070 con 0x7f0fe80b6690 2026-02-23T06:52:26.751 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.752+0000 7f0fe4ff9640 1 -- 10.20.193.58:0/1950642540 <== mon.2 v2:10.20.193.93:3301/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f0fd4038470 con 0x7f0fe80b6690 2026-02-23T06:52:26.751 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.752+0000 7f0fe4ff9640 1 -- 10.20.193.58:0/1950642540 <== mon.2 v2:10.20.193.93:3301/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0fd4038860 con 0x7f0fe80b6690 2026-02-23T06:52:26.751 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.752+0000 7f0fed283640 1 -- 10.20.193.58:0/1950642540 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fe811a0d0 con 0x7f0fe80b6690 2026-02-23T06:52:26.752 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.753+0000 7f0fed283640 1 -- 10.20.193.58:0/1950642540 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fe80b79a0 con 0x7f0fe80b6690 2026-02-23T06:52:26.752 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.753+0000 7f0fed283640 1 -- 10.20.193.58:0/1950642540 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fe80b6d50 con 0x7f0fe80b6690 2026-02-23T06:52:26.752 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.754+0000 7f0fe4ff9640 1 -- 10.20.193.58:0/1950642540 <== mon.2 v2:10.20.193.93:3301/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f0fd40389c0 con 0x7f0fe80b6690 2026-02-23T06:52:26.753 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.755+0000 7f0fe4ff9640 1 --2- 10.20.193.58:0/1950642540 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0fb807a6c0 0x7f0fb809ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:26.753 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.755+0000 7f0fe4ff9640 1 -- 10.20.193.58:0/1950642540 <== mon.2 v2:10.20.193.93:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f0fd40c1fa0 con 0x7f0fe80b6690 2026-02-23T06:52:26.753 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.755+0000 7f0fe77fe640 1 --2- 10.20.193.58:0/1950642540 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0fb807a6c0 0x7f0fb809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:26.753 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.756+0000 7f0fe77fe640 1 --2- 10.20.193.58:0/1950642540 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0fb807a6c0 0x7f0fb809ab70 secure :-1 s=READY pgs=627 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fe80b0450 tx=0x7f0fd8007f40 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:52:26.753 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.757+0000 7f0fe4ff9640 1 -- 10.20.193.58:0/1950642540 <== mon.2 v2:10.20.193.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f0fd4085300 con 0x7f0fe80b6690 2026-02-23T06:52:26.890 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.895+0000 7f0fed283640 1 -- 10.20.193.58:0/1950642540 --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0fe80b7b30 con 0x7f0fe80b6690 2026-02-23T06:52:26.890 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.895+0000 7f0fe4ff9640 1 -- 10.20.193.58:0/1950642540 <== mon.2 v2:10.20.193.93:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6886 (secure 0 0 0) 0x7f0fd4088420 con 0x7f0fe80b6690 2026-02-23T06:52:26.891 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:52:26.891 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":9,"btime":"2026-02-23T06:21:35:181391+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4320,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.58:6836/332204623","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6834","nonce":332204623},{"type":"v1","addr":"10.20.193.58:6836","nonce":332204623}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4349,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6839/49797428","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6838","nonce":49797428},{"type":"v1","addr":"10.20.193.93:6839","nonce":49797428}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4355,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.58:6833/363105980","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6832","nonce":363105980},{"type":"v1","addr":"10.20.193.58:6833","nonce":363105980}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4438,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6835/3715244768","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6834","nonce":3715244768},{"type":"v1","addr":"10.20.193.93:6835","nonce":3715244768}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4444,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.93:6837/3986540573","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6836","nonce":3986540573},{"type":"v1","addr":"10.20.193.93:6837","nonce":3986540573}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false,"allow_referent_inodes":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-23T06:21:17.428505+0000","modified":"2026-02-23T06:21:34.468900+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4468},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4468":{"gid":4468,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"10.20.193.58:6837/4266460647","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6835","nonce":4266460647},{"type":"v1","addr":"10.20.193.58:6837","nonce":4266460647}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4468,"qdb_cluster":[4468]},"id":1}]} 2026-02-23T06:52:26.891 INFO:teuthology.orchestra.run.trial058.stderr:dumped fsmap epoch 9 2026-02-23T06:52:26.892 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.896+0000 7f0fed283640 1 -- 10.20.193.58:0/1950642540 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0fb807a6c0 msgr2=0x7f0fb809ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:26.892 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.896+0000 7f0fed283640 1 --2- 10.20.193.58:0/1950642540 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0fb807a6c0 0x7f0fb809ab70 secure :-1 s=READY pgs=627 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fe80b0450 tx=0x7f0fd8007f40 comp rx=0 tx=0).stop 2026-02-23T06:52:26.892 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.896+0000 7f0fed283640 1 -- 10.20.193.58:0/1950642540 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0fe80b6690 msgr2=0x7f0fe814b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:26.892 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.896+0000 7f0fed283640 1 --2- 10.20.193.58:0/1950642540 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0fe80b6690 0x7f0fe814b7f0 secure :-1 s=READY pgs=22 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fd4004820 tx=0x7f0fd40028d0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.892 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.896+0000 7f0fed283640 1 -- 10.20.193.58:0/1950642540 shutdown_connections 2026-02-23T06:52:26.892 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.896+0000 7f0fed283640 1 --2- 10.20.193.58:0/1950642540 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f0fb807a6c0 0x7f0fb809ab70 unknown :-1 s=CLOSED pgs=627 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.892 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.896+0000 7f0fed283640 1 --2- 10.20.193.58:0/1950642540 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f0fe815d870 0x7f0fe8056770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.892 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.896+0000 7f0fed283640 1 --2- 10.20.193.58:0/1950642540 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f0fe815d4a0 0x7f0fe813b1a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.892 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.896+0000 7f0fed283640 1 --2- 10.20.193.58:0/1950642540 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f0fe80b6690 0x7f0fe814b7f0 unknown :-1 s=CLOSED pgs=22 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:26.892 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.896+0000 7f0fed283640 1 -- 10.20.193.58:0/1950642540 >> 10.20.193.58:0/1950642540 conn(0x7f0fe80b3c20 msgr2=0x7f0fe815b350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:52:26.892 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.896+0000 7f0fed283640 1 -- 10.20.193.58:0/1950642540 shutdown_connections 2026-02-23T06:52:26.892 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:26.896+0000 7f0fed283640 1 -- 10.20.193.58:0/1950642540 wait complete. 2026-02-23T06:52:26.903 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-23T06:52:27.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.027+0000 7fd9075be640 1 -- 10.20.193.58:0/1110080977 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd90015d4a0 msgr2=0x7fd9000affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:27.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.027+0000 7fd9075be640 1 --2- 10.20.193.58:0/1110080977 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd90015d4a0 0x7fd9000affb0 secure :-1 s=READY pgs=211 gs=2 cs=0 l=1 c_cookie=15576957896642992354 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd900059740 tx=0x7fd8f802f260 comp rx=0 tx=0).stop 2026-02-23T06:52:27.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.028+0000 7fd9075be640 1 -- 10.20.193.58:0/1110080977 shutdown_connections 2026-02-23T06:52:27.023 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.028+0000 7fd9075be640 1 --2- 10.20.193.58:0/1110080977 >> v2:10.20.193.93:3300/0 conn(0x7fd90015d870 0x7fd9000587b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:27.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.028+0000 7fd9075be640 1 --2- 10.20.193.58:0/1110080977 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd90015d4a0 0x7fd9000affb0 unknown :-1 s=CLOSED pgs=211 gs=2 cs=0 l=1 c_cookie=15576957896642992354 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:27.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.028+0000 7fd9075be640 1 -- 10.20.193.58:0/1110080977 >> 10.20.193.58:0/1110080977 conn(0x7fd9000b3c20 msgr2=0x7fd9000b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:52:27.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.028+0000 7fd9075be640 1 -- 10.20.193.58:0/1110080977 shutdown_connections 2026-02-23T06:52:27.024 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.028+0000 7fd9075be640 1 -- 10.20.193.58:0/1110080977 wait complete. 2026-02-23T06:52:27.026 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.029+0000 7fd9075be640 1 Processor -- start 2026-02-23T06:52:27.026 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.029+0000 7fd9075be640 1 -- start start 2026-02-23T06:52:27.026 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.029+0000 7fd9075be640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd9000b6690 0x7fd900141670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:27.026 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.029+0000 7fd9075be640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd90015d4a0 0x7fd900141bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:27.027 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.029+0000 7fd9075be640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd90015d870 0x7fd900123a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:27.027 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.029+0000 7fd9075be640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fd900140770 con 0x7fd90015d870 2026-02-23T06:52:27.027 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.029+0000 7fd9075be640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fd9001411e0 con 0x7fd90015d4a0 2026-02-23T06:52:27.027 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.029+0000 7fd9075be640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fd900120170 con 0x7fd9000b6690 2026-02-23T06:52:27.027 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.029+0000 7fd906dbd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd90015d870 0x7fd900123a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:27.027 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.029+0000 7fd9065bc640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd9000b6690 0x7fd900141670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:27.027 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.030+0000 7fd906dbd640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd90015d870 0x7fd900123a70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:48730/0 (socket says 10.20.193.58:48730) 2026-02-23T06:52:27.027 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.030+0000 7fd906dbd640 1 -- 10.20.193.58:0/761405982 learned_addr learned my addr 10.20.193.58:0/761405982 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:52:27.027 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.030+0000 7fd905dbb640 1 --2- 10.20.193.58:0/761405982 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd90015d4a0 0x7fd900141bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:27.027 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.030+0000 7fd906dbd640 1 -- 10.20.193.58:0/761405982 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd9000b6690 msgr2=0x7fd900141670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:27.027 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.030+0000 7fd906dbd640 1 --2- 10.20.193.58:0/761405982 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd9000b6690 0x7fd900141670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:27.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.030+0000 7fd906dbd640 1 -- 10.20.193.58:0/761405982 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd90015d4a0 msgr2=0x7fd900141bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:27.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.030+0000 7fd906dbd640 1 --2- 10.20.193.58:0/761405982 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd90015d4a0 0x7fd900141bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:27.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.030+0000 7fd906dbd640 1 -- 10.20.193.58:0/761405982 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f8009570 con 0x7fd90015d870 2026-02-23T06:52:27.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.030+0000 7fd906dbd640 1 --2- 10.20.193.58:0/761405982 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd90015d870 0x7fd900123a70 secure :-1 s=READY pgs=212 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8f400d700 tx=0x7fd8f400dbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:52:27.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.030+0000 7fd8eaffd640 1 -- 10.20.193.58:0/761405982 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd8f4006290 con 0x7fd90015d870 2026-02-23T06:52:27.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.030+0000 7fd9075be640 1 -- 10.20.193.58:0/761405982 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd90014b260 con 0x7fd90015d870 2026-02-23T06:52:27.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.030+0000 7fd8eaffd640 1 -- 10.20.193.58:0/761405982 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fd8f40063f0 con 0x7fd90015d870 2026-02-23T06:52:27.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.030+0000 7fd8eaffd640 1 -- 10.20.193.58:0/761405982 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd8f4004a10 con 0x7fd90015d870 2026-02-23T06:52:27.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.030+0000 7fd9075be640 1 -- 10.20.193.58:0/761405982 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd900140980 con 0x7fd90015d870 2026-02-23T06:52:27.028 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.031+0000 7fd9075be640 1 -- 10.20.193.58:0/761405982 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9000b6d50 con 0x7fd90015d870 2026-02-23T06:52:27.029 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.032+0000 7fd8eaffd640 1 -- 10.20.193.58:0/761405982 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fd8f401a020 con 0x7fd90015d870 2026-02-23T06:52:27.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.033+0000 7fd8eaffd640 1 --2- 10.20.193.58:0/761405982 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd8d007a6c0 0x7fd8d009ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:27.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.033+0000 7fd8eaffd640 1 -- 10.20.193.58:0/761405982 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7fd8f409e9d0 con 0x7fd90015d870 2026-02-23T06:52:27.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.033+0000 7fd9065bc640 1 --2- 10.20.193.58:0/761405982 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd8d007a6c0 0x7fd8d009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:27.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.034+0000 7fd8eaffd640 1 -- 10.20.193.58:0/761405982 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fd8f4061b80 con 0x7fd90015d870 2026-02-23T06:52:27.030 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.034+0000 7fd9065bc640 1 --2- 10.20.193.58:0/761405982 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd8d007a6c0 0x7fd8d009ab70 secure :-1 s=READY pgs=628 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8f802f790 tx=0x7fd8f803a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:52:27.142 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.147+0000 7fd9075be640 1 -- 10.20.193.58:0/761405982 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd90005b0e0 con 0x7fd90015d870 2026-02-23T06:52:27.143 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.148+0000 7fd8eaffd640 1 -- 10.20.193.58:0/761405982 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18696 (secure 0 0 0) 0x7fd8f4064d30 con 0x7fd90015d870 2026-02-23T06:52:27.143 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-23T06:52:27.144 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":27,"fsid":"2624bd29-dc40-41ea-9c77-09981694f232","created":"2026-02-23T06:21:02.010508+0000","modified":"2026-02-23T06:22:05.841021+0000","last_up_change":"2026-02-23T06:21:08.383048+0000","last_in_change":"2026-02-23T06:21:04.690899+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-23T06:21:10.389081+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-23T06:21:16.080621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-23T06:21:16.401311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-23T06:21:20.153808+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"96cc0898-14bb-4d56-827a-8845bd4307c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6808","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6809","nonce":692913334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6810","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6811","nonce":692913334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6814","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6815","nonce":692913334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6812","nonce":692913334},{"type":"v1","addr":"10.20.193.58:6813","nonce":692913334}]},"public_addr":"10.20.193.58:6809/692913334","cluster_addr":"10.20.193.58:6811/692913334","heartbeat_back_addr":"10.20.193.58:6815/692913334","heartbeat_front_addr":"10.20.193.58:6813/692913334","state":["exists","up"]},{"osd":1,"uuid":"bf665af4-6e3c-4cb3-899c-acede65c31f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6800","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6801","nonce":1850584280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6802","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6803","nonce":1850584280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6806","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6807","nonce":1850584280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6804","nonce":1850584280},{"type":"v1","addr":"10.20.193.58:6805","nonce":1850584280}]},"public_addr":"10.20.193.58:6801/1850584280","cluster_addr":"10.20.193.58:6803/1850584280","heartbeat_back_addr":"10.20.193.58:6807/1850584280","heartbeat_front_addr":"10.20.193.58:6805/1850584280","state":["exists","up"]},{"osd":2,"uuid":"2bcb3165-28ad-45d6-9a49-9d9da08501f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6823","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6825","nonce":4284600061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6826","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6827","nonce":4284600061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6830","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6831","nonce":4284600061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6828","nonce":4284600061},{"type":"v1","addr":"10.20.193.58:6829","nonce":4284600061}]},"public_addr":"10.20.193.58:6825/4284600061","cluster_addr":"10.20.193.58:6827/4284600061","heartbeat_back_addr":"10.20.193.58:6831/4284600061","heartbeat_front_addr":"10.20.193.58:6829/4284600061","state":["exists","up"]},{"osd":3,"uuid":"4750309a-5bf2-4f48-a550-ca677b0b0f61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6816","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6817","nonce":2858636994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6818","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6819","nonce":2858636994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6822","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6824","nonce":2858636994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6820","nonce":2858636994},{"type":"v1","addr":"10.20.193.58:6821","nonce":2858636994}]},"public_addr":"10.20.193.58:6817/2858636994","cluster_addr":"10.20.193.58:6819/2858636994","heartbeat_back_addr":"10.20.193.58:6824/2858636994","heartbeat_front_addr":"10.20.193.58:6821/2858636994","state":["exists","up"]},{"osd":4,"uuid":"5cbb50f2-4e49-46eb-bd84-d92706459d2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6803","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6805","nonce":1874834171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6807","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6809","nonce":1874834171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6816","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6817","nonce":1874834171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6812","nonce":1874834171},{"type":"v1","addr":"10.20.193.93:6814","nonce":1874834171}]},"public_addr":"10.20.193.93:6805/1874834171","cluster_addr":"10.20.193.93:6809/1874834171","heartbeat_back_addr":"10.20.193.93:6817/1874834171","heartbeat_front_addr":"10.20.193.93:6814/1874834171","state":["exists","up"]},{"osd":5,"uuid":"2806c775-4720-43a7-ab9f-85a4adb31098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6802","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6804","nonce":356968280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6806","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6808","nonce":356968280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6813","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6815","nonce":356968280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6810","nonce":356968280},{"type":"v1","addr":"10.20.193.93:6811","nonce":356968280}]},"public_addr":"10.20.193.93:6804/356968280","cluster_addr":"10.20.193.93:6808/356968280","heartbeat_back_addr":"10.20.193.93:6815/356968280","heartbeat_front_addr":"10.20.193.93:6811/356968280","state":["exists","up"]},{"osd":6,"uuid":"aa03b46d-d30f-4b09-9251-c9514e8b8b6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6819","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6821","nonce":2948039088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6823","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6825","nonce":2948039088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6831","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6833","nonce":2948039088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6827","nonce":2948039088},{"type":"v1","addr":"10.20.193.93:6829","nonce":2948039088}]},"public_addr":"10.20.193.93:6821/2948039088","cluster_addr":"10.20.193.93:6825/2948039088","heartbeat_back_addr":"10.20.193.93:6833/2948039088","heartbeat_front_addr":"10.20.193.93:6829/2948039088","state":["exists","up"]},{"osd":7,"uuid":"b15519bf-2b7b-4fd5-8ef6-e09af0ad9817","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6818","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6820","nonce":2960650087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6822","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6824","nonce":2960650087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6830","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6832","nonce":2960650087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.93:6826","nonce":2960650087},{"type":"v1","addr":"10.20.193.93:6828","nonce":2960650087}]},"public_addr":"10.20.193.93:6820/2960650087","cluster_addr":"10.20.193.93:6824/2960650087","heartbeat_back_addr":"10.20.193.93:6832/2960650087","heartbeat_front_addr":"10.20.193.93:6828/2960650087","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.717515+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.744114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.772247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.768341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.521808+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.486005+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.480882+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-23T06:21:06.473408+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1d","mappings":[{"from":0,"to":7}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"2","m":"2","plugin":"isa","technique":"reed_sol_van"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-23T06:52:27.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.149+0000 7fd9075be640 1 -- 10.20.193.58:0/761405982 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd8d007a6c0 msgr2=0x7fd8d009ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:27.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.149+0000 7fd9075be640 1 --2- 10.20.193.58:0/761405982 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd8d007a6c0 0x7fd8d009ab70 secure :-1 s=READY pgs=628 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8f802f790 tx=0x7fd8f803a040 comp rx=0 tx=0).stop 2026-02-23T06:52:27.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.149+0000 7fd9075be640 1 -- 10.20.193.58:0/761405982 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd90015d870 msgr2=0x7fd900123a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:27.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.149+0000 7fd9075be640 1 --2- 10.20.193.58:0/761405982 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd90015d870 0x7fd900123a70 secure :-1 s=READY pgs=212 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8f400d700 tx=0x7fd8f400dbd0 comp rx=0 tx=0).stop 2026-02-23T06:52:27.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.149+0000 7fd9075be640 1 -- 10.20.193.58:0/761405982 shutdown_connections 2026-02-23T06:52:27.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.149+0000 7fd9075be640 1 --2- 10.20.193.58:0/761405982 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd8d007a6c0 0x7fd8d009ab70 unknown :-1 s=CLOSED pgs=628 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:27.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.149+0000 7fd9075be640 1 --2- 10.20.193.58:0/761405982 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd90015d870 0x7fd900123a70 unknown :-1 s=CLOSED pgs=212 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:27.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.149+0000 7fd9075be640 1 --2- 10.20.193.58:0/761405982 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd90015d4a0 0x7fd900141bb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:27.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.149+0000 7fd9075be640 1 --2- 10.20.193.58:0/761405982 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd9000b6690 0x7fd900141670 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:27.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.149+0000 7fd9075be640 1 -- 10.20.193.58:0/761405982 >> 10.20.193.58:0/761405982 conn(0x7fd9000b3c20 msgr2=0x7fd90005d100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:52:27.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.149+0000 7fd9075be640 1 -- 10.20.193.58:0/761405982 shutdown_connections 2026-02-23T06:52:27.145 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.149+0000 7fd9075be640 1 -- 10.20.193.58:0/761405982 wait complete. 2026-02-23T06:52:27.155 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2026-02-23T06:52:27.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.280+0000 7f5cef375640 1 -- 10.20.193.58:0/3224922964 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5ce8056550 msgr2=0x7f5ce805ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:27.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.280+0000 7f5cef375640 1 --2- 10.20.193.58:0/3224922964 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5ce8056550 0x7f5ce805ce30 secure :-1 s=READY pgs=210 gs=3 cs=0 l=1 c_cookie=9409736657403634167 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cdc004740 tx=0x7f5cdc02f1d0 comp rx=0 tx=0).stop 2026-02-23T06:52:27.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.280+0000 7f5cef375640 1 -- 10.20.193.58:0/3224922964 shutdown_connections 2026-02-23T06:52:27.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.280+0000 7f5cef375640 1 --2- 10.20.193.58:0/3224922964 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5ce8056550 0x7f5ce805ce30 unknown :-1 s=CLOSED pgs=210 gs=3 cs=0 l=1 c_cookie=9409736657403634167 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:27.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.280+0000 7f5cef375640 1 -- 10.20.193.58:0/3224922964 >> 10.20.193.58:0/3224922964 conn(0x7f5ce80b3c20 msgr2=0x7f5ce80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:52:27.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.280+0000 7f5cef375640 1 -- 10.20.193.58:0/3224922964 shutdown_connections 2026-02-23T06:52:27.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.280+0000 7f5cef375640 1 -- 10.20.193.58:0/3224922964 wait complete. 2026-02-23T06:52:27.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.281+0000 7f5cef375640 1 Processor -- start 2026-02-23T06:52:27.275 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.281+0000 7f5cef375640 1 -- start start 2026-02-23T06:52:27.276 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.282+0000 7f5cef375640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ce8056550 0x7f5ce8164ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:27.276 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.282+0000 7f5cef375640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5ce805d370 0x7f5ce80ac620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:27.276 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.282+0000 7f5cef375640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ce815c040 0x7f5ce80acb60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:27.276 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.282+0000 7f5cef375640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce81fea60 con 0x7f5ce815c040 2026-02-23T06:52:27.276 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.282+0000 7f5cef375640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce80aad70 con 0x7f5ce805d370 2026-02-23T06:52:27.276 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.282+0000 7f5cef375640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f5ce81fe4e0 con 0x7f5ce8056550 2026-02-23T06:52:27.276 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.282+0000 7f5cedb72640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5ce805d370 0x7f5ce80ac620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:27.276 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.282+0000 7f5ceeb74640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ce815c040 0x7f5ce80acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:27.276 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.282+0000 7f5cee373640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ce8056550 0x7f5ce8164ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:27.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.282+0000 7f5cedb72640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5ce805d370 0x7f5ce80ac620 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:44020/0 (socket says 10.20.193.58:44020) 2026-02-23T06:52:27.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.282+0000 7f5cedb72640 1 -- 10.20.193.58:0/149619651 learned_addr learned my addr 10.20.193.58:0/149619651 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:52:27.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.282+0000 7f5ceeb74640 1 -- 10.20.193.58:0/149619651 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ce8056550 msgr2=0x7f5ce8164ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:27.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.282+0000 7f5ceeb74640 1 --2- 10.20.193.58:0/149619651 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ce8056550 0x7f5ce8164ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:27.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.282+0000 7f5ceeb74640 1 -- 10.20.193.58:0/149619651 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5ce805d370 msgr2=0x7f5ce80ac620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:27.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.282+0000 7f5ceeb74640 1 --2- 10.20.193.58:0/149619651 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5ce805d370 0x7f5ce80ac620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:27.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.282+0000 7f5ceeb74640 1 -- 10.20.193.58:0/149619651 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cdc0094b0 con 0x7f5ce815c040 2026-02-23T06:52:27.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.282+0000 7f5cedb72640 1 --2- 10.20.193.58:0/149619651 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5ce805d370 0x7f5ce80ac620 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:52:27.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.282+0000 7f5ceeb74640 1 --2- 10.20.193.58:0/149619651 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ce815c040 0x7f5ce80acb60 secure :-1 s=READY pgs=214 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ce4003a80 tx=0x7f5ce400d970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:52:27.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.283+0000 7f5cceffd640 1 -- 10.20.193.58:0/149619651 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ce4013850 con 0x7f5ce815c040 2026-02-23T06:52:27.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.283+0000 7f5cef375640 1 -- 10.20.193.58:0/149619651 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ce81fe780 con 0x7f5ce815c040 2026-02-23T06:52:27.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.283+0000 7f5cceffd640 1 -- 10.20.193.58:0/149619651 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f5ce40139b0 con 0x7f5ce815c040 2026-02-23T06:52:27.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.283+0000 7f5cceffd640 1 -- 10.20.193.58:0/149619651 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ce4013e00 con 0x7f5ce815c040 2026-02-23T06:52:27.277 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.283+0000 7f5cef375640 1 -- 10.20.193.58:0/149619651 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ce80aa170 con 0x7f5ce815c040 2026-02-23T06:52:27.278 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.283+0000 7f5cef375640 1 -- 10.20.193.58:0/149619651 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ce80aaee0 con 0x7f5ce815c040 2026-02-23T06:52:27.279 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.285+0000 7f5cceffd640 1 -- 10.20.193.58:0/149619651 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f5ce401c400 con 0x7f5ce815c040 2026-02-23T06:52:27.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.286+0000 7f5cceffd640 1 --2- 10.20.193.58:0/149619651 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5cb807a6b0 0x7f5cb809ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:27.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.286+0000 7f5cceffd640 1 -- 10.20.193.58:0/149619651 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6537+0+0 (secure 0 0 0) 0x7f5ce409e710 con 0x7f5ce815c040 2026-02-23T06:52:27.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.286+0000 7f5cee373640 1 --2- 10.20.193.58:0/149619651 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5cb807a6b0 0x7f5cb809ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:27.281 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.287+0000 7f5cee373640 1 --2- 10.20.193.58:0/149619651 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5cb807a6b0 0x7f5cb809ab60 secure :-1 s=READY pgs=629 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cd8007fd0 tx=0x7f5cd8007ec0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:52:27.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.287+0000 7f5cceffd640 1 -- 10.20.193.58:0/149619651 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f5ce80aaee0 con 0x7f5ce815c040 2026-02-23T06:52:27.421 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.427+0000 7f5cef375640 1 -- 10.20.193.58:0/149619651 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5ce80aaee0 con 0x7f5ce815c040 2026-02-23T06:52:27.423 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.428+0000 7f5cceffd640 1 -- 10.20.193.58:0/149619651 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f5ce80aaee0 con 0x7f5ce815c040 2026-02-23T06:52:27.423 INFO:teuthology.orchestra.run.trial058.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2026-02-23T06:52:27.425 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.430+0000 7f5cef375640 1 -- 10.20.193.58:0/149619651 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5cb807a6b0 msgr2=0x7f5cb809ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:27.425 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.430+0000 7f5cef375640 1 --2- 10.20.193.58:0/149619651 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5cb807a6b0 0x7f5cb809ab60 secure :-1 s=READY pgs=629 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cd8007fd0 tx=0x7f5cd8007ec0 comp rx=0 tx=0).stop 2026-02-23T06:52:27.425 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.430+0000 7f5cef375640 1 -- 10.20.193.58:0/149619651 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ce815c040 msgr2=0x7f5ce80acb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:27.425 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.430+0000 7f5cef375640 1 --2- 10.20.193.58:0/149619651 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ce815c040 0x7f5ce80acb60 secure :-1 s=READY pgs=214 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ce4003a80 tx=0x7f5ce400d970 comp rx=0 tx=0).stop 2026-02-23T06:52:27.425 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.431+0000 7f5cef375640 1 -- 10.20.193.58:0/149619651 shutdown_connections 2026-02-23T06:52:27.425 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.431+0000 7f5cef375640 1 --2- 10.20.193.58:0/149619651 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f5cb807a6b0 0x7f5cb809ab60 unknown :-1 s=CLOSED pgs=629 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:27.425 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.431+0000 7f5cef375640 1 --2- 10.20.193.58:0/149619651 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f5ce815c040 0x7f5ce80acb60 unknown :-1 s=CLOSED pgs=214 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:27.425 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.431+0000 7f5cef375640 1 --2- 10.20.193.58:0/149619651 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f5ce805d370 0x7f5ce80ac620 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:27.425 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.431+0000 7f5cef375640 1 --2- 10.20.193.58:0/149619651 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f5ce8056550 0x7f5ce8164ac0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:27.425 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.431+0000 7f5cef375640 1 -- 10.20.193.58:0/149619651 >> 10.20.193.58:0/149619651 conn(0x7f5ce80b3c20 msgr2=0x7f5ce81598a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:52:27.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.432+0000 7f5cef375640 1 -- 10.20.193.58:0/149619651 shutdown_connections 2026-02-23T06:52:27.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.432+0000 7f5cef375640 1 -- 10.20.193.58:0/149619651 wait complete. 2026-02-23T06:52:27.441 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2026-02-23T06:52:27.474 INFO:tasks.ceph.mds.e.trial058.stdout:starting mds.e at 2026-02-23T06:52:27.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.569+0000 7f2d725be640 1 -- 10.20.193.58:0/3231205756 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2d6c0b5680 msgr2=0x7f2d6c0b5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:27.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.569+0000 7f2d725be640 1 --2- 10.20.193.58:0/3231205756 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2d6c0b5680 0x7f2d6c0b5b20 secure :-1 s=READY pgs=216 gs=2 cs=0 l=1 c_cookie=10239097125449634472 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d68006f50 tx=0x7f2d68030360 comp rx=0 tx=0).stop 2026-02-23T06:52:27.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.569+0000 7f2d725be640 1 -- 10.20.193.58:0/3231205756 shutdown_connections 2026-02-23T06:52:27.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.569+0000 7f2d725be640 1 --2- 10.20.193.58:0/3231205756 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2d6c0b5680 0x7f2d6c0b5b20 unknown :-1 s=CLOSED pgs=216 gs=2 cs=0 l=1 c_cookie=10239097125449634472 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:27.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.569+0000 7f2d725be640 1 --2- 10.20.193.58:0/3231205756 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2d6c15c040 0x7f2d6c05b0e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:27.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.569+0000 7f2d725be640 1 -- 10.20.193.58:0/3231205756 >> 10.20.193.58:0/3231205756 conn(0x7f2d6c0b3c20 msgr2=0x7f2d6c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:52:27.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.569+0000 7f2d725be640 1 -- 10.20.193.58:0/3231205756 shutdown_connections 2026-02-23T06:52:27.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.569+0000 7f2d725be640 1 -- 10.20.193.58:0/3231205756 wait complete. 2026-02-23T06:52:27.565 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.570+0000 7f2d725be640 1 Processor -- start 2026-02-23T06:52:27.565 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.570+0000 7f2d725be640 1 -- start start 2026-02-23T06:52:27.565 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.571+0000 7f2d725be640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2d6c056550 0x7f2d6c154da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:27.565 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.571+0000 7f2d725be640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2d6c0b5680 0x7f2d6c125230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:27.565 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.571+0000 7f2d725be640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2d6c15c040 0x7f2d6c0585e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:27.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.571+0000 7f2d725be640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c162940 con 0x7f2d6c056550 2026-02-23T06:52:27.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.571+0000 7f2d725be640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c1558e0 con 0x7f2d6c0b5680 2026-02-23T06:52:27.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.571+0000 7f2d725be640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7f2d6c155b80 con 0x7f2d6c15c040 2026-02-23T06:52:27.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.571+0000 7f2d715bc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2d6c056550 0x7f2d6c154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:27.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.571+0000 7f2d70dbb640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2d6c0b5680 0x7f2d6c125230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:27.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.571+0000 7f2d70dbb640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2d6c0b5680 0x7f2d6c125230 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.93:3300/0 says I am v2:10.20.193.58:44052/0 (socket says 10.20.193.58:44052) 2026-02-23T06:52:27.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.571+0000 7f2d715bc640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2d6c056550 0x7f2d6c154da0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:48766/0 (socket says 10.20.193.58:48766) 2026-02-23T06:52:27.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.571+0000 7f2d71dbd640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2d6c15c040 0x7f2d6c0585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:27.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.571+0000 7f2d715bc640 1 -- 10.20.193.58:0/539320684 learned_addr learned my addr 10.20.193.58:0/539320684 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:52:27.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.571+0000 7f2d715bc640 1 -- 10.20.193.58:0/539320684 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2d6c15c040 msgr2=0x7f2d6c0585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:27.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.571+0000 7f2d715bc640 1 --2- 10.20.193.58:0/539320684 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2d6c15c040 0x7f2d6c0585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:27.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.571+0000 7f2d715bc640 1 -- 10.20.193.58:0/539320684 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2d6c0b5680 msgr2=0x7f2d6c125230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:27.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.571+0000 7f2d715bc640 1 --2- 10.20.193.58:0/539320684 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2d6c0b5680 0x7f2d6c125230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:27.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.572+0000 7f2d715bc640 1 -- 10.20.193.58:0/539320684 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d6800a650 con 0x7f2d6c056550 2026-02-23T06:52:27.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.572+0000 7f2d71dbd640 1 --2- 10.20.193.58:0/539320684 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2d6c15c040 0x7f2d6c0585e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-23T06:52:27.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.572+0000 7f2d715bc640 1 --2- 10.20.193.58:0/539320684 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2d6c056550 0x7f2d6c154da0 secure :-1 s=READY pgs=217 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d5c009480 tx=0x7f2d5c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:52:27.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.572+0000 7f2d59ffb640 1 -- 10.20.193.58:0/539320684 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2d5c00cd40 con 0x7f2d6c056550 2026-02-23T06:52:27.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.572+0000 7f2d725be640 1 -- 10.20.193.58:0/539320684 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d6c162bb0 con 0x7f2d6c056550 2026-02-23T06:52:27.566 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.572+0000 7f2d725be640 1 -- 10.20.193.58:0/539320684 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d6c157ed0 con 0x7f2d6c056550 2026-02-23T06:52:27.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.572+0000 7f2d59ffb640 1 -- 10.20.193.58:0/539320684 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f2d5c004850 con 0x7f2d6c056550 2026-02-23T06:52:27.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.572+0000 7f2d59ffb640 1 -- 10.20.193.58:0/539320684 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2d5c004ca0 con 0x7f2d6c056550 2026-02-23T06:52:27.567 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.573+0000 7f2d725be640 1 -- 10.20.193.58:0/539320684 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d6c1552e0 con 0x7f2d6c056550 2026-02-23T06:52:27.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.574+0000 7f2d59ffb640 1 -- 10.20.193.58:0/539320684 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7f2d5c01f060 con 0x7f2d6c056550 2026-02-23T06:52:27.570 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.575+0000 7f2d59ffb640 1 --2- 10.20.193.58:0/539320684 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2d3c07a6c0 0x7f2d3c09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:27.570 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.575+0000 7f2d59ffb640 1 -- 10.20.193.58:0/539320684 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6623+0+0 (secure 0 0 0) 0x7f2d5c014070 con 0x7f2d6c056550 2026-02-23T06:52:27.570 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.575+0000 7f2d70dbb640 1 --2- 10.20.193.58:0/539320684 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2d3c07a6c0 0x7f2d3c09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:27.571 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.576+0000 7f2d70dbb640 1 --2- 10.20.193.58:0/539320684 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2d3c07a6c0 0x7f2d3c09ab70 secure :-1 s=READY pgs=630 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d6c163270 tx=0x7f2d60007ee0 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:52:27.571 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.576+0000 7f2d59ffb640 1 -- 10.20.193.58:0/539320684 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7f2d5c061050 con 0x7f2d6c056550 2026-02-23T06:52:27.711 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:27.716+0000 7f2d725be640 1 -- 10.20.193.58:0/539320684 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2d6c05d9c0 con 0x7f2d6c056550 2026-02-23T06:52:28.424 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.429+0000 7f2d59ffb640 1 -- 10.20.193.58:0/539320684 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 If there are active snapshot schedules associated with this file-system, you might see EIO errors in the mgr logs or at the snap-schedule command-line due to the missing file-system. However, these errors are transient and will get auto-resolved. v11) ==== 350+0+0 (secure 0 0 0) 0x7f2d5c064200 con 0x7f2d6c056550 2026-02-23T06:52:28.424 INFO:teuthology.orchestra.run.trial058.stderr:If there are active snapshot schedules associated with this file-system, you might see EIO errors in the mgr logs or at the snap-schedule command-line due to the missing file-system. However, these errors are transient and will get auto-resolved. 2026-02-23T06:52:28.426 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.431+0000 7f2d725be640 1 -- 10.20.193.58:0/539320684 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2d3c07a6c0 msgr2=0x7f2d3c09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:28.426 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.431+0000 7f2d725be640 1 --2- 10.20.193.58:0/539320684 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2d3c07a6c0 0x7f2d3c09ab70 secure :-1 s=READY pgs=630 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d6c163270 tx=0x7f2d60007ee0 comp rx=0 tx=0).stop 2026-02-23T06:52:28.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.431+0000 7f2d725be640 1 -- 10.20.193.58:0/539320684 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2d6c056550 msgr2=0x7f2d6c154da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:28.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.431+0000 7f2d725be640 1 --2- 10.20.193.58:0/539320684 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2d6c056550 0x7f2d6c154da0 secure :-1 s=READY pgs=217 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d5c009480 tx=0x7f2d5c00ee60 comp rx=0 tx=0).stop 2026-02-23T06:52:28.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.431+0000 7f2d725be640 1 -- 10.20.193.58:0/539320684 shutdown_connections 2026-02-23T06:52:28.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.431+0000 7f2d725be640 1 --2- 10.20.193.58:0/539320684 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7f2d3c07a6c0 0x7f2d3c09ab70 unknown :-1 s=CLOSED pgs=630 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:28.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.431+0000 7f2d725be640 1 --2- 10.20.193.58:0/539320684 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7f2d6c15c040 0x7f2d6c0585e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:28.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.431+0000 7f2d725be640 1 --2- 10.20.193.58:0/539320684 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7f2d6c0b5680 0x7f2d6c125230 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:28.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.431+0000 7f2d725be640 1 --2- 10.20.193.58:0/539320684 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7f2d6c056550 0x7f2d6c154da0 unknown :-1 s=CLOSED pgs=217 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:28.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.431+0000 7f2d725be640 1 -- 10.20.193.58:0/539320684 >> 10.20.193.58:0/539320684 conn(0x7f2d6c0b3c20 msgr2=0x7f2d6c15a270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:52:28.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.431+0000 7f2d725be640 1 -- 10.20.193.58:0/539320684 shutdown_connections 2026-02-23T06:52:28.427 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.431+0000 7f2d725be640 1 -- 10.20.193.58:0/539320684 wait complete. 2026-02-23T06:52:28.441 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2026-02-23T06:52:28.603 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.608+0000 7fd652443640 1 -- 10.20.193.58:0/1421151963 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd64c056550 msgr2=0x7fd64c05ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:28.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.608+0000 7fd652443640 1 --2- 10.20.193.58:0/1421151963 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd64c056550 0x7fd64c05ce30 secure :-1 s=READY pgs=218 gs=1 cs=0 l=1 c_cookie=2537496418217306595 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd64c0b5010 tx=0x7fd64002f250 comp rx=0 tx=0).stop 2026-02-23T06:52:28.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.608+0000 7fd652443640 1 -- 10.20.193.58:0/1421151963 shutdown_connections 2026-02-23T06:52:28.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.608+0000 7fd652443640 1 --2- 10.20.193.58:0/1421151963 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd64c05d370 0x7fd64c0b5680 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:28.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.608+0000 7fd652443640 1 --2- 10.20.193.58:0/1421151963 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd64c056550 0x7fd64c05ce30 unknown :-1 s=CLOSED pgs=218 gs=1 cs=0 l=1 c_cookie=2537496418217306595 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:28.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.608+0000 7fd652443640 1 --2- 10.20.193.58:0/1421151963 >> v2:10.20.193.93:3300/0 conn(0x7fd64c15c040 0x7fd64c05b0e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:28.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.608+0000 7fd652443640 1 -- 10.20.193.58:0/1421151963 >> 10.20.193.58:0/1421151963 conn(0x7fd64c0b3c20 msgr2=0x7fd64c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:52:28.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.608+0000 7fd652443640 1 -- 10.20.193.58:0/1421151963 shutdown_connections 2026-02-23T06:52:28.604 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.608+0000 7fd652443640 1 -- 10.20.193.58:0/1421151963 wait complete. 2026-02-23T06:52:28.606 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.609+0000 7fd652443640 1 Processor -- start 2026-02-23T06:52:28.606 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.609+0000 7fd652443640 1 -- start start 2026-02-23T06:52:28.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.610+0000 7fd652443640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd64c056550 0x7fd64c15c8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:28.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.610+0000 7fd652443640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd64c05d370 0x7fd64c1fe720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:28.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.610+0000 7fd652443640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd64c15c040 0x7fd64c058810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:28.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.610+0000 7fd652443640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fd64c1fe290 con 0x7fd64c056550 2026-02-23T06:52:28.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.610+0000 7fd652443640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fd64c1623e0 con 0x7fd64c05d370 2026-02-23T06:52:28.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.610+0000 7fd652443640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fd64c1559c0 con 0x7fd64c15c040 2026-02-23T06:52:28.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.610+0000 7fd651441640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd64c056550 0x7fd64c15c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:28.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.610+0000 7fd650c40640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd64c05d370 0x7fd64c1fe720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:28.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.610+0000 7fd651441640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd64c056550 0x7fd64c15c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:48782/0 (socket says 10.20.193.58:48782) 2026-02-23T06:52:28.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.610+0000 7fd651441640 1 -- 10.20.193.58:0/3391006388 learned_addr learned my addr 10.20.193.58:0/3391006388 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:52:28.607 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.611+0000 7fd651c42640 1 --2- 10.20.193.58:0/3391006388 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd64c15c040 0x7fd64c058810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:28.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.611+0000 7fd651441640 1 -- 10.20.193.58:0/3391006388 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd64c15c040 msgr2=0x7fd64c058810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:28.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.611+0000 7fd651441640 1 --2- 10.20.193.58:0/3391006388 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd64c15c040 0x7fd64c058810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:28.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.611+0000 7fd651441640 1 -- 10.20.193.58:0/3391006388 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd64c05d370 msgr2=0x7fd64c1fe720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:28.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.611+0000 7fd651441640 1 --2- 10.20.193.58:0/3391006388 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd64c05d370 0x7fd64c1fe720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:28.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.611+0000 7fd651441640 1 -- 10.20.193.58:0/3391006388 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd640009570 con 0x7fd64c056550 2026-02-23T06:52:28.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.611+0000 7fd651c42640 1 --2- 10.20.193.58:0/3391006388 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd64c15c040 0x7fd64c058810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-23T06:52:28.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.611+0000 7fd651441640 1 --2- 10.20.193.58:0/3391006388 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd64c056550 0x7fd64c15c8c0 secure :-1 s=READY pgs=219 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd63c009480 tx=0x7fd63c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:52:28.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.611+0000 7fd639ffb640 1 -- 10.20.193.58:0/3391006388 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd63c00cd40 con 0x7fd64c056550 2026-02-23T06:52:28.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.611+0000 7fd639ffb640 1 -- 10.20.193.58:0/3391006388 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fd63c004850 con 0x7fd64c056550 2026-02-23T06:52:28.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.611+0000 7fd652443640 1 -- 10.20.193.58:0/3391006388 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd64c155c60 con 0x7fd64c056550 2026-02-23T06:52:28.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.611+0000 7fd639ffb640 1 -- 10.20.193.58:0/3391006388 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd63c004ca0 con 0x7fd64c056550 2026-02-23T06:52:28.608 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.611+0000 7fd652443640 1 -- 10.20.193.58:0/3391006388 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd64c1620c0 con 0x7fd64c056550 2026-02-23T06:52:28.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.612+0000 7fd652443640 1 -- 10.20.193.58:0/3391006388 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd64c05ce30 con 0x7fd64c056550 2026-02-23T06:52:28.609 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.613+0000 7fd639ffb640 1 -- 10.20.193.58:0/3391006388 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fd63c01f060 con 0x7fd64c056550 2026-02-23T06:52:28.610 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.614+0000 7fd639ffb640 1 --2- 10.20.193.58:0/3391006388 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd61c07a6c0 0x7fd61c09ab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:28.610 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.614+0000 7fd639ffb640 1 -- 10.20.193.58:0/3391006388 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6623+0+0 (secure 0 0 0) 0x7fd63c014070 con 0x7fd64c056550 2026-02-23T06:52:28.610 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.615+0000 7fd650c40640 1 --2- 10.20.193.58:0/3391006388 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd61c07a6c0 0x7fd61c09ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:28.610 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.615+0000 7fd650c40640 1 --2- 10.20.193.58:0/3391006388 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd61c07a6c0 0x7fd61c09ab70 secure :-1 s=READY pgs=632 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6400023d0 tx=0x7fd64003a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:52:28.610 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.616+0000 7fd639ffb640 1 -- 10.20.193.58:0/3391006388 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fd63c060f40 con 0x7fd64c056550 2026-02-23T06:52:28.724 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:28.730+0000 7fd652443640 1 -- 10.20.193.58:0/3391006388 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd64c162f70 con 0x7fd64c056550 2026-02-23T06:52:29.429 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.434+0000 7fd639ffb640 1 -- 10.20.193.58:0/3391006388 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7fd63c064060 con 0x7fd64c056550 2026-02-23T06:52:29.429 INFO:teuthology.orchestra.run.trial058.stderr:pool 'cephfs_metadata' removed 2026-02-23T06:52:29.432 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.437+0000 7fd652443640 1 -- 10.20.193.58:0/3391006388 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd61c07a6c0 msgr2=0x7fd61c09ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:29.432 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.437+0000 7fd652443640 1 --2- 10.20.193.58:0/3391006388 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd61c07a6c0 0x7fd61c09ab70 secure :-1 s=READY pgs=632 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6400023d0 tx=0x7fd64003a040 comp rx=0 tx=0).stop 2026-02-23T06:52:29.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.437+0000 7fd652443640 1 -- 10.20.193.58:0/3391006388 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd64c056550 msgr2=0x7fd64c15c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:29.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.437+0000 7fd652443640 1 --2- 10.20.193.58:0/3391006388 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd64c056550 0x7fd64c15c8c0 secure :-1 s=READY pgs=219 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd63c009480 tx=0x7fd63c00ee60 comp rx=0 tx=0).stop 2026-02-23T06:52:29.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.438+0000 7fd652443640 1 -- 10.20.193.58:0/3391006388 shutdown_connections 2026-02-23T06:52:29.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.438+0000 7fd652443640 1 --2- 10.20.193.58:0/3391006388 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fd61c07a6c0 0x7fd61c09ab70 unknown :-1 s=CLOSED pgs=632 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:29.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.438+0000 7fd652443640 1 --2- 10.20.193.58:0/3391006388 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fd64c15c040 0x7fd64c058810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:29.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.438+0000 7fd652443640 1 --2- 10.20.193.58:0/3391006388 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fd64c05d370 0x7fd64c1fe720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:29.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.438+0000 7fd652443640 1 --2- 10.20.193.58:0/3391006388 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fd64c056550 0x7fd64c15c8c0 unknown :-1 s=CLOSED pgs=219 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:29.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.438+0000 7fd652443640 1 -- 10.20.193.58:0/3391006388 >> 10.20.193.58:0/3391006388 conn(0x7fd64c0b3c20 msgr2=0x7fd64c15a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:52:29.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.439+0000 7fd652443640 1 -- 10.20.193.58:0/3391006388 shutdown_connections 2026-02-23T06:52:29.434 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.439+0000 7fd652443640 1 -- 10.20.193.58:0/3391006388 wait complete. 2026-02-23T06:52:29.450 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2026-02-23T06:52:29.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.578+0000 7fc18ffff640 1 -- 10.20.193.58:0/1074436950 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc19015d4a0 msgr2=0x7fc1900affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:29.573 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.578+0000 7fc18ffff640 1 --2- 10.20.193.58:0/1074436950 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc19015d4a0 0x7fc1900affb0 secure :-1 s=READY pgs=220 gs=1 cs=0 l=1 c_cookie=13909160251383252873 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc190160f40 tx=0x7fc18402f250 comp rx=0 tx=0).stop 2026-02-23T06:52:29.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.578+0000 7fc18ffff640 1 -- 10.20.193.58:0/1074436950 shutdown_connections 2026-02-23T06:52:29.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.578+0000 7fc18ffff640 1 --2- 10.20.193.58:0/1074436950 >> v2:10.20.193.93:3300/0 conn(0x7fc1900b6690 0x7fc190058cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:29.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.578+0000 7fc18ffff640 1 --2- 10.20.193.58:0/1074436950 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc19015d870 0x7fc1900587b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:29.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.578+0000 7fc18ffff640 1 --2- 10.20.193.58:0/1074436950 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc19015d4a0 0x7fc1900affb0 unknown :-1 s=CLOSED pgs=220 gs=1 cs=0 l=1 c_cookie=13909160251383252873 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:29.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.578+0000 7fc18ffff640 1 -- 10.20.193.58:0/1074436950 >> 10.20.193.58:0/1074436950 conn(0x7fc1900b3c20 msgr2=0x7fc1900b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:52:29.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.578+0000 7fc18ffff640 1 -- 10.20.193.58:0/1074436950 shutdown_connections 2026-02-23T06:52:29.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.578+0000 7fc18ffff640 1 -- 10.20.193.58:0/1074436950 wait complete. 2026-02-23T06:52:29.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.579+0000 7fc18ffff640 1 Processor -- start 2026-02-23T06:52:29.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.579+0000 7fc18ffff640 1 -- start start 2026-02-23T06:52:29.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.580+0000 7fc18ffff640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc1900b6690 0x7fc190057d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:29.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.580+0000 7fc18ffff640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc19015d4a0 0x7fc190126fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:29.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.580+0000 7fc18ffff640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc19015d870 0x7fc190131f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:29.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.580+0000 7fc18ffff640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fc19013c4f0 con 0x7fc19015d870 2026-02-23T06:52:29.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.580+0000 7fc18ffff640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fc19013d660 con 0x7fc1900b6690 2026-02-23T06:52:29.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.580+0000 7fc18ffff640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fc190057360 con 0x7fc19015d4a0 2026-02-23T06:52:29.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.580+0000 7fc18f7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc19015d870 0x7fc190131f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:29.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.580+0000 7fc18f7fe640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc19015d870 0x7fc190131f60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:58820/0 (socket says 10.20.193.58:58820) 2026-02-23T06:52:29.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.580+0000 7fc18f7fe640 1 -- 10.20.193.58:0/10677716 learned_addr learned my addr 10.20.193.58:0/10677716 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:52:29.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.580+0000 7fc18effd640 1 --2- 10.20.193.58:0/10677716 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc1900b6690 0x7fc190057d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:29.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.580+0000 7fc18e7fc640 1 --2- 10.20.193.58:0/10677716 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc19015d4a0 0x7fc190126fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:29.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.580+0000 7fc18f7fe640 1 -- 10.20.193.58:0/10677716 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc19015d4a0 msgr2=0x7fc190126fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:29.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.580+0000 7fc18f7fe640 1 --2- 10.20.193.58:0/10677716 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc19015d4a0 0x7fc190126fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:29.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.580+0000 7fc18f7fe640 1 -- 10.20.193.58:0/10677716 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc1900b6690 msgr2=0x7fc190057d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:29.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.580+0000 7fc18f7fe640 1 --2- 10.20.193.58:0/10677716 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc1900b6690 0x7fc190057d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:29.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.580+0000 7fc18f7fe640 1 -- 10.20.193.58:0/10677716 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc184009570 con 0x7fc19015d870 2026-02-23T06:52:29.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.580+0000 7fc18f7fe640 1 --2- 10.20.193.58:0/10677716 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc19015d870 0x7fc190131f60 secure :-1 s=READY pgs=221 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc180006a50 tx=0x7fc18000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:52:29.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.580+0000 7fc167fff640 1 -- 10.20.193.58:0/10677716 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc180005500 con 0x7fc19015d870 2026-02-23T06:52:29.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.581+0000 7fc167fff640 1 -- 10.20.193.58:0/10677716 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fc180005930 con 0x7fc19015d870 2026-02-23T06:52:29.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.581+0000 7fc18ffff640 1 -- 10.20.193.58:0/10677716 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc19013ded0 con 0x7fc19015d870 2026-02-23T06:52:29.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.581+0000 7fc167fff640 1 -- 10.20.193.58:0/10677716 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc180005d80 con 0x7fc19015d870 2026-02-23T06:52:29.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.581+0000 7fc18ffff640 1 -- 10.20.193.58:0/10677716 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc190058280 con 0x7fc19015d870 2026-02-23T06:52:29.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.581+0000 7fc18ffff640 1 -- 10.20.193.58:0/10677716 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc19013d8b0 con 0x7fc19015d870 2026-02-23T06:52:29.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.583+0000 7fc167fff640 1 -- 10.20.193.58:0/10677716 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fc180021070 con 0x7fc19015d870 2026-02-23T06:52:29.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.584+0000 7fc167fff640 1 --2- 10.20.193.58:0/10677716 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc16007a630 0x7fc16009aae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:29.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.584+0000 7fc167fff640 1 -- 10.20.193.58:0/10677716 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6182+0+0 (secure 0 0 0) 0x7fc18009eb10 con 0x7fc19015d870 2026-02-23T06:52:29.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.584+0000 7fc18effd640 1 --2- 10.20.193.58:0/10677716 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc16007a630 0x7fc16009aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:29.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.584+0000 7fc167fff640 1 -- 10.20.193.58:0/10677716 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fc180061e60 con 0x7fc19015d870 2026-02-23T06:52:29.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.585+0000 7fc18effd640 1 --2- 10.20.193.58:0/10677716 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc16007a630 0x7fc16009aae0 secure :-1 s=READY pgs=633 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc1840023d0 tx=0x7fc18403a040 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:52:29.690 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:29.696+0000 7fc18ffff640 1 -- 10.20.193.58:0/10677716 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc190163760 con 0x7fc19015d870 2026-02-23T06:52:30.433 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.438+0000 7fc167fff640 1 -- 10.20.193.58:0/10677716 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7fc180065010 con 0x7fc19015d870 2026-02-23T06:52:30.433 INFO:teuthology.orchestra.run.trial058.stderr:pool 'cephfs_data' removed 2026-02-23T06:52:30.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.441+0000 7fc18ffff640 1 -- 10.20.193.58:0/10677716 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc16007a630 msgr2=0x7fc16009aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:30.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.441+0000 7fc18ffff640 1 --2- 10.20.193.58:0/10677716 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc16007a630 0x7fc16009aae0 secure :-1 s=READY pgs=633 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc1840023d0 tx=0x7fc18403a040 comp rx=0 tx=0).stop 2026-02-23T06:52:30.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.441+0000 7fc18ffff640 1 -- 10.20.193.58:0/10677716 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc19015d870 msgr2=0x7fc190131f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:30.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.441+0000 7fc18ffff640 1 --2- 10.20.193.58:0/10677716 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc19015d870 0x7fc190131f60 secure :-1 s=READY pgs=221 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc180006a50 tx=0x7fc18000edf0 comp rx=0 tx=0).stop 2026-02-23T06:52:30.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.441+0000 7fc18ffff640 1 -- 10.20.193.58:0/10677716 shutdown_connections 2026-02-23T06:52:30.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.441+0000 7fc18ffff640 1 --2- 10.20.193.58:0/10677716 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fc16007a630 0x7fc16009aae0 unknown :-1 s=CLOSED pgs=633 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:30.436 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.441+0000 7fc18ffff640 1 --2- 10.20.193.58:0/10677716 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fc19015d870 0x7fc190131f60 unknown :-1 s=CLOSED pgs=221 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:30.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.441+0000 7fc18ffff640 1 --2- 10.20.193.58:0/10677716 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fc19015d4a0 0x7fc190126fd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:30.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.441+0000 7fc18ffff640 1 --2- 10.20.193.58:0/10677716 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fc1900b6690 0x7fc190057d40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:30.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.441+0000 7fc18ffff640 1 -- 10.20.193.58:0/10677716 >> 10.20.193.58:0/10677716 conn(0x7fc1900b3c20 msgr2=0x7fc1900b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:52:30.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.441+0000 7fc18ffff640 1 -- 10.20.193.58:0/10677716 shutdown_connections 2026-02-23T06:52:30.437 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.441+0000 7fc18ffff640 1 -- 10.20.193.58:0/10677716 wait complete. 2026-02-23T06:52:30.450 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2026-02-23T06:52:30.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.578+0000 7fb362203640 1 -- 10.20.193.58:0/4252699005 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb35c0b6690 msgr2=0x7fb35c058ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:30.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.578+0000 7fb362203640 1 --2- 10.20.193.58:0/4252699005 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb35c0b6690 0x7fb35c058ec0 secure :-1 s=READY pgs=223 gs=3 cs=0 l=1 c_cookie=12660589739634651854 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb358005820 tx=0x7fb358030300 comp rx=0 tx=0).stop 2026-02-23T06:52:30.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.578+0000 7fb362203640 1 -- 10.20.193.58:0/4252699005 shutdown_connections 2026-02-23T06:52:30.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.578+0000 7fb362203640 1 --2- 10.20.193.58:0/4252699005 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb35c0b6690 0x7fb35c058ec0 unknown :-1 s=CLOSED pgs=223 gs=3 cs=0 l=1 c_cookie=12660589739634651854 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:30.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.578+0000 7fb362203640 1 -- 10.20.193.58:0/4252699005 >> 10.20.193.58:0/4252699005 conn(0x7fb35c0b3c20 msgr2=0x7fb35c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:52:30.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.578+0000 7fb362203640 1 -- 10.20.193.58:0/4252699005 shutdown_connections 2026-02-23T06:52:30.574 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.578+0000 7fb362203640 1 -- 10.20.193.58:0/4252699005 wait complete. 2026-02-23T06:52:30.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.580+0000 7fb362203640 1 Processor -- start 2026-02-23T06:52:30.576 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.580+0000 7fb362203640 1 -- start start 2026-02-23T06:52:30.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.580+0000 7fb362203640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb35c0b6690 0x7fb35c13e690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:30.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.580+0000 7fb362203640 1 --2- >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb35c15d4a0 0x7fb35c1ff180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:30.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.581+0000 7fb362203640 1 --2- >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb35c15d870 0x7fb35c1591d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:30.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.581+0000 7fb362203640 1 -- --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_getmap magic: 0 -- 0x7fb35c202230 con 0x7fb35c0b6690 2026-02-23T06:52:30.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.581+0000 7fb362203640 1 -- --> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] -- mon_getmap magic: 0 -- 0x7fb35c13c920 con 0x7fb35c15d4a0 2026-02-23T06:52:30.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.581+0000 7fb362203640 1 -- --> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] -- mon_getmap magic: 0 -- 0x7fb35c056ac0 con 0x7fb35c15d870 2026-02-23T06:52:30.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.581+0000 7fb361201640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb35c0b6690 0x7fb35c13e690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:30.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.581+0000 7fb361201640 1 --2- >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb35c0b6690 0x7fb35c13e690 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.58:3300/0 says I am v2:10.20.193.58:58836/0 (socket says 10.20.193.58:58836) 2026-02-23T06:52:30.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.581+0000 7fb361201640 1 -- 10.20.193.58:0/3109174630 learned_addr learned my addr 10.20.193.58:0/3109174630 (peer_addr_for_me v2:10.20.193.58:0/0) 2026-02-23T06:52:30.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.581+0000 7fb360a00640 1 --2- 10.20.193.58:0/3109174630 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb35c15d4a0 0x7fb35c1ff180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:30.577 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.581+0000 7fb361a02640 1 --2- 10.20.193.58:0/3109174630 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb35c15d870 0x7fb35c1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:30.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.581+0000 7fb361201640 1 -- 10.20.193.58:0/3109174630 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb35c15d870 msgr2=0x7fb35c1591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:30.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.581+0000 7fb361201640 1 --2- 10.20.193.58:0/3109174630 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb35c15d870 0x7fb35c1591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:30.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.581+0000 7fb361201640 1 -- 10.20.193.58:0/3109174630 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb35c15d4a0 msgr2=0x7fb35c1ff180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:30.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.581+0000 7fb361201640 1 --2- 10.20.193.58:0/3109174630 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb35c15d4a0 0x7fb35c1ff180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:30.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.581+0000 7fb361201640 1 -- 10.20.193.58:0/3109174630 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb35800a590 con 0x7fb35c0b6690 2026-02-23T06:52:30.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.581+0000 7fb361201640 1 --2- 10.20.193.58:0/3109174630 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb35c0b6690 0x7fb35c13e690 secure :-1 s=READY pgs=224 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb34c00c4d0 tx=0x7fb34c00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:52:30.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.581+0000 7fb349ffb640 1 -- 10.20.193.58:0/3109174630 <== mon.0 v2:10.20.193.58:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb34c012850 con 0x7fb35c0b6690 2026-02-23T06:52:30.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.581+0000 7fb362203640 1 -- 10.20.193.58:0/3109174630 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb35c201c90 con 0x7fb35c0b6690 2026-02-23T06:52:30.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.581+0000 7fb362203640 1 -- 10.20.193.58:0/3109174630 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb35c056f60 con 0x7fb35c0b6690 2026-02-23T06:52:30.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.581+0000 7fb349ffb640 1 -- 10.20.193.58:0/3109174630 <== mon.0 v2:10.20.193.58:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fb34c0129b0 con 0x7fb35c0b6690 2026-02-23T06:52:30.578 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.581+0000 7fb349ffb640 1 -- 10.20.193.58:0/3109174630 <== mon.0 v2:10.20.193.58:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb34c012dc0 con 0x7fb35c0b6690 2026-02-23T06:52:30.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.582+0000 7fb362203640 1 -- 10.20.193.58:0/3109174630 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb35c0b6d50 con 0x7fb35c0b6690 2026-02-23T06:52:30.579 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.583+0000 7fb349ffb640 1 -- 10.20.193.58:0/3109174630 <== mon.0 v2:10.20.193.58:3300/0 4 ==== mgrmap(e 5) ==== 104893+0+0 (secure 0 0 0) 0x7fb34c01c460 con 0x7fb35c0b6690 2026-02-23T06:52:30.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.584+0000 7fb349ffb640 1 --2- 10.20.193.58:0/3109174630 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb32c07a6b0 0x7fb32c09ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-23T06:52:30.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.584+0000 7fb349ffb640 1 -- 10.20.193.58:0/3109174630 <== mon.0 v2:10.20.193.58:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5736+0+0 (secure 0 0 0) 0x7fb34c09cf20 con 0x7fb35c0b6690 2026-02-23T06:52:30.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.584+0000 7fb360a00640 1 --2- 10.20.193.58:0/3109174630 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb32c07a6b0 0x7fb32c09ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-23T06:52:30.580 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.585+0000 7fb360a00640 1 --2- 10.20.193.58:0/3109174630 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb32c07a6b0 0x7fb32c09ab60 secure :-1 s=READY pgs=634 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb35c056a20 tx=0x7fb350007c10 comp rx=0 tx=0).ready entity=mgr.4126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-23T06:52:30.581 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.586+0000 7fb349ffb640 1 -- 10.20.193.58:0/3109174630 <== mon.0 v2:10.20.193.58:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231011 (secure 0 0 0) 0x7fb34c060420 con 0x7fb35c0b6690 2026-02-23T06:52:30.694 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:30.699+0000 7fb362203640 1 -- 10.20.193.58:0/3109174630 --> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb35c1642e0 con 0x7fb35c0b6690 2026-02-23T06:52:31.438 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:31.443+0000 7fb349ffb640 1 -- 10.20.193.58:0/3109174630 <== mon.0 v2:10.20.193.58:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) ==== 178+0+0 (secure 0 0 0) 0x7fb34c063540 con 0x7fb35c0b6690 2026-02-23T06:52:31.438 INFO:teuthology.orchestra.run.trial058.stderr:pool 'cephfs_data_ec' removed 2026-02-23T06:52:31.443 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:31.447+0000 7fb362203640 1 -- 10.20.193.58:0/3109174630 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb32c07a6b0 msgr2=0x7fb32c09ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:31.443 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:31.447+0000 7fb362203640 1 --2- 10.20.193.58:0/3109174630 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb32c07a6b0 0x7fb32c09ab60 secure :-1 s=READY pgs=634 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb35c056a20 tx=0x7fb350007c10 comp rx=0 tx=0).stop 2026-02-23T06:52:31.443 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:31.447+0000 7fb362203640 1 -- 10.20.193.58:0/3109174630 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb35c0b6690 msgr2=0x7fb35c13e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-23T06:52:31.443 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:31.447+0000 7fb362203640 1 --2- 10.20.193.58:0/3109174630 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb35c0b6690 0x7fb35c13e690 secure :-1 s=READY pgs=224 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb34c00c4d0 tx=0x7fb34c00c9a0 comp rx=0 tx=0).stop 2026-02-23T06:52:31.443 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:31.447+0000 7fb362203640 1 -- 10.20.193.58:0/3109174630 shutdown_connections 2026-02-23T06:52:31.443 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:31.447+0000 7fb362203640 1 --2- 10.20.193.58:0/3109174630 >> [v2:10.20.193.93:6800/4124709854,v1:10.20.193.93:6801/4124709854] conn(0x7fb32c07a6b0 0x7fb32c09ab60 unknown :-1 s=CLOSED pgs=634 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:31.443 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:31.447+0000 7fb362203640 1 --2- 10.20.193.58:0/3109174630 >> [v2:10.20.193.93:3301/0,v1:10.20.193.93:6790/0] conn(0x7fb35c15d870 0x7fb35c1591d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:31.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:31.447+0000 7fb362203640 1 --2- 10.20.193.58:0/3109174630 >> [v2:10.20.193.93:3300/0,v1:10.20.193.93:6789/0] conn(0x7fb35c15d4a0 0x7fb35c1ff180 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:31.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:31.447+0000 7fb362203640 1 --2- 10.20.193.58:0/3109174630 >> [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] conn(0x7fb35c0b6690 0x7fb35c13e690 unknown :-1 s=CLOSED pgs=224 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-23T06:52:31.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:31.447+0000 7fb362203640 1 -- 10.20.193.58:0/3109174630 >> 10.20.193.58:0/3109174630 conn(0x7fb35c0b3c20 msgr2=0x7fb35c15b590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-23T06:52:31.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:31.447+0000 7fb362203640 1 -- 10.20.193.58:0/3109174630 shutdown_connections 2026-02-23T06:52:31.444 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-23T06:52:31.448+0000 7fb362203640 1 -- 10.20.193.58:0/3109174630 wait complete. 2026-02-23T06:52:31.462 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-23T06:52:31.463 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2026-02-23T06:52:31.463 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:52:31.481 INFO:tasks.ceph.mds.a:Stopped 2026-02-23T06:52:31.481 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2026-02-23T06:52:31.482 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:52:31.536 INFO:tasks.ceph.mds.c:Stopped 2026-02-23T06:52:31.536 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2026-02-23T06:52:31.537 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:52:31.588 INFO:tasks.ceph.mds.e:Stopped 2026-02-23T06:52:31.588 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2026-02-23T06:52:31.588 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:52:31.596 INFO:tasks.ceph.mds.b:Stopped 2026-02-23T06:52:31.596 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2026-02-23T06:52:31.596 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:52:31.645 INFO:tasks.ceph.mds.d:Stopped 2026-02-23T06:52:31.645 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2026-02-23T06:52:31.645 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:52:31.692 INFO:tasks.ceph.mds.f:Stopped 2026-02-23T06:52:31.693 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-23T06:52:31.693 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-23T06:52:31.693 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:52:31.784 INFO:tasks.ceph.osd.0:Stopped 2026-02-23T06:52:31.784 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-23T06:52:31.784 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:52:31.881 INFO:tasks.ceph.osd.1:Stopped 2026-02-23T06:52:31.881 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-23T06:52:31.881 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:52:31.974 INFO:tasks.ceph.osd.2:Stopped 2026-02-23T06:52:31.974 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-23T06:52:31.974 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:52:34.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2026-02-23T06:52:38.076 INFO:tasks.ceph.osd.3:Stopped 2026-02-23T06:52:38.077 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-23T06:52:38.077 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:52:38.129 INFO:tasks.ceph.osd.4:Stopped 2026-02-23T06:52:38.129 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-23T06:52:38.129 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:52:38.177 INFO:tasks.ceph.osd.5:Stopped 2026-02-23T06:52:38.177 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2026-02-23T06:52:38.177 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:52:38.233 INFO:tasks.ceph.osd.6:Stopped 2026-02-23T06:52:38.234 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2026-02-23T06:52:38.234 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:52:38.279 INFO:tasks.ceph.osd.7:Stopped 2026-02-23T06:52:38.280 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-23T06:52:38.281 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2026-02-23T06:52:38.281 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:52:38.360 INFO:tasks.ceph.mgr.y:Stopped 2026-02-23T06:52:38.360 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-23T06:52:38.360 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:52:38.391 INFO:tasks.ceph.mgr.x:Stopped 2026-02-23T06:52:38.392 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-23T06:52:38.392 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-23T06:52:38.392 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:52:38.412 INFO:tasks.ceph.mon.a:Stopped 2026-02-23T06:52:38.412 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-23T06:52:38.412 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:52:38.441 INFO:tasks.ceph.mon.b:Stopped 2026-02-23T06:52:38.441 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-23T06:52:38.441 INFO:teuthology.orchestra.run:waiting for 300 2026-02-23T06:52:38.491 INFO:tasks.ceph.mon.c:Stopped 2026-02-23T06:52:38.491 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-23T06:52:38.492 DEBUG:teuthology.orchestra.run.trial058:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v '\(OSD_SLOW_PING_TIME' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSDMAP_FLAGS\)' | grep -E -v '\(OSD_' | grep -E -v '\(PG_' | grep -E -v '\(POOL_' | grep -E -v '\(CACHE_POOL_' | grep -E -v '\(SMALLER_PGP_NUM\)' | grep -E -v '\(OBJECT_' | grep -E -v SLOW_OPS | grep -E -v '\(REQUEST_SLOW\)' | grep -E -v '\(TOO_FEW_PGS\)' | grep -E -v 'slow request' | grep -E -v 'timeout on replica' | grep -E -v 'late reservation from' | grep -E -v MON_DOWN | grep -E -v OSDMAP_FLAGS | grep -E -v OSD_DOWN | grep -E -v PG_DEGRADED | grep -E -v PG_AVAILABILITY | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'mons down' | grep -E -v 'mon down' | grep -E -v 'out of quorum' | grep -E -v noscrub | grep -E -v nodeep-scrub | grep -E -v 'Degraded data redundancy' | grep -E -v 'is down' | grep -E -v 'osds down' | grep -E -v 'pg .*? is .*?degraded.*?, acting' | grep -E -v 'pg .*? is stuck' | grep -E -v 'pg degraded' | grep -E -v PG_BACKFILL_FULL | grep -E -v 'Low space hindering backfill .*? backfill_toofull' | grep -E -v OSD_ROOT_DOWN | grep -E -v 'pgs degraded' | grep -E -v 'pgs undersized' | grep -E -v 'is active.*backfill_toofull.*' | grep -E -v 'overall HEALTH_' | grep -E -v '\(MON_DOWN\)' | grep -E -v SLOW_OPS | grep -E -v 'slow request' | head -n 1 2026-02-23T06:52:38.568 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial058.front.sepia.ceph.com 2026-02-23T06:52:38.568 DEBUG:teuthology.orchestra.run.trial058:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-23T06:52:38.695 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial058.front.sepia.ceph.com 2026-02-23T06:52:38.695 DEBUG:teuthology.orchestra.run.trial058:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-23T06:52:38.816 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial058.front.sepia.ceph.com 2026-02-23T06:52:38.816 DEBUG:teuthology.orchestra.run.trial058:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-23T06:52:38.924 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial058.front.sepia.ceph.com 2026-02-23T06:52:38.925 DEBUG:teuthology.orchestra.run.trial058:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-23T06:52:39.045 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@trial093.front.sepia.ceph.com 2026-02-23T06:52:39.046 DEBUG:teuthology.orchestra.run.trial093:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2026-02-23T06:52:39.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2026-02-23T06:52:39.097 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@trial093.front.sepia.ceph.com 2026-02-23T06:52:39.097 DEBUG:teuthology.orchestra.run.trial093:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2026-02-23T06:52:39.137 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@trial093.front.sepia.ceph.com 2026-02-23T06:52:39.137 DEBUG:teuthology.orchestra.run.trial093:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2026-02-23T06:52:39.227 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@trial093.front.sepia.ceph.com 2026-02-23T06:52:39.227 DEBUG:teuthology.orchestra.run.trial093:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2026-02-23T06:52:39.270 INFO:tasks.ceph:Archiving mon data... 2026-02-23T06:52:39.272 DEBUG:teuthology.misc:Transferring archived files from trial058:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial/64975/data/mon.a.tgz 2026-02-23T06:52:39.272 DEBUG:teuthology.orchestra.run.trial058:> mktemp 2026-02-23T06:52:39.312 INFO:teuthology.orchestra.run.trial058.stdout:/tmp/tmp.38xOTQzPWI 2026-02-23T06:52:39.313 DEBUG:teuthology.orchestra.run.trial058:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.38xOTQzPWI 2026-02-23T06:52:39.468 DEBUG:teuthology.orchestra.run.trial058:> sudo chmod 0666 /tmp/tmp.38xOTQzPWI 2026-02-23T06:52:39.564 DEBUG:teuthology.orchestra.remote:trial058:/tmp/tmp.38xOTQzPWI is 542KB 2026-02-23T06:52:39.648 DEBUG:teuthology.orchestra.run.trial058:> rm -fr /tmp/tmp.38xOTQzPWI 2026-02-23T06:52:39.687 DEBUG:teuthology.misc:Transferring archived files from trial093:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial/64975/data/mon.b.tgz 2026-02-23T06:52:39.687 DEBUG:teuthology.orchestra.run.trial093:> mktemp 2026-02-23T06:52:39.705 INFO:teuthology.orchestra.run.trial093.stdout:/tmp/tmp.S2qTbSEJya 2026-02-23T06:52:39.705 DEBUG:teuthology.orchestra.run.trial093:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.S2qTbSEJya 2026-02-23T06:52:39.828 DEBUG:teuthology.orchestra.run.trial093:> sudo chmod 0666 /tmp/tmp.S2qTbSEJya 2026-02-23T06:52:39.910 DEBUG:teuthology.orchestra.remote:trial093:/tmp/tmp.S2qTbSEJya is 545KB 2026-02-23T06:52:40.007 DEBUG:teuthology.orchestra.run.trial093:> rm -fr /tmp/tmp.S2qTbSEJya 2026-02-23T06:52:40.024 DEBUG:teuthology.misc:Transferring archived files from trial093:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial/64975/data/mon.c.tgz 2026-02-23T06:52:40.024 DEBUG:teuthology.orchestra.run.trial093:> mktemp 2026-02-23T06:52:40.079 INFO:teuthology.orchestra.run.trial093.stdout:/tmp/tmp.zWtV54y7bb 2026-02-23T06:52:40.080 DEBUG:teuthology.orchestra.run.trial093:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.zWtV54y7bb 2026-02-23T06:52:40.200 DEBUG:teuthology.orchestra.run.trial093:> sudo chmod 0666 /tmp/tmp.zWtV54y7bb 2026-02-23T06:52:40.283 DEBUG:teuthology.orchestra.remote:trial093:/tmp/tmp.zWtV54y7bb is 547KB 2026-02-23T06:52:40.348 DEBUG:teuthology.orchestra.run.trial093:> rm -fr /tmp/tmp.zWtV54y7bb 2026-02-23T06:52:40.365 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-23T06:52:40.365 DEBUG:teuthology.orchestra.run.trial058:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-23T06:52:40.369 DEBUG:teuthology.orchestra.run.trial093:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-23T06:52:40.466 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-23T06:52:40.484 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-23T06:52:40.485 INFO:tasks.ceph:Archiving crash dumps... 2026-02-23T06:52:40.487 DEBUG:teuthology.misc:Transferring archived files from trial058:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial/64975/remote/trial058/crash 2026-02-23T06:52:40.489 DEBUG:teuthology.orchestra.run.trial058:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-23T06:52:40.563 DEBUG:teuthology.misc:Transferring archived files from trial093:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial/64975/remote/trial093/crash 2026-02-23T06:52:40.564 DEBUG:teuthology.orchestra.run.trial093:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-23T06:52:40.590 INFO:tasks.ceph:Shutting down logrotate 2026-02-23T06:52:40.590 DEBUG:teuthology.orchestra.run.trial058:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:52:40.595 DEBUG:teuthology.orchestra.run.trial093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-02-23T06:52:40.656 DEBUG:teuthology.orchestra.run.trial058:> sudo rm /etc/logrotate.d/ceph-test.conf 2026-02-23T06:52:40.713 DEBUG:teuthology.orchestra.run.trial093:> sudo rm /etc/logrotate.d/ceph-test.conf 2026-02-23T06:52:40.737 INFO:tasks.ceph:Compressing logs... 2026-02-23T06:52:40.738 DEBUG:teuthology.orchestra.run.trial058:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-23T06:52:40.742 DEBUG:teuthology.orchestra.run.trial093:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-23T06:52:40.794 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58736.log 2026-02-23T06:52:40.796 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-23T06:52:40.796 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.58736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70843.log 2026-02-23T06:52:40.796 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58736.log.gz 2026-02-23T06:52:40.796 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61725.log 2026-02-23T06:52:40.798 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.70843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52311.log 2026-02-23T06:52:40.799 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.70843.log.gz 2026-02-23T06:52:40.799 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54591.log 2026-02-23T06:52:40.799 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.61725.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61725.log.gz 2026-02-23T06:52:40.799 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.52311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82951.log 2026-02-23T06:52:40.799 INFO:teuthology.orchestra.run.trial058.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52311.log.gz 2026-02-23T06:52:40.799 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.54591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49919.log 2026-02-23T06:52:40.801 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54591.log.gz 2026-02-23T06:52:40.801 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67260.log 2026-02-23T06:52:40.801 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.82951.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.82951.log.gz 2026-02-23T06:52:40.801 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.49919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73235.log 2026-02-23T06:52:40.802 INFO:teuthology.orchestra.run.trial058.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49919.log.gz 2026-02-23T06:52:40.802 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.67260.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-23T06:52:40.802 INFO:teuthology.orchestra.run.trial058.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.67260.log.gz 2026-02-23T06:52:40.802 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.73235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65069.log 2026-02-23T06:52:40.802 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.73235.log.gz 2026-02-23T06:52:40.802 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59390.log 2026-02-23T06:52:40.802 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2026-02-23T06:52:40.802 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2026-02-23T06:52:40.802 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-23T06:52:40.802 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46675.log 2026-02-23T06:52:40.802 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2026-02-23T06:52:40.802 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.46675.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-23T06:52:40.802 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 86.7% 2026-02-23T06:52:40.802 INFO:teuthology.orchestra.run.trial093.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46675.log.gz 2026-02-23T06:52:40.802 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46744.log 2026-02-23T06:52:40.802 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-23T06:52:40.802 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-client.admin.46744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46478.log 2026-02-23T06:52:40.802 INFO:teuthology.orchestra.run.trial093.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.46744.log.gz 2026-02-23T06:52:40.802 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-23T06:52:40.802 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-23T06:52:40.803 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.65069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79605.log 2026-02-23T06:52:40.803 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.65069.log.gz 2026-02-23T06:52:40.803 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.59390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63550.log 2026-02-23T06:52:40.803 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59390.log.gz 2026-02-23T06:52:40.803 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.79605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72204.log 2026-02-23T06:52:40.803 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.79605.log.gz 2026-02-23T06:52:40.804 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.46478.log: /var/log/ceph/ceph.audit.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.46478.log.gz 2026-02-23T06:52:40.804 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46378.log 2026-02-23T06:52:40.804 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2026-02-23T06:52:40.804 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.46378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46525.log 2026-02-23T06:52:40.804 INFO:teuthology.orchestra.run.trial093.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.46378.log.gz 2026-02-23T06:52:40.804 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-23T06:52:40.804 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.46525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46572.log 2026-02-23T06:52:40.804 INFO:teuthology.orchestra.run.trial093.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.46525.log.gz 2026-02-23T06:52:40.804 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46431.log 2026-02-23T06:52:40.804 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.63550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53684.log 2026-02-23T06:52:40.804 INFO:teuthology.orchestra.run.trial058.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63550.log.gz 2026-02-23T06:52:40.805 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46791.log 2026-02-23T06:52:40.805 INFO:teuthology.orchestra.run.trial093.stderr: 94.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-23T06:52:40.805 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.46572.log: /var/log/ceph/ceph-client.admin.46431.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-23T06:52:40.805 INFO:teuthology.orchestra.run.trial093.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.46572.log.gz 2026-02-23T06:52:40.805 INFO:teuthology.orchestra.run.trial093.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.46431.log.gz 2026-02-23T06:52:40.805 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.46791.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.46791.log.gz 2026-02-23T06:52:40.805 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.72204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52042.log 2026-02-23T06:52:40.805 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph.log: 94.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2026-02-23T06:52:40.805 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.72204.log.gz 2026-02-23T06:52:40.805 INFO:teuthology.orchestra.run.trial093.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2026-02-23T06:52:40.806 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.53684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62093.log 2026-02-23T06:52:40.806 INFO:teuthology.orchestra.run.trial058.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53684.log.gz 2026-02-23T06:52:40.807 INFO:teuthology.orchestra.run.trial093.stderr: 94.5% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2026-02-23T06:52:40.809 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.52042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74281.log 2026-02-23T06:52:40.809 INFO:teuthology.orchestra.run.trial058.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52042.log.gz 2026-02-23T06:52:40.809 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51502.log 2026-02-23T06:52:40.809 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.62093.log: /var/log/ceph/ceph-client.admin.74281.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62093.log.gz 2026-02-23T06:52:40.809 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45049.log 2026-02-23T06:52:40.809 INFO:teuthology.orchestra.run.trial058.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.74281.log.gz 2026-02-23T06:52:40.809 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.51502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70582.log 2026-02-23T06:52:40.809 INFO:teuthology.orchestra.run.trial058.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51502.log.gz 2026-02-23T06:52:40.810 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.45049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79090.log 2026-02-23T06:52:40.810 INFO:teuthology.orchestra.run.trial058.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.45049.log.gz 2026-02-23T06:52:40.810 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.70582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64854.log 2026-02-23T06:52:40.811 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.70582.log.gz 2026-02-23T06:52:40.811 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.79090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52721.log 2026-02-23T06:52:40.812 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.79090.log.gz 2026-02-23T06:52:40.812 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.64854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44940.log 2026-02-23T06:52:40.812 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64854.log.gz 2026-02-23T06:52:40.812 INFO:teuthology.orchestra.run.trial093.stderr: 92.6% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-23T06:52:40.813 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.52721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52328.log 2026-02-23T06:52:40.813 INFO:teuthology.orchestra.run.trial058.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52721.log.gz 2026-02-23T06:52:40.813 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.44940.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-23T06:52:40.813 INFO:teuthology.orchestra.run.trial058.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.44940.log.gz 2026-02-23T06:52:40.814 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.52328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66198.log 2026-02-23T06:52:40.814 INFO:teuthology.orchestra.run.trial058.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52328.log.gz 2026-02-23T06:52:40.814 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54689.log 2026-02-23T06:52:40.815 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.66198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70631.log 2026-02-23T06:52:40.815 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.66198.log.gz 2026-02-23T06:52:40.816 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.54689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70533.log 2026-02-23T06:52:40.816 INFO:teuthology.orchestra.run.trial058.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54689.log.gz 2026-02-23T06:52:40.816 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.70631.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.70631.log.gz 2026-02-23T06:52:40.817 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.70533.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.70533.log.gz 2026-02-23T06:52:40.817 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81874.log 2026-02-23T06:52:40.818 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53183.log 2026-02-23T06:52:40.818 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.81874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71713.log 2026-02-23T06:52:40.819 INFO:teuthology.orchestra.run.trial058.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.81874.log.gz 2026-02-23T06:52:40.819 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.53183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78142.log 2026-02-23T06:52:40.819 INFO:teuthology.orchestra.run.trial058.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53183.log.gz 2026-02-23T06:52:40.820 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.71713.log: /var/log/ceph/ceph-client.admin.63942.log 2026-02-23T06:52:40.820 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.71713.log.gz 2026-02-23T06:52:40.820 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.78142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50127.log 2026-02-23T06:52:40.821 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.78142.log.gz 2026-02-23T06:52:40.821 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.63942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82609.log 2026-02-23T06:52:40.821 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63942.log.gz 2026-02-23T06:52:40.822 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.50127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59201.log 2026-02-23T06:52:40.822 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50127.log.gz 2026-02-23T06:52:40.822 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.82609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74020.log 2026-02-23T06:52:40.823 INFO:teuthology.orchestra.run.trial058.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.82609.log.gz 2026-02-23T06:52:40.823 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.59201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48488.log 2026-02-23T06:52:40.823 INFO:teuthology.orchestra.run.trial058.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59201.log.gz 2026-02-23T06:52:40.824 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.74020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44810.log 2026-02-23T06:52:40.824 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.74020.log.gz 2026-02-23T06:52:40.825 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.48488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55010.log 2026-02-23T06:52:40.825 INFO:teuthology.orchestra.run.trial058.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48488.log.gz 2026-02-23T06:52:40.826 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.44810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60747.log 2026-02-23T06:52:40.826 INFO:teuthology.orchestra.run.trial058.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.44810.log.gz 2026-02-23T06:52:40.826 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.55010.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55010.log.gz 2026-02-23T06:52:40.826 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78387.log 2026-02-23T06:52:40.827 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.60747.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2026-02-23T06:52:40.827 INFO:teuthology.orchestra.run.trial058.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60747.log.gz 2026-02-23T06:52:40.828 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.78387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81298.log 2026-02-23T06:52:40.828 INFO:teuthology.orchestra.run.trial058.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.78387.log.gz 2026-02-23T06:52:40.828 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78044.log 2026-02-23T06:52:40.829 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.81298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79703.log 2026-02-23T06:52:40.829 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.81298.log.gz 2026-02-23T06:52:40.830 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.78044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51895.log 2026-02-23T06:52:40.830 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.78044.log.gz 2026-02-23T06:52:40.831 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.79703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71261.log 2026-02-23T06:52:40.831 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.79703.log.gz 2026-02-23T06:52:40.831 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.51895.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51895.log.gz 2026-02-23T06:52:40.832 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60832.log 2026-02-23T06:52:40.832 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.71261.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71261.log.gz 2026-02-23T06:52:40.833 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.60832.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60832.log.gz 2026-02-23T06:52:40.833 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53044.log 2026-02-23T06:52:40.834 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76571.log 2026-02-23T06:52:40.835 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.53044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59635.log 2026-02-23T06:52:40.835 INFO:teuthology.orchestra.run.trial058.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53044.log.gz 2026-02-23T06:52:40.836 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.76571.log: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80562.log 2026-02-23T06:52:40.836 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.59635.log: -- replaced with /var/log/ceph/ceph-client.admin.76571.log.gz 2026-02-23T06:52:40.836 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59635.log.gz 2026-02-23T06:52:40.836 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44604.log 2026-02-23T06:52:40.837 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.80562.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-23T06:52:40.837 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.80562.log.gz 2026-02-23T06:52:40.838 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.44604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51699.log 2026-02-23T06:52:40.838 INFO:teuthology.orchestra.run.trial058.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.44604.log.gz 2026-02-23T06:52:40.839 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65118.log 2026-02-23T06:52:40.839 INFO:teuthology.orchestra.run.trial058.stderr: 94.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2026-02-23T06:52:40.840 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.51699.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51699.log.gz 2026-02-23T06:52:40.840 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.65118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70208.log 2026-02-23T06:52:40.841 INFO:teuthology.orchestra.run.trial058.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.65118.log.gz 2026-02-23T06:52:40.841 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63329.log 2026-02-23T06:52:40.842 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.70208.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.70208.log.gz 2026-02-23T06:52:40.842 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72916.log 2026-02-23T06:52:40.842 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.63329.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.63329.log.gz 2026-02-23T06:52:40.843 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65732.log 2026-02-23T06:52:40.843 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.72916.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.72916.log.gz 2026-02-23T06:52:40.844 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.65732.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.65732.log.gz 2026-02-23T06:52:40.845 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63378.log 2026-02-23T06:52:40.845 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58929.log 2026-02-23T06:52:40.847 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.63378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66999.log 2026-02-23T06:52:40.847 INFO:teuthology.orchestra.run.trial058.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.63378.log.gz 2026-02-23T06:52:40.847 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.58929.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58929.log.gz 2026-02-23T06:52:40.848 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.66999.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.66999.log.gz 2026-02-23T06:52:40.848 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82683.log 2026-02-23T06:52:40.848 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83218.log 2026-02-23T06:52:40.849 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.82683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64277.log 2026-02-23T06:52:40.849 INFO:teuthology.orchestra.run.trial058.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.82683.log.gz 2026-02-23T06:52:40.850 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.83218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77699.log 2026-02-23T06:52:40.850 INFO:teuthology.orchestra.run.trial058.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.83218.log.gz 2026-02-23T06:52:40.851 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.64277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66435.log 2026-02-23T06:52:40.851 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64277.log.gz 2026-02-23T06:52:40.851 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.77699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64932.log 2026-02-23T06:52:40.851 INFO:teuthology.orchestra.run.trial058.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77699.log.gz 2026-02-23T06:52:40.852 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.66435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81972.log 2026-02-23T06:52:40.852 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66435.log.gz 2026-02-23T06:52:40.853 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.64932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81629.log 2026-02-23T06:52:40.853 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64932.log.gz 2026-02-23T06:52:40.854 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.81972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70898.log 2026-02-23T06:52:40.854 INFO:teuthology.orchestra.run.trial058.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.81972.log.gz 2026-02-23T06:52:40.854 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.81629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51748.log 2026-02-23T06:52:40.854 INFO:teuthology.orchestra.run.trial058.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.81629.log.gz 2026-02-23T06:52:40.855 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.70898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77331.log 2026-02-23T06:52:40.855 INFO:teuthology.orchestra.run.trial058.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70898.log.gz 2026-02-23T06:52:40.856 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.51748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75067.log 2026-02-23T06:52:40.856 INFO:teuthology.orchestra.run.trial058.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51748.log.gz 2026-02-23T06:52:40.857 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.77331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61921.log 2026-02-23T06:52:40.857 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.77331.log.gz 2026-02-23T06:52:40.857 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.75067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83169.log 2026-02-23T06:52:40.857 INFO:teuthology.orchestra.run.trial058.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.75067.log.gz 2026-02-23T06:52:40.858 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.61921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73088.log 2026-02-23T06:52:40.858 INFO:teuthology.orchestra.run.trial058.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61921.log.gz 2026-02-23T06:52:40.859 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.83169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51551.log 2026-02-23T06:52:40.859 INFO:teuthology.orchestra.run.trial058.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.83169.log.gz 2026-02-23T06:52:40.859 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.73088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79654.log 2026-02-23T06:52:40.860 INFO:teuthology.orchestra.run.trial058.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.73088.log.gz 2026-02-23T06:52:40.860 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.51551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75263.log 2026-02-23T06:52:40.860 INFO:teuthology.orchestra.run.trial058.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51551.log.gz 2026-02-23T06:52:40.861 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.79654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45384.log 2026-02-23T06:52:40.862 INFO:teuthology.orchestra.run.trial058.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.79654.log.gz 2026-02-23T06:52:40.862 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.75263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79850.log 2026-02-23T06:52:40.862 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.75263.log.gz 2026-02-23T06:52:40.863 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.45384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59881.log 2026-02-23T06:52:40.863 INFO:teuthology.orchestra.run.trial058.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.45384.log.gz 2026-02-23T06:52:40.863 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.79850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67580.log 2026-02-23T06:52:40.863 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.79850.log.gz 2026-02-23T06:52:40.864 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.59881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79139.log 2026-02-23T06:52:40.864 INFO:teuthology.orchestra.run.trial058.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59881.log.gz 2026-02-23T06:52:40.865 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.67580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73014.log 2026-02-23T06:52:40.865 INFO:teuthology.orchestra.run.trial058.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.67580.log.gz 2026-02-23T06:52:40.865 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.79139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45411.log 2026-02-23T06:52:40.866 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.79139.log.gz 2026-02-23T06:52:40.866 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.73014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67629.log 2026-02-23T06:52:40.866 INFO:teuthology.orchestra.run.trial058.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.73014.log.gz 2026-02-23T06:52:40.867 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.45411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82021.log 2026-02-23T06:52:40.867 INFO:teuthology.orchestra.run.trial058.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.45411.log.gz 2026-02-23T06:52:40.868 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.67629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67727.log 2026-02-23T06:52:40.868 INFO:teuthology.orchestra.run.trial058.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67629.log.gz 2026-02-23T06:52:40.868 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.82021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66631.log 2026-02-23T06:52:40.869 INFO:teuthology.orchestra.run.trial058.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.82021.log.gz 2026-02-23T06:52:40.869 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.67727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44486.log 2026-02-23T06:52:40.869 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67727.log.gz 2026-02-23T06:52:40.870 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.66631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66533.log 2026-02-23T06:52:40.871 INFO:teuthology.orchestra.run.trial058.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.66631.log.gz 2026-02-23T06:52:40.871 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.44486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75410.log 2026-02-23T06:52:40.871 INFO:teuthology.orchestra.run.trial058.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44486.log.gz 2026-02-23T06:52:40.871 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.66533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66680.log 2026-02-23T06:52:40.871 INFO:teuthology.orchestra.run.trial058.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.66533.log.gz 2026-02-23T06:52:40.872 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.75410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81776.log 2026-02-23T06:52:40.872 INFO:teuthology.orchestra.run.trial058.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.75410.log.gz 2026-02-23T06:52:40.873 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.66680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58793.log 2026-02-23T06:52:40.873 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.66680.log.gz 2026-02-23T06:52:40.874 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.81776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64091.log 2026-02-23T06:52:40.874 INFO:teuthology.orchestra.run.trial058.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.81776.log.gz 2026-02-23T06:52:40.874 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.58793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62340.log 2026-02-23T06:52:40.875 INFO:teuthology.orchestra.run.trial058.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58793.log.gz 2026-02-23T06:52:40.875 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.64091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53316.log 2026-02-23T06:52:40.875 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64091.log.gz 2026-02-23T06:52:40.876 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.62340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62538.log 2026-02-23T06:52:40.877 INFO:teuthology.orchestra.run.trial058.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62340.log.gz 2026-02-23T06:52:40.877 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.53316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72351.log 2026-02-23T06:52:40.877 INFO:teuthology.orchestra.run.trial058.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53316.log.gz 2026-02-23T06:52:40.877 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.62538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65781.log 2026-02-23T06:52:40.878 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62538.log.gz 2026-02-23T06:52:40.878 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.72351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83120.log 2026-02-23T06:52:40.878 INFO:teuthology.orchestra.run.trial058.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.72351.log.gz 2026-02-23T06:52:40.879 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.65781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60142.log 2026-02-23T06:52:40.879 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.65781.log.gz 2026-02-23T06:52:40.880 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.83120.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.83120.log.gz 2026-02-23T06:52:40.880 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77503.log 2026-02-23T06:52:40.881 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.60142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68390.log 87.6% 2026-02-23T06:52:40.881 INFO:teuthology.orchestra.run.trial058.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60142.log.gz 2026-02-23T06:52:40.881 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.77503.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.77503.log.gz 2026-02-23T06:52:40.882 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.68390.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68390.log.gz 2026-02-23T06:52:40.882 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79801.log 2026-02-23T06:52:40.883 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63795.log 2026-02-23T06:52:40.884 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.79801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63648.log 2026-02-23T06:52:40.884 INFO:teuthology.orchestra.run.trial058.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.79801.log.gz 2026-02-23T06:52:40.885 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.63795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59035.log 2026-02-23T06:52:40.885 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63795.log.gz 2026-02-23T06:52:40.886 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.63648.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.63648.log.gz 2026-02-23T06:52:40.886 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74894.log 2026-02-23T06:52:40.887 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.59035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73799.log 2026-02-23T06:52:40.887 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59035.log.gz 2026-02-23T06:52:40.888 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.74894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74600.log 2026-02-23T06:52:40.888 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.74894.log.gz 2026-02-23T06:52:40.888 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.73799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64179.log 2026-02-23T06:52:40.889 INFO:teuthology.orchestra.run.trial058.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.73799.log.gz 2026-02-23T06:52:40.889 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.74600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55355.log 2026-02-23T06:52:40.890 INFO:teuthology.orchestra.run.trial058.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.74600.log.gz 2026-02-23T06:52:40.890 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.64179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72106.log 2026-02-23T06:52:40.890 INFO:teuthology.orchestra.run.trial058.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.64179.log.gz 2026-02-23T06:52:40.891 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.55355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69252.log 2026-02-23T06:52:40.891 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55355.log.gz 2026-02-23T06:52:40.892 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.72106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69424.log 2026-02-23T06:52:40.892 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.72106.log.gz 2026-02-23T06:52:40.892 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.69252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62969.log 2026-02-23T06:52:40.892 INFO:teuthology.orchestra.run.trial058.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.69252.log.gz 2026-02-23T06:52:40.893 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.69424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68341.log 2026-02-23T06:52:40.893 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.69424.log.gz 2026-02-23T06:52:40.893 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.62969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80954.log 2026-02-23T06:52:40.894 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62969.log.gz 2026-02-23T06:52:40.895 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.68341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54542.log 2026-02-23T06:52:40.895 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68341.log.gz 2026-02-23T06:52:40.895 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.80954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65241.log 2026-02-23T06:52:40.895 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.80954.log.gz 2026-02-23T06:52:40.896 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.54542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60698.log 2026-02-23T06:52:40.896 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54542.log.gz 2026-02-23T06:52:40.896 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.65241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80145.log 2026-02-23T06:52:40.896 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65241.log.gz 2026-02-23T06:52:40.897 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.60698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61823.log 2026-02-23T06:52:40.897 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60698.log.gz 2026-02-23T06:52:40.898 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.80145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81678.log 2026-02-23T06:52:40.898 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.80145.log.gz 2026-02-23T06:52:40.898 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.61823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49819.log 2026-02-23T06:52:40.899 INFO:teuthology.orchestra.run.trial058.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.61823.log.gz 2026-02-23T06:52:40.899 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.81678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82804.log 2026-02-23T06:52:40.899 INFO:teuthology.orchestra.run.trial058.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.81678.log.gz 2026-02-23T06:52:40.900 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.49819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80341.log 2026-02-23T06:52:40.900 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49819.log.gz 2026-02-23T06:52:40.901 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.82804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71065.log 2026-02-23T06:52:40.901 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.82804.log.gz 2026-02-23T06:52:40.901 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.80341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82119.log 2026-02-23T06:52:40.902 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.80341.log.gz 2026-02-23T06:52:40.902 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.71065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50422.log 2026-02-23T06:52:40.902 INFO:teuthology.orchestra.run.trial058.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71065.log.gz 2026-02-23T06:52:40.904 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.82119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53414.log 2026-02-23T06:52:40.904 INFO:teuthology.orchestra.run.trial058.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.82119.log.gz 2026-02-23T06:52:40.904 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.50422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79041.log 2026-02-23T06:52:40.904 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50422.log.gz 2026-02-23T06:52:40.904 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.53414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50275.log 2026-02-23T06:52:40.905 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53414.log.gz 2026-02-23T06:52:40.905 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.79041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61546.log 2026-02-23T06:52:40.905 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.79041.log.gz 2026-02-23T06:52:40.906 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.50275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54262.log 2026-02-23T06:52:40.906 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50275.log.gz 2026-02-23T06:52:40.907 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.61546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78240.log 2026-02-23T06:52:40.907 INFO:teuthology.orchestra.run.trial058.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61546.log.gz 2026-02-23T06:52:40.907 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.0.54262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64687.log 2026-02-23T06:52:40.907 INFO:teuthology.orchestra.run.trial058.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54262.log.gz 2026-02-23T06:52:40.908 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.78240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66901.log 2026-02-23T06:52:40.908 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.78240.log.gz 2026-02-23T06:52:40.909 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.64687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76718.log 2026-02-23T06:52:40.909 INFO:teuthology.orchestra.run.trial058.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64687.log.gz 2026-02-23T06:52:40.910 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.66901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69731.log 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66901.log.gz 2026-02-23T06:52:40.910 INFO:teuthology.orchestra.run.trial058.stderr: 2026-02-23T06:52:40.911 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.76718.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.76718.log.gz -5 2026-02-23T06:52:40.911 INFO:teuthology.orchestra.run.trial058.stderr: --verbose -- /var/log/ceph/ceph-client.admin.66484.log 2026-02-23T06:52:40.911 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.69731.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.69731.log.gz 2026-02-23T06:52:40.912 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82462.log 2026-02-23T06:52:40.912 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.66484.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.66484.log.gz 2026-02-23T06:52:40.913 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51404.log 2026-02-23T06:52:40.913 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.82462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80710.log 2026-02-23T06:52:40.913 INFO:teuthology.orchestra.run.trial058.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.82462.log.gz 2026-02-23T06:52:40.914 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.51404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63844.log 2026-02-23T06:52:40.915 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51404.log.gz 2026-02-23T06:52:40.915 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.80710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73750.log 2026-02-23T06:52:40.915 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.80710.log.gz 2026-02-23T06:52:40.916 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.63844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55059.log 2026-02-23T06:52:40.916 INFO:teuthology.orchestra.run.trial058.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63844.log.gz 2026-02-23T06:52:40.917 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.73750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66827.log 2026-02-23T06:52:40.917 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.73750.log.gz 2026-02-23T06:52:40.917 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.55059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68981.log 2026-02-23T06:52:40.918 INFO:teuthology.orchestra.run.trial058.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55059.log.gz 2026-02-23T06:52:40.918 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.66827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79556.log 2026-02-23T06:52:40.918 INFO:teuthology.orchestra.run.trial058.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.66827.log.gz 2026-02-23T06:52:40.919 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.68981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65830.log 2026-02-23T06:52:40.919 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68981.log.gz 2026-02-23T06:52:40.919 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.79556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51600.log 2026-02-23T06:52:40.920 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.79556.log.gz 2026-02-23T06:52:40.920 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.65830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77184.log 2026-02-23T06:52:40.920 INFO:teuthology.orchestra.run.trial058.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65830.log.gz 2026-02-23T06:52:40.921 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.51600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59782.log 2026-02-23T06:52:40.921 INFO:teuthology.orchestra.run.trial058.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51600.log.gz 2026-02-23T06:52:40.922 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.77184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68194.log 2026-02-23T06:52:40.922 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.77184.log.gz 2026-02-23T06:52:40.922 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.59782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61252.log 2026-02-23T06:52:40.922 INFO:teuthology.orchestra.run.trial058.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59782.log.gz 2026-02-23T06:52:40.923 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.68194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52091.log 2026-02-23T06:52:40.923 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68194.log.gz 2026-02-23T06:52:40.924 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.61252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71163.log 2026-02-23T06:52:40.924 INFO:teuthology.orchestra.run.trial058.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.61252.log.gz 2026-02-23T06:52:40.925 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.52091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79507.log 2026-02-23T06:52:40.925 INFO:teuthology.orchestra.run.trial058.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52091.log.gz 2026-02-23T06:52:40.925 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.71163.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.71163.log.gz 2026-02-23T06:52:40.925 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70110.log 2026-02-23T06:52:40.926 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.79507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77650.log 2026-02-23T06:52:40.927 INFO:teuthology.orchestra.run.trial058.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.79507.log.gz 2026-02-23T06:52:40.927 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.70110.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67048.log 2026-02-23T06:52:40.927 INFO:teuthology.orchestra.run.trial058.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70110.log.gz 2026-02-23T06:52:40.928 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.77650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59439.log 2026-02-23T06:52:40.928 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.77650.log.gz 2026-02-23T06:52:40.929 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.67048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66149.log 2026-02-23T06:52:40.929 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.67048.log.gz 2026-02-23T06:52:40.930 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.59439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52319.log 2026-02-23T06:52:40.930 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59439.log.gz 2026-02-23T06:52:40.930 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.66149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71664.log 2026-02-23T06:52:40.930 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.66149.log.gz 2026-02-23T06:52:40.931 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.52319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62822.log 2026-02-23T06:52:40.931 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52319.log.gz 2026-02-23T06:52:40.932 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.71664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54640.log 2026-02-23T06:52:40.932 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.71664.log.gz 2026-02-23T06:52:40.932 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.62822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78869.log 2026-02-23T06:52:40.932 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62822.log.gz 2026-02-23T06:52:40.933 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.54640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70484.log 2026-02-23T06:52:40.933 INFO:teuthology.orchestra.run.trial058.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54640.log.gz 2026-02-23T06:52:40.934 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.78869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71408.log 2026-02-23T06:52:40.934 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.78869.log.gz 2026-02-23T06:52:40.935 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.70484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74845.log 2026-02-23T06:52:40.935 INFO:teuthology.orchestra.run.trial058.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.70484.log.gz 2026-02-23T06:52:40.935 INFO:teuthology.orchestra.run.trial093.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-23T06:52:40.936 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.71408.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.71408.log.gz 2026-02-23T06:52:40.936 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.74845.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.74845.log.gz 2026-02-23T06:52:40.937 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81101.log 2026-02-23T06:52:40.937 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80415.log 2026-02-23T06:52:40.938 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.81101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67874.log 2026-02-23T06:52:40.938 INFO:teuthology.orchestra.run.trial058.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.81101.log.gz 2026-02-23T06:52:40.939 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.80415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79188.log 2026-02-23T06:52:40.939 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.80415.log.gz 2026-02-23T06:52:40.940 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.67874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77135.log 2026-02-23T06:52:40.940 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.67874.log.gz 2026-02-23T06:52:40.940 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.79188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45462.log 2026-02-23T06:52:40.941 INFO:teuthology.orchestra.run.trial058.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.79188.log.gz 2026-02-23T06:52:40.941 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.77135.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.77135.log.gz 2026-02-23T06:52:40.941 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69682.log 2026-02-23T06:52:40.942 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.45462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72057.log 2026-02-23T06:52:40.942 INFO:teuthology.orchestra.run.trial058.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.45462.log.gz 2026-02-23T06:52:40.943 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.69682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76816.log 2026-02-23T06:52:40.943 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69682.log.gz 2026-02-23T06:52:40.943 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.72057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63893.log 2026-02-23T06:52:40.944 INFO:teuthology.orchestra.run.trial058.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72057.log.gz 2026-02-23T06:52:40.944 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.76816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67949.log 2026-02-23T06:52:40.944 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.76816.log.gz 2026-02-23T06:52:40.945 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.63893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61350.log 2026-02-23T06:52:40.945 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63893.log.gz 2026-02-23T06:52:40.946 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.67949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76111.log 2026-02-23T06:52:40.946 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67949.log.gz 2026-02-23T06:52:40.946 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.61350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76210.log 2026-02-23T06:52:40.947 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61350.log.gz 2026-02-23T06:52:40.947 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.76111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63092.log 2026-02-23T06:52:40.948 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.76111.log.gz 2026-02-23T06:52:40.948 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.76210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80071.log 2026-02-23T06:52:40.948 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.76210.log.gz 2026-02-23T06:52:40.949 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.63092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50324.log 2026-02-23T06:52:40.949 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63092.log.gz 2026-02-23T06:52:40.949 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.80071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68514.log 2026-02-23T06:52:40.950 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.80071.log.gz/var/log/ceph/ceph-client.admin.50324.log: 2026-02-23T06:52:40.950 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69030.log 2026-02-23T06:52:40.950 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50324.log.gz 2026-02-23T06:52:40.951 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.68514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65634.log 2026-02-23T06:52:40.952 INFO:teuthology.orchestra.run.trial058.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.68514.log.gz 2026-02-23T06:52:40.952 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.69030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78918.log 2026-02-23T06:52:40.952 INFO:teuthology.orchestra.run.trial058.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.69030.log.gz 2026-02-23T06:52:40.952 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.65634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52715.log 2026-02-23T06:52:40.952 INFO:teuthology.orchestra.run.trial058.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65634.log.gz 2026-02-23T06:52:40.953 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.78918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60279.log 2026-02-23T06:52:40.953 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.78918.log.gz 2026-02-23T06:52:40.954 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.52715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81249.log 2026-02-23T06:52:40.954 INFO:teuthology.orchestra.run.trial058.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52715.log.gz 2026-02-23T06:52:40.955 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73848.log 2026-02-23T06:52:40.956 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.60279.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60279.log.gz 2026-02-23T06:52:40.956 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.81249.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2026-02-23T06:52:40.956 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.81249.log.gz 2026-02-23T06:52:40.956 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.73848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65290.log 2026-02-23T06:52:40.956 INFO:teuthology.orchestra.run.trial058.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.73848.log.gz 2026-02-23T06:52:40.957 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64486.log 2026-02-23T06:52:40.957 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.65290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45005.log 2026-02-23T06:52:40.958 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.65290.log.gz 2026-02-23T06:52:40.958 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.64486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82902.log 2026-02-23T06:52:40.958 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64486.log.gz 2026-02-23T06:52:40.958 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67482.log 2026-02-23T06:52:40.960 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.45005.log: /var/log/ceph/ceph-client.admin.82902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82217.log 2026-02-23T06:52:40.960 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63280.log 2026-02-23T06:52:40.960 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.67482.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.82902.log.gz 2026-02-23T06:52:40.961 INFO:teuthology.orchestra.run.trial058.stderr: 89.4%/var/log/ceph/ceph-client.admin.82217.log: -- replaced with /var/log/ceph/ceph-client.admin.67482.log.gz 2026-02-23T06:52:40.961 INFO:teuthology.orchestra.run.trial058.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.45005.log.gz 2026-02-23T06:52:40.961 INFO:teuthology.orchestra.run.trial058.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.82217.log.gz 2026-02-23T06:52:40.961 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77380.log 2026-02-23T06:52:40.962 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.63280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77822.log 2026-02-23T06:52:40.962 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63280.log.gz 2026-02-23T06:52:40.962 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.77380.log: 94.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2026-02-23T06:52:40.963 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68735.log 2026-02-23T06:52:40.963 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.77380.log.gz 2026-02-23T06:52:40.963 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.77822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45421.log 2026-02-23T06:52:40.964 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.77822.log.gz 2026-02-23T06:52:40.965 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.68735.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68735.log.gz 2026-02-23T06:52:40.966 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.45421.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.45421.log.gz 2026-02-23T06:52:40.966 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59488.log 2026-02-23T06:52:40.967 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55404.log 2026-02-23T06:52:40.967 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.59488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45514.log 2026-02-23T06:52:40.967 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59488.log.gz 2026-02-23T06:52:40.968 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.55404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45743.log 2026-02-23T06:52:40.968 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55404.log.gz 2026-02-23T06:52:40.968 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64756.log 2026-02-23T06:52:40.969 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.45514.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.45514.log.gz 2026-02-23T06:52:40.969 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.45743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56077.log 2026-02-23T06:52:40.969 INFO:teuthology.orchestra.run.trial058.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45743.log.gz 2026-02-23T06:52:40.970 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.64756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44706.log 2026-02-23T06:52:40.970 INFO:teuthology.orchestra.run.trial058.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64756.log.gz 2026-02-23T06:52:40.970 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.56077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65560.log 2026-02-23T06:52:40.971 INFO:teuthology.orchestra.run.trial058.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.56077.log.gz 2026-02-23T06:52:40.971 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.44706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63599.log 2026-02-23T06:52:40.971 INFO:teuthology.orchestra.run.trial058.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.44706.log.gz 2026-02-23T06:52:40.972 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.65560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63476.log 2026-02-23T06:52:40.972 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.65560.log.gz 2026-02-23T06:52:40.973 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.63599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78485.log 2026-02-23T06:52:40.973 INFO:teuthology.orchestra.run.trial058.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.63599.log.gz 2026-02-23T06:52:40.974 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.63476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78191.log 2026-02-23T06:52:40.974 INFO:teuthology.orchestra.run.trial058.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63476.log.gz 2026-02-23T06:52:40.974 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.78485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79286.log 2026-02-23T06:52:40.974 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.78485.log.gz 2026-02-23T06:52:40.975 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.78191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59341.log 2026-02-23T06:52:40.975 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.78191.log.gz 2026-02-23T06:52:40.976 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.79286.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.79286.log.gz 2026-02-23T06:52:40.977 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.59341.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59341.log.gz 2026-02-23T06:52:40.977 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54738.log 2026-02-23T06:52:40.978 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62242.log 2026-02-23T06:52:40.979 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.54738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53029.log 2026-02-23T06:52:40.979 INFO:teuthology.orchestra.run.trial058.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54738.log.gz 2026-02-23T06:52:40.979 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.62242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67358.log 2026-02-23T06:52:40.979 INFO:teuthology.orchestra.run.trial058.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62242.log.gz 2026-02-23T06:52:40.980 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77601.log 2026-02-23T06:52:40.980 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.53029.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53029.log.gz 2026-02-23T06:52:40.981 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.67358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55257.log 2026-02-23T06:52:40.981 INFO:teuthology.orchestra.run.trial058.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67358.log.gz 2026-02-23T06:52:40.981 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71836.log 2026-02-23T06:52:40.982 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.77601.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.77601.log.gz 2026-02-23T06:52:40.982 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.55257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76865.log 2026-02-23T06:52:40.982 INFO:teuthology.orchestra.run.trial058.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55257.log.gz 2026-02-23T06:52:40.984 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.71836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45466.log 2026-02-23T06:52:40.984 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.71836.log.gz 2026-02-23T06:52:40.984 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.76865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62724.log 2026-02-23T06:52:40.984 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.76865.log.gz 2026-02-23T06:52:40.984 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.45466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75767.log 2026-02-23T06:52:40.984 INFO:teuthology.orchestra.run.trial058.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.45466.log.gz 2026-02-23T06:52:40.985 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.62724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51797.log 2026-02-23T06:52:40.985 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62724.log.gz 2026-02-23T06:52:40.986 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.75767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53024.log 2026-02-23T06:52:40.986 INFO:teuthology.orchestra.run.trial058.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.75767.log.gz 2026-02-23T06:52:40.986 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.51797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73358.log 2026-02-23T06:52:40.987 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51797.log.gz 2026-02-23T06:52:40.987 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.53024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66582.log 2026-02-23T06:52:40.987 INFO:teuthology.orchestra.run.trial058.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53024.log.gz 2026-02-23T06:52:40.988 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.73358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60908.log 2026-02-23T06:52:40.988 INFO:teuthology.orchestra.run.trial058.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.73358.log.gz 2026-02-23T06:52:40.989 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.66582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66337.log 2026-02-23T06:52:40.989 INFO:teuthology.orchestra.run.trial058.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66582.log.gz 2026-02-23T06:52:40.989 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71212.log 2026-02-23T06:52:40.990 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.60908.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60908.log.gz 2026-02-23T06:52:40.990 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.66337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55983.log 2026-02-23T06:52:40.990 INFO:teuthology.orchestra.run.trial058.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.66337.log.gz 2026-02-23T06:52:40.991 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.71212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53034.log 2026-02-23T06:52:40.992 INFO:teuthology.orchestra.run.trial058.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.71212.log.gz 2026-02-23T06:52:40.992 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.55983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44548.log 2026-02-23T06:52:40.992 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55983.log.gz 2026-02-23T06:52:40.992 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.53034.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.37879.log 2026-02-23T06:52:40.992 INFO:teuthology.orchestra.run.trial058.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53034.log.gz 2026-02-23T06:52:40.993 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.44548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77429.log 2026-02-23T06:52:40.993 INFO:teuthology.orchestra.run.trial058.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.44548.log.gz 2026-02-23T06:52:40.994 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph.tmp-client.admin.37879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71934.log 2026-02-23T06:52:40.994 INFO:teuthology.orchestra.run.trial058.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.37879.log.gz 2026-02-23T06:52:40.995 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.77429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61301.log 2026-02-23T06:52:40.995 INFO:teuthology.orchestra.run.trial058.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.77429.log.gz 2026-02-23T06:52:40.995 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.71934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67678.log 2026-02-23T06:52:40.995 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.71934.log.gz 2026-02-23T06:52:40.996 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.61301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81825.log 2026-02-23T06:52:40.996 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61301.log.gz 2026-02-23T06:52:40.996 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.67678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59586.log 2026-02-23T06:52:40.997 INFO:teuthology.orchestra.run.trial058.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67678.log.gz 2026-02-23T06:52:40.997 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.81825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83070.log 2026-02-23T06:52:40.998 INFO:teuthology.orchestra.run.trial058.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.81825.log.gz 2026-02-23T06:52:40.998 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.59586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75963.log 2026-02-23T06:52:40.998 INFO:teuthology.orchestra.run.trial058.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59586.log.gz 2026-02-23T06:52:40.998 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.83070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53561.log 2026-02-23T06:52:40.999 INFO:teuthology.orchestra.run.trial058.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.83070.log.gz 2026-02-23T06:52:41.000 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.75963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71983.log 2026-02-23T06:52:41.000 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.75963.log.gz 2026-02-23T06:52:41.000 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.53561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52708.log 2026-02-23T06:52:41.000 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53561.log.gz 2026-02-23T06:52:41.002 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.71983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73137.log 2026-02-23T06:52:41.002 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71983.log.gz 2026-02-23T06:52:41.002 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.52708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74379.log 2026-02-23T06:52:41.002 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52708.log.gz 2026-02-23T06:52:41.002 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.73137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68243.log 2026-02-23T06:52:41.002 INFO:teuthology.orchestra.run.trial058.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73137.log.gz 2026-02-23T06:52:41.003 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.74379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72670.log 2026-02-23T06:52:41.003 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.74379.log.gz 2026-02-23T06:52:41.004 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.68243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70778.log 2026-02-23T06:52:41.004 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.68243.log.gz 2026-02-23T06:52:41.004 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.72670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82070.log 2026-02-23T06:52:41.005 INFO:teuthology.orchestra.run.trial058.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.72670.log.gz 2026-02-23T06:52:41.005 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.70778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51332.log 2026-02-23T06:52:41.005 INFO:teuthology.orchestra.run.trial058.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.70778.log.gz 2026-02-23T06:52:41.006 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.82070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81727.log 2026-02-23T06:52:41.006 INFO:teuthology.orchestra.run.trial058.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.82070.log.gz 2026-02-23T06:52:41.007 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.51332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71359.log 2026-02-23T06:52:41.007 INFO:teuthology.orchestra.run.trial058.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51332.log.gz 2026-02-23T06:52:41.007 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.81727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61995.log 2026-02-23T06:52:41.007 INFO:teuthology.orchestra.run.trial058.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.81727.log.gz 2026-02-23T06:52:41.008 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.71359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61774.log 2026-02-23T06:52:41.008 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.71359.log.gz 2026-02-23T06:52:41.010 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.61995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69473.log 2026-02-23T06:52:41.010 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61995.log.gz 2026-02-23T06:52:41.010 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.61774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78338.log 2026-02-23T06:52:41.010 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61774.log.gz 2026-02-23T06:52:41.010 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.69473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76333.log 2026-02-23T06:52:41.010 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69473.log.gz 2026-02-23T06:52:41.011 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.78338.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.78338.log.gz 2026-02-23T06:52:41.011 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82315.log 2026-02-23T06:52:41.012 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.76333.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.76333.log.gz 2026-02-23T06:52:41.012 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69079.log 2026-02-23T06:52:41.014 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.82315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68465.log 2026-02-23T06:52:41.014 INFO:teuthology.orchestra.run.trial058.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.82315.log.gz 2026-02-23T06:52:41.014 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.69079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72253.log 2026-02-23T06:52:41.014 INFO:teuthology.orchestra.run.trial058.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.69079.log.gz 2026-02-23T06:52:41.014 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.68465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74796.log 2026-02-23T06:52:41.015 INFO:teuthology.orchestra.run.trial058.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68465.log.gz 2026-02-23T06:52:41.015 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.72253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68047.log 2026-02-23T06:52:41.015 INFO:teuthology.orchestra.run.trial058.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72253.log.gz 2026-02-23T06:52:41.016 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.74796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64535.log 2026-02-23T06:52:41.016 INFO:teuthology.orchestra.run.trial058.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74796.log.gz 2026-02-23T06:52:41.017 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.68047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59280.log 2026-02-23T06:52:41.017 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.68047.log.gz 2026-02-23T06:52:41.017 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.64535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52327.log 2026-02-23T06:52:41.017 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64535.log.gz 2026-02-23T06:52:41.018 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.59280.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59280.log.gz 2026-02-23T06:52:41.019 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.52327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75865.log 2026-02-23T06:52:41.019 INFO:teuthology.orchestra.run.trial058.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52327.log.gz 2026-02-23T06:52:41.020 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78820.log 2026-02-23T06:52:41.020 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.75865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66026.log 2026-02-23T06:52:41.020 INFO:teuthology.orchestra.run.trial058.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.75865.log.gz 2026-02-23T06:52:41.021 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.78820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65339.log 2026-02-23T06:52:41.021 INFO:teuthology.orchestra.run.trial058.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.78820.log.gz 2026-02-23T06:52:41.022 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.66026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74502.log 2026-02-23T06:52:41.022 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.66026.log.gz 2026-02-23T06:52:41.023 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.65339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68096.log 2026-02-23T06:52:41.023 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.65339.log.gz 2026-02-23T06:52:41.023 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45496.log 2026-02-23T06:52:41.024 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.74502.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.74502.log.gz 2026-02-23T06:52:41.024 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78289.log 2026-02-23T06:52:41.024 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.68096.log: /var/log/ceph/ceph-client.admin.45496.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68096.log.gz 2026-02-23T06:52:41.024 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76160.log 2026-02-23T06:52:41.025 INFO:teuthology.orchestra.run.trial058.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.45496.log.gz 2026-02-23T06:52:41.025 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.78289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52719.log 2026-02-23T06:52:41.026 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.78289.log.gz 2026-02-23T06:52:41.026 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.76160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75582.log 2026-02-23T06:52:41.026 INFO:teuthology.orchestra.run.trial058.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.76160.log.gz 2026-02-23T06:52:41.027 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.52719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75914.log 2026-02-23T06:52:41.027 INFO:teuthology.orchestra.run.trial058.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52719.log.gz 2026-02-23T06:52:41.028 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.75582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76963.log 2026-02-23T06:52:41.028 INFO:teuthology.orchestra.run.trial058.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.75582.log.gz 2026-02-23T06:52:41.028 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.75914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74453.log 2026-02-23T06:52:41.029 INFO:teuthology.orchestra.run.trial058.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.75914.log.gz 2026-02-23T06:52:41.029 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.76963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64805.log 2026-02-23T06:52:41.029 INFO:teuthology.orchestra.run.trial058.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.76963.log.gz 2026-02-23T06:52:41.030 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.74453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44984.log 2026-02-23T06:52:41.030 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.74453.log.gz 2026-02-23T06:52:41.031 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.64805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62920.log 2026-02-23T06:52:41.031 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64805.log.gz 2026-02-23T06:52:41.031 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.44984.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.44984.log.gz 2026-02-23T06:52:41.032 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.62920.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62920.log.gz 2026-02-23T06:52:41.032 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67776.log 2026-02-23T06:52:41.033 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76284.log 2026-02-23T06:52:41.034 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.67776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62389.log 2026-02-23T06:52:41.034 INFO:teuthology.orchestra.run.trial058.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67776.log.gz 2026-02-23T06:52:41.035 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.76284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59733.log 2026-02-23T06:52:41.035 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.76284.log.gz 2026-02-23T06:52:41.035 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.62389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82757.log 2026-02-23T06:52:41.036 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62389.log.gz 2026-02-23T06:52:41.036 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.59733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61006.log 2026-02-23T06:52:41.036 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59733.log.gz 2026-02-23T06:52:41.037 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.82757.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.82757.log.gz 2026-02-23T06:52:41.038 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.61006.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61006.log.gz 2026-02-23T06:52:41.038 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78771.log 2026-02-23T06:52:41.039 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45790.log 2026-02-23T06:52:41.040 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.78771.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.78771.log.gz 2026-02-23T06:52:41.040 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63697.log 2026-02-23T06:52:41.041 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.45790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77995.log 2026-02-23T06:52:41.041 INFO:teuthology.orchestra.run.trial058.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.45790.log.gz 2026-02-23T06:52:41.042 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.63697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68932.log 2026-02-23T06:52:41.042 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63697.log.gz 2026-02-23T06:52:41.043 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.77995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82364.log 2026-02-23T06:52:41.043 INFO:teuthology.orchestra.run.trial058.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.77995.log.gz 2026-02-23T06:52:41.043 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.68932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44808.log 2026-02-23T06:52:41.043 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68932.log.gz 2026-02-23T06:52:41.044 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67998.log 2026-02-23T06:52:41.044 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.82364.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.82364.log.gz 2026-02-23T06:52:41.045 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.44808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66950.log 2026-02-23T06:52:41.045 INFO:teuthology.orchestra.run.trial058.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.44808.log.gz 2026-02-23T06:52:41.045 INFO:teuthology.orchestra.run.trial058.stderr:gzip/var/log/ceph/ceph-client.admin.67998.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.76669.log 2026-02-23T06:52:41.046 INFO:teuthology.orchestra.run.trial058.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.67998.log.gz 2026-02-23T06:52:41.046 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.66950.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.66950.log.gz 2026-02-23T06:52:41.046 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69986.log 2026-02-23T06:52:41.048 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.76669.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.76669.log.gz 2026-02-23T06:52:41.048 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.69986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66386.log 2026-02-23T06:52:41.048 INFO:teuthology.orchestra.run.trial058.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.69986.log.gz 2026-02-23T06:52:41.049 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74551.log 2026-02-23T06:52:41.050 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.66386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75361.log 2026-02-23T06:52:41.050 INFO:teuthology.orchestra.run.trial058.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.66386.log.gz 2026-02-23T06:52:41.050 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.74551.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.74551.log.gz 2026-02-23T06:52:41.051 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69633.log 2026-02-23T06:52:41.051 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.75361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44642.log 2026-02-23T06:52:41.051 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.75361.log.gz 2026-02-23T06:52:41.052 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.69633.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-23T06:52:41.052 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.69633.log.gz 2026-02-23T06:52:41.053 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.44642.log: 87.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66778.log 2026-02-23T06:52:41.053 INFO:teuthology.orchestra.run.trial058.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44642.log.gz 2026-02-23T06:52:41.054 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73897.log 2026-02-23T06:52:41.054 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.66778.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66778.log.gz 2026-02-23T06:52:41.055 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.73897.log: 89.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-23T06:52:41.055 INFO:teuthology.orchestra.run.trial058.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.73897.log.gz 2026-02-23T06:52:41.055 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59930.log 2026-02-23T06:52:41.056 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73652.log 2026-02-23T06:52:41.057 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5/var/log/ceph/ceph-client.admin.59930.log: --verbose -- /var/log/ceph/ceph-client.admin.75018.log 2026-02-23T06:52:41.057 INFO:teuthology.orchestra.run.trial058.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59930.log.gz 2026-02-23T06:52:41.058 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.73652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50548.log 2026-02-23T06:52:41.058 INFO:teuthology.orchestra.run.trial058.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.73652.log.gz 2026-02-23T06:52:41.058 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.75018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60957.log 2026-02-23T06:52:41.059 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.75018.log.gz 2026-02-23T06:52:41.059 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.50548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82413.log 2026-02-23T06:52:41.059 INFO:teuthology.orchestra.run.trial058.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50548.log.gz 2026-02-23T06:52:41.060 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.60957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69888.log 2026-02-23T06:52:41.060 INFO:teuthology.orchestra.run.trial058.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60957.log.gz 2026-02-23T06:52:41.061 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.82413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79335.log 2026-02-23T06:52:41.061 INFO:teuthology.orchestra.run.trial058.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.82413.log.gz 2026-02-23T06:52:41.061 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.69888.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.69888.log.gz 2026-02-23T06:52:41.062 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60550.log 2026-02-23T06:52:41.062 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.79335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70729.log 2026-02-23T06:52:41.063 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.79335.log.gz 2026-02-23T06:52:41.063 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.60550.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60550.log.gz 2026-02-23T06:52:41.064 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45497.log 2026-02-23T06:52:41.064 INFO:teuthology.orchestra.run.trial093.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-23T06:52:41.064 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.70729.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.70729.log.gz 2026-02-23T06:52:41.064 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44786.log 2026-02-23T06:52:41.065 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.45497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60053.log 2026-02-23T06:52:41.065 INFO:teuthology.orchestra.run.trial058.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.45497.log.gz 2026-02-23T06:52:41.066 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.44786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72818.log 2026-02-23T06:52:41.066 INFO:teuthology.orchestra.run.trial058.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.44786.log.gz 2026-02-23T06:52:41.067 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.60053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78436.log 2026-02-23T06:52:41.067 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60053.log.gz 2026-02-23T06:52:41.067 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.72818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76620.log 2026-02-23T06:52:41.068 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.72818.log.gz 2026-02-23T06:52:41.068 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.78436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61399.log 2026-02-23T06:52:41.068 INFO:teuthology.orchestra.run.trial058.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.78436.log.gz 2026-02-23T06:52:41.069 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.76620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74969.log 2026-02-23T06:52:41.069 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.76620.log.gz 2026-02-23T06:52:41.069 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.61399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77773.log 2026-02-23T06:52:41.070 INFO:teuthology.orchestra.run.trial058.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61399.log.gz 2026-02-23T06:52:41.070 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.74969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72965.log 2026-02-23T06:52:41.071 INFO:teuthology.orchestra.run.trial058.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.74969.log.gz 2026-02-23T06:52:41.071 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.77773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75312.log 2026-02-23T06:52:41.071 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.77773.log.gz 2026-02-23T06:52:41.072 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.72965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71615.log 2026-02-23T06:52:41.072 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.72965.log.gz 2026-02-23T06:52:41.072 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.75312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62675.log 2026-02-23T06:52:41.073 INFO:teuthology.orchestra.run.trial058.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.75312.log.gz 2026-02-23T06:52:41.073 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.71615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46056.log 2026-02-23T06:52:41.073 INFO:teuthology.orchestra.run.trial058.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.71615.log.gz 2026-02-23T06:52:41.074 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.62675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60648.log 2026-02-23T06:52:41.074 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.62675.log.gz 2026-02-23T06:52:41.076 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.46056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45400.log 2026-02-23T06:52:41.076 INFO:teuthology.orchestra.run.trial058.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46056.log.gz 2026-02-23T06:52:41.076 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.60648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64228.log 2026-02-23T06:52:41.076 INFO:teuthology.orchestra.run.trial058.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60648.log.gz 2026-02-23T06:52:41.076 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.45400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79384.log 2026-02-23T06:52:41.076 INFO:teuthology.orchestra.run.trial058.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45400.log.gz 2026-02-23T06:52:41.077 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.64228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69128.log 2026-02-23T06:52:41.077 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64228.log.gz 2026-02-23T06:52:41.077 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.79384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52308.log 2026-02-23T06:52:41.078 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.79384.log.gz 2026-02-23T06:52:41.078 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.69128.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.69128.log.gz 2026-02-23T06:52:41.080 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.52308.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52308.log.gz 2026-02-23T06:52:41.080 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68612.log 2026-02-23T06:52:41.080 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58986.log 2026-02-23T06:52:41.081 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63746.log 2026-02-23T06:52:41.081 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.68612.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68612.log.gz 2026-02-23T06:52:41.082 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.58986.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.58986.log.gz 2026-02-23T06:52:41.082 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.63746.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63746.log.gz 2026-02-23T06:52:41.082 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69202.log 2026-02-23T06:52:41.083 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82560.log 2026-02-23T06:52:41.084 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.69202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77012.log 2026-02-23T06:52:41.084 INFO:teuthology.orchestra.run.trial058.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.69202.log.gz 2026-02-23T06:52:41.085 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.82560.log: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72720.log 2026-02-23T06:52:41.085 INFO:teuthology.orchestra.run.trial058.stderr: -- replaced with /var/log/ceph/ceph-client.admin.82560.log.gz 2026-02-23T06:52:41.086 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.77012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76062.log 2026-02-23T06:52:41.086 INFO:teuthology.orchestra.run.trial058.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77012.log.gz 2026-02-23T06:52:41.086 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.72720.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.72720.log.gz 2026-02-23T06:52:41.087 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.76062.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.76062.log.gz 2026-02-23T06:52:41.087 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74698.log 2026-02-23T06:52:41.088 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55892.log 2026-02-23T06:52:41.089 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.74698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67309.log 2026-02-23T06:52:41.089 INFO:teuthology.orchestra.run.trial058.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74698.log.gz 2026-02-23T06:52:41.090 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.55892.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-23T06:52:41.090 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55892.log.gz 2026-02-23T06:52:41.090 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.67309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66729.log 2026-02-23T06:52:41.091 INFO:teuthology.orchestra.run.trial058.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.67309.log.gz 2026-02-23T06:52:41.091 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45397.log 2026-02-23T06:52:41.092 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.66729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80880.log 2026-02-23T06:52:41.092 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66729.log.gz 2026-02-23T06:52:41.093 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.45397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72867.log 2026-02-23T06:52:41.093 INFO:teuthology.orchestra.run.trial058.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.45397.log.gz 2026-02-23T06:52:41.095 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76767.log 2026-02-23T06:52:41.095 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.80880.log: /var/log/ceph/ceph-client.admin.72867.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.80880.log.gz 2026-02-23T06:52:41.095 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71310.log 2026-02-23T06:52:41.095 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.72867.log.gz 2026-02-23T06:52:41.095 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.76767.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.76767.log.gz 2026-02-23T06:52:41.095 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77086.log 2026-02-23T06:52:41.096 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.71310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45056.log 2026-02-23T06:52:41.096 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71310.log.gz 2026-02-23T06:52:41.097 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.77086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80611.log 2026-02-23T06:52:41.097 INFO:teuthology.orchestra.run.trial058.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77086.log.gz 2026-02-23T06:52:41.097 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.45056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59537.log 2026-02-23T06:52:41.099 INFO:teuthology.orchestra.run.trial058.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.45056.log.gz 2026-02-23T06:52:41.099 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70159.log 2026-02-23T06:52:41.099 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.80611.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.80611.log.gz 2026-02-23T06:52:41.099 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.59537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68661.log 2026-02-23T06:52:41.099 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59537.log.gz 2026-02-23T06:52:41.099 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76914.log 2026-02-23T06:52:41.101 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.70159.log: /var/log/ceph/ceph-client.admin.68661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63043.log 2026-02-23T06:52:41.101 INFO:teuthology.orchestra.run.trial058.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68661.log.gz 2026-02-23T06:52:41.101 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.76914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71787.log 2026-02-23T06:52:41.101 INFO:teuthology.orchestra.run.trial058.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.76914.log.gz 2026-02-23T06:52:41.102 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.63043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77282.log 2026-02-23T06:52:41.102 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63043.log.gz 2026-02-23T06:52:41.102 INFO:teuthology.orchestra.run.trial058.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.70159.log.gz 2026-02-23T06:52:41.102 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81393.log 2026-02-23T06:52:41.103 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.71787.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.71787.log.gz 2026-02-23T06:52:41.103 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.77282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62291.log 2026-02-23T06:52:41.103 INFO:teuthology.orchestra.run.trial058.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.77282.log.gz 2026-02-23T06:52:41.103 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50373.log 2026-02-23T06:52:41.105 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.62291.log: 87.7%/var/log/ceph/ceph-client.admin.81393.log: -- replaced with /var/log/ceph/ceph-client.admin.62291.log.gz 2026-02-23T06:52:41.105 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.81393.log.gz 2026-02-23T06:52:41.105 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.50373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63427.log 2026-02-23T06:52:41.105 INFO:teuthology.orchestra.run.trial058.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50373.log.gz 2026-02-23T06:52:41.106 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53463.log 2026-02-23T06:52:41.107 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.63427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61872.log 2026-02-23T06:52:41.107 INFO:teuthology.orchestra.run.trial058.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.63427.log.gz 2026-02-23T06:52:41.107 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.53463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74747.log 2026-02-23T06:52:41.107 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53463.log.gz 2026-02-23T06:52:41.108 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.61872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75116.log 2026-02-23T06:52:41.109 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61872.log.gz 2026-02-23T06:52:41.109 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53177.log 2026-02-23T06:52:41.109 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.74747.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.74747.log.gz 2026-02-23T06:52:41.109 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64633.log 2026-02-23T06:52:41.110 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.75116.log: /var/log/ceph/ceph-client.admin.53177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62438.log 2026-02-23T06:52:41.110 INFO:teuthology.orchestra.run.trial058.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53177.log.gz 2026-02-23T06:52:41.110 INFO:teuthology.orchestra.run.trial058.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.75116.log.gz 2026-02-23T06:52:41.111 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73971.log 2026-02-23T06:52:41.111 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.64633.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64633.log.gz 2026-02-23T06:52:41.111 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.62438.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62438.log.gz 2026-02-23T06:52:41.112 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.73971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66100.log 2026-02-23T06:52:41.112 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.73971.log.gz 2026-02-23T06:52:41.113 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60377.log 2026-02-23T06:52:41.115 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.66100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51650.log 2026-02-23T06:52:41.115 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66100.log.gz 2026-02-23T06:52:41.115 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.60377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73603.log 2026-02-23T06:52:41.115 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60377.log.gz 2026-02-23T06:52:41.115 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.51650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80464.log 2026-02-23T06:52:41.115 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51650.log.gz 2026-02-23T06:52:41.115 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54444.log 2026-02-23T06:52:41.117 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.80464.log: /var/log/ceph/ceph-client.admin.73603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78608.log 2026-02-23T06:52:41.117 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.80464.log.gz 2026-02-23T06:52:41.117 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.54444.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73603.log.gz 2026-02-23T06:52:41.118 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75484.log 2026-02-23T06:52:41.118 INFO:teuthology.orchestra.run.trial058.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54444.log.gz 2026-02-23T06:52:41.118 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82266.log 2026-02-23T06:52:41.120 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.78608.log: /var/log/ceph/ceph-client.admin.75484.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.78608.log.gz 2026-02-23T06:52:41.120 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65388.log 2026-02-23T06:52:41.120 INFO:teuthology.orchestra.run.trial058.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.75484.log.gz 2026-02-23T06:52:41.120 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.82266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53133.log 2026-02-23T06:52:41.120 INFO:teuthology.orchestra.run.trial058.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.82266.log.gz 2026-02-23T06:52:41.120 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.65388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78093.log 2026-02-23T06:52:41.121 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.65388.log.gz 2026-02-23T06:52:41.121 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53610.log 2026-02-23T06:52:41.121 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.53133.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53133.log.gz 2026-02-23T06:52:41.121 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.78093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60004.log 2026-02-23T06:52:41.121 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.78093.log.gz 2026-02-23T06:52:41.122 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74330.log 2026-02-23T06:52:41.122 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.53610.log: /var/log/ceph/ceph-client.admin.60004.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53610.log.gz 2026-02-23T06:52:41.123 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58614.log 2026-02-23T06:52:41.123 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60004.log.gz 2026-02-23T06:52:41.123 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52709.log 2026-02-23T06:52:41.124 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.74330.log: /var/log/ceph/ceph-client.admin.58614.log: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83000.log 2026-02-23T06:52:41.124 INFO:teuthology.orchestra.run.trial058.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58614.log.gz 2026-02-23T06:52:41.124 INFO:teuthology.orchestra.run.trial058.stderr: -- replaced with /var/log/ceph/ceph-client.admin.74330.log.gz 2026-02-23T06:52:41.125 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53843.log 2026-02-23T06:52:41.125 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.52709.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52709.log.gz 2026-02-23T06:52:41.125 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.83000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73186.log 2026-02-23T06:52:41.126 INFO:teuthology.orchestra.run.trial058.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.83000.log.gz 2026-02-23T06:52:41.126 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71458.log 2026-02-23T06:52:41.126 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.53843.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53843.log.gz 2026-02-23T06:52:41.127 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77946.log 2026-02-23T06:52:41.127 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.73186.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73186.log.gz 2026-02-23T06:52:41.127 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72769.log 2026-02-23T06:52:41.128 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.71458.log: /var/log/ceph/ceph-client.admin.77946.log: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81923.log 2026-02-23T06:52:41.128 INFO:teuthology.orchestra.run.trial058.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71458.log.gz 2026-02-23T06:52:41.128 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.77946.log.gz 2026-02-23T06:52:41.129 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.72769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54787.log 2026-02-23T06:52:41.129 INFO:teuthology.orchestra.run.trial058.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72769.log.gz 2026-02-23T06:52:41.130 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.81923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72400.log 2026-02-23T06:52:41.131 INFO:teuthology.orchestra.run.trial058.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.81923.log.gz 2026-02-23T06:52:41.131 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60452.log 2026-02-23T06:52:41.131 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.54787.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54787.log.gz 2026-02-23T06:52:41.131 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.72400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81003.log 2026-02-23T06:52:41.132 INFO:teuthology.orchestra.run.trial058.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.72400.log.gz 2026-02-23T06:52:41.132 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55157.log 2026-02-23T06:52:41.132 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.60452.log: /var/log/ceph/ceph-client.admin.81003.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60452.log.gz 2026-02-23T06:52:41.132 INFO:teuthology.orchestra.run.trial058.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.81003.log.gz 2026-02-23T06:52:41.133 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79237.log 2026-02-23T06:52:41.133 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.55157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80243.log 2026-02-23T06:52:41.134 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55157.log.gz 2026-02-23T06:52:41.134 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.79237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69571.log 2026-02-23T06:52:41.135 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.79237.log.gz 2026-02-23T06:52:41.135 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62191.log 2026-02-23T06:52:41.135 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.80243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81052.log 2026-02-23T06:52:41.136 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.69571.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.80243.log.gz 2026-02-23T06:52:41.136 INFO:teuthology.orchestra.run.trial058.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69571.log.gz 2026-02-23T06:52:41.136 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.62191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65020.log 2026-02-23T06:52:41.136 INFO:teuthology.orchestra.run.trial058.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62191.log.gz 2026-02-23T06:52:41.137 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78992.log 2026-02-23T06:52:41.137 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.81052.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.81052.log.gz 2026-02-23T06:52:41.138 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77233.log 2026-02-23T06:52:41.138 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.65020.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.65020.log.gz 2026-02-23T06:52:41.138 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73456.log 2026-02-23T06:52:41.139 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.78992.log: /var/log/ceph/ceph-client.admin.77233.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68563.log 2026-02-23T06:52:41.139 INFO:teuthology.orchestra.run.trial058.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77233.log.gz 2026-02-23T06:52:41.139 INFO:teuthology.orchestra.run.trial058.stderr: -- replaced with /var/log/ceph/ceph-client.admin.78992.log.gz 2026-02-23T06:52:41.140 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45014.log 2026-02-23T06:52:41.140 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.73456.log: 89.1%/var/log/ceph/ceph-client.admin.68563.log: -- replaced with /var/log/ceph/ceph-client.admin.73456.log.gz 2026-02-23T06:52:41.141 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61104.log 2026-02-23T06:52:41.141 INFO:teuthology.orchestra.run.trial058.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.68563.log.gz 2026-02-23T06:52:41.143 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73407.log 2026-02-23T06:52:41.143 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.45014.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.45014.log.gz 2026-02-23T06:52:41.143 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.61104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62773.log 2026-02-23T06:52:41.143 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61104.log.gz 2026-02-23T06:52:41.143 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.73407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69301.log 2026-02-23T06:52:41.144 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.73407.log.gz 2026-02-23T06:52:41.144 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81199.log 2026-02-23T06:52:41.144 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.62773.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62773.log.gz 2026-02-23T06:52:41.144 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64584.log 2026-02-23T06:52:41.145 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.69301.log: /var/log/ceph/ceph-client.admin.81199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60230.log 2026-02-23T06:52:41.145 INFO:teuthology.orchestra.run.trial058.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.69301.log.gz 2026-02-23T06:52:41.146 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.64584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68833.log 2026-02-23T06:52:41.146 INFO:teuthology.orchestra.run.trial058.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64584.log.gz 2026-02-23T06:52:41.146 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.60230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78683.log 2026-02-23T06:52:41.147 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60230.log.gz 2026-02-23T06:52:41.147 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.81199.log.gz 2026-02-23T06:52:41.147 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50076.log 2026-02-23T06:52:41.149 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.68833.log: /var/log/ceph/ceph-client.admin.78683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70306.log 2026-02-23T06:52:41.149 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.78683.log.gz 2026-02-23T06:52:41.149 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.50076.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50076.log.gz 2026-02-23T06:52:41.149 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.70306.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.68833.log.gz 2026-02-23T06:52:41.149 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.70306.log.gz 2026-02-23T06:52:41.149 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51103.log 2026-02-23T06:52:41.150 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76013.log 2026-02-23T06:52:41.151 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.51103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62871.log 2026-02-23T06:52:41.152 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55208.log 2026-02-23T06:52:41.152 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.76013.log: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.51103.log.gz 2026-02-23T06:52:41.152 INFO:teuthology.orchestra.run.trial058.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.76013.log.gz 2026-02-23T06:52:41.152 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74069.log 2026-02-23T06:52:41.154 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.55208.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55208.log.gz 2026-02-23T06:52:41.154 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.62871.log: /var/log/ceph/ceph-client.admin.74069.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.62871.log.gz 2026-02-23T06:52:41.154 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73284.log 2026-02-23T06:52:41.154 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.74069.log.gz 2026-02-23T06:52:41.156 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60501.log 2026-02-23T06:52:41.156 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.73284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65928.log 2026-02-23T06:52:41.156 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.73284.log.gz 2026-02-23T06:52:41.156 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.60501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82853.log 2026-02-23T06:52:41.156 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60501.log.gz 2026-02-23T06:52:41.157 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.65928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61624.log 2026-02-23T06:52:41.158 INFO:teuthology.orchestra.run.trial058.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.65928.log.gz 2026-02-23T06:52:41.158 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.82853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60599.log 2026-02-23T06:52:41.158 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.82853.log.gz 2026-02-23T06:52:41.158 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.61624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78559.log 2026-02-23T06:52:41.158 INFO:teuthology.orchestra.run.trial058.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61624.log.gz 2026-02-23T06:52:41.159 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81150.log 2026-02-23T06:52:41.161 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.60599.log: /var/log/ceph/ceph-client.admin.78559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67825.log 2026-02-23T06:52:41.161 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.78559.log.gz 2026-02-23T06:52:41.161 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60599.log.gz/var/log/ceph/ceph-client.admin.81150.log: 2026-02-23T06:52:41.161 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62044.log 2026-02-23T06:52:41.161 INFO:teuthology.orchestra.run.trial058.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.81150.log.gz 2026-02-23T06:52:41.161 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.67825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79899.log 2026-02-23T06:52:41.161 INFO:teuthology.orchestra.run.trial058.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.67825.log.gz 2026-02-23T06:52:41.162 INFO:teuthology.orchestra.run.trial093.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-23T06:52:41.162 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.62044.log: /var/log/ceph/ceph-client.admin.79899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75533.log 2026-02-23T06:52:41.162 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.62044.log.gz 2026-02-23T06:52:41.162 INFO:teuthology.orchestra.run.trial058.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.79899.log.gz 2026-02-23T06:52:41.163 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65437.log 2026-02-23T06:52:41.164 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.75533.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.75533.log.gz 2026-02-23T06:52:41.164 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69780.log 2026-02-23T06:52:41.165 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.65437.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65437.log.gz 2026-02-23T06:52:41.165 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72572.log 2026-02-23T06:52:41.166 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.69780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50176.log 2026-02-23T06:52:41.166 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.69780.log.gz 2026-02-23T06:52:41.167 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.72572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82511.log 2026-02-23T06:52:41.167 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.72572.log.gz 2026-02-23T06:52:41.167 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51846.log 2026-02-23T06:52:41.168 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.50176.log: /var/log/ceph/ceph-client.admin.82511.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50176.log.gz 2026-02-23T06:52:41.168 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73554.log 2026-02-23T06:52:41.168 INFO:teuthology.orchestra.run.trial058.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.82511.log.gz 2026-02-23T06:52:41.169 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.51846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75631.log 2026-02-23T06:52:41.169 INFO:teuthology.orchestra.run.trial058.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51846.log.gz 2026-02-23T06:52:41.170 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.73554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50226.log 2026-02-23T06:52:41.170 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.73554.log.gz 2026-02-23T06:52:41.170 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74144.log 2026-02-23T06:52:41.171 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.75631.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.75631.log.gz 2026-02-23T06:52:41.171 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.50226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63141.log 2026-02-23T06:52:41.172 INFO:teuthology.orchestra.run.trial058.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50226.log.gz 2026-02-23T06:52:41.172 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53512.log 2026-02-23T06:52:41.173 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.74144.log: /var/log/ceph/ceph-client.admin.63141.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2026-02-23T06:52:41.173 INFO:teuthology.orchestra.run.trial058.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.63141.log.gz 2026-02-23T06:52:41.174 INFO:teuthology.orchestra.run.trial058.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.74144.log.gz 2026-02-23T06:52:41.174 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.53512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77897.log 2026-02-23T06:52:41.174 INFO:teuthology.orchestra.run.trial058.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53512.log.gz 2026-02-23T06:52:41.174 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71885.log 2026-02-23T06:52:41.175 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49868.log 2026-02-23T06:52:41.176 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.77897.log: /var/log/ceph/ceph-client.admin.71885.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.77897.log.gz 2026-02-23T06:52:41.176 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.71885.log.gz 2026-02-23T06:52:41.176 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65879.log 2026-02-23T06:52:41.176 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64326.log 2026-02-23T06:52:41.177 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.49868.log: /var/log/ceph/ceph-client.admin.65879.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49868.log.gz 2026-02-23T06:52:41.178 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65879.log.gz 2026-02-23T06:52:41.178 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72498.log 2026-02-23T06:52:41.180 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69937.log 2026-02-23T06:52:41.180 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.64326.log: /var/log/ceph/ceph-client.admin.72498.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64326.log.gz 2026-02-23T06:52:41.180 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.72498.log.gz 2026-02-23T06:52:41.180 INFO:teuthology.orchestra.run.trial058.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2026-02-23T06:52:41.180 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53041.log 2026-02-23T06:52:41.181 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67531.log 2026-02-23T06:52:41.181 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.69937.log: /var/log/ceph/ceph-client.admin.53041.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.69937.log.gz 2026-02-23T06:52:41.181 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72449.log 2026-02-23T06:52:41.181 INFO:teuthology.orchestra.run.trial058.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53041.log.gz 2026-02-23T06:52:41.183 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72302.log 2026-02-23T06:52:41.183 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.67531.log: /var/log/ceph/ceph-client.admin.72449.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.67531.log.gz 2026-02-23T06:52:41.183 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45314.log 2026-02-23T06:52:41.183 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.72449.log.gz 2026-02-23T06:52:41.183 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68145.log 2026-02-23T06:52:41.184 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.72302.log: /var/log/ceph/ceph-client.admin.45314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74649.log 2026-02-23T06:52:41.184 INFO:teuthology.orchestra.run.trial058.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.45314.log.gz 2026-02-23T06:52:41.184 INFO:teuthology.orchestra.run.trial058.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72302.log.gz 2026-02-23T06:52:41.185 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.68145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75214.log 2026-02-23T06:52:41.185 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68145.log.gz 2026-02-23T06:52:41.186 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.74649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51944.log 2026-02-23T06:52:41.186 INFO:teuthology.orchestra.run.trial058.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74649.log.gz 2026-02-23T06:52:41.187 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.75214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61203.log 2026-02-23T06:52:41.187 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.75214.log.gz 2026-02-23T06:52:41.187 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58683.log 2026-02-23T06:52:41.188 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.51944.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51944.log.gz 2026-02-23T06:52:41.189 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80661.log 2026-02-23T06:52:41.189 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.61203.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61203.log.gz 2026-02-23T06:52:41.189 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.58683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52710.log 2026-02-23T06:52:41.189 INFO:teuthology.orchestra.run.trial058.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58683.log.gz 2026-02-23T06:52:41.189 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76522.log 2026-02-23T06:52:41.190 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.80661.log: /var/log/ceph/ceph-client.admin.52710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62626.log 2026-02-23T06:52:41.190 INFO:teuthology.orchestra.run.trial058.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52710.log.gz 2026-02-23T06:52:41.190 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.80661.log.gz 2026-02-23T06:52:41.191 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68784.log 2026-02-23T06:52:41.191 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.76522.log: 89.2%/var/log/ceph/ceph-client.admin.62626.log: -- replaced with /var/log/ceph/ceph-client.admin.76522.log.gz 2026-02-23T06:52:41.191 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70257.log 2026-02-23T06:52:41.191 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62626.log.gz 2026-02-23T06:52:41.192 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50027.log 2026-02-23T06:52:41.193 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.68784.log: 89.3%/var/log/ceph/ceph-client.admin.70257.log: -- replaced with /var/log/ceph/ceph-client.admin.68784.log.gz 2026-02-23T06:52:41.193 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64388.log 2026-02-23T06:52:41.193 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.70257.log.gz 2026-02-23T06:52:41.194 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52329.log 2026-02-23T06:52:41.194 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.50027.log: /var/log/ceph/ceph-client.admin.64388.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50027.log.gz 2026-02-23T06:52:41.194 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52320.log 2026-02-23T06:52:41.194 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64388.log.gz 2026-02-23T06:52:41.196 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63991.log 2026-02-23T06:52:41.196 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.52329.log: /var/log/ceph/ceph-client.admin.52320.log: gzip 87.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.52329.log.gz --verbose 2026-02-23T06:52:41.196 INFO:teuthology.orchestra.run.trial058.stderr: -- /var/log/ceph/ceph-client.admin.49652.log 2026-02-23T06:52:41.196 INFO:teuthology.orchestra.run.trial058.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52320.log.gz 2026-02-23T06:52:41.196 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59832.log 2026-02-23T06:52:41.197 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.63991.log: /var/log/ceph/ceph-client.admin.49652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64437.log 2026-02-23T06:52:41.197 INFO:teuthology.orchestra.run.trial058.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63991.log.gz 2026-02-23T06:52:41.198 INFO:teuthology.orchestra.run.trial058.stderr: 87.9%/var/log/ceph/ceph-client.admin.59832.log: -- replaced with /var/log/ceph/ceph-client.admin.49652.log.gz 2026-02-23T06:52:41.198 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51993.log 2026-02-23T06:52:41.198 INFO:teuthology.orchestra.run.trial058.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59832.log.gz 2026-02-23T06:52:41.198 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60328.log 2026-02-23T06:52:41.200 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.64437.log: /var/log/ceph/ceph-client.admin.51993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67433.log 2026-02-23T06:52:41.200 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51993.log.gz 2026-02-23T06:52:41.200 INFO:teuthology.orchestra.run.trial058.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.64437.log.gz 2026-02-23T06:52:41.200 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.60328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49970.log 2026-02-23T06:52:41.200 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60328.log.gz 2026-02-23T06:52:41.200 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67211.log 2026-02-23T06:52:41.202 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.67433.log: /var/log/ceph/ceph-client.admin.49970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79752.log 2026-02-23T06:52:41.202 INFO:teuthology.orchestra.run.trial058.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49970.log.gz 2026-02-23T06:52:41.202 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67433.log.gz 2026-02-23T06:52:41.202 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.67211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61153.log 2026-02-23T06:52:41.202 INFO:teuthology.orchestra.run.trial058.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.67211.log.gz 2026-02-23T06:52:41.203 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.79752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80513.log 2026-02-23T06:52:41.204 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.79752.log.gz 2026-02-23T06:52:41.204 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77552.log 2026-02-23T06:52:41.204 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.61153.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61153.log.gz 2026-02-23T06:52:41.204 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.80513.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-23T06:52:41.204 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.80513.log.gz 2026-02-23T06:52:41.205 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.77552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79973.log 2026-02-23T06:52:41.205 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.77552.log.gz 2026-02-23T06:52:41.205 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61673.log 2026-02-23T06:52:41.206 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.79973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82168.log 2026-02-23T06:52:41.206 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.79973.log.gz 2026-02-23T06:52:41.207 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.82168.log: /var/log/ceph/ceph-client.admin.61673.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.82168.log.gz 2026-02-23T06:52:41.208 INFO:teuthology.orchestra.run.trial058.stderr:gzip 89.1% -5 --verbose -- /var/log/ceph/ceph-client.admin.65977.log 2026-02-23T06:52:41.208 INFO:teuthology.orchestra.run.trial058.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61673.log.gz 2026-02-23T06:52:41.208 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62142.log 2026-02-23T06:52:41.209 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.65977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54859.log 2026-02-23T06:52:41.210 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.65977.log.gz 2026-02-23T06:52:41.210 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.62142.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.62142.log.gz 2026-02-23T06:52:41.211 INFO:teuthology.orchestra.run.trial058.stderr: 88.5% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-23T06:52:41.211 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53365.log 2026-02-23T06:52:41.212 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.54859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44971.log 2026-02-23T06:52:41.212 INFO:teuthology.orchestra.run.trial058.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54859.log.gz 2026-02-23T06:52:41.212 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.53365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54257.log 2026-02-23T06:52:41.213 INFO:teuthology.orchestra.run.trial058.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53365.log.gz 2026-02-23T06:52:41.213 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80292.log 2026-02-23T06:52:41.213 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.44971.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44971.log.gz 2026-02-23T06:52:41.214 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59144.log 2026-02-23T06:52:41.214 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.0.54257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54257.log.gz 2026-02-23T06:52:41.214 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52324.log 2026-02-23T06:52:41.216 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.80292.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.80292.log.gz 2026-02-23T06:52:41.216 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61055.log 2026-02-23T06:52:41.216 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.59144.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59144.log.gz 2026-02-23T06:52:41.216 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54493.log 2026-02-23T06:52:41.216 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.52324.log: /var/log/ceph/ceph-client.admin.61055.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52324.log.gz 2026-02-23T06:52:41.217 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69375.log 2026-02-23T06:52:41.217 INFO:teuthology.orchestra.run.trial058.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.61055.log.gz 2026-02-23T06:52:41.217 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.54493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67123.log 2026-02-23T06:52:41.218 INFO:teuthology.orchestra.run.trial058.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54493.log.gz 2026-02-23T06:52:41.218 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.69375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74232.log 2026-02-23T06:52:41.218 INFO:teuthology.orchestra.run.trial058.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.69375.log.gz 2026-02-23T06:52:41.219 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59684.log 2026-02-23T06:52:41.219 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.67123.log: /var/log/ceph/ceph-client.admin.74232.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67123.log.gz 2026-02-23T06:52:41.220 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55739.log 2026-02-23T06:52:41.220 INFO:teuthology.orchestra.run.trial058.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.74232.log.gz 2026-02-23T06:52:41.220 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73701.log 2026-02-23T06:52:41.221 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.59684.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.59684.log.gz 2026-02-23T06:52:41.221 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61448.log 2026-02-23T06:52:41.221 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.55739.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55739.log.gz 2026-02-23T06:52:41.222 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76473.log 2026-02-23T06:52:41.223 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.73701.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.73701.log.gz 2026-02-23T06:52:41.223 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.61448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54961.log 2026-02-23T06:52:41.223 INFO:teuthology.orchestra.run.trial058.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61448.log.gz 2026-02-23T06:52:41.223 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.76473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55108.log 2026-02-23T06:52:41.224 INFO:teuthology.orchestra.run.trial058.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.76473.log.gz 2026-02-23T06:52:41.224 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49770.log 2026-02-23T06:52:41.225 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.54961.log: /var/log/ceph/ceph-client.admin.55108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55306.log 2026-02-23T06:52:41.225 INFO:teuthology.orchestra.run.trial058.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54961.log.gz 2026-02-23T06:52:41.225 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.49770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44412.log 2026-02-23T06:52:41.225 INFO:teuthology.orchestra.run.trial058.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49770.log.gz 2026-02-23T06:52:41.226 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.55306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72621.log 2026-02-23T06:52:41.226 INFO:teuthology.orchestra.run.trial058.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55306.log.gz 2026-02-23T06:52:41.226 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55108.log.gz 2026-02-23T06:52:41.227 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65167.log 2026-02-23T06:52:41.227 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.44412.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44412.log.gz 2026-02-23T06:52:41.227 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.72621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75680.log 2026-02-23T06:52:41.227 INFO:teuthology.orchestra.run.trial058.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.72621.log.gz 2026-02-23T06:52:41.228 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.65167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72155.log 2026-02-23T06:52:41.229 INFO:teuthology.orchestra.run.trial058.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65167.log.gz 2026-02-23T06:52:41.229 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73505.log 2026-02-23T06:52:41.229 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.75680.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.75680.log.gz 2026-02-23T06:52:41.229 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75165.log 2026-02-23T06:52:41.230 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.72155.log: /var/log/ceph/ceph-client.admin.73505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68883.log 2026-02-23T06:52:41.230 INFO:teuthology.orchestra.run.trial058.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.73505.log.gz 2026-02-23T06:52:41.231 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.75165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79433.log 2026-02-23T06:52:41.231 INFO:teuthology.orchestra.run.trial058.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.75165.log.gz 2026-02-23T06:52:41.231 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.68883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70435.log 2026-02-23T06:52:41.232 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68883.log.gz 2026-02-23T06:52:41.232 INFO:teuthology.orchestra.run.trial058.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.72155.log.gz 2026-02-23T06:52:41.232 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61497.log 2026-02-23T06:52:41.234 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.79433.log: /var/log/ceph/ceph-client.admin.70435.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.79433.log.gz 2026-02-23T06:52:41.234 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57301.log 2026-02-23T06:52:41.234 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.70435.log.gz 2026-02-23T06:52:41.234 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.61497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52716.log 2026-02-23T06:52:41.234 INFO:teuthology.orchestra.run.trial058.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61497.log.gz 2026-02-23T06:52:41.235 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.52716.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52716.log.gz 2026-02-23T06:52:41.235 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52717.log 2026-02-23T06:52:41.236 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.57301.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57301.log.gz 2026-02-23T06:52:41.237 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.52717.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2026-02-23T06:52:41.237 INFO:teuthology.orchestra.run.trial058.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52717.log.gz 2026-02-23T06:52:41.238 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80194.log 2026-02-23T06:52:41.238 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80022.log 2026-02-23T06:52:41.239 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-mds.e.log: /var/log/ceph/ceph-client.admin.80194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70680.log 2026-02-23T06:52:41.239 INFO:teuthology.orchestra.run.trial058.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.80194.log.gz 2026-02-23T06:52:41.240 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.80022.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.80022.log.gz 2026-02-23T06:52:41.240 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69522.log 2026-02-23T06:52:41.241 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.70680.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.70680.log.gz 2026-02-23T06:52:41.242 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.69522.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69522.log.gz 2026-02-23T06:52:41.242 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49502.log 2026-02-23T06:52:41.243 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68292.log 2026-02-23T06:52:41.244 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.49502.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49502.log.gz 2026-02-23T06:52:41.245 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75816.log 2026-02-23T06:52:41.245 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.68292.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68292.log.gz 2026-02-23T06:52:41.246 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50471.log 2026-02-23T06:52:41.247 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.75816.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.75816.log.gz 2026-02-23T06:52:41.248 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71114.log 2026-02-23T06:52:41.248 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.50471.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50471.log.gz 2026-02-23T06:52:41.249 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65511.log 2026-02-23T06:52:41.250 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.71114.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.71114.log.gz 2026-02-23T06:52:41.250 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65683.log 2026-02-23T06:52:41.252 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.65511.log: 89.1%/var/log/ceph/ceph-client.admin.65683.log: -- replaced with /var/log/ceph/ceph-client.admin.65511.log.gz 2026-02-23T06:52:41.252 INFO:teuthology.orchestra.run.trial058.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.65683.log.gz 2026-02-23T06:52:41.390 INFO:teuthology.orchestra.run.trial058.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-23T06:52:43.471 INFO:teuthology.orchestra.run.trial058.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2026-02-23T06:52:58.792 INFO:teuthology.orchestra.run.trial058.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-23T06:53:08.656 INFO:teuthology.orchestra.run.trial093.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-23T06:53:09.530 INFO:teuthology.orchestra.run.trial093.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-23T06:53:10.740 INFO:teuthology.orchestra.run.trial058.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-23T06:53:11.276 INFO:teuthology.orchestra.run.trial058.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-23T06:53:12.159 INFO:teuthology.orchestra.run.trial093.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2026-02-23T06:53:12.600 INFO:teuthology.orchestra.run.trial093.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2026-02-23T06:53:12.602 INFO:teuthology.orchestra.run.trial093.stderr: 2026-02-23T06:53:12.602 INFO:teuthology.orchestra.run.trial093.stderr:real 0m31.811s 2026-02-23T06:53:12.602 INFO:teuthology.orchestra.run.trial093.stderr:user 1m55.374s 2026-02-23T06:53:12.602 INFO:teuthology.orchestra.run.trial093.stderr:sys 0m4.909s 2026-02-23T06:53:15.557 INFO:teuthology.orchestra.run.trial058.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-23T06:53:15.560 INFO:teuthology.orchestra.run.trial058.stderr: 2026-02-23T06:53:15.560 INFO:teuthology.orchestra.run.trial058.stderr:real 0m34.785s 2026-02-23T06:53:15.560 INFO:teuthology.orchestra.run.trial058.stderr:user 1m45.438s 2026-02-23T06:53:15.560 INFO:teuthology.orchestra.run.trial058.stderr:sys 0m11.318s 2026-02-23T06:53:15.561 INFO:tasks.ceph:Archiving logs... 2026-02-23T06:53:15.561 DEBUG:teuthology.misc:Transferring archived files from trial058:/var/log/ceph to /home/teuthworker/mnt/teuthology/vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial/64975/remote/trial058/log 2026-02-23T06:53:15.563 DEBUG:teuthology.orchestra.run.trial058:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-23T06:53:24.688 DEBUG:teuthology.misc:Transferring archived files from trial093:/var/log/ceph to /home/teuthworker/mnt/teuthology/vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial/64975/remote/trial093/log 2026-02-23T06:53:24.688 DEBUG:teuthology.orchestra.run.trial093:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-23T06:53:34.416 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-23T06:53:34.423 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-23T06:53:34.424 DEBUG:teuthology.orchestra.run.trial058:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-23T06:53:34.428 DEBUG:teuthology.orchestra.run.trial093:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-23T06:53:34.605 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-23T06:53:34.616 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-23T06:53:34.616 DEBUG:teuthology.orchestra.run.trial058:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-23T06:53:34.620 DEBUG:teuthology.orchestra.run.trial093:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-23T06:53:34.636 INFO:teuthology.orchestra.run.trial093.stderr:bash: line 1: ntpq: command not found 2026-02-23T06:53:34.653 INFO:teuthology.orchestra.run.trial058.stderr:bash: line 1: ntpq: command not found 2026-02-23T06:53:34.663 INFO:teuthology.orchestra.run.trial093.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-23T06:53:34.663 INFO:teuthology.orchestra.run.trial093.stdout:=============================================================================== 2026-02-23T06:53:34.663 INFO:teuthology.orchestra.run.trial093.stdout:^* 144.202.62.209.vultruser> 3 6 377 35 +5841us[+5801us] +/- 19ms 2026-02-23T06:53:34.663 INFO:teuthology.orchestra.run.trial093.stdout:^+ t1.time.bf1.yahoo.com 2 8 377 33 -28ms[ -28ms] +/- 42ms 2026-02-23T06:53:34.663 INFO:teuthology.orchestra.run.trial093.stdout:^+ ntp6.kernfusion.at 2 7 377 101 +6639us[+6682us] +/- 46ms 2026-02-23T06:53:34.663 INFO:teuthology.orchestra.run.trial093.stdout:^+ perturb.org 2 8 377 165 +9373us[+9651us] +/- 51ms 2026-02-23T06:53:34.669 INFO:teuthology.orchestra.run.trial058.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-23T06:53:34.669 INFO:teuthology.orchestra.run.trial058.stdout:=============================================================================== 2026-02-23T06:53:34.669 INFO:teuthology.orchestra.run.trial058.stdout:^* 144.202.62.209.vultruser> 3 6 377 34 +6151us[+6142us] +/- 19ms 2026-02-23T06:53:34.669 INFO:teuthology.orchestra.run.trial058.stdout:^+ t1.time.bf1.yahoo.com 2 6 377 34 -28ms[ -28ms] +/- 42ms 2026-02-23T06:53:34.669 INFO:teuthology.orchestra.run.trial058.stdout:^+ ntp6.kernfusion.at 2 6 377 32 +7096us[+7096us] +/- 46ms 2026-02-23T06:53:34.669 INFO:teuthology.orchestra.run.trial058.stdout:^+ perturb.org 2 7 377 34 +9721us[+9712us] +/- 51ms 2026-02-23T06:53:34.670 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-23T06:53:34.681 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-23T06:53:34.681 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-23T06:53:34.690 DEBUG:teuthology.orchestra.run.trial058:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-23T06:53:34.833 DEBUG:teuthology.orchestra.run.trial093:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-23T06:53:34.888 DEBUG:teuthology.orchestra.run.trial058:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-23T06:53:34.950 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T06:53:34.951 DEBUG:teuthology.orchestra.run.trial093:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-23T06:53:34.979 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T06:53:34.980 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-23T06:53:34.995 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-23T06:53:35.011 INFO:teuthology.task.internal:Duration was 2271.856113 seconds 2026-02-23T06:53:35.011 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-23T06:53:35.028 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-23T06:53:35.028 DEBUG:teuthology.orchestra.run.trial058:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-23T06:53:35.032 DEBUG:teuthology.orchestra.run.trial093:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-23T06:53:35.069 INFO:teuthology.orchestra.run.trial093.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-23T06:53:35.114 INFO:teuthology.orchestra.run.trial058.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-23T06:53:35.546 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-23T06:53:35.546 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial058.front.sepia.ceph.com 2026-02-23T06:53:35.547 DEBUG:teuthology.orchestra.run.trial058:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-23T06:53:35.591 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial093.front.sepia.ceph.com 2026-02-23T06:53:35.592 DEBUG:teuthology.orchestra.run.trial093:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-23T06:53:35.612 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-23T06:53:35.612 DEBUG:teuthology.orchestra.run.trial058:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-23T06:53:35.616 DEBUG:teuthology.orchestra.run.trial093:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-23T06:53:35.767 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-23T06:53:35.768 DEBUG:teuthology.orchestra.run.trial058:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-23T06:53:35.772 DEBUG:teuthology.orchestra.run.trial093:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-23T06:53:35.798 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-23T06:53:35.798 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-23T06:53:35.798 INFO:teuthology.orchestra.run.trial093.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-23T06:53:35.798 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-23T06:53:35.798 INFO:teuthology.orchestra.run.trial093.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-23T06:53:35.808 INFO:teuthology.orchestra.run.trial093.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 84.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-23T06:53:35.823 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-23T06:53:35.823 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-23T06:53:35.825 INFO:teuthology.orchestra.run.trial058.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-23T06:53:35.825 INFO:teuthology.orchestra.run.trial058.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-23T06:53:35.825 INFO:teuthology.orchestra.run.trial058.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-23T06:53:35.844 INFO:teuthology.orchestra.run.trial058.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 91.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-23T06:53:35.848 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-23T06:53:35.865 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-23T06:53:35.865 DEBUG:teuthology.orchestra.run.trial058:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-23T06:53:35.923 DEBUG:teuthology.orchestra.run.trial093:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-23T06:53:35.949 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-23T06:53:35.966 DEBUG:teuthology.orchestra.run.trial058:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-23T06:53:35.971 DEBUG:teuthology.orchestra.run.trial093:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-23T06:53:36.012 INFO:teuthology.orchestra.run.trial093.stdout:kernel.core_pattern = core 2026-02-23T06:53:36.041 INFO:teuthology.orchestra.run.trial058.stdout:kernel.core_pattern = core 2026-02-23T06:53:36.067 DEBUG:teuthology.orchestra.run.trial058:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-23T06:53:36.105 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T06:53:36.106 DEBUG:teuthology.orchestra.run.trial093:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-23T06:53:36.122 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T06:53:36.123 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-23T06:53:36.140 INFO:teuthology.task.internal:Transferring archived files... 2026-02-23T06:53:36.141 DEBUG:teuthology.misc:Transferring archived files from trial058:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial/64975/remote/trial058 2026-02-23T06:53:36.142 DEBUG:teuthology.orchestra.run.trial058:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-23T06:53:36.218 DEBUG:teuthology.misc:Transferring archived files from trial093:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial/64975/remote/trial093 2026-02-23T06:53:36.218 DEBUG:teuthology.orchestra.run.trial093:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-23T06:53:36.255 INFO:teuthology.task.internal:Removing archive directory... 2026-02-23T06:53:36.255 DEBUG:teuthology.orchestra.run.trial058:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-23T06:53:36.258 DEBUG:teuthology.orchestra.run.trial093:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-23T06:53:36.303 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-23T06:53:36.313 INFO:teuthology.task.internal:Not uploading archives. 2026-02-23T06:53:36.313 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-23T06:53:36.324 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-23T06:53:36.324 DEBUG:teuthology.orchestra.run.trial058:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-23T06:53:36.338 DEBUG:teuthology.orchestra.run.trial093:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-23T06:53:36.359 INFO:teuthology.orchestra.run.trial093.stdout: 917521 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 23 06:53 /home/ubuntu/cephtest 2026-02-23T06:53:36.373 INFO:teuthology.orchestra.run.trial058.stdout: 1048605 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 23 06:53 /home/ubuntu/cephtest 2026-02-23T06:53:36.376 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-23T06:53:36.401 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-23T06:53:36.447 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8dec4b357aab872d3b63ec979924962a64be83dd description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_entire_dirfrags/no prefetch_oft_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} duration: 2271.8561129570007 flavor: default owner: scheduled_vshankar@soko04.front.sepia.ceph.com success: true 2026-02-23T06:53:36.447 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T06:53:36.573 INFO:teuthology.run:pass